2023-10-08T15:49:08.241 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-08T15:49:08.241 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299 --verbose --name yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi --owner scheduled_yuriw@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} -- /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/orig.config.yaml 2023-10-08T15:49:08.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T15:49:08.359 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7418299' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-07-1508-quincy sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 owner: scheduled_yuriw@teuthology priority: 74 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 8174 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-07-1508-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: abf19fc7a04fe4fceab4e98d4013ae1da7c06006 targets: smithi012.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSkqEekuv48eEViEh/hZX5CTaaT7iF+B/2QetvIcodglzyMmHjjeTQrGGJ0mfaWgRgghq4SWSW5oD7HokWaGKI= smithi029.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlrEluFPAewIEV+F/mxYeLr3pAqlh5o5h8DmueNzXHleLpXz6BOCyvMVla7cIzyZi/+j9wnJXYXUmGsYTDq2d0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-08_15:41:30 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-08T15:49:08.359 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa; will attempt to use it 2023-10-08T15:49:08.360 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa/tasks 2023-10-08T15:49:08.360 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-08T15:49:08.362 INFO:teuthology.task.internal:Checking packages... 2023-10-08T15:49:08.385 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-08T15:49:08.385 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-08T15:49:08.385 INFO:teuthology.packaging:ref: None 2023-10-08T15:49:08.385 INFO:teuthology.packaging:tag: None 2023-10-08T15:49:08.385 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:49:08.385 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T15:49:08.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-08T15:49:08.542 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-08T15:49:08.542 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-08T15:49:08.549 INFO:teuthology.task.internal:no buildpackages task found 2023-10-08T15:49:08.549 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-08T15:49:08.594 INFO:teuthology.task.internal:Saving configuration 2023-10-08T15:49:08.609 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-08T15:49:08.618 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T15:49:08.644 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:39.832299', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSkqEekuv48eEViEh/hZX5CTaaT7iF+B/2QetvIcodglzyMmHjjeTQrGGJ0mfaWgRgghq4SWSW5oD7HokWaGKI='} 2023-10-08T15:49:08.668 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:39.833820', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlrEluFPAewIEV+F/mxYeLr3pAqlh5o5h8DmueNzXHleLpXz6BOCyvMVla7cIzyZi/+j9wnJXYXUmGsYTDq2d0='} 2023-10-08T15:49:08.668 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-08T15:49:08.674 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-08T15:49:08.674 INFO:teuthology.task.internal:roles: ubuntu@smithi029.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-08T15:49:08.674 INFO:teuthology.run_tasks:Running task console_log... 2023-10-08T15:49:08.768 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49e7f8fb80>, signals=[15]) 2023-10-08T15:49:08.768 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-08T15:49:08.774 INFO:teuthology.task.internal:Opening connections... 2023-10-08T15:49:08.774 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T15:49:08.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:49:08.843 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T15:49:08.844 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:49:08.911 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-08T15:49:08.917 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-10-08T15:49:08.938 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-10-08T15:49:08.938 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-10-08T15:49:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:49:08.995 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:ID="rhel" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE="fedora" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="8.4" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:ANSI_COLOR="0;31" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:49:08.996 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:49:08.997 INFO:teuthology.orchestra.run.smithi012.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:49:08.998 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-10-08T15:49:09.017 DEBUG:teuthology.orchestra.run.smithi029:> uname -m 2023-10-08T15:49:09.034 INFO:teuthology.orchestra.run.smithi029.stdout:x86_64 2023-10-08T15:49:09.035 DEBUG:teuthology.orchestra.run.smithi029:> cat /etc/os-release 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:NAME="Red Hat Enterprise Linux" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION="8.4 (Ootpa)" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:ID="rhel" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:ID_LIKE="fedora" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:VERSION_ID="8.4" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:PLATFORM_ID="platform:el8" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-08T15:49:09.092 INFO:teuthology.orchestra.run.smithi029.stdout:ANSI_COLOR="0;31" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:HOME_URL="https://www.redhat.com/" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-08T15:49:09.093 INFO:teuthology.orchestra.run.smithi029.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-08T15:49:09.093 INFO:teuthology.lock.ops:Updating smithi029.front.sepia.ceph.com on lock server 2023-10-08T15:49:09.117 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-08T15:49:09.126 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-08T15:49:09.144 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-08T15:49:09.145 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:49:09.147 DEBUG:teuthology.orchestra.run.smithi029:> test '!' -e /home/ubuntu/cephtest 2023-10-08T15:49:09.164 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-08T15:49:09.169 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-08T15:49:09.169 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:49:09.203 DEBUG:teuthology.orchestra.run.smithi029:> test -z $(ls -A /var/lib/ceph) 2023-10-08T15:49:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:49:09.221 INFO:teuthology.orchestra.run.smithi029.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-08T15:49:09.222 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-08T15:49:09.276 INFO:teuthology.run_tasks:Running task kernel... 2023-10-08T15:49:09.290 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-10-08T15:49:09.290 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-10-08T15:49:09.290 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-10-08T15:49:09.290 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:49:09.291 DEBUG:teuthology.orchestra.run.smithi029:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-08T15:49:09.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:49:09.307 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:49:09.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-08T15:49:09.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-10-08T15:49:09.481 DEBUG:teuthology.task.kernel:sha1 for client.0 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:09.482 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-08T15:49:09.482 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-08T15:49:09.499 INFO:teuthology.orchestra.run.smithi012.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:49:09.499 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:09.500 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-08T15:49:09.500 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum upgrade -y linux-firmware 2023-10-08T15:49:09.550 DEBUG:teuthology.task.kernel:sha1 for client.1 is fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:09.550 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c"... 2023-10-08T15:49:09.550 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-08T15:49:09.567 INFO:teuthology.orchestra.run.smithi029.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-08T15:49:09.567 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-305.25.1.el8_4.x86_64 vs fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:09.567 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-08T15:49:09.567 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum upgrade -y linux-firmware 2023-10-08T15:49:10.904 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-10-08T15:49:10.905 INFO:teuthology.orchestra.run.smithi012.stdout:Unable to read consumer identity 2023-10-08T15:49:11.695 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T15:49:11.695 INFO:teuthology.orchestra.run.smithi029.stdout:Unable to read consumer identity 2023-10-08T15:49:12.401 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-10-08T15:49:13.022 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-08T15:49:14.704 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-10-08T15:49:15.212 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 35 MB/s | 16 MB 00:00 2023-10-08T15:49:16.493 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-08T15:49:17.411 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-08T15:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout:Nothing to do. 2023-10-08T15:49:17.412 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-08T15:49:17.527 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T15:49:17.528 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:17.678 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-08T15:49:17.678 DEBUG:teuthology.orchestra.run.smithi012:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-08T15:49:17.680 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi012.front.sepia.ceph.com to complete... 2023-10-08T15:49:18.954 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-08T15:49:19.967 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-08T15:49:19.968 INFO:teuthology.orchestra.run.smithi029.stdout:Nothing to do. 2023-10-08T15:49:19.968 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-08T15:49:20.089 INFO:teuthology.task.kernel:Downloading kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-08T15:49:20.090 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c 2023-10-08T15:49:20.245 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ 2023-10-08T15:49:20.245 DEBUG:teuthology.orchestra.run.smithi029:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/ --input-file=- 2023-10-08T15:49:20.247 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi029.front.sepia.ceph.com to complete... 2023-10-08T15:49:34.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08 15:49:34 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-08T15:49:34.484 INFO:teuthology.orchestra.run.smithi012.stderr:FINISHED --2023-10-08 15:49:34-- 2023-10-08T15:49:34.484 INFO:teuthology.orchestra.run.smithi012.stderr:Total wall clock time: 17s 2023-10-08T15:49:34.484 INFO:teuthology.orchestra.run.smithi012.stderr:Downloaded: 1 files, 363M in 17s (22.0 MB/s) 2023-10-08T15:49:34.485 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.0... 2023-10-08T15:49:34.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-08T15:49:36.314 INFO:teuthology.orchestra.run.smithi012.stdout:Verifying... ######################################## 2023-10-08T15:49:36.719 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing... ######################################## 2023-10-08T15:49:36.842 INFO:teuthology.orchestra.run.smithi012.stdout:Updating / installing... 2023-10-08T15:49:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08 15:49:44 URL:https://3.chacra.ceph.com/r/kernel/testing/fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c/centos/8/flavors/default/x86_64/kernel-6.5.0_rc7_gfef64f93da2b-1.x86_64.rpm [380759012/380759012] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-08T15:49:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:FINISHED --2023-10-08 15:49:44-- 2023-10-08T15:49:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:Total wall clock time: 24s 2023-10-08T15:49:44.184 INFO:teuthology.orchestra.run.smithi029.stderr:Downloaded: 1 files, 363M in 23s (15.6 MB/s) 2023-10-08T15:49:44.185 INFO:teuthology.task.kernel:Installing kernel fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c on client.1... 2023-10-08T15:49:44.186 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-08T15:49:46.811 INFO:teuthology.orchestra.run.smithi029.stdout:Verifying... ######################################## 2023-10-08T15:49:51.126 INFO:teuthology.orchestra.run.smithi029.stdout:Preparing... ######################################## 2023-10-08T15:49:51.283 INFO:teuthology.orchestra.run.smithi029.stdout:Updating / installing... 2023-10-08T15:50:17.249 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-08T15:50:31.848 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-6.5.0_rc7_gfef64f93da2b-1 ######################################## 2023-10-08T15:50:41.445 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-08T15:50:41.445 DEBUG:teuthology.orchestra.run.smithi012:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-08T15:50:41.503 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.503 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-08T15:50:41.504 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-08T15:50:41.505 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-08T15:50:41.506 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-08T15:50:41.507 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-08T15:50:41.508 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-08T15:50:41.509 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-08T15:50:41.510 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-08T15:50:41.511 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-08T15:50:41.512 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-08T15:50:41.513 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-08T15:50:41.514 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-08T15:50:41.515 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-08T15:50:41.516 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-08T15:50:41.517 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-08T15:50:41.518 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-08T15:50:41.519 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-08T15:50:41.520 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-08T15:50:41.521 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-08T15:50:41.522 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-08T15:50:41.523 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-08T15:50:41.524 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-08T15:50:41.525 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-08T15:50:41.526 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-08T15:50:41.527 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-08T15:50:41.528 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-08T15:50:41.529 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-08T15:50:41.530 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-08T15:50:41.531 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-08T15:50:41.532 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-08T15:50:41.533 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-08T15:50:41.534 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-08T15:50:41.535 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-08T15:50:41.536 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-08T15:50:41.537 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-08T15:50:41.538 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-08T15:50:41.539 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-08T15:50:41.540 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-08T15:50:41.541 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-08T15:50:41.542 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-08T15:50:41.543 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-08T15:50:41.544 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-08T15:50:41.545 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-08T15:50:41.546 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-08T15:50:41.547 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-08T15:50:41.548 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-08T15:50:41.549 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-08T15:50:41.550 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-08T15:50:41.551 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-08T15:50:41.552 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-08T15:50:41.553 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-08T15:50:41.554 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-08T15:50:41.555 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-08T15:50:41.556 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-08T15:50:41.557 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-08T15:50:41.558 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-08T15:50:41.559 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-08T15:50:41.560 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-08T15:50:41.561 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-08T15:50:41.562 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-08T15:50:41.563 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-08T15:50:41.564 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-08T15:50:41.565 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-08T15:50:41.566 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-08T15:50:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-08T15:50:41.568 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-08T15:50:41.569 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-08T15:50:41.570 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-08T15:50:41.571 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-08T15:50:41.572 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-08T15:50:41.573 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-08T15:50:41.574 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-08T15:50:41.575 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-08T15:50:41.576 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-08T15:50:41.577 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-08T15:50:41.578 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-08T15:50:41.579 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-08T15:50:41.580 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-08T15:50:41.581 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-08T15:50:41.582 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-08T15:50:41.583 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-08T15:50:41.584 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-08T15:50:41.585 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-08T15:50:41.586 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-08T15:50:41.587 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-08T15:50:41.588 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-08T15:50:41.589 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-08T15:50:41.590 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-08T15:50:41.591 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-08T15:50:41.592 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-08T15:50:41.593 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-08T15:50:41.594 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-08T15:50:41.595 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-08T15:50:41.596 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-08T15:50:41.597 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-08T15:50:41.598 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-08T15:50:41.599 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-08T15:50:41.600 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-08T15:50:41.601 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-08T15:50:41.602 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-08T15:50:41.603 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-08T15:50:41.604 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-08T15:50:41.605 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-08T15:50:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-08T15:50:41.607 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-08T15:50:41.608 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-08T15:50:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-08T15:50:41.610 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-08T15:50:41.611 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-08T15:50:41.612 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-08T15:50:41.613 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-08T15:50:41.614 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-08T15:50:41.615 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-08T15:50:41.616 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-08T15:50:41.617 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-08T15:50:41.618 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-08T15:50:41.619 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-08T15:50:41.620 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-08T15:50:41.621 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-08T15:50:41.622 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-08T15:50:41.623 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-08T15:50:41.624 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-08T15:50:41.625 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-08T15:50:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-08T15:50:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-08T15:50:41.628 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-08T15:50:41.629 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-08T15:50:41.630 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-08T15:50:41.631 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-08T15:50:41.632 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-08T15:50:41.633 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-08T15:50:41.634 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-08T15:50:41.635 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-08T15:50:41.636 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-08T15:50:41.637 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-08T15:50:41.638 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-08T15:50:41.639 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-08T15:50:41.640 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-08T15:50:41.641 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-08T15:50:41.642 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-08T15:50:41.643 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-08T15:50:41.644 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-08T15:50:41.645 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-08T15:50:41.646 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-08T15:50:41.647 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-08T15:50:41.648 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-08T15:50:41.649 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-08T15:50:41.650 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-08T15:50:41.651 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-08T15:50:41.652 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-08T15:50:41.653 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-08T15:50:41.654 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-08T15:50:41.655 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-08T15:50:41.656 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-08T15:50:41.657 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-08T15:50:41.658 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-08T15:50:41.659 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-08T15:50:41.660 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-08T15:50:41.661 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-08T15:50:41.662 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-08T15:50:41.663 INFO:teuthology.orchestra.run.smithi012.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-08T15:50:41.664 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.664 DEBUG:teuthology.orchestra.run.smithi012:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-08T15:50:41.689 INFO:teuthology.orchestra.run.smithi012.stdout:postinstall scriptlet (using /bin/sh): 2023-10-08T15:50:41.689 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-08T15:50:41.689 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-08T15:50:41.690 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.691 INFO:teuthology.orchestra.run.smithi012.stdout:fi 2023-10-08T15:50:41.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo rpm -qi grub2-tools 2023-10-08T15:50:41.768 INFO:teuthology.orchestra.run.smithi012.stdout:Name : grub2-tools 2023-10-08T15:50:41.768 INFO:teuthology.orchestra.run.smithi012.stdout:Epoch : 1 2023-10-08T15:50:41.768 INFO:teuthology.orchestra.run.smithi012.stdout:Version : 2.02 2023-10-08T15:50:41.768 INFO:teuthology.orchestra.run.smithi012.stdout:Release : 99.el8_4.1 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: x86_64 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Group : System Environment/Base 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Size : 9264631 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:License : GPLv3+ 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:50:41.769 INFO:teuthology.orchestra.run.smithi012.stdout:Relocations : (not relocatable) 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:Packager : Red Hat, Inc. 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:Summary : Support tools for GRUB. 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:Description : 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:50:41.770 INFO:teuthology.orchestra.run.smithi012.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:50:41.771 INFO:teuthology.orchestra.run.smithi012.stdout:hardware devices. 2023-10-08T15:50:41.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T15:50:41.771 INFO:teuthology.orchestra.run.smithi012.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:50:41.772 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:50:41.772 INFO:teuthology.task.kernel:Updating grub on smithi012 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:41.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:50:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-10-08T15:50:47.402 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-10-08T15:50:47.404 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-08T15:50:47.418 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.Hei66wUieL 2023-10-08T15:50:47.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Hei66wUieL 2023-10-08T15:50:47.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.Hei66wUieL 2023-10-08T15:50:47.654 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.Hei66wUieL is 6KB 2023-10-08T15:50:47.702 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.Hei66wUieL 2023-10-08T15:50:47.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:50:47.788 INFO:teuthology.orchestra.run.smithi012.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:50:47.788 INFO:teuthology.orchestra.run.smithi012.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:50:47.788 INFO:teuthology.orchestra.run.smithi012.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:50:47.789 INFO:teuthology.orchestra.run.smithi012.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:50:47.789 INFO:teuthology.orchestra.run.smithi012.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-08T15:50:47.790 DEBUG:teuthology.orchestra.run.smithi012:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:50:47.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-10-08T15:51:15.473 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi029.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-08T15:51:15.473 DEBUG:teuthology.orchestra.run.smithi029:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-08T15:51:15.525 INFO:teuthology.orchestra.run.smithi029.stdout:/boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.525 INFO:teuthology.orchestra.run.smithi029.stdout:/boot/config-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.525 INFO:teuthology.orchestra.run.smithi029.stdout:/boot/vmlinuz-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.525 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.525 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-08T15:51:15.526 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-08T15:51:15.527 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/arch/x86/kvm/kvm.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ansi_cprng.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/anubis.ko 2023-10-08T15:51:15.528 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/arc4.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_pq.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_tx.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/async_xor.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/async_tx/raid6test.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authenc.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/authencesn.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blake2b_generic.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_common.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/blowfish_generic.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/camellia_generic.ko 2023-10-08T15:51:15.529 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast5_generic.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast6_generic.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cast_common.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/ccm.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cmac.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crc32_generic.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_engine.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/crypto_user.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/cts.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/des_generic.ko 2023-10-08T15:51:15.530 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/dh_generic.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/echainiv.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/essiv.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/fcrypt.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/khazad.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/lz4hc.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/md4.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/michael_mic.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcbc.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/pcrypt.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/rmd160.ko 2023-10-08T15:51:15.531 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/seed.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/serpent_generic.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tcrypt.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/tea.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_common.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/twofish_generic.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/vmac.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/wp512.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xcbc.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xor.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/crypto/xxhash_generic.ko 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers 2023-10-08T15:51:15.532 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/acpi_pad.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/custom_method.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/ec_sys.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/platform_profile.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbs.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/sbshc.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/acpi/video.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/acard-ahci.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ahci_platform.ko 2023-10-08T15:51:15.533 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/ata_generic.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/libahci_platform.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_acpi.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ali.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_amd.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_artop.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atiixp.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_atp867x.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd640.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_cypress.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_efar.ko 2023-10-08T15:51:15.534 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt366.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it8213.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_it821x.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_jmicron.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_marvell.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_mpiix.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_netcell.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ninja32.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87410.ko 2023-10-08T15:51:15.535 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_ns87415.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_opti.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_optidma.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_piccolo.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_rdc.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sch.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_serverworks.ko 2023-10-08T15:51:15.536 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sil680.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sis.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_triflex.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pata_via.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/pdc_adma.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_inic162x.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_mv.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_nv.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_promise.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_qstor.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil.ko 2023-10-08T15:51:15.537 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sil24.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sis.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_svw.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_sx4.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_uli.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_via.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ata/sata_vsc.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap 2023-10-08T15:51:15.538 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/bcma/bcma.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/aoe/aoe.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/brd.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/drbd/drbd.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/floppy.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/loop.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-08T15:51:15.539 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/nbd.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/pktcdvd.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/rbd.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/virtio_blk.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/xen-blkfront.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/block/zram/zram.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hangcheck-timer.ko 2023-10-08T15:51:15.540 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-08T15:51:15.541 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/lp.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/mwave/mwave.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/ppdev.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tlclk.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-08T15:51:15.542 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/uv_mmtimer.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/char/virtio_console.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp 2023-10-08T15:51:15.543 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-aes.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/padlock-sha.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-08T15:51:15.544 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dca/dca.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/amd64_edac.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/e752x_edac.ko 2023-10-08T15:51:15.545 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3000_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i3200_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5100_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i5400_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7300_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i7core_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/i82975x_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/ie31200_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/sb_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/edac/x38_edac.ko 2023-10-08T15:51:15.546 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/edd.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-ich.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-appleir.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-aureal.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-axff.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-dr.ko 2023-10-08T15:51:15.547 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elecom.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-elo.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-emsff.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gaff.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gt683r.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-gyration.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-holtekff.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-hyperv.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-icade.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-keytouch.ko 2023-10-08T15:51:15.548 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-kye.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lcpower.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-led.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-lenovo.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-multitouch.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-ortek.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-penmount.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-petalynx.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-picolcd.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-pl.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-plantronics.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-primax.ko 2023-10-08T15:51:15.549 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-rmi.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-08T15:51:15.550 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-roccat.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-saitek.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-samsung.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sjoy.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sony.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-speedlink.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-steelseries.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-sunplus.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tivo.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-tmff.ko 2023-10-08T15:51:15.551 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-topseed.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-twinhan.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-uclogic.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-waltop.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-wiimote.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-xinmo.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zpff.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/hid-zydacron.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/uhid.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hid/wacom.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_balloon.ko 2023-10-08T15:51:15.552 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_utils.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hv/hv_vmbus.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/abituguru3.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7414.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ad7418.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adc128d818.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1025.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1026.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1029.ko 2023-10-08T15:51:15.553 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm1031.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adm9240.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ads7828.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7410.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7411.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7462.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7470.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7475.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/adt7x10.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/amc6821.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/applesmc.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asb100.ko 2023-10-08T15:51:15.554 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asc7621.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/atxp1.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/coretemp.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/dme1737.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds1621.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ds620.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc1403.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/emc6w201.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71805f.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f71882fg.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/f75375s.ko 2023-10-08T15:51:15.555 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/fschmd.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g760a.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/g762.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl518sm.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/gl520sm.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmaem.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ibmpex.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina209.ko 2023-10-08T15:51:15.556 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ina2xx.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/it87.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k10temp.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/k8temp.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm63.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm73.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm75.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm77.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm78.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm80.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm83.ko 2023-10-08T15:51:15.557 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm85.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm87.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm90.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm92.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm93.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95234.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95241.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/lm95245.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc2945.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4151.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4215.ko 2023-10-08T15:51:15.558 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4222.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4245.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4260.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/ltc4261.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max16065.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1619.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max1668.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max197.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6639.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6650.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/max6697.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/mcp3021.ko 2023-10-08T15:51:15.559 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6683.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct6775.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/nct7802.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87360.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pc87427.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pcf8591.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-08T15:51:15.560 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/powr1220.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5627.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch5636.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht15.ko 2023-10-08T15:51:15.561 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sht21.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/shtc1.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/sis5595.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/thmc50.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp102.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp103.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp401.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/tmp421.ko 2023-10-08T15:51:15.562 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/via686a.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt1211.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/vt8231.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83627hf.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83781d.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83791d.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83792d.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83793.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83795.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-08T15:51:15.563 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-08T15:51:15.564 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-08T15:51:15.565 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-dev.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-mux.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/i2c/i2c-stub.ko 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband 2023-10-08T15:51:15.566 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4 2023-10-08T15:51:15.567 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-08T15:51:15.568 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/gameport.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/lightning.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/gameport/ns558.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/joydev.ko 2023-10-08T15:51:15.569 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/appletouch.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/sermouse.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-08T15:51:15.570 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/serio/serio_raw.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/input/sparse-keymap.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-blinkm.ko 2023-10-08T15:51:15.571 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lm3530.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-lp3944.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/leds-ss4200.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-08T15:51:15.572 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/bcache/bcache.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-bio-prison.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache-smq.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-cache.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-crypt.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-delay.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-flakey.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-log-userspace.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-multipath.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-queue-length.ko 2023-10-08T15:51:15.573 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-raid.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-round-robin.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-service-time.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-switch.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-thin-pool.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/dm-verity.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/faulty.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/linear.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/multipath.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-08T15:51:15.574 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid0.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid1.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid10.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/md/raid456.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptbase.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptctl.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptfc.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptlan.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptsas.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/message/fusion/mptspi.ko 2023-10-08T15:51:15.575 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_ich.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/lpc_sch.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/mfd-core.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/sm501.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/viperboard.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/vx855.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/mfd/wl1273-core.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds9802als.ko 2023-10-08T15:51:15.576 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/apds990x.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/bh1770glc.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/cb710/cb710.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/at24.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/enclosure.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/hpilo.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29003.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/isl29020.ko 2023-10-08T15:51:15.577 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-me.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/mei/mei.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-08T15:51:15.578 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tifm_core.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/tsl2550.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_balloon.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/bonding/bonding.ko 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53 2023-10-08T15:51:15.579 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/dummy.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/eql.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-08T15:51:15.580 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera 2023-10-08T15:51:15.581 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-08T15:51:15.582 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade 2023-10-08T15:51:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-08T15:51:15.584 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-08T15:51:15.585 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/dnet.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000 2023-10-08T15:51:15.586 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-08T15:51:15.587 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/jme.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox 2023-10-08T15:51:15.588 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-08T15:51:15.589 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-08T15:51:15.590 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker 2023-10-08T15:51:15.591 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-08T15:51:15.592 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-08T15:51:15.593 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/geneve.ko 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv 2023-10-08T15:51:15.594 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ifb.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvlan.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/macvtap.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-08T15:51:15.595 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/mii.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/net_failover.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/netconsole.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/nlmon.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/amd.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-08T15:51:15.596 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/broadcom.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/cicada.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/davicom.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/dp83640.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/et1011c.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/icplus.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/lxt.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/marvell.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/micrel.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/national.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/phylink.ko 2023-10-08T15:51:15.597 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/qsemi.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/realtek.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/smsc.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/phy/vitesse.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppoe.ko 2023-10-08T15:51:15.598 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pppox.ko 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/ppp/pptp.ko 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slhc.ko 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/slip/slip.ko 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/sungem_phy.ko 2023-10-08T15:51:15.599 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tap.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_random.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/tun.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/veth.ko 2023-10-08T15:51:15.601 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/virtio_net.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/net/xen-netfront.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ntb/ntb.ko 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host 2023-10-08T15:51:15.602 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/nvme/host/nvme.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_cs.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_pc.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/parport/parport_serial.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-08T15:51:15.603 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pci/xen-pcifront.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/i82092.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/pd6729.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-08T15:51:15.604 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/hdaps.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-08T15:51:15.605 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/platform/x86/wmi.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-08T15:51:15.606 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/pps/pps_core.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-08T15:51:15.607 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-bq4802.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-08T15:51:15.608 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-08T15:51:15.609 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-sas.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/BusLogic.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/a100u2w.ko 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid 2023-10-08T15:51:15.610 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/advansys.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/am53c974.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/atp870u.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa 2023-10-08T15:51:15.611 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ch.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-08T15:51:15.612 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dc395x.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/dmx3191d.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/esp_scsi.ko 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe 2023-10-08T15:51:15.613 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hpsa.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hptiop.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/initio.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ipr.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ips.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/isci/isci.ko 2023-10-08T15:51:15.614 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-08T15:51:15.615 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/mvumi.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/pmcraid.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla1280.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-08T15:51:15.616 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/raid_class.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_debug.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/ses.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/st.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/stex.ko 2023-10-08T15:51:15.617 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/scsi/wd719x.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ssb/ssb.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-08T15:51:15.618 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_file.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_iblock.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_mod.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_pscsi.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/target_core_user.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-08T15:51:15.619 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty 2023-10-08T15:51:15.620 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_gsm.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/n_hdlc.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/nozomi.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/tty/synclink_gt.ko 2023-10-08T15:51:15.621 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_aec.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_cif.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/uio/uio_sercos3.ko 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb 2023-10-08T15:51:15.622 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usblp.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/class/usbtmc.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/mdc800.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/image/microtek.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/adutux.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-08T15:51:15.623 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi26.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/emi62.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ezusb.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/idmouse.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/ldusb.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usb3503.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usblcd.ko 2023-10-08T15:51:15.624 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/uss720.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/misc/yurex.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/aircable.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ark3116.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ch341.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cp210x.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-08T15:51:15.625 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/empeg.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/io_ti.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipaq.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ipw.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-08T15:51:15.626 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7720.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/mos7840.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/navman.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/omninet.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/opticon.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/option.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/oti6858.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/pl2303.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcaux.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/qcserial.ko 2023-10-08T15:51:15.627 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/quatech2.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/sierra.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ssu100.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/visor.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-08T15:51:15.628 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/uas.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-08T15:51:15.629 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio.ko 2023-10-08T15:51:15.630 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_net.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/lcd.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio 2023-10-08T15:51:15.631 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/virtio/virtio_ring.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2482.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/masters/ds2490.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-08T15:51:15.632 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/w1/wire.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-08T15:51:15.633 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/hpwdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/i6300esb.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ibmasr.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/machzwd.ko 2023-10-08T15:51:15.634 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/nv_tco.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/softdog.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/via_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-08T15:51:15.635 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-evtchn.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-gntdev.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xen-privcmd.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p 2023-10-08T15:51:15.636 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/9p/9p.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/affs/affs.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/befs/befs.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/binfmt_misc.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/btrfs/btrfs.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cachefiles/cachefiles.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ceph/ceph.ko 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda 2023-10-08T15:51:15.637 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/coda/coda.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/cramfs/cramfs.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/dlm/dlm.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/f2fs/f2fs.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/fat.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/msdos.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fat/vfat.ko 2023-10-08T15:51:15.638 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fscache/fscache.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/cuse.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/fuse/fuse.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/gfs2/gfs2.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfs/hfs.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/hfsplus/hfsplus.ko 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs 2023-10-08T15:51:15.639 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/isofs/isofs.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/jfs/jfs.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/lockd/lockd.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/minix/minix.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/netfs/netfs.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout 2023-10-08T15:51:15.640 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfs.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv3.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs/nfsv4.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/grace.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nfsd/nfsd.ko 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2 2023-10-08T15:51:15.641 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nilfs2/nilfs2.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-celtic.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-centeuro.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-croatian.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-cyrillic.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-gaelic.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-greek.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-iceland.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-inuit.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-roman.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-romanian.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/mac-turkish.ko 2023-10-08T15:51:15.642 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1250.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1251.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp1255.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp737.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp775.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp850.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp852.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp855.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp857.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp860.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp861.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp862.ko 2023-10-08T15:51:15.643 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp863.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp864.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp865.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp866.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp869.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp874.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp932.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp936.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp949.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_cp950.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_euc-jp.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-08T15:51:15.644 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-r.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_koi8-u.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/nls/nls_utf8.ko 2023-10-08T15:51:15.645 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs 2023-10-08T15:51:15.646 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/overlayfs/overlay.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/pstore/ramoops.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/reiserfs/reiserfs.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/romfs/romfs.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/client/cifs.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/smb/common/cifs_md4.ko 2023-10-08T15:51:15.647 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/squashfs/squashfs.ko 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/sysv/sysv.ko 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/udf/udf.ko 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/ufs/ufs.ko 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/fs/xfs/xfs.ko 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu 2023-10-08T15:51:15.648 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/rcu/rcutorture.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/torture.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/asn1_encoder.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc-itu-t.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crc8.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libarc4.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/crypto/libdes.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/libcrc32c.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lru_cache.ko 2023-10-08T15:51:15.649 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4_compress.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/math/cordic.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/raid6/raid6_pq.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_bm.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_fsm.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/ts_kmp.ko 2023-10-08T15:51:15.650 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/lib/zstd/zstd_compress.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/mm/hwpoison-inject.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/6lowpan.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_dest.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_hop.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_routing.ko 2023-10-08T15:51:15.651 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/6lowpan/nhc_udp.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/garp.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/mrp.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/p8022.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/psnap.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/802/stp.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/8021q/8021q.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_fd.ko 2023-10-08T15:51:15.652 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_rdma.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/9p/9pnet_virtio.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/batman-adv/batman-adv.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/br_netfilter.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/bridge.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-08T15:51:15.653 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-08T15:51:15.654 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ceph/libceph.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/failover.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/core/pktgen.ko 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp 2023-10-08T15:51:15.655 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_diag.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv4.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dccp/dccp_ipv6.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/dsa_core.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_brcm.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_dsa.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_none.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/dsa/tag_trailer.ko 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154 2023-10-08T15:51:15.656 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ah4.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/esp4.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/fou.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/gre.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/inet_diag.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_gre.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_tunnel.ko 2023-10-08T15:51:15.657 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ip_vti.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipcomp.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/ipip.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-08T15:51:15.658 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_bic.ko 2023-10-08T15:51:15.659 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_diag.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_htcp.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_hybla.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_illinois.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_lp.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_scalable.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_vegas.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_veno.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_westwood.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tcp_yeah.ko 2023-10-08T15:51:15.660 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/tunnel4.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_diag.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/udp_tunnel.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ah6.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/esp6.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/fou6.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ip6_vti.ko 2023-10-08T15:51:15.661 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/ipcomp6.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-08T15:51:15.662 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-08T15:51:15.663 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/sit.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/tunnel6.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/key/af_key.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_core.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_eth.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-08T15:51:15.664 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/llc/llc.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mac802154/mac802154.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/mpls/mpls_gso.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-08T15:51:15.665 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-08T15:51:15.666 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-08T15:51:15.667 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conncount.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-08T15:51:15.668 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-08T15:51:15.669 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nf_tables.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_compat.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_ct.ko 2023-10-08T15:51:15.670 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fib.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_hash.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_limit.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_log.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_masq.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_nat.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_numgen.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_queue.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_quota.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_redir.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject.ko 2023-10-08T15:51:15.671 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_socket.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/nft_tunnel.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_CT.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_DSCP.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HL.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_HMARK.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LED.ko 2023-10-08T15:51:15.672 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_LOG.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TEE.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_TRACE.ko 2023-10-08T15:51:15.673 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_addrtype.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_bpf.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cgroup.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cluster.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_comment.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connbytes.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlabel.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connlimit.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_connmark.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_conntrack.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_cpu.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dccp.ko 2023-10-08T15:51:15.674 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_devgroup.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_dscp.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ecn.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_esp.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_helper.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_hl.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_iprange.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_ipvs.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_l2tp.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_length.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_limit.ko 2023-10-08T15:51:15.675 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mac.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_mark.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_multiport.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nat.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_nfacct.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_osf.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_owner.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_physdev.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_pkttype.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_policy.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_quota.ko 2023-10-08T15:51:15.676 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_rateest.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_realm.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_recent.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_sctp.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_set.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_socket.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_state.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_statistic.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_string.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_time.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netfilter/xt_u32.ko 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink 2023-10-08T15:51:15.677 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/netlink/netlink_diag.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/nsh/nsh.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/openvswitch.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-geneve.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-gre.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/packet/af_packet_diag.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds.ko 2023-10-08T15:51:15.678 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_rdma.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/rds/rds_tcp.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_csum.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_gact.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_ipt.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_mirred.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_nat.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_pedit.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_police.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_simple.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_skbedit.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/act_vlan.ko 2023-10-08T15:51:15.679 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_basic.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_bpf.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_flow.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_fw.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_route.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/cls_u32.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_cmp.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_ipset.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_meta.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_nbyte.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_text.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/em_u32.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_choke.ko 2023-10-08T15:51:15.680 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_codel.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_drr.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_fq.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_gred.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hfsc.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_hhf.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_htb.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_ingress.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_multiq.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_netem.ko 2023-10-08T15:51:15.681 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_pie.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_plug.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_prio.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_qfq.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_red.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfb.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_sfq.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_tbf.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sched/sch_teql.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sctp/sctp_diag.ko 2023-10-08T15:51:15.682 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/sunrpc.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/diag.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/tipc/tipc.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/unix/unix_diag.ko 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock 2023-10-08T15:51:15.683 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys 2023-10-08T15:51:15.684 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/kernel/virt/lib/irqbypass.ko 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.alias.bin 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.bin 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.builtin.modinfo 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.dep.bin 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.devname 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.order 2023-10-08T15:51:15.685 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.softdep 2023-10-08T15:51:15.686 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols 2023-10-08T15:51:15.686 INFO:teuthology.orchestra.run.smithi029.stdout:/lib/modules/6.5.0-rc7-gfef64f93da2b/modules.symbols.bin 2023-10-08T15:51:15.686 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.686 DEBUG:teuthology.orchestra.run.smithi029:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:postinstall scriptlet (using /bin/sh): 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b -a -r /boot/System.map-6.5.0-rc7-gfef64f93da2b ]; then 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:cp /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:cp /boot/System.map-6.5.0-rc7-gfef64f93da2b /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:rm -f /boot/vmlinuz-6.5.0-rc7-gfef64f93da2b /boot/System.map-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/installkernel 6.5.0-rc7-gfef64f93da2b /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:rm -f /boot/.vmlinuz-6.5.0-rc7-gfef64f93da2b-rpm /boot/.System.map-6.5.0-rc7-gfef64f93da2b-rpm 2023-10-08T15:51:15.709 INFO:teuthology.orchestra.run.smithi029.stdout:fi 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:new-kernel-pkg --remove 6.5.0-rc7-gfef64f93da2b --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc7-gfef64f93da2b.img 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:kernel-install remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:fi 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:/sbin/update-bootloader --remove 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.710 INFO:teuthology.orchestra.run.smithi029.stdout:fi 2023-10-08T15:51:15.711 DEBUG:teuthology.orchestra.run.smithi029:> sudo rpm -qi grub2-tools 2023-10-08T15:51:15.784 INFO:teuthology.orchestra.run.smithi029.stdout:Name : grub2-tools 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Epoch : 1 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Version : 2.02 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Release : 99.el8_4.1 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Architecture: x86_64 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Group : System Environment/Base 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Size : 9264631 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:License : GPLv3+ 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-08T15:51:15.785 INFO:teuthology.orchestra.run.smithi029.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Relocations : (not relocatable) 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Packager : Red Hat, Inc. 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Vendor : Red Hat, Inc. 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Summary : Support tools for GRUB. 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:Description : 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-08T15:51:15.786 INFO:teuthology.orchestra.run.smithi029.stdout:hardware devices. 2023-10-08T15:51:15.787 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T15:51:15.787 INFO:teuthology.orchestra.run.smithi029.stdout:This subpackage provides tools for support of all platforms. 2023-10-08T15:51:15.787 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-08T15:51:15.788 INFO:teuthology.task.kernel:Updating grub on smithi029 to boot 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:15.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-08T15:51:16.789 INFO:teuthology.orchestra.run.smithi029.stderr:Generating grub configuration file ... 2023-10-08T15:51:17.953 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-08T15:51:17.953 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T15:51:17.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:19.595 INFO:teuthology.orchestra.run.smithi029.stderr:done 2023-10-08T15:51:19.596 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-08T15:51:19.621 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.U27HnQXBIs 2023-10-08T15:51:19.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U27HnQXBIs 2023-10-08T15:51:19.697 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.U27HnQXBIs 2023-10-08T15:51:19.855 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.U27HnQXBIs is 6KB 2023-10-08T15:51:19.904 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.U27HnQXBIs 2023-10-08T15:51:19.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo /bin/ls /boot/loader/entries || true 2023-10-08T15:51:19.979 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-08T15:51:19.979 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-08T15:51:19.979 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-08T15:51:19.980 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-08T15:51:19.980 INFO:teuthology.orchestra.run.smithi029.stdout:298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b.conf 2023-10-08T15:51:19.981 DEBUG:teuthology.orchestra.run.smithi029:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-6.5.0-rc7-gfef64f93da2b 2023-10-08T15:51:20.182 DEBUG:teuthology.orchestra.run.smithi029:> sudo shutdown -r now 2023-10-08T15:51:36.314 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-08T15:51:45.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T15:51:45.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:51:50.186 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-08T15:51:50.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:51:50.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:03.706 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-08T15:52:08.570 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.29 2023-10-08T15:52:15.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T15:52:15.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:17.571 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:52:17.572 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:18.782 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-10-08T15:52:33.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T15:52:33.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:52:34.150 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-08T15:52:34.507 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T15:52:34.507 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-08T15:52:34.507 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-10-08T15:52:34.543 INFO:teuthology.orchestra.run.smithi012.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-08T15:52:34.543 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:52:34.543 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:52:34.543 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:52:35.544 DEBUG:teuthology.parallel:result is None 2023-10-08T15:53:17.574 DEBUG:teuthology.orchestra.remote:timed out 2023-10-08T15:53:29.575 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:53:29.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T15:53:29.979 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-08T15:53:30.415 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T15:53:30.416 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc7-gfef64f93da2b"... 2023-10-08T15:53:30.416 DEBUG:teuthology.orchestra.run.smithi029:> uname -r 2023-10-08T15:53:30.452 INFO:teuthology.orchestra.run.smithi029.stdout:6.5.0-rc7-gfef64f93da2b 2023-10-08T15:53:30.452 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc7-gfef64f93da2b vs 6.5.0-rc7-gfef64f93da2b 2023-10-08T15:53:30.452 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-08T15:53:30.453 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-08T15:53:31.454 DEBUG:teuthology.parallel:result is None 2023-10-08T15:53:31.454 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-08T15:53:31.462 INFO:teuthology.task.internal:Creating test directory... 2023-10-08T15:53:31.462 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:53:31.469 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-08T15:53:31.509 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-08T15:53:31.518 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-08T15:53:31.537 INFO:teuthology.task.internal:Creating archive directory... 2023-10-08T15:53:31.537 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:53:31.550 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-08T15:53:31.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-08T15:53:31.618 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-08T15:53:31.618 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:53:31.636 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-08T15:53:31.767 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:53:31.776 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:53:31.801 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:53:31.816 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-08T15:53:31.819 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-08T15:53:31.826 INFO:teuthology.task.internal:Configuring sudo... 2023-10-08T15:53:31.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:53:31.830 DEBUG:teuthology.orchestra.run.smithi029:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-08T15:53:31.893 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-08T15:53:31.902 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-08T15:53:31.902 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:53:31.906 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-08T15:53:31.942 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:53:32.043 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:53:32.140 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:53:32.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:53:32.280 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T15:53:32.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:53:32.353 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:53:32.419 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-08T15:53:32.524 DEBUG:teuthology.orchestra.run.smithi029:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:53:32.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-08T15:53:32.665 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T15:53:32.665 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-08T15:53:32.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-10-08T15:53:32.739 DEBUG:teuthology.orchestra.run.smithi029:> sudo service rsyslog restart 2023-10-08T15:53:32.843 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:53:32.887 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T15:53:33.290 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-08T15:53:33.298 INFO:teuthology.task.internal:Starting timer... 2023-10-08T15:53:33.299 INFO:teuthology.run_tasks:Running task pcp... 2023-10-08T15:53:33.349 INFO:teuthology.run_tasks:Running task selinux... 2023-10-08T15:53:33.380 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-08T15:53:33.381 DEBUG:teuthology.orchestra.run.smithi012:> sudo service auditd rotate 2023-10-08T15:53:33.514 INFO:teuthology.orchestra.run.smithi012.stdout:Rotating logs: [ OK ] 2023-10-08T15:53:33.518 DEBUG:teuthology.orchestra.run.smithi029:> sudo service auditd rotate 2023-10-08T15:53:33.652 INFO:teuthology.orchestra.run.smithi029.stdout:Rotating logs: [ OK ] 2023-10-08T15:53:33.655 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-08T15:53:33.655 DEBUG:teuthology.orchestra.run.smithi012:> /usr/sbin/getenforce 2023-10-08T15:53:33.695 INFO:teuthology.orchestra.run.smithi012.stdout:Permissive 2023-10-08T15:53:33.696 DEBUG:teuthology.orchestra.run.smithi029:> /usr/sbin/getenforce 2023-10-08T15:53:33.744 INFO:teuthology.orchestra.run.smithi029.stdout:Permissive 2023-10-08T15:53:33.745 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi012.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi029.front.sepia.ceph.com': 'permissive'} 2023-10-08T15:53:33.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:53:33.809 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:53:33.810 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T15:53:33.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T15:53:33.880 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-08T15:53:33.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:53:33.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo /usr/sbin/setenforce permissive 2023-10-08T15:53:34.015 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-08T15:53:34.024 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-08T15:53:34.024 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-08T15:53:34.042 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-08T15:53:34.043 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com,smithi029.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-08T16:05:44.063 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com'), Remote(name='ubuntu@smithi029.front.sepia.ceph.com')] 2023-10-08T16:05:44.064 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T16:05:44.065 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:05:44.154 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-10-08T16:05:44.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-10-08T16:05:44.258 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T16:05:44.258 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi029.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-08T16:05:44.348 DEBUG:teuthology.orchestra.run.smithi029:> true 2023-10-08T16:05:44.466 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi029.front.sepia.ceph.com' 2023-10-08T16:05:44.466 INFO:teuthology.run_tasks:Running task clock... 2023-10-08T16:05:44.475 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-08T16:05:44.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:05:44.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:05:44.481 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-08T16:05:44.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T16:05:44.546 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T16:05:44.574 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-08T16:05:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T16:05:44.609 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-08T16:05:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: ntpd: command not found 2023-10-08T16:05:44.671 INFO:teuthology.orchestra.run.smithi029.stderr:sudo: ntpd: command not found 2023-10-08T16:05:44.673 INFO:teuthology.orchestra.run.smithi012.stdout:506 Cannot talk to daemon 2023-10-08T16:05:44.698 INFO:teuthology.orchestra.run.smithi029.stdout:506 Cannot talk to daemon 2023-10-08T16:05:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T16:05:44.732 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-08T16:05:44.742 INFO:teuthology.orchestra.run.smithi012.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T16:05:44.767 INFO:teuthology.orchestra.run.smithi029.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-08T16:05:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:bash: ntpq: command not found 2023-10-08T16:05:44.836 INFO:teuthology.orchestra.run.smithi012.stdout:210 Number of sources = 4 2023-10-08T16:05:44.836 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:05:44.836 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-08T16:05:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.837 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.853 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-10-08T16:05:44.858 INFO:teuthology.orchestra.run.smithi029.stdout:210 Number of sources = 4 2023-10-08T16:05:44.858 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T16:05:44.858 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-10-08T16:05:44.858 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.858 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.859 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.859 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T16:05:44.860 INFO:teuthology.run_tasks:Running task install... 2023-10-08T16:05:44.867 DEBUG:teuthology.task.install:project ceph 2023-10-08T16:05:44.868 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-08T16:05:44.868 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-08T16:05:44.868 INFO:teuthology.task.install:Using flavor: default 2023-10-08T16:05:44.874 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-08T16:05:44.874 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-08T16:05:44.874 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T16:05:44.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:05:44.877 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-08T16:05:44.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:05:45.024 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T16:05:45.024 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T16:05:45.048 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-08T16:05:45.049 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-08T16:05:45.190 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T16:05:45.191 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:05:45.191 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T16:05:45.254 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T16:05:45.254 DEBUG:teuthology.orchestra.run.smithi012:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T16:05:45.267 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-08T16:05:45.267 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:05:45.267 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-08T16:05:45.332 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-08T16:05:45.332 DEBUG:teuthology.orchestra.run.smithi029:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-08T16:05:45.357 DEBUG:teuthology.orchestra.run.smithi012:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T16:05:45.436 DEBUG:teuthology.orchestra.run.smithi029:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-08T16:05:45.447 DEBUG:teuthology.orchestra.run.smithi012:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T16:05:45.508 INFO:teuthology.orchestra.run.smithi012.stdout:check_obsoletes = 1 2023-10-08T16:05:45.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum clean all 2023-10-08T16:05:45.526 DEBUG:teuthology.orchestra.run.smithi029:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-08T16:05:45.587 INFO:teuthology.orchestra.run.smithi029.stdout:check_obsoletes = 1 2023-10-08T16:05:45.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum clean all 2023-10-08T16:05:46.005 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-10-08T16:05:46.087 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T16:05:46.510 INFO:teuthology.orchestra.run.smithi012.stdout:44 files removed 2023-10-08T16:05:46.561 INFO:teuthology.orchestra.run.smithi029.stdout:44 files removed 2023-10-08T16:05:46.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T16:05:46.620 DEBUG:teuthology.orchestra.run.smithi029:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-08T16:05:47.066 INFO:teuthology.orchestra.run.smithi012.stdout:Updating Subscription Management repositories. 2023-10-08T16:05:47.114 INFO:teuthology.orchestra.run.smithi029.stdout:Updating Subscription Management repositories. 2023-10-08T16:05:47.847 INFO:teuthology.orchestra.run.smithi029.stdout:ceph packages for x86_64 354 kB/s | 78 kB 00:00 2023-10-08T16:05:47.910 INFO:teuthology.orchestra.run.smithi012.stdout:ceph packages for x86_64 232 kB/s | 78 kB 00:00 2023-10-08T16:05:48.141 INFO:teuthology.orchestra.run.smithi029.stdout:ceph noarch packages 37 kB/s | 9.2 kB 00:00 2023-10-08T16:05:48.261 INFO:teuthology.orchestra.run.smithi012.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-08T16:05:48.422 INFO:teuthology.orchestra.run.smithi029.stdout:ceph source packages 5.9 kB/s | 1.5 kB 00:00 2023-10-08T16:05:48.536 INFO:teuthology.orchestra.run.smithi029.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-08T16:05:48.540 INFO:teuthology.orchestra.run.smithi012.stdout:ceph source packages 6.0 kB/s | 1.5 kB 00:00 2023-10-08T16:05:48.655 INFO:teuthology.orchestra.run.smithi012.stdout:Copr repo for python3-asyncssh owned by ceph 42 kB/s | 3.5 kB 00:00 2023-10-08T16:05:49.123 INFO:teuthology.orchestra.run.smithi029.stdout:Extra Packages for Enterprise Linux 29 MB/s | 16 MB 00:00 2023-10-08T16:05:50.649 INFO:teuthology.orchestra.run.smithi012.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 16 MB 00:01 2023-10-08T16:05:52.859 INFO:teuthology.orchestra.run.smithi029.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2023-10-08T16:05:53.382 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 76 MB/s | 33 MB 00:00 2023-10-08T16:05:54.381 INFO:teuthology.orchestra.run.smithi012.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-08T16:05:54.940 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 81 MB/s | 38 MB 00:00 2023-10-08T16:05:59.352 INFO:teuthology.orchestra.run.smithi029.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 MB/s | 38 MB 00:00 2023-10-08T16:06:01.201 INFO:teuthology.orchestra.run.smithi012.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 78 MB/s | 33 MB 00:00 2023-10-08T16:06:08.704 INFO:teuthology.orchestra.run.smithi029.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:06:08.705 INFO:teuthology.orchestra.run.smithi029.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:06:08.716 INFO:teuthology.orchestra.run.smithi029.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T16:06:08.717 INFO:teuthology.orchestra.run.smithi029.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T16:06:08.718 INFO:teuthology.orchestra.run.smithi029.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T16:06:08.719 INFO:teuthology.orchestra.run.smithi029.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T16:06:08.721 INFO:teuthology.orchestra.run.smithi029.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T16:06:08.726 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T16:06:08.726 INFO:teuthology.orchestra.run.smithi029.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T16:06:09.267 INFO:teuthology.orchestra.run.smithi029.stdout:Dependencies resolved. 2023-10-08T16:06:09.279 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T16:06:09.279 INFO:teuthology.orchestra.run.smithi029.stdout: Package Arch Version Repository Size 2023-10-08T16:06:09.279 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T16:06:09.279 INFO:teuthology.orchestra.run.smithi029.stdout:Installing: 2023-10-08T16:06:09.279 INFO:teuthology.orchestra.run.smithi029.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T16:06:09.280 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T16:06:09.281 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrading: 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T16:06:09.282 INFO:teuthology.orchestra.run.smithi029.stdout:Installing dependencies: 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T16:06:09.283 INFO:teuthology.orchestra.run.smithi029.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T16:06:09.284 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T16:06:09.285 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T16:06:09.286 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T16:06:09.287 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T16:06:09.288 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T16:06:09.289 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction Summary 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout:====================================================================================================================== 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout:Install 118 Packages 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout:Upgrade 2 Packages 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:06:09.290 INFO:teuthology.orchestra.run.smithi029.stdout:Total download size: 202 M 2023-10-08T16:06:09.291 INFO:teuthology.orchestra.run.smithi029.stdout:Downloading Packages: 2023-10-08T16:06:09.560 INFO:teuthology.orchestra.run.smithi029.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-08T16:06:09.730 INFO:teuthology.orchestra.run.smithi029.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 5.0 MB/s | 876 kB 00:00 2023-10-08T16:06:09.765 INFO:teuthology.orchestra.run.smithi029.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 4.5 MB/s | 162 kB 00:00 2023-10-08T16:06:10.055 INFO:teuthology.orchestra.run.smithi029.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 8.0 MB/s | 2.3 MB 00:00 2023-10-08T16:06:10.097 INFO:teuthology.orchestra.run.smithi012.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:06:10.098 INFO:teuthology.orchestra.run.smithi012.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-08T16:06:10.110 INFO:teuthology.orchestra.run.smithi012.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-08T16:06:10.111 INFO:teuthology.orchestra.run.smithi012.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-08T16:06:10.111 INFO:teuthology.orchestra.run.smithi012.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-08T16:06:10.112 INFO:teuthology.orchestra.run.smithi012.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-08T16:06:10.114 INFO:teuthology.orchestra.run.smithi012.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-08T16:06:10.117 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-08T16:06:10.118 INFO:teuthology.orchestra.run.smithi012.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-08T16:06:10.235 INFO:teuthology.orchestra.run.smithi029.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 8.8 MB/s | 1.6 MB 00:00 2023-10-08T16:06:10.650 INFO:teuthology.orchestra.run.smithi012.stdout:Dependencies resolved. 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================================================== 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: Package Arch Version Repository Size 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================================================== 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout:Installing: 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-08T16:06:10.663 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-08T16:06:10.664 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-08T16:06:10.665 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-08T16:06:10.666 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrading: 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout:Installing dependencies: 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-08T16:06:10.667 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-08T16:06:10.668 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-08T16:06:10.669 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-08T16:06:10.670 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-08T16:06:10.671 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-08T16:06:10.672 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-08T16:06:10.673 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-08T16:06:10.674 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction Summary 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:====================================================================================================================== 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:Install 118 Packages 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout:Upgrade 2 Packages 2023-10-08T16:06:10.675 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:06:10.676 INFO:teuthology.orchestra.run.smithi029.stdout:(6/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 9.1 MB/s | 3.9 MB 00:00 2023-10-08T16:06:10.676 INFO:teuthology.orchestra.run.smithi012.stdout:Total download size: 202 M 2023-10-08T16:06:10.676 INFO:teuthology.orchestra.run.smithi012.stdout:Downloading Packages: 2023-10-08T16:06:10.969 INFO:teuthology.orchestra.run.smithi029.stdout:(7/120): ceph-common-17.2.6-1320.g08cac018.el8. 16 MB/s | 23 MB 00:01 2023-10-08T16:06:11.305 INFO:teuthology.orchestra.run.smithi012.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 23 kB/s | 6.4 kB 00:00 2023-10-08T16:06:12.049 INFO:teuthology.orchestra.run.smithi012.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.1 MB/s | 876 kB 00:00 2023-10-08T16:06:12.097 INFO:teuthology.orchestra.run.smithi029.stdout:(8/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 15 MB/s | 17 MB 00:01 2023-10-08T16:06:12.099 INFO:teuthology.orchestra.run.smithi012.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 3.2 MB/s | 162 kB 00:00 2023-10-08T16:06:12.124 INFO:teuthology.orchestra.run.smithi029.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 913 kB/s | 24 kB 00:00 2023-10-08T16:06:12.550 INFO:teuthology.orchestra.run.smithi029.stdout:(10/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 8.9 MB/s | 17 MB 00:01 2023-10-08T16:06:12.614 INFO:teuthology.orchestra.run.smithi029.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 3.9 MB/s | 255 kB 00:00 2023-10-08T16:06:12.672 INFO:teuthology.orchestra.run.smithi029.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 434 kB/s | 25 kB 00:00 2023-10-08T16:06:12.814 INFO:teuthology.orchestra.run.smithi029.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.5 MB/s | 797 kB 00:00 2023-10-08T16:06:12.880 INFO:teuthology.orchestra.run.smithi029.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 2.6 MB/s | 174 kB 00:00 2023-10-08T16:06:12.944 INFO:teuthology.orchestra.run.smithi029.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 2.0 MB/s | 130 kB 00:00 2023-10-08T16:06:13.023 INFO:teuthology.orchestra.run.smithi029.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 6.3 MB/s | 507 kB 00:00 2023-10-08T16:06:13.104 INFO:teuthology.orchestra.run.smithi029.stdout:(17/120): ceph-base-17.2.6-1320.g08cac018.el8.x 1.4 MB/s | 5.2 MB 00:03 2023-10-08T16:06:13.200 INFO:teuthology.orchestra.run.smithi029.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 470 kB/s | 45 kB 00:00 2023-10-08T16:06:13.383 INFO:teuthology.orchestra.run.smithi012.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 1.8 MB/s | 2.3 MB 00:01 2023-10-08T16:06:13.889 INFO:teuthology.orchestra.run.smithi029.stdout:(19/120): librgw2-17.2.6-1320.g08cac018.el8.x86 6.4 MB/s | 5.6 MB 00:00 2023-10-08T16:06:13.940 INFO:teuthology.orchestra.run.smithi029.stdout:(20/120): python3-ceph-common-17.2.6-1320.g08ca 156 kB/s | 115 kB 00:00 2023-10-08T16:06:13.945 INFO:teuthology.orchestra.run.smithi029.stdout:(21/120): python3-cephfs-17.2.6-1320.g08cac018. 3.4 MB/s | 190 kB 00:00 2023-10-08T16:06:14.011 INFO:teuthology.orchestra.run.smithi029.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 5.4 MB/s | 358 kB 00:00 2023-10-08T16:06:14.064 INFO:teuthology.orchestra.run.smithi029.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.0 MB/s | 107 kB 00:00 2023-10-08T16:06:14.081 INFO:teuthology.orchestra.run.smithi012.stdout:(5/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 1.7 MB/s | 5.2 MB 00:03 2023-10-08T16:06:14.110 INFO:teuthology.orchestra.run.smithi029.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 1.9 MB/s | 90 kB 00:00 2023-10-08T16:06:14.133 INFO:teuthology.orchestra.run.smithi012.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 2.1 MB/s | 1.6 MB 00:00 2023-10-08T16:06:14.205 INFO:teuthology.orchestra.run.smithi029.stdout:(25/120): python3-rados-17.2.6-1320.g08cac018.e 1.4 MB/s | 371 kB 00:00 2023-10-08T16:06:14.364 INFO:teuthology.orchestra.run.smithi029.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 1.1 MB/s | 173 kB 00:00 2023-10-08T16:06:14.442 INFO:teuthology.orchestra.run.smithi029.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 296 kB/s | 23 kB 00:00 2023-10-08T16:06:14.599 INFO:teuthology.orchestra.run.smithi029.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 776 kB/s | 121 kB 00:00 2023-10-08T16:06:14.702 INFO:teuthology.orchestra.run.smithi029.stdout:(29/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 5.8 MB/s | 3.5 MB 00:00 2023-10-08T16:06:15.744 INFO:teuthology.orchestra.run.smithi012.stdout:(7/120): ceph-common-17.2.6-1320.g08cac018.el8. 5.0 MB/s | 23 MB 00:04 2023-10-08T16:06:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:(8/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 2.3 MB/s | 3.9 MB 00:01 2023-10-08T16:06:15.846 INFO:teuthology.orchestra.run.smithi029.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 1.4 MB/s | 1.7 MB 00:01 2023-10-08T16:06:15.871 INFO:teuthology.orchestra.run.smithi012.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 286 kB/s | 24 kB 00:00 2023-10-08T16:06:15.928 INFO:teuthology.orchestra.run.smithi029.stdout:(31/120): ceph-mgr-diskprediction-local-17.2.6- 6.0 MB/s | 7.4 MB 00:01 2023-10-08T16:06:15.972 INFO:teuthology.orchestra.run.smithi029.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 1.1 MB/s | 47 kB 00:00 2023-10-08T16:06:16.023 INFO:teuthology.orchestra.run.smithi029.stdout:(33/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.3 MB/s | 238 kB 00:00 2023-10-08T16:06:16.024 INFO:teuthology.orchestra.run.smithi029.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1320.g0 278 kB/s | 14 kB 00:00 2023-10-08T16:06:16.087 INFO:teuthology.orchestra.run.smithi029.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-08T16:06:16.143 INFO:teuthology.orchestra.run.smithi029.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 324 kB/s | 18 kB 00:00 2023-10-08T16:06:16.238 INFO:teuthology.orchestra.run.smithi029.stdout:(37/120): ceph-volume-17.2.6-1320.g08cac018.el8 1.2 MB/s | 267 kB 00:00 2023-10-08T16:06:16.482 INFO:teuthology.orchestra.run.smithi029.stdout:(38/120): ceph-test-17.2.6-1320.g08cac018.el8.x 12 MB/s | 52 MB 00:04 2023-10-08T16:06:16.644 INFO:teuthology.orchestra.run.smithi029.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 612 kB/s | 306 kB 00:00 2023-10-08T16:06:16.689 INFO:teuthology.orchestra.run.smithi029.stdout:(40/120): liboath-2.6.2-3.el8.x86_64.rpm 130 kB/s | 59 kB 00:00 2023-10-08T16:06:16.752 INFO:teuthology.orchestra.run.smithi029.stdout:(41/120): libunwind-1.3.1-3.el8.x86_64.rpm 284 kB/s | 75 kB 00:00 2023-10-08T16:06:16.757 INFO:teuthology.orchestra.run.smithi029.stdout:(42/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 645 kB/s | 44 kB 00:00 2023-10-08T16:06:16.759 INFO:teuthology.orchestra.run.smithi029.stdout:(43/120): python3-asyncssh-2.7.0-2.el8.noarch.r 4.0 MB/s | 476 kB 00:00 2023-10-08T16:06:16.807 INFO:teuthology.orchestra.run.smithi029.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 669 kB/s | 33 kB 00:00 2023-10-08T16:06:16.815 INFO:teuthology.orchestra.run.smithi029.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 295 kB/s | 16 kB 00:00 2023-10-08T16:06:16.866 INFO:teuthology.orchestra.run.smithi029.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-10-08T16:06:16.883 INFO:teuthology.orchestra.run.smithi029.stdout:(47/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-10-08T16:06:16.919 INFO:teuthology.orchestra.run.smithi029.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.5 MB/s | 81 kB 00:00 2023-10-08T16:06:16.934 INFO:teuthology.orchestra.run.smithi029.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 220 kB/s | 11 kB 00:00 2023-10-08T16:06:16.969 INFO:teuthology.orchestra.run.smithi029.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 354 kB/s | 18 kB 00:00 2023-10-08T16:06:16.985 INFO:teuthology.orchestra.run.smithi029.stdout:(51/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.2 MB/s | 384 kB 00:00 2023-10-08T16:06:17.020 INFO:teuthology.orchestra.run.smithi029.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 959 kB/s | 49 kB 00:00 2023-10-08T16:06:17.023 INFO:teuthology.orchestra.run.smithi012.stdout:(10/120): ceph-radosgw-17.2.6-1320.g08cac018.el 13 MB/s | 17 MB 00:01 2023-10-08T16:06:17.037 INFO:teuthology.orchestra.run.smithi029.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-10-08T16:06:17.047 INFO:teuthology.orchestra.run.smithi012.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 11 MB/s | 255 kB 00:00 2023-10-08T16:06:17.070 INFO:teuthology.orchestra.run.smithi012.stdout:(12/120): libcephfs-devel-17.2.6-1320.g08cac018 1.1 MB/s | 25 kB 00:00 2023-10-08T16:06:17.096 INFO:teuthology.orchestra.run.smithi029.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 804 kB/s | 60 kB 00:00 2023-10-08T16:06:17.121 INFO:teuthology.orchestra.run.smithi029.stdout:(55/120): python3-kubernetes-11.0.0-6.el8.noarc 6.2 MB/s | 1.2 MB 00:00 2023-10-08T16:06:17.123 INFO:teuthology.orchestra.run.smithi029.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.2 MB/s | 283 kB 00:00 2023-10-08T16:06:17.126 INFO:teuthology.orchestra.run.smithi012.stdout:(13/120): libcephfs2-17.2.6-1320.g08cac018.el8. 14 MB/s | 797 kB 00:00 2023-10-08T16:06:17.148 INFO:teuthology.orchestra.run.smithi012.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 7.6 MB/s | 174 kB 00:00 2023-10-08T16:06:17.171 INFO:teuthology.orchestra.run.smithi012.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 5.8 MB/s | 130 kB 00:00 2023-10-08T16:06:17.214 INFO:teuthology.orchestra.run.smithi012.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 12 MB/s | 507 kB 00:00 2023-10-08T16:06:17.279 INFO:teuthology.orchestra.run.smithi029.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 1.2 MB/s | 196 kB 00:00 2023-10-08T16:06:17.284 INFO:teuthology.orchestra.run.smithi029.stdout:(58/120): python3-portend-2.6-1.el8.noarch.rpm 83 kB/s | 16 kB 00:00 2023-10-08T16:06:17.299 INFO:teuthology.orchestra.run.smithi029.stdout:(59/120): python3-repoze-lru-0.7-6.el8.noarch.r 189 kB/s | 34 kB 00:00 2023-10-08T16:06:17.337 INFO:teuthology.orchestra.run.smithi029.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 357 kB/s | 19 kB 00:00 2023-10-08T16:06:17.347 INFO:teuthology.orchestra.run.smithi029.stdout:(61/120): python3-rsa-4.9-2.el8.noarch.rpm 935 kB/s | 64 kB 00:00 2023-10-08T16:06:17.353 INFO:teuthology.orchestra.run.smithi029.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 448 kB/s | 24 kB 00:00 2023-10-08T16:06:17.390 INFO:teuthology.orchestra.run.smithi029.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 554 kB/s | 29 kB 00:00 2023-10-08T16:06:17.548 INFO:teuthology.orchestra.run.smithi012.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 17 MB/s | 5.6 MB 00:00 2023-10-08T16:06:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 2.0 MB/s | 45 kB 00:00 2023-10-08T16:06:17.593 INFO:teuthology.orchestra.run.smithi012.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 5.2 MB/s | 115 kB 00:00 2023-10-08T16:06:17.615 INFO:teuthology.orchestra.run.smithi012.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 8.2 MB/s | 190 kB 00:00 2023-10-08T16:06:17.640 INFO:teuthology.orchestra.run.smithi012.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 15 MB/s | 371 kB 00:00 2023-10-08T16:06:17.651 INFO:teuthology.orchestra.run.smithi029.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 857 kB/s | 255 kB 00:00 2023-10-08T16:06:17.665 INFO:teuthology.orchestra.run.smithi012.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 14 MB/s | 358 kB 00:00 2023-10-08T16:06:17.687 INFO:teuthology.orchestra.run.smithi012.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 4.7 MB/s | 107 kB 00:00 2023-10-08T16:06:17.709 INFO:teuthology.orchestra.run.smithi012.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 90 kB 00:00 2023-10-08T16:06:17.745 INFO:teuthology.orchestra.run.smithi029.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 652 kB/s | 61 kB 00:00 2023-10-08T16:06:17.759 INFO:teuthology.orchestra.run.smithi029.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 681 kB/s | 251 kB 00:00 2023-10-08T16:06:17.929 INFO:teuthology.orchestra.run.smithi012.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 16 MB/s | 3.5 MB 00:00 2023-10-08T16:06:17.951 INFO:teuthology.orchestra.run.smithi012.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 7.5 MB/s | 173 kB 00:00 2023-10-08T16:06:17.972 INFO:teuthology.orchestra.run.smithi012.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.1 MB/s | 23 kB 00:00 2023-10-08T16:06:17.994 INFO:teuthology.orchestra.run.smithi012.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.5 MB/s | 121 kB 00:00 2023-10-08T16:06:18.016 INFO:teuthology.orchestra.run.smithi029.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 316 kB/s | 85 kB 00:00 2023-10-08T16:06:18.083 INFO:teuthology.orchestra.run.smithi029.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 71 kB/s | 23 kB 00:00 2023-10-08T16:06:18.089 INFO:teuthology.orchestra.run.smithi029.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-08T16:06:18.144 INFO:teuthology.orchestra.run.smithi012.stdout:(29/120): ceph-osd-17.2.6-1320.g08cac018.el8.x8 4.2 MB/s | 17 MB 00:04 2023-10-08T16:06:18.152 INFO:teuthology.orchestra.run.smithi012.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 11 MB/s | 1.7 MB 00:00 2023-10-08T16:06:18.176 INFO:teuthology.orchestra.run.smithi012.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 10 MB/s | 238 kB 00:00 2023-10-08T16:06:18.197 INFO:teuthology.orchestra.run.smithi012.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 2.2 MB/s | 47 kB 00:00 2023-10-08T16:06:18.218 INFO:teuthology.orchestra.run.smithi012.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 699 kB/s | 14 kB 00:00 2023-10-08T16:06:18.242 INFO:teuthology.orchestra.run.smithi012.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 11 MB/s | 267 kB 00:00 2023-10-08T16:06:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 3.7 MB/s | 80 kB 00:00 2023-10-08T16:06:18.308 INFO:teuthology.orchestra.run.smithi012.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 852 kB/s | 18 kB 00:00 2023-10-08T16:06:18.385 INFO:teuthology.orchestra.run.smithi029.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 49 MB/s | 15 MB 00:00 2023-10-08T16:06:18.402 INFO:teuthology.orchestra.run.smithi029.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2023-10-08T16:06:18.417 INFO:teuthology.orchestra.run.smithi029.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.7 MB/s | 27 kB 00:00 2023-10-08T16:06:18.435 INFO:teuthology.orchestra.run.smithi029.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.3 MB/s | 161 kB 00:00 2023-10-08T16:06:18.435 INFO:teuthology.orchestra.run.smithi012.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 2.0 MB/s | 306 kB 00:00 2023-10-08T16:06:18.455 INFO:teuthology.orchestra.run.smithi029.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-08T16:06:18.456 INFO:teuthology.orchestra.run.smithi012.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 2.7 MB/s | 59 kB 00:00 2023-10-08T16:06:18.475 INFO:teuthology.orchestra.run.smithi029.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2023-10-08T16:06:18.478 INFO:teuthology.orchestra.run.smithi012.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 3.5 MB/s | 75 kB 00:00 2023-10-08T16:06:18.521 INFO:teuthology.orchestra.run.smithi012.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 11 MB/s | 476 kB 00:00 2023-10-08T16:06:18.542 INFO:teuthology.orchestra.run.smithi012.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2023-10-08T16:06:18.565 INFO:teuthology.orchestra.run.smithi012.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 7.9 MB/s | 185 kB 00:00 2023-10-08T16:06:18.573 INFO:teuthology.orchestra.run.smithi029.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 49 MB/s | 4.8 MB 00:00 2023-10-08T16:06:18.587 INFO:teuthology.orchestra.run.smithi012.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.5 MB/s | 33 kB 00:00 2023-10-08T16:06:18.587 INFO:teuthology.orchestra.run.smithi029.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.7 MB/s | 39 kB 00:00 2023-10-08T16:06:18.608 INFO:teuthology.orchestra.run.smithi012.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 796 kB/s | 16 kB 00:00 2023-10-08T16:06:18.611 INFO:teuthology.orchestra.run.smithi029.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2023-10-08T16:06:18.627 INFO:teuthology.orchestra.run.smithi029.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-08T16:06:18.631 INFO:teuthology.orchestra.run.smithi012.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 7.2 MB/s | 173 kB 00:00 2023-10-08T16:06:18.644 INFO:teuthology.orchestra.run.smithi029.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 13 MB/s | 225 kB 00:00 2023-10-08T16:06:18.658 INFO:teuthology.orchestra.run.smithi012.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 14 MB/s | 384 kB 00:00 2023-10-08T16:06:18.658 INFO:teuthology.orchestra.run.smithi029.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.0 MB/s | 126 kB 00:00 2023-10-08T16:06:18.679 INFO:teuthology.orchestra.run.smithi012.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 3.7 MB/s | 81 kB 00:00 2023-10-08T16:06:18.692 INFO:teuthology.orchestra.run.smithi029.stdout:(82/120): python3-trustme-0.6.0-4.el8.noarch.rp 20 kB/s | 27 kB 00:01 2023-10-08T16:06:18.700 INFO:teuthology.orchestra.run.smithi012.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 548 kB/s | 11 kB 00:00 2023-10-08T16:06:18.721 INFO:teuthology.orchestra.run.smithi012.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 861 kB/s | 18 kB 00:00 2023-10-08T16:06:18.725 INFO:teuthology.orchestra.run.smithi029.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 5.6 MB/s | 187 kB 00:00 2023-10-08T16:06:18.747 INFO:teuthology.orchestra.run.smithi029.stdout:(84/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 42 MB/s | 3.7 MB 00:00 2023-10-08T16:06:18.757 INFO:teuthology.orchestra.run.smithi029.stdout:(85/120): python3-jinja2-2.10.1-2.el8_0.noarch. 17 MB/s | 538 kB 00:00 2023-10-08T16:06:18.765 INFO:teuthology.orchestra.run.smithi029.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 17 MB/s | 302 kB 00:00 2023-10-08T16:06:18.770 INFO:teuthology.orchestra.run.smithi012.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 24 MB/s | 1.2 MB 00:00 2023-10-08T16:06:18.772 INFO:teuthology.orchestra.run.smithi029.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.9 MB/s | 157 kB 00:00 2023-10-08T16:06:18.780 INFO:teuthology.orchestra.run.smithi029.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 6.9 MB/s | 110 kB 00:00 2023-10-08T16:06:18.791 INFO:teuthology.orchestra.run.smithi029.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 19 MB/s | 353 kB 00:00 2023-10-08T16:06:18.792 INFO:teuthology.orchestra.run.smithi012.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 2.2 MB/s | 49 kB 00:00 2023-10-08T16:06:18.798 INFO:teuthology.orchestra.run.smithi029.stdout:(90/120): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-10-08T16:06:18.799 INFO:teuthology.orchestra.run.smithi029.stdout:(91/120): python3-jsonpointer-1.10-11.el8.noarc 1.0 MB/s | 20 kB 00:00 2023-10-08T16:06:18.814 INFO:teuthology.orchestra.run.smithi012.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 2.7 MB/s | 59 kB 00:00 2023-10-08T16:06:18.828 INFO:teuthology.orchestra.run.smithi029.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 1.8 MB/s | 54 kB 00:00 2023-10-08T16:06:18.831 INFO:teuthology.orchestra.run.smithi029.stdout:(93/120): libtool-2.4.6-25.el8.x86_64.rpm 17 MB/s | 709 kB 00:00 2023-10-08T16:06:18.835 INFO:teuthology.orchestra.run.smithi012.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 2.8 MB/s | 60 kB 00:00 2023-10-08T16:06:18.859 INFO:teuthology.orchestra.run.smithi012.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 11 MB/s | 283 kB 00:00 2023-10-08T16:06:18.864 INFO:teuthology.orchestra.run.smithi029.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 22 MB/s | 713 kB 00:00 2023-10-08T16:06:18.878 INFO:teuthology.orchestra.run.smithi029.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.3 MB/s | 19 kB 00:00 2023-10-08T16:06:18.891 INFO:teuthology.orchestra.run.smithi029.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.2 MB/s | 43 kB 00:00 2023-10-08T16:06:18.898 INFO:teuthology.orchestra.run.smithi012.stdout:(55/120): ceph-mgr-diskprediction-local-17.2.6- 9.8 MB/s | 7.4 MB 00:00 2023-10-08T16:06:18.899 INFO:teuthology.orchestra.run.smithi012.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 399 kB/s | 16 kB 00:00 2023-10-08T16:06:18.907 INFO:teuthology.orchestra.run.smithi029.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.7 MB/s | 155 kB 00:00 2023-10-08T16:06:18.927 INFO:teuthology.orchestra.run.smithi012.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 6.9 MB/s | 196 kB 00:00 2023-10-08T16:06:18.933 INFO:teuthology.orchestra.run.smithi029.stdout:(98/120): openblas-threads-0.3.12-1.el8.x86_64. 35 MB/s | 4.7 MB 00:00 2023-10-08T16:06:18.939 INFO:teuthology.orchestra.run.smithi029.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 6.9 MB/s | 220 kB 00:00 2023-10-08T16:06:18.947 INFO:teuthology.orchestra.run.smithi029.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.5 MB/s | 48 kB 00:00 2023-10-08T16:06:18.948 INFO:teuthology.orchestra.run.smithi012.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.0 MB/s | 64 kB 00:00 2023-10-08T16:06:18.969 INFO:teuthology.orchestra.run.smithi012.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 915 kB/s | 19 kB 00:00 2023-10-08T16:06:18.969 INFO:teuthology.orchestra.run.smithi029.stdout:(101/120): openblas-0.3.12-1.el8.x86_64.rpm 32 MB/s | 4.6 MB 00:00 2023-10-08T16:06:18.971 INFO:teuthology.orchestra.run.smithi029.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 1.7 MB/s | 43 kB 00:00 2023-10-08T16:06:18.973 INFO:teuthology.orchestra.run.smithi029.stdout:(103/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.6 MB/s | 229 kB 00:00 2023-10-08T16:06:18.990 INFO:teuthology.orchestra.run.smithi012.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 1.1 MB/s | 24 kB 00:00 2023-10-08T16:06:18.995 INFO:teuthology.orchestra.run.smithi012.stdout:(61/120): python3-repoze-lru-0.7-6.el8.noarch.r 348 kB/s | 34 kB 00:00 2023-10-08T16:06:18.996 INFO:teuthology.orchestra.run.smithi029.stdout:(104/120): libverto-devel-0.3.0-5.el8.x86_64.rp 738 kB/s | 18 kB 00:00 2023-10-08T16:06:19.001 INFO:teuthology.orchestra.run.smithi029.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 21 MB/s | 605 kB 00:00 2023-10-08T16:06:19.010 INFO:teuthology.orchestra.run.smithi029.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 5.7 MB/s | 83 kB 00:00 2023-10-08T16:06:19.010 INFO:teuthology.orchestra.run.smithi012.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.4 MB/s | 29 kB 00:00 2023-10-08T16:06:19.015 INFO:teuthology.orchestra.run.smithi029.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.1 MB/s | 59 kB 00:00 2023-10-08T16:06:19.018 INFO:teuthology.orchestra.run.smithi012.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.2 MB/s | 27 kB 00:00 2023-10-08T16:06:19.027 INFO:teuthology.orchestra.run.smithi029.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.9 MB/s | 169 kB 00:00 2023-10-08T16:06:19.028 INFO:teuthology.orchestra.run.smithi029.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.9 MB/s | 38 kB 00:00 2023-10-08T16:06:19.035 INFO:teuthology.orchestra.run.smithi012.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 10 MB/s | 255 kB 00:00 2023-10-08T16:06:19.041 INFO:teuthology.orchestra.run.smithi029.stdout:(110/120): openssl-devel-1.1.1g-15.el8_3.x86_64 33 MB/s | 2.3 MB 00:00 2023-10-08T16:06:19.043 INFO:teuthology.orchestra.run.smithi029.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.0 MB/s | 58 kB 00:00 2023-10-08T16:06:19.044 INFO:teuthology.orchestra.run.smithi029.stdout:(112/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.1 MB/s | 86 kB 00:00 2023-10-08T16:06:19.055 INFO:teuthology.orchestra.run.smithi029.stdout:(113/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.2 MB/s | 47 kB 00:00 2023-10-08T16:06:19.056 INFO:teuthology.orchestra.run.smithi012.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 2.9 MB/s | 61 kB 00:00 2023-10-08T16:06:19.069 INFO:teuthology.orchestra.run.smithi029.stdout:(114/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 21 MB/s | 559 kB 00:00 2023-10-08T16:06:19.071 INFO:teuthology.orchestra.run.smithi029.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.5 MB/s | 70 kB 00:00 2023-10-08T16:06:19.074 INFO:teuthology.orchestra.run.smithi029.stdout:(116/120): libgfortran-8.4.1-1.el8.x86_64.rpm 21 MB/s | 639 kB 00:00 2023-10-08T16:06:19.078 INFO:teuthology.orchestra.run.smithi012.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 3.8 MB/s | 85 kB 00:00 2023-10-08T16:06:19.085 INFO:teuthology.orchestra.run.smithi029.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-10-08T16:06:19.085 INFO:teuthology.orchestra.run.smithi012.stdout:(67/120): python3-webob-1.8.5-1.el8.1.noarch.rp 3.7 MB/s | 251 kB 00:00 2023-10-08T16:06:19.086 INFO:teuthology.orchestra.run.smithi029.stdout:(118/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.3 MB/s | 97 kB 00:00 2023-10-08T16:06:19.099 INFO:teuthology.orchestra.run.smithi012.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2023-10-08T16:06:19.104 INFO:teuthology.orchestra.run.smithi012.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-08T16:06:19.134 INFO:teuthology.orchestra.run.smithi012.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 623 kB/s | 19 kB 00:00 2023-10-08T16:06:19.146 INFO:teuthology.orchestra.run.smithi012.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.4 MB/s | 43 kB 00:00 2023-10-08T16:06:19.162 INFO:teuthology.orchestra.run.smithi012.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 9.7 MB/s | 155 kB 00:00 2023-10-08T16:06:19.171 INFO:teuthology.orchestra.run.smithi012.stdout:(73/120): thrift-0.13.0-2.el8.x86_64.rpm 20 MB/s | 1.7 MB 00:00 2023-10-08T16:06:19.177 INFO:teuthology.orchestra.run.smithi012.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 15 MB/s | 220 kB 00:00 2023-10-08T16:06:19.193 INFO:teuthology.orchestra.run.smithi012.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-08T16:06:19.202 INFO:teuthology.orchestra.run.smithi012.stdout:(76/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.5 MB/s | 48 kB 00:00 2023-10-08T16:06:19.207 INFO:teuthology.orchestra.run.smithi012.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 3.1 MB/s | 43 kB 00:00 2023-10-08T16:06:19.221 INFO:teuthology.orchestra.run.smithi012.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.3 MB/s | 18 kB 00:00 2023-10-08T16:06:19.247 INFO:teuthology.orchestra.run.smithi012.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 23 MB/s | 605 kB 00:00 2023-10-08T16:06:19.263 INFO:teuthology.orchestra.run.smithi012.stdout:(80/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 38 MB/s | 2.3 MB 00:00 2023-10-08T16:06:19.265 INFO:teuthology.orchestra.run.smithi012.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 4.5 MB/s | 83 kB 00:00 2023-10-08T16:06:19.276 INFO:teuthology.orchestra.run.smithi012.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 4.3 MB/s | 59 kB 00:00 2023-10-08T16:06:19.281 INFO:teuthology.orchestra.run.smithi012.stdout:(83/120): libquadmath-8.4.1-1.el8.x86_64.rpm 10 MB/s | 169 kB 00:00 2023-10-08T16:06:19.290 INFO:teuthology.orchestra.run.smithi012.stdout:(84/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.8 MB/s | 38 kB 00:00 2023-10-08T16:06:19.296 INFO:teuthology.orchestra.run.smithi012.stdout:(85/120): libsepol-devel-2.9-2.el8.x86_64.rpm 6.0 MB/s | 86 kB 00:00 2023-10-08T16:06:19.304 INFO:teuthology.orchestra.run.smithi012.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-08T16:06:19.311 INFO:teuthology.orchestra.run.smithi012.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.1 MB/s | 47 kB 00:00 2023-10-08T16:06:19.329 INFO:teuthology.orchestra.run.smithi012.stdout:(88/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 22 MB/s | 559 kB 00:00 2023-10-08T16:06:19.339 INFO:teuthology.orchestra.run.smithi012.stdout:(89/120): libgfortran-8.4.1-1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2023-10-08T16:06:19.344 INFO:teuthology.orchestra.run.smithi012.stdout:(90/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.8 MB/s | 70 kB 00:00 2023-10-08T16:06:19.356 INFO:teuthology.orchestra.run.smithi012.stdout:(91/120): libselinux-devel-2.9-5.el8.x86_64.rpm 11 MB/s | 200 kB 00:00 2023-10-08T16:06:19.358 INFO:teuthology.orchestra.run.smithi029.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 12 MB/s | 3.5 MB 00:00 2023-10-08T16:06:19.358 INFO:teuthology.orchestra.run.smithi012.stdout:(92/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 6.7 MB/s | 97 kB 00:00 2023-10-08T16:06:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-08T16:06:19.384 INFO:teuthology.orchestra.run.smithi012.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-08T16:06:19.399 INFO:teuthology.orchestra.run.smithi012.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-08T16:06:19.418 INFO:teuthology.orchestra.run.smithi012.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-08T16:06:19.441 INFO:teuthology.orchestra.run.smithi012.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 20 MB/s | 457 kB 00:00 2023-10-08T16:06:19.569 INFO:teuthology.orchestra.run.smithi012.stdout:(98/120): python3-babel-2.5.1-5.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-10-08T16:06:19.581 INFO:teuthology.orchestra.run.smithi012.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-08T16:06:19.609 INFO:teuthology.orchestra.run.smithi012.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-08T16:06:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-08T16:06:19.646 INFO:teuthology.orchestra.run.smithi012.stdout:(102/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-08T16:06:19.700 INFO:teuthology.orchestra.run.smithi012.stdout:(103/120): python3-scipy-1.0.0-20.module+el8.1. 42 MB/s | 15 MB 00:00 2023-10-08T16:06:19.704 INFO:teuthology.orchestra.run.smithi012.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.2 MB/s | 126 kB 00:00 2023-10-08T16:06:19.720 INFO:teuthology.orchestra.run.smithi012.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 11 MB/s | 187 kB 00:00 2023-10-08T16:06:19.744 INFO:teuthology.orchestra.run.smithi012.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 23 MB/s | 538 kB 00:00 2023-10-08T16:06:19.763 INFO:teuthology.orchestra.run.smithi012.stdout:(107/120): socat-1.7.3.3-2.el8.x86_64.rpm 15 MB/s | 302 kB 00:00 2023-10-08T16:06:19.779 INFO:teuthology.orchestra.run.smithi012.stdout:(108/120): python3-mako-1.0.6-13.el8.noarch.rpm 10 MB/s | 157 kB 00:00 2023-10-08T16:06:19.793 INFO:teuthology.orchestra.run.smithi012.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 40 MB/s | 3.7 MB 00:00 2023-10-08T16:06:19.796 INFO:teuthology.orchestra.run.smithi012.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 6.5 MB/s | 110 kB 00:00 2023-10-08T16:06:19.809 INFO:teuthology.orchestra.run.smithi012.stdout:(111/120): python3-jsonpointer-1.10-11.el8.noar 1.5 MB/s | 20 kB 00:00 2023-10-08T16:06:19.813 INFO:teuthology.orchestra.run.smithi012.stdout:(112/120): librdkafka-0.11.4-1.el8.x86_64.rpm 18 MB/s | 353 kB 00:00 2023-10-08T16:06:19.826 INFO:teuthology.orchestra.run.smithi012.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.1 MB/s | 54 kB 00:00 2023-10-08T16:06:19.834 INFO:teuthology.orchestra.run.smithi012.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 27 MB/s | 709 kB 00:00 2023-10-08T16:06:19.951 INFO:teuthology.orchestra.run.smithi012.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 38 MB/s | 4.7 MB 00:00 2023-10-08T16:06:19.973 INFO:teuthology.orchestra.run.smithi012.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 33 MB/s | 4.6 MB 00:00 2023-10-08T16:06:19.985 INFO:teuthology.orchestra.run.smithi012.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 21 MB/s | 713 kB 00:00 2023-10-08T16:06:20.189 INFO:teuthology.orchestra.run.smithi029.stdout:(120/120): librbd1-17.2.6-1320.g08cac018.el8.x8 3.3 MB/s | 3.6 MB 00:01 2023-10-08T16:06:20.193 INFO:teuthology.orchestra.run.smithi029.stdout:-------------------------------------------------------------------------------- 2023-10-08T16:06:20.194 INFO:teuthology.orchestra.run.smithi029.stdout:Total 18 MB/s | 202 MB 00:10 2023-10-08T16:06:20.272 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction check 2023-10-08T16:06:20.307 INFO:teuthology.orchestra.run.smithi012.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 11 MB/s | 3.6 MB 00:00 2023-10-08T16:06:20.408 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction check succeeded. 2023-10-08T16:06:20.408 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction test 2023-10-08T16:06:20.440 INFO:teuthology.orchestra.run.smithi012.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 7.4 MB/s | 3.5 MB 00:00 2023-10-08T16:06:22.650 INFO:teuthology.orchestra.run.smithi029.stdout:Transaction test succeeded. 2023-10-08T16:06:22.655 INFO:teuthology.orchestra.run.smithi029.stdout:Running transaction 2023-10-08T16:06:24.125 INFO:teuthology.orchestra.run.smithi012.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 6.3 MB/s | 52 MB 00:08 2023-10-08T16:06:24.130 INFO:teuthology.orchestra.run.smithi012.stdout:-------------------------------------------------------------------------------- 2023-10-08T16:06:24.131 INFO:teuthology.orchestra.run.smithi012.stdout:Total 15 MB/s | 202 MB 00:13 2023-10-08T16:06:24.205 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction check 2023-10-08T16:06:24.342 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction check succeeded. 2023-10-08T16:06:24.342 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction test 2023-10-08T16:06:26.143 INFO:teuthology.orchestra.run.smithi012.stdout:Transaction test succeeded. 2023-10-08T16:06:26.148 INFO:teuthology.orchestra.run.smithi012.stdout:Running transaction 2023-10-08T16:06:27.243 INFO:teuthology.orchestra.run.smithi029.stdout: Preparing : 1/1 2023-10-08T16:06:27.526 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T16:06:27.782 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-08T16:06:28.067 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-08T16:06:28.251 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-08T16:06:28.483 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-08T16:06:28.961 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-08T16:06:29.209 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:06:29.698 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:06:29.983 INFO:teuthology.orchestra.run.smithi029.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:06:30.147 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:06:30.358 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:06:30.491 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:06:30.778 INFO:teuthology.orchestra.run.smithi012.stdout: Preparing : 1/1 2023-10-08T16:06:30.968 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T16:06:30.980 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-08T16:06:31.167 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:06:31.346 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-08T16:06:31.517 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:06:31.765 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T16:06:31.971 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-08T16:06:31.974 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:06:32.125 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:06:32.158 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:06:32.626 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:06:32.800 INFO:teuthology.orchestra.run.smithi012.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:06:32.969 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-08T16:06:33.174 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:06:33.301 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:06:33.420 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T16:06:33.497 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:06:33.632 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T16:06:33.870 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-08T16:06:33.874 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:06:34.012 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:06:34.258 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:06:34.357 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:06:34.585 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-08T16:06:34.609 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-08T16:06:34.774 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:06:34.791 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-08T16:06:34.954 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:06:34.977 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-08T16:06:35.207 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-08T16:06:35.249 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-08T16:06:35.385 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-08T16:06:35.599 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:06:35.738 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:06:35.907 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:06:35.943 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-08T16:06:36.012 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-08T16:06:36.166 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-08T16:06:36.224 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-08T16:06:36.489 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-08T16:06:36.707 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-08T16:06:36.808 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-08T16:06:36.890 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-08T16:06:37.007 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:06:37.066 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-08T16:06:37.178 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-08T16:06:37.373 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:06:38.030 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-08T16:06:38.213 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-08T16:06:38.344 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-08T16:06:38.357 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:06:38.554 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-08T16:06:38.775 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-08T16:06:38.985 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-08T16:06:39.109 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-08T16:06:39.190 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:06:39.472 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-08T16:06:39.784 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T16:06:39.957 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T16:06:40.096 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T16:06:40.097 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-08T16:06:40.384 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-08T16:06:40.396 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T16:06:40.609 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-08T16:06:40.840 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-08T16:06:41.031 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-08T16:06:41.162 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-08T16:06:41.466 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-08T16:06:41.664 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-08T16:06:41.704 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-08T16:06:41.986 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-08T16:06:42.059 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-08T16:06:42.231 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:06:42.366 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-08T16:06:42.723 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-08T16:06:43.064 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-08T16:06:43.356 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-08T16:06:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-08T16:06:45.182 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-08T16:06:46.018 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-08T16:06:46.334 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-08T16:06:46.406 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-08T16:06:46.686 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T16:06:46.687 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-08T16:06:46.961 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-08T16:06:46.965 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T16:06:47.191 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-08T16:06:47.206 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T16:06:47.420 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-08T16:06:47.432 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T16:06:47.638 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-08T16:06:47.647 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T16:06:47.814 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-08T16:06:47.903 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-08T16:06:48.101 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-08T16:06:48.247 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-08T16:06:48.314 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-08T16:06:48.333 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-08T16:06:48.481 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-08T16:06:48.560 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-08T16:06:48.701 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-08T16:06:48.773 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-08T16:06:48.893 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-08T16:06:49.028 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-08T16:06:49.046 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:06:49.181 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-08T16:06:49.231 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-08T16:06:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-08T16:06:49.502 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-08T16:06:49.628 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-08T16:06:49.676 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-08T16:06:49.845 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-08T16:06:49.958 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-08T16:06:50.020 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-08T16:06:50.200 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-08T16:06:50.262 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-08T16:06:50.388 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-08T16:06:50.569 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-08T16:06:50.733 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-08T16:06:50.737 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-08T16:06:50.998 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-08T16:06:51.116 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-08T16:06:51.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-08T16:06:51.403 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-08T16:06:51.475 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-08T16:06:51.709 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-08T16:06:51.822 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-08T16:06:51.922 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-08T16:06:52.039 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-08T16:06:52.154 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-08T16:06:52.301 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-08T16:06:52.307 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T16:06:52.500 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T16:06:52.535 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-08T16:06:52.729 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-08T16:06:52.795 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T16:06:52.990 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T16:06:53.016 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-08T16:06:53.205 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T16:06:53.352 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T16:06:53.382 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-08T16:06:53.503 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T16:06:53.626 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-08T16:06:53.702 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T16:06:53.858 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-08T16:06:53.951 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T16:06:54.047 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-08T16:06:54.165 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T16:06:54.290 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-08T16:06:54.367 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T16:06:54.538 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T16:06:54.540 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-08T16:06:54.777 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T16:06:54.787 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-08T16:06:55.036 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-08T16:06:55.037 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T16:06:55.245 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T16:06:55.285 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-08T16:06:55.482 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-08T16:06:55.540 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T16:06:55.771 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-08T16:06:55.772 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T16:06:55.961 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T16:06:56.108 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-08T16:06:56.234 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T16:06:56.348 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-08T16:06:56.710 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-08T16:06:57.067 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-08T16:06:57.315 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-08T16:06:57.612 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-08T16:06:57.826 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T16:06:58.162 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T16:06:58.434 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T16:06:58.790 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T16:06:59.099 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T16:06:59.457 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T16:06:59.642 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-08T16:06:59.703 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T16:06:59.868 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T16:07:00.015 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-08T16:07:00.053 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T16:07:00.299 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-08T16:07:00.713 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-08T16:07:01.017 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-08T16:07:01.431 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-08T16:07:01.704 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-08T16:07:01.937 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-08T16:07:02.155 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-08T16:07:07.772 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:08.018 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:08.725 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:09.629 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:07:09.813 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:07:09.942 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:07:11.654 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:11.921 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:12.657 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-08T16:07:12.986 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:07:13.162 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-08T16:07:13.337 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:07:30.075 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:07:30.075 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /sys 2023-10-08T16:07:30.075 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /proc 2023-10-08T16:07:30.075 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /run 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /mnt 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /var/tmp 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /home 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /tmp 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout:skipping the directory /dev 2023-10-08T16:07:30.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:07:30.487 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:07:32.221 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:07:32.389 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:07:32.677 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:07:32.855 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:07:33.338 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:07:33.495 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:07:33.537 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /sys 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /proc 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /run 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /mnt 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /var/tmp 2023-10-08T16:07:35.404 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /home 2023-10-08T16:07:35.405 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /tmp 2023-10-08T16:07:35.405 INFO:teuthology.orchestra.run.smithi029.stdout:skipping the directory /dev 2023-10-08T16:07:35.405 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:07:35.867 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:07:37.627 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-08T16:07:37.841 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:07:38.131 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-08T16:07:38.273 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:07:38.340 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:07:38.433 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:07:38.569 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T16:07:38.841 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T16:07:38.843 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-08T16:07:38.993 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:07:39.067 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:07:39.109 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-08T16:07:39.273 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:07:39.454 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:07:40.646 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:07:40.818 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:07:40.963 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:07:41.350 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T16:07:41.563 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:07:41.634 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:07:41.767 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:07:41.795 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:07:43.619 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T16:07:43.879 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:07:43.927 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:07:43.998 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:07:44.119 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-08T16:07:44.151 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:07:44.226 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:07:44.359 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:07:44.367 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-08T16:07:44.624 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-08T16:07:44.793 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:07:44.823 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:07:44.951 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:07:45.110 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-08T16:07:45.348 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:07:46.546 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-08T16:07:46.741 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:07:46.889 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-08T16:07:47.354 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-08T16:07:47.549 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:07:47.620 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-08T16:07:47.765 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:07:47.793 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-08T16:07:49.672 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-08T16:07:49.990 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:07:50.127 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-08T16:07:50.308 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:07:50.383 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-08T16:07:50.541 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:07:50.679 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:07:50.980 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-08T16:07:51.191 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:07:52.084 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T16:07:52.536 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-08T16:07:52.750 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 110/122 2023-10-08T16:07:52.983 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-08T16:07:53.123 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:07:53.151 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-08T16:07:53.329 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T16:07:53.463 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T16:07:53.600 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T16:07:53.767 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T16:07:54.049 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T16:07:54.231 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:07:54.314 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-08T16:07:54.507 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:07:54.531 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-08T16:07:54.652 INFO:teuthology.orchestra.run.smithi012.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-08T16:07:54.652 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:07:54.863 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:07:54.863 INFO:teuthology.orchestra.run.smithi012.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:07:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:07:55.214 INFO:teuthology.orchestra.run.smithi012.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-08T16:07:55.214 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:07:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T16:07:56.161 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T16:07:56.162 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T16:07:56.163 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T16:07:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T16:07:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T16:07:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T16:07:56.164 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T16:07:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T16:07:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T16:07:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T16:07:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T16:07:56.171 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T16:07:56.172 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T16:07:56.173 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T16:07:56.174 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-08T16:07:56.175 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-08T16:07:56.176 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-08T16:07:56.177 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T16:07:56.178 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T16:07:57.031 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-08T16:07:57.399 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-08T16:07:57.589 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-08T16:07:58.459 INFO:teuthology.orchestra.run.smithi012.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:07:58.459 INFO:teuthology.orchestra.run.smithi012.stdout:Last metadata expiration check: 0:01:58 ago on Sun 08 Oct 2023 04:06:00 PM UTC. 2023-10-08T16:07:58.756 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-08T16:07:59.136 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-08T16:07:59.393 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-08T16:07:59.602 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-08T16:07:59.829 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-08T16:08:00.014 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-08T16:08:00.175 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-08T16:08:00.401 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-08T16:08:00.552 INFO:teuthology.orchestra.run.smithi012.stdout:Installed products updated. 2023-10-08T16:08:00.615 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout:Upgraded: 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout:Installed: 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T16:08:00.688 INFO:teuthology.orchestra.run.smithi012.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.689 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.690 INFO:teuthology.orchestra.run.smithi012.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: jq-1.5-12.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.691 INFO:teuthology.orchestra.run.smithi012.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T16:08:00.692 INFO:teuthology.orchestra.run.smithi012.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T16:08:00.693 INFO:teuthology.orchestra.run.smithi012.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T16:08:00.694 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T16:08:00.695 INFO:teuthology.orchestra.run.smithi012.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T16:08:00.696 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T16:08:00.697 INFO:teuthology.orchestra.run.smithi012.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T16:08:00.698 INFO:teuthology.orchestra.run.smithi012.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T16:08:00.699 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:00.699 INFO:teuthology.orchestra.run.smithi012.stdout:Complete! 2023-10-08T16:08:00.858 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-08T16:08:01.029 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:01.088 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-08T16:08:01.176 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-08T16:08:01.447 INFO:teuthology.orchestra.run.smithi029.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-08T16:08:01.472 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-08T16:08:01.473 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:08:01.737 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-08T16:08:01.737 INFO:teuthology.orchestra.run.smithi029.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:08:02.168 INFO:teuthology.orchestra.run.smithi029.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:08:02.168 INFO:teuthology.orchestra.run.smithi029.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-08T16:08:02.168 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:03.094 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-08T16:08:03.094 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-08T16:08:03.094 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-08T16:08:03.094 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-08T16:08:03.095 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-08T16:08:03.096 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-08T16:08:03.097 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-08T16:08:03.104 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-08T16:08:03.104 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-08T16:08:03.104 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-08T16:08:03.105 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-08T16:08:03.106 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-08T16:08:03.107 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-08T16:08:03.108 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-08T16:08:03.109 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-08T16:08:03.110 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-08T16:08:03.111 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-08T16:08:05.578 INFO:teuthology.orchestra.run.smithi029.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-08T16:08:05.578 INFO:teuthology.orchestra.run.smithi029.stdout:Last metadata expiration check: 0:02:06 ago on Sun 08 Oct 2023 04:05:59 PM UTC. 2023-10-08T16:08:07.635 INFO:teuthology.orchestra.run.smithi029.stdout:Installed products updated. 2023-10-08T16:08:07.800 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout:Upgraded: 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout:Installed: 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: automake-1.16.1-7.el8.noarch 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: bison-3.0.4-10.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.801 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.802 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: flex-2.6.1-9.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-08T16:08:07.803 INFO:teuthology.orchestra.run.smithi029.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: jq-1.5-12.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-08T16:08:07.804 INFO:teuthology.orchestra.run.smithi029.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-08T16:08:07.805 INFO:teuthology.orchestra.run.smithi029.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-08T16:08:07.806 INFO:teuthology.orchestra.run.smithi029.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-08T16:08:07.807 INFO:teuthology.orchestra.run.smithi029.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-08T16:08:07.808 INFO:teuthology.orchestra.run.smithi029.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-portend-2.6-1.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-08T16:08:07.809 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-08T16:08:07.810 INFO:teuthology.orchestra.run.smithi029.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-08T16:08:07.811 INFO:teuthology.orchestra.run.smithi029.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-08T16:08:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-08T16:08:07.812 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:07.812 INFO:teuthology.orchestra.run.smithi029.stdout:Complete! 2023-10-08T16:08:08.142 DEBUG:teuthology.parallel:result is None 2023-10-08T16:08:08.143 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:08:08.378 DEBUG:teuthology.orchestra.run.smithi012:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T16:08:08.427 INFO:teuthology.orchestra.run.smithi012.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T16:08:08.427 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T16:08:08.428 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T16:08:08.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-08T16:08:08.674 DEBUG:teuthology.orchestra.run.smithi029:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-08T16:08:08.723 INFO:teuthology.orchestra.run.smithi029.stdout:17.2.6-1320.g08cac018.el8 2023-10-08T16:08:08.724 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-08T16:08:08.724 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-08T16:08:08.724 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-08T16:08:08.724 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:08.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:08:08.816 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:08.816 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-08T16:08:08.903 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-08T16:08:08.903 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:08.903 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:08:08.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:08:09.072 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:09.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/daemon-helper 2023-10-08T16:08:09.134 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-08T16:08:09.234 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-08T16:08:09.234 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:09.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:08:09.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:08:09.398 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:09.398 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-08T16:08:09.461 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-08T16:08:10.334 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-08T16:08:10.334 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:10.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:08:10.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:08:10.499 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:10.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/usr/bin/stdin-killer 2023-10-08T16:08:10.567 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-08T16:08:10.670 INFO:teuthology.run_tasks:Running task ceph... 2023-10-08T16:08:10.730 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-08T16:08:10.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-10-08T16:08:10.735 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 777 /var/log/ceph 2023-10-08T16:08:10.797 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-08T16:08:10.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:08:10.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-08T16:08:10.863 INFO:tasks.ceph:Creating extra log directories... 2023-10-08T16:08:10.863 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:08:10.868 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-08T16:08:10.939 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-08T16:08:10.939 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-08T16:08:10.939 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-08T16:08:10.939 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:10.939 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:08:10.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:11.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:11.254 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:11.254 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-08T16:08:11.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:11.511 DEBUG:teuthology.orchestra.run.smithi029:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:11.581 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-08T16:08:11.581 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-08T16:08:11.581 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7418299', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 74, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 8174, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-07-1508-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_abf19fc7a04fe4fceab4e98d4013ae1da7c06006/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'abf19fc7a04fe4fceab4e98d4013ae1da7c06006', 'targets': {'smithi012.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSkqEekuv48eEViEh/hZX5CTaaT7iF+B/2QetvIcodglzyMmHjjeTQrGGJ0mfaWgRgghq4SWSW5oD7HokWaGKI=', 'smithi029.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlrEluFPAewIEV+F/mxYeLr3pAqlh5o5h8DmueNzXHleLpXz6BOCyvMVla7cIzyZi/+j9wnJXYXUmGsYTDq2d0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-08_15:41:30', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-08T16:08:11.581 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:08:11.586 DEBUG:teuthology.orchestra.run.smithi029:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-08T16:08:11.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:08:11.663 DEBUG:teuthology.orchestra.run.smithi029:> sudo install -d -m0777 -- /var/run/ceph 2023-10-08T16:08:11.733 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:11.733 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:08:11.769 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:08:11.769 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:11.850 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-08 16:07:55.587569179 +0000 2023-10-08T16:08:11.851 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-08 16:04:59.826603007 +0000 2023-10-08T16:08:11.851 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-08 16:04:59.826603007 +0000 2023-10-08T16:08:11.851 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-08T16:08:11.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:08:11.950 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-08T16:08:11.951 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-08T16:08:11.951 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000345399 s, 1.5 MB/s 2023-10-08T16:08:11.953 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:08:11.991 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-10-08T16:08:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:08:12.070 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-08T16:08:12.070 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:12.071 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:12.071 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-08 16:07:55.587569179 +0000 2023-10-08T16:08:12.071 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-08 16:05:00.608597372 +0000 2023-10-08T16:08:12.071 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-08 16:05:00.608597372 +0000 2023-10-08T16:08:12.071 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-08T16:08:12.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:08:12.171 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-08T16:08:12.171 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-08T16:08:12.171 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.00028743 s, 1.8 MB/s 2023-10-08T16:08:12.173 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:08:12.212 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-08 16:07:55.587569179 +0000 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-08 16:05:01.373591859 +0000 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-08 16:05:01.373591859 +0000 2023-10-08T16:08:12.291 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-08T16:08:12.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:08:12.397 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-08T16:08:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-08T16:08:12.398 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000291406 s, 1.8 MB/s 2023-10-08T16:08:12.401 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:08:12.439 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-10-08T16:08:12.517 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-10-08 16:07:55.587569179 +0000 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-10-08 16:05:02.167586138 +0000 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-10-08 16:05:02.167586138 +0000 2023-10-08T16:08:12.518 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-10-08T16:08:12.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:08:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-10-08T16:08:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-10-08T16:08:12.617 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000292412 s, 1.8 MB/s 2023-10-08T16:08:12.620 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:08:12.658 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:12.659 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:12.659 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/scratch_devs of=/dev/stdout 2023-10-08T16:08:12.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-08T16:08:12.697 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_1 2023-10-08T16:08:12.775 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-08T16:08:12.775 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:12.775 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-10-08T16:08:12.775 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:12.775 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:12.776 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 16:08:02.514585773 +0000 2023-10-08T16:08:12.776 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 16:05:03.980643245 +0000 2023-10-08T16:08:12.776 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 16:05:03.980643245 +0000 2023-10-08T16:08:12.776 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T16:08:12.776 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-08T16:08:12.881 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T16:08:12.881 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T16:08:12.881 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000249683 s, 2.1 MB/s 2023-10-08T16:08:12.883 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-08T16:08:12.923 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_2 2023-10-08T16:08:13.002 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 16:08:02.514585773 +0000 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 16:05:04.753631201 +0000 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 16:05:04.753631201 +0000 2023-10-08T16:08:13.003 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T16:08:13.003 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-08T16:08:13.105 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T16:08:13.105 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T16:08:13.105 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000182689 s, 2.8 MB/s 2023-10-08T16:08:13.108 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-08T16:08:13.148 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_3 2023-10-08T16:08:13.227 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-08T16:08:13.227 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:13.227 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-10-08T16:08:13.227 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:13.228 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:13.228 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 16:08:02.515585758 +0000 2023-10-08T16:08:13.228 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 16:05:05.516619312 +0000 2023-10-08T16:08:13.228 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 16:05:05.516619312 +0000 2023-10-08T16:08:13.228 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T16:08:13.228 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-08T16:08:13.329 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T16:08:13.329 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T16:08:13.329 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.00019145 s, 2.7 MB/s 2023-10-08T16:08:13.332 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-08T16:08:13.371 DEBUG:teuthology.orchestra.run.smithi029:> stat /dev/vg_nvme/lv_4 2023-10-08T16:08:13.448 INFO:teuthology.orchestra.run.smithi029.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-08T16:08:13.448 INFO:teuthology.orchestra.run.smithi029.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-08T16:08:13.448 INFO:teuthology.orchestra.run.smithi029.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-10-08T16:08:13.448 INFO:teuthology.orchestra.run.smithi029.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-08T16:08:13.448 INFO:teuthology.orchestra.run.smithi029.stdout:Context: system_u:object_r:device_t:s0 2023-10-08T16:08:13.449 INFO:teuthology.orchestra.run.smithi029.stdout:Access: 2023-10-08 16:08:02.515585758 +0000 2023-10-08T16:08:13.449 INFO:teuthology.orchestra.run.smithi029.stdout:Modify: 2023-10-08 16:05:06.360606162 +0000 2023-10-08T16:08:13.449 INFO:teuthology.orchestra.run.smithi029.stdout:Change: 2023-10-08 16:05:06.360606162 +0000 2023-10-08T16:08:13.449 INFO:teuthology.orchestra.run.smithi029.stdout: Birth: - 2023-10-08T16:08:13.449 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-08T16:08:13.550 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records in 2023-10-08T16:08:13.550 INFO:teuthology.orchestra.run.smithi029.stderr:1+0 records out 2023-10-08T16:08:13.551 INFO:teuthology.orchestra.run.smithi029.stderr:512 bytes copied, 0.000182687 s, 2.8 MB/s 2023-10-08T16:08:13.553 DEBUG:teuthology.orchestra.run.smithi029:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-08T16:08:13.592 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:13.592 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:08:13.592 INFO:tasks.ceph:Generating config... 2023-10-08T16:08:13.593 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-08T16:08:13.594 INFO:tasks.ceph:[client] debug client = 20 2023-10-08T16:08:13.594 INFO:tasks.ceph:[client] debug ms = 1 2023-10-08T16:08:13.594 INFO:tasks.ceph:[client] pid file = 2023-10-08T16:08:13.594 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-08T16:08:13.594 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-08T16:08:13.594 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-08T16:08:13.594 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-08T16:08:13.594 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-08T16:08:13.594 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-08T16:08:13.594 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-08T16:08:13.595 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-08T16:08:13.596 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-08T16:08:13.596 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-08T16:08:13.597 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-08T16:08:13.597 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-08T16:08:13.597 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-08T16:08:13.597 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-08T16:08:13.597 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-08T16:08:13.597 INFO:tasks.ceph:Setting up mon.a... 2023-10-08T16:08:13.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-08T16:08:13.684 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-10-08T16:08:13.690 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-08T16:08:13.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:08:13.843 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12'), ('mon.b', '172.21.15.29'), ('mon.c', '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]')] 2023-10-08T16:08:13.843 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12,172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-08T16:08:13.844 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:13.844 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:08:13.881 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --add b 172.21.15.29 --addv c '[v2:172.21.15.29:3301,v1:172.21.15.29:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 0ae45396-6d03-47bf-984b-756ce4c92578 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:setting min_mon_release = octopus 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 0ae45396-6d03-47bf-984b-756ce4c92578 2023-10-08T16:08:13.997 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-10-08T16:08:13.997728+0000 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-10-08T16:08:13.997728+0000 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 15 (octopus) 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:1: [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] mon.b 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:2: [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] mon.c 2023-10-08T16:08:13.998 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-08T16:08:13.999 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-08T16:08:14.037 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0ae45396-6d03-47bf-984b-756ce4c92578... 2023-10-08T16:08:14.038 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:08:14.083 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-08T16:08:14.194 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.195 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-10-08T16:08:14.196 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-10-08T16:08:14.197 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = "172.21.15.12,172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790]" 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on skipped message = False 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 0ae45396-6d03-47bf-984b-756ce4c92578 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-10-08T16:08:14.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-10-08T16:08:14.199 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-10-08T16:08:14.200 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = bitmap 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:08:14.201 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-10-08T16:08:14.202 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: debug finisher = 20 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-10-08T16:08:14.203 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: # 1m isn't quite enough 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:08:14.204 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: mon op complaint time = 120 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: client mount timeout = 600 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: debug client = 20 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-08T16:08:14.205 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = "" 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.b] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.c] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout:[mds] 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: debug mds = 20 2023-10-08T16:08:14.206 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug frag = True 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: mds debug scatterstat = True 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: mds op complaint time = 180 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: mds verify scatter = True 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: osd op complaint time = 180 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: rados mon op timeout = 900 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi012.stdout: rados osd op timeout = 900 2023-10-08T16:08:14.207 INFO:teuthology.orchestra.run.smithi029.stdout:[global] 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: chdir = "" 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: auth supported = cephx 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: filestore xattr use omap = true 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: mon clock drift allowed = 1.000 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: osd crush chooseleaf type = 0 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: auth debug = true 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.208 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on old message = true 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on bug = true 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon pg warn max object skew = 0 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: # disable pg_autoscaler by default for new pools 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default size = 2 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow primary affinity = true 2023-10-08T16:08:14.209 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd allow pg remap = true 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on legacy crush tunables = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on crush straw calc version zero = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on no sortbitwise = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on osd down out interval zero = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon warn on too few osds = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: mon_allow_pool_size_one = true 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-08T16:08:14.210 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: osd default data pool replay window = 5 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: mon allow pool delete = true 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: mon cluster log file level = debug 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: debug asserts on shutdown = true 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: mon health detail to clog = false 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: mon host = "172.21.15.12,172.21.15.29,[v2:172.21.15.29:3301,v1:172.21.15.29:6790]" 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: ms die on skipped message = False 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: fsid = 0ae45396-6d03-47bf-984b-756ce4c92578 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout:[osd] 2023-10-08T16:08:14.211 INFO:teuthology.orchestra.run.smithi029.stdout: osd journal size = 100 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub load threshold = 5.0 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd scrub max interval = 600 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd mclock profile = high_recovery_ops 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd recover clone overlap = true 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd recovery max chunk = 1048576 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug shutdown = true 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug op order = true 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug verify stray on activate = true 2023-10-08T16:08:14.212 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: osd open classes on start = true 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug pg log writeout = true 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: osd deep scrub update digest min age = 30 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: osd map max advance = 10 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: journal zero on create = true 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: filestore ondisk finisher threads = 3 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: filestore apply finisher threads = 3 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.213 INFO:teuthology.orchestra.run.smithi029.stdout: bdev debug aio = true 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: osd debug misdirected ops = true 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: bdev async discard = True 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: bdev enable discard = True 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore allocator = bitmap 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore block size = 96636764160 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: bluestore fsck on mount = True 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluefs = 1/20 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: debug bluestore = 1/20 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: debug osd = 20 2023-10-08T16:08:14.214 INFO:teuthology.orchestra.run.smithi029.stdout: debug rocksdb = 4/10 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd backfillfull_ratio = 0.85 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd full ratio = 0.9 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd nearfull ratio = 0.8 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: osd failsafe full ratio = 0.95 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: osd objectstore = bluestore 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr] 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: debug mgr = 20 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:08:14.215 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: mgr/telemetry/nag = false 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug finisher = 20 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout:[mon] 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug mon = 20 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug paxos = 20 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: debug auth = 20 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: mon data avail warn = 5 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: mon mgr mkfs grace = 240 2023-10-08T16:08:14.216 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min pgs per osd = 4 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd reporter subtree level = osd 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: mon osd prime pg temp = true 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: mon reweight min bytes per osd = 10 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: auth mon ticket ttl = 660 # 11m 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: auth service ticket ttl = 240 # 4m 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: # don't complain about insecure global_id in the test suite 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.217 INFO:teuthology.orchestra.run.smithi029.stdout: # 1m isn't quite enough 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: mon_down_mkfs_grace = 2m 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: mon_warn_on_filestore_osds = false 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: mon op complaint time = 120 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout:[client] 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: rgw cache enabled = true 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable ops log = true 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: rgw enable usage log = true 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-08T16:08:14.218 INFO:teuthology.orchestra.run.smithi029.stdout: client mount timeout = 600 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout: debug client = 20 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout: pid file = "" 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.a] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.b] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mon.c] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-08T16:08:14.219 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout:[mds] 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: debug mds = 20 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: debug ms = 1 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug frag = True 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds debug scatterstat = True 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds op complaint time = 180 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: mds verify scatter = True 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: osd op complaint time = 180 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: rados mon op timeout = 900 2023-10-08T16:08:14.220 INFO:teuthology.orchestra.run.smithi029.stdout: rados osd op timeout = 900 2023-10-08T16:08:14.231 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-08T16:08:14.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-08T16:08:14.335 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-08T16:08:14.335 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:14.335 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-08T16:08:14.372 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:14.373 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-08T16:08:14.450 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:08:14.451 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:14.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:08:14.451 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:08:14.582 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:14.582 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:14.661 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:08:14.662 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:14.662 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-08T16:08:14.662 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-08T16:08:14.754 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:14.754 DEBUG:teuthology.orchestra.run.smithi029:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:14.831 INFO:tasks.ceph:Setting up mon nodes... 2023-10-08T16:08:14.832 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-08T16:08:14.832 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:08:14.949 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-08T16:08:14.955 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:08:15.087 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-08T16:08:15.093 INFO:tasks.ceph:Setting up mds nodes... 2023-10-08T16:08:15.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:08:15.212 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-08T16:08:15.217 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-08T16:08:15.281 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:08:15.396 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-08T16:08:15.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-08T16:08:15.465 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:08:15.583 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-08T16:08:15.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-08T16:08:15.656 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:08:15.769 INFO:teuthology.orchestra.run.smithi029.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-08T16:08:15.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-08T16:08:15.835 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-08T16:08:15.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-08T16:08:15.920 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-08T16:08:15.959 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-08T16:08:16.045 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-08T16:08:16.078 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-08T16:08:16.163 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-08T16:08:16.194 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-08T16:08:16.278 INFO:teuthology.orchestra.run.smithi029.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-08T16:08:16.309 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-08T16:08:16.310 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi029.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-08T16:08:16.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-08T16:08:16.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:16.376 INFO:tasks.ceph:role: osd.0 2023-10-08T16:08:16.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:08:16.376 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:16.447 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:16.448 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:16.448 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:16.448 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:16.448 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:16.880 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-08T16:08:16.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-08T16:08:16.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-08T16:08:17.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-08T16:08:17.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-08T16:08:17.940 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:17.941 INFO:tasks.ceph:role: osd.1 2023-10-08T16:08:17.941 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:08:17.941 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:08:18.013 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:18.014 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:18.465 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-08T16:08:18.470 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-08T16:08:18.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-08T16:08:18.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-08T16:08:18.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-08T16:08:18.739 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:18.739 INFO:tasks.ceph:role: osd.2 2023-10-08T16:08:18.740 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:08:18.740 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:08:18.809 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:18.809 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:18.810 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:19.253 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-08T16:08:19.257 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-08T16:08:19.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-08T16:08:19.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-08T16:08:19.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-08T16:08:19.558 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:19.559 INFO:tasks.ceph:role: osd.3 2023-10-08T16:08:19.559 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:08:19.559 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:08:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:19.627 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-10-08T16:08:19.627 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:19.628 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:20.063 INFO:teuthology.orchestra.run.smithi012.stdout:Discarding blocks...Done. 2023-10-08T16:08:20.068 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-10-08T16:08:20.068 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-08T16:08:20.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-08T16:08:20.257 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.401+0000 7f59f8824540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-08T16:08:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.401+0000 7f59f8824540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-08T16:08:20.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.401+0000 7f59f8824540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:08:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.401+0000 7f59f8824540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:08:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.401+0000 7f59f8824540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-08T16:08:20.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.403+0000 7f59f8824540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-08T16:08:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:20.961+0000 7f59f8824540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:21.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:21.728+0000 7f59f8824540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:22.500+0000 7f59f8824540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:23.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-08T16:08:23.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:23.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.476+0000 7fd369863540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-08T16:08:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.476+0000 7fd369863540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-08T16:08:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.476+0000 7fd369863540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:08:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.476+0000 7fd369863540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:08:23.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.476+0000 7fd369863540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-08T16:08:23.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:23.478+0000 7fd369863540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-08T16:08:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:24.026+0000 7fd369863540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:24.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:24.802+0000 7fd369863540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:25.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:25.570+0000 7fd369863540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:26.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-08T16:08:26.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.554+0000 7f935a092540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-08T16:08:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.555+0000 7f935a092540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-08T16:08:26.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.555+0000 7f935a092540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:08:26.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.555+0000 7f935a092540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:08:26.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.555+0000 7f935a092540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-08T16:08:26.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:26.556+0000 7f935a092540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-08T16:08:27.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:27.104+0000 7f935a092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:27.885+0000 7f935a092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:28.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:28.657+0000 7f935a092540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:29.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-08T16:08:29.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:29.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.645+0000 7fec579ea540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-08T16:08:29.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.645+0000 7fec579ea540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-08T16:08:29.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.645+0000 7fec579ea540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:08:29.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.645+0000 7fec579ea540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:08:29.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.645+0000 7fec579ea540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-08T16:08:29.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:29.647+0000 7fec579ea540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-08T16:08:30.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:30.195+0000 7fec579ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:30.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:30.968+0000 7fec579ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:31.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:31.738+0000 7fec579ea540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:32.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-08T16:08:32.637 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-08T16:08:32.701 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:32.701 INFO:tasks.ceph:role: osd.4 2023-10-08T16:08:32.701 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:08:32.701 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:32.765 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:32.788 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T16:08:32.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T16:08:32.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-08T16:08:32.899 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-08T16:08:32.974 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-08T16:08:33.036 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:33.036 INFO:tasks.ceph:role: osd.5 2023-10-08T16:08:33.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:08:33.036 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:33.100 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:33.101 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:33.124 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T16:08:33.128 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T16:08:33.128 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-08T16:08:33.229 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-08T16:08:33.300 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-08T16:08:33.369 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:33.370 INFO:tasks.ceph:role: osd.6 2023-10-08T16:08:33.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:08:33.370 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-08T16:08:33.431 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:33.431 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:33.431 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:33.431 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:33.432 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:33.455 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T16:08:33.459 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T16:08:33.460 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-08T16:08:33.559 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-08T16:08:33.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-08T16:08:33.690 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-08T16:08:33.690 INFO:tasks.ceph:role: osd.7 2023-10-08T16:08:33.691 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:08:33.691 DEBUG:teuthology.orchestra.run.smithi029:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-08T16:08:33.757 INFO:teuthology.orchestra.run.smithi029.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-08T16:08:33.757 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-08T16:08:33.757 INFO:teuthology.orchestra.run.smithi029.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout: = reflink=1 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout: = sunit=0 swidth=0 blks 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-08T16:08:33.758 INFO:teuthology.orchestra.run.smithi029.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-08T16:08:33.778 INFO:teuthology.orchestra.run.smithi029.stdout:Discarding blocks...Done. 2023-10-08T16:08:33.782 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi029.front.sepia.ceph.com -o noatime 2023-10-08T16:08:33.782 DEBUG:teuthology.orchestra.run.smithi029:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-08T16:08:33.881 DEBUG:teuthology.orchestra.run.smithi029:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-08T16:08:33.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:34.058 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.058+0000 7f29cc1c8540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-08T16:08:34.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.059+0000 7f29cc1c8540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-08T16:08:34.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.059+0000 7f29cc1c8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:08:34.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.059+0000 7f29cc1c8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:08:34.059 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.059+0000 7f29cc1c8540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-08T16:08:34.061 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.061+0000 7f29cc1c8540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-08T16:08:34.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:34.607+0000 7f29cc1c8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:35.373 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:35.373+0000 7f29cc1c8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:36.154 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:36.154+0000 7f29cc1c8540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:36.995 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-08T16:08:37.064 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:37.158 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.158+0000 7f45582b6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-08T16:08:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.158+0000 7f45582b6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-08T16:08:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.158+0000 7f45582b6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:08:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.159+0000 7f45582b6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:08:37.159 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.159+0000 7f45582b6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-08T16:08:37.160 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.160+0000 7f45582b6540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-08T16:08:37.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:37.705+0000 7f45582b6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:38.470 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:38.470+0000 7f45582b6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:39.234 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:39.233+0000 7f45582b6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:40.068 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-08T16:08:40.131 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:40.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.226+0000 7f91e0904540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-08T16:08:40.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.226+0000 7f91e0904540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-08T16:08:40.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.226+0000 7f91e0904540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:08:40.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.226+0000 7f91e0904540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:08:40.227 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.226+0000 7f91e0904540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-08T16:08:40.228 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.227+0000 7f91e0904540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-08T16:08:40.784 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:40.783+0000 7f91e0904540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:41.550 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:41.549+0000 7f91e0904540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:41.583 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:41.661 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:08:42.315 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:42.314+0000 7f91e0904540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:43.148 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-08T16:08:43.212 DEBUG:teuthology.orchestra.run.smithi029:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:43.306 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.305+0000 7fda95ff5540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-08T16:08:43.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.305+0000 7fda95ff5540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-08T16:08:43.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.305+0000 7fda95ff5540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:08:43.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.305+0000 7fda95ff5540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:08:43.307 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.305+0000 7fda95ff5540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-08T16:08:43.308 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.307+0000 7fda95ff5540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-08T16:08:43.857 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:43.856+0000 7fda95ff5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:44.636 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:44.635+0000 7fda95ff5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:45.411 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:45.410+0000 7fda95ff5540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-08T16:08:46.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-08T16:08:46.301 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-08T16:08:46.301 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-08T16:08:46.366 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-08T16:08:46.468 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-08T16:08:46.569 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-08T16:08:46.672 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-08T16:08:46.775 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.775 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-08T16:08:46.881 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:46.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-08T16:08:46.983 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:46.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-08T16:08:47.049 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-08T16:08:47.152 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.152 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-08T16:08:47.259 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.259 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-08T16:08:47.364 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.364 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-08T16:08:47.468 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-08T16:08:47.578 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.578 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-08T16:08:47.685 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:47.685 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-08T16:08:47.723 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:47.723 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-08T16:08:47.799 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.800 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-08T16:08:47.836 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:47.837 DEBUG:teuthology.orchestra.run.smithi029:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-08T16:08:47.914 INFO:tasks.ceph:Adding keys to all mons... 2023-10-08T16:08:47.914 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:08:47.920 DEBUG:teuthology.orchestra.run.smithi029:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.y] 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg== 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.a] 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw== 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.c] 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w== 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-10-08T16:08:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.3] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.b] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA== 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout:[mds.d] 2023-10-08T16:08:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.4] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.5] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.6] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.7] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw== 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout:[client.2] 2023-10-08T16:08:47.978 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg== 2023-10-08T16:08:47.979 INFO:teuthology.orchestra.run.smithi012.stdout:[client.1] 2023-10-08T16:08:47.979 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA== 2023-10-08T16:08:47.979 INFO:teuthology.orchestra.run.smithi012.stdout:[client.3] 2023-10-08T16:08:47.979 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ== 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.y] 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg== 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.a] 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw== 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.c] 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w== 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.0] 2023-10-08T16:08:48.016 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.1] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.2] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.3] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[mgr.x] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.b] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA== 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout:[mds.d] 2023-10-08T16:08:48.017 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.4] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.5] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.6] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[osd.7] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[client.0] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw== 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout:[client.2] 2023-10-08T16:08:48.018 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg== 2023-10-08T16:08:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:[client.1] 2023-10-08T16:08:48.019 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA== 2023-10-08T16:08:48.019 INFO:teuthology.orchestra.run.smithi029.stdout:[client.3] 2023-10-08T16:08:48.019 INFO:teuthology.orchestra.run.smithi029.stdout: key = AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ== 2023-10-08T16:08:48.020 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:08:48.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:08:48.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.162 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.378 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.476 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.480 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.577 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.582 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.689 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:48.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:08:48.791 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-08T16:08:48.889 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.893 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:48.998 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-08T16:08:49.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.214 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.314 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.319 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.425 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-08T16:08:49.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.630 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.634 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.738 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.840 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.845 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-08T16:08:49.947 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-08T16:08:49.947 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-08T16:08:50.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:08:50.117 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-08T16:08:50.180 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-08T16:08:50.244 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:08:50.357 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-08T16:08:50.420 DEBUG:teuthology.orchestra.run.smithi029:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-08T16:08:50.483 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-08T16:08:50.598 DEBUG:teuthology.orchestra.run.smithi029:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-08T16:08:50.661 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:50.665 DEBUG:teuthology.orchestra.run.smithi029:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-08T16:08:50.702 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-08T16:08:50.702 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-08T16:08:50.703 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-08T16:08:50.742 INFO:tasks.ceph.mon.a:Started 2023-10-08T16:08:50.742 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-08T16:08:50.742 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-08T16:08:50.746 INFO:tasks.ceph.mon.b:Started 2023-10-08T16:08:50.746 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-08T16:08:50.746 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-08T16:08:50.751 INFO:tasks.ceph.mon.c:Started 2023-10-08T16:08:50.751 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-08T16:08:50.751 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T16:08:50.751 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T16:08:50.756 INFO:tasks.ceph.mgr.y:Started 2023-10-08T16:08:50.756 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-08T16:08:50.756 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-08T16:08:50.761 INFO:tasks.ceph.mgr.x:Started 2023-10-08T16:08:50.761 INFO:tasks.ceph:Setting crush tunables to default 2023-10-08T16:08:50.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-10-08T16:08:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.949+0000 7f17bed9d700 1 Processor -- start 2023-10-08T16:08:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.949+0000 7f17bed9d700 1 -- start start 2023-10-08T16:08:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.950+0000 7f17bed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.950+0000 7f17bed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.950+0000 7f17bed9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b815af60 con 0x7f17b80cea00 2023-10-08T16:08:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.950+0000 7f17bed9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b815d010 con 0x7f17b815de50 2023-10-08T16:08:50.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.950+0000 7f17bed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815b240 con 0x7f17b8153a00 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:50614/0 (socket says 172.21.15.12:50614) 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 learned_addr learned my addr 172.21.15.12:0/203857749 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.951+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.952+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.952+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.952+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.952+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:50.952+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:08:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.152+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.152+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.152+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:51.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.152+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.152+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:08:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.153+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.153+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:51.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.153+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.153+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.153+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:08:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.553+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.553+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.553+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.553+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.553+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:08:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.554+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.554+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.554+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.554+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:51.554+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bd59a700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:08:52.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.355+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:52.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.356+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-08T16:08:52.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.356+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:52.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.356+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:52.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:52.356+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:08:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.950+0000 7f17af7fe700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b8153dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:08:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b8153dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 msgr2=0x7f17b815a540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.29:3300/0 conn(0x7f17b815de50 0x7f17b815a540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 -- 172.21.15.12:0/203857749 >> v1:172.21.15.29:6789/0 conn(0x7f17b80cea00 legacy=0x7f17b80cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 -- 172.21.15.12:0/203857749 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b815b520 con 0x7f179c0061b0 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17af7fe700 1 -- 172.21.15.12:0/203857749 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b815d010 con 0x7f179c003710 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:53.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:53.951+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:08:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.152+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.152+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.152+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.152+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:54.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.152+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:08:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.553+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.553+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.553+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:54.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.553+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:54.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:54.553+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:08:55.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:55.354+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:55.355+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-08T16:08:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:55.355+0000 7f17bdd9b700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-08T16:08:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:55.355+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-08T16:08:55.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:55.355+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:08:56.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139862554 0 0) 0x7f17b815b520 con 0x7f179c0061b0 2023-10-08T16:08:56.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a4003570 con 0x7f179c0061b0 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 539749992 0 0) 0x7f17a4003570 con 0x7f179c0061b0 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 msgr2=0x7f179c005b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 --2- 172.21.15.12:0/203857749 >> v2:172.21.15.12:3300/0 conn(0x7f179c003710 0x7f179c005b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c00af50 con 0x7f179c0061b0 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.148+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f17a800c2f0 con 0x7f179c0061b0 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 >> v1:172.21.15.12:6789/0 conn(0x7f179c0061b0 legacy=0x7f179c008660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17be59c700 1 -- 172.21.15.12:0/203857749 reap_dead start 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17a4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17a400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b815d010 con 0x7f17a4003a60 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4005540 con 0x7f17a4004810 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a400bfa0 con 0x7f17b8153a00 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bd59a700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17be59c700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17a400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.149+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17a4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 msgr2=0x7f17a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 msgr2=0x7f17a4003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:56.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17a4003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 -- 172.21.15.12:0/203857749 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a4003570 con 0x7f17b8153a00 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17be59c700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17a400ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b3070 tx=0x7f17b0007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e62d87c755a7d2c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0005b90 con 0x7f17b8153a00 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b0005cf0 con 0x7f17b8153a00 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.150+0000 7f17bcd99700 1 -- 172.21.15.12:0/203857749 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0007320 con 0x7f17b8153a00 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 -- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17a400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17a400ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b3070 tx=0x7f17b0007f50 comp rx=0 tx=0).stop 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 -- 172.21.15.12:0/203857749 shutdown_connections 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17a400ba60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17a4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 --2- 172.21.15.12:0/203857749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17a4003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 -- 172.21.15.12:0/203857749 >> 172.21.15.12:0/203857749 conn(0x7f17b80703a0 msgr2=0x7f17b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 -- 172.21.15.12:0/203857749 shutdown_connections 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.151+0000 7f17bed9d700 1 -- 172.21.15.12:0/203857749 wait complete. 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.153+0000 7f17bed9d700 1 Processor -- start 2023-10-08T16:08:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.153+0000 7f17bed9d700 1 -- start start 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17b80b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b81586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80cb2e0 con 0x7f17a4003a60 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81698d0 con 0x7f17a4004810 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8169bb0 con 0x7f17b8153a00 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bd59a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17b80b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53492/0 (socket says 172.21.15.12:53492) 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17be59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b81586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.154+0000 7f17bdd9b700 1 -- 172.21.15.12:0/2823192211 learned_addr learned my addr 172.21.15.12:0/2823192211 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 -- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 msgr2=0x7f17b81586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b81586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 -- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 msgr2=0x7f17b80b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17b80b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 -- 172.21.15.12:0/2823192211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8169e90 con 0x7f17a4003a60 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bd59a700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17b80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17bdd9b700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17b4017c40 tx=0x7f17b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.155+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b401e050 con 0x7f17a4003a60 2023-10-08T16:08:56.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b401f040 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4016e60 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b816a170 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b80b5a60 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f17b4005a00 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.156+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f17b4023d60 con 0x7f17a4003a60 2023-10-08T16:08:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.157+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80cb5c0 con 0x7f17a4003a60 2023-10-08T16:08:56.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.160+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f17b4036490 con 0x7f17a4003a60 2023-10-08T16:08:56.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.241+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f17b80b5c80 con 0x7f17a4003a60 2023-10-08T16:08:56.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.246+0000 7f17adffb700 1 -- 172.21.15.12:0/2823192211 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f17b4036630 con 0x7f17a4003a60 2023-10-08T16:08:56.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 msgr2=0x7f17b80c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f17b4017c40 tx=0x7f17b4008040 comp rx=0 tx=0).stop 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 shutdown_connections 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17a4003a60 0x7f17b80c9ce0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17b8153a00 0x7f17b81586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 --2- 172.21.15.12:0/2823192211 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17a4004810 0x7f17b80b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:56.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 >> 172.21.15.12:0/2823192211 conn(0x7f17b80703a0 msgr2=0x7f17b80cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:56.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 shutdown_connections 2023-10-08T16:08:56.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:08:56.247+0000 7f17bed9d700 1 -- 172.21.15.12:0/2823192211 wait complete. 2023-10-08T16:08:56.248 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-10-08T16:08:56.263 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-08T16:08:56.263 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:56.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-08T16:08:56.325 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:56.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-08T16:08:56.426 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:56.426 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-08T16:08:56.528 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-10-08T16:08:56.528 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-08T16:08:56.629 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:56.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-08T16:08:56.695 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:56.695 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-08T16:08:56.801 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:56.801 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-08T16:08:56.903 DEBUG:teuthology.orchestra.run.smithi029:> set -ex 2023-10-08T16:08:56.903 DEBUG:teuthology.orchestra.run.smithi029:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-08T16:08:57.008 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new b3f88c40-0762-47e9-b476-591d845036b1 0 2023-10-08T16:08:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.253+0000 7f48395ff700 1 Processor -- start 2023-10-08T16:08:57.254 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.253+0000 7f48395ff700 1 -- start start 2023-10-08T16:08:57.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48395ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4834159860 0x7f48340ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.255 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48395ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48395ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48340cf510 con 0x7f48340cbd90 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48395ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48340d00b0 con 0x7f4834159860 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48395ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48340cc210 con 0x7f48340ccfa0 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f4832ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4834159860 0x7f48340ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48337fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48337fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50510/0 (socket says 172.21.15.29:50510) 2023-10-08T16:08:57.256 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.254+0000 7f48337fe700 1 -- 172.21.15.29:0/3131688834 learned_addr learned my addr 172.21.15.29:0/3131688834 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:57.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4832ffd700 1 -- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 msgr2=0x7f48340cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:57.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4832ffd700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.258 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4832ffd700 1 -- 172.21.15.29:0/3131688834 >> v1:172.21.15.12:6789/0 conn(0x7f48340cbd90 legacy=0x7f48340cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4832ffd700 1 -- 172.21.15.29:0/3131688834 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340cd960 con 0x7f4834159860 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f48337fe700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4832ffd700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4834159860 0x7f48340ce220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f48240098d0 tx=0x7f4824009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe8a02fc36049 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4831ffb700 1 -- 172.21.15.29:0/3131688834 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824005c10 con 0x7f4834159860 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4831ffb700 1 -- 172.21.15.29:0/3131688834 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824005d70 con 0x7f4834159860 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.255+0000 7f4831ffb700 1 -- 172.21.15.29:0/3131688834 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824006280 con 0x7f4834159860 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 -- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4834159860 msgr2=0x7f48340ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.259 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4834159860 0x7f48340ce220 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f48240098d0 tx=0x7f4824009120 comp rx=0 tx=0).stop 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 -- 172.21.15.29:0/3131688834 shutdown_connections 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f48340cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 --2- 172.21.15.29:0/3131688834 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4834159860 0x7f48340ce220 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 -- 172.21.15.29:0/3131688834 >> 172.21.15.29:0/3131688834 conn(0x7f48340999b0 msgr2=0x7f4834070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 -- 172.21.15.29:0/3131688834 shutdown_connections 2023-10-08T16:08:57.260 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.256+0000 7f48395ff700 1 -- 172.21.15.29:0/3131688834 wait complete. 2023-10-08T16:08:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.259+0000 7f48395ff700 1 Processor -- start 2023-10-08T16:08:57.261 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.259+0000 7f48395ff700 1 -- start start 2023-10-08T16:08:57.263 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f483415ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4834159860 0x7f483415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4834158950 con 0x7f4834159860 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483409b510 con 0x7f48340cbd90 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.260+0000 7f48395ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483409a900 con 0x7f48340ccfa0 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56084/0 (socket says 172.21.15.29:56084) 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 -- 172.21.15.29:0/4118760438 learned_addr learned my addr 172.21.15.29:0/4118760438 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f48327fc700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f483415ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.264 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f48337fe700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4834159860 0x7f483415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 -- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 msgr2=0x7f483415ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f483415ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 -- 172.21.15.29:0/4118760438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4834159860 msgr2=0x7f483415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4834159860 0x7f483415b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f4832ffd700 1 -- 172.21.15.29:0/4118760438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c009ae0 con 0x7f48340cbd90 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.261+0000 7f48327fc700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f483415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f4832ffd700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4824003080 tx=0x7f4824015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824000d10 con 0x7f48340cbd90 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4824006260 con 0x7f48340cbd90 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48240093c0 con 0x7f48340cbd90 2023-10-08T16:08:57.265 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824011d10 con 0x7f48340cbd90 2023-10-08T16:08:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483409aec0 con 0x7f48340cbd90 2023-10-08T16:08:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4824023070 con 0x7f48340cbd90 2023-10-08T16:08:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.262+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f482401c430 con 0x7f48340cbd90 2023-10-08T16:08:57.266 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.263+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483409b7f0 con 0x7f48340cbd90 2023-10-08T16:08:57.267 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.266+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4824026a40 con 0x7f48340cbd90 2023-10-08T16:08:57.356 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.355+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b3f88c40-0762-47e9-b476-591d845036b1", "id": 0} v 0) v1 -- 0x7f483404c3c0 con 0x7f48340cbd90 2023-10-08T16:08:57.420 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.363+0000 7f481affd700 1 -- 172.21.15.29:0/4118760438 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b3f88c40-0762-47e9-b476-591d845036b1", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4824026be0 con 0x7f48340cbd90 2023-10-08T16:08:57.420 INFO:teuthology.orchestra.run.smithi029.stdout:0 2023-10-08T16:08:57.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 msgr2=0x7f48340c8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4824003080 tx=0x7f4824015000 comp rx=0 tx=0).stop 2023-10-08T16:08:57.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 shutdown_connections 2023-10-08T16:08:57.421 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4834159860 0x7f483415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48340cbd90 0x7f48340c8de0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 --2- 172.21.15.29:0/4118760438 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48340ccfa0 0x7f483415ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 >> 172.21.15.29:0/4118760438 conn(0x7f48340999b0 msgr2=0x7f48340b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 shutdown_connections 2023-10-08T16:08:57.422 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.364+0000 7f48395ff700 1 -- 172.21.15.29:0/4118760438 wait complete. 2023-10-08T16:08:57.422 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new 52b48da5-8abc-4fa2-9966-fab8ecd6cdb7 1 2023-10-08T16:08:57.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.607+0000 7f0d7d99d700 1 Processor -- start 2023-10-08T16:08:57.617 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.607+0000 7f0d7d99d700 1 -- start start 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.608+0000 7f0d7d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.608+0000 7f0d7d99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 0x7f0d7815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7d99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7815af60 con 0x7f0d780cea00 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7d99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d7815d010 con 0x7f0d7815de50 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7815b240 con 0x7f0d78153a00 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d77fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 0x7f0d7815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.621 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d77fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 0x7f0d7815a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56088/0 (socket says 172.21.15.29:56088) 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50528/0 (socket says 172.21.15.29:50528) 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d77fff700 1 -- 172.21.15.29:0/3891761175 learned_addr learned my addr 172.21.15.29:0/3891761175 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 -- 172.21.15.29:0/3891761175 >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 msgr2=0x7f0d7815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 --2- 172.21.15.29:0/3891761175 >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 0x7f0d7815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 -- 172.21.15.29:0/3891761175 >> v1:172.21.15.12:6789/0 conn(0x7f0d780cea00 legacy=0x7f0d780cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d777fe700 1 -- 172.21.15.29:0/3891761175 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127972545 0 0) 0x7f0d7815af60 con 0x7f0d780cea00 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.609+0000 7f0d7c99b700 1 -- 172.21.15.29:0/3891761175 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7815b520 con 0x7f0d78153a00 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d7c99b700 1 --2- 172.21.15.29:0/3891761175 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0098e0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ea7d78abfd1d6df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d777fe700 1 -- 172.21.15.29:0/3891761175 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00b640 con 0x7f0d78153a00 2023-10-08T16:08:57.622 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d777fe700 1 -- 172.21.15.29:0/3891761175 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00b7a0 con 0x7f0d78153a00 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d777fe700 1 -- 172.21.15.29:0/3891761175 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00bb40 con 0x7f0d78153a00 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d7d99d700 1 -- 172.21.15.29:0/3891761175 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 msgr2=0x7f0d78153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.610+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/3891761175 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0098e0 tx=0x7f0d6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 -- 172.21.15.29:0/3891761175 shutdown_connections 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/3891761175 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d78153a00 0x7f0d78153dd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/3891761175 >> v2:172.21.15.29:3300/0 conn(0x7f0d7815de50 0x7f0d7815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 -- 172.21.15.29:0/3891761175 >> 172.21.15.29:0/3891761175 conn(0x7f0d780703a0 msgr2=0x7f0d780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 -- 172.21.15.29:0/3891761175 shutdown_connections 2023-10-08T16:08:57.623 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.611+0000 7f0d7d99d700 1 -- 172.21.15.29:0/3891761175 wait complete. 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.612+0000 7f0d7d99d700 1 Processor -- start 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.612+0000 7f0d7d99d700 1 -- start start 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d78153a00 0x7f0d780cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815de50 0x7f0d780cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d78150f20 con 0x7f0d78153a00 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b1a10 con 0x7f0d7815de50 2023-10-08T16:08:57.624 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b1cf0 con 0x7f0d780cea00 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7c99b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7c99b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50534/0 (socket says 172.21.15.29:50534) 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7c99b700 1 -- 172.21.15.29:0/2736722965 learned_addr learned my addr 172.21.15.29:0/2736722965 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d7d19c700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815de50 0x7f0d780cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.613+0000 7f0d77fff700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d78153a00 0x7f0d780cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 -- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815de50 msgr2=0x7f0d780cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.625 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815de50 0x7f0d780cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 -- 172.21.15.29:0/2736722965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d78153a00 msgr2=0x7f0d780cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d78153a00 0x7f0d780cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 -- 172.21.15.29:0/2736722965 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009420 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7c99b700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d7815b380 tx=0x7f0d6c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00bb20 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c000c90 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c011630 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.614+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780b1fd0 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.615+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780b2590 con 0x7f0d780cea00 2023-10-08T16:08:57.626 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.615+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0d6c0119a0 con 0x7f0d780cea00 2023-10-08T16:08:57.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.615+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f0d6c02c9d0 con 0x7f0d780cea00 2023-10-08T16:08:57.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.616+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d780b2780 con 0x7f0d780cea00 2023-10-08T16:08:57.627 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.619+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f0d6c031060 con 0x7f0d780cea00 2023-10-08T16:08:57.707 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.706+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd new", "uuid": "52b48da5-8abc-4fa2-9966-fab8ecd6cdb7", "id": 1} v 0) v1 -- 0x7f0d7804c3c0 con 0x7f0d780cea00 2023-10-08T16:08:57.715 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.714+0000 7f0d74ff9700 1 -- 172.21.15.29:0/2736722965 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "52b48da5-8abc-4fa2-9966-fab8ecd6cdb7", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d6c015020 con 0x7f0d780cea00 2023-10-08T16:08:57.715 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 msgr2=0x7f0d781509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0d7815b380 tx=0x7f0d6c017000 comp rx=0 tx=0).stop 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 shutdown_connections 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d7815de50 0x7f0d780cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d780cea00 0x7f0d781509e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 --2- 172.21.15.29:0/2736722965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d78153a00 0x7f0d780cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.715+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 >> 172.21.15.29:0/2736722965 conn(0x7f0d780703a0 msgr2=0x7f0d78158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.716+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 shutdown_connections 2023-10-08T16:08:57.717 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.716+0000 7f0d7d99d700 1 -- 172.21.15.29:0/2736722965 wait complete. 2023-10-08T16:08:57.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new b09982ef-2211-4f91-9baf-3aac0f1c92ee 2 2023-10-08T16:08:57.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.920+0000 7f9b5bfff700 1 Processor -- start 2023-10-08T16:08:57.922 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.921+0000 7f9b5bfff700 1 -- start start 2023-10-08T16:08:57.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9b5c0cf110 0x7f9b5c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c15ac50 con 0x7f9b5c153dd0 2023-10-08T16:08:57.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5c15d010 con 0x7f9b5c153a00 2023-10-08T16:08:57.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5c15af60 con 0x7f9b5c0cf110 2023-10-08T16:08:57.923 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5affd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9b5c153a00 0x7f9b5c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54100/0 (socket says 172.21.15.29:54100) 2023-10-08T16:08:57.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5affd700 1 -- 172.21.15.29:0/3530168616 learned_addr learned my addr 172.21.15.29:0/3530168616 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T16:08:57.924 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.922+0000 7f9b5b7fe700 1 --2- 172.21.15.29:0/3530168616 >> v2:172.21.15.29:3300/0 conn(0x7f9b5c0cf110 0x7f9b5c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b5b7fe700 1 -- 172.21.15.29:0/3530168616 >> v1:172.21.15.29:6789/0 conn(0x7f9b5c153a00 legacy=0x7f9b5c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b5b7fe700 1 -- 172.21.15.29:0/3530168616 >> v1:172.21.15.12:6789/0 conn(0x7f9b5c153dd0 legacy=0x7f9b5c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b5b7fe700 1 -- 172.21.15.29:0/3530168616 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5c15b240 con 0x7f9b5c0cf110 2023-10-08T16:08:57.925 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b59ffb700 1 -- 172.21.15.29:0/3530168616 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1967464627 0 0) 0x7f9b5c15ac50 con 0x7f9b5c153dd0 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b5b7fe700 1 --2- 172.21.15.29:0/3530168616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c15de50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e60 tx=0x7f9b54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ba280efe4f8aea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b59ffb700 1 -- 172.21.15.29:0/3530168616 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5400e070 con 0x7f9b5c0cf110 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b59ffb700 1 -- 172.21.15.29:0/3530168616 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b5400bc30 con 0x7f9b5c0cf110 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.923+0000 7f9b59ffb700 1 -- 172.21.15.29:0/3530168616 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b54012430 con 0x7f9b5c0cf110 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 -- 172.21.15.29:0/3530168616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0cf110 msgr2=0x7f9b5c15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/3530168616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c15de50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9b54009e60 tx=0x7f9b54009780 comp rx=0 tx=0).stop 2023-10-08T16:08:57.926 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 -- 172.21.15.29:0/3530168616 shutdown_connections 2023-10-08T16:08:57.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/3530168616 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c15de50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 -- 172.21.15.29:0/3530168616 >> 172.21.15.29:0/3530168616 conn(0x7f9b5c0703a0 msgr2=0x7f9b5c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:57.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 -- 172.21.15.29:0/3530168616 shutdown_connections 2023-10-08T16:08:57.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.924+0000 7f9b5bfff700 1 -- 172.21.15.29:0/3530168616 wait complete. 2023-10-08T16:08:57.927 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.927+0000 7f9b5bfff700 1 Processor -- start 2023-10-08T16:08:57.928 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.927+0000 7f9b5bfff700 1 -- start start 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 0x7f9b5c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0b4820 con 0x7f9b5c0cf110 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c8b70 con 0x7f9b5c153a00 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.928+0000 7f9b5bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5c0c82d0 con 0x7f9b5c153dd0 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.29:51602/0 (socket says 172.21.15.29:51602) 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50536/0 (socket says 172.21.15.29:50536) 2023-10-08T16:08:57.930 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 -- 172.21.15.29:0/491040527 learned_addr learned my addr 172.21.15.29:0/491040527 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:57.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 -- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 msgr2=0x7f9b5c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 -- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 msgr2=0x7f9b5c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:57.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5a7fc700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 0x7f9b5c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:57.932 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 0x7f9b5c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5affd700 1 -- 172.21.15.29:0/491040527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b54009a20 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5b7fe700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.929+0000 7f9b5a7fc700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 0x7f9b5c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b5affd700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c7c0 tx=0x7f9b4c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c005b30 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4c005c90 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c0072e0 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5c0c85b0 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5c152b20 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9b4c01c6c0 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.930+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9b4c005e00 con 0x7f9b5c0cf110 2023-10-08T16:08:57.933 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.931+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b5c0b45f0 con 0x7f9b5c0cf110 2023-10-08T16:08:57.935 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:57.934+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9b4c021060 con 0x7f9b5c0cf110 2023-10-08T16:08:58.053 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.052+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b09982ef-2211-4f91-9baf-3aac0f1c92ee", "id": 2} v 0) v1 -- 0x7f9b5c04c3c0 con 0x7f9b5c0cf110 2023-10-08T16:08:58.060 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.059+0000 7f9b42ffd700 1 -- 172.21.15.29:0/491040527 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b09982ef-2211-4f91-9baf-3aac0f1c92ee", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9b4c017070 con 0x7f9b5c0cf110 2023-10-08T16:08:58.060 INFO:teuthology.orchestra.run.smithi029.stdout:2 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 msgr2=0x7f9b5c1525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c7c0 tx=0x7f9b4c007f70 comp rx=0 tx=0).stop 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 shutdown_connections 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9b5c0cf110 0x7f9b5c1525e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9b5c153dd0 0x7f9b5c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 --2- 172.21.15.29:0/491040527 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9b5c153a00 0x7f9b5c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.060+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 >> 172.21.15.29:0/491040527 conn(0x7f9b5c0703a0 msgr2=0x7f9b5c0b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.061+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 shutdown_connections 2023-10-08T16:08:58.062 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.061+0000 7f9b5bfff700 1 -- 172.21.15.29:0/491040527 wait complete. 2023-10-08T16:08:58.080 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new 6fc5ba17-37ee-493a-8505-36897a935766 3 2023-10-08T16:08:58.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.287+0000 7f9bd6b9d700 1 Processor -- start 2023-10-08T16:08:58.289 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.288+0000 7f9bd6b9d700 1 -- start start 2023-10-08T16:08:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd6b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9bd00c7350 0x7f9bd00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd6b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd006a280 con 0x7f9bd006de50 2023-10-08T16:08:58.291 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd6b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd006ed90 con 0x7f9bd00c6ed0 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd6b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd00c9d00 con 0x7f9bd00c7350 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd539a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9bd00c6ed0 0x7f9bd0069b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54104/0 (socket says 172.21.15.29:54104) 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd539a700 1 -- 172.21.15.29:0/653848080 learned_addr learned my addr 172.21.15.29:0/653848080 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd639c700 1 --2- 172.21.15.29:0/653848080 >> v2:172.21.15.12:3300/0 conn(0x7f9bd00c7350 0x7f9bd00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878528975 0 0) 0x7f9bd006ed90 con 0x7f9bd00c6ed0 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.289+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc003570 con 0x7f9bd00c6ed0 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190679627 0 0) 0x7f9bcc001160 con 0x7f9bd006de50 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd006ed90 con 0x7f9bd006de50 2023-10-08T16:08:58.292 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd639c700 1 -- 172.21.15.29:0/653848080 >> v1:172.21.15.29:6789/0 conn(0x7f9bd00c6ed0 legacy=0x7f9bd0069b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd639c700 1 -- 172.21.15.29:0/653848080 >> v1:172.21.15.12:6789/0 conn(0x7f9bd006de50 legacy=0x7f9bd006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd639c700 1 -- 172.21.15.29:0/653848080 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd00c9fe0 con 0x7f9bd00c7350 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd639c700 1 --2- 172.21.15.29:0/653848080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c7350 0x7f9bd00cb080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc2ab68cdffa9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800e070 con 0x7f9bd00c7350 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc800bab0 con 0x7f9bd00c7350 2023-10-08T16:08:58.293 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.290+0000 7f9bd4b99700 1 -- 172.21.15.29:0/653848080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc800be70 con 0x7f9bd00c7350 2023-10-08T16:08:58.297 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/653848080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c7350 msgr2=0x7f9bd00cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/653848080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c7350 0x7f9bd00cb080 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8009e60 tx=0x7f9bc8009780 comp rx=0 tx=0).stop 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/653848080 shutdown_connections 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/653848080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c7350 0x7f9bd00cb080 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/653848080 >> 172.21.15.29:0/653848080 conn(0x7f9bd006d130 msgr2=0x7f9bd00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/653848080 shutdown_connections 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.291+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/653848080 wait complete. 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.292+0000 7f9bd6b9d700 1 Processor -- start 2023-10-08T16:08:58.298 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.293+0000 7f9bd6b9d700 1 -- start start 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.293+0000 7f9bd6b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.293+0000 7f9bd6b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 0x7f9bd00b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.293+0000 7f9bd6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bd00c7350 0x7f9bd00c1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd6b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00b1a80 con 0x7f9bd00c6ed0 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd6b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd017a090 con 0x7f9bd006de50 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd00c3cb0 con 0x7f9bd00c7350 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56130/0 (socket says 172.21.15.29:56130) 2023-10-08T16:08:58.299 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 -- 172.21.15.29:0/1907368990 learned_addr learned my addr 172.21.15.29:0/1907368990 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd539a700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 0x7f9bd00b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd639c700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bd00c7350 0x7f9bd00c1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 -- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bd00c7350 msgr2=0x7f9bd00c1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bd00c7350 0x7f9bd00c1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 -- 172.21.15.29:0/1907368990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 msgr2=0x7f9bd00b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 0x7f9bd00b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd5b9b700 1 -- 172.21.15.29:0/1907368990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009a20 con 0x7f9bd006de50 2023-10-08T16:08:58.300 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.294+0000 7f9bd539a700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 0x7f9bd00b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bd5b9b700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c7c0 tx=0x7f9bcc007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc002ea0 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc011590 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc011930 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd00c3380 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd00c3940 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9bcc011ca0 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.295+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f9bcc012420 con 0x7f9bd006de50 2023-10-08T16:08:58.301 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.296+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd00aeb00 con 0x7f9bd006de50 2023-10-08T16:08:58.302 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.299+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9bd00aeb00 con 0x7f9bd006de50 2023-10-08T16:08:58.336 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:58.336+0000 7f4876250180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:08:58.389 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.388+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6fc5ba17-37ee-493a-8505-36897a935766", "id": 3} v 0) v1 -- 0x7f9bd004c3c0 con 0x7f9bd006de50 2023-10-08T16:08:58.393 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.392+0000 7f9bc5ffb700 1 -- 172.21.15.29:0/1907368990 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6fc5ba17-37ee-493a-8505-36897a935766", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9bd006a280 con 0x7f9bd006de50 2023-10-08T16:08:58.393 INFO:teuthology.orchestra.run.smithi029.stdout:3 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.393+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 msgr2=0x7f9bd0166f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.393+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc00c7c0 tx=0x7f9bcc007c70 comp rx=0 tx=0).stop 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 shutdown_connections 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bd00c7350 0x7f9bd00c1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bd006de50 0x7f9bd0166f20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 --2- 172.21.15.29:0/1907368990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bd00c6ed0 0x7f9bd00b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 >> 172.21.15.29:0/1907368990 conn(0x7f9bd006d130 msgr2=0x7f9bd0169de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 shutdown_connections 2023-10-08T16:08:58.395 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.394+0000 7f9bd6b9d700 1 -- 172.21.15.29:0/1907368990 wait complete. 2023-10-08T16:08:58.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new 8bb8e057-6efe-4ad6-b188-441da397f8a7 4 2023-10-08T16:08:58.449 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:58.448+0000 7fa9ddc9b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:08:58.506 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:58.506+0000 7f4876250180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:08:58.599 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.598+0000 7fc3f97ff700 1 Processor -- start 2023-10-08T16:08:58.600 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.598+0000 7fc3f97ff700 1 -- start start 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f97ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 0x7fc3f415b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f97ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f97ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f40cc2e0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f97ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f40ce300 con 0x7fc3f40c8d90 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f97ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cce60 con 0x7fc3f40c9160 2023-10-08T16:08:58.601 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 0x7fc3f415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50556/0 (socket says 172.21.15.29:50556) 2023-10-08T16:08:58.602 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f37fe700 1 -- 172.21.15.29:0/878665375 learned_addr learned my addr 172.21.15.29:0/878665375 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:58.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f37fe700 1 -- 172.21.15.29:0/878665375 >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 msgr2=0x7fc3f415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:58.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f37fe700 1 --2- 172.21.15.29:0/878665375 >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 0x7fc3f415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.600+0000 7fc3f1ffb700 1 -- 172.21.15.29:0/878665375 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418755927 0 0) 0x7fc3f40cc2e0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.603 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f37fe700 1 -- 172.21.15.29:0/878665375 >> v1:172.21.15.12:6789/0 conn(0x7fc3f406a3e0 legacy=0x7fc3f4157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f37fe700 1 -- 172.21.15.29:0/878665375 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f40cc530 con 0x7fc3f40c9160 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f2ffd700 1 --2- 172.21.15.29:0/878665375 >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 0x7fc3f415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f37fe700 1 --2- 172.21.15.29:0/878665375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009f20 tx=0x7fc3ec009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4041353b7117dc8f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f1ffb700 1 -- 172.21.15.29:0/878665375 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec00e070 con 0x7fc3f40c9160 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f1ffb700 1 -- 172.21.15.29:0/878665375 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec00b9d0 con 0x7fc3f40c9160 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.601+0000 7fc3f1ffb700 1 -- 172.21.15.29:0/878665375 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec0092e0 con 0x7fc3f40c9160 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 -- 172.21.15.29:0/878665375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 msgr2=0x7fc3f4157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/878665375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009f20 tx=0x7fc3ec009840 comp rx=0 tx=0).stop 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 -- 172.21.15.29:0/878665375 shutdown_connections 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/878665375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f4157710 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/878665375 >> v2:172.21.15.12:3300/0 conn(0x7fc3f40c8d90 0x7fc3f415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.604 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 -- 172.21.15.29:0/878665375 >> 172.21.15.29:0/878665375 conn(0x7fc3f4067f00 msgr2=0x7fc3f4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 -- 172.21.15.29:0/878665375 shutdown_connections 2023-10-08T16:08:58.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.602+0000 7fc3f97ff700 1 -- 172.21.15.29:0/878665375 wait complete. 2023-10-08T16:08:58.605 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:58.604+0000 7f4876250180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:08:58.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.604+0000 7fc3f97ff700 1 Processor -- start 2023-10-08T16:08:58.605 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.604+0000 7fc3f97ff700 1 -- start start 2023-10-08T16:08:58.606 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 0x7fc3f40c36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f40afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4159b70 con 0x7fc3f406a3e0 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40c3f30 con 0x7fc3f40c8d90 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f97ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f4159df0 con 0x7fc3f40c9160 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f27fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 0x7fc3f40c36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.29:51646/0 (socket says 172.21.15.29:51646) 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f2ffd700 1 -- 172.21.15.29:0/3101857305 learned_addr learned my addr 172.21.15.29:0/3101857305 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:58.607 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.605+0000 7fc3f37fe700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f40afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.608 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 -- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 msgr2=0x7fc3f40afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f40afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 -- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 msgr2=0x7fc3f40c36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 0x7fc3f40c36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 -- 172.21.15.29:0/3101857305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e4009420 con 0x7fc3f406a3e0 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f27fc700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 0x7fc3f40c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3f2ffd700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400ec80 tx=0x7fc3e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400c920 con 0x7fc3f406a3e0 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.606+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e400ca80 con 0x7fc3f406a3e0 2023-10-08T16:08:58.609 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.607+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e400ce00 con 0x7fc3f406a3e0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.607+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec009ae0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.607+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f415a3b0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.607+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc3e4013900 con 0x7fc3f406a3e0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.607+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fc3e401cc80 con 0x7fc3f406a3e0 2023-10-08T16:08:58.610 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.608+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f415a5d0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.611 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.610+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc3e4021060 con 0x7fc3f406a3e0 2023-10-08T16:08:58.656 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:58.655+0000 7fa9ddc9b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:08:58.699 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.698+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8bb8e057-6efe-4ad6-b188-441da397f8a7", "id": 4} v 0) v1 -- 0x7fc3f404c3c0 con 0x7fc3f406a3e0 2023-10-08T16:08:58.702 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.701+0000 7fc3daffd700 1 -- 172.21.15.29:0/3101857305 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8bb8e057-6efe-4ad6-b188-441da397f8a7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3e4017070 con 0x7fc3f406a3e0 2023-10-08T16:08:58.702 INFO:teuthology.orchestra.run.smithi029.stdout:4 2023-10-08T16:08:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 msgr2=0x7fc3f415a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400ec80 tx=0x7fc3e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.704 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 shutdown_connections 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc3f406a3e0 0x7fc3f415a8d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc3f40c9160 0x7fc3f40afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 --2- 172.21.15.29:0/3101857305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc3f40c8d90 0x7fc3f40c36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 >> 172.21.15.29:0/3101857305 conn(0x7fc3f4067f00 msgr2=0x7fc3f4069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 shutdown_connections 2023-10-08T16:08:58.705 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.703+0000 7fc3f97ff700 1 -- 172.21.15.29:0/3101857305 wait complete. 2023-10-08T16:08:58.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new 8a4c2509-6d27-49b8-878f-36ac07816e18 5 2023-10-08T16:08:58.778 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:58.777+0000 7fa9ddc9b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:08:58.833 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:58.833+0000 7f4876250180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:08:58.945 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.944+0000 7fcd8f39d700 1 Processor -- start 2023-10-08T16:08:58.946 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.945+0000 7fcd8f39d700 1 -- start start 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 0x7fcd8815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8f39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8815ac50 con 0x7fcd88153a00 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8f39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd8815d010 con 0x7fcd880cea00 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8815af60 con 0x7fcd88153dd0 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8db9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 0x7fcd8815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8eb9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fcd880cea00 0x7fcd880cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54112/0 (socket says 172.21.15.29:54112) 2023-10-08T16:08:58.948 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8eb9c700 1 -- 172.21.15.29:0/1642704597 learned_addr learned my addr 172.21.15.29:0/1642704597 (peer_addr_for_me v1:172.21.15.29:0/0) 2023-10-08T16:08:58.949 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.947+0000 7fcd8e39b700 1 --1- 172.21.15.29:0/1642704597 >> v1:172.21.15.12:6789/0 conn(0x7fcd88153a00 0x7fcd8815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.29:50622/0 (socket says 172.21.15.29:50622) 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908544595 0 0) 0x7fcd8815ac50 con 0x7fcd88153a00 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd74003570 con 0x7fcd88153a00 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028287315 0 0) 0x7fcd8815d010 con 0x7fcd880cea00 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd8815ac50 con 0x7fcd880cea00 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8db9a700 1 -- 172.21.15.29:0/1642704597 >> v1:172.21.15.29:6789/0 conn(0x7fcd880cea00 legacy=0x7fcd880cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8db9a700 1 -- 172.21.15.29:0/1642704597 >> v1:172.21.15.12:6789/0 conn(0x7fcd88153a00 legacy=0x7fcd8815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8db9a700 1 -- 172.21.15.29:0/1642704597 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8815b240 con 0x7fcd88153dd0 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8db9a700 1 --2- 172.21.15.29:0/1642704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 0x7fcd8815de50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009910 tx=0x7fcd780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ec6787c150801b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.948+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011630 con 0x7fcd88153dd0 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78011790 con 0x7fcd88153dd0 2023-10-08T16:08:58.950 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8d399700 1 -- 172.21.15.29:0/1642704597 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011b30 con 0x7fcd88153dd0 2023-10-08T16:08:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 -- 172.21.15.29:0/1642704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 msgr2=0x7fcd8815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/1642704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 0x7fcd8815de50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcd78009910 tx=0x7fcd780091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 -- 172.21.15.29:0/1642704597 shutdown_connections 2023-10-08T16:08:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/1642704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153dd0 0x7fcd8815de50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.951 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 -- 172.21.15.29:0/1642704597 >> 172.21.15.29:0/1642704597 conn(0x7fcd880703a0 msgr2=0x7fcd880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 -- 172.21.15.29:0/1642704597 shutdown_connections 2023-10-08T16:08:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.949+0000 7fcd8f39d700 1 -- 172.21.15.29:0/1642704597 wait complete. 2023-10-08T16:08:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.951+0000 7fcd8f39d700 1 Processor -- start 2023-10-08T16:08:58.952 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.951+0000 7fcd8f39d700 1 -- start start 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 0x7fcd88151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 0x7fcd88154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd880c8b80 con 0x7fcd880cea00 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd88156510 con 0x7fcd88153dd0 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd881567f0 con 0x7fcd88153a00 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8eb9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.954 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8db9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 0x7fcd88154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8eb9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56142/0 (socket says 172.21.15.29:56142) 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8eb9c700 1 -- 172.21.15.29:0/3289605413 learned_addr learned my addr 172.21.15.29:0/3289605413 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.952+0000 7fcd8e39b700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 0x7fcd88151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 -- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 msgr2=0x7fcd88155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 -- 172.21.15.29:0/3289605413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 msgr2=0x7fcd88151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 0x7fcd88151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 -- 172.21.15.29:0/3289605413 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78009420 con 0x7fcd88153a00 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8eb9c700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:58.955 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8e39b700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 0x7fcd88151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:58.956 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.953+0000 7fcd8db9a700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 0x7fcd88154fe0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd78016000 tx=0x7fcd78017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd7801f070 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78002f70 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd88156ad0 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011900 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd88157090 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcd78023070 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.954+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fcd78011a60 con 0x7fcd88153a00 2023-10-08T16:08:58.957 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.955+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd880c89e0 con 0x7fcd88153a00 2023-10-08T16:08:58.958 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:58.958+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcd880c89e0 con 0x7fcd88153a00 2023-10-08T16:08:59.050 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:59.049+0000 7fa9ddc9b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:08:59.052 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:59.053+0000 7f4876250180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:08:59.070 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.069+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8a4c2509-6d27-49b8-878f-36ac07816e18", "id": 5} v 0) v1 -- 0x7fcd880c8cf0 con 0x7fcd88153a00 2023-10-08T16:08:59.074 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.073+0000 7fcd7e7fc700 1 -- 172.21.15.29:0/3289605413 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a4c2509-6d27-49b8-878f-36ac07816e18", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcd7802a070 con 0x7fcd88153a00 2023-10-08T16:08:59.074 INFO:teuthology.orchestra.run.smithi029.stdout:5 2023-10-08T16:08:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 msgr2=0x7fcd88154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 0x7fcd88154fe0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcd78016000 tx=0x7fcd78017000 comp rx=0 tx=0).stop 2023-10-08T16:08:59.075 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 shutdown_connections 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcd880cea00 0x7fcd88151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcd88153dd0 0x7fcd88155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 --2- 172.21.15.29:0/3289605413 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcd88153a00 0x7fcd88154fe0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 >> 172.21.15.29:0/3289605413 conn(0x7fcd880703a0 msgr2=0x7fcd88152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 shutdown_connections 2023-10-08T16:08:59.076 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.074+0000 7fcd8f39d700 1 -- 172.21.15.29:0/3289605413 wait complete. 2023-10-08T16:08:59.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new 35731bb8-abf5-4baf-a7d8-c1d376952af9 6 2023-10-08T16:08:59.151 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:59.151+0000 7f4876250180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:08:59.298 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:59.297+0000 7fa9ddc9b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:08:59.316 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:59.316+0000 7f4876250180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:08:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.319+0000 7f5305b9d700 1 Processor -- start 2023-10-08T16:08:59.320 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.319+0000 7f5305b9d700 1 -- start start 2023-10-08T16:08:59.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.320+0000 7f5305b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f5300153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.320+0000 7f5305b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530015de50 0x7f530015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.322 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.320+0000 7f5305b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530015af60 con 0x7f53000cea00 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.320+0000 7f5305b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f530015d010 con 0x7f530015de50 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.320+0000 7f5305b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530015b240 con 0x7f5300153a00 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530015de50 0x7f530015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f5304b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f5300153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f530015de50 0x7f530015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56152/0 (socket says 172.21.15.29:56152) 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 -- 172.21.15.29:0/1254169358 learned_addr learned my addr 172.21.15.29:0/1254169358 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f530539c700 1 --1- 172.21.15.29:0/1254169358 >> v1:172.21.15.29:6789/0 conn(0x7f53000cea00 0x7f53000cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.29:54116/0 (socket says 172.21.15.29:54116) 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 -- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 msgr2=0x7f5300153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f5300153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 -- 172.21.15.29:0/1254169358 >> v1:172.21.15.29:6789/0 conn(0x7f53000cea00 legacy=0x7f53000cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f52fffff700 1 -- 172.21.15.29:0/1254169358 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530015b520 con 0x7f530015de50 2023-10-08T16:08:59.323 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.321+0000 7f5304b9b700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f5300153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.322+0000 7f52fffff700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530015de50 0x7f530015a540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0099b0 tx=0x7f52ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90a30f423ff3d0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.322+0000 7f52ff7fe700 1 -- 172.21.15.29:0/1254169358 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec009ea0 con 0x7f530015de50 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.322+0000 7f52ff7fe700 1 -- 172.21.15.29:0/1254169358 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00b860 con 0x7f530015de50 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.322+0000 7f52ff7fe700 1 -- 172.21.15.29:0/1254169358 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec00bc00 con 0x7f530015de50 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 -- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530015de50 msgr2=0x7f530015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530015de50 0x7f530015a540 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f52ec0099b0 tx=0x7f52ec009250 comp rx=0 tx=0).stop 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 -- 172.21.15.29:0/1254169358 shutdown_connections 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f5300153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1254169358 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530015de50 0x7f530015a540 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 -- 172.21.15.29:0/1254169358 >> 172.21.15.29:0/1254169358 conn(0x7f53000703a0 msgr2=0x7f53000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.325 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 -- 172.21.15.29:0/1254169358 shutdown_connections 2023-10-08T16:08:59.326 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.323+0000 7f5305b9d700 1 -- 172.21.15.29:0/1254169358 wait complete. 2023-10-08T16:08:59.327 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.324+0000 7f5305b9d700 1 Processor -- start 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 -- start start 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 0x7f53000b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530015de50 0x7f5300169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000b0af0 con 0x7f530015de50 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000b04e0 con 0x7f53000cea00 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.325+0000 7f5305b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000cbc60 con 0x7f5300153a00 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f5304b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 0x7f53000b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.29:50612/0 (socket says 172.21.15.29:50612) 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 -- 172.21.15.29:0/1083723631 learned_addr learned my addr 172.21.15.29:0/1083723631 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:59.328 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f530539c700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530015de50 0x7f5300169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 -- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 msgr2=0x7f53000b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 0x7f53000b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 -- 172.21.15.29:0/1083723631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530015de50 msgr2=0x7f5300169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530015de50 0x7f5300169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f52fffff700 1 -- 172.21.15.29:0/1083723631 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009420 con 0x7f5300153a00 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.326+0000 7f5304b9b700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 0x7f53000b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:59.329 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fffff700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f530006eb00 tx=0x7f52ec017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec000d10 con 0x7f5300153a00 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec00bbe0 con 0x7f5300153a00 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec011670 con 0x7f5300153a00 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52ec0094f0 con 0x7f5300153a00 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53000b0780 con 0x7f5300153a00 2023-10-08T16:08:59.330 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f52ec011d20 con 0x7f5300153a00 2023-10-08T16:08:59.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.327+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f52ec02edb0 con 0x7f5300153a00 2023-10-08T16:08:59.331 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.328+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000cc160 con 0x7f5300153a00 2023-10-08T16:08:59.332 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.331+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f53000cc160 con 0x7f5300153a00 2023-10-08T16:08:59.404 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:59.403+0000 7fa9ddc9b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:08:59.438 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:08:59.439+0000 7f4876250180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:08:59.439 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.438+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd new", "uuid": "35731bb8-abf5-4baf-a7d8-c1d376952af9", "id": 6} v 0) v1 -- 0x7f53000b0c60 con 0x7f5300153a00 2023-10-08T16:08:59.443 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.442+0000 7f52fcff9700 1 -- 172.21.15.29:0/1083723631 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35731bb8-abf5-4baf-a7d8-c1d376952af9", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f52ec033060 con 0x7f5300153a00 2023-10-08T16:08:59.443 INFO:teuthology.orchestra.run.smithi029.stdout:6 2023-10-08T16:08:59.444 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 msgr2=0x7f53001519b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f530006eb00 tx=0x7f52ec017000 comp rx=0 tx=0).stop 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 shutdown_connections 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530015de50 0x7f5300169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53000cea00 0x7f53000b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 --2- 172.21.15.29:0/1083723631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5300153a00 0x7f53001519b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 >> 172.21.15.29:0/1083723631 conn(0x7f53000703a0 msgr2=0x7f530015e380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 shutdown_connections 2023-10-08T16:08:59.445 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.443+0000 7f5305b9d700 1 -- 172.21.15.29:0/1083723631 wait complete. 2023-10-08T16:08:59.462 DEBUG:teuthology.orchestra.run.smithi029:> sudo ceph --cluster ceph osd new f1671df4-437c-41c9-8b0d-10a0e2d1dbfa 7 2023-10-08T16:08:59.575 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:59.575+0000 7fa9ddc9b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:08:59.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.645+0000 7fe69299d700 1 Processor -- start 2023-10-08T16:08:59.646 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.645+0000 7fe69299d700 1 -- start start 2023-10-08T16:08:59.649 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 0x7fe68c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe68c0cea00 0x7fe68c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69299d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c15ac50 con 0x7fe68c15de50 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c15d010 con 0x7fe68c153a00 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0cf3c0 con 0x7fe68c0cea00 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69219c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe68c0cea00 0x7fe68c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.646+0000 7fe69199b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 0x7fe68c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe68c0cea00 0x7fe68c0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56164/0 (socket says 172.21.15.29:56164) 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 -- 172.21.15.29:0/536291425 learned_addr learned my addr 172.21.15.29:0/536291425 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:59.650 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 -- 172.21.15.29:0/536291425 >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 msgr2=0x7fe68c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 --2- 172.21.15.29:0/536291425 >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 0x7fe68c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 -- 172.21.15.29:0/536291425 >> v1:172.21.15.12:6789/0 conn(0x7fe68c15de50 legacy=0x7fe68c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 -- 172.21.15.29:0/536291425 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c15af60 con 0x7fe68c0cea00 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe690999700 1 -- 172.21.15.29:0/536291425 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205312001 0 0) 0x7fe68c15ac50 con 0x7fe68c15de50 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69199b700 1 --2- 172.21.15.29:0/536291425 >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 0x7fe68c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe69219c700 1 --2- 172.21.15.29:0/536291425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c0cea00 0x7fe68c0cee80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0d03e0 tx=0x7fe684009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ada64244c5faf49c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.647+0000 7fe690999700 1 -- 172.21.15.29:0/536291425 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68400e070 con 0x7fe68c0cea00 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe690999700 1 -- 172.21.15.29:0/536291425 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68400ba20 con 0x7fe68c0cea00 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe690999700 1 -- 172.21.15.29:0/536291425 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840092e0 con 0x7fe68c0cea00 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 -- 172.21.15.29:0/536291425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c0cea00 msgr2=0x7fe68c0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.651 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 --2- 172.21.15.29:0/536291425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c0cea00 0x7fe68c0cee80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe68c0d03e0 tx=0x7fe684009840 comp rx=0 tx=0).stop 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 -- 172.21.15.29:0/536291425 shutdown_connections 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 --2- 172.21.15.29:0/536291425 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c0cea00 0x7fe68c0cee80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 --2- 172.21.15.29:0/536291425 >> v2:172.21.15.12:3300/0 conn(0x7fe68c153a00 0x7fe68c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 -- 172.21.15.29:0/536291425 >> 172.21.15.29:0/536291425 conn(0x7fe68c0703a0 msgr2=0x7fe68c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 -- 172.21.15.29:0/536291425 shutdown_connections 2023-10-08T16:08:59.652 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.648+0000 7fe69299d700 1 -- 172.21.15.29:0/536291425 wait complete. 2023-10-08T16:08:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.650+0000 7fe69299d700 1 Processor -- start 2023-10-08T16:08:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.650+0000 7fe69299d700 1 -- start start 2023-10-08T16:08:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe68c153a00 0x7fe68c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.655 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 0x7fe68c0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b36a0 con 0x7fe68c0cea00 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0b3370 con 0x7fe68c15de50 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0c7760 con 0x7fe68c153a00 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69219c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 0x7fe68c0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69219c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 0x7fe68c0c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.29:56170/0 (socket says 172.21.15.29:56170) 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.29:51684/0 (socket says 172.21.15.29:51684) 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69219c700 1 -- 172.21.15.29:0/857026346 learned_addr learned my addr 172.21.15.29:0/857026346 (peer_addr_for_me v2:172.21.15.29:0/0) 2023-10-08T16:08:59.656 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.651+0000 7fe69119a700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe68c153a00 0x7fe68c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 -- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe68c153a00 msgr2=0x7fe68c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe68c153a00 0x7fe68c0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 -- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 msgr2=0x7fe68c0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 0x7fe68c0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 -- 172.21.15.29:0/857026346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009420 con 0x7fe68c0cea00 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69199b700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe68800ec80 tx=0x7fe6880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800c850 con 0x7fe68c0cea00 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68800c9b0 con 0x7fe68c0cea00 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684009ae0 con 0x7fe68c0cea00 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68800cd70 con 0x7fe68c0cea00 2023-10-08T16:08:59.657 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.652+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c0ca0e0 con 0x7fe68c0cea00 2023-10-08T16:08:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.653+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fe688005c80 con 0x7fe68c0cea00 2023-10-08T16:08:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.653+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fe688013680 con 0x7fe68c0cea00 2023-10-08T16:08:59.658 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.654+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c0b3980 con 0x7fe68c0cea00 2023-10-08T16:08:59.659 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.656+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fe688021060 con 0x7fe68c0cea00 2023-10-08T16:08:59.715 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:08:59.714+0000 7fa9ddc9b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:08:59.760 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.759+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f1671df4-437c-41c9-8b0d-10a0e2d1dbfa", "id": 7} v 0) v1 -- 0x7fe68c04c3c0 con 0x7fe68c0cea00 2023-10-08T16:08:59.764 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.763+0000 7fe681ffb700 1 -- 172.21.15.29:0/857026346 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f1671df4-437c-41c9-8b0d-10a0e2d1dbfa", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe688029020 con 0x7fe68c0cea00 2023-10-08T16:08:59.764 INFO:teuthology.orchestra.run.smithi029.stdout:7 2023-10-08T16:08:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 msgr2=0x7fe68c140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:08:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fe68800ec80 tx=0x7fe6880091a0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 shutdown_connections 2023-10-08T16:08:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe68c0cea00 0x7fe68c140e40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.765 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe68c15de50 0x7fe68c0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 --2- 172.21.15.29:0/857026346 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe68c153a00 0x7fe68c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:08:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 >> 172.21.15.29:0/857026346 conn(0x7fe68c0703a0 msgr2=0x7fe68c0b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:08:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 shutdown_connections 2023-10-08T16:08:59.766 INFO:teuthology.orchestra.run.smithi029.stderr:2023-10-08T16:08:59.764+0000 7fe69299d700 1 -- 172.21.15.29:0/857026346 wait complete. 2023-10-08T16:08:59.782 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-08T16:08:59.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-08T16:08:59.787 INFO:tasks.ceph.osd.0:Started 2023-10-08T16:08:59.787 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-08T16:08:59.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-08T16:08:59.791 INFO:tasks.ceph.osd.1:Started 2023-10-08T16:08:59.792 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-08T16:08:59.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-08T16:08:59.796 INFO:tasks.ceph.osd.2:Started 2023-10-08T16:08:59.796 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-08T16:08:59.796 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-08T16:08:59.802 INFO:tasks.ceph.osd.3:Started 2023-10-08T16:08:59.802 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-08T16:08:59.802 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-08T16:08:59.808 INFO:tasks.ceph.osd.4:Started 2023-10-08T16:08:59.808 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-08T16:08:59.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-08T16:08:59.812 INFO:tasks.ceph.osd.5:Started 2023-10-08T16:08:59.813 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-08T16:08:59.813 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-08T16:08:59.819 INFO:tasks.ceph.osd.6:Started 2023-10-08T16:08:59.819 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-08T16:08:59.819 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-08T16:08:59.824 INFO:tasks.ceph.osd.7:Started 2023-10-08T16:08:59.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:00.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.060+0000 7fcbb0d9d700 1 Processor -- start 2023-10-08T16:09:00.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.060+0000 7fcbb0d9d700 1 -- start start 2023-10-08T16:09:00.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.061+0000 7fcbb0d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcbac15dfd0 0x7fcbac0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.061+0000 7fcbb0d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbb0d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0acc00 con 0x7fcbac159550 2023-10-08T16:09:00.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbb0d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0abff0 con 0x7fcbac159920 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbb0d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0ac2d0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53538/0 (socket says 172.21.15.12:53538) 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaaffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcbac15dfd0 0x7fcbac0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbabfff700 1 -- 172.21.15.12:0/3865877532 learned_addr learned my addr 172.21.15.12:0/3865877532 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaaffd700 1 -- 172.21.15.12:0/3865877532 >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 msgr2=0x7fcbac0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaaffd700 1 --2- 172.21.15.12:0/3865877532 >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaaffd700 1 -- 172.21.15.12:0/3865877532 >> v1:172.21.15.12:6789/0 conn(0x7fcbac159550 legacy=0x7fcbac0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaaffd700 1 -- 172.21.15.12:0/3865877532 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0ac5b0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbaa7fc700 1 -- 172.21.15.12:0/3865877532 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852618610 0 0) 0x7fcbac0acc00 con 0x7fcbac159550 2023-10-08T16:09:00.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.062+0000 7fcbabfff700 1 --2- 172.21.15.12:0/3865877532 >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:00.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.063+0000 7fcbaaffd700 1 --2- 172.21.15.12:0/3865877532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0aedb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbac06c180 tx=0x7fcba00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ecb012708475639 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.063+0000 7fcbaa7fc700 1 -- 172.21.15.12:0/3865877532 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011630 con 0x7fcbac15dfd0 2023-10-08T16:09:00.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.063+0000 7fcbaa7fc700 1 -- 172.21.15.12:0/3865877532 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0011790 con 0x7fcbac15dfd0 2023-10-08T16:09:00.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.063+0000 7fcbaa7fc700 1 -- 172.21.15.12:0/3865877532 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0011b30 con 0x7fcbac15dfd0 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/3865877532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac15dfd0 msgr2=0x7fcbac0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/3865877532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0aedb0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fcbac06c180 tx=0x7fcba00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/3865877532 shutdown_connections 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/3865877532 >> v2:172.21.15.12:3300/0 conn(0x7fcbac159920 0x7fcbac0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/3865877532 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0aedb0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/3865877532 >> 172.21.15.12:0/3865877532 conn(0x7fcbac06ce80 msgr2=0x7fcbac0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/3865877532 shutdown_connections 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.064+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/3865877532 wait complete. 2023-10-08T16:09:00.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.065+0000 7fcbb0d9d700 1 Processor -- start 2023-10-08T16:09:00.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.065+0000 7fcbb0d9d700 1 -- start start 2023-10-08T16:09:00.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.066+0000 7fcbb0d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac159550 0x7fcbac14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbb0d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbac159920 0x7fcbac0b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbb0d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:00.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbabfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53546/0 (socket says 172.21.15.12:53546) 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbabfff700 1 -- 172.21.15.12:0/2337659006 learned_addr learned my addr 172.21.15.12:0/2337659006 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbab7fe700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac159550 0x7fcbac14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbaaffd700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbac159920 0x7fcbac0b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbb0d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b2a90 con 0x7fcbac15dfd0 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0b2830 con 0x7fcbac159550 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.067+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac14ae00 con 0x7fcbac159920 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 -- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbac159920 msgr2=0x7fcbac0b3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbac159920 0x7fcbac0b3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 -- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac159550 msgr2=0x7fcbac14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac159550 0x7fcbac14a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009ae0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbabfff700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009fd0 tx=0x7fcba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4018070 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba400f040 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba400cbd0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba0009420 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac14b3c0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.068+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcba4003020 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.069+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fcba4014be0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.069+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac0b3c90 con 0x7fcbac15dfd0 2023-10-08T16:09:00.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.074+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcba4023060 con 0x7fcbac15dfd0 2023-10-08T16:09:00.115 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:00.115+0000 7f4876250180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:09:00.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.147+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbac0b0ce0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.149+0000 7fcb937fe700 1 -- 172.21.15.12:0/2337659006 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fcba4014da0 con 0x7fcbac15dfd0 2023-10-08T16:09:00.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:00.149 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":10,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:08:59.761551+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 msgr2=0x7fcbac0b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009fd0 tx=0x7fcba400b040 comp rx=0 tx=0).stop 2023-10-08T16:09:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 shutdown_connections 2023-10-08T16:09:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbac15dfd0 0x7fcbac0b22f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbac159550 0x7fcbac14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 --2- 172.21.15.12:0/2337659006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbac159920 0x7fcbac0b3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 >> 172.21.15.12:0/2337659006 conn(0x7fcbac06ce80 msgr2=0x7fcbac1533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 shutdown_connections 2023-10-08T16:09:00.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:00.150+0000 7fcbb0d9d700 1 -- 172.21.15.12:0/2337659006 wait complete. 2023-10-08T16:09:00.168 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-08T16:09:00.168 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-08T16:09:00.216 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:00.217+0000 7f4876250180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:09:00.317 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:00.317+0000 7f4876250180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:09:00.393 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:00.392+0000 7fa9ddc9b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:09:00.494 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:00.493+0000 7fa9ddc9b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:09:00.495 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-08T16:09:00.496+0000 7ffa661a5540 -1 Falling back to public interface 2023-10-08T16:09:00.507 INFO:tasks.ceph.osd.4.smithi029.stderr:2023-10-08T16:09:00.506+0000 7ff2e3fe5540 -1 Falling back to public interface 2023-10-08T16:09:00.507 INFO:tasks.ceph.osd.7.smithi029.stderr:2023-10-08T16:09:00.506+0000 7fe8636a7540 -1 Falling back to public interface 2023-10-08T16:09:00.508 INFO:tasks.ceph.osd.4.smithi029.stderr:2023-10-08T16:09:00.506+0000 7ff2db1fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-08T16:09:00.515 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-08T16:09:00.515+0000 7fa66433c540 -1 Falling back to public interface 2023-10-08T16:09:00.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-08T16:09:00.518+0000 7f12a82d5540 -1 Falling back to public interface 2023-10-08T16:09:00.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-08T16:09:00.518+0000 7fd7c7ed6540 -1 Falling back to public interface 2023-10-08T16:09:00.521 INFO:tasks.ceph.osd.5.smithi029.stderr:2023-10-08T16:09:00.521+0000 7f1d1e5d8540 -1 Falling back to public interface 2023-10-08T16:09:00.542 INFO:tasks.ceph.osd.6.smithi029.stderr:2023-10-08T16:09:00.541+0000 7f30b4ba1540 -1 Falling back to public interface 2023-10-08T16:09:00.621 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:00.618+0000 7fa9ddc9b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:09:00.974 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:01.059 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:01.060+0000 7f4876250180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:09:01.138 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.138+0000 7f2a7eb9d700 1 Processor -- start 2023-10-08T16:09:01.138 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.138+0000 7f2a7eb9d700 1 -- start start 2023-10-08T16:09:01.139 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7eb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a7806ccd0 0x7f2a7815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.139 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7eb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2a780af840 0x7f2a780cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.139 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7eb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a780b0e10 con 0x7f2a780af470 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7eb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b1c20 con 0x7f2a7806ccd0 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7eb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a780b0200 con 0x7f2a780af840 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.139+0000 7f2a7d39a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a7806ccd0 0x7f2a7815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2a7806ccd0 0x7f2a7815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53554/0 (socket says 172.21.15.12:53554) 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 -- 172.21.15.12:0/616179354 learned_addr learned my addr 172.21.15.12:0/616179354 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:01.140 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7e39c700 1 --2- 172.21.15.12:0/616179354 >> v2:172.21.15.29:3300/0 conn(0x7f2a780af840 0x7f2a780cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 -- 172.21.15.12:0/616179354 >> v2:172.21.15.29:3300/0 conn(0x7f2a780af840 msgr2=0x7f2a780cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 --2- 172.21.15.12:0/616179354 >> v2:172.21.15.29:3300/0 conn(0x7f2a780af840 0x7f2a780cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 -- 172.21.15.12:0/616179354 >> v1:172.21.15.12:6789/0 conn(0x7f2a780af470 legacy=0x7f2a7806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7cb99700 1 -- 172.21.15.12:0/616179354 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256757875 0 0) 0x7f2a780b0e10 con 0x7f2a780af470 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 -- 172.21.15.12:0/616179354 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a780b04e0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.140+0000 7f2a7d39a700 1 --2- 172.21.15.12:0/616179354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7815ddb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a78089370 tx=0x7f2a68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f828846e783a5b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7cb99700 1 -- 172.21.15.12:0/616179354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a68009e70 con 0x7f2a7806ccd0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7cb99700 1 -- 172.21.15.12:0/616179354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6800b860 con 0x7f2a7806ccd0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7cb99700 1 -- 172.21.15.12:0/616179354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6800bc00 con 0x7f2a7806ccd0 2023-10-08T16:09:01.142 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/616179354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 msgr2=0x7f2a7815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/616179354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7815ddb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2a78089370 tx=0x7f2a68009250 comp rx=0 tx=0).stop 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/616179354 shutdown_connections 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/616179354 >> v2:172.21.15.29:3300/0 conn(0x7f2a780af840 0x7f2a780cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/616179354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7815ddb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/616179354 >> 172.21.15.12:0/616179354 conn(0x7f2a780d0590 msgr2=0x7f2a780d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/616179354 shutdown_connections 2023-10-08T16:09:01.143 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.141+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/616179354 wait complete. 2023-10-08T16:09:01.145 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.143+0000 7f2a7eb9d700 1 Processor -- start 2023-10-08T16:09:01.145 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.143+0000 7f2a7eb9d700 1 -- start start 2023-10-08T16:09:01.145 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a780af470 0x7f2a7816cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2a780af840 0x7f2a781551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780c48d0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7816b050 con 0x7f2a780af470 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7eb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a780c3fa0 con 0x7f2a780af840 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7db9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53568/0 (socket says 172.21.15.12:53568) 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7db9b700 1 -- 172.21.15.12:0/3239800218 learned_addr learned my addr 172.21.15.12:0/3239800218 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:01.146 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7d39a700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a780af470 0x7f2a7816cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.144+0000 7f2a7e39c700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2a780af840 0x7f2a781551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 -- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2a780af840 msgr2=0x7f2a781551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2a780af840 0x7f2a781551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 -- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a780af470 msgr2=0x7f2a7816cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a780af470 0x7f2a7816cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 -- 172.21.15.12:0/3239800218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680094f0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7db9b700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c7e0 tx=0x7f2a74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a740105c0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a74010740 con 0x7f2a7806ccd0 2023-10-08T16:09:01.147 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a74010b00 con 0x7f2a7806ccd0 2023-10-08T16:09:01.148 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a780c4280 con 0x7f2a7806ccd0 2023-10-08T16:09:01.148 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a7816d300 con 0x7f2a7806ccd0 2023-10-08T16:09:01.148 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.145+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f2a7401c6c0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.148 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.146+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f2a74012b00 con 0x7f2a7806ccd0 2023-10-08T16:09:01.148 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.146+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a780632c0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.149 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.149+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f2a74017070 con 0x7f2a7806ccd0 2023-10-08T16:09:01.222 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.222+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a780b24d0 con 0x7f2a7806ccd0 2023-10-08T16:09:01.223 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.223+0000 7f2a6dffb700 1 -- 172.21.15.12:0/3239800218 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f2a7401c970 con 0x7f2a7806ccd0 2023-10-08T16:09:01.223 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-08T16:09:01.223 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":10,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:08:59.761551+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:01.224 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 msgr2=0x7f2a7816b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:01.224 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c7e0 tx=0x7f2a74007df0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.224 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 shutdown_connections 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2a7806ccd0 0x7f2a7816b360 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2a780af840 0x7f2a781551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 --2- 172.21.15.12:0/3239800218 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2a780af470 0x7f2a7816cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 >> 172.21.15.12:0/3239800218 conn(0x7f2a780d0590 msgr2=0x7f2a780d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 shutdown_connections 2023-10-08T16:09:01.225 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:01.224+0000 7f2a7eb9d700 1 -- 172.21.15.12:0/3239800218 wait complete. 2023-10-08T16:09:01.238 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:09:01.241 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:01.241+0000 7f4876250180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:09:01.352 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:01.352+0000 7f4876250180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:09:01.449 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:01.448+0000 7fa9ddc9b180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:09:01.630 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:01.629+0000 7fa9ddc9b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:09:01.656 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:01.657+0000 7f4876250180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:09:01.755 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:01.755+0000 7f4876250180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:09:01.756 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:01.754+0000 7fa9ddc9b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:09:02.088 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:02.087+0000 7fa9ddc9b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:09:02.191 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:02.190+0000 7fa9ddc9b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:09:02.778 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:02.778+0000 7f4876250180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:09:02.873 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:02.874+0000 7f4876250180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:09:02.970 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:02.970+0000 7f4876250180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:09:03.163 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.163+0000 7f4876250180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:09:03.254 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:03.253+0000 7fa9ddc9b180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:09:03.300 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.301+0000 7f4876250180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:09:03.372 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:03.371+0000 7fa9ddc9b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:09:03.537 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:03.536+0000 7fa9ddc9b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:09:03.597 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.598+0000 7f4876250180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:09:03.698 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.698+0000 7f4876250180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:09:03.765 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:03.763+0000 7fa9ddc9b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:09:03.800 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.801+0000 7f4876250180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:09:03.897 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:03.897+0000 7f4876250180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:09:03.898 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:03.896+0000 7fa9ddc9b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:09:04.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-08T16:09:04.073+0000 7fd7c7ed6540 -1 osd.0 0 log_to_monitors true 2023-10-08T16:09:04.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-08T16:09:04.075+0000 7f12a82d5540 -1 osd.1 0 log_to_monitors true 2023-10-08T16:09:04.085 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-08T16:09:04.086+0000 7fa66433c540 -1 osd.3 0 log_to_monitors true 2023-10-08T16:09:04.110 INFO:tasks.ceph.osd.7.smithi029.stderr:2023-10-08T16:09:04.109+0000 7fe8636a7540 -1 osd.7 0 log_to_monitors true 2023-10-08T16:09:04.110 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:04.110+0000 7fa9ddc9b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:09:04.212 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:04.211+0000 7fa9ddc9b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:09:04.303 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-08T16:09:04.303+0000 7ffa661a5540 -1 osd.2 0 log_to_monitors true 2023-10-08T16:09:04.312 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:04.312+0000 7fa9ddc9b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:09:04.374 INFO:tasks.ceph.osd.5.smithi029.stderr:2023-10-08T16:09:04.373+0000 7f1d1e5d8540 -1 osd.5 0 log_to_monitors true 2023-10-08T16:09:04.376 INFO:tasks.ceph.osd.4.smithi029.stderr:2023-10-08T16:09:04.375+0000 7ff2e3fe5540 -1 osd.4 0 log_to_monitors true 2023-10-08T16:09:04.414 INFO:tasks.ceph.osd.6.smithi029.stderr:2023-10-08T16:09:04.413+0000 7f30b4ba1540 -1 osd.6 0 log_to_monitors true 2023-10-08T16:09:04.432 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:09:04.431+0000 7fa9ddc9b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:09:04.916 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:04.916+0000 7f482e3fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-08T16:09:04.916 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:09:04.917+0000 7f482e3fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-08T16:09:07.624 INFO:tasks.ceph.osd.4.smithi029.stderr:2023-10-08T16:09:07.623+0000 7ff2d79f6700 -1 osd.4 0 waiting for initial osdmap 2023-10-08T16:09:07.633 INFO:tasks.ceph.osd.4.smithi029.stderr:2023-10-08T16:09:07.629+0000 7ff2d09e8700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:07.649 INFO:tasks.ceph.osd.6.smithi029.stderr:2023-10-08T16:09:07.648+0000 7f30a9df9700 -1 osd.6 0 waiting for initial osdmap 2023-10-08T16:09:07.656 INFO:tasks.ceph.osd.6.smithi029.stderr:2023-10-08T16:09:07.655+0000 7f30a15e8700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:07.686 INFO:tasks.ceph.osd.7.smithi029.stderr:2023-10-08T16:09:07.685+0000 7fe8571f6700 -1 osd.7 0 waiting for initial osdmap 2023-10-08T16:09:07.693 INFO:tasks.ceph.osd.7.smithi029.stderr:2023-10-08T16:09:07.692+0000 7fe8501e8700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:07.725 INFO:tasks.ceph.osd.5.smithi029.stderr:2023-10-08T16:09:07.724+0000 7f1d11ff6700 -1 osd.5 0 waiting for initial osdmap 2023-10-08T16:09:07.729 INFO:tasks.ceph.osd.5.smithi029.stderr:2023-10-08T16:09:07.728+0000 7f1d0afe8700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:08.043 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:08.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-08T16:09:08.289+0000 7fd7bb9f6700 -1 osd.0 0 waiting for initial osdmap 2023-10-08T16:09:08.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-10-08T16:09:08.300+0000 7fd7b49e8700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:08.308 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.308+0000 7fe8edb9d700 1 Processor -- start 2023-10-08T16:09:08.308 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.308+0000 7fe8edb9d700 1 -- start start 2023-10-08T16:09:08.310 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.310+0000 7fe8edb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.310 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.310+0000 7fe8edb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8e80af840 0x7fe8e80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.310 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.310+0000 7fe8edb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8e80b0e10 con 0x7fe8e80af470 2023-10-08T16:09:08.310 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8edb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80b1c20 con 0x7fe8e80af840 2023-10-08T16:09:08.310 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8edb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80b0200 con 0x7fe8e806ccd0 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8ed39c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8e80af840 0x7fe8e80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8ed39c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe8e80af840 0x7fe8e80cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36102/0 (socket says 172.21.15.12:36102) 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:35828/0 (socket says 172.21.15.12:35828) 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8ed39c700 1 -- 172.21.15.12:0/3944592203 learned_addr learned my addr 172.21.15.12:0/3944592203 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.311+0000 7fe8ed39c700 1 -- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 msgr2=0x7fe8e815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:08.311 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8ed39c700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.312 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8ed39c700 1 -- 172.21.15.12:0/3944592203 >> v1:172.21.15.29:6789/0 conn(0x7fe8e80af470 legacy=0x7fe8e806c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.312 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8ed39c700 1 -- 172.21.15.12:0/3944592203 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80b04e0 con 0x7fe8e80af840 2023-10-08T16:09:08.312 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8e7fff700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:08.313 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8ed39c700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e80af840 0x7fe8e80cb440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009f20 tx=0x7fe8e0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33784ef771303223 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.313 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8e77fe700 1 -- 172.21.15.12:0/3944592203 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e000e070 con 0x7fe8e80af840 2023-10-08T16:09:08.313 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8e77fe700 1 -- 172.21.15.12:0/3944592203 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e000b9d0 con 0x7fe8e80af840 2023-10-08T16:09:08.313 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.312+0000 7fe8e77fe700 1 -- 172.21.15.12:0/3944592203 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00092e0 con 0x7fe8e80af840 2023-10-08T16:09:08.313 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 -- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e80af840 msgr2=0x7fe8e80cb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e80af840 0x7fe8e80cb440 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009f20 tx=0x7fe8e0009840 comp rx=0 tx=0).stop 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 -- 172.21.15.12:0/3944592203 shutdown_connections 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e80af840 0x7fe8e80cb440 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/3944592203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e806ccd0 0x7fe8e815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 -- 172.21.15.12:0/3944592203 >> 172.21.15.12:0/3944592203 conn(0x7fe8e80d0590 msgr2=0x7fe8e80d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 -- 172.21.15.12:0/3944592203 shutdown_connections 2023-10-08T16:09:08.314 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.313+0000 7fe8edb9d700 1 -- 172.21.15.12:0/3944592203 wait complete. 2023-10-08T16:09:08.316 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.316+0000 7fe8edb9d700 1 Processor -- start 2023-10-08T16:09:08.316 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.316+0000 7fe8edb9d700 1 -- start start 2023-10-08T16:09:08.318 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.318+0000 7fe8edb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 0x7fe8e816d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.318 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.318+0000 7fe8edb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.319 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8ecb9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 0x7fe8e816d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.319 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8ecb9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 0x7fe8e816d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36108/0 (socket says 172.21.15.12:36108) 2023-10-08T16:09:08.319 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.319 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39566/0 (socket says 172.21.15.12:39566) 2023-10-08T16:09:08.319 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8edb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 0x7fe8e815a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8e7fff700 1 -- 172.21.15.12:0/829241703 learned_addr learned my addr 172.21.15.12:0/829241703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:08.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.319+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8220 con 0x7fe8e80af470 2023-10-08T16:09:08.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.320+0000 7fe8ed39c700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 0x7fe8e815a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.320+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8d30 con 0x7fe8e806ccd0 2023-10-08T16:09:08.320 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.320+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80c8400 con 0x7fe8e80af840 2023-10-08T16:09:08.321 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 -- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 msgr2=0x7fe8e815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.321 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 0x7fe8e815a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 -- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 msgr2=0x7fe8e816d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 0x7fe8e816d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4009420 con 0x7fe8e80af470 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e7fff700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400ec80 tx=0x7fe8d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8ed39c700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 0x7fe8e815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400c8f0 con 0x7fe8e80af470 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d400ca50 con 0x7fe8e80af470 2023-10-08T16:09:08.322 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.321+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d400cdd0 con 0x7fe8e80af470 2023-10-08T16:09:08.323 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-08T16:09:08.321+0000 7ffa59bf6700 -1 osd.2 0 waiting for initial osdmap 2023-10-08T16:09:08.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.322+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e0009ae0 con 0x7fe8e80af470 2023-10-08T16:09:08.323 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.322+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80c89c0 con 0x7fe8e80af470 2023-10-08T16:09:08.329 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.325+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe8d4013680 con 0x7fe8e80af470 2023-10-08T16:09:08.329 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.325+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80c8ea0 con 0x7fe8e80af470 2023-10-08T16:09:08.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.326+0000 7fe8e4ff9700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 0x7fe8cc0694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:08.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.326+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fe8d4083a00 con 0x7fe8e80af470 2023-10-08T16:09:08.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.327+0000 7fe8ecb9b700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 0x7fe8cc0694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:08.330 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.331+0000 7fe8ecb9b700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 0x7fe8cc0694a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc003a80 tx=0x7fe8dc007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:08.330 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-10-08T16:09:08.331+0000 7ffa52be8700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:08.336 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.337+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8d4017080 con 0x7fe8e80af470 2023-10-08T16:09:08.355 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-08T16:09:08.355+0000 7fa6595f9700 -1 osd.3 0 waiting for initial osdmap 2023-10-08T16:09:08.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-08T16:09:08.359+0000 7f129d5f9700 -1 osd.1 0 waiting for initial osdmap 2023-10-08T16:09:08.365 INFO:tasks.ceph.osd.3.smithi012.stderr:2023-10-08T16:09:08.366+0000 7fa650de8700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:08.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-10-08T16:09:08.370+0000 7f1294de8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-08T16:09:08.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.551+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8e80632c0 con 0x7fe8e80af470 2023-10-08T16:09:08.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.552+0000 7fe8e4ff9700 1 -- 172.21.15.12:0/829241703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fe8d4021090 con 0x7fe8e80af470 2023-10-08T16:09:08.552 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-08T16:09:08.552 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":12,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:05.959326+0000","last_up_change":"0.000000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:08.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 msgr2=0x7fe8cc0694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 0x7fe8cc0694a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc003a80 tx=0x7fe8dc007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 msgr2=0x7fe8e816d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:08.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400ec80 tx=0x7fe8d40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 shutdown_connections 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8e80af840 0x7fe8e815a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8e806ccd0 0x7fe8e816d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8cc066ff0 0x7fe8cc0694a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 --2- 172.21.15.12:0/829241703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8e80af470 0x7fe8e816d670 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 >> 172.21.15.12:0/829241703 conn(0x7fe8e80d0590 msgr2=0x7fe8e815b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 shutdown_connections 2023-10-08T16:09:08.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:08.554+0000 7fe8edb9d700 1 -- 172.21.15.12:0/829241703 wait complete. 2023-10-08T16:09:08.569 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-08T16:09:11.851 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:13.249 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:15.376 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:15.542 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.541+0000 7f1564b9d700 1 Processor -- start 2023-10-08T16:09:15.542 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.541+0000 7f1564b9d700 1 -- start start 2023-10-08T16:09:15.546 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f1564b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15600b19b0 0x7f15601581c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.546 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f1564b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600cbd30 con 0x7f15600ccab0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f1564b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15600c8f10 con 0x7f1560157df0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f1564b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15600c98f0 con 0x7f15600b19b0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f155ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f15600ccab0 0x7f1560158700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49352/0 (socket says 172.21.15.12:49352) 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f155ffff700 1 -- 172.21.15.12:0/2560184303 learned_addr learned my addr 172.21.15.12:0/2560184303 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f155effd700 1 --2- 172.21.15.12:0/2560184303 >> v2:172.21.15.29:3300/0 conn(0x7f15600b19b0 0x7f15601581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877596410 0 0) 0x7f15600cbd30 con 0x7f15600ccab0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.543+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1548003570 con 0x7f15600ccab0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3346024047 0 0) 0x7f1548003570 con 0x7f15600ccab0 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 >> v2:172.21.15.29:3300/0 conn(0x7f15600b19b0 msgr2=0x7f15601581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 --2- 172.21.15.12:0/2560184303 >> v2:172.21.15.29:3300/0 conn(0x7f15600b19b0 0x7f15601581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 >> v1:172.21.15.29:6789/0 conn(0x7f1560157df0 legacy=0x7f15600b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.547 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15600ae550 con 0x7f15600ccab0 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f15580017f0 con 0x7f15600ccab0 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 >> v1:172.21.15.12:6789/0 conn(0x7f15600ccab0 legacy=0x7f1560158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1548003ab0 0x7f1548003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548005210 0x7f154800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15600c98f0 con 0x7f1548004810 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154800c130 con 0x7f1548003ab0 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154800c2f0 con 0x7f1548005210 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155f7fe700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1548003ab0 0x7f1548003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.548 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155ffff700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548005210 0x7f154800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.549 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 -- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548005210 msgr2=0x7f154800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:15.549 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548005210 0x7f154800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.549 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 -- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1548003ab0 msgr2=0x7f1548003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:15.549 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1548003ab0 0x7f1548003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.549 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155effd700 1 -- 172.21.15.12:0/2560184303 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1548003570 con 0x7f1548004810 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.544+0000 7f155ffff700 1 -- 172.21.15.12:0/2560184303 reap_dead start 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f155effd700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 0x7f1548004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f15600b1db0 tx=0x7f15540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420b30c951343f71 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400e710 con 0x7f1548004810 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400e870 con 0x7f1548004810 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f155e7fc700 1 -- 172.21.15.12:0/2560184303 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155400ec30 con 0x7f1548004810 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f1564b9d700 1 -- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 msgr2=0x7f1548004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 0x7f1548004c80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f15600b1db0 tx=0x7f15540091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.551 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.545+0000 7f1564b9d700 1 -- 172.21.15.12:0/2560184303 shutdown_connections 2023-10-08T16:09:15.552 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.546+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2560184303 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1548004810 0x7f1548004c80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.552 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.546+0000 7f1564b9d700 1 -- 172.21.15.12:0/2560184303 >> 172.21.15.12:0/2560184303 conn(0x7f156006d090 msgr2=0x7f15600cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.552 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.546+0000 7f1564b9d700 1 -- 172.21.15.12:0/2560184303 shutdown_connections 2023-10-08T16:09:15.552 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.546+0000 7f1564b9d700 1 -- 172.21.15.12:0/2560184303 wait complete. 2023-10-08T16:09:15.554 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.547+0000 7f1564b9d700 1 Processor -- start 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.547+0000 7f1564b9d700 1 -- start start 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548004810 0x7f1560145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f156015acb0 0x7f156006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156016b0b0 con 0x7f156015a840 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f156016b390 con 0x7f156015acb0 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f1564b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f156016b670 con 0x7f1548004810 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f155effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f155effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39158/0 (socket says 172.21.15.12:39158) 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.548+0000 7f155effd700 1 -- 172.21.15.12:0/2971690923 learned_addr learned my addr 172.21.15.12:0/2971690923 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:15.555 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155f7fe700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548004810 0x7f1560145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155ffff700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f156015acb0 0x7f156006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 -- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548004810 msgr2=0x7f1560145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548004810 0x7f1560145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 -- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f156015acb0 msgr2=0x7f156006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f156015acb0 0x7f156006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 -- 172.21.15.12:0/2971690923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f156016b950 con 0x7f156015a840 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f155effd700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15480057d0 tx=0x7f155401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554022070 con 0x7f156015a840 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155400e9e0 con 0x7f156015a840 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1554027470 con 0x7f156015a840 2023-10-08T16:09:15.556 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f156016bc30 con 0x7f156015a840 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.549+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1560146070 con 0x7f156015a840 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.551+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f156016bfa0 con 0x7f156015a840 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.551+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f155401c450 con 0x7f156015a840 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.552+0000 7f15477fe700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.552+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1554085e90 con 0x7f156015a840 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.552+0000 7f155f7fe700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:15.557 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.553+0000 7f155f7fe700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 0x7f154c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1550000c00 tx=0x7f1550009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:15.558 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.557+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1554053470 con 0x7f156015a840 2023-10-08T16:09:15.762 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.761+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f156016b4d0 con 0x7f156015a840 2023-10-08T16:09:15.762 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.762+0000 7f15477fe700 1 -- 172.21.15.12:0/2971690923 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f156016b4d0 con 0x7f156015a840 2023-10-08T16:09:15.763 INFO:teuthology.misc.health.smithi012.stdout: 2023-10-08T16:09:15.763 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":17,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:12.645978+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:15.765 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 msgr2=0x7f154c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.765 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 0x7f154c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1550000c00 tx=0x7f1550009040 comp rx=0 tx=0).stop 2023-10-08T16:09:15.765 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 msgr2=0x7f1560069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:15.765 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f15480057d0 tx=0x7f155401a000 comp rx=0 tx=0).stop 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 shutdown_connections 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f156015acb0 0x7f156006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1548004810 0x7f1560145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f154c066f30 0x7f154c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 --2- 172.21.15.12:0/2971690923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f156015a840 0x7f1560069ea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 >> 172.21.15.12:0/2971690923 conn(0x7f156006d090 msgr2=0x7f1560154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 shutdown_connections 2023-10-08T16:09:15.766 INFO:teuthology.misc.health.smithi012.stderr:2023-10-08T16:09:15.764+0000 7f1564b9d700 1 -- 172.21.15.12:0/2971690923 wait complete. 2023-10-08T16:09:15.779 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-08T16:09:15.780 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-08T16:09:15.780 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:09:15.780 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:09:15.784 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:09:15.784 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:09:15.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:09:15.788 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:09:15.788 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:09:15.788 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:09:15.793 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:09:15.793 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:09:15.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:09:15.798 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:09:15.798 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-08T16:09:15.798 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:15.921 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:09:15.925 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:09:15.939 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:09:15.939 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:09:16.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:15.999+0000 7f1d4e39d700 1 Processor -- start 2023-10-08T16:09:16.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:15.999+0000 7f1d4e39d700 1 -- start start 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.000+0000 7f1d4e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 0x7f1d480cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4e39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4815afd0 con 0x7f1d480cef40 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4e39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4815b2b0 con 0x7f1d48153c30 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4815b590 con 0x7f1d4815de50 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4db9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1d480cef40 0x7f1d4815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49358/0 (socket says 172.21.15.12:49358) 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4db9c700 1 -- 172.21.15.12:0/3136611536 learned_addr learned my addr 172.21.15.12:0/3136611536 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4d39b700 1 --1- 172.21.15.12:0/3136611536 >> v1:172.21.15.29:6789/0 conn(0x7f1d48153c30 0x7f1d4815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42062/0 (socket says 172.21.15.12:42062) 2023-10-08T16:09:16.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4cb9a700 1 --2- 172.21.15.12:0/3136611536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 0x7f1d480cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4cb9a700 1 -- 172.21.15.12:0/3136611536 >> v1:172.21.15.29:6789/0 conn(0x7f1d48153c30 legacy=0x7f1d4815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4cb9a700 1 -- 172.21.15.12:0/3136611536 >> v1:172.21.15.12:6789/0 conn(0x7f1d480cef40 legacy=0x7f1d4815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d3ffff700 1 -- 172.21.15.12:0/3136611536 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143418141 0 0) 0x7f1d4815b2b0 con 0x7f1d48153c30 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.001+0000 7f1d4cb9a700 1 -- 172.21.15.12:0/3136611536 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4815b870 con 0x7f1d4815de50 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4cb9a700 1 --2- 172.21.15.12:0/3136611536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 0x7f1d480cea00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009910 tx=0x7f1d380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=318e96224a0e128 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d3ffff700 1 -- 172.21.15.12:0/3136611536 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800b760 con 0x7f1d4815de50 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d3ffff700 1 -- 172.21.15.12:0/3136611536 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3800b8c0 con 0x7f1d4815de50 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d3ffff700 1 -- 172.21.15.12:0/3136611536 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800bc60 con 0x7f1d4815de50 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 -- 172.21.15.12:0/3136611536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 msgr2=0x7f1d480cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/3136611536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 0x7f1d480cea00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009910 tx=0x7f1d380091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 -- 172.21.15.12:0/3136611536 shutdown_connections 2023-10-08T16:09:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/3136611536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d4815de50 0x7f1d480cea00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 -- 172.21.15.12:0/3136611536 >> 172.21.15.12:0/3136611536 conn(0x7f1d480703a0 msgr2=0x7f1d480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 -- 172.21.15.12:0/3136611536 shutdown_connections 2023-10-08T16:09:16.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.002+0000 7f1d4e39d700 1 -- 172.21.15.12:0/3136611536 wait complete. 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.004+0000 7f1d4e39d700 1 Processor -- start 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.004+0000 7f1d4e39d700 1 -- start start 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 0x7f1d480b5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d48153c30 0x7f1d480b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480b3d50 con 0x7f1d4815de50 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480b3fc0 con 0x7f1d480cef40 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480b42a0 con 0x7f1d48153c30 2023-10-08T16:09:16.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39194/0 (socket says 172.21.15.12:39194) 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 -- 172.21.15.12:0/2513098984 learned_addr learned my addr 172.21.15.12:0/2513098984 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4d39b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 0x7f1d480b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4cb9a700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d48153c30 0x7f1d480b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 -- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d48153c30 msgr2=0x7f1d480b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d48153c30 0x7f1d480b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 -- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 msgr2=0x7f1d480b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 0x7f1d480b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.005+0000 7f1d4db9c700 1 -- 172.21.15.12:0/2513098984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38009420 con 0x7f1d4815de50 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d4d39b700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 0x7f1d480b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d4db9c700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cc70 tx=0x7f1d40001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000a890 con 0x7f1d4815de50 2023-10-08T16:09:16.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4000aa10 con 0x7f1d4815de50 2023-10-08T16:09:16.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000add0 con 0x7f1d4815de50 2023-10-08T16:09:16.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d480b4580 con 0x7f1d4815de50 2023-10-08T16:09:16.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.006+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d480b4b40 con 0x7f1d4815de50 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.007+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4804c3c0 con 0x7f1d4815de50 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.008+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d40007300 con 0x7f1d4815de50 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.009+0000 7f1d3d7fa700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 0x7f1d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.009+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1d40084530 con 0x7f1d4815de50 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.009+0000 7f1d4d39b700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 0x7f1d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.010+0000 7f1d4d39b700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 0x7f1d2c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d44007fd0 tx=0x7f1d44007d50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.013+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d40051b70 con 0x7f1d4815de50 2023-10-08T16:09:16.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.216+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d480b4d30 con 0x7f1d4815de50 2023-10-08T16:09:16.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.217+0000 7f1d3d7fa700 1 -- 172.21.15.12:0/2513098984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7f1d40055190 con 0x7f1d4815de50 2023-10-08T16:09:16.218 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:16.219 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:12.645978+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 msgr2=0x7f1d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 0x7f1d2c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d44007fd0 tx=0x7f1d44007d50 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 msgr2=0x7f1d480b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cc70 tx=0x7f1d40001a40 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 shutdown_connections 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d2c066f30 0x7f1d2c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d4815de50 0x7f1d480b3810 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d480cef40 0x7f1d480b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 --2- 172.21.15.12:0/2513098984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d48153c30 0x7f1d480b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 >> 172.21.15.12:0/2513098984 conn(0x7f1d480703a0 msgr2=0x7f1d480638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 shutdown_connections 2023-10-08T16:09:16.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.220+0000 7f1d4e39d700 1 -- 172.21.15.12:0/2513098984 wait complete. 2023-10-08T16:09:16.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:09:16.238 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.426+0000 7fa5bcd9d700 1 Processor -- start 2023-10-08T16:09:16.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.426+0000 7fa5bcd9d700 1 -- start start 2023-10-08T16:09:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.427+0000 7fa5bcd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa5b80c7fb0 0x7fa5b806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.427+0000 7fa5bcd9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b806b290 con 0x7fa5b813f780 2023-10-08T16:09:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.427+0000 7fa5bcd9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b806b570 con 0x7fa5b80c7be0 2023-10-08T16:09:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.427+0000 7fa5bcd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b806bf10 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa5b813f780 0x7fa5b813fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49366/0 (socket says 172.21.15.12:49366) 2023-10-08T16:09:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b7fff700 1 -- 172.21.15.12:0/810872262 learned_addr learned my addr 172.21.15.12:0/810872262 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:16.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b6ffd700 1 --2- 172.21.15.12:0/810872262 >> v2:172.21.15.29:3300/0 conn(0x7fa5b80c7fb0 0x7fa5b806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b67fc700 1 -- 172.21.15.12:0/810872262 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103413032 0 0) 0x7fa5b806b290 con 0x7fa5b813f780 2023-10-08T16:09:16.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b67fc700 1 -- 172.21.15.12:0/810872262 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a0003570 con 0x7fa5b813f780 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/810872262 >> v1:172.21.15.29:6789/0 conn(0x7fa5b80c7be0 legacy=0x7fa5b815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/810872262 >> v1:172.21.15.12:6789/0 conn(0x7fa5b813f780 legacy=0x7fa5b813fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.428+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/810872262 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b806b850 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5b6ffd700 1 --2- 172.21.15.12:0/810872262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b806abd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098e0 tx=0x7fa5ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0c7420c507da95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5b67fc700 1 -- 172.21.15.12:0/810872262 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00b640 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5b67fc700 1 -- 172.21.15.12:0/810872262 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00b7a0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5b67fc700 1 -- 172.21.15.12:0/810872262 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00bb20 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/810872262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7fb0 msgr2=0x7fa5b806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/810872262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b806abd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098e0 tx=0x7fa5ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/810872262 shutdown_connections 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/810872262 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b806abd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.429+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/810872262 >> 172.21.15.12:0/810872262 conn(0x7fa5b806d110 msgr2=0x7fa5b80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.430+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/810872262 shutdown_connections 2023-10-08T16:09:16.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.430+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/810872262 wait complete. 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.431+0000 7fa5bcd9d700 1 Processor -- start 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.431+0000 7fa5bcd9d700 1 -- start start 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 0x7fa5b8157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5b813f780 0x7fa5b815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b81583f0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8156e10 con 0x7fa5b80c7be0 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5bcd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b81570f0 con 0x7fa5b813f780 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5b6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39202/0 (socket says 172.21.15.12:39202) 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/3137807241 learned_addr learned my addr 172.21.15.12:0/3137807241 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5b77fe700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 0x7fa5b8157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.432+0000 7fa5b7fff700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5b813f780 0x7fa5b815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5b813f780 msgr2=0x7fa5b815d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5b813f780 0x7fa5b815d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 msgr2=0x7fa5b8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 0x7fa5b8157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 -- 172.21.15.12:0/3137807241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009420 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b77fe700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 0x7fa5b8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5b6ffd700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0093f0 tx=0x7fa5ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac000d10 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00b910 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac025650 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b81573d0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.433+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8157990 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.434+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b804c3c0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.435+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5ac023070 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.437+0000 7fa59f7fe700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.437+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa5ac0858c0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.437+0000 7fa5b77fe700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.437+0000 7fa5b77fe700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8001de0 tx=0x7fa5a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.441+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5ac052de0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.644+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5b806bb30 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.644+0000 7fa59f7fe700 1 -- 172.21.15.12:0/3137807241 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa5ac0150a0 con 0x7fa5b80c7fb0 2023-10-08T16:09:16.645 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 msgr2=0x7fa5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8001de0 tx=0x7fa5a8009040 comp rx=0 tx=0).stop 2023-10-08T16:09:16.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 msgr2=0x7fa5b815cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0093f0 tx=0x7fa5ac017000 comp rx=0 tx=0).stop 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 shutdown_connections 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5b813f780 0x7fa5b815d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5b80c7be0 0x7fa5b8157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 --2- 172.21.15.12:0/3137807241 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5b80c7fb0 0x7fa5b815cd90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.646+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 >> 172.21.15.12:0/3137807241 conn(0x7fa5b806d110 msgr2=0x7fa5b80c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.647+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 shutdown_connections 2023-10-08T16:09:16.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.647+0000 7fa5bcd9d700 1 -- 172.21.15.12:0/3137807241 wait complete. 2023-10-08T16:09:16.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.850+0000 7f6a2f39d700 1 Processor -- start 2023-10-08T16:09:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.850+0000 7f6a2f39d700 1 -- start start 2023-10-08T16:09:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2f39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6a2815de50 0x7f6a280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2f39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a280cf3c0 con 0x7f6a280cef40 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2f39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2815afd0 con 0x7f6a28153c30 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2f39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a2815b2b0 con 0x7f6a2815de50 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2eb9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6a280cef40 0x7f6a2815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49374/0 (socket says 172.21.15.12:49374) 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2eb9c700 1 -- 172.21.15.12:0/2523386015 learned_addr learned my addr 172.21.15.12:0/2523386015 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2db9a700 1 --2- 172.21.15.12:0/2523386015 >> v2:172.21.15.12:3300/0 conn(0x7f6a2815de50 0x7f6a280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882397187 0 0) 0x7f6a280cf3c0 con 0x7f6a280cef40 2023-10-08T16:09:16.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a14003570 con 0x7f6a280cef40 2023-10-08T16:09:16.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201569635 0 0) 0x7f6a2815afd0 con 0x7f6a28153c30 2023-10-08T16:09:16.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2db9a700 1 -- 172.21.15.12:0/2523386015 >> v1:172.21.15.29:6789/0 conn(0x7f6a28153c30 legacy=0x7f6a2815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2db9a700 1 -- 172.21.15.12:0/2523386015 >> v1:172.21.15.12:6789/0 conn(0x7f6a280cef40 legacy=0x7f6a2815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.852+0000 7f6a2db9a700 1 -- 172.21.15.12:0/2523386015 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2815b590 con 0x7f6a2815de50 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2db9a700 1 --2- 172.21.15.12:0/2523386015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a2815de50 0x7f6a280cea00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a180098e0 tx=0x7f6a180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8d72e758b31f1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800b640 con 0x7f6a2815de50 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800b7a0 con 0x7f6a2815de50 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2d399700 1 -- 172.21.15.12:0/2523386015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800bb40 con 0x7f6a2815de50 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2f39d700 1 -- 172.21.15.12:0/2523386015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a2815de50 msgr2=0x7f6a280cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.853+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/2523386015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a2815de50 0x7f6a280cea00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6a180098e0 tx=0x7f6a180091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.854+0000 7f6a2f39d700 1 -- 172.21.15.12:0/2523386015 shutdown_connections 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.854+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/2523386015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a2815de50 0x7f6a280cea00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.854+0000 7f6a2f39d700 1 -- 172.21.15.12:0/2523386015 >> 172.21.15.12:0/2523386015 conn(0x7f6a280703a0 msgr2=0x7f6a280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:16.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.854+0000 7f6a2f39d700 1 -- 172.21.15.12:0/2523386015 shutdown_connections 2023-10-08T16:09:16.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.854+0000 7f6a2f39d700 1 -- 172.21.15.12:0/2523386015 wait complete. 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.855+0000 7f6a2f39d700 1 Processor -- start 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.855+0000 7f6a2f39d700 1 -- start start 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 0x7f6a280c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a2815de50 0x7f6a28151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280ca080 con 0x7f6a28153c30 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280b4510 con 0x7f6a280cef40 2023-10-08T16:09:16.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a280b41e0 con 0x7f6a2815de50 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39222/0 (socket says 172.21.15.12:39222) 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.856+0000 7f6a2db9a700 1 -- 172.21.15.12:0/4164935405 learned_addr learned my addr 172.21.15.12:0/4164935405 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2e39b700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 0x7f6a280c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2eb9c700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a2815de50 0x7f6a28151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 -- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a2815de50 msgr2=0x7f6a28151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a2815de50 0x7f6a28151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 -- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 msgr2=0x7f6a280c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 0x7f6a280c8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 -- 172.21.15.12:0/4164935405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009420 con 0x7f6a28153c30 2023-10-08T16:09:16.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2e39b700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 0x7f6a280c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2db9a700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a180093f0 tx=0x7f6a18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1801f070 con 0x7f6a28153c30 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18000c90 con 0x7f6a28153c30 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800bb40 con 0x7f6a28153c30 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a280c97e0 con 0x7f6a28153c30 2023-10-08T16:09:16.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.857+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a280c9da0 con 0x7f6a28153c30 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.858+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a2804c3c0 con 0x7f6a28153c30 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.859+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a18023070 con 0x7f6a28153c30 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.860+0000 7f6a1e7fc700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 0x7f6a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.860+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6a18085790 con 0x7f6a28153c30 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.860+0000 7f6a2e39b700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 0x7f6a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:16.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.861+0000 7f6a2e39b700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 0x7f6a0c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a240011e0 tx=0x7f6a24009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:16.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:16.864+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a18052cb0 con 0x7f6a28153c30 2023-10-08T16:09:17.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.116+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a280ce330 con 0x7f6a28153c30 2023-10-08T16:09:17.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.116+0000 7f6a1e7fc700 1 -- 172.21.15.12:0/4164935405 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f6a1802add0 con 0x7f6a28153c30 2023-10-08T16:09:17.117 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:17.117 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 msgr2=0x7f6a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 0x7f6a0c0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6a240011e0 tx=0x7f6a24009040 comp rx=0 tx=0).stop 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 msgr2=0x7f6a280b1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6a180093f0 tx=0x7f6a18017000 comp rx=0 tx=0).stop 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 shutdown_connections 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a2815de50 0x7f6a28151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a280cef40 0x7f6a280c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a0c066f30 0x7f6a0c0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 --2- 172.21.15.12:0/4164935405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a28153c30 0x7f6a280b1530 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 >> 172.21.15.12:0/4164935405 conn(0x7f6a280703a0 msgr2=0x7f6a280c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 shutdown_connections 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.119+0000 7f6a2f39d700 1 -- 172.21.15.12:0/4164935405 wait complete. 2023-10-08T16:09:17.121 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 3 2023-10-08T16:09:17.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.323+0000 7fa17979d700 1 Processor -- start 2023-10-08T16:09:17.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.323+0000 7fa17979d700 1 -- start start 2023-10-08T16:09:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa17979d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa174159920 0x7fa1740ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa17979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740acc00 con 0x7fa17415dfd0 2023-10-08T16:09:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa17979d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740abff0 con 0x7fa174159550 2023-10-08T16:09:17.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa17979d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1740ac2d0 con 0x7fa174159920 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa1737fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa17415dfd0 0x7fa1740aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49378/0 (socket says 172.21.15.12:49378) 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa1737fe700 1 -- 172.21.15.12:0/2756569906 learned_addr learned my addr 172.21.15.12:0/2756569906 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa178f9c700 1 --2- 172.21.15.12:0/2756569906 >> v2:172.21.15.29:3300/0 conn(0x7fa174159920 0x7fa1740ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.325+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154793233 0 0) 0x7fa1740acc00 con 0x7fa17415dfd0 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa15c003570 con 0x7fa17415dfd0 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583327148 0 0) 0x7fa1740abff0 con 0x7fa174159550 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1740acc00 con 0x7fa174159550 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa178f9c700 1 -- 172.21.15.12:0/2756569906 >> v1:172.21.15.29:6789/0 conn(0x7fa174159550 legacy=0x7fa1740ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa178f9c700 1 -- 172.21.15.12:0/2756569906 >> v1:172.21.15.12:6789/0 conn(0x7fa17415dfd0 legacy=0x7fa1740aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa178f9c700 1 -- 172.21.15.12:0/2756569906 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740ac5b0 con 0x7fa174159920 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa178f9c700 1 --2- 172.21.15.12:0/2756569906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740ad090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009e60 tx=0x7fa16c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44bf6845d1e8a77 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c00e070 con 0x7fa174159920 2023-10-08T16:09:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16c00bab0 con 0x7fa174159920 2023-10-08T16:09:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.326+0000 7fa172ffd700 1 -- 172.21.15.12:0/2756569906 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c00be70 con 0x7fa174159920 2023-10-08T16:09:17.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 -- 172.21.15.12:0/2756569906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 msgr2=0x7fa1740ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 --2- 172.21.15.12:0/2756569906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740ad090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009e60 tx=0x7fa16c009780 comp rx=0 tx=0).stop 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 -- 172.21.15.12:0/2756569906 shutdown_connections 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 --2- 172.21.15.12:0/2756569906 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740ad090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 -- 172.21.15.12:0/2756569906 >> 172.21.15.12:0/2756569906 conn(0x7fa17406ce80 msgr2=0x7fa1740ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 -- 172.21.15.12:0/2756569906 shutdown_connections 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.327+0000 7fa17979d700 1 -- 172.21.15.12:0/2756569906 wait complete. 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.328+0000 7fa17979d700 1 Processor -- start 2023-10-08T16:09:17.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.329+0000 7fa17979d700 1 -- start start 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.329+0000 7fa17979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.329+0000 7fa17979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa17979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa17415dfd0 0x7fa174151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa17979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740c83e0 con 0x7fa174159550 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa17979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740c9780 con 0x7fa174159920 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa17979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa174169ad0 con 0x7fa17415dfd0 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39226/0 (socket says 172.21.15.12:39226) 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 -- 172.21.15.12:0/1475375400 learned_addr learned my addr 172.21.15.12:0/1475375400 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa1737fe700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa178f9c700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa17415dfd0 0x7fa174151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 -- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa17415dfd0 msgr2=0x7fa174151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa17415dfd0 0x7fa174151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 -- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 msgr2=0x7fa1740c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 -- 172.21.15.12:0/1475375400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c009a20 con 0x7fa174159550 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa1737fe700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.330+0000 7fa173fff700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c790 tx=0x7fa164007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.331+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164010510 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.331+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa164010670 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.331+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa164010a10 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.331+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1741697e0 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.331+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740c7b40 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.332+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17404c3c0 con 0x7fa174159550 2023-10-08T16:09:17.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.333+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa16401b400 con 0x7fa174159550 2023-10-08T16:09:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.334+0000 7fa15bfff700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 0x7fa1600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.334+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa1640840d0 con 0x7fa174159550 2023-10-08T16:09:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.334+0000 7fa1737fe700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 0x7fa1600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.334+0000 7fa1737fe700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 0x7fa1600693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1740cf0f0 tx=0x7fa168009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.338+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1640515f0 con 0x7fa174159550 2023-10-08T16:09:17.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.543+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa17406e7c0 con 0x7fa174159550 2023-10-08T16:09:17.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.543+0000 7fa15bfff700 1 -- 172.21.15.12:0/1475375400 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12175 (secure 0 0 0) 0x7fa164054c10 con 0x7fa174159550 2023-10-08T16:09:17.545 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:17.545 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":17,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:12.645978+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:17.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.545+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 msgr2=0x7fa1600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 0x7fa1600693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa1740cf0f0 tx=0x7fa168009040 comp rx=0 tx=0).stop 2023-10-08T16:09:17.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 msgr2=0x7fa1740c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa16400c790 tx=0x7fa164007e10 comp rx=0 tx=0).stop 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 shutdown_connections 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa160066f30 0x7fa1600693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa174159550 0x7fa1740c7560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa17415dfd0 0x7fa174151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 --2- 172.21.15.12:0/1475375400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa174159920 0x7fa1740c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 >> 172.21.15.12:0/1475375400 conn(0x7fa17406ce80 msgr2=0x7fa1740b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 shutdown_connections 2023-10-08T16:09:17.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.546+0000 7fa17979d700 1 -- 172.21.15.12:0/1475375400 wait complete. 2023-10-08T16:09:17.564 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:09:17.564 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:17.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.752+0000 7f3cd559d700 1 Processor -- start 2023-10-08T16:09:17.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.752+0000 7f3cd559d700 1 -- start start 2023-10-08T16:09:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.753+0000 7f3cd559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.753+0000 7f3cd559d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd015ac50 con 0x7f3cd015de50 2023-10-08T16:09:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.753+0000 7f3cd559d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd015d010 con 0x7f3cd00cea00 2023-10-08T16:09:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.753+0000 7f3cd559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd015af60 con 0x7f3cd0153a00 2023-10-08T16:09:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3cd015de50 0x7f3cd015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49392/0 (socket says 172.21.15.12:49392) 2023-10-08T16:09:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccf7fe700 1 -- 172.21.15.12:0/4277005908 learned_addr learned my addr 172.21.15.12:0/4277005908 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccffff700 1 --2- 172.21.15.12:0/4277005908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479784823 0 0) 0x7f3cd015ac50 con 0x7f3cd015de50 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb8003570 con 0x7f3cd015de50 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596732610 0 0) 0x7f3cd015d010 con 0x7f3cd00cea00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cd015ac50 con 0x7f3cd00cea00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccffff700 1 -- 172.21.15.12:0/4277005908 >> v1:172.21.15.29:6789/0 conn(0x7f3cd00cea00 legacy=0x7f3cd00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccffff700 1 -- 172.21.15.12:0/4277005908 >> v1:172.21.15.12:6789/0 conn(0x7f3cd015de50 legacy=0x7f3cd015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccffff700 1 -- 172.21.15.12:0/4277005908 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd015b240 con 0x7f3cd0153a00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.754+0000 7f3ccffff700 1 --2- 172.21.15.12:0/4277005908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd0153dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009910 tx=0x7f3cc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d72133102cbda16e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0011630 con 0x7f3cd0153a00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0011790 con 0x7f3cd0153a00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cceffd700 1 -- 172.21.15.12:0/4277005908 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0011b30 con 0x7f3cd0153a00 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 -- 172.21.15.12:0/4277005908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 msgr2=0x7f3cd0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 --2- 172.21.15.12:0/4277005908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd0153dd0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009910 tx=0x7f3cc00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 -- 172.21.15.12:0/4277005908 shutdown_connections 2023-10-08T16:09:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 --2- 172.21.15.12:0/4277005908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd0153dd0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 -- 172.21.15.12:0/4277005908 >> 172.21.15.12:0/4277005908 conn(0x7f3cd00703a0 msgr2=0x7f3cd00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 -- 172.21.15.12:0/4277005908 shutdown_connections 2023-10-08T16:09:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.755+0000 7f3cd559d700 1 -- 172.21.15.12:0/4277005908 wait complete. 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.757+0000 7f3cd559d700 1 Processor -- start 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.757+0000 7f3cd559d700 1 -- start start 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cd00cea00 0x7f3cd014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd00b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c9540 con 0x7f3cd015de50 2023-10-08T16:09:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b1280 con 0x7f3cd00cea00 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c8930 con 0x7f3cd0153a00 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd4d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd4d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39232/0 (socket says 172.21.15.12:39232) 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3cd4d9c700 1 -- 172.21.15.12:0/3983933036 learned_addr learned my addr 172.21.15.12:0/3983933036 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3ccffff700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cd00cea00 0x7f3cd014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.758+0000 7f3ccf7fe700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd00b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 -- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 msgr2=0x7f3cd00b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd00b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 -- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cd00cea00 msgr2=0x7f3cd014afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cd00cea00 0x7f3cd014afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 -- 172.21.15.12:0/3983933036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0009420 con 0x7f3cd015de50 2023-10-08T16:09:17.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd4d9c700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c910 tx=0x7f3cc80027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012630 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80127b0 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8012b70 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00c8c10 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.759+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00c91d0 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.760+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd004c3c0 con 0x7f3cd015de50 2023-10-08T16:09:17.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.761+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3cc801b400 con 0x7f3cd015de50 2023-10-08T16:09:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.762+0000 7f3cb7fff700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.762+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3cc80845e0 con 0x7f3cd015de50 2023-10-08T16:09:17.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.763+0000 7f3ccffff700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.763+0000 7f3ccffff700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 0x7f3cbc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009860 tx=0x7f3cc0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.767+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3cc8051b00 con 0x7f3cd015de50 2023-10-08T16:09:17.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.971+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cd00c9680 con 0x7f3cd015de50 2023-10-08T16:09:17.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.971+0000 7f3cb7fff700 1 -- 172.21.15.12:0/3983933036 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cc8055120 con 0x7f3cd015de50 2023-10-08T16:09:17.972 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.973+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 msgr2=0x7f3cbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.973+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 0x7f3cbc0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009860 tx=0x7f3cc0017000 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.973+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 msgr2=0x7f3cd00b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.973+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800c910 tx=0x7f3cc80027a0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 shutdown_connections 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3cbc066f30 0x7f3cbc0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3cd015de50 0x7f3cd00b1ea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3cd00cea00 0x7f3cd014afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 --2- 172.21.15.12:0/3983933036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3cd0153a00 0x7f3cd00b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 >> 172.21.15.12:0/3983933036 conn(0x7f3cd00703a0 msgr2=0x7f3cd006d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 shutdown_connections 2023-10-08T16:09:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:17.974+0000 7f3cd559d700 1 -- 172.21.15.12:0/3983933036 wait complete. 2023-10-08T16:09:17.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.178+0000 7f3eb8f9d700 1 Processor -- start 2023-10-08T16:09:18.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.178+0000 7f3eb8f9d700 1 -- start start 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb8f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3eb4140a70 0x7f3eb40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb406de50 0x7f3eb40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40c6d50 con 0x7f3eb4140e40 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb8f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40c7030 con 0x7f3eb4140a70 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40c7310 con 0x7f3eb406de50 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3eb4140a70 0x7f3eb40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3eb4140e40 0x7f3eb40c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49402/0 (socket says 172.21.15.12:49402) 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.179+0000 7f3eb2ffd700 1 -- 172.21.15.12:0/445674012 learned_addr learned my addr 172.21.15.12:0/445674012 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:18.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb3fff700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb406de50 0x7f3eb40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb27fc700 1 -- 172.21.15.12:0/445674012 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628904134 0 0) 0x7f3eb40c6d50 con 0x7f3eb4140e40 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb27fc700 1 -- 172.21.15.12:0/445674012 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e9c003570 con 0x7f3eb4140e40 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb37fe700 1 -- 172.21.15.12:0/445674012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb406de50 msgr2=0x7f3eb40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb37fe700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb406de50 0x7f3eb40aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb37fe700 1 -- 172.21.15.12:0/445674012 >> v1:172.21.15.12:6789/0 conn(0x7f3eb4140e40 legacy=0x7f3eb40c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb37fe700 1 -- 172.21.15.12:0/445674012 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40c75f0 con 0x7f3eb4140a70 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb37fe700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb4140a70 0x7f3eb40c6770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40098e0 tx=0x7f3ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8bd4e9d8621942 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb27fc700 1 -- 172.21.15.12:0/445674012 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011630 con 0x7f3eb4140a70 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb27fc700 1 -- 172.21.15.12:0/445674012 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea4011790 con 0x7f3eb4140a70 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.180+0000 7f3eb27fc700 1 -- 172.21.15.12:0/445674012 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011b30 con 0x7f3eb4140a70 2023-10-08T16:09:18.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/445674012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb4140a70 msgr2=0x7f3eb40c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb4140a70 0x7f3eb40c6770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3ea40098e0 tx=0x7f3ea40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/445674012 shutdown_connections 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb406de50 0x7f3eb40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/445674012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb4140a70 0x7f3eb40c6770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/445674012 >> 172.21.15.12:0/445674012 conn(0x7f3eb406d170 msgr2=0x7f3eb40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/445674012 shutdown_connections 2023-10-08T16:09:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.181+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/445674012 wait complete. 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.182+0000 7f3eb8f9d700 1 Processor -- start 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.182+0000 7f3eb8f9d700 1 -- start start 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb4140a70 0x7f3eb416ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb4140e40 0x7f3eb4169cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb413e8c0 con 0x7f3eb406de50 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb41597f0 con 0x7f3eb4140a70 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.183+0000 7f3eb8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40afea0 con 0x7f3eb4140e40 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39252/0 (socket says 172.21.15.12:39252) 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 -- 172.21.15.12:0/4123173902 learned_addr learned my addr 172.21.15.12:0/4123173902 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 -- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb4140e40 msgr2=0x7f3eb4169cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb4140e40 0x7f3eb4169cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 -- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb4140a70 msgr2=0x7f3eb416ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb4140a70 0x7f3eb416ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 -- 172.21.15.12:0/4123173902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009420 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb37fe700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4071320 tx=0x7f3ea4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea4011b10 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea40253f0 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea40257b0 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.184+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40af290 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.185+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb40af850 con 0x7f3eb406de50 2023-10-08T16:09:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.186+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40cbd50 con 0x7f3eb406de50 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.186+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ea4025ba0 con 0x7f3eb406de50 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.187+0000 7f3e9b7fe700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 0x7f3ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.187+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3ea4085bb0 con 0x7f3eb406de50 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.188+0000 7f3eb2ffd700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 0x7f3ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.188+0000 7f3eb2ffd700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 0x7f3ea00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8001360 tx=0x7f3ea80078a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.191+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ea40530d0 con 0x7f3eb406de50 2023-10-08T16:09:18.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.394+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3eb404c3c0 con 0x7f3eb406de50 2023-10-08T16:09:18.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.394+0000 7f3e9b7fe700 1 -- 172.21.15.12:0/4123173902 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3ea40566f0 con 0x7f3eb406de50 2023-10-08T16:09:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:18.395 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:09:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:09:18.395 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:09:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:09:18.396 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:09:18.396 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 msgr2=0x7f3ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 0x7f3ea00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8001360 tx=0x7f3ea80078a0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 msgr2=0x7f3eb41592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4071320 tx=0x7f3ea4017000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 shutdown_connections 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3ea0066f30 0x7f3ea00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3eb406de50 0x7f3eb41592b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3eb4140e40 0x7f3eb4169cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 --2- 172.21.15.12:0/4123173902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3eb4140a70 0x7f3eb416ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 >> 172.21.15.12:0/4123173902 conn(0x7f3eb406d170 msgr2=0x7f3eb40c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 shutdown_connections 2023-10-08T16:09:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.397+0000 7f3eb8f9d700 1 -- 172.21.15.12:0/4123173902 wait complete. 2023-10-08T16:09:18.415 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:09:18.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:09:18.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.604+0000 7f74af19d700 1 Processor -- start 2023-10-08T16:09:18.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.605+0000 7f74af19d700 1 -- start start 2023-10-08T16:09:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74af19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74af19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74a80c9090 0x7f74a8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74af19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80c2200 con 0x7f74a8153a30 2023-10-08T16:09:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74af19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a8157250 con 0x7f74a80c9090 2023-10-08T16:09:18.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74af19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80c15f0 con 0x7f74a8153660 2023-10-08T16:09:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74ae19b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74ae99c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f74a80c9090 0x7f74a8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74ae19b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42458/0 (socket says 172.21.15.12:42458) 2023-10-08T16:09:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74ae19b700 1 -- 172.21.15.12:0/216349174 learned_addr learned my addr 172.21.15.12:0/216349174 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:18.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.606+0000 7f74ad99a700 1 --1- 172.21.15.12:0/216349174 >> v1:172.21.15.29:6789/0 conn(0x7f74a8153a30 0x7f74a80c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42112/0 (socket says 172.21.15.12:42112) 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ad199700 1 -- 172.21.15.12:0/216349174 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061141557 0 0) 0x7f74a80c2200 con 0x7f74a8153a30 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ad199700 1 -- 172.21.15.12:0/216349174 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003570 con 0x7f74a8153a30 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ae19b700 1 -- 172.21.15.12:0/216349174 >> v2:172.21.15.29:3300/0 conn(0x7f74a80c9090 msgr2=0x7f74a8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ae19b700 1 --2- 172.21.15.12:0/216349174 >> v2:172.21.15.29:3300/0 conn(0x7f74a80c9090 0x7f74a8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ae19b700 1 -- 172.21.15.12:0/216349174 >> v1:172.21.15.29:6789/0 conn(0x7f74a8153a30 legacy=0x7f74a80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ae19b700 1 -- 172.21.15.12:0/216349174 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80c18d0 con 0x7f74a8153660 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.607+0000 7f74ae19b700 1 --2- 172.21.15.12:0/216349174 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74a400bc40 tx=0x7f74a400b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577a5825e47a4d50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74ad199700 1 -- 172.21.15.12:0/216349174 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a400da30 con 0x7f74a8153660 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74ad199700 1 -- 172.21.15.12:0/216349174 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a400db90 con 0x7f74a8153660 2023-10-08T16:09:18.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74ad199700 1 -- 172.21.15.12:0/216349174 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4017410 con 0x7f74a8153660 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 -- 172.21.15.12:0/216349174 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 msgr2=0x7f74a80c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 --2- 172.21.15.12:0/216349174 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f74a400bc40 tx=0x7f74a400b4e0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 -- 172.21.15.12:0/216349174 shutdown_connections 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 --2- 172.21.15.12:0/216349174 >> v2:172.21.15.29:3300/0 conn(0x7f74a80c9090 0x7f74a8156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 --2- 172.21.15.12:0/216349174 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a80c0ef0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 -- 172.21.15.12:0/216349174 >> 172.21.15.12:0/216349174 conn(0x7f74a806c6a0 msgr2=0x7f74a806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 -- 172.21.15.12:0/216349174 shutdown_connections 2023-10-08T16:09:18.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.608+0000 7f74af19d700 1 -- 172.21.15.12:0/216349174 wait complete. 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.610+0000 7f74af19d700 1 Processor -- start 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.610+0000 7f74af19d700 1 -- start start 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 0x7f74a8165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a8169510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8169a50 con 0x7f74a8153a30 2023-10-08T16:09:18.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8166420 con 0x7f74a80c9090 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74af19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a8155c20 con 0x7f74a8153660 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74ae99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74ae99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39264/0 (socket says 172.21.15.12:39264) 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74ae99c700 1 -- 172.21.15.12:0/1751678064 learned_addr learned my addr 172.21.15.12:0/1751678064 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74ad99a700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a8169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.611+0000 7f74ae19b700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 0x7f74a8165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 -- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 msgr2=0x7f74a8169510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a8169510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 -- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 msgr2=0x7f74a8165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 0x7f74a8165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 -- 172.21.15.12:0/1751678064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a400b780 con 0x7f74a8153a30 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae19b700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 0x7f74a8165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74ae99c700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e90 tx=0x7f74a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000cc20 con 0x7f74a8153a30 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000f040 con 0x7f74a8153a30 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a8165b80 con 0x7f74a8153a30 2023-10-08T16:09:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0014480 con 0x7f74a8153a30 2023-10-08T16:09:18.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.612+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a8166140 con 0x7f74a8153a30 2023-10-08T16:09:18.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.613+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804c3c0 con 0x7f74a8153a30 2023-10-08T16:09:18.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.614+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a0014830 con 0x7f74a8153a30 2023-10-08T16:09:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.615+0000 7f749e7fc700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 0x7f748c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.615+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f74a0084fb0 con 0x7f74a8153a30 2023-10-08T16:09:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.615+0000 7f74ae19b700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 0x7f748c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.616+0000 7f74ae19b700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 0x7f748c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74a400b520 tx=0x7f74a4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.619+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a0055f60 con 0x7f74a8153a30 2023-10-08T16:09:18.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.819+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f74a80ccd60 con 0x7f74a8153a30 2023-10-08T16:09:18.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.949+0000 7f749e7fc700 1 -- 172.21.15.12:0/1751678064 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f74a0055af0 con 0x7f74a8153a30 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 msgr2=0x7f748c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 0x7f748c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74a400b520 tx=0x7f74a4019000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 msgr2=0x7f74a8157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e90 tx=0x7f74a000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 shutdown_connections 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f748c066f30 0x7f748c0693e0 secure :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74a400b520 tx=0x7f74a4019000 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f74a8153a30 0x7f74a8157750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f74a80c9090 0x7f74a8165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 --2- 172.21.15.12:0/1751678064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f74a8153660 0x7f74a8169510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.953+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 >> 172.21.15.12:0/1751678064 conn(0x7f74a806c6a0 msgr2=0x7f74a80cada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:18.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.954+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 shutdown_connections 2023-10-08T16:09:18.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:18.954+0000 7f74af19d700 1 -- 172.21.15.12:0/1751678064 wait complete. 2023-10-08T16:09:18.960 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:09:18.977 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:09:19.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.170+0000 7f1a7759e700 1 Processor -- start 2023-10-08T16:09:19.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.170+0000 7f1a7759e700 1 -- start start 2023-10-08T16:09:19.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.171+0000 7f1a7759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a7815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.171+0000 7f1a7759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7815ae70 con 0x7f1a7813fef0 2023-10-08T16:09:19.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.171+0000 7f1a7759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7806af60 con 0x7f1a7813fb20 2023-10-08T16:09:19.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.171+0000 7f1a7759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7806b240 con 0x7f1a7806aaa0 2023-10-08T16:09:19.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a75d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a7813fef0 0x7f1a780c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49410/0 (socket says 172.21.15.12:49410) 2023-10-08T16:09:19.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a75d9b700 1 -- 172.21.15.12:0/856036400 learned_addr learned my addr 172.21.15.12:0/856036400 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:19.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a7815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535619227 0 0) 0x7f1a6c001290 con 0x7f1a7813fef0 2023-10-08T16:09:19.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a60003570 con 0x7f1a7813fef0 2023-10-08T16:09:19.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274359554 0 0) 0x7f1a60003570 con 0x7f1a7813fef0 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 msgr2=0x7f1a7815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a7815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 >> v1:172.21.15.29:6789/0 conn(0x7f1a7813fb20 legacy=0x7f1a780c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7806b520 con 0x7f1a7813fef0 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1a6c001780 con 0x7f1a7813fef0 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.172+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 >> v1:172.21.15.12:6789/0 conn(0x7f1a7813fef0 legacy=0x7f1a780c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a60003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a60003fd0 0x7f1a60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a60004d50 0x7f1a600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7806b240 con 0x7f1a60004d50 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6000bb40 con 0x7f1a60003fd0 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6000bd00 con 0x7f1a7806aaa0 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a60004d50 0x7f1a600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a75d9b700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a60003fd0 0x7f1a60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a7659c700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a60003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 -- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 msgr2=0x7f1a60003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a7806aaa0 0x7f1a60003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 -- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a60003fd0 msgr2=0x7f1a60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a60003fd0 0x7f1a60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.173+0000 7f1a76d9d700 1 -- 172.21.15.12:0/856036400 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60003570 con 0x7f1a60004d50 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a60004d50 0x7f1a600051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a7806ae90 tx=0x7f1a7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fe25da5cd8dca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000ea90 con 0x7f1a60004d50 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a7000f040 con 0x7f1a60004d50 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7559a700 1 -- 172.21.15.12:0/856036400 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a7000ee40 con 0x7f1a60004d50 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 -- 172.21.15.12:0/856036400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a60004d50 msgr2=0x7f1a600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 --2- 172.21.15.12:0/856036400 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a60004d50 0x7f1a600051c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1a7806ae90 tx=0x7f1a7000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a76d9d700 1 -- 172.21.15.12:0/856036400 reap_dead start 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 -- 172.21.15.12:0/856036400 shutdown_connections 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 -- 172.21.15.12:0/856036400 >> 172.21.15.12:0/856036400 conn(0x7f1a7806d170 msgr2=0x7f1a780cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 -- 172.21.15.12:0/856036400 shutdown_connections 2023-10-08T16:09:19.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.174+0000 7f1a7759e700 1 -- 172.21.15.12:0/856036400 wait complete. 2023-10-08T16:09:19.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.176+0000 7f1a7759e700 1 Processor -- start 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.176+0000 7f1a7759e700 1 -- start start 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a60004d50 0x7f1a780adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7813c500 0x7f1a780c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780aeab0 con 0x7f1a780ab860 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780ae0a0 con 0x7f1a7813c500 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780acda0 con 0x7f1a60004d50 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a75d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a75d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39290/0 (socket says 172.21.15.12:39290) 2023-10-08T16:09:19.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a75d9b700 1 -- 172.21.15.12:0/2216693710 learned_addr learned my addr 172.21.15.12:0/2216693710 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a7659c700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a60004d50 0x7f1a780adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.177+0000 7f1a76d9d700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7813c500 0x7f1a780c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 -- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a60004d50 msgr2=0x7f1a780adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a60004d50 0x7f1a780adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 -- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7813c500 msgr2=0x7f1a780c10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7813c500 0x7f1a780c10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 -- 172.21.15.12:0/2216693710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a780ad080 con 0x7f1a780ab860 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a75d9b700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0013f0 tx=0x7f1a6c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c007e10 con 0x7f1a780ab860 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6c00f8d0 con 0x7f1a780ab860 2023-10-08T16:09:19.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00fc90 con 0x7f1a780ab860 2023-10-08T16:09:19.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a780ad360 con 0x7f1a780ab860 2023-10-08T16:09:19.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.178+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780ae790 con 0x7f1a780ab860 2023-10-08T16:09:19.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.179+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a780ad880 con 0x7f1a780ab860 2023-10-08T16:09:19.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.181+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a6c013600 con 0x7f1a780ab860 2023-10-08T16:09:19.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.183+0000 7f1a667fc700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 0x7f1a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.183+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1a6c084850 con 0x7f1a780ab860 2023-10-08T16:09:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.183+0000 7f1a7659c700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 0x7f1a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:19.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.184+0000 7f1a7659c700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 0x7f1a580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c1d60 tx=0x7f1a68007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:19.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.186+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a6c051df0 con 0x7f1a780ab860 2023-10-08T16:09:19.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.390+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1a7815ae70 con 0x7f1a780ab860 2023-10-08T16:09:19.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.957+0000 7f1a667fc700 1 -- 172.21.15.12:0/2216693710 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1a7815ae70 con 0x7f1a780ab860 2023-10-08T16:09:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.968+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 msgr2=0x7f1a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.968+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 0x7f1a580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c1d60 tx=0x7f1a68007d30 comp rx=0 tx=0).stop 2023-10-08T16:09:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.968+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 msgr2=0x7f1a780ae250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.968+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0013f0 tx=0x7f1a6c007a10 comp rx=0 tx=0).stop 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 shutdown_connections 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a7813c500 0x7f1a780c10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a60004d50 0x7f1a780adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1a58066f30 0x7f1a580693e0 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a780c1d60 tx=0x7f1a68007d30 comp rx=0 tx=0).stop 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 --2- 172.21.15.12:0/2216693710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a780ab860 0x7f1a780ae250 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.970+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 >> 172.21.15.12:0/2216693710 conn(0x7f1a7806d170 msgr2=0x7f1a780c20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:19.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.972+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 shutdown_connections 2023-10-08T16:09:19.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:19.973+0000 7f1a7759e700 1 -- 172.21.15.12:0/2216693710 wait complete. 2023-10-08T16:09:19.977 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:09:20.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.191+0000 7fef3c99d700 1 Processor -- start 2023-10-08T16:09:20.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.191+0000 7fef3c99d700 1 -- start start 2023-10-08T16:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef3c99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef3815dfd0 0x7fef380aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef3c99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef38159920 0x7fef380ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef3c99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef380acc00 con 0x7fef38159550 2023-10-08T16:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef3c99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef380abff0 con 0x7fef38159920 2023-10-08T16:09:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef3c99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef380ac2d0 con 0x7fef3815dfd0 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef377fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fef38159550 0x7fef380ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49424/0 (socket says 172.21.15.12:49424) 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef377fe700 1 -- 172.21.15.12:0/2241939698 learned_addr learned my addr 172.21.15.12:0/2241939698 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef37fff700 1 --2- 172.21.15.12:0/2241939698 >> v2:172.21.15.12:3300/0 conn(0x7fef38159920 0x7fef380ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef36ffd700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef3815dfd0 0x7fef380aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef367fc700 1 -- 172.21.15.12:0/2241939698 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051820479 0 0) 0x7fef380acc00 con 0x7fef38159550 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.193+0000 7fef367fc700 1 -- 172.21.15.12:0/2241939698 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef20003570 con 0x7fef38159550 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef37fff700 1 -- 172.21.15.12:0/2241939698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef3815dfd0 msgr2=0x7fef380aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef37fff700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef3815dfd0 0x7fef380aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef37fff700 1 -- 172.21.15.12:0/2241939698 >> v1:172.21.15.12:6789/0 conn(0x7fef38159550 legacy=0x7fef380ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef37fff700 1 -- 172.21.15.12:0/2241939698 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef380ac5b0 con 0x7fef38159920 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef37fff700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef38159920 0x7fef380ad090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e60 tx=0x7fef30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d12c099b7fa8c07f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef367fc700 1 -- 172.21.15.12:0/2241939698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000e070 con 0x7fef38159920 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef367fc700 1 -- 172.21.15.12:0/2241939698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3000bab0 con 0x7fef38159920 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.194+0000 7fef367fc700 1 -- 172.21.15.12:0/2241939698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3000be70 con 0x7fef38159920 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 -- 172.21.15.12:0/2241939698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef38159920 msgr2=0x7fef380ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef38159920 0x7fef380ad090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fef30009e60 tx=0x7fef30009780 comp rx=0 tx=0).stop 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 -- 172.21.15.12:0/2241939698 shutdown_connections 2023-10-08T16:09:20.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef38159920 0x7fef380ad090 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 --2- 172.21.15.12:0/2241939698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef3815dfd0 0x7fef380aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 -- 172.21.15.12:0/2241939698 >> 172.21.15.12:0/2241939698 conn(0x7fef3806ce80 msgr2=0x7fef380ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 -- 172.21.15.12:0/2241939698 shutdown_connections 2023-10-08T16:09:20.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.195+0000 7fef3c99d700 1 -- 172.21.15.12:0/2241939698 wait complete. 2023-10-08T16:09:20.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.196+0000 7fef3c99d700 1 Processor -- start 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.196+0000 7fef3c99d700 1 -- start start 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef38159550 0x7fef3814c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 0x7fef380c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef380ca3b0 con 0x7fef3815dfd0 2023-10-08T16:09:20.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef3814c680 con 0x7fef38159920 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.197+0000 7fef3c99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef380c97a0 con 0x7fef38159550 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39298/0 (socket says 172.21.15.12:39298) 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 -- 172.21.15.12:0/3253535776 learned_addr learned my addr 172.21.15.12:0/3253535776 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef377fe700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef38159550 0x7fef3814c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef36ffd700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 0x7fef380c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 -- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef38159550 msgr2=0x7fef3814c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef38159550 0x7fef3814c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 -- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 msgr2=0x7fef380c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 0x7fef380c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 -- 172.21.15.12:0/3253535776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009a20 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef36ffd700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 0x7fef380c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef37fff700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef3806ad70 tx=0x7fef30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.198+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30027470 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.199+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef300275f0 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.199+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef380c9a80 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.199+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300279b0 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.199+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef380ca040 con 0x7fef3815dfd0 2023-10-08T16:09:20.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.200+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef380ca4f0 con 0x7fef3815dfd0 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.202+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef30024070 con 0x7fef3815dfd0 2023-10-08T16:09:20.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.202+0000 7fef1f7fe700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.202+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fef30087100 con 0x7fef3815dfd0 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.203+0000 7fef377fe700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.203+0000 7fef377fe700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 0x7fef240693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef28007fd0 tx=0x7fef28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:20.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.206+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef300543f0 con 0x7fef3815dfd0 2023-10-08T16:09:20.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.452+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fef380ca4f0 con 0x7fef3815dfd0 2023-10-08T16:09:20.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.957+0000 7fef1f7fe700 1 -- 172.21.15.12:0/3253535776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fef380ca4f0 con 0x7fef3815dfd0 2023-10-08T16:09:20.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 msgr2=0x7fef240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 0x7fef240693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fef28007fd0 tx=0x7fef28009040 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 msgr2=0x7fef38153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fef3806ad70 tx=0x7fef30019000 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 shutdown_connections 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef3815dfd0 0x7fef38153260 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef38159550 0x7fef3814c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 --2- 172.21.15.12:0/3253535776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef38159920 0x7fef380c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:20.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.959+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 >> 172.21.15.12:0/3253535776 conn(0x7fef3806ce80 msgr2=0x7fef3814cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.960+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 shutdown_connections 2023-10-08T16:09:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:20.960+0000 7fef3c99d700 1 -- 172.21.15.12:0/3253535776 wait complete. 2023-10-08T16:09:20.962 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 2 and data pool 3 2023-10-08T16:09:20.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.170+0000 7f2d5d59d700 1 Processor -- start 2023-10-08T16:09:21.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.170+0000 7f2d5d59d700 1 -- start start 2023-10-08T16:09:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.171+0000 7f2d5d59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.171+0000 7f2d5d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.171+0000 7f2d5d59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5815ae70 con 0x7f2d5813fef0 2023-10-08T16:09:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.171+0000 7f2d5d59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5806af60 con 0x7f2d5813fb20 2023-10-08T16:09:21.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.171+0000 7f2d5d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5806b240 con 0x7f2d5806aaa0 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d57fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d57fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54314/0 (socket says 172.21.15.12:54314) 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42512/0 (socket says 172.21.15.12:42512) 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d57fff700 1 -- 172.21.15.12:0/3160573533 learned_addr learned my addr 172.21.15.12:0/3160573533 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d577fe700 1 --1- 172.21.15.12:0/3160573533 >> v1:172.21.15.29:6789/0 conn(0x7f2d5813fef0 0x7f2d580c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42134/0 (socket says 172.21.15.12:42134) 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d56ffd700 1 -- 172.21.15.12:0/3160573533 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081981377 0 0) 0x7f2d4c001160 con 0x7f2d5813fef0 2023-10-08T16:09:21.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d56ffd700 1 -- 172.21.15.12:0/3160573533 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d40003570 con 0x7f2d5813fef0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 -- 172.21.15.12:0/3160573533 >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 msgr2=0x7f2d5815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 --2- 172.21.15.12:0/3160573533 >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 -- 172.21.15.12:0/3160573533 >> v1:172.21.15.29:6789/0 conn(0x7f2d5813fef0 legacy=0x7f2d580c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d5cd9c700 1 -- 172.21.15.12:0/3160573533 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5806b520 con 0x7f2d5806aaa0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.172+0000 7f2d57fff700 1 --2- 172.21.15.12:0/3160573533 >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5cd9c700 1 --2- 172.21.15.12:0/3160573533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009e60 tx=0x7f2d50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24047af03435019e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d56ffd700 1 -- 172.21.15.12:0/3160573533 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000e070 con 0x7f2d5806aaa0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d56ffd700 1 -- 172.21.15.12:0/3160573533 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000bab0 con 0x7f2d5806aaa0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d56ffd700 1 -- 172.21.15.12:0/3160573533 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000be70 con 0x7f2d5806aaa0 2023-10-08T16:09:21.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 -- 172.21.15.12:0/3160573533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 msgr2=0x7f2d580c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/3160573533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009e60 tx=0x7f2d50009780 comp rx=0 tx=0).stop 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 -- 172.21.15.12:0/3160573533 shutdown_connections 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/3160573533 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5806aaa0 0x7f2d580c9d00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/3160573533 >> v2:172.21.15.29:3300/0 conn(0x7f2d5813fb20 0x7f2d5815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 -- 172.21.15.12:0/3160573533 >> 172.21.15.12:0/3160573533 conn(0x7f2d5806d170 msgr2=0x7f2d580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.173+0000 7f2d5d59d700 1 -- 172.21.15.12:0/3160573533 shutdown_connections 2023-10-08T16:09:21.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.174+0000 7f2d5d59d700 1 -- 172.21.15.12:0/3160573533 wait complete. 2023-10-08T16:09:21.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.175+0000 7f2d5d59d700 1 Processor -- start 2023-10-08T16:09:21.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.175+0000 7f2d5d59d700 1 -- start start 2023-10-08T16:09:21.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 0x7f2d5813e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581589a0 con 0x7f2d5813fef0 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58157d90 con 0x7f2d5806aaa0 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58158070 con 0x7f2d5813fb20 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d5cd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 0x7f2d5813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d577fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54320/0 (socket says 172.21.15.12:54320) 2023-10-08T16:09:21.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d577fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42514/0 (socket says 172.21.15.12:42514) 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.176+0000 7f2d57fff700 1 -- 172.21.15.12:0/932699890 learned_addr learned my addr 172.21.15.12:0/932699890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 -- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 msgr2=0x7f2d580b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 -- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 msgr2=0x7f2d5813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 0x7f2d5813e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 -- 172.21.15.12:0/932699890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4800b790 con 0x7f2d5806aaa0 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d5cd9c700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 0x7f2d5813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:21.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d577fe700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d57fff700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800ede0 tx=0x7f2d4800b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4800dcd0 con 0x7f2d5806aaa0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4800de30 con 0x7f2d5806aaa0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48010650 con 0x7f2d5806aaa0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.177+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d50009a20 con 0x7f2d5806aaa0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.178+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d58158630 con 0x7f2d5806aaa0 2023-10-08T16:09:21.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.178+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5804c3c0 con 0x7f2d5806aaa0 2023-10-08T16:09:21.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.180+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d48010a40 con 0x7f2d5806aaa0 2023-10-08T16:09:21.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.180+0000 7f2d3ffff700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 0x7f2d440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.180+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d48084d80 con 0x7f2d5806aaa0 2023-10-08T16:09:21.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.181+0000 7f2d577fe700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 0x7f2d440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.181+0000 7f2d577fe700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 0x7f2d440693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d580b0c20 tx=0x7f2d4c007ba0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.186+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d48051f50 con 0x7f2d5806aaa0 2023-10-08T16:09:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.388+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d581587c0 con 0x7f2d5806aaa0 2023-10-08T16:09:21.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.389+0000 7f2d3ffff700 1 -- 172.21.15.12:0/932699890 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f2d48055570 con 0x7f2d5806aaa0 2023-10-08T16:09:21.390 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:21.390 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:20.453676+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 msgr2=0x7f2d440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 0x7f2d440693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2d580b0c20 tx=0x7f2d4c007ba0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 msgr2=0x7f2d581697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800ede0 tx=0x7f2d4800b4f0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 shutdown_connections 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d44066f30 0x7f2d440693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d5813fef0 0x7f2d5813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d5806aaa0 0x7f2d581697a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 --2- 172.21.15.12:0/932699890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d5813fb20 0x7f2d580b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 >> 172.21.15.12:0/932699890 conn(0x7f2d5806d170 msgr2=0x7f2d580b0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 shutdown_connections 2023-10-08T16:09:21.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.391+0000 7f2d5d59d700 1 -- 172.21.15.12:0/932699890 wait complete. 2023-10-08T16:09:21.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:21.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.594+0000 7f30a099d700 1 Processor -- start 2023-10-08T16:09:21.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.595+0000 7f30a099d700 1 -- start start 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f30a099d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f309c06e0a0 0x7f309c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f30a099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 0x7f309c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f30a099d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c06a490 con 0x7f309c06e470 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f30a099d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c06b930 con 0x7f309c06e0a0 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f30a099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c7490 con 0x7f309c06f3a0 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f309bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f309c06e470 0x7f309c159740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49428/0 (socket says 172.21.15.12:49428) 2023-10-08T16:09:21.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f309bfff700 1 -- 172.21.15.12:0/237766279 learned_addr learned my addr 172.21.15.12:0/237766279 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.596+0000 7f309affd700 1 --2- 172.21.15.12:0/237766279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 0x7f309c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309b7fe700 1 --2- 172.21.15.12:0/237766279 >> v2:172.21.15.29:3300/0 conn(0x7f309c06e0a0 0x7f309c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309a7fc700 1 -- 172.21.15.12:0/237766279 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763259124 0 0) 0x7f309c06a490 con 0x7f309c06e470 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309a7fc700 1 -- 172.21.15.12:0/237766279 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3084003570 con 0x7f309c06e470 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309affd700 1 -- 172.21.15.12:0/237766279 >> v2:172.21.15.29:3300/0 conn(0x7f309c06e0a0 msgr2=0x7f309c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309affd700 1 --2- 172.21.15.12:0/237766279 >> v2:172.21.15.29:3300/0 conn(0x7f309c06e0a0 0x7f309c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309affd700 1 -- 172.21.15.12:0/237766279 >> v1:172.21.15.12:6789/0 conn(0x7f309c06e470 legacy=0x7f309c159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309affd700 1 -- 172.21.15.12:0/237766279 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c0c7770 con 0x7f309c06f3a0 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.597+0000 7f309affd700 1 --2- 172.21.15.12:0/237766279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 0x7f309c14fc70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30900098d0 tx=0x7f3090009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c14da3009e3367 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f309a7fc700 1 -- 172.21.15.12:0/237766279 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090005c10 con 0x7f309c06f3a0 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f309a7fc700 1 -- 172.21.15.12:0/237766279 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090005d70 con 0x7f309c06f3a0 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f309a7fc700 1 -- 172.21.15.12:0/237766279 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090006260 con 0x7f309c06f3a0 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 -- 172.21.15.12:0/237766279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 msgr2=0x7f309c14fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 --2- 172.21.15.12:0/237766279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 0x7f309c14fc70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f30900098d0 tx=0x7f3090009120 comp rx=0 tx=0).stop 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 -- 172.21.15.12:0/237766279 shutdown_connections 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 --2- 172.21.15.12:0/237766279 >> v2:172.21.15.29:3300/0 conn(0x7f309c06e0a0 0x7f309c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 --2- 172.21.15.12:0/237766279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06f3a0 0x7f309c14fc70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 -- 172.21.15.12:0/237766279 >> 172.21.15.12:0/237766279 conn(0x7f309c06d170 msgr2=0x7f309c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 -- 172.21.15.12:0/237766279 shutdown_connections 2023-10-08T16:09:21.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.598+0000 7f30a099d700 1 -- 172.21.15.12:0/237766279 wait complete. 2023-10-08T16:09:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.600+0000 7f30a099d700 1 Processor -- start 2023-10-08T16:09:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.600+0000 7f30a099d700 1 -- start start 2023-10-08T16:09:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f309c06e0a0 0x7f309c14c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 0x7f309c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c7100 con 0x7f309c06f3a0 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0c61e0 con 0x7f309c06e0a0 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f30a099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c141610 con 0x7f309c06e470 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f309bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f309bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39310/0 (socket says 172.21.15.12:39310) 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f309b7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f309c06e0a0 0x7f309c14c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f309bfff700 1 -- 172.21.15.12:0/2732532613 learned_addr learned my addr 172.21.15.12:0/2732532613 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.601+0000 7f309affd700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 0x7f309c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 -- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 msgr2=0x7f309c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 0x7f309c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 -- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f309c06e0a0 msgr2=0x7f309c14c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f309c06e0a0 0x7f309c14c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 -- 172.21.15.12:0/2732532613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30900093c0 con 0x7f309c06f3a0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309affd700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 0x7f309c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f309bfff700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f309400cca0 tx=0x7f3094001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400a980 con 0x7f309c06f3a0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309400aae0 con 0x7f309c06f3a0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309400ae60 con 0x7f309c06f3a0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309c14c8c0 con 0x7f309c06f3a0 2023-10-08T16:09:21.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.602+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c1412a0 con 0x7f309c06f3a0 2023-10-08T16:09:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.603+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c04c3c0 con 0x7f309c06f3a0 2023-10-08T16:09:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.604+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3094007300 con 0x7f309c06f3a0 2023-10-08T16:09:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.605+0000 7f30837fe700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 0x7f30880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.605+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3094084a40 con 0x7f309c06f3a0 2023-10-08T16:09:21.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.605+0000 7f309b7fe700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 0x7f30880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:21.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.606+0000 7f309b7fe700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 0x7f30880693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f309c0c2510 tx=0x7f308c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:21.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.609+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3094051c90 con 0x7f309c06f3a0 2023-10-08T16:09:21.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.811+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f309c0c7a50 con 0x7f309c06f3a0 2023-10-08T16:09:21.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.812+0000 7f30837fe700 1 -- 172.21.15.12:0/2732532613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f30940552b0 con 0x7f309c06f3a0 2023-10-08T16:09:21.813 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:21.813 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:20.453676+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:21.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 msgr2=0x7f30880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 0x7f30880693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f309c0c2510 tx=0x7f308c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 msgr2=0x7f309c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:21.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f309400cca0 tx=0x7f3094001ae0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 shutdown_connections 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3088066f30 0x7f30880693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f309c06f3a0 0x7f309c0c5ca0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f309c06e0a0 0x7f309c14c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 --2- 172.21.15.12:0/2732532613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f309c06e470 0x7f309c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 >> 172.21.15.12:0/2732532613 conn(0x7f309c06d170 msgr2=0x7f309c0c1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 shutdown_connections 2023-10-08T16:09:21.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:21.814+0000 7f30a099d700 1 -- 172.21.15.12:0/2732532613 wait complete. 2023-10-08T16:09:21.833 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:09:22.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.023+0000 7fb23b39d700 1 Processor -- start 2023-10-08T16:09:22.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.023+0000 7fb23b39d700 1 -- start start 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb23b39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb234159920 0x7fb2340ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb23b39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340acc00 con 0x7fb23415dfd0 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb23b39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2340abff0 con 0x7fb234159550 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb23b39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2340ac2d0 con 0x7fb234159920 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb239b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb23415dfd0 0x7fb2340aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49438/0 (socket says 172.21.15.12:49438) 2023-10-08T16:09:22.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb239b9a700 1 -- 172.21.15.12:0/3078749976 learned_addr learned my addr 172.21.15.12:0/3078749976 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:22.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.024+0000 7fb23ab9c700 1 --2- 172.21.15.12:0/3078749976 >> v2:172.21.15.12:3300/0 conn(0x7fb234159920 0x7fb2340ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb239399700 1 -- 172.21.15.12:0/3078749976 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991458117 0 0) 0x7fb2340acc00 con 0x7fb23415dfd0 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb239399700 1 -- 172.21.15.12:0/3078749976 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb220003570 con 0x7fb23415dfd0 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb23ab9c700 1 -- 172.21.15.12:0/3078749976 >> v1:172.21.15.29:6789/0 conn(0x7fb234159550 legacy=0x7fb2340ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb23ab9c700 1 -- 172.21.15.12:0/3078749976 >> v1:172.21.15.12:6789/0 conn(0x7fb23415dfd0 legacy=0x7fb2340aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb23ab9c700 1 -- 172.21.15.12:0/3078749976 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2340ac5b0 con 0x7fb234159920 2023-10-08T16:09:22.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb23ab9c700 1 --2- 172.21.15.12:0/3078749976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159920 0x7fb2340ad090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009e60 tx=0x7fb22c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aeff30e92c8d6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.025+0000 7fb239399700 1 -- 172.21.15.12:0/3078749976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00e070 con 0x7fb234159920 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb239399700 1 -- 172.21.15.12:0/3078749976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00bb60 con 0x7fb234159920 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb239399700 1 -- 172.21.15.12:0/3078749976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c012430 con 0x7fb234159920 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 -- 172.21.15.12:0/3078749976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159920 msgr2=0x7fb2340ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 --2- 172.21.15.12:0/3078749976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159920 0x7fb2340ad090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009e60 tx=0x7fb22c009780 comp rx=0 tx=0).stop 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 -- 172.21.15.12:0/3078749976 shutdown_connections 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 --2- 172.21.15.12:0/3078749976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159920 0x7fb2340ad090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 -- 172.21.15.12:0/3078749976 >> 172.21.15.12:0/3078749976 conn(0x7fb23406ce80 msgr2=0x7fb2340ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 -- 172.21.15.12:0/3078749976 shutdown_connections 2023-10-08T16:09:22.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.026+0000 7fb23b39d700 1 -- 172.21.15.12:0/3078749976 wait complete. 2023-10-08T16:09:22.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.028+0000 7fb23b39d700 1 Processor -- start 2023-10-08T16:09:22.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.028+0000 7fb23b39d700 1 -- start start 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 0x7fb2341559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb23415dfd0 0x7fb2340c9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb234147420 con 0x7fb234159550 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340c7560 con 0x7fb234159920 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2340c7840 con 0x7fb23415dfd0 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:22.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39334/0 (socket says 172.21.15.12:39334) 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 -- 172.21.15.12:0/2661485971 learned_addr learned my addr 172.21.15.12:0/2661485971 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb239b9a700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 0x7fb2341559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23ab9c700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb23415dfd0 0x7fb2340c9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 -- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb23415dfd0 msgr2=0x7fb2340c9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb23415dfd0 0x7fb2340c9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 -- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 msgr2=0x7fb2341559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 0x7fb2341559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb23a39b700 1 -- 172.21.15.12:0/2661485971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c009a20 con 0x7fb234159550 2023-10-08T16:09:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.029+0000 7fb239b9a700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 0x7fb2341559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:22.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb23a39b700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c5c0 tx=0x7fb23000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011590 con 0x7fb234159550 2023-10-08T16:09:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb230011710 con 0x7fb234159550 2023-10-08T16:09:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2341562a0 con 0x7fb234159550 2023-10-08T16:09:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb230011ad0 con 0x7fb234159550 2023-10-08T16:09:22.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.030+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb234156860 con 0x7fb234159550 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.031+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23404c3c0 con 0x7fb234159550 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.032+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb23001b3b0 con 0x7fb234159550 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.033+0000 7fb22a7fc700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 0x7fb2180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.033+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb230083b90 con 0x7fb234159550 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.033+0000 7fb239b9a700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 0x7fb2180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:22.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.034+0000 7fb239b9a700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 0x7fb2180693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb23416cd80 tx=0x7fb224009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:22.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.037+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb230050d60 con 0x7fb234159550 2023-10-08T16:09:22.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.282+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb2340cab90 con 0x7fb234159550 2023-10-08T16:09:22.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.973+0000 7fb22a7fc700 1 -- 172.21.15.12:0/2661485971 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb230017020 con 0x7fb234159550 2023-10-08T16:09:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 msgr2=0x7fb2180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 0x7fb2180693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb23416cd80 tx=0x7fb224009040 comp rx=0 tx=0).stop 2023-10-08T16:09:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 msgr2=0x7fb234146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:22.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c5c0 tx=0x7fb23000c980 comp rx=0 tx=0).stop 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 shutdown_connections 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb218066f30 0x7fb2180693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb234159550 0x7fb234146ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb23415dfd0 0x7fb2340c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 --2- 172.21.15.12:0/2661485971 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb234159920 0x7fb2341559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 >> 172.21.15.12:0/2661485971 conn(0x7fb23406ce80 msgr2=0x7fb2340b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 shutdown_connections 2023-10-08T16:09:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:22.976+0000 7fb23b39d700 1 -- 172.21.15.12:0/2661485971 wait complete. 2023-10-08T16:09:22.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:09:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.193+0000 7f9601d9d700 1 Processor -- start 2023-10-08T16:09:23.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.193+0000 7f9601d9d700 1 -- start start 2023-10-08T16:09:23.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc159550 0x7f95fc0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9601d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95fc15dfd0 0x7f95fc0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9601d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95fc0acc00 con 0x7f95fc159920 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9601d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95fc0abff0 con 0x7f95fc15dfd0 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9601d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0ac2d0 con 0x7f95fc159550 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f960159c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95fc159920 0x7f95fc0ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41680/0 (socket says 172.21.15.12:41680) 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f960159c700 1 -- 172.21.15.12:0/2996876722 learned_addr learned my addr 172.21.15.12:0/2996876722 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fbfff700 1 --2- 172.21.15.12:0/2996876722 >> v2:172.21.15.12:3300/0 conn(0x7f95fc15dfd0 0x7f95fc0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f9600d9b700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc159550 0x7f95fc0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fbfff700 1 -- 172.21.15.12:0/2996876722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc159550 msgr2=0x7f95fc0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fbfff700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc159550 0x7f95fc0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fbfff700 1 -- 172.21.15.12:0/2996876722 >> v1:172.21.15.12:6789/0 conn(0x7f95fc159920 legacy=0x7f95fc0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fbfff700 1 -- 172.21.15.12:0/2996876722 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95fc0ac5b0 con 0x7f95fc15dfd0 2023-10-08T16:09:23.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.195+0000 7f95fb7fe700 1 -- 172.21.15.12:0/2996876722 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962542357 0 0) 0x7f95fc0acc00 con 0x7f95fc159920 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f95fbfff700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc15dfd0 0x7f95fc0aedb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098e0 tx=0x7f95e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714ca317f79e2966 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f95fb7fe700 1 -- 172.21.15.12:0/2996876722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e8009e80 con 0x7f95fc15dfd0 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f95fb7fe700 1 -- 172.21.15.12:0/2996876722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e800b860 con 0x7f95fc15dfd0 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f95fb7fe700 1 -- 172.21.15.12:0/2996876722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e800bbe0 con 0x7f95fc15dfd0 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 -- 172.21.15.12:0/2996876722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc15dfd0 msgr2=0x7f95fc0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc15dfd0 0x7f95fc0aedb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95e80098e0 tx=0x7f95e80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 -- 172.21.15.12:0/2996876722 shutdown_connections 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc159550 0x7f95fc0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 --2- 172.21.15.12:0/2996876722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc15dfd0 0x7f95fc0aedb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.196+0000 7f9601d9d700 1 -- 172.21.15.12:0/2996876722 >> 172.21.15.12:0/2996876722 conn(0x7f95fc06ce80 msgr2=0x7f95fc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.197+0000 7f9601d9d700 1 -- 172.21.15.12:0/2996876722 shutdown_connections 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.197+0000 7f9601d9d700 1 -- 172.21.15.12:0/2996876722 wait complete. 2023-10-08T16:09:23.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.198+0000 7f9601d9d700 1 Processor -- start 2023-10-08T16:09:23.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.198+0000 7f9601d9d700 1 -- start start 2023-10-08T16:09:23.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc159920 0x7f95fc099b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc15dfd0 0x7f95fc09a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc0ca240 con 0x7f95fc159550 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc09b420 con 0x7f95fc159920 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9601d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95fc09a5c0 con 0x7f95fc15dfd0 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9600d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9600d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58152/0 (socket says 172.21.15.12:58152) 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f9600d9b700 1 -- 172.21.15.12:0/3804321386 learned_addr learned my addr 172.21.15.12:0/3804321386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f95fbfff700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc159920 0x7f95fc099b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.199+0000 7f960159c700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc15dfd0 0x7f95fc09a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 -- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc15dfd0 msgr2=0x7f95fc09a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc15dfd0 0x7f95fc09a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 -- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc159920 msgr2=0x7f95fc099b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc159920 0x7f95fc099b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 -- 172.21.15.12:0/3804321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8009420 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9600d9b700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95f000d860 tx=0x7f95f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00125f0 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0012750 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0012b10 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95fc09a810 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.200+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95fc09add0 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.201+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95fc04c3c0 con 0x7f95fc159550 2023-10-08T16:09:23.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.202+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95f0013480 con 0x7f95fc159550 2023-10-08T16:09:23.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.204+0000 7f95f8ff9700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 0x7f95e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:23.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.204+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95f0084850 con 0x7f95fc159550 2023-10-08T16:09:23.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.204+0000 7f95fbfff700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 0x7f95e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:23.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.204+0000 7f95fbfff700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 0x7f95e00693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95e80091e0 tx=0x7f95e8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:23.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.208+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95f00554b0 con 0x7f95fc159550 2023-10-08T16:09:23.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.458+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f95fc06e7c0 con 0x7f95fc159550 2023-10-08T16:09:23.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.978+0000 7f95f8ff9700 1 -- 172.21.15.12:0/3804321386 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95f0055040 con 0x7f95fc159550 2023-10-08T16:09:23.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 msgr2=0x7f95e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 0x7f95e00693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95e80091e0 tx=0x7f95e8017000 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 msgr2=0x7f95fc1521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f95f000d860 tx=0x7f95f0008040 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 shutdown_connections 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f95e0066f30 0x7f95e00693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95fc159550 0x7f95fc1521a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95fc15dfd0 0x7f95fc09a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 --2- 172.21.15.12:0/3804321386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95fc159920 0x7f95fc099b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.981+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 >> 172.21.15.12:0/3804321386 conn(0x7f95fc06ce80 msgr2=0x7f95fc0b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.982+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 shutdown_connections 2023-10-08T16:09:23.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:23.982+0000 7f9601d9d700 1 -- 172.21.15.12:0/3804321386 wait complete. 2023-10-08T16:09:24.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.189+0000 7f434139d700 1 Processor -- start 2023-10-08T16:09:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.189+0000 7f434139d700 1 -- start start 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f434139d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f433c13fb20 0x7f433c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f434139d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c15ae70 con 0x7f433c06aaa0 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f434139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433c06af60 con 0x7f433c13fef0 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f434139d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433c06b240 con 0x7f433c13fb20 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f4340b9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f433c06aaa0 0x7f433c0c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41682/0 (socket says 172.21.15.12:41682) 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f4340b9c700 1 -- 172.21.15.12:0/2075348750 learned_addr learned my addr 172.21.15.12:0/2075348750 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:24.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f433bfff700 1 --2- 172.21.15.12:0/2075348750 >> v2:172.21.15.29:3300/0 conn(0x7f433c13fb20 0x7f433c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.191+0000 7f433affd700 1 -- 172.21.15.12:0/2075348750 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636933411 0 0) 0x7f4334001490 con 0x7f433c06aaa0 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433affd700 1 -- 172.21.15.12:0/2075348750 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4324003570 con 0x7f433c06aaa0 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433bfff700 1 -- 172.21.15.12:0/2075348750 >> v1:172.21.15.29:6789/0 conn(0x7f433c13fef0 legacy=0x7f433c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433bfff700 1 -- 172.21.15.12:0/2075348750 >> v1:172.21.15.12:6789/0 conn(0x7f433c06aaa0 legacy=0x7f433c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433bfff700 1 -- 172.21.15.12:0/2075348750 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433c06b520 con 0x7f433c13fb20 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433bfff700 1 --2- 172.21.15.12:0/2075348750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c15a930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f432c0098e0 tx=0x7f432c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=443c070e70f7c248 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433affd700 1 -- 172.21.15.12:0/2075348750 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00f6b0 con 0x7f433c13fb20 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433affd700 1 -- 172.21.15.12:0/2075348750 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432c00f810 con 0x7f433c13fb20 2023-10-08T16:09:24.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.192+0000 7f433affd700 1 -- 172.21.15.12:0/2075348750 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432c00fb90 con 0x7f433c13fb20 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 -- 172.21.15.12:0/2075348750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 msgr2=0x7f433c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 --2- 172.21.15.12:0/2075348750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c15a930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f432c0098e0 tx=0x7f432c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 -- 172.21.15.12:0/2075348750 shutdown_connections 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 --2- 172.21.15.12:0/2075348750 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c15a930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 -- 172.21.15.12:0/2075348750 >> 172.21.15.12:0/2075348750 conn(0x7f433c06d170 msgr2=0x7f433c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 -- 172.21.15.12:0/2075348750 shutdown_connections 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.193+0000 7f434139d700 1 -- 172.21.15.12:0/2075348750 wait complete. 2023-10-08T16:09:24.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.194+0000 7f434139d700 1 Processor -- start 2023-10-08T16:09:24.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.194+0000 7f434139d700 1 -- start start 2023-10-08T16:09:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f433c06aaa0 0x7f433c13cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0ab740 con 0x7f433c13fef0 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f433c13d110 con 0x7f433c13fb20 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.195+0000 7f434139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f433c0ae420 con 0x7f433c06aaa0 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58156/0 (socket says 172.21.15.12:58156) 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 -- 172.21.15.12:0/1882540552 learned_addr learned my addr 172.21.15.12:0/1882540552 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f433bfff700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f433c06aaa0 0x7f433c13cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f433b7fe700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 -- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f433c06aaa0 msgr2=0x7f433c13cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f433c06aaa0 0x7f433c13cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 -- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 msgr2=0x7f433c157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 -- 172.21.15.12:0/1882540552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c009420 con 0x7f433c13fef0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.196+0000 7f4340b9c700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43340015f0 tx=0x7f4334001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.197+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400a930 con 0x7f433c13fef0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.197+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433400aa90 con 0x7f433c13fef0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.197+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f433c0ab990 con 0x7f433c13fef0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.197+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433400ae10 con 0x7f433c13fef0 2023-10-08T16:09:24.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.197+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f433c0abf50 con 0x7f433c13fef0 2023-10-08T16:09:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.198+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433c04c3c0 con 0x7f433c13fef0 2023-10-08T16:09:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.199+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4334007300 con 0x7f433c13fef0 2023-10-08T16:09:24.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.200+0000 7f4323fff700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 0x7f43280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.200+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f43340847f0 con 0x7f433c13fef0 2023-10-08T16:09:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.200+0000 7f433bfff700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 0x7f43280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.201+0000 7f433bfff700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 0x7f43280693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f432c0093f0 tx=0x7f432c019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.204+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43340554e0 con 0x7f433c13fef0 2023-10-08T16:09:24.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.449+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f433c15ae70 con 0x7f433c13fef0 2023-10-08T16:09:24.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.450+0000 7f4323fff700 1 -- 172.21.15.12:0/1882540552 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f433c15ae70 con 0x7f433c13fef0 2023-10-08T16:09:24.451 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:24.451 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:09:24.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 msgr2=0x7f43280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 0x7f43280693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f432c0093f0 tx=0x7f432c019000 comp rx=0 tx=0).stop 2023-10-08T16:09:24.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 msgr2=0x7f433c0aca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f43340015f0 tx=0x7f4334001a10 comp rx=0 tx=0).stop 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 shutdown_connections 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4328066f30 0x7f43280693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433c13fef0 0x7f433c0aca30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f433c06aaa0 0x7f433c13cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 --2- 172.21.15.12:0/1882540552 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f433c13fb20 0x7f433c157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 >> 172.21.15.12:0/1882540552 conn(0x7f433c06d170 msgr2=0x7f433c0c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.452+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 shutdown_connections 2023-10-08T16:09:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.453+0000 7f434139d700 1 -- 172.21.15.12:0/1882540552 wait complete. 2023-10-08T16:09:24.455 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:09:24.470 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.655+0000 7f602899d700 1 Processor -- start 2023-10-08T16:09:24.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.655+0000 7f602899d700 1 -- start start 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f602899d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6024142fd0 0x7f60240c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f602899d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60240c7dc0 0x7f602406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f602899d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240ca480 con 0x7f6024142c00 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f602899d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602415e240 con 0x7f60240c7dc0 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f602899d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602406b350 con 0x7f6024142fd0 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60240c7dc0 0x7f602406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60240c7dc0 0x7f602406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58166/0 (socket says 172.21.15.12:58166) 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 -- 172.21.15.12:0/862441578 learned_addr learned my addr 172.21.15.12:0/862441578 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6022ffd700 1 --2- 172.21.15.12:0/862441578 >> v2:172.21.15.29:3300/0 conn(0x7f6024142fd0 0x7f60240c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 -- 172.21.15.12:0/862441578 >> v2:172.21.15.29:3300/0 conn(0x7f6024142fd0 msgr2=0x7f60240c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 --2- 172.21.15.12:0/862441578 >> v2:172.21.15.29:3300/0 conn(0x7f6024142fd0 0x7f60240c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 -- 172.21.15.12:0/862441578 >> v1:172.21.15.29:6789/0 conn(0x7f6024142c00 legacy=0x7f602406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.657+0000 7f6023fff700 1 -- 172.21.15.12:0/862441578 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240c81d0 con 0x7f60240c7dc0 2023-10-08T16:09:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f6023fff700 1 --2- 172.21.15.12:0/862441578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60240c7dc0 0x7f602406c6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60240ce1b0 tx=0x7f601c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66237a33adcb5e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f60227fc700 1 -- 172.21.15.12:0/862441578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00e070 con 0x7f60240c7dc0 2023-10-08T16:09:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f60227fc700 1 -- 172.21.15.12:0/862441578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c00ba20 con 0x7f60240c7dc0 2023-10-08T16:09:24.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f60227fc700 1 -- 172.21.15.12:0/862441578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c0092e0 con 0x7f60240c7dc0 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f602899d700 1 -- 172.21.15.12:0/862441578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60240c7dc0 msgr2=0x7f602406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.658+0000 7f602899d700 1 --2- 172.21.15.12:0/862441578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60240c7dc0 0x7f602406c6a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f60240ce1b0 tx=0x7f601c009840 comp rx=0 tx=0).stop 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 -- 172.21.15.12:0/862441578 shutdown_connections 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 --2- 172.21.15.12:0/862441578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60240c7dc0 0x7f602406c6a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 --2- 172.21.15.12:0/862441578 >> v2:172.21.15.29:3300/0 conn(0x7f6024142fd0 0x7f60240c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 -- 172.21.15.12:0/862441578 >> 172.21.15.12:0/862441578 conn(0x7f60240675a0 msgr2=0x7f60240679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 -- 172.21.15.12:0/862441578 shutdown_connections 2023-10-08T16:09:24.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.659+0000 7f602899d700 1 -- 172.21.15.12:0/862441578 wait complete. 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.660+0000 7f602899d700 1 Processor -- start 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.660+0000 7f602899d700 1 -- start start 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60240c7dc0 0x7f60240c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6024142c00 0x7f6024158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c5980 con 0x7f6024142fd0 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c6350 con 0x7f60240c7dc0 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f602899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c4d70 con 0x7f6024142c00 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f6023fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f6023fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58176/0 (socket says 172.21.15.12:58176) 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f6023fff700 1 -- 172.21.15.12:0/182542659 learned_addr learned my addr 172.21.15.12:0/182542659 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.661+0000 7f60237fe700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60240c7dc0 0x7f60240c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6022ffd700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6024142c00 0x7f6024158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 -- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6024142c00 msgr2=0x7f6024158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6024142c00 0x7f6024158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 -- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60240c7dc0 msgr2=0x7f60240c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60240c7dc0 0x7f60240c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 -- 172.21.15.12:0/182542659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009ae0 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f6023fff700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f601c0072f0 tx=0x7f601c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c008b00 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c008c60 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60240c5050 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.662+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c026460 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.663+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240c5610 con 0x7f6024142fd0 2023-10-08T16:09:24.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.664+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240c5b30 con 0x7f6024142fd0 2023-10-08T16:09:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.665+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f601c003040 con 0x7f6024142fd0 2023-10-08T16:09:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.665+0000 7f600b7fe700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.665+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f601c086470 con 0x7f6024142fd0 2023-10-08T16:09:24.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.666+0000 7f60237fe700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:24.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.666+0000 7f60237fe700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 0x7f60100693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6014003a80 tx=0x7f6014007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:24.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.670+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60240c5b30 con 0x7f6024142fd0 2023-10-08T16:09:24.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.872+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6024142490 con 0x7f6024142fd0 2023-10-08T16:09:24.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.873+0000 7f600b7fe700 1 -- 172.21.15.12:0/182542659 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f601c053640 con 0x7f6024142fd0 2023-10-08T16:09:24.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:24.874 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 msgr2=0x7f60100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 0x7f60100693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6014003a80 tx=0x7f6014007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 msgr2=0x7f60240c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:24.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f601c0072f0 tx=0x7f601c018000 comp rx=0 tx=0).stop 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 shutdown_connections 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6010066f30 0x7f60100693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6024142fd0 0x7f60240c42f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60240c7dc0 0x7f60240c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 --2- 172.21.15.12:0/182542659 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6024142c00 0x7f6024158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 >> 172.21.15.12:0/182542659 conn(0x7f60240675a0 msgr2=0x7f6024158f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 shutdown_connections 2023-10-08T16:09:24.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:24.875+0000 7f602899d700 1 -- 172.21.15.12:0/182542659 wait complete. 2023-10-08T16:09:24.894 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:09:24.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.081+0000 7f6af3fff700 1 Processor -- start 2023-10-08T16:09:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.081+0000 7f6af3fff700 1 -- start start 2023-10-08T16:09:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6af40cf110 0x7f6af4164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af415afd0 con 0x7f6af415de50 2023-10-08T16:09:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6af415b2b0 con 0x7f6af4153c30 2023-10-08T16:09:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6af415b590 con 0x7f6af40cf110 2023-10-08T16:09:25.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af27fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6af415de50 0x7f6af40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41692/0 (socket says 172.21.15.12:41692) 2023-10-08T16:09:25.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af27fc700 1 -- 172.21.15.12:0/2249742597 learned_addr learned my addr 172.21.15.12:0/2249742597 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:25.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.082+0000 7f6af37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6af40cf110 0x7f6af4164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af1ffb700 1 -- 172.21.15.12:0/2249742597 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 544711132 0 0) 0x7f6af415afd0 con 0x7f6af415de50 2023-10-08T16:09:25.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af1ffb700 1 -- 172.21.15.12:0/2249742597 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc003570 con 0x7f6af415de50 2023-10-08T16:09:25.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af37fe700 1 -- 172.21.15.12:0/2249742597 >> v1:172.21.15.29:6789/0 conn(0x7f6af4153c30 legacy=0x7f6af415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af37fe700 1 -- 172.21.15.12:0/2249742597 >> v1:172.21.15.12:6789/0 conn(0x7f6af415de50 legacy=0x7f6af40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af37fe700 1 -- 172.21.15.12:0/2249742597 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6af415b870 con 0x7f6af40cf110 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af37fe700 1 --2- 172.21.15.12:0/2249742597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af40cf110 0x7f6af4164600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009e60 tx=0x7f6aec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fbac7ba206cf51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af1ffb700 1 -- 172.21.15.12:0/2249742597 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec00e070 con 0x7f6af40cf110 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af1ffb700 1 -- 172.21.15.12:0/2249742597 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec00bb60 con 0x7f6af40cf110 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.083+0000 7f6af1ffb700 1 -- 172.21.15.12:0/2249742597 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec012430 con 0x7f6af40cf110 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 -- 172.21.15.12:0/2249742597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af40cf110 msgr2=0x7f6af4164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 --2- 172.21.15.12:0/2249742597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af40cf110 0x7f6af4164600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6aec009e60 tx=0x7f6aec009780 comp rx=0 tx=0).stop 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 -- 172.21.15.12:0/2249742597 shutdown_connections 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 --2- 172.21.15.12:0/2249742597 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af40cf110 0x7f6af4164600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 -- 172.21.15.12:0/2249742597 >> 172.21.15.12:0/2249742597 conn(0x7f6af40703a0 msgr2=0x7f6af40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:25.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 -- 172.21.15.12:0/2249742597 shutdown_connections 2023-10-08T16:09:25.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.084+0000 7f6af3fff700 1 -- 172.21.15.12:0/2249742597 wait complete. 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.086+0000 7f6af3fff700 1 Processor -- start 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.086+0000 7f6af3fff700 1 -- start start 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6af40cf110 0x7f6af40c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6af4153c30 0x7f6af4145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40ca2d0 con 0x7f6af415de50 2023-10-08T16:09:25.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c9900 con 0x7f6af40cf110 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6af40c8cf0 con 0x7f6af4153c30 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6af40cf110 0x7f6af40c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58184/0 (socket says 172.21.15.12:58184) 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 -- 172.21.15.12:0/3425794404 learned_addr learned my addr 172.21.15.12:0/3425794404 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af27fc700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6af4153c30 0x7f6af4145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 -- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6af4153c30 msgr2=0x7f6af4145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6af4153c30 0x7f6af4145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 -- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6af40cf110 msgr2=0x7f6af40c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6af40cf110 0x7f6af40c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.087+0000 7f6af37fe700 1 -- 172.21.15.12:0/3425794404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aec009a20 con 0x7f6af415de50 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6af37fe700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6af406eb00 tx=0x7f6aec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec027470 con 0x7f6af415de50 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aec0275d0 con 0x7f6af415de50 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aec027990 con 0x7f6af415de50 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6af40c8fd0 con 0x7f6af415de50 2023-10-08T16:09:25.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.088+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6af40c9590 con 0x7f6af415de50 2023-10-08T16:09:25.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.089+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6af40c9ab0 con 0x7f6af415de50 2023-10-08T16:09:25.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.090+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6aec024070 con 0x7f6af415de50 2023-10-08T16:09:25.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.091+0000 7f6adaffd700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.091+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6aec086fe0 con 0x7f6af415de50 2023-10-08T16:09:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.091+0000 7f6af2ffd700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.092+0000 7f6af2ffd700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4003a80 tx=0x7f6ae4007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.095+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6af40c9ab0 con 0x7f6af415de50 2023-10-08T16:09:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.292+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6af40b24f0 con 0x7f6ae0066f30 2023-10-08T16:09:25.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.301+0000 7f6adaffd700 1 -- 172.21.15.12:0/3425794404 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253873 (secure 0 0 0) 0x7f6af40b24f0 con 0x7f6ae0066f30 2023-10-08T16:09:25.306 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:25.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 msgr2=0x7f6ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 0x7f6ae00693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6ae4003a80 tx=0x7f6ae4007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 msgr2=0x7f6af40cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6af406eb00 tx=0x7f6aec019000 comp rx=0 tx=0).stop 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 shutdown_connections 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6ae0066f30 0x7f6ae00693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6af415de50 0x7f6af40cc5f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6af40cf110 0x7f6af40c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 --2- 172.21.15.12:0/3425794404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6af4153c30 0x7f6af4145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 >> 172.21.15.12:0/3425794404 conn(0x7f6af40703a0 msgr2=0x7f6af4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 shutdown_connections 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.305+0000 7f6af3fff700 1 -- 172.21.15.12:0/3425794404 wait complete. 2023-10-08T16:09:25.309 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:25.323 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:09:23.912560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397288,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577432,"statfs":{"total":773094113280,"available":770639290368,"internally_reserved":0,"allocated":2531328,"data_stored":1582288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963244"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956459+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959856+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960142+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954624+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957119+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954615+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953638+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959167+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959265+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957310+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956455+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.955036+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957598+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952371+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953234+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957281+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953739+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.951856+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:09:13.936535+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:13.936535+0000","last_peered":"2023-10-08T16:09:13.936535+0000","last_clean":"2023-10-08T16:09:13.936535+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:13.936535+0000","last_undegraded":"2023-10-08T16:09:13.936535+0000","last_fullsized":"2023-10-08T16:09:13.936535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960103+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959273+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957831+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957131+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960870+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956793+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.958733+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959012+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952041+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.958385+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952345+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":761856,"data_stored":640562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":640562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:25.334 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.548+0000 7f5e401ff700 1 Processor -- start 2023-10-08T16:09:25.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.548+0000 7f5e401ff700 1 -- start start 2023-10-08T16:09:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.549+0000 7f5e401ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e38157600 0x7f5e380b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.549+0000 7f5e401ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e380ccba0 0x7f5e380b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.549+0000 7f5e401ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e38158210 con 0x7f5e381579d0 2023-10-08T16:09:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.549+0000 7f5e401ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e380cb850 con 0x7f5e38157600 2023-10-08T16:09:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.549+0000 7f5e401ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380cb290 con 0x7f5e380ccba0 2023-10-08T16:09:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3d79a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e381579d0 0x7f5e381586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41700/0 (socket says 172.21.15.12:41700) 2023-10-08T16:09:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3d79a700 1 -- 172.21.15.12:0/1588539065 learned_addr learned my addr 172.21.15.12:0/1588539065 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/1588539065 >> v2:172.21.15.29:3300/0 conn(0x7f5e38157600 0x7f5e380b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3e79c700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e380ccba0 0x7f5e380b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3cf99700 1 -- 172.21.15.12:0/1588539065 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126791527 0 0) 0x7f5e38158210 con 0x7f5e381579d0 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3cf99700 1 -- 172.21.15.12:0/1588539065 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e24003570 con 0x7f5e381579d0 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3df9b700 1 -- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e380ccba0 msgr2=0x7f5e380b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e380ccba0 0x7f5e380b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3df9b700 1 -- 172.21.15.12:0/1588539065 >> v1:172.21.15.12:6789/0 conn(0x7f5e381579d0 legacy=0x7f5e381586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.550+0000 7f5e3df9b700 1 -- 172.21.15.12:0/1588539065 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e380cb570 con 0x7f5e38157600 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e38157600 0x7f5e380b1410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098e0 tx=0x7f5e340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ed57e04c933afc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e3cf99700 1 -- 172.21.15.12:0/1588539065 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34011630 con 0x7f5e38157600 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e3cf99700 1 -- 172.21.15.12:0/1588539065 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34011790 con 0x7f5e38157600 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e3cf99700 1 -- 172.21.15.12:0/1588539065 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34011b10 con 0x7f5e38157600 2023-10-08T16:09:25.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 -- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e38157600 msgr2=0x7f5e380b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e38157600 0x7f5e380b1410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5e340098e0 tx=0x7f5e340091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 -- 172.21.15.12:0/1588539065 shutdown_connections 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e380ccba0 0x7f5e380b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 --2- 172.21.15.12:0/1588539065 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e38157600 0x7f5e380b1410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.551+0000 7f5e401ff700 1 -- 172.21.15.12:0/1588539065 >> 172.21.15.12:0/1588539065 conn(0x7f5e3806d170 msgr2=0x7f5e380cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.552+0000 7f5e401ff700 1 -- 172.21.15.12:0/1588539065 shutdown_connections 2023-10-08T16:09:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.552+0000 7f5e401ff700 1 -- 172.21.15.12:0/1588539065 wait complete. 2023-10-08T16:09:25.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.553+0000 7f5e401ff700 1 Processor -- start 2023-10-08T16:09:25.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.553+0000 7f5e401ff700 1 -- start start 2023-10-08T16:09:25.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 0x7f5e380c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e38157600 0x7f5e38146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e38155550 con 0x7f5e381579d0 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380c6340 con 0x7f5e380ccba0 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e401ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380c8920 con 0x7f5e38157600 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e3e79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e3e79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58200/0 (socket says 172.21.15.12:58200) 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e3e79c700 1 -- 172.21.15.12:0/689171974 learned_addr learned my addr 172.21.15.12:0/689171974 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e3df9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 0x7f5e380c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.554+0000 7f5e3d79a700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e38157600 0x7f5e38146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 -- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e38157600 msgr2=0x7f5e38146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e38157600 0x7f5e38146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 -- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 msgr2=0x7f5e380c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 0x7f5e380c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 -- 172.21.15.12:0/689171974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009420 con 0x7f5e381579d0 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 0x7f5e380c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e3e79c700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009df0 tx=0x7f5e3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000caa0 con 0x7f5e381579d0 2023-10-08T16:09:25.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000f040 con 0x7f5e381579d0 2023-10-08T16:09:25.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000ce70 con 0x7f5e381579d0 2023-10-08T16:09:25.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380c5a10 con 0x7f5e381579d0 2023-10-08T16:09:25.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.555+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e380c5fd0 con 0x7f5e381579d0 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.556+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3804c3c0 con 0x7f5e381579d0 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.557+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e30014690 con 0x7f5e381579d0 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.558+0000 7f5e2dffb700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.558+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e300850f0 con 0x7f5e381579d0 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.558+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.559+0000 7f5e3df9b700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 0x7f5e1c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e340091e0 tx=0x7f5e34017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:25.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.562+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e30055d50 con 0x7f5e381579d0 2023-10-08T16:09:25.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.758+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5e38155ce0 con 0x7f5e1c066f30 2023-10-08T16:09:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.766+0000 7f5e2dffb700 1 -- 172.21.15.12:0/689171974 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253873 (secure 0 0 0) 0x7f5e38155ce0 con 0x7f5e1c066f30 2023-10-08T16:09:25.771 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 msgr2=0x7f5e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 0x7f5e1c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5e340091e0 tx=0x7f5e34017000 comp rx=0 tx=0).stop 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 msgr2=0x7f5e38146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e30009df0 tx=0x7f5e3000b040 comp rx=0 tx=0).stop 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 shutdown_connections 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e1c066f30 0x7f5e1c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e381579d0 0x7f5e38146e90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e380ccba0 0x7f5e380c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 --2- 172.21.15.12:0/689171974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e38157600 0x7f5e38146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 >> 172.21.15.12:0/689171974 conn(0x7f5e3806d170 msgr2=0x7f5e3815a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 shutdown_connections 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:25.770+0000 7f5e401ff700 1 -- 172.21.15.12:0/689171974 wait complete. 2023-10-08T16:09:25.774 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:25.788 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:09:23.912560+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397288,"kb_used_data":2472,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577432,"statfs":{"total":773094113280,"available":770639290368,"internally_reserved":0,"allocated":2531328,"data_stored":1582288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.963244"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956459+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959856+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960142+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954624+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957119+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.954615+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953638+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959167+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959265+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957310+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956455+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.955036+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957598+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952371+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:31.637599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953234+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957281+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953739+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.951856+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:37.798019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.953643+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":160,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-10-08T16:09:13.936535+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:13.936535+0000","last_peered":"2023-10-08T16:09:13.936535+0000","last_clean":"2023-10-08T16:09:13.936535+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:13.936535+0000","last_undegraded":"2023-10-08T16:09:13.936535+0000","last_fullsized":"2023-10-08T16:09:13.936535+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960103+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959273+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957831+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.957131+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.960870+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.956793+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.958733+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.959012+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952041+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.958385+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:09:18.943347+0000","last_change":"2023-10-08T16:09:18.952345+0000","last_active":"2023-10-08T16:09:18.943347+0000","last_peered":"2023-10-08T16:09:18.943347+0000","last_clean":"2023-10-08T16:09:18.943347+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:18.943347+0000","last_undegraded":"2023-10-08T16:09:18.943347+0000","last_fullsized":"2023-10-08T16:09:18.943347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:09:19.949446+0000","last_change":"2023-10-08T16:09:19.949446+0000","last_active":"2023-10-08T16:09:19.949446+0000","last_peered":"2023-10-08T16:09:19.949446+0000","last_clean":"2023-10-08T16:09:19.949446+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:09:19.949446+0000","last_undegraded":"2023-10-08T16:09:19.949446+0000","last_fullsized":"2023-10-08T16:09:19.949446+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302256,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069584,"statfs":{"total":96636764160,"available":96327254016,"internally_reserved":0,"allocated":761856,"data_stored":640562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94399999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.149}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":640562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301548,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070292,"statfs":{"total":96636764160,"available":96327979008,"internally_reserved":0,"allocated":167936,"data_stored":50194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:25.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:26.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.016+0000 7f9f0bfff700 1 Processor -- start 2023-10-08T16:09:26.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.017+0000 7f9f0bfff700 1 -- start start 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9f0c159550 0x7f9f0c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0acc00 con 0x7f9f0c159920 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0c0abff0 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0c0ac2d0 con 0x7f9f0c159550 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9f0c159920 0x7f9f0c0ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41716/0 (socket says 172.21.15.12:41716) 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0b7fe700 1 -- 172.21.15.12:0/3726495917 learned_addr learned my addr 172.21.15.12:0/3726495917 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:26.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.018+0000 7f9f0affd700 1 --2- 172.21.15.12:0/3726495917 >> v2:172.21.15.29:3300/0 conn(0x7f9f0c159550 0x7f9f0c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f09ffb700 1 -- 172.21.15.12:0/3726495917 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1165920861 0 0) 0x7f9f0c0acc00 con 0x7f9f0c159920 2023-10-08T16:09:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f09ffb700 1 -- 172.21.15.12:0/3726495917 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef4003570 con 0x7f9f0c159920 2023-10-08T16:09:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f0affd700 1 -- 172.21.15.12:0/3726495917 >> v1:172.21.15.29:6789/0 conn(0x7f9f0c15dfd0 legacy=0x7f9f0c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f0affd700 1 -- 172.21.15.12:0/3726495917 >> v1:172.21.15.12:6789/0 conn(0x7f9f0c159920 legacy=0x7f9f0c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f0affd700 1 -- 172.21.15.12:0/3726495917 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0c0ac5b0 con 0x7f9f0c159550 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f0affd700 1 --2- 172.21.15.12:0/3726495917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159550 0x7f9f0c0ceac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098e0 tx=0x7f9efc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=601889dbd5a4d6c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f09ffb700 1 -- 172.21.15.12:0/3726495917 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00b640 con 0x7f9f0c159550 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f09ffb700 1 -- 172.21.15.12:0/3726495917 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc00b7a0 con 0x7f9f0c159550 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.019+0000 7f9f09ffb700 1 -- 172.21.15.12:0/3726495917 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc00bb40 con 0x7f9f0c159550 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 -- 172.21.15.12:0/3726495917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159550 msgr2=0x7f9f0c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/3726495917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159550 0x7f9f0c0ceac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0098e0 tx=0x7f9efc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 -- 172.21.15.12:0/3726495917 shutdown_connections 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/3726495917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159550 0x7f9f0c0ceac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 -- 172.21.15.12:0/3726495917 >> 172.21.15.12:0/3726495917 conn(0x7f9f0c06ce80 msgr2=0x7f9f0c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 -- 172.21.15.12:0/3726495917 shutdown_connections 2023-10-08T16:09:26.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.020+0000 7f9f0bfff700 1 -- 172.21.15.12:0/3726495917 wait complete. 2023-10-08T16:09:26.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.021+0000 7f9f0bfff700 1 Processor -- start 2023-10-08T16:09:26.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.021+0000 7f9f0bfff700 1 -- start start 2023-10-08T16:09:26.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f0c159550 0x7f9f0c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159920 0x7f9f0c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1150 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b13a0 con 0x7f9f0c159920 2023-10-08T16:09:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.022+0000 7f9f0bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c0b1680 con 0x7f9f0c159550 2023-10-08T16:09:26.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58208/0 (socket says 172.21.15.12:58208) 2023-10-08T16:09:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 -- 172.21.15.12:0/1802836 learned_addr learned my addr 172.21.15.12:0/1802836 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:26.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0a7fc700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159920 0x7f9f0c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0affd700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f0c159550 0x7f9f0c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 -- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f0c159550 msgr2=0x7f9f0c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f0c159550 0x7f9f0c0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 -- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159920 msgr2=0x7f9f0c0cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159920 0x7f9f0c0cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 -- 172.21.15.12:0/1802836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc009420 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9f0b7fe700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f04001460 tx=0x7f9f04001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.023+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0400ce80 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.024+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0400ab70 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.024+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040070f0 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.024+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c0b1960 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.024+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c0b1f20 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.025+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0c04c3c0 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.026+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f04007520 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.027+0000 7f9ef2ffd700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.027+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f04084b30 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.027+0000 7f9f0affd700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.028+0000 7f9f0affd700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 0x7f9ef80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0093f0 tx=0x7f9efc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.031+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f04051cf0 con 0x7f9f0c15dfd0 2023-10-08T16:09:26.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.229+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f0c0ade50 con 0x7f9ef8066f30 2023-10-08T16:09:26.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.237+0000 7f9ef2ffd700 1 -- 172.21.15.12:0/1802836 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264632 (secure 0 0 0) 0x7f9f0c0ade50 con 0x7f9ef8066f30 2023-10-08T16:09:26.241 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 msgr2=0x7f9ef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 0x7f9ef80693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0093f0 tx=0x7f9efc017000 comp rx=0 tx=0).stop 2023-10-08T16:09:26.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 msgr2=0x7f9f0c146b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f04001460 tx=0x7f9f04001ae0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 shutdown_connections 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9ef8066f30 0x7f9ef80693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f0c15dfd0 0x7f9f0c146b10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f0c159550 0x7f9f0c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 --2- 172.21.15.12:0/1802836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f0c159920 0x7f9f0c0cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 >> 172.21.15.12:0/1802836 conn(0x7f9f0c06ce80 msgr2=0x7f9f0c1535c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 shutdown_connections 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.241+0000 7f9f0bfff700 1 -- 172.21.15.12:0/1802836 wait complete. 2023-10-08T16:09:26.244 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:26.259 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:09:25.912923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397608,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577112,"statfs":{"total":773094113280,"available":770638962688,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001223"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931948+0000","last_change":"2023-10-08T16:09:20.923239+0000","last_active":"2023-10-08T16:09:20.931948+0000","last_peered":"2023-10-08T16:09:20.931948+0000","last_clean":"2023-10-08T16:09:20.931948+0000","last_became_active":"2023-10-08T16:09:20.922789+0000","last_became_peered":"2023-10-08T16:09:20.922789+0000","last_unstale":"2023-10-08T16:09:20.931948+0000","last_undegraded":"2023-10-08T16:09:20.931948+0000","last_fullsized":"2023-10-08T16:09:20.931948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:36.471481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918249+0000","last_change":"2023-10-08T16:09:20.914085+0000","last_active":"2023-10-08T16:09:20.918249+0000","last_peered":"2023-10-08T16:09:20.918249+0000","last_clean":"2023-10-08T16:09:20.918249+0000","last_became_active":"2023-10-08T16:09:20.913834+0000","last_became_peered":"2023-10-08T16:09:20.913834+0000","last_unstale":"2023-10-08T16:09:20.918249+0000","last_undegraded":"2023-10-08T16:09:20.918249+0000","last_fullsized":"2023-10-08T16:09:20.918249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.919536+0000","last_change":"2023-10-08T16:09:20.915094+0000","last_active":"2023-10-08T16:09:20.919536+0000","last_peered":"2023-10-08T16:09:20.919536+0000","last_clean":"2023-10-08T16:09:20.919536+0000","last_became_active":"2023-10-08T16:09:20.914821+0000","last_became_peered":"2023-10-08T16:09:20.914821+0000","last_unstale":"2023-10-08T16:09:20.919536+0000","last_undegraded":"2023-10-08T16:09:20.919536+0000","last_fullsized":"2023-10-08T16:09:20.919536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:39.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934072+0000","last_change":"2023-10-08T16:09:20.931361+0000","last_active":"2023-10-08T16:09:20.934072+0000","last_peered":"2023-10-08T16:09:20.934072+0000","last_clean":"2023-10-08T16:09:20.934072+0000","last_became_active":"2023-10-08T16:09:20.931006+0000","last_became_peered":"2023-10-08T16:09:20.931006+0000","last_unstale":"2023-10-08T16:09:20.934072+0000","last_undegraded":"2023-10-08T16:09:20.934072+0000","last_fullsized":"2023-10-08T16:09:20.934072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931450+0000","last_change":"2023-10-08T16:09:20.924404+0000","last_active":"2023-10-08T16:09:20.931450+0000","last_peered":"2023-10-08T16:09:20.931450+0000","last_clean":"2023-10-08T16:09:20.931450+0000","last_became_active":"2023-10-08T16:09:20.924076+0000","last_became_peered":"2023-10-08T16:09:20.924076+0000","last_unstale":"2023-10-08T16:09:20.931450+0000","last_undegraded":"2023-10-08T16:09:20.931450+0000","last_fullsized":"2023-10-08T16:09:20.931450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:29.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932898+0000","last_change":"2023-10-08T16:09:20.922230+0000","last_active":"2023-10-08T16:09:20.932898+0000","last_peered":"2023-10-08T16:09:20.932898+0000","last_clean":"2023-10-08T16:09:20.932898+0000","last_became_active":"2023-10-08T16:09:20.921756+0000","last_became_peered":"2023-10-08T16:09:20.921756+0000","last_unstale":"2023-10-08T16:09:20.932898+0000","last_undegraded":"2023-10-08T16:09:20.932898+0000","last_fullsized":"2023-10-08T16:09:20.932898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930235+0000","last_change":"2023-10-08T16:09:20.926442+0000","last_active":"2023-10-08T16:09:20.930235+0000","last_peered":"2023-10-08T16:09:20.930235+0000","last_clean":"2023-10-08T16:09:20.930235+0000","last_became_active":"2023-10-08T16:09:20.926134+0000","last_became_peered":"2023-10-08T16:09:20.926134+0000","last_unstale":"2023-10-08T16:09:20.930235+0000","last_undegraded":"2023-10-08T16:09:20.930235+0000","last_fullsized":"2023-10-08T16:09:20.930235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:09.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938511+0000","last_change":"2023-10-08T16:09:20.934468+0000","last_active":"2023-10-08T16:09:20.938511+0000","last_peered":"2023-10-08T16:09:20.938511+0000","last_clean":"2023-10-08T16:09:20.938511+0000","last_became_active":"2023-10-08T16:09:20.934187+0000","last_became_peered":"2023-10-08T16:09:20.934187+0000","last_unstale":"2023-10-08T16:09:20.938511+0000","last_undegraded":"2023-10-08T16:09:20.938511+0000","last_fullsized":"2023-10-08T16:09:20.938511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934886+0000","last_change":"2023-10-08T16:09:20.930046+0000","last_active":"2023-10-08T16:09:20.934886+0000","last_peered":"2023-10-08T16:09:20.934886+0000","last_clean":"2023-10-08T16:09:20.934886+0000","last_became_active":"2023-10-08T16:09:20.929384+0000","last_became_peered":"2023-10-08T16:09:20.929384+0000","last_unstale":"2023-10-08T16:09:20.934886+0000","last_undegraded":"2023-10-08T16:09:20.934886+0000","last_fullsized":"2023-10-08T16:09:20.934886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:29.654343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925610+0000","last_change":"2023-10-08T16:09:20.921732+0000","last_active":"2023-10-08T16:09:20.925610+0000","last_peered":"2023-10-08T16:09:20.925610+0000","last_clean":"2023-10-08T16:09:20.925610+0000","last_became_active":"2023-10-08T16:09:20.921260+0000","last_became_peered":"2023-10-08T16:09:20.921260+0000","last_unstale":"2023-10-08T16:09:20.925610+0000","last_undegraded":"2023-10-08T16:09:20.925610+0000","last_fullsized":"2023-10-08T16:09:20.925610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935782+0000","last_change":"2023-10-08T16:09:20.934331+0000","last_active":"2023-10-08T16:09:20.935782+0000","last_peered":"2023-10-08T16:09:20.935782+0000","last_clean":"2023-10-08T16:09:20.935782+0000","last_became_active":"2023-10-08T16:09:20.934023+0000","last_became_peered":"2023-10-08T16:09:20.934023+0000","last_unstale":"2023-10-08T16:09:20.935782+0000","last_undegraded":"2023-10-08T16:09:20.935782+0000","last_fullsized":"2023-10-08T16:09:20.935782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927686+0000","last_change":"2023-10-08T16:09:20.921076+0000","last_active":"2023-10-08T16:09:20.927686+0000","last_peered":"2023-10-08T16:09:20.927686+0000","last_clean":"2023-10-08T16:09:20.927686+0000","last_became_active":"2023-10-08T16:09:20.920798+0000","last_became_peered":"2023-10-08T16:09:20.920798+0000","last_unstale":"2023-10-08T16:09:20.927686+0000","last_undegraded":"2023-10-08T16:09:20.927686+0000","last_fullsized":"2023-10-08T16:09:20.927686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:00.083968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925745+0000","last_change":"2023-10-08T16:09:20.922551+0000","last_active":"2023-10-08T16:09:20.925745+0000","last_peered":"2023-10-08T16:09:20.925745+0000","last_clean":"2023-10-08T16:09:20.925745+0000","last_became_active":"2023-10-08T16:09:20.922276+0000","last_became_peered":"2023-10-08T16:09:20.922276+0000","last_unstale":"2023-10-08T16:09:20.925745+0000","last_undegraded":"2023-10-08T16:09:20.925745+0000","last_fullsized":"2023-10-08T16:09:20.925745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927387+0000","last_change":"2023-10-08T16:09:20.921190+0000","last_active":"2023-10-08T16:09:20.927387+0000","last_peered":"2023-10-08T16:09:20.927387+0000","last_clean":"2023-10-08T16:09:20.927387+0000","last_became_active":"2023-10-08T16:09:20.920627+0000","last_became_peered":"2023-10-08T16:09:20.920627+0000","last_unstale":"2023-10-08T16:09:20.927387+0000","last_undegraded":"2023-10-08T16:09:20.927387+0000","last_fullsized":"2023-10-08T16:09:20.927387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:16.772848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918396+0000","last_change":"2023-10-08T16:09:20.913009+0000","last_active":"2023-10-08T16:09:20.918396+0000","last_peered":"2023-10-08T16:09:20.918396+0000","last_clean":"2023-10-08T16:09:20.918396+0000","last_became_active":"2023-10-08T16:09:20.912719+0000","last_became_peered":"2023-10-08T16:09:20.912719+0000","last_unstale":"2023-10-08T16:09:20.918396+0000","last_undegraded":"2023-10-08T16:09:20.918396+0000","last_fullsized":"2023-10-08T16:09:20.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920698+0000","last_change":"2023-10-08T16:09:20.916696+0000","last_active":"2023-10-08T16:09:20.920698+0000","last_peered":"2023-10-08T16:09:20.920698+0000","last_clean":"2023-10-08T16:09:20.920698+0000","last_became_active":"2023-10-08T16:09:20.916352+0000","last_became_peered":"2023-10-08T16:09:20.916352+0000","last_unstale":"2023-10-08T16:09:20.920698+0000","last_undegraded":"2023-10-08T16:09:20.920698+0000","last_fullsized":"2023-10-08T16:09:20.920698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928741+0000","last_change":"2023-10-08T16:09:20.919110+0000","last_active":"2023-10-08T16:09:20.928741+0000","last_peered":"2023-10-08T16:09:20.928741+0000","last_clean":"2023-10-08T16:09:20.928741+0000","last_became_active":"2023-10-08T16:09:20.918780+0000","last_became_peered":"2023-10-08T16:09:20.918780+0000","last_unstale":"2023-10-08T16:09:20.928741+0000","last_undegraded":"2023-10-08T16:09:20.928741+0000","last_fullsized":"2023-10-08T16:09:20.928741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922564+0000","last_change":"2023-10-08T16:09:20.918158+0000","last_active":"2023-10-08T16:09:20.922564+0000","last_peered":"2023-10-08T16:09:20.922564+0000","last_clean":"2023-10-08T16:09:20.922564+0000","last_became_active":"2023-10-08T16:09:20.917856+0000","last_became_peered":"2023-10-08T16:09:20.917856+0000","last_unstale":"2023-10-08T16:09:20.922564+0000","last_undegraded":"2023-10-08T16:09:20.922564+0000","last_fullsized":"2023-10-08T16:09:20.922564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931481+0000","last_change":"2023-10-08T16:09:20.927146+0000","last_active":"2023-10-08T16:09:20.931481+0000","last_peered":"2023-10-08T16:09:20.931481+0000","last_clean":"2023-10-08T16:09:20.931481+0000","last_became_active":"2023-10-08T16:09:20.924805+0000","last_became_peered":"2023-10-08T16:09:20.924805+0000","last_unstale":"2023-10-08T16:09:20.931481+0000","last_undegraded":"2023-10-08T16:09:20.931481+0000","last_fullsized":"2023-10-08T16:09:20.931481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:43.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972105+0000","last_change":"2023-10-08T16:09:19.983339+0000","last_active":"2023-10-08T16:09:20.972105+0000","last_peered":"2023-10-08T16:09:20.972105+0000","last_clean":"2023-10-08T16:09:20.972105+0000","last_became_active":"2023-10-08T16:09:19.983052+0000","last_became_peered":"2023-10-08T16:09:19.983052+0000","last_unstale":"2023-10-08T16:09:20.972105+0000","last_undegraded":"2023-10-08T16:09:20.972105+0000","last_fullsized":"2023-10-08T16:09:20.972105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925071+0000","last_change":"2023-10-08T16:09:20.923270+0000","last_active":"2023-10-08T16:09:20.925071+0000","last_peered":"2023-10-08T16:09:20.925071+0000","last_clean":"2023-10-08T16:09:20.925071+0000","last_became_active":"2023-10-08T16:09:20.923011+0000","last_became_peered":"2023-10-08T16:09:20.923011+0000","last_unstale":"2023-10-08T16:09:20.925071+0000","last_undegraded":"2023-10-08T16:09:20.925071+0000","last_fullsized":"2023-10-08T16:09:20.925071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975780+0000","last_change":"2023-10-08T16:09:19.983890+0000","last_active":"2023-10-08T16:09:20.975780+0000","last_peered":"2023-10-08T16:09:20.975780+0000","last_clean":"2023-10-08T16:09:20.975780+0000","last_became_active":"2023-10-08T16:09:19.983629+0000","last_became_peered":"2023-10-08T16:09:19.983629+0000","last_unstale":"2023-10-08T16:09:20.975780+0000","last_undegraded":"2023-10-08T16:09:20.975780+0000","last_fullsized":"2023-10-08T16:09:20.975780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932721+0000","last_change":"2023-10-08T16:09:20.929176+0000","last_active":"2023-10-08T16:09:20.932721+0000","last_peered":"2023-10-08T16:09:20.932721+0000","last_clean":"2023-10-08T16:09:20.932721+0000","last_became_active":"2023-10-08T16:09:20.928937+0000","last_became_peered":"2023-10-08T16:09:20.928937+0000","last_unstale":"2023-10-08T16:09:20.932721+0000","last_undegraded":"2023-10-08T16:09:20.932721+0000","last_fullsized":"2023-10-08T16:09:20.932721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973901+0000","last_change":"2023-10-08T16:09:19.982390+0000","last_active":"2023-10-08T16:09:20.973901+0000","last_peered":"2023-10-08T16:09:20.973901+0000","last_clean":"2023-10-08T16:09:20.973901+0000","last_became_active":"2023-10-08T16:09:19.982067+0000","last_became_peered":"2023-10-08T16:09:19.982067+0000","last_unstale":"2023-10-08T16:09:20.973901+0000","last_undegraded":"2023-10-08T16:09:20.973901+0000","last_fullsized":"2023-10-08T16:09:20.973901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:56.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933876+0000","last_change":"2023-10-08T16:09:20.928229+0000","last_active":"2023-10-08T16:09:20.933876+0000","last_peered":"2023-10-08T16:09:20.933876+0000","last_clean":"2023-10-08T16:09:20.933876+0000","last_became_active":"2023-10-08T16:09:20.927947+0000","last_became_peered":"2023-10-08T16:09:20.927947+0000","last_unstale":"2023-10-08T16:09:20.933876+0000","last_undegraded":"2023-10-08T16:09:20.933876+0000","last_fullsized":"2023-10-08T16:09:20.933876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:20.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971881+0000","last_change":"2023-10-08T16:09:19.976558+0000","last_active":"2023-10-08T16:09:20.971881+0000","last_peered":"2023-10-08T16:09:20.971881+0000","last_clean":"2023-10-08T16:09:20.971881+0000","last_became_active":"2023-10-08T16:09:19.976190+0000","last_became_peered":"2023-10-08T16:09:19.976190+0000","last_unstale":"2023-10-08T16:09:20.971881+0000","last_undegraded":"2023-10-08T16:09:20.971881+0000","last_fullsized":"2023-10-08T16:09:20.971881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:16.143856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933050+0000","last_change":"2023-10-08T16:09:20.926759+0000","last_active":"2023-10-08T16:09:20.933050+0000","last_peered":"2023-10-08T16:09:20.933050+0000","last_clean":"2023-10-08T16:09:20.933050+0000","last_became_active":"2023-10-08T16:09:20.926449+0000","last_became_peered":"2023-10-08T16:09:20.926449+0000","last_unstale":"2023-10-08T16:09:20.933050+0000","last_undegraded":"2023-10-08T16:09:20.933050+0000","last_fullsized":"2023-10-08T16:09:20.933050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975655+0000","last_change":"2023-10-08T16:09:19.983304+0000","last_active":"2023-10-08T16:09:20.975655+0000","last_peered":"2023-10-08T16:09:20.975655+0000","last_clean":"2023-10-08T16:09:20.975655+0000","last_became_active":"2023-10-08T16:09:19.982916+0000","last_became_peered":"2023-10-08T16:09:19.982916+0000","last_unstale":"2023-10-08T16:09:20.975655+0000","last_undegraded":"2023-10-08T16:09:20.975655+0000","last_fullsized":"2023-10-08T16:09:20.975655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925716+0000","last_change":"2023-10-08T16:09:20.914915+0000","last_active":"2023-10-08T16:09:20.925716+0000","last_peered":"2023-10-08T16:09:20.925716+0000","last_clean":"2023-10-08T16:09:20.925716+0000","last_became_active":"2023-10-08T16:09:20.914562+0000","last_became_peered":"2023-10-08T16:09:20.914562+0000","last_unstale":"2023-10-08T16:09:20.925716+0000","last_undegraded":"2023-10-08T16:09:20.925716+0000","last_fullsized":"2023-10-08T16:09:20.925716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.969110+0000","last_change":"2023-10-08T16:09:19.982834+0000","last_active":"2023-10-08T16:09:20.969110+0000","last_peered":"2023-10-08T16:09:20.969110+0000","last_clean":"2023-10-08T16:09:20.969110+0000","last_became_active":"2023-10-08T16:09:19.981385+0000","last_became_peered":"2023-10-08T16:09:19.981385+0000","last_unstale":"2023-10-08T16:09:20.969110+0000","last_undegraded":"2023-10-08T16:09:20.969110+0000","last_fullsized":"2023-10-08T16:09:20.969110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930013+0000","last_change":"2023-10-08T16:09:20.924374+0000","last_active":"2023-10-08T16:09:20.930013+0000","last_peered":"2023-10-08T16:09:20.930013+0000","last_clean":"2023-10-08T16:09:20.930013+0000","last_became_active":"2023-10-08T16:09:20.924067+0000","last_became_peered":"2023-10-08T16:09:20.924067+0000","last_unstale":"2023-10-08T16:09:20.930013+0000","last_undegraded":"2023-10-08T16:09:20.930013+0000","last_fullsized":"2023-10-08T16:09:20.930013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.916621+0000","last_change":"2023-10-08T16:09:19.979195+0000","last_active":"2023-10-08T16:09:20.916621+0000","last_peered":"2023-10-08T16:09:20.916621+0000","last_clean":"2023-10-08T16:09:20.916621+0000","last_became_active":"2023-10-08T16:09:19.977936+0000","last_became_peered":"2023-10-08T16:09:19.977936+0000","last_unstale":"2023-10-08T16:09:20.916621+0000","last_undegraded":"2023-10-08T16:09:20.916621+0000","last_fullsized":"2023-10-08T16:09:20.916621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933011+0000","last_change":"2023-10-08T16:09:20.928131+0000","last_active":"2023-10-08T16:09:20.933011+0000","last_peered":"2023-10-08T16:09:20.933011+0000","last_clean":"2023-10-08T16:09:20.933011+0000","last_became_active":"2023-10-08T16:09:20.927721+0000","last_became_peered":"2023-10-08T16:09:20.927721+0000","last_unstale":"2023-10-08T16:09:20.933011+0000","last_undegraded":"2023-10-08T16:09:20.933011+0000","last_fullsized":"2023-10-08T16:09:20.933011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906866+0000","last_change":"2023-10-08T16:09:19.988608+0000","last_active":"2023-10-08T16:09:20.906866+0000","last_peered":"2023-10-08T16:09:20.906866+0000","last_clean":"2023-10-08T16:09:20.906866+0000","last_became_active":"2023-10-08T16:09:19.988278+0000","last_became_peered":"2023-10-08T16:09:19.988278+0000","last_unstale":"2023-10-08T16:09:20.906866+0000","last_undegraded":"2023-10-08T16:09:20.906866+0000","last_fullsized":"2023-10-08T16:09:20.906866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.921581+0000","last_change":"2023-10-08T16:09:20.918971+0000","last_active":"2023-10-08T16:09:20.921581+0000","last_peered":"2023-10-08T16:09:20.921581+0000","last_clean":"2023-10-08T16:09:20.921581+0000","last_became_active":"2023-10-08T16:09:20.918687+0000","last_became_peered":"2023-10-08T16:09:20.918687+0000","last_unstale":"2023-10-08T16:09:20.921581+0000","last_undegraded":"2023-10-08T16:09:20.921581+0000","last_fullsized":"2023-10-08T16:09:20.921581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910412+0000","last_change":"2023-10-08T16:09:19.989053+0000","last_active":"2023-10-08T16:09:20.910412+0000","last_peered":"2023-10-08T16:09:20.910412+0000","last_clean":"2023-10-08T16:09:20.910412+0000","last_became_active":"2023-10-08T16:09:19.988777+0000","last_became_peered":"2023-10-08T16:09:19.988777+0000","last_unstale":"2023-10-08T16:09:20.910412+0000","last_undegraded":"2023-10-08T16:09:20.910412+0000","last_fullsized":"2023-10-08T16:09:20.910412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928707+0000","last_change":"2023-10-08T16:09:20.919114+0000","last_active":"2023-10-08T16:09:20.928707+0000","last_peered":"2023-10-08T16:09:20.928707+0000","last_clean":"2023-10-08T16:09:20.928707+0000","last_became_active":"2023-10-08T16:09:20.918800+0000","last_became_peered":"2023-10-08T16:09:20.918800+0000","last_unstale":"2023-10-08T16:09:20.928707+0000","last_undegraded":"2023-10-08T16:09:20.928707+0000","last_fullsized":"2023-10-08T16:09:20.928707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.907633+0000","last_change":"2023-10-08T16:09:19.985911+0000","last_active":"2023-10-08T16:09:20.907633+0000","last_peered":"2023-10-08T16:09:20.907633+0000","last_clean":"2023-10-08T16:09:20.907633+0000","last_became_active":"2023-10-08T16:09:19.985587+0000","last_became_peered":"2023-10-08T16:09:19.985587+0000","last_unstale":"2023-10-08T16:09:20.907633+0000","last_undegraded":"2023-10-08T16:09:20.907633+0000","last_fullsized":"2023-10-08T16:09:20.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927469+0000","last_change":"2023-10-08T16:09:20.923331+0000","last_active":"2023-10-08T16:09:20.927469+0000","last_peered":"2023-10-08T16:09:20.927469+0000","last_clean":"2023-10-08T16:09:20.927469+0000","last_became_active":"2023-10-08T16:09:20.923039+0000","last_became_peered":"2023-10-08T16:09:20.923039+0000","last_unstale":"2023-10-08T16:09:20.927469+0000","last_undegraded":"2023-10-08T16:09:20.927469+0000","last_fullsized":"2023-10-08T16:09:20.927469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:17.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970716+0000","last_change":"2023-10-08T16:09:19.977329+0000","last_active":"2023-10-08T16:09:20.970716+0000","last_peered":"2023-10-08T16:09:20.970716+0000","last_clean":"2023-10-08T16:09:20.970716+0000","last_became_active":"2023-10-08T16:09:19.977037+0000","last_became_peered":"2023-10-08T16:09:19.977037+0000","last_unstale":"2023-10-08T16:09:20.970716+0000","last_undegraded":"2023-10-08T16:09:20.970716+0000","last_fullsized":"2023-10-08T16:09:20.970716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929923+0000","last_change":"2023-10-08T16:09:20.925081+0000","last_active":"2023-10-08T16:09:20.929923+0000","last_peered":"2023-10-08T16:09:20.929923+0000","last_clean":"2023-10-08T16:09:20.929923+0000","last_became_active":"2023-10-08T16:09:20.924752+0000","last_became_peered":"2023-10-08T16:09:20.924752+0000","last_unstale":"2023-10-08T16:09:20.929923+0000","last_undegraded":"2023-10-08T16:09:20.929923+0000","last_fullsized":"2023-10-08T16:09:20.929923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:26.766584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.977381+0000","last_change":"2023-10-08T16:09:19.983118+0000","last_active":"2023-10-08T16:09:20.977381+0000","last_peered":"2023-10-08T16:09:20.977381+0000","last_clean":"2023-10-08T16:09:20.977381+0000","last_became_active":"2023-10-08T16:09:19.980439+0000","last_became_peered":"2023-10-08T16:09:19.980439+0000","last_unstale":"2023-10-08T16:09:20.977381+0000","last_undegraded":"2023-10-08T16:09:20.977381+0000","last_fullsized":"2023-10-08T16:09:20.977381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931518+0000","last_change":"2023-10-08T16:09:20.927943+0000","last_active":"2023-10-08T16:09:20.931518+0000","last_peered":"2023-10-08T16:09:20.931518+0000","last_clean":"2023-10-08T16:09:20.931518+0000","last_became_active":"2023-10-08T16:09:20.927658+0000","last_became_peered":"2023-10-08T16:09:20.927658+0000","last_unstale":"2023-10-08T16:09:20.931518+0000","last_undegraded":"2023-10-08T16:09:20.931518+0000","last_fullsized":"2023-10-08T16:09:20.931518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:12.394183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973062+0000","last_change":"2023-10-08T16:09:19.980609+0000","last_active":"2023-10-08T16:09:20.973062+0000","last_peered":"2023-10-08T16:09:20.973062+0000","last_clean":"2023-10-08T16:09:20.973062+0000","last_became_active":"2023-10-08T16:09:19.980306+0000","last_became_peered":"2023-10-08T16:09:19.980306+0000","last_unstale":"2023-10-08T16:09:20.973062+0000","last_undegraded":"2023-10-08T16:09:20.973062+0000","last_fullsized":"2023-10-08T16:09:20.973062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927258+0000","last_change":"2023-10-08T16:09:20.920087+0000","last_active":"2023-10-08T16:09:20.927258+0000","last_peered":"2023-10-08T16:09:20.927258+0000","last_clean":"2023-10-08T16:09:20.927258+0000","last_became_active":"2023-10-08T16:09:20.919773+0000","last_became_peered":"2023-10-08T16:09:20.919773+0000","last_unstale":"2023-10-08T16:09:20.927258+0000","last_undegraded":"2023-10-08T16:09:20.927258+0000","last_fullsized":"2023-10-08T16:09:20.927258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908169+0000","last_change":"2023-10-08T16:09:19.982809+0000","last_active":"2023-10-08T16:09:20.908169+0000","last_peered":"2023-10-08T16:09:20.908169+0000","last_clean":"2023-10-08T16:09:20.908169+0000","last_became_active":"2023-10-08T16:09:19.981705+0000","last_became_peered":"2023-10-08T16:09:19.981705+0000","last_unstale":"2023-10-08T16:09:20.908169+0000","last_undegraded":"2023-10-08T16:09:20.908169+0000","last_fullsized":"2023-10-08T16:09:20.908169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933512+0000","last_change":"2023-10-08T16:09:20.930857+0000","last_active":"2023-10-08T16:09:20.933512+0000","last_peered":"2023-10-08T16:09:20.933512+0000","last_clean":"2023-10-08T16:09:20.933512+0000","last_became_active":"2023-10-08T16:09:20.930508+0000","last_became_peered":"2023-10-08T16:09:20.930508+0000","last_unstale":"2023-10-08T16:09:20.933512+0000","last_undegraded":"2023-10-08T16:09:20.933512+0000","last_fullsized":"2023-10-08T16:09:20.933512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910553+0000","last_change":"2023-10-08T16:09:19.982295+0000","last_active":"2023-10-08T16:09:20.910553+0000","last_peered":"2023-10-08T16:09:20.910553+0000","last_clean":"2023-10-08T16:09:20.910553+0000","last_became_active":"2023-10-08T16:09:19.980861+0000","last_became_peered":"2023-10-08T16:09:19.980861+0000","last_unstale":"2023-10-08T16:09:20.910553+0000","last_undegraded":"2023-10-08T16:09:20.910553+0000","last_fullsized":"2023-10-08T16:09:20.910553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922812+0000","last_change":"2023-10-08T16:09:20.921200+0000","last_active":"2023-10-08T16:09:20.922812+0000","last_peered":"2023-10-08T16:09:20.922812+0000","last_clean":"2023-10-08T16:09:20.922812+0000","last_became_active":"2023-10-08T16:09:20.920910+0000","last_became_peered":"2023-10-08T16:09:20.920910+0000","last_unstale":"2023-10-08T16:09:20.922812+0000","last_undegraded":"2023-10-08T16:09:20.922812+0000","last_fullsized":"2023-10-08T16:09:20.922812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973571+0000","last_change":"2023-10-08T16:09:19.977338+0000","last_active":"2023-10-08T16:09:20.973571+0000","last_peered":"2023-10-08T16:09:20.973571+0000","last_clean":"2023-10-08T16:09:20.973571+0000","last_became_active":"2023-10-08T16:09:19.976975+0000","last_became_peered":"2023-10-08T16:09:19.976975+0000","last_unstale":"2023-10-08T16:09:20.973571+0000","last_undegraded":"2023-10-08T16:09:20.973571+0000","last_fullsized":"2023-10-08T16:09:20.973571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930255+0000","last_change":"2023-10-08T16:09:20.927111+0000","last_active":"2023-10-08T16:09:20.930255+0000","last_peered":"2023-10-08T16:09:20.930255+0000","last_clean":"2023-10-08T16:09:20.930255+0000","last_became_active":"2023-10-08T16:09:20.926829+0000","last_became_peered":"2023-10-08T16:09:20.926829+0000","last_unstale":"2023-10-08T16:09:20.930255+0000","last_undegraded":"2023-10-08T16:09:20.930255+0000","last_fullsized":"2023-10-08T16:09:20.930255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970929+0000","last_change":"2023-10-08T16:09:19.975261+0000","last_active":"2023-10-08T16:09:20.970929+0000","last_peered":"2023-10-08T16:09:20.970929+0000","last_clean":"2023-10-08T16:09:20.970929+0000","last_became_active":"2023-10-08T16:09:19.973725+0000","last_became_peered":"2023-10-08T16:09:19.973725+0000","last_unstale":"2023-10-08T16:09:20.970929+0000","last_undegraded":"2023-10-08T16:09:20.970929+0000","last_fullsized":"2023-10-08T16:09:20.970929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934834+0000","last_change":"2023-10-08T16:09:20.931298+0000","last_active":"2023-10-08T16:09:20.934834+0000","last_peered":"2023-10-08T16:09:20.934834+0000","last_clean":"2023-10-08T16:09:20.934834+0000","last_became_active":"2023-10-08T16:09:20.931005+0000","last_became_peered":"2023-10-08T16:09:20.931005+0000","last_unstale":"2023-10-08T16:09:20.934834+0000","last_undegraded":"2023-10-08T16:09:20.934834+0000","last_fullsized":"2023-10-08T16:09:20.934834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904313+0000","last_change":"2023-10-08T16:09:19.984230+0000","last_active":"2023-10-08T16:09:20.904313+0000","last_peered":"2023-10-08T16:09:20.904313+0000","last_clean":"2023-10-08T16:09:20.904313+0000","last_became_active":"2023-10-08T16:09:19.983946+0000","last_became_peered":"2023-10-08T16:09:19.983946+0000","last_unstale":"2023-10-08T16:09:20.904313+0000","last_undegraded":"2023-10-08T16:09:20.904313+0000","last_fullsized":"2023-10-08T16:09:20.904313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933894+0000","last_change":"2023-10-08T16:09:20.927574+0000","last_active":"2023-10-08T16:09:20.933894+0000","last_peered":"2023-10-08T16:09:20.933894+0000","last_clean":"2023-10-08T16:09:20.933894+0000","last_became_active":"2023-10-08T16:09:20.927296+0000","last_became_peered":"2023-10-08T16:09:20.927296+0000","last_unstale":"2023-10-08T16:09:20.933894+0000","last_undegraded":"2023-10-08T16:09:20.933894+0000","last_fullsized":"2023-10-08T16:09:20.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908051+0000","last_change":"2023-10-08T16:09:19.980289+0000","last_active":"2023-10-08T16:09:20.908051+0000","last_peered":"2023-10-08T16:09:20.908051+0000","last_clean":"2023-10-08T16:09:20.908051+0000","last_became_active":"2023-10-08T16:09:19.979983+0000","last_became_peered":"2023-10-08T16:09:19.979983+0000","last_unstale":"2023-10-08T16:09:20.908051+0000","last_undegraded":"2023-10-08T16:09:20.908051+0000","last_fullsized":"2023-10-08T16:09:20.908051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920184+0000","last_change":"2023-10-08T16:09:20.914485+0000","last_active":"2023-10-08T16:09:20.920184+0000","last_peered":"2023-10-08T16:09:20.920184+0000","last_clean":"2023-10-08T16:09:20.920184+0000","last_became_active":"2023-10-08T16:09:20.914148+0000","last_became_peered":"2023-10-08T16:09:20.914148+0000","last_unstale":"2023-10-08T16:09:20.920184+0000","last_undegraded":"2023-10-08T16:09:20.920184+0000","last_fullsized":"2023-10-08T16:09:20.920184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918439+0000","last_change":"2023-10-08T16:09:20.914673+0000","last_active":"2023-10-08T16:09:20.918439+0000","last_peered":"2023-10-08T16:09:20.918439+0000","last_clean":"2023-10-08T16:09:20.918439+0000","last_became_active":"2023-10-08T16:09:20.914358+0000","last_became_peered":"2023-10-08T16:09:20.914358+0000","last_unstale":"2023-10-08T16:09:20.918439+0000","last_undegraded":"2023-10-08T16:09:20.918439+0000","last_fullsized":"2023-10-08T16:09:20.918439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909604+0000","last_change":"2023-10-08T16:09:19.976530+0000","last_active":"2023-10-08T16:09:20.909604+0000","last_peered":"2023-10-08T16:09:20.909604+0000","last_clean":"2023-10-08T16:09:20.909604+0000","last_became_active":"2023-10-08T16:09:19.976209+0000","last_became_peered":"2023-10-08T16:09:19.976209+0000","last_unstale":"2023-10-08T16:09:20.909604+0000","last_undegraded":"2023-10-08T16:09:20.909604+0000","last_fullsized":"2023-10-08T16:09:20.909604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938527+0000","last_change":"2023-10-08T16:09:20.934594+0000","last_active":"2023-10-08T16:09:20.938527+0000","last_peered":"2023-10-08T16:09:20.938527+0000","last_clean":"2023-10-08T16:09:20.938527+0000","last_became_active":"2023-10-08T16:09:20.934373+0000","last_became_peered":"2023-10-08T16:09:20.934373+0000","last_unstale":"2023-10-08T16:09:20.938527+0000","last_undegraded":"2023-10-08T16:09:20.938527+0000","last_fullsized":"2023-10-08T16:09:20.938527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906768+0000","last_change":"2023-10-08T16:09:19.978998+0000","last_active":"2023-10-08T16:09:20.906768+0000","last_peered":"2023-10-08T16:09:20.906768+0000","last_clean":"2023-10-08T16:09:20.906768+0000","last_became_active":"2023-10-08T16:09:19.978699+0000","last_became_peered":"2023-10-08T16:09:19.978699+0000","last_unstale":"2023-10-08T16:09:20.906768+0000","last_undegraded":"2023-10-08T16:09:20.906768+0000","last_fullsized":"2023-10-08T16:09:20.906768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910926+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:20.910926+0000","last_peered":"2023-10-08T16:09:20.910926+0000","last_clean":"2023-10-08T16:09:20.910926+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:20.910926+0000","last_undegraded":"2023-10-08T16:09:20.910926+0000","last_fullsized":"2023-10-08T16:09:20.910926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927499+0000","last_change":"2023-10-08T16:09:20.922573+0000","last_active":"2023-10-08T16:09:20.927499+0000","last_peered":"2023-10-08T16:09:20.927499+0000","last_clean":"2023-10-08T16:09:20.927499+0000","last_became_active":"2023-10-08T16:09:20.922307+0000","last_became_peered":"2023-10-08T16:09:20.922307+0000","last_unstale":"2023-10-08T16:09:20.927499+0000","last_undegraded":"2023-10-08T16:09:20.927499+0000","last_fullsized":"2023-10-08T16:09:20.927499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.913353+0000","last_change":"2023-10-08T16:09:19.986258+0000","last_active":"2023-10-08T16:09:20.913353+0000","last_peered":"2023-10-08T16:09:20.913353+0000","last_clean":"2023-10-08T16:09:20.913353+0000","last_became_active":"2023-10-08T16:09:19.985989+0000","last_became_peered":"2023-10-08T16:09:19.985989+0000","last_unstale":"2023-10-08T16:09:20.913353+0000","last_undegraded":"2023-10-08T16:09:20.913353+0000","last_fullsized":"2023-10-08T16:09:20.913353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.912945+0000","last_change":"2023-10-08T16:09:19.980337+0000","last_active":"2023-10-08T16:09:20.912945+0000","last_peered":"2023-10-08T16:09:20.912945+0000","last_clean":"2023-10-08T16:09:20.912945+0000","last_became_active":"2023-10-08T16:09:19.980070+0000","last_became_peered":"2023-10-08T16:09:19.980070+0000","last_unstale":"2023-10-08T16:09:20.912945+0000","last_undegraded":"2023-10-08T16:09:20.912945+0000","last_fullsized":"2023-10-08T16:09:20.912945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918188+0000","last_change":"2023-10-08T16:09:20.915246+0000","last_active":"2023-10-08T16:09:20.918188+0000","last_peered":"2023-10-08T16:09:20.918188+0000","last_clean":"2023-10-08T16:09:20.918188+0000","last_became_active":"2023-10-08T16:09:20.914991+0000","last_became_peered":"2023-10-08T16:09:20.914991+0000","last_unstale":"2023-10-08T16:09:20.918188+0000","last_undegraded":"2023-10-08T16:09:20.918188+0000","last_fullsized":"2023-10-08T16:09:20.918188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904380+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904380+0000","last_peered":"2023-10-08T16:09:20.904380+0000","last_clean":"2023-10-08T16:09:20.904380+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904380+0000","last_undegraded":"2023-10-08T16:09:20.904380+0000","last_fullsized":"2023-10-08T16:09:20.904380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925249+0000","last_change":"2023-10-08T16:09:20.921141+0000","last_active":"2023-10-08T16:09:20.925249+0000","last_peered":"2023-10-08T16:09:20.925249+0000","last_clean":"2023-10-08T16:09:20.925249+0000","last_became_active":"2023-10-08T16:09:20.920816+0000","last_became_peered":"2023-10-08T16:09:20.920816+0000","last_unstale":"2023-10-08T16:09:20.925249+0000","last_undegraded":"2023-10-08T16:09:20.925249+0000","last_fullsized":"2023-10-08T16:09:20.925249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972582+0000","last_change":"2023-10-08T16:09:19.983612+0000","last_active":"2023-10-08T16:09:20.972582+0000","last_peered":"2023-10-08T16:09:20.972582+0000","last_clean":"2023-10-08T16:09:20.972582+0000","last_became_active":"2023-10-08T16:09:19.983271+0000","last_became_peered":"2023-10-08T16:09:19.983271+0000","last_unstale":"2023-10-08T16:09:20.972582+0000","last_undegraded":"2023-10-08T16:09:20.972582+0000","last_fullsized":"2023-10-08T16:09:20.972582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927296+0000","last_change":"2023-10-08T16:09:20.920177+0000","last_active":"2023-10-08T16:09:20.927296+0000","last_peered":"2023-10-08T16:09:20.927296+0000","last_clean":"2023-10-08T16:09:20.927296+0000","last_became_active":"2023-10-08T16:09:20.919978+0000","last_became_peered":"2023-10-08T16:09:20.919978+0000","last_unstale":"2023-10-08T16:09:20.927296+0000","last_undegraded":"2023-10-08T16:09:20.927296+0000","last_fullsized":"2023-10-08T16:09:20.927296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.911835+0000","last_change":"2023-10-08T16:09:19.982502+0000","last_active":"2023-10-08T16:09:20.911835+0000","last_peered":"2023-10-08T16:09:20.911835+0000","last_clean":"2023-10-08T16:09:20.911835+0000","last_became_active":"2023-10-08T16:09:19.982165+0000","last_became_peered":"2023-10-08T16:09:19.982165+0000","last_unstale":"2023-10-08T16:09:20.911835+0000","last_undegraded":"2023-10-08T16:09:20.911835+0000","last_fullsized":"2023-10-08T16:09:20.911835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920335+0000","last_change":"2023-10-08T16:09:20.912685+0000","last_active":"2023-10-08T16:09:20.920335+0000","last_peered":"2023-10-08T16:09:20.920335+0000","last_clean":"2023-10-08T16:09:20.920335+0000","last_became_active":"2023-10-08T16:09:20.912404+0000","last_became_peered":"2023-10-08T16:09:20.912404+0000","last_unstale":"2023-10-08T16:09:20.920335+0000","last_undegraded":"2023-10-08T16:09:20.920335+0000","last_fullsized":"2023-10-08T16:09:20.920335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:49.906876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904177+0000","last_change":"2023-10-08T16:09:19.982753+0000","last_active":"2023-10-08T16:09:20.904177+0000","last_peered":"2023-10-08T16:09:20.904177+0000","last_clean":"2023-10-08T16:09:20.904177+0000","last_became_active":"2023-10-08T16:09:19.982334+0000","last_became_peered":"2023-10-08T16:09:19.982334+0000","last_unstale":"2023-10-08T16:09:20.904177+0000","last_undegraded":"2023-10-08T16:09:20.904177+0000","last_fullsized":"2023-10-08T16:09:20.904177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.924534+0000","last_change":"2023-10-08T16:09:20.919166+0000","last_active":"2023-10-08T16:09:20.924534+0000","last_peered":"2023-10-08T16:09:20.924534+0000","last_clean":"2023-10-08T16:09:20.924534+0000","last_became_active":"2023-10-08T16:09:20.918875+0000","last_became_peered":"2023-10-08T16:09:20.918875+0000","last_unstale":"2023-10-08T16:09:20.924534+0000","last_undegraded":"2023-10-08T16:09:20.924534+0000","last_fullsized":"2023-10-08T16:09:20.924534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904175+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904175+0000","last_peered":"2023-10-08T16:09:20.904175+0000","last_clean":"2023-10-08T16:09:20.904175+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904175+0000","last_undegraded":"2023-10-08T16:09:20.904175+0000","last_fullsized":"2023-10-08T16:09:20.904175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930491+0000","last_change":"2023-10-08T16:09:20.925593+0000","last_active":"2023-10-08T16:09:20.930491+0000","last_peered":"2023-10-08T16:09:20.930491+0000","last_clean":"2023-10-08T16:09:20.930491+0000","last_became_active":"2023-10-08T16:09:20.925297+0000","last_became_peered":"2023-10-08T16:09:20.925297+0000","last_unstale":"2023-10-08T16:09:20.930491+0000","last_undegraded":"2023-10-08T16:09:20.930491+0000","last_fullsized":"2023-10-08T16:09:20.930491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971799+0000","last_change":"2023-10-08T16:09:19.971356+0000","last_active":"2023-10-08T16:09:20.971799+0000","last_peered":"2023-10-08T16:09:20.971799+0000","last_clean":"2023-10-08T16:09:20.971799+0000","last_became_active":"2023-10-08T16:09:19.970744+0000","last_became_peered":"2023-10-08T16:09:19.970744+0000","last_unstale":"2023-10-08T16:09:20.971799+0000","last_undegraded":"2023-10-08T16:09:20.971799+0000","last_fullsized":"2023-10-08T16:09:20.971799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932776+0000","last_change":"2023-10-08T16:09:20.929086+0000","last_active":"2023-10-08T16:09:20.932776+0000","last_peered":"2023-10-08T16:09:20.932776+0000","last_clean":"2023-10-08T16:09:20.932776+0000","last_became_active":"2023-10-08T16:09:20.928822+0000","last_became_peered":"2023-10-08T16:09:20.928822+0000","last_unstale":"2023-10-08T16:09:20.932776+0000","last_undegraded":"2023-10-08T16:09:20.932776+0000","last_fullsized":"2023-10-08T16:09:20.932776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909850+0000","last_change":"2023-10-08T16:09:19.981894+0000","last_active":"2023-10-08T16:09:20.909850+0000","last_peered":"2023-10-08T16:09:20.909850+0000","last_clean":"2023-10-08T16:09:20.909850+0000","last_became_active":"2023-10-08T16:09:19.981565+0000","last_became_peered":"2023-10-08T16:09:19.981565+0000","last_unstale":"2023-10-08T16:09:20.909850+0000","last_undegraded":"2023-10-08T16:09:20.909850+0000","last_fullsized":"2023-10-08T16:09:20.909850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929759+0000","last_change":"2023-10-08T16:09:20.923617+0000","last_active":"2023-10-08T16:09:20.929759+0000","last_peered":"2023-10-08T16:09:20.929759+0000","last_clean":"2023-10-08T16:09:20.929759+0000","last_became_active":"2023-10-08T16:09:20.923317+0000","last_became_peered":"2023-10-08T16:09:20.923317+0000","last_unstale":"2023-10-08T16:09:20.929759+0000","last_undegraded":"2023-10-08T16:09:20.929759+0000","last_fullsized":"2023-10-08T16:09:20.929759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:42.436753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970642+0000","last_change":"2023-10-08T16:09:19.980864+0000","last_active":"2023-10-08T16:09:20.970642+0000","last_peered":"2023-10-08T16:09:20.970642+0000","last_clean":"2023-10-08T16:09:20.970642+0000","last_became_active":"2023-10-08T16:09:19.980600+0000","last_became_peered":"2023-10-08T16:09:19.980600+0000","last_unstale":"2023-10-08T16:09:20.970642+0000","last_undegraded":"2023-10-08T16:09:20.970642+0000","last_fullsized":"2023-10-08T16:09:20.970642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935869+0000","last_change":"2023-10-08T16:09:20.933766+0000","last_active":"2023-10-08T16:09:20.935869+0000","last_peered":"2023-10-08T16:09:20.935869+0000","last_clean":"2023-10-08T16:09:20.935869+0000","last_became_active":"2023-10-08T16:09:20.932450+0000","last_became_peered":"2023-10-08T16:09:20.932450+0000","last_unstale":"2023-10-08T16:09:20.935869+0000","last_undegraded":"2023-10-08T16:09:20.935869+0000","last_fullsized":"2023-10-08T16:09:20.935869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973172+0000","last_change":"2023-10-08T16:09:19.976571+0000","last_active":"2023-10-08T16:09:20.973172+0000","last_peered":"2023-10-08T16:09:20.973172+0000","last_clean":"2023-10-08T16:09:20.973172+0000","last_became_active":"2023-10-08T16:09:19.976236+0000","last_became_peered":"2023-10-08T16:09:19.976236+0000","last_unstale":"2023-10-08T16:09:20.973172+0000","last_undegraded":"2023-10-08T16:09:20.973172+0000","last_fullsized":"2023-10-08T16:09:20.973172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934951+0000","last_change":"2023-10-08T16:09:20.932413+0000","last_active":"2023-10-08T16:09:20.934951+0000","last_peered":"2023-10-08T16:09:20.934951+0000","last_clean":"2023-10-08T16:09:20.934951+0000","last_became_active":"2023-10-08T16:09:20.932147+0000","last_became_peered":"2023-10-08T16:09:20.932147+0000","last_unstale":"2023-10-08T16:09:20.934951+0000","last_undegraded":"2023-10-08T16:09:20.934951+0000","last_fullsized":"2023-10-08T16:09:20.934951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925266+0000","last_change":"2023-10-08T16:09:20.922001+0000","last_active":"2023-10-08T16:09:20.925266+0000","last_peered":"2023-10-08T16:09:20.925266+0000","last_clean":"2023-10-08T16:09:20.925266+0000","last_became_active":"2023-10-08T16:09:20.921669+0000","last_became_peered":"2023-10-08T16:09:20.921669+0000","last_unstale":"2023-10-08T16:09:20.925266+0000","last_undegraded":"2023-10-08T16:09:20.925266+0000","last_fullsized":"2023-10-08T16:09:20.925266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922887+0000","last_change":"2023-10-08T16:09:20.921422+0000","last_active":"2023-10-08T16:09:20.922887+0000","last_peered":"2023-10-08T16:09:20.922887+0000","last_clean":"2023-10-08T16:09:20.922887+0000","last_became_active":"2023-10-08T16:09:20.921165+0000","last_became_peered":"2023-10-08T16:09:20.921165+0000","last_unstale":"2023-10-08T16:09:20.922887+0000","last_undegraded":"2023-10-08T16:09:20.922887+0000","last_fullsized":"2023-10-08T16:09:20.922887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934025+0000","last_change":"2023-10-08T16:09:20.931352+0000","last_active":"2023-10-08T16:09:20.934025+0000","last_peered":"2023-10-08T16:09:20.934025+0000","last_clean":"2023-10-08T16:09:20.934025+0000","last_became_active":"2023-10-08T16:09:20.931070+0000","last_became_peered":"2023-10-08T16:09:20.931070+0000","last_unstale":"2023-10-08T16:09:20.934025+0000","last_undegraded":"2023-10-08T16:09:20.934025+0000","last_fullsized":"2023-10-08T16:09:20.934025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930029+0000","last_change":"2023-10-08T16:09:20.926274+0000","last_active":"2023-10-08T16:09:20.930029+0000","last_peered":"2023-10-08T16:09:20.930029+0000","last_clean":"2023-10-08T16:09:20.930029+0000","last_became_active":"2023-10-08T16:09:20.925863+0000","last_became_peered":"2023-10-08T16:09:20.925863+0000","last_unstale":"2023-10-08T16:09:20.930029+0000","last_undegraded":"2023-10-08T16:09:20.930029+0000","last_fullsized":"2023-10-08T16:09:20.930029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930429+0000","last_change":"2023-10-08T16:09:20.925620+0000","last_active":"2023-10-08T16:09:20.930429+0000","last_peered":"2023-10-08T16:09:20.930429+0000","last_clean":"2023-10-08T16:09:20.930429+0000","last_became_active":"2023-10-08T16:09:20.924561+0000","last_became_peered":"2023-10-08T16:09:20.924561+0000","last_unstale":"2023-10-08T16:09:20.930429+0000","last_undegraded":"2023-10-08T16:09:20.930429+0000","last_fullsized":"2023-10-08T16:09:20.930429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918309+0000","last_change":"2023-10-08T16:09:20.916056+0000","last_active":"2023-10-08T16:09:20.918309+0000","last_peered":"2023-10-08T16:09:20.918309+0000","last_clean":"2023-10-08T16:09:20.918309+0000","last_became_active":"2023-10-08T16:09:20.915784+0000","last_became_peered":"2023-10-08T16:09:20.915784+0000","last_unstale":"2023-10-08T16:09:20.918309+0000","last_undegraded":"2023-10-08T16:09:20.918309+0000","last_fullsized":"2023-10-08T16:09:20.918309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927968+0000","last_change":"2023-10-08T16:09:20.926730+0000","last_active":"2023-10-08T16:09:20.927968+0000","last_peered":"2023-10-08T16:09:20.927968+0000","last_clean":"2023-10-08T16:09:20.927968+0000","last_became_active":"2023-10-08T16:09:20.925172+0000","last_became_peered":"2023-10-08T16:09:20.925172+0000","last_unstale":"2023-10-08T16:09:20.927968+0000","last_undegraded":"2023-10-08T16:09:20.927968+0000","last_fullsized":"2023-10-08T16:09:20.927968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930295+0000","last_change":"2023-10-08T16:09:20.925120+0000","last_active":"2023-10-08T16:09:20.930295+0000","last_peered":"2023-10-08T16:09:20.930295+0000","last_clean":"2023-10-08T16:09:20.930295+0000","last_became_active":"2023-10-08T16:09:20.924840+0000","last_became_peered":"2023-10-08T16:09:20.924840+0000","last_unstale":"2023-10-08T16:09:20.930295+0000","last_undegraded":"2023-10-08T16:09:20.930295+0000","last_fullsized":"2023-10-08T16:09:20.930295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934825+0000","last_change":"2023-10-08T16:09:20.932038+0000","last_active":"2023-10-08T16:09:20.934825+0000","last_peered":"2023-10-08T16:09:20.934825+0000","last_clean":"2023-10-08T16:09:20.934825+0000","last_became_active":"2023-10-08T16:09:20.931773+0000","last_became_peered":"2023-10-08T16:09:20.931773+0000","last_unstale":"2023-10-08T16:09:20.934825+0000","last_undegraded":"2023-10-08T16:09:20.934825+0000","last_fullsized":"2023-10-08T16:09:20.934825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930258+0000","last_change":"2023-10-08T16:09:20.925060+0000","last_active":"2023-10-08T16:09:20.930258+0000","last_peered":"2023-10-08T16:09:20.930258+0000","last_clean":"2023-10-08T16:09:20.930258+0000","last_became_active":"2023-10-08T16:09:20.924565+0000","last_became_peered":"2023-10-08T16:09:20.924565+0000","last_unstale":"2023-10-08T16:09:20.930258+0000","last_undegraded":"2023-10-08T16:09:20.930258+0000","last_fullsized":"2023-10-08T16:09:20.930258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932817+0000","last_change":"2023-10-08T16:09:20.921042+0000","last_active":"2023-10-08T16:09:20.932817+0000","last_peered":"2023-10-08T16:09:20.932817+0000","last_clean":"2023-10-08T16:09:20.932817+0000","last_became_active":"2023-10-08T16:09:20.920766+0000","last_became_peered":"2023-10-08T16:09:20.920766+0000","last_unstale":"2023-10-08T16:09:20.932817+0000","last_undegraded":"2023-10-08T16:09:20.932817+0000","last_fullsized":"2023-10-08T16:09:20.932817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927308+0000","last_change":"2023-10-08T16:09:20.920992+0000","last_active":"2023-10-08T16:09:20.927308+0000","last_peered":"2023-10-08T16:09:20.927308+0000","last_clean":"2023-10-08T16:09:20.927308+0000","last_became_active":"2023-10-08T16:09:20.920227+0000","last_became_peered":"2023-10-08T16:09:20.920227+0000","last_unstale":"2023-10-08T16:09:20.927308+0000","last_undegraded":"2023-10-08T16:09:20.927308+0000","last_fullsized":"2023-10-08T16:09:20.927308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932806+0000","last_change":"2023-10-08T16:09:20.930112+0000","last_active":"2023-10-08T16:09:20.932806+0000","last_peered":"2023-10-08T16:09:20.932806+0000","last_clean":"2023-10-08T16:09:20.932806+0000","last_became_active":"2023-10-08T16:09:20.929813+0000","last_became_peered":"2023-10-08T16:09:20.929813+0000","last_unstale":"2023-10-08T16:09:20.932806+0000","last_undegraded":"2023-10-08T16:09:20.932806+0000","last_fullsized":"2023-10-08T16:09:20.932806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301600,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070240,"statfs":{"total":96636764160,"available":96327925760,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:26.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:09:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.484+0000 7f1478dff700 1 Processor -- start 2023-10-08T16:09:26.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.484+0000 7f1478dff700 1 -- start start 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1478dff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1474155b70 0x7f14740b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1478dff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f14740b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1478dff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1474157510 con 0x7f1474159940 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1478dff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14740ae2f0 con 0x7f1474155b70 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1478dff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14740ae5d0 con 0x7f14740add80 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1472d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1474159940 0x7f1474155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41724/0 (socket says 172.21.15.12:41724) 2023-10-08T16:09:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1472d9d700 1 -- 172.21.15.12:0/1634452271 learned_addr learned my addr 172.21.15.12:0/1634452271 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f1471d9b700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f14740b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f147259c700 1 --2- 172.21.15.12:0/1634452271 >> v2:172.21.15.29:3300/0 conn(0x7f1474155b70 0x7f14740b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264741626 0 0) 0x7f1474157510 con 0x7f1474159940 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.486+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c003570 con 0x7f1474159940 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342924373 0 0) 0x7f145c003570 con 0x7f1474159940 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 msgr2=0x7f14740b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f14740b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 >> v2:172.21.15.29:3300/0 conn(0x7f1474155b70 msgr2=0x7f14740b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 --2- 172.21.15.12:0/1634452271 >> v2:172.21.15.29:3300/0 conn(0x7f1474155b70 0x7f14740b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740ae8b0 con 0x7f1474159940 2023-10-08T16:09:26.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f146c0017f0 con 0x7f1474159940 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 >> v1:172.21.15.12:6789/0 conn(0x7f1474159940 legacy=0x7f1474155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f145c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f145c003fe0 0x7f145c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14740ae2f0 con 0x7f145c003fe0 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14740ae5d0 con 0x7f145c004d50 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00ba90 con 0x7f14740add80 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f1471d9b700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f145c003fe0 0x7f145c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f147259c700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f145c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.487+0000 7f1472d9d700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 -- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 msgr2=0x7f145c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:26.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14740add80 0x7f145c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 -- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c004d50 msgr2=0x7f145c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 -- 172.21.15.12:0/1634452271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c003570 con 0x7f145c003fe0 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f1471d9b700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f145c003fe0 0x7f145c004810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1468009c00 tx=0x7f14680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695795f1c50da09b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800e6b0 con 0x7f145c003fe0 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800e810 con 0x7f145c003fe0 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.488+0000 7f147159a700 1 -- 172.21.15.12:0/1634452271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800ebd0 con 0x7f145c003fe0 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 -- 172.21.15.12:0/1634452271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f145c003fe0 msgr2=0x7f145c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 --2- 172.21.15.12:0/1634452271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f145c003fe0 0x7f145c004810 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1468009c00 tx=0x7f14680091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1472d9d700 1 -- 172.21.15.12:0/1634452271 reap_dead start 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 -- 172.21.15.12:0/1634452271 shutdown_connections 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 -- 172.21.15.12:0/1634452271 >> 172.21.15.12:0/1634452271 conn(0x7f147406d170 msgr2=0x7f14740cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 -- 172.21.15.12:0/1634452271 shutdown_connections 2023-10-08T16:09:26.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.489+0000 7f1478dff700 1 -- 172.21.15.12:0/1634452271 wait complete. 2023-10-08T16:09:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.490+0000 7f1478dff700 1 Processor -- start 2023-10-08T16:09:26.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.490+0000 7f1478dff700 1 -- start start 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f145c003fe0 0x7f147416af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 0x7f14740c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14740c1f90 con 0x7f147416a8c0 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147416ad30 con 0x7f147416ca90 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.491+0000 7f1478dff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14740a98e0 con 0x7f145c003fe0 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58224/0 (socket says 172.21.15.12:58224) 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 -- 172.21.15.12:0/801753326 learned_addr learned my addr 172.21.15.12:0/801753326 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 -- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f145c003fe0 msgr2=0x7f147416af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f147259c700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f145c003fe0 0x7f147416af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1472d9d700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 0x7f14740c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f145c003fe0 0x7f147416af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 -- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 msgr2=0x7f14740c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 0x7f14740c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 -- 172.21.15.12:0/801753326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14740c21c0 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1472d9d700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 0x7f14740c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f1471d9b700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f14680091e0 tx=0x7f146801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.492+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468022070 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.493+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800e980 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.493+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468027470 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.493+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14740a9ba0 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.493+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14740aa160 con 0x7f147416a8c0 2023-10-08T16:09:26.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.494+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f147404c3c0 con 0x7f147416a8c0 2023-10-08T16:09:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.494+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f146801c450 con 0x7f147416a8c0 2023-10-08T16:09:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.496+0000 7f14627fc700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.496+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14680861f0 con 0x7f147416a8c0 2023-10-08T16:09:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.496+0000 7f147259c700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.496+0000 7f147259c700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14640093f0 tx=0x7f1464008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.499+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14680534c0 con 0x7f147416a8c0 2023-10-08T16:09:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.784+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f147406be60 con 0x7f147416a8c0 2023-10-08T16:09:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.784+0000 7f14627fc700 1 -- 172.21.15.12:0/801753326 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f14680569e0 con 0x7f147416a8c0 2023-10-08T16:09:26.786 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:26.786 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2454822912,"bytes_avail":770639290368,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4300}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-08T16:08:56.126877+0000","services":{}},"progress_events":{}} 2023-10-08T16:09:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 msgr2=0x7f14540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f14640093f0 tx=0x7f1464008040 comp rx=0 tx=0).stop 2023-10-08T16:09:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 msgr2=0x7f14740c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f14680091e0 tx=0x7f146801a000 comp rx=0 tx=0).stop 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 shutdown_connections 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f147416ca90 0x7f14740c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f145c003fe0 0x7f147416af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 --2- 172.21.15.12:0/801753326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147416a8c0 0x7f14740c1a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 >> 172.21.15.12:0/801753326 conn(0x7f147406d170 msgr2=0x7f1474155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 shutdown_connections 2023-10-08T16:09:26.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.787+0000 7f1478dff700 1 -- 172.21.15.12:0/801753326 wait complete. 2023-10-08T16:09:26.805 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:09:26.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:26.945 INFO:tasks.ceph.mds.d.smithi029.stderr:2023-10-08T16:09:26.945+0000 7ff1381f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:09:26.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.992+0000 7feec4d9d700 1 Processor -- start 2023-10-08T16:09:26.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.993+0000 7feec4d9d700 1 -- start start 2023-10-08T16:09:26.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feec4d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feec015dfd0 0x7feec00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feec4d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec0159920 0x7feec00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feec4d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec00acc00 con 0x7feec0159550 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feec4d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec00abff0 con 0x7feec015dfd0 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feec4d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec00ac2d0 con 0x7feec0159920 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feebf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feec0159550 0x7feec00ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41740/0 (socket says 172.21.15.12:41740) 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.994+0000 7feebf7fe700 1 -- 172.21.15.12:0/1906140747 learned_addr learned my addr 172.21.15.12:0/1906140747 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 --2- 172.21.15.12:0/1906140747 >> v2:172.21.15.29:3300/0 conn(0x7feec015dfd0 0x7feec00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebffff700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec0159920 0x7feec00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebe7fc700 1 -- 172.21.15.12:0/1906140747 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543856783 0 0) 0x7feec00acc00 con 0x7feec0159550 2023-10-08T16:09:26.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebe7fc700 1 -- 172.21.15.12:0/1906140747 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea8003570 con 0x7feec0159550 2023-10-08T16:09:26.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 -- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec0159920 msgr2=0x7feec00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec0159920 0x7feec00ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 -- 172.21.15.12:0/1906140747 >> v1:172.21.15.12:6789/0 conn(0x7feec0159550 legacy=0x7feec00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 -- 172.21.15.12:0/1906140747 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec00ac5b0 con 0x7feec015dfd0 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.995+0000 7feebeffd700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec015dfd0 0x7feec00aedb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feeb40098e0 tx=0x7feeb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c88c196da98ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feebe7fc700 1 -- 172.21.15.12:0/1906140747 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4011630 con 0x7feec015dfd0 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feebe7fc700 1 -- 172.21.15.12:0/1906140747 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4011790 con 0x7feec015dfd0 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feebe7fc700 1 -- 172.21.15.12:0/1906140747 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4011b10 con 0x7feec015dfd0 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 -- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec015dfd0 msgr2=0x7feec00aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec015dfd0 0x7feec00aedb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feeb40098e0 tx=0x7feeb40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 -- 172.21.15.12:0/1906140747 shutdown_connections 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec0159920 0x7feec00ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 --2- 172.21.15.12:0/1906140747 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec015dfd0 0x7feec00aedb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 -- 172.21.15.12:0/1906140747 >> 172.21.15.12:0/1906140747 conn(0x7feec006ce80 msgr2=0x7feec00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 -- 172.21.15.12:0/1906140747 shutdown_connections 2023-10-08T16:09:26.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.996+0000 7feec4d9d700 1 -- 172.21.15.12:0/1906140747 wait complete. 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.998+0000 7feec4d9d700 1 Processor -- start 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.998+0000 7feec4d9d700 1 -- start start 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec0159550 0x7feec01487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec015dfd0 0x7feec0169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec014def0 con 0x7feec0159920 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec014dbc0 con 0x7feec0159550 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feec4d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec0148d00 con 0x7feec015dfd0 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:27.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58232/0 (socket says 172.21.15.12:58232) 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 -- 172.21.15.12:0/4288050381 learned_addr learned my addr 172.21.15.12:0/4288050381 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebffff700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec015dfd0 0x7feec0169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebf7fe700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec0159550 0x7feec01487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 -- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec015dfd0 msgr2=0x7feec0169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec015dfd0 0x7feec0169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 -- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec0159550 msgr2=0x7feec01487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec0159550 0x7feec01487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:26.999+0000 7feebeffd700 1 -- 172.21.15.12:0/4288050381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4009420 con 0x7feec0159920 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feebeffd700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feec006ad70 tx=0x7feeb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4011b10 con 0x7feec0159920 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb401a430 con 0x7feec0159920 2023-10-08T16:09:27.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec016a6b0 con 0x7feec0159920 2023-10-08T16:09:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401a7f0 con 0x7feec0159920 2023-10-08T16:09:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.000+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec016ac70 con 0x7feec0159920 2023-10-08T16:09:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.001+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec014e060 con 0x7feec0159920 2023-10-08T16:09:27.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.002+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feeb401aba0 con 0x7feec0159920 2023-10-08T16:09:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.003+0000 7feea77fe700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 0x7feeac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.003+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feeb4086310 con 0x7feec0159920 2023-10-08T16:09:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.003+0000 7feebf7fe700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 0x7feeac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:27.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.004+0000 7feebf7fe700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 0x7feeac0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feeb00058d0 tx=0x7feeb0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:27.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.007+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feeb40534e0 con 0x7feec0159920 2023-10-08T16:09:27.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.202+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feec004c3c0 con 0x7feeac066f30 2023-10-08T16:09:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.210+0000 7feea77fe700 1 -- 172.21.15.12:0/4288050381 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264632 (secure 0 0 0) 0x7feec004c3c0 con 0x7feeac066f30 2023-10-08T16:09:27.215 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 msgr2=0x7feeac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 0x7feeac0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7feeb00058d0 tx=0x7feeb0009040 comp rx=0 tx=0).stop 2023-10-08T16:09:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 msgr2=0x7feec0068030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feec006ad70 tx=0x7feeb4017000 comp rx=0 tx=0).stop 2023-10-08T16:09:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 shutdown_connections 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feec015dfd0 0x7feec0169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feec0159550 0x7feec01487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feeac066f30 0x7feeac0693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 --2- 172.21.15.12:0/4288050381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feec0159920 0x7feec0068030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.214+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 >> 172.21.15.12:0/4288050381 conn(0x7feec006ce80 msgr2=0x7feec00ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.215+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 shutdown_connections 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:27.215+0000 7feec4d9d700 1 -- 172.21.15.12:0/4288050381 wait complete. 2023-10-08T16:09:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:27.232 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:09:25.912923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397608,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577112,"statfs":{"total":773094113280,"available":770638962688,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001223"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931948+0000","last_change":"2023-10-08T16:09:20.923239+0000","last_active":"2023-10-08T16:09:20.931948+0000","last_peered":"2023-10-08T16:09:20.931948+0000","last_clean":"2023-10-08T16:09:20.931948+0000","last_became_active":"2023-10-08T16:09:20.922789+0000","last_became_peered":"2023-10-08T16:09:20.922789+0000","last_unstale":"2023-10-08T16:09:20.931948+0000","last_undegraded":"2023-10-08T16:09:20.931948+0000","last_fullsized":"2023-10-08T16:09:20.931948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:36.471481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918249+0000","last_change":"2023-10-08T16:09:20.914085+0000","last_active":"2023-10-08T16:09:20.918249+0000","last_peered":"2023-10-08T16:09:20.918249+0000","last_clean":"2023-10-08T16:09:20.918249+0000","last_became_active":"2023-10-08T16:09:20.913834+0000","last_became_peered":"2023-10-08T16:09:20.913834+0000","last_unstale":"2023-10-08T16:09:20.918249+0000","last_undegraded":"2023-10-08T16:09:20.918249+0000","last_fullsized":"2023-10-08T16:09:20.918249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.919536+0000","last_change":"2023-10-08T16:09:20.915094+0000","last_active":"2023-10-08T16:09:20.919536+0000","last_peered":"2023-10-08T16:09:20.919536+0000","last_clean":"2023-10-08T16:09:20.919536+0000","last_became_active":"2023-10-08T16:09:20.914821+0000","last_became_peered":"2023-10-08T16:09:20.914821+0000","last_unstale":"2023-10-08T16:09:20.919536+0000","last_undegraded":"2023-10-08T16:09:20.919536+0000","last_fullsized":"2023-10-08T16:09:20.919536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:39.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934072+0000","last_change":"2023-10-08T16:09:20.931361+0000","last_active":"2023-10-08T16:09:20.934072+0000","last_peered":"2023-10-08T16:09:20.934072+0000","last_clean":"2023-10-08T16:09:20.934072+0000","last_became_active":"2023-10-08T16:09:20.931006+0000","last_became_peered":"2023-10-08T16:09:20.931006+0000","last_unstale":"2023-10-08T16:09:20.934072+0000","last_undegraded":"2023-10-08T16:09:20.934072+0000","last_fullsized":"2023-10-08T16:09:20.934072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931450+0000","last_change":"2023-10-08T16:09:20.924404+0000","last_active":"2023-10-08T16:09:20.931450+0000","last_peered":"2023-10-08T16:09:20.931450+0000","last_clean":"2023-10-08T16:09:20.931450+0000","last_became_active":"2023-10-08T16:09:20.924076+0000","last_became_peered":"2023-10-08T16:09:20.924076+0000","last_unstale":"2023-10-08T16:09:20.931450+0000","last_undegraded":"2023-10-08T16:09:20.931450+0000","last_fullsized":"2023-10-08T16:09:20.931450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:29.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932898+0000","last_change":"2023-10-08T16:09:20.922230+0000","last_active":"2023-10-08T16:09:20.932898+0000","last_peered":"2023-10-08T16:09:20.932898+0000","last_clean":"2023-10-08T16:09:20.932898+0000","last_became_active":"2023-10-08T16:09:20.921756+0000","last_became_peered":"2023-10-08T16:09:20.921756+0000","last_unstale":"2023-10-08T16:09:20.932898+0000","last_undegraded":"2023-10-08T16:09:20.932898+0000","last_fullsized":"2023-10-08T16:09:20.932898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930235+0000","last_change":"2023-10-08T16:09:20.926442+0000","last_active":"2023-10-08T16:09:20.930235+0000","last_peered":"2023-10-08T16:09:20.930235+0000","last_clean":"2023-10-08T16:09:20.930235+0000","last_became_active":"2023-10-08T16:09:20.926134+0000","last_became_peered":"2023-10-08T16:09:20.926134+0000","last_unstale":"2023-10-08T16:09:20.930235+0000","last_undegraded":"2023-10-08T16:09:20.930235+0000","last_fullsized":"2023-10-08T16:09:20.930235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:09.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938511+0000","last_change":"2023-10-08T16:09:20.934468+0000","last_active":"2023-10-08T16:09:20.938511+0000","last_peered":"2023-10-08T16:09:20.938511+0000","last_clean":"2023-10-08T16:09:20.938511+0000","last_became_active":"2023-10-08T16:09:20.934187+0000","last_became_peered":"2023-10-08T16:09:20.934187+0000","last_unstale":"2023-10-08T16:09:20.938511+0000","last_undegraded":"2023-10-08T16:09:20.938511+0000","last_fullsized":"2023-10-08T16:09:20.938511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934886+0000","last_change":"2023-10-08T16:09:20.930046+0000","last_active":"2023-10-08T16:09:20.934886+0000","last_peered":"2023-10-08T16:09:20.934886+0000","last_clean":"2023-10-08T16:09:20.934886+0000","last_became_active":"2023-10-08T16:09:20.929384+0000","last_became_peered":"2023-10-08T16:09:20.929384+0000","last_unstale":"2023-10-08T16:09:20.934886+0000","last_undegraded":"2023-10-08T16:09:20.934886+0000","last_fullsized":"2023-10-08T16:09:20.934886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:29.654343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925610+0000","last_change":"2023-10-08T16:09:20.921732+0000","last_active":"2023-10-08T16:09:20.925610+0000","last_peered":"2023-10-08T16:09:20.925610+0000","last_clean":"2023-10-08T16:09:20.925610+0000","last_became_active":"2023-10-08T16:09:20.921260+0000","last_became_peered":"2023-10-08T16:09:20.921260+0000","last_unstale":"2023-10-08T16:09:20.925610+0000","last_undegraded":"2023-10-08T16:09:20.925610+0000","last_fullsized":"2023-10-08T16:09:20.925610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935782+0000","last_change":"2023-10-08T16:09:20.934331+0000","last_active":"2023-10-08T16:09:20.935782+0000","last_peered":"2023-10-08T16:09:20.935782+0000","last_clean":"2023-10-08T16:09:20.935782+0000","last_became_active":"2023-10-08T16:09:20.934023+0000","last_became_peered":"2023-10-08T16:09:20.934023+0000","last_unstale":"2023-10-08T16:09:20.935782+0000","last_undegraded":"2023-10-08T16:09:20.935782+0000","last_fullsized":"2023-10-08T16:09:20.935782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927686+0000","last_change":"2023-10-08T16:09:20.921076+0000","last_active":"2023-10-08T16:09:20.927686+0000","last_peered":"2023-10-08T16:09:20.927686+0000","last_clean":"2023-10-08T16:09:20.927686+0000","last_became_active":"2023-10-08T16:09:20.920798+0000","last_became_peered":"2023-10-08T16:09:20.920798+0000","last_unstale":"2023-10-08T16:09:20.927686+0000","last_undegraded":"2023-10-08T16:09:20.927686+0000","last_fullsized":"2023-10-08T16:09:20.927686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:00.083968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925745+0000","last_change":"2023-10-08T16:09:20.922551+0000","last_active":"2023-10-08T16:09:20.925745+0000","last_peered":"2023-10-08T16:09:20.925745+0000","last_clean":"2023-10-08T16:09:20.925745+0000","last_became_active":"2023-10-08T16:09:20.922276+0000","last_became_peered":"2023-10-08T16:09:20.922276+0000","last_unstale":"2023-10-08T16:09:20.925745+0000","last_undegraded":"2023-10-08T16:09:20.925745+0000","last_fullsized":"2023-10-08T16:09:20.925745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927387+0000","last_change":"2023-10-08T16:09:20.921190+0000","last_active":"2023-10-08T16:09:20.927387+0000","last_peered":"2023-10-08T16:09:20.927387+0000","last_clean":"2023-10-08T16:09:20.927387+0000","last_became_active":"2023-10-08T16:09:20.920627+0000","last_became_peered":"2023-10-08T16:09:20.920627+0000","last_unstale":"2023-10-08T16:09:20.927387+0000","last_undegraded":"2023-10-08T16:09:20.927387+0000","last_fullsized":"2023-10-08T16:09:20.927387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:16.772848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918396+0000","last_change":"2023-10-08T16:09:20.913009+0000","last_active":"2023-10-08T16:09:20.918396+0000","last_peered":"2023-10-08T16:09:20.918396+0000","last_clean":"2023-10-08T16:09:20.918396+0000","last_became_active":"2023-10-08T16:09:20.912719+0000","last_became_peered":"2023-10-08T16:09:20.912719+0000","last_unstale":"2023-10-08T16:09:20.918396+0000","last_undegraded":"2023-10-08T16:09:20.918396+0000","last_fullsized":"2023-10-08T16:09:20.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920698+0000","last_change":"2023-10-08T16:09:20.916696+0000","last_active":"2023-10-08T16:09:20.920698+0000","last_peered":"2023-10-08T16:09:20.920698+0000","last_clean":"2023-10-08T16:09:20.920698+0000","last_became_active":"2023-10-08T16:09:20.916352+0000","last_became_peered":"2023-10-08T16:09:20.916352+0000","last_unstale":"2023-10-08T16:09:20.920698+0000","last_undegraded":"2023-10-08T16:09:20.920698+0000","last_fullsized":"2023-10-08T16:09:20.920698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928741+0000","last_change":"2023-10-08T16:09:20.919110+0000","last_active":"2023-10-08T16:09:20.928741+0000","last_peered":"2023-10-08T16:09:20.928741+0000","last_clean":"2023-10-08T16:09:20.928741+0000","last_became_active":"2023-10-08T16:09:20.918780+0000","last_became_peered":"2023-10-08T16:09:20.918780+0000","last_unstale":"2023-10-08T16:09:20.928741+0000","last_undegraded":"2023-10-08T16:09:20.928741+0000","last_fullsized":"2023-10-08T16:09:20.928741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922564+0000","last_change":"2023-10-08T16:09:20.918158+0000","last_active":"2023-10-08T16:09:20.922564+0000","last_peered":"2023-10-08T16:09:20.922564+0000","last_clean":"2023-10-08T16:09:20.922564+0000","last_became_active":"2023-10-08T16:09:20.917856+0000","last_became_peered":"2023-10-08T16:09:20.917856+0000","last_unstale":"2023-10-08T16:09:20.922564+0000","last_undegraded":"2023-10-08T16:09:20.922564+0000","last_fullsized":"2023-10-08T16:09:20.922564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931481+0000","last_change":"2023-10-08T16:09:20.927146+0000","last_active":"2023-10-08T16:09:20.931481+0000","last_peered":"2023-10-08T16:09:20.931481+0000","last_clean":"2023-10-08T16:09:20.931481+0000","last_became_active":"2023-10-08T16:09:20.924805+0000","last_became_peered":"2023-10-08T16:09:20.924805+0000","last_unstale":"2023-10-08T16:09:20.931481+0000","last_undegraded":"2023-10-08T16:09:20.931481+0000","last_fullsized":"2023-10-08T16:09:20.931481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:43.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972105+0000","last_change":"2023-10-08T16:09:19.983339+0000","last_active":"2023-10-08T16:09:20.972105+0000","last_peered":"2023-10-08T16:09:20.972105+0000","last_clean":"2023-10-08T16:09:20.972105+0000","last_became_active":"2023-10-08T16:09:19.983052+0000","last_became_peered":"2023-10-08T16:09:19.983052+0000","last_unstale":"2023-10-08T16:09:20.972105+0000","last_undegraded":"2023-10-08T16:09:20.972105+0000","last_fullsized":"2023-10-08T16:09:20.972105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925071+0000","last_change":"2023-10-08T16:09:20.923270+0000","last_active":"2023-10-08T16:09:20.925071+0000","last_peered":"2023-10-08T16:09:20.925071+0000","last_clean":"2023-10-08T16:09:20.925071+0000","last_became_active":"2023-10-08T16:09:20.923011+0000","last_became_peered":"2023-10-08T16:09:20.923011+0000","last_unstale":"2023-10-08T16:09:20.925071+0000","last_undegraded":"2023-10-08T16:09:20.925071+0000","last_fullsized":"2023-10-08T16:09:20.925071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975780+0000","last_change":"2023-10-08T16:09:19.983890+0000","last_active":"2023-10-08T16:09:20.975780+0000","last_peered":"2023-10-08T16:09:20.975780+0000","last_clean":"2023-10-08T16:09:20.975780+0000","last_became_active":"2023-10-08T16:09:19.983629+0000","last_became_peered":"2023-10-08T16:09:19.983629+0000","last_unstale":"2023-10-08T16:09:20.975780+0000","last_undegraded":"2023-10-08T16:09:20.975780+0000","last_fullsized":"2023-10-08T16:09:20.975780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932721+0000","last_change":"2023-10-08T16:09:20.929176+0000","last_active":"2023-10-08T16:09:20.932721+0000","last_peered":"2023-10-08T16:09:20.932721+0000","last_clean":"2023-10-08T16:09:20.932721+0000","last_became_active":"2023-10-08T16:09:20.928937+0000","last_became_peered":"2023-10-08T16:09:20.928937+0000","last_unstale":"2023-10-08T16:09:20.932721+0000","last_undegraded":"2023-10-08T16:09:20.932721+0000","last_fullsized":"2023-10-08T16:09:20.932721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973901+0000","last_change":"2023-10-08T16:09:19.982390+0000","last_active":"2023-10-08T16:09:20.973901+0000","last_peered":"2023-10-08T16:09:20.973901+0000","last_clean":"2023-10-08T16:09:20.973901+0000","last_became_active":"2023-10-08T16:09:19.982067+0000","last_became_peered":"2023-10-08T16:09:19.982067+0000","last_unstale":"2023-10-08T16:09:20.973901+0000","last_undegraded":"2023-10-08T16:09:20.973901+0000","last_fullsized":"2023-10-08T16:09:20.973901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:56.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933876+0000","last_change":"2023-10-08T16:09:20.928229+0000","last_active":"2023-10-08T16:09:20.933876+0000","last_peered":"2023-10-08T16:09:20.933876+0000","last_clean":"2023-10-08T16:09:20.933876+0000","last_became_active":"2023-10-08T16:09:20.927947+0000","last_became_peered":"2023-10-08T16:09:20.927947+0000","last_unstale":"2023-10-08T16:09:20.933876+0000","last_undegraded":"2023-10-08T16:09:20.933876+0000","last_fullsized":"2023-10-08T16:09:20.933876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:20.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971881+0000","last_change":"2023-10-08T16:09:19.976558+0000","last_active":"2023-10-08T16:09:20.971881+0000","last_peered":"2023-10-08T16:09:20.971881+0000","last_clean":"2023-10-08T16:09:20.971881+0000","last_became_active":"2023-10-08T16:09:19.976190+0000","last_became_peered":"2023-10-08T16:09:19.976190+0000","last_unstale":"2023-10-08T16:09:20.971881+0000","last_undegraded":"2023-10-08T16:09:20.971881+0000","last_fullsized":"2023-10-08T16:09:20.971881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:16.143856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933050+0000","last_change":"2023-10-08T16:09:20.926759+0000","last_active":"2023-10-08T16:09:20.933050+0000","last_peered":"2023-10-08T16:09:20.933050+0000","last_clean":"2023-10-08T16:09:20.933050+0000","last_became_active":"2023-10-08T16:09:20.926449+0000","last_became_peered":"2023-10-08T16:09:20.926449+0000","last_unstale":"2023-10-08T16:09:20.933050+0000","last_undegraded":"2023-10-08T16:09:20.933050+0000","last_fullsized":"2023-10-08T16:09:20.933050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975655+0000","last_change":"2023-10-08T16:09:19.983304+0000","last_active":"2023-10-08T16:09:20.975655+0000","last_peered":"2023-10-08T16:09:20.975655+0000","last_clean":"2023-10-08T16:09:20.975655+0000","last_became_active":"2023-10-08T16:09:19.982916+0000","last_became_peered":"2023-10-08T16:09:19.982916+0000","last_unstale":"2023-10-08T16:09:20.975655+0000","last_undegraded":"2023-10-08T16:09:20.975655+0000","last_fullsized":"2023-10-08T16:09:20.975655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925716+0000","last_change":"2023-10-08T16:09:20.914915+0000","last_active":"2023-10-08T16:09:20.925716+0000","last_peered":"2023-10-08T16:09:20.925716+0000","last_clean":"2023-10-08T16:09:20.925716+0000","last_became_active":"2023-10-08T16:09:20.914562+0000","last_became_peered":"2023-10-08T16:09:20.914562+0000","last_unstale":"2023-10-08T16:09:20.925716+0000","last_undegraded":"2023-10-08T16:09:20.925716+0000","last_fullsized":"2023-10-08T16:09:20.925716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.969110+0000","last_change":"2023-10-08T16:09:19.982834+0000","last_active":"2023-10-08T16:09:20.969110+0000","last_peered":"2023-10-08T16:09:20.969110+0000","last_clean":"2023-10-08T16:09:20.969110+0000","last_became_active":"2023-10-08T16:09:19.981385+0000","last_became_peered":"2023-10-08T16:09:19.981385+0000","last_unstale":"2023-10-08T16:09:20.969110+0000","last_undegraded":"2023-10-08T16:09:20.969110+0000","last_fullsized":"2023-10-08T16:09:20.969110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930013+0000","last_change":"2023-10-08T16:09:20.924374+0000","last_active":"2023-10-08T16:09:20.930013+0000","last_peered":"2023-10-08T16:09:20.930013+0000","last_clean":"2023-10-08T16:09:20.930013+0000","last_became_active":"2023-10-08T16:09:20.924067+0000","last_became_peered":"2023-10-08T16:09:20.924067+0000","last_unstale":"2023-10-08T16:09:20.930013+0000","last_undegraded":"2023-10-08T16:09:20.930013+0000","last_fullsized":"2023-10-08T16:09:20.930013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.916621+0000","last_change":"2023-10-08T16:09:19.979195+0000","last_active":"2023-10-08T16:09:20.916621+0000","last_peered":"2023-10-08T16:09:20.916621+0000","last_clean":"2023-10-08T16:09:20.916621+0000","last_became_active":"2023-10-08T16:09:19.977936+0000","last_became_peered":"2023-10-08T16:09:19.977936+0000","last_unstale":"2023-10-08T16:09:20.916621+0000","last_undegraded":"2023-10-08T16:09:20.916621+0000","last_fullsized":"2023-10-08T16:09:20.916621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933011+0000","last_change":"2023-10-08T16:09:20.928131+0000","last_active":"2023-10-08T16:09:20.933011+0000","last_peered":"2023-10-08T16:09:20.933011+0000","last_clean":"2023-10-08T16:09:20.933011+0000","last_became_active":"2023-10-08T16:09:20.927721+0000","last_became_peered":"2023-10-08T16:09:20.927721+0000","last_unstale":"2023-10-08T16:09:20.933011+0000","last_undegraded":"2023-10-08T16:09:20.933011+0000","last_fullsized":"2023-10-08T16:09:20.933011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906866+0000","last_change":"2023-10-08T16:09:19.988608+0000","last_active":"2023-10-08T16:09:20.906866+0000","last_peered":"2023-10-08T16:09:20.906866+0000","last_clean":"2023-10-08T16:09:20.906866+0000","last_became_active":"2023-10-08T16:09:19.988278+0000","last_became_peered":"2023-10-08T16:09:19.988278+0000","last_unstale":"2023-10-08T16:09:20.906866+0000","last_undegraded":"2023-10-08T16:09:20.906866+0000","last_fullsized":"2023-10-08T16:09:20.906866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.921581+0000","last_change":"2023-10-08T16:09:20.918971+0000","last_active":"2023-10-08T16:09:20.921581+0000","last_peered":"2023-10-08T16:09:20.921581+0000","last_clean":"2023-10-08T16:09:20.921581+0000","last_became_active":"2023-10-08T16:09:20.918687+0000","last_became_peered":"2023-10-08T16:09:20.918687+0000","last_unstale":"2023-10-08T16:09:20.921581+0000","last_undegraded":"2023-10-08T16:09:20.921581+0000","last_fullsized":"2023-10-08T16:09:20.921581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910412+0000","last_change":"2023-10-08T16:09:19.989053+0000","last_active":"2023-10-08T16:09:20.910412+0000","last_peered":"2023-10-08T16:09:20.910412+0000","last_clean":"2023-10-08T16:09:20.910412+0000","last_became_active":"2023-10-08T16:09:19.988777+0000","last_became_peered":"2023-10-08T16:09:19.988777+0000","last_unstale":"2023-10-08T16:09:20.910412+0000","last_undegraded":"2023-10-08T16:09:20.910412+0000","last_fullsized":"2023-10-08T16:09:20.910412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928707+0000","last_change":"2023-10-08T16:09:20.919114+0000","last_active":"2023-10-08T16:09:20.928707+0000","last_peered":"2023-10-08T16:09:20.928707+0000","last_clean":"2023-10-08T16:09:20.928707+0000","last_became_active":"2023-10-08T16:09:20.918800+0000","last_became_peered":"2023-10-08T16:09:20.918800+0000","last_unstale":"2023-10-08T16:09:20.928707+0000","last_undegraded":"2023-10-08T16:09:20.928707+0000","last_fullsized":"2023-10-08T16:09:20.928707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.907633+0000","last_change":"2023-10-08T16:09:19.985911+0000","last_active":"2023-10-08T16:09:20.907633+0000","last_peered":"2023-10-08T16:09:20.907633+0000","last_clean":"2023-10-08T16:09:20.907633+0000","last_became_active":"2023-10-08T16:09:19.985587+0000","last_became_peered":"2023-10-08T16:09:19.985587+0000","last_unstale":"2023-10-08T16:09:20.907633+0000","last_undegraded":"2023-10-08T16:09:20.907633+0000","last_fullsized":"2023-10-08T16:09:20.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927469+0000","last_change":"2023-10-08T16:09:20.923331+0000","last_active":"2023-10-08T16:09:20.927469+0000","last_peered":"2023-10-08T16:09:20.927469+0000","last_clean":"2023-10-08T16:09:20.927469+0000","last_became_active":"2023-10-08T16:09:20.923039+0000","last_became_peered":"2023-10-08T16:09:20.923039+0000","last_unstale":"2023-10-08T16:09:20.927469+0000","last_undegraded":"2023-10-08T16:09:20.927469+0000","last_fullsized":"2023-10-08T16:09:20.927469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:17.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970716+0000","last_change":"2023-10-08T16:09:19.977329+0000","last_active":"2023-10-08T16:09:20.970716+0000","last_peered":"2023-10-08T16:09:20.970716+0000","last_clean":"2023-10-08T16:09:20.970716+0000","last_became_active":"2023-10-08T16:09:19.977037+0000","last_became_peered":"2023-10-08T16:09:19.977037+0000","last_unstale":"2023-10-08T16:09:20.970716+0000","last_undegraded":"2023-10-08T16:09:20.970716+0000","last_fullsized":"2023-10-08T16:09:20.970716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929923+0000","last_change":"2023-10-08T16:09:20.925081+0000","last_active":"2023-10-08T16:09:20.929923+0000","last_peered":"2023-10-08T16:09:20.929923+0000","last_clean":"2023-10-08T16:09:20.929923+0000","last_became_active":"2023-10-08T16:09:20.924752+0000","last_became_peered":"2023-10-08T16:09:20.924752+0000","last_unstale":"2023-10-08T16:09:20.929923+0000","last_undegraded":"2023-10-08T16:09:20.929923+0000","last_fullsized":"2023-10-08T16:09:20.929923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:26.766584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.977381+0000","last_change":"2023-10-08T16:09:19.983118+0000","last_active":"2023-10-08T16:09:20.977381+0000","last_peered":"2023-10-08T16:09:20.977381+0000","last_clean":"2023-10-08T16:09:20.977381+0000","last_became_active":"2023-10-08T16:09:19.980439+0000","last_became_peered":"2023-10-08T16:09:19.980439+0000","last_unstale":"2023-10-08T16:09:20.977381+0000","last_undegraded":"2023-10-08T16:09:20.977381+0000","last_fullsized":"2023-10-08T16:09:20.977381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931518+0000","last_change":"2023-10-08T16:09:20.927943+0000","last_active":"2023-10-08T16:09:20.931518+0000","last_peered":"2023-10-08T16:09:20.931518+0000","last_clean":"2023-10-08T16:09:20.931518+0000","last_became_active":"2023-10-08T16:09:20.927658+0000","last_became_peered":"2023-10-08T16:09:20.927658+0000","last_unstale":"2023-10-08T16:09:20.931518+0000","last_undegraded":"2023-10-08T16:09:20.931518+0000","last_fullsized":"2023-10-08T16:09:20.931518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:12.394183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973062+0000","last_change":"2023-10-08T16:09:19.980609+0000","last_active":"2023-10-08T16:09:20.973062+0000","last_peered":"2023-10-08T16:09:20.973062+0000","last_clean":"2023-10-08T16:09:20.973062+0000","last_became_active":"2023-10-08T16:09:19.980306+0000","last_became_peered":"2023-10-08T16:09:19.980306+0000","last_unstale":"2023-10-08T16:09:20.973062+0000","last_undegraded":"2023-10-08T16:09:20.973062+0000","last_fullsized":"2023-10-08T16:09:20.973062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927258+0000","last_change":"2023-10-08T16:09:20.920087+0000","last_active":"2023-10-08T16:09:20.927258+0000","last_peered":"2023-10-08T16:09:20.927258+0000","last_clean":"2023-10-08T16:09:20.927258+0000","last_became_active":"2023-10-08T16:09:20.919773+0000","last_became_peered":"2023-10-08T16:09:20.919773+0000","last_unstale":"2023-10-08T16:09:20.927258+0000","last_undegraded":"2023-10-08T16:09:20.927258+0000","last_fullsized":"2023-10-08T16:09:20.927258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908169+0000","last_change":"2023-10-08T16:09:19.982809+0000","last_active":"2023-10-08T16:09:20.908169+0000","last_peered":"2023-10-08T16:09:20.908169+0000","last_clean":"2023-10-08T16:09:20.908169+0000","last_became_active":"2023-10-08T16:09:19.981705+0000","last_became_peered":"2023-10-08T16:09:19.981705+0000","last_unstale":"2023-10-08T16:09:20.908169+0000","last_undegraded":"2023-10-08T16:09:20.908169+0000","last_fullsized":"2023-10-08T16:09:20.908169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933512+0000","last_change":"2023-10-08T16:09:20.930857+0000","last_active":"2023-10-08T16:09:20.933512+0000","last_peered":"2023-10-08T16:09:20.933512+0000","last_clean":"2023-10-08T16:09:20.933512+0000","last_became_active":"2023-10-08T16:09:20.930508+0000","last_became_peered":"2023-10-08T16:09:20.930508+0000","last_unstale":"2023-10-08T16:09:20.933512+0000","last_undegraded":"2023-10-08T16:09:20.933512+0000","last_fullsized":"2023-10-08T16:09:20.933512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910553+0000","last_change":"2023-10-08T16:09:19.982295+0000","last_active":"2023-10-08T16:09:20.910553+0000","last_peered":"2023-10-08T16:09:20.910553+0000","last_clean":"2023-10-08T16:09:20.910553+0000","last_became_active":"2023-10-08T16:09:19.980861+0000","last_became_peered":"2023-10-08T16:09:19.980861+0000","last_unstale":"2023-10-08T16:09:20.910553+0000","last_undegraded":"2023-10-08T16:09:20.910553+0000","last_fullsized":"2023-10-08T16:09:20.910553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922812+0000","last_change":"2023-10-08T16:09:20.921200+0000","last_active":"2023-10-08T16:09:20.922812+0000","last_peered":"2023-10-08T16:09:20.922812+0000","last_clean":"2023-10-08T16:09:20.922812+0000","last_became_active":"2023-10-08T16:09:20.920910+0000","last_became_peered":"2023-10-08T16:09:20.920910+0000","last_unstale":"2023-10-08T16:09:20.922812+0000","last_undegraded":"2023-10-08T16:09:20.922812+0000","last_fullsized":"2023-10-08T16:09:20.922812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973571+0000","last_change":"2023-10-08T16:09:19.977338+0000","last_active":"2023-10-08T16:09:20.973571+0000","last_peered":"2023-10-08T16:09:20.973571+0000","last_clean":"2023-10-08T16:09:20.973571+0000","last_became_active":"2023-10-08T16:09:19.976975+0000","last_became_peered":"2023-10-08T16:09:19.976975+0000","last_unstale":"2023-10-08T16:09:20.973571+0000","last_undegraded":"2023-10-08T16:09:20.973571+0000","last_fullsized":"2023-10-08T16:09:20.973571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930255+0000","last_change":"2023-10-08T16:09:20.927111+0000","last_active":"2023-10-08T16:09:20.930255+0000","last_peered":"2023-10-08T16:09:20.930255+0000","last_clean":"2023-10-08T16:09:20.930255+0000","last_became_active":"2023-10-08T16:09:20.926829+0000","last_became_peered":"2023-10-08T16:09:20.926829+0000","last_unstale":"2023-10-08T16:09:20.930255+0000","last_undegraded":"2023-10-08T16:09:20.930255+0000","last_fullsized":"2023-10-08T16:09:20.930255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970929+0000","last_change":"2023-10-08T16:09:19.975261+0000","last_active":"2023-10-08T16:09:20.970929+0000","last_peered":"2023-10-08T16:09:20.970929+0000","last_clean":"2023-10-08T16:09:20.970929+0000","last_became_active":"2023-10-08T16:09:19.973725+0000","last_became_peered":"2023-10-08T16:09:19.973725+0000","last_unstale":"2023-10-08T16:09:20.970929+0000","last_undegraded":"2023-10-08T16:09:20.970929+0000","last_fullsized":"2023-10-08T16:09:20.970929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934834+0000","last_change":"2023-10-08T16:09:20.931298+0000","last_active":"2023-10-08T16:09:20.934834+0000","last_peered":"2023-10-08T16:09:20.934834+0000","last_clean":"2023-10-08T16:09:20.934834+0000","last_became_active":"2023-10-08T16:09:20.931005+0000","last_became_peered":"2023-10-08T16:09:20.931005+0000","last_unstale":"2023-10-08T16:09:20.934834+0000","last_undegraded":"2023-10-08T16:09:20.934834+0000","last_fullsized":"2023-10-08T16:09:20.934834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904313+0000","last_change":"2023-10-08T16:09:19.984230+0000","last_active":"2023-10-08T16:09:20.904313+0000","last_peered":"2023-10-08T16:09:20.904313+0000","last_clean":"2023-10-08T16:09:20.904313+0000","last_became_active":"2023-10-08T16:09:19.983946+0000","last_became_peered":"2023-10-08T16:09:19.983946+0000","last_unstale":"2023-10-08T16:09:20.904313+0000","last_undegraded":"2023-10-08T16:09:20.904313+0000","last_fullsized":"2023-10-08T16:09:20.904313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933894+0000","last_change":"2023-10-08T16:09:20.927574+0000","last_active":"2023-10-08T16:09:20.933894+0000","last_peered":"2023-10-08T16:09:20.933894+0000","last_clean":"2023-10-08T16:09:20.933894+0000","last_became_active":"2023-10-08T16:09:20.927296+0000","last_became_peered":"2023-10-08T16:09:20.927296+0000","last_unstale":"2023-10-08T16:09:20.933894+0000","last_undegraded":"2023-10-08T16:09:20.933894+0000","last_fullsized":"2023-10-08T16:09:20.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908051+0000","last_change":"2023-10-08T16:09:19.980289+0000","last_active":"2023-10-08T16:09:20.908051+0000","last_peered":"2023-10-08T16:09:20.908051+0000","last_clean":"2023-10-08T16:09:20.908051+0000","last_became_active":"2023-10-08T16:09:19.979983+0000","last_became_peered":"2023-10-08T16:09:19.979983+0000","last_unstale":"2023-10-08T16:09:20.908051+0000","last_undegraded":"2023-10-08T16:09:20.908051+0000","last_fullsized":"2023-10-08T16:09:20.908051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920184+0000","last_change":"2023-10-08T16:09:20.914485+0000","last_active":"2023-10-08T16:09:20.920184+0000","last_peered":"2023-10-08T16:09:20.920184+0000","last_clean":"2023-10-08T16:09:20.920184+0000","last_became_active":"2023-10-08T16:09:20.914148+0000","last_became_peered":"2023-10-08T16:09:20.914148+0000","last_unstale":"2023-10-08T16:09:20.920184+0000","last_undegraded":"2023-10-08T16:09:20.920184+0000","last_fullsized":"2023-10-08T16:09:20.920184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918439+0000","last_change":"2023-10-08T16:09:20.914673+0000","last_active":"2023-10-08T16:09:20.918439+0000","last_peered":"2023-10-08T16:09:20.918439+0000","last_clean":"2023-10-08T16:09:20.918439+0000","last_became_active":"2023-10-08T16:09:20.914358+0000","last_became_peered":"2023-10-08T16:09:20.914358+0000","last_unstale":"2023-10-08T16:09:20.918439+0000","last_undegraded":"2023-10-08T16:09:20.918439+0000","last_fullsized":"2023-10-08T16:09:20.918439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909604+0000","last_change":"2023-10-08T16:09:19.976530+0000","last_active":"2023-10-08T16:09:20.909604+0000","last_peered":"2023-10-08T16:09:20.909604+0000","last_clean":"2023-10-08T16:09:20.909604+0000","last_became_active":"2023-10-08T16:09:19.976209+0000","last_became_peered":"2023-10-08T16:09:19.976209+0000","last_unstale":"2023-10-08T16:09:20.909604+0000","last_undegraded":"2023-10-08T16:09:20.909604+0000","last_fullsized":"2023-10-08T16:09:20.909604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938527+0000","last_change":"2023-10-08T16:09:20.934594+0000","last_active":"2023-10-08T16:09:20.938527+0000","last_peered":"2023-10-08T16:09:20.938527+0000","last_clean":"2023-10-08T16:09:20.938527+0000","last_became_active":"2023-10-08T16:09:20.934373+0000","last_became_peered":"2023-10-08T16:09:20.934373+0000","last_unstale":"2023-10-08T16:09:20.938527+0000","last_undegraded":"2023-10-08T16:09:20.938527+0000","last_fullsized":"2023-10-08T16:09:20.938527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906768+0000","last_change":"2023-10-08T16:09:19.978998+0000","last_active":"2023-10-08T16:09:20.906768+0000","last_peered":"2023-10-08T16:09:20.906768+0000","last_clean":"2023-10-08T16:09:20.906768+0000","last_became_active":"2023-10-08T16:09:19.978699+0000","last_became_peered":"2023-10-08T16:09:19.978699+0000","last_unstale":"2023-10-08T16:09:20.906768+0000","last_undegraded":"2023-10-08T16:09:20.906768+0000","last_fullsized":"2023-10-08T16:09:20.906768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910926+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:20.910926+0000","last_peered":"2023-10-08T16:09:20.910926+0000","last_clean":"2023-10-08T16:09:20.910926+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:20.910926+0000","last_undegraded":"2023-10-08T16:09:20.910926+0000","last_fullsized":"2023-10-08T16:09:20.910926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927499+0000","last_change":"2023-10-08T16:09:20.922573+0000","last_active":"2023-10-08T16:09:20.927499+0000","last_peered":"2023-10-08T16:09:20.927499+0000","last_clean":"2023-10-08T16:09:20.927499+0000","last_became_active":"2023-10-08T16:09:20.922307+0000","last_became_peered":"2023-10-08T16:09:20.922307+0000","last_unstale":"2023-10-08T16:09:20.927499+0000","last_undegraded":"2023-10-08T16:09:20.927499+0000","last_fullsized":"2023-10-08T16:09:20.927499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.913353+0000","last_change":"2023-10-08T16:09:19.986258+0000","last_active":"2023-10-08T16:09:20.913353+0000","last_peered":"2023-10-08T16:09:20.913353+0000","last_clean":"2023-10-08T16:09:20.913353+0000","last_became_active":"2023-10-08T16:09:19.985989+0000","last_became_peered":"2023-10-08T16:09:19.985989+0000","last_unstale":"2023-10-08T16:09:20.913353+0000","last_undegraded":"2023-10-08T16:09:20.913353+0000","last_fullsized":"2023-10-08T16:09:20.913353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.912945+0000","last_change":"2023-10-08T16:09:19.980337+0000","last_active":"2023-10-08T16:09:20.912945+0000","last_peered":"2023-10-08T16:09:20.912945+0000","last_clean":"2023-10-08T16:09:20.912945+0000","last_became_active":"2023-10-08T16:09:19.980070+0000","last_became_peered":"2023-10-08T16:09:19.980070+0000","last_unstale":"2023-10-08T16:09:20.912945+0000","last_undegraded":"2023-10-08T16:09:20.912945+0000","last_fullsized":"2023-10-08T16:09:20.912945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918188+0000","last_change":"2023-10-08T16:09:20.915246+0000","last_active":"2023-10-08T16:09:20.918188+0000","last_peered":"2023-10-08T16:09:20.918188+0000","last_clean":"2023-10-08T16:09:20.918188+0000","last_became_active":"2023-10-08T16:09:20.914991+0000","last_became_peered":"2023-10-08T16:09:20.914991+0000","last_unstale":"2023-10-08T16:09:20.918188+0000","last_undegraded":"2023-10-08T16:09:20.918188+0000","last_fullsized":"2023-10-08T16:09:20.918188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904380+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904380+0000","last_peered":"2023-10-08T16:09:20.904380+0000","last_clean":"2023-10-08T16:09:20.904380+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904380+0000","last_undegraded":"2023-10-08T16:09:20.904380+0000","last_fullsized":"2023-10-08T16:09:20.904380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925249+0000","last_change":"2023-10-08T16:09:20.921141+0000","last_active":"2023-10-08T16:09:20.925249+0000","last_peered":"2023-10-08T16:09:20.925249+0000","last_clean":"2023-10-08T16:09:20.925249+0000","last_became_active":"2023-10-08T16:09:20.920816+0000","last_became_peered":"2023-10-08T16:09:20.920816+0000","last_unstale":"2023-10-08T16:09:20.925249+0000","last_undegraded":"2023-10-08T16:09:20.925249+0000","last_fullsized":"2023-10-08T16:09:20.925249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972582+0000","last_change":"2023-10-08T16:09:19.983612+0000","last_active":"2023-10-08T16:09:20.972582+0000","last_peered":"2023-10-08T16:09:20.972582+0000","last_clean":"2023-10-08T16:09:20.972582+0000","last_became_active":"2023-10-08T16:09:19.983271+0000","last_became_peered":"2023-10-08T16:09:19.983271+0000","last_unstale":"2023-10-08T16:09:20.972582+0000","last_undegraded":"2023-10-08T16:09:20.972582+0000","last_fullsized":"2023-10-08T16:09:20.972582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927296+0000","last_change":"2023-10-08T16:09:20.920177+0000","last_active":"2023-10-08T16:09:20.927296+0000","last_peered":"2023-10-08T16:09:20.927296+0000","last_clean":"2023-10-08T16:09:20.927296+0000","last_became_active":"2023-10-08T16:09:20.919978+0000","last_became_peered":"2023-10-08T16:09:20.919978+0000","last_unstale":"2023-10-08T16:09:20.927296+0000","last_undegraded":"2023-10-08T16:09:20.927296+0000","last_fullsized":"2023-10-08T16:09:20.927296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.911835+0000","last_change":"2023-10-08T16:09:19.982502+0000","last_active":"2023-10-08T16:09:20.911835+0000","last_peered":"2023-10-08T16:09:20.911835+0000","last_clean":"2023-10-08T16:09:20.911835+0000","last_became_active":"2023-10-08T16:09:19.982165+0000","last_became_peered":"2023-10-08T16:09:19.982165+0000","last_unstale":"2023-10-08T16:09:20.911835+0000","last_undegraded":"2023-10-08T16:09:20.911835+0000","last_fullsized":"2023-10-08T16:09:20.911835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920335+0000","last_change":"2023-10-08T16:09:20.912685+0000","last_active":"2023-10-08T16:09:20.920335+0000","last_peered":"2023-10-08T16:09:20.920335+0000","last_clean":"2023-10-08T16:09:20.920335+0000","last_became_active":"2023-10-08T16:09:20.912404+0000","last_became_peered":"2023-10-08T16:09:20.912404+0000","last_unstale":"2023-10-08T16:09:20.920335+0000","last_undegraded":"2023-10-08T16:09:20.920335+0000","last_fullsized":"2023-10-08T16:09:20.920335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:49.906876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904177+0000","last_change":"2023-10-08T16:09:19.982753+0000","last_active":"2023-10-08T16:09:20.904177+0000","last_peered":"2023-10-08T16:09:20.904177+0000","last_clean":"2023-10-08T16:09:20.904177+0000","last_became_active":"2023-10-08T16:09:19.982334+0000","last_became_peered":"2023-10-08T16:09:19.982334+0000","last_unstale":"2023-10-08T16:09:20.904177+0000","last_undegraded":"2023-10-08T16:09:20.904177+0000","last_fullsized":"2023-10-08T16:09:20.904177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.924534+0000","last_change":"2023-10-08T16:09:20.919166+0000","last_active":"2023-10-08T16:09:20.924534+0000","last_peered":"2023-10-08T16:09:20.924534+0000","last_clean":"2023-10-08T16:09:20.924534+0000","last_became_active":"2023-10-08T16:09:20.918875+0000","last_became_peered":"2023-10-08T16:09:20.918875+0000","last_unstale":"2023-10-08T16:09:20.924534+0000","last_undegraded":"2023-10-08T16:09:20.924534+0000","last_fullsized":"2023-10-08T16:09:20.924534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904175+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904175+0000","last_peered":"2023-10-08T16:09:20.904175+0000","last_clean":"2023-10-08T16:09:20.904175+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904175+0000","last_undegraded":"2023-10-08T16:09:20.904175+0000","last_fullsized":"2023-10-08T16:09:20.904175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930491+0000","last_change":"2023-10-08T16:09:20.925593+0000","last_active":"2023-10-08T16:09:20.930491+0000","last_peered":"2023-10-08T16:09:20.930491+0000","last_clean":"2023-10-08T16:09:20.930491+0000","last_became_active":"2023-10-08T16:09:20.925297+0000","last_became_peered":"2023-10-08T16:09:20.925297+0000","last_unstale":"2023-10-08T16:09:20.930491+0000","last_undegraded":"2023-10-08T16:09:20.930491+0000","last_fullsized":"2023-10-08T16:09:20.930491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971799+0000","last_change":"2023-10-08T16:09:19.971356+0000","last_active":"2023-10-08T16:09:20.971799+0000","last_peered":"2023-10-08T16:09:20.971799+0000","last_clean":"2023-10-08T16:09:20.971799+0000","last_became_active":"2023-10-08T16:09:19.970744+0000","last_became_peered":"2023-10-08T16:09:19.970744+0000","last_unstale":"2023-10-08T16:09:20.971799+0000","last_undegraded":"2023-10-08T16:09:20.971799+0000","last_fullsized":"2023-10-08T16:09:20.971799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932776+0000","last_change":"2023-10-08T16:09:20.929086+0000","last_active":"2023-10-08T16:09:20.932776+0000","last_peered":"2023-10-08T16:09:20.932776+0000","last_clean":"2023-10-08T16:09:20.932776+0000","last_became_active":"2023-10-08T16:09:20.928822+0000","last_became_peered":"2023-10-08T16:09:20.928822+0000","last_unstale":"2023-10-08T16:09:20.932776+0000","last_undegraded":"2023-10-08T16:09:20.932776+0000","last_fullsized":"2023-10-08T16:09:20.932776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909850+0000","last_change":"2023-10-08T16:09:19.981894+0000","last_active":"2023-10-08T16:09:20.909850+0000","last_peered":"2023-10-08T16:09:20.909850+0000","last_clean":"2023-10-08T16:09:20.909850+0000","last_became_active":"2023-10-08T16:09:19.981565+0000","last_became_peered":"2023-10-08T16:09:19.981565+0000","last_unstale":"2023-10-08T16:09:20.909850+0000","last_undegraded":"2023-10-08T16:09:20.909850+0000","last_fullsized":"2023-10-08T16:09:20.909850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929759+0000","last_change":"2023-10-08T16:09:20.923617+0000","last_active":"2023-10-08T16:09:20.929759+0000","last_peered":"2023-10-08T16:09:20.929759+0000","last_clean":"2023-10-08T16:09:20.929759+0000","last_became_active":"2023-10-08T16:09:20.923317+0000","last_became_peered":"2023-10-08T16:09:20.923317+0000","last_unstale":"2023-10-08T16:09:20.929759+0000","last_undegraded":"2023-10-08T16:09:20.929759+0000","last_fullsized":"2023-10-08T16:09:20.929759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:42.436753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970642+0000","last_change":"2023-10-08T16:09:19.980864+0000","last_active":"2023-10-08T16:09:20.970642+0000","last_peered":"2023-10-08T16:09:20.970642+0000","last_clean":"2023-10-08T16:09:20.970642+0000","last_became_active":"2023-10-08T16:09:19.980600+0000","last_became_peered":"2023-10-08T16:09:19.980600+0000","last_unstale":"2023-10-08T16:09:20.970642+0000","last_undegraded":"2023-10-08T16:09:20.970642+0000","last_fullsized":"2023-10-08T16:09:20.970642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935869+0000","last_change":"2023-10-08T16:09:20.933766+0000","last_active":"2023-10-08T16:09:20.935869+0000","last_peered":"2023-10-08T16:09:20.935869+0000","last_clean":"2023-10-08T16:09:20.935869+0000","last_became_active":"2023-10-08T16:09:20.932450+0000","last_became_peered":"2023-10-08T16:09:20.932450+0000","last_unstale":"2023-10-08T16:09:20.935869+0000","last_undegraded":"2023-10-08T16:09:20.935869+0000","last_fullsized":"2023-10-08T16:09:20.935869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973172+0000","last_change":"2023-10-08T16:09:19.976571+0000","last_active":"2023-10-08T16:09:20.973172+0000","last_peered":"2023-10-08T16:09:20.973172+0000","last_clean":"2023-10-08T16:09:20.973172+0000","last_became_active":"2023-10-08T16:09:19.976236+0000","last_became_peered":"2023-10-08T16:09:19.976236+0000","last_unstale":"2023-10-08T16:09:20.973172+0000","last_undegraded":"2023-10-08T16:09:20.973172+0000","last_fullsized":"2023-10-08T16:09:20.973172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934951+0000","last_change":"2023-10-08T16:09:20.932413+0000","last_active":"2023-10-08T16:09:20.934951+0000","last_peered":"2023-10-08T16:09:20.934951+0000","last_clean":"2023-10-08T16:09:20.934951+0000","last_became_active":"2023-10-08T16:09:20.932147+0000","last_became_peered":"2023-10-08T16:09:20.932147+0000","last_unstale":"2023-10-08T16:09:20.934951+0000","last_undegraded":"2023-10-08T16:09:20.934951+0000","last_fullsized":"2023-10-08T16:09:20.934951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925266+0000","last_change":"2023-10-08T16:09:20.922001+0000","last_active":"2023-10-08T16:09:20.925266+0000","last_peered":"2023-10-08T16:09:20.925266+0000","last_clean":"2023-10-08T16:09:20.925266+0000","last_became_active":"2023-10-08T16:09:20.921669+0000","last_became_peered":"2023-10-08T16:09:20.921669+0000","last_unstale":"2023-10-08T16:09:20.925266+0000","last_undegraded":"2023-10-08T16:09:20.925266+0000","last_fullsized":"2023-10-08T16:09:20.925266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922887+0000","last_change":"2023-10-08T16:09:20.921422+0000","last_active":"2023-10-08T16:09:20.922887+0000","last_peered":"2023-10-08T16:09:20.922887+0000","last_clean":"2023-10-08T16:09:20.922887+0000","last_became_active":"2023-10-08T16:09:20.921165+0000","last_became_peered":"2023-10-08T16:09:20.921165+0000","last_unstale":"2023-10-08T16:09:20.922887+0000","last_undegraded":"2023-10-08T16:09:20.922887+0000","last_fullsized":"2023-10-08T16:09:20.922887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934025+0000","last_change":"2023-10-08T16:09:20.931352+0000","last_active":"2023-10-08T16:09:20.934025+0000","last_peered":"2023-10-08T16:09:20.934025+0000","last_clean":"2023-10-08T16:09:20.934025+0000","last_became_active":"2023-10-08T16:09:20.931070+0000","last_became_peered":"2023-10-08T16:09:20.931070+0000","last_unstale":"2023-10-08T16:09:20.934025+0000","last_undegraded":"2023-10-08T16:09:20.934025+0000","last_fullsized":"2023-10-08T16:09:20.934025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930029+0000","last_change":"2023-10-08T16:09:20.926274+0000","last_active":"2023-10-08T16:09:20.930029+0000","last_peered":"2023-10-08T16:09:20.930029+0000","last_clean":"2023-10-08T16:09:20.930029+0000","last_became_active":"2023-10-08T16:09:20.925863+0000","last_became_peered":"2023-10-08T16:09:20.925863+0000","last_unstale":"2023-10-08T16:09:20.930029+0000","last_undegraded":"2023-10-08T16:09:20.930029+0000","last_fullsized":"2023-10-08T16:09:20.930029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930429+0000","last_change":"2023-10-08T16:09:20.925620+0000","last_active":"2023-10-08T16:09:20.930429+0000","last_peered":"2023-10-08T16:09:20.930429+0000","last_clean":"2023-10-08T16:09:20.930429+0000","last_became_active":"2023-10-08T16:09:20.924561+0000","last_became_peered":"2023-10-08T16:09:20.924561+0000","last_unstale":"2023-10-08T16:09:20.930429+0000","last_undegraded":"2023-10-08T16:09:20.930429+0000","last_fullsized":"2023-10-08T16:09:20.930429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918309+0000","last_change":"2023-10-08T16:09:20.916056+0000","last_active":"2023-10-08T16:09:20.918309+0000","last_peered":"2023-10-08T16:09:20.918309+0000","last_clean":"2023-10-08T16:09:20.918309+0000","last_became_active":"2023-10-08T16:09:20.915784+0000","last_became_peered":"2023-10-08T16:09:20.915784+0000","last_unstale":"2023-10-08T16:09:20.918309+0000","last_undegraded":"2023-10-08T16:09:20.918309+0000","last_fullsized":"2023-10-08T16:09:20.918309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927968+0000","last_change":"2023-10-08T16:09:20.926730+0000","last_active":"2023-10-08T16:09:20.927968+0000","last_peered":"2023-10-08T16:09:20.927968+0000","last_clean":"2023-10-08T16:09:20.927968+0000","last_became_active":"2023-10-08T16:09:20.925172+0000","last_became_peered":"2023-10-08T16:09:20.925172+0000","last_unstale":"2023-10-08T16:09:20.927968+0000","last_undegraded":"2023-10-08T16:09:20.927968+0000","last_fullsized":"2023-10-08T16:09:20.927968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930295+0000","last_change":"2023-10-08T16:09:20.925120+0000","last_active":"2023-10-08T16:09:20.930295+0000","last_peered":"2023-10-08T16:09:20.930295+0000","last_clean":"2023-10-08T16:09:20.930295+0000","last_became_active":"2023-10-08T16:09:20.924840+0000","last_became_peered":"2023-10-08T16:09:20.924840+0000","last_unstale":"2023-10-08T16:09:20.930295+0000","last_undegraded":"2023-10-08T16:09:20.930295+0000","last_fullsized":"2023-10-08T16:09:20.930295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934825+0000","last_change":"2023-10-08T16:09:20.932038+0000","last_active":"2023-10-08T16:09:20.934825+0000","last_peered":"2023-10-08T16:09:20.934825+0000","last_clean":"2023-10-08T16:09:20.934825+0000","last_became_active":"2023-10-08T16:09:20.931773+0000","last_became_peered":"2023-10-08T16:09:20.931773+0000","last_unstale":"2023-10-08T16:09:20.934825+0000","last_undegraded":"2023-10-08T16:09:20.934825+0000","last_fullsized":"2023-10-08T16:09:20.934825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930258+0000","last_change":"2023-10-08T16:09:20.925060+0000","last_active":"2023-10-08T16:09:20.930258+0000","last_peered":"2023-10-08T16:09:20.930258+0000","last_clean":"2023-10-08T16:09:20.930258+0000","last_became_active":"2023-10-08T16:09:20.924565+0000","last_became_peered":"2023-10-08T16:09:20.924565+0000","last_unstale":"2023-10-08T16:09:20.930258+0000","last_undegraded":"2023-10-08T16:09:20.930258+0000","last_fullsized":"2023-10-08T16:09:20.930258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932817+0000","last_change":"2023-10-08T16:09:20.921042+0000","last_active":"2023-10-08T16:09:20.932817+0000","last_peered":"2023-10-08T16:09:20.932817+0000","last_clean":"2023-10-08T16:09:20.932817+0000","last_became_active":"2023-10-08T16:09:20.920766+0000","last_became_peered":"2023-10-08T16:09:20.920766+0000","last_unstale":"2023-10-08T16:09:20.932817+0000","last_undegraded":"2023-10-08T16:09:20.932817+0000","last_fullsized":"2023-10-08T16:09:20.932817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927308+0000","last_change":"2023-10-08T16:09:20.920992+0000","last_active":"2023-10-08T16:09:20.927308+0000","last_peered":"2023-10-08T16:09:20.927308+0000","last_clean":"2023-10-08T16:09:20.927308+0000","last_became_active":"2023-10-08T16:09:20.920227+0000","last_became_peered":"2023-10-08T16:09:20.920227+0000","last_unstale":"2023-10-08T16:09:20.927308+0000","last_undegraded":"2023-10-08T16:09:20.927308+0000","last_fullsized":"2023-10-08T16:09:20.927308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932806+0000","last_change":"2023-10-08T16:09:20.930112+0000","last_active":"2023-10-08T16:09:20.932806+0000","last_peered":"2023-10-08T16:09:20.932806+0000","last_clean":"2023-10-08T16:09:20.932806+0000","last_became_active":"2023-10-08T16:09:20.929813+0000","last_became_peered":"2023-10-08T16:09:20.929813+0000","last_unstale":"2023-10-08T16:09:20.932806+0000","last_undegraded":"2023-10-08T16:09:20.932806+0000","last_fullsized":"2023-10-08T16:09:20.932806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301600,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070240,"statfs":{"total":96636764160,"available":96327925760,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:30.239 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.436+0000 7f859d79d700 1 Processor -- start 2023-10-08T16:09:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.436+0000 7f859d79d700 1 -- start start 2023-10-08T16:09:30.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859d79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8598153c30 0x7f859815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f85980cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859d79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859815afd0 con 0x7f85980cef40 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859d79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859815b2b0 con 0x7f8598153c30 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859815b590 con 0x7f859815de50 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f8597fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8598153c30 0x7f859815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859cf9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f85980cef40 0x7f859806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41754/0 (socket says 172.21.15.12:41754) 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.437+0000 7f859cf9c700 1 -- 172.21.15.12:0/3778547326 learned_addr learned my addr 172.21.15.12:0/3778547326 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f85977fe700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f85980cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8597fff700 1 -- 172.21.15.12:0/3778547326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 msgr2=0x7f85980cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8596ffd700 1 -- 172.21.15.12:0/3778547326 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844987673 0 0) 0x7f859815afd0 con 0x7f85980cef40 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8597fff700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f85980cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8597fff700 1 -- 172.21.15.12:0/3778547326 >> v1:172.21.15.12:6789/0 conn(0x7f85980cef40 legacy=0x7f859806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8597fff700 1 -- 172.21.15.12:0/3778547326 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859815b870 con 0x7f8598153c30 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8597fff700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f859815a5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85880098e0 tx=0x7f85880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6889c412b8c8c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8596ffd700 1 -- 172.21.15.12:0/3778547326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588009e80 con 0x7f8598153c30 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8596ffd700 1 -- 172.21.15.12:0/3778547326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858800b860 con 0x7f8598153c30 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.438+0000 7f8596ffd700 1 -- 172.21.15.12:0/3778547326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800bbe0 con 0x7f8598153c30 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 -- 172.21.15.12:0/3778547326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 msgr2=0x7f859815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f859815a5e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f85880098e0 tx=0x7f85880091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 -- 172.21.15.12:0/3778547326 shutdown_connections 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f859815a5e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 --2- 172.21.15.12:0/3778547326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f85980cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 -- 172.21.15.12:0/3778547326 >> 172.21.15.12:0/3778547326 conn(0x7f85980703a0 msgr2=0x7f85980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 -- 172.21.15.12:0/3778547326 shutdown_connections 2023-10-08T16:09:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.439+0000 7f859d79d700 1 -- 172.21.15.12:0/3778547326 wait complete. 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.441+0000 7f859d79d700 1 Processor -- start 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.441+0000 7f859d79d700 1 -- start start 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85980cef40 0x7f859814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f8598152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859814d910 con 0x7f8598153c30 2023-10-08T16:09:30.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85980b1d60 con 0x7f85980cef40 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85981525d0 con 0x7f859815de50 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58252/0 (socket says 172.21.15.12:58252) 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 -- 172.21.15.12:0/3487829964 learned_addr learned my addr 172.21.15.12:0/3487829964 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f859cf9c700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f8598152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f8597fff700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85980cef40 0x7f859814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 -- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 msgr2=0x7f8598152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f8598152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 -- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85980cef40 msgr2=0x7f859814d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85980cef40 0x7f859814d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.442+0000 7f85977fe700 1 -- 172.21.15.12:0/3487829964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8588009420 con 0x7f8598153c30 2023-10-08T16:09:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f85977fe700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f858c00d8c0 tx=0x7f858c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00de60 con 0x7f8598153c30 2023-10-08T16:09:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00b780 con 0x7f8598153c30 2023-10-08T16:09:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85980c78a0 con 0x7f8598153c30 2023-10-08T16:09:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00bb20 con 0x7f8598153c30 2023-10-08T16:09:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.443+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85980b1f70 con 0x7f8598153c30 2023-10-08T16:09:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.444+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85980c7cf0 con 0x7f8598153c30 2023-10-08T16:09:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.445+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f858c01e460 con 0x7f8598153c30 2023-10-08T16:09:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.446+0000 7f857ffff700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 0x7f85840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.446+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f858c084bd0 con 0x7f8598153c30 2023-10-08T16:09:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.446+0000 7f8597fff700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 0x7f85840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.447+0000 7f8597fff700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 0x7f85840693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85880091e0 tx=0x7f8588017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.450+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f858c051e40 con 0x7f8598153c30 2023-10-08T16:09:30.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.649+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f859804c3c0 con 0x7f8584066f30 2023-10-08T16:09:30.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.657+0000 7f857ffff700 1 -- 172.21.15.12:0/3487829964 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264540 (secure 0 0 0) 0x7f859804c3c0 con 0x7f8584066f30 2023-10-08T16:09:30.661 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 msgr2=0x7f85840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 0x7f85840693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f85880091e0 tx=0x7f8588017000 comp rx=0 tx=0).stop 2023-10-08T16:09:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 msgr2=0x7f85980b1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f858c00d8c0 tx=0x7f858c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 shutdown_connections 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f859815de50 0x7f8598152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85980cef40 0x7f859814d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8584066f30 0x7f85840693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 --2- 172.21.15.12:0/3487829964 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8598153c30 0x7f85980b1820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 >> 172.21.15.12:0/3487829964 conn(0x7f85980703a0 msgr2=0x7f859815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 shutdown_connections 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.661+0000 7f859d79d700 1 -- 172.21.15.12:0/3487829964 wait complete. 2023-10-08T16:09:30.664 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:30.679 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:09:29.914023+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397608,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577112,"statfs":{"total":773094113280,"available":770638962688,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.011573"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931948+0000","last_change":"2023-10-08T16:09:20.923239+0000","last_active":"2023-10-08T16:09:20.931948+0000","last_peered":"2023-10-08T16:09:20.931948+0000","last_clean":"2023-10-08T16:09:20.931948+0000","last_became_active":"2023-10-08T16:09:20.922789+0000","last_became_peered":"2023-10-08T16:09:20.922789+0000","last_unstale":"2023-10-08T16:09:20.931948+0000","last_undegraded":"2023-10-08T16:09:20.931948+0000","last_fullsized":"2023-10-08T16:09:20.931948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:36.471481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918249+0000","last_change":"2023-10-08T16:09:20.914085+0000","last_active":"2023-10-08T16:09:20.918249+0000","last_peered":"2023-10-08T16:09:20.918249+0000","last_clean":"2023-10-08T16:09:20.918249+0000","last_became_active":"2023-10-08T16:09:20.913834+0000","last_became_peered":"2023-10-08T16:09:20.913834+0000","last_unstale":"2023-10-08T16:09:20.918249+0000","last_undegraded":"2023-10-08T16:09:20.918249+0000","last_fullsized":"2023-10-08T16:09:20.918249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.919536+0000","last_change":"2023-10-08T16:09:20.915094+0000","last_active":"2023-10-08T16:09:20.919536+0000","last_peered":"2023-10-08T16:09:20.919536+0000","last_clean":"2023-10-08T16:09:20.919536+0000","last_became_active":"2023-10-08T16:09:20.914821+0000","last_became_peered":"2023-10-08T16:09:20.914821+0000","last_unstale":"2023-10-08T16:09:20.919536+0000","last_undegraded":"2023-10-08T16:09:20.919536+0000","last_fullsized":"2023-10-08T16:09:20.919536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:39.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934072+0000","last_change":"2023-10-08T16:09:20.931361+0000","last_active":"2023-10-08T16:09:20.934072+0000","last_peered":"2023-10-08T16:09:20.934072+0000","last_clean":"2023-10-08T16:09:20.934072+0000","last_became_active":"2023-10-08T16:09:20.931006+0000","last_became_peered":"2023-10-08T16:09:20.931006+0000","last_unstale":"2023-10-08T16:09:20.934072+0000","last_undegraded":"2023-10-08T16:09:20.934072+0000","last_fullsized":"2023-10-08T16:09:20.934072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931450+0000","last_change":"2023-10-08T16:09:20.924404+0000","last_active":"2023-10-08T16:09:20.931450+0000","last_peered":"2023-10-08T16:09:20.931450+0000","last_clean":"2023-10-08T16:09:20.931450+0000","last_became_active":"2023-10-08T16:09:20.924076+0000","last_became_peered":"2023-10-08T16:09:20.924076+0000","last_unstale":"2023-10-08T16:09:20.931450+0000","last_undegraded":"2023-10-08T16:09:20.931450+0000","last_fullsized":"2023-10-08T16:09:20.931450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:29.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932898+0000","last_change":"2023-10-08T16:09:20.922230+0000","last_active":"2023-10-08T16:09:20.932898+0000","last_peered":"2023-10-08T16:09:20.932898+0000","last_clean":"2023-10-08T16:09:20.932898+0000","last_became_active":"2023-10-08T16:09:20.921756+0000","last_became_peered":"2023-10-08T16:09:20.921756+0000","last_unstale":"2023-10-08T16:09:20.932898+0000","last_undegraded":"2023-10-08T16:09:20.932898+0000","last_fullsized":"2023-10-08T16:09:20.932898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930235+0000","last_change":"2023-10-08T16:09:20.926442+0000","last_active":"2023-10-08T16:09:20.930235+0000","last_peered":"2023-10-08T16:09:20.930235+0000","last_clean":"2023-10-08T16:09:20.930235+0000","last_became_active":"2023-10-08T16:09:20.926134+0000","last_became_peered":"2023-10-08T16:09:20.926134+0000","last_unstale":"2023-10-08T16:09:20.930235+0000","last_undegraded":"2023-10-08T16:09:20.930235+0000","last_fullsized":"2023-10-08T16:09:20.930235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:09.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938511+0000","last_change":"2023-10-08T16:09:20.934468+0000","last_active":"2023-10-08T16:09:20.938511+0000","last_peered":"2023-10-08T16:09:20.938511+0000","last_clean":"2023-10-08T16:09:20.938511+0000","last_became_active":"2023-10-08T16:09:20.934187+0000","last_became_peered":"2023-10-08T16:09:20.934187+0000","last_unstale":"2023-10-08T16:09:20.938511+0000","last_undegraded":"2023-10-08T16:09:20.938511+0000","last_fullsized":"2023-10-08T16:09:20.938511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934886+0000","last_change":"2023-10-08T16:09:20.930046+0000","last_active":"2023-10-08T16:09:20.934886+0000","last_peered":"2023-10-08T16:09:20.934886+0000","last_clean":"2023-10-08T16:09:20.934886+0000","last_became_active":"2023-10-08T16:09:20.929384+0000","last_became_peered":"2023-10-08T16:09:20.929384+0000","last_unstale":"2023-10-08T16:09:20.934886+0000","last_undegraded":"2023-10-08T16:09:20.934886+0000","last_fullsized":"2023-10-08T16:09:20.934886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:29.654343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925610+0000","last_change":"2023-10-08T16:09:20.921732+0000","last_active":"2023-10-08T16:09:20.925610+0000","last_peered":"2023-10-08T16:09:20.925610+0000","last_clean":"2023-10-08T16:09:20.925610+0000","last_became_active":"2023-10-08T16:09:20.921260+0000","last_became_peered":"2023-10-08T16:09:20.921260+0000","last_unstale":"2023-10-08T16:09:20.925610+0000","last_undegraded":"2023-10-08T16:09:20.925610+0000","last_fullsized":"2023-10-08T16:09:20.925610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935782+0000","last_change":"2023-10-08T16:09:20.934331+0000","last_active":"2023-10-08T16:09:20.935782+0000","last_peered":"2023-10-08T16:09:20.935782+0000","last_clean":"2023-10-08T16:09:20.935782+0000","last_became_active":"2023-10-08T16:09:20.934023+0000","last_became_peered":"2023-10-08T16:09:20.934023+0000","last_unstale":"2023-10-08T16:09:20.935782+0000","last_undegraded":"2023-10-08T16:09:20.935782+0000","last_fullsized":"2023-10-08T16:09:20.935782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927686+0000","last_change":"2023-10-08T16:09:20.921076+0000","last_active":"2023-10-08T16:09:20.927686+0000","last_peered":"2023-10-08T16:09:20.927686+0000","last_clean":"2023-10-08T16:09:20.927686+0000","last_became_active":"2023-10-08T16:09:20.920798+0000","last_became_peered":"2023-10-08T16:09:20.920798+0000","last_unstale":"2023-10-08T16:09:20.927686+0000","last_undegraded":"2023-10-08T16:09:20.927686+0000","last_fullsized":"2023-10-08T16:09:20.927686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:00.083968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925745+0000","last_change":"2023-10-08T16:09:20.922551+0000","last_active":"2023-10-08T16:09:20.925745+0000","last_peered":"2023-10-08T16:09:20.925745+0000","last_clean":"2023-10-08T16:09:20.925745+0000","last_became_active":"2023-10-08T16:09:20.922276+0000","last_became_peered":"2023-10-08T16:09:20.922276+0000","last_unstale":"2023-10-08T16:09:20.925745+0000","last_undegraded":"2023-10-08T16:09:20.925745+0000","last_fullsized":"2023-10-08T16:09:20.925745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927387+0000","last_change":"2023-10-08T16:09:20.921190+0000","last_active":"2023-10-08T16:09:20.927387+0000","last_peered":"2023-10-08T16:09:20.927387+0000","last_clean":"2023-10-08T16:09:20.927387+0000","last_became_active":"2023-10-08T16:09:20.920627+0000","last_became_peered":"2023-10-08T16:09:20.920627+0000","last_unstale":"2023-10-08T16:09:20.927387+0000","last_undegraded":"2023-10-08T16:09:20.927387+0000","last_fullsized":"2023-10-08T16:09:20.927387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:16.772848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918396+0000","last_change":"2023-10-08T16:09:20.913009+0000","last_active":"2023-10-08T16:09:20.918396+0000","last_peered":"2023-10-08T16:09:20.918396+0000","last_clean":"2023-10-08T16:09:20.918396+0000","last_became_active":"2023-10-08T16:09:20.912719+0000","last_became_peered":"2023-10-08T16:09:20.912719+0000","last_unstale":"2023-10-08T16:09:20.918396+0000","last_undegraded":"2023-10-08T16:09:20.918396+0000","last_fullsized":"2023-10-08T16:09:20.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920698+0000","last_change":"2023-10-08T16:09:20.916696+0000","last_active":"2023-10-08T16:09:20.920698+0000","last_peered":"2023-10-08T16:09:20.920698+0000","last_clean":"2023-10-08T16:09:20.920698+0000","last_became_active":"2023-10-08T16:09:20.916352+0000","last_became_peered":"2023-10-08T16:09:20.916352+0000","last_unstale":"2023-10-08T16:09:20.920698+0000","last_undegraded":"2023-10-08T16:09:20.920698+0000","last_fullsized":"2023-10-08T16:09:20.920698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928741+0000","last_change":"2023-10-08T16:09:20.919110+0000","last_active":"2023-10-08T16:09:20.928741+0000","last_peered":"2023-10-08T16:09:20.928741+0000","last_clean":"2023-10-08T16:09:20.928741+0000","last_became_active":"2023-10-08T16:09:20.918780+0000","last_became_peered":"2023-10-08T16:09:20.918780+0000","last_unstale":"2023-10-08T16:09:20.928741+0000","last_undegraded":"2023-10-08T16:09:20.928741+0000","last_fullsized":"2023-10-08T16:09:20.928741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922564+0000","last_change":"2023-10-08T16:09:20.918158+0000","last_active":"2023-10-08T16:09:20.922564+0000","last_peered":"2023-10-08T16:09:20.922564+0000","last_clean":"2023-10-08T16:09:20.922564+0000","last_became_active":"2023-10-08T16:09:20.917856+0000","last_became_peered":"2023-10-08T16:09:20.917856+0000","last_unstale":"2023-10-08T16:09:20.922564+0000","last_undegraded":"2023-10-08T16:09:20.922564+0000","last_fullsized":"2023-10-08T16:09:20.922564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931481+0000","last_change":"2023-10-08T16:09:20.927146+0000","last_active":"2023-10-08T16:09:20.931481+0000","last_peered":"2023-10-08T16:09:20.931481+0000","last_clean":"2023-10-08T16:09:20.931481+0000","last_became_active":"2023-10-08T16:09:20.924805+0000","last_became_peered":"2023-10-08T16:09:20.924805+0000","last_unstale":"2023-10-08T16:09:20.931481+0000","last_undegraded":"2023-10-08T16:09:20.931481+0000","last_fullsized":"2023-10-08T16:09:20.931481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:43.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972105+0000","last_change":"2023-10-08T16:09:19.983339+0000","last_active":"2023-10-08T16:09:20.972105+0000","last_peered":"2023-10-08T16:09:20.972105+0000","last_clean":"2023-10-08T16:09:20.972105+0000","last_became_active":"2023-10-08T16:09:19.983052+0000","last_became_peered":"2023-10-08T16:09:19.983052+0000","last_unstale":"2023-10-08T16:09:20.972105+0000","last_undegraded":"2023-10-08T16:09:20.972105+0000","last_fullsized":"2023-10-08T16:09:20.972105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925071+0000","last_change":"2023-10-08T16:09:20.923270+0000","last_active":"2023-10-08T16:09:20.925071+0000","last_peered":"2023-10-08T16:09:20.925071+0000","last_clean":"2023-10-08T16:09:20.925071+0000","last_became_active":"2023-10-08T16:09:20.923011+0000","last_became_peered":"2023-10-08T16:09:20.923011+0000","last_unstale":"2023-10-08T16:09:20.925071+0000","last_undegraded":"2023-10-08T16:09:20.925071+0000","last_fullsized":"2023-10-08T16:09:20.925071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975780+0000","last_change":"2023-10-08T16:09:19.983890+0000","last_active":"2023-10-08T16:09:20.975780+0000","last_peered":"2023-10-08T16:09:20.975780+0000","last_clean":"2023-10-08T16:09:20.975780+0000","last_became_active":"2023-10-08T16:09:19.983629+0000","last_became_peered":"2023-10-08T16:09:19.983629+0000","last_unstale":"2023-10-08T16:09:20.975780+0000","last_undegraded":"2023-10-08T16:09:20.975780+0000","last_fullsized":"2023-10-08T16:09:20.975780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932721+0000","last_change":"2023-10-08T16:09:20.929176+0000","last_active":"2023-10-08T16:09:20.932721+0000","last_peered":"2023-10-08T16:09:20.932721+0000","last_clean":"2023-10-08T16:09:20.932721+0000","last_became_active":"2023-10-08T16:09:20.928937+0000","last_became_peered":"2023-10-08T16:09:20.928937+0000","last_unstale":"2023-10-08T16:09:20.932721+0000","last_undegraded":"2023-10-08T16:09:20.932721+0000","last_fullsized":"2023-10-08T16:09:20.932721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973901+0000","last_change":"2023-10-08T16:09:19.982390+0000","last_active":"2023-10-08T16:09:20.973901+0000","last_peered":"2023-10-08T16:09:20.973901+0000","last_clean":"2023-10-08T16:09:20.973901+0000","last_became_active":"2023-10-08T16:09:19.982067+0000","last_became_peered":"2023-10-08T16:09:19.982067+0000","last_unstale":"2023-10-08T16:09:20.973901+0000","last_undegraded":"2023-10-08T16:09:20.973901+0000","last_fullsized":"2023-10-08T16:09:20.973901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:56.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933876+0000","last_change":"2023-10-08T16:09:20.928229+0000","last_active":"2023-10-08T16:09:20.933876+0000","last_peered":"2023-10-08T16:09:20.933876+0000","last_clean":"2023-10-08T16:09:20.933876+0000","last_became_active":"2023-10-08T16:09:20.927947+0000","last_became_peered":"2023-10-08T16:09:20.927947+0000","last_unstale":"2023-10-08T16:09:20.933876+0000","last_undegraded":"2023-10-08T16:09:20.933876+0000","last_fullsized":"2023-10-08T16:09:20.933876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:20.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971881+0000","last_change":"2023-10-08T16:09:19.976558+0000","last_active":"2023-10-08T16:09:20.971881+0000","last_peered":"2023-10-08T16:09:20.971881+0000","last_clean":"2023-10-08T16:09:20.971881+0000","last_became_active":"2023-10-08T16:09:19.976190+0000","last_became_peered":"2023-10-08T16:09:19.976190+0000","last_unstale":"2023-10-08T16:09:20.971881+0000","last_undegraded":"2023-10-08T16:09:20.971881+0000","last_fullsized":"2023-10-08T16:09:20.971881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:16.143856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933050+0000","last_change":"2023-10-08T16:09:20.926759+0000","last_active":"2023-10-08T16:09:20.933050+0000","last_peered":"2023-10-08T16:09:20.933050+0000","last_clean":"2023-10-08T16:09:20.933050+0000","last_became_active":"2023-10-08T16:09:20.926449+0000","last_became_peered":"2023-10-08T16:09:20.926449+0000","last_unstale":"2023-10-08T16:09:20.933050+0000","last_undegraded":"2023-10-08T16:09:20.933050+0000","last_fullsized":"2023-10-08T16:09:20.933050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975655+0000","last_change":"2023-10-08T16:09:19.983304+0000","last_active":"2023-10-08T16:09:20.975655+0000","last_peered":"2023-10-08T16:09:20.975655+0000","last_clean":"2023-10-08T16:09:20.975655+0000","last_became_active":"2023-10-08T16:09:19.982916+0000","last_became_peered":"2023-10-08T16:09:19.982916+0000","last_unstale":"2023-10-08T16:09:20.975655+0000","last_undegraded":"2023-10-08T16:09:20.975655+0000","last_fullsized":"2023-10-08T16:09:20.975655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925716+0000","last_change":"2023-10-08T16:09:20.914915+0000","last_active":"2023-10-08T16:09:20.925716+0000","last_peered":"2023-10-08T16:09:20.925716+0000","last_clean":"2023-10-08T16:09:20.925716+0000","last_became_active":"2023-10-08T16:09:20.914562+0000","last_became_peered":"2023-10-08T16:09:20.914562+0000","last_unstale":"2023-10-08T16:09:20.925716+0000","last_undegraded":"2023-10-08T16:09:20.925716+0000","last_fullsized":"2023-10-08T16:09:20.925716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.969110+0000","last_change":"2023-10-08T16:09:19.982834+0000","last_active":"2023-10-08T16:09:20.969110+0000","last_peered":"2023-10-08T16:09:20.969110+0000","last_clean":"2023-10-08T16:09:20.969110+0000","last_became_active":"2023-10-08T16:09:19.981385+0000","last_became_peered":"2023-10-08T16:09:19.981385+0000","last_unstale":"2023-10-08T16:09:20.969110+0000","last_undegraded":"2023-10-08T16:09:20.969110+0000","last_fullsized":"2023-10-08T16:09:20.969110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930013+0000","last_change":"2023-10-08T16:09:20.924374+0000","last_active":"2023-10-08T16:09:20.930013+0000","last_peered":"2023-10-08T16:09:20.930013+0000","last_clean":"2023-10-08T16:09:20.930013+0000","last_became_active":"2023-10-08T16:09:20.924067+0000","last_became_peered":"2023-10-08T16:09:20.924067+0000","last_unstale":"2023-10-08T16:09:20.930013+0000","last_undegraded":"2023-10-08T16:09:20.930013+0000","last_fullsized":"2023-10-08T16:09:20.930013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.916621+0000","last_change":"2023-10-08T16:09:19.979195+0000","last_active":"2023-10-08T16:09:20.916621+0000","last_peered":"2023-10-08T16:09:20.916621+0000","last_clean":"2023-10-08T16:09:20.916621+0000","last_became_active":"2023-10-08T16:09:19.977936+0000","last_became_peered":"2023-10-08T16:09:19.977936+0000","last_unstale":"2023-10-08T16:09:20.916621+0000","last_undegraded":"2023-10-08T16:09:20.916621+0000","last_fullsized":"2023-10-08T16:09:20.916621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933011+0000","last_change":"2023-10-08T16:09:20.928131+0000","last_active":"2023-10-08T16:09:20.933011+0000","last_peered":"2023-10-08T16:09:20.933011+0000","last_clean":"2023-10-08T16:09:20.933011+0000","last_became_active":"2023-10-08T16:09:20.927721+0000","last_became_peered":"2023-10-08T16:09:20.927721+0000","last_unstale":"2023-10-08T16:09:20.933011+0000","last_undegraded":"2023-10-08T16:09:20.933011+0000","last_fullsized":"2023-10-08T16:09:20.933011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906866+0000","last_change":"2023-10-08T16:09:19.988608+0000","last_active":"2023-10-08T16:09:20.906866+0000","last_peered":"2023-10-08T16:09:20.906866+0000","last_clean":"2023-10-08T16:09:20.906866+0000","last_became_active":"2023-10-08T16:09:19.988278+0000","last_became_peered":"2023-10-08T16:09:19.988278+0000","last_unstale":"2023-10-08T16:09:20.906866+0000","last_undegraded":"2023-10-08T16:09:20.906866+0000","last_fullsized":"2023-10-08T16:09:20.906866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.921581+0000","last_change":"2023-10-08T16:09:20.918971+0000","last_active":"2023-10-08T16:09:20.921581+0000","last_peered":"2023-10-08T16:09:20.921581+0000","last_clean":"2023-10-08T16:09:20.921581+0000","last_became_active":"2023-10-08T16:09:20.918687+0000","last_became_peered":"2023-10-08T16:09:20.918687+0000","last_unstale":"2023-10-08T16:09:20.921581+0000","last_undegraded":"2023-10-08T16:09:20.921581+0000","last_fullsized":"2023-10-08T16:09:20.921581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910412+0000","last_change":"2023-10-08T16:09:19.989053+0000","last_active":"2023-10-08T16:09:20.910412+0000","last_peered":"2023-10-08T16:09:20.910412+0000","last_clean":"2023-10-08T16:09:20.910412+0000","last_became_active":"2023-10-08T16:09:19.988777+0000","last_became_peered":"2023-10-08T16:09:19.988777+0000","last_unstale":"2023-10-08T16:09:20.910412+0000","last_undegraded":"2023-10-08T16:09:20.910412+0000","last_fullsized":"2023-10-08T16:09:20.910412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928707+0000","last_change":"2023-10-08T16:09:20.919114+0000","last_active":"2023-10-08T16:09:20.928707+0000","last_peered":"2023-10-08T16:09:20.928707+0000","last_clean":"2023-10-08T16:09:20.928707+0000","last_became_active":"2023-10-08T16:09:20.918800+0000","last_became_peered":"2023-10-08T16:09:20.918800+0000","last_unstale":"2023-10-08T16:09:20.928707+0000","last_undegraded":"2023-10-08T16:09:20.928707+0000","last_fullsized":"2023-10-08T16:09:20.928707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.907633+0000","last_change":"2023-10-08T16:09:19.985911+0000","last_active":"2023-10-08T16:09:20.907633+0000","last_peered":"2023-10-08T16:09:20.907633+0000","last_clean":"2023-10-08T16:09:20.907633+0000","last_became_active":"2023-10-08T16:09:19.985587+0000","last_became_peered":"2023-10-08T16:09:19.985587+0000","last_unstale":"2023-10-08T16:09:20.907633+0000","last_undegraded":"2023-10-08T16:09:20.907633+0000","last_fullsized":"2023-10-08T16:09:20.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927469+0000","last_change":"2023-10-08T16:09:20.923331+0000","last_active":"2023-10-08T16:09:20.927469+0000","last_peered":"2023-10-08T16:09:20.927469+0000","last_clean":"2023-10-08T16:09:20.927469+0000","last_became_active":"2023-10-08T16:09:20.923039+0000","last_became_peered":"2023-10-08T16:09:20.923039+0000","last_unstale":"2023-10-08T16:09:20.927469+0000","last_undegraded":"2023-10-08T16:09:20.927469+0000","last_fullsized":"2023-10-08T16:09:20.927469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:17.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970716+0000","last_change":"2023-10-08T16:09:19.977329+0000","last_active":"2023-10-08T16:09:20.970716+0000","last_peered":"2023-10-08T16:09:20.970716+0000","last_clean":"2023-10-08T16:09:20.970716+0000","last_became_active":"2023-10-08T16:09:19.977037+0000","last_became_peered":"2023-10-08T16:09:19.977037+0000","last_unstale":"2023-10-08T16:09:20.970716+0000","last_undegraded":"2023-10-08T16:09:20.970716+0000","last_fullsized":"2023-10-08T16:09:20.970716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929923+0000","last_change":"2023-10-08T16:09:20.925081+0000","last_active":"2023-10-08T16:09:20.929923+0000","last_peered":"2023-10-08T16:09:20.929923+0000","last_clean":"2023-10-08T16:09:20.929923+0000","last_became_active":"2023-10-08T16:09:20.924752+0000","last_became_peered":"2023-10-08T16:09:20.924752+0000","last_unstale":"2023-10-08T16:09:20.929923+0000","last_undegraded":"2023-10-08T16:09:20.929923+0000","last_fullsized":"2023-10-08T16:09:20.929923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:26.766584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.977381+0000","last_change":"2023-10-08T16:09:19.983118+0000","last_active":"2023-10-08T16:09:20.977381+0000","last_peered":"2023-10-08T16:09:20.977381+0000","last_clean":"2023-10-08T16:09:20.977381+0000","last_became_active":"2023-10-08T16:09:19.980439+0000","last_became_peered":"2023-10-08T16:09:19.980439+0000","last_unstale":"2023-10-08T16:09:20.977381+0000","last_undegraded":"2023-10-08T16:09:20.977381+0000","last_fullsized":"2023-10-08T16:09:20.977381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931518+0000","last_change":"2023-10-08T16:09:20.927943+0000","last_active":"2023-10-08T16:09:20.931518+0000","last_peered":"2023-10-08T16:09:20.931518+0000","last_clean":"2023-10-08T16:09:20.931518+0000","last_became_active":"2023-10-08T16:09:20.927658+0000","last_became_peered":"2023-10-08T16:09:20.927658+0000","last_unstale":"2023-10-08T16:09:20.931518+0000","last_undegraded":"2023-10-08T16:09:20.931518+0000","last_fullsized":"2023-10-08T16:09:20.931518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:12.394183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973062+0000","last_change":"2023-10-08T16:09:19.980609+0000","last_active":"2023-10-08T16:09:20.973062+0000","last_peered":"2023-10-08T16:09:20.973062+0000","last_clean":"2023-10-08T16:09:20.973062+0000","last_became_active":"2023-10-08T16:09:19.980306+0000","last_became_peered":"2023-10-08T16:09:19.980306+0000","last_unstale":"2023-10-08T16:09:20.973062+0000","last_undegraded":"2023-10-08T16:09:20.973062+0000","last_fullsized":"2023-10-08T16:09:20.973062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927258+0000","last_change":"2023-10-08T16:09:20.920087+0000","last_active":"2023-10-08T16:09:20.927258+0000","last_peered":"2023-10-08T16:09:20.927258+0000","last_clean":"2023-10-08T16:09:20.927258+0000","last_became_active":"2023-10-08T16:09:20.919773+0000","last_became_peered":"2023-10-08T16:09:20.919773+0000","last_unstale":"2023-10-08T16:09:20.927258+0000","last_undegraded":"2023-10-08T16:09:20.927258+0000","last_fullsized":"2023-10-08T16:09:20.927258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908169+0000","last_change":"2023-10-08T16:09:19.982809+0000","last_active":"2023-10-08T16:09:20.908169+0000","last_peered":"2023-10-08T16:09:20.908169+0000","last_clean":"2023-10-08T16:09:20.908169+0000","last_became_active":"2023-10-08T16:09:19.981705+0000","last_became_peered":"2023-10-08T16:09:19.981705+0000","last_unstale":"2023-10-08T16:09:20.908169+0000","last_undegraded":"2023-10-08T16:09:20.908169+0000","last_fullsized":"2023-10-08T16:09:20.908169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933512+0000","last_change":"2023-10-08T16:09:20.930857+0000","last_active":"2023-10-08T16:09:20.933512+0000","last_peered":"2023-10-08T16:09:20.933512+0000","last_clean":"2023-10-08T16:09:20.933512+0000","last_became_active":"2023-10-08T16:09:20.930508+0000","last_became_peered":"2023-10-08T16:09:20.930508+0000","last_unstale":"2023-10-08T16:09:20.933512+0000","last_undegraded":"2023-10-08T16:09:20.933512+0000","last_fullsized":"2023-10-08T16:09:20.933512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910553+0000","last_change":"2023-10-08T16:09:19.982295+0000","last_active":"2023-10-08T16:09:20.910553+0000","last_peered":"2023-10-08T16:09:20.910553+0000","last_clean":"2023-10-08T16:09:20.910553+0000","last_became_active":"2023-10-08T16:09:19.980861+0000","last_became_peered":"2023-10-08T16:09:19.980861+0000","last_unstale":"2023-10-08T16:09:20.910553+0000","last_undegraded":"2023-10-08T16:09:20.910553+0000","last_fullsized":"2023-10-08T16:09:20.910553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922812+0000","last_change":"2023-10-08T16:09:20.921200+0000","last_active":"2023-10-08T16:09:20.922812+0000","last_peered":"2023-10-08T16:09:20.922812+0000","last_clean":"2023-10-08T16:09:20.922812+0000","last_became_active":"2023-10-08T16:09:20.920910+0000","last_became_peered":"2023-10-08T16:09:20.920910+0000","last_unstale":"2023-10-08T16:09:20.922812+0000","last_undegraded":"2023-10-08T16:09:20.922812+0000","last_fullsized":"2023-10-08T16:09:20.922812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973571+0000","last_change":"2023-10-08T16:09:19.977338+0000","last_active":"2023-10-08T16:09:20.973571+0000","last_peered":"2023-10-08T16:09:20.973571+0000","last_clean":"2023-10-08T16:09:20.973571+0000","last_became_active":"2023-10-08T16:09:19.976975+0000","last_became_peered":"2023-10-08T16:09:19.976975+0000","last_unstale":"2023-10-08T16:09:20.973571+0000","last_undegraded":"2023-10-08T16:09:20.973571+0000","last_fullsized":"2023-10-08T16:09:20.973571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930255+0000","last_change":"2023-10-08T16:09:20.927111+0000","last_active":"2023-10-08T16:09:20.930255+0000","last_peered":"2023-10-08T16:09:20.930255+0000","last_clean":"2023-10-08T16:09:20.930255+0000","last_became_active":"2023-10-08T16:09:20.926829+0000","last_became_peered":"2023-10-08T16:09:20.926829+0000","last_unstale":"2023-10-08T16:09:20.930255+0000","last_undegraded":"2023-10-08T16:09:20.930255+0000","last_fullsized":"2023-10-08T16:09:20.930255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970929+0000","last_change":"2023-10-08T16:09:19.975261+0000","last_active":"2023-10-08T16:09:20.970929+0000","last_peered":"2023-10-08T16:09:20.970929+0000","last_clean":"2023-10-08T16:09:20.970929+0000","last_became_active":"2023-10-08T16:09:19.973725+0000","last_became_peered":"2023-10-08T16:09:19.973725+0000","last_unstale":"2023-10-08T16:09:20.970929+0000","last_undegraded":"2023-10-08T16:09:20.970929+0000","last_fullsized":"2023-10-08T16:09:20.970929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934834+0000","last_change":"2023-10-08T16:09:20.931298+0000","last_active":"2023-10-08T16:09:20.934834+0000","last_peered":"2023-10-08T16:09:20.934834+0000","last_clean":"2023-10-08T16:09:20.934834+0000","last_became_active":"2023-10-08T16:09:20.931005+0000","last_became_peered":"2023-10-08T16:09:20.931005+0000","last_unstale":"2023-10-08T16:09:20.934834+0000","last_undegraded":"2023-10-08T16:09:20.934834+0000","last_fullsized":"2023-10-08T16:09:20.934834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904313+0000","last_change":"2023-10-08T16:09:19.984230+0000","last_active":"2023-10-08T16:09:20.904313+0000","last_peered":"2023-10-08T16:09:20.904313+0000","last_clean":"2023-10-08T16:09:20.904313+0000","last_became_active":"2023-10-08T16:09:19.983946+0000","last_became_peered":"2023-10-08T16:09:19.983946+0000","last_unstale":"2023-10-08T16:09:20.904313+0000","last_undegraded":"2023-10-08T16:09:20.904313+0000","last_fullsized":"2023-10-08T16:09:20.904313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933894+0000","last_change":"2023-10-08T16:09:20.927574+0000","last_active":"2023-10-08T16:09:20.933894+0000","last_peered":"2023-10-08T16:09:20.933894+0000","last_clean":"2023-10-08T16:09:20.933894+0000","last_became_active":"2023-10-08T16:09:20.927296+0000","last_became_peered":"2023-10-08T16:09:20.927296+0000","last_unstale":"2023-10-08T16:09:20.933894+0000","last_undegraded":"2023-10-08T16:09:20.933894+0000","last_fullsized":"2023-10-08T16:09:20.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908051+0000","last_change":"2023-10-08T16:09:19.980289+0000","last_active":"2023-10-08T16:09:20.908051+0000","last_peered":"2023-10-08T16:09:20.908051+0000","last_clean":"2023-10-08T16:09:20.908051+0000","last_became_active":"2023-10-08T16:09:19.979983+0000","last_became_peered":"2023-10-08T16:09:19.979983+0000","last_unstale":"2023-10-08T16:09:20.908051+0000","last_undegraded":"2023-10-08T16:09:20.908051+0000","last_fullsized":"2023-10-08T16:09:20.908051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920184+0000","last_change":"2023-10-08T16:09:20.914485+0000","last_active":"2023-10-08T16:09:20.920184+0000","last_peered":"2023-10-08T16:09:20.920184+0000","last_clean":"2023-10-08T16:09:20.920184+0000","last_became_active":"2023-10-08T16:09:20.914148+0000","last_became_peered":"2023-10-08T16:09:20.914148+0000","last_unstale":"2023-10-08T16:09:20.920184+0000","last_undegraded":"2023-10-08T16:09:20.920184+0000","last_fullsized":"2023-10-08T16:09:20.920184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918439+0000","last_change":"2023-10-08T16:09:20.914673+0000","last_active":"2023-10-08T16:09:20.918439+0000","last_peered":"2023-10-08T16:09:20.918439+0000","last_clean":"2023-10-08T16:09:20.918439+0000","last_became_active":"2023-10-08T16:09:20.914358+0000","last_became_peered":"2023-10-08T16:09:20.914358+0000","last_unstale":"2023-10-08T16:09:20.918439+0000","last_undegraded":"2023-10-08T16:09:20.918439+0000","last_fullsized":"2023-10-08T16:09:20.918439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909604+0000","last_change":"2023-10-08T16:09:19.976530+0000","last_active":"2023-10-08T16:09:20.909604+0000","last_peered":"2023-10-08T16:09:20.909604+0000","last_clean":"2023-10-08T16:09:20.909604+0000","last_became_active":"2023-10-08T16:09:19.976209+0000","last_became_peered":"2023-10-08T16:09:19.976209+0000","last_unstale":"2023-10-08T16:09:20.909604+0000","last_undegraded":"2023-10-08T16:09:20.909604+0000","last_fullsized":"2023-10-08T16:09:20.909604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938527+0000","last_change":"2023-10-08T16:09:20.934594+0000","last_active":"2023-10-08T16:09:20.938527+0000","last_peered":"2023-10-08T16:09:20.938527+0000","last_clean":"2023-10-08T16:09:20.938527+0000","last_became_active":"2023-10-08T16:09:20.934373+0000","last_became_peered":"2023-10-08T16:09:20.934373+0000","last_unstale":"2023-10-08T16:09:20.938527+0000","last_undegraded":"2023-10-08T16:09:20.938527+0000","last_fullsized":"2023-10-08T16:09:20.938527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906768+0000","last_change":"2023-10-08T16:09:19.978998+0000","last_active":"2023-10-08T16:09:20.906768+0000","last_peered":"2023-10-08T16:09:20.906768+0000","last_clean":"2023-10-08T16:09:20.906768+0000","last_became_active":"2023-10-08T16:09:19.978699+0000","last_became_peered":"2023-10-08T16:09:19.978699+0000","last_unstale":"2023-10-08T16:09:20.906768+0000","last_undegraded":"2023-10-08T16:09:20.906768+0000","last_fullsized":"2023-10-08T16:09:20.906768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910926+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:20.910926+0000","last_peered":"2023-10-08T16:09:20.910926+0000","last_clean":"2023-10-08T16:09:20.910926+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:20.910926+0000","last_undegraded":"2023-10-08T16:09:20.910926+0000","last_fullsized":"2023-10-08T16:09:20.910926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927499+0000","last_change":"2023-10-08T16:09:20.922573+0000","last_active":"2023-10-08T16:09:20.927499+0000","last_peered":"2023-10-08T16:09:20.927499+0000","last_clean":"2023-10-08T16:09:20.927499+0000","last_became_active":"2023-10-08T16:09:20.922307+0000","last_became_peered":"2023-10-08T16:09:20.922307+0000","last_unstale":"2023-10-08T16:09:20.927499+0000","last_undegraded":"2023-10-08T16:09:20.927499+0000","last_fullsized":"2023-10-08T16:09:20.927499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.913353+0000","last_change":"2023-10-08T16:09:19.986258+0000","last_active":"2023-10-08T16:09:20.913353+0000","last_peered":"2023-10-08T16:09:20.913353+0000","last_clean":"2023-10-08T16:09:20.913353+0000","last_became_active":"2023-10-08T16:09:19.985989+0000","last_became_peered":"2023-10-08T16:09:19.985989+0000","last_unstale":"2023-10-08T16:09:20.913353+0000","last_undegraded":"2023-10-08T16:09:20.913353+0000","last_fullsized":"2023-10-08T16:09:20.913353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.912945+0000","last_change":"2023-10-08T16:09:19.980337+0000","last_active":"2023-10-08T16:09:20.912945+0000","last_peered":"2023-10-08T16:09:20.912945+0000","last_clean":"2023-10-08T16:09:20.912945+0000","last_became_active":"2023-10-08T16:09:19.980070+0000","last_became_peered":"2023-10-08T16:09:19.980070+0000","last_unstale":"2023-10-08T16:09:20.912945+0000","last_undegraded":"2023-10-08T16:09:20.912945+0000","last_fullsized":"2023-10-08T16:09:20.912945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918188+0000","last_change":"2023-10-08T16:09:20.915246+0000","last_active":"2023-10-08T16:09:20.918188+0000","last_peered":"2023-10-08T16:09:20.918188+0000","last_clean":"2023-10-08T16:09:20.918188+0000","last_became_active":"2023-10-08T16:09:20.914991+0000","last_became_peered":"2023-10-08T16:09:20.914991+0000","last_unstale":"2023-10-08T16:09:20.918188+0000","last_undegraded":"2023-10-08T16:09:20.918188+0000","last_fullsized":"2023-10-08T16:09:20.918188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.623858+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:22.623858+0000","last_peered":"2023-10-08T16:09:22.623858+0000","last_clean":"2023-10-08T16:09:22.623858+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:22.623858+0000","last_undegraded":"2023-10-08T16:09:22.623858+0000","last_fullsized":"2023-10-08T16:09:22.623858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925249+0000","last_change":"2023-10-08T16:09:20.921141+0000","last_active":"2023-10-08T16:09:20.925249+0000","last_peered":"2023-10-08T16:09:20.925249+0000","last_clean":"2023-10-08T16:09:20.925249+0000","last_became_active":"2023-10-08T16:09:20.920816+0000","last_became_peered":"2023-10-08T16:09:20.920816+0000","last_unstale":"2023-10-08T16:09:20.925249+0000","last_undegraded":"2023-10-08T16:09:20.925249+0000","last_fullsized":"2023-10-08T16:09:20.925249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972582+0000","last_change":"2023-10-08T16:09:19.983612+0000","last_active":"2023-10-08T16:09:20.972582+0000","last_peered":"2023-10-08T16:09:20.972582+0000","last_clean":"2023-10-08T16:09:20.972582+0000","last_became_active":"2023-10-08T16:09:19.983271+0000","last_became_peered":"2023-10-08T16:09:19.983271+0000","last_unstale":"2023-10-08T16:09:20.972582+0000","last_undegraded":"2023-10-08T16:09:20.972582+0000","last_fullsized":"2023-10-08T16:09:20.972582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927296+0000","last_change":"2023-10-08T16:09:20.920177+0000","last_active":"2023-10-08T16:09:20.927296+0000","last_peered":"2023-10-08T16:09:20.927296+0000","last_clean":"2023-10-08T16:09:20.927296+0000","last_became_active":"2023-10-08T16:09:20.919978+0000","last_became_peered":"2023-10-08T16:09:20.919978+0000","last_unstale":"2023-10-08T16:09:20.927296+0000","last_undegraded":"2023-10-08T16:09:20.927296+0000","last_fullsized":"2023-10-08T16:09:20.927296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.911835+0000","last_change":"2023-10-08T16:09:19.982502+0000","last_active":"2023-10-08T16:09:20.911835+0000","last_peered":"2023-10-08T16:09:20.911835+0000","last_clean":"2023-10-08T16:09:20.911835+0000","last_became_active":"2023-10-08T16:09:19.982165+0000","last_became_peered":"2023-10-08T16:09:19.982165+0000","last_unstale":"2023-10-08T16:09:20.911835+0000","last_undegraded":"2023-10-08T16:09:20.911835+0000","last_fullsized":"2023-10-08T16:09:20.911835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920335+0000","last_change":"2023-10-08T16:09:20.912685+0000","last_active":"2023-10-08T16:09:20.920335+0000","last_peered":"2023-10-08T16:09:20.920335+0000","last_clean":"2023-10-08T16:09:20.920335+0000","last_became_active":"2023-10-08T16:09:20.912404+0000","last_became_peered":"2023-10-08T16:09:20.912404+0000","last_unstale":"2023-10-08T16:09:20.920335+0000","last_undegraded":"2023-10-08T16:09:20.920335+0000","last_fullsized":"2023-10-08T16:09:20.920335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:49.906876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904177+0000","last_change":"2023-10-08T16:09:19.982753+0000","last_active":"2023-10-08T16:09:20.904177+0000","last_peered":"2023-10-08T16:09:20.904177+0000","last_clean":"2023-10-08T16:09:20.904177+0000","last_became_active":"2023-10-08T16:09:19.982334+0000","last_became_peered":"2023-10-08T16:09:19.982334+0000","last_unstale":"2023-10-08T16:09:20.904177+0000","last_undegraded":"2023-10-08T16:09:20.904177+0000","last_fullsized":"2023-10-08T16:09:20.904177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.924534+0000","last_change":"2023-10-08T16:09:20.919166+0000","last_active":"2023-10-08T16:09:20.924534+0000","last_peered":"2023-10-08T16:09:20.924534+0000","last_clean":"2023-10-08T16:09:20.924534+0000","last_became_active":"2023-10-08T16:09:20.918875+0000","last_became_peered":"2023-10-08T16:09:20.918875+0000","last_unstale":"2023-10-08T16:09:20.924534+0000","last_undegraded":"2023-10-08T16:09:20.924534+0000","last_fullsized":"2023-10-08T16:09:20.924534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904175+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904175+0000","last_peered":"2023-10-08T16:09:20.904175+0000","last_clean":"2023-10-08T16:09:20.904175+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904175+0000","last_undegraded":"2023-10-08T16:09:20.904175+0000","last_fullsized":"2023-10-08T16:09:20.904175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930491+0000","last_change":"2023-10-08T16:09:20.925593+0000","last_active":"2023-10-08T16:09:20.930491+0000","last_peered":"2023-10-08T16:09:20.930491+0000","last_clean":"2023-10-08T16:09:20.930491+0000","last_became_active":"2023-10-08T16:09:20.925297+0000","last_became_peered":"2023-10-08T16:09:20.925297+0000","last_unstale":"2023-10-08T16:09:20.930491+0000","last_undegraded":"2023-10-08T16:09:20.930491+0000","last_fullsized":"2023-10-08T16:09:20.930491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971799+0000","last_change":"2023-10-08T16:09:19.971356+0000","last_active":"2023-10-08T16:09:20.971799+0000","last_peered":"2023-10-08T16:09:20.971799+0000","last_clean":"2023-10-08T16:09:20.971799+0000","last_became_active":"2023-10-08T16:09:19.970744+0000","last_became_peered":"2023-10-08T16:09:19.970744+0000","last_unstale":"2023-10-08T16:09:20.971799+0000","last_undegraded":"2023-10-08T16:09:20.971799+0000","last_fullsized":"2023-10-08T16:09:20.971799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932776+0000","last_change":"2023-10-08T16:09:20.929086+0000","last_active":"2023-10-08T16:09:20.932776+0000","last_peered":"2023-10-08T16:09:20.932776+0000","last_clean":"2023-10-08T16:09:20.932776+0000","last_became_active":"2023-10-08T16:09:20.928822+0000","last_became_peered":"2023-10-08T16:09:20.928822+0000","last_unstale":"2023-10-08T16:09:20.932776+0000","last_undegraded":"2023-10-08T16:09:20.932776+0000","last_fullsized":"2023-10-08T16:09:20.932776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909850+0000","last_change":"2023-10-08T16:09:19.981894+0000","last_active":"2023-10-08T16:09:20.909850+0000","last_peered":"2023-10-08T16:09:20.909850+0000","last_clean":"2023-10-08T16:09:20.909850+0000","last_became_active":"2023-10-08T16:09:19.981565+0000","last_became_peered":"2023-10-08T16:09:19.981565+0000","last_unstale":"2023-10-08T16:09:20.909850+0000","last_undegraded":"2023-10-08T16:09:20.909850+0000","last_fullsized":"2023-10-08T16:09:20.909850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929759+0000","last_change":"2023-10-08T16:09:20.923617+0000","last_active":"2023-10-08T16:09:20.929759+0000","last_peered":"2023-10-08T16:09:20.929759+0000","last_clean":"2023-10-08T16:09:20.929759+0000","last_became_active":"2023-10-08T16:09:20.923317+0000","last_became_peered":"2023-10-08T16:09:20.923317+0000","last_unstale":"2023-10-08T16:09:20.929759+0000","last_undegraded":"2023-10-08T16:09:20.929759+0000","last_fullsized":"2023-10-08T16:09:20.929759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:42.436753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970642+0000","last_change":"2023-10-08T16:09:19.980864+0000","last_active":"2023-10-08T16:09:20.970642+0000","last_peered":"2023-10-08T16:09:20.970642+0000","last_clean":"2023-10-08T16:09:20.970642+0000","last_became_active":"2023-10-08T16:09:19.980600+0000","last_became_peered":"2023-10-08T16:09:19.980600+0000","last_unstale":"2023-10-08T16:09:20.970642+0000","last_undegraded":"2023-10-08T16:09:20.970642+0000","last_fullsized":"2023-10-08T16:09:20.970642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935869+0000","last_change":"2023-10-08T16:09:20.933766+0000","last_active":"2023-10-08T16:09:20.935869+0000","last_peered":"2023-10-08T16:09:20.935869+0000","last_clean":"2023-10-08T16:09:20.935869+0000","last_became_active":"2023-10-08T16:09:20.932450+0000","last_became_peered":"2023-10-08T16:09:20.932450+0000","last_unstale":"2023-10-08T16:09:20.935869+0000","last_undegraded":"2023-10-08T16:09:20.935869+0000","last_fullsized":"2023-10-08T16:09:20.935869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973172+0000","last_change":"2023-10-08T16:09:19.976571+0000","last_active":"2023-10-08T16:09:20.973172+0000","last_peered":"2023-10-08T16:09:20.973172+0000","last_clean":"2023-10-08T16:09:20.973172+0000","last_became_active":"2023-10-08T16:09:19.976236+0000","last_became_peered":"2023-10-08T16:09:19.976236+0000","last_unstale":"2023-10-08T16:09:20.973172+0000","last_undegraded":"2023-10-08T16:09:20.973172+0000","last_fullsized":"2023-10-08T16:09:20.973172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934951+0000","last_change":"2023-10-08T16:09:20.932413+0000","last_active":"2023-10-08T16:09:20.934951+0000","last_peered":"2023-10-08T16:09:20.934951+0000","last_clean":"2023-10-08T16:09:20.934951+0000","last_became_active":"2023-10-08T16:09:20.932147+0000","last_became_peered":"2023-10-08T16:09:20.932147+0000","last_unstale":"2023-10-08T16:09:20.934951+0000","last_undegraded":"2023-10-08T16:09:20.934951+0000","last_fullsized":"2023-10-08T16:09:20.934951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925266+0000","last_change":"2023-10-08T16:09:20.922001+0000","last_active":"2023-10-08T16:09:20.925266+0000","last_peered":"2023-10-08T16:09:20.925266+0000","last_clean":"2023-10-08T16:09:20.925266+0000","last_became_active":"2023-10-08T16:09:20.921669+0000","last_became_peered":"2023-10-08T16:09:20.921669+0000","last_unstale":"2023-10-08T16:09:20.925266+0000","last_undegraded":"2023-10-08T16:09:20.925266+0000","last_fullsized":"2023-10-08T16:09:20.925266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922887+0000","last_change":"2023-10-08T16:09:20.921422+0000","last_active":"2023-10-08T16:09:20.922887+0000","last_peered":"2023-10-08T16:09:20.922887+0000","last_clean":"2023-10-08T16:09:20.922887+0000","last_became_active":"2023-10-08T16:09:20.921165+0000","last_became_peered":"2023-10-08T16:09:20.921165+0000","last_unstale":"2023-10-08T16:09:20.922887+0000","last_undegraded":"2023-10-08T16:09:20.922887+0000","last_fullsized":"2023-10-08T16:09:20.922887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934025+0000","last_change":"2023-10-08T16:09:20.931352+0000","last_active":"2023-10-08T16:09:20.934025+0000","last_peered":"2023-10-08T16:09:20.934025+0000","last_clean":"2023-10-08T16:09:20.934025+0000","last_became_active":"2023-10-08T16:09:20.931070+0000","last_became_peered":"2023-10-08T16:09:20.931070+0000","last_unstale":"2023-10-08T16:09:20.934025+0000","last_undegraded":"2023-10-08T16:09:20.934025+0000","last_fullsized":"2023-10-08T16:09:20.934025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930029+0000","last_change":"2023-10-08T16:09:20.926274+0000","last_active":"2023-10-08T16:09:20.930029+0000","last_peered":"2023-10-08T16:09:20.930029+0000","last_clean":"2023-10-08T16:09:20.930029+0000","last_became_active":"2023-10-08T16:09:20.925863+0000","last_became_peered":"2023-10-08T16:09:20.925863+0000","last_unstale":"2023-10-08T16:09:20.930029+0000","last_undegraded":"2023-10-08T16:09:20.930029+0000","last_fullsized":"2023-10-08T16:09:20.930029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930429+0000","last_change":"2023-10-08T16:09:20.925620+0000","last_active":"2023-10-08T16:09:20.930429+0000","last_peered":"2023-10-08T16:09:20.930429+0000","last_clean":"2023-10-08T16:09:20.930429+0000","last_became_active":"2023-10-08T16:09:20.924561+0000","last_became_peered":"2023-10-08T16:09:20.924561+0000","last_unstale":"2023-10-08T16:09:20.930429+0000","last_undegraded":"2023-10-08T16:09:20.930429+0000","last_fullsized":"2023-10-08T16:09:20.930429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918309+0000","last_change":"2023-10-08T16:09:20.916056+0000","last_active":"2023-10-08T16:09:20.918309+0000","last_peered":"2023-10-08T16:09:20.918309+0000","last_clean":"2023-10-08T16:09:20.918309+0000","last_became_active":"2023-10-08T16:09:20.915784+0000","last_became_peered":"2023-10-08T16:09:20.915784+0000","last_unstale":"2023-10-08T16:09:20.918309+0000","last_undegraded":"2023-10-08T16:09:20.918309+0000","last_fullsized":"2023-10-08T16:09:20.918309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927968+0000","last_change":"2023-10-08T16:09:20.926730+0000","last_active":"2023-10-08T16:09:20.927968+0000","last_peered":"2023-10-08T16:09:20.927968+0000","last_clean":"2023-10-08T16:09:20.927968+0000","last_became_active":"2023-10-08T16:09:20.925172+0000","last_became_peered":"2023-10-08T16:09:20.925172+0000","last_unstale":"2023-10-08T16:09:20.927968+0000","last_undegraded":"2023-10-08T16:09:20.927968+0000","last_fullsized":"2023-10-08T16:09:20.927968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930295+0000","last_change":"2023-10-08T16:09:20.925120+0000","last_active":"2023-10-08T16:09:20.930295+0000","last_peered":"2023-10-08T16:09:20.930295+0000","last_clean":"2023-10-08T16:09:20.930295+0000","last_became_active":"2023-10-08T16:09:20.924840+0000","last_became_peered":"2023-10-08T16:09:20.924840+0000","last_unstale":"2023-10-08T16:09:20.930295+0000","last_undegraded":"2023-10-08T16:09:20.930295+0000","last_fullsized":"2023-10-08T16:09:20.930295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934825+0000","last_change":"2023-10-08T16:09:20.932038+0000","last_active":"2023-10-08T16:09:20.934825+0000","last_peered":"2023-10-08T16:09:20.934825+0000","last_clean":"2023-10-08T16:09:20.934825+0000","last_became_active":"2023-10-08T16:09:20.931773+0000","last_became_peered":"2023-10-08T16:09:20.931773+0000","last_unstale":"2023-10-08T16:09:20.934825+0000","last_undegraded":"2023-10-08T16:09:20.934825+0000","last_fullsized":"2023-10-08T16:09:20.934825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930258+0000","last_change":"2023-10-08T16:09:20.925060+0000","last_active":"2023-10-08T16:09:20.930258+0000","last_peered":"2023-10-08T16:09:20.930258+0000","last_clean":"2023-10-08T16:09:20.930258+0000","last_became_active":"2023-10-08T16:09:20.924565+0000","last_became_peered":"2023-10-08T16:09:20.924565+0000","last_unstale":"2023-10-08T16:09:20.930258+0000","last_undegraded":"2023-10-08T16:09:20.930258+0000","last_fullsized":"2023-10-08T16:09:20.930258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932817+0000","last_change":"2023-10-08T16:09:20.921042+0000","last_active":"2023-10-08T16:09:20.932817+0000","last_peered":"2023-10-08T16:09:20.932817+0000","last_clean":"2023-10-08T16:09:20.932817+0000","last_became_active":"2023-10-08T16:09:20.920766+0000","last_became_peered":"2023-10-08T16:09:20.920766+0000","last_unstale":"2023-10-08T16:09:20.932817+0000","last_undegraded":"2023-10-08T16:09:20.932817+0000","last_fullsized":"2023-10-08T16:09:20.932817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927308+0000","last_change":"2023-10-08T16:09:20.920992+0000","last_active":"2023-10-08T16:09:20.927308+0000","last_peered":"2023-10-08T16:09:20.927308+0000","last_clean":"2023-10-08T16:09:20.927308+0000","last_became_active":"2023-10-08T16:09:20.920227+0000","last_became_peered":"2023-10-08T16:09:20.920227+0000","last_unstale":"2023-10-08T16:09:20.927308+0000","last_undegraded":"2023-10-08T16:09:20.927308+0000","last_fullsized":"2023-10-08T16:09:20.927308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932806+0000","last_change":"2023-10-08T16:09:20.930112+0000","last_active":"2023-10-08T16:09:20.932806+0000","last_peered":"2023-10-08T16:09:20.932806+0000","last_clean":"2023-10-08T16:09:20.932806+0000","last_became_active":"2023-10-08T16:09:20.929813+0000","last_became_peered":"2023-10-08T16:09:20.929813+0000","last_unstale":"2023-10-08T16:09:20.932806+0000","last_undegraded":"2023-10-08T16:09:20.932806+0000","last_fullsized":"2023-10-08T16:09:20.932806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301600,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070240,"statfs":{"total":96636764160,"available":96327925760,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:30.684 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:09:30.685 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-08T16:09:30.685 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-08T16:09:30.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T16:09:30.685 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-08T16:09:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.905+0000 7fda5699d700 1 Processor -- start 2023-10-08T16:09:30.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.906+0000 7fda5699d700 1 -- start start 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda5015a8c0 0x7fda5006d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5699d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda5006ddd0 0x7fda500cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5699d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda500cec30 con 0x7fda500b2980 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5699d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5006e270 con 0x7fda5006ddd0 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500ce930 con 0x7fda5015a8c0 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5599b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fda500b2980 0x7fda500cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41758/0 (socket says 172.21.15.12:41758) 2023-10-08T16:09:30.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5599b700 1 -- 172.21.15.12:0/803543360 learned_addr learned my addr 172.21.15.12:0/803543360 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5519a700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda5015a8c0 0x7fda5006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda5619c700 1 --2- 172.21.15.12:0/803543360 >> v2:172.21.15.29:3300/0 conn(0x7fda5006ddd0 0x7fda500cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.907+0000 7fda54999700 1 -- 172.21.15.12:0/803543360 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79863365 0 0) 0x7fda500cec30 con 0x7fda500b2980 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda54999700 1 -- 172.21.15.12:0/803543360 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda3c003570 con 0x7fda500b2980 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda5619c700 1 -- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda5015a8c0 msgr2=0x7fda5006d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda5619c700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda5015a8c0 0x7fda5006d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda5619c700 1 -- 172.21.15.12:0/803543360 >> v1:172.21.15.12:6789/0 conn(0x7fda500b2980 legacy=0x7fda500cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda5619c700 1 -- 172.21.15.12:0/803543360 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500cd510 con 0x7fda5006ddd0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda5619c700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5006ddd0 0x7fda500cf0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda48009e60 tx=0x7fda48009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cade0f4e4608b720 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda54999700 1 -- 172.21.15.12:0/803543360 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800e070 con 0x7fda5006ddd0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda54999700 1 -- 172.21.15.12:0/803543360 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4800bab0 con 0x7fda5006ddd0 2023-10-08T16:09:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.908+0000 7fda54999700 1 -- 172.21.15.12:0/803543360 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4800be70 con 0x7fda5006ddd0 2023-10-08T16:09:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 -- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5006ddd0 msgr2=0x7fda500cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5006ddd0 0x7fda500cf0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda48009e60 tx=0x7fda48009780 comp rx=0 tx=0).stop 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 -- 172.21.15.12:0/803543360 shutdown_connections 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5006ddd0 0x7fda500cf0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 --2- 172.21.15.12:0/803543360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda5015a8c0 0x7fda5006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 -- 172.21.15.12:0/803543360 >> 172.21.15.12:0/803543360 conn(0x7fda500703a0 msgr2=0x7fda500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 -- 172.21.15.12:0/803543360 shutdown_connections 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.909+0000 7fda5699d700 1 -- 172.21.15.12:0/803543360 wait complete. 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.910+0000 7fda5699d700 1 Processor -- start 2023-10-08T16:09:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.910+0000 7fda5699d700 1 -- start start 2023-10-08T16:09:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda500b2980 0x7fda5015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5015a8c0 0x7fda5015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500c79b0 con 0x7fda5006ddd0 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5015e1b0 con 0x7fda5015a8c0 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.911+0000 7fda5699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5015e490 con 0x7fda500b2980 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58256/0 (socket says 172.21.15.12:58256) 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 -- 172.21.15.12:0/1265621294 learned_addr learned my addr 172.21.15.12:0/1265621294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5519a700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda500b2980 0x7fda5015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5619c700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5015a8c0 0x7fda5015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 -- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda500b2980 msgr2=0x7fda5015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda500b2980 0x7fda5015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 -- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5015a8c0 msgr2=0x7fda5015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5015a8c0 0x7fda5015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 -- 172.21.15.12:0/1265621294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda48009a20 con 0x7fda5006ddd0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda5599b700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0011e0 tx=0x7fda4c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005b30 con 0x7fda5006ddd0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.912+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c005c90 con 0x7fda5006ddd0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.913+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5015e770 con 0x7fda5006ddd0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.913+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c0072e0 con 0x7fda5006ddd0 2023-10-08T16:09:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.913+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5014e4b0 con 0x7fda5006ddd0 2023-10-08T16:09:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.914+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5004c3c0 con 0x7fda5006ddd0 2023-10-08T16:09:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.914+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda4c007650 con 0x7fda5006ddd0 2023-10-08T16:09:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.915+0000 7fda45ffb700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.915+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda4c0839f0 con 0x7fda5006ddd0 2023-10-08T16:09:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.916+0000 7fda5519a700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.916+0000 7fda5519a700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda5016c6c0 tx=0x7fda40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:30.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:30.920+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda4c04b5a0 con 0x7fda5006ddd0 2023-10-08T16:09:31.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.176+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fda500ce470 con 0x7fda5006ddd0 2023-10-08T16:09:31.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.179+0000 7fda45ffb700 1 -- 172.21.15.12:0/1265621294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163702 (secure 0 0 0) 0x7fda4c048f90 con 0x7fda5006ddd0 2023-10-08T16:09:31.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:31.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 msgr2=0x7fda340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 0x7fda340693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fda5016c6c0 tx=0x7fda40008040 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 msgr2=0x7fda5014df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0011e0 tx=0x7fda4c007df0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 shutdown_connections 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda34066f30 0x7fda340693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda5006ddd0 0x7fda5014df70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda5015a8c0 0x7fda5015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 --2- 172.21.15.12:0/1265621294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda500b2980 0x7fda5015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 >> 172.21.15.12:0/1265621294 conn(0x7fda500703a0 msgr2=0x7fda500cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:31.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 shutdown_connections 2023-10-08T16:09:31.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.182+0000 7fda5699d700 1 -- 172.21.15.12:0/1265621294 wait complete. 2023-10-08T16:09:31.201 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":115415},{"type":"v1","addr":"172.21.15.12:6833","nonce":115415}]},"active_addr":"172.21.15.12:6833/115415","active_change":"2023-10-08T16:09:03.899696+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3105973545}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3799372723}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1489576806}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2568382938}]}]} 2023-10-08T16:09:31.204 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-08T16:09:31.204 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-08T16:09:31.204 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.389+0000 7fefbe79d700 1 Processor -- start 2023-10-08T16:09:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.389+0000 7fefbe79d700 1 -- start start 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbe79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbe79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 0x7fefb80aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbe79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb80c6d50 con 0x7fefb8140e40 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbe79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb80c7030 con 0x7fefb806de50 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbe79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80c7310 con 0x7fefb8140a70 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbdf9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 0x7fefb80aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbcf9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fefb8140e40 0x7fefb80c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:39678/0 (socket says 172.21.15.12:39678) 2023-10-08T16:09:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:55782/0 (socket says 172.21.15.12:55782) 2023-10-08T16:09:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.391+0000 7fefbcf9a700 1 -- 172.21.15.12:0/3850878485 learned_addr learned my addr 172.21.15.12:0/3850878485 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbd79b700 1 -- 172.21.15.12:0/3850878485 >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 msgr2=0x7fefb80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbd79b700 1 --2- 172.21.15.12:0/3850878485 >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 0x7fefb80aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbd79b700 1 -- 172.21.15.12:0/3850878485 >> v1:172.21.15.29:6789/0 conn(0x7fefb8140e40 legacy=0x7fefb80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbd79b700 1 -- 172.21.15.12:0/3850878485 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80c75f0 con 0x7fefb8140a70 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbdf9c700 1 --2- 172.21.15.12:0/3850878485 >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 0x7fefb80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefbd79b700 1 --2- 172.21.15.12:0/3850878485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098e0 tx=0x7fefb40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e9a50ddafff1658 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefaffff700 1 -- 172.21.15.12:0/3850878485 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400b640 con 0x7fefb8140a70 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefaffff700 1 -- 172.21.15.12:0/3850878485 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb400b7a0 con 0x7fefb8140a70 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.392+0000 7fefaffff700 1 -- 172.21.15.12:0/3850878485 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb400bb40 con 0x7fefb8140a70 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 -- 172.21.15.12:0/3850878485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 msgr2=0x7fefb80c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 --2- 172.21.15.12:0/3850878485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fefb40098e0 tx=0x7fefb40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 -- 172.21.15.12:0/3850878485 shutdown_connections 2023-10-08T16:09:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 --2- 172.21.15.12:0/3850878485 >> v2:172.21.15.12:3300/0 conn(0x7fefb806de50 0x7fefb80aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 --2- 172.21.15.12:0/3850878485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80c6770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 -- 172.21.15.12:0/3850878485 >> 172.21.15.12:0/3850878485 conn(0x7fefb806d170 msgr2=0x7fefb80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 -- 172.21.15.12:0/3850878485 shutdown_connections 2023-10-08T16:09:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.393+0000 7fefbe79d700 1 -- 172.21.15.12:0/3850878485 wait complete. 2023-10-08T16:09:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.394+0000 7fefbe79d700 1 Processor -- start 2023-10-08T16:09:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.394+0000 7fefbe79d700 1 -- start start 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 0x7fefb813aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8158290 con 0x7fefb806de50 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8157ca0 con 0x7fefb8140e40 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.395+0000 7fefbe79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb81584e0 con 0x7fefb8140a70 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58266/0 (socket says 172.21.15.12:58266) 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 -- 172.21.15.12:0/1747776637 learned_addr learned my addr 172.21.15.12:0/1747776637 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbcf9a700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbdf9c700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 0x7fefb813aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 -- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 msgr2=0x7fefb80b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 -- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 msgr2=0x7fefb813aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 0x7fefb813aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 -- 172.21.15.12:0/1747776637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb0009a20 con 0x7fefb806de50 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbcf9a700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbdf9c700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 0x7fefb813aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefbd79b700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefb80c7450 tx=0x7fefb4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb401bda0 con 0x7fefb806de50 2023-10-08T16:09:31.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.396+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb4011420 con 0x7fefb806de50 2023-10-08T16:09:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.397+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb4009420 con 0x7fefb806de50 2023-10-08T16:09:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.397+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb40117e0 con 0x7fefb806de50 2023-10-08T16:09:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.397+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81578e0 con 0x7fefb806de50 2023-10-08T16:09:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.398+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb804c3c0 con 0x7fefb806de50 2023-10-08T16:09:31.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.398+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefb4011b90 con 0x7fefb806de50 2023-10-08T16:09:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.399+0000 7fefad7fa700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.399+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefb4085cf0 con 0x7fefb806de50 2023-10-08T16:09:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.400+0000 7fefbcf9a700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.400+0000 7fefbcf9a700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 0x7fef9c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefa8007fd0 tx=0x7fefa8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.404+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefb4052ec0 con 0x7fefb806de50 2023-10-08T16:09:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.607+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefb80c78d0 con 0x7fefb806de50 2023-10-08T16:09:31.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.608+0000 7fefad7fa700 1 -- 172.21.15.12:0/1747776637 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fefb40564e0 con 0x7fefb806de50 2023-10-08T16:09:31.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:31.609 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 msgr2=0x7fef9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 0x7fef9c0693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefa8007fd0 tx=0x7fefa8009040 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 msgr2=0x7fefb80c5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fefb80c7450 tx=0x7fefb4017000 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 shutdown_connections 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fef9c066f30 0x7fef9c0693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefb806de50 0x7fefb80c5d30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefb8140e40 0x7fefb813aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 --2- 172.21.15.12:0/1747776637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefb8140a70 0x7fefb80b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 >> 172.21.15.12:0/1747776637 conn(0x7fefb806d170 msgr2=0x7fefb8069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 shutdown_connections 2023-10-08T16:09:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.611+0000 7fefbe79d700 1 -- 172.21.15.12:0/1747776637 wait complete. 2023-10-08T16:09:31.629 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-08T16:09:31.629 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.814+0000 7ffb8159d700 1 Processor -- start 2023-10-08T16:09:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.814+0000 7ffb8159d700 1 -- start start 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c153c30 0x7ffb7c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb7c15de50 0x7ffb7c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb7c0cef40 0x7ffb7c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c15afd0 con 0x7ffb7c15de50 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb7c15b2b0 con 0x7ffb7c0cef40 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb8159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c15b590 con 0x7ffb7c153c30 2023-10-08T16:09:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb7b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb7c15de50 0x7ffb7c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb7b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb7c15de50 0x7ffb7c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58268/0 (socket says 172.21.15.12:58268) 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/1306382105 learned_addr learned my addr 172.21.15.12:0/1306382105 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb80d9c700 1 --2- 172.21.15.12:0/1306382105 >> v2:172.21.15.29:3300/0 conn(0x7ffb7c0cef40 0x7ffb7c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.815+0000 7ffb7bfff700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c153c30 0x7ffb7c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/1306382105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c153c30 msgr2=0x7ffb7c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c153c30 0x7ffb7c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/1306382105 >> v2:172.21.15.29:3300/0 conn(0x7ffb7c0cef40 msgr2=0x7ffb7c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/1306382105 >> v2:172.21.15.29:3300/0 conn(0x7ffb7c0cef40 0x7ffb7c06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/1306382105 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c15b870 con 0x7ffb7c15de50 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0cea00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c071370 tx=0x7ffb70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac213d7ac42b88b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7affd700 1 -- 172.21.15.12:0/1306382105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000b640 con 0x7ffb7c15de50 2023-10-08T16:09:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7affd700 1 -- 172.21.15.12:0/1306382105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000b7a0 con 0x7ffb7c15de50 2023-10-08T16:09:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.816+0000 7ffb7affd700 1 -- 172.21.15.12:0/1306382105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7000bb60 con 0x7ffb7c15de50 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 -- 172.21.15.12:0/1306382105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c15de50 msgr2=0x7ffb7c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0cea00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c071370 tx=0x7ffb70009250 comp rx=0 tx=0).stop 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 -- 172.21.15.12:0/1306382105 shutdown_connections 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 --2- 172.21.15.12:0/1306382105 >> v2:172.21.15.29:3300/0 conn(0x7ffb7c0cef40 0x7ffb7c06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c153c30 0x7ffb7c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 --2- 172.21.15.12:0/1306382105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0cea00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 -- 172.21.15.12:0/1306382105 >> 172.21.15.12:0/1306382105 conn(0x7ffb7c0703a0 msgr2=0x7ffb7c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 -- 172.21.15.12:0/1306382105 shutdown_connections 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.817+0000 7ffb8159d700 1 -- 172.21.15.12:0/1306382105 wait complete. 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.818+0000 7ffb8159d700 1 Processor -- start 2023-10-08T16:09:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.819+0000 7ffb8159d700 1 -- start start 2023-10-08T16:09:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c0cef40 0x7ffb7c13e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0ccb90 con 0x7ffb7c153c30 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0c8800 con 0x7ffb7c15de50 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb8159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7c0cc5d0 con 0x7ffb7c0cef40 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58270/0 (socket says 172.21.15.12:58270) 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/3918553779 learned_addr learned my addr 172.21.15.12:0/3918553779 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7bfff700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c0cef40 0x7ffb7c13e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb80d9c700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c0cef40 msgr2=0x7ffb7c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c0cef40 0x7ffb7c13e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 msgr2=0x7ffb7c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 -- 172.21.15.12:0/3918553779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb700094f0 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb80d9c700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.820+0000 7ffb7b7fe700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c06eb00 tx=0x7ffb70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.821+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70000d10 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.821+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7000bb20 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.821+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7001a6a0 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.821+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7c0cc8b0 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.821+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7c151f50 con 0x7ffb7c153c30 2023-10-08T16:09:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.822+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7c0c8970 con 0x7ffb7c153c30 2023-10-08T16:09:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.823+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb7001aa90 con 0x7ffb7c153c30 2023-10-08T16:09:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.823+0000 7ffb63fff700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.823+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffb70085e70 con 0x7ffb7c153c30 2023-10-08T16:09:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.824+0000 7ffb7bfff700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.824+0000 7ffb7bfff700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 0x7ffb680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d40 tx=0x7ffb6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:31.828+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb70053040 con 0x7ffb7c153c30 2023-10-08T16:09:32.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.033+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb7c04c3c0 con 0x7ffb7c153c30 2023-10-08T16:09:32.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.034+0000 7ffb63fff700 1 -- 172.21.15.12:0/3918553779 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ffb70056660 con 0x7ffb7c153c30 2023-10-08T16:09:32.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:32.038 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 msgr2=0x7ffb680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 0x7ffb680693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c009d40 tx=0x7ffb6c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 msgr2=0x7ffb7c0cbb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c06eb00 tx=0x7ffb70017000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 shutdown_connections 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb7c15de50 0x7ffb7c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb7c0cef40 0x7ffb7c13e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ffb68066f30 0x7ffb680693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 --2- 172.21.15.12:0/3918553779 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb7c153c30 0x7ffb7c0cbb40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 >> 172.21.15.12:0/3918553779 conn(0x7ffb7c0703a0 msgr2=0x7ffb7c0c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 shutdown_connections 2023-10-08T16:09:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.036+0000 7ffb8159d700 1 -- 172.21.15.12:0/3918553779 wait complete. 2023-10-08T16:09:32.055 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-08T16:09:32.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-08T16:09:32.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-08T16:09:32.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-08T16:09:32.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-08T16:09:32.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-08T16:09:32.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-08T16:09:32.071 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-08T16:09:32.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.403+0000 7f16ae3ff700 1 Processor -- start 2023-10-08T16:09:32.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.403+0000 7f7fe979d700 1 Processor -- start 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.404+0000 7f7fe979d700 1 -- start start 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f7fe979d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7fe415de50 0x7f7fe40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f7fe979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe40cef40 0x7f7fe415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f7fe979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe40cf3c0 con 0x7f7fe4153c30 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f7fe979d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe415afd0 con 0x7f7fe415de50 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.404+0000 7f16ae3ff700 1 -- start start 2023-10-08T16:09:32.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a80cb5a0 0x7f16a80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16a80cd9e0 0x7f16a8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f16a80cde50 0x7f16a815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a80d13f0 con 0x7f16a80cde50 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16a815a940 con 0x7f16a80cd9e0 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16ae3ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a815ae40 con 0x7f16a80cb5a0 2023-10-08T16:09:32.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f7fe979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe415b2b0 con 0x7f7fe40cef40 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16a77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16a80cd9e0 0x7f16a8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16a77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16a80cd9e0 0x7f16a8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46826/0 (socket says 172.21.15.12:46826) 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.406+0000 7f16a77fe700 1 -- 172.21.15.12:0/3571545064 learned_addr learned my addr 172.21.15.12:0/3571545064 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a7fff700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a80cb5a0 0x7f16a80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a77fe700 1 -- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a80cb5a0 msgr2=0x7f16a80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a80cb5a0 0x7f16a80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7fc8affff700 1 Processor -- start 2023-10-08T16:09:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a77fe700 1 -- 172.21.15.12:0/3571545064 >> v2:172.21.15.12:3300/0 conn(0x7f16a80cde50 msgr2=0x7f16a815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16ac99c700 1 --2- 172.21.15.12:0/3571545064 >> v2:172.21.15.12:3300/0 conn(0x7f16a80cde50 0x7f16a815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3571545064 >> v2:172.21.15.12:3300/0 conn(0x7f16a80cde50 0x7f16a815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f16a77fe700 1 -- 172.21.15.12:0/3571545064 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a815ab60 con 0x7f16a80cd9e0 2023-10-08T16:09:32.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8159ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f16a806ea90 tx=0x7f1698009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1bb28f0a610b11c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7fc8affff700 1 -- start start 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f16a6ffd700 1 -- 172.21.15.12:0/3571545064 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800b860 con 0x7f16a80cd9e0 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f16a6ffd700 1 -- 172.21.15.12:0/3571545064 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169800b9c0 con 0x7f16a80cd9e0 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f16a6ffd700 1 -- 172.21.15.12:0/3571545064 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169800bd60 con 0x7f16a80cd9e0 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 msgr2=0x7f16a8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f16ae3ff700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8159ec0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f16a806ea90 tx=0x7f1698009250 comp rx=0 tx=0).stop 2023-10-08T16:09:32.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7fc8affff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8a80e20d0 0x7fc8a8006080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3571545064 shutdown_connections 2023-10-08T16:09:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f16ae3ff700 1 --2- 172.21.15.12:0/3571545064 >> v2:172.21.15.12:3300/0 conn(0x7f16a80cde50 0x7f16a815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f16ae3ff700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a80cb5a0 0x7f16a80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f16ae3ff700 1 --2- 172.21.15.12:0/3571545064 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8159ec0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7fc8affff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8a80e24a0 0x7fc8a80065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7fc8affff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a80399d0 con 0x7fc8a8038be0 2023-10-08T16:09:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7fc8affff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a8007870 con 0x7fc8a80e20d0 2023-10-08T16:09:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7fc8affff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a8006bf0 con 0x7fc8a80e24a0 2023-10-08T16:09:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3571545064 >> 172.21.15.12:0/3571545064 conn(0x7f16a8070e30 msgr2=0x7f16a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7fc8af7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc8a8038be0 0x7fc8a80e5ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46902/0 (socket says 172.21.15.12:46902) 2023-10-08T16:09:32.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7fc8af7fe700 1 -- 172.21.15.12:0/765596525 learned_addr learned my addr 172.21.15.12:0/765596525 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:32.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7fc8aeffd700 1 --2- 172.21.15.12:0/765596525 >> v2:172.21.15.12:3300/0 conn(0x7fc8a80e20d0 0x7fc8a8006080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7fc8ae7fc700 1 --2- 172.21.15.12:0/765596525 >> v2:172.21.15.29:3300/0 conn(0x7fc8a80e24a0 0x7fc8a80065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3571545064 shutdown_connections 2023-10-08T16:09:32.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7fc8adffb700 1 -- 172.21.15.12:0/765596525 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473073553 0 0) 0x7fc8a80399d0 con 0x7fc8a8038be0 2023-10-08T16:09:32.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3571545064 wait complete. 2023-10-08T16:09:32.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7fc8adffb700 1 -- 172.21.15.12:0/765596525 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc898003570 con 0x7fc8a8038be0 2023-10-08T16:09:32.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7fc8ae7fc700 1 -- 172.21.15.12:0/765596525 >> v2:172.21.15.12:3300/0 conn(0x7fc8a80e20d0 msgr2=0x7fc8a8006080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f7fe3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7fe4153c30 0x7f7fe415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46894/0 (socket says 172.21.15.12:46894) 2023-10-08T16:09:32.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.407+0000 7f7fe3fff700 1 -- 172.21.15.12:0/734137839 learned_addr learned my addr 172.21.15.12:0/734137839 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/734137839 >> v2:172.21.15.29:3300/0 conn(0x7f7fe415de50 0x7f7fe40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.408+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516653884 0 0) 0x7f7fe40cf3c0 con 0x7f7fe4153c30 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fcc003570 con 0x7f7fe4153c30 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe40cef40 0x7f7fe415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3107461224 0 0) 0x7f7fcc003570 con 0x7f7fe4153c30 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe40cef40 msgr2=0x7f7fe415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe40cef40 0x7f7fe415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 >> v2:172.21.15.29:3300/0 conn(0x7f7fe415de50 msgr2=0x7f7fe40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 --2- 172.21.15.12:0/734137839 >> v2:172.21.15.29:3300/0 conn(0x7f7fe415de50 0x7f7fe40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe415b590 con 0x7f7fe4153c30 2023-10-08T16:09:32.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f7fd4001470 con 0x7f7fe4153c30 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 >> v1:172.21.15.12:6789/0 conn(0x7f7fe4153c30 legacy=0x7f7fe415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc003ae0 0x7f7fcc003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fcc004810 0x7f7fcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc01ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.409+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe415afd0 con 0x7f7fcc0051c0 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe415b2b0 con 0x7f7fcc003ae0 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.410+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fcc01d0e0 con 0x7f7fcc004810 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.411+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc01ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.412+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fcc004810 0x7f7fcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.412+0000 7fc8ae7fc700 1 --2- 172.21.15.12:0/765596525 >> v2:172.21.15.12:3300/0 conn(0x7fc8a80e20d0 0x7fc8a8006080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.412+0000 7fc8ae7fc700 1 -- 172.21.15.12:0/765596525 >> v1:172.21.15.12:6789/0 conn(0x7fc8a8038be0 legacy=0x7fc8a80e5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.412+0000 7fc8ae7fc700 1 -- 172.21.15.12:0/765596525 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a8006ed0 con 0x7fc8a80e24a0 2023-10-08T16:09:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe3fff700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc003ae0 0x7f7fcc003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7fc8ae7fc700 1 --2- 172.21.15.12:0/765596525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e24a0 0x7fc8a80065c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8a804c850 tx=0x7fc8a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3e74fbebec1799 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe37fe700 1 -- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc003ae0 msgr2=0x7f7fcc003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fcc003ae0 0x7f7fcc003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe37fe700 1 -- 172.21.15.12:0/734137839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fcc0051c0 msgr2=0x7f7fcc01ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fcc0051c0 0x7f7fcc01ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7f7fe37fe700 1 -- 172.21.15.12:0/734137839 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe415b590 con 0x7f7fcc004810 2023-10-08T16:09:32.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7ff07ddff700 1 Processor -- start 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7ff07ddff700 1 -- start start 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7fc8adffb700 1 -- 172.21.15.12:0/765596525 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4011630 con 0x7fc8a80e24a0 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7fc8adffb700 1 -- 172.21.15.12:0/765596525 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4011790 con 0x7fc8a80e24a0 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.413+0000 7fc8adffb700 1 -- 172.21.15.12:0/765596525 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4011b50 con 0x7fc8a80e24a0 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7f16ae3ff700 1 Processor -- start 2023-10-08T16:09:32.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7f16ae3ff700 1 -- start start 2023-10-08T16:09:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fcc004810 0x7f7fcc004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc007470 tx=0x7f7fdc009710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aedcfbfba0f13d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc009a40 con 0x7f7fcc004810 2023-10-08T16:09:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7fc8affff700 1 -- 172.21.15.12:0/765596525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e24a0 msgr2=0x7fc8a80065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.414+0000 7fc8affff700 1 --2- 172.21.15.12:0/765596525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e24a0 0x7fc8a80065c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8a804c850 tx=0x7fc8a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc007d20 con 0x7f7fcc004810 2023-10-08T16:09:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7fc8affff700 1 -- 172.21.15.12:0/765596525 shutdown_connections 2023-10-08T16:09:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7fc8affff700 1 --2- 172.21.15.12:0/765596525 >> v2:172.21.15.12:3300/0 conn(0x7fc8a80e20d0 0x7fc8a8006080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7fc8affff700 1 --2- 172.21.15.12:0/765596525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e24a0 0x7fc8a80065c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7fc8affff700 1 -- 172.21.15.12:0/765596525 >> 172.21.15.12:0/765596525 conn(0x7fc8a800efe0 msgr2=0x7fc8a8059000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f7fe979d700 1 -- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fcc004810 msgr2=0x7f7fcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7f16ae3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a80cb5a0 0x7f16a81564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7f16ae3ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16ae3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a8176280 0x7f16a80c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16ae3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8159560 con 0x7f16a80cb5a0 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16ae3ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81590d0 con 0x7f16a80cd9e0 2023-10-08T16:09:32.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16ae3ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81584c0 con 0x7f16a8176280 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7ff07ddff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0781595f0 0x7ff0780cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.415+0000 7ff07ddff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff0780cee70 0x7ff07806d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0781595f0 0x7ff0780cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff07ddff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0780cc770 con 0x7ff0780cf2c0 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff07ddff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780cbb60 con 0x7ff0780cee70 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff07ddff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0780cbe40 con 0x7ff0781595f0 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0781595f0 0x7ff0780cb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46840/0 (socket says 172.21.15.12:46840) 2023-10-08T16:09:32.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 -- 172.21.15.12:0/2947599302 learned_addr learned my addr 172.21.15.12:0/2947599302 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16a77fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46850/0 (socket says 172.21.15.12:46850) 2023-10-08T16:09:32.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16a77fe700 1 -- 172.21.15.12:0/3855547658 learned_addr learned my addr 172.21.15.12:0/3855547658 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 -- 172.21.15.12:0/2947599302 >> v2:172.21.15.12:3300/0 conn(0x7ff0780cee70 msgr2=0x7ff07806d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 --2- 172.21.15.12:0/2947599302 >> v2:172.21.15.12:3300/0 conn(0x7ff0780cee70 0x7ff07806d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7ff0777fe700 1 -- 172.21.15.12:0/2947599302 >> v1:172.21.15.12:6789/0 conn(0x7ff0780cf2c0 legacy=0x7ff0780b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f7fe2ffd700 1 -- 172.21.15.12:0/734137839 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc009a40 con 0x7f7fcc004810 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f7fe979d700 1 --2- 172.21.15.12:0/734137839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fcc004810 0x7f7fcc004c80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc007470 tx=0x7f7fdc009710 comp rx=0 tx=0).stop 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f7fe8f9c700 1 -- 172.21.15.12:0/734137839 reap_dead start 2023-10-08T16:09:32.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f7fe979d700 1 -- 172.21.15.12:0/734137839 shutdown_connections 2023-10-08T16:09:32.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f7fe979d700 1 -- 172.21.15.12:0/734137839 >> 172.21.15.12:0/734137839 conn(0x7f7fe40703a0 msgr2=0x7f7fe40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7ff0777fe700 1 -- 172.21.15.12:0/2947599302 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0780cc120 con 0x7ff0781595f0 2023-10-08T16:09:32.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f7fe979d700 1 -- 172.21.15.12:0/734137839 shutdown_connections 2023-10-08T16:09:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16ac99c700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a8176280 0x7f16a80c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.416+0000 7f16a7fff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a80cb5a0 0x7f16a81564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a7fff700 1 -- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a8176280 msgr2=0x7f16a80c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7fc8affff700 1 -- 172.21.15.12:0/765596525 shutdown_connections 2023-10-08T16:09:32.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7ff0777fe700 1 --2- 172.21.15.12:0/2947599302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0781595f0 0x7ff0780cb560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff07806cd10 tx=0x7ff068009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301a42f7d7dcf854 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f7fe979d700 1 -- 172.21.15.12:0/734137839 wait complete. 2023-10-08T16:09:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a7fff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16a8176280 0x7f16a80c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a7fff700 1 -- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 msgr2=0x7f16a8157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a7fff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a7fff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980094f0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.417+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16a80cd9e0 0x7f16a8157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:32.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.418+0000 7fc8affff700 1 -- 172.21.15.12:0/765596525 wait complete. 2023-10-08T16:09:32.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.418+0000 7f16a7fff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a80cb5a0 0x7f16a81564c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d8c0 tx=0x7f169c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.419+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00b5d0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.419+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00b730 con 0x7f16a80cb5a0 2023-10-08T16:09:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.419+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00bad0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.419+0000 7f7fe979d700 1 Processor -- start 2023-10-08T16:09:32.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.420+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a81587a0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.420+0000 7f7fe979d700 1 -- start start 2023-10-08T16:09:32.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.420+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8158d60 con 0x7f16a80cb5a0 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.420+0000 7fc8affff700 1 Processor -- start 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.420+0000 7fc8affff700 1 -- start start 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.421+0000 7fc8affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 0x7fc8a80d3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.421+0000 7ff0767fc700 1 -- 172.21.15.12:0/2947599302 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800b820 con 0x7ff0781595f0 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.421+0000 7ff0767fc700 1 -- 172.21.15.12:0/2947599302 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06800b980 con 0x7ff0781595f0 2023-10-08T16:09:32.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 -- 172.21.15.12:0/2947599302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0781595f0 msgr2=0x7ff0780cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff0767fc700 1 -- 172.21.15.12:0/2947599302 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06800b820 con 0x7ff0781595f0 2023-10-08T16:09:32.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 --2- 172.21.15.12:0/2947599302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0781595f0 0x7ff0780cb560 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff07806cd10 tx=0x7ff068009250 comp rx=0 tx=0).stop 2023-10-08T16:09:32.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7fc8affff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e20d0 0x7fc8a8050010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7f7fe979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe414b3c0 0x7f7fe414ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7fc8affff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8a80e24a0 0x7fc8a8050550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7fc8affff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a804f200 con 0x7fc8a8038be0 2023-10-08T16:09:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7fc8affff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80d1ae0 con 0x7fc8a80e20d0 2023-10-08T16:09:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7fc8affff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a804ee90 con 0x7fc8a80e24a0 2023-10-08T16:09:32.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 -- 172.21.15.12:0/2947599302 shutdown_connections 2023-10-08T16:09:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 --2- 172.21.15.12:0/2947599302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0781595f0 0x7ff0780cb560 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 --2- 172.21.15.12:0/2947599302 >> v2:172.21.15.12:3300/0 conn(0x7ff0780cee70 0x7ff07806d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7ff07ddff700 1 -- 172.21.15.12:0/2947599302 >> 172.21.15.12:0/2947599302 conn(0x7ff078070e70 msgr2=0x7ff0780d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7f7fe979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe414d1c0 0x7f7fe414de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 0x7fc8a80d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 0x7fc8a80d3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39976/0 (socket says 172.21.15.12:39976) 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 -- 172.21.15.12:0/3505475581 learned_addr learned my addr 172.21.15.12:0/3505475581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe414e350 0x7f7fe40cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 -- 172.21.15.12:0/3505475581 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8a80e24a0 msgr2=0x7fc8a8050550 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8a80e24a0 0x7fc8a8050550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7fc8aeffd700 1 -- 172.21.15.12:0/3505475581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e20d0 msgr2=0x7fc8a8050010 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:09:32.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe414e7c0 con 0x7f7fe414e350 2023-10-08T16:09:32.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.424+0000 7fc8aeffd700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8a80e20d0 0x7fc8a8050010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.424+0000 7fc8aeffd700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a4009420 con 0x7fc8a8038be0 2023-10-08T16:09:32.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe40b41c0 con 0x7f7fe414d1c0 2023-10-08T16:09:32.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe414c2b0 con 0x7f7fe414b3c0 2023-10-08T16:09:32.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.422+0000 7f7fe3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe414b3c0 0x7f7fe414ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.424+0000 7fc8aeffd700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 0x7fc8a80d3140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000edb0 tx=0x7fc8a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe414b3c0 0x7f7fe414ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49932/0 (socket says 172.21.15.12:49932) 2023-10-08T16:09:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe3fff700 1 -- 172.21.15.12:0/1326189505 learned_addr learned my addr 172.21.15.12:0/1326189505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.423+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe414e350 0x7f7fe40cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0009690 con 0x7fc8a8038be0 2023-10-08T16:09:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f7fe8f9c700 1 -- 172.21.15.12:0/1326189505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe414b3c0 msgr2=0x7f7fe414ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7fe414b3c0 0x7f7fe414ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a000c9d0 con 0x7fc8a8038be0 2023-10-08T16:09:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a804f690 con 0x7fc8a8038be0 2023-10-08T16:09:32.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a80d3840 con 0x7fc8a8038be0 2023-10-08T16:09:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f7fe8f9c700 1 -- 172.21.15.12:0/1326189505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe414d1c0 msgr2=0x7f7fe414de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a000cd90 con 0x7fc8a8038be0 2023-10-08T16:09:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7fe414d1c0 0x7f7fe414de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f7fe8f9c700 1 -- 172.21.15.12:0/1326189505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe414c590 con 0x7f7fe414e350 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7ff07ddff700 1 -- 172.21.15.12:0/2947599302 shutdown_connections 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7f7fe8f9c700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe414e350 0x7f7fe40cb110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7fe415e220 tx=0x7f7fd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd800fed0 con 0x7f7fe414e350 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe414c870 con 0x7f7fe414e350 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe414b790 con 0x7f7fe414e350 2023-10-08T16:09:32.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.426+0000 7ff07ddff700 1 -- 172.21.15.12:0/2947599302 wait complete. 2023-10-08T16:09:32.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc890000fd0 con 0x7fc8a8038be0 2023-10-08T16:09:32.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.427+0000 7f80e639d700 1 Processor -- start 2023-10-08T16:09:32.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.427+0000 7f80e639d700 1 -- start start 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd800c040 con 0x7f7fe414e350 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011320 con 0x7f7fe414e350 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8a0013680 con 0x7fc8a8038be0 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f169c01e460 con 0x7f16a80cb5a0 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.425+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16a804c3c0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f168ffff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1694067000 0x7f16940694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f169c084ac0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f168ffff700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f169406f190 0x7f16940715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.428+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1694071c50 con 0x7f169406f190 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.429+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f169c0073c0 con 0x7f16a80cb5a0 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.429+0000 7f16ac99c700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f169406f190 0x7f16940715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1694067000 0x7f16940694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7ff07ddff700 1 Processor -- start 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.429+0000 7f80e639d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f80e00c8790 0x7f80e00a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80e00a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e639d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e00ab620 con 0x7f80e0159610 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e639d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e00ab370 con 0x7f80e00c8790 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c6ca0 con 0x7f80e00caaf0 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.429+0000 7f50517ff700 1 Processor -- start 2023-10-08T16:09:32.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f50517ff700 1 -- start start 2023-10-08T16:09:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f16a77fe700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1694067000 0x7f16940694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1698009ef0 tx=0x7f1698017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e539b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f80e0159610 0x7f80e00ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46918/0 (socket says 172.21.15.12:46918) 2023-10-08T16:09:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.430+0000 7f80e539b700 1 -- 172.21.15.12:0/1626172945 learned_addr learned my addr 172.21.15.12:0/1626172945 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f80e5b9c700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80e00a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1626172945 >> v2:172.21.15.12:3300/0 conn(0x7f80e00c8790 0x7f80e00a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7fc896ffd700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc89c067000 0x7fc89c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8a00847b0 con 0x7fc8a8038be0 2023-10-08T16:09:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7fc896ffd700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fc89c06f190 0x7fc89c0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc89c071c50 con 0x7fc89c06f190 2023-10-08T16:09:32.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fd80233f0 con 0x7f7fe414e350 2023-10-08T16:09:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f5cfe59d700 1 Processor -- start 2023-10-08T16:09:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7f5cfe59d700 1 -- start start 2023-10-08T16:09:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7fc8af7fe700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fc89c06f190 0x7fc89c0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1681772308 0 0) 0x7f80e00ab620 con 0x7f80e0159610 2023-10-08T16:09:32.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80cc003570 con 0x7f80e0159610 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f50517ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f504c0b0910 0x7f504c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f50517ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f50517ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c157510 con 0x7f504c155b70 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f50517ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c0ae2f0 con 0x7f504c0b0910 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f50517ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c0ae5d0 con 0x7f504c156f50 2023-10-08T16:09:32.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7f7fcbfff700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7fd0067080 0x7f7fd0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7fd8084100 con 0x7f7fe414e350 2023-10-08T16:09:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f504b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7fc8af7fe700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fc89c06f190 0x7fc89c0715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f504b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49968/0 (socket says 172.21.15.12:49968) 2023-10-08T16:09:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f504b7fe700 1 -- 172.21.15.12:0/2454005225 learned_addr learned my addr 172.21.15.12:0/2454005225 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f7fe979d700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f7fc40015f0 0x7f7fc4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.431+0000 7ff07ddff700 1 -- start start 2023-10-08T16:09:32.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654371355 0 0) 0x7f80cc003570 con 0x7f80e0159610 2023-10-08T16:09:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 0x7ff0780c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0780cf2c0 0x7ff0780b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0781595f0 0x7ff078146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 msgr2=0x7f80e00a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f504a7fc700 1 --2- 172.21.15.12:0/2454005225 >> v2:172.21.15.12:3300/0 conn(0x7f504c0b0910 0x7f504c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07814bd40 con 0x7ff0781595f0 2023-10-08T16:09:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07814c020 con 0x7ff0780cf2c0 2023-10-08T16:09:32.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.432+0000 7ff07ddff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780c9600 con 0x7ff0780cee70 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80e00a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 >> v2:172.21.15.12:3300/0 conn(0x7f80e00c8790 msgr2=0x7f80e00a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 --2- 172.21.15.12:0/1626172945 >> v2:172.21.15.12:3300/0 conn(0x7f80e00c8790 0x7f80e00a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f504b7fe700 1 -- 172.21.15.12:0/2454005225 >> v2:172.21.15.12:3300/0 conn(0x7f504c0b0910 msgr2=0x7f504c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f504b7fe700 1 --2- 172.21.15.12:0/2454005225 >> v2:172.21.15.12:3300/0 conn(0x7f504c0b0910 0x7f504c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00c6f80 con 0x7f80e0159610 2023-10-08T16:09:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7ff0777fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 0x7ff0780c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f504b7fe700 1 -- 172.21.15.12:0/2454005225 >> v1:172.21.15.29:6789/0 conn(0x7f504c155b70 legacy=0x7f504c0b0200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:09:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f504b7fe700 1 -- 172.21.15.12:0/2454005225 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0ae8b0 con 0x7f504c156f50 2023-10-08T16:09:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f5cfe59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5cf81549e0 0x7f5cf806e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfe59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7ff0777fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 0x7ff0780c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49972/0 (socket says 172.21.15.12:49972) 2023-10-08T16:09:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f80dc0014c0 con 0x7f80e0159610 2023-10-08T16:09:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfe59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80ccf40 con 0x7f5cf815e080 2023-10-08T16:09:32.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfe59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf80ce870 con 0x7f5cf81549e0 2023-10-08T16:09:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfe59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80cb550 con 0x7f5cf80cabd0 2023-10-08T16:09:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7ff0777fe700 1 -- 172.21.15.12:0/703935 learned_addr learned my addr 172.21.15.12:0/703935 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.433+0000 7f7fe3fff700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7fd0067080 0x7f7fd0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 >> v1:172.21.15.12:6789/0 conn(0x7f80e0159610 legacy=0x7f80e00ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f504b7fe700 1 --2- 172.21.15.12:0/2454005225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f503400bc40 tx=0x7f503400b4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7116aa2149d25ec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7ff077fff700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0781595f0 0x7ff078146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== osd.3 v2:172.21.15.12:6808/115684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc89c071c50 con 0x7fc89c06f190 2023-10-08T16:09:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f80d7fff700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80cc003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f16ac99c700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f169406f190 0x7f16940715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5049ffb700 1 -- 172.21.15.12:0/2454005225 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503400db00 con 0x7f504c156f50 2023-10-08T16:09:32.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5049ffb700 1 -- 172.21.15.12:0/2454005225 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503400dc60 con 0x7f504c156f50 2023-10-08T16:09:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f7fe3fff700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7fd0067080 0x7f7fd0069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4004890 tx=0x7f7fd4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5049ffb700 1 -- 172.21.15.12:0/2454005225 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034017410 con 0x7f504c156f50 2023-10-08T16:09:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7ff0777fe700 1 -- 172.21.15.12:0/703935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0780cf2c0 msgr2=0x7ff0780b4810 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:32.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7ff0777fe700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0780cf2c0 0x7ff0780b4810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7ff0777fe700 1 -- 172.21.15.12:0/703935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0781595f0 msgr2=0x7ff078146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7fc8ae7fc700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc89c067000 0x7fc89c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7ff0777fe700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0781595f0 0x7ff078146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7ff0777fe700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0680094f0 con 0x7ff0780cee70 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfdd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfdd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49978/0 (socket says 172.21.15.12:49978) 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/3591976222 learned_addr learned my addr 172.21.15.12:0/3591976222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/3591976222 >> v2:172.21.15.29:3300/0 conn(0x7f5cf81549e0 msgr2=0x7f5cf806e060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5cfdd9c700 1 --2- 172.21.15.12:0/3591976222 >> v2:172.21.15.29:3300/0 conn(0x7f5cf81549e0 0x7f5cf806e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/3591976222 >> v1:172.21.15.12:6789/0 conn(0x7f5cf815e080 legacy=0x7f5cf80ce160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:09:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/3591976222 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf815e8d0 con 0x7f5cf80cabd0 2023-10-08T16:09:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f5cfdd9c700 1 --2- 172.21.15.12:0/3591976222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80099b0 tx=0x7f5ce8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cee9f88689d20f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.435+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f7fc40015f0 0x7f7fc4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7fb63f59d700 1 Processor -- start 2023-10-08T16:09:32.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.434+0000 7fb63f59d700 1 -- start start 2023-10-08T16:09:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f5ceffff700 1 -- 172.21.15.12:0/3591976222 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800b820 con 0x7f5cf80cabd0 2023-10-08T16:09:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a0051ac0 con 0x7fc8a8038be0 2023-10-08T16:09:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 -- 172.21.15.12:0/2454005225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 msgr2=0x7f504c157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 --2- 172.21.15.12:0/2454005225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f503400bc40 tx=0x7f503400b4e0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f80d7fff700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc0040b0 0x7f80cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f5ceffff700 1 -- 172.21.15.12:0/3591976222 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800b980 con 0x7f5cf80cabd0 2023-10-08T16:09:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== osd.1 v2:172.21.15.12:6814/115687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f1694071c50 con 0x7f169406f190 2023-10-08T16:09:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f5ceffff700 1 -- 172.21.15.12:0/3591976222 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800bd40 con 0x7f5cf80cabd0 2023-10-08T16:09:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f80d7fff700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80cc004d50 0x7f80cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 --> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fc4006b90 con 0x7f7fc40015f0 2023-10-08T16:09:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f80e539b700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80cc003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00ab370 con 0x7f80cc0040b0 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7ff0777fe700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 0x7ff0780c7620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0680090b0 tx=0x7ff068016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 -- 172.21.15.12:0/2454005225 shutdown_connections 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 --2- 172.21.15.12:0/2454005225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c156f50 0x7f504c157ee0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 --2- 172.21.15.12:0/2454005225 >> v2:172.21.15.12:3300/0 conn(0x7f504c0b0910 0x7f504c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.436+0000 7f50517ff700 1 -- 172.21.15.12:0/2454005225 >> 172.21.15.12:0/2454005225 conn(0x7f504c06d170 msgr2=0x7f504c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7fc8ae7fc700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc89c067000 0x7fc89c0694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8a804c850 tx=0x7fc8a4017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00c6ca0 con 0x7f80cc004d50 2023-10-08T16:09:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc00bb60 con 0x7f80e00caaf0 2023-10-08T16:09:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e5b9c700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80cc004d50 0x7f80cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f7fe37fe700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f7fc40015f0 0x7f7fc4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06801a650 con 0x7ff0780cee70 2023-10-08T16:09:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 -- 172.21.15.12:0/3591976222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 msgr2=0x7f5cf80cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 --2- 172.21.15.12:0/3591976222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ce80099b0 tx=0x7f5ce8009250 comp rx=0 tx=0).stop 2023-10-08T16:09:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06801f070 con 0x7ff0780cee70 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7ff07ddff700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780c98e0 con 0x7ff0780cee70 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06801a650 con 0x7ff0780cee70 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7ff07ddff700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0780c9220 con 0x7ff0780cee70 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 -- 172.21.15.12:0/3591976222 shutdown_connections 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 --2- 172.21.15.12:0/3591976222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf80cabd0 0x7f5cf80cb010 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 --2- 172.21.15.12:0/3591976222 >> v2:172.21.15.29:3300/0 conn(0x7f5cf81549e0 0x7f5cf806e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f5cfe59d700 1 -- 172.21.15.12:0/3591976222 >> 172.21.15.12:0/3591976222 conn(0x7f5cf80703a0 msgr2=0x7f5cf80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7fb63f59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb638147390 0x7fb6380cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7f50517ff700 1 -- 172.21.15.12:0/2454005225 shutdown_connections 2023-10-08T16:09:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc0040b0 0x7f80cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e539b700 1 -- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80cc004d50 msgr2=0x7f80cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e539b700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80cc004d50 0x7f80cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== osd.0 v2:172.21.15.12:6815/115685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7fc4006b90 con 0x7f7fc40015f0 2023-10-08T16:09:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff050000fd0 con 0x7ff0780cee70 2023-10-08T16:09:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e539b700 1 -- 172.21.15.12:0/1626172945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc0040b0 msgr2=0x7f80cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e539b700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc0040b0 0x7f80cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7f80e539b700 1 -- 172.21.15.12:0/1626172945 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80cc003570 con 0x7f80e00caaf0 2023-10-08T16:09:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7f50517ff700 1 -- 172.21.15.12:0/2454005225 wait complete. 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.437+0000 7fb63e59b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb638147390 0x7fb6380cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63e59b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb638147390 0x7fb6380cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40006/0 (socket says 172.21.15.12:40006) 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63e59b700 1 -- 172.21.15.12:0/3010098236 learned_addr learned my addr 172.21.15.12:0/3010098236 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63f59d700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb63806dee0 0x7fb6380c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6380cb280 con 0x7fb6380c6980 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6380ca670 con 0x7fb638147390 2023-10-08T16:09:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380ca950 con 0x7fb63806dee0 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63e59b700 1 -- 172.21.15.12:0/3010098236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb63806dee0 msgr2=0x7fb6380c9d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7fb63e59b700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb63806dee0 0x7fb6380c9d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7fb63e59b700 1 -- 172.21.15.12:0/3010098236 >> v1:172.21.15.29:6789/0 conn(0x7fb6380c6980 legacy=0x7fb638069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7fb63e59b700 1 -- 172.21.15.12:0/3010098236 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380cac30 con 0x7fb638147390 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7fb63e59b700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb638147390 0x7fb6380cb710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f70 tx=0x7fb630009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea1ccfd66ab299c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80cc0040b0 0x7f80cc004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7f80e539b700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80cc003ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00c2a0 tx=0x7f80e00c68a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa972153c5e17f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.438+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00cb70 con 0x7f80e00caaf0 2023-10-08T16:09:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7f5cfe59d700 1 -- 172.21.15.12:0/3591976222 shutdown_connections 2023-10-08T16:09:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc00ccd0 con 0x7f80e00caaf0 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.439+0000 7f80d7fff700 1 -- 172.21.15.12:0/1626172945 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc018d40 con 0x7f80e00caaf0 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e639d700 1 -- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 msgr2=0x7f80cc003ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e639d700 1 --2- 172.21.15.12:0/1626172945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00caaf0 0x7f80cc003ae0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00c2a0 tx=0x7f80e00c68a0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e5b9c700 1 -- 172.21.15.12:0/1626172945 reap_dead start 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7fb63d599700 1 -- 172.21.15.12:0/3010098236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63000e070 con 0x7fb638147390 2023-10-08T16:09:32.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7fb63d599700 1 -- 172.21.15.12:0/3010098236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63000ba90 con 0x7fb638147390 2023-10-08T16:09:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e639d700 1 -- 172.21.15.12:0/1626172945 shutdown_connections 2023-10-08T16:09:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e639d700 1 -- 172.21.15.12:0/1626172945 >> 172.21.15.12:0/1626172945 conn(0x7f80e006d130 msgr2=0x7f80e00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.440+0000 7f80e639d700 1 -- 172.21.15.12:0/1626172945 shutdown_connections 2023-10-08T16:09:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7f80e639d700 1 -- 172.21.15.12:0/1626172945 wait complete. 2023-10-08T16:09:32.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7f50517ff700 1 Processor -- start 2023-10-08T16:09:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb638147390 msgr2=0x7fb6380cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb638147390 0x7fb6380cb710 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb630009f70 tx=0x7fb630009840 comp rx=0 tx=0).stop 2023-10-08T16:09:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7f50517ff700 1 -- start start 2023-10-08T16:09:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 shutdown_connections 2023-10-08T16:09:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb638147390 0x7fb6380cb710 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 --2- 172.21.15.12:0/3010098236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb63806dee0 0x7fb6380c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 >> 172.21.15.12:0/3010098236 conn(0x7fb63806d130 msgr2=0x7fb6380cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.441+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff06801aa00 con 0x7ff0780cee70 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.442+0000 7ff05f7fe700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff064066fc0 0x7ff064069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff068021070 con 0x7ff0780cee70 2023-10-08T16:09:32.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff076ffd700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff064066fc0 0x7ff064069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 shutdown_connections 2023-10-08T16:09:32.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7f50517ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f504c0b0910 0x7f504c16a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff05f7fe700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7ff06406fd60 0x7ff0640721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0640728c0 con 0x7ff06406fd60 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff068057340 con 0x7ff0780cee70 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7ff076ffd700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff064066fc0 0x7ff064069470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c006d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7ff077fff700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7ff06406fd60 0x7ff0640721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f504affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f504c0b0910 0x7f504c16a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f80e639d700 1 Processor -- start 2023-10-08T16:09:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f504affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f504c0b0910 0x7f504c16a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40020/0 (socket says 172.21.15.12:40020) 2023-10-08T16:09:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f504affd700 1 -- 172.21.15.12:0/270465902 learned_addr learned my addr 172.21.15.12:0/270465902 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f50517ff700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c155b70 0x7f504c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f80e639d700 1 -- start start 2023-10-08T16:09:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7ff077fff700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7ff06406fd60 0x7ff0640721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.444+0000 7f50517ff700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f504c156f50 0x7f504c15cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7f504a7fc700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c155b70 0x7f504c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15aa10 con 0x7f504c0b0910 2023-10-08T16:09:32.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7f504b7fe700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f504c156f50 0x7f504c15cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.443+0000 7fb63f59d700 1 -- 172.21.15.12:0/3010098236 wait complete. 2023-10-08T16:09:32.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15b590 con 0x7f504c156f50 2023-10-08T16:09:32.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7fb63f59d700 1 Processor -- start 2023-10-08T16:09:32.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c15d2c0 con 0x7f504c155b70 2023-10-08T16:09:32.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.445+0000 7fb63f59d700 1 -- start start 2023-10-08T16:09:32.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== osd.2 v2:172.21.15.12:6800/115686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7ff0640728c0 con 0x7ff06406fd60 2023-10-08T16:09:32.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f5cfe59d700 1 -- 172.21.15.12:0/3591976222 wait complete. 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00caaf0 0x7f80e00af880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e00acb50 0x7f80e014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00b1160 0x7f80e00b15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00adcd0 con 0x7f80e00caaf0 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e014f690 con 0x7f80e00acb50 2023-10-08T16:09:32.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f80e639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e00ad0c0 con 0x7f80e00b1160 2023-10-08T16:09:32.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.446+0000 7f504a7fc700 1 -- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f504c156f50 msgr2=0x7f504c15cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f504a7fc700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f504c156f50 0x7f504c15cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f504a7fc700 1 -- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f504c0b0910 msgr2=0x7f504c16a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f504a7fc700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f504c0b0910 0x7f504c16a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f80e5b9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00b1160 0x7f80e00b15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f80e5b9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00b1160 0x7f80e00b15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50018/0 (socket says 172.21.15.12:50018) 2023-10-08T16:09:32.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f80e5b9c700 1 -- 172.21.15.12:0/1588950015 learned_addr learned my addr 172.21.15.12:0/1588950015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f504a7fc700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503400b780 con 0x7f504c155b70 2023-10-08T16:09:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f80e539b700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00caaf0 0x7f80e00af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7fb63f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806dee0 0x7fb6380a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7fb63f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6380c6980 0x7fb63816ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7fb63f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb638147390 0x7fb63816e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.447+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e00acb50 0x7f80e014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f504a7fc700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c155b70 0x7f504c153f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d860 tx=0x7f503c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f80e539b700 1 -- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00b1160 msgr2=0x7f80e00b15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f80e539b700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80e00b1160 0x7f80e00b15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f80e539b700 1 -- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e00acb50 msgr2=0x7f80e014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f80e539b700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80e00acb50 0x7f80e014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f80e539b700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e00ad3a0 con 0x7f80e00caaf0 2023-10-08T16:09:32.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f5cfe59d700 1 Processor -- start 2023-10-08T16:09:32.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c0125f0 con 0x7f504c155b70 2023-10-08T16:09:32.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c012750 con 0x7f504c155b70 2023-10-08T16:09:32.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c012b10 con 0x7f504c155b70 2023-10-08T16:09:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.449+0000 7f80e539b700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00caaf0 0x7f80e00af880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80dc01c000 tx=0x7f80dc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.449+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00cb70 con 0x7f80e00caaf0 2023-10-08T16:09:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.449+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc018e90 con 0x7f80e00caaf0 2023-10-08T16:09:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7f5cfe59d700 1 -- start start 2023-10-08T16:09:32.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.449+0000 7f5cfe59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cf80cabd0 0x7f5cf8157760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c15ac60 con 0x7f504c155b70 2023-10-08T16:09:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfe59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf81549e0 0x7f5cf81537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfe59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 0x7f5cf80b55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfe59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf8155610 con 0x7f5cf81549e0 2023-10-08T16:09:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfe59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf816dc80 con 0x7f5cf80cabd0 2023-10-08T16:09:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfe59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf81542c0 con 0x7f5cf815e080 2023-10-08T16:09:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c15b220 con 0x7f504c155b70 2023-10-08T16:09:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc00ce40 con 0x7f80e00caaf0 2023-10-08T16:09:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f80e639d700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e00ad680 con 0x7f80e00caaf0 2023-10-08T16:09:32.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f80e639d700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e00ac490 con 0x7f80e00caaf0 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfdd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 0x7f5cf80b55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfdd9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 0x7f5cf80b55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50034/0 (socket says 172.21.15.12:50034) 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.450+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/2211902914 learned_addr learned my addr 172.21.15.12:0/2211902914 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cf80cabd0 msgr2=0x7f5cf8157760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfd59b700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cf80cabd0 0x7f5cf8157760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cf80cabd0 0x7f5cf8157760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf81549e0 msgr2=0x7f5cf81537e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:09:32.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5cf81549e0 0x7f5cf81537e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80094f0 con 0x7f5cf815e080 2023-10-08T16:09:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfd59b700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5cf80cabd0 0x7f5cf8157760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f504c04c3c0 con 0x7f504c155b70 2023-10-08T16:09:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7f5cfdd9c700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 0x7f5cf80b55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8006fd0 tx=0x7f5ce8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f80b8000fd0 con 0x7f80e00caaf0 2023-10-08T16:09:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7fb63f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c4bc0 con 0x7fb6380c6980 2023-10-08T16:09:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7fb63f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c4e60 con 0x7fb63806dee0 2023-10-08T16:09:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7fb63dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6380c6980 0x7fb63816ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7fb63e59b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806dee0 0x7fb6380a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7fb63e59b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806dee0 0x7fb6380a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46908/0 (socket says 172.21.15.12:46908) 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.451+0000 7fb63e59b700 1 -- 172.21.15.12:0/4166699226 learned_addr learned my addr 172.21.15.12:0/4166699226 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7fb63ed9c700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb638147390 0x7fb63816e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.448+0000 7fb63f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6380c5140 con 0x7fb638147390 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800b820 con 0x7f5cf815e080 2023-10-08T16:09:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce8020070 con 0x7f5cf815e080 2023-10-08T16:09:32.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce801b680 con 0x7f5cf815e080 2023-10-08T16:09:32.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f5cfe59d700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf815f190 con 0x7f5cf815e080 2023-10-08T16:09:32.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.452+0000 7f5cfe59d700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf815f470 con 0x7f5cf815e080 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.454+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80dc004a40 con 0x7f80e00caaf0 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.455+0000 7f80d57fa700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f80c4067080 0x7f80c4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.455+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80dc08e180 con 0x7f80e00caaf0 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.455+0000 7f80d57fa700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f80c406f290 0x7f80c40716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.456+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f80c4071d50 con 0x7f80c406f290 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.456+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80dc08e4b0 con 0x7f80e00caaf0 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f80c4067080 0x7f80c4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7f80e4b9a700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f80c4067080 0x7f80c4069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80e0156e80 tx=0x7f80d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 -- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806dee0 msgr2=0x7fb6380a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb63806dee0 0x7fb6380a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 -- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6380c6980 msgr2=0x7fb63816ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6380c6980 0x7fb63816ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb630009ae0 con 0x7fb638147390 2023-10-08T16:09:32.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63dd9a700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6380c6980 0x7fb63816ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7fb63ed9c700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb638147390 0x7fb63816e310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb62800b4c0 tx=0x7fb628009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800f510 con 0x7fb638147390 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6380c5420 con 0x7fb638147390 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.456+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f503c01e460 con 0x7f504c155b70 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5042ffd700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f502c066f30 0x7f502c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f503c084ce0 con 0x7f504c155b70 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5042ffd700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7f502c06f140 0x7f502c071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f502c071c00 con 0x7f502c06f140 2023-10-08T16:09:32.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503c084fd0 con 0x7f504c155b70 2023-10-08T16:09:32.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f504affd700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f502c066f30 0x7f502c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.456+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ce8022030 con 0x7f5cf815e080 2023-10-08T16:09:32.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6380c59e0 con 0x7fb638147390 2023-10-08T16:09:32.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.456+0000 7f5cfe59d700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5cf804c3c0 con 0x7f5cf815e080 2023-10-08T16:09:32.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f80e5b9c700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f80c406f290 0x7f80c40716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7f5ced7fa700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5cdc067080 0x7f5cdc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.459+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62800f690 con 0x7fb638147390 2023-10-08T16:09:32.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.457+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ce80864f0 con 0x7f5cf815e080 2023-10-08T16:09:32.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5ced7fa700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7f5cdc06f210 0x7f5cdc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.458+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5cdc071cd0 con 0x7f5cdc06f210 2023-10-08T16:09:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.459+0000 7f504b7fe700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7f502c06f140 0x7f502c071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.459+0000 7f504affd700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f502c066f30 0x7f502c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5044009f50 tx=0x7f5044009840 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.460+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ce8053740 con 0x7f5cf815e080 2023-10-08T16:09:32.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.460+0000 7f5cfd59b700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5cdc067080 0x7f5cdc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.460+0000 7f504b7fe700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7f502c06f140 0x7f502c071550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.461+0000 7f5cfcd9a700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7f5cdc06f210 0x7f5cdc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.461+0000 7f80e5b9c700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f80c406f290 0x7f80c40716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.461+0000 7f5cfd59b700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5cdc067080 0x7f5cdc069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006fd0 tx=0x7f5cf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.460+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62800fa50 con 0x7fb638147390 2023-10-08T16:09:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.461+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb620000fd0 con 0x7fb638147390 2023-10-08T16:09:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.461+0000 7f5cfcd9a700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7f5cdc06f210 0x7f5cdc071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.462+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== osd.7 v2:172.21.15.29:6800/114128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f502c071c00 con 0x7f502c06f140 2023-10-08T16:09:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.462+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== osd.5 v2:172.21.15.29:6816/114133 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5cdc071cd0 con 0x7f5cdc06f210 2023-10-08T16:09:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.462+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb62801a400 con 0x7fb638147390 2023-10-08T16:09:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.463+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== osd.4 v2:172.21.15.29:6801/114126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f80c4071d50 con 0x7f80c406f290 2023-10-08T16:09:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.463+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 --> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fc4005c20 con 0x7f7fc40015f0 2023-10-08T16:09:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.463+0000 7f7fcbfff700 1 -- 172.21.15.12:0/1326189505 <== osd.0 v2:172.21.15.12:6815/115685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7fc4005c20 con 0x7f7fc40015f0 2023-10-08T16:09:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.464+0000 7fb62e7fc700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb61c067000 0x7fb61c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.464+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f7fc40015f0 msgr2=0x7f7fc4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.464+0000 7f7fe979d700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f7fc40015f0 0x7f7fc4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7fd0067080 msgr2=0x7f7fd0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7f7fe979d700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7fd0067080 0x7f7fd0069530 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4004890 tx=0x7f7fd4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe414e350 msgr2=0x7f7fe40cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7f7fe979d700 1 --2- 172.21.15.12:0/1326189505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7fe414e350 0x7f7fe40cb110 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7fe415e220 tx=0x7f7fd8008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.464+0000 7fb63e59b700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb61c067000 0x7fb61c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.466+0000 7f7fe8f9c700 1 -- 172.21.15.12:0/1326189505 reap_dead start 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb628083df0 con 0x7fb638147390 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.465+0000 7fb62e7fc700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7fb61c06f0a0 0x7fb61c0714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.466+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb61c071b60 con 0x7fb61c06f0a0 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.466+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb628086390 con 0x7fb638147390 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.466+0000 7fb63e59b700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb61c067000 0x7fb61c0694b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c010 tx=0x7fb630017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.466+0000 7fb63dd9a700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7fb61c06f0a0 0x7fb61c0714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.467+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 shutdown_connections 2023-10-08T16:09:32.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.467+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 >> 172.21.15.12:0/1326189505 conn(0x7f7fe40703a0 msgr2=0x7f7fe40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.467+0000 7fb63dd9a700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7fb61c06f0a0 0x7fb61c0714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.467+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 shutdown_connections 2023-10-08T16:09:32.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.467+0000 7f7fe979d700 1 -- 172.21.15.12:0/1326189505 wait complete. 2023-10-08T16:09:32.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.468+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== osd.6 v2:172.21.15.29:6824/114138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb61c071b60 con 0x7fb61c06f0a0 2023-10-08T16:09:32.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.473+0000 7f16ae3ff700 1 -- 172.21.15.12:0/3855547658 --> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16a80ccf00 con 0x7f169406f190 2023-10-08T16:09:32.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.474+0000 7f168ffff700 1 -- 172.21.15.12:0/3855547658 <== osd.1 v2:172.21.15.12:6814/115687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16a80ccf00 con 0x7f169406f190 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.475+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f169406f190 msgr2=0x7f16940715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.475+0000 7f168dffb700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f169406f190 0x7f16940715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1694067000 msgr2=0x7f16940694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1694067000 0x7f16940694b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1698009ef0 tx=0x7f1698017000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a80cb5a0 msgr2=0x7f16a81564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 --2- 172.21.15.12:0/3855547658 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16a80cb5a0 0x7f16a81564c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d8c0 tx=0x7f169c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f16ac99c700 1 -- 172.21.15.12:0/3855547658 reap_dead start 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 shutdown_connections 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.476+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 >> 172.21.15.12:0/3855547658 conn(0x7f16a8070e30 msgr2=0x7f16a80af4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.477+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 shutdown_connections 2023-10-08T16:09:32.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.477+0000 7f168dffb700 1 -- 172.21.15.12:0/3855547658 wait complete. 2023-10-08T16:09:32.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.481+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 --> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff050002d30 con 0x7ff06406fd60 2023-10-08T16:09:32.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.481+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 --> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc890002d30 con 0x7fc89c06f190 2023-10-08T16:09:32.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.482+0000 7fc896ffd700 1 -- 172.21.15.12:0/3505475581 <== osd.3 v2:172.21.15.12:6808/115684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc890002d30 con 0x7fc89c06f190 2023-10-08T16:09:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.482+0000 7ff05f7fe700 1 -- 172.21.15.12:0/703935 <== osd.2 v2:172.21.15.12:6800/115686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff050002d30 con 0x7ff06406fd60 2023-10-08T16:09:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.482+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7ff06406fd60 msgr2=0x7ff0640721f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff05d7fa700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7ff06406fd60 0x7ff0640721f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff064066fc0 msgr2=0x7ff064069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff05d7fa700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff064066fc0 0x7ff064069470 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff06c006fd0 tx=0x7ff06c006d30 comp rx=0 tx=0).stop 2023-10-08T16:09:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 msgr2=0x7ff0780c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff05d7fa700 1 --2- 172.21.15.12:0/703935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0780cee70 0x7ff0780c7620 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff0680090b0 tx=0x7ff068016000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.483+0000 7ff077fff700 1 -- 172.21.15.12:0/703935 reap_dead start 2023-10-08T16:09:32.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 shutdown_connections 2023-10-08T16:09:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 >> 172.21.15.12:0/703935 conn(0x7ff078070e70 msgr2=0x7ff0780b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 shutdown_connections 2023-10-08T16:09:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fc89c06f190 msgr2=0x7fc89c0715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7fc8affff700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fc89c06f190 0x7fc89c0715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.484+0000 7ff05d7fa700 1 -- 172.21.15.12:0/703935 wait complete. 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.485+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc89c067000 msgr2=0x7fc89c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.485+0000 7fc8affff700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc89c067000 0x7fc89c0694b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc8a804c850 tx=0x7fc8a4017000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.485+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 msgr2=0x7fc8a80d3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.485+0000 7fc8affff700 1 --2- 172.21.15.12:0/3505475581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8a8038be0 0x7fc8a80d3140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc8a000edb0 tx=0x7fc8a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.486+0000 7fc8af7fe700 1 -- 172.21.15.12:0/3505475581 reap_dead start 2023-10-08T16:09:32.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.486+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 shutdown_connections 2023-10-08T16:09:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.486+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 >> 172.21.15.12:0/3505475581 conn(0x7fc8a800efe0 msgr2=0x7fc8a803cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.487+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 shutdown_connections 2023-10-08T16:09:32.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.487+0000 7fc8affff700 1 -- 172.21.15.12:0/3505475581 wait complete. 2023-10-08T16:09:32.584 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:32.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:09:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.497+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 --> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80b8002c50 con 0x7f80c406f290 2023-10-08T16:09:32.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.497+0000 7f5cfe59d700 1 -- 172.21.15.12:0/2211902914 --> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5cf815ebb0 con 0x7f5cdc06f210 2023-10-08T16:09:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.498+0000 7f80d57fa700 1 -- 172.21.15.12:0/1588950015 <== osd.4 v2:172.21.15.29:6801/114126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80b8002c50 con 0x7f80c406f290 2023-10-08T16:09:32.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.498+0000 7f5ced7fa700 1 -- 172.21.15.12:0/2211902914 <== osd.5 v2:172.21.15.29:6816/114133 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5cf815ebb0 con 0x7f5cdc06f210 2023-10-08T16:09:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.498+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f80c406f290 msgr2=0x7f80c40716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.498+0000 7f80caffd700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f80c406f290 0x7f80c40716a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7f5cdc06f210 msgr2=0x7f5cdc071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7f5cdc06f210 0x7f5cdc071620 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f80c4067080 msgr2=0x7f80c4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 --> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb620002d30 con 0x7fb61c06f0a0 2023-10-08T16:09:32.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 --> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f504c1553c0 con 0x7f502c06f140 2023-10-08T16:09:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f80caffd700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f80c4067080 0x7f80c4069530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f80e0156e80 tx=0x7f80d0008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00caaf0 msgr2=0x7f80e00af880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f80caffd700 1 --2- 172.21.15.12:0/1588950015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80e00caaf0 0x7f80e00af880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80dc01c000 tx=0x7f80dc01d000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f80e5b9c700 1 -- 172.21.15.12:0/1588950015 reap_dead start 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5cdc067080 msgr2=0x7f5cdc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5cdc067080 0x7f5cdc069530 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4006fd0 tx=0x7f5cf4008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 msgr2=0x7f5cf80b55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5ce2ffd700 1 --2- 172.21.15.12:0/2211902914 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5cf815e080 0x7f5cf80b55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8006fd0 tx=0x7f5ce8016000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.499+0000 7f5cfdd9c700 1 -- 172.21.15.12:0/2211902914 reap_dead start 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 shutdown_connections 2023-10-08T16:09:32.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 >> 172.21.15.12:0/2211902914 conn(0x7f5cf80703a0 msgr2=0x7f5cf80c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 shutdown_connections 2023-10-08T16:09:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 >> 172.21.15.12:0/1588950015 conn(0x7f80e006d130 msgr2=0x7f80e00c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 shutdown_connections 2023-10-08T16:09:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7fb62e7fc700 1 -- 172.21.15.12:0/4166699226 <== osd.6 v2:172.21.15.29:6824/114138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb620002d30 con 0x7fb61c06f0a0 2023-10-08T16:09:32.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 shutdown_connections 2023-10-08T16:09:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f5042ffd700 1 -- 172.21.15.12:0/270465902 <== osd.7 v2:172.21.15.29:6800/114128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f504c1553c0 con 0x7f502c06f140 2023-10-08T16:09:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.500+0000 7f80caffd700 1 -- 172.21.15.12:0/1588950015 wait complete. 2023-10-08T16:09:32.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f5ce2ffd700 1 -- 172.21.15.12:0/2211902914 wait complete. 2023-10-08T16:09:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7fb61c06f0a0 msgr2=0x7fb61c0714b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7fb63f59d700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7fb61c06f0a0 0x7fb61c0714b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7f502c06f140 msgr2=0x7f502c071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7f502c06f140 0x7f502c071550 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f502c066f30 msgr2=0x7f502c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f502c066f30 0x7f502c0693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5044009f50 tx=0x7f5044009840 comp rx=0 tx=0).stop 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c155b70 msgr2=0x7f504c153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f50517ff700 1 --2- 172.21.15.12:0/270465902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f504c155b70 0x7f504c153f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f503c00d860 tx=0x7f503c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:32.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.501+0000 7f504b7fe700 1 -- 172.21.15.12:0/270465902 reap_dead start 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb61c067000 msgr2=0x7fb61c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb61c067000 0x7fb61c0694b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb63000c010 tx=0x7fb630017000 comp rx=0 tx=0).stop 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb638147390 msgr2=0x7fb63816e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 --2- 172.21.15.12:0/4166699226 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb638147390 0x7fb63816e310 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb62800b4c0 tx=0x7fb628009060 comp rx=0 tx=0).stop 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63ed9c700 1 -- 172.21.15.12:0/4166699226 reap_dead start 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 shutdown_connections 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 >> 172.21.15.12:0/4166699226 conn(0x7fb63806d130 msgr2=0x7fb638069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 shutdown_connections 2023-10-08T16:09:32.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 shutdown_connections 2023-10-08T16:09:32.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.502+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 >> 172.21.15.12:0/270465902 conn(0x7f504c06d170 msgr2=0x7f504c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.503+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 shutdown_connections 2023-10-08T16:09:32.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.503+0000 7f50517ff700 1 -- 172.21.15.12:0/270465902 wait complete. 2023-10-08T16:09:32.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.503+0000 7fb63f59d700 1 -- 172.21.15.12:0/4166699226 wait complete. 2023-10-08T16:09:32.597 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:32.597 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:09:32.599 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:32.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:09:32.600 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:32.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:09:32.602 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:32.602 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:09:32.603 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:32.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:09:32.605 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:32.605 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:09:32.606 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:32.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:09:32.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.970+0000 7f5924b9d700 1 Processor -- start 2023-10-08T16:09:32.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.970+0000 7f5924b9d700 1 -- start start 2023-10-08T16:09:32.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.972+0000 7f8a03fff700 1 Processor -- start 2023-10-08T16:09:32.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.972+0000 7f8a03fff700 1 -- start start 2023-10-08T16:09:32.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f591803b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59180e67f0 0x7f591803b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 0x7f5918053c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918057a00 con 0x7f5918053820 2023-10-08T16:09:32.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5918058810 con 0x7f59180e67f0 2023-10-08T16:09:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f8a03fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0d8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f8a03fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f89fc04ff70 0x7f89fc0503b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f8a03fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc053390 con 0x7f89fc00c1f0 2023-10-08T16:09:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f8a03fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0d8e40 con 0x7f89fc04ff70 2023-10-08T16:09:32.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f8a03fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0508f0 con 0x7f89fc0d84b0 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.973+0000 7f5924b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5918057c00 con 0x7f59180e6420 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f591ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 0x7f5918053c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f591ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 0x7f5918053c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40042/0 (socket says 172.21.15.12:40042) 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f591ffff700 1 -- 172.21.15.12:0/794250481 learned_addr learned my addr 172.21.15.12:0/794250481 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.974+0000 7f591effd700 1 --2- 172.21.15.12:0/794250481 >> v2:172.21.15.29:3300/0 conn(0x7f59180e67f0 0x7f591803b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591f7fe700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f591803b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591effd700 1 -- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 msgr2=0x7f591803b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591effd700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f591803b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591effd700 1 -- 172.21.15.12:0/794250481 >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 msgr2=0x7f5918053c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591effd700 1 --2- 172.21.15.12:0/794250481 >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 0x7f5918053c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f8a02ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f89fc00c1f0 0x7f89fc0de900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41954/0 (socket says 172.21.15.12:41954) 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f8a02ffd700 1 -- 172.21.15.12:0/959458898 learned_addr learned my addr 172.21.15.12:0/959458898 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f8a037fe700 1 --2- 172.21.15.12:0/959458898 >> v2:172.21.15.29:3300/0 conn(0x7f89fc04ff70 0x7f89fc0503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f8a027fc700 1 --2- 172.21.15.12:0/959458898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633803319 0 0) 0x7f89fc053390 con 0x7f89fc00c1f0 2023-10-08T16:09:32.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ec003570 con 0x7f89fc00c1f0 2023-10-08T16:09:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.975+0000 7f591effd700 1 -- 172.21.15.12:0/794250481 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918057ee0 con 0x7f59180e67f0 2023-10-08T16:09:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f591effd700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59180e67f0 0x7f591803b5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5918056c70 tx=0x7f59140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa6a6c93b8559921 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a027fc700 1 -- 172.21.15.12:0/959458898 >> v2:172.21.15.29:3300/0 conn(0x7f89fc04ff70 msgr2=0x7f89fc0503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a027fc700 1 --2- 172.21.15.12:0/959458898 >> v2:172.21.15.29:3300/0 conn(0x7f89fc04ff70 0x7f89fc0503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a027fc700 1 -- 172.21.15.12:0/959458898 >> v1:172.21.15.29:6789/0 conn(0x7f89fc00c1f0 legacy=0x7f89fc0de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 <== mon.1 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3332622511 0 0) 0x7f89ec003570 con 0x7f89fc00c1f0 2023-10-08T16:09:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.976+0000 7f8a027fc700 1 -- 172.21.15.12:0/959458898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0df430 con 0x7f89fc0d84b0 2023-10-08T16:09:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.977+0000 7f14b6bff700 1 Processor -- start 2023-10-08T16:09:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.977+0000 7f8a027fc700 1 --2- 172.21.15.12:0/959458898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0d8900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098e0 tx=0x7f89f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c10df2d1f16e539 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:32.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.977+0000 7f591e7fc700 1 -- 172.21.15.12:0/794250481 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914011630 con 0x7f59180e67f0 2023-10-08T16:09:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.977+0000 7f14b6bff700 1 -- start start 2023-10-08T16:09:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.977+0000 7fd5ccdff700 1 Processor -- start 2023-10-08T16:09:32.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.978+0000 7f591e7fc700 1 -- 172.21.15.12:0/794250481 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5914011790 con 0x7f59180e67f0 2023-10-08T16:09:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.978+0000 7f591e7fc700 1 -- 172.21.15.12:0/794250481 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5914011b10 con 0x7f59180e67f0 2023-10-08T16:09:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.978+0000 7f1f7e1ff700 1 Processor -- start 2023-10-08T16:09:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.978+0000 7f1f7e1ff700 1 -- start start 2023-10-08T16:09:32.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7f5924b9d700 1 -- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59180e67f0 msgr2=0x7f591803b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7f5924b9d700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59180e67f0 0x7f591803b5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5918056c70 tx=0x7f59140091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7fd5ccdff700 1 -- start start 2023-10-08T16:09:32.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0404c9a0 con 0x7f89fc0d84b0 2023-10-08T16:09:32.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f8011420 con 0x7f89fc0d84b0 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.979+0000 7f8a01ffb700 1 -- 172.21.15.12:0/959458898 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80117e0 con 0x7f89fc0d84b0 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f5924b9d700 1 -- 172.21.15.12:0/794250481 shutdown_connections 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f5924b9d700 1 --2- 172.21.15.12:0/794250481 >> v2:172.21.15.12:3300/0 conn(0x7f5918053820 0x7f5918053c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f5924b9d700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f591803b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f5924b9d700 1 --2- 172.21.15.12:0/794250481 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59180e67f0 0x7f591803b5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f5924b9d700 1 -- 172.21.15.12:0/794250481 >> 172.21.15.12:0/794250481 conn(0x7f5918059130 msgr2=0x7f5918059530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:32.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 -- 172.21.15.12:0/959458898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 msgr2=0x7f89fc0d8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:32.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 --2- 172.21.15.12:0/959458898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0d8900 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f89f80098e0 tx=0x7f89f80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f14b6bff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14b006cdb0 0x7f14b01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 -- 172.21.15.12:0/959458898 shutdown_connections 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f1f7e1ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f1f7e1ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f70007000 0x7f1f700ea830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f1f7e1ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f70037740 con 0x7f1f700e0fc0 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f1f7e1ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700eb190 con 0x7f1f70007000 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f1f7e1ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f70053620 con 0x7f1f700e0bf0 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 --2- 172.21.15.12:0/959458898 >> v2:172.21.15.29:3300/0 conn(0x7f89fc04ff70 0x7f89fc0503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:32.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 --2- 172.21.15.12:0/959458898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0d8900 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f5924b9d700 1 -- 172.21.15.12:0/794250481 shutdown_connections 2023-10-08T16:09:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.980+0000 7f8a03fff700 1 -- 172.21.15.12:0/959458898 >> 172.21.15.12:0/959458898 conn(0x7f89fc054d40 msgr2=0x7f89fc055140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14affff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14b006cdb0 0x7f14b01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14b499b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f14b01531f0 0x7f14b006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41960/0 (socket says 172.21.15.12:41960) 2023-10-08T16:09:33.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14b499b700 1 -- 172.21.15.12:0/3166423919 learned_addr learned my addr 172.21.15.12:0/3166423919 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:33.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f5924b9d700 1 -- 172.21.15.12:0/794250481 wait complete. 2023-10-08T16:09:33.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14b6bff700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b01592d0 0x7f14b01596f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f8a03fff700 1 -- 172.21.15.12:0/959458898 shutdown_connections 2023-10-08T16:09:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b0159c30 con 0x7f14b01531f0 2023-10-08T16:09:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f14b519c700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b01592d0 0x7f14b01596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.981+0000 7f1f777fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f1f777fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46938/0 (socket says 172.21.15.12:46938) 2023-10-08T16:09:33.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f1f777fe700 1 -- 172.21.15.12:0/3111062323 learned_addr learned my addr 172.21.15.12:0/3111062323 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f1f76ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1f700e0fc0 0x7f1f700068f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46944/0 (socket says 172.21.15.12:46944) 2023-10-08T16:09:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f1f77fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f70007000 0x7f1f700ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7fd5ccdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c80ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7fd5c5d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd5c80cbcb0 0x7fd5c806e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41972/0 (socket says 172.21.15.12:41972) 2023-10-08T16:09:33.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b006a0a0 con 0x7f14b006cdb0 2023-10-08T16:09:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015a1c0 con 0x7f14b01592d0 2023-10-08T16:09:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399153102 0 0) 0x7f14b0159c30 con 0x7f14b01531f0 2023-10-08T16:09:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7fd5c5d9b700 1 -- 172.21.15.12:0/965215819 learned_addr learned my addr 172.21.15.12:0/965215819 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:33.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c003570 con 0x7f14b01531f0 2023-10-08T16:09:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.982+0000 7fd5ccdff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80acf40 con 0x7fd5c80cb8e0 2023-10-08T16:09:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7fd5c6d9d700 1 --2- 172.21.15.12:0/965215819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c80ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c8156c00 con 0x7fd5c80cbcb0 2023-10-08T16:09:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b20a0 con 0x7fd5c806eb00 2023-10-08T16:09:33.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 <== mon.1 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944137750 0 0) 0x7f149c003570 con 0x7f14b01531f0 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b01592d0 msgr2=0x7f14b01596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b01592d0 0x7f14b01596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 >> v2:172.21.15.12:3300/0 conn(0x7f14b006cdb0 msgr2=0x7f14b01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 --2- 172.21.15.12:0/3166423919 >> v2:172.21.15.12:3300/0 conn(0x7f14b006cdb0 0x7f14b01568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 --> v1:172.21.15.29:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0159ee0 con 0x7f14b01531f0 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 <== mon.1 v1:172.21.15.29:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1498001470 con 0x7f14b01531f0 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 >> v1:172.21.15.29:6789/0 conn(0x7f14b01531f0 legacy=0x7f14b006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f149c003ae0 0x7f149c003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f149c004810 0x7f149c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f149c005230 0x7f149c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b006a0a0 con 0x7f149c004810 2023-10-08T16:09:33.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b015a1c0 con 0x7f149c003ae0 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c014a10 con 0x7f149c005230 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7fd5c559a700 1 -- 172.21.15.12:0/965215819 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845312722 0 0) 0x7fd5c8156c00 con 0x7fd5c80cbcb0 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.983+0000 7f1f767fc700 1 -- 172.21.15.12:0/3111062323 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24464746 0 0) 0x7f1f64001110 con 0x7f1f700e0fc0 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f1f77fff700 1 -- 172.21.15.12:0/3111062323 >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 msgr2=0x7f1f700ea2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f1f77fff700 1 --2- 172.21.15.12:0/3111062323 >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f1f77fff700 1 -- 172.21.15.12:0/3111062323 >> v1:172.21.15.12:6789/0 conn(0x7f1f700e0fc0 legacy=0x7f1f700068f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7fd5c559a700 1 -- 172.21.15.12:0/965215819 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5b0003570 con 0x7fd5c80cbcb0 2023-10-08T16:09:33.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f1f77fff700 1 -- 172.21.15.12:0/3111062323 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70054ac0 con 0x7f1f70007000 2023-10-08T16:09:33.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f5924b9d700 1 Processor -- start 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f149c003ae0 0x7f149c003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 -- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f149c005230 msgr2=0x7f149c00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f149c005230 0x7f149c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 -- 172.21.15.12:0/3166423919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f149c004810 msgr2=0x7f149c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f149c004810 0x7f149c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 -- 172.21.15.12:0/3166423919 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c003570 con 0x7f149c003ae0 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7fd5c6d9d700 1 -- 172.21.15.12:0/965215819 >> v1:172.21.15.29:6789/0 conn(0x7fd5c80cbcb0 legacy=0x7fd5c806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7fd5c6d9d700 1 -- 172.21.15.12:0/965215819 >> v1:172.21.15.12:6789/0 conn(0x7fd5c80cb8e0 legacy=0x7fd5c80ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f1f777fe700 1 --2- 172.21.15.12:0/3111062323 >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7fd5c6d9d700 1 -- 172.21.15.12:0/965215819 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80abd50 con 0x7fd5c806eb00 2023-10-08T16:09:33.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.984+0000 7f14b499b700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f149c003ae0 0x7f149c003ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f149800c2d0 tx=0x7f1498001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c5648f818490286 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f1f77fff700 1 --2- 172.21.15.12:0/3111062323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f70007000 0x7f1f700ea830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000eb0 tx=0x7f1f780673b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2f86afd7cdf8d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7fd5c6d9d700 1 --2- 172.21.15.12:0/965215819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c80ad6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e90 tx=0x7fd5c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3234049d2193855 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800cc00 con 0x7f149c003ae0 2023-10-08T16:09:33.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f14af7fe700 1 -- 172.21.15.12:0/3166423919 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800cd80 con 0x7f149c003ae0 2023-10-08T16:09:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f1f767fc700 1 -- 172.21.15.12:0/3111062323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780008d0 con 0x7f1f70007000 2023-10-08T16:09:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f1f767fc700 1 -- 172.21.15.12:0/3111062323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78064550 con 0x7f1f70007000 2023-10-08T16:09:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7fd5c559a700 1 -- 172.21.15.12:0/965215819 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c000e070 con 0x7fd5c806eb00 2023-10-08T16:09:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7fd5c559a700 1 -- 172.21.15.12:0/965215819 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c000bbf0 con 0x7fd5c806eb00 2023-10-08T16:09:33.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7fd5c559a700 1 -- 172.21.15.12:0/965215819 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0012430 con 0x7fd5c806eb00 2023-10-08T16:09:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f149c003ae0 msgr2=0x7f149c003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7f14b6bff700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f149c003ae0 0x7f149c003ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f149800c2d0 tx=0x7f1498001dc0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.986+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3111062323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f70007000 msgr2=0x7f1f700ea830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f767fc700 1 -- 172.21.15.12:0/3111062323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f780008d0 con 0x7f1f70007000 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f7e1ff700 1 --2- 172.21.15.12:0/3111062323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f70007000 0x7f1f700ea830 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f78000eb0 tx=0x7f1f780673b0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f8a03fff700 1 -- 172.21.15.12:0/959458898 wait complete. 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.985+0000 7f5924b9d700 1 -- start start 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f5924b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f5924b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f59180e25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f5924b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 0x7f59180e2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f591f7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46946/0 (socket says 172.21.15.12:46946) 2023-10-08T16:09:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3111062323 shutdown_connections 2023-10-08T16:09:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f7e1ff700 1 --2- 172.21.15.12:0/3111062323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f70007000 0x7f1f700ea830 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f7e1ff700 1 --2- 172.21.15.12:0/3111062323 >> v2:172.21.15.29:3300/0 conn(0x7f1f700e0bf0 0x7f1f700ea2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3111062323 >> 172.21.15.12:0/3111062323 conn(0x7f1f70054d70 msgr2=0x7f1f70055170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f591f7fe700 1 -- 172.21.15.12:0/1095478920 learned_addr learned my addr 172.21.15.12:0/1095478920 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f591ffff700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 0x7f59180e2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.987+0000 7f591effd700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f59180e25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5918051090 con 0x7f59180e67f0 2023-10-08T16:09:33.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59180501e0 con 0x7f5918053820 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59180dfda0 con 0x7f59180e6420 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f591f7fe700 1 -- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 msgr2=0x7f59180e25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f591f7fe700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f59180e25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f591f7fe700 1 -- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 msgr2=0x7f59180e2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f591f7fe700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 0x7f59180e2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.988+0000 7f591f7fe700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914009420 con 0x7f5918053820 2023-10-08T16:09:33.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 msgr2=0x7fd5c80ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7fd5ccdff700 1 --2- 172.21.15.12:0/965215819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c80ad6b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e90 tx=0x7fd5c0009780 comp rx=0 tx=0).stop 2023-10-08T16:09:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f8a03fff700 1 Processor -- start 2023-10-08T16:09:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f591ffff700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 0x7f59180e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f591f7fe700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5920062fd0 tx=0x7f592006b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 shutdown_connections 2023-10-08T16:09:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7fd5ccdff700 1 --2- 172.21.15.12:0/965215819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c80ad6b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 >> 172.21.15.12:0/965215819 conn(0x7fd5c80cc300 msgr2=0x7fd5c80cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3111062323 shutdown_connections 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592008c070 con 0x7f5918053820 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592006d820 con 0x7f5918053820 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f8a03fff700 1 -- start start 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89fc00c1f0 0x7f89fc0ded10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 0x7f89fc036a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0e0dc0 con 0x7f89fc04ff70 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0d08c0 con 0x7f89fc00c1f0 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f8a03fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc0d2c90 con 0x7f89fc0d84b0 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f14b519c700 1 --2- 172.21.15.12:0/3166423919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b01592d0 0x7f14b01596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f14b519c700 1 -- 172.21.15.12:0/3166423919 reap_dead start 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 shutdown_connections 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 >> 172.21.15.12:0/3166423919 conn(0x7f14b00c8bb0 msgr2=0x7f14b00c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 shutdown_connections 2023-10-08T16:09:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f14b6bff700 1 -- 172.21.15.12:0/3166423919 wait complete. 2023-10-08T16:09:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3111062323 wait complete. 2023-10-08T16:09:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7facb2b9d700 1 Processor -- start 2023-10-08T16:09:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7facb2b9d700 1 -- start start 2023-10-08T16:09:33.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592006dbe0 con 0x7f5918053820 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.989+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5918050480 con 0x7f5918053820 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.990+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5918050a40 con 0x7f5918053820 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 shutdown_connections 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a037fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 0x7f89fc036a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a037fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50090/0 (socket says 172.21.15.12:50090) 2023-10-08T16:09:33.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a037fe700 1 -- 172.21.15.12:0/2513225623 learned_addr learned my addr 172.21.15.12:0/2513225623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7fd5ccdff700 1 -- 172.21.15.12:0/965215819 wait complete. 2023-10-08T16:09:33.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59180053d0 con 0x7f5918053820 2023-10-08T16:09:33.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7facb2b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facac153c30 0x7facac15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7f1f7e1ff700 1 Processor -- start 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 -- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 msgr2=0x7f89fc0e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 -- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89fc00c1f0 msgr2=0x7f89fc0ded10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89fc00c1f0 0x7f89fc0ded10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.991+0000 7f8a027fc700 1 -- 172.21.15.12:0/2513225623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8009420 con 0x7f89fc04ff70 2023-10-08T16:09:33.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.992+0000 7f8a037fe700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:33.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f8a027fc700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 0x7f89fc036a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89f8015000 tx=0x7f89f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb2b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 0x7facac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb1b9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facac153c30 0x7facac15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f14b6bff700 1 Processor -- start 2023-10-08T16:09:33.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f14b6bff700 1 -- start start 2023-10-08T16:09:33.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb1b9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7facac153c30 0x7facac15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46966/0 (socket says 172.21.15.12:46966) 2023-10-08T16:09:33.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59200675a0 con 0x7f5918053820 2023-10-08T16:09:33.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f801d170 con 0x7f89fc04ff70 2023-10-08T16:09:33.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb139a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 0x7facac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f801d310 con 0x7f89fc04ff70 2023-10-08T16:09:33.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb139a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 0x7facac0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40110/0 (socket says 172.21.15.12:40110) 2023-10-08T16:09:33.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7f1f7e1ff700 1 -- start start 2023-10-08T16:09:33.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.993+0000 7facb139a700 1 -- 172.21.15.12:0/721445898 learned_addr learned my addr 172.21.15.12:0/721445898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facac0cf3c0 con 0x7facac0cef40 2023-10-08T16:09:33.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac15afd0 con 0x7facac15de50 2023-10-08T16:09:33.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facac15b2b0 con 0x7facac153c30 2023-10-08T16:09:33.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f80288d0 con 0x7f89fc04ff70 2023-10-08T16:09:33.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f8a03fff700 1 -- 172.21.15.12:0/2513225623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc0d2f70 con 0x7f89fc04ff70 2023-10-08T16:09:33.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7facb1b9b700 1 -- 172.21.15.12:0/721445898 >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 msgr2=0x7facac0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7fd5ccdff700 1 Processor -- start 2023-10-08T16:09:33.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.994+0000 7f590b7fe700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 0x7f5904069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7facb1b9b700 1 --2- 172.21.15.12:0/721445898 >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 0x7facac0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7fd5ccdff700 1 -- start start 2023-10-08T16:09:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f591effd700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 0x7f5904069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f8a03fff700 1 -- 172.21.15.12:0/2513225623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc0e0a50 con 0x7f89fc04ff70 2023-10-08T16:09:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 0x7f1f70036890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 0x7f1f700dcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7facb1b9b700 1 -- 172.21.15.12:0/721445898 >> v1:172.21.15.12:6789/0 conn(0x7facac0cef40 legacy=0x7facac06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f700dd000 0x7f1f70034b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7facb1b9b700 1 -- 172.21.15.12:0/721445898 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facac15b590 con 0x7facac153c30 2023-10-08T16:09:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f777fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 0x7f1f70036890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700357f0 con 0x7f1f700dd000 2023-10-08T16:09:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f76ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 0x7f1f700dcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70035ad0 con 0x7f1f700e0bf0 2023-10-08T16:09:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f7e1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70035db0 con 0x7f1f70007000 2023-10-08T16:09:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f76ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 0x7f1f700dcac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46976/0 (socket says 172.21.15.12:46976) 2023-10-08T16:09:33.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.996+0000 7f1f76ffd700 1 -- 172.21.15.12:0/3543361506 learned_addr learned my addr 172.21.15.12:0/3543361506 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b01511f0 0x7f14b00af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14b00c7ae0 0x7f14b00ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00ade60 con 0x7f14b00c7ae0 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00b02b0 con 0x7f14b01511f0 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.995+0000 7f14b6bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b00c7f50 con 0x7f14b00afe40 2023-10-08T16:09:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc0052b0 con 0x7f89fc04ff70 2023-10-08T16:09:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f1f777fe700 1 -- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 msgr2=0x7f1f700dcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f1f777fe700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 0x7f1f700dcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f1f777fe700 1 -- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f700dd000 msgr2=0x7f1f70034b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f1f777fe700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f700dd000 0x7f1f70034b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.997+0000 7f1f777fe700 1 -- 172.21.15.12:0/3543361506 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6c0094f0 con 0x7f1f70007000 2023-10-08T16:09:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f1f777fe700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 0x7f1f70036890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c006fd0 tx=0x7f1f6c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7fd5ccdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7fd5ccdff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80cb8e0 0x7fd5c8144db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f59200fb350 con 0x7f5918053820 2023-10-08T16:09:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7fd5ccdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 0x7fd5c8158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f591effd700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 0x7f5904069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59140093f0 tx=0x7f5914017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00c850 con 0x7f1f70007000 2023-10-08T16:09:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6c00c9b0 con 0x7f1f70007000 2023-10-08T16:09:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c00cd50 con 0x7f1f70007000 2023-10-08T16:09:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3543361506 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f70036090 con 0x7f1f70007000 2023-10-08T16:09:33.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7f1f7e1ff700 1 -- 172.21.15.12:0/3543361506 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f70035090 con 0x7f1f70007000 2023-10-08T16:09:33.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7facb1b9b700 1 --2- 172.21.15.12:0/721445898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac15a5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facac06ead0 tx=0x7fac9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9842c4b12df61789 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14b499b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b01511f0 0x7f14b00af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14b519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14b00c7ae0 0x7f14b00ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50112/0 (socket says 172.21.15.12:50112) 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 -- 172.21.15.12:0/154776931 learned_addr learned my addr 172.21.15.12:0/154776931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 -- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b01511f0 msgr2=0x7f14b00af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b01511f0 0x7f14b00af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 -- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14b00c7ae0 msgr2=0x7f14b00ab9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14b00c7ae0 0x7f14b00ab9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 -- 172.21.15.12:0/154776931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b00b10f0 con 0x7f14b00afe40 2023-10-08T16:09:33.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.998+0000 7f14affff700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e850 tx=0x7f14a000c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89f801a460 con 0x7f89fc04ff70 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7fd5c659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:32.999+0000 7fd5c659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50124/0 (socket says 172.21.15.12:50124) 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5ccdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8146f30 con 0x7fd5c815ab70 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5ccdff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8146480 con 0x7fd5c80cb8e0 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5ccdff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c814ac70 con 0x7fd5c806eb00 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5c659c700 1 -- 172.21.15.12:0/1366705649 learned_addr learned my addr 172.21.15.12:0/1366705649 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5c6d9d700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 0x7fd5c8158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.000+0000 7fd5c5d9b700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80cb8e0 0x7fd5c8144db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c659c700 1 -- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80cb8e0 msgr2=0x7fd5c8144db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c659c700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80cb8e0 0x7fd5c8144db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c659c700 1 -- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 msgr2=0x7fd5c8158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c659c700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 0x7fd5c8158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c659c700 1 -- 172.21.15.12:0/1366705649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009a20 con 0x7fd5c806eb00 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7fd5c6d9d700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 0x7fd5c8158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:33.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f500052b0 con 0x7f1f70007000 2023-10-08T16:09:33.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.002+0000 7f629f59e700 1 Processor -- start 2023-10-08T16:09:33.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.002+0000 7fd5c659c700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800bec0 tx=0x7fd5b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000c5d0 con 0x7f14b00afe40 2023-10-08T16:09:33.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0010040 con 0x7f14b00afe40 2023-10-08T16:09:33.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.002+0000 7f89eaffd700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 0x7f89f0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000c960 con 0x7f14b00afe40 2023-10-08T16:09:33.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f14b6bff700 1 -- 172.21.15.12:0/154776931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b00b04e0 con 0x7f14b00afe40 2023-10-08T16:09:33.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7f14b6bff700 1 -- 172.21.15.12:0/154776931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b00b0aa0 con 0x7f14b00afe40 2023-10-08T16:09:33.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7f14b6bff700 1 -- 172.21.15.12:0/154776931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b00b1280 con 0x7f14b00afe40 2023-10-08T16:09:33.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800cd20 con 0x7fd5c806eb00 2023-10-08T16:09:33.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b800b4d0 con 0x7fd5c806eb00 2023-10-08T16:09:33.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59200c85a0 con 0x7f5918053820 2023-10-08T16:09:33.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f6c013680 con 0x7f1f70007000 2023-10-08T16:09:33.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.002+0000 7f629f59e700 1 -- start start 2023-10-08T16:09:33.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b800cea0 con 0x7fd5c806eb00 2023-10-08T16:09:33.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7f629f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62a0159380 0x7f62a0159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89f808d910 con 0x7f89fc04ff70 2023-10-08T16:09:33.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7f8a02ffd700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 0x7f89f0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a000ccd0 con 0x7f14b00afe40 2023-10-08T16:09:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f8a02ffd700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 0x7f89f0069430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a0405f200 tx=0x7f8a040673b0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a00ccfa0 con 0x7f62a00cea00 2023-10-08T16:09:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00cb880 con 0x7f62a0159380 2023-10-08T16:09:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00cbb60 con 0x7f62a00cb3f0 2023-10-08T16:09:33.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f62a00cea00 0x7f62a00cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46982/0 (socket says 172.21.15.12:46982) 2023-10-08T16:09:33.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7f629ed9d700 1 -- 172.21.15.12:0/2074882118 learned_addr learned my addr 172.21.15.12:0/2074882118 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:33.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7f1f637fe700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 0x7f1f5c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f6c084790 con 0x7f1f70007000 2023-10-08T16:09:33.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7f1f76ffd700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 0x7f1f5c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7f14acff9700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 0x7f1490069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14a0084000 con 0x7f14b00afe40 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7facb0b99700 1 -- 172.21.15.12:0/721445898 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00b6b0 con 0x7facac153c30 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7facb0b99700 1 -- 172.21.15.12:0/721445898 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9c00b810 con 0x7facac153c30 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.003+0000 7facb0b99700 1 -- 172.21.15.12:0/721445898 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c00bbb0 con 0x7facac153c30 2023-10-08T16:09:33.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 msgr2=0x7facac15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7facb2b9d700 1 --2- 172.21.15.12:0/721445898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac15a5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facac06ead0 tx=0x7fac9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 shutdown_connections 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7facb2b9d700 1 --2- 172.21.15.12:0/721445898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac15a5e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7facb2b9d700 1 --2- 172.21.15.12:0/721445898 >> v2:172.21.15.12:3300/0 conn(0x7facac15de50 0x7facac0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 >> 172.21.15.12:0/721445898 conn(0x7facac0703a0 msgr2=0x7facac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.001+0000 7ff06599d700 1 Processor -- start 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.002+0000 7ff06599d700 1 -- start start 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7ff06599d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 0x7ff06006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7ff06599d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060069d10 con 0x7ff0601555e0 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7ff06599d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff060069fd0 con 0x7ff06006e390 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.004+0000 7ff06599d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06006bfd0 con 0x7ff06006ad90 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7ff05ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 0x7ff06006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7ff06499b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff0601555e0 0x7ff06006b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46974/0 (socket says 172.21.15.12:46974) 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.005+0000 7ff06499b700 1 -- 172.21.15.12:0/819154993 learned_addr learned my addr 172.21.15.12:0/819154993 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7ff05ffff700 1 -- 172.21.15.12:0/819154993 >> v1:172.21.15.29:6789/0 conn(0x7ff06006e390 legacy=0x7ff0600c9d00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7ff05ffff700 1 -- 172.21.15.12:0/819154993 >> v1:172.21.15.12:6789/0 conn(0x7ff0601555e0 legacy=0x7ff06006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7ff05ffff700 1 -- 172.21.15.12:0/819154993 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06006a2b0 con 0x7ff06006ad90 2023-10-08T16:09:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.006+0000 7ff05ffff700 1 --2- 172.21.15.12:0/819154993 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 0x7ff06006de50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff048009900 tx=0x7ff048009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09c488ca650342c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89f805abe0 con 0x7f89fc04ff70 2023-10-08T16:09:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7f14b499b700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 0x7f1490069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7fd5ccdff700 1 -- 172.21.15.12:0/1366705649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c81581c0 con 0x7fd5c806eb00 2023-10-08T16:09:33.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7fd5ccdff700 1 -- 172.21.15.12:0/1366705649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c8146710 con 0x7fd5c806eb00 2023-10-08T16:09:33.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7f1f76ffd700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 0x7f1f5c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009b90 tx=0x7f1f64009120 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 shutdown_connections 2023-10-08T16:09:33.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.007+0000 7facb2b9d700 1 -- 172.21.15.12:0/721445898 wait complete. 2023-10-08T16:09:33.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.008+0000 7f629e59c700 1 --2- 172.21.15.12:0/2074882118 >> v2:172.21.15.29:3300/0 conn(0x7f62a0159380 0x7f62a0159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.008+0000 7f14b499b700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 0x7f1490069500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1498007c60 tx=0x7f1498015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.008+0000 7f629dd9b700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629e59c700 1 -- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 msgr2=0x7f62a015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629e59c700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629e59c700 1 -- 172.21.15.12:0/2074882118 >> v1:172.21.15.12:6789/0 conn(0x7f62a00cea00 legacy=0x7f62a00cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629e59c700 1 -- 172.21.15.12:0/2074882118 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a00cbe40 con 0x7f62a0159380 2023-10-08T16:09:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629e59c700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0159750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62900098e0 tx=0x7f62900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d207325a64f3185 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a00052b0 con 0x7fd5c806eb00 2023-10-08T16:09:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.009+0000 7f629d59a700 1 -- 172.21.15.12:0/2074882118 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000b640 con 0x7f62a0159380 2023-10-08T16:09:33.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629d59a700 1 -- 172.21.15.12:0/2074882118 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f629000b7a0 con 0x7f62a0159380 2023-10-08T16:09:33.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629d59a700 1 -- 172.21.15.12:0/2074882118 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629000bb40 con 0x7f62a0159380 2023-10-08T16:09:33.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 -- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 msgr2=0x7f62a0159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0159750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62900098e0 tx=0x7f62900091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7facb2b9d700 1 Processor -- start 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 -- 172.21.15.12:0/2074882118 shutdown_connections 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0159750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 --2- 172.21.15.12:0/2074882118 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.010+0000 7f629f59e700 1 -- 172.21.15.12:0/2074882118 >> 172.21.15.12:0/2074882118 conn(0x7f62a00703a0 msgr2=0x7f62a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.011+0000 7f629f59e700 1 -- 172.21.15.12:0/2074882118 shutdown_connections 2023-10-08T16:09:33.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.011+0000 7f629f59e700 1 -- 172.21.15.12:0/2074882118 wait complete. 2023-10-08T16:09:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.011+0000 7facb2b9d700 1 -- start start 2023-10-08T16:09:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.011+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f6c051960 con 0x7f1f70007000 2023-10-08T16:09:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.012+0000 7f629f59e700 1 Processor -- start 2023-10-08T16:09:33.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.012+0000 7f629f59e700 1 -- start start 2023-10-08T16:09:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.013+0000 7facb2b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.013+0000 7f629f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.013+0000 7facb1b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7facb1b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40148/0 (socket says 172.21.15.12:40148) 2023-10-08T16:09:33.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7facb1b9b700 1 -- 172.21.15.12:0/1767804668 learned_addr learned my addr 172.21.15.12:0/1767804668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 0x7f62a01519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a015afd0 con 0x7f62a00cea00 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a015b160 con 0x7f62a0159380 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00b3f70 con 0x7f62a00cb3f0 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50142/0 (socket says 172.21.15.12:50142) 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 -- 172.21.15.12:0/2085769170 learned_addr learned my addr 172.21.15.12:0/2085769170 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629dd9b700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 0x7f62a01519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 -- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 msgr2=0x7f62a0151f20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7facac15de50 0x7facac0c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629ed9d700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 -- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 msgr2=0x7f62a01519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac16cfb0 con 0x7facac0cef40 2023-10-08T16:09:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac0c9c40 con 0x7facac153c30 2023-10-08T16:09:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7facb239c700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7facac15de50 0x7facac0c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7facb139a700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 0x7f62a01519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facac16a060 con 0x7facac15de50 2023-10-08T16:09:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.014+0000 7f629e59c700 1 -- 172.21.15.12:0/2085769170 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290009420 con 0x7f62a00cb3f0 2023-10-08T16:09:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7f629dd9b700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 0x7f62a01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:33.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7f629ed9d700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.015+0000 7f629e59c700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62a006eb50 tx=0x7f6290017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 -- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7facac15de50 msgr2=0x7facac0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7facac15de50 0x7facac0c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 -- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 msgr2=0x7facac0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009420 con 0x7facac153c30 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb1b9b700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.016+0000 7facb139a700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac146fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faca0007c50 tx=0x7faca0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.017+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a0051250 con 0x7f14b00afe40 2023-10-08T16:09:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.017+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000d8a0 con 0x7facac153c30 2023-10-08T16:09:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.017+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000f040 con 0x7facac153c30 2023-10-08T16:09:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.017+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000dc50 con 0x7facac153c30 2023-10-08T16:09:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.017+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac16a340 con 0x7facac153c30 2023-10-08T16:09:33.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.018+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac16a900 con 0x7facac153c30 2023-10-08T16:09:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.019+0000 7ff05f7fe700 1 -- 172.21.15.12:0/819154993 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048009ea0 con 0x7ff06006ad90 2023-10-08T16:09:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.019+0000 7ff05f7fe700 1 -- 172.21.15.12:0/819154993 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff048005c10 con 0x7ff06006ad90 2023-10-08T16:09:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.019+0000 7ff05f7fe700 1 -- 172.21.15.12:0/819154993 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff048009ea0 con 0x7ff06006ad90 2023-10-08T16:09:33.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facac16aa90 con 0x7facac153c30 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faca001e3b0 con 0x7facac153c30 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7ff06599d700 1 -- 172.21.15.12:0/819154993 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 msgr2=0x7ff06006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7ff06599d700 1 --2- 172.21.15.12:0/819154993 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 0x7ff06006de50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff048009900 tx=0x7ff048009120 comp rx=0 tx=0).stop 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.021+0000 7ff06599d700 1 -- 172.21.15.12:0/819154993 shutdown_connections 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.021+0000 7ff06599d700 1 --2- 172.21.15.12:0/819154993 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff06006ad90 0x7ff06006de50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.021+0000 7ff06599d700 1 -- 172.21.15.12:0/819154993 >> 172.21.15.12:0/819154993 conn(0x7ff06006d170 msgr2=0x7ff0600cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.021+0000 7faca9ffb700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 0x7fac98069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.021+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faca0084620 con 0x7facac153c30 2023-10-08T16:09:33.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f629001bda0 con 0x7f62a00cb3f0 2023-10-08T16:09:33.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6290011420 con 0x7f62a00cb3f0 2023-10-08T16:09:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62900117e0 con 0x7f62a00cb3f0 2023-10-08T16:09:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a00b4250 con 0x7f62a00cb3f0 2023-10-08T16:09:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.020+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a00b4810 con 0x7f62a00cb3f0 2023-10-08T16:09:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.023+0000 7facb1b9b700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 0x7fac98069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.023+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62840052b0 con 0x7f62a00cb3f0 2023-10-08T16:09:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.023+0000 7ff06599d700 1 -- 172.21.15.12:0/819154993 shutdown_connections 2023-10-08T16:09:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.023+0000 7ff06599d700 1 -- 172.21.15.12:0/819154993 wait complete. 2023-10-08T16:09:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.024+0000 7facb1b9b700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 0x7fac98069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0093c0 tx=0x7fac9c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.025+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5b8012070 con 0x7fd5c806eb00 2023-10-08T16:09:33.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.025+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faca0055280 con 0x7facac153c30 2023-10-08T16:09:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.026+0000 7ff06599d700 1 Processor -- start 2023-10-08T16:09:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.026+0000 7fd5b67fc700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 0x7fd5a80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.026+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd5b8083ba0 con 0x7fd5c806eb00 2023-10-08T16:09:33.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.027+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5b80ae640 con 0x7fd5c806eb00 2023-10-08T16:09:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.026+0000 7ff06599d700 1 -- start start 2023-10-08T16:09:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.027+0000 7ff06599d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.027+0000 7fd5c5d9b700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 0x7fd5a80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.028+0000 7ff06499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.028+0000 7ff06499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40170/0 (socket says 172.21.15.12:40170) 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.028+0000 7ff06499b700 1 -- 172.21.15.12:0/1793064411 learned_addr learned my addr 172.21.15.12:0/1793064411 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.028+0000 7ff06599d700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff06006e390 0x7ff0601511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.029+0000 7ff06599d700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0601555e0 0x7ff06015c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.029+0000 7ff06599d700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff06006b200 con 0x7ff06006ad90 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.029+0000 7ff06599d700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0600ad2e0 con 0x7ff06006e390 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.029+0000 7ff06599d700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff06015c180 con 0x7ff0601555e0 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7ff06499b700 1 -- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0601555e0 msgr2=0x7ff06015c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.027+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6290011b90 con 0x7f62a00cb3f0 2023-10-08T16:09:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7f628e7fc700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 0x7f62800694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6290085b30 con 0x7f62a00cb3f0 2023-10-08T16:09:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7ff06499b700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0601555e0 0x7ff06015c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7ff06499b700 1 -- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff06006e390 msgr2=0x7ff0601511d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7ff06499b700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff06006e390 0x7ff0601511d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.030+0000 7ff06499b700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480093c0 con 0x7ff06006ad90 2023-10-08T16:09:33.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.031+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6290052e00 con 0x7f62a00cb3f0 2023-10-08T16:09:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.028+0000 7fd5c5d9b700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 0x7fd5a80694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8148da0 tx=0x7fd5bc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.031+0000 7ff06499b700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c810 tx=0x7ff050007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.032+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050005900 con 0x7ff06006ad90 2023-10-08T16:09:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.032+0000 7f629dd9b700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 0x7f62800694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.032+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050005a60 con 0x7ff06006ad90 2023-10-08T16:09:33.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.033+0000 7f629dd9b700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 0x7f62800694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6294006f00 tx=0x7f6294008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.033+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff050005de0 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.034+0000 7ff06599d700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0600ad510 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.034+0000 7ff06599d700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0600adad0 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.042+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff06004c3c0 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.045+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff050007300 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.047+0000 7ff05cff9700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 0x7ff0440694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.049+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff050084b20 con 0x7ff06006ad90 2023-10-08T16:09:33.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.050+0000 7ff05ffff700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 0x7ff0440694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.051+0000 7ff05ffff700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 0x7ff0440694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0600cce60 tx=0x7ff048015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:33.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.052+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff050051df0 con 0x7ff06006ad90 2023-10-08T16:09:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.453+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f59180581c0 con 0x7f5918053820 2023-10-08T16:09:33.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.454+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f89dc005830 con 0x7f89fc04ff70 2023-10-08T16:09:33.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.454+0000 7f590b7fe700 1 -- 172.21.15.12:0/1095478920 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5920096020 con 0x7f5918053820 2023-10-08T16:09:33.455 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2023-10-08T16:09:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.455+0000 7f89eaffd700 1 -- 172.21.15.12:0/2513225623 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89f805e200 con 0x7f89fc04ff70 2023-10-08T16:09:33.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.455+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1f50005560 con 0x7f1f70007000 2023-10-08T16:09:33.457 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2023-10-08T16:09:33.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.456+0000 7f1f637fe700 1 -- 172.21.15.12:0/3543361506 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1f6c054f80 con 0x7f1f70007000 2023-10-08T16:09:33.458 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2023-10-08T16:09:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.458+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 msgr2=0x7f5904069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.458+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 0x7f5904069530 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f59140093f0 tx=0x7f5914017000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 msgr2=0x7f59180df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5920062fd0 tx=0x7f592006b040 comp rx=0 tx=0).stop 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 msgr2=0x7f89f0069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 0x7f89f0069430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8a0405f200 tx=0x7f8a040673b0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 msgr2=0x7f89fc036a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.459+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 0x7f89fc036a80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89f8015000 tx=0x7f89f8016000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 shutdown_connections 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5904067080 0x7f5904069530 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59180e67f0 0x7f59180e2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5918053820 0x7f59180df860 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 --2- 172.21.15.12:0/1095478920 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59180e6420 0x7f59180e25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 >> 172.21.15.12:0/1095478920 conn(0x7f5918059130 msgr2=0x7f59180e1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 shutdown_connections 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89fc0d84b0 0x7f89fc0e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89fc00c1f0 0x7f89fc0ded10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89f0066f80 0x7f89f0069430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 --2- 172.21.15.12:0/2513225623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89fc04ff70 0x7f89fc036a80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 >> 172.21.15.12:0/2513225623 conn(0x7f89fc054d40 msgr2=0x7f89fc005f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 msgr2=0x7f1f5c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 shutdown_connections 2023-10-08T16:09:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f5924b9d700 1 -- 172.21.15.12:0/1095478920 wait complete. 2023-10-08T16:09:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 shutdown_connections 2023-10-08T16:09:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f89e8ff9700 1 -- 172.21.15.12:0/2513225623 wait complete. 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.460+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 0x7f1f5c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1f64009b90 tx=0x7f1f64009120 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 msgr2=0x7f1f70036890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 0x7f1f70036890 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c006fd0 tx=0x7f1f6c009250 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 shutdown_connections 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1f5c066fb0 0x7f1f5c069460 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f700dd000 0x7f1f70034b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f70007000 0x7f1f70036890 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 --2- 172.21.15.12:0/3543361506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f700e0bf0 0x7f1f700dcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 >> 172.21.15.12:0/3543361506 conn(0x7f1f70054d70 msgr2=0x7f1f7004fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.461+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 shutdown_connections 2023-10-08T16:09:33.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.462+0000 7f1f617fa700 1 -- 172.21.15.12:0/3543361506 wait complete. 2023-10-08T16:09:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.476+0000 7f14b6bff700 1 -- 172.21.15.12:0/154776931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f14b004c3c0 con 0x7f14b00afe40 2023-10-08T16:09:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.477+0000 7f14acff9700 1 -- 172.21.15.12:0/154776931 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14a0054870 con 0x7f14b00afe40 2023-10-08T16:09:33.478 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:33.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.481+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 msgr2=0x7f1490069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.481+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 0x7f1490069500 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f1498007c60 tx=0x7f1498015000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 msgr2=0x7f14b00c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e850 tx=0x7f14a000c040 comp rx=0 tx=0).stop 2023-10-08T16:09:33.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 shutdown_connections 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1490067050 0x7f1490069500 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14b00c7ae0 0x7f14b00ab9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14b01511f0 0x7f14b00af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.482+0000 7f14a67fc700 1 --2- 172.21.15.12:0/154776931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14b00afe40 0x7f14b00c75a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.483+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 >> 172.21.15.12:0/154776931 conn(0x7f14b00c8bb0 msgr2=0x7f14b0155580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.483+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 shutdown_connections 2023-10-08T16:09:33.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.483+0000 7f14a67fc700 1 -- 172.21.15.12:0/154776931 wait complete. 2023-10-08T16:09:33.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.485+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f6284005830 con 0x7f62a00cb3f0 2023-10-08T16:09:33.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.486+0000 7f628e7fc700 1 -- 172.21.15.12:0/2085769170 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6290056420 con 0x7f62a00cb3f0 2023-10-08T16:09:33.487 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.487+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5a0005830 con 0x7fd5c806eb00 2023-10-08T16:09:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.487+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7facac04c3c0 con 0x7facac153c30 2023-10-08T16:09:33.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.488+0000 7faca9ffb700 1 -- 172.21.15.12:0/1767804668 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faca001a020 con 0x7facac153c30 2023-10-08T16:09:33.489 INFO:teuthology.orchestra.run.smithi012.stdout:55834574853 2023-10-08T16:09:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.489+0000 7fd5b67fc700 1 -- 172.21.15.12:0/1366705649 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5b8050e70 con 0x7fd5c806eb00 2023-10-08T16:09:33.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.489+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 msgr2=0x7f62800694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.491 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:33.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.490+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 0x7f62800694b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6294006f00 tx=0x7f6294008040 comp rx=0 tx=0).stop 2023-10-08T16:09:33.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.490+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 msgr2=0x7f62a00c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.490+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f62a006eb50 tx=0x7f6290017000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.490+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 shutdown_connections 2023-10-08T16:09:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62a0159380 0x7f62a0151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62a00cb3f0 0x7f62a00c6900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6280067000 0x7f62800694b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 --2- 172.21.15.12:0/2085769170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62a00cea00 0x7f62a01519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 >> 172.21.15.12:0/2085769170 conn(0x7f62a00703a0 msgr2=0x7f62a00b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 shutdown_connections 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 msgr2=0x7fac98069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 0x7fac98069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0093c0 tx=0x7fac9c017000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 msgr2=0x7facac146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac146fa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faca0007c50 tx=0x7faca0009250 comp rx=0 tx=0).stop 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.491+0000 7f629f59e700 1 -- 172.21.15.12:0/2085769170 wait complete. 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 shutdown_connections 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fac98066fb0 0x7fac98069460 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7facac0cef40 0x7facac0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7facac15de50 0x7facac0c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 --2- 172.21.15.12:0/1767804668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7facac153c30 0x7facac146fa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.492+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 >> 172.21.15.12:0/1767804668 conn(0x7facac0703a0 msgr2=0x7facac0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.494+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 msgr2=0x7fd5a80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.494+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 0x7fd5a80694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8148da0 tx=0x7fd5bc009040 comp rx=0 tx=0).stop 2023-10-08T16:09:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.494+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 msgr2=0x7fd5c8145f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.494+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800bec0 tx=0x7fd5b80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2023-10-08T16:09:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 shutdown_connections 2023-10-08T16:09:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd5a8067000 0x7fd5a80694b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5c815ab70 0x7fd5c8158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5c806eb00 0x7fd5c8145f40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-10-08T16:09:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 --2- 172.21.15.12:0/1366705649 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5c80cb8e0 0x7fd5c8144db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 >> 172.21.15.12:0/1366705649 conn(0x7fd5c80cc300 msgr2=0x7fd5c8069ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.495+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ff0600ab7f0 con 0x7ff06006ad90 2023-10-08T16:09:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 shutdown_connections 2023-10-08T16:09:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 shutdown_connections 2023-10-08T16:09:33.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7ff05cff9700 1 -- 172.21.15.12:0/1793064411 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff050055410 con 0x7ff06006ad90 2023-10-08T16:09:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7facb2b9d700 1 -- 172.21.15.12:0/1767804668 wait complete. 2023-10-08T16:09:33.500 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.496+0000 7fd5a7fff700 1 -- 172.21.15.12:0/1366705649 wait complete. 2023-10-08T16:09:33.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 msgr2=0x7ff0440694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 0x7ff0440694b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff0600cce60 tx=0x7ff048015000 comp rx=0 tx=0).stop 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 msgr2=0x7ff0600acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff05000c810 tx=0x7ff050007f20 comp rx=0 tx=0).stop 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 shutdown_connections 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff044067000 0x7ff0440694b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff06006ad90 0x7ff0600acda0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0601555e0 0x7ff06015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 --2- 172.21.15.12:0/1793064411 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff06006e390 0x7ff0601511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 >> 172.21.15.12:0/1793064411 conn(0x7ff06006d170 msgr2=0x7ff060160390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 shutdown_connections 2023-10-08T16:09:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:33.500+0000 7ff0567fc700 1 -- 172.21.15.12:0/1793064411 wait complete. 2023-10-08T16:09:33.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-08T16:09:33.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-08T16:09:33.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2023-10-08T16:09:33.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-10-08T16:09:33.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.3 2023-10-08T16:09:34.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-08T16:09:34.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-08T16:09:34.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-08T16:09:34.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-08T16:09:34.518 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-08T16:09:34.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-08T16:09:34.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-08T16:09:34.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-08T16:09:34.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.800+0000 7f913ad9d700 1 Processor -- start 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.800+0000 7f913ad9d700 1 -- start start 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f913ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f912c0e0bc0 0x7f912c0ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f913ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f912c0e0f90 0x7f912c0ea800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f913ad9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912c037710 con 0x7f912c0068c0 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f913ad9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0eb160 con 0x7f912c0e0bc0 2023-10-08T16:09:34.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f913ad9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f912c0535f0 con 0x7f912c0e0f90 2023-10-08T16:09:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.803+0000 7f9139d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f912c0e0bc0 0x7f912c0ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.804+0000 7ff5b9f9d700 1 Processor -- start 2023-10-08T16:09:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.804+0000 7f9139d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f912c0e0bc0 0x7f912c0ea2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40178/0 (socket says 172.21.15.12:40178) 2023-10-08T16:09:34.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.804+0000 7f9139d9b700 1 -- 172.21.15.12:0/507200224 learned_addr learned my addr 172.21.15.12:0/507200224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.805+0000 7f9139d9b700 1 -- 172.21.15.12:0/507200224 >> v2:172.21.15.29:3300/0 conn(0x7f912c0e0f90 msgr2=0x7f912c0ea800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:34.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.805+0000 7f9139d9b700 1 --2- 172.21.15.12:0/507200224 >> v2:172.21.15.29:3300/0 conn(0x7f912c0e0f90 0x7f912c0ea800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.805+0000 7f9139d9b700 1 -- 172.21.15.12:0/507200224 >> v1:172.21.15.12:6789/0 conn(0x7f912c0068c0 legacy=0x7f912c006d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.805+0000 7f9139d9b700 1 -- 172.21.15.12:0/507200224 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c054a90 con 0x7f912c0e0bc0 2023-10-08T16:09:34.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.806+0000 7f9139d9b700 1 --2- 172.21.15.12:0/507200224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c0e0bc0 0x7f912c0ea2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9134065460 tx=0x7f91340673b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76c1388533f484b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.806+0000 7f9138d99700 1 -- 172.21.15.12:0/507200224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340008d0 con 0x7f912c0e0bc0 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7f9138d99700 1 -- 172.21.15.12:0/507200224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134064550 con 0x7f912c0e0bc0 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7f9138d99700 1 -- 172.21.15.12:0/507200224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134064700 con 0x7f912c0e0bc0 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.804+0000 7ff5b9f9d700 1 -- start start 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7ff5b9f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5ac0e0aa0 0x7ff5ac0ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7ff5b9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 0x7ff5ac0ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7ff5b9f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0375f0 con 0x7ff5ac0067a0 2023-10-08T16:09:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7ff5b9f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0eb040 con 0x7ff5ac0e0aa0 2023-10-08T16:09:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.807+0000 7ff5b9f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0534d0 con 0x7ff5ac0e0e70 2023-10-08T16:09:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7ff5b8f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff5ac0e0aa0 0x7ff5ac0ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 -- 172.21.15.12:0/507200224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c0e0bc0 msgr2=0x7f912c0ea2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 --2- 172.21.15.12:0/507200224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c0e0bc0 0x7f912c0ea2c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9134065460 tx=0x7f91340673b0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 0x7ff5ac0ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7ff5b979c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff5ac0067a0 0x7ff5ac006bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46996/0 (socket says 172.21.15.12:46996) 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 -- 172.21.15.12:0/507200224 shutdown_connections 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 --2- 172.21.15.12:0/507200224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c0e0bc0 0x7f912c0ea2c0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9134065460 tx=0x7f91340673b0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 --2- 172.21.15.12:0/507200224 >> v2:172.21.15.29:3300/0 conn(0x7f912c0e0f90 0x7f912c0ea800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.808+0000 7f913ad9d700 1 -- 172.21.15.12:0/507200224 >> 172.21.15.12:0/507200224 conn(0x7f912c054d40 msgr2=0x7f912c055140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.809+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 0x7ff5ac0ea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50170/0 (socket says 172.21.15.12:50170) 2023-10-08T16:09:34.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.809+0000 7ff5b979c700 1 -- 172.21.15.12:0/692585504 learned_addr learned my addr 172.21.15.12:0/692585504 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:34.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.809+0000 7f913ad9d700 1 -- 172.21.15.12:0/507200224 shutdown_connections 2023-10-08T16:09:34.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.809+0000 7f913ad9d700 1 -- 172.21.15.12:0/507200224 wait complete. 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.810+0000 7ff5b8f9b700 1 -- 172.21.15.12:0/692585504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 msgr2=0x7ff5ac0ea6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.810+0000 7ff5b8f9b700 1 --2- 172.21.15.12:0/692585504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 0x7ff5ac0ea6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.810+0000 7ff5b8f9b700 1 -- 172.21.15.12:0/692585504 >> v1:172.21.15.12:6789/0 conn(0x7ff5ac0067a0 legacy=0x7ff5ac006bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.811+0000 7ff5b8f9b700 1 -- 172.21.15.12:0/692585504 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac054970 con 0x7ff5ac0e0aa0 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.812+0000 7ff5b8f9b700 1 --2- 172.21.15.12:0/692585504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac0e0aa0 0x7ff5ac0ea1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098e0 tx=0x7ff5a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cf44e4e42b2e8ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.812+0000 7ff5b37fe700 1 -- 172.21.15.12:0/692585504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0009e80 con 0x7ff5ac0e0aa0 2023-10-08T16:09:34.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.812+0000 7ff5b37fe700 1 -- 172.21.15.12:0/692585504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a000b820 con 0x7ff5ac0e0aa0 2023-10-08T16:09:34.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.813+0000 7ff5b37fe700 1 -- 172.21.15.12:0/692585504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a000bba0 con 0x7ff5ac0e0aa0 2023-10-08T16:09:34.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.813+0000 7f913ad9d700 1 Processor -- start 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7f913ad9d700 1 -- start start 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/692585504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac0e0aa0 msgr2=0x7ff5ac0ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 --2- 172.21.15.12:0/692585504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac0e0aa0 0x7ff5ac0ea1a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098e0 tx=0x7ff5a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/692585504 shutdown_connections 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 --2- 172.21.15.12:0/692585504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac0e0aa0 0x7ff5ac0ea1a0 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098e0 tx=0x7ff5a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 --2- 172.21.15.12:0/692585504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e0e70 0x7ff5ac0ea6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.814+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/692585504 >> 172.21.15.12:0/692585504 conn(0x7ff5ac054c20 msgr2=0x7ff5ac055020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.816+0000 7f913ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f912c0068c0 0x7f912c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.816+0000 7f913ad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f912c0e1370 0x7f912c0dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913ad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c036100 con 0x7f912c037ae0 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913ad9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912c035ad0 con 0x7f912c0068c0 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40202/0 (socket says 172.21.15.12:40202) 2023-10-08T16:09:34.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.817+0000 7f913a59c700 1 -- 172.21.15.12:0/2340282451 learned_addr learned my addr 172.21.15.12:0/2340282451 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913ad9d700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f912c0e18c0 con 0x7f912c0e1370 2023-10-08T16:09:34.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/692585504 shutdown_connections 2023-10-08T16:09:34.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/692585504 wait complete. 2023-10-08T16:09:34.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.820+0000 7ff5b9f9d700 1 Processor -- start 2023-10-08T16:09:34.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.821+0000 7ff5b9f9d700 1 -- start start 2023-10-08T16:09:34.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.823+0000 7ff5b9f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 0x7ff5ac0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913a59c700 1 -- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f912c0e1370 msgr2=0x7f912c0dd180 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:34.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913a59c700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f912c0e1370 0x7f912c0dd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.823+0000 7ff5b9f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 0x7ff5ac03a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913a59c700 1 -- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f912c0068c0 msgr2=0x7f912c03a3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:34.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913a59c700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f912c0068c0 0x7f912c03a3b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.818+0000 7f913a59c700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c035d90 con 0x7f912c037ae0 2023-10-08T16:09:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.819+0000 7f913a59c700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f913000c5b0 tx=0x7f9130007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.819+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011590 con 0x7f912c037ae0 2023-10-08T16:09:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.819+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9130011710 con 0x7f912c037ae0 2023-10-08T16:09:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.819+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130011ad0 con 0x7f912c037ae0 2023-10-08T16:09:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.825+0000 7f913ad9d700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912c03a8f0 con 0x7f912c037ae0 2023-10-08T16:09:34.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.825+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 0x7ff5ac03a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e1b40 0x7ff5ac0e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b9f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac038bc0 con 0x7ff5ac038490 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b8f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 0x7ff5ac0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b8f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 0x7ff5ac0cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47056/0 (socket says 172.21.15.12:47056) 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b8f9b700 1 -- 172.21.15.12:0/304779797 learned_addr learned my addr 172.21.15.12:0/304779797 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d24b0 con 0x7ff5ac0067a0 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac0d2790 con 0x7ff5ac0e1b40 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.826+0000 7ff5b979c700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e1b40 0x7ff5ac0e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.827+0000 7ff5b3fff700 1 -- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e1b40 msgr2=0x7ff5ac0e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.827+0000 7ff5b3fff700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e1b40 0x7ff5ac0e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.827+0000 7ff5b3fff700 1 -- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 msgr2=0x7ff5ac0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.827+0000 7ff5b3fff700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 0x7ff5ac0cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.827+0000 7ff5b3fff700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009420 con 0x7ff5ac038490 2023-10-08T16:09:34.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.828+0000 7f913ad9d700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912c037f40 con 0x7f912c037ae0 2023-10-08T16:09:34.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.830+0000 7f913ad9d700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912c0053d0 con 0x7f912c037ae0 2023-10-08T16:09:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.829+0000 7ff5b3fff700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 0x7ff5ac03a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5b404c860 tx=0x7ff5b406b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.830+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40636e0 con 0x7ff5ac038490 2023-10-08T16:09:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.830+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b406d820 con 0x7ff5ac038490 2023-10-08T16:09:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.830+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b406dbc0 con 0x7ff5ac038490 2023-10-08T16:09:34.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.831+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac0d2a70 con 0x7ff5ac038490 2023-10-08T16:09:34.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.832+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f913001c460 con 0x7f912c037ae0 2023-10-08T16:09:34.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.833+0000 7f9129ffb700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 0x7f91180694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.834+0000 7f9139d9b700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 0x7f91180694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.835+0000 7f9139d9b700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 0x7f91180694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f912c00dae0 tx=0x7f9134068000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.835+0000 7ff5b9f9d700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac0e1620 con 0x7ff5ac038490 2023-10-08T16:09:34.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.839+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9130055050 con 0x7f912c037ae0 2023-10-08T16:09:34.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.840+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac0e1810 con 0x7ff5ac038490 2023-10-08T16:09:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.840+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5b40675a0 con 0x7ff5ac038490 2023-10-08T16:09:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.842+0000 7ff5b0ff9700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 0x7ff5980694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.843+0000 7ff5b8f9b700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 0x7ff5980694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.844+0000 7ff5b8f9b700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 0x7ff5980694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c010 tx=0x7ff5a0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.844+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9130089060 con 0x7f912c037ae0 2023-10-08T16:09:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.852+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff5b408d070 con 0x7ff5ac038490 2023-10-08T16:09:34.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.852+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5b40c8420 con 0x7ff5ac038490 2023-10-08T16:09:34.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.880+0000 7f89e35ff700 1 Processor -- start 2023-10-08T16:09:34.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.881+0000 7f89e35ff700 1 -- start start 2023-10-08T16:09:34.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.883+0000 7f89e35ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc157270 0x7f89dc15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.883+0000 7f89e35ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89dc158110 0x7f89dc1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.883+0000 7f89e35ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc157c80 con 0x7f89dc157640 2023-10-08T16:09:34.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.883+0000 7f89e35ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc15bf10 con 0x7f89dc158110 2023-10-08T16:09:34.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.883+0000 7f89e35ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15b670 con 0x7f89dc157270 2023-10-08T16:09:34.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.884+0000 7f89e239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89dc158110 0x7f89dc1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89dc158110 0x7f89dc1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40230/0 (socket says 172.21.15.12:40230) 2023-10-08T16:09:34.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 -- 172.21.15.12:0/82917756 learned_addr learned my addr 172.21.15.12:0/82917756 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e139b700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc157270 0x7f89dc15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 -- 172.21.15.12:0/82917756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc157270 msgr2=0x7f89dc15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc157270 0x7f89dc15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 -- 172.21.15.12:0/82917756 >> v1:172.21.15.29:6789/0 conn(0x7f89dc157640 legacy=0x7f89dc0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.885+0000 7f89e239d700 1 -- 172.21.15.12:0/82917756 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc15b950 con 0x7f89dc158110 2023-10-08T16:09:34.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.886+0000 7f89e239d700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc158110 0x7f89dc1585b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009ec0 tx=0x7f89d40097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6d142e94dbe513f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.887+0000 7f89d3fff700 1 -- 172.21.15.12:0/82917756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400e070 con 0x7f89dc158110 2023-10-08T16:09:34.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.888+0000 7f89d3fff700 1 -- 172.21.15.12:0/82917756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d400bbf0 con 0x7f89dc158110 2023-10-08T16:09:34.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.888+0000 7f89d3fff700 1 -- 172.21.15.12:0/82917756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4012430 con 0x7f89dc158110 2023-10-08T16:09:34.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.889+0000 7f89e35ff700 1 -- 172.21.15.12:0/82917756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc158110 msgr2=0x7f89dc1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.889+0000 7f89e35ff700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc158110 0x7f89dc1585b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009ec0 tx=0x7f89d40097e0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.890+0000 7f89e35ff700 1 -- 172.21.15.12:0/82917756 shutdown_connections 2023-10-08T16:09:34.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.890+0000 7f89e35ff700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc158110 0x7f89dc1585b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.890+0000 7f89e35ff700 1 --2- 172.21.15.12:0/82917756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc157270 0x7f89dc15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.890+0000 7f89e35ff700 1 -- 172.21.15.12:0/82917756 >> 172.21.15.12:0/82917756 conn(0x7f89dc0ce3d0 msgr2=0x7f89dc0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.890+0000 7f89e35ff700 1 -- 172.21.15.12:0/82917756 shutdown_connections 2023-10-08T16:09:34.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.891+0000 7f89e35ff700 1 -- 172.21.15.12:0/82917756 wait complete. 2023-10-08T16:09:34.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.893+0000 7f89e35ff700 1 Processor -- start 2023-10-08T16:09:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f4b7c9fe700 1 Processor -- start 2023-10-08T16:09:34.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f4b7c9fe700 1 -- start start 2023-10-08T16:09:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.894+0000 7f89e35ff700 1 -- start start 2023-10-08T16:09:34.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 0x7f89dc1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc158110 0x7f89dc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15e0d0 con 0x7f89dc157270 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0cc680 con 0x7f89dc157640 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e35ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc156d30 con 0x7f89dc158110 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e0b9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e0b9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47060/0 (socket says 172.21.15.12:47060) 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e0b9a700 1 -- 172.21.15.12:0/2586509236 learned_addr learned my addr 172.21.15.12:0/2586509236 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.896+0000 7f89e139b700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 0x7f89dc1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 -- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc158110 msgr2=0x7f89dc0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc158110 0x7f89dc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 -- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 msgr2=0x7f89dc1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 0x7f89dc1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 -- 172.21.15.12:0/2586509236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d4009a80 con 0x7f89dc157640 2023-10-08T16:09:34.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.897+0000 7f89e0b9a700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c7f0 tx=0x7f89cc007f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f38d6f9d700 1 Processor -- start 2023-10-08T16:09:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f4b7c9fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4b780b2980 0x7f4b780cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f4b7c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f4b7c9fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b780cec30 con 0x7f4b7806ddd0 2023-10-08T16:09:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f4b7759e700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f4b7806ddd0 0x7f4b7815d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42014/0 (socket says 172.21.15.12:42014) 2023-10-08T16:09:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f4b7759e700 1 -- 172.21.15.12:0/174597573 learned_addr learned my addr 172.21.15.12:0/174597573 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011590 con 0x7f89dc157640 2023-10-08T16:09:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7806e270 con 0x7f4b780b2980 2023-10-08T16:09:34.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780ce930 con 0x7f4b7815a8c0 2023-10-08T16:09:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0116f0 con 0x7f89dc157640 2023-10-08T16:09:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc011ab0 con 0x7f89dc157640 2023-10-08T16:09:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc0cd050 con 0x7f89dc157640 2023-10-08T16:09:34.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.899+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc0cc030 con 0x7f89dc157640 2023-10-08T16:09:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b7659c700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b75d9b700 1 -- 172.21.15.12:0/174597573 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212696591 0 0) 0x7f4b780cec30 con 0x7f4b7806ddd0 2023-10-08T16:09:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/174597573 >> v2:172.21.15.12:3300/0 conn(0x7f4b780b2980 0x7f4b780cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f89e139b700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 0x7f89dc1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:34.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.900+0000 7f4b75d9b700 1 -- 172.21.15.12:0/174597573 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b60003570 con 0x7f4b7806ddd0 2023-10-08T16:09:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc04c3c0 con 0x7f89dc157640 2023-10-08T16:09:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f4b76d9d700 1 -- 172.21.15.12:0/174597573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 msgr2=0x7f4b7806d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7806d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f4b76d9d700 1 -- 172.21.15.12:0/174597573 >> v1:172.21.15.29:6789/0 conn(0x7f4b7806ddd0 legacy=0x7f4b7815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f4b76d9d700 1 -- 172.21.15.12:0/174597573 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780d00d0 con 0x7f4b780b2980 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.903+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b780b2980 0x7f4b780cce00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b680098e0 tx=0x7f4b680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25829f48af7f87c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.898+0000 7f38d6f9d700 1 -- start start 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f38d6f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c80dc600 0x7f38c8054290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f38d6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f38d6f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38c8007090 con 0x7f38c8006b50 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f38d6f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38c8007370 con 0x7f38c80dc600 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.901+0000 7f38d6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c8007650 con 0x7f38c80547d0 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c80dc600 0x7f38c8054290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38c80dc600 0x7f38c8054290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47076/0 (socket says 172.21.15.12:47076) 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 -- 172.21.15.12:0/3165671114 learned_addr learned my addr 172.21.15.12:0/3165671114 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d579a700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 -- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 msgr2=0x7f38c80e5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80e5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.902+0000 7f38d5f9b700 1 -- 172.21.15.12:0/3165671114 >> v1:172.21.15.12:6789/0 conn(0x7f38c8006b50 legacy=0x7f38c80e28d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.903+0000 7f38d5f9b700 1 -- 172.21.15.12:0/3165671114 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c8007930 con 0x7f38c80dc600 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.903+0000 7f38d5f9b700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c8054290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38d0065460 tx=0x7f38d00673b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ea61661d9790c9b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.904+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89cc01c440 con 0x7f89dc157640 2023-10-08T16:09:34.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.904+0000 7f4b75d9b700 1 -- 172.21.15.12:0/174597573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011630 con 0x7f4b780b2980 2023-10-08T16:09:34.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.905+0000 7f4b75d9b700 1 -- 172.21.15.12:0/174597573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68011790 con 0x7f4b780b2980 2023-10-08T16:09:34.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.905+0000 7f4b75d9b700 1 -- 172.21.15.12:0/174597573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011b10 con 0x7f4b780b2980 2023-10-08T16:09:34.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.905+0000 7f89d17fa700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 0x7f89c0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.905+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89cc083d40 con 0x7f89dc157640 2023-10-08T16:09:34.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f89e139b700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 0x7f89c0069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b780b2980 msgr2=0x7f4b780cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b780b2980 0x7f4b780cce00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4b680098e0 tx=0x7f4b680091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 shutdown_connections 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b780b2980 0x7f4b780cce00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/174597573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7806d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 >> 172.21.15.12:0/174597573 conn(0x7f4b780703a0 msgr2=0x7f4b780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 shutdown_connections 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.906+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/174597573 wait complete. 2023-10-08T16:09:34.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.907+0000 7f89e139b700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 0x7f89c0069430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89dc158750 tx=0x7f89d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.907+0000 7f943cdff700 1 Processor -- start 2023-10-08T16:09:34.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.907+0000 7f943cdff700 1 -- start start 2023-10-08T16:09:34.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.908+0000 7f38d4f99700 1 -- 172.21.15.12:0/3165671114 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00008d0 con 0x7f38c80dc600 2023-10-08T16:09:34.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.908+0000 7f38d4f99700 1 -- 172.21.15.12:0/3165671114 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d0064550 con 0x7f38c80dc600 2023-10-08T16:09:34.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.908+0000 7f38d4f99700 1 -- 172.21.15.12:0/3165671114 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00646e0 con 0x7f38c80dc600 2023-10-08T16:09:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7ff1447ff700 1 Processor -- start 2023-10-08T16:09:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7f4b7c9fe700 1 Processor -- start 2023-10-08T16:09:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7f38d6f9d700 1 -- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 msgr2=0x7f38c8054290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c8054290 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38d0065460 tx=0x7f38d00673b0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7f4b7c9fe700 1 -- start start 2023-10-08T16:09:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.909+0000 7ff1447ff700 1 -- start start 2023-10-08T16:09:34.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89cc050f90 con 0x7f89dc157640 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7f943cdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f9438159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7f943cdff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f943815a400 0x7f9438156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7f9436d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f943815a400 0x7f9438156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f9436d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f943815a400 0x7f9438156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40270/0 (socket says 172.21.15.12:40270) 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f9436d9d700 1 -- 172.21.15.12:0/3585934440 learned_addr learned my addr 172.21.15.12:0/3585934440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7f943cdff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f943815ae40 con 0x7f94380cb5a0 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94380ce0f0 con 0x7f943815a400 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94380cbde0 con 0x7f94380cb970 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f38d6f9d700 1 -- 172.21.15.12:0/3165671114 shutdown_connections 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c8054290 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/3165671114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80e5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f38d6f9d700 1 -- 172.21.15.12:0/3165671114 >> 172.21.15.12:0/3165671114 conn(0x7f38c8055ba0 msgr2=0x7f38c8055fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.910+0000 7ff1447ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cb5a0 0x7ff13c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff1447ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff13c0cde50 0x7ff13c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff1447ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff13c15ae40 con 0x7ff13c0cd9e0 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff1447ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0d13f0 con 0x7ff13c0cde50 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff1447ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c15ab60 con 0x7ff13c0cb5a0 2023-10-08T16:09:34.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f4b7c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff142d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff13c0cde50 0x7ff13c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff142d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff13c0cde50 0x7ff13c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40274/0 (socket says 172.21.15.12:40274) 2023-10-08T16:09:34.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7ff142d9c700 1 -- 172.21.15.12:0/909722989 learned_addr learned my addr 172.21.15.12:0/909722989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.911+0000 7f4b76d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b76d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40276/0 (socket says 172.21.15.12:40276) 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7c9fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b780b2980 0x7f4b780c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b76d9d700 1 -- 172.21.15.12:0/3914135388 learned_addr learned my addr 172.21.15.12:0/3914135388 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f9436d9d700 1 -- 172.21.15.12:0/3585934440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 msgr2=0x7f9438159ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f9436d9d700 1 --2- 172.21.15.12:0/3585934440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f9438159ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f9436d9d700 1 -- 172.21.15.12:0/3585934440 >> v1:172.21.15.29:6789/0 conn(0x7f94380cb5a0 legacy=0x7f94380cd9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f9436d9d700 1 -- 172.21.15.12:0/3585934440 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943815ab60 con 0x7f943815a400 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c8a10 con 0x7f4b7806ddd0 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7ff142d9c700 1 -- 172.21.15.12:0/909722989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cb5a0 msgr2=0x7ff13c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7ff142d9c700 1 --2- 172.21.15.12:0/909722989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cb5a0 0x7ff13c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7ff142d9c700 1 -- 172.21.15.12:0/909722989 >> v1:172.21.15.29:6789/0 conn(0x7ff13c0cd9e0 legacy=0x7ff13c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7ff142d9c700 1 -- 172.21.15.12:0/909722989 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0ccf00 con 0x7ff13c0cde50 2023-10-08T16:09:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7759e700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c7b80 con 0x7f4b780b2980 2023-10-08T16:09:34.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b780c7e00 con 0x7f4b7815a8c0 2023-10-08T16:09:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7ff142d9c700 1 --2- 172.21.15.12:0/909722989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cde50 0x7ff13c156e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b1f0 tx=0x7ff134009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85425302f5a8dc1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.912+0000 7f9436d9d700 1 --2- 172.21.15.12:0/3585934440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f943815a400 0x7f9438156e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94200099e0 tx=0x7f9420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22aa869f48602a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f943559a700 1 -- 172.21.15.12:0/3585934440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942000b7e0 con 0x7f943815a400 2023-10-08T16:09:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f943559a700 1 -- 172.21.15.12:0/3585934440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942000b940 con 0x7f943815a400 2023-10-08T16:09:34.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f943559a700 1 -- 172.21.15.12:0/3585934440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942000bce0 con 0x7f943815a400 2023-10-08T16:09:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f4b76d9d700 1 -- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 msgr2=0x7f4b7814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f4b76d9d700 1 -- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b780b2980 msgr2=0x7f4b780c7640 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:09:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b780b2980 0x7f4b780c7640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7f4b76d9d700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68009420 con 0x7f4b7806ddd0 2023-10-08T16:09:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7ff141599700 1 -- 172.21.15.12:0/909722989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400e070 con 0x7ff13c0cde50 2023-10-08T16:09:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.913+0000 7ff141599700 1 -- 172.21.15.12:0/909722989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400bcc0 con 0x7ff13c0cde50 2023-10-08T16:09:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7ff141599700 1 -- 172.21.15.12:0/909722989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400be30 con 0x7ff13c0cde50 2023-10-08T16:09:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7f38d6f9d700 1 -- 172.21.15.12:0/3165671114 shutdown_connections 2023-10-08T16:09:34.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7f38d6f9d700 1 -- 172.21.15.12:0/3165671114 wait complete. 2023-10-08T16:09:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f943815a400 msgr2=0x7f9438156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7f943cdff700 1 --2- 172.21.15.12:0/3585934440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f943815a400 0x7f9438156e90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f94200099e0 tx=0x7f9420009250 comp rx=0 tx=0).stop 2023-10-08T16:09:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7ff1447ff700 1 -- 172.21.15.12:0/909722989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cde50 msgr2=0x7ff13c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7ff1447ff700 1 --2- 172.21.15.12:0/909722989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cde50 0x7ff13c156e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff13400b1f0 tx=0x7ff134009840 comp rx=0 tx=0).stop 2023-10-08T16:09:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.914+0000 7f4b76d9d700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b68011f50 tx=0x7f4b68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011900 con 0x7f4b7806ddd0 2023-10-08T16:09:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 shutdown_connections 2023-10-08T16:09:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f943cdff700 1 --2- 172.21.15.12:0/3585934440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f943815a400 0x7f9438156e90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f943cdff700 1 --2- 172.21.15.12:0/3585934440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f9438159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 >> 172.21.15.12:0/3585934440 conn(0x7f9438070e30 msgr2=0x7f94380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b780c80e0 con 0x7f4b7806ddd0 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b780c86a0 con 0x7f4b7806ddd0 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68011a60 con 0x7f4b7806ddd0 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68025630 con 0x7f4b7806ddd0 2023-10-08T16:09:34.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.915+0000 7f38d6f9d700 1 Processor -- start 2023-10-08T16:09:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7f77ba3ff700 1 Processor -- start 2023-10-08T16:09:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 -- 172.21.15.12:0/909722989 shutdown_connections 2023-10-08T16:09:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 --2- 172.21.15.12:0/909722989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cde50 0x7ff13c156e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 --2- 172.21.15.12:0/909722989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cb5a0 0x7ff13c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 -- 172.21.15.12:0/909722989 >> 172.21.15.12:0/909722989 conn(0x7ff13c070e30 msgr2=0x7ff13c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 -- 172.21.15.12:0/909722989 shutdown_connections 2023-10-08T16:09:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7f77ba3ff700 1 -- start start 2023-10-08T16:09:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.916+0000 7ff1447ff700 1 -- 172.21.15.12:0/909722989 wait complete. 2023-10-08T16:09:34.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.917+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 shutdown_connections 2023-10-08T16:09:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.917+0000 7f943cdff700 1 -- 172.21.15.12:0/3585934440 wait complete. 2023-10-08T16:09:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.917+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7804c3c0 con 0x7f4b7806ddd0 2023-10-08T16:09:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.918+0000 7ff1447ff700 1 Processor -- start 2023-10-08T16:09:34.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7f77ba3ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77b41557a0 0x7f77b4156950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7ff1447ff700 1 -- start start 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7f77ba3ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77b4155b70 0x7f77b40afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7f77ba3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 0x7f77b40b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77b37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77b4155b70 0x7f77b40afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77b37fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77b4155b70 0x7f77b40afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47090/0 (socket says 172.21.15.12:47090) 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77b899c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 0x7f77b40b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77b899c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 0x7f77b40b01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50258/0 (socket says 172.21.15.12:50258) 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7f77b3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77b41557a0 0x7f77b4156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77b37fe700 1 -- 172.21.15.12:0/1529181516 learned_addr learned my addr 172.21.15.12:0/1529181516 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b4157fe0 con 0x7f77b41557a0 2023-10-08T16:09:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7ff1447ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 0x7ff13c0b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b41573d0 con 0x7f77b4155b70 2023-10-08T16:09:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f943cdff700 1 Processor -- start 2023-10-08T16:09:34.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7ff1447ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 0x7ff13c0cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b41576b0 con 0x7f77b40b1e00 2023-10-08T16:09:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7ff1447ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff1447ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b3f70 con 0x7ff13c0cb5a0 2023-10-08T16:09:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff1447ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b4250 con 0x7ff13c0b34b0 2023-10-08T16:09:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff1447ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0b4530 con 0x7ff13c0cd9e0 2023-10-08T16:09:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.919+0000 7f38d6f9d700 1 -- start start 2023-10-08T16:09:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.920+0000 7f38d6f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c8006b50 0x7f38c80cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d6f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c80dace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d6f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c800d480 con 0x7f38c8006b50 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d6f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c800d760 con 0x7f38c80dc600 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c800da40 con 0x7f38c80547d0 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff142d9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff142d9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47094/0 (socket says 172.21.15.12:47094) 2023-10-08T16:09:34.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7ff142d9c700 1 -- 172.21.15.12:0/1998234710 learned_addr learned my addr 172.21.15.12:0/1998234710 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d579a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d579a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50264/0 (socket says 172.21.15.12:50264) 2023-10-08T16:09:34.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d579a700 1 -- 172.21.15.12:0/75287510 learned_addr learned my addr 172.21.15.12:0/75287510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f38d679c700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c80dace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff142d9c700 1 -- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 msgr2=0x7ff13c0cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff141d9a700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 0x7ff13c0cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff142d9c700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 0x7ff13c0cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff142d9c700 1 -- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 msgr2=0x7ff13c0b5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff14259b700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 0x7ff13c0b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 -- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 msgr2=0x7f38c80dace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c80dace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f943cdff700 1 -- start start 2023-10-08T16:09:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 0x7f94380c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff142d9c700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 0x7ff13c0b5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7ff142d9c700 1 -- 172.21.15.12:0/1998234710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff134009ae0 con 0x7ff13c0b34b0 2023-10-08T16:09:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 -- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c8006b50 msgr2=0x7f38c80cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7ff141d9a700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 0x7ff13c0cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f943816f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f943815a400 0x7f94380c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7ff142d9c700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff13c06ea60 tx=0x7ff134017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94380c86c0 con 0x7f94380cb5a0 2023-10-08T16:09:34.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9438171490 con 0x7f943815a400 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943cdff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943816e430 con 0x7f94380cb970 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 0x7f94380c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 0x7f94380c8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40318/0 (socket says 172.21.15.12:40318) 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f943659c700 1 -- 172.21.15.12:0/3521121736 learned_addr learned my addr 172.21.15.12:0/3521121736 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c8006b50 0x7f38c80cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 -- 172.21.15.12:0/75287510 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c800dd20 con 0x7f38c80547d0 2023-10-08T16:09:34.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38d579a700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e930 tx=0x7f38c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f9435d9b700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f943816f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000eed0 con 0x7f38c80547d0 2023-10-08T16:09:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c000c850 con 0x7f38c80547d0 2023-10-08T16:09:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38c80cb9a0 con 0x7f38c80547d0 2023-10-08T16:09:34.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38c800c950 con 0x7f38c80547d0 2023-10-08T16:09:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 -- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f943815a400 msgr2=0x7f94380c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f943815a400 0x7f94380c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c000cbf0 con 0x7f38c80547d0 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 -- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 msgr2=0x7f94380c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 0x7f94380c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134012c80 con 0x7ff13c0b34b0 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134012e00 con 0x7ff13c0b34b0 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13401e680 con 0x7ff13c0b34b0 2023-10-08T16:09:34.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c0b4810 con 0x7ff13c0b34b0 2023-10-08T16:09:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 -- 172.21.15.12:0/3521121736 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94200094f0 con 0x7f94380cb970 2023-10-08T16:09:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7ff14259b700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 0x7ff13c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:34.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.924+0000 7f9435d9b700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f943816f060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f942800bb00 tx=0x7f9428009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800c900 con 0x7f94380cb970 2023-10-08T16:09:34.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942800caa0 con 0x7f94380cb970 2023-10-08T16:09:34.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c158a00 con 0x7ff13c0b34b0 2023-10-08T16:09:34.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800ce60 con 0x7f94380cb970 2023-10-08T16:09:34.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.923+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b68023070 con 0x7f4b7806ddd0 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7f4b5effd700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 0x7f4b64069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.925+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b680858b0 con 0x7f4b7806ddd0 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f77b37fe700 1 -- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 msgr2=0x7f77b40b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f77b37fe700 1 --2- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 0x7f77b40b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f77b37fe700 1 -- 172.21.15.12:0/1529181516 >> v2:172.21.15.12:3300/0 conn(0x7f77b41557a0 msgr2=0x7f77b4156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.921+0000 7f77b37fe700 1 --2- 172.21.15.12:0/1529181516 >> v2:172.21.15.12:3300/0 conn(0x7f77b41557a0 0x7f77b4156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f77b37fe700 1 -- 172.21.15.12:0/1529181516 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b4157990 con 0x7f77b4155b70 2023-10-08T16:09:34.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.922+0000 7f77b37fe700 1 --2- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b40afc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77b406bec0 tx=0x7f77a80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15f534185289f0c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.926+0000 7f77b2ffd700 1 -- 172.21.15.12:0/1529181516 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800be70 con 0x7f77b4155b70 2023-10-08T16:09:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.926+0000 7f77b2ffd700 1 -- 172.21.15.12:0/1529181516 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a800ca60 con 0x7f77b4155b70 2023-10-08T16:09:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.926+0000 7f77b2ffd700 1 -- 172.21.15.12:0/1529181516 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a800be70 con 0x7f77b4155b70 2023-10-08T16:09:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f38c0013470 con 0x7f38c80547d0 2023-10-08T16:09:34.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff13c04c3c0 con 0x7ff13c0b34b0 2023-10-08T16:09:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943816e710 con 0x7f94380cb970 2023-10-08T16:09:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943816ecd0 con 0x7f94380cb970 2023-10-08T16:09:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.928+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 msgr2=0x7f77b40afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.928+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b40afc80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77b406bec0 tx=0x7f77a80090f0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38c8005820 con 0x7f38c80547d0 2023-10-08T16:09:34.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f38c5ffb700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.926+0000 7f4b7659c700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 0x7f4b64069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.927+0000 7f4b7659c700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 0x7f4b64069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b780c7290 tx=0x7f4b6c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f38c0084790 con 0x7f38c80547d0 2023-10-08T16:09:34.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f38d5f9b700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 shutdown_connections 2023-10-08T16:09:34.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b40b1e00 0x7f77b40b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1529181516 >> v2:172.21.15.12:3300/0 conn(0x7f77b41557a0 0x7f77b4156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.930+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1529181516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b40afc80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.930+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 >> 172.21.15.12:0/1529181516 conn(0x7f77b406d170 msgr2=0x7f77b40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.929+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9428006d50 con 0x7f94380cb970 2023-10-08T16:09:34.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.930+0000 7f38d5f9b700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 0x7f38b40693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38c8011ff0 tx=0x7f38d0068000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.930+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff13401ea30 con 0x7ff13c0b34b0 2023-10-08T16:09:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.930+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9438171600 con 0x7f94380cb970 2023-10-08T16:09:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.931+0000 7ff1327fc700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 0x7ff120069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.931+0000 7f942e7fc700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 0x7f9418069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.931+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff134086230 con 0x7ff13c0b34b0 2023-10-08T16:09:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.932+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94280842f0 con 0x7f94380cb970 2023-10-08T16:09:34.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.932+0000 7ff14259b700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 0x7ff120069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.932+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 shutdown_connections 2023-10-08T16:09:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.932+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1529181516 wait complete. 2023-10-08T16:09:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.932+0000 7f943659c700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 0x7f9418069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.933+0000 7ff14259b700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 0x7ff120069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006fd0 tx=0x7ff12c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.933+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b68052b00 con 0x7f4b7806ddd0 2023-10-08T16:09:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.933+0000 7f943659c700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 0x7f9418069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9430009af0 tx=0x7f9430008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.933+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38c0051960 con 0x7f38c80547d0 2023-10-08T16:09:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.935+0000 7f77ba3ff700 1 Processor -- start 2023-10-08T16:09:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.935+0000 7f77ba3ff700 1 -- start start 2023-10-08T16:09:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.937+0000 7f77ba3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 0x7f77b41489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.936+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff134053480 con 0x7ff13c0b34b0 2023-10-08T16:09:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.938+0000 7f77ba3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 0x7f77b41523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.938+0000 7f77ba3ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b4151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.938+0000 7f77ba3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4169a30 con 0x7f77b40b1e00 2023-10-08T16:09:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.939+0000 7f77b899c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b4151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.939+0000 7f77b899c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b4151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47126/0 (socket says 172.21.15.12:47126) 2023-10-08T16:09:34.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.938+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9428051540 con 0x7f94380cb970 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.940+0000 7f77b37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 0x7f77b41523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.940+0000 7f77b37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 0x7f77b41523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50278/0 (socket says 172.21.15.12:50278) 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.940+0000 7f77b37fe700 1 -- 172.21.15.12:0/1150656401 learned_addr learned my addr 172.21.15.12:0/1150656401 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.942+0000 7f77b3fff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 0x7f77b41489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.942+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4152910 con 0x7f77b4155b70 2023-10-08T16:09:34.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.942+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4168db0 con 0x7f77b41557a0 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.943+0000 7f77b3fff700 1 -- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 msgr2=0x7f77b41523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.943+0000 7f77b3fff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 0x7f77b41523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.943+0000 7f77b3fff700 1 -- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 msgr2=0x7f77b4151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.943+0000 7f77b3fff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b4151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.943+0000 7f77b3fff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a800b5a0 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.944+0000 7f77b3fff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 0x7f77b41489b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77a400ebe0 tx=0x7f77a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.944+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400f040 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.945+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400c8f0 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.945+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400f040 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.945+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b4169090 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.947+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b4169650 con 0x7f77b40b1e00 2023-10-08T16:09:34.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.956+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77a400ca60 con 0x7f77b40b1e00 2023-10-08T16:09:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.957+0000 7f779bfff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 0x7f77a00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.954+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b404c3c0 con 0x7f77b40b1e00 2023-10-08T16:09:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.958+0000 7f77b37fe700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 0x7f77a00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:34.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.959+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f77a4054eb0 con 0x7f77b40b1e00 2023-10-08T16:09:34.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.963+0000 7f77b37fe700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 0x7f77a00694a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77b4152360 tx=0x7f77a8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:34.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:34.969+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77a4051280 con 0x7f77b40b1e00 2023-10-08T16:09:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.296+0000 7f913ad9d700 1 -- 172.21.15.12:0/2340282451 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f912c0e7e90 con 0x7f912c037ae0 2023-10-08T16:09:35.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.297+0000 7f9129ffb700 1 -- 172.21.15.12:0/2340282451 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9130089070 con 0x7f912c037ae0 2023-10-08T16:09:35.298 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.301+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 msgr2=0x7f91180694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.302+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 0x7f91180694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f912c00dae0 tx=0x7f9134068000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.302+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 msgr2=0x7f912c051930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.302+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f913000c5b0 tx=0x7f9130007f60 comp rx=0 tx=0).stop 2023-10-08T16:09:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 shutdown_connections 2023-10-08T16:09:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9118067000 0x7f91180694b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f912c037ae0 0x7f912c051930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f912c0068c0 0x7f912c03a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 --2- 172.21.15.12:0/2340282451 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f912c0e1370 0x7f912c0dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.303+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 >> 172.21.15.12:0/2340282451 conn(0x7f912c054d40 msgr2=0x7f912c0dfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.304+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 shutdown_connections 2023-10-08T16:09:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.304+0000 7f91177fe700 1 -- 172.21.15.12:0/2340282451 wait complete. 2023-10-08T16:09:35.311 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.306+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff5ac0052b0 con 0x7ff5ac038490 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.307+0000 7ff5b0ff9700 1 -- 172.21.15.12:0/304779797 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5b40cba40 con 0x7ff5ac038490 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.311+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 msgr2=0x7ff5980694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.311+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 0x7ff5980694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c010 tx=0x7ff5a0016000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.311+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 msgr2=0x7ff5ac03a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.311+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 0x7ff5ac03a430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff5b404c860 tx=0x7ff5b406b040 comp rx=0 tx=0).stop 2023-10-08T16:09:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 shutdown_connections 2023-10-08T16:09:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5ac0e1b40 0x7ff5ac0e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5ac0067a0 0x7ff5ac0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff598067000 0x7ff5980694b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 --2- 172.21.15.12:0/304779797 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5ac038490 0x7ff5ac03a430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.313+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 >> 172.21.15.12:0/304779797 conn(0x7ff5ac054c20 msgr2=0x7ff5ac0ea440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.318+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 shutdown_connections 2023-10-08T16:09:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.318+0000 7ff59e7fc700 1 -- 172.21.15.12:0/304779797 wait complete. 2023-10-08T16:09:35.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2023-10-08T16:09:35.332 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-10-08T16:09:35.342 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.349+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89dc15bc60 con 0x7f89dc157640 2023-10-08T16:09:35.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.349+0000 7f89d17fa700 1 -- 172.21.15.12:0/2586509236 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89cc017090 con 0x7f89dc157640 2023-10-08T16:09:35.350 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 msgr2=0x7f89c0069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 0x7f89c0069430 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f89dc158750 tx=0x7f89d8008040 comp rx=0 tx=0).stop 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 msgr2=0x7f89dc0ccb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c7f0 tx=0x7f89cc007f50 comp rx=0 tx=0).stop 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 shutdown_connections 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f89c0066f80 0x7f89c0069430 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89dc157270 0x7f89dc1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89dc158110 0x7f89dc0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 --2- 172.21.15.12:0/2586509236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89dc157640 0x7f89dc0ccb10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 >> 172.21.15.12:0/2586509236 conn(0x7f89dc0ce3d0 msgr2=0x7f89dc0c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.353+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 shutdown_connections 2023-10-08T16:09:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.354+0000 7f89e35ff700 1 -- 172.21.15.12:0/2586509236 wait complete. 2023-10-08T16:09:35.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-08T16:09:35.372 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.384+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f77b40ccc10 con 0x7f77b40b1e00 2023-10-08T16:09:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.384+0000 7f779bfff700 1 -- 172.21.15.12:0/1150656401 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77a4051280 con 0x7f77b40b1e00 2023-10-08T16:09:35.385 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.386+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b780ce470 con 0x7f4b7806ddd0 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 msgr2=0x7f77a00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 0x7f77a00694a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77b4152360 tx=0x7f77a8017000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 msgr2=0x7f77b41489b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 0x7f77b41489b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f77a400ebe0 tx=0x7f77a4008040 comp rx=0 tx=0).stop 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 shutdown_connections 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f77a0066ff0 0x7f77a00694a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77b40b1e00 0x7f77b41489b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77b4155b70 0x7f77b4151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 --2- 172.21.15.12:0/1150656401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77b41557a0 0x7f77b41523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 >> 172.21.15.12:0/1150656401 conn(0x7f77b406d170 msgr2=0x7f77b4152b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f4b5effd700 1 -- 172.21.15.12:0/3914135388 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b68015020 con 0x7f4b7806ddd0 2023-10-08T16:09:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 shutdown_connections 2023-10-08T16:09:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.387+0000 7f77ba3ff700 1 -- 172.21.15.12:0/1150656401 wait complete. 2023-10-08T16:09:35.390 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 msgr2=0x7f4b64069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 0x7f4b64069530 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4b780c7290 tx=0x7f4b6c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 msgr2=0x7f4b780b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4b68011f50 tx=0x7f4b68017000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f38c80dc9d0 con 0x7f38c80547d0 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 shutdown_connections 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4b64067080 0x7f4b64069530 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4b7806ddd0 0x7f4b780b42d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4b7815a8c0 0x7f4b7814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 --2- 172.21.15.12:0/3914135388 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4b780b2980 0x7f4b780c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.390+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 >> 172.21.15.12:0/3914135388 conn(0x7f4b780703a0 msgr2=0x7f4b78150120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.391+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 shutdown_connections 2023-10-08T16:09:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.391+0000 7f4b7c9fe700 1 -- 172.21.15.12:0/3914135388 wait complete. 2023-10-08T16:09:35.393 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.391+0000 7f38c5ffb700 1 -- 172.21.15.12:0/75287510 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f38c0054f80 con 0x7f38c80547d0 2023-10-08T16:09:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.394+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff13c0b4390 con 0x7ff13c0b34b0 2023-10-08T16:09:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 msgr2=0x7f38b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 0x7f38b40693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38c8011ff0 tx=0x7f38d0068000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 msgr2=0x7f38c80da7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38c000e930 tx=0x7f38c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 shutdown_connections 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f38b4066f30 0x7f38b40693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38c8006b50 0x7f38c80cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38c80dc600 0x7f38c80dace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 --2- 172.21.15.12:0/75287510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38c80547d0 0x7f38c80da7a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 >> 172.21.15.12:0/75287510 conn(0x7f38c8055ba0 msgr2=0x7f38c804e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7ff1327fc700 1 -- 172.21.15.12:0/1998234710 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff13c0b4390 con 0x7ff13c0b34b0 2023-10-08T16:09:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 shutdown_connections 2023-10-08T16:09:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.395+0000 7f38d6f9d700 1 -- 172.21.15.12:0/75287510 wait complete. 2023-10-08T16:09:35.397 INFO:teuthology.orchestra.run.smithi012.stdout:55834574854 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.397+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 msgr2=0x7ff120069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 0x7ff120069530 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff12c006fd0 tx=0x7ff12c008040 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 msgr2=0x7ff13c0b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff13c06ea60 tx=0x7ff134017000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 shutdown_connections 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff120067080 0x7ff120069530 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff13c0cb5a0 0x7ff13c0b5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff13c0b34b0 0x7ff13c0b38e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 --2- 172.21.15.12:0/1998234710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff13c0cd9e0 0x7ff13c0cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 >> 172.21.15.12:0/1998234710 conn(0x7ff13c070e30 msgr2=0x7ff13c155f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 shutdown_connections 2023-10-08T16:09:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.398+0000 7ff1447ff700 1 -- 172.21.15.12:0/1998234710 wait complete. 2023-10-08T16:09:35.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.406+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f943804c3c0 con 0x7f94380cb970 2023-10-08T16:09:35.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.406+0000 7f942e7fc700 1 -- 172.21.15.12:0/3521121736 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9428054b60 con 0x7f94380cb970 2023-10-08T16:09:35.407 INFO:teuthology.orchestra.run.smithi012.stdout:55834574855 2023-10-08T16:09:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.410+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 msgr2=0x7f9418069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.410+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 0x7f9418069530 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9430009af0 tx=0x7f9430008040 comp rx=0 tx=0).stop 2023-10-08T16:09:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.410+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 msgr2=0x7f943816f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.410+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f943816f060 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f942800bb00 tx=0x7f9428009780 comp rx=0 tx=0).stop 2023-10-08T16:09:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 shutdown_connections 2023-10-08T16:09:35.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9418067080 0x7f9418069530 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f94380cb5a0 0x7f94380c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f943815a400 0x7f94380c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 --2- 172.21.15.12:0/3521121736 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f94380cb970 0x7f943816f060 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 >> 172.21.15.12:0/3521121736 conn(0x7f9438070e30 msgr2=0x7f94380b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 shutdown_connections 2023-10-08T16:09:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.411+0000 7f943cdff700 1 -- 172.21.15.12:0/3521121736 wait complete. 2023-10-08T16:09:35.413 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-08T16:09:35.415 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-08T16:09:35.422 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-08T16:09:35.422 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-08T16:09:35.431 DEBUG:teuthology.parallel:result is None 2023-10-08T16:09:35.431 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T16:09:35.431 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:35.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.656+0000 7f144579d700 1 Processor -- start 2023-10-08T16:09:35.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.656+0000 7f144579d700 1 -- start start 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f144579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f14400aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f144579d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400acc00 con 0x7f1440159550 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f144579d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14400abff0 con 0x7f1440159920 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f144579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ac2d0 con 0x7f144015dfd0 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f143ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1440159550 0x7f14400ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47014/0 (socket says 172.21.15.12:47014) 2023-10-08T16:09:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.657+0000 7f143ffff700 1 -- 172.21.15.12:0/2276215048 learned_addr learned my addr 172.21.15.12:0/2276215048 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143f7fe700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f14400aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287978272 0 0) 0x7f14400acc00 con 0x7f1440159550 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1428003570 con 0x7f1440159550 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073046844 0 0) 0x7f14400abff0 con 0x7f1440159920 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14400acc00 con 0x7f1440159920 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1299338332 0 0) 0x7f1428003570 con 0x7f1440159550 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 msgr2=0x7f14400aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f14400aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 >> v1:172.21.15.29:6789/0 conn(0x7f1440159920 legacy=0x7f14400ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400ac5b0 con 0x7f1440159550 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1430001470 con 0x7f1440159550 2023-10-08T16:09:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 >> v1:172.21.15.12:6789/0 conn(0x7f1440159550 legacy=0x7f14400ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f1428004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f1428004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1428004d50 0x7f14280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400ac2d0 con 0x7f1428003c20 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142800bb70 con 0x7f1428004d50 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142800bd30 con 0x7f144015dfd0 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143ffff700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f1428004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.658+0000 7f143f7fe700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f1428004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f1444f9c700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1428004d50 0x7f14280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 -- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 msgr2=0x7f1428004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f144015dfd0 0x7f1428004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 -- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1428004d50 msgr2=0x7f14280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1428004d50 0x7f14280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 -- 172.21.15.12:0/2276215048 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428003570 con 0x7f1428003c20 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143ffff700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f1428004010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f143000c2d0 tx=0x7f1430001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dba18fe32979057 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000cbc0 con 0x7f1428003c20 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000cd20 con 0x7f1428003c20 2023-10-08T16:09:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.659+0000 7f143effd700 1 -- 172.21.15.12:0/2276215048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430005b70 con 0x7f1428003c20 2023-10-08T16:09:35.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 -- 172.21.15.12:0/2276215048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 msgr2=0x7f1428004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 --2- 172.21.15.12:0/2276215048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f1428004010 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f143000c2d0 tx=0x7f1430001e10 comp rx=0 tx=0).stop 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f1444f9c700 1 -- 172.21.15.12:0/2276215048 reap_dead start 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 -- 172.21.15.12:0/2276215048 shutdown_connections 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 -- 172.21.15.12:0/2276215048 >> 172.21.15.12:0/2276215048 conn(0x7f144006ce80 msgr2=0x7f14400ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 -- 172.21.15.12:0/2276215048 shutdown_connections 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.660+0000 7f144579d700 1 -- 172.21.15.12:0/2276215048 wait complete. 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.661+0000 7f144579d700 1 Processor -- start 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 -- start start 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440157cb0 0x7f1440158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14400c88a0 0x7f14400c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440155d30 con 0x7f1428003c20 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400c9630 con 0x7f14400c88a0 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.662+0000 7f144579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1440158660 con 0x7f1440157cb0 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40352/0 (socket says 172.21.15.12:40352) 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 -- 172.21.15.12:0/468178019 learned_addr learned my addr 172.21.15.12:0/468178019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 -- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440157cb0 msgr2=0x7f1440158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440157cb0 0x7f1440158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 -- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14400c88a0 msgr2=0x7f14400c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14400c88a0 0x7f14400c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 -- 172.21.15.12:0/468178019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1440155400 con 0x7f1428003c20 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f143ffff700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f143000c8c0 tx=0x7f1430015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430001760 con 0x7f1428003c20 2023-10-08T16:09:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.663+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14300072e0 con 0x7f1428003c20 2023-10-08T16:09:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.664+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300076a0 con 0x7f1428003c20 2023-10-08T16:09:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.664+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14401556e0 con 0x7f1428003c20 2023-10-08T16:09:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.664+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400ce890 con 0x7f1428003c20 2023-10-08T16:09:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.665+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144004c3c0 con 0x7f1428003c20 2023-10-08T16:09:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.665+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1430019030 con 0x7f1428003c20 2023-10-08T16:09:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.666+0000 7f1427fff700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 0x7f142c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.666+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1430085ad0 con 0x7f1428003c20 2023-10-08T16:09:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.666+0000 7f143f7fe700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 0x7f142c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.667+0000 7f143f7fe700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 0x7f142c069410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14400ca4e0 tx=0x7f14340091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:35.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.671+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1430052ca0 con 0x7f1428003c20 2023-10-08T16:09:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.868+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f144006e7c0 con 0x7f142c066f60 2023-10-08T16:09:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.876+0000 7f1427fff700 1 -- 172.21.15.12:0/468178019 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264513 (secure 0 0 0) 0x7f144006e7c0 con 0x7f142c066f60 2023-10-08T16:09:35.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 msgr2=0x7f142c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 0x7f142c069410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f14400ca4e0 tx=0x7f14340091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 msgr2=0x7f14400ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f143000c8c0 tx=0x7f1430015000 comp rx=0 tx=0).stop 2023-10-08T16:09:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 shutdown_connections 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f142c066f60 0x7f142c069410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1428003c20 0x7f14400ce350 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14400c88a0 0x7f14400c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 --2- 172.21.15.12:0/468178019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440157cb0 0x7f1440158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 >> 172.21.15.12:0/468178019 conn(0x7f144006ce80 msgr2=0x7f14400b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 shutdown_connections 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:35.880+0000 7f144579d700 1 -- 172.21.15.12:0/468178019 wait complete. 2023-10-08T16:09:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:35.898 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-10-08T16:09:33.915125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397608,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577112,"statfs":{"total":773094113280,"available":770638962688,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002954"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931948+0000","last_change":"2023-10-08T16:09:20.923239+0000","last_active":"2023-10-08T16:09:20.931948+0000","last_peered":"2023-10-08T16:09:20.931948+0000","last_clean":"2023-10-08T16:09:20.931948+0000","last_became_active":"2023-10-08T16:09:20.922789+0000","last_became_peered":"2023-10-08T16:09:20.922789+0000","last_unstale":"2023-10-08T16:09:20.931948+0000","last_undegraded":"2023-10-08T16:09:20.931948+0000","last_fullsized":"2023-10-08T16:09:20.931948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:36.471481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918249+0000","last_change":"2023-10-08T16:09:20.914085+0000","last_active":"2023-10-08T16:09:20.918249+0000","last_peered":"2023-10-08T16:09:20.918249+0000","last_clean":"2023-10-08T16:09:20.918249+0000","last_became_active":"2023-10-08T16:09:20.913834+0000","last_became_peered":"2023-10-08T16:09:20.913834+0000","last_unstale":"2023-10-08T16:09:20.918249+0000","last_undegraded":"2023-10-08T16:09:20.918249+0000","last_fullsized":"2023-10-08T16:09:20.918249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.919536+0000","last_change":"2023-10-08T16:09:20.915094+0000","last_active":"2023-10-08T16:09:20.919536+0000","last_peered":"2023-10-08T16:09:20.919536+0000","last_clean":"2023-10-08T16:09:20.919536+0000","last_became_active":"2023-10-08T16:09:20.914821+0000","last_became_peered":"2023-10-08T16:09:20.914821+0000","last_unstale":"2023-10-08T16:09:20.919536+0000","last_undegraded":"2023-10-08T16:09:20.919536+0000","last_fullsized":"2023-10-08T16:09:20.919536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:39.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934072+0000","last_change":"2023-10-08T16:09:20.931361+0000","last_active":"2023-10-08T16:09:20.934072+0000","last_peered":"2023-10-08T16:09:20.934072+0000","last_clean":"2023-10-08T16:09:20.934072+0000","last_became_active":"2023-10-08T16:09:20.931006+0000","last_became_peered":"2023-10-08T16:09:20.931006+0000","last_unstale":"2023-10-08T16:09:20.934072+0000","last_undegraded":"2023-10-08T16:09:20.934072+0000","last_fullsized":"2023-10-08T16:09:20.934072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931450+0000","last_change":"2023-10-08T16:09:20.924404+0000","last_active":"2023-10-08T16:09:20.931450+0000","last_peered":"2023-10-08T16:09:20.931450+0000","last_clean":"2023-10-08T16:09:20.931450+0000","last_became_active":"2023-10-08T16:09:20.924076+0000","last_became_peered":"2023-10-08T16:09:20.924076+0000","last_unstale":"2023-10-08T16:09:20.931450+0000","last_undegraded":"2023-10-08T16:09:20.931450+0000","last_fullsized":"2023-10-08T16:09:20.931450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:29.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932898+0000","last_change":"2023-10-08T16:09:20.922230+0000","last_active":"2023-10-08T16:09:20.932898+0000","last_peered":"2023-10-08T16:09:20.932898+0000","last_clean":"2023-10-08T16:09:20.932898+0000","last_became_active":"2023-10-08T16:09:20.921756+0000","last_became_peered":"2023-10-08T16:09:20.921756+0000","last_unstale":"2023-10-08T16:09:20.932898+0000","last_undegraded":"2023-10-08T16:09:20.932898+0000","last_fullsized":"2023-10-08T16:09:20.932898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930235+0000","last_change":"2023-10-08T16:09:20.926442+0000","last_active":"2023-10-08T16:09:20.930235+0000","last_peered":"2023-10-08T16:09:20.930235+0000","last_clean":"2023-10-08T16:09:20.930235+0000","last_became_active":"2023-10-08T16:09:20.926134+0000","last_became_peered":"2023-10-08T16:09:20.926134+0000","last_unstale":"2023-10-08T16:09:20.930235+0000","last_undegraded":"2023-10-08T16:09:20.930235+0000","last_fullsized":"2023-10-08T16:09:20.930235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:09.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938511+0000","last_change":"2023-10-08T16:09:20.934468+0000","last_active":"2023-10-08T16:09:20.938511+0000","last_peered":"2023-10-08T16:09:20.938511+0000","last_clean":"2023-10-08T16:09:20.938511+0000","last_became_active":"2023-10-08T16:09:20.934187+0000","last_became_peered":"2023-10-08T16:09:20.934187+0000","last_unstale":"2023-10-08T16:09:20.938511+0000","last_undegraded":"2023-10-08T16:09:20.938511+0000","last_fullsized":"2023-10-08T16:09:20.938511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934886+0000","last_change":"2023-10-08T16:09:20.930046+0000","last_active":"2023-10-08T16:09:20.934886+0000","last_peered":"2023-10-08T16:09:20.934886+0000","last_clean":"2023-10-08T16:09:20.934886+0000","last_became_active":"2023-10-08T16:09:20.929384+0000","last_became_peered":"2023-10-08T16:09:20.929384+0000","last_unstale":"2023-10-08T16:09:20.934886+0000","last_undegraded":"2023-10-08T16:09:20.934886+0000","last_fullsized":"2023-10-08T16:09:20.934886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:29.654343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925610+0000","last_change":"2023-10-08T16:09:20.921732+0000","last_active":"2023-10-08T16:09:20.925610+0000","last_peered":"2023-10-08T16:09:20.925610+0000","last_clean":"2023-10-08T16:09:20.925610+0000","last_became_active":"2023-10-08T16:09:20.921260+0000","last_became_peered":"2023-10-08T16:09:20.921260+0000","last_unstale":"2023-10-08T16:09:20.925610+0000","last_undegraded":"2023-10-08T16:09:20.925610+0000","last_fullsized":"2023-10-08T16:09:20.925610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935782+0000","last_change":"2023-10-08T16:09:20.934331+0000","last_active":"2023-10-08T16:09:20.935782+0000","last_peered":"2023-10-08T16:09:20.935782+0000","last_clean":"2023-10-08T16:09:20.935782+0000","last_became_active":"2023-10-08T16:09:20.934023+0000","last_became_peered":"2023-10-08T16:09:20.934023+0000","last_unstale":"2023-10-08T16:09:20.935782+0000","last_undegraded":"2023-10-08T16:09:20.935782+0000","last_fullsized":"2023-10-08T16:09:20.935782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927686+0000","last_change":"2023-10-08T16:09:20.921076+0000","last_active":"2023-10-08T16:09:20.927686+0000","last_peered":"2023-10-08T16:09:20.927686+0000","last_clean":"2023-10-08T16:09:20.927686+0000","last_became_active":"2023-10-08T16:09:20.920798+0000","last_became_peered":"2023-10-08T16:09:20.920798+0000","last_unstale":"2023-10-08T16:09:20.927686+0000","last_undegraded":"2023-10-08T16:09:20.927686+0000","last_fullsized":"2023-10-08T16:09:20.927686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:00.083968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925745+0000","last_change":"2023-10-08T16:09:20.922551+0000","last_active":"2023-10-08T16:09:20.925745+0000","last_peered":"2023-10-08T16:09:20.925745+0000","last_clean":"2023-10-08T16:09:20.925745+0000","last_became_active":"2023-10-08T16:09:20.922276+0000","last_became_peered":"2023-10-08T16:09:20.922276+0000","last_unstale":"2023-10-08T16:09:20.925745+0000","last_undegraded":"2023-10-08T16:09:20.925745+0000","last_fullsized":"2023-10-08T16:09:20.925745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927387+0000","last_change":"2023-10-08T16:09:20.921190+0000","last_active":"2023-10-08T16:09:20.927387+0000","last_peered":"2023-10-08T16:09:20.927387+0000","last_clean":"2023-10-08T16:09:20.927387+0000","last_became_active":"2023-10-08T16:09:20.920627+0000","last_became_peered":"2023-10-08T16:09:20.920627+0000","last_unstale":"2023-10-08T16:09:20.927387+0000","last_undegraded":"2023-10-08T16:09:20.927387+0000","last_fullsized":"2023-10-08T16:09:20.927387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:16.772848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918396+0000","last_change":"2023-10-08T16:09:20.913009+0000","last_active":"2023-10-08T16:09:20.918396+0000","last_peered":"2023-10-08T16:09:20.918396+0000","last_clean":"2023-10-08T16:09:20.918396+0000","last_became_active":"2023-10-08T16:09:20.912719+0000","last_became_peered":"2023-10-08T16:09:20.912719+0000","last_unstale":"2023-10-08T16:09:20.918396+0000","last_undegraded":"2023-10-08T16:09:20.918396+0000","last_fullsized":"2023-10-08T16:09:20.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920698+0000","last_change":"2023-10-08T16:09:20.916696+0000","last_active":"2023-10-08T16:09:20.920698+0000","last_peered":"2023-10-08T16:09:20.920698+0000","last_clean":"2023-10-08T16:09:20.920698+0000","last_became_active":"2023-10-08T16:09:20.916352+0000","last_became_peered":"2023-10-08T16:09:20.916352+0000","last_unstale":"2023-10-08T16:09:20.920698+0000","last_undegraded":"2023-10-08T16:09:20.920698+0000","last_fullsized":"2023-10-08T16:09:20.920698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928741+0000","last_change":"2023-10-08T16:09:20.919110+0000","last_active":"2023-10-08T16:09:20.928741+0000","last_peered":"2023-10-08T16:09:20.928741+0000","last_clean":"2023-10-08T16:09:20.928741+0000","last_became_active":"2023-10-08T16:09:20.918780+0000","last_became_peered":"2023-10-08T16:09:20.918780+0000","last_unstale":"2023-10-08T16:09:20.928741+0000","last_undegraded":"2023-10-08T16:09:20.928741+0000","last_fullsized":"2023-10-08T16:09:20.928741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922564+0000","last_change":"2023-10-08T16:09:20.918158+0000","last_active":"2023-10-08T16:09:20.922564+0000","last_peered":"2023-10-08T16:09:20.922564+0000","last_clean":"2023-10-08T16:09:20.922564+0000","last_became_active":"2023-10-08T16:09:20.917856+0000","last_became_peered":"2023-10-08T16:09:20.917856+0000","last_unstale":"2023-10-08T16:09:20.922564+0000","last_undegraded":"2023-10-08T16:09:20.922564+0000","last_fullsized":"2023-10-08T16:09:20.922564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931481+0000","last_change":"2023-10-08T16:09:20.927146+0000","last_active":"2023-10-08T16:09:20.931481+0000","last_peered":"2023-10-08T16:09:20.931481+0000","last_clean":"2023-10-08T16:09:20.931481+0000","last_became_active":"2023-10-08T16:09:20.924805+0000","last_became_peered":"2023-10-08T16:09:20.924805+0000","last_unstale":"2023-10-08T16:09:20.931481+0000","last_undegraded":"2023-10-08T16:09:20.931481+0000","last_fullsized":"2023-10-08T16:09:20.931481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:43.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972105+0000","last_change":"2023-10-08T16:09:19.983339+0000","last_active":"2023-10-08T16:09:20.972105+0000","last_peered":"2023-10-08T16:09:20.972105+0000","last_clean":"2023-10-08T16:09:20.972105+0000","last_became_active":"2023-10-08T16:09:19.983052+0000","last_became_peered":"2023-10-08T16:09:19.983052+0000","last_unstale":"2023-10-08T16:09:20.972105+0000","last_undegraded":"2023-10-08T16:09:20.972105+0000","last_fullsized":"2023-10-08T16:09:20.972105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925071+0000","last_change":"2023-10-08T16:09:20.923270+0000","last_active":"2023-10-08T16:09:20.925071+0000","last_peered":"2023-10-08T16:09:20.925071+0000","last_clean":"2023-10-08T16:09:20.925071+0000","last_became_active":"2023-10-08T16:09:20.923011+0000","last_became_peered":"2023-10-08T16:09:20.923011+0000","last_unstale":"2023-10-08T16:09:20.925071+0000","last_undegraded":"2023-10-08T16:09:20.925071+0000","last_fullsized":"2023-10-08T16:09:20.925071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975780+0000","last_change":"2023-10-08T16:09:19.983890+0000","last_active":"2023-10-08T16:09:20.975780+0000","last_peered":"2023-10-08T16:09:20.975780+0000","last_clean":"2023-10-08T16:09:20.975780+0000","last_became_active":"2023-10-08T16:09:19.983629+0000","last_became_peered":"2023-10-08T16:09:19.983629+0000","last_unstale":"2023-10-08T16:09:20.975780+0000","last_undegraded":"2023-10-08T16:09:20.975780+0000","last_fullsized":"2023-10-08T16:09:20.975780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932721+0000","last_change":"2023-10-08T16:09:20.929176+0000","last_active":"2023-10-08T16:09:20.932721+0000","last_peered":"2023-10-08T16:09:20.932721+0000","last_clean":"2023-10-08T16:09:20.932721+0000","last_became_active":"2023-10-08T16:09:20.928937+0000","last_became_peered":"2023-10-08T16:09:20.928937+0000","last_unstale":"2023-10-08T16:09:20.932721+0000","last_undegraded":"2023-10-08T16:09:20.932721+0000","last_fullsized":"2023-10-08T16:09:20.932721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973901+0000","last_change":"2023-10-08T16:09:19.982390+0000","last_active":"2023-10-08T16:09:20.973901+0000","last_peered":"2023-10-08T16:09:20.973901+0000","last_clean":"2023-10-08T16:09:20.973901+0000","last_became_active":"2023-10-08T16:09:19.982067+0000","last_became_peered":"2023-10-08T16:09:19.982067+0000","last_unstale":"2023-10-08T16:09:20.973901+0000","last_undegraded":"2023-10-08T16:09:20.973901+0000","last_fullsized":"2023-10-08T16:09:20.973901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:56.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933876+0000","last_change":"2023-10-08T16:09:20.928229+0000","last_active":"2023-10-08T16:09:20.933876+0000","last_peered":"2023-10-08T16:09:20.933876+0000","last_clean":"2023-10-08T16:09:20.933876+0000","last_became_active":"2023-10-08T16:09:20.927947+0000","last_became_peered":"2023-10-08T16:09:20.927947+0000","last_unstale":"2023-10-08T16:09:20.933876+0000","last_undegraded":"2023-10-08T16:09:20.933876+0000","last_fullsized":"2023-10-08T16:09:20.933876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:20.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971881+0000","last_change":"2023-10-08T16:09:19.976558+0000","last_active":"2023-10-08T16:09:20.971881+0000","last_peered":"2023-10-08T16:09:20.971881+0000","last_clean":"2023-10-08T16:09:20.971881+0000","last_became_active":"2023-10-08T16:09:19.976190+0000","last_became_peered":"2023-10-08T16:09:19.976190+0000","last_unstale":"2023-10-08T16:09:20.971881+0000","last_undegraded":"2023-10-08T16:09:20.971881+0000","last_fullsized":"2023-10-08T16:09:20.971881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:16.143856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933050+0000","last_change":"2023-10-08T16:09:20.926759+0000","last_active":"2023-10-08T16:09:20.933050+0000","last_peered":"2023-10-08T16:09:20.933050+0000","last_clean":"2023-10-08T16:09:20.933050+0000","last_became_active":"2023-10-08T16:09:20.926449+0000","last_became_peered":"2023-10-08T16:09:20.926449+0000","last_unstale":"2023-10-08T16:09:20.933050+0000","last_undegraded":"2023-10-08T16:09:20.933050+0000","last_fullsized":"2023-10-08T16:09:20.933050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975655+0000","last_change":"2023-10-08T16:09:19.983304+0000","last_active":"2023-10-08T16:09:20.975655+0000","last_peered":"2023-10-08T16:09:20.975655+0000","last_clean":"2023-10-08T16:09:20.975655+0000","last_became_active":"2023-10-08T16:09:19.982916+0000","last_became_peered":"2023-10-08T16:09:19.982916+0000","last_unstale":"2023-10-08T16:09:20.975655+0000","last_undegraded":"2023-10-08T16:09:20.975655+0000","last_fullsized":"2023-10-08T16:09:20.975655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925716+0000","last_change":"2023-10-08T16:09:20.914915+0000","last_active":"2023-10-08T16:09:20.925716+0000","last_peered":"2023-10-08T16:09:20.925716+0000","last_clean":"2023-10-08T16:09:20.925716+0000","last_became_active":"2023-10-08T16:09:20.914562+0000","last_became_peered":"2023-10-08T16:09:20.914562+0000","last_unstale":"2023-10-08T16:09:20.925716+0000","last_undegraded":"2023-10-08T16:09:20.925716+0000","last_fullsized":"2023-10-08T16:09:20.925716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.969110+0000","last_change":"2023-10-08T16:09:19.982834+0000","last_active":"2023-10-08T16:09:20.969110+0000","last_peered":"2023-10-08T16:09:20.969110+0000","last_clean":"2023-10-08T16:09:20.969110+0000","last_became_active":"2023-10-08T16:09:19.981385+0000","last_became_peered":"2023-10-08T16:09:19.981385+0000","last_unstale":"2023-10-08T16:09:20.969110+0000","last_undegraded":"2023-10-08T16:09:20.969110+0000","last_fullsized":"2023-10-08T16:09:20.969110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930013+0000","last_change":"2023-10-08T16:09:20.924374+0000","last_active":"2023-10-08T16:09:20.930013+0000","last_peered":"2023-10-08T16:09:20.930013+0000","last_clean":"2023-10-08T16:09:20.930013+0000","last_became_active":"2023-10-08T16:09:20.924067+0000","last_became_peered":"2023-10-08T16:09:20.924067+0000","last_unstale":"2023-10-08T16:09:20.930013+0000","last_undegraded":"2023-10-08T16:09:20.930013+0000","last_fullsized":"2023-10-08T16:09:20.930013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.916621+0000","last_change":"2023-10-08T16:09:19.979195+0000","last_active":"2023-10-08T16:09:20.916621+0000","last_peered":"2023-10-08T16:09:20.916621+0000","last_clean":"2023-10-08T16:09:20.916621+0000","last_became_active":"2023-10-08T16:09:19.977936+0000","last_became_peered":"2023-10-08T16:09:19.977936+0000","last_unstale":"2023-10-08T16:09:20.916621+0000","last_undegraded":"2023-10-08T16:09:20.916621+0000","last_fullsized":"2023-10-08T16:09:20.916621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933011+0000","last_change":"2023-10-08T16:09:20.928131+0000","last_active":"2023-10-08T16:09:20.933011+0000","last_peered":"2023-10-08T16:09:20.933011+0000","last_clean":"2023-10-08T16:09:20.933011+0000","last_became_active":"2023-10-08T16:09:20.927721+0000","last_became_peered":"2023-10-08T16:09:20.927721+0000","last_unstale":"2023-10-08T16:09:20.933011+0000","last_undegraded":"2023-10-08T16:09:20.933011+0000","last_fullsized":"2023-10-08T16:09:20.933011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906866+0000","last_change":"2023-10-08T16:09:19.988608+0000","last_active":"2023-10-08T16:09:20.906866+0000","last_peered":"2023-10-08T16:09:20.906866+0000","last_clean":"2023-10-08T16:09:20.906866+0000","last_became_active":"2023-10-08T16:09:19.988278+0000","last_became_peered":"2023-10-08T16:09:19.988278+0000","last_unstale":"2023-10-08T16:09:20.906866+0000","last_undegraded":"2023-10-08T16:09:20.906866+0000","last_fullsized":"2023-10-08T16:09:20.906866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.921581+0000","last_change":"2023-10-08T16:09:20.918971+0000","last_active":"2023-10-08T16:09:20.921581+0000","last_peered":"2023-10-08T16:09:20.921581+0000","last_clean":"2023-10-08T16:09:20.921581+0000","last_became_active":"2023-10-08T16:09:20.918687+0000","last_became_peered":"2023-10-08T16:09:20.918687+0000","last_unstale":"2023-10-08T16:09:20.921581+0000","last_undegraded":"2023-10-08T16:09:20.921581+0000","last_fullsized":"2023-10-08T16:09:20.921581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910412+0000","last_change":"2023-10-08T16:09:19.989053+0000","last_active":"2023-10-08T16:09:20.910412+0000","last_peered":"2023-10-08T16:09:20.910412+0000","last_clean":"2023-10-08T16:09:20.910412+0000","last_became_active":"2023-10-08T16:09:19.988777+0000","last_became_peered":"2023-10-08T16:09:19.988777+0000","last_unstale":"2023-10-08T16:09:20.910412+0000","last_undegraded":"2023-10-08T16:09:20.910412+0000","last_fullsized":"2023-10-08T16:09:20.910412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928707+0000","last_change":"2023-10-08T16:09:20.919114+0000","last_active":"2023-10-08T16:09:20.928707+0000","last_peered":"2023-10-08T16:09:20.928707+0000","last_clean":"2023-10-08T16:09:20.928707+0000","last_became_active":"2023-10-08T16:09:20.918800+0000","last_became_peered":"2023-10-08T16:09:20.918800+0000","last_unstale":"2023-10-08T16:09:20.928707+0000","last_undegraded":"2023-10-08T16:09:20.928707+0000","last_fullsized":"2023-10-08T16:09:20.928707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.907633+0000","last_change":"2023-10-08T16:09:19.985911+0000","last_active":"2023-10-08T16:09:20.907633+0000","last_peered":"2023-10-08T16:09:20.907633+0000","last_clean":"2023-10-08T16:09:20.907633+0000","last_became_active":"2023-10-08T16:09:19.985587+0000","last_became_peered":"2023-10-08T16:09:19.985587+0000","last_unstale":"2023-10-08T16:09:20.907633+0000","last_undegraded":"2023-10-08T16:09:20.907633+0000","last_fullsized":"2023-10-08T16:09:20.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927469+0000","last_change":"2023-10-08T16:09:20.923331+0000","last_active":"2023-10-08T16:09:20.927469+0000","last_peered":"2023-10-08T16:09:20.927469+0000","last_clean":"2023-10-08T16:09:20.927469+0000","last_became_active":"2023-10-08T16:09:20.923039+0000","last_became_peered":"2023-10-08T16:09:20.923039+0000","last_unstale":"2023-10-08T16:09:20.927469+0000","last_undegraded":"2023-10-08T16:09:20.927469+0000","last_fullsized":"2023-10-08T16:09:20.927469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:17.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970716+0000","last_change":"2023-10-08T16:09:19.977329+0000","last_active":"2023-10-08T16:09:20.970716+0000","last_peered":"2023-10-08T16:09:20.970716+0000","last_clean":"2023-10-08T16:09:20.970716+0000","last_became_active":"2023-10-08T16:09:19.977037+0000","last_became_peered":"2023-10-08T16:09:19.977037+0000","last_unstale":"2023-10-08T16:09:20.970716+0000","last_undegraded":"2023-10-08T16:09:20.970716+0000","last_fullsized":"2023-10-08T16:09:20.970716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929923+0000","last_change":"2023-10-08T16:09:20.925081+0000","last_active":"2023-10-08T16:09:20.929923+0000","last_peered":"2023-10-08T16:09:20.929923+0000","last_clean":"2023-10-08T16:09:20.929923+0000","last_became_active":"2023-10-08T16:09:20.924752+0000","last_became_peered":"2023-10-08T16:09:20.924752+0000","last_unstale":"2023-10-08T16:09:20.929923+0000","last_undegraded":"2023-10-08T16:09:20.929923+0000","last_fullsized":"2023-10-08T16:09:20.929923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:26.766584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.977381+0000","last_change":"2023-10-08T16:09:19.983118+0000","last_active":"2023-10-08T16:09:20.977381+0000","last_peered":"2023-10-08T16:09:20.977381+0000","last_clean":"2023-10-08T16:09:20.977381+0000","last_became_active":"2023-10-08T16:09:19.980439+0000","last_became_peered":"2023-10-08T16:09:19.980439+0000","last_unstale":"2023-10-08T16:09:20.977381+0000","last_undegraded":"2023-10-08T16:09:20.977381+0000","last_fullsized":"2023-10-08T16:09:20.977381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931518+0000","last_change":"2023-10-08T16:09:20.927943+0000","last_active":"2023-10-08T16:09:20.931518+0000","last_peered":"2023-10-08T16:09:20.931518+0000","last_clean":"2023-10-08T16:09:20.931518+0000","last_became_active":"2023-10-08T16:09:20.927658+0000","last_became_peered":"2023-10-08T16:09:20.927658+0000","last_unstale":"2023-10-08T16:09:20.931518+0000","last_undegraded":"2023-10-08T16:09:20.931518+0000","last_fullsized":"2023-10-08T16:09:20.931518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:12.394183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973062+0000","last_change":"2023-10-08T16:09:19.980609+0000","last_active":"2023-10-08T16:09:20.973062+0000","last_peered":"2023-10-08T16:09:20.973062+0000","last_clean":"2023-10-08T16:09:20.973062+0000","last_became_active":"2023-10-08T16:09:19.980306+0000","last_became_peered":"2023-10-08T16:09:19.980306+0000","last_unstale":"2023-10-08T16:09:20.973062+0000","last_undegraded":"2023-10-08T16:09:20.973062+0000","last_fullsized":"2023-10-08T16:09:20.973062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927258+0000","last_change":"2023-10-08T16:09:20.920087+0000","last_active":"2023-10-08T16:09:20.927258+0000","last_peered":"2023-10-08T16:09:20.927258+0000","last_clean":"2023-10-08T16:09:20.927258+0000","last_became_active":"2023-10-08T16:09:20.919773+0000","last_became_peered":"2023-10-08T16:09:20.919773+0000","last_unstale":"2023-10-08T16:09:20.927258+0000","last_undegraded":"2023-10-08T16:09:20.927258+0000","last_fullsized":"2023-10-08T16:09:20.927258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908169+0000","last_change":"2023-10-08T16:09:19.982809+0000","last_active":"2023-10-08T16:09:20.908169+0000","last_peered":"2023-10-08T16:09:20.908169+0000","last_clean":"2023-10-08T16:09:20.908169+0000","last_became_active":"2023-10-08T16:09:19.981705+0000","last_became_peered":"2023-10-08T16:09:19.981705+0000","last_unstale":"2023-10-08T16:09:20.908169+0000","last_undegraded":"2023-10-08T16:09:20.908169+0000","last_fullsized":"2023-10-08T16:09:20.908169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933512+0000","last_change":"2023-10-08T16:09:20.930857+0000","last_active":"2023-10-08T16:09:20.933512+0000","last_peered":"2023-10-08T16:09:20.933512+0000","last_clean":"2023-10-08T16:09:20.933512+0000","last_became_active":"2023-10-08T16:09:20.930508+0000","last_became_peered":"2023-10-08T16:09:20.930508+0000","last_unstale":"2023-10-08T16:09:20.933512+0000","last_undegraded":"2023-10-08T16:09:20.933512+0000","last_fullsized":"2023-10-08T16:09:20.933512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910553+0000","last_change":"2023-10-08T16:09:19.982295+0000","last_active":"2023-10-08T16:09:20.910553+0000","last_peered":"2023-10-08T16:09:20.910553+0000","last_clean":"2023-10-08T16:09:20.910553+0000","last_became_active":"2023-10-08T16:09:19.980861+0000","last_became_peered":"2023-10-08T16:09:19.980861+0000","last_unstale":"2023-10-08T16:09:20.910553+0000","last_undegraded":"2023-10-08T16:09:20.910553+0000","last_fullsized":"2023-10-08T16:09:20.910553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922812+0000","last_change":"2023-10-08T16:09:20.921200+0000","last_active":"2023-10-08T16:09:20.922812+0000","last_peered":"2023-10-08T16:09:20.922812+0000","last_clean":"2023-10-08T16:09:20.922812+0000","last_became_active":"2023-10-08T16:09:20.920910+0000","last_became_peered":"2023-10-08T16:09:20.920910+0000","last_unstale":"2023-10-08T16:09:20.922812+0000","last_undegraded":"2023-10-08T16:09:20.922812+0000","last_fullsized":"2023-10-08T16:09:20.922812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973571+0000","last_change":"2023-10-08T16:09:19.977338+0000","last_active":"2023-10-08T16:09:20.973571+0000","last_peered":"2023-10-08T16:09:20.973571+0000","last_clean":"2023-10-08T16:09:20.973571+0000","last_became_active":"2023-10-08T16:09:19.976975+0000","last_became_peered":"2023-10-08T16:09:19.976975+0000","last_unstale":"2023-10-08T16:09:20.973571+0000","last_undegraded":"2023-10-08T16:09:20.973571+0000","last_fullsized":"2023-10-08T16:09:20.973571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930255+0000","last_change":"2023-10-08T16:09:20.927111+0000","last_active":"2023-10-08T16:09:20.930255+0000","last_peered":"2023-10-08T16:09:20.930255+0000","last_clean":"2023-10-08T16:09:20.930255+0000","last_became_active":"2023-10-08T16:09:20.926829+0000","last_became_peered":"2023-10-08T16:09:20.926829+0000","last_unstale":"2023-10-08T16:09:20.930255+0000","last_undegraded":"2023-10-08T16:09:20.930255+0000","last_fullsized":"2023-10-08T16:09:20.930255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970929+0000","last_change":"2023-10-08T16:09:19.975261+0000","last_active":"2023-10-08T16:09:20.970929+0000","last_peered":"2023-10-08T16:09:20.970929+0000","last_clean":"2023-10-08T16:09:20.970929+0000","last_became_active":"2023-10-08T16:09:19.973725+0000","last_became_peered":"2023-10-08T16:09:19.973725+0000","last_unstale":"2023-10-08T16:09:20.970929+0000","last_undegraded":"2023-10-08T16:09:20.970929+0000","last_fullsized":"2023-10-08T16:09:20.970929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934834+0000","last_change":"2023-10-08T16:09:20.931298+0000","last_active":"2023-10-08T16:09:20.934834+0000","last_peered":"2023-10-08T16:09:20.934834+0000","last_clean":"2023-10-08T16:09:20.934834+0000","last_became_active":"2023-10-08T16:09:20.931005+0000","last_became_peered":"2023-10-08T16:09:20.931005+0000","last_unstale":"2023-10-08T16:09:20.934834+0000","last_undegraded":"2023-10-08T16:09:20.934834+0000","last_fullsized":"2023-10-08T16:09:20.934834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904313+0000","last_change":"2023-10-08T16:09:19.984230+0000","last_active":"2023-10-08T16:09:20.904313+0000","last_peered":"2023-10-08T16:09:20.904313+0000","last_clean":"2023-10-08T16:09:20.904313+0000","last_became_active":"2023-10-08T16:09:19.983946+0000","last_became_peered":"2023-10-08T16:09:19.983946+0000","last_unstale":"2023-10-08T16:09:20.904313+0000","last_undegraded":"2023-10-08T16:09:20.904313+0000","last_fullsized":"2023-10-08T16:09:20.904313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933894+0000","last_change":"2023-10-08T16:09:20.927574+0000","last_active":"2023-10-08T16:09:20.933894+0000","last_peered":"2023-10-08T16:09:20.933894+0000","last_clean":"2023-10-08T16:09:20.933894+0000","last_became_active":"2023-10-08T16:09:20.927296+0000","last_became_peered":"2023-10-08T16:09:20.927296+0000","last_unstale":"2023-10-08T16:09:20.933894+0000","last_undegraded":"2023-10-08T16:09:20.933894+0000","last_fullsized":"2023-10-08T16:09:20.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908051+0000","last_change":"2023-10-08T16:09:19.980289+0000","last_active":"2023-10-08T16:09:20.908051+0000","last_peered":"2023-10-08T16:09:20.908051+0000","last_clean":"2023-10-08T16:09:20.908051+0000","last_became_active":"2023-10-08T16:09:19.979983+0000","last_became_peered":"2023-10-08T16:09:19.979983+0000","last_unstale":"2023-10-08T16:09:20.908051+0000","last_undegraded":"2023-10-08T16:09:20.908051+0000","last_fullsized":"2023-10-08T16:09:20.908051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920184+0000","last_change":"2023-10-08T16:09:20.914485+0000","last_active":"2023-10-08T16:09:20.920184+0000","last_peered":"2023-10-08T16:09:20.920184+0000","last_clean":"2023-10-08T16:09:20.920184+0000","last_became_active":"2023-10-08T16:09:20.914148+0000","last_became_peered":"2023-10-08T16:09:20.914148+0000","last_unstale":"2023-10-08T16:09:20.920184+0000","last_undegraded":"2023-10-08T16:09:20.920184+0000","last_fullsized":"2023-10-08T16:09:20.920184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918439+0000","last_change":"2023-10-08T16:09:20.914673+0000","last_active":"2023-10-08T16:09:20.918439+0000","last_peered":"2023-10-08T16:09:20.918439+0000","last_clean":"2023-10-08T16:09:20.918439+0000","last_became_active":"2023-10-08T16:09:20.914358+0000","last_became_peered":"2023-10-08T16:09:20.914358+0000","last_unstale":"2023-10-08T16:09:20.918439+0000","last_undegraded":"2023-10-08T16:09:20.918439+0000","last_fullsized":"2023-10-08T16:09:20.918439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909604+0000","last_change":"2023-10-08T16:09:19.976530+0000","last_active":"2023-10-08T16:09:20.909604+0000","last_peered":"2023-10-08T16:09:20.909604+0000","last_clean":"2023-10-08T16:09:20.909604+0000","last_became_active":"2023-10-08T16:09:19.976209+0000","last_became_peered":"2023-10-08T16:09:19.976209+0000","last_unstale":"2023-10-08T16:09:20.909604+0000","last_undegraded":"2023-10-08T16:09:20.909604+0000","last_fullsized":"2023-10-08T16:09:20.909604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938527+0000","last_change":"2023-10-08T16:09:20.934594+0000","last_active":"2023-10-08T16:09:20.938527+0000","last_peered":"2023-10-08T16:09:20.938527+0000","last_clean":"2023-10-08T16:09:20.938527+0000","last_became_active":"2023-10-08T16:09:20.934373+0000","last_became_peered":"2023-10-08T16:09:20.934373+0000","last_unstale":"2023-10-08T16:09:20.938527+0000","last_undegraded":"2023-10-08T16:09:20.938527+0000","last_fullsized":"2023-10-08T16:09:20.938527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906768+0000","last_change":"2023-10-08T16:09:19.978998+0000","last_active":"2023-10-08T16:09:20.906768+0000","last_peered":"2023-10-08T16:09:20.906768+0000","last_clean":"2023-10-08T16:09:20.906768+0000","last_became_active":"2023-10-08T16:09:19.978699+0000","last_became_peered":"2023-10-08T16:09:19.978699+0000","last_unstale":"2023-10-08T16:09:20.906768+0000","last_undegraded":"2023-10-08T16:09:20.906768+0000","last_fullsized":"2023-10-08T16:09:20.906768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910926+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:20.910926+0000","last_peered":"2023-10-08T16:09:20.910926+0000","last_clean":"2023-10-08T16:09:20.910926+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:20.910926+0000","last_undegraded":"2023-10-08T16:09:20.910926+0000","last_fullsized":"2023-10-08T16:09:20.910926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927499+0000","last_change":"2023-10-08T16:09:20.922573+0000","last_active":"2023-10-08T16:09:20.927499+0000","last_peered":"2023-10-08T16:09:20.927499+0000","last_clean":"2023-10-08T16:09:20.927499+0000","last_became_active":"2023-10-08T16:09:20.922307+0000","last_became_peered":"2023-10-08T16:09:20.922307+0000","last_unstale":"2023-10-08T16:09:20.927499+0000","last_undegraded":"2023-10-08T16:09:20.927499+0000","last_fullsized":"2023-10-08T16:09:20.927499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.913353+0000","last_change":"2023-10-08T16:09:19.986258+0000","last_active":"2023-10-08T16:09:20.913353+0000","last_peered":"2023-10-08T16:09:20.913353+0000","last_clean":"2023-10-08T16:09:20.913353+0000","last_became_active":"2023-10-08T16:09:19.985989+0000","last_became_peered":"2023-10-08T16:09:19.985989+0000","last_unstale":"2023-10-08T16:09:20.913353+0000","last_undegraded":"2023-10-08T16:09:20.913353+0000","last_fullsized":"2023-10-08T16:09:20.913353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.912945+0000","last_change":"2023-10-08T16:09:19.980337+0000","last_active":"2023-10-08T16:09:20.912945+0000","last_peered":"2023-10-08T16:09:20.912945+0000","last_clean":"2023-10-08T16:09:20.912945+0000","last_became_active":"2023-10-08T16:09:19.980070+0000","last_became_peered":"2023-10-08T16:09:19.980070+0000","last_unstale":"2023-10-08T16:09:20.912945+0000","last_undegraded":"2023-10-08T16:09:20.912945+0000","last_fullsized":"2023-10-08T16:09:20.912945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918188+0000","last_change":"2023-10-08T16:09:20.915246+0000","last_active":"2023-10-08T16:09:20.918188+0000","last_peered":"2023-10-08T16:09:20.918188+0000","last_clean":"2023-10-08T16:09:20.918188+0000","last_became_active":"2023-10-08T16:09:20.914991+0000","last_became_peered":"2023-10-08T16:09:20.914991+0000","last_unstale":"2023-10-08T16:09:20.918188+0000","last_undegraded":"2023-10-08T16:09:20.918188+0000","last_fullsized":"2023-10-08T16:09:20.918188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.623858+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:22.623858+0000","last_peered":"2023-10-08T16:09:22.623858+0000","last_clean":"2023-10-08T16:09:22.623858+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:22.623858+0000","last_undegraded":"2023-10-08T16:09:22.623858+0000","last_fullsized":"2023-10-08T16:09:22.623858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925249+0000","last_change":"2023-10-08T16:09:20.921141+0000","last_active":"2023-10-08T16:09:20.925249+0000","last_peered":"2023-10-08T16:09:20.925249+0000","last_clean":"2023-10-08T16:09:20.925249+0000","last_became_active":"2023-10-08T16:09:20.920816+0000","last_became_peered":"2023-10-08T16:09:20.920816+0000","last_unstale":"2023-10-08T16:09:20.925249+0000","last_undegraded":"2023-10-08T16:09:20.925249+0000","last_fullsized":"2023-10-08T16:09:20.925249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972582+0000","last_change":"2023-10-08T16:09:19.983612+0000","last_active":"2023-10-08T16:09:20.972582+0000","last_peered":"2023-10-08T16:09:20.972582+0000","last_clean":"2023-10-08T16:09:20.972582+0000","last_became_active":"2023-10-08T16:09:19.983271+0000","last_became_peered":"2023-10-08T16:09:19.983271+0000","last_unstale":"2023-10-08T16:09:20.972582+0000","last_undegraded":"2023-10-08T16:09:20.972582+0000","last_fullsized":"2023-10-08T16:09:20.972582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927296+0000","last_change":"2023-10-08T16:09:20.920177+0000","last_active":"2023-10-08T16:09:20.927296+0000","last_peered":"2023-10-08T16:09:20.927296+0000","last_clean":"2023-10-08T16:09:20.927296+0000","last_became_active":"2023-10-08T16:09:20.919978+0000","last_became_peered":"2023-10-08T16:09:20.919978+0000","last_unstale":"2023-10-08T16:09:20.927296+0000","last_undegraded":"2023-10-08T16:09:20.927296+0000","last_fullsized":"2023-10-08T16:09:20.927296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.911835+0000","last_change":"2023-10-08T16:09:19.982502+0000","last_active":"2023-10-08T16:09:20.911835+0000","last_peered":"2023-10-08T16:09:20.911835+0000","last_clean":"2023-10-08T16:09:20.911835+0000","last_became_active":"2023-10-08T16:09:19.982165+0000","last_became_peered":"2023-10-08T16:09:19.982165+0000","last_unstale":"2023-10-08T16:09:20.911835+0000","last_undegraded":"2023-10-08T16:09:20.911835+0000","last_fullsized":"2023-10-08T16:09:20.911835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920335+0000","last_change":"2023-10-08T16:09:20.912685+0000","last_active":"2023-10-08T16:09:20.920335+0000","last_peered":"2023-10-08T16:09:20.920335+0000","last_clean":"2023-10-08T16:09:20.920335+0000","last_became_active":"2023-10-08T16:09:20.912404+0000","last_became_peered":"2023-10-08T16:09:20.912404+0000","last_unstale":"2023-10-08T16:09:20.920335+0000","last_undegraded":"2023-10-08T16:09:20.920335+0000","last_fullsized":"2023-10-08T16:09:20.920335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:49.906876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904177+0000","last_change":"2023-10-08T16:09:19.982753+0000","last_active":"2023-10-08T16:09:20.904177+0000","last_peered":"2023-10-08T16:09:20.904177+0000","last_clean":"2023-10-08T16:09:20.904177+0000","last_became_active":"2023-10-08T16:09:19.982334+0000","last_became_peered":"2023-10-08T16:09:19.982334+0000","last_unstale":"2023-10-08T16:09:20.904177+0000","last_undegraded":"2023-10-08T16:09:20.904177+0000","last_fullsized":"2023-10-08T16:09:20.904177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.924534+0000","last_change":"2023-10-08T16:09:20.919166+0000","last_active":"2023-10-08T16:09:20.924534+0000","last_peered":"2023-10-08T16:09:20.924534+0000","last_clean":"2023-10-08T16:09:20.924534+0000","last_became_active":"2023-10-08T16:09:20.918875+0000","last_became_peered":"2023-10-08T16:09:20.918875+0000","last_unstale":"2023-10-08T16:09:20.924534+0000","last_undegraded":"2023-10-08T16:09:20.924534+0000","last_fullsized":"2023-10-08T16:09:20.924534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904175+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904175+0000","last_peered":"2023-10-08T16:09:20.904175+0000","last_clean":"2023-10-08T16:09:20.904175+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904175+0000","last_undegraded":"2023-10-08T16:09:20.904175+0000","last_fullsized":"2023-10-08T16:09:20.904175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930491+0000","last_change":"2023-10-08T16:09:20.925593+0000","last_active":"2023-10-08T16:09:20.930491+0000","last_peered":"2023-10-08T16:09:20.930491+0000","last_clean":"2023-10-08T16:09:20.930491+0000","last_became_active":"2023-10-08T16:09:20.925297+0000","last_became_peered":"2023-10-08T16:09:20.925297+0000","last_unstale":"2023-10-08T16:09:20.930491+0000","last_undegraded":"2023-10-08T16:09:20.930491+0000","last_fullsized":"2023-10-08T16:09:20.930491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971799+0000","last_change":"2023-10-08T16:09:19.971356+0000","last_active":"2023-10-08T16:09:20.971799+0000","last_peered":"2023-10-08T16:09:20.971799+0000","last_clean":"2023-10-08T16:09:20.971799+0000","last_became_active":"2023-10-08T16:09:19.970744+0000","last_became_peered":"2023-10-08T16:09:19.970744+0000","last_unstale":"2023-10-08T16:09:20.971799+0000","last_undegraded":"2023-10-08T16:09:20.971799+0000","last_fullsized":"2023-10-08T16:09:20.971799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932776+0000","last_change":"2023-10-08T16:09:20.929086+0000","last_active":"2023-10-08T16:09:20.932776+0000","last_peered":"2023-10-08T16:09:20.932776+0000","last_clean":"2023-10-08T16:09:20.932776+0000","last_became_active":"2023-10-08T16:09:20.928822+0000","last_became_peered":"2023-10-08T16:09:20.928822+0000","last_unstale":"2023-10-08T16:09:20.932776+0000","last_undegraded":"2023-10-08T16:09:20.932776+0000","last_fullsized":"2023-10-08T16:09:20.932776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909850+0000","last_change":"2023-10-08T16:09:19.981894+0000","last_active":"2023-10-08T16:09:20.909850+0000","last_peered":"2023-10-08T16:09:20.909850+0000","last_clean":"2023-10-08T16:09:20.909850+0000","last_became_active":"2023-10-08T16:09:19.981565+0000","last_became_peered":"2023-10-08T16:09:19.981565+0000","last_unstale":"2023-10-08T16:09:20.909850+0000","last_undegraded":"2023-10-08T16:09:20.909850+0000","last_fullsized":"2023-10-08T16:09:20.909850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929759+0000","last_change":"2023-10-08T16:09:20.923617+0000","last_active":"2023-10-08T16:09:20.929759+0000","last_peered":"2023-10-08T16:09:20.929759+0000","last_clean":"2023-10-08T16:09:20.929759+0000","last_became_active":"2023-10-08T16:09:20.923317+0000","last_became_peered":"2023-10-08T16:09:20.923317+0000","last_unstale":"2023-10-08T16:09:20.929759+0000","last_undegraded":"2023-10-08T16:09:20.929759+0000","last_fullsized":"2023-10-08T16:09:20.929759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:42.436753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970642+0000","last_change":"2023-10-08T16:09:19.980864+0000","last_active":"2023-10-08T16:09:20.970642+0000","last_peered":"2023-10-08T16:09:20.970642+0000","last_clean":"2023-10-08T16:09:20.970642+0000","last_became_active":"2023-10-08T16:09:19.980600+0000","last_became_peered":"2023-10-08T16:09:19.980600+0000","last_unstale":"2023-10-08T16:09:20.970642+0000","last_undegraded":"2023-10-08T16:09:20.970642+0000","last_fullsized":"2023-10-08T16:09:20.970642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935869+0000","last_change":"2023-10-08T16:09:20.933766+0000","last_active":"2023-10-08T16:09:20.935869+0000","last_peered":"2023-10-08T16:09:20.935869+0000","last_clean":"2023-10-08T16:09:20.935869+0000","last_became_active":"2023-10-08T16:09:20.932450+0000","last_became_peered":"2023-10-08T16:09:20.932450+0000","last_unstale":"2023-10-08T16:09:20.935869+0000","last_undegraded":"2023-10-08T16:09:20.935869+0000","last_fullsized":"2023-10-08T16:09:20.935869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973172+0000","last_change":"2023-10-08T16:09:19.976571+0000","last_active":"2023-10-08T16:09:20.973172+0000","last_peered":"2023-10-08T16:09:20.973172+0000","last_clean":"2023-10-08T16:09:20.973172+0000","last_became_active":"2023-10-08T16:09:19.976236+0000","last_became_peered":"2023-10-08T16:09:19.976236+0000","last_unstale":"2023-10-08T16:09:20.973172+0000","last_undegraded":"2023-10-08T16:09:20.973172+0000","last_fullsized":"2023-10-08T16:09:20.973172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934951+0000","last_change":"2023-10-08T16:09:20.932413+0000","last_active":"2023-10-08T16:09:20.934951+0000","last_peered":"2023-10-08T16:09:20.934951+0000","last_clean":"2023-10-08T16:09:20.934951+0000","last_became_active":"2023-10-08T16:09:20.932147+0000","last_became_peered":"2023-10-08T16:09:20.932147+0000","last_unstale":"2023-10-08T16:09:20.934951+0000","last_undegraded":"2023-10-08T16:09:20.934951+0000","last_fullsized":"2023-10-08T16:09:20.934951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925266+0000","last_change":"2023-10-08T16:09:20.922001+0000","last_active":"2023-10-08T16:09:20.925266+0000","last_peered":"2023-10-08T16:09:20.925266+0000","last_clean":"2023-10-08T16:09:20.925266+0000","last_became_active":"2023-10-08T16:09:20.921669+0000","last_became_peered":"2023-10-08T16:09:20.921669+0000","last_unstale":"2023-10-08T16:09:20.925266+0000","last_undegraded":"2023-10-08T16:09:20.925266+0000","last_fullsized":"2023-10-08T16:09:20.925266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922887+0000","last_change":"2023-10-08T16:09:20.921422+0000","last_active":"2023-10-08T16:09:20.922887+0000","last_peered":"2023-10-08T16:09:20.922887+0000","last_clean":"2023-10-08T16:09:20.922887+0000","last_became_active":"2023-10-08T16:09:20.921165+0000","last_became_peered":"2023-10-08T16:09:20.921165+0000","last_unstale":"2023-10-08T16:09:20.922887+0000","last_undegraded":"2023-10-08T16:09:20.922887+0000","last_fullsized":"2023-10-08T16:09:20.922887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934025+0000","last_change":"2023-10-08T16:09:20.931352+0000","last_active":"2023-10-08T16:09:20.934025+0000","last_peered":"2023-10-08T16:09:20.934025+0000","last_clean":"2023-10-08T16:09:20.934025+0000","last_became_active":"2023-10-08T16:09:20.931070+0000","last_became_peered":"2023-10-08T16:09:20.931070+0000","last_unstale":"2023-10-08T16:09:20.934025+0000","last_undegraded":"2023-10-08T16:09:20.934025+0000","last_fullsized":"2023-10-08T16:09:20.934025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930029+0000","last_change":"2023-10-08T16:09:20.926274+0000","last_active":"2023-10-08T16:09:20.930029+0000","last_peered":"2023-10-08T16:09:20.930029+0000","last_clean":"2023-10-08T16:09:20.930029+0000","last_became_active":"2023-10-08T16:09:20.925863+0000","last_became_peered":"2023-10-08T16:09:20.925863+0000","last_unstale":"2023-10-08T16:09:20.930029+0000","last_undegraded":"2023-10-08T16:09:20.930029+0000","last_fullsized":"2023-10-08T16:09:20.930029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930429+0000","last_change":"2023-10-08T16:09:20.925620+0000","last_active":"2023-10-08T16:09:20.930429+0000","last_peered":"2023-10-08T16:09:20.930429+0000","last_clean":"2023-10-08T16:09:20.930429+0000","last_became_active":"2023-10-08T16:09:20.924561+0000","last_became_peered":"2023-10-08T16:09:20.924561+0000","last_unstale":"2023-10-08T16:09:20.930429+0000","last_undegraded":"2023-10-08T16:09:20.930429+0000","last_fullsized":"2023-10-08T16:09:20.930429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918309+0000","last_change":"2023-10-08T16:09:20.916056+0000","last_active":"2023-10-08T16:09:20.918309+0000","last_peered":"2023-10-08T16:09:20.918309+0000","last_clean":"2023-10-08T16:09:20.918309+0000","last_became_active":"2023-10-08T16:09:20.915784+0000","last_became_peered":"2023-10-08T16:09:20.915784+0000","last_unstale":"2023-10-08T16:09:20.918309+0000","last_undegraded":"2023-10-08T16:09:20.918309+0000","last_fullsized":"2023-10-08T16:09:20.918309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927968+0000","last_change":"2023-10-08T16:09:20.926730+0000","last_active":"2023-10-08T16:09:20.927968+0000","last_peered":"2023-10-08T16:09:20.927968+0000","last_clean":"2023-10-08T16:09:20.927968+0000","last_became_active":"2023-10-08T16:09:20.925172+0000","last_became_peered":"2023-10-08T16:09:20.925172+0000","last_unstale":"2023-10-08T16:09:20.927968+0000","last_undegraded":"2023-10-08T16:09:20.927968+0000","last_fullsized":"2023-10-08T16:09:20.927968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930295+0000","last_change":"2023-10-08T16:09:20.925120+0000","last_active":"2023-10-08T16:09:20.930295+0000","last_peered":"2023-10-08T16:09:20.930295+0000","last_clean":"2023-10-08T16:09:20.930295+0000","last_became_active":"2023-10-08T16:09:20.924840+0000","last_became_peered":"2023-10-08T16:09:20.924840+0000","last_unstale":"2023-10-08T16:09:20.930295+0000","last_undegraded":"2023-10-08T16:09:20.930295+0000","last_fullsized":"2023-10-08T16:09:20.930295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934825+0000","last_change":"2023-10-08T16:09:20.932038+0000","last_active":"2023-10-08T16:09:20.934825+0000","last_peered":"2023-10-08T16:09:20.934825+0000","last_clean":"2023-10-08T16:09:20.934825+0000","last_became_active":"2023-10-08T16:09:20.931773+0000","last_became_peered":"2023-10-08T16:09:20.931773+0000","last_unstale":"2023-10-08T16:09:20.934825+0000","last_undegraded":"2023-10-08T16:09:20.934825+0000","last_fullsized":"2023-10-08T16:09:20.934825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930258+0000","last_change":"2023-10-08T16:09:20.925060+0000","last_active":"2023-10-08T16:09:20.930258+0000","last_peered":"2023-10-08T16:09:20.930258+0000","last_clean":"2023-10-08T16:09:20.930258+0000","last_became_active":"2023-10-08T16:09:20.924565+0000","last_became_peered":"2023-10-08T16:09:20.924565+0000","last_unstale":"2023-10-08T16:09:20.930258+0000","last_undegraded":"2023-10-08T16:09:20.930258+0000","last_fullsized":"2023-10-08T16:09:20.930258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932817+0000","last_change":"2023-10-08T16:09:20.921042+0000","last_active":"2023-10-08T16:09:20.932817+0000","last_peered":"2023-10-08T16:09:20.932817+0000","last_clean":"2023-10-08T16:09:20.932817+0000","last_became_active":"2023-10-08T16:09:20.920766+0000","last_became_peered":"2023-10-08T16:09:20.920766+0000","last_unstale":"2023-10-08T16:09:20.932817+0000","last_undegraded":"2023-10-08T16:09:20.932817+0000","last_fullsized":"2023-10-08T16:09:20.932817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927308+0000","last_change":"2023-10-08T16:09:20.920992+0000","last_active":"2023-10-08T16:09:20.927308+0000","last_peered":"2023-10-08T16:09:20.927308+0000","last_clean":"2023-10-08T16:09:20.927308+0000","last_became_active":"2023-10-08T16:09:20.920227+0000","last_became_peered":"2023-10-08T16:09:20.920227+0000","last_unstale":"2023-10-08T16:09:20.927308+0000","last_undegraded":"2023-10-08T16:09:20.927308+0000","last_fullsized":"2023-10-08T16:09:20.927308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932806+0000","last_change":"2023-10-08T16:09:20.930112+0000","last_active":"2023-10-08T16:09:20.932806+0000","last_peered":"2023-10-08T16:09:20.932806+0000","last_clean":"2023-10-08T16:09:20.932806+0000","last_became_active":"2023-10-08T16:09:20.929813+0000","last_became_peered":"2023-10-08T16:09:20.929813+0000","last_unstale":"2023-10-08T16:09:20.932806+0000","last_undegraded":"2023-10-08T16:09:20.932806+0000","last_fullsized":"2023-10-08T16:09:20.932806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.032}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301600,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070240,"statfs":{"total":96636764160,"available":96327925760,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:35.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:09:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.127+0000 7faf8359e700 1 Processor -- start 2023-10-08T16:09:36.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.128+0000 7faf8359e700 1 -- start start 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840cec30 con 0x7faf8415a8c0 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840ce930 con 0x7faf8406dfa0 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840cd7a0 con 0x7faf840b2980 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf82d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.129+0000 7faf8259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf81d9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7faf8415a8c0 0x7faf8406d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42064/0 (socket says 172.21.15.12:42064) 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf81d9b700 1 -- 172.21.15.12:0/2006376626 learned_addr learned my addr 172.21.15.12:0/2006376626 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:50330/0 (socket says 172.21.15.12:50330) 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf82d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47152/0 (socket says 172.21.15.12:47152) 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8159a700 1 -- 172.21.15.12:0/2006376626 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574288128 0 0) 0x7faf840cec30 con 0x7faf8415a8c0 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8159a700 1 -- 172.21.15.12:0/2006376626 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf6c003570 con 0x7faf8415a8c0 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 -- 172.21.15.12:0/2006376626 >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 msgr2=0x7faf840cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 --2- 172.21.15.12:0/2006376626 >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 -- 172.21.15.12:0/2006376626 >> v1:172.21.15.29:6789/0 conn(0x7faf8415a8c0 legacy=0x7faf8406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 -- 172.21.15.12:0/2006376626 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840cda80 con 0x7faf840b2980 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf82d9d700 1 --2- 172.21.15.12:0/2006376626 >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.130+0000 7faf8259c700 1 --2- 172.21.15.12:0/2006376626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf740098e0 tx=0x7faf740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=871e15d373e0632 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8159a700 1 -- 172.21.15.12:0/2006376626 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011630 con 0x7faf840b2980 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8159a700 1 -- 172.21.15.12:0/2006376626 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74011790 con 0x7faf840b2980 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8159a700 1 -- 172.21.15.12:0/2006376626 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf74011b30 con 0x7faf840b2980 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 -- 172.21.15.12:0/2006376626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 msgr2=0x7faf840cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 --2- 172.21.15.12:0/2006376626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7faf740098e0 tx=0x7faf740091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 -- 172.21.15.12:0/2006376626 shutdown_connections 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 --2- 172.21.15.12:0/2006376626 >> v2:172.21.15.29:3300/0 conn(0x7faf8406dfa0 0x7faf840cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 --2- 172.21.15.12:0/2006376626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf840b2980 0x7faf840cce00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 -- 172.21.15.12:0/2006376626 >> 172.21.15.12:0/2006376626 conn(0x7faf840703a0 msgr2=0x7faf840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 -- 172.21.15.12:0/2006376626 shutdown_connections 2023-10-08T16:09:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.131+0000 7faf8359e700 1 -- 172.21.15.12:0/2006376626 wait complete. 2023-10-08T16:09:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.133+0000 7faf8359e700 1 Processor -- start 2023-10-08T16:09:36.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.133+0000 7faf8359e700 1 -- start start 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 0x7faf8414ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 0x7faf8415e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b50c0 con 0x7faf840b2980 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b41e0 con 0x7faf8415a8c0 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b44b0 con 0x7faf8406dfa0 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf81d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf81d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40358/0 (socket says 172.21.15.12:40358) 2023-10-08T16:09:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf81d9b700 1 -- 172.21.15.12:0/2701097071 learned_addr learned my addr 172.21.15.12:0/2701097071 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf8259c700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 0x7faf8414ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.134+0000 7faf82d9d700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 0x7faf8415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 -- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 msgr2=0x7faf8414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 0x7faf8414ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 -- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 msgr2=0x7faf8415e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 0x7faf8415e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 -- 172.21.15.12:0/2701097071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009a20 con 0x7faf840b2980 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf8259c700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 0x7faf8414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf82d9d700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 0x7faf8415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf81d9b700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c7c0 tx=0x7faf78007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78005b30 con 0x7faf840b2980 2023-10-08T16:09:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78005c90 con 0x7faf840b2980 2023-10-08T16:09:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf74009420 con 0x7faf840b2980 2023-10-08T16:09:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78007340 con 0x7faf840b2980 2023-10-08T16:09:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.135+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840b4a70 con 0x7faf840b2980 2023-10-08T16:09:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.136+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8404c3c0 con 0x7faf840b2980 2023-10-08T16:09:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.137+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf7801b400 con 0x7faf840b2980 2023-10-08T16:09:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.138+0000 7faf727fc700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 0x7faf640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.138+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf78084070 con 0x7faf840b2980 2023-10-08T16:09:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.138+0000 7faf8259c700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 0x7faf640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.139+0000 7faf8259c700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 0x7faf640693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf74003080 tx=0x7faf74017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.142+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf780512c0 con 0x7faf840b2980 2023-10-08T16:09:36.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.338+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf840cbd30 con 0x7faf64066f30 2023-10-08T16:09:36.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.346+0000 7faf727fc700 1 -- 172.21.15.12:0/2701097071 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264448 (secure 0 0 0) 0x7faf840cbd30 con 0x7faf64066f30 2023-10-08T16:09:36.350 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 msgr2=0x7faf640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 0x7faf640693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faf74003080 tx=0x7faf74017000 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 msgr2=0x7faf840b3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c7c0 tx=0x7faf78007e00 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 shutdown_connections 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf8415a8c0 0x7faf8415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf8406dfa0 0x7faf8414ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faf64066f30 0x7faf640693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 --2- 172.21.15.12:0/2701097071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf840b2980 0x7faf840b3ca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 >> 172.21.15.12:0/2701097071 conn(0x7faf840703a0 msgr2=0x7faf84158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 shutdown_connections 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.350+0000 7faf8359e700 1 -- 172.21.15.12:0/2701097071 wait complete. 2023-10-08T16:09:36.353 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:09:36.368 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-08T16:09:35.915585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2397608,"kb_used_data":2920,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752577112,"statfs":{"total":773094113280,"available":770638962688,"internally_reserved":0,"allocated":2990080,"data_stored":1787852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931948+0000","last_change":"2023-10-08T16:09:20.923239+0000","last_active":"2023-10-08T16:09:20.931948+0000","last_peered":"2023-10-08T16:09:20.931948+0000","last_clean":"2023-10-08T16:09:20.931948+0000","last_became_active":"2023-10-08T16:09:20.922789+0000","last_became_peered":"2023-10-08T16:09:20.922789+0000","last_unstale":"2023-10-08T16:09:20.931948+0000","last_undegraded":"2023-10-08T16:09:20.931948+0000","last_fullsized":"2023-10-08T16:09:20.931948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:36.471481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918249+0000","last_change":"2023-10-08T16:09:20.914085+0000","last_active":"2023-10-08T16:09:20.918249+0000","last_peered":"2023-10-08T16:09:20.918249+0000","last_clean":"2023-10-08T16:09:20.918249+0000","last_became_active":"2023-10-08T16:09:20.913834+0000","last_became_peered":"2023-10-08T16:09:20.913834+0000","last_unstale":"2023-10-08T16:09:20.918249+0000","last_undegraded":"2023-10-08T16:09:20.918249+0000","last_fullsized":"2023-10-08T16:09:20.918249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.919536+0000","last_change":"2023-10-08T16:09:20.915094+0000","last_active":"2023-10-08T16:09:20.919536+0000","last_peered":"2023-10-08T16:09:20.919536+0000","last_clean":"2023-10-08T16:09:20.919536+0000","last_became_active":"2023-10-08T16:09:20.914821+0000","last_became_peered":"2023-10-08T16:09:20.914821+0000","last_unstale":"2023-10-08T16:09:20.919536+0000","last_undegraded":"2023-10-08T16:09:20.919536+0000","last_fullsized":"2023-10-08T16:09:20.919536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:32:39.983055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934072+0000","last_change":"2023-10-08T16:09:20.931361+0000","last_active":"2023-10-08T16:09:20.934072+0000","last_peered":"2023-10-08T16:09:20.934072+0000","last_clean":"2023-10-08T16:09:20.934072+0000","last_became_active":"2023-10-08T16:09:20.931006+0000","last_became_peered":"2023-10-08T16:09:20.931006+0000","last_unstale":"2023-10-08T16:09:20.934072+0000","last_undegraded":"2023-10-08T16:09:20.934072+0000","last_fullsized":"2023-10-08T16:09:20.934072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931450+0000","last_change":"2023-10-08T16:09:20.924404+0000","last_active":"2023-10-08T16:09:20.931450+0000","last_peered":"2023-10-08T16:09:20.931450+0000","last_clean":"2023-10-08T16:09:20.931450+0000","last_became_active":"2023-10-08T16:09:20.924076+0000","last_became_peered":"2023-10-08T16:09:20.924076+0000","last_unstale":"2023-10-08T16:09:20.931450+0000","last_undegraded":"2023-10-08T16:09:20.931450+0000","last_fullsized":"2023-10-08T16:09:20.931450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:29.248199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932898+0000","last_change":"2023-10-08T16:09:20.922230+0000","last_active":"2023-10-08T16:09:20.932898+0000","last_peered":"2023-10-08T16:09:20.932898+0000","last_clean":"2023-10-08T16:09:20.932898+0000","last_became_active":"2023-10-08T16:09:20.921756+0000","last_became_peered":"2023-10-08T16:09:20.921756+0000","last_unstale":"2023-10-08T16:09:20.932898+0000","last_undegraded":"2023-10-08T16:09:20.932898+0000","last_fullsized":"2023-10-08T16:09:20.932898+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930235+0000","last_change":"2023-10-08T16:09:20.926442+0000","last_active":"2023-10-08T16:09:20.930235+0000","last_peered":"2023-10-08T16:09:20.930235+0000","last_clean":"2023-10-08T16:09:20.930235+0000","last_became_active":"2023-10-08T16:09:20.926134+0000","last_became_peered":"2023-10-08T16:09:20.926134+0000","last_unstale":"2023-10-08T16:09:20.930235+0000","last_undegraded":"2023-10-08T16:09:20.930235+0000","last_fullsized":"2023-10-08T16:09:20.930235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:51:09.382701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938511+0000","last_change":"2023-10-08T16:09:20.934468+0000","last_active":"2023-10-08T16:09:20.938511+0000","last_peered":"2023-10-08T16:09:20.938511+0000","last_clean":"2023-10-08T16:09:20.938511+0000","last_became_active":"2023-10-08T16:09:20.934187+0000","last_became_peered":"2023-10-08T16:09:20.934187+0000","last_unstale":"2023-10-08T16:09:20.938511+0000","last_undegraded":"2023-10-08T16:09:20.938511+0000","last_fullsized":"2023-10-08T16:09:20.938511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:02:48.801193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934886+0000","last_change":"2023-10-08T16:09:20.930046+0000","last_active":"2023-10-08T16:09:20.934886+0000","last_peered":"2023-10-08T16:09:20.934886+0000","last_clean":"2023-10-08T16:09:20.934886+0000","last_became_active":"2023-10-08T16:09:20.929384+0000","last_became_peered":"2023-10-08T16:09:20.929384+0000","last_unstale":"2023-10-08T16:09:20.934886+0000","last_undegraded":"2023-10-08T16:09:20.934886+0000","last_fullsized":"2023-10-08T16:09:20.934886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:39:29.654343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925610+0000","last_change":"2023-10-08T16:09:20.921732+0000","last_active":"2023-10-08T16:09:20.925610+0000","last_peered":"2023-10-08T16:09:20.925610+0000","last_clean":"2023-10-08T16:09:20.925610+0000","last_became_active":"2023-10-08T16:09:20.921260+0000","last_became_peered":"2023-10-08T16:09:20.921260+0000","last_unstale":"2023-10-08T16:09:20.925610+0000","last_undegraded":"2023-10-08T16:09:20.925610+0000","last_fullsized":"2023-10-08T16:09:20.925610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935782+0000","last_change":"2023-10-08T16:09:20.934331+0000","last_active":"2023-10-08T16:09:20.935782+0000","last_peered":"2023-10-08T16:09:20.935782+0000","last_clean":"2023-10-08T16:09:20.935782+0000","last_became_active":"2023-10-08T16:09:20.934023+0000","last_became_peered":"2023-10-08T16:09:20.934023+0000","last_unstale":"2023-10-08T16:09:20.935782+0000","last_undegraded":"2023-10-08T16:09:20.935782+0000","last_fullsized":"2023-10-08T16:09:20.935782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927686+0000","last_change":"2023-10-08T16:09:20.921076+0000","last_active":"2023-10-08T16:09:20.927686+0000","last_peered":"2023-10-08T16:09:20.927686+0000","last_clean":"2023-10-08T16:09:20.927686+0000","last_became_active":"2023-10-08T16:09:20.920798+0000","last_became_peered":"2023-10-08T16:09:20.920798+0000","last_unstale":"2023-10-08T16:09:20.927686+0000","last_undegraded":"2023-10-08T16:09:20.927686+0000","last_fullsized":"2023-10-08T16:09:20.927686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:00.083968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925745+0000","last_change":"2023-10-08T16:09:20.922551+0000","last_active":"2023-10-08T16:09:20.925745+0000","last_peered":"2023-10-08T16:09:20.925745+0000","last_clean":"2023-10-08T16:09:20.925745+0000","last_became_active":"2023-10-08T16:09:20.922276+0000","last_became_peered":"2023-10-08T16:09:20.922276+0000","last_unstale":"2023-10-08T16:09:20.925745+0000","last_undegraded":"2023-10-08T16:09:20.925745+0000","last_fullsized":"2023-10-08T16:09:20.925745+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927387+0000","last_change":"2023-10-08T16:09:20.921190+0000","last_active":"2023-10-08T16:09:20.927387+0000","last_peered":"2023-10-08T16:09:20.927387+0000","last_clean":"2023-10-08T16:09:20.927387+0000","last_became_active":"2023-10-08T16:09:20.920627+0000","last_became_peered":"2023-10-08T16:09:20.920627+0000","last_unstale":"2023-10-08T16:09:20.927387+0000","last_undegraded":"2023-10-08T16:09:20.927387+0000","last_fullsized":"2023-10-08T16:09:20.927387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:16.772848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918396+0000","last_change":"2023-10-08T16:09:20.913009+0000","last_active":"2023-10-08T16:09:20.918396+0000","last_peered":"2023-10-08T16:09:20.918396+0000","last_clean":"2023-10-08T16:09:20.918396+0000","last_became_active":"2023-10-08T16:09:20.912719+0000","last_became_peered":"2023-10-08T16:09:20.912719+0000","last_unstale":"2023-10-08T16:09:20.918396+0000","last_undegraded":"2023-10-08T16:09:20.918396+0000","last_fullsized":"2023-10-08T16:09:20.918396+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920698+0000","last_change":"2023-10-08T16:09:20.916696+0000","last_active":"2023-10-08T16:09:20.920698+0000","last_peered":"2023-10-08T16:09:20.920698+0000","last_clean":"2023-10-08T16:09:20.920698+0000","last_became_active":"2023-10-08T16:09:20.916352+0000","last_became_peered":"2023-10-08T16:09:20.916352+0000","last_unstale":"2023-10-08T16:09:20.920698+0000","last_undegraded":"2023-10-08T16:09:20.920698+0000","last_fullsized":"2023-10-08T16:09:20.920698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928741+0000","last_change":"2023-10-08T16:09:20.919110+0000","last_active":"2023-10-08T16:09:20.928741+0000","last_peered":"2023-10-08T16:09:20.928741+0000","last_clean":"2023-10-08T16:09:20.928741+0000","last_became_active":"2023-10-08T16:09:20.918780+0000","last_became_peered":"2023-10-08T16:09:20.918780+0000","last_unstale":"2023-10-08T16:09:20.928741+0000","last_undegraded":"2023-10-08T16:09:20.928741+0000","last_fullsized":"2023-10-08T16:09:20.928741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922564+0000","last_change":"2023-10-08T16:09:20.918158+0000","last_active":"2023-10-08T16:09:20.922564+0000","last_peered":"2023-10-08T16:09:20.922564+0000","last_clean":"2023-10-08T16:09:20.922564+0000","last_became_active":"2023-10-08T16:09:20.917856+0000","last_became_peered":"2023-10-08T16:09:20.917856+0000","last_unstale":"2023-10-08T16:09:20.922564+0000","last_undegraded":"2023-10-08T16:09:20.922564+0000","last_fullsized":"2023-10-08T16:09:20.922564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931481+0000","last_change":"2023-10-08T16:09:20.927146+0000","last_active":"2023-10-08T16:09:20.931481+0000","last_peered":"2023-10-08T16:09:20.931481+0000","last_clean":"2023-10-08T16:09:20.931481+0000","last_became_active":"2023-10-08T16:09:20.924805+0000","last_became_peered":"2023-10-08T16:09:20.924805+0000","last_unstale":"2023-10-08T16:09:20.931481+0000","last_undegraded":"2023-10-08T16:09:20.931481+0000","last_fullsized":"2023-10-08T16:09:20.931481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:05:43.539522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972105+0000","last_change":"2023-10-08T16:09:19.983339+0000","last_active":"2023-10-08T16:09:20.972105+0000","last_peered":"2023-10-08T16:09:20.972105+0000","last_clean":"2023-10-08T16:09:20.972105+0000","last_became_active":"2023-10-08T16:09:19.983052+0000","last_became_peered":"2023-10-08T16:09:19.983052+0000","last_unstale":"2023-10-08T16:09:20.972105+0000","last_undegraded":"2023-10-08T16:09:20.972105+0000","last_fullsized":"2023-10-08T16:09:20.972105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:34.125353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925071+0000","last_change":"2023-10-08T16:09:20.923270+0000","last_active":"2023-10-08T16:09:20.925071+0000","last_peered":"2023-10-08T16:09:20.925071+0000","last_clean":"2023-10-08T16:09:20.925071+0000","last_became_active":"2023-10-08T16:09:20.923011+0000","last_became_peered":"2023-10-08T16:09:20.923011+0000","last_unstale":"2023-10-08T16:09:20.925071+0000","last_undegraded":"2023-10-08T16:09:20.925071+0000","last_fullsized":"2023-10-08T16:09:20.925071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975780+0000","last_change":"2023-10-08T16:09:19.983890+0000","last_active":"2023-10-08T16:09:20.975780+0000","last_peered":"2023-10-08T16:09:20.975780+0000","last_clean":"2023-10-08T16:09:20.975780+0000","last_became_active":"2023-10-08T16:09:19.983629+0000","last_became_peered":"2023-10-08T16:09:19.983629+0000","last_unstale":"2023-10-08T16:09:20.975780+0000","last_undegraded":"2023-10-08T16:09:20.975780+0000","last_fullsized":"2023-10-08T16:09:20.975780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932721+0000","last_change":"2023-10-08T16:09:20.929176+0000","last_active":"2023-10-08T16:09:20.932721+0000","last_peered":"2023-10-08T16:09:20.932721+0000","last_clean":"2023-10-08T16:09:20.932721+0000","last_became_active":"2023-10-08T16:09:20.928937+0000","last_became_peered":"2023-10-08T16:09:20.928937+0000","last_unstale":"2023-10-08T16:09:20.932721+0000","last_undegraded":"2023-10-08T16:09:20.932721+0000","last_fullsized":"2023-10-08T16:09:20.932721+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973901+0000","last_change":"2023-10-08T16:09:19.982390+0000","last_active":"2023-10-08T16:09:20.973901+0000","last_peered":"2023-10-08T16:09:20.973901+0000","last_clean":"2023-10-08T16:09:20.973901+0000","last_became_active":"2023-10-08T16:09:19.982067+0000","last_became_peered":"2023-10-08T16:09:19.982067+0000","last_unstale":"2023-10-08T16:09:20.973901+0000","last_undegraded":"2023-10-08T16:09:20.973901+0000","last_fullsized":"2023-10-08T16:09:20.973901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:52:56.247054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933876+0000","last_change":"2023-10-08T16:09:20.928229+0000","last_active":"2023-10-08T16:09:20.933876+0000","last_peered":"2023-10-08T16:09:20.933876+0000","last_clean":"2023-10-08T16:09:20.933876+0000","last_became_active":"2023-10-08T16:09:20.927947+0000","last_became_peered":"2023-10-08T16:09:20.927947+0000","last_unstale":"2023-10-08T16:09:20.933876+0000","last_undegraded":"2023-10-08T16:09:20.933876+0000","last_fullsized":"2023-10-08T16:09:20.933876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:20.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971881+0000","last_change":"2023-10-08T16:09:19.976558+0000","last_active":"2023-10-08T16:09:20.971881+0000","last_peered":"2023-10-08T16:09:20.971881+0000","last_clean":"2023-10-08T16:09:20.971881+0000","last_became_active":"2023-10-08T16:09:19.976190+0000","last_became_peered":"2023-10-08T16:09:19.976190+0000","last_unstale":"2023-10-08T16:09:20.971881+0000","last_undegraded":"2023-10-08T16:09:20.971881+0000","last_fullsized":"2023-10-08T16:09:20.971881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:16.143856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933050+0000","last_change":"2023-10-08T16:09:20.926759+0000","last_active":"2023-10-08T16:09:20.933050+0000","last_peered":"2023-10-08T16:09:20.933050+0000","last_clean":"2023-10-08T16:09:20.933050+0000","last_became_active":"2023-10-08T16:09:20.926449+0000","last_became_peered":"2023-10-08T16:09:20.926449+0000","last_unstale":"2023-10-08T16:09:20.933050+0000","last_undegraded":"2023-10-08T16:09:20.933050+0000","last_fullsized":"2023-10-08T16:09:20.933050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.975655+0000","last_change":"2023-10-08T16:09:19.983304+0000","last_active":"2023-10-08T16:09:20.975655+0000","last_peered":"2023-10-08T16:09:20.975655+0000","last_clean":"2023-10-08T16:09:20.975655+0000","last_became_active":"2023-10-08T16:09:19.982916+0000","last_became_peered":"2023-10-08T16:09:19.982916+0000","last_unstale":"2023-10-08T16:09:20.975655+0000","last_undegraded":"2023-10-08T16:09:20.975655+0000","last_fullsized":"2023-10-08T16:09:20.975655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925716+0000","last_change":"2023-10-08T16:09:20.914915+0000","last_active":"2023-10-08T16:09:20.925716+0000","last_peered":"2023-10-08T16:09:20.925716+0000","last_clean":"2023-10-08T16:09:20.925716+0000","last_became_active":"2023-10-08T16:09:20.914562+0000","last_became_peered":"2023-10-08T16:09:20.914562+0000","last_unstale":"2023-10-08T16:09:20.925716+0000","last_undegraded":"2023-10-08T16:09:20.925716+0000","last_fullsized":"2023-10-08T16:09:20.925716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:04.190114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.969110+0000","last_change":"2023-10-08T16:09:19.982834+0000","last_active":"2023-10-08T16:09:20.969110+0000","last_peered":"2023-10-08T16:09:20.969110+0000","last_clean":"2023-10-08T16:09:20.969110+0000","last_became_active":"2023-10-08T16:09:19.981385+0000","last_became_peered":"2023-10-08T16:09:19.981385+0000","last_unstale":"2023-10-08T16:09:20.969110+0000","last_undegraded":"2023-10-08T16:09:20.969110+0000","last_fullsized":"2023-10-08T16:09:20.969110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930013+0000","last_change":"2023-10-08T16:09:20.924374+0000","last_active":"2023-10-08T16:09:20.930013+0000","last_peered":"2023-10-08T16:09:20.930013+0000","last_clean":"2023-10-08T16:09:20.930013+0000","last_became_active":"2023-10-08T16:09:20.924067+0000","last_became_peered":"2023-10-08T16:09:20.924067+0000","last_unstale":"2023-10-08T16:09:20.930013+0000","last_undegraded":"2023-10-08T16:09:20.930013+0000","last_fullsized":"2023-10-08T16:09:20.930013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.916621+0000","last_change":"2023-10-08T16:09:19.979195+0000","last_active":"2023-10-08T16:09:20.916621+0000","last_peered":"2023-10-08T16:09:20.916621+0000","last_clean":"2023-10-08T16:09:20.916621+0000","last_became_active":"2023-10-08T16:09:19.977936+0000","last_became_peered":"2023-10-08T16:09:19.977936+0000","last_unstale":"2023-10-08T16:09:20.916621+0000","last_undegraded":"2023-10-08T16:09:20.916621+0000","last_fullsized":"2023-10-08T16:09:20.916621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933011+0000","last_change":"2023-10-08T16:09:20.928131+0000","last_active":"2023-10-08T16:09:20.933011+0000","last_peered":"2023-10-08T16:09:20.933011+0000","last_clean":"2023-10-08T16:09:20.933011+0000","last_became_active":"2023-10-08T16:09:20.927721+0000","last_became_peered":"2023-10-08T16:09:20.927721+0000","last_unstale":"2023-10-08T16:09:20.933011+0000","last_undegraded":"2023-10-08T16:09:20.933011+0000","last_fullsized":"2023-10-08T16:09:20.933011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906866+0000","last_change":"2023-10-08T16:09:19.988608+0000","last_active":"2023-10-08T16:09:20.906866+0000","last_peered":"2023-10-08T16:09:20.906866+0000","last_clean":"2023-10-08T16:09:20.906866+0000","last_became_active":"2023-10-08T16:09:19.988278+0000","last_became_peered":"2023-10-08T16:09:19.988278+0000","last_unstale":"2023-10-08T16:09:20.906866+0000","last_undegraded":"2023-10-08T16:09:20.906866+0000","last_fullsized":"2023-10-08T16:09:20.906866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.921581+0000","last_change":"2023-10-08T16:09:20.918971+0000","last_active":"2023-10-08T16:09:20.921581+0000","last_peered":"2023-10-08T16:09:20.921581+0000","last_clean":"2023-10-08T16:09:20.921581+0000","last_became_active":"2023-10-08T16:09:20.918687+0000","last_became_peered":"2023-10-08T16:09:20.918687+0000","last_unstale":"2023-10-08T16:09:20.921581+0000","last_undegraded":"2023-10-08T16:09:20.921581+0000","last_fullsized":"2023-10-08T16:09:20.921581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910412+0000","last_change":"2023-10-08T16:09:19.989053+0000","last_active":"2023-10-08T16:09:20.910412+0000","last_peered":"2023-10-08T16:09:20.910412+0000","last_clean":"2023-10-08T16:09:20.910412+0000","last_became_active":"2023-10-08T16:09:19.988777+0000","last_became_peered":"2023-10-08T16:09:19.988777+0000","last_unstale":"2023-10-08T16:09:20.910412+0000","last_undegraded":"2023-10-08T16:09:20.910412+0000","last_fullsized":"2023-10-08T16:09:20.910412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.928707+0000","last_change":"2023-10-08T16:09:20.919114+0000","last_active":"2023-10-08T16:09:20.928707+0000","last_peered":"2023-10-08T16:09:20.928707+0000","last_clean":"2023-10-08T16:09:20.928707+0000","last_became_active":"2023-10-08T16:09:20.918800+0000","last_became_peered":"2023-10-08T16:09:20.918800+0000","last_unstale":"2023-10-08T16:09:20.928707+0000","last_undegraded":"2023-10-08T16:09:20.928707+0000","last_fullsized":"2023-10-08T16:09:20.928707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.907633+0000","last_change":"2023-10-08T16:09:19.985911+0000","last_active":"2023-10-08T16:09:20.907633+0000","last_peered":"2023-10-08T16:09:20.907633+0000","last_clean":"2023-10-08T16:09:20.907633+0000","last_became_active":"2023-10-08T16:09:19.985587+0000","last_became_peered":"2023-10-08T16:09:19.985587+0000","last_unstale":"2023-10-08T16:09:20.907633+0000","last_undegraded":"2023-10-08T16:09:20.907633+0000","last_fullsized":"2023-10-08T16:09:20.907633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927469+0000","last_change":"2023-10-08T16:09:20.923331+0000","last_active":"2023-10-08T16:09:20.927469+0000","last_peered":"2023-10-08T16:09:20.927469+0000","last_clean":"2023-10-08T16:09:20.927469+0000","last_became_active":"2023-10-08T16:09:20.923039+0000","last_became_peered":"2023-10-08T16:09:20.923039+0000","last_unstale":"2023-10-08T16:09:20.927469+0000","last_undegraded":"2023-10-08T16:09:20.927469+0000","last_fullsized":"2023-10-08T16:09:20.927469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:14:17.149954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970716+0000","last_change":"2023-10-08T16:09:19.977329+0000","last_active":"2023-10-08T16:09:20.970716+0000","last_peered":"2023-10-08T16:09:20.970716+0000","last_clean":"2023-10-08T16:09:20.970716+0000","last_became_active":"2023-10-08T16:09:19.977037+0000","last_became_peered":"2023-10-08T16:09:19.977037+0000","last_unstale":"2023-10-08T16:09:20.970716+0000","last_undegraded":"2023-10-08T16:09:20.970716+0000","last_fullsized":"2023-10-08T16:09:20.970716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929923+0000","last_change":"2023-10-08T16:09:20.925081+0000","last_active":"2023-10-08T16:09:20.929923+0000","last_peered":"2023-10-08T16:09:20.929923+0000","last_clean":"2023-10-08T16:09:20.929923+0000","last_became_active":"2023-10-08T16:09:20.924752+0000","last_became_peered":"2023-10-08T16:09:20.924752+0000","last_unstale":"2023-10-08T16:09:20.929923+0000","last_undegraded":"2023-10-08T16:09:20.929923+0000","last_fullsized":"2023-10-08T16:09:20.929923+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:26.766584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.977381+0000","last_change":"2023-10-08T16:09:19.983118+0000","last_active":"2023-10-08T16:09:20.977381+0000","last_peered":"2023-10-08T16:09:20.977381+0000","last_clean":"2023-10-08T16:09:20.977381+0000","last_became_active":"2023-10-08T16:09:19.980439+0000","last_became_peered":"2023-10-08T16:09:19.980439+0000","last_unstale":"2023-10-08T16:09:20.977381+0000","last_undegraded":"2023-10-08T16:09:20.977381+0000","last_fullsized":"2023-10-08T16:09:20.977381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.931518+0000","last_change":"2023-10-08T16:09:20.927943+0000","last_active":"2023-10-08T16:09:20.931518+0000","last_peered":"2023-10-08T16:09:20.931518+0000","last_clean":"2023-10-08T16:09:20.931518+0000","last_became_active":"2023-10-08T16:09:20.927658+0000","last_became_peered":"2023-10-08T16:09:20.927658+0000","last_unstale":"2023-10-08T16:09:20.931518+0000","last_undegraded":"2023-10-08T16:09:20.931518+0000","last_fullsized":"2023-10-08T16:09:20.931518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:12.394183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973062+0000","last_change":"2023-10-08T16:09:19.980609+0000","last_active":"2023-10-08T16:09:20.973062+0000","last_peered":"2023-10-08T16:09:20.973062+0000","last_clean":"2023-10-08T16:09:20.973062+0000","last_became_active":"2023-10-08T16:09:19.980306+0000","last_became_peered":"2023-10-08T16:09:19.980306+0000","last_unstale":"2023-10-08T16:09:20.973062+0000","last_undegraded":"2023-10-08T16:09:20.973062+0000","last_fullsized":"2023-10-08T16:09:20.973062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927258+0000","last_change":"2023-10-08T16:09:20.920087+0000","last_active":"2023-10-08T16:09:20.927258+0000","last_peered":"2023-10-08T16:09:20.927258+0000","last_clean":"2023-10-08T16:09:20.927258+0000","last_became_active":"2023-10-08T16:09:20.919773+0000","last_became_peered":"2023-10-08T16:09:20.919773+0000","last_unstale":"2023-10-08T16:09:20.927258+0000","last_undegraded":"2023-10-08T16:09:20.927258+0000","last_fullsized":"2023-10-08T16:09:20.927258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908169+0000","last_change":"2023-10-08T16:09:19.982809+0000","last_active":"2023-10-08T16:09:20.908169+0000","last_peered":"2023-10-08T16:09:20.908169+0000","last_clean":"2023-10-08T16:09:20.908169+0000","last_became_active":"2023-10-08T16:09:19.981705+0000","last_became_peered":"2023-10-08T16:09:19.981705+0000","last_unstale":"2023-10-08T16:09:20.908169+0000","last_undegraded":"2023-10-08T16:09:20.908169+0000","last_fullsized":"2023-10-08T16:09:20.908169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933512+0000","last_change":"2023-10-08T16:09:20.930857+0000","last_active":"2023-10-08T16:09:20.933512+0000","last_peered":"2023-10-08T16:09:20.933512+0000","last_clean":"2023-10-08T16:09:20.933512+0000","last_became_active":"2023-10-08T16:09:20.930508+0000","last_became_peered":"2023-10-08T16:09:20.930508+0000","last_unstale":"2023-10-08T16:09:20.933512+0000","last_undegraded":"2023-10-08T16:09:20.933512+0000","last_fullsized":"2023-10-08T16:09:20.933512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:44.921976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910553+0000","last_change":"2023-10-08T16:09:19.982295+0000","last_active":"2023-10-08T16:09:20.910553+0000","last_peered":"2023-10-08T16:09:20.910553+0000","last_clean":"2023-10-08T16:09:20.910553+0000","last_became_active":"2023-10-08T16:09:19.980861+0000","last_became_peered":"2023-10-08T16:09:19.980861+0000","last_unstale":"2023-10-08T16:09:20.910553+0000","last_undegraded":"2023-10-08T16:09:20.910553+0000","last_fullsized":"2023-10-08T16:09:20.910553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922812+0000","last_change":"2023-10-08T16:09:20.921200+0000","last_active":"2023-10-08T16:09:20.922812+0000","last_peered":"2023-10-08T16:09:20.922812+0000","last_clean":"2023-10-08T16:09:20.922812+0000","last_became_active":"2023-10-08T16:09:20.920910+0000","last_became_peered":"2023-10-08T16:09:20.920910+0000","last_unstale":"2023-10-08T16:09:20.922812+0000","last_undegraded":"2023-10-08T16:09:20.922812+0000","last_fullsized":"2023-10-08T16:09:20.922812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973571+0000","last_change":"2023-10-08T16:09:19.977338+0000","last_active":"2023-10-08T16:09:20.973571+0000","last_peered":"2023-10-08T16:09:20.973571+0000","last_clean":"2023-10-08T16:09:20.973571+0000","last_became_active":"2023-10-08T16:09:19.976975+0000","last_became_peered":"2023-10-08T16:09:19.976975+0000","last_unstale":"2023-10-08T16:09:20.973571+0000","last_undegraded":"2023-10-08T16:09:20.973571+0000","last_fullsized":"2023-10-08T16:09:20.973571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:46:04.652004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930255+0000","last_change":"2023-10-08T16:09:20.927111+0000","last_active":"2023-10-08T16:09:20.930255+0000","last_peered":"2023-10-08T16:09:20.930255+0000","last_clean":"2023-10-08T16:09:20.930255+0000","last_became_active":"2023-10-08T16:09:20.926829+0000","last_became_peered":"2023-10-08T16:09:20.926829+0000","last_unstale":"2023-10-08T16:09:20.930255+0000","last_undegraded":"2023-10-08T16:09:20.930255+0000","last_fullsized":"2023-10-08T16:09:20.930255+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970929+0000","last_change":"2023-10-08T16:09:19.975261+0000","last_active":"2023-10-08T16:09:20.970929+0000","last_peered":"2023-10-08T16:09:20.970929+0000","last_clean":"2023-10-08T16:09:20.970929+0000","last_became_active":"2023-10-08T16:09:19.973725+0000","last_became_peered":"2023-10-08T16:09:19.973725+0000","last_unstale":"2023-10-08T16:09:20.970929+0000","last_undegraded":"2023-10-08T16:09:20.970929+0000","last_fullsized":"2023-10-08T16:09:20.970929+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:31:40.024282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934834+0000","last_change":"2023-10-08T16:09:20.931298+0000","last_active":"2023-10-08T16:09:20.934834+0000","last_peered":"2023-10-08T16:09:20.934834+0000","last_clean":"2023-10-08T16:09:20.934834+0000","last_became_active":"2023-10-08T16:09:20.931005+0000","last_became_peered":"2023-10-08T16:09:20.931005+0000","last_unstale":"2023-10-08T16:09:20.934834+0000","last_undegraded":"2023-10-08T16:09:20.934834+0000","last_fullsized":"2023-10-08T16:09:20.934834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904313+0000","last_change":"2023-10-08T16:09:19.984230+0000","last_active":"2023-10-08T16:09:20.904313+0000","last_peered":"2023-10-08T16:09:20.904313+0000","last_clean":"2023-10-08T16:09:20.904313+0000","last_became_active":"2023-10-08T16:09:19.983946+0000","last_became_peered":"2023-10-08T16:09:19.983946+0000","last_unstale":"2023-10-08T16:09:20.904313+0000","last_undegraded":"2023-10-08T16:09:20.904313+0000","last_fullsized":"2023-10-08T16:09:20.904313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.933894+0000","last_change":"2023-10-08T16:09:20.927574+0000","last_active":"2023-10-08T16:09:20.933894+0000","last_peered":"2023-10-08T16:09:20.933894+0000","last_clean":"2023-10-08T16:09:20.933894+0000","last_became_active":"2023-10-08T16:09:20.927296+0000","last_became_peered":"2023-10-08T16:09:20.927296+0000","last_unstale":"2023-10-08T16:09:20.933894+0000","last_undegraded":"2023-10-08T16:09:20.933894+0000","last_fullsized":"2023-10-08T16:09:20.933894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:47:05.355038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.908051+0000","last_change":"2023-10-08T16:09:19.980289+0000","last_active":"2023-10-08T16:09:20.908051+0000","last_peered":"2023-10-08T16:09:20.908051+0000","last_clean":"2023-10-08T16:09:20.908051+0000","last_became_active":"2023-10-08T16:09:19.979983+0000","last_became_peered":"2023-10-08T16:09:19.979983+0000","last_unstale":"2023-10-08T16:09:20.908051+0000","last_undegraded":"2023-10-08T16:09:20.908051+0000","last_fullsized":"2023-10-08T16:09:20.908051+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:25.760485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920184+0000","last_change":"2023-10-08T16:09:20.914485+0000","last_active":"2023-10-08T16:09:20.920184+0000","last_peered":"2023-10-08T16:09:20.920184+0000","last_clean":"2023-10-08T16:09:20.920184+0000","last_became_active":"2023-10-08T16:09:20.914148+0000","last_became_peered":"2023-10-08T16:09:20.914148+0000","last_unstale":"2023-10-08T16:09:20.920184+0000","last_undegraded":"2023-10-08T16:09:20.920184+0000","last_fullsized":"2023-10-08T16:09:20.920184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918439+0000","last_change":"2023-10-08T16:09:20.914673+0000","last_active":"2023-10-08T16:09:20.918439+0000","last_peered":"2023-10-08T16:09:20.918439+0000","last_clean":"2023-10-08T16:09:20.918439+0000","last_became_active":"2023-10-08T16:09:20.914358+0000","last_became_peered":"2023-10-08T16:09:20.914358+0000","last_unstale":"2023-10-08T16:09:20.918439+0000","last_undegraded":"2023-10-08T16:09:20.918439+0000","last_fullsized":"2023-10-08T16:09:20.918439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909604+0000","last_change":"2023-10-08T16:09:19.976530+0000","last_active":"2023-10-08T16:09:20.909604+0000","last_peered":"2023-10-08T16:09:20.909604+0000","last_clean":"2023-10-08T16:09:20.909604+0000","last_became_active":"2023-10-08T16:09:19.976209+0000","last_became_peered":"2023-10-08T16:09:19.976209+0000","last_unstale":"2023-10-08T16:09:20.909604+0000","last_undegraded":"2023-10-08T16:09:20.909604+0000","last_fullsized":"2023-10-08T16:09:20.909604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.938527+0000","last_change":"2023-10-08T16:09:20.934594+0000","last_active":"2023-10-08T16:09:20.938527+0000","last_peered":"2023-10-08T16:09:20.938527+0000","last_clean":"2023-10-08T16:09:20.938527+0000","last_became_active":"2023-10-08T16:09:20.934373+0000","last_became_peered":"2023-10-08T16:09:20.934373+0000","last_unstale":"2023-10-08T16:09:20.938527+0000","last_undegraded":"2023-10-08T16:09:20.938527+0000","last_fullsized":"2023-10-08T16:09:20.938527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.906768+0000","last_change":"2023-10-08T16:09:19.978998+0000","last_active":"2023-10-08T16:09:20.906768+0000","last_peered":"2023-10-08T16:09:20.906768+0000","last_clean":"2023-10-08T16:09:20.906768+0000","last_became_active":"2023-10-08T16:09:19.978699+0000","last_became_peered":"2023-10-08T16:09:19.978699+0000","last_unstale":"2023-10-08T16:09:20.906768+0000","last_undegraded":"2023-10-08T16:09:20.906768+0000","last_fullsized":"2023-10-08T16:09:20.906768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:36:28.060667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":163,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.910926+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:09:20.910926+0000","last_peered":"2023-10-08T16:09:20.910926+0000","last_clean":"2023-10-08T16:09:20.910926+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:09:20.910926+0000","last_undegraded":"2023-10-08T16:09:20.910926+0000","last_fullsized":"2023-10-08T16:09:20.910926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927499+0000","last_change":"2023-10-08T16:09:20.922573+0000","last_active":"2023-10-08T16:09:20.927499+0000","last_peered":"2023-10-08T16:09:20.927499+0000","last_clean":"2023-10-08T16:09:20.927499+0000","last_became_active":"2023-10-08T16:09:20.922307+0000","last_became_peered":"2023-10-08T16:09:20.922307+0000","last_unstale":"2023-10-08T16:09:20.927499+0000","last_undegraded":"2023-10-08T16:09:20.927499+0000","last_fullsized":"2023-10-08T16:09:20.927499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.913353+0000","last_change":"2023-10-08T16:09:19.986258+0000","last_active":"2023-10-08T16:09:20.913353+0000","last_peered":"2023-10-08T16:09:20.913353+0000","last_clean":"2023-10-08T16:09:20.913353+0000","last_became_active":"2023-10-08T16:09:19.985989+0000","last_became_peered":"2023-10-08T16:09:19.985989+0000","last_unstale":"2023-10-08T16:09:20.913353+0000","last_undegraded":"2023-10-08T16:09:20.913353+0000","last_fullsized":"2023-10-08T16:09:20.913353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.912945+0000","last_change":"2023-10-08T16:09:19.980337+0000","last_active":"2023-10-08T16:09:20.912945+0000","last_peered":"2023-10-08T16:09:20.912945+0000","last_clean":"2023-10-08T16:09:20.912945+0000","last_became_active":"2023-10-08T16:09:19.980070+0000","last_became_peered":"2023-10-08T16:09:19.980070+0000","last_unstale":"2023-10-08T16:09:20.912945+0000","last_undegraded":"2023-10-08T16:09:20.912945+0000","last_fullsized":"2023-10-08T16:09:20.912945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918188+0000","last_change":"2023-10-08T16:09:20.915246+0000","last_active":"2023-10-08T16:09:20.918188+0000","last_peered":"2023-10-08T16:09:20.918188+0000","last_clean":"2023-10-08T16:09:20.918188+0000","last_became_active":"2023-10-08T16:09:20.914991+0000","last_became_peered":"2023-10-08T16:09:20.914991+0000","last_unstale":"2023-10-08T16:09:20.918188+0000","last_undegraded":"2023-10-08T16:09:20.918188+0000","last_fullsized":"2023-10-08T16:09:20.918188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-10-08T16:09:22.623858+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:22.623858+0000","last_peered":"2023-10-08T16:09:22.623858+0000","last_clean":"2023-10-08T16:09:22.623858+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:22.623858+0000","last_undegraded":"2023-10-08T16:09:22.623858+0000","last_fullsized":"2023-10-08T16:09:22.623858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:00.408431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925249+0000","last_change":"2023-10-08T16:09:20.921141+0000","last_active":"2023-10-08T16:09:20.925249+0000","last_peered":"2023-10-08T16:09:20.925249+0000","last_clean":"2023-10-08T16:09:20.925249+0000","last_became_active":"2023-10-08T16:09:20.920816+0000","last_became_peered":"2023-10-08T16:09:20.920816+0000","last_unstale":"2023-10-08T16:09:20.925249+0000","last_undegraded":"2023-10-08T16:09:20.925249+0000","last_fullsized":"2023-10-08T16:09:20.925249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.972582+0000","last_change":"2023-10-08T16:09:19.983612+0000","last_active":"2023-10-08T16:09:20.972582+0000","last_peered":"2023-10-08T16:09:20.972582+0000","last_clean":"2023-10-08T16:09:20.972582+0000","last_became_active":"2023-10-08T16:09:19.983271+0000","last_became_peered":"2023-10-08T16:09:19.983271+0000","last_unstale":"2023-10-08T16:09:20.972582+0000","last_undegraded":"2023-10-08T16:09:20.972582+0000","last_fullsized":"2023-10-08T16:09:20.972582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:48.900778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927296+0000","last_change":"2023-10-08T16:09:20.920177+0000","last_active":"2023-10-08T16:09:20.927296+0000","last_peered":"2023-10-08T16:09:20.927296+0000","last_clean":"2023-10-08T16:09:20.927296+0000","last_became_active":"2023-10-08T16:09:20.919978+0000","last_became_peered":"2023-10-08T16:09:20.919978+0000","last_unstale":"2023-10-08T16:09:20.927296+0000","last_undegraded":"2023-10-08T16:09:20.927296+0000","last_fullsized":"2023-10-08T16:09:20.927296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.911835+0000","last_change":"2023-10-08T16:09:19.982502+0000","last_active":"2023-10-08T16:09:20.911835+0000","last_peered":"2023-10-08T16:09:20.911835+0000","last_clean":"2023-10-08T16:09:20.911835+0000","last_became_active":"2023-10-08T16:09:19.982165+0000","last_became_peered":"2023-10-08T16:09:19.982165+0000","last_unstale":"2023-10-08T16:09:20.911835+0000","last_undegraded":"2023-10-08T16:09:20.911835+0000","last_fullsized":"2023-10-08T16:09:20.911835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:13.775618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.920335+0000","last_change":"2023-10-08T16:09:20.912685+0000","last_active":"2023-10-08T16:09:20.920335+0000","last_peered":"2023-10-08T16:09:20.920335+0000","last_clean":"2023-10-08T16:09:20.920335+0000","last_became_active":"2023-10-08T16:09:20.912404+0000","last_became_peered":"2023-10-08T16:09:20.912404+0000","last_unstale":"2023-10-08T16:09:20.920335+0000","last_undegraded":"2023-10-08T16:09:20.920335+0000","last_fullsized":"2023-10-08T16:09:20.920335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:57:49.906876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904177+0000","last_change":"2023-10-08T16:09:19.982753+0000","last_active":"2023-10-08T16:09:20.904177+0000","last_peered":"2023-10-08T16:09:20.904177+0000","last_clean":"2023-10-08T16:09:20.904177+0000","last_became_active":"2023-10-08T16:09:19.982334+0000","last_became_peered":"2023-10-08T16:09:19.982334+0000","last_unstale":"2023-10-08T16:09:20.904177+0000","last_undegraded":"2023-10-08T16:09:20.904177+0000","last_fullsized":"2023-10-08T16:09:20.904177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:59.077869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.924534+0000","last_change":"2023-10-08T16:09:20.919166+0000","last_active":"2023-10-08T16:09:20.924534+0000","last_peered":"2023-10-08T16:09:20.924534+0000","last_clean":"2023-10-08T16:09:20.924534+0000","last_became_active":"2023-10-08T16:09:20.918875+0000","last_became_peered":"2023-10-08T16:09:20.918875+0000","last_unstale":"2023-10-08T16:09:20.924534+0000","last_undegraded":"2023-10-08T16:09:20.924534+0000","last_fullsized":"2023-10-08T16:09:20.924534+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:05.277661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.904175+0000","last_change":"2023-10-08T16:09:19.979602+0000","last_active":"2023-10-08T16:09:20.904175+0000","last_peered":"2023-10-08T16:09:20.904175+0000","last_clean":"2023-10-08T16:09:20.904175+0000","last_became_active":"2023-10-08T16:09:19.979266+0000","last_became_peered":"2023-10-08T16:09:19.979266+0000","last_unstale":"2023-10-08T16:09:20.904175+0000","last_undegraded":"2023-10-08T16:09:20.904175+0000","last_fullsized":"2023-10-08T16:09:20.904175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930491+0000","last_change":"2023-10-08T16:09:20.925593+0000","last_active":"2023-10-08T16:09:20.930491+0000","last_peered":"2023-10-08T16:09:20.930491+0000","last_clean":"2023-10-08T16:09:20.930491+0000","last_became_active":"2023-10-08T16:09:20.925297+0000","last_became_peered":"2023-10-08T16:09:20.925297+0000","last_unstale":"2023-10-08T16:09:20.930491+0000","last_undegraded":"2023-10-08T16:09:20.930491+0000","last_fullsized":"2023-10-08T16:09:20.930491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:34.125145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.971799+0000","last_change":"2023-10-08T16:09:19.971356+0000","last_active":"2023-10-08T16:09:20.971799+0000","last_peered":"2023-10-08T16:09:20.971799+0000","last_clean":"2023-10-08T16:09:20.971799+0000","last_became_active":"2023-10-08T16:09:19.970744+0000","last_became_peered":"2023-10-08T16:09:19.970744+0000","last_unstale":"2023-10-08T16:09:20.971799+0000","last_undegraded":"2023-10-08T16:09:20.971799+0000","last_fullsized":"2023-10-08T16:09:20.971799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:23:03.184015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932776+0000","last_change":"2023-10-08T16:09:20.929086+0000","last_active":"2023-10-08T16:09:20.932776+0000","last_peered":"2023-10-08T16:09:20.932776+0000","last_clean":"2023-10-08T16:09:20.932776+0000","last_became_active":"2023-10-08T16:09:20.928822+0000","last_became_peered":"2023-10-08T16:09:20.928822+0000","last_unstale":"2023-10-08T16:09:20.932776+0000","last_undegraded":"2023-10-08T16:09:20.932776+0000","last_fullsized":"2023-10-08T16:09:20.932776+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:27:44.514110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.909850+0000","last_change":"2023-10-08T16:09:19.981894+0000","last_active":"2023-10-08T16:09:20.909850+0000","last_peered":"2023-10-08T16:09:20.909850+0000","last_clean":"2023-10-08T16:09:20.909850+0000","last_became_active":"2023-10-08T16:09:19.981565+0000","last_became_peered":"2023-10-08T16:09:19.981565+0000","last_unstale":"2023-10-08T16:09:20.909850+0000","last_undegraded":"2023-10-08T16:09:20.909850+0000","last_fullsized":"2023-10-08T16:09:20.909850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:52.600761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.929759+0000","last_change":"2023-10-08T16:09:20.923617+0000","last_active":"2023-10-08T16:09:20.929759+0000","last_peered":"2023-10-08T16:09:20.929759+0000","last_clean":"2023-10-08T16:09:20.929759+0000","last_became_active":"2023-10-08T16:09:20.923317+0000","last_became_peered":"2023-10-08T16:09:20.923317+0000","last_unstale":"2023-10-08T16:09:20.929759+0000","last_undegraded":"2023-10-08T16:09:20.929759+0000","last_fullsized":"2023-10-08T16:09:20.929759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:24:42.436753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.970642+0000","last_change":"2023-10-08T16:09:19.980864+0000","last_active":"2023-10-08T16:09:20.970642+0000","last_peered":"2023-10-08T16:09:20.970642+0000","last_clean":"2023-10-08T16:09:20.970642+0000","last_became_active":"2023-10-08T16:09:19.980600+0000","last_became_peered":"2023-10-08T16:09:19.980600+0000","last_unstale":"2023-10-08T16:09:20.970642+0000","last_undegraded":"2023-10-08T16:09:20.970642+0000","last_fullsized":"2023-10-08T16:09:20.970642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:34.538069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.935869+0000","last_change":"2023-10-08T16:09:20.933766+0000","last_active":"2023-10-08T16:09:20.935869+0000","last_peered":"2023-10-08T16:09:20.935869+0000","last_clean":"2023-10-08T16:09:20.935869+0000","last_became_active":"2023-10-08T16:09:20.932450+0000","last_became_peered":"2023-10-08T16:09:20.932450+0000","last_unstale":"2023-10-08T16:09:20.935869+0000","last_undegraded":"2023-10-08T16:09:20.935869+0000","last_fullsized":"2023-10-08T16:09:20.935869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.973172+0000","last_change":"2023-10-08T16:09:19.976571+0000","last_active":"2023-10-08T16:09:20.973172+0000","last_peered":"2023-10-08T16:09:20.973172+0000","last_clean":"2023-10-08T16:09:20.973172+0000","last_became_active":"2023-10-08T16:09:19.976236+0000","last_became_peered":"2023-10-08T16:09:19.976236+0000","last_unstale":"2023-10-08T16:09:20.973172+0000","last_undegraded":"2023-10-08T16:09:20.973172+0000","last_fullsized":"2023-10-08T16:09:20.973172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:18.943347+0000","last_clean_scrub_stamp":"2023-10-08T16:09:18.943347+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:20:16.458124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934951+0000","last_change":"2023-10-08T16:09:20.932413+0000","last_active":"2023-10-08T16:09:20.934951+0000","last_peered":"2023-10-08T16:09:20.934951+0000","last_clean":"2023-10-08T16:09:20.934951+0000","last_became_active":"2023-10-08T16:09:20.932147+0000","last_became_peered":"2023-10-08T16:09:20.932147+0000","last_unstale":"2023-10-08T16:09:20.934951+0000","last_undegraded":"2023-10-08T16:09:20.934951+0000","last_fullsized":"2023-10-08T16:09:20.934951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:09.882128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.925266+0000","last_change":"2023-10-08T16:09:20.922001+0000","last_active":"2023-10-08T16:09:20.925266+0000","last_peered":"2023-10-08T16:09:20.925266+0000","last_clean":"2023-10-08T16:09:20.925266+0000","last_became_active":"2023-10-08T16:09:20.921669+0000","last_became_peered":"2023-10-08T16:09:20.921669+0000","last_unstale":"2023-10-08T16:09:20.925266+0000","last_undegraded":"2023-10-08T16:09:20.925266+0000","last_fullsized":"2023-10-08T16:09:20.925266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.922887+0000","last_change":"2023-10-08T16:09:20.921422+0000","last_active":"2023-10-08T16:09:20.922887+0000","last_peered":"2023-10-08T16:09:20.922887+0000","last_clean":"2023-10-08T16:09:20.922887+0000","last_became_active":"2023-10-08T16:09:20.921165+0000","last_became_peered":"2023-10-08T16:09:20.921165+0000","last_unstale":"2023-10-08T16:09:20.922887+0000","last_undegraded":"2023-10-08T16:09:20.922887+0000","last_fullsized":"2023-10-08T16:09:20.922887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:12:35.544167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934025+0000","last_change":"2023-10-08T16:09:20.931352+0000","last_active":"2023-10-08T16:09:20.934025+0000","last_peered":"2023-10-08T16:09:20.934025+0000","last_clean":"2023-10-08T16:09:20.934025+0000","last_became_active":"2023-10-08T16:09:20.931070+0000","last_became_peered":"2023-10-08T16:09:20.931070+0000","last_unstale":"2023-10-08T16:09:20.934025+0000","last_undegraded":"2023-10-08T16:09:20.934025+0000","last_fullsized":"2023-10-08T16:09:20.934025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:46.500366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930029+0000","last_change":"2023-10-08T16:09:20.926274+0000","last_active":"2023-10-08T16:09:20.930029+0000","last_peered":"2023-10-08T16:09:20.930029+0000","last_clean":"2023-10-08T16:09:20.930029+0000","last_became_active":"2023-10-08T16:09:20.925863+0000","last_became_peered":"2023-10-08T16:09:20.925863+0000","last_unstale":"2023-10-08T16:09:20.930029+0000","last_undegraded":"2023-10-08T16:09:20.930029+0000","last_fullsized":"2023-10-08T16:09:20.930029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930429+0000","last_change":"2023-10-08T16:09:20.925620+0000","last_active":"2023-10-08T16:09:20.930429+0000","last_peered":"2023-10-08T16:09:20.930429+0000","last_clean":"2023-10-08T16:09:20.930429+0000","last_became_active":"2023-10-08T16:09:20.924561+0000","last_became_peered":"2023-10-08T16:09:20.924561+0000","last_unstale":"2023-10-08T16:09:20.930429+0000","last_undegraded":"2023-10-08T16:09:20.930429+0000","last_fullsized":"2023-10-08T16:09:20.930429+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.918309+0000","last_change":"2023-10-08T16:09:20.916056+0000","last_active":"2023-10-08T16:09:20.918309+0000","last_peered":"2023-10-08T16:09:20.918309+0000","last_clean":"2023-10-08T16:09:20.918309+0000","last_became_active":"2023-10-08T16:09:20.915784+0000","last_became_peered":"2023-10-08T16:09:20.915784+0000","last_unstale":"2023-10-08T16:09:20.918309+0000","last_undegraded":"2023-10-08T16:09:20.918309+0000","last_fullsized":"2023-10-08T16:09:20.918309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:24:50.885073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927968+0000","last_change":"2023-10-08T16:09:20.926730+0000","last_active":"2023-10-08T16:09:20.927968+0000","last_peered":"2023-10-08T16:09:20.927968+0000","last_clean":"2023-10-08T16:09:20.927968+0000","last_became_active":"2023-10-08T16:09:20.925172+0000","last_became_peered":"2023-10-08T16:09:20.925172+0000","last_unstale":"2023-10-08T16:09:20.927968+0000","last_undegraded":"2023-10-08T16:09:20.927968+0000","last_fullsized":"2023-10-08T16:09:20.927968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:47:17.233537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930295+0000","last_change":"2023-10-08T16:09:20.925120+0000","last_active":"2023-10-08T16:09:20.930295+0000","last_peered":"2023-10-08T16:09:20.930295+0000","last_clean":"2023-10-08T16:09:20.930295+0000","last_became_active":"2023-10-08T16:09:20.924840+0000","last_became_peered":"2023-10-08T16:09:20.924840+0000","last_unstale":"2023-10-08T16:09:20.930295+0000","last_undegraded":"2023-10-08T16:09:20.930295+0000","last_fullsized":"2023-10-08T16:09:20.930295+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.934825+0000","last_change":"2023-10-08T16:09:20.932038+0000","last_active":"2023-10-08T16:09:20.934825+0000","last_peered":"2023-10-08T16:09:20.934825+0000","last_clean":"2023-10-08T16:09:20.934825+0000","last_became_active":"2023-10-08T16:09:20.931773+0000","last_became_peered":"2023-10-08T16:09:20.931773+0000","last_unstale":"2023-10-08T16:09:20.934825+0000","last_undegraded":"2023-10-08T16:09:20.934825+0000","last_fullsized":"2023-10-08T16:09:20.934825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:32.227704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.930258+0000","last_change":"2023-10-08T16:09:20.925060+0000","last_active":"2023-10-08T16:09:20.930258+0000","last_peered":"2023-10-08T16:09:20.930258+0000","last_clean":"2023-10-08T16:09:20.930258+0000","last_became_active":"2023-10-08T16:09:20.924565+0000","last_became_peered":"2023-10-08T16:09:20.924565+0000","last_unstale":"2023-10-08T16:09:20.930258+0000","last_undegraded":"2023-10-08T16:09:20.930258+0000","last_fullsized":"2023-10-08T16:09:20.930258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:38.267408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932817+0000","last_change":"2023-10-08T16:09:20.921042+0000","last_active":"2023-10-08T16:09:20.932817+0000","last_peered":"2023-10-08T16:09:20.932817+0000","last_clean":"2023-10-08T16:09:20.932817+0000","last_became_active":"2023-10-08T16:09:20.920766+0000","last_became_peered":"2023-10-08T16:09:20.920766+0000","last_unstale":"2023-10-08T16:09:20.932817+0000","last_undegraded":"2023-10-08T16:09:20.932817+0000","last_fullsized":"2023-10-08T16:09:20.932817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:20.269832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.927308+0000","last_change":"2023-10-08T16:09:20.920992+0000","last_active":"2023-10-08T16:09:20.927308+0000","last_peered":"2023-10-08T16:09:20.927308+0000","last_clean":"2023-10-08T16:09:20.927308+0000","last_became_active":"2023-10-08T16:09:20.920227+0000","last_became_peered":"2023-10-08T16:09:20.920227+0000","last_unstale":"2023-10-08T16:09:20.927308+0000","last_undegraded":"2023-10-08T16:09:20.927308+0000","last_fullsized":"2023-10-08T16:09:20.927308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:39.152653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-08T16:09:20.932806+0000","last_change":"2023-10-08T16:09:20.930112+0000","last_active":"2023-10-08T16:09:20.932806+0000","last_peered":"2023-10-08T16:09:20.932806+0000","last_clean":"2023-10-08T16:09:20.932806+0000","last_became_active":"2023-10-08T16:09:20.929813+0000","last_became_peered":"2023-10-08T16:09:20.929813+0000","last_unstale":"2023-10-08T16:09:20.932806+0000","last_undegraded":"2023-10-08T16:09:20.932806+0000","last_fullsized":"2023-10-08T16:09:20.932806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:19.949446+0000","last_clean_scrub_stamp":"2023-10-08T16:09:19.949446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:49.233945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":666235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":666291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.524}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":75313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4690000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4119999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":229376,"data_stored":76849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301608,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070232,"statfs":{"total":96636764160,"available":96327917568,"internally_reserved":0,"allocated":229376,"data_stored":75439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301600,"kb_used_data":216,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070240,"statfs":{"total":96636764160,"available":96327925760,"internally_reserved":0,"allocated":221184,"data_stored":75403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:09:36.374 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T16:09:36.374 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-08T16:09:36.374 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-08T16:09:36.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-08T16:09:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.593+0000 7fa3a959d700 1 Processor -- start 2023-10-08T16:09:36.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.593+0000 7fa3a959d700 1 -- start start 2023-10-08T16:09:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.594+0000 7fa3a959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.594+0000 7fa3a959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a4153dd0 0x7fa3a415a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.594+0000 7fa3a959d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a415d750 con 0x7fa3a40cea30 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.594+0000 7fa3a959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40cdbc0 con 0x7fa3a4153dd0 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.594+0000 7fa3a959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a40cb3d0 con 0x7fa3a4153a00 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a4153dd0 0x7fa3a415a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47178/0 (socket says 172.21.15.12:47178) 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a3fff700 1 -- 172.21.15.12:0/11796266 learned_addr learned my addr 172.21.15.12:0/11796266 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a4153dd0 0x7fa3a415a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40364/0 (socket says 172.21.15.12:40364) 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 -- 172.21.15.12:0/11796266 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 msgr2=0x7fa3a415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/11796266 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 -- 172.21.15.12:0/11796266 >> v1:172.21.15.29:6789/0 conn(0x7fa3a40cea30 legacy=0x7fa3a40cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 -- 172.21.15.12:0/11796266 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a40cb6b0 con 0x7fa3a4153dd0 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a3fff700 1 --2- 172.21.15.12:0/11796266 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a2ffd700 1 -- 172.21.15.12:0/11796266 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308246609 0 0) 0x7fa39c001490 con 0x7fa3a40cea30 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.595+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/11796266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4153dd0 0x7fa3a415a740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4088780 tx=0x7fa3980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=969899b89ec83ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a2ffd700 1 -- 172.21.15.12:0/11796266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011630 con 0x7fa3a4153dd0 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a2ffd700 1 -- 172.21.15.12:0/11796266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398011790 con 0x7fa3a4153dd0 2023-10-08T16:09:36.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a2ffd700 1 -- 172.21.15.12:0/11796266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398011b30 con 0x7fa3a4153dd0 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 -- 172.21.15.12:0/11796266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4153dd0 msgr2=0x7fa3a415a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 --2- 172.21.15.12:0/11796266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4153dd0 0x7fa3a415a740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4088780 tx=0x7fa3980091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 -- 172.21.15.12:0/11796266 shutdown_connections 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 --2- 172.21.15.12:0/11796266 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4153a00 0x7fa3a415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 --2- 172.21.15.12:0/11796266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4153dd0 0x7fa3a415a740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 -- 172.21.15.12:0/11796266 >> 172.21.15.12:0/11796266 conn(0x7fa3a40703a0 msgr2=0x7fa3a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 -- 172.21.15.12:0/11796266 shutdown_connections 2023-10-08T16:09:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.596+0000 7fa3a959d700 1 -- 172.21.15.12:0/11796266 wait complete. 2023-10-08T16:09:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.598+0000 7fa3a959d700 1 Processor -- start 2023-10-08T16:09:36.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.598+0000 7fa3a959d700 1 -- start start 2023-10-08T16:09:36.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 0x7fa3a415a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4153dd0 0x7fa3a416d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40b32d0 con 0x7fa3a40cea30 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40b3b70 con 0x7fa3a4153dd0 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415b3d0 con 0x7fa3a4153a00 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40378/0 (socket says 172.21.15.12:40378) 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a3fff700 1 -- 172.21.15.12:0/3898917827 learned_addr learned my addr 172.21.15.12:0/3898917827 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 0x7fa3a415a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.599+0000 7fa3a8d9c700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4153dd0 0x7fa3a416d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 -- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 msgr2=0x7fa3a415a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 0x7fa3a415a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 -- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4153dd0 msgr2=0x7fa3a416d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4153dd0 0x7fa3a416d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 -- 172.21.15.12:0/3898917827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940094f0 con 0x7fa3a40cea30 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 0x7fa3a415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a3fff700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa39400ec50 tx=0x7fa394009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400c9d0 con 0x7fa3a40cea30 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400cb30 con 0x7fa3a40cea30 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394013470 con 0x7fa3a40cea30 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa398009420 con 0x7fa3a40cea30 2023-10-08T16:09:36.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.600+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40b3800 con 0x7fa3a40cea30 2023-10-08T16:09:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.601+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a404c3c0 con 0x7fa3a40cea30 2023-10-08T16:09:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.602+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa394013860 con 0x7fa3a40cea30 2023-10-08T16:09:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.603+0000 7fa38bfff700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.603+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa394084d60 con 0x7fa3a40cea30 2023-10-08T16:09:36.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.604+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:36.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.604+0000 7fa3a37fe700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 0x7fa3900693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3980091e0 tx=0x7fa398017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.608+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa394051f30 con 0x7fa3a40cea30 2023-10-08T16:09:36.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.855+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa3a415d990 con 0x7fa3a40cea30 2023-10-08T16:09:36.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.856+0000 7fa38bfff700 1 -- 172.21.15.12:0/3898917827 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa394055550 con 0x7fa3a40cea30 2023-10-08T16:09:36.857 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:36.857 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-08T16:09:36.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 msgr2=0x7fa3900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 0x7fa3900693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa3980091e0 tx=0x7fa398017000 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 msgr2=0x7fa3a40b1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa39400ec50 tx=0x7fa394009250 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 shutdown_connections 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa390066f30 0x7fa3900693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a40cea30 0x7fa3a40b1b40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4153dd0 0x7fa3a416d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 --2- 172.21.15.12:0/3898917827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a4153a00 0x7fa3a415a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 >> 172.21.15.12:0/3898917827 conn(0x7fa3a40703a0 msgr2=0x7fa3a4159200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.858+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 shutdown_connections 2023-10-08T16:09:36.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:36.859+0000 7fa3a959d700 1 -- 172.21.15.12:0/3898917827 wait complete. 2023-10-08T16:09:36.876 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-08T16:09:36.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.064+0000 7f851b19d700 1 Processor -- start 2023-10-08T16:09:37.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.064+0000 7f851b19d700 1 -- start start 2023-10-08T16:09:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851b19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8514159640 0x7f851406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851b19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85140caec0 0x7f85140c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851b19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85140c7420 con 0x7f8514159a10 2023-10-08T16:09:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851b19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851406d5a0 con 0x7f85140caec0 2023-10-08T16:09:37.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851b19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851406d820 con 0x7f8514159640 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85140caec0 0x7f85140c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f85140caec0 0x7f85140c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40394/0 (socket says 172.21.15.12:40394) 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 -- 172.21.15.12:0/2066060058 learned_addr learned my addr 172.21.15.12:0/2066060058 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a19b700 1 --2- 172.21.15.12:0/2066060058 >> v2:172.21.15.29:3300/0 conn(0x7f8514159640 0x7f851406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 -- 172.21.15.12:0/2066060058 >> v2:172.21.15.29:3300/0 conn(0x7f8514159640 msgr2=0x7f851406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 --2- 172.21.15.12:0/2066060058 >> v2:172.21.15.29:3300/0 conn(0x7f8514159640 0x7f851406d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 -- 172.21.15.12:0/2066060058 >> v1:172.21.15.29:6789/0 conn(0x7f8514159a10 legacy=0x7f85140ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.066+0000 7f851a99c700 1 -- 172.21.15.12:0/2066060058 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851406db00 con 0x7f85140caec0 2023-10-08T16:09:37.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f851a99c700 1 --2- 172.21.15.12:0/2066060058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85140caec0 0x7f85140c78b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f850c009f20 tx=0x7f850c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2f4d727a4fb1d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f8519199700 1 -- 172.21.15.12:0/2066060058 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00e070 con 0x7f85140caec0 2023-10-08T16:09:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f8519199700 1 -- 172.21.15.12:0/2066060058 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00b990 con 0x7f85140caec0 2023-10-08T16:09:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f8519199700 1 -- 172.21.15.12:0/2066060058 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c0092e0 con 0x7f85140caec0 2023-10-08T16:09:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f851b19d700 1 -- 172.21.15.12:0/2066060058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85140caec0 msgr2=0x7f85140c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.067+0000 7f851b19d700 1 --2- 172.21.15.12:0/2066060058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85140caec0 0x7f85140c78b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f850c009f20 tx=0x7f850c009840 comp rx=0 tx=0).stop 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 -- 172.21.15.12:0/2066060058 shutdown_connections 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 --2- 172.21.15.12:0/2066060058 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f85140caec0 0x7f85140c78b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 --2- 172.21.15.12:0/2066060058 >> v2:172.21.15.29:3300/0 conn(0x7f8514159640 0x7f851406d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 -- 172.21.15.12:0/2066060058 >> 172.21.15.12:0/2066060058 conn(0x7f851406e720 msgr2=0x7f851406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 -- 172.21.15.12:0/2066060058 shutdown_connections 2023-10-08T16:09:37.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.068+0000 7f851b19d700 1 -- 172.21.15.12:0/2066060058 wait complete. 2023-10-08T16:09:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.069+0000 7f851b19d700 1 Processor -- start 2023-10-08T16:09:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.069+0000 7f851b19d700 1 -- start start 2023-10-08T16:09:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85140caec0 0x7f85141525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514159640 0x7f8514155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85140c3e60 con 0x7f8514159a10 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85141561f0 con 0x7f8514159640 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8514155950 con 0x7f85140caec0 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40406/0 (socket says 172.21.15.12:40406) 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851a99c700 1 -- 172.21.15.12:0/4229565235 learned_addr learned my addr 172.21.15.12:0/4229565235 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851a19b700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85140caec0 0x7f85141525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.070+0000 7f851999a700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514159640 0x7f8514155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 -- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85140caec0 msgr2=0x7f85141525d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85140caec0 0x7f85141525d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 -- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514159640 msgr2=0x7f8514155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514159640 0x7f8514155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 -- 172.21.15.12:0/4229565235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c009ae0 con 0x7f8514159a10 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851a99c700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f850c009880 tx=0x7f850c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c008ad0 con 0x7f8514159a10 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c008c30 con 0x7f8514159a10 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c026460 con 0x7f8514159a10 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.071+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8514155c30 con 0x7f8514159a10 2023-10-08T16:09:37.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.072+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8514152b10 con 0x7f8514159a10 2023-10-08T16:09:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.073+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85140c4010 con 0x7f8514159a10 2023-10-08T16:09:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.074+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f850c003040 con 0x7f8514159a10 2023-10-08T16:09:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.074+0000 7f850a7fc700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.074+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f850c086290 con 0x7f8514159a10 2023-10-08T16:09:37.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.075+0000 7f851a19b700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.075+0000 7f851a19b700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 0x7f84f80693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8510009db0 tx=0x7f85100091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.078+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85140c4010 con 0x7f8514159a10 2023-10-08T16:09:37.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.278+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f851404c3c0 con 0x7f8514159a10 2023-10-08T16:09:37.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.279+0000 7f850a7fc700 1 -- 172.21.15.12:0/4229565235 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f850c053500 con 0x7f8514159a10 2023-10-08T16:09:37.280 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:37.280 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 msgr2=0x7f84f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 0x7f84f80693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8510009db0 tx=0x7f85100091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 msgr2=0x7f851406eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f850c009880 tx=0x7f850c018000 comp rx=0 tx=0).stop 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 shutdown_connections 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f84f8066f30 0x7f84f80693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8514159a10 0x7f851406eaf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85140caec0 0x7f85141525d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 --2- 172.21.15.12:0/4229565235 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8514159640 0x7f8514155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 >> 172.21.15.12:0/4229565235 conn(0x7f851406e720 msgr2=0x7f851415f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 shutdown_connections 2023-10-08T16:09:37.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.282+0000 7f851b19d700 1 -- 172.21.15.12:0/4229565235 wait complete. 2023-10-08T16:09:37.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:37.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.489+0000 7f21c5d9d700 1 Processor -- start 2023-10-08T16:09:37.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.490+0000 7f21c5d9d700 1 -- start start 2023-10-08T16:09:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c5d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21c0159920 0x7f21c00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c5d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00acc00 con 0x7f21c015dfd0 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c5d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c00abff0 con 0x7f21c0159920 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00ac2d0 con 0x7f21c0159550 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21c0159920 0x7f21c00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21c0159920 0x7f21c00ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40420/0 (socket says 172.21.15.12:40420) 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c559c700 1 -- 172.21.15.12:0/2798729963 learned_addr learned my addr 172.21.15.12:0/2798729963 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c4d9b700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c559c700 1 -- 172.21.15.12:0/2798729963 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 msgr2=0x7f21c00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.491+0000 7f21c559c700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c00ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21c559c700 1 -- 172.21.15.12:0/2798729963 >> v1:172.21.15.29:6789/0 conn(0x7f21c015dfd0 legacy=0x7f21c00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21c559c700 1 -- 172.21.15.12:0/2798729963 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c00ac5b0 con 0x7f21c0159920 2023-10-08T16:09:37.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21c559c700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c0159920 0x7f21c00ad090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009f20 tx=0x7f21b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b097e4f04612015a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21bf7fe700 1 -- 172.21.15.12:0/2798729963 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b800e070 con 0x7f21c0159920 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21bf7fe700 1 -- 172.21.15.12:0/2798729963 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b800ba80 con 0x7f21c0159920 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.492+0000 7f21bf7fe700 1 -- 172.21.15.12:0/2798729963 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80092e0 con 0x7f21c0159920 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 -- 172.21.15.12:0/2798729963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c0159920 msgr2=0x7f21c00ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c0159920 0x7f21c00ad090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f21b8009f20 tx=0x7f21b8009840 comp rx=0 tx=0).stop 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 -- 172.21.15.12:0/2798729963 shutdown_connections 2023-10-08T16:09:37.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c0159920 0x7f21c00ad090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/2798729963 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 -- 172.21.15.12:0/2798729963 >> 172.21.15.12:0/2798729963 conn(0x7f21c006ce80 msgr2=0x7f21c00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 -- 172.21.15.12:0/2798729963 shutdown_connections 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.493+0000 7f21c5d9d700 1 -- 172.21.15.12:0/2798729963 wait complete. 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.494+0000 7f21c5d9d700 1 Processor -- start 2023-10-08T16:09:37.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.494+0000 7f21c5d9d700 1 -- start start 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c0146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 0x7f21c00c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0156ea0 con 0x7f21c015dfd0 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0156350 con 0x7f21c0159920 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c0156600 con 0x7f21c0159550 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40434/0 (socket says 172.21.15.12:40434) 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.495+0000 7f21c559c700 1 -- 172.21.15.12:0/301230044 learned_addr learned my addr 172.21.15.12:0/301230044 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c4d9b700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c0146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21bffff700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 0x7f21c00c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 -- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 msgr2=0x7f21c0146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c0146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 -- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 msgr2=0x7f21c00c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 0x7f21c00c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 -- 172.21.15.12:0/301230044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8009ae0 con 0x7f21c015dfd0 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21bffff700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 0x7f21c00c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c559c700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b6c0 tx=0x7f21b8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b80032f0 con 0x7f21c015dfd0 2023-10-08T16:09:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8008dd0 con 0x7f21c015dfd0 2023-10-08T16:09:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c01568e0 con 0x7f21c015dfd0 2023-10-08T16:09:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.496+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b8026670 con 0x7f21c015dfd0 2023-10-08T16:09:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.497+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00c7600 con 0x7f21c015dfd0 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.498+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c004c3c0 con 0x7f21c015dfd0 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.498+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21b8003040 con 0x7f21c015dfd0 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.499+0000 7f21bcff9700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 0x7f21a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.499+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21b8086300 con 0x7f21c015dfd0 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.499+0000 7f21c4d9b700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 0x7f21a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.500+0000 7f21c4d9b700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 0x7f21a40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21c006c2c0 tx=0x7f21b4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.504+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21b8053580 con 0x7f21c015dfd0 2023-10-08T16:09:37.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.704+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21c006b8e0 con 0x7f21c015dfd0 2023-10-08T16:09:37.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.704+0000 7f21bcff9700 1 -- 172.21.15.12:0/301230044 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21b8056ba0 con 0x7f21c015dfd0 2023-10-08T16:09:37.705 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 msgr2=0x7f21a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 0x7f21a40693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f21c006c2c0 tx=0x7f21b4008040 comp rx=0 tx=0).stop 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 msgr2=0x7f21c01576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f21b800b6c0 tx=0x7f21b8018000 comp rx=0 tx=0).stop 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 shutdown_connections 2023-10-08T16:09:37.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f21a4066f30 0x7f21a40693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21c015dfd0 0x7f21c01576a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21c0159550 0x7f21c0146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 --2- 172.21.15.12:0/301230044 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21c0159920 0x7f21c00c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 >> 172.21.15.12:0/301230044 conn(0x7f21c006ce80 msgr2=0x7f21c00b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 shutdown_connections 2023-10-08T16:09:37.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.707+0000 7f21c5d9d700 1 -- 172.21.15.12:0/301230044 wait complete. 2023-10-08T16:09:37.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:37.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.913+0000 7fea33fff700 1 Processor -- start 2023-10-08T16:09:37.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.913+0000 7fea33fff700 1 -- start start 2023-10-08T16:09:37.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea33fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fea34153a00 0x7fea34153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea33fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3415ac50 con 0x7fea3415de50 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea33fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea3415d010 con 0x7fea340cea00 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea33fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3415af60 con 0x7fea34153a00 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea327fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fea3415de50 0x7fea3415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47030/0 (socket says 172.21.15.12:47030) 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea327fc700 1 -- 172.21.15.12:0/2618046835 learned_addr learned my addr 172.21.15.12:0/2618046835 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.914+0000 7fea32ffd700 1 --2- 172.21.15.12:0/2618046835 >> v2:172.21.15.12:3300/0 conn(0x7fea34153a00 0x7fea34153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea32ffd700 1 -- 172.21.15.12:0/2618046835 >> v1:172.21.15.29:6789/0 conn(0x7fea340cea00 legacy=0x7fea340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea32ffd700 1 -- 172.21.15.12:0/2618046835 >> v1:172.21.15.12:6789/0 conn(0x7fea3415de50 legacy=0x7fea3415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea32ffd700 1 -- 172.21.15.12:0/2618046835 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3415b240 con 0x7fea34153a00 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea31ffb700 1 -- 172.21.15.12:0/2618046835 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814099661 0 0) 0x7fea3415ac50 con 0x7fea3415de50 2023-10-08T16:09:37.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea32ffd700 1 --2- 172.21.15.12:0/2618046835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea34153a00 0x7fea34153dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5bd6f1c78a039c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea31ffb700 1 -- 172.21.15.12:0/2618046835 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24009e80 con 0x7fea34153a00 2023-10-08T16:09:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea31ffb700 1 -- 172.21.15.12:0/2618046835 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2400b860 con 0x7fea34153a00 2023-10-08T16:09:37.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.915+0000 7fea31ffb700 1 -- 172.21.15.12:0/2618046835 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400bbe0 con 0x7fea34153a00 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 -- 172.21.15.12:0/2618046835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea34153a00 msgr2=0x7fea34153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 --2- 172.21.15.12:0/2618046835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea34153a00 0x7fea34153dd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fea240098e0 tx=0x7fea240091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 -- 172.21.15.12:0/2618046835 shutdown_connections 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 --2- 172.21.15.12:0/2618046835 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea34153a00 0x7fea34153dd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 -- 172.21.15.12:0/2618046835 >> 172.21.15.12:0/2618046835 conn(0x7fea340703a0 msgr2=0x7fea340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 -- 172.21.15.12:0/2618046835 shutdown_connections 2023-10-08T16:09:37.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.916+0000 7fea33fff700 1 -- 172.21.15.12:0/2618046835 wait complete. 2023-10-08T16:09:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.917+0000 7fea33fff700 1 Processor -- start 2023-10-08T16:09:37.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.918+0000 7fea33fff700 1 -- start start 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 0x7fea3416cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fea34153a00 0x7fea340b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340cc0e0 con 0x7fea3415de50 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea340cc980 con 0x7fea340cea00 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea33fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3416b340 con 0x7fea34153a00 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40452/0 (socket says 172.21.15.12:40452) 2023-10-08T16:09:37.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 -- 172.21.15.12:0/1558662473 learned_addr learned my addr 172.21.15.12:0/1558662473 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea32ffd700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 0x7fea3416cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea327fc700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fea34153a00 0x7fea340b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 -- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fea34153a00 msgr2=0x7fea340b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fea34153a00 0x7fea340b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 -- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 msgr2=0x7fea3416cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 0x7fea3416cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 -- 172.21.15.12:0/1558662473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea24009420 con 0x7fea3415de50 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea32ffd700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 0x7fea3416cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.919+0000 7fea337fe700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c970 tx=0x7fea2c0016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.920+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00a760 con 0x7fea3415de50 2023-10-08T16:09:37.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.920+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c00a8c0 con 0x7fea3415de50 2023-10-08T16:09:37.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.920+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3416aa90 con 0x7fea3415de50 2023-10-08T16:09:37.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.920+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00ac80 con 0x7fea3415de50 2023-10-08T16:09:37.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.920+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea340cc610 con 0x7fea3415de50 2023-10-08T16:09:37.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.921+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea340ccb10 con 0x7fea3415de50 2023-10-08T16:09:37.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.922+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea2c012630 con 0x7fea3415de50 2023-10-08T16:09:37.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.923+0000 7fea1affd700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 0x7fea200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:37.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.923+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea2c084780 con 0x7fea3415de50 2023-10-08T16:09:37.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.923+0000 7fea32ffd700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 0x7fea200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:37.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.924+0000 7fea32ffd700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 0x7fea200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea240093f0 tx=0x7fea24017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:37.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:37.927+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea2c0519f0 con 0x7fea3415de50 2023-10-08T16:09:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.128+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea3404c3c0 con 0x7fea3415de50 2023-10-08T16:09:38.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.128+0000 7fea1affd700 1 -- 172.21.15.12:0/1558662473 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea2c055010 con 0x7fea3415de50 2023-10-08T16:09:38.129 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:09:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 msgr2=0x7fea200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 0x7fea200693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fea240093f0 tx=0x7fea24017000 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 msgr2=0x7fea3416ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c970 tx=0x7fea2c0016b0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 shutdown_connections 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fea20066f30 0x7fea200693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fea3415de50 0x7fea3416ae00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fea340cea00 0x7fea3416cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 --2- 172.21.15.12:0/1558662473 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fea34153a00 0x7fea340b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 >> 172.21.15.12:0/1558662473 conn(0x7fea340703a0 msgr2=0x7fea340c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.130+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 shutdown_connections 2023-10-08T16:09:38.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.131+0000 7fea33fff700 1 -- 172.21.15.12:0/1558662473 wait complete. 2023-10-08T16:09:38.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.336+0000 7efc6199d700 1 Processor -- start 2023-10-08T16:09:38.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.336+0000 7efc6199d700 1 -- start start 2023-10-08T16:09:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.337+0000 7efc6199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc5c06e560 0x7efc5c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.337+0000 7efc6199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c0c7e70 con 0x7efc5c155890 2023-10-08T16:09:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6199d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c06b790 con 0x7efc5c155c60 2023-10-08T16:09:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c06ab80 con 0x7efc5c06e560 2023-10-08T16:09:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6099b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc5c155890 0x7efc5c06a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47032/0 (socket says 172.21.15.12:47032) 2023-10-08T16:09:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6099b700 1 -- 172.21.15.12:0/742047805 learned_addr learned my addr 172.21.15.12:0/742047805 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:38.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6119c700 1 --2- 172.21.15.12:0/742047805 >> v2:172.21.15.29:3300/0 conn(0x7efc5c06e560 0x7efc5c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822961708 0 0) 0x7efc5c0c7e70 con 0x7efc5c155890 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc4c003570 con 0x7efc5c155890 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308380424 0 0) 0x7efc5c06b790 con 0x7efc5c155c60 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc5c0c7e70 con 0x7efc5c155c60 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1103338598 0 0) 0x7efc4c003570 con 0x7efc5c155890 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6119c700 1 -- 172.21.15.12:0/742047805 >> v1:172.21.15.29:6789/0 conn(0x7efc5c155c60 legacy=0x7efc5c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6119c700 1 -- 172.21.15.12:0/742047805 >> v1:172.21.15.12:6789/0 conn(0x7efc5c155890 legacy=0x7efc5c06a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.338+0000 7efc6119c700 1 -- 172.21.15.12:0/742047805 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c06ae60 con 0x7efc5c06e560 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.339+0000 7efc6119c700 1 --2- 172.21.15.12:0/742047805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c06e560 0x7efc5c0c7930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc54009e60 tx=0x7efc54009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecb080e2bd093e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.339+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5400e070 con 0x7efc5c06e560 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.339+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5400b7a0 con 0x7efc5c06e560 2023-10-08T16:09:38.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.339+0000 7efc5b7fe700 1 -- 172.21.15.12:0/742047805 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50001470 con 0x7efc5c06e560 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 -- 172.21.15.12:0/742047805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c06e560 msgr2=0x7efc5c0c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 --2- 172.21.15.12:0/742047805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c06e560 0x7efc5c0c7930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efc54009e60 tx=0x7efc54009780 comp rx=0 tx=0).stop 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 -- 172.21.15.12:0/742047805 shutdown_connections 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 --2- 172.21.15.12:0/742047805 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c06e560 0x7efc5c0c7930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 -- 172.21.15.12:0/742047805 >> 172.21.15.12:0/742047805 conn(0x7efc5c06d110 msgr2=0x7efc5c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 -- 172.21.15.12:0/742047805 shutdown_connections 2023-10-08T16:09:38.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.340+0000 7efc6199d700 1 -- 172.21.15.12:0/742047805 wait complete. 2023-10-08T16:09:38.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.341+0000 7efc6199d700 1 Processor -- start 2023-10-08T16:09:38.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.341+0000 7efc6199d700 1 -- start start 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 0x7efc5c0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c155c60 0x7efc5c0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c1e50 con 0x7efc5c06e560 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c2130 con 0x7efc5c155c60 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.342+0000 7efc6199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0c2410 con 0x7efc5c155890 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40468/0 (socket says 172.21.15.12:40468) 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 -- 172.21.15.12:0/531524239 learned_addr learned my addr 172.21.15.12:0/531524239 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:38.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6119c700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c155c60 0x7efc5c0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc5bfff700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 0x7efc5c0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 -- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 msgr2=0x7efc5c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 0x7efc5c0adfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 -- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c155c60 msgr2=0x7efc5c0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c155c60 0x7efc5c0ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 -- 172.21.15.12:0/531524239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54009a20 con 0x7efc5c06e560 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc5bfff700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 0x7efc5c0adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc6099b700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5000cb90 tx=0x7efc50001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.343+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50007360 con 0x7efc5c06e560 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.344+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc500074e0 con 0x7efc5c06e560 2023-10-08T16:09:38.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.344+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50004830 con 0x7efc5c06e560 2023-10-08T16:09:38.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.344+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc5c0c26f0 con 0x7efc5c06e560 2023-10-08T16:09:38.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.344+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c0aa070 con 0x7efc5c06e560 2023-10-08T16:09:38.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.345+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c04c3c0 con 0x7efc5c06e560 2023-10-08T16:09:38.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.346+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc50004ba0 con 0x7efc5c06e560 2023-10-08T16:09:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.347+0000 7efc58ff9700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 0x7efc400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.347+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc50083a30 con 0x7efc5c06e560 2023-10-08T16:09:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.347+0000 7efc5bfff700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 0x7efc400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.348+0000 7efc5bfff700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 0x7efc400693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc48007fd0 tx=0x7efc48009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.351+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc50050c80 con 0x7efc5c06e560 2023-10-08T16:09:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.550+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc5c0cbb00 con 0x7efc5c06e560 2023-10-08T16:09:38.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.550+0000 7efc58ff9700 1 -- 172.21.15.12:0/531524239 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc50018020 con 0x7efc5c06e560 2023-10-08T16:09:38.551 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:09:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.552+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 msgr2=0x7efc400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.552+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 0x7efc400693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efc48007fd0 tx=0x7efc48009040 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.552+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 msgr2=0x7efc5c0a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.552+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efc5000cb90 tx=0x7efc50001b50 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 shutdown_connections 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efc40066f30 0x7efc400693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc5c06e560 0x7efc5c0a9b30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc5c155c60 0x7efc5c0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 --2- 172.21.15.12:0/531524239 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc5c155890 0x7efc5c0adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 >> 172.21.15.12:0/531524239 conn(0x7efc5c06d110 msgr2=0x7efc5c156750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:38.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 shutdown_connections 2023-10-08T16:09:38.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.553+0000 7efc6199d700 1 -- 172.21.15.12:0/531524239 wait complete. 2023-10-08T16:09:38.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:38.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.755+0000 7f300199d700 1 Processor -- start 2023-10-08T16:09:38.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.755+0000 7f300199d700 1 -- start start 2023-10-08T16:09:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.756+0000 7f300199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ffc153c30 0x7f2ffc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.756+0000 7f300199d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ffc15de50 0x7f2ffc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.756+0000 7f300199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ffc0cf3c0 con 0x7f2ffc0cef40 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.756+0000 7f300199d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc15afd0 con 0x7f2ffc15de50 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.756+0000 7f300199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ffc15b2b0 con 0x7f2ffc153c30 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f300119c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2ffc0cef40 0x7f2ffc06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47046/0 (socket says 172.21.15.12:47046) 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f300119c700 1 -- 172.21.15.12:0/3991692732 learned_addr learned my addr 172.21.15.12:0/3991692732 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/3991692732 >> v2:172.21.15.12:3300/0 conn(0x7f2ffc15de50 0x7f2ffc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f300099b700 1 --2- 172.21.15.12:0/3991692732 >> v2:172.21.15.29:3300/0 conn(0x7f2ffc153c30 0x7f2ffc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffb7fe700 1 -- 172.21.15.12:0/3991692732 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280937285 0 0) 0x7f2ffc0cf3c0 con 0x7f2ffc0cef40 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffb7fe700 1 -- 172.21.15.12:0/3991692732 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003570 con 0x7f2ffc0cef40 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 -- 172.21.15.12:0/3991692732 >> v2:172.21.15.29:3300/0 conn(0x7f2ffc153c30 msgr2=0x7f2ffc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/3991692732 >> v2:172.21.15.29:3300/0 conn(0x7f2ffc153c30 0x7f2ffc15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 -- 172.21.15.12:0/3991692732 >> v1:172.21.15.12:6789/0 conn(0x7f2ffc0cef40 legacy=0x7f2ffc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 -- 172.21.15.12:0/3991692732 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc15b590 con 0x7f2ffc15de50 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.757+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/3991692732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc15de50 0x7f2ffc0cea00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06ead0 tx=0x7f2fe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac23d4cb98426316 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f2ffb7fe700 1 -- 172.21.15.12:0/3991692732 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011630 con 0x7f2ffc15de50 2023-10-08T16:09:38.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f2ffb7fe700 1 -- 172.21.15.12:0/3991692732 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe80117b0 con 0x7f2ffc15de50 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f2ffb7fe700 1 -- 172.21.15.12:0/3991692732 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011b70 con 0x7f2ffc15de50 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 -- 172.21.15.12:0/3991692732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc15de50 msgr2=0x7f2ffc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 --2- 172.21.15.12:0/3991692732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc15de50 0x7f2ffc0cea00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06ead0 tx=0x7f2fe80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 -- 172.21.15.12:0/3991692732 shutdown_connections 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 --2- 172.21.15.12:0/3991692732 >> v2:172.21.15.29:3300/0 conn(0x7f2ffc153c30 0x7f2ffc15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 --2- 172.21.15.12:0/3991692732 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc15de50 0x7f2ffc0cea00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 -- 172.21.15.12:0/3991692732 >> 172.21.15.12:0/3991692732 conn(0x7f2ffc0703a0 msgr2=0x7f2ffc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 -- 172.21.15.12:0/3991692732 shutdown_connections 2023-10-08T16:09:38.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.758+0000 7f300199d700 1 -- 172.21.15.12:0/3991692732 wait complete. 2023-10-08T16:09:38.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.760+0000 7f300199d700 1 Processor -- start 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.760+0000 7f300199d700 1 -- start start 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc153c30 0x7f2ffc15e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ffc15de50 0x7f2ffc140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c9250 con 0x7f2ffc0cef40 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc15f2f0 con 0x7f2ffc153c30 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ffc0c7710 con 0x7f2ffc15de50 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40482/0 (socket says 172.21.15.12:40482) 2023-10-08T16:09:38.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300099b700 1 -- 172.21.15.12:0/1812500103 learned_addr learned my addr 172.21.15.12:0/1812500103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc153c30 0x7f2ffc15e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.761+0000 7f300099b700 1 -- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ffc15de50 msgr2=0x7f2ffc140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300099b700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ffc15de50 0x7f2ffc140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300099b700 1 -- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc153c30 msgr2=0x7f2ffc15e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300099b700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc153c30 0x7f2ffc15e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300099b700 1 -- 172.21.15.12:0/1812500103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe8009420 con 0x7f2ffc0cef40 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300099b700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000e930 tx=0x7f2ff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff000eed0 con 0x7f2ffc0cef40 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff000c850 con 0x7f2ffc0cef40 2023-10-08T16:09:38.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff000cbf0 con 0x7f2ffc0cef40 2023-10-08T16:09:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ffc15ea50 con 0x7f2ffc0cef40 2023-10-08T16:09:38.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.762+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ffc15f010 con 0x7f2ffc0cef40 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.763+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ffc04c3c0 con 0x7f2ffc0cef40 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.764+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ff0013470 con 0x7f2ffc0cef40 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.765+0000 7f2ff8ff9700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.765+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ff0084800 con 0x7f2ffc0cef40 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.765+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:38.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.766+0000 7f2ffbfff700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 0x7f2fe00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06ead0 tx=0x7f2fe8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:38.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:38.769+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ff00519d0 con 0x7f2ffc0cef40 2023-10-08T16:09:39.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.015+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2ffc0caef0 con 0x7f2ffc0cef40 2023-10-08T16:09:39.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.016+0000 7f2ff8ff9700 1 -- 172.21.15.12:0/1812500103 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f2ff0054ff0 con 0x7f2ffc0cef40 2023-10-08T16:09:39.017 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:39.017 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:09:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 msgr2=0x7f2fe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 0x7f2fe00693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc06ead0 tx=0x7f2fe8017000 comp rx=0 tx=0).stop 2023-10-08T16:09:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 msgr2=0x7f2ffc1600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000e930 tx=0x7f2ff00091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 shutdown_connections 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fe0066f30 0x7f2fe00693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ffc0cef40 0x7f2ffc1600f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ffc15de50 0x7f2ffc140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 --2- 172.21.15.12:0/1812500103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ffc153c30 0x7f2ffc15e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 >> 172.21.15.12:0/1812500103 conn(0x7f2ffc0703a0 msgr2=0x7f2ffc0b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 shutdown_connections 2023-10-08T16:09:39.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.018+0000 7f300199d700 1 -- 172.21.15.12:0/1812500103 wait complete. 2023-10-08T16:09:39.021 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:09:39.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.223+0000 7f8e049fe700 1 Processor -- start 2023-10-08T16:09:39.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.223+0000 7f8e049fe700 1 -- start start 2023-10-08T16:09:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8e049fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e0015de50 0x7f8e000cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8e049fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e000cef40 0x7f8e0015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8e049fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000cf3c0 con 0x7f8e00153c30 2023-10-08T16:09:39.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8e049fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0015afd0 con 0x7f8e000cef40 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8e049fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0015b2b0 con 0x7f8e0015de50 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8dfed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8e00153c30 0x7f8e0015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47050/0 (socket says 172.21.15.12:47050) 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8dfed9d700 1 -- 172.21.15.12:0/1045390512 learned_addr learned my addr 172.21.15.12:0/1045390512 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.224+0000 7f8dff59e700 1 --2- 172.21.15.12:0/1045390512 >> v2:172.21.15.12:3300/0 conn(0x7f8e000cef40 0x7f8e0015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfe59c700 1 --2- 172.21.15.12:0/1045390512 >> v2:172.21.15.29:3300/0 conn(0x7f8e0015de50 0x7f8e000cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfdd9b700 1 -- 172.21.15.12:0/1045390512 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039510087 0 0) 0x7f8e000cf3c0 con 0x7f8e00153c30 2023-10-08T16:09:39.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfdd9b700 1 -- 172.21.15.12:0/1045390512 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de8003570 con 0x7f8e00153c30 2023-10-08T16:09:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dff59e700 1 -- 172.21.15.12:0/1045390512 >> v2:172.21.15.29:3300/0 conn(0x7f8e0015de50 msgr2=0x7f8e000cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dff59e700 1 --2- 172.21.15.12:0/1045390512 >> v2:172.21.15.29:3300/0 conn(0x7f8e0015de50 0x7f8e000cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dff59e700 1 -- 172.21.15.12:0/1045390512 >> v1:172.21.15.12:6789/0 conn(0x7f8e00153c30 legacy=0x7f8e0015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dff59e700 1 -- 172.21.15.12:0/1045390512 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0015b590 con 0x7f8e000cef40 2023-10-08T16:09:39.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dff59e700 1 --2- 172.21.15.12:0/1045390512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e000cef40 0x7f8e0015c070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e000713a0 tx=0x7f8df8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600ee2a4e2495bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfdd9b700 1 -- 172.21.15.12:0/1045390512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800e070 con 0x7f8e000cef40 2023-10-08T16:09:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfdd9b700 1 -- 172.21.15.12:0/1045390512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800bb60 con 0x7f8e000cef40 2023-10-08T16:09:39.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.225+0000 7f8dfdd9b700 1 -- 172.21.15.12:0/1045390512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8012430 con 0x7f8e000cef40 2023-10-08T16:09:39.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 -- 172.21.15.12:0/1045390512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e000cef40 msgr2=0x7f8e0015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 --2- 172.21.15.12:0/1045390512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e000cef40 0x7f8e0015c070 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e000713a0 tx=0x7f8df8009780 comp rx=0 tx=0).stop 2023-10-08T16:09:39.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 -- 172.21.15.12:0/1045390512 shutdown_connections 2023-10-08T16:09:39.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 --2- 172.21.15.12:0/1045390512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e000cef40 0x7f8e0015c070 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 --2- 172.21.15.12:0/1045390512 >> v2:172.21.15.29:3300/0 conn(0x7f8e0015de50 0x7f8e000cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 -- 172.21.15.12:0/1045390512 >> 172.21.15.12:0/1045390512 conn(0x7f8e000703a0 msgr2=0x7f8e000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 -- 172.21.15.12:0/1045390512 shutdown_connections 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.226+0000 7f8e049fe700 1 -- 172.21.15.12:0/1045390512 wait complete. 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.227+0000 7f8e049fe700 1 Processor -- start 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.228+0000 7f8e049fe700 1 -- start start 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.228+0000 7f8e049fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000cef40 0x7f8e000b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.228+0000 7f8e049fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.228+0000 7f8e049fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e0015de50 0x7f8e001519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8e049fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000c94f0 con 0x7f8e00153c30 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8e049fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000ca310 con 0x7f8e000cef40 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8e049fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e000c9700 con 0x7f8e0015de50 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40498/0 (socket says 172.21.15.12:40498) 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 -- 172.21.15.12:0/4077061516 learned_addr learned my addr 172.21.15.12:0/4077061516 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfed9d700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000cef40 0x7f8e000b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dff59e700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e0015de50 0x7f8e001519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 -- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e0015de50 msgr2=0x7f8e001519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e0015de50 0x7f8e001519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 -- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000cef40 msgr2=0x7f8e000b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000cef40 0x7f8e000b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 -- 172.21.15.12:0/4077061516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8009a20 con 0x7f8e00153c30 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.229+0000 7f8dfe59c700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8df400d8c0 tx=0x7f8df4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.230+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400de60 con 0x7f8e00153c30 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.230+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df400b780 con 0x7f8e00153c30 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.230+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e000c99e0 con 0x7f8e00153c30 2023-10-08T16:09:39.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.230+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df400bb20 con 0x7f8e00153c30 2023-10-08T16:09:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.230+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e000c9fa0 con 0x7f8e00153c30 2023-10-08T16:09:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.231+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0004c3c0 con 0x7f8e00153c30 2023-10-08T16:09:39.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.232+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8df401e460 con 0x7f8e00153c30 2023-10-08T16:09:39.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.233+0000 7f8de6ffd700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 0x7f8dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.233+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8df4084bd0 con 0x7f8e00153c30 2023-10-08T16:09:39.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.233+0000 7f8dfed9d700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 0x7f8dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.234+0000 7f8dfed9d700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 0x7f8dec0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8df00058d0 tx=0x7f8df0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.237+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8df4051e40 con 0x7f8e00153c30 2023-10-08T16:09:39.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.439+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e000caef0 con 0x7f8e00153c30 2023-10-08T16:09:39.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.440+0000 7f8de6ffd700 1 -- 172.21.15.12:0/4077061516 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f8df4055460 con 0x7f8e00153c30 2023-10-08T16:09:39.440 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:39.441 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 msgr2=0x7f8dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 0x7f8dec0693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8df00058d0 tx=0x7f8df0009040 comp rx=0 tx=0).stop 2023-10-08T16:09:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 msgr2=0x7f8e000c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8df400d8c0 tx=0x7f8df4008040 comp rx=0 tx=0).stop 2023-10-08T16:09:39.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 shutdown_connections 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e0015de50 0x7f8e001519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e000cef40 0x7f8e000b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8dec066f30 0x7f8dec0693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 --2- 172.21.15.12:0/4077061516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e00153c30 0x7f8e000c8fb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 >> 172.21.15.12:0/4077061516 conn(0x7f8e000703a0 msgr2=0x7f8e000c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 shutdown_connections 2023-10-08T16:09:39.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.442+0000 7f8e049fe700 1 -- 172.21.15.12:0/4077061516 wait complete. 2023-10-08T16:09:39.461 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:39.461 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:39.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.649+0000 7fe5bb39d700 1 Processor -- start 2023-10-08T16:09:39.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.649+0000 7fe5bb39d700 1 -- start start 2023-10-08T16:09:39.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.650+0000 7fe5bb39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5b4142fd0 0x7fe5b40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.650+0000 7fe5bb39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b40ca480 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.650+0000 7fe5bb39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b415e240 con 0x7fe5b4142c00 2023-10-08T16:09:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.650+0000 7fe5bb39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b406b350 con 0x7fe5b4142fd0 2023-10-08T16:09:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5bab9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe5b40c7dc0 0x7fe5b406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47052/0 (socket says 172.21.15.12:47052) 2023-10-08T16:09:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5bab9c700 1 -- 172.21.15.12:0/1530495525 learned_addr learned my addr 172.21.15.12:0/1530495525 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> v2:172.21.15.29:3300/0 conn(0x7fe5b4142fd0 0x7fe5b40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796611303 0 0) 0x7fe5b40ca480 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5a0003570 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959143699 0 0) 0x7fe5b415e240 con 0x7fe5b4142c00 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5b40ca480 con 0x7fe5b4142c00 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 85697756 0 0) 0x7fe5a0003570 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 >> v2:172.21.15.29:3300/0 conn(0x7fe5b4142fd0 msgr2=0x7fe5b40c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.651+0000 7fe5b9399700 1 --2- 172.21.15.12:0/1530495525 >> v2:172.21.15.29:3300/0 conn(0x7fe5b4142fd0 0x7fe5b40c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 >> v1:172.21.15.29:6789/0 conn(0x7fe5b4142c00 legacy=0x7fe5b406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40c81d0 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe5ac0017f0 con 0x7fe5b40c7dc0 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 >> v1:172.21.15.12:6789/0 conn(0x7fe5b40c7dc0 legacy=0x7fe5b406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0003c40 0x7fe5a0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5a0005210 0x7fe5a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b406b350 con 0x7fe5a0004810 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000c1b0 con 0x7fe5a0003c40 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a000c370 con 0x7fe5a0005210 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> v2:172.21.15.29:3300/0 conn(0x7fe5b4142fd0 0x7fe5b40c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5ba39b700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0003c40 0x7fe5a0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5bab9c700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5a0005210 0x7fe5a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 -- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5a0005210 msgr2=0x7fe5a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5a0005210 0x7fe5a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 -- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0003c40 msgr2=0x7fe5a0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5a0003c40 0x7fe5a0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5b9b9a700 1 -- 172.21.15.12:0/1530495525 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a0003570 con 0x7fe5a0004810 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.652+0000 7fe5bab9c700 1 -- 172.21.15.12:0/1530495525 reap_dead start 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5a0004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006f00 tx=0x7fe5a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f941879098a441 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4009740 con 0x7fe5a0004810 2023-10-08T16:09:39.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a400e920 con 0x7fe5a0004810 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5b9399700 1 -- 172.21.15.12:0/1530495525 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a400ecc0 con 0x7fe5a0004810 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5bb39d700 1 -- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 msgr2=0x7fe5a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5a0004c80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4006f00 tx=0x7fe5a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5bb39d700 1 -- 172.21.15.12:0/1530495525 shutdown_connections 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/1530495525 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5a0004c80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.653+0000 7fe5bb39d700 1 -- 172.21.15.12:0/1530495525 >> 172.21.15.12:0/1530495525 conn(0x7fe5b40675a0 msgr2=0x7fe5b40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.654+0000 7fe5bb39d700 1 -- 172.21.15.12:0/1530495525 shutdown_connections 2023-10-08T16:09:39.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.654+0000 7fe5bb39d700 1 -- 172.21.15.12:0/1530495525 wait complete. 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.655+0000 7fe5bb39d700 1 Processor -- start 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.655+0000 7fe5bb39d700 1 -- start start 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 0x7fe5b40b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 0x7fe5b40c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40c7460 con 0x7fe5a0004810 2023-10-08T16:09:39.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b40b2000 con 0x7fe5b40b2770 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bb39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b416ca30 con 0x7fe5b416c5c0 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5ba39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5ba39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40514/0 (socket says 172.21.15.12:40514) 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5ba39b700 1 -- 172.21.15.12:0/765342508 learned_addr learned my addr 172.21.15.12:0/765342508 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.656+0000 7fe5bab9c700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 0x7fe5b40c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 0x7fe5b40b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 -- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 msgr2=0x7fe5b40b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 0x7fe5b40b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 -- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 msgr2=0x7fe5b40c33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 0x7fe5b40c33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 -- 172.21.15.12:0/765342508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b416ccf0 con 0x7fe5a0004810 2023-10-08T16:09:39.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5bab9c700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 0x7fe5b40c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 0x7fe5b40b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5ba39b700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000d670 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b000d7f0 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b000dbb0 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b416cfd0 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.657+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b40b2250 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.658+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b40b2470 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.659+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5b001c400 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.660+0000 7fe5aa7fc700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 0x7fe5980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.660+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5b0084910 con 0x7fe5a0004810 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.660+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 0x7fe5980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:39.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.661+0000 7fe5b9b9a700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 0x7fe5980693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4065160 tx=0x7fe5a4019000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:39.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.664+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5b0051b90 con 0x7fe5a0004810 2023-10-08T16:09:39.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.865+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5b404c3c0 con 0x7fe5a0004810 2023-10-08T16:09:39.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.865+0000 7fe5aa7fc700 1 -- 172.21.15.12:0/765342508 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5b0017020 con 0x7fe5a0004810 2023-10-08T16:09:39.866 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.867+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 msgr2=0x7fe5980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.867+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 0x7fe5980693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4065160 tx=0x7fe5a4019000 comp rx=0 tx=0).stop 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 msgr2=0x7fe5b4169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0000c00 tx=0x7fe5b0007d10 comp rx=0 tx=0).stop 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 shutdown_connections 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe598066f30 0x7fe5980693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5a0004810 0x7fe5b4169a80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b40b2770 0x7fe5b40c33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 --2- 172.21.15.12:0/765342508 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b416c5c0 0x7fe5b40b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:39.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 >> 172.21.15.12:0/765342508 conn(0x7fe5b40675a0 msgr2=0x7fe5b40c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:39.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 shutdown_connections 2023-10-08T16:09:39.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:39.868+0000 7fe5bb39d700 1 -- 172.21.15.12:0/765342508 wait complete. 2023-10-08T16:09:39.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.076+0000 7fe3109fe700 1 Processor -- start 2023-10-08T16:09:40.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.077+0000 7fe3109fe700 1 -- start start 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe3109fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe3109fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe30c0c7fb0 0x7fe30c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe3109fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c15aed0 con 0x7fe30c13f780 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe3109fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c06bf10 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe3109fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06b290 con 0x7fe30c0c7be0 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe30a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe30c0c7fb0 0x7fe30c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe30b59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe30c13f780 0x7fe30c0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47056/0 (socket says 172.21.15.12:47056) 2023-10-08T16:09:40.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe30b59e700 1 -- 172.21.15.12:0/2976056042 learned_addr learned my addr 172.21.15.12:0/2976056042 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:40.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.078+0000 7fe30ad9d700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe30a59c700 1 -- 172.21.15.12:0/2976056042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 msgr2=0x7fe30c06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe30a59c700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe30a59c700 1 -- 172.21.15.12:0/2976056042 >> v1:172.21.15.12:6789/0 conn(0x7fe30c13f780 legacy=0x7fe30c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe30a59c700 1 -- 172.21.15.12:0/2976056042 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c06b570 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe30a59c700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c15a990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe3000098e0 tx=0x7fe3000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e968f8762fa41e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe309d9b700 1 -- 172.21.15.12:0/2976056042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000b640 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe309d9b700 1 -- 172.21.15.12:0/2976056042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000b7a0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.079+0000 7fe309d9b700 1 -- 172.21.15.12:0/2976056042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000bb40 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 -- 172.21.15.12:0/2976056042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 msgr2=0x7fe30c15a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c15a990 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe3000098e0 tx=0x7fe3000091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 -- 172.21.15.12:0/2976056042 shutdown_connections 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 --2- 172.21.15.12:0/2976056042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c15a990 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 -- 172.21.15.12:0/2976056042 >> 172.21.15.12:0/2976056042 conn(0x7fe30c06d110 msgr2=0x7fe30c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 -- 172.21.15.12:0/2976056042 shutdown_connections 2023-10-08T16:09:40.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.080+0000 7fe3109fe700 1 -- 172.21.15.12:0/2976056042 wait complete. 2023-10-08T16:09:40.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.081+0000 7fe3109fe700 1 Processor -- start 2023-10-08T16:09:40.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.081+0000 7fe3109fe700 1 -- start start 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c163360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c13f780 0x7fe30c16d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c16aa10 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c2250 con 0x7fe30c13f780 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe3109fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c0c2530 con 0x7fe30c0c7be0 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.082+0000 7fe30a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40538/0 (socket says 172.21.15.12:40538) 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 -- 172.21.15.12:0/4096133563 learned_addr learned my addr 172.21.15.12:0/4096133563 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30ad9d700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c163360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30b59e700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c13f780 0x7fe30c16d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 -- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 msgr2=0x7fe30c163360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c163360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 -- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c13f780 msgr2=0x7fe30c16d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c13f780 0x7fe30c16d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 -- 172.21.15.12:0/4096133563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe300009420 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe30a59c700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0693f0 tx=0x7fe300017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.083+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30001bc40 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.084+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30001bdc0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.084+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300011670 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.084+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0c2810 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.084+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c15c150 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.085+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c15c3a0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.086+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe300011a20 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.087+0000 7fe2f2ffd700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 0x7fe2f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.087+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe300085b30 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.087+0000 7fe30ad9d700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 0x7fe2f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.088+0000 7fe30ad9d700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 0x7fe2f80693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe30c156430 tx=0x7fe2fc0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.091+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe30c15c3a0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.291+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe30c15c3a0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.291+0000 7fe2f2ffd700 1 -- 172.21.15.12:0/4096133563 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe30c15c3a0 con 0x7fe30c0c7fb0 2023-10-08T16:09:40.293 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.293+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 msgr2=0x7fe2f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 0x7fe2f80693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe30c156430 tx=0x7fe2fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 msgr2=0x7fe30c16cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0693f0 tx=0x7fe300017000 comp rx=0 tx=0).stop 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 shutdown_connections 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe30c13f780 0x7fe30c16d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe30c0c7be0 0x7fe30c163360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe2f8066f30 0x7fe2f80693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 --2- 172.21.15.12:0/4096133563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe30c0c7fb0 0x7fe30c16cd10 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 >> 172.21.15.12:0/4096133563 conn(0x7fe30c06d110 msgr2=0x7fe30c13d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 shutdown_connections 2023-10-08T16:09:40.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.294+0000 7fe3109fe700 1 -- 172.21.15.12:0/4096133563 wait complete. 2023-10-08T16:09:40.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.500+0000 7fe613fff700 1 Processor -- start 2023-10-08T16:09:40.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.500+0000 7fe613fff700 1 -- start start 2023-10-08T16:09:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.501+0000 7fe613fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe61415dfd0 0x7fe6140aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.501+0000 7fe613fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe614159920 0x7fe6140ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.501+0000 7fe613fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6140acc00 con 0x7fe614159550 2023-10-08T16:09:40.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.501+0000 7fe613fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140abff0 con 0x7fe614159920 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.501+0000 7fe613fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140ac2d0 con 0x7fe61415dfd0 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe612ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe614159550 0x7fe6140ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47068/0 (socket says 172.21.15.12:47068) 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe612ffd700 1 -- 172.21.15.12:0/2787266517 learned_addr learned my addr 172.21.15.12:0/2787266517 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 --2- 172.21.15.12:0/2787266517 >> v2:172.21.15.12:3300/0 conn(0x7fe614159920 0x7fe6140ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6127fc700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe61415dfd0 0x7fe6140aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe611ffb700 1 -- 172.21.15.12:0/2787266517 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840614338 0 0) 0x7fe6140acc00 con 0x7fe614159550 2023-10-08T16:09:40.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe611ffb700 1 -- 172.21.15.12:0/2787266517 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5fc003570 con 0x7fe614159550 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 -- 172.21.15.12:0/2787266517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe61415dfd0 msgr2=0x7fe6140aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe61415dfd0 0x7fe6140aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 -- 172.21.15.12:0/2787266517 >> v1:172.21.15.12:6789/0 conn(0x7fe614159550 legacy=0x7fe6140ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 -- 172.21.15.12:0/2787266517 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140ac5b0 con 0x7fe614159920 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.502+0000 7fe6137fe700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614159920 0x7fe6140ad090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678656e8ab4fcb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe611ffb700 1 -- 172.21.15.12:0/2787266517 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00e070 con 0x7fe614159920 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe611ffb700 1 -- 172.21.15.12:0/2787266517 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c00bab0 con 0x7fe614159920 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe611ffb700 1 -- 172.21.15.12:0/2787266517 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c00be70 con 0x7fe614159920 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 -- 172.21.15.12:0/2787266517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614159920 msgr2=0x7fe6140ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614159920 0x7fe6140ad090 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe60c009e60 tx=0x7fe60c009780 comp rx=0 tx=0).stop 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 -- 172.21.15.12:0/2787266517 shutdown_connections 2023-10-08T16:09:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe614159920 0x7fe6140ad090 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 --2- 172.21.15.12:0/2787266517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe61415dfd0 0x7fe6140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 -- 172.21.15.12:0/2787266517 >> 172.21.15.12:0/2787266517 conn(0x7fe61406ce80 msgr2=0x7fe6140ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 -- 172.21.15.12:0/2787266517 shutdown_connections 2023-10-08T16:09:40.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.503+0000 7fe613fff700 1 -- 172.21.15.12:0/2787266517 wait complete. 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.505+0000 7fe613fff700 1 Processor -- start 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.505+0000 7fe613fff700 1 -- start start 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe614159550 0x7fe614146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe614159920 0x7fe614157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140c7d30 con 0x7fe61415dfd0 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe614147530 con 0x7fe614159550 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe613fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe614157050 con 0x7fe614159920 2023-10-08T16:09:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe6137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe6137fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40548/0 (socket says 172.21.15.12:40548) 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe6137fe700 1 -- 172.21.15.12:0/761061967 learned_addr learned my addr 172.21.15.12:0/761061967 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe612ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe614159550 0x7fe614146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.506+0000 7fe6127fc700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe614159920 0x7fe614157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 -- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe614159920 msgr2=0x7fe614157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe614159920 0x7fe614157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 -- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe614159550 msgr2=0x7fe614146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe614159550 0x7fe614146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 -- 172.21.15.12:0/761061967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe60c009a20 con 0x7fe61415dfd0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe6137fe700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe61406ad70 tx=0x7fe60c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c012e10 con 0x7fe61415dfd0 2023-10-08T16:09:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c027470 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6140c76e0 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c027830 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.507+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe614169d50 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.508+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61404c3c0 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.509+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe60c024070 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.510+0000 7fe5faffd700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 0x7fe6000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.510+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe60c086fe0 con 0x7fe61415dfd0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.510+0000 7fe612ffd700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 0x7fe6000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.511+0000 7fe612ffd700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 0x7fe6000693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe604007fd0 tx=0x7fe604009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.514+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe60c0541b0 con 0x7fe61415dfd0 2023-10-08T16:09:40.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.715+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6140aca90 con 0x7fe61415dfd0 2023-10-08T16:09:40.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.716+0000 7fe5faffd700 1 -- 172.21.15.12:0/761061967 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe60c0577d0 con 0x7fe61415dfd0 2023-10-08T16:09:40.717 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:09:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 msgr2=0x7fe6000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 0x7fe6000693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe604007fd0 tx=0x7fe604009040 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 msgr2=0x7fe614157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe61406ad70 tx=0x7fe60c019000 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 shutdown_connections 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe600066f30 0x7fe6000693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe61415dfd0 0x7fe614157f70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe614159550 0x7fe614146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 --2- 172.21.15.12:0/761061967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe614159920 0x7fe614157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.718+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 >> 172.21.15.12:0/761061967 conn(0x7fe61406ce80 msgr2=0x7fe6140afe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.719+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 shutdown_connections 2023-10-08T16:09:40.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.719+0000 7fe613fff700 1 -- 172.21.15.12:0/761061967 wait complete. 2023-10-08T16:09:40.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:40.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.922+0000 7fd86319d700 1 Processor -- start 2023-10-08T16:09:40.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.922+0000 7fd86319d700 1 -- start start 2023-10-08T16:09:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86319d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd85c159450 0x7fd85c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86319d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c06f420 con 0x7fd85c06e390 2023-10-08T16:09:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86319d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c06e810 con 0x7fd85c0a9ff0 2023-10-08T16:09:40.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86319d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c06eaf0 con 0x7fd85c159450 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86219b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd85c159450 0x7fd85c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86199a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd85c06e390 0x7fd85c0a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47078/0 (socket says 172.21.15.12:47078) 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86199a700 1 -- 172.21.15.12:0/1302353765 learned_addr learned my addr 172.21.15.12:0/1302353765 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86219b700 1 -- 172.21.15.12:0/1302353765 >> v1:172.21.15.29:6789/0 conn(0x7fd85c0a9ff0 legacy=0x7fd85c163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86219b700 1 -- 172.21.15.12:0/1302353765 >> v1:172.21.15.12:6789/0 conn(0x7fd85c06e390 legacy=0x7fd85c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd86219b700 1 -- 172.21.15.12:0/1302353765 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c06edd0 con 0x7fd85c159450 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.924+0000 7fd861199700 1 -- 172.21.15.12:0/1302353765 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761964077 0 0) 0x7fd85c06f420 con 0x7fd85c06e390 2023-10-08T16:09:40.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86219b700 1 --2- 172.21.15.12:0/1302353765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c06de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098e0 tx=0x7fd8580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea7efb8ec38b03a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd861199700 1 -- 172.21.15.12:0/1302353765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd858009e80 con 0x7fd85c159450 2023-10-08T16:09:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd861199700 1 -- 172.21.15.12:0/1302353765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85800b860 con 0x7fd85c159450 2023-10-08T16:09:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd861199700 1 -- 172.21.15.12:0/1302353765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85800bbe0 con 0x7fd85c159450 2023-10-08T16:09:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86319d700 1 -- 172.21.15.12:0/1302353765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 msgr2=0x7fd85c06de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86319d700 1 --2- 172.21.15.12:0/1302353765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c06de50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd8580098e0 tx=0x7fd8580091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86319d700 1 -- 172.21.15.12:0/1302353765 shutdown_connections 2023-10-08T16:09:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86319d700 1 --2- 172.21.15.12:0/1302353765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c06de50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.925+0000 7fd86319d700 1 -- 172.21.15.12:0/1302353765 >> 172.21.15.12:0/1302353765 conn(0x7fd85c06d170 msgr2=0x7fd85c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.926+0000 7fd86319d700 1 -- 172.21.15.12:0/1302353765 shutdown_connections 2023-10-08T16:09:40.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.926+0000 7fd86319d700 1 -- 172.21.15.12:0/1302353765 wait complete. 2023-10-08T16:09:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.927+0000 7fd86319d700 1 Processor -- start 2023-10-08T16:09:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.927+0000 7fd86319d700 1 -- start start 2023-10-08T16:09:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0a9ff0 0x7fd85c0c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 0x7fd85c14f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c4640 con 0x7fd85c159450 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0af6a0 con 0x7fd85c0a9ff0 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c0c40d0 con 0x7fd85c14dfa0 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40564/0 (socket says 172.21.15.12:40564) 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86199a700 1 -- 172.21.15.12:0/1939351788 learned_addr learned my addr 172.21.15.12:0/1939351788 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86219b700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0a9ff0 0x7fd85c0c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.928+0000 7fd86299c700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 0x7fd85c14f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 -- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 msgr2=0x7fd85c14f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 0x7fd85c14f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 -- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0a9ff0 msgr2=0x7fd85c0c5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0a9ff0 0x7fd85c0c5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 -- 172.21.15.12:0/1939351788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd858009420 con 0x7fd85c159450 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86299c700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 0x7fd85c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86199a700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c560 tx=0x7fd84c007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0072e0 con 0x7fd85c159450 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c007440 con 0x7fd85c159450 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c0057f0 con 0x7fd85c159450 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c0c4360 con 0x7fd85c159450 2023-10-08T16:09:40.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.929+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c0af330 con 0x7fd85c159450 2023-10-08T16:09:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.930+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c0af830 con 0x7fd85c159450 2023-10-08T16:09:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.931+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd84c005c00 con 0x7fd85c159450 2023-10-08T16:09:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.932+0000 7fd8527fc700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.932+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd84c083a20 con 0x7fd85c159450 2023-10-08T16:09:40.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.932+0000 7fd86219b700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:40.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.933+0000 7fd86219b700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 0x7fd8400693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8580093f0 tx=0x7fd858017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:40.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:40.936+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd84c050bf0 con 0x7fd85c159450 2023-10-08T16:09:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.184+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd85c04c3c0 con 0x7fd85c159450 2023-10-08T16:09:41.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.185+0000 7fd8527fc700 1 -- 172.21.15.12:0/1939351788 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fd84c017020 con 0x7fd85c159450 2023-10-08T16:09:41.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:41.186 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.187+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 msgr2=0x7fd8400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.187+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 0x7fd8400693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd8580093f0 tx=0x7fd858017000 comp rx=0 tx=0).stop 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.187+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 msgr2=0x7fd85c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.187+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd84c00c560 tx=0x7fd84c007e30 comp rx=0 tx=0).stop 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 shutdown_connections 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c14dfa0 0x7fd85c14f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0a9ff0 0x7fd85c0c5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd840066f30 0x7fd8400693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 --2- 172.21.15.12:0/1939351788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd85c159450 0x7fd85c0c3b90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 >> 172.21.15.12:0/1939351788 conn(0x7fd85c06d170 msgr2=0x7fd85c0a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 shutdown_connections 2023-10-08T16:09:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.188+0000 7fd86319d700 1 -- 172.21.15.12:0/1939351788 wait complete. 2023-10-08T16:09:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:09:41.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.390+0000 7f09d759e700 1 Processor -- start 2023-10-08T16:09:41.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.390+0000 7f09d759e700 1 -- start start 2023-10-08T16:09:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09d815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d815ae70 con 0x7f09d813fef0 2023-10-08T16:09:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d806af60 con 0x7f09d806aaa0 2023-10-08T16:09:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d806b240 con 0x7f09d813fb20 2023-10-08T16:09:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09d813fef0 0x7f09d80c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47092/0 (socket says 172.21.15.12:47092) 2023-10-08T16:09:41.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d5d9b700 1 -- 172.21.15.12:0/2168136073 learned_addr learned my addr 172.21.15.12:0/2168136073 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:41.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d659c700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09d815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630829218 0 0) 0x7f09cc001290 con 0x7f09d813fef0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09c0003570 con 0x7f09d813fef0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.392+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389805368 0 0) 0x7f09d806af60 con 0x7f09d806aaa0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09cc001290 con 0x7f09d806aaa0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560493974 0 0) 0x7f09c0003570 con 0x7f09d813fef0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 msgr2=0x7f09d815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09d815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 >> v1:172.21.15.29:6789/0 conn(0x7f09d806aaa0 legacy=0x7f09d80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d806b520 con 0x7f09d813fef0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f09cc001780 con 0x7f09d813fef0 2023-10-08T16:09:41.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 >> v1:172.21.15.12:6789/0 conn(0x7f09d813fef0 legacy=0x7f09d80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0003c20 0x7f09c0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c0004810 0x7f09c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d806b240 con 0x7f09c0004810 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c000dd50 con 0x7f09c0003c20 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09c000df10 con 0x7f09d813fb20 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c0004810 0x7f09c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d659c700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0003c20 0x7f09c0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d6d9d700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 -- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 msgr2=0x7f09c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:41.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d813fb20 0x7f09c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 -- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0003c20 msgr2=0x7f09c0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0003c20 0x7f09c0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.393+0000 7f09d5d9b700 1 -- 172.21.15.12:0/2168136073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c0003570 con 0x7f09c0004810 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d5d9b700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c0004810 0x7f09c0004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c410 tx=0x7f09cc007a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d730e8fe3b852ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00cd40 con 0x7f09c0004810 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc0070d0 con 0x7f09c0004810 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d559a700 1 -- 172.21.15.12:0/2168136073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00cea0 con 0x7f09c0004810 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d759e700 1 -- 172.21.15.12:0/2168136073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c0004810 msgr2=0x7f09c0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d759e700 1 --2- 172.21.15.12:0/2168136073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09c0004810 0x7f09c0004c80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00c410 tx=0x7f09cc007a30 comp rx=0 tx=0).stop 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d6d9d700 1 -- 172.21.15.12:0/2168136073 reap_dead start 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d759e700 1 -- 172.21.15.12:0/2168136073 shutdown_connections 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.394+0000 7f09d759e700 1 -- 172.21.15.12:0/2168136073 >> 172.21.15.12:0/2168136073 conn(0x7f09d806d170 msgr2=0x7f09d80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:41.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.395+0000 7f09d759e700 1 -- 172.21.15.12:0/2168136073 shutdown_connections 2023-10-08T16:09:41.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.395+0000 7f09d759e700 1 -- 172.21.15.12:0/2168136073 wait complete. 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.396+0000 7f09d759e700 1 Processor -- start 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.396+0000 7f09d759e700 1 -- start start 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0004810 0x7f09d80ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d8152cc0 0x7f09d8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80caa50 con 0x7f09d80ca0a0 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d81581b0 con 0x7f09c0004810 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d8154550 con 0x7f09d8152cc0 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40580/0 (socket says 172.21.15.12:40580) 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d6d9d700 1 -- 172.21.15.12:0/746417094 learned_addr learned my addr 172.21.15.12:0/746417094 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d659c700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0004810 0x7f09d80ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.397+0000 7f09d5d9b700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d8152cc0 0x7f09d8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 -- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d8152cc0 msgr2=0x7f09d8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d8152cc0 0x7f09d8154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 -- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0004810 msgr2=0x7f09d80ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0004810 0x7f09d80ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 -- 172.21.15.12:0/746417094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d813a860 con 0x7f09d80ca0a0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d6d9d700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09d806ae90 tx=0x7f09d00017e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000ee70 con 0x7f09d80ca0a0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d0006db0 con 0x7f09d80ca0a0 2023-10-08T16:09:41.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d000c7c0 con 0x7f09d80ca0a0 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d80ac9d0 con 0x7f09d80ca0a0 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.398+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d8157b60 con 0x7f09d80ca0a0 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.399+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d8158360 con 0x7f09d80ca0a0 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.400+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09d000cb30 con 0x7f09d80ca0a0 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.401+0000 7f09c67fc700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.401+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09d0083d00 con 0x7f09d80ca0a0 2023-10-08T16:09:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.401+0000 7f09d659c700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.402+0000 7f09d659c700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 0x7f09b80693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f09c8006f00 tx=0x7f09c80091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.405+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09d004c5a0 con 0x7f09d80ca0a0 2023-10-08T16:09:41.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.607+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09d804c3c0 con 0x7f09d80ca0a0 2023-10-08T16:09:41.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.608+0000 7f09c67fc700 1 -- 172.21.15.12:0/746417094 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f09d8158360 con 0x7f09d80ca0a0 2023-10-08T16:09:41.609 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:41.609 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 msgr2=0x7f09b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 0x7f09b80693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f09c8006f00 tx=0x7f09c80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 msgr2=0x7f09d80ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f09d806ae90 tx=0x7f09d00017e0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 shutdown_connections 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f09b8066f30 0x7f09b80693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09d80ca0a0 0x7f09d80ca510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09c0004810 0x7f09d80ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 --2- 172.21.15.12:0/746417094 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09d8152cc0 0x7f09d8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 >> 172.21.15.12:0/746417094 conn(0x7f09d806d170 msgr2=0x7f09d8155ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:41.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 shutdown_connections 2023-10-08T16:09:41.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.610+0000 7f09d759e700 1 -- 172.21.15.12:0/746417094 wait complete. 2023-10-08T16:09:41.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:09:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.813+0000 7fda5af9d700 1 Processor -- start 2023-10-08T16:09:41.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.813+0000 7fda5af9d700 1 -- start start 2023-10-08T16:09:41.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda54159640 0x7fda5406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5af9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda540c7420 con 0x7fda54159a10 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5af9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5406d5a0 con 0x7fda540caec0 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5406d820 con 0x7fda54159640 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda59f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda54159640 0x7fda5406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5979a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fda54159a10 0x7fda540ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47108/0 (socket says 172.21.15.12:47108) 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda5979a700 1 -- 172.21.15.12:0/3668461745 learned_addr learned my addr 172.21.15.12:0/3668461745 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda59f9b700 1 -- 172.21.15.12:0/3668461745 >> v1:172.21.15.29:6789/0 conn(0x7fda540caec0 legacy=0x7fda540c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda59f9b700 1 -- 172.21.15.12:0/3668461745 >> v1:172.21.15.12:6789/0 conn(0x7fda54159a10 legacy=0x7fda540ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda59f9b700 1 -- 172.21.15.12:0/3668461745 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5406db00 con 0x7fda54159640 2023-10-08T16:09:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.815+0000 7fda58f99700 1 -- 172.21.15.12:0/3668461745 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148740107 0 0) 0x7fda540c7420 con 0x7fda54159a10 2023-10-08T16:09:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda59f9b700 1 --2- 172.21.15.12:0/3668461745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159640 0x7fda5406d060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda50009910 tx=0x7fda500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892f8cf4fce27615 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda58f99700 1 -- 172.21.15.12:0/3668461745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000b820 con 0x7fda54159640 2023-10-08T16:09:41.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda58f99700 1 -- 172.21.15.12:0/3668461745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5000b980 con 0x7fda54159640 2023-10-08T16:09:41.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda58f99700 1 -- 172.21.15.12:0/3668461745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000bd20 con 0x7fda54159640 2023-10-08T16:09:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda5af9d700 1 -- 172.21.15.12:0/3668461745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159640 msgr2=0x7fda5406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.816+0000 7fda5af9d700 1 --2- 172.21.15.12:0/3668461745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159640 0x7fda5406d060 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fda50009910 tx=0x7fda500091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.817+0000 7fda5af9d700 1 -- 172.21.15.12:0/3668461745 shutdown_connections 2023-10-08T16:09:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.817+0000 7fda5af9d700 1 --2- 172.21.15.12:0/3668461745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159640 0x7fda5406d060 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.817+0000 7fda5af9d700 1 -- 172.21.15.12:0/3668461745 >> 172.21.15.12:0/3668461745 conn(0x7fda5406e720 msgr2=0x7fda5406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.817+0000 7fda5af9d700 1 -- 172.21.15.12:0/3668461745 shutdown_connections 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.817+0000 7fda5af9d700 1 -- 172.21.15.12:0/3668461745 wait complete. 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.818+0000 7fda5af9d700 1 Processor -- start 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.818+0000 7fda5af9d700 1 -- start start 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540caec0 0x7fda5416deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda54159640 0x7fda5406ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5416da20 con 0x7fda54159a10 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c46e0 con 0x7fda540caec0 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c49c0 con 0x7fda54159640 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda59f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540caec0 0x7fda5416deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40606/0 (socket says 172.21.15.12:40606) 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5a79c700 1 -- 172.21.15.12:0/980968367 learned_addr learned my addr 172.21.15.12:0/980968367 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.819+0000 7fda5979a700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda54159640 0x7fda5406ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 -- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda54159640 msgr2=0x7fda5406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda54159640 0x7fda5406ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 -- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540caec0 msgr2=0x7fda5416deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540caec0 0x7fda5416deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 -- 172.21.15.12:0/980968367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009420 con 0x7fda54159a10 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5a79c700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c910 tx=0x7fda4c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c012630 con 0x7fda54159a10 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c012790 con 0x7fda54159a10 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c012b50 con 0x7fda54159a10 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.820+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5416d3d0 con 0x7fda54159a10 2023-10-08T16:09:41.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.821+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5414ebf0 con 0x7fda54159a10 2023-10-08T16:09:41.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.821+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda5404c3c0 con 0x7fda54159a10 2023-10-08T16:09:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.822+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda4c01b450 con 0x7fda54159a10 2023-10-08T16:09:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.823+0000 7fda49ffb700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.823+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fda4c084720 con 0x7fda54159a10 2023-10-08T16:09:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.823+0000 7fda59f9b700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:41.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.824+0000 7fda59f9b700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 0x7fda380693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda500093f0 tx=0x7fda50017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:41.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:41.827+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda4c055380 con 0x7fda54159a10 2023-10-08T16:09:42.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.071+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda540af3b0 con 0x7fda54159a10 2023-10-08T16:09:42.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.072+0000 7fda49ffb700 1 -- 172.21.15.12:0/980968367 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7fda4c054f10 con 0x7fda54159a10 2023-10-08T16:09:42.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:42.073 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:09:42.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 msgr2=0x7fda380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 0x7fda380693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fda500093f0 tx=0x7fda50017000 comp rx=0 tx=0).stop 2023-10-08T16:09:42.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 msgr2=0x7fda540c3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fda4c00c910 tx=0x7fda4c0016f0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 shutdown_connections 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fda38066f30 0x7fda380693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda54159a10 0x7fda540c3c90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda540caec0 0x7fda5416deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 --2- 172.21.15.12:0/980968367 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda54159640 0x7fda5406ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 >> 172.21.15.12:0/980968367 conn(0x7fda5406e720 msgr2=0x7fda54158950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 shutdown_connections 2023-10-08T16:09:42.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.074+0000 7fda5af9d700 1 -- 172.21.15.12:0/980968367 wait complete. 2023-10-08T16:09:42.077 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:09:42.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:09:20.453996+0000', 'modified': '2023-10-08T16:09:23.973059+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/3750481948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 3750481948}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 3750481948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:09:42.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:09:42.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T16:09:42.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.683+0000 7f47e7fff700 1 Processor -- start 2023-10-08T16:09:42.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.683+0000 7f47e7fff700 1 -- start start 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47e8140e40 0x7f47e80c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e80c6d50 con 0x7f47e80c8330 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e80c7030 con 0x7f47e8140e40 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c7310 con 0x7f47e8140a70 2023-10-08T16:09:42.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e67fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f47e8140e40 0x7f47e80c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f47e80c8330 0x7f47e80aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40004/0 (socket says 172.21.15.12:40004) 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e77fe700 1 -- 172.21.15.12:0/3803932456 learned_addr learned my addr 172.21.15.12:0/3803932456 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e5ffb700 1 -- 172.21.15.12:0/3803932456 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176595967 0 0) 0x7f47e80c6d50 con 0x7f47e80c8330 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e5ffb700 1 -- 172.21.15.12:0/3803932456 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d0003570 con 0x7f47e80c8330 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e67fc700 1 -- 172.21.15.12:0/3803932456 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 msgr2=0x7f47e80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e67fc700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e67fc700 1 -- 172.21.15.12:0/3803932456 >> v1:172.21.15.12:6789/0 conn(0x7f47e80c8330 legacy=0x7f47e80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.685+0000 7f47e67fc700 1 -- 172.21.15.12:0/3803932456 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80c75f0 con 0x7f47e8140e40 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e67fc700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e8140e40 0x7f47e80c7df0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098d0 tx=0x7f47dc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7a14befdea2949 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e5ffb700 1 -- 172.21.15.12:0/3803932456 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc005c10 con 0x7f47e8140e40 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e5ffb700 1 -- 172.21.15.12:0/3803932456 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc005d70 con 0x7f47e8140e40 2023-10-08T16:09:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e5ffb700 1 -- 172.21.15.12:0/3803932456 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc006240 con 0x7f47e8140e40 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e7fff700 1 -- 172.21.15.12:0/3803932456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e8140e40 msgr2=0x7f47e80c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.686+0000 7f47e7fff700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e8140e40 0x7f47e80c7df0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0098d0 tx=0x7f47dc009120 comp rx=0 tx=0).stop 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 -- 172.21.15.12:0/3803932456 shutdown_connections 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 --2- 172.21.15.12:0/3803932456 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e8140e40 0x7f47e80c7df0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 -- 172.21.15.12:0/3803932456 >> 172.21.15.12:0/3803932456 conn(0x7f47e806d170 msgr2=0x7f47e80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 -- 172.21.15.12:0/3803932456 shutdown_connections 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.687+0000 7f47e7fff700 1 -- 172.21.15.12:0/3803932456 wait complete. 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.688+0000 7f47e7fff700 1 Processor -- start 2023-10-08T16:09:42.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.688+0000 7f47e7fff700 1 -- start start 2023-10-08T16:09:42.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47e8140e40 0x7f47e80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e80c3e10 con 0x7f47e80c8330 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8157210 con 0x7f47e8140e40 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e8168e30 con 0x7f47e8140a70 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42754/0 (socket says 172.21.15.12:42754) 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.689+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2006477518 learned_addr learned my addr 172.21.15.12:0/2006477518 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 msgr2=0x7f47e80c42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47e8140e40 msgr2=0x7f47e80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47e8140e40 0x7f47e80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2006477518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc0093c0 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f47d800ec80 tx=0x7f47d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47ceffd700 1 -- 172.21.15.12:0/2006477518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d800c9d0 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47ceffd700 1 -- 172.21.15.12:0/2006477518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800cb30 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47ceffd700 1 -- 172.21.15.12:0/2006477518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8013470 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8169110 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.690+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80c3aa0 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.692+0000 7f47ceffd700 1 -- 172.21.15.12:0/2006477518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47d8013820 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.693+0000 7f47ceffd700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 0x7f47d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.693+0000 7f47ceffd700 1 -- 172.21.15.12:0/2006477518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47d8084960 con 0x7f47e80c8330 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.693+0000 7f47e67fc700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 0x7f47d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.694+0000 7f47e67fc700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 0x7f47d40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f47e813f090 tx=0x7f47dc016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.695+0000 7f47fbdf0b80 1 Processor -- start 2023-10-08T16:09:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.695+0000 7f47fbdf0b80 1 -- start start 2023-10-08T16:09:42.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 0x563dfedfd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb2b80 0x563dfedb2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfed09a70 con 0x563dfedfd480 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfed07270 con 0x563dfedb2b80 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dfed03060 con 0x563dfedb05f0 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47e6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42768/0 (socket says 172.21.15.12:42768) 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.696+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2416861380 learned_addr learned my addr 172.21.15.12:0/2416861380 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e77fe700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb2b80 0x563dfedb2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e67fc700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 0x563dfedfd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 msgr2=0x563dfedfd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 0x563dfedfd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb2b80 msgr2=0x563dfedb2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb2b80 0x563dfedb2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 -- 172.21.15.12:0/2416861380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dfeb9d270 con 0x563dfedfd480 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e67fc700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 0x563dfedfd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47d8055780 tx=0x7f47d8082d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d6b5e38524a759 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47c7fff700 1 -- 172.21.15.12:0/2416861380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d80557f0 con 0x563dfedfd480 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47c7fff700 1 -- 172.21.15.12:0/2416861380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d806b020 con 0x563dfedfd480 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.697+0000 7f47c7fff700 1 -- 172.21.15.12:0/2416861380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8058a40 con 0x563dfedfd480 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2416861380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 msgr2=0x563dfeddc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47d8055780 tx=0x7f47d8082d40 comp rx=0 tx=0).stop 2023-10-08T16:09:42.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2416861380 shutdown_connections 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddc7d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb2b80 0x563dfedb2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2416861380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb05f0 0x563dfedfd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2416861380 >> 172.21.15.12:0/2416861380 conn(0x563dfedb40c0 msgr2=0x563dfedb48f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2416861380 shutdown_connections 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.698+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2416861380 wait complete. 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.699+0000 7f47fbdf0b80 1 -- start start 2023-10-08T16:09:42.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.699+0000 7f47fbdf0b80 1 Processor -- start 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedfc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfecae890 con 0x563dfedfd480 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfecc9ea0 con 0x563dfedb05f0 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dfeb85e30 con 0x563dfedb2b80 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47fbdf0b80 10 client.0 _ll_register_callbacks cb 0x563dfed762c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42772/0 (socket says 172.21.15.12:42772) 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47e77fe700 1 -- 172.21.15.12:0/862328076 learned_addr learned my addr 172.21.15.12:0/862328076 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:42.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.700+0000 7f47e67fc700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedfc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 -- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 msgr2=0x563dfedfc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedfc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 -- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 msgr2=0x563dfedd6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 -- 172.21.15.12:0/862328076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e80c3aa0 con 0x563dfedfd480 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47e77fe700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e9a0 tx=0x7f47e0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efd35ece7cb3521 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000c5d0 con 0x563dfedfd480 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47e000c730 con 0x563dfedfd480 2023-10-08T16:09:42.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563dfeda7cd0 con 0x563dfedfd480 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47e0001ca0 con 0x563dfedfd480 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47fbdf0b80 10 client.4695 fetch_fsmap learned FSMap version 8 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.701+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563dfeb3ffe0 con 0x563dfedfd480 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563dfeda7cd0 con 0x563dfedfd480 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f47e000cb20 con 0x563dfedfd480 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 10 client.4695 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 10 client.4695 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 20 client.4695 populate_metadata read hostname 'smithi012' 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfedfa320 0x563dfedfa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 4 client.4695 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 --> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563dfed84aa0 con 0x563dfedfa320 2023-10-08T16:09:42.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.702+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfedfa320 0x563dfedfa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.703+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfedfa320 0x563dfedfa6f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280ea05490464250 server_cookie=7047b452a60212c3 in_seq=0 out_seq=0 2023-10-08T16:09:42.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.703+0000 7f47c57fa700 10 client.4695 ms_handle_connect on v2:172.21.15.29:6833/3750481948 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.703+0000 7f47c57fa700 1 -- 172.21.15.12:0/862328076 <== mds.0 v2:172.21.15.29:6833/3750481948 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563dfed84aa0 con 0x563dfedfa320 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.703+0000 7f47c57fa700 10 client.4695 handle_command_reply: tid=0 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.703+0000 7f47fbdf0b80 1 client.4695 shutdown 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 msgr2=0x563dfeddb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f47e000e9a0 tx=0x7f47e0009040 comp rx=0 tx=0).stop 2023-10-08T16:09:42.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 shutdown_connections 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfeddb100 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfedfa320 0x563dfedfa6f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/862328076 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedfc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47c57fa700 0 client.4695 ms_handle_reset on v2:172.21.15.29:6833/3750481948 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 >> 172.21.15.12:0/862328076 conn(0x563dfedb40c0 msgr2=0x563dfedb48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 shutdown_connections 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/862328076 wait complete. 2023-10-08T16:09:42.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.704+0000 7f47fbdf0b80 20 client.4695 trim_cache size 0 max 16384 2023-10-08T16:09:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.721+0000 7f47fbdf0b80 1 Processor -- start 2023-10-08T16:09:42.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.721+0000 7f47fbdf0b80 1 -- start start 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedafc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfed8b4b0 con 0x563dfedfd480 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfede0050 con 0x563dfedb05f0 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dfeda7c90 con 0x563dfedb2b80 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42776/0 (socket says 172.21.15.12:42776) 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.722+0000 7f47e77fe700 1 -- 172.21.15.12:0/2036239236 learned_addr learned my addr 172.21.15.12:0/2036239236 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:42.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e67fc700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedafc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 -- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 msgr2=0x563dfedafc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedafc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 -- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 msgr2=0x563dfedd85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 -- 172.21.15.12:0/2036239236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563dfecd1780 con 0x563dfedfd480 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47e77fe700 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47e00017b0 tx=0x7f47e0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea54762cf4fa2e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47ccff9700 1 -- 172.21.15.12:0/2036239236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e00011c0 con 0x563dfedfd480 2023-10-08T16:09:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47ccff9700 1 -- 172.21.15.12:0/2036239236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e000cb20 con 0x563dfedfd480 2023-10-08T16:09:42.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.723+0000 7f47ccff9700 1 -- 172.21.15.12:0/2036239236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e000cc90 con 0x563dfedfd480 2023-10-08T16:09:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2036239236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 msgr2=0x563dfedd73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f47e00017b0 tx=0x7f47e0018000 comp rx=0 tx=0).stop 2023-10-08T16:09:42.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2036239236 shutdown_connections 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedfd480 0x563dfedd73a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfedd85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/2036239236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedb2b80 0x563dfedafc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2036239236 >> 172.21.15.12:0/2036239236 conn(0x563dfedb40c0 msgr2=0x563dfedd6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2036239236 shutdown_connections 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/2036239236 wait complete. 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.724+0000 7f47fbdf0b80 1 -- start start 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.725+0000 7f47fbdf0b80 1 Processor -- start 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfee55210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedfd480 0x563dfee0d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfeda9950 con 0x563dfedb2b80 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x563dfee55750 con 0x563dfedb05f0 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x563dfedd5d40 con 0x563dfedfd480 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47fbdf0b80 10 client.0 _ll_register_callbacks cb 0x563dfed762c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42788/0 (socket says 172.21.15.12:42788) 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 -- 172.21.15.12:0/1395581911 learned_addr learned my addr 172.21.15.12:0/1395581911 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfee55210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e77fe700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedfd480 0x563dfee0d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 -- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedfd480 msgr2=0x563dfee0d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedfd480 0x563dfee0d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 -- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 msgr2=0x563dfee55210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfee55210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.726+0000 7f47e67fc700 1 -- 172.21.15.12:0/1395581911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563dfeb3ffe0 con 0x563dfedb2b80 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47e67fc700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47e8071320 tx=0x7f47dc01f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6b5822e5232afc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02c070 con 0x563dfedb2b80 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47dc0061d0 con 0x563dfedb2b80 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47d806b020 con 0x563dfedb2b80 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47dc0282e0 con 0x563dfedb2b80 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 10 client.4701 fetch_fsmap learned FSMap version 8 2023-10-08T16:09:42.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x563dfecb8470 con 0x563dfedb2b80 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d806b020 con 0x563dfedb2b80 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f47dc033ce0 con 0x563dfedb2b80 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 10 client.4701 fetch_fsmap finished waiting for FSMap version 8 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 10 client.4701 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 20 client.4701 populate_metadata read hostname 'smithi012' 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfee5eac0 0x563dfee5ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 4 client.4701 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.727+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 --> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563dfeca5e00 con 0x563dfee5eac0 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.728+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfee5eac0 0x563dfee5ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.728+0000 7f47c57fa700 10 client.4701 ms_handle_connect on v2:172.21.15.29:6833/3750481948 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.728+0000 7f47e6ffd700 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfee5eac0 0x563dfee5ee90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3824db3d170fb7a server_cookie=778add6c9d7449ba in_seq=0 out_seq=0 2023-10-08T16:09:42.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47c57fa700 1 -- 172.21.15.12:0/1395581911 <== mds.0 v2:172.21.15.29:6833/3750481948 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x563dfeca5e00 con 0x563dfee5eac0 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47c57fa700 10 client.4701 handle_command_reply: tid=0 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 client.4701 shutdown 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 msgr2=0x563dfee08f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f47e8071320 tx=0x7f47dc01f040 comp rx=0 tx=0).stop 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 shutdown_connections 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:6833/3750481948,v1:172.21.15.29:6835/3750481948] conn(0x563dfee5eac0 0x563dfee5ee90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x563dfedfd480 0x563dfee0d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x563dfedb05f0 0x563dfee55210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 --2- 172.21.15.12:0/1395581911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x563dfedb2b80 0x563dfee08f10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47c57fa700 0 client.4701 ms_handle_reset on v2:172.21.15.29:6833/3750481948 2023-10-08T16:09:42.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 >> 172.21.15.12:0/1395581911 conn(0x563dfedb40c0 msgr2=0x563dfedafc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 shutdown_connections 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 1 -- 172.21.15.12:0/1395581911 wait complete. 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.729+0000 7f47fbdf0b80 20 client.4701 trim_cache size 0 max 16384 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4300, 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:09:42.739 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 21.772169602000002, 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 8, 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 21, 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 21, 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 26.785672759000001 2023-10-08T16:09:42.740 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 msgr2=0x7f47d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 0x7f47d40693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f47e813f090 tx=0x7f47dc016000 comp rx=0 tx=0).stop 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 msgr2=0x7f47e8156cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f47d800ec80 tx=0x7f47d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 shutdown_connections 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f47d4066f30 0x7f47d40693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47e80c8330 0x7f47e8156cd0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47e8140e40 0x7f47e80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 --2- 172.21.15.12:0/2006477518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47e8140a70 0x7f47e80c42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 >> 172.21.15.12:0/2006477518 conn(0x7f47e806d170 msgr2=0x7f47e80c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 shutdown_connections 2023-10-08T16:09:42.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:42.730+0000 7f47e7fff700 1 -- 172.21.15.12:0/2006477518 wait complete. 2023-10-08T16:09:42.747 INFO:teuthology.run_tasks:Running task kclient... 2023-10-08T16:09:42.769 INFO:tasks.kclient:Mounting kernel clients... 2023-10-08T16:09:42.770 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-08T16:09:42.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:42.770 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:09:42.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:42.807 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-08T16:09:42.912 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-10-08T16:09:42.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:09:42.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:42.915 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:09:42.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:42.952 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-08T16:09:43.056 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-10-08T16:09:43.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:09:43.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.060 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T16:09:43.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.101 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T16:09:43.212 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-08T16:09:43.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:09:43.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.215 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T16:09:43.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T16:09:43.358 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-08T16:09:43.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T16:09:43.361 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-08T16:09:43.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:43.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.547+0000 7fe626b9d700 1 Processor -- start 2023-10-08T16:09:43.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.547+0000 7fe626b9d700 1 -- start start 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.548+0000 7fe626b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe620153c30 0x7fe62015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.548+0000 7fe626b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 0x7fe6200cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe626b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6200cef40 0x7fe62006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe626b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6200cf3c0 con 0x7fe620153c30 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe626b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62015afd0 con 0x7fe62015de50 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe626b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62015b2b0 con 0x7fe6200cef40 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe620153c30 0x7fe62015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe620153c30 0x7fe62015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42804/0 (socket says 172.21.15.12:42804) 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 -- 172.21.15.12:0/752677542 learned_addr learned my addr 172.21.15.12:0/752677542 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:43.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe62539a700 1 --2- 172.21.15.12:0/752677542 >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 0x7fe6200cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe62639c700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6200cef40 0x7fe62006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 -- 172.21.15.12:0/752677542 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6200cef40 msgr2=0x7fe62006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6200cef40 0x7fe62006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 -- 172.21.15.12:0/752677542 >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 msgr2=0x7fe6200cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 --2- 172.21.15.12:0/752677542 >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 0x7fe6200cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe625b9b700 1 -- 172.21.15.12:0/752677542 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62015b590 con 0x7fe620153c30 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.549+0000 7fe62539a700 1 --2- 172.21.15.12:0/752677542 >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 0x7fe6200cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe625b9b700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620153c30 0x7fe62015a5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe6200713a0 tx=0x7fe61c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c9c638b4c3da2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe624b99700 1 -- 172.21.15.12:0/752677542 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00b860 con 0x7fe620153c30 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe624b99700 1 -- 172.21.15.12:0/752677542 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c00b9c0 con 0x7fe620153c30 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe624b99700 1 -- 172.21.15.12:0/752677542 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c00bd60 con 0x7fe620153c30 2023-10-08T16:09:43.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 -- 172.21.15.12:0/752677542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620153c30 msgr2=0x7fe62015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620153c30 0x7fe62015a5e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe6200713a0 tx=0x7fe61c009250 comp rx=0 tx=0).stop 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 -- 172.21.15.12:0/752677542 shutdown_connections 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6200cef40 0x7fe62006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 --2- 172.21.15.12:0/752677542 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620153c30 0x7fe62015a5e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 --2- 172.21.15.12:0/752677542 >> v2:172.21.15.29:3300/0 conn(0x7fe62015de50 0x7fe6200cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.550+0000 7fe626b9d700 1 -- 172.21.15.12:0/752677542 >> 172.21.15.12:0/752677542 conn(0x7fe6200703a0 msgr2=0x7fe6200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.551+0000 7fe626b9d700 1 -- 172.21.15.12:0/752677542 shutdown_connections 2023-10-08T16:09:43.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.551+0000 7fe626b9d700 1 -- 172.21.15.12:0/752677542 wait complete. 2023-10-08T16:09:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.552+0000 7fe626b9d700 1 Processor -- start 2023-10-08T16:09:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.552+0000 7fe626b9d700 1 -- start start 2023-10-08T16:09:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 0x7fe62014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe62015de50 0x7fe62014e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6200cb460 con 0x7fe6200cef40 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62014edf0 con 0x7fe62015de50 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe626b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62014f0d0 con 0x7fe620153c30 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe625b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe625b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42816/0 (socket says 172.21.15.12:42816) 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe625b9b700 1 -- 172.21.15.12:0/2358460433 learned_addr learned my addr 172.21.15.12:0/2358460433 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe62639c700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe62015de50 0x7fe62014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.553+0000 7fe62539a700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 0x7fe62014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 -- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 msgr2=0x7fe62014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 0x7fe62014e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 -- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe62015de50 msgr2=0x7fe62014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe62015de50 0x7fe62014e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 -- 172.21.15.12:0/2358460433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61c0094f0 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe62539a700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 0x7fe62014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe625b9b700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009290 tx=0x7fe61c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c026480 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe61c01f070 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe62014f3b0 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61c026870 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.554+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe62014f970 con 0x7fe6200cef40 2023-10-08T16:09:43.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.555+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe62004c3c0 con 0x7fe6200cef40 2023-10-08T16:09:43.559 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:43.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.556+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe61c026be0 con 0x7fe6200cef40 2023-10-08T16:09:43.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.557+0000 7fe615ffb700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:43.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.557+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe61c021070 con 0x7fe6200cef40 2023-10-08T16:09:43.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.558+0000 7fe62539a700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:43.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.558+0000 7fe62539a700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 0x7fe6040693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe62015cb00 tx=0x7fe610008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:43.565 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:09:43.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.562+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe61c053690 con 0x7fe6200cef40 2023-10-08T16:09:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.811+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe62015b870 con 0x7fe6200cef40 2023-10-08T16:09:43.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.811+0000 7fe615ffb700 1 -- 172.21.15.12:0/2358460433 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe61c015070 con 0x7fe6200cef40 2023-10-08T16:09:43.813 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 msgr2=0x7fe6040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 0x7fe6040693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe62015cb00 tx=0x7fe610008040 comp rx=0 tx=0).stop 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 msgr2=0x7fe6200cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe61c009290 tx=0x7fe61c017000 comp rx=0 tx=0).stop 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 shutdown_connections 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe604066f30 0x7fe6040693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6200cef40 0x7fe6200cbfe0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe62015de50 0x7fe62014e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 --2- 172.21.15.12:0/2358460433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe620153c30 0x7fe62014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 >> 172.21.15.12:0/2358460433 conn(0x7fe6200703a0 msgr2=0x7fe6200cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 shutdown_connections 2023-10-08T16:09:43.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:43.814+0000 7fe626b9d700 1 -- 172.21.15.12:0/2358460433 wait complete. 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:43.832 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:09:43.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.833 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:09:43.869 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:43.869 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:09:43.870 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42158sec preferred_lft 42158sec 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:43.871 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:09:43.872 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:09:43.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:43.872 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:43.872 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:43.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:09:43.872 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr flush dev ceph-brx 2023-10-08T16:09:43.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set ceph-brx up 2023-10-08T16:09:43.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:09:43.873 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:44.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:44.329 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:44.476 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:09:44.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:44.479 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:09:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:09:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:44.534 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:09:44.535 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:09:44.535 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:44.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:44.535 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:44.535 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:44.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:09:44.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:09:44.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:09:44.536 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:45.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:45.271 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:09:45.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:45.309 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-10-08T16:09:45.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:45.386 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:45.386 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:45.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:09:45.387 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-08T16:09:45.387 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:45.555 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-08T16:09:45.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:45.555 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-08T16:09:45.556 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:45.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:45.820 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:45.820 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:45.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:09:45.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:09:45.820 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:45.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:45.980 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:46.017 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:09:46.018 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:46.018 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:46.093 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:09:46.093 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:46.093 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:46.250 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:46.250 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:46.712 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:46.713 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:46.713 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:09:46.713 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:09:46.713 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:09:46.717 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:46.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:46.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:09:46.781 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-08T16:09:46.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:46.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.967+0000 7f5579d9d700 1 Processor -- start 2023-10-08T16:09:46.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.967+0000 7f5579d9d700 1 -- start start 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5579d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5579d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f557406aaa0 0x7f55740c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5579d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f557415ae70 con 0x7f557413fb20 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5579d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f557406af60 con 0x7f557406aaa0 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5579d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557406b240 con 0x7f557413fef0 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f557406aaa0 0x7f55740c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f557406aaa0 0x7f55740c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42824/0 (socket says 172.21.15.12:42824) 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 -- 172.21.15.12:0/3835297699 learned_addr learned my addr 172.21.15.12:0/3835297699 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:46.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f5573fff700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 -- 172.21.15.12:0/3835297699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 msgr2=0x7f557415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 -- 172.21.15.12:0/3835297699 >> v1:172.21.15.29:6789/0 conn(0x7f557413fb20 legacy=0x7f55740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.969+0000 7f557959c700 1 -- 172.21.15.12:0/3835297699 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557406b520 con 0x7f557406aaa0 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f557959c700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557406aaa0 0x7f55740c9d00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f556c009f20 tx=0x7f556c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9177e119e4d9c046 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f55737fe700 1 -- 172.21.15.12:0/3835297699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00e070 con 0x7f557406aaa0 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f55737fe700 1 -- 172.21.15.12:0/3835297699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00b9d0 con 0x7f557406aaa0 2023-10-08T16:09:46.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f55737fe700 1 -- 172.21.15.12:0/3835297699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c0092e0 con 0x7f557406aaa0 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f5579d9d700 1 -- 172.21.15.12:0/3835297699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557406aaa0 msgr2=0x7f55740c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.970+0000 7f5579d9d700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557406aaa0 0x7f55740c9d00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f556c009f20 tx=0x7f556c009840 comp rx=0 tx=0).stop 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 -- 172.21.15.12:0/3835297699 shutdown_connections 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557406aaa0 0x7f55740c9d00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 --2- 172.21.15.12:0/3835297699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 -- 172.21.15.12:0/3835297699 >> 172.21.15.12:0/3835297699 conn(0x7f557406d170 msgr2=0x7f55740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 -- 172.21.15.12:0/3835297699 shutdown_connections 2023-10-08T16:09:46.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.971+0000 7f5579d9d700 1 -- 172.21.15.12:0/3835297699 wait complete. 2023-10-08T16:09:46.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.972+0000 7f5579d9d700 1 Processor -- start 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.972+0000 7f5579d9d700 1 -- start start 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f557406aaa0 0x7f55740ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557413eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557415eda0 con 0x7f557413fb20 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557415df20 con 0x7f557406aaa0 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.973+0000 7f5579d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557415e190 con 0x7f557413fef0 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42828/0 (socket says 172.21.15.12:42828) 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 -- 172.21.15.12:0/4269820381 learned_addr learned my addr 172.21.15.12:0/4269820381 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:46.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5578d9b700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f557406aaa0 0x7f55740ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f557959c700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557413eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 -- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 msgr2=0x7f557413eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557413eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 -- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f557406aaa0 msgr2=0x7f55740ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f557406aaa0 0x7f55740ae640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:46.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 -- 172.21.15.12:0/4269820381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c009ae0 con 0x7f557413fb20 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5573fff700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f556000ea00 tx=0x7f5560009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.974+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560013680 con 0x7f557413fb20 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.975+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557415e470 con 0x7f557413fb20 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.975+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55600137e0 con 0x7f557413fb20 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.975+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560013b80 con 0x7f557413fb20 2023-10-08T16:09:46.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.975+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f557415ea30 con 0x7f557413fb20 2023-10-08T16:09:46.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.976+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f557404c3c0 con 0x7f557413fb20 2023-10-08T16:09:46.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.977+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f556000c490 con 0x7f557413fb20 2023-10-08T16:09:46.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.977+0000 7f5570ff9700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:46.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.978+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5560084bc0 con 0x7f557413fb20 2023-10-08T16:09:46.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.978+0000 7f5578d9b700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:46.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.978+0000 7f5578d9b700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 0x7f55580693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5568003a80 tx=0x7f5568007ec0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:46.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:46.982+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5560051d90 con 0x7f557413fb20 2023-10-08T16:09:47.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.232+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f557415eee0 con 0x7f557413fb20 2023-10-08T16:09:47.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.232+0000 7f5570ff9700 1 -- 172.21.15.12:0/4269820381 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5560021060 con 0x7f557413fb20 2023-10-08T16:09:47.233 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 msgr2=0x7f55580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 0x7f55580693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5568003a80 tx=0x7f5568007ec0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 msgr2=0x7f557415d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f556000ea00 tx=0x7f5560009120 comp rx=0 tx=0).stop 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 shutdown_connections 2023-10-08T16:09:47.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f557413fef0 0x7f557413eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f557406aaa0 0x7f55740ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5558066f30 0x7f55580693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 --2- 172.21.15.12:0/4269820381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f557413fb20 0x7f557415d9e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 >> 172.21.15.12:0/4269820381 conn(0x7f557406d170 msgr2=0x7f55740c1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 shutdown_connections 2023-10-08T16:09:47.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:47.235+0000 7f5579d9d700 1 -- 172.21.15.12:0/4269820381 wait complete. 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:47.253 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:09:47.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.254 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:09:47.290 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:47.291 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42154sec preferred_lft 42154sec 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:47.292 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link tentative 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.293 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:47.390 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:09:47.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.393 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:09:47.432 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:09:47.432 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:47.432 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:09:47.432 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:09:47.432 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:47.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.433 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:47.433 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:47.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:09:47.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:09:47.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:09:47.434 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:47.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.632 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:09:47.667 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:09:47.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.669 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list-id 2023-10-08T16:09:47.744 INFO:teuthology.orchestra.run.smithi012.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-08T16:09:47.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.745 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:47.745 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:47.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:09:47.745 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-08T16:09:47.745 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:47.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:2d:69:da:13:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:09:47.976 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c42d:69ff:feda:13c4/64 scope link 2023-10-08T16:09:47.977 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:47.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:47.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-08T16:09:48.040 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether c6:2d:69:da:13:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::c42d:69ff:feda:13c4/64 scope link 2023-10-08T16:09:48.041 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:48.043 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-08T16:09:48.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-08T16:09:48.044 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:48.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:48.278 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:09:48.279 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:09:48.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.1 up 2023-10-08T16:09:48.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:09:48.279 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:09:48.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:48.438 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-08T16:09:48.474 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-08T16:09:48.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:48.475 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:09:48.550 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-08T16:09:48.550 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:48.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:48.682 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:48.711 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:48.711 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:48.711 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:09:48.711 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 2@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:09:48.711 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:09:48.716 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:48.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:48.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-08T16:09:48.778 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-08T16:09:48.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:48.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.965+0000 7f223f59e700 1 Processor -- start 2023-10-08T16:09:48.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.965+0000 7f223f59e700 1 -- start start 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.966+0000 7f223f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f224015dfd0 0x7f22400aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.966+0000 7f223f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400acc00 con 0x7f2240159550 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.966+0000 7f223f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22400abff0 con 0x7f2240159920 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.966+0000 7f223f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22400ac2d0 con 0x7f224015dfd0 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f224015dfd0 0x7f22400aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f224015dfd0 0x7f22400aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42840/0 (socket says 172.21.15.12:42840) 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 -- 172.21.15.12:0/610975619 learned_addr learned my addr 172.21.15.12:0/610975619 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223e59c700 1 --1- 172.21.15.12:0/610975619 >> v1:172.21.15.12:6789/0 conn(0x7f2240159550 0x7f22400ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40008/0 (socket says 172.21.15.12:40008) 2023-10-08T16:09:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 -- 172.21.15.12:0/610975619 >> v1:172.21.15.29:6789/0 conn(0x7f2240159920 legacy=0x7f22400ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 -- 172.21.15.12:0/610975619 >> v1:172.21.15.12:6789/0 conn(0x7f2240159550 legacy=0x7f22400ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 -- 172.21.15.12:0/610975619 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22400ac5b0 con 0x7f224015dfd0 2023-10-08T16:09:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223dd9b700 1 --2- 172.21.15.12:0/610975619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f224015dfd0 0x7f22400aedb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22340099b0 tx=0x7f2234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2e76c378350d94 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.967+0000 7f223d59a700 1 -- 172.21.15.12:0/610975619 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400b860 con 0x7f224015dfd0 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223d59a700 1 -- 172.21.15.12:0/610975619 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400b9c0 con 0x7f224015dfd0 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223d59a700 1 -- 172.21.15.12:0/610975619 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400bd60 con 0x7f224015dfd0 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 -- 172.21.15.12:0/610975619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f224015dfd0 msgr2=0x7f22400aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 --2- 172.21.15.12:0/610975619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f224015dfd0 0x7f22400aedb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f22340099b0 tx=0x7f2234009250 comp rx=0 tx=0).stop 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 -- 172.21.15.12:0/610975619 shutdown_connections 2023-10-08T16:09:48.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 --2- 172.21.15.12:0/610975619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f224015dfd0 0x7f22400aedb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 -- 172.21.15.12:0/610975619 >> 172.21.15.12:0/610975619 conn(0x7f224006ce80 msgr2=0x7f22400ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 -- 172.21.15.12:0/610975619 shutdown_connections 2023-10-08T16:09:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.968+0000 7f223f59e700 1 -- 172.21.15.12:0/610975619 wait complete. 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.970+0000 7f223f59e700 1 Processor -- start 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.970+0000 7f223f59e700 1 -- start start 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2240159920 0x7f22400ce100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f224015dfd0 0x7f22400ce640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400c9e00 con 0x7f2240159550 2023-10-08T16:09:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400c91f0 con 0x7f2240159920 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400c94d0 con 0x7f224015dfd0 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:42844/0 (socket says 172.21.15.12:42844) 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223e59c700 1 -- 172.21.15.12:0/2391706299 learned_addr learned my addr 172.21.15.12:0/2391706299 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223dd9b700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2240159920 0x7f22400ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.971+0000 7f223ed9d700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f224015dfd0 0x7f22400ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 -- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f224015dfd0 msgr2=0x7f22400ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f224015dfd0 0x7f22400ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 -- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2240159920 msgr2=0x7f22400ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2240159920 0x7f22400ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:48.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 -- 172.21.15.12:0/2391706299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340094f0 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223e59c700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f223000c7c0 tx=0x7f2230007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2230005a70 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2230005bd0 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300070d0 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22400c97b0 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.972+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224016af50 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.973+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224004c3c0 con 0x7f2240159550 2023-10-08T16:09:48.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.974+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2230007480 con 0x7f2240159550 2023-10-08T16:09:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.976+0000 7f222e7fc700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.976+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2230083a90 con 0x7f2240159550 2023-10-08T16:09:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.976+0000 7f223dd9b700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.977+0000 7f223dd9b700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22340099b0 tx=0x7f2234017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:48.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:48.980+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2230050c60 con 0x7f2240159550 2023-10-08T16:09:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.226+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2240069ba0 con 0x7f2240159550 2023-10-08T16:09:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.227+0000 7f222e7fc700 1 -- 172.21.15.12:0/2391706299 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2230017020 con 0x7f2240159550 2023-10-08T16:09:49.228 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 msgr2=0x7f22200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22340099b0 tx=0x7f2234017000 comp rx=0 tx=0).stop 2023-10-08T16:09:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 msgr2=0x7f224016aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f223000c7c0 tx=0x7f2230007f70 comp rx=0 tx=0).stop 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 shutdown_connections 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2240159550 0x7f224016aa10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f224015dfd0 0x7f22400ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 --2- 172.21.15.12:0/2391706299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2240159920 0x7f22400ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 >> 172.21.15.12:0/2391706299 conn(0x7f224006ce80 msgr2=0x7f22400aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 shutdown_connections 2023-10-08T16:09:49.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:49.229+0000 7f223f59e700 1 -- 172.21.15.12:0/2391706299 wait complete. 2023-10-08T16:09:49.247 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:09:49.247 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:49.247 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:49.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:09:49.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:49.248 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:49.290 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42199sec preferred_lft 42199sec 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:49.291 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:49.292 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:49.292 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T16:09:49.292 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-08T16:09:49.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add name ceph-brx type bridge 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr flush dev ceph-brx 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set ceph-brx up 2023-10-08T16:09:49.292 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-08T16:09:49.293 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:49.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:49.903 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:50.050 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T16:09:50.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:50.053 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T16:09:50.108 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T16:09:50.108 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:50.108 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:09:50.108 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:09:50.108 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:50.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:09:50.109 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:51.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:51.567 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T16:09:51.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:51.609 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-08T16:09:51.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:51.687 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:51.687 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:51.687 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:09:51.688 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-08T16:09:51.688 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:51.860 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-08T16:09:51.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:51.860 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:51.860 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:51.860 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-08T16:09:51.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-08T16:09:51.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-08T16:09:51.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-08T16:09:51.861 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-08T16:09:51.861 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:52.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:52.187 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:52.187 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:52.187 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.0 up 2023-10-08T16:09:52.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.0 master ceph-brx 2023-10-08T16:09:52.188 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:52.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:52.348 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:52.384 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-08T16:09:52.384 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:52.384 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:52.461 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-08T16:09:52.499 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:52.499 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:52.606 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:52.645 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:53.274 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:53.274 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:53.274 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:09:53.274 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 1@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:09:53.274 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:09:53.278 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:53.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:53.279 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-08T16:09:53.340 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-08T16:09:53.341 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:09:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.539+0000 7fe5b4fff700 1 Processor -- start 2023-10-08T16:09:53.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.539+0000 7fe5b4fff700 1 -- start start 2023-10-08T16:09:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.540+0000 7fe5b4fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.540+0000 7fe5b4fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 0x7fe5b00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.540+0000 7fe5b4fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00adb20 con 0x7fe5b0159850 2023-10-08T16:09:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.540+0000 7fe5b4fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b00ccdc0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.540+0000 7fe5b4fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00b12f0 con 0x7fe5b0159c20 2023-10-08T16:09:53.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5aed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 0x7fe5b00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:54014/0 (socket says 172.21.15.12:54014) 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 -- 172.21.15.12:0/637865415 learned_addr learned my addr 172.21.15.12:0/637865415 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5ae59c700 1 --1- 172.21.15.12:0/637865415 >> v1:172.21.15.29:6789/0 conn(0x7fe5b0159850 0x7fe5b00adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41902/0 (socket says 172.21.15.12:41902) 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 -- 172.21.15.12:0/637865415 >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 msgr2=0x7fe5b00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 --2- 172.21.15.12:0/637865415 >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 0x7fe5b00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 -- 172.21.15.12:0/637865415 >> v1:172.21.15.29:6789/0 conn(0x7fe5b0159850 legacy=0x7fe5b00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5add9b700 1 -- 172.21.15.12:0/637865415 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00acf10 con 0x7fe5b0159c20 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5ad59a700 1 -- 172.21.15.12:0/637865415 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794726291 0 0) 0x7fe5b00adb20 con 0x7fe5b0159850 2023-10-08T16:09:53.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.541+0000 7fe5aed9d700 1 --2- 172.21.15.12:0/637865415 >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 0x7fe5b00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:53.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5add9b700 1 --2- 172.21.15.12:0/637865415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400bc50 tx=0x7fe5a400b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35e70d66d1019b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5ad59a700 1 -- 172.21.15.12:0/637865415 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a400dbf0 con 0x7fe5b0159c20 2023-10-08T16:09:53.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5ad59a700 1 -- 172.21.15.12:0/637865415 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a400dd50 con 0x7fe5b0159c20 2023-10-08T16:09:53.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5ad59a700 1 -- 172.21.15.12:0/637865415 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40196b0 con 0x7fe5b0159c20 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5b4fff700 1 -- 172.21.15.12:0/637865415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 msgr2=0x7fe5b00b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.542+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/637865415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400bc50 tx=0x7fe5a400b4f0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 -- 172.21.15.12:0/637865415 shutdown_connections 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/637865415 >> v2:172.21.15.29:3300/0 conn(0x7fe5b00b0e70 0x7fe5b00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/637865415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159c20 0x7fe5b00b0930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 -- 172.21.15.12:0/637865415 >> 172.21.15.12:0/637865415 conn(0x7fe5b006d170 msgr2=0x7fe5b00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 -- 172.21.15.12:0/637865415 shutdown_connections 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.543+0000 7fe5b4fff700 1 -- 172.21.15.12:0/637865415 wait complete. 2023-10-08T16:09:53.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.544+0000 7fe5b4fff700 1 Processor -- start 2023-10-08T16:09:53.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.544+0000 7fe5b4fff700 1 -- start start 2023-10-08T16:09:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159850 0x7fe5b00c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b0159c20 0x7fe5b00a68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0153700 con 0x7fe5b00b0e70 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00a9e40 con 0x7fe5b0159c20 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5b4fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00ca2e0 con 0x7fe5b0159850 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45388/0 (socket says 172.21.15.12:45388) 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5ae59c700 1 -- 172.21.15.12:0/2424307886 learned_addr learned my addr 172.21.15.12:0/2424307886 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5aed9d700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b0159c20 0x7fe5b00a68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.545+0000 7fe5add9b700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159850 0x7fe5b00c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 -- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159850 msgr2=0x7fe5b00c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159850 0x7fe5b00c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 -- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b0159c20 msgr2=0x7fe5b00a68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b0159c20 0x7fe5b00a68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 -- 172.21.15.12:0/2424307886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8009a20 con 0x7fe5b00b0e70 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5ae59c700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00011e0 tx=0x7fe5a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a0005a70 con 0x7fe5b00b0e70 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a0005bd0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a00070d0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5a400b790 con 0x7fe5b00b0e70 2023-10-08T16:09:53.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.546+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b00ca7d0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.547+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b004c3c0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.549+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5a0007480 con 0x7fe5b00b0e70 2023-10-08T16:09:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.550+0000 7fe59e7fc700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.550+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5a0083960 con 0x7fe5b00b0e70 2023-10-08T16:09:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.550+0000 7fe5add9b700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:53.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.551+0000 7fe5add9b700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400b760 tx=0x7fe5a401b000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:53.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.554+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5a004b5a0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.800+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe5b00ad1f0 con 0x7fe5b00b0e70 2023-10-08T16:09:53.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.801+0000 7fe59e7fc700 1 -- 172.21.15.12:0/2424307886 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe5a0017070 con 0x7fe5b00b0e70 2023-10-08T16:09:53.802 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:09:53.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 msgr2=0x7fe5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe5a400b760 tx=0x7fe5a401b000 comp rx=0 tx=0).stop 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 msgr2=0x7fe5b01531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5a00011e0 tx=0x7fe5a0007e10 comp rx=0 tx=0).stop 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 shutdown_connections 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe5b00b0e70 0x7fe5b01531c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe5b0159c20 0x7fe5b00a68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 --2- 172.21.15.12:0/2424307886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe5b0159850 0x7fe5b00c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.803+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 >> 172.21.15.12:0/2424307886 conn(0x7fe5b006d170 msgr2=0x7fe5b006acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.804+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 shutdown_connections 2023-10-08T16:09:54.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:53.804+0000 7fe5b4fff700 1 -- 172.21.15.12:0/2424307886 wait complete. 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi029.front.sepia.ceph.com 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:09:54.113 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:09:54.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.114 DEBUG:teuthology.orchestra.run.smithi029:> ip addr 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:54.156 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a0 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f0 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:6b:fd:a1 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp7s0f1 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5a brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f0 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: inet 172.21.15.29/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:09:54.157 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft 42194sec preferred_lft 42194sec 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::ec4:7aff:febd:125a/64 scope link 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 0c:c4:7a:bd:12:5b brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: altname enp1s0f1 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 4e:d3:46:e5:29:0c brd ff:ff:ff:ff:ff:ff 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::1ce4:e0ff:fe21:b191/64 scope link 2023-10-08T16:09:54.158 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.159 INFO:teuthology.orchestra.run.smithi029.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:09:54.159 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 4e:d3:46:e5:29:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T16:09:54.159 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::4cd3:46ff:fee5:290c/64 scope link 2023-10-08T16:09:54.159 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.159 DEBUG:teuthology.orchestra.run.smithi029:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:09:54.260 INFO:teuthology.orchestra.run.smithi029.stdout:1 2023-10-08T16:09:54.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.263 DEBUG:teuthology.orchestra.run.smithi029:> route 2023-10-08T16:09:54.304 INFO:teuthology.orchestra.run.smithi029.stdout:Kernel IP routing table 2023-10-08T16:09:54.305 INFO:teuthology.orchestra.run.smithi029.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:09:54.305 INFO:teuthology.orchestra.run.smithi029.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:09:54.305 INFO:teuthology.orchestra.run.smithi029.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:09:54.305 INFO:teuthology.orchestra.run.smithi029.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:09:54.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.305 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:54.305 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:54.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:09:54.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:09:54.306 DEBUG:teuthology.orchestra.run.smithi029:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:09:54.306 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:54.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.505 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T16:09:54.542 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T16:09:54.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.543 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list-id 2023-10-08T16:09:54.619 INFO:teuthology.orchestra.run.smithi029.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-08T16:09:54.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.621 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:54.621 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:54.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T16:09:54.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-08T16:09:54.621 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:54.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:09:54.850 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:54.850 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:54.850 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:54.850 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5a:97:59:1c:d7:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5897:59ff:fe1c:d76d/64 scope link 2023-10-08T16:09:54.851 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.853 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 ::1/128 scope host 2023-10-08T16:09:54.915 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: link/ether 5a:97:59:1c:d7:6d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: inet6 fe80::5897:59ff:fe1c:d76d/64 scope link 2023-10-08T16:09:54.916 INFO:teuthology.orchestra.run.smithi029.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:09:54.918 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-08T16:09:54.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:54.918 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:54.918 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-08T16:09:54.919 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:55.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:55.174 DEBUG:teuthology.orchestra.run.smithi029:> (cd / && exec bash -c ' 2023-10-08T16:09:55.174 DEBUG:teuthology.orchestra.run.smithi029:> set -e 2023-10-08T16:09:55.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set brx.1 up 2023-10-08T16:09:55.174 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link set dev brx.1 master ceph-brx 2023-10-08T16:09:55.174 DEBUG:teuthology.orchestra.run.smithi029:> ') 2023-10-08T16:09:55.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:55.334 DEBUG:teuthology.orchestra.run.smithi029:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-08T16:09:55.372 INFO:teuthology.orchestra.run.smithi029.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-08T16:09:55.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:09:55.372 DEBUG:teuthology.orchestra.run.smithi029:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:09:55.448 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-08T16:09:55.448 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:09:55.448 DEBUG:teuthology.orchestra.run.smithi029:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:55.579 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:55.580 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:55.608 INFO:teuthology.orchestra.run.smithi029.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:09:55.608 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:09:55.608 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:09:55.608 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: trying mount with new device syntax: 3@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:09:55.609 INFO:teuthology.orchestra.run.smithi029.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:09:55.614 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:09:55.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:09:55.614 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-08T16:09:55.676 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-08T16:09:55.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.892+0000 7f9bf89fe700 1 Processor -- start 2023-10-08T16:09:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.892+0000 7f9bf89fe700 1 -- start start 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf89fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bf406f3a0 0x7f9bf414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf89fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf406a490 con 0x7f9bf406e0a0 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf89fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40c7230 con 0x7f9bf406f3a0 2023-10-08T16:09:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf406b930 con 0x7f9bf406e470 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:54028/0 (socket says 172.21.15.12:54028) 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf359e700 1 -- 172.21.15.12:0/3717828128 learned_addr learned my addr 172.21.15.12:0/3717828128 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf259c700 1 --2- 172.21.15.12:0/3717828128 >> v2:172.21.15.29:3300/0 conn(0x7f9bf406f3a0 0x7f9bf414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.894+0000 7f9bf2d9d700 1 --1- 172.21.15.12:0/3717828128 >> v1:172.21.15.29:6789/0 conn(0x7f9bf406e0a0 0x7f9bf40c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41908/0 (socket says 172.21.15.12:41908) 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf259c700 1 -- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 msgr2=0x7f9bf41501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf259c700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf259c700 1 -- 172.21.15.12:0/3717828128 >> v1:172.21.15.29:6789/0 conn(0x7f9bf406e0a0 legacy=0x7f9bf40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf259c700 1 -- 172.21.15.12:0/3717828128 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40c7490 con 0x7f9bf406f3a0 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf359e700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/3717828128 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359582771 0 0) 0x7f9bf406a490 con 0x7f9bf406e0a0 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf259c700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406f3a0 0x7f9bf414fc70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9be80098d0 tx=0x7f9be8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6183031a3aa9e7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/3717828128 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8005c10 con 0x7f9bf406f3a0 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/3717828128 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8005d70 con 0x7f9bf406f3a0 2023-10-08T16:09:55.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.895+0000 7f9bf1d9b700 1 -- 172.21.15.12:0/3717828128 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8006280 con 0x7f9bf406f3a0 2023-10-08T16:09:55.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 -- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406f3a0 msgr2=0x7f9bf414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406f3a0 0x7f9bf414fc70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9be80098d0 tx=0x7f9be8009120 comp rx=0 tx=0).stop 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 -- 172.21.15.12:0/3717828128 shutdown_connections 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf41501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/3717828128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406f3a0 0x7f9bf414fc70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 -- 172.21.15.12:0/3717828128 >> 172.21.15.12:0/3717828128 conn(0x7f9bf406d170 msgr2=0x7f9bf40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 -- 172.21.15.12:0/3717828128 shutdown_connections 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.896+0000 7f9bf89fe700 1 -- 172.21.15.12:0/3717828128 wait complete. 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.897+0000 7f9bf89fe700 1 Processor -- start 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.898+0000 7f9bf89fe700 1 -- start start 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 0x7f9bf40c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf40c2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40afe30 con 0x7f9bf406f3a0 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b0110 con 0x7f9bf406e0a0 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf4169b20 con 0x7f9bf406e470 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45392/0 (socket says 172.21.15.12:45392) 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 -- 172.21.15.12:0/1148065828 learned_addr learned my addr 172.21.15.12:0/1148065828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf259c700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf40c2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 0x7f9bf40c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 -- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 msgr2=0x7f9bf40c2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf40c2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 -- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 msgr2=0x7f9bf40c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 0x7f9bf40c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:55.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf359e700 1 -- 172.21.15.12:0/1148065828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec00bcf0 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf259c700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf40c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.899+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 0x7f9bf40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bf359e700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0072f0 tx=0x7f9bec00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec010040 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00ea10 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00edd0 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be80093c0 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.900+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf40c5ee0 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.901+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40b0280 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.902+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bec014610 con 0x7f9bf406f3a0 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.904+0000 7f9bdaffd700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:55.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.904+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9bec084940 con 0x7f9bf406f3a0 2023-10-08T16:09:55.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.904+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:55.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.905+0000 7f9bf2d9d700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4133490 tx=0x7f9be4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:55.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:55.908+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bec051b10 con 0x7f9bf406f3a0 2023-10-08T16:09:56.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.112+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9bf404c3c0 con 0x7f9bf406f3a0 2023-10-08T16:09:56.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.113+0000 7f9bdaffd700 1 -- 172.21.15.12:0/1148065828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f9bec055130 con 0x7f9bf406f3a0 2023-10-08T16:09:56.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:56.137 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 msgr2=0x7f9be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4133490 tx=0x7f9be4009040 comp rx=0 tx=0).stop 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 msgr2=0x7f9bf40c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0072f0 tx=0x7f9bec00d040 comp rx=0 tx=0).stop 2023-10-08T16:09:56.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 shutdown_connections 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bf406f3a0 0x7f9bf40c2aa0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bf406e0a0 0x7f9bf40c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 --2- 172.21.15.12:0/1148065828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bf406e470 0x7f9bf40c2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 >> 172.21.15.12:0/1148065828 conn(0x7f9bf406d170 msgr2=0x7f9bf4155530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 shutdown_connections 2023-10-08T16:09:56.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.115+0000 7f9bf89fe700 1 -- 172.21.15.12:0/1148065828 wait complete. 2023-10-08T16:09:56.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:56.186 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.376+0000 7fcc2919d700 1 Processor -- start 2023-10-08T16:09:56.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.376+0000 7fcc2919d700 1 -- start start 2023-10-08T16:09:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc2919d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc24153a00 0x7fcc24153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc2919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc240cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc2919d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2415ac50 con 0x7fcc2415de50 2023-10-08T16:09:56.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc2919d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2415d010 con 0x7fcc24153a00 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc2919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240cf3c0 con 0x7fcc240cea00 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.377+0000 7fcc23fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc24153a00 0x7fcc24153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcc24153a00 0x7fcc24153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45402/0 (socket says 172.21.15.12:45402) 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 -- 172.21.15.12:0/3719989068 learned_addr learned my addr 172.21.15.12:0/3719989068 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc2899c700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc240cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 -- 172.21.15.12:0/3719989068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 msgr2=0x7fcc240cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc240cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 -- 172.21.15.12:0/3719989068 >> v1:172.21.15.29:6789/0 conn(0x7fcc2415de50 legacy=0x7fcc2415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 -- 172.21.15.12:0/3719989068 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2415af60 con 0x7fcc24153a00 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc2899c700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc240cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:56.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc23fff700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc24153a00 0x7fcc24153dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc140099b0 tx=0x7fcc14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5261aebdcca91806 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.378+0000 7fcc22ffd700 1 -- 172.21.15.12:0/3719989068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400b860 con 0x7fcc24153a00 2023-10-08T16:09:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc22ffd700 1 -- 172.21.15.12:0/3719989068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400b9c0 con 0x7fcc24153a00 2023-10-08T16:09:56.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc22ffd700 1 -- 172.21.15.12:0/3719989068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400bd60 con 0x7fcc24153a00 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 -- 172.21.15.12:0/3719989068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc24153a00 msgr2=0x7fcc24153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc24153a00 0x7fcc24153dd0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcc140099b0 tx=0x7fcc14009250 comp rx=0 tx=0).stop 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 -- 172.21.15.12:0/3719989068 shutdown_connections 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc240cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3719989068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc24153a00 0x7fcc24153dd0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 -- 172.21.15.12:0/3719989068 >> 172.21.15.12:0/3719989068 conn(0x7fcc240703a0 msgr2=0x7fcc240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 -- 172.21.15.12:0/3719989068 shutdown_connections 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.379+0000 7fcc2919d700 1 -- 172.21.15.12:0/3719989068 wait complete. 2023-10-08T16:09:56.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.381+0000 7fcc2919d700 1 Processor -- start 2023-10-08T16:09:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.381+0000 7fcc2919d700 1 -- start start 2023-10-08T16:09:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc24158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc24153a00 0x7fcc24169b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240cb110 con 0x7fcc2415de50 2023-10-08T16:09:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240cb3f0 con 0x7fcc24153a00 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2416a0a0 con 0x7fcc240cea00 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45406/0 (socket says 172.21.15.12:45406) 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 -- 172.21.15.12:0/3947000791 learned_addr learned my addr 172.21.15.12:0/3947000791 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc23fff700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc24158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc237fe700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc24153a00 0x7fcc24169b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 -- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 msgr2=0x7fcc24158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc24158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 -- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc24153a00 msgr2=0x7fcc24169b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.382+0000 7fcc2899c700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc24153a00 0x7fcc24169b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc2899c700 1 -- 172.21.15.12:0/3947000791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc140094f0 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc2899c700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d180 tx=0x7fcc1c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c00dcc0 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1c00f040 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c015440 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2416a320 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.383+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2416a960 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.384+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc240cb5a0 con 0x7fcc2415de50 2023-10-08T16:09:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.385+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc1c01e3b0 con 0x7fcc2415de50 2023-10-08T16:09:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.386+0000 7fcc0bfff700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 0x7fcc100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.386+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc1c084a70 con 0x7fcc2415de50 2023-10-08T16:09:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.386+0000 7fcc23fff700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 0x7fcc100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.387+0000 7fcc23fff700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 0x7fcc100693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc140099b0 tx=0x7fcc14017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.390+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc240cb5a0 con 0x7fcc2415de50 2023-10-08T16:09:56.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.591+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc240cb560 con 0x7fcc2415de50 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.591+0000 7fcc0bfff700 1 -- 172.21.15.12:0/3947000791 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc1c01a0a0 con 0x7fcc2415de50 2023-10-08T16:09:56.592 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:56.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 msgr2=0x7fcc100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 0x7fcc100693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcc140099b0 tx=0x7fcc14017000 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 msgr2=0x7fcc2414ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c00d180 tx=0x7fcc1c009a50 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 shutdown_connections 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcc10066f30 0x7fcc100693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc2415de50 0x7fcc2414ff20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc240cea00 0x7fcc24158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 --2- 172.21.15.12:0/3947000791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc24153a00 0x7fcc24169b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.593+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 >> 172.21.15.12:0/3947000791 conn(0x7fcc240703a0 msgr2=0x7fcc24152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.594+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 shutdown_connections 2023-10-08T16:09:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.594+0000 7fcc2919d700 1 -- 172.21.15.12:0/3947000791 wait complete. 2023-10-08T16:09:56.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:56.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.802+0000 7efbfdd9d700 1 Processor -- start 2023-10-08T16:09:56.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.802+0000 7efbfdd9d700 1 -- start start 2023-10-08T16:09:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfdd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efbf80accb0 0x7efbf80aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfdd9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efbf80cc340 0x7efbf806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfdd9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efbf80ad780 con 0x7efbf80cbea0 2023-10-08T16:09:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfdd9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80cee60 con 0x7efbf80cc340 2023-10-08T16:09:56.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfdd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efbf80cf140 con 0x7efbf80accb0 2023-10-08T16:09:56.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfd59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efbf80cc340 0x7efbf806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfd59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efbf80cc340 0x7efbf806ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45416/0 (socket says 172.21.15.12:45416) 2023-10-08T16:09:56.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfd59c700 1 -- 172.21.15.12:0/775066310 learned_addr learned my addr 172.21.15.12:0/775066310 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:56.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.803+0000 7efbfcd9b700 1 --2- 172.21.15.12:0/775066310 >> v2:172.21.15.29:3300/0 conn(0x7efbf80accb0 0x7efbf80aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbfd59c700 1 -- 172.21.15.12:0/775066310 >> v2:172.21.15.29:3300/0 conn(0x7efbf80accb0 msgr2=0x7efbf80aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:56.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbfd59c700 1 --2- 172.21.15.12:0/775066310 >> v2:172.21.15.29:3300/0 conn(0x7efbf80accb0 0x7efbf80aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbfd59c700 1 -- 172.21.15.12:0/775066310 >> v1:172.21.15.12:6789/0 conn(0x7efbf80cbea0 legacy=0x7efbf806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbfd59c700 1 -- 172.21.15.12:0/775066310 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf806d850 con 0x7efbf80cc340 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbf77fe700 1 -- 172.21.15.12:0/775066310 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601016652 0 0) 0x7efbf80ad780 con 0x7efbf80cbea0 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbfd59c700 1 --2- 172.21.15.12:0/775066310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf806ea40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efbf806a9c0 tx=0x7efbf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb2d197c3178f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbf77fe700 1 -- 172.21.15.12:0/775066310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf000e070 con 0x7efbf80cc340 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbf77fe700 1 -- 172.21.15.12:0/775066310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf000ba20 con 0x7efbf80cc340 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.804+0000 7efbf77fe700 1 -- 172.21.15.12:0/775066310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00092e0 con 0x7efbf80cc340 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 -- 172.21.15.12:0/775066310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 msgr2=0x7efbf806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/775066310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf806ea40 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efbf806a9c0 tx=0x7efbf0009840 comp rx=0 tx=0).stop 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 -- 172.21.15.12:0/775066310 shutdown_connections 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/775066310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf806ea40 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/775066310 >> v2:172.21.15.29:3300/0 conn(0x7efbf80accb0 0x7efbf80aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 -- 172.21.15.12:0/775066310 >> 172.21.15.12:0/775066310 conn(0x7efbf806ce80 msgr2=0x7efbf80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:56.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 -- 172.21.15.12:0/775066310 shutdown_connections 2023-10-08T16:09:56.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.805+0000 7efbfdd9d700 1 -- 172.21.15.12:0/775066310 wait complete. 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.806+0000 7efbfdd9d700 1 Processor -- start 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.807+0000 7efbfdd9d700 1 -- start start 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.807+0000 7efbfdd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efbf80accb0 0x7efbf816a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfdd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 0x7efbf816c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfdd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfdd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf8169870 con 0x7efbf80cc340 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfdd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efbf816d970 con 0x7efbf80accb0 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfdd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efbf816c860 con 0x7efbf80cbea0 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45430/0 (socket says 172.21.15.12:45430) 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 -- 172.21.15.12:0/2816620224 learned_addr learned my addr 172.21.15.12:0/2816620224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfcd9b700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efbf80accb0 0x7efbf816a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbf7fff700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 0x7efbf816c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 -- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 msgr2=0x7efbf816c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 0x7efbf816c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 -- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efbf80accb0 msgr2=0x7efbf816a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efbf80accb0 0x7efbf816a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbfd59c700 1 -- 172.21.15.12:0/2816620224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf0009ae0 con 0x7efbf80cc340 2023-10-08T16:09:56.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.808+0000 7efbf7fff700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 0x7efbf816c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbfd59c700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009880 tx=0x7efbf0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf0008c20 con 0x7efbf80cc340 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf0008d80 con 0x7efbf80cc340 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf816d690 con 0x7efbf80cc340 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00256b0 con 0x7efbf80cc340 2023-10-08T16:09:56.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.809+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efbf815a5a0 con 0x7efbf80cc340 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.810+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efbf804c3c0 con 0x7efbf80cc340 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.811+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efbf0003040 con 0x7efbf80cc340 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.812+0000 7efbf4ff9700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 0x7efbdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.812+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efbf0086200 con 0x7efbf80cc340 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.812+0000 7efbfcd9b700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 0x7efbdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:56.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.813+0000 7efbfcd9b700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 0x7efbdc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efbec009ca0 tx=0x7efbec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:56.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:56.816+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efbf0053520 con 0x7efbf80cc340 2023-10-08T16:09:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.018+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efbf806d4b0 con 0x7efbf80cc340 2023-10-08T16:09:57.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.018+0000 7efbf4ff9700 1 -- 172.21.15.12:0/2816620224 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7efbf0056b40 con 0x7efbf80cc340 2023-10-08T16:09:57.019 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.020+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 msgr2=0x7efbdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.020+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 0x7efbdc0693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efbec009ca0 tx=0x7efbec008040 comp rx=0 tx=0).stop 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.020+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 msgr2=0x7efbf816cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.020+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efbf0009880 tx=0x7efbf0018000 comp rx=0 tx=0).stop 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 shutdown_connections 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efbdc066f30 0x7efbdc0693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efbf80cc340 0x7efbf816cab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efbf80accb0 0x7efbf816a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 --2- 172.21.15.12:0/2816620224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efbf80cbea0 0x7efbf816c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 >> 172.21.15.12:0/2816620224 conn(0x7efbf806ce80 msgr2=0x7efbf80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 shutdown_connections 2023-10-08T16:09:57.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.021+0000 7efbfdd9d700 1 -- 172.21.15.12:0/2816620224 wait complete. 2023-10-08T16:09:57.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.228+0000 7fcb0b59d700 1 Processor -- start 2023-10-08T16:09:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.228+0000 7fcb0b59d700 1 -- start start 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcb04153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0b59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcb0415de50 0x7fcb0415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0b59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0415af60 con 0x7fcb040cea00 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0b59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0415d010 con 0x7fcb0415de50 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0415b240 con 0x7fcb04153a00 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0ad9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcb040cea00 0x7fcb040cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39812/0 (socket says 172.21.15.12:39812) 2023-10-08T16:09:57.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.229+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/2207978449 learned_addr learned my addr 172.21.15.12:0/2207978449 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcb04153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/2207978449 >> v2:172.21.15.29:3300/0 conn(0x7fcb0415de50 0x7fcb0415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394307093 0 0) 0x7fcb0415af60 con 0x7fcb040cea00 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf0003570 con 0x7fcb040cea00 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 241864632 0 0) 0x7fcaf0003570 con 0x7fcb040cea00 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 msgr2=0x7fcb04153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:57.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcb04153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 >> v2:172.21.15.29:3300/0 conn(0x7fcb0415de50 msgr2=0x7fcb0415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 --2- 172.21.15.12:0/2207978449 >> v2:172.21.15.29:3300/0 conn(0x7fcb0415de50 0x7fcb0415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0415b520 con 0x7fcb040cea00 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fcafc0017f0 con 0x7fcb040cea00 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 >> v1:172.21.15.12:6789/0 conn(0x7fcb040cea00 legacy=0x7fcb040cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcaf0003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00040b0 0x7fcaf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf0004d50 0x7fcaf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0415d010 con 0x7fcaf00040b0 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0415b240 con 0x7fcaf0004d50 2023-10-08T16:09:57.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.230+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf000bb60 con 0x7fcb04153a00 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00040b0 0x7fcaf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcaf0003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb0ad9c700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf0004d50 0x7fcaf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 -- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 msgr2=0x7fcaf0003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcb04153a00 0x7fcaf0003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 -- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf0004d50 msgr2=0x7fcaf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf0004d50 0x7fcaf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 -- 172.21.15.12:0/2207978449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0003570 con 0x7fcaf00040b0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.231+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00040b0 0x7fcaf0004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006f00 tx=0x7fcaf40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f1d9ca3c5cefb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400e710 con 0x7fcaf00040b0 2023-10-08T16:09:57.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf400e870 con 0x7fcaf00040b0 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb09599700 1 -- 172.21.15.12:0/2207978449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf400ec30 con 0x7fcaf00040b0 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 -- 172.21.15.12:0/2207978449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00040b0 msgr2=0x7fcaf0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/2207978449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00040b0 0x7fcaf0004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006f00 tx=0x7fcaf40091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/2207978449 reap_dead start 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 -- 172.21.15.12:0/2207978449 shutdown_connections 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 -- 172.21.15.12:0/2207978449 >> 172.21.15.12:0/2207978449 conn(0x7fcb040703a0 msgr2=0x7fcb040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 -- 172.21.15.12:0/2207978449 shutdown_connections 2023-10-08T16:09:57.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.232+0000 7fcb0b59d700 1 -- 172.21.15.12:0/2207978449 wait complete. 2023-10-08T16:09:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.234+0000 7fcb0b59d700 1 Processor -- start 2023-10-08T16:09:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.234+0000 7fcb0b59d700 1 -- start start 2023-10-08T16:09:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 0x7fcb040b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 0x7fcb040b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0416d500 con 0x7fcb0416d990 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0416d1b0 con 0x7fcb040c8dd0 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb040b0b50 con 0x7fcaf00040b0 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45452/0 (socket says 172.21.15.12:45452) 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/1670442128 learned_addr learned my addr 172.21.15.12:0/1670442128 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 0x7fcb040b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 0x7fcb040b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 msgr2=0x7fcb040b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 0x7fcb040b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 msgr2=0x7fcb040b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 0x7fcb040b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0ad9c700 1 -- 172.21.15.12:0/1670442128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb040b0e30 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 0x7fcb040b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.235+0000 7fcb09d9a700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 0x7fcb040b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcb0ad9c700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb0415e220 tx=0x7fcafc002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00acb0 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00ae50 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc013640 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb040b1110 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.236+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb040b24b0 con 0x7fcb0416d990 2023-10-08T16:09:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.237+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0416d6b0 con 0x7fcb0416d990 2023-10-08T16:09:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.238+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcafc0139b0 con 0x7fcb0416d990 2023-10-08T16:09:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.239+0000 7fcafa7fc700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 0x7fcae8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.239+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcafc084eb0 con 0x7fcb0416d990 2023-10-08T16:09:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.239+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 0x7fcae8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.239+0000 7fcb0a59b700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 0x7fcae8069410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb00006dc0 tx=0x7fcb00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.243+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb0416d6b0 con 0x7fcb0416d990 2023-10-08T16:09:57.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.443+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb0404c3c0 con 0x7fcb0416d990 2023-10-08T16:09:57.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.444+0000 7fcafa7fc700 1 -- 172.21.15.12:0/1670442128 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcafc052080 con 0x7fcb0416d990 2023-10-08T16:09:57.462 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 msgr2=0x7fcae8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 0x7fcae8069410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcb00006dc0 tx=0x7fcb00008040 comp rx=0 tx=0).stop 2023-10-08T16:09:57.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 msgr2=0x7fcb040cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcb0415e220 tx=0x7fcafc002140 comp rx=0 tx=0).stop 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 shutdown_connections 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fcae8066f60 0x7fcae8069410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcb0416d990 0x7fcb040cc0e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf00040b0 0x7fcb040b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 --2- 172.21.15.12:0/1670442128 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcb040c8dd0 0x7fcb040b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.446+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 >> 172.21.15.12:0/1670442128 conn(0x7fcb040703a0 msgr2=0x7fcb04159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.447+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 shutdown_connections 2023-10-08T16:09:57.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.447+0000 7fcb0b59d700 1 -- 172.21.15.12:0/1670442128 wait complete. 2023-10-08T16:09:57.465 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:57.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.651+0000 7ff554b9d700 1 Processor -- start 2023-10-08T16:09:57.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.652+0000 7ff554b9d700 1 -- start start 2023-10-08T16:09:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff554b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff55013fef0 0x7ff55015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff554b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55015ae70 con 0x7ff55006aaa0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff554b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff55006af60 con 0x7ff55013fb20 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff554b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff55006b240 con 0x7ff55013fef0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff54ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff55006aaa0 0x7ff5500c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39822/0 (socket says 172.21.15.12:39822) 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff54ffff700 1 -- 172.21.15.12:0/3935723516 learned_addr learned my addr 172.21.15.12:0/3935723516 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.653+0000 7ff54effd700 1 --2- 172.21.15.12:0/3935723516 >> v2:172.21.15.29:3300/0 conn(0x7ff55013fef0 0x7ff55015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516756303 0 0) 0x7ff548001490 con 0x7ff55006aaa0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff538003570 con 0x7ff55006aaa0 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501615803 0 0) 0x7ff55006af60 con 0x7ff55013fb20 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54effd700 1 -- 172.21.15.12:0/3935723516 >> v1:172.21.15.29:6789/0 conn(0x7ff55013fb20 legacy=0x7ff5500c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54effd700 1 -- 172.21.15.12:0/3935723516 >> v1:172.21.15.12:6789/0 conn(0x7ff55006aaa0 legacy=0x7ff5500c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54effd700 1 -- 172.21.15.12:0/3935723516 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55006b520 con 0x7ff55013fef0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54effd700 1 --2- 172.21.15.12:0/3935723516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55013fef0 0x7ff55015a930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5440098d0 tx=0x7ff544009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=535ae7a21cd036ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544005c10 con 0x7ff55013fef0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff544005d70 con 0x7ff55013fef0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.654+0000 7ff54e7fc700 1 -- 172.21.15.12:0/3935723516 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff544006280 con 0x7ff55013fef0 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 -- 172.21.15.12:0/3935723516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55013fef0 msgr2=0x7ff55015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 --2- 172.21.15.12:0/3935723516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55013fef0 0x7ff55015a930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff5440098d0 tx=0x7ff544009120 comp rx=0 tx=0).stop 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 -- 172.21.15.12:0/3935723516 shutdown_connections 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 --2- 172.21.15.12:0/3935723516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55013fef0 0x7ff55015a930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 -- 172.21.15.12:0/3935723516 >> 172.21.15.12:0/3935723516 conn(0x7ff55006d170 msgr2=0x7ff5500cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 -- 172.21.15.12:0/3935723516 shutdown_connections 2023-10-08T16:09:57.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.655+0000 7ff554b9d700 1 -- 172.21.15.12:0/3935723516 wait complete. 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.656+0000 7ff554b9d700 1 Processor -- start 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.657+0000 7ff554b9d700 1 -- start start 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55006aaa0 0x7ff550135af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff55013fb20 0x7ff5500c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff550136030 con 0x7ff55013fef0 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5501569f0 con 0x7ff55006aaa0 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff554b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff550156cd0 con 0x7ff55013fb20 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45460/0 (socket says 172.21.15.12:45460) 2023-10-08T16:09:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 -- 172.21.15.12:0/2289411849 learned_addr learned my addr 172.21.15.12:0/2289411849 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54effd700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff55013fb20 0x7ff5500c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54f7fe700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55006aaa0 0x7ff550135af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 -- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff55013fb20 msgr2=0x7ff5500c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff55013fb20 0x7ff5500c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 -- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55006aaa0 msgr2=0x7ff550135af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55006aaa0 0x7ff550135af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 -- 172.21.15.12:0/2289411849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5440093c0 con 0x7ff55013fef0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.658+0000 7ff54ffff700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5480015f0 tx=0x7ff548001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.659+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800a930 con 0x7ff55013fef0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.659+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54800aa90 con 0x7ff55013fef0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.659+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54800ae10 con 0x7ff55013fef0 2023-10-08T16:09:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.659+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff550156fb0 con 0x7ff55013fef0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.659+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff550157570 con 0x7ff55013fef0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.660+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff55004c3c0 con 0x7ff55013fef0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.661+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff548007300 con 0x7ff55013fef0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.662+0000 7ff5377fe700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 0x7ff53c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.662+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff548084830 con 0x7ff55013fef0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.662+0000 7ff54f7fe700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 0x7ff53c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.663+0000 7ff54f7fe700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 0x7ff53c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff540003860 tx=0x7ff540009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:57.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.666+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff548055510 con 0x7ff55013fef0 2023-10-08T16:09:57.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.870+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff55015ae70 con 0x7ff55013fef0 2023-10-08T16:09:57.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.870+0000 7ff5377fe700 1 -- 172.21.15.12:0/2289411849 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7ff55015ae70 con 0x7ff55013fef0 2023-10-08T16:09:57.871 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:57.872 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 msgr2=0x7ff53c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 0x7ff53c0693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff540003860 tx=0x7ff540009040 comp rx=0 tx=0).stop 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 msgr2=0x7ff5500c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff5480015f0 tx=0x7ff548001a10 comp rx=0 tx=0).stop 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 shutdown_connections 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff53c066f30 0x7ff53c0693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff55013fef0 0x7ff5500c7b30 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff55006aaa0 0x7ff550135af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 --2- 172.21.15.12:0/2289411849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff55013fb20 0x7ff5500c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 >> 172.21.15.12:0/2289411849 conn(0x7ff55006d170 msgr2=0x7ff5500cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 shutdown_connections 2023-10-08T16:09:57.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:57.873+0000 7ff554b9d700 1 -- 172.21.15.12:0/2289411849 wait complete. 2023-10-08T16:09:57.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:57.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.081+0000 7f3837fff700 1 Processor -- start 2023-10-08T16:09:58.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.082+0000 7f3837fff700 1 -- start start 2023-10-08T16:09:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3837fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3838153a00 0x7f3838153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3837fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f383815de50 0x7f383815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3837fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383815af60 con 0x7f38380cea00 2023-10-08T16:09:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3837fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383815d010 con 0x7f3838153a00 2023-10-08T16:09:58.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3837fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383815b240 con 0x7f383815de50 2023-10-08T16:09:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f38367fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f383815de50 0x7f383815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f3836ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3838153a00 0x7f3838153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f38377fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f38380cea00 0x7f38380cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41946/0 (socket says 172.21.15.12:41946) 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.083+0000 7f38377fe700 1 -- 172.21.15.12:0/303468837 learned_addr learned my addr 172.21.15.12:0/303468837 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3835ffb700 1 -- 172.21.15.12:0/303468837 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3739885711 0 0) 0x7f383815af60 con 0x7f38380cea00 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3835ffb700 1 -- 172.21.15.12:0/303468837 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3820003570 con 0x7f38380cea00 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3836ffd700 1 -- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f383815de50 msgr2=0x7f383815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3836ffd700 1 --2- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f383815de50 0x7f383815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3836ffd700 1 -- 172.21.15.12:0/303468837 >> v1:172.21.15.29:6789/0 conn(0x7f38380cea00 legacy=0x7f38380cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3836ffd700 1 -- 172.21.15.12:0/303468837 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383815b520 con 0x7f3838153a00 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.084+0000 7f3836ffd700 1 --2- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3838153a00 0x7f3838153dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38280098e0 tx=0x7f38280091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c92b8c6e6f768248 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3835ffb700 1 -- 172.21.15.12:0/303468837 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828011630 con 0x7f3838153a00 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3835ffb700 1 -- 172.21.15.12:0/303468837 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3828011790 con 0x7f3838153a00 2023-10-08T16:09:58.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3835ffb700 1 -- 172.21.15.12:0/303468837 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828011b30 con 0x7f3838153a00 2023-10-08T16:09:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 -- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3838153a00 msgr2=0x7f3838153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 --2- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3838153a00 0x7f3838153dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f38280098e0 tx=0x7f38280091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 -- 172.21.15.12:0/303468837 shutdown_connections 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 --2- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3838153a00 0x7f3838153dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 --2- 172.21.15.12:0/303468837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f383815de50 0x7f383815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 -- 172.21.15.12:0/303468837 >> 172.21.15.12:0/303468837 conn(0x7f38380703a0 msgr2=0x7f38380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 -- 172.21.15.12:0/303468837 shutdown_connections 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.085+0000 7f3837fff700 1 -- 172.21.15.12:0/303468837 wait complete. 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.087+0000 7f3837fff700 1 Processor -- start 2023-10-08T16:09:58.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.087+0000 7f3837fff700 1 -- start start 2023-10-08T16:09:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38380cea00 0x7f383814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 0x7f38380b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3838150590 con 0x7f383815de50 2023-10-08T16:09:58.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383814f980 con 0x7f38380cea00 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3837fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383814fc60 con 0x7f3838153a00 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f38377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f38377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45474/0 (socket says 172.21.15.12:45474) 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f38377fe700 1 -- 172.21.15.12:0/1721173354 learned_addr learned my addr 172.21.15.12:0/1721173354 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f38367fc700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 0x7f38380b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.088+0000 7f3836ffd700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38380cea00 0x7f383814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 -- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38380cea00 msgr2=0x7f383814d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38380cea00 0x7f383814d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 -- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 msgr2=0x7f38380b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 -- 172.21.15.12:0/1721173354 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3828009420 con 0x7f3838153a00 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38377fe700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f38367fc700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 0x7f38380b0520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f382c00e900 tx=0x7f382c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c013680 con 0x7f3838153a00 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0137e0 con 0x7f3838153a00 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383814ff40 con 0x7f3838153a00 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c013ba0 con 0x7f3838153a00 2023-10-08T16:09:58.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.089+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383814d990 con 0x7f3838153a00 2023-10-08T16:09:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.090+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383804c3c0 con 0x7f3838153a00 2023-10-08T16:09:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.091+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f382c0123d0 con 0x7f3838153a00 2023-10-08T16:09:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.092+0000 7f381effd700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 0x7f38240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.092+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f382c084630 con 0x7f3838153a00 2023-10-08T16:09:58.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.093+0000 7f3836ffd700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 0x7f38240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.093+0000 7f3836ffd700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 0x7f38240693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38280091e0 tx=0x7f3828017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.097+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f382c051800 con 0x7f3838153a00 2023-10-08T16:09:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.297+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f383815b800 con 0x7f3838153a00 2023-10-08T16:09:58.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.298+0000 7f381effd700 1 -- 172.21.15.12:0/1721173354 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f382c054e20 con 0x7f3838153a00 2023-10-08T16:09:58.299 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 msgr2=0x7f38240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 0x7f38240693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f38280091e0 tx=0x7f3828017000 comp rx=0 tx=0).stop 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 msgr2=0x7f38380b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 0x7f38380b0520 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f382c00e900 tx=0x7f382c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 shutdown_connections 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3824066f30 0x7f38240693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f383815de50 0x7f38380b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38380cea00 0x7f383814d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 --2- 172.21.15.12:0/1721173354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3838153a00 0x7f38380b0520 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 >> 172.21.15.12:0/1721173354 conn(0x7f38380703a0 msgr2=0x7f383814e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 shutdown_connections 2023-10-08T16:09:58.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.300+0000 7f3837fff700 1 -- 172.21.15.12:0/1721173354 wait complete. 2023-10-08T16:09:58.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:09:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.507+0000 7fc8e959d700 1 Processor -- start 2023-10-08T16:09:58.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.508+0000 7fc8e959d700 1 -- start start 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8e4153dd0 0x7fc8e415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e415ac50 con 0x7fc8e4153a00 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e415d010 con 0x7fc8e4153dd0 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40cf3e0 con 0x7fc8e40cea00 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc8e4153a00 0x7fc8e415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39826/0 (socket says 172.21.15.12:39826) 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc8e4153dd0 0x7fc8e415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e3fff700 1 -- 172.21.15.12:0/987370350 learned_addr learned my addr 172.21.15.12:0/987370350 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:58.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.509+0000 7fc8e8d9c700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e37fe700 1 -- 172.21.15.12:0/987370350 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 msgr2=0x7fc8e40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e37fe700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e37fe700 1 -- 172.21.15.12:0/987370350 >> v1:172.21.15.12:6789/0 conn(0x7fc8e4153a00 legacy=0x7fc8e415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e37fe700 1 -- 172.21.15.12:0/987370350 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e415af60 con 0x7fc8e4153dd0 2023-10-08T16:09:58.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e8d9c700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e37fe700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e415de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098e0 tx=0x7fc8d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b020eaeac1bceac9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e2ffd700 1 -- 172.21.15.12:0/987370350 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8009e80 con 0x7fc8e4153dd0 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e2ffd700 1 -- 172.21.15.12:0/987370350 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800b860 con 0x7fc8e4153dd0 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.510+0000 7fc8e2ffd700 1 -- 172.21.15.12:0/987370350 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d800bbe0 con 0x7fc8e4153dd0 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 -- 172.21.15.12:0/987370350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 msgr2=0x7fc8e415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e415de50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80098e0 tx=0x7fc8d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 -- 172.21.15.12:0/987370350 shutdown_connections 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 --2- 172.21.15.12:0/987370350 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e415de50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 -- 172.21.15.12:0/987370350 >> 172.21.15.12:0/987370350 conn(0x7fc8e40703a0 msgr2=0x7fc8e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 -- 172.21.15.12:0/987370350 shutdown_connections 2023-10-08T16:09:58.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.511+0000 7fc8e959d700 1 -- 172.21.15.12:0/987370350 wait complete. 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.512+0000 7fc8e959d700 1 Processor -- start 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.512+0000 7fc8e959d700 1 -- start start 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8e4153a00 0x7fc8e4143120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4158bb0 con 0x7fc8e4153dd0 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4158e90 con 0x7fc8e4153a00 2023-10-08T16:09:58.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4159170 con 0x7fc8e40cea00 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e8d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e8d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45494/0 (socket says 172.21.15.12:45494) 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.513+0000 7fc8e8d9c700 1 -- 172.21.15.12:0/2466031646 learned_addr learned my addr 172.21.15.12:0/2466031646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e3fff700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e37fe700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8e4153a00 0x7fc8e4143120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 -- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 msgr2=0x7fc8e40b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 -- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8e4153a00 msgr2=0x7fc8e4143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8e4153a00 0x7fc8e4143120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 -- 172.21.15.12:0/2466031646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8009420 con 0x7fc8e4153dd0 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e8d9c700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00d180 tx=0x7fc8dc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00dc60 con 0x7fc8e4153dd0 2023-10-08T16:09:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc00f040 con 0x7fc8e4153dd0 2023-10-08T16:09:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc015440 con 0x7fc8e4153dd0 2023-10-08T16:09:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.514+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e4159450 con 0x7fc8e4153dd0 2023-10-08T16:09:58.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.515+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e4152f80 con 0x7fc8e4153dd0 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.516+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e404c3c0 con 0x7fc8e4153dd0 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.517+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8dc01e3b0 con 0x7fc8e4153dd0 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.517+0000 7fc8cbfff700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 0x7fc8d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.517+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8dc084a00 con 0x7fc8e4153dd0 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.518+0000 7fc8e3fff700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 0x7fc8d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.518+0000 7fc8e3fff700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 0x7fc8d00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40cf1d0 tx=0x7fc8d4007eb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.522+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8dc051bd0 con 0x7fc8e4153dd0 2023-10-08T16:09:58.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.725+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc8e415b240 con 0x7fc8e4153dd0 2023-10-08T16:09:58.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.726+0000 7fc8cbfff700 1 -- 172.21.15.12:0/2466031646 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc8dc01a020 con 0x7fc8e4153dd0 2023-10-08T16:09:58.727 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:09:58.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 msgr2=0x7fc8d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 0x7fc8d00693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc8e40cf1d0 tx=0x7fc8d4007eb0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 msgr2=0x7fc8e4158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc00d180 tx=0x7fc8dc009a50 comp rx=0 tx=0).stop 2023-10-08T16:09:58.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 shutdown_connections 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc8d0066f30 0x7fc8d00693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8e4153dd0 0x7fc8e4158520 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8e40cea00 0x7fc8e40b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 --2- 172.21.15.12:0/2466031646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8e4153a00 0x7fc8e4143120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 >> 172.21.15.12:0/2466031646 conn(0x7fc8e40703a0 msgr2=0x7fc8e40b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 shutdown_connections 2023-10-08T16:09:58.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.728+0000 7fc8e959d700 1 -- 172.21.15.12:0/2466031646 wait complete. 2023-10-08T16:09:58.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:09:58.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.936+0000 7faf1159d700 1 Processor -- start 2023-10-08T16:09:58.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.936+0000 7faf1159d700 1 -- start start 2023-10-08T16:09:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf1159d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faf0c159550 0x7faf0c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf1159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf1159d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf0c0acc00 con 0x7faf0c15dfd0 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf1159d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf0c0abff0 con 0x7faf0c159550 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf1159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c0ac2d0 con 0x7faf0c159920 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf0b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faf0c15dfd0 0x7faf0c0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39828/0 (socket says 172.21.15.12:39828) 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf0b7fe700 1 -- 172.21.15.12:0/4123129242 learned_addr learned my addr 172.21.15.12:0/4123129242 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf0bfff700 1 --2- 172.21.15.12:0/4123129242 >> v2:172.21.15.29:3300/0 conn(0x7faf0c159550 0x7faf0c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.937+0000 7faf10d9c700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0affd700 1 -- 172.21.15.12:0/4123129242 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143448592 0 0) 0x7faf0c0acc00 con 0x7faf0c15dfd0 2023-10-08T16:09:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0affd700 1 -- 172.21.15.12:0/4123129242 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef4003570 con 0x7faf0c15dfd0 2023-10-08T16:09:58.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0bfff700 1 -- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 msgr2=0x7faf0c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0bfff700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0bfff700 1 -- 172.21.15.12:0/4123129242 >> v1:172.21.15.12:6789/0 conn(0x7faf0c15dfd0 legacy=0x7faf0c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0bfff700 1 -- 172.21.15.12:0/4123129242 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c0ac5b0 con 0x7faf0c159550 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf10d9c700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.938+0000 7faf0bfff700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c0ceac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc0098e0 tx=0x7faefc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d48dbe0379382207 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf0affd700 1 -- 172.21.15.12:0/4123129242 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011630 con 0x7faf0c159550 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf0affd700 1 -- 172.21.15.12:0/4123129242 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc011790 con 0x7faf0c159550 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf0affd700 1 -- 172.21.15.12:0/4123129242 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc011b30 con 0x7faf0c159550 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 -- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 msgr2=0x7faf0c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c0ceac0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faefc0098e0 tx=0x7faefc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 -- 172.21.15.12:0/4123129242 shutdown_connections 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 --2- 172.21.15.12:0/4123129242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c0ceac0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 -- 172.21.15.12:0/4123129242 >> 172.21.15.12:0/4123129242 conn(0x7faf0c06ce80 msgr2=0x7faf0c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 -- 172.21.15.12:0/4123129242 shutdown_connections 2023-10-08T16:09:58.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.939+0000 7faf1159d700 1 -- 172.21.15.12:0/4123129242 wait complete. 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.941+0000 7faf1159d700 1 Processor -- start 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.941+0000 7faf1159d700 1 -- start start 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c06db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c146a80 con 0x7faf0c15dfd0 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c145e70 con 0x7faf0c159550 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf1159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c146150 con 0x7faf0c159920 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45500/0 (socket says 172.21.15.12:45500) 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 -- 172.21.15.12:0/3041391250 learned_addr learned my addr 172.21.15.12:0/3041391250 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf0b7fe700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c06db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf0bfff700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 -- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 msgr2=0x7faf0c06db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c06db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 -- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 msgr2=0x7faf0c145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:58.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.942+0000 7faf10d9c700 1 -- 172.21.15.12:0/3041391250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf04009a20 con 0x7faf0c15dfd0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faf10d9c700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf04009fc0 tx=0x7faf0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400cd30 con 0x7faf0c15dfd0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400f040 con 0x7faf0c15dfd0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040146d0 con 0x7faf0c15dfd0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc009420 con 0x7faf0c15dfd0 2023-10-08T16:09:58.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.943+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c146710 con 0x7faf0c15dfd0 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.944+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c0b4310 con 0x7faf0c15dfd0 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.945+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf04003020 con 0x7faf0c15dfd0 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.946+0000 7faef3fff700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 0x7faef80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.946+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf04085060 con 0x7faf0c15dfd0 2023-10-08T16:09:58.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.946+0000 7faf0bfff700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 0x7faef80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:58.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.947+0000 7faf0bfff700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 0x7faef80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faefc0091e0 tx=0x7faefc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:58.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:58.950+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf04052230 con 0x7faf0c15dfd0 2023-10-08T16:09:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.153+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf0c04c3c0 con 0x7faf0c15dfd0 2023-10-08T16:09:59.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.153+0000 7faef3fff700 1 -- 172.21.15.12:0/3041391250 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf04055850 con 0x7faf0c15dfd0 2023-10-08T16:09:59.154 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:09:59.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 msgr2=0x7faef80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 0x7faef80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faefc0091e0 tx=0x7faefc017000 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 msgr2=0x7faf0c06e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faf04009fc0 tx=0x7faf0400b040 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 shutdown_connections 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faef8066f30 0x7faef80693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faf0c15dfd0 0x7faf0c06e040 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faf0c159550 0x7faf0c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 --2- 172.21.15.12:0/3041391250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faf0c159920 0x7faf0c06db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 >> 172.21.15.12:0/3041391250 conn(0x7faf0c06ce80 msgr2=0x7faf0c0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 shutdown_connections 2023-10-08T16:09:59.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.155+0000 7faf1159d700 1 -- 172.21.15.12:0/3041391250 wait complete. 2023-10-08T16:09:59.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:09:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.360+0000 7f005999d700 1 Processor -- start 2023-10-08T16:09:59.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.360+0000 7f005999d700 1 -- start start 2023-10-08T16:09:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 0x7f005415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f005413fef0 0x7f00540c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f00540c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00540c8410 con 0x7f005413fef0 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005415ae70 con 0x7f005413fb20 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f005999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005406af60 con 0x7f005406aaa0 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.361+0000 7f0053fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f005413fef0 0x7f00540c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f005413fef0 0x7f00540c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45516/0 (socket says 172.21.15.12:45516) 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 -- 172.21.15.12:0/311749261 learned_addr learned my addr 172.21.15.12:0/311749261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f005919c700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f00540c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f005899b700 1 --2- 172.21.15.12:0/311749261 >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 0x7f005415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 -- 172.21.15.12:0/311749261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 msgr2=0x7f00540c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f00540c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 -- 172.21.15.12:0/311749261 >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 msgr2=0x7f005415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 --2- 172.21.15.12:0/311749261 >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 0x7f005415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 -- 172.21.15.12:0/311749261 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005406b240 con 0x7f005413fef0 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f005899b700 1 --2- 172.21.15.12:0/311749261 >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 0x7f005415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f0053fff700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fef0 0x7f00540c7990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00540695b0 tx=0x7f0040009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168ed27c1afea4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.362+0000 7f00537fe700 1 -- 172.21.15.12:0/311749261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040005c10 con 0x7f005413fef0 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f00537fe700 1 -- 172.21.15.12:0/311749261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0040005d70 con 0x7f005413fef0 2023-10-08T16:09:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f00537fe700 1 -- 172.21.15.12:0/311749261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0040006260 con 0x7f005413fef0 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 -- 172.21.15.12:0/311749261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fef0 msgr2=0x7f00540c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fef0 0x7f00540c7990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00540695b0 tx=0x7f0040009220 comp rx=0 tx=0).stop 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 -- 172.21.15.12:0/311749261 shutdown_connections 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f00540c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 --2- 172.21.15.12:0/311749261 >> v2:172.21.15.29:3300/0 conn(0x7f005413fb20 0x7f005415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 --2- 172.21.15.12:0/311749261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fef0 0x7f00540c7990 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 -- 172.21.15.12:0/311749261 >> 172.21.15.12:0/311749261 conn(0x7f005406d170 msgr2=0x7f00540cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 -- 172.21.15.12:0/311749261 shutdown_connections 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.363+0000 7f005999d700 1 -- 172.21.15.12:0/311749261 wait complete. 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.365+0000 7f005999d700 1 Processor -- start 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.365+0000 7f005999d700 1 -- start start 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f005413cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005413fef0 0x7f005406de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541564d0 con 0x7f005413fb20 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541585b0 con 0x7f005413fef0 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005416d5f0 con 0x7f005406aaa0 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f0053fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f0053fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45518/0 (socket says 172.21.15.12:45518) 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f0053fff700 1 -- 172.21.15.12:0/755166668 learned_addr learned my addr 172.21.15.12:0/755166668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005899b700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f005413cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.366+0000 7f005919c700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005413fef0 0x7f005406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 -- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 msgr2=0x7f005413cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f005413cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 -- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005413fef0 msgr2=0x7f005406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005413fef0 0x7f005406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 -- 172.21.15.12:0/755166668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040009480 con 0x7f005413fb20 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0053fff700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0054071320 tx=0x7f0040016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000b850 con 0x7f005413fb20 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004000b9b0 con 0x7f005413fb20 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0054158240 con 0x7f005413fb20 2023-10-08T16:09:59.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004000bd70 con 0x7f005413fb20 2023-10-08T16:09:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.367+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00540c7660 con 0x7f005413fb20 2023-10-08T16:09:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.368+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00540c7910 con 0x7f005413fb20 2023-10-08T16:09:59.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.369+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f004001b640 con 0x7f005413fb20 2023-10-08T16:09:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.370+0000 7f0050ff9700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 0x7f00380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.370+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0040085dc0 con 0x7f005413fb20 2023-10-08T16:09:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.370+0000 7f005899b700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 0x7f00380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.371+0000 7f005899b700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 0x7f00380693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0048006f00 tx=0x7f0048008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.374+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0040052f90 con 0x7f005413fb20 2023-10-08T16:09:59.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.576+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0054158720 con 0x7f005413fb20 2023-10-08T16:09:59.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.577+0000 7f0050ff9700 1 -- 172.21.15.12:0/755166668 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f00400565b0 con 0x7f005413fb20 2023-10-08T16:09:59.578 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:09:59.578 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:09:59.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 msgr2=0x7f00380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 0x7f00380693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0048006f00 tx=0x7f0048008040 comp rx=0 tx=0).stop 2023-10-08T16:09:59.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 msgr2=0x7f0054155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0054071320 tx=0x7f0040016000 comp rx=0 tx=0).stop 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 shutdown_connections 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005413fef0 0x7f005406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005406aaa0 0x7f005413cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0038066f30 0x7f00380693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 --2- 172.21.15.12:0/755166668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f005413fb20 0x7f0054155f90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 >> 172.21.15.12:0/755166668 conn(0x7f005406d170 msgr2=0x7f00540aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 shutdown_connections 2023-10-08T16:09:59.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.579+0000 7f005999d700 1 -- 172.21.15.12:0/755166668 wait complete. 2023-10-08T16:09:59.597 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:09:59.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:09:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.785+0000 7f9e7ffff700 1 Processor -- start 2023-10-08T16:09:59.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.785+0000 7f9e7ffff700 1 -- start start 2023-10-08T16:09:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e800ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e80159920 0x7f9e800ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800acc00 con 0x7f9e8015dfd0 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e800abff0 con 0x7f9e80159920 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800ac2d0 con 0x7f9e80159550 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e80159920 0x7f9e800ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e80159920 0x7f9e800ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45526/0 (socket says 172.21.15.12:45526) 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/3918162927 learned_addr learned my addr 172.21.15.12:0/3918162927 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.787+0000 7f9e7effd700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e800ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/3918162927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 msgr2=0x7f9e800ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7f7fe700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e800ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/3918162927 >> v1:172.21.15.29:6789/0 conn(0x7f9e8015dfd0 legacy=0x7f9e800aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/3918162927 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800ac5b0 con 0x7f9e80159920 2023-10-08T16:09:59.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7f7fe700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e80159920 0x7f9e800ad090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009f20 tx=0x7f9e78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f75058c39ab4481 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7dffb700 1 -- 172.21.15.12:0/3918162927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7800e070 con 0x7f9e80159920 2023-10-08T16:09:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7dffb700 1 -- 172.21.15.12:0/3918162927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7800ba80 con 0x7f9e80159920 2023-10-08T16:09:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.788+0000 7f9e7dffb700 1 -- 172.21.15.12:0/3918162927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780092e0 con 0x7f9e80159920 2023-10-08T16:09:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 -- 172.21.15.12:0/3918162927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e80159920 msgr2=0x7f9e800ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e80159920 0x7f9e800ad090 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9e78009f20 tx=0x7f9e78009840 comp rx=0 tx=0).stop 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 -- 172.21.15.12:0/3918162927 shutdown_connections 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e80159920 0x7f9e800ad090 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/3918162927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e800ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 -- 172.21.15.12:0/3918162927 >> 172.21.15.12:0/3918162927 conn(0x7f9e8006ce80 msgr2=0x7f9e800ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 -- 172.21.15.12:0/3918162927 shutdown_connections 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.789+0000 7f9e7ffff700 1 -- 172.21.15.12:0/3918162927 wait complete. 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.790+0000 7f9e7ffff700 1 Processor -- start 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.790+0000 7f9e7ffff700 1 -- start start 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e80146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e80159920 0x7f9e800c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80156ea0 con 0x7f9e8015dfd0 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80156350 con 0x7f9e80159920 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.791+0000 7f9e7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80156600 con 0x7f9e80159550 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45538/0 (socket says 172.21.15.12:45538) 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/1720575913 learned_addr learned my addr 172.21.15.12:0/1720575913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7effd700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e80146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7e7fc700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e80159920 0x7f9e800c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 msgr2=0x7f9e80146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e80146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e80159920 msgr2=0x7f9e800c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e80159920 0x7f9e800c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:09:59.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 -- 172.21.15.12:0/1720575913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e78009ae0 con 0x7f9e8015dfd0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e7f7fe700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800b6c0 tx=0x7f9e78018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.792+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e780032f0 con 0x7f9e8015dfd0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.793+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e78008d20 con 0x7f9e8015dfd0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.793+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e801568e0 con 0x7f9e8015dfd0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.793+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e78026670 con 0x7f9e8015dfd0 2023-10-08T16:09:59.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.793+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e800c7600 con 0x7f9e8015dfd0 2023-10-08T16:09:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.794+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800c7820 con 0x7f9e8015dfd0 2023-10-08T16:09:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.795+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e78003040 con 0x7f9e8015dfd0 2023-10-08T16:09:59.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.795+0000 7f9e66ffd700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:09:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.796+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e78086490 con 0x7f9e8015dfd0 2023-10-08T16:09:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.796+0000 7f9e7effd700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:09:59.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.796+0000 7f9e7effd700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e8006c2c0 tx=0x7f9e70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:09:59.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:09:59.800+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e78053700 con 0x7f9e8015dfd0 2023-10-08T16:10:00.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.004+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e8004c3c0 con 0x7f9e8015dfd0 2023-10-08T16:10:00.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.005+0000 7f9e66ffd700 1 -- 172.21.15.12:0/1720575913 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e78056d20 con 0x7f9e8015dfd0 2023-10-08T16:10:00.006 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:10:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 msgr2=0x7f9e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9e8006c2c0 tx=0x7f9e70008040 comp rx=0 tx=0).stop 2023-10-08T16:10:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 msgr2=0x7f9e801576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800b6c0 tx=0x7f9e78018000 comp rx=0 tx=0).stop 2023-10-08T16:10:00.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 shutdown_connections 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8015dfd0 0x7f9e801576a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e80159550 0x7f9e80146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 --2- 172.21.15.12:0/1720575913 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e80159920 0x7f9e800c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 >> 172.21.15.12:0/1720575913 conn(0x7f9e8006ce80 msgr2=0x7f9e800b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 shutdown_connections 2023-10-08T16:10:00.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.007+0000 7f9e7ffff700 1 -- 172.21.15.12:0/1720575913 wait complete. 2023-10-08T16:10:00.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:10:00.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.223+0000 7f2241d9d700 1 Processor -- start 2023-10-08T16:10:00.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.223+0000 7f2241d9d700 1 -- start start 2023-10-08T16:10:00.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2241d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2241d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f223c0cea00 0x7f223c0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2241d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223c15ac50 con 0x7f223c153a00 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2241d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223c15d010 con 0x7f223c0cea00 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2241d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c15af60 con 0x7f223c153dd0 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.224+0000 7f2240d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f223c153a00 0x7f223c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39832/0 (socket says 172.21.15.12:39832) 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f2240d9b700 1 -- 172.21.15.12:0/4072610928 learned_addr learned my addr 172.21.15.12:0/4072610928 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 --2- 172.21.15.12:0/4072610928 >> v2:172.21.15.12:3300/0 conn(0x7f223c0cea00 0x7f223c0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f223bfff700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f223b7fe700 1 -- 172.21.15.12:0/4072610928 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396133926 0 0) 0x7f223c15ac50 con 0x7f223c153a00 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f223b7fe700 1 -- 172.21.15.12:0/4072610928 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f222c003570 con 0x7f223c153a00 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 -- 172.21.15.12:0/4072610928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 msgr2=0x7f223c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 -- 172.21.15.12:0/4072610928 >> v1:172.21.15.12:6789/0 conn(0x7f223c153a00 legacy=0x7f223c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 -- 172.21.15.12:0/4072610928 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c15b240 con 0x7f223c0cea00 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.225+0000 7f224159c700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c0cea00 0x7f223c0cee60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2234009e90 tx=0x7f2234009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ada4f20d99b1c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f223b7fe700 1 -- 172.21.15.12:0/4072610928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223400e070 con 0x7f223c0cea00 2023-10-08T16:10:00.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f223b7fe700 1 -- 172.21.15.12:0/4072610928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223400bb40 con 0x7f223c0cea00 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f223b7fe700 1 -- 172.21.15.12:0/4072610928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234012430 con 0x7f223c0cea00 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 -- 172.21.15.12:0/4072610928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c0cea00 msgr2=0x7f223c0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c0cea00 0x7f223c0cee60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2234009e90 tx=0x7f2234009780 comp rx=0 tx=0).stop 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 -- 172.21.15.12:0/4072610928 shutdown_connections 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c0cea00 0x7f223c0cee60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 --2- 172.21.15.12:0/4072610928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 -- 172.21.15.12:0/4072610928 >> 172.21.15.12:0/4072610928 conn(0x7f223c0703a0 msgr2=0x7f223c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 -- 172.21.15.12:0/4072610928 shutdown_connections 2023-10-08T16:10:00.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.226+0000 7f2241d9d700 1 -- 172.21.15.12:0/4072610928 wait complete. 2023-10-08T16:10:00.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.228+0000 7f2241d9d700 1 Processor -- start 2023-10-08T16:10:00.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.228+0000 7f2241d9d700 1 -- start start 2023-10-08T16:10:00.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 0x7f223c169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c16a140 con 0x7f223c153a00 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b0680 con 0x7f223c0cea00 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2241d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223c0b0960 con 0x7f223c153dd0 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f223bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45548/0 (socket says 172.21.15.12:45548) 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f223bfff700 1 -- 172.21.15.12:0/723204030 learned_addr learned my addr 172.21.15.12:0/723204030 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f224159c700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f2240d9b700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 0x7f223c169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.229+0000 7f223bfff700 1 -- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 msgr2=0x7f223c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f223bfff700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f223bfff700 1 -- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 msgr2=0x7f223c169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f223bfff700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 0x7f223c169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f223bfff700 1 -- 172.21.15.12:0/723204030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2234009a20 con 0x7f223c153a00 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2240d9b700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 0x7f223c169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f223bfff700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f222800e900 tx=0x7f22280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228013680 con 0x7f223c153a00 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22280137e0 con 0x7f223c153a00 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228013ba0 con 0x7f223c153a00 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223c0b0c40 con 0x7f223c153a00 2023-10-08T16:10:00.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.230+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f223c0b1280 con 0x7f223c153a00 2023-10-08T16:10:00.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.231+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f223c0b03d0 con 0x7f223c153a00 2023-10-08T16:10:00.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.232+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f222800c460 con 0x7f223c153a00 2023-10-08T16:10:00.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.233+0000 7f2238ff9700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.233+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2228084480 con 0x7f223c153a00 2023-10-08T16:10:00.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.233+0000 7f2240d9b700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.234+0000 7f2240d9b700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f223c0caec0 tx=0x7f2230009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.237+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2228051650 con 0x7f223c153a00 2023-10-08T16:10:00.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.442+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f223c04c3c0 con 0x7f223c153a00 2023-10-08T16:10:00.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.442+0000 7f2238ff9700 1 -- 172.21.15.12:0/723204030 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2228054c70 con 0x7f223c153a00 2023-10-08T16:10:00.443 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:10:00.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.444+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 msgr2=0x7f22200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.444+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f223c0caec0 tx=0x7f2230009040 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.444+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 msgr2=0x7f223c162f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.444+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f222800e900 tx=0x7f22280091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 shutdown_connections 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f223c153dd0 0x7f223c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f223c0cea00 0x7f223c169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2220066f30 0x7f22200693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 --2- 172.21.15.12:0/723204030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f223c153a00 0x7f223c162f30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 >> 172.21.15.12:0/723204030 conn(0x7f223c0703a0 msgr2=0x7f223c0c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 shutdown_connections 2023-10-08T16:10:00.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.445+0000 7f2241d9d700 1 -- 172.21.15.12:0/723204030 wait complete. 2023-10-08T16:10:00.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:10:00.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.653+0000 7f8ba9f9d700 1 Processor -- start 2023-10-08T16:10:00.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.654+0000 7f8ba9f9d700 1 -- start start 2023-10-08T16:10:00.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba9f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ba4153dd0 0x7f8ba415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 0x7f8ba40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba9f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ba415ac50 con 0x7f8ba4153a00 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba9f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ba415d010 con 0x7f8ba4153dd0 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba9f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40cf3e0 con 0x7f8ba40cea00 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba8f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8ba4153a00 0x7f8ba415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39840/0 (socket says 172.21.15.12:39840) 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba8f9b700 1 -- 172.21.15.12:0/3854682829 learned_addr learned my addr 172.21.15.12:0/3854682829 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3854682829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 0x7f8ba40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.655+0000 7f8ba3fff700 1 --2- 172.21.15.12:0/3854682829 >> v2:172.21.15.29:3300/0 conn(0x7f8ba4153dd0 0x7f8ba415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba37fe700 1 -- 172.21.15.12:0/3854682829 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 976797064 0 0) 0x7f8ba415ac50 con 0x7f8ba4153a00 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba37fe700 1 -- 172.21.15.12:0/3854682829 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b94003570 con 0x7f8ba4153a00 2023-10-08T16:10:00.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba979c700 1 -- 172.21.15.12:0/3854682829 >> v2:172.21.15.29:3300/0 conn(0x7f8ba4153dd0 msgr2=0x7f8ba415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3854682829 >> v2:172.21.15.29:3300/0 conn(0x7f8ba4153dd0 0x7f8ba415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba979c700 1 -- 172.21.15.12:0/3854682829 >> v1:172.21.15.12:6789/0 conn(0x7f8ba4153a00 legacy=0x7f8ba415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba979c700 1 -- 172.21.15.12:0/3854682829 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba415af60 con 0x7f8ba40cea00 2023-10-08T16:10:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3854682829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 0x7f8ba40ceea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009e60 tx=0x7f8b9c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a40c2e89a75885b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.656+0000 7f8ba37fe700 1 -- 172.21.15.12:0/3854682829 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00e070 con 0x7f8ba40cea00 2023-10-08T16:10:00.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba37fe700 1 -- 172.21.15.12:0/3854682829 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c00bab0 con 0x7f8ba40cea00 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba37fe700 1 -- 172.21.15.12:0/3854682829 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c00be70 con 0x7f8ba40cea00 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3854682829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 msgr2=0x7f8ba40ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3854682829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 0x7f8ba40ceea0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009e60 tx=0x7f8b9c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3854682829 shutdown_connections 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3854682829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba40cea00 0x7f8ba40ceea0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3854682829 >> v2:172.21.15.29:3300/0 conn(0x7f8ba4153dd0 0x7f8ba415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3854682829 >> 172.21.15.12:0/3854682829 conn(0x7f8ba40703a0 msgr2=0x7f8ba40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3854682829 shutdown_connections 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.657+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3854682829 wait complete. 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.659+0000 7f8ba9f9d700 1 Processor -- start 2023-10-08T16:10:00.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.659+0000 7f8ba9f9d700 1 -- start start 2023-10-08T16:10:00.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ba40cea00 0x7f8ba40c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba4153a00 0x7f8ba40c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40c5400 con 0x7f8ba4153dd0 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba40c73a0 con 0x7f8ba40cea00 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba9f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba4157130 con 0x7f8ba4153a00 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45554/0 (socket says 172.21.15.12:45554) 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 -- 172.21.15.12:0/3504966782 learned_addr learned my addr 172.21.15.12:0/3504966782 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba3fff700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba4153a00 0x7f8ba40c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba8f9b700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ba40cea00 0x7f8ba40c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 -- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba4153a00 msgr2=0x7f8ba40c6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba4153a00 0x7f8ba40c6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 -- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ba40cea00 msgr2=0x7f8ba40c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ba40cea00 0x7f8ba40c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.660+0000 7f8ba979c700 1 -- 172.21.15.12:0/3504966782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c009a20 con 0x7f8ba4153dd0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba979c700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40cf520 tx=0x7f8b9c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c012e10 con 0x7f8ba4153dd0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9c027470 con 0x7f8ba4153dd0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ba40c9af0 con 0x7f8ba4153dd0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c027830 con 0x7f8ba4153dd0 2023-10-08T16:10:00.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.661+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ba40ca0b0 con 0x7f8ba4153dd0 2023-10-08T16:10:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.662+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ba40c5570 con 0x7f8ba4153dd0 2023-10-08T16:10:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.663+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8b9c024070 con 0x7f8ba4153dd0 2023-10-08T16:10:00.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.664+0000 7f8ba0ff9700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 0x7f8b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:00.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.664+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8b9c086b40 con 0x7f8ba4153dd0 2023-10-08T16:10:00.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.664+0000 7f8ba8f9b700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 0x7f8b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:00.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.665+0000 7f8ba8f9b700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 0x7f8b880693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007fd0 tx=0x7f8b98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:00.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.668+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b9c053d10 con 0x7f8ba4153dd0 2023-10-08T16:10:00.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.873+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8ba404c3c0 con 0x7f8ba4153dd0 2023-10-08T16:10:00.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.873+0000 7f8ba0ff9700 1 -- 172.21.15.12:0/3504966782 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b9c057330 con 0x7f8ba4153dd0 2023-10-08T16:10:00.874 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:10:00.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 msgr2=0x7f8b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 0x7f8b880693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8b98007fd0 tx=0x7f8b98009040 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 msgr2=0x7f8ba4156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8ba40cf520 tx=0x7f8b9c019000 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 shutdown_connections 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8b88066f30 0x7f8b880693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ba4153dd0 0x7f8ba4156bf0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ba40cea00 0x7f8ba40c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 --2- 172.21.15.12:0/3504966782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ba4153a00 0x7f8ba40c6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.875+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 >> 172.21.15.12:0/3504966782 conn(0x7f8ba40703a0 msgr2=0x7f8ba40d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.876+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 shutdown_connections 2023-10-08T16:10:00.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:00.876+0000 7f8ba9f9d700 1 -- 172.21.15.12:0/3504966782 wait complete. 2023-10-08T16:10:00.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:01.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.083+0000 7f5e1e39d700 1 Processor -- start 2023-10-08T16:10:01.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.084+0000 7f5e1e39d700 1 -- start start 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159550 0x7f5e180ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1e39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e18159920 0x7f5e180ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1e39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e180acc00 con 0x7f5e1815dfd0 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1e39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e180abff0 con 0x7f5e18159920 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e180ac2d0 con 0x7f5e18159550 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1db9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e18159920 0x7f5e180ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1cb9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5e1815dfd0 0x7f5e180aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39852/0 (socket says 172.21.15.12:39852) 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1cb9a700 1 -- 172.21.15.12:0/3361861214 learned_addr learned my addr 172.21.15.12:0/3361861214 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:01.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.085+0000 7f5e1d39b700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159550 0x7f5e180ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e1db9c700 1 -- 172.21.15.12:0/3361861214 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159550 msgr2=0x7f5e180ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e1db9c700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159550 0x7f5e180ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e1db9c700 1 -- 172.21.15.12:0/3361861214 >> v1:172.21.15.12:6789/0 conn(0x7f5e1815dfd0 legacy=0x7f5e180aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e1db9c700 1 -- 172.21.15.12:0/3361861214 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180ac5b0 con 0x7f5e18159920 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e0ffff700 1 -- 172.21.15.12:0/3361861214 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333759840 0 0) 0x7f5e180acc00 con 0x7f5e1815dfd0 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e1db9c700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159920 0x7f5e180ad090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009e60 tx=0x7f5e10009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a8fe845d1adbdd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e0ffff700 1 -- 172.21.15.12:0/3361861214 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1000e070 con 0x7f5e18159920 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e0ffff700 1 -- 172.21.15.12:0/3361861214 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1000bc30 con 0x7f5e18159920 2023-10-08T16:10:01.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.086+0000 7f5e0ffff700 1 -- 172.21.15.12:0/3361861214 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e10012430 con 0x7f5e18159920 2023-10-08T16:10:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 -- 172.21.15.12:0/3361861214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159920 msgr2=0x7f5e180ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159920 0x7f5e180ad090 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5e10009e60 tx=0x7f5e10009780 comp rx=0 tx=0).stop 2023-10-08T16:10:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 -- 172.21.15.12:0/3361861214 shutdown_connections 2023-10-08T16:10:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159920 0x7f5e180ad090 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/3361861214 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159550 0x7f5e180ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 -- 172.21.15.12:0/3361861214 >> 172.21.15.12:0/3361861214 conn(0x7f5e1806ce80 msgr2=0x7f5e180ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 -- 172.21.15.12:0/3361861214 shutdown_connections 2023-10-08T16:10:01.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.087+0000 7f5e1e39d700 1 -- 172.21.15.12:0/3361861214 wait complete. 2023-10-08T16:10:01.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.088+0000 7f5e1e39d700 1 Processor -- start 2023-10-08T16:10:01.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.088+0000 7f5e1e39d700 1 -- start start 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 0x7f5e1814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 0x7f5e18158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18157b80 con 0x7f5e18159550 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18156f70 con 0x7f5e1815dfd0 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e18157250 con 0x7f5e18159920 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1d39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1d39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45564/0 (socket says 172.21.15.12:45564) 2023-10-08T16:10:01.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.089+0000 7f5e1d39b700 1 -- 172.21.15.12:0/1190549631 learned_addr learned my addr 172.21.15.12:0/1190549631 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1cb9a700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 0x7f5e1814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1db9c700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 0x7f5e18158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 -- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 msgr2=0x7f5e1814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 0x7f5e1814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 -- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 msgr2=0x7f5e18158010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 0x7f5e18158010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 -- 172.21.15.12:0/1190549631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e10009a20 con 0x7f5e18159550 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1cb9a700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 0x7f5e1814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1db9c700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 0x7f5e18158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1d39b700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d860 tx=0x7f5e14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14009610 con 0x7f5e18159550 2023-10-08T16:10:01.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14009770 con 0x7f5e18159550 2023-10-08T16:10:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.090+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e18157530 con 0x7f5e18159550 2023-10-08T16:10:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.091+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14009b30 con 0x7f5e18159550 2023-10-08T16:10:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.091+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1814f7d0 con 0x7f5e18159550 2023-10-08T16:10:01.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.092+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e18157e60 con 0x7f5e18159550 2023-10-08T16:10:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.093+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e1401e460 con 0x7f5e18159550 2023-10-08T16:10:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.093+0000 7f5e0d7fa700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 0x7f5dfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.093+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e14084bf0 con 0x7f5e18159550 2023-10-08T16:10:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.094+0000 7f5e1cb9a700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 0x7f5dfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.094+0000 7f5e1cb9a700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 0x7f5dfc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e18154a70 tx=0x7f5e08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.098+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e14051dc0 con 0x7f5e18159550 2023-10-08T16:10:01.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.303+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e1806d250 con 0x7f5e18159550 2023-10-08T16:10:01.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.304+0000 7f5e0d7fa700 1 -- 172.21.15.12:0/1190549631 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15398 (secure 0 0 0) 0x7f5e140553e0 con 0x7f5e18159550 2023-10-08T16:10:01.305 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:01.305 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":21,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:09:21.901547+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:01.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 msgr2=0x7f5dfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 0x7f5dfc0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5e18154a70 tx=0x7f5e08009040 comp rx=0 tx=0).stop 2023-10-08T16:10:01.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 msgr2=0x7f5e180c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5e1400d860 tx=0x7f5e14008040 comp rx=0 tx=0).stop 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 shutdown_connections 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5dfc066f30 0x7f5dfc0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e18159550 0x7f5e180c8420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e1815dfd0 0x7f5e18158010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 --2- 172.21.15.12:0/1190549631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e18159920 0x7f5e1814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 >> 172.21.15.12:0/1190549631 conn(0x7f5e1806ce80 msgr2=0x7f5e1806d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 shutdown_connections 2023-10-08T16:10:01.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.306+0000 7f5e1e39d700 1 -- 172.21.15.12:0/1190549631 wait complete. 2023-10-08T16:10:01.324 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:10:01.325 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:10:01.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.514+0000 7fca4359d700 1 Processor -- start 2023-10-08T16:10:01.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.514+0000 7fca4359d700 1 -- start start 2023-10-08T16:10:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4359d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fca3c153a00 0x7fca3c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4359d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fca3c0cea00 0x7fca3c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4359d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3c15ac50 con 0x7fca3c15de50 2023-10-08T16:10:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4359d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c15d010 con 0x7fca3c153a00 2023-10-08T16:10:01.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4359d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3c0cf3c0 con 0x7fca3c0cea00 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.515+0000 7fca4259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fca3c153a00 0x7fca3c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fca3c153a00 0x7fca3c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45580/0 (socket says 172.21.15.12:45580) 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 -- 172.21.15.12:0/1852151799 learned_addr learned my addr 172.21.15.12:0/1852151799 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca41d9a700 1 --1- 172.21.15.12:0/1852151799 >> v1:172.21.15.12:6789/0 conn(0x7fca3c15de50 0x7fca3c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39866/0 (socket says 172.21.15.12:39866) 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca42d9c700 1 --2- 172.21.15.12:0/1852151799 >> v2:172.21.15.29:3300/0 conn(0x7fca3c0cea00 0x7fca3c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 -- 172.21.15.12:0/1852151799 >> v2:172.21.15.29:3300/0 conn(0x7fca3c0cea00 msgr2=0x7fca3c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 --2- 172.21.15.12:0/1852151799 >> v2:172.21.15.29:3300/0 conn(0x7fca3c0cea00 0x7fca3c0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 -- 172.21.15.12:0/1852151799 >> v1:172.21.15.12:6789/0 conn(0x7fca3c15de50 legacy=0x7fca3c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 -- 172.21.15.12:0/1852151799 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c15af60 con 0x7fca3c153a00 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca41599700 1 -- 172.21.15.12:0/1852151799 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451319890 0 0) 0x7fca3c15ac50 con 0x7fca3c15de50 2023-10-08T16:10:01.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca4259b700 1 --2- 172.21.15.12:0/1852151799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c153a00 0x7fca3c153dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0d03e0 tx=0x7fca38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=624492ed7f03ae32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.516+0000 7fca41599700 1 -- 172.21.15.12:0/1852151799 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38009e70 con 0x7fca3c153a00 2023-10-08T16:10:01.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca41599700 1 -- 172.21.15.12:0/1852151799 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3800b860 con 0x7fca3c153a00 2023-10-08T16:10:01.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca41599700 1 -- 172.21.15.12:0/1852151799 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3800bc00 con 0x7fca3c153a00 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 -- 172.21.15.12:0/1852151799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c153a00 msgr2=0x7fca3c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 --2- 172.21.15.12:0/1852151799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c153a00 0x7fca3c153dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0d03e0 tx=0x7fca38009250 comp rx=0 tx=0).stop 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 -- 172.21.15.12:0/1852151799 shutdown_connections 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 --2- 172.21.15.12:0/1852151799 >> v2:172.21.15.29:3300/0 conn(0x7fca3c0cea00 0x7fca3c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 --2- 172.21.15.12:0/1852151799 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c153a00 0x7fca3c153dd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 -- 172.21.15.12:0/1852151799 >> 172.21.15.12:0/1852151799 conn(0x7fca3c0703a0 msgr2=0x7fca3c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 -- 172.21.15.12:0/1852151799 shutdown_connections 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.517+0000 7fca4359d700 1 -- 172.21.15.12:0/1852151799 wait complete. 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.519+0000 7fca4359d700 1 Processor -- start 2023-10-08T16:10:01.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.519+0000 7fca4359d700 1 -- start start 2023-10-08T16:10:01.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fca3c0cea00 0x7fca3c158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c153a00 0x7fca3c0b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0b0790 con 0x7fca3c15de50 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0c9db0 con 0x7fca3c153a00 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca3c0ca090 con 0x7fca3c0cea00 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45590/0 (socket says 172.21.15.12:45590) 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 -- 172.21.15.12:0/700712699 learned_addr learned my addr 172.21.15.12:0/700712699 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca4259b700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fca3c0cea00 0x7fca3c158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca41d9a700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c153a00 0x7fca3c0b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 -- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fca3c0cea00 msgr2=0x7fca3c158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fca3c0cea00 0x7fca3c158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 -- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c153a00 msgr2=0x7fca3c0b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c153a00 0x7fca3c0b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.520+0000 7fca42d9c700 1 -- 172.21.15.12:0/700712699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380094f0 con 0x7fca3c15de50 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca42d9c700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca34009df0 tx=0x7fca3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3400cb50 con 0x7fca3c15de50 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3400f040 con 0x7fca3c15de50 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34014480 con 0x7fca3c15de50 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca3c0ca370 con 0x7fca3c15de50 2023-10-08T16:10:01.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.521+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca3c158d60 con 0x7fca3c15de50 2023-10-08T16:10:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.522+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca3c04c3c0 con 0x7fca3c15de50 2023-10-08T16:10:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.523+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca34014830 con 0x7fca3c15de50 2023-10-08T16:10:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.524+0000 7fca327fc700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.524+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fca34084f50 con 0x7fca3c15de50 2023-10-08T16:10:01.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.524+0000 7fca4259b700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.525+0000 7fca4259b700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0d03e0 tx=0x7fca38017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.528+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca34052120 con 0x7fca3c15de50 2023-10-08T16:10:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.728+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca3c0cf1a0 con 0x7fca3c15de50 2023-10-08T16:10:01.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.729+0000 7fca327fc700 1 -- 172.21.15.12:0/700712699 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca34018020 con 0x7fca3c15de50 2023-10-08T16:10:01.730 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:10:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 msgr2=0x7fca200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 0x7fca200693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca3c0d03e0 tx=0x7fca38017000 comp rx=0 tx=0).stop 2023-10-08T16:10:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 msgr2=0x7fca3c14aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fca34009df0 tx=0x7fca3400b040 comp rx=0 tx=0).stop 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 shutdown_connections 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fca20066f30 0x7fca200693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fca3c15de50 0x7fca3c14aed0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fca3c0cea00 0x7fca3c158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 --2- 172.21.15.12:0/700712699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fca3c153a00 0x7fca3c0b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 >> 172.21.15.12:0/700712699 conn(0x7fca3c0703a0 msgr2=0x7fca3c0c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 shutdown_connections 2023-10-08T16:10:01.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.731+0000 7fca4359d700 1 -- 172.21.15.12:0/700712699 wait complete. 2023-10-08T16:10:01.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:10:01.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.938+0000 7f6da099d700 1 Processor -- start 2023-10-08T16:10:01.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.938+0000 7f6da099d700 1 -- start start 2023-10-08T16:10:01.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6da099d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d9c153a00 0x7f6d9c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6da099d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 0x7f6d9c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6da099d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c15ac50 con 0x7f6d9c15de50 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6da099d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c15d010 con 0x7f6d9c153a00 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6da099d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c0cf3c0 con 0x7f6d9c0cea00 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d9c153a00 0x7f6d9c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6d9c15de50 0x7f6d9c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39876/0 (socket says 172.21.15.12:39876) 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9affd700 1 -- 172.21.15.12:0/2326793827 learned_addr learned my addr 172.21.15.12:0/2326793827 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9bfff700 1 --2- 172.21.15.12:0/2326793827 >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 0x7f6d9c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/2326793827 >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 msgr2=0x7f6d9c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9b7fe700 1 --2- 172.21.15.12:0/2326793827 >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 0x7f6d9c0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/2326793827 >> v1:172.21.15.12:6789/0 conn(0x7f6d9c15de50 legacy=0x7f6d9c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/2326793827 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c15af60 con 0x7f6d9c153a00 2023-10-08T16:10:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9a7fc700 1 -- 172.21.15.12:0/2326793827 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590052457 0 0) 0x7f6d9c15ac50 con 0x7f6d9c15de50 2023-10-08T16:10:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.940+0000 7f6d9bfff700 1 --2- 172.21.15.12:0/2326793827 >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 0x7f6d9c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:01.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6d9b7fe700 1 --2- 172.21.15.12:0/2326793827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c153a00 0x7f6d9c153dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0d03e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad58cdaf0ceec096 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6d9a7fc700 1 -- 172.21.15.12:0/2326793827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00b6b0 con 0x7f6d9c153a00 2023-10-08T16:10:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6d9a7fc700 1 -- 172.21.15.12:0/2326793827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c00b810 con 0x7f6d9c153a00 2023-10-08T16:10:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6d9a7fc700 1 -- 172.21.15.12:0/2326793827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00bbb0 con 0x7f6d9c153a00 2023-10-08T16:10:01.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6da099d700 1 -- 172.21.15.12:0/2326793827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c153a00 msgr2=0x7f6d9c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.941+0000 7f6da099d700 1 --2- 172.21.15.12:0/2326793827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c153a00 0x7f6d9c153dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0d03e0 tx=0x7f6d8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 -- 172.21.15.12:0/2326793827 shutdown_connections 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 --2- 172.21.15.12:0/2326793827 >> v2:172.21.15.29:3300/0 conn(0x7f6d9c0cea00 0x7f6d9c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 --2- 172.21.15.12:0/2326793827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c153a00 0x7f6d9c153dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 -- 172.21.15.12:0/2326793827 >> 172.21.15.12:0/2326793827 conn(0x7f6d9c0703a0 msgr2=0x7f6d9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 -- 172.21.15.12:0/2326793827 shutdown_connections 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.942+0000 7f6da099d700 1 -- 172.21.15.12:0/2326793827 wait complete. 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.943+0000 7f6da099d700 1 Processor -- start 2023-10-08T16:10:01.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.943+0000 7f6da099d700 1 -- start start 2023-10-08T16:10:01.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d9c153a00 0x7f6d9c0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 0x7f6d9c14abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0c9700 con 0x7f6d9c0cea00 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0c8af0 con 0x7f6d9c15de50 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6da099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0c8dd0 con 0x7f6d9c153a00 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6d9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6d9b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45612/0 (socket says 172.21.15.12:45612) 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.944+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/139443494 learned_addr learned my addr 172.21.15.12:0/139443494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9affd700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d9c153a00 0x7f6d9c0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9bfff700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 0x7f6d9c14abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d9c153a00 msgr2=0x7f6d9c0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d9c153a00 0x7f6d9c0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 msgr2=0x7f6d9c14abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 0x7f6d9c14abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 -- 172.21.15.12:0/139443494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009420 con 0x7f6d9c0cea00 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9bfff700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 0x7f6d9c14abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d9b7fe700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c06eb00 tx=0x7f6d8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.945+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c00bb90 con 0x7f6d9c0cea00 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.946+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c011420 con 0x7f6d9c0cea00 2023-10-08T16:10:01.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.946+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0117a0 con 0x7f6d9c0cea00 2023-10-08T16:10:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.946+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c0c90b0 con 0x7f6d9c0cea00 2023-10-08T16:10:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.946+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c0d0bc0 con 0x7f6d9c0cea00 2023-10-08T16:10:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.947+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c04c3c0 con 0x7f6d9c0cea00 2023-10-08T16:10:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.947+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d8c011b90 con 0x7f6d9c0cea00 2023-10-08T16:10:01.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.948+0000 7f6d837fe700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 0x7f6d880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.948+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6d8c085e40 con 0x7f6d9c0cea00 2023-10-08T16:10:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.949+0000 7f6d9affd700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 0x7f6d880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:01.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.949+0000 7f6d9affd700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 0x7f6d880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0affa0 tx=0x7f6d90007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:01.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:01.953+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d8c053010 con 0x7f6d9c0cea00 2023-10-08T16:10:02.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.151+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d9c0ce3e0 con 0x7f6d9c0cea00 2023-10-08T16:10:02.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.152+0000 7f6d837fe700 1 -- 172.21.15.12:0/139443494 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d8c056630 con 0x7f6d9c0cea00 2023-10-08T16:10:02.153 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 msgr2=0x7f6d880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 0x7f6d880693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0affa0 tx=0x7f6d90007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 msgr2=0x7f6d9c0d0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c06eb00 tx=0x7f6d8c017000 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 shutdown_connections 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6d88066f30 0x7f6d880693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d9c0cea00 0x7f6d9c0d0680 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d9c15de50 0x7f6d9c14abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 --2- 172.21.15.12:0/139443494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d9c153a00 0x7f6d9c0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 >> 172.21.15.12:0/139443494 conn(0x7f6d9c0703a0 msgr2=0x7f6d9c1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 shutdown_connections 2023-10-08T16:10:02.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.154+0000 7f6da099d700 1 -- 172.21.15.12:0/139443494 wait complete. 2023-10-08T16:10:02.172 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:10:02.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.361+0000 7fc0ff59e700 1 Processor -- start 2023-10-08T16:10:02.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.361+0000 7fc0ff59e700 1 -- start start 2023-10-08T16:10:02.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.362+0000 7fc0ff59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.362+0000 7fc0ff59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc10015de50 0x7fc10015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.362+0000 7fc0ff59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10015af60 con 0x7fc1000cea00 2023-10-08T16:10:02.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.362+0000 7fc0ff59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10015d010 con 0x7fc10015de50 2023-10-08T16:10:02.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.362+0000 7fc0ff59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10015b240 con 0x7fc100153a00 2023-10-08T16:10:02.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:45612/0 (socket says 172.21.15.12:45612) 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2610701409 learned_addr learned my addr 172.21.15.12:0/2610701409 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fdd9b700 1 --2- 172.21.15.12:0/2610701409 >> v2:172.21.15.29:3300/0 conn(0x7fc10015de50 0x7fc10015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2610701409 >> v2:172.21.15.29:3300/0 conn(0x7fc10015de50 msgr2=0x7fc10015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 --2- 172.21.15.12:0/2610701409 >> v2:172.21.15.29:3300/0 conn(0x7fc10015de50 0x7fc10015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2610701409 >> v1:172.21.15.29:6789/0 conn(0x7fc1000cea00 legacy=0x7fc1000cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2610701409 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10015b520 con 0x7fc100153a00 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.363+0000 7fc0fd59a700 1 -- 172.21.15.12:0/2610701409 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823237931 0 0) 0x7fc10015af60 con 0x7fc1000cea00 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0fe59c700 1 --2- 172.21.15.12:0/2610701409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00099b0 tx=0x7fc0f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1afde7c9bb01bbbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0fd59a700 1 -- 172.21.15.12:0/2610701409 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0009ea0 con 0x7fc100153a00 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0fd59a700 1 -- 172.21.15.12:0/2610701409 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f000b860 con 0x7fc100153a00 2023-10-08T16:10:02.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0fd59a700 1 -- 172.21.15.12:0/2610701409 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000bc00 con 0x7fc100153a00 2023-10-08T16:10:02.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2610701409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 msgr2=0x7fc100153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2610701409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00099b0 tx=0x7fc0f0009250 comp rx=0 tx=0).stop 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2610701409 shutdown_connections 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2610701409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc100153a00 0x7fc100153dd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2610701409 >> v2:172.21.15.29:3300/0 conn(0x7fc10015de50 0x7fc10015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.364+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2610701409 >> 172.21.15.12:0/2610701409 conn(0x7fc1000703a0 msgr2=0x7fc1000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.365+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2610701409 shutdown_connections 2023-10-08T16:10:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.365+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2610701409 wait complete. 2023-10-08T16:10:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.366+0000 7fc0ff59e700 1 Processor -- start 2023-10-08T16:10:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.366+0000 7fc0ff59e700 1 -- start start 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 0x7fc10014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc100153a00 0x7fc100151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1001508f0 con 0x7fc10015de50 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10014fce0 con 0x7fc100153a00 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0ff59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10014ffc0 con 0x7fc1000cea00 2023-10-08T16:10:02.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0fed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0fed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36150/0 (socket says 172.21.15.12:36150) 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0fe59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 0x7fc10014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0fed9d700 1 -- 172.21.15.12:0/2079606824 learned_addr learned my addr 172.21.15.12:0/2079606824 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.367+0000 7fc0fdd9b700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc100153a00 0x7fc100151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc100153a00 msgr2=0x7fc100151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc100153a00 0x7fc100151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 msgr2=0x7fc1001519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 -- 172.21.15.12:0/2079606824 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00094f0 con 0x7fc1000cea00 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fed9d700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0fe59c700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 0x7fc10014af90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc100159c60 tx=0x7fc0f0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.368+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f000bbe0 con 0x7fc1000cea00 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.369+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f001be00 con 0x7fc1000cea00 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.369+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1001502a0 con 0x7fc1000cea00 2023-10-08T16:10:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.369+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011630 con 0x7fc1000cea00 2023-10-08T16:10:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.369+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10014b4d0 con 0x7fc1000cea00 2023-10-08T16:10:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.370+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10004c3c0 con 0x7fc1000cea00 2023-10-08T16:10:02.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.371+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0f0041b80 con 0x7fc1000cea00 2023-10-08T16:10:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.372+0000 7fc0ee7fc700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 0x7fc0e0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.372+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0f00854f0 con 0x7fc1000cea00 2023-10-08T16:10:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.372+0000 7fc0fdd9b700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 0x7fc0e0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.373+0000 7fc0fdd9b700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 0x7fc0e0069410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009c80 tx=0x7fc0f40091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.375+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0f00527c0 con 0x7fc1000cea00 2023-10-08T16:10:02.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.580+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc100150100 con 0x7fc1000cea00 2023-10-08T16:10:02.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.580+0000 7fc0ee7fc700 1 -- 172.21.15.12:0/2079606824 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc100150100 con 0x7fc1000cea00 2023-10-08T16:10:02.581 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:10:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 msgr2=0x7fc0e0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 0x7fc0e0069410 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009c80 tx=0x7fc0f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 msgr2=0x7fc10014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 0x7fc10014af90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc100159c60 tx=0x7fc0f0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 shutdown_connections 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc0e0066f60 0x7fc0e0069410 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc10015de50 0x7fc1001519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1000cea00 0x7fc10014af90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 --2- 172.21.15.12:0/2079606824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc100153a00 0x7fc100151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 >> 172.21.15.12:0/2079606824 conn(0x7fc1000703a0 msgr2=0x7fc1000d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 shutdown_connections 2023-10-08T16:10:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.583+0000 7fc0ff59e700 1 -- 172.21.15.12:0/2079606824 wait complete. 2023-10-08T16:10:02.610 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-10-08T16:10:02.611 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:10:02.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-08T16:10:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.797+0000 7f433dd9d700 1 Processor -- start 2023-10-08T16:10:02.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.797+0000 7f433dd9d700 1 -- start start 2023-10-08T16:10:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.798+0000 7f433dd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 0x7f433815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.798+0000 7f433dd9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43380cf110 0x7f433815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.798+0000 7f433dd9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f433815afd0 con 0x7f433815de50 2023-10-08T16:10:02.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.798+0000 7f433dd9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433815b2b0 con 0x7f43380cf110 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.798+0000 7f433dd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f433815b590 con 0x7f4338153c30 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43380cf110 0x7f433815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f4337fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f433815de50 0x7f43380cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41790/0 (socket says 172.21.15.12:41790) 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43380cf110 0x7f433815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36152/0 (socket says 172.21.15.12:36152) 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f4337fff700 1 -- 172.21.15.12:0/2648273598 learned_addr learned my addr 172.21.15.12:0/2648273598 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:02.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433cd9b700 1 --2- 172.21.15.12:0/2648273598 >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 0x7f433815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 -- 172.21.15.12:0/2648273598 >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 msgr2=0x7f433815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:02.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 --2- 172.21.15.12:0/2648273598 >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 0x7f433815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 -- 172.21.15.12:0/2648273598 >> v1:172.21.15.12:6789/0 conn(0x7f433815de50 legacy=0x7f43380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 -- 172.21.15.12:0/2648273598 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f433815b870 con 0x7f43380cf110 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433cd9b700 1 --2- 172.21.15.12:0/2648273598 >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 0x7f433815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f433d59c700 1 --2- 172.21.15.12:0/2648273598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43380cf110 0x7f433815c070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f433806ead0 tx=0x7f4330009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5560d139b90e86f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.799+0000 7f43377fe700 1 -- 172.21.15.12:0/2648273598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433000e070 con 0x7f43380cf110 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f43377fe700 1 -- 172.21.15.12:0/2648273598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433000bc30 con 0x7f43380cf110 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f43377fe700 1 -- 172.21.15.12:0/2648273598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4330012430 con 0x7f43380cf110 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 -- 172.21.15.12:0/2648273598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43380cf110 msgr2=0x7f433815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2648273598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43380cf110 0x7f433815c070 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f433806ead0 tx=0x7f4330009780 comp rx=0 tx=0).stop 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 -- 172.21.15.12:0/2648273598 shutdown_connections 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2648273598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43380cf110 0x7f433815c070 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2648273598 >> v2:172.21.15.29:3300/0 conn(0x7f4338153c30 0x7f433815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 -- 172.21.15.12:0/2648273598 >> 172.21.15.12:0/2648273598 conn(0x7f43380703a0 msgr2=0x7f43380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 -- 172.21.15.12:0/2648273598 shutdown_connections 2023-10-08T16:10:02.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.800+0000 7f433dd9d700 1 -- 172.21.15.12:0/2648273598 wait complete. 2023-10-08T16:10:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.802+0000 7f433dd9d700 1 Processor -- start 2023-10-08T16:10:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.802+0000 7f433dd9d700 1 -- start start 2023-10-08T16:10:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43380cf110 0x7f43380c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 0x7f4338152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4338154210 con 0x7f433815de50 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43380b43c0 con 0x7f4338153c30 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43380c9a10 con 0x7f43380cf110 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36154/0 (socket says 172.21.15.12:36154) 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 -- 172.21.15.12:0/2122041653 learned_addr learned my addr 172.21.15.12:0/2122041653 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f4337fff700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 0x7f4338152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433cd9b700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43380cf110 0x7f43380c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 -- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43380cf110 msgr2=0x7f43380c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43380cf110 0x7f43380c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 -- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 msgr2=0x7f4338152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 0x7f4338152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f433d59c700 1 -- 172.21.15.12:0/2122041653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4330009a20 con 0x7f433815de50 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.803+0000 7f4337fff700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 0x7f4338152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f433d59c700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4330013000 tx=0x7f4330019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433001e630 con 0x7f433815de50 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f433001e7d0 con 0x7f433815de50 2023-10-08T16:10:02.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433001eb90 con 0x7f433815de50 2023-10-08T16:10:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43380b37b0 con 0x7f433815de50 2023-10-08T16:10:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.804+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43380b3d70 con 0x7f433815de50 2023-10-08T16:10:02.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.805+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433804c3c0 con 0x7f433815de50 2023-10-08T16:10:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.806+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4330024070 con 0x7f433815de50 2023-10-08T16:10:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.807+0000 7f4334ff9700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 0x7f431c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.807+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4330086e00 con 0x7f433815de50 2023-10-08T16:10:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.807+0000 7f433cd9b700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 0x7f431c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:02.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.808+0000 7f433cd9b700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 0x7f431c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f432c006f00 tx=0x7f432c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:02.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:02.812+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4330053fd0 con 0x7f433815de50 2023-10-08T16:10:03.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.094+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f43380caef0 con 0x7f433815de50 2023-10-08T16:10:03.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.947+0000 7f4334ff9700 1 -- 172.21.15.12:0/2122041653 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7f43300575f0 con 0x7f433815de50 2023-10-08T16:10:03.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 msgr2=0x7f431c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 0x7f431c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f432c006f00 tx=0x7f432c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:03.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 msgr2=0x7f433816a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:03.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4330013000 tx=0x7f4330019000 comp rx=0 tx=0).stop 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 shutdown_connections 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f431c066f30 0x7f431c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f433815de50 0x7f433816a810 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43380cf110 0x7f43380c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 --2- 172.21.15.12:0/2122041653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4338153c30 0x7f4338152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 >> 172.21.15.12:0/2122041653 conn(0x7f43380703a0 msgr2=0x7f43380c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.951+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 shutdown_connections 2023-10-08T16:10:03.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:03.952+0000 7f433dd9d700 1 -- 172.21.15.12:0/2122041653 wait complete. 2023-10-08T16:10:03.973 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:10:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.169+0000 7fa28919d700 1 Processor -- start 2023-10-08T16:10:04.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.169+0000 7fa28919d700 1 -- start start 2023-10-08T16:10:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa28919d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa284140a70 0x7fa284069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa28919d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415b640 con 0x7fa28406de50 2023-10-08T16:10:04.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa28919d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28415b920 con 0x7fa2840c7c60 2023-10-08T16:10:04.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa28919d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840c6800 con 0x7fa284140a70 2023-10-08T16:10:04.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa2837fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa28406de50 0x7fa284157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41802/0 (socket says 172.21.15.12:41802) 2023-10-08T16:10:04.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa2837fe700 1 -- 172.21.15.12:0/1034108501 learned_addr learned my addr 172.21.15.12:0/1034108501 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932603286 0 0) 0x7fa28415b640 con 0x7fa28406de50 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa283fff700 1 --2- 172.21.15.12:0/1034108501 >> v2:172.21.15.29:3300/0 conn(0x7fa284140a70 0x7fa284069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.171+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26c003570 con 0x7fa28406de50 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3282004419 0 0) 0x7fa26c003570 con 0x7fa28406de50 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 >> v2:172.21.15.29:3300/0 conn(0x7fa284140a70 msgr2=0x7fa284069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 --2- 172.21.15.12:0/1034108501 >> v2:172.21.15.29:3300/0 conn(0x7fa284140a70 0x7fa284069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 >> v1:172.21.15.29:6789/0 conn(0x7fa2840c7c60 legacy=0x7fa284158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28415bc00 con 0x7fa28406de50 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fa278001470 con 0x7fa28406de50 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 >> v1:172.21.15.12:6789/0 conn(0x7fa28406de50 legacy=0x7fa284157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26c003ab0 0x7fa26c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 0x7fa26c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c005210 0x7fa26c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840c6800 con 0x7fa26c004810 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c00c130 con 0x7fa26c005210 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c00c2f0 con 0x7fa26c003ab0 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa2837fe700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 0x7fa26c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa283fff700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26c003ab0 0x7fa26c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.172+0000 7fa28899c700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c005210 0x7fa26c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 -- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26c003ab0 msgr2=0x7fa26c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26c003ab0 0x7fa26c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 -- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c005210 msgr2=0x7fa26c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c005210 0x7fa26c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 -- 172.21.15.12:0/1034108501 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c003570 con 0x7fa26c004810 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa28899c700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c005210 0x7fa26c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa28899c700 1 -- 172.21.15.12:0/1034108501 reap_dead start 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa2837fe700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 0x7fa26c004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c2d0 tx=0x7fa278001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee65ee799282e24b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800cba0 con 0x7fa26c004810 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800cd20 con 0x7fa26c004810 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.173+0000 7fa282ffd700 1 -- 172.21.15.12:0/1034108501 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278005b70 con 0x7fa26c004810 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 -- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 msgr2=0x7fa26c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 0x7fa26c004c80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c2d0 tx=0x7fa278001d80 comp rx=0 tx=0).stop 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 -- 172.21.15.12:0/1034108501 shutdown_connections 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 --2- 172.21.15.12:0/1034108501 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa26c004810 0x7fa26c004c80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 -- 172.21.15.12:0/1034108501 >> 172.21.15.12:0/1034108501 conn(0x7fa28406d110 msgr2=0x7fa2840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 -- 172.21.15.12:0/1034108501 shutdown_connections 2023-10-08T16:10:04.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.174+0000 7fa28919d700 1 -- 172.21.15.12:0/1034108501 wait complete. 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.175+0000 7fa28919d700 1 Processor -- start 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.175+0000 7fa28919d700 1 -- start start 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c004810 0x7fa2840c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa2840ae220 0x7fa284069a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b0d90 con 0x7fa2840c5da0 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840afea0 con 0x7fa26c004810 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.176+0000 7fa28919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840b0180 con 0x7fa2840ae220 2023-10-08T16:10:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36174/0 (socket says 172.21.15.12:36174) 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 -- 172.21.15.12:0/3278508788 learned_addr learned my addr 172.21.15.12:0/3278508788 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa283fff700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c004810 0x7fa2840c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa28899c700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa2840ae220 0x7fa284069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 -- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa2840ae220 msgr2=0x7fa284069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa2840ae220 0x7fa284069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 -- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c004810 msgr2=0x7fa2840c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c004810 0x7fa2840c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 -- 172.21.15.12:0/3278508788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840b0460 con 0x7fa2840c5da0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa2837fe700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c8c0 tx=0x7fa278015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.177+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278022070 con 0x7fa2840c5da0 2023-10-08T16:10:04.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.178+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa278001470 con 0x7fa2840c5da0 2023-10-08T16:10:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.178+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2840b0740 con 0x7fa2840c5da0 2023-10-08T16:10:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.178+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278007320 con 0x7fa2840c5da0 2023-10-08T16:10:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.178+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa284069f40 con 0x7fa2840c5da0 2023-10-08T16:10:04.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.179+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2840b0be0 con 0x7fa2840c5da0 2023-10-08T16:10:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.180+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa27801e430 con 0x7fa2840c5da0 2023-10-08T16:10:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.180+0000 7fa26bfff700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.181+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fa278085790 con 0x7fa2840c5da0 2023-10-08T16:10:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.181+0000 7fa283fff700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:04.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.181+0000 7fa283fff700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa274006f00 tx=0x7fa274008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:04.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.185+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2780528f0 con 0x7fa2840c5da0 2023-10-08T16:10:04.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.386+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa28404c3c0 con 0x7fa2840c5da0 2023-10-08T16:10:04.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.391+0000 7fa26bfff700 1 -- 172.21.15.12:0/3278508788 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa2780170c0 con 0x7fa2840c5da0 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 msgr2=0x7fa2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa274006f00 tx=0x7fa274008040 comp rx=0 tx=0).stop 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 msgr2=0x7fa2840adce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa27800c8c0 tx=0x7fa278015000 comp rx=0 tx=0).stop 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 shutdown_connections 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa2840ae220 0x7fa284069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa26c004810 0x7fa2840c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 --2- 172.21.15.12:0/3278508788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2840c5da0 0x7fa2840adce0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:04.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 >> 172.21.15.12:0/3278508788 conn(0x7fa28406d110 msgr2=0x7fa28415c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:04.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 shutdown_connections 2023-10-08T16:10:04.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:04.393+0000 7fa28919d700 1 -- 172.21.15.12:0/3278508788 wait complete. 2023-10-08T16:10:04.411 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:10:04.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:04.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:10:04.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:10:04.647 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:10:04.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:04.647 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-08T16:10:04.741 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:10:04.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.741 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:10:04.797 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-08T16:10:04.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:04.798 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-08T16:10:04.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:10:04.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:04.889 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-08T16:10:04.933 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-08T16:10:04.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:04.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-08T16:10:05.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:10:05.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.011 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-08T16:10:05.048 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-08T16:10:05.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:05.048 DEBUG:teuthology.orchestra.run.smithi029:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-08T16:10:05.132 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T16:10:05.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:05.132 DEBUG:teuthology.orchestra.run.smithi029:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-08T16:10:05.170 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:10:05.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.356+0000 7ff90af9d700 1 Processor -- start 2023-10-08T16:10:05.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.356+0000 7ff90af9d700 1 -- start start 2023-10-08T16:10:05.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 0x7ff90415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 0x7ff9040cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9040cef40 0x7ff90406d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90415afd0 con 0x7ff9040cef40 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90415b2b0 con 0x7ff90415de50 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.357+0000 7ff90af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90415b590 con 0x7ff904153c30 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9040cef40 0x7ff90406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff9040cef40 0x7ff90406d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36184/0 (socket says 172.21.15.12:36184) 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 -- 172.21.15.12:0/323983390 learned_addr learned my addr 172.21.15.12:0/323983390 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90979a700 1 --2- 172.21.15.12:0/323983390 >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 0x7ff9040cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff909f9b700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 0x7ff90415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 -- 172.21.15.12:0/323983390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 msgr2=0x7ff90415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 0x7ff90415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 -- 172.21.15.12:0/323983390 >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 msgr2=0x7ff9040cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 --2- 172.21.15.12:0/323983390 >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 0x7ff9040cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 -- 172.21.15.12:0/323983390 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90415b870 con 0x7ff9040cef40 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90979a700 1 --2- 172.21.15.12:0/323983390 >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 0x7ff9040cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff909f9b700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 0x7ff90415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.358+0000 7ff90a79c700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9040cef40 0x7ff90406d790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff90406e800 tx=0x7ff8fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719a1d8bb3aca998 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff908f99700 1 -- 172.21.15.12:0/323983390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc00e070 con 0x7ff9040cef40 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff908f99700 1 -- 172.21.15.12:0/323983390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc00ba50 con 0x7ff9040cef40 2023-10-08T16:10:05.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff908f99700 1 -- 172.21.15.12:0/323983390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0092e0 con 0x7ff9040cef40 2023-10-08T16:10:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 -- 172.21.15.12:0/323983390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9040cef40 msgr2=0x7ff90406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9040cef40 0x7ff90406d790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff90406e800 tx=0x7ff8fc009840 comp rx=0 tx=0).stop 2023-10-08T16:10:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 -- 172.21.15.12:0/323983390 shutdown_connections 2023-10-08T16:10:05.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff9040cef40 0x7ff90406d790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 --2- 172.21.15.12:0/323983390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff904153c30 0x7ff90415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 --2- 172.21.15.12:0/323983390 >> v2:172.21.15.29:3300/0 conn(0x7ff90415de50 0x7ff9040cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 -- 172.21.15.12:0/323983390 >> 172.21.15.12:0/323983390 conn(0x7ff9040703a0 msgr2=0x7ff9040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.359+0000 7ff90af9d700 1 -- 172.21.15.12:0/323983390 shutdown_connections 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.360+0000 7ff90af9d700 1 -- 172.21.15.12:0/323983390 wait complete. 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.361+0000 7ff90af9d700 1 Processor -- start 2023-10-08T16:10:05.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.361+0000 7ff90af9d700 1 -- start start 2023-10-08T16:10:05.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff9040cef40 0x7ff904151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff90415de50 0x7ff90414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040c7910 con 0x7ff904153c30 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414eee0 con 0x7ff90415de50 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414d670 con 0x7ff9040cef40 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36188/0 (socket says 172.21.15.12:36188) 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90979a700 1 -- 172.21.15.12:0/591800249 learned_addr learned my addr 172.21.15.12:0/591800249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff909f9b700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff9040cef40 0x7ff904151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.362+0000 7ff90a79c700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff90415de50 0x7ff90414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 -- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff9040cef40 msgr2=0x7ff904151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff9040cef40 0x7ff904151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 -- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff90415de50 msgr2=0x7ff90414d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff90415de50 0x7ff90414d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 -- 172.21.15.12:0/591800249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009ae0 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90979a700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c880 tx=0x7ff8f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4011600 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f4011760 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9040c76f0 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.363+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f4011b00 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.364+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90414f3d0 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.365+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9040c7a80 con 0x7ff904153c30 2023-10-08T16:10:05.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.366+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8f4018350 con 0x7ff904153c30 2023-10-08T16:10:05.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.366+0000 7ff8f9ffb700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 0x7ff8e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.367+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7ff8f40844e0 con 0x7ff904153c30 2023-10-08T16:10:05.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.367+0000 7ff909f9b700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 0x7ff8e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.367+0000 7ff909f9b700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 0x7ff8e80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff90000acc0 tx=0x7ff900008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.371+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9040c7a80 con 0x7ff904153c30 2023-10-08T16:10:05.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.616+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9040c7a50 con 0x7ff904153c30 2023-10-08T16:10:05.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.617+0000 7ff8f9ffb700 1 -- 172.21.15.12:0/591800249 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7ff8f40550d0 con 0x7ff904153c30 2023-10-08T16:10:05.618 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:05.618 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 msgr2=0x7ff8e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 0x7ff8e80693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff90000acc0 tx=0x7ff900008040 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 msgr2=0x7ff90414e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff8f400c880 tx=0x7ff8f4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 shutdown_connections 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff90415de50 0x7ff90414d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff9040cef40 0x7ff904151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff8e8066f30 0x7ff8e80693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 --2- 172.21.15.12:0/591800249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff904153c30 0x7ff90414e9a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.619+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 >> 172.21.15.12:0/591800249 conn(0x7ff9040703a0 msgr2=0x7ff9040c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.620+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 shutdown_connections 2023-10-08T16:10:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.620+0000 7ff90af9d700 1 -- 172.21.15.12:0/591800249 wait complete. 2023-10-08T16:10:05.622 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:10:05.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:05.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.825+0000 7fd926d9d700 1 Processor -- start 2023-10-08T16:10:05.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.825+0000 7fd926d9d700 1 -- start start 2023-10-08T16:10:05.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd926d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 0x7fd92015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd926d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd92006aaa0 0x7fd9200c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd926d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92015ae70 con 0x7fd92013fef0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd926d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92006af60 con 0x7fd92006aaa0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd926d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92006b240 con 0x7fd92013fb20 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd92559a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd92013fef0 0x7fd9200c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41814/0 (socket says 172.21.15.12:41814) 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd92559a700 1 -- 172.21.15.12:0/111547280 learned_addr learned my addr 172.21.15.12:0/111547280 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd92659c700 1 --2- 172.21.15.12:0/111547280 >> v2:172.21.15.29:3300/0 conn(0x7fd92006aaa0 0x7fd9200c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.826+0000 7fd925d9b700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 0x7fd92015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd924d99700 1 -- 172.21.15.12:0/111547280 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702084456 0 0) 0x7fd910001290 con 0x7fd92013fef0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd924d99700 1 -- 172.21.15.12:0/111547280 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd90c003570 con 0x7fd92013fef0 2023-10-08T16:10:05.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd92659c700 1 -- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 msgr2=0x7fd92015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd92659c700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 0x7fd92015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd92659c700 1 -- 172.21.15.12:0/111547280 >> v1:172.21.15.12:6789/0 conn(0x7fd92013fef0 legacy=0x7fd9200c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd92659c700 1 -- 172.21.15.12:0/111547280 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92006b520 con 0x7fd92006aaa0 2023-10-08T16:10:05.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd925d9b700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 0x7fd92015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.827+0000 7fd92659c700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92006aaa0 0x7fd9200c9d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e60 tx=0x7fd918009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c475477a4d7d7145 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd924d99700 1 -- 172.21.15.12:0/111547280 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800e070 con 0x7fd92006aaa0 2023-10-08T16:10:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd924d99700 1 -- 172.21.15.12:0/111547280 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91800bab0 con 0x7fd92006aaa0 2023-10-08T16:10:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd924d99700 1 -- 172.21.15.12:0/111547280 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91800be70 con 0x7fd92006aaa0 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 -- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92006aaa0 msgr2=0x7fd9200c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92006aaa0 0x7fd9200c9d00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd918009e60 tx=0x7fd918009780 comp rx=0 tx=0).stop 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 -- 172.21.15.12:0/111547280 shutdown_connections 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92006aaa0 0x7fd9200c9d00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 --2- 172.21.15.12:0/111547280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92013fb20 0x7fd92015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 -- 172.21.15.12:0/111547280 >> 172.21.15.12:0/111547280 conn(0x7fd92006d170 msgr2=0x7fd9200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 -- 172.21.15.12:0/111547280 shutdown_connections 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.828+0000 7fd926d9d700 1 -- 172.21.15.12:0/111547280 wait complete. 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.830+0000 7fd926d9d700 1 Processor -- start 2023-10-08T16:10:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.830+0000 7fd926d9d700 1 -- start start 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92006aaa0 0x7fd9200acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92013fef0 0x7fd9200adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd920158750 con 0x7fd92013fb20 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd920157b40 con 0x7fd92013fef0 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd926d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd920157e20 con 0x7fd92006aaa0 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36200/0 (socket says 172.21.15.12:36200) 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 -- 172.21.15.12:0/1907666354 learned_addr learned my addr 172.21.15.12:0/1907666354 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 -- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92006aaa0 msgr2=0x7fd9200acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92006aaa0 0x7fd9200acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 -- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92013fef0 msgr2=0x7fd9200adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92013fef0 0x7fd9200adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.831+0000 7fd92559a700 1 -- 172.21.15.12:0/1907666354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009420 con 0x7fd92013fb20 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd92559a700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c590 tx=0x7fd910007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100072e0 con 0x7fd92013fb20 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910007460 con 0x7fd92013fb20 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd918009a20 con 0x7fd92013fb20 2023-10-08T16:10:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100057f0 con 0x7fd92013fb20 2023-10-08T16:10:05.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.832+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9201583e0 con 0x7fd92013fb20 2023-10-08T16:10:05.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.833+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92004c3c0 con 0x7fd92013fb20 2023-10-08T16:10:05.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.834+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd910005c00 con 0x7fd92013fb20 2023-10-08T16:10:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.835+0000 7fd915ffb700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 0x7fd9040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.835+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fd910083940 con 0x7fd92013fb20 2023-10-08T16:10:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.835+0000 7fd925d9b700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 0x7fd9040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.836+0000 7fd925d9b700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 0x7fd9040693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009d60 tx=0x7fd91c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:05.839+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd91004b5a0 con 0x7fd92013fb20 2023-10-08T16:10:06.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.043+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd92015ae70 con 0x7fd92013fb20 2023-10-08T16:10:06.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.044+0000 7fd915ffb700 1 -- 172.21.15.12:0/1907666354 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15588 (secure 0 0 0) 0x7fd92015ae70 con 0x7fd92013fb20 2023-10-08T16:10:06.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:06.045 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:04.939846+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.046+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 msgr2=0x7fd9040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.046+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 0x7fd9040693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009d60 tx=0x7fd91c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 msgr2=0x7fd920158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c590 tx=0x7fd910007ae0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 shutdown_connections 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd92013fef0 0x7fd9200adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd92006aaa0 0x7fd9200acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd904066f30 0x7fd9040693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 --2- 172.21.15.12:0/1907666354 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd92013fb20 0x7fd920158be0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 >> 172.21.15.12:0/1907666354 conn(0x7fd92006d170 msgr2=0x7fd9200c1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 shutdown_connections 2023-10-08T16:10:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.047+0000 7fd926d9d700 1 -- 172.21.15.12:0/1907666354 wait complete. 2023-10-08T16:10:06.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:09:18.859708+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:09:19.430887+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:10:06.066 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:10:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.255+0000 7f6500b9d700 1 Processor -- start 2023-10-08T16:10:06.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.255+0000 7f6500b9d700 1 -- start start 2023-10-08T16:10:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.256+0000 7f6500b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64fc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.256+0000 7f6500b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc15ac50 con 0x7f64fc153a00 2023-10-08T16:10:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.256+0000 7f6500b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64fc15d010 con 0x7f64fc153dd0 2023-10-08T16:10:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.256+0000 7f6500b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15af60 con 0x7f64fc0cf110 2023-10-08T16:10:06.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f64fc153a00 0x7f64fc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41816/0 (socket says 172.21.15.12:41816) 2023-10-08T16:10:06.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fb7fe700 1 -- 172.21.15.12:0/471716621 learned_addr learned my addr 172.21.15.12:0/471716621 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fbfff700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64fc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396027405 0 0) 0x7f64fc15ac50 con 0x7f64fc153a00 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e4003570 con 0x7f64fc153a00 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794433391 0 0) 0x7f64e4003570 con 0x7f64fc153a00 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 msgr2=0x7f64fc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64fc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 >> v1:172.21.15.29:6789/0 conn(0x7f64fc153dd0 legacy=0x7f64fc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc15b240 con 0x7f64fc153a00 2023-10-08T16:10:06.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f64ec001470 con 0x7f64fc153a00 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 >> v1:172.21.15.12:6789/0 conn(0x7f64fc153a00 legacy=0x7f64fc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.257+0000 7f64fa7fc700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64e4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fa7fc700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fa7fc700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64e4004d50 0x7f64e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc15af60 con 0x7f64e4004010 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e400bbf0 con 0x7f64e4004d50 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e400bdb0 con 0x7f64fc0cf110 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fb7fe700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64e4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64fbfff700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64e4004d50 0x7f64e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 -- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 msgr2=0x7f64e4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc0cf110 0x7f64e4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 -- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64e4004d50 msgr2=0x7f64e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64e4004d50 0x7f64e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.258+0000 7f64faffd700 1 -- 172.21.15.12:0/471716621 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e4003570 con 0x7f64e4004010 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f64faffd700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64e4004810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001880 tx=0x7f64f0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2f328d888334c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0012420 con 0x7f64e4004010 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0012580 con 0x7f64e4004010 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f64fa7fc700 1 -- 172.21.15.12:0/471716621 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64f0012920 con 0x7f64e4004010 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f6500b9d700 1 -- 172.21.15.12:0/471716621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 msgr2=0x7f64e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f6500b9d700 1 --2- 172.21.15.12:0/471716621 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64e4004810 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001880 tx=0x7f64f0007d30 comp rx=0 tx=0).stop 2023-10-08T16:10:06.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f64fbfff700 1 -- 172.21.15.12:0/471716621 reap_dead start 2023-10-08T16:10:06.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f6500b9d700 1 -- 172.21.15.12:0/471716621 shutdown_connections 2023-10-08T16:10:06.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f6500b9d700 1 -- 172.21.15.12:0/471716621 >> 172.21.15.12:0/471716621 conn(0x7f64fc0703a0 msgr2=0x7f64fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.259+0000 7f6500b9d700 1 -- 172.21.15.12:0/471716621 shutdown_connections 2023-10-08T16:10:06.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.260+0000 7f6500b9d700 1 -- 172.21.15.12:0/471716621 wait complete. 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.261+0000 7f6500b9d700 1 Processor -- start 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.261+0000 7f6500b9d700 1 -- start start 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc14a160 0x7f64fc0b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 0x7f64fc0b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc150320 con 0x7f64e4004010 2023-10-08T16:10:06.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0cc5a0 con 0x7f64fc14a5d0 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f6500b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64fc0c7b20 con 0x7f64fc14a160 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f64fb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f64fb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36218/0 (socket says 172.21.15.12:36218) 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f64fb7fe700 1 -- 172.21.15.12:0/1325922475 learned_addr learned my addr 172.21.15.12:0/1325922475 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f64faffd700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc14a160 0x7f64fc0b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.262+0000 7f64fbfff700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 0x7f64fc0b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 -- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc14a160 msgr2=0x7f64fc0b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc14a160 0x7f64fc0b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 -- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 msgr2=0x7f64fc0b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 0x7f64fc0b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 -- 172.21.15.12:0/1325922475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64fc0b0ec0 con 0x7f64e4004010 2023-10-08T16:10:06.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fbfff700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 0x7f64fc0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64fb7fe700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0073c0 tx=0x7f64ec001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec018030 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00f8d0 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00fc70 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0b11a0 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.263+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64fc0cc150 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.264+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64fc0cc370 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.265+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64ec01b070 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.266+0000 7f64e37fe700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.266+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f64ec019070 con 0x7f64e4004010 2023-10-08T16:10:06.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.266+0000 7f64faffd700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.267+0000 7f64faffd700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 0x7f64e80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64f0008fd0 tx=0x7f64f0015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.271+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f64fc0cc370 con 0x7f64e4004010 2023-10-08T16:10:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.471+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f64fc0cc370 con 0x7f64e4004010 2023-10-08T16:10:06.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.471+0000 7f64e37fe700 1 -- 172.21.15.12:0/1325922475 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64fc0cc370 con 0x7f64e4004010 2023-10-08T16:10:06.472 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 msgr2=0x7f64e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 0x7f64e80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f64f0008fd0 tx=0x7f64f0015000 comp rx=0 tx=0).stop 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 msgr2=0x7f64fc0c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0073c0 tx=0x7f64ec001e50 comp rx=0 tx=0).stop 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 shutdown_connections 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f64e8066f30 0x7f64e80693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f64e4004010 0x7f64fc0c75e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f64fc14a5d0 0x7f64fc0b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 --2- 172.21.15.12:0/1325922475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f64fc14a160 0x7f64fc0b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 >> 172.21.15.12:0/1325922475 conn(0x7f64fc0703a0 msgr2=0x7f64fc0c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 shutdown_connections 2023-10-08T16:10:06.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.474+0000 7f6500b9d700 1 -- 172.21.15.12:0/1325922475 wait complete. 2023-10-08T16:10:06.492 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:10:06.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.682+0000 7f68a319d700 1 Processor -- start 2023-10-08T16:10:06.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.682+0000 7f68a319d700 1 -- start start 2023-10-08T16:10:06.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.683+0000 7f68a319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.683+0000 7f68a319d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 0x7f689c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.683+0000 7f68a319d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f689c15af60 con 0x7f689c0cea00 2023-10-08T16:10:06.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.683+0000 7f68a319d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f689c15d010 con 0x7f689c15de50 2023-10-08T16:10:06.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.683+0000 7f68a319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c15b240 con 0x7f689c153a00 2023-10-08T16:10:06.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a219b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a199a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 0x7f689c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a199a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 0x7f689c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38150/0 (socket says 172.21.15.12:38150) 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a219b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:45710/0 (socket says 172.21.15.12:45710) 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a199a700 1 -- 172.21.15.12:0/181664353 learned_addr learned my addr 172.21.15.12:0/181664353 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.684+0000 7f68a299c700 1 --1- 172.21.15.12:0/181664353 >> v1:172.21.15.29:6789/0 conn(0x7f689c0cea00 0x7f689c0cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:37108/0 (socket says 172.21.15.12:37108) 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a219b700 1 -- 172.21.15.12:0/181664353 >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 msgr2=0x7f689c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a219b700 1 --2- 172.21.15.12:0/181664353 >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 0x7f689c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a219b700 1 -- 172.21.15.12:0/181664353 >> v1:172.21.15.29:6789/0 conn(0x7f689c0cea00 legacy=0x7f689c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a1199700 1 -- 172.21.15.12:0/181664353 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766965663 0 0) 0x7f689c15af60 con 0x7f689c0cea00 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a219b700 1 -- 172.21.15.12:0/181664353 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f689c15b520 con 0x7f689c153a00 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a219b700 1 --2- 172.21.15.12:0/181664353 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68980098e0 tx=0x7f68980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bded9219787217e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a1199700 1 -- 172.21.15.12:0/181664353 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800b640 con 0x7f689c153a00 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a1199700 1 -- 172.21.15.12:0/181664353 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f689800b7a0 con 0x7f689c153a00 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.685+0000 7f68a1199700 1 -- 172.21.15.12:0/181664353 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800bb40 con 0x7f689c153a00 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 -- 172.21.15.12:0/181664353 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 msgr2=0x7f689c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 --2- 172.21.15.12:0/181664353 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f68980098e0 tx=0x7f68980091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 -- 172.21.15.12:0/181664353 shutdown_connections 2023-10-08T16:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 --2- 172.21.15.12:0/181664353 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c153a00 0x7f689c153dd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 --2- 172.21.15.12:0/181664353 >> v2:172.21.15.29:3300/0 conn(0x7f689c15de50 0x7f689c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 -- 172.21.15.12:0/181664353 >> 172.21.15.12:0/181664353 conn(0x7f689c0703a0 msgr2=0x7f689c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 -- 172.21.15.12:0/181664353 shutdown_connections 2023-10-08T16:10:06.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.686+0000 7f68a319d700 1 -- 172.21.15.12:0/181664353 wait complete. 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.687+0000 7f68a319d700 1 Processor -- start 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.687+0000 7f68a319d700 1 -- start start 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 0x7f689c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c15de50 0x7f689c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c150f20 con 0x7f689c0cea00 2023-10-08T16:10:06.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0b1a10 con 0x7f689c153a00 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.688+0000 7f68a319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f689c0b1cf0 con 0x7f689c15de50 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36232/0 (socket says 172.21.15.12:36232) 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 -- 172.21.15.12:0/3154023422 learned_addr learned my addr 172.21.15.12:0/3154023422 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 -- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c15de50 msgr2=0x7f689c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c15de50 0x7f689c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 -- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 msgr2=0x7f689c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a199a700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 0x7f689c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 0x7f689c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 -- 172.21.15.12:0/3154023422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898009420 con 0x7f689c0cea00 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a199a700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 0x7f689c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:06.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.689+0000 7f68a219b700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f689c15b380 tx=0x7f6898017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.690+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f689800bb20 con 0x7f689c0cea00 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.690+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6898011420 con 0x7f689c0cea00 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.690+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68980117c0 con 0x7f689c0cea00 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.690+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f689c0b1fd0 con 0x7f689c0cea00 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.690+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f689c0b2590 con 0x7f689c0cea00 2023-10-08T16:10:06.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.691+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689c0b2780 con 0x7f689c0cea00 2023-10-08T16:10:06.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.692+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6898011b70 con 0x7f689c0cea00 2023-10-08T16:10:06.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.693+0000 7f68927fc700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:06.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.693+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f6898085c30 con 0x7f689c0cea00 2023-10-08T16:10:06.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.693+0000 7f68a199a700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:06.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.693+0000 7f68a199a700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 0x7f68800693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f688c006d40 tx=0x7f688c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:06.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.697+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6898052e30 con 0x7f689c0cea00 2023-10-08T16:10:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.901+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f689c04c3c0 con 0x7f689c0cea00 2023-10-08T16:10:06.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.902+0000 7f68927fc700 1 -- 172.21.15.12:0/3154023422 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6898056450 con 0x7f689c0cea00 2023-10-08T16:10:06.903 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:10:06.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 msgr2=0x7f68800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 0x7f68800693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f688c006d40 tx=0x7f688c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:06.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 msgr2=0x7f689c1509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:06.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f689c15b380 tx=0x7f6898017000 comp rx=0 tx=0).stop 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 shutdown_connections 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6880066f30 0x7f68800693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f689c0cea00 0x7f689c1509e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f689c15de50 0x7f689c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 --2- 172.21.15.12:0/3154023422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f689c153a00 0x7f689c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 >> 172.21.15.12:0/3154023422 conn(0x7f689c0703a0 msgr2=0x7f689c158540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 shutdown_connections 2023-10-08T16:10:06.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:06.904+0000 7f68a319d700 1 -- 172.21.15.12:0/3154023422 wait complete. 2023-10-08T16:10:06.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:10:07.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.113+0000 7f713f39d700 1 Processor -- start 2023-10-08T16:10:07.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.113+0000 7f713f39d700 1 -- start start 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713f39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71380accb0 0x7f71380aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f71380cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713f39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71380cc850 con 0x7f713806e330 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713f39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71380ad780 con 0x7f71380accb0 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71380cee60 con 0x7f71380cbea0 2023-10-08T16:10:07.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713e39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71380accb0 0x7f71380aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713eb9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f713806e330 0x7f713806e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41822/0 (socket says 172.21.15.12:41822) 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713eb9c700 1 -- 172.21.15.12:0/1949529910 learned_addr learned my addr 172.21.15.12:0/1949529910 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713db9a700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f71380cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713e39b700 1 -- 172.21.15.12:0/1949529910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 msgr2=0x7f71380cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713e39b700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f71380cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713e39b700 1 -- 172.21.15.12:0/1949529910 >> v1:172.21.15.12:6789/0 conn(0x7f713806e330 legacy=0x7f713806e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713e39b700 1 -- 172.21.15.12:0/1949529910 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71380cf140 con 0x7f71380accb0 2023-10-08T16:10:07.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.115+0000 7f713d399700 1 -- 172.21.15.12:0/1949529910 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3598797559 0 0) 0x7f71380cc850 con 0x7f713806e330 2023-10-08T16:10:07.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.116+0000 7f713e39b700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f71380aaed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f71340098e0 tx=0x7f71340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c7c6d09c7f841b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.116+0000 7f713d399700 1 -- 172.21.15.12:0/1949529910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134009e80 con 0x7f71380accb0 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.116+0000 7f713d399700 1 -- 172.21.15.12:0/1949529910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400b860 con 0x7f71380accb0 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.116+0000 7f713d399700 1 -- 172.21.15.12:0/1949529910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400bbe0 con 0x7f71380accb0 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.116+0000 7f713f39d700 1 -- 172.21.15.12:0/1949529910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 msgr2=0x7f71380aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f71380aaed0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f71340098e0 tx=0x7f71340091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 -- 172.21.15.12:0/1949529910 shutdown_connections 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f71380aaed0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 --2- 172.21.15.12:0/1949529910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f71380cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 -- 172.21.15.12:0/1949529910 >> 172.21.15.12:0/1949529910 conn(0x7f713806ce80 msgr2=0x7f71380ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 -- 172.21.15.12:0/1949529910 shutdown_connections 2023-10-08T16:10:07.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.117+0000 7f713f39d700 1 -- 172.21.15.12:0/1949529910 wait complete. 2023-10-08T16:10:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.118+0000 7f713f39d700 1 Processor -- start 2023-10-08T16:10:07.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.118+0000 7f713f39d700 1 -- start start 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f713806e330 0x7f71380c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f7138149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71380c6d30 con 0x7f71380accb0 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713816ab90 con 0x7f713806e330 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71380c2fc0 con 0x7f71380cbea0 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36262/0 (socket says 172.21.15.12:36262) 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.119+0000 7f713db9a700 1 -- 172.21.15.12:0/2616388661 learned_addr learned my addr 172.21.15.12:0/2616388661 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:07.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713eb9c700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f7138149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713e39b700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f713806e330 0x7f71380c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 -- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 msgr2=0x7f7138149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f7138149340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 -- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f713806e330 msgr2=0x7f71380c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f713806e330 0x7f71380c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 -- 172.21.15.12:0/2616388661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7134009420 con 0x7f71380accb0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713db9a700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f712800d860 tx=0x7f7128008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128009610 con 0x7f71380accb0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7128009770 con 0x7f71380accb0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7128009b30 con 0x7f71380accb0 2023-10-08T16:10:07.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.120+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71380c6490 con 0x7f71380accb0 2023-10-08T16:10:07.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.121+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71380c6a50 con 0x7f71380accb0 2023-10-08T16:10:07.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.121+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713804c3c0 con 0x7f71380accb0 2023-10-08T16:10:07.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.122+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f712801e460 con 0x7f71380accb0 2023-10-08T16:10:07.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.123+0000 7f712e7fc700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.123+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f7128084cb0 con 0x7f71380accb0 2023-10-08T16:10:07.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.123+0000 7f713e39b700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.124+0000 7f713e39b700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 0x7f711c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71340091e0 tx=0x7f7134017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.127+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7128051e10 con 0x7f71380accb0 2023-10-08T16:10:07.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.328+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f71380c1b50 con 0x7f71380accb0 2023-10-08T16:10:07.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.328+0000 7f712e7fc700 1 -- 172.21.15.12:0/2616388661 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7128055430 con 0x7f71380accb0 2023-10-08T16:10:07.329 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 msgr2=0x7f711c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 0x7f711c0693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f71340091e0 tx=0x7f7134017000 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 msgr2=0x7f7138169f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f712800d860 tx=0x7f7128008040 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 shutdown_connections 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71380cbea0 0x7f7138149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f713806e330 0x7f71380c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f711c066f30 0x7f711c0693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 --2- 172.21.15.12:0/2616388661 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71380accb0 0x7f7138169f80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 >> 172.21.15.12:0/2616388661 conn(0x7f713806ce80 msgr2=0x7f71380ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:07.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 shutdown_connections 2023-10-08T16:10:07.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.331+0000 7f713f39d700 1 -- 172.21.15.12:0/2616388661 wait complete. 2023-10-08T16:10:07.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:07.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.536+0000 7f541359e700 1 Processor -- start 2023-10-08T16:10:07.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.536+0000 7f541359e700 1 -- start start 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 0x7f541415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f541415de50 0x7f54140cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541415afd0 con 0x7f54140cef40 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f541415b2b0 con 0x7f541415de50 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f541415b590 con 0x7f5414153c30 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f5411d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f541415de50 0x7f54140cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f541259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 0x7f541415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f5412d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f54140cef40 0x7f541406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:37110/0 (socket says 172.21.15.12:37110) 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.537+0000 7f5412d9d700 1 -- 172.21.15.12:0/2742524562 learned_addr learned my addr 172.21.15.12:0/2742524562 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:07.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f5411d9b700 1 -- 172.21.15.12:0/2742524562 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 msgr2=0x7f541415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f541159a700 1 -- 172.21.15.12:0/2742524562 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159149225 0 0) 0x7f541415afd0 con 0x7f54140cef40 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f5411d9b700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 0x7f541415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f5411d9b700 1 -- 172.21.15.12:0/2742524562 >> v1:172.21.15.29:6789/0 conn(0x7f54140cef40 legacy=0x7f541406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f5411d9b700 1 -- 172.21.15.12:0/2742524562 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541415b870 con 0x7f541415de50 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f541259c700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 0x7f541415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f5411d9b700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f541415de50 0x7f54140cea00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f54080098e0 tx=0x7f54080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798635bace4d464 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.538+0000 7f541159a700 1 -- 172.21.15.12:0/2742524562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800b640 con 0x7f541415de50 2023-10-08T16:10:07.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541159a700 1 -- 172.21.15.12:0/2742524562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800b7a0 con 0x7f541415de50 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541159a700 1 -- 172.21.15.12:0/2742524562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800bb40 con 0x7f541415de50 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 -- 172.21.15.12:0/2742524562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f541415de50 msgr2=0x7f54140cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f541415de50 0x7f54140cea00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f54080098e0 tx=0x7f54080091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 -- 172.21.15.12:0/2742524562 shutdown_connections 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5414153c30 0x7f541415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 --2- 172.21.15.12:0/2742524562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f541415de50 0x7f54140cea00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 -- 172.21.15.12:0/2742524562 >> 172.21.15.12:0/2742524562 conn(0x7f54140703a0 msgr2=0x7f54140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 -- 172.21.15.12:0/2742524562 shutdown_connections 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.539+0000 7f541359e700 1 -- 172.21.15.12:0/2742524562 wait complete. 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.541+0000 7f541359e700 1 Processor -- start 2023-10-08T16:10:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.541+0000 7f541359e700 1 -- start start 2023-10-08T16:10:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f54140cef40 0x7f54140c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541415de50 0x7f54140cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c9990 con 0x7f5414153c30 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140cd500 con 0x7f541415de50 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c8fc0 con 0x7f54140cef40 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36288/0 (socket says 172.21.15.12:36288) 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 -- 172.21.15.12:0/1689192904 learned_addr learned my addr 172.21.15.12:0/1689192904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f541259c700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f54140cef40 0x7f54140c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5412d9d700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541415de50 0x7f54140cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 -- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f54140cef40 msgr2=0x7f54140c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f54140cef40 0x7f54140c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 -- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541415de50 msgr2=0x7f54140cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.542+0000 7f5411d9b700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541415de50 0x7f54140cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f5411d9b700 1 -- 172.21.15.12:0/1689192904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404009420 con 0x7f5414153c30 2023-10-08T16:10:07.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f5411d9b700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f541406eb00 tx=0x7f5408017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800bb20 con 0x7f5414153c30 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5408000c90 con 0x7f5414153c30 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5408009420 con 0x7f5414153c30 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408011650 con 0x7f5414153c30 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.543+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54140c8710 con 0x7f5414153c30 2023-10-08T16:10:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.544+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f541404c3c0 con 0x7f5414153c30 2023-10-08T16:10:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.545+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5408011a40 con 0x7f5414153c30 2023-10-08T16:10:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.546+0000 7f54027fc700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.546+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f5408085b00 con 0x7f5414153c30 2023-10-08T16:10:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.547+0000 7f541259c700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:07.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.547+0000 7f541259c700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5404009f40 tx=0x7f54040091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:07.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.550+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5408087e60 con 0x7f5414153c30 2023-10-08T16:10:07.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.796+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54140b6300 con 0x7f5414153c30 2023-10-08T16:10:07.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.796+0000 7f54027fc700 1 -- 172.21.15.12:0/1689192904 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f5408052c60 con 0x7f5414153c30 2023-10-08T16:10:07.797 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:07.797 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 msgr2=0x7f53f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 0x7f53f40693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5404009f40 tx=0x7f54040091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 msgr2=0x7f5414152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f541406eb00 tx=0x7f5408017000 comp rx=0 tx=0).stop 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 shutdown_connections 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f541415de50 0x7f54140cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f54140cef40 0x7f54140c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f53f4066f30 0x7f53f40693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 --2- 172.21.15.12:0/1689192904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5414153c30 0x7f5414152ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 >> 172.21.15.12:0/1689192904 conn(0x7f54140703a0 msgr2=0x7f5414070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 shutdown_connections 2023-10-08T16:10:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:07.799+0000 7f541359e700 1 -- 172.21.15.12:0/1689192904 wait complete. 2023-10-08T16:10:07.801 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:10:07.817 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.006+0000 7fb69a39d700 1 Processor -- start 2023-10-08T16:10:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.006+0000 7fb69a39d700 1 -- start start 2023-10-08T16:10:08.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69a39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb694159640 0x7fb69406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69a39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6940c7420 con 0x7fb694159a10 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69a39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69406d5a0 con 0x7fb6940caec0 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69a39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69406d820 con 0x7fb694159640 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69939b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb694159640 0x7fb69406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb698b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb694159a10 0x7fb6940ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41836/0 (socket says 172.21.15.12:41836) 2023-10-08T16:10:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb698b9a700 1 -- 172.21.15.12:0/3798470240 learned_addr learned my addr 172.21.15.12:0/3798470240 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69939b700 1 -- 172.21.15.12:0/3798470240 >> v1:172.21.15.29:6789/0 conn(0x7fb6940caec0 legacy=0x7fb6940c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69939b700 1 -- 172.21.15.12:0/3798470240 >> v1:172.21.15.12:6789/0 conn(0x7fb694159a10 legacy=0x7fb6940ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.008+0000 7fb69939b700 1 -- 172.21.15.12:0/3798470240 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69406db00 con 0x7fb694159640 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb69939b700 1 --2- 172.21.15.12:0/3798470240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb69406d060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb690009910 tx=0x7fb6900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814a105f45cba89f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb68bfff700 1 -- 172.21.15.12:0/3798470240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000b820 con 0x7fb694159640 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb68bfff700 1 -- 172.21.15.12:0/3798470240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000b980 con 0x7fb694159640 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb68bfff700 1 -- 172.21.15.12:0/3798470240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69000bd20 con 0x7fb694159640 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb69a39d700 1 -- 172.21.15.12:0/3798470240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 msgr2=0x7fb69406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.009+0000 7fb69a39d700 1 --2- 172.21.15.12:0/3798470240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb69406d060 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb690009910 tx=0x7fb6900091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.010+0000 7fb69a39d700 1 -- 172.21.15.12:0/3798470240 shutdown_connections 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.010+0000 7fb69a39d700 1 --2- 172.21.15.12:0/3798470240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb69406d060 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.010+0000 7fb69a39d700 1 -- 172.21.15.12:0/3798470240 >> 172.21.15.12:0/3798470240 conn(0x7fb69406e720 msgr2=0x7fb69406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.010+0000 7fb69a39d700 1 -- 172.21.15.12:0/3798470240 shutdown_connections 2023-10-08T16:10:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.010+0000 7fb69a39d700 1 -- 172.21.15.12:0/3798470240 wait complete. 2023-10-08T16:10:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.011+0000 7fb69a39d700 1 Processor -- start 2023-10-08T16:10:08.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.011+0000 7fb69a39d700 1 -- start start 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6940caec0 0x7fb6940afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694159a10 0x7fb69416af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb694143c30 con 0x7fb694159640 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69415d220 con 0x7fb694159a10 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb69a39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6940b0090 con 0x7fb6940caec0 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb698b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb698b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36306/0 (socket says 172.21.15.12:36306) 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.012+0000 7fb698b9a700 1 -- 172.21.15.12:0/1118890316 learned_addr learned my addr 172.21.15.12:0/1118890316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb69939b700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6940caec0 0x7fb6940afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb699b9c700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694159a10 0x7fb69416af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 -- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6940caec0 msgr2=0x7fb6940afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6940caec0 0x7fb6940afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 -- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694159a10 msgr2=0x7fb69416af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694159a10 0x7fb69416af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 -- 172.21.15.12:0/1118890316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690009420 con 0x7fb694159640 2023-10-08T16:10:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb698b9a700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c590 tx=0x7fb684001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684005b30 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb684005cb0 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb684007320 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.013+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6940b24d0 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.014+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69415c8f0 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.014+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69415d390 con 0x7fb694159640 2023-10-08T16:10:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.015+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb68401b3b0 con 0x7fb694159640 2023-10-08T16:10:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.016+0000 7fb6897fa700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 0x7fb6780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.016+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fb6840839c0 con 0x7fb694159640 2023-10-08T16:10:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.017+0000 7fb69939b700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 0x7fb6780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.017+0000 7fb69939b700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 0x7fb6780693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6900093f0 tx=0x7fb690017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.020+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb684050b20 con 0x7fb694159640 2023-10-08T16:10:08.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.226+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6940cb2f0 con 0x7fb694159640 2023-10-08T16:10:08.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.227+0000 7fb6897fa700 1 -- 172.21.15.12:0/1118890316 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15588 (secure 0 0 0) 0x7fb684017090 con 0x7fb694159640 2023-10-08T16:10:08.230 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:08.230 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:04.939846+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 msgr2=0x7fb6780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 0x7fb6780693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6900093f0 tx=0x7fb690017000 comp rx=0 tx=0).stop 2023-10-08T16:10:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 msgr2=0x7fb6940b1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb68400c590 tx=0x7fb684001020 comp rx=0 tx=0).stop 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 shutdown_connections 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb694159a10 0x7fb69416af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6940caec0 0x7fb6940afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb678066f30 0x7fb6780693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 --2- 172.21.15.12:0/1118890316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb694159640 0x7fb6940b1f90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.229+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 >> 172.21.15.12:0/1118890316 conn(0x7fb69406e720 msgr2=0x7fb694157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.230+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 shutdown_connections 2023-10-08T16:10:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.230+0000 7fb69a39d700 1 -- 172.21.15.12:0/1118890316 wait complete. 2023-10-08T16:10:08.249 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:10:08.249 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:08.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.434+0000 7f1e78fff700 1 Processor -- start 2023-10-08T16:10:08.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.434+0000 7f1e78fff700 1 -- start start 2023-10-08T16:10:08.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.435+0000 7f1e78fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e74157600 0x7f1e740b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.435+0000 7f1e78fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e740ccba0 0x7f1e740b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.435+0000 7f1e78fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e74158210 con 0x7f1e741579d0 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.435+0000 7f1e78fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e740cb850 con 0x7f1e740ccba0 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.435+0000 7f1e78fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740cb290 con 0x7f1e74157600 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e72d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e740ccba0 0x7f1e740b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e71d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1e741579d0 0x7f1e741586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41842/0 (socket says 172.21.15.12:41842) 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e71d9b700 1 -- 172.21.15.12:0/3890675441 learned_addr learned my addr 172.21.15.12:0/3890675441 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e7259c700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e74157600 0x7f1e740b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e7159a700 1 -- 172.21.15.12:0/3890675441 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195668238 0 0) 0x7f1e74158210 con 0x7f1e741579d0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e7159a700 1 -- 172.21.15.12:0/3890675441 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e5c003570 con 0x7f1e741579d0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e72d9d700 1 -- 172.21.15.12:0/3890675441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e74157600 msgr2=0x7f1e740b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e72d9d700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e74157600 0x7f1e740b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e72d9d700 1 -- 172.21.15.12:0/3890675441 >> v1:172.21.15.12:6789/0 conn(0x7f1e741579d0 legacy=0x7f1e741586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.436+0000 7f1e72d9d700 1 -- 172.21.15.12:0/3890675441 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e740cb570 con 0x7f1e740ccba0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e72d9d700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e740b1950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e60 tx=0x7f1e6c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38afeff5eaa6fc8e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e7159a700 1 -- 172.21.15.12:0/3890675441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00e070 con 0x7f1e740ccba0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e7159a700 1 -- 172.21.15.12:0/3890675441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00bab0 con 0x7f1e740ccba0 2023-10-08T16:10:08.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e7159a700 1 -- 172.21.15.12:0/3890675441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00be70 con 0x7f1e740ccba0 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 -- 172.21.15.12:0/3890675441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 msgr2=0x7f1e740b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e740b1950 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e60 tx=0x7f1e6c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 -- 172.21.15.12:0/3890675441 shutdown_connections 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e740b1950 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 --2- 172.21.15.12:0/3890675441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e74157600 0x7f1e740b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 -- 172.21.15.12:0/3890675441 >> 172.21.15.12:0/3890675441 conn(0x7f1e7406d170 msgr2=0x7f1e740cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.437+0000 7f1e78fff700 1 -- 172.21.15.12:0/3890675441 shutdown_connections 2023-10-08T16:10:08.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.438+0000 7f1e78fff700 1 -- 172.21.15.12:0/3890675441 wait complete. 2023-10-08T16:10:08.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.439+0000 7f1e78fff700 1 Processor -- start 2023-10-08T16:10:08.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.439+0000 7f1e78fff700 1 -- start start 2023-10-08T16:10:08.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 0x7f1e74145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e741579d0 0x7f1e74150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c54b0 con 0x7f1e740ccba0 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c6030 con 0x7f1e74157600 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e78fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c5700 con 0x7f1e741579d0 2023-10-08T16:10:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e7259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e7259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36324/0 (socket says 172.21.15.12:36324) 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e7259c700 1 -- 172.21.15.12:0/232498207 learned_addr learned my addr 172.21.15.12:0/232498207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e72d9d700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e741579d0 0x7f1e74150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.440+0000 7f1e71d9b700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 0x7f1e74145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 -- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e741579d0 msgr2=0x7f1e74150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e741579d0 0x7f1e74150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 -- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 msgr2=0x7f1e74145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 0x7f1e74145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 -- 172.21.15.12:0/232498207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009a20 con 0x7f1e740ccba0 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e71d9b700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 0x7f1e74145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:08.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e7259c700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400ec80 tx=0x7f1e640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400c850 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6400c9b0 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e740c59e0 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6400cd50 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.441+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e741532f0 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.442+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7404c3c0 con 0x7f1e740ccba0 2023-10-08T16:10:08.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.443+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e64013680 con 0x7f1e740ccba0 2023-10-08T16:10:08.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.445+0000 7f1e627fc700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 0x7f1e540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.445+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f1e64084900 con 0x7f1e740ccba0 2023-10-08T16:10:08.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.445+0000 7f1e71d9b700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 0x7f1e540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.445+0000 7f1e71d9b700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 0x7f1e540693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e680058d0 tx=0x7f1e68009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.449+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e64051a60 con 0x7f1e740ccba0 2023-10-08T16:10:08.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.695+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e740c84e0 con 0x7f1e740ccba0 2023-10-08T16:10:08.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.696+0000 7f1e627fc700 1 -- 172.21.15.12:0/232498207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f1e64055080 con 0x7f1e740ccba0 2023-10-08T16:10:08.696 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:08.697 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 msgr2=0x7f1e540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 0x7f1e540693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1e680058d0 tx=0x7f1e68009040 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 msgr2=0x7f1e74152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1e6400ec80 tx=0x7f1e640091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 shutdown_connections 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e54066f30 0x7f1e540693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e740ccba0 0x7f1e74152db0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e741579d0 0x7f1e74150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 --2- 172.21.15.12:0/232498207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e74157600 0x7f1e74145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 >> 172.21.15.12:0/232498207 conn(0x7f1e7406d170 msgr2=0x7f1e741597f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 shutdown_connections 2023-10-08T16:10:08.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.698+0000 7f1e78fff700 1 -- 172.21.15.12:0/232498207 wait complete. 2023-10-08T16:10:08.701 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:10:08.716 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.902+0000 7f8c3f59d700 1 Processor -- start 2023-10-08T16:10:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.902+0000 7f8c3f59d700 1 -- start start 2023-10-08T16:10:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.903+0000 7f8c3f59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c38159550 0x7f8c380ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3f59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c38159920 0x7f8c380ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3f59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c380acc00 con 0x7f8c3815dfd0 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3f59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380abff0 con 0x7f8c38159920 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3f59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380ac2d0 con 0x7f8c38159550 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c38159920 0x7f8c380ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c38159920 0x7f8c380ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36326/0 (socket says 172.21.15.12:36326) 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 -- 172.21.15.12:0/2073011733 learned_addr learned my addr 172.21.15.12:0/2073011733 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:08.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3e59b700 1 --2- 172.21.15.12:0/2073011733 >> v2:172.21.15.29:3300/0 conn(0x7f8c38159550 0x7f8c380ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 -- 172.21.15.12:0/2073011733 >> v2:172.21.15.29:3300/0 conn(0x7f8c38159550 msgr2=0x7f8c380ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 --2- 172.21.15.12:0/2073011733 >> v2:172.21.15.29:3300/0 conn(0x7f8c38159550 0x7f8c380ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 -- 172.21.15.12:0/2073011733 >> v1:172.21.15.29:6789/0 conn(0x7f8c3815dfd0 legacy=0x7f8c380aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.904+0000 7f8c3ed9c700 1 -- 172.21.15.12:0/2073011733 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380ac5b0 con 0x7f8c38159920 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3ed9c700 1 --2- 172.21.15.12:0/2073011733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159920 0x7f8c380ad090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c38064270 tx=0x7f8c30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfe7ce99b7e4639 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3d599700 1 -- 172.21.15.12:0/2073011733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000e070 con 0x7f8c38159920 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3d599700 1 -- 172.21.15.12:0/2073011733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000ba20 con 0x7f8c38159920 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3d599700 1 -- 172.21.15.12:0/2073011733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c300092e0 con 0x7f8c38159920 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2073011733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159920 msgr2=0x7f8c380ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.905+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2073011733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159920 0x7f8c380ad090 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8c38064270 tx=0x7f8c30009840 comp rx=0 tx=0).stop 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2073011733 shutdown_connections 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2073011733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159920 0x7f8c380ad090 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2073011733 >> v2:172.21.15.29:3300/0 conn(0x7f8c38159550 0x7f8c380ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2073011733 >> 172.21.15.12:0/2073011733 conn(0x7f8c3806ce80 msgr2=0x7f8c380ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2073011733 shutdown_connections 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.906+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2073011733 wait complete. 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.907+0000 7f8c3f59d700 1 Processor -- start 2023-10-08T16:10:08.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.907+0000 7f8c3f59d700 1 -- start start 2023-10-08T16:10:08.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c38159920 0x7f8c380c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c3815dfd0 0x7f8c380b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38169b50 con 0x7f8c38159550 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38169df0 con 0x7f8c38159920 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3816a0d0 con 0x7f8c3815dfd0 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36332/0 (socket says 172.21.15.12:36332) 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.908+0000 7f8c3e59b700 1 -- 172.21.15.12:0/2250324232 learned_addr learned my addr 172.21.15.12:0/2250324232 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3ed9c700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c3815dfd0 0x7f8c380b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3dd9a700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c38159920 0x7f8c380c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 -- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c3815dfd0 msgr2=0x7f8c380b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c3815dfd0 0x7f8c380b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 -- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c38159920 msgr2=0x7f8c380c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c38159920 0x7f8c380c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 -- 172.21.15.12:0/2250324232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30009ae0 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3e59b700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400ec80 tx=0x7f8c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3400c9d0 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3400cb30 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c34013470 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.909+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3816a3b0 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.910+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c381559a0 con 0x7f8c38159550 2023-10-08T16:10:08.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.910+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3816aa00 con 0x7f8c38159550 2023-10-08T16:10:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.911+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c34013820 con 0x7f8c38159550 2023-10-08T16:10:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.912+0000 7f8c2e7fc700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.912+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f8c340849d0 con 0x7f8c38159550 2023-10-08T16:10:08.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.913+0000 7f8c3dd9a700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:08.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.913+0000 7f8c3dd9a700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 0x7f8c1c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c3815dfa0 tx=0x7f8c28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:08.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:08.917+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c34051b30 con 0x7f8c38159550 2023-10-08T16:10:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.168+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c3804c3c0 con 0x7f8c38159550 2023-10-08T16:10:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.169+0000 7f8c2e7fc700 1 -- 172.21.15.12:0/2250324232 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f8c34055150 con 0x7f8c38159550 2023-10-08T16:10:09.170 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:09.170 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/4287549073","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":4287549073},{"type":"v1","addr":"172.21.15.12:6835","nonce":4287549073}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/790804434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":790804434},{"type":"v1","addr":"172.21.15.12:6837","nonce":790804434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/470513785","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":470513785},{"type":"v1","addr":"172.21.15.29:6834","nonce":470513785}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:09:20.453996+0000","modified":"2023-10-08T16:09:23.973059+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/3750481948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3750481948},{"type":"v1","addr":"172.21.15.29:6835","nonce":3750481948}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-08T16:10:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 msgr2=0x7f8c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 0x7f8c1c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c3815dfa0 tx=0x7f8c28009040 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 msgr2=0x7f8c381511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400ec80 tx=0x7f8c340091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 shutdown_connections 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8c1c066f30 0x7f8c1c0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c38159550 0x7f8c381511b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c3815dfd0 0x7f8c380b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 --2- 172.21.15.12:0/2250324232 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c38159920 0x7f8c380c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 >> 172.21.15.12:0/2250324232 conn(0x7f8c3806ce80 msgr2=0x7f8c38152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 shutdown_connections 2023-10-08T16:10:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.171+0000 7f8c3f59d700 1 -- 172.21.15.12:0/2250324232 wait complete. 2023-10-08T16:10:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 8 2023-10-08T16:10:09.189 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:09.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.375+0000 7f2198f9d700 1 Processor -- start 2023-10-08T16:10:09.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.375+0000 7f2198f9d700 1 -- start start 2023-10-08T16:10:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f219413fb20 0x7f219415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 0x7f21940c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f219406aaa0 0x7f21940c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21940c8410 con 0x7f219406aaa0 2023-10-08T16:10:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219415ae70 con 0x7f219413fb20 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2198f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219406af60 con 0x7f219413fef0 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2193fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f219406aaa0 0x7f21940c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2193fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f219406aaa0 0x7f21940c7ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36342/0 (socket says 172.21.15.12:36342) 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.376+0000 7f2193fff700 1 -- 172.21.15.12:0/2356992896 learned_addr learned my addr 172.21.15.12:0/2356992896 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f21937fe700 1 --2- 172.21.15.12:0/2356992896 >> v2:172.21.15.29:3300/0 conn(0x7f219413fb20 0x7f219415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2192ffd700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 0x7f21940c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 -- 172.21.15.12:0/2356992896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 msgr2=0x7f21940c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 0x7f21940c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 -- 172.21.15.12:0/2356992896 >> v2:172.21.15.29:3300/0 conn(0x7f219413fb20 msgr2=0x7f219415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 --2- 172.21.15.12:0/2356992896 >> v2:172.21.15.29:3300/0 conn(0x7f219413fb20 0x7f219415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 -- 172.21.15.12:0/2356992896 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219406b240 con 0x7f219406aaa0 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2192ffd700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 0x7f21940c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:09.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f2193fff700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219406aaa0 0x7f21940c7ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21940695b0 tx=0x7f218c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3ac0294f53e7cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.377+0000 7f21927fc700 1 -- 172.21.15.12:0/2356992896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00e070 con 0x7f219406aaa0 2023-10-08T16:10:09.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f21927fc700 1 -- 172.21.15.12:0/2356992896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c00ba50 con 0x7f219406aaa0 2023-10-08T16:10:09.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f21927fc700 1 -- 172.21.15.12:0/2356992896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0092e0 con 0x7f219406aaa0 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 -- 172.21.15.12:0/2356992896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219406aaa0 msgr2=0x7f21940c7ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219406aaa0 0x7f21940c7ed0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f21940695b0 tx=0x7f218c009840 comp rx=0 tx=0).stop 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 -- 172.21.15.12:0/2356992896 shutdown_connections 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219406aaa0 0x7f21940c7ed0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 --2- 172.21.15.12:0/2356992896 >> v2:172.21.15.29:3300/0 conn(0x7f219413fb20 0x7f219415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 --2- 172.21.15.12:0/2356992896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219413fef0 0x7f21940c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 -- 172.21.15.12:0/2356992896 >> 172.21.15.12:0/2356992896 conn(0x7f219406d170 msgr2=0x7f21940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 -- 172.21.15.12:0/2356992896 shutdown_connections 2023-10-08T16:10:09.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.378+0000 7f2198f9d700 1 -- 172.21.15.12:0/2356992896 wait complete. 2023-10-08T16:10:09.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.380+0000 7f2198f9d700 1 Processor -- start 2023-10-08T16:10:09.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.380+0000 7f2198f9d700 1 -- start start 2023-10-08T16:10:09.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 0x7f219413e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 0x7f21940b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940ac730 con 0x7f219413fef0 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21940abb20 con 0x7f219413fb20 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2198f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21940abe00 con 0x7f219406aaa0 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36356/0 (socket says 172.21.15.12:36356) 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 -- 172.21.15.12:0/737203123 learned_addr learned my addr 172.21.15.12:0/737203123 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f21937fe700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 0x7f219413e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2192ffd700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 0x7f21940b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 -- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 msgr2=0x7f219413e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 0x7f219413e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 -- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 msgr2=0x7f21940b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 0x7f21940b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2193fff700 1 -- 172.21.15.12:0/737203123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c009ae0 con 0x7f219413fef0 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f2192ffd700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 0x7f21940b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.381+0000 7f21937fe700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 0x7f219413e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f2193fff700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f218c012000 tx=0x7f218c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0032f0 con 0x7f219413fef0 2023-10-08T16:10:09.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c008e80 con 0x7f219413fef0 2023-10-08T16:10:09.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0266b0 con 0x7f219413fef0 2023-10-08T16:10:09.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940ac0e0 con 0x7f219413fef0 2023-10-08T16:10:09.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.382+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219413ea40 con 0x7f219413fef0 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.383+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21940ac8e0 con 0x7f219413fef0 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.384+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f218c003040 con 0x7f219413fef0 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.385+0000 7f217b7fe700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 0x7f21800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.385+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7f218c0866b0 con 0x7f219413fef0 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.385+0000 7f21937fe700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 0x7f21800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.385+0000 7f21937fe700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 0x7f21800693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2184006fd0 tx=0x7f2184008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.389+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21940ac8e0 con 0x7f219413fef0 2023-10-08T16:10:09.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.590+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f219404c3c0 con 0x7f219413fef0 2023-10-08T16:10:09.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.591+0000 7f217b7fe700 1 -- 172.21.15.12:0/737203123 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+15588 (secure 0 0 0) 0x7f218c053810 con 0x7f219413fef0 2023-10-08T16:10:09.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:09.592 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":23,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:04.939846+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:09:18.859708+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-08T16:09:19.430887+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.13","mappings":[{"from":7,"to":2}]},{"pgid":"3.1e","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:09.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 msgr2=0x7f21800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 0x7f21800693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2184006fd0 tx=0x7f2184008040 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 msgr2=0x7f21941584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f218c012000 tx=0x7f218c018000 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 shutdown_connections 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2180066f30 0x7f21800693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f219413fef0 0x7f21941584f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f219406aaa0 0x7f219413e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 --2- 172.21.15.12:0/737203123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f219413fb20 0x7f21940b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.593+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 >> 172.21.15.12:0/737203123 conn(0x7f219406d170 msgr2=0x7f219406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:09.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.594+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 shutdown_connections 2023-10-08T16:10:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.594+0000 7f2198f9d700 1 -- 172.21.15.12:0/737203123 wait complete. 2023-10-08T16:10:09.612 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:10:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.800+0000 7fe850b9d700 1 Processor -- start 2023-10-08T16:10:09.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.800+0000 7fe850b9d700 1 -- start start 2023-10-08T16:10:09.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe850b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe84c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe850b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c15ae70 con 0x7fe84c06aaa0 2023-10-08T16:10:09.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe850b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84c06af60 con 0x7fe84c13fef0 2023-10-08T16:10:09.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe850b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c06b240 con 0x7fe84c13fb20 2023-10-08T16:10:09.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe84bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe84c06aaa0 0x7fe84c0c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41852/0 (socket says 172.21.15.12:41852) 2023-10-08T16:10:09.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe84bfff700 1 -- 172.21.15.12:0/2322516141 learned_addr learned my addr 172.21.15.12:0/2322516141 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe84c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617181816 0 0) 0x7fe844001490 con 0x7fe84c06aaa0 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.802+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe834003570 con 0x7fe84c06aaa0 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 78880036 0 0) 0x7fe84c06af60 con 0x7fe84c13fef0 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe844001490 con 0x7fe84c13fef0 2023-10-08T16:10:09.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1878280308 0 0) 0x7fe834003570 con 0x7fe84c06aaa0 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 msgr2=0x7fe84c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe84c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 >> v1:172.21.15.29:6789/0 conn(0x7fe84c13fef0 legacy=0x7fe84c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c06b520 con 0x7fe84c06aaa0 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe844001980 con 0x7fe84c06aaa0 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 >> v1:172.21.15.12:6789/0 conn(0x7fe84c06aaa0 legacy=0x7fe84c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe834003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8340041d0 0x7fe834004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe8340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c06b240 con 0x7fe8340041d0 2023-10-08T16:10:09.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83400bbf0 con 0x7fe834004d50 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83400bdb0 con 0x7fe84c13fb20 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe834003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84bfff700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe8340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.803+0000 7fe84affd700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8340041d0 0x7fe834004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 -- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 msgr2=0x7fe834003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe834003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 -- 172.21.15.12:0/2322516141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8340041d0 msgr2=0x7fe834004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8340041d0 0x7fe834004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 -- 172.21.15.12:0/2322516141 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe834003570 con 0x7fe834004d50 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c13fb20 0x7fe834003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:09.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84bfff700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe8340051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe84c06ae90 tx=0x7fe84400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1925ff82b6bc4051 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8440070f0 con 0x7fe834004d50 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe844007270 con 0x7fe834004d50 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.804+0000 7fe84a7fc700 1 -- 172.21.15.12:0/2322516141 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844007630 con 0x7fe834004d50 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 -- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 msgr2=0x7fe8340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 --2- 172.21.15.12:0/2322516141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe8340051c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe84c06ae90 tx=0x7fe84400a060 comp rx=0 tx=0).stop 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe84bfff700 1 -- 172.21.15.12:0/2322516141 reap_dead start 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 -- 172.21.15.12:0/2322516141 shutdown_connections 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 -- 172.21.15.12:0/2322516141 >> 172.21.15.12:0/2322516141 conn(0x7fe84c06d170 msgr2=0x7fe84c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:09.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 -- 172.21.15.12:0/2322516141 shutdown_connections 2023-10-08T16:10:09.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.805+0000 7fe850b9d700 1 -- 172.21.15.12:0/2322516141 wait complete. 2023-10-08T16:10:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.806+0000 7fe850b9d700 1 Processor -- start 2023-10-08T16:10:09.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 -- start start 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe84c138dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c0ab740 0x7fe84c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c156990 con 0x7fe84c0b0b50 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c0b1510 con 0x7fe834004d50 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.807+0000 7fe850b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84c139310 con 0x7fe84c0ab740 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36376/0 (socket says 172.21.15.12:36376) 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 -- 172.21.15.12:0/1003770373 learned_addr learned my addr 172.21.15.12:0/1003770373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84affd700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c0ab740 0x7fe84c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe84c138dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 -- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c0ab740 msgr2=0x7fe84c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c0ab740 0x7fe84c0abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 -- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 msgr2=0x7fe84c138dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe84c138dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 -- 172.21.15.12:0/1003770373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84c0ac200 con 0x7fe84c0b0b50 2023-10-08T16:10:09.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.808+0000 7fe84bfff700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe84400a460 tx=0x7fe844016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.809+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844007070 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.809+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8440011c0 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.809+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84c0ac4e0 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.809+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844001330 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.809+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84c156ec0 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.810+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe84c1570e0 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.811+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe844004bb0 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.811+0000 7fe8337fe700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.812+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5821+0+0 (secure 0 0 0) 0x7fe844086720 con 0x7fe84c0b0b50 2023-10-08T16:10:09.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.812+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.812+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 0x7fe8380693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe84c13f080 tx=0x7fe83c0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:09.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:09.816+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe844053920 con 0x7fe84c0b0b50 2023-10-08T16:10:10.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.068+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe84c15ae70 con 0x7fe84c0b0b50 2023-10-08T16:10:10.070 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:10:10.069+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:10:10.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.077+0000 7fe8337fe700 1 -- 172.21.15.12:0/1003770373 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe84c15ae70 con 0x7fe84c0b0b50 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 msgr2=0x7fe8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 0x7fe8380693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe84c13f080 tx=0x7fe83c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 msgr2=0x7fe84c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe84400a460 tx=0x7fe844016000 comp rx=0 tx=0).stop 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 shutdown_connections 2023-10-08T16:10:10.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe838066f30 0x7fe8380693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe84c0b0b50 0x7fe84c0b0fd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe834004d50 0x7fe84c138dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 --2- 172.21.15.12:0/1003770373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe84c0ab740 0x7fe84c0abbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 >> 172.21.15.12:0/1003770373 conn(0x7fe84c06d170 msgr2=0x7fe84c0c1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 shutdown_connections 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.080+0000 7fe850b9d700 1 -- 172.21.15.12:0/1003770373 wait complete. 2023-10-08T16:10:10.082 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:10:10.083 INFO:tasks.ceph.mds.d.smithi029.stderr: -2188> 2023-10-08T16:09:26.945+0000 7ff1381f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:10:10.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:10:10.127 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:10:10.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.287+0000 7f642139d700 1 Processor -- start 2023-10-08T16:10:10.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.287+0000 7f642139d700 1 -- start start 2023-10-08T16:10:10.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.288+0000 7f642139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 0x7f641c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.288+0000 7f642139d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c15b640 con 0x7f641c140a70 2023-10-08T16:10:10.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.288+0000 7f642139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f641c15b920 con 0x7f641c06de50 2023-10-08T16:10:10.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.288+0000 7f642139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0c6800 con 0x7f641c06a210 2023-10-08T16:10:10.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f641c140a70 0x7f641c069b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41864/0 (socket says 172.21.15.12:41864) 2023-10-08T16:10:10.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641bfff700 1 -- 172.21.15.12:0/3016121782 learned_addr learned my addr 172.21.15.12:0/3016121782 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:10.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641b7fe700 1 --2- 172.21.15.12:0/3016121782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 0x7f641c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641affd700 1 -- 172.21.15.12:0/3016121782 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028891226 0 0) 0x7f641c15b640 con 0x7f641c140a70 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641affd700 1 -- 172.21.15.12:0/3016121782 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6404003570 con 0x7f641c140a70 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641b7fe700 1 -- 172.21.15.12:0/3016121782 >> v1:172.21.15.29:6789/0 conn(0x7f641c06de50 legacy=0x7f641c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641b7fe700 1 -- 172.21.15.12:0/3016121782 >> v1:172.21.15.12:6789/0 conn(0x7f641c140a70 legacy=0x7f641c069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641b7fe700 1 -- 172.21.15.12:0/3016121782 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c15bc00 con 0x7f641c06a210 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.289+0000 7f641b7fe700 1 --2- 172.21.15.12:0/3016121782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 0x7f641c0c6c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6410009910 tx=0x7f64100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410cf043ecb14755 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.290+0000 7f641affd700 1 -- 172.21.15.12:0/3016121782 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000b680 con 0x7f641c06a210 2023-10-08T16:10:10.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.290+0000 7f641affd700 1 -- 172.21.15.12:0/3016121782 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641000b7e0 con 0x7f641c06a210 2023-10-08T16:10:10.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.290+0000 7f641affd700 1 -- 172.21.15.12:0/3016121782 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641000bba0 con 0x7f641c06a210 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 -- 172.21.15.12:0/3016121782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 msgr2=0x7f641c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 --2- 172.21.15.12:0/3016121782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 0x7f641c0c6c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6410009910 tx=0x7f64100091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 -- 172.21.15.12:0/3016121782 shutdown_connections 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 --2- 172.21.15.12:0/3016121782 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06a210 0x7f641c0c6c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 -- 172.21.15.12:0/3016121782 >> 172.21.15.12:0/3016121782 conn(0x7f641c06d110 msgr2=0x7f641c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 -- 172.21.15.12:0/3016121782 shutdown_connections 2023-10-08T16:10:10.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.291+0000 7f642139d700 1 -- 172.21.15.12:0/3016121782 wait complete. 2023-10-08T16:10:10.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.293+0000 7f642139d700 1 Processor -- start 2023-10-08T16:10:10.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.293+0000 7f642139d700 1 -- start start 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06de50 0x7f641c13f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 0x7f641c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0c3590 con 0x7f641c06a210 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0b01c0 con 0x7f641c140a70 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f642139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641c0af5b0 con 0x7f641c06de50 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f641bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f641bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36390/0 (socket says 172.21.15.12:36390) 2023-10-08T16:10:10.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f641bfff700 1 -- 172.21.15.12:0/3293140272 learned_addr learned my addr 172.21.15.12:0/3293140272 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:10.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f641b7fe700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06de50 0x7f641c13f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.294+0000 7f6420b9c700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 0x7f641c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 -- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06de50 msgr2=0x7f641c13f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06de50 0x7f641c13f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 -- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 msgr2=0x7f641c13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 0x7f641c13fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 -- 172.21.15.12:0/3293140272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6410009420 con 0x7f641c06a210 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f6420b9c700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 0x7f641c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:10.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f641bfff700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c5c0 tx=0x7f640c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c005b30 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640c005cb0 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640c007320 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641c0af890 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.295+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641c0afe50 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.296+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f641c04c3c0 con 0x7f641c06a210 2023-10-08T16:10:10.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.297+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f640c01b3b0 con 0x7f641c06a210 2023-10-08T16:10:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.298+0000 7f6403fff700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 0x7f64080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.299+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5907+0+0 (secure 0 0 0) 0x7f640c083ad0 con 0x7f641c06a210 2023-10-08T16:10:10.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.299+0000 7f641b7fe700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 0x7f64080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:10.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.299+0000 7f641b7fe700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 0x7f64080693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64100093f0 tx=0x7f6410017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:10.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.303+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f640c050bd0 con 0x7f641c06a210 2023-10-08T16:10:10.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:10.550+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f641c15bee0 con 0x7f641c06a210 2023-10-08T16:10:11.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.076+0000 7f6403fff700 1 -- 172.21.15.12:0/3293140272 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f640c0170a0 con 0x7f641c06a210 2023-10-08T16:10:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 msgr2=0x7f64080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 0x7f64080693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f64100093f0 tx=0x7f6410017000 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 msgr2=0x7f641c1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f640c00c5c0 tx=0x7f640c007e00 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 shutdown_connections 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6408066f30 0x7f64080693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f641c06a210 0x7f641c1577f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f641c140a70 0x7f641c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 --2- 172.21.15.12:0/3293140272 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f641c06de50 0x7f641c13f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 >> 172.21.15.12:0/3293140272 conn(0x7f641c06d110 msgr2=0x7f641c0c0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 shutdown_connections 2023-10-08T16:10:11.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.079+0000 7f642139d700 1 -- 172.21.15.12:0/3293140272 wait complete. 2023-10-08T16:10:11.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:10:11.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.294+0000 7fdda359d700 1 Processor -- start 2023-10-08T16:10:11.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.294+0000 7fdda359d700 1 -- start start 2023-10-08T16:10:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda359d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdd9c153a30 0x7fdd9c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c0c9090 0x7fdd9c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda359d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd9c0c2200 con 0x7fdd9c153660 2023-10-08T16:10:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda359d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9c157250 con 0x7fdd9c153a30 2023-10-08T16:10:11.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c15f0 con 0x7fdd9c0c9090 2023-10-08T16:10:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda259b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdd9c153660 0x7fdd9c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41866/0 (socket says 172.21.15.12:41866) 2023-10-08T16:10:11.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.295+0000 7fdda259b700 1 -- 172.21.15.12:0/3446692686 learned_addr learned my addr 172.21.15.12:0/3446692686 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:11.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1d9a700 1 --2- 172.21.15.12:0/3446692686 >> v2:172.21.15.29:3300/0 conn(0x7fdd9c153a30 0x7fdd9c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c0c9090 0x7fdd9c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807847071 0 0) 0x7fdd9c0c2200 con 0x7fdd9c153660 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd88003570 con 0x7fdd9c153660 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570115666 0 0) 0x7fdd88003570 con 0x7fdd9c153660 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c0c9090 msgr2=0x7fdd9c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c0c9090 0x7fdd9c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 >> v2:172.21.15.29:3300/0 conn(0x7fdd9c153a30 msgr2=0x7fdd9c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:11.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 --2- 172.21.15.12:0/3446692686 >> v2:172.21.15.29:3300/0 conn(0x7fdd9c153a30 0x7fdd9c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c0c18d0 con 0x7fdd9c153660 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fdd98001470 con 0x7fdd9c153660 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 >> v1:172.21.15.12:6789/0 conn(0x7fdd9c153660 legacy=0x7fdd9c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd88003a60 0x7fdd88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88004810 0x7fdd88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd880051c0 0x7fdd8800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c157250 con 0x7fdd88003a60 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0c15f0 con 0x7fdd88004810 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8800e1b0 con 0x7fdd880051c0 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c0c9090 0x7fdd9c156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.296+0000 7fdda1d9a700 1 --2- 172.21.15.12:0/3446692686 >> v2:172.21.15.29:3300/0 conn(0x7fdd9c153a30 0x7fdd9c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:11.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd88003a60 0x7fdd88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda1d9a700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88004810 0x7fdd88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd880051c0 0x7fdd8800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 -- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd880051c0 msgr2=0x7fdd8800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd880051c0 0x7fdd8800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 -- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88004810 msgr2=0x7fdd88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88004810 0x7fdd88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 -- 172.21.15.12:0/3446692686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88003570 con 0x7fdd88003a60 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda1d9a700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88004810 0x7fdd88004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda259b700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd88003a60 0x7fdd88003e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c3c0 tx=0x7fdd98001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa8060a4fac9fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9800cc90 con 0x7fdd88003a60 2023-10-08T16:10:11.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9800ce30 con 0x7fdd88003a60 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.297+0000 7fdda1599700 1 -- 172.21.15.12:0/3446692686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98005b70 con 0x7fdd88003a60 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 -- 172.21.15.12:0/3446692686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd88003a60 msgr2=0x7fdd88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 --2- 172.21.15.12:0/3446692686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd88003a60 0x7fdd88003e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c3c0 tx=0x7fdd98001e90 comp rx=0 tx=0).stop 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda2d9c700 1 -- 172.21.15.12:0/3446692686 reap_dead start 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 -- 172.21.15.12:0/3446692686 shutdown_connections 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 -- 172.21.15.12:0/3446692686 >> 172.21.15.12:0/3446692686 conn(0x7fdd9c06c6a0 msgr2=0x7fdd9c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 -- 172.21.15.12:0/3446692686 shutdown_connections 2023-10-08T16:10:11.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.298+0000 7fdda359d700 1 -- 172.21.15.12:0/3446692686 wait complete. 2023-10-08T16:10:11.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.300+0000 7fdda359d700 1 Processor -- start 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.300+0000 7fdda359d700 1 -- start start 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88003a60 0x7fdd9c0b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c1407b0 0x7fdd9c140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c159130 con 0x7fdd9c158130 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c141160 con 0x7fdd88003a60 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c0af6e0 con 0x7fdd9c1407b0 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36416/0 (socket says 172.21.15.12:36416) 2023-10-08T16:10:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 -- 172.21.15.12:0/3583097107 learned_addr learned my addr 172.21.15.12:0/3583097107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda1d9a700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c1407b0 0x7fdd9c140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda259b700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88003a60 0x7fdd9c0b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 -- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c1407b0 msgr2=0x7fdd9c140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c1407b0 0x7fdd9c140c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 -- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88003a60 msgr2=0x7fdd9c0b1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88003a60 0x7fdd9c0b1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 -- 172.21.15.12:0/3583097107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c158e50 con 0x7fdd9c158130 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.301+0000 7fdda2d9c700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0c9460 tx=0x7fdd9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.302+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400e070 con 0x7fdd9c158130 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.302+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd94011de0 con 0x7fdd9c158130 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.302+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9c0af090 con 0x7fdd9c158130 2023-10-08T16:10:11.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.302+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd940166a0 con 0x7fdd9c158130 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.302+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9c158ac0 con 0x7fdd9c158130 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.303+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9c0aeef0 con 0x7fdd9c158130 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.304+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd94016a90 con 0x7fdd9c158130 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.305+0000 7fdd927fc700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 0x7fdd800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.305+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5907+0+0 (secure 0 0 0) 0x7fdd94085350 con 0x7fdd9c158130 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.305+0000 7fdda259b700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 0x7fdd800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.305+0000 7fdda259b700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 0x7fdd800693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c3c0 tx=0x7fdd98015000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:11.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.309+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd9c0aeef0 con 0x7fdd9c158130 2023-10-08T16:10:11.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:11.513+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdd9c0aeef0 con 0x7fdd9c158130 2023-10-08T16:10:12.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.082+0000 7fdd927fc700 1 -- 172.21.15.12:0/3583097107 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdd9c0aeef0 con 0x7fdd9c158130 2023-10-08T16:10:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.086+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 msgr2=0x7fdd800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.086+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 0x7fdd800693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c3c0 tx=0x7fdd98015000 comp rx=0 tx=0).stop 2023-10-08T16:10:12.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 msgr2=0x7fdd9c158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0c9460 tx=0x7fdd9400b040 comp rx=0 tx=0).stop 2023-10-08T16:10:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 shutdown_connections 2023-10-08T16:10:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd80066f30 0x7fdd800693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd9c158130 0x7fdd9c158580 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd88003a60 0x7fdd9c0b1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 --2- 172.21.15.12:0/3583097107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd9c1407b0 0x7fdd9c140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 >> 172.21.15.12:0/3583097107 conn(0x7fdd9c06c6a0 msgr2=0x7fdd9c153e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 shutdown_connections 2023-10-08T16:10:12.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.087+0000 7fdda359d700 1 -- 172.21.15.12:0/3583097107 wait complete. 2023-10-08T16:10:12.090 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:10:12.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:10:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.309+0000 7feb0359e700 1 Processor -- start 2023-10-08T16:10:12.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.309+0000 7feb0359e700 1 -- start start 2023-10-08T16:10:12.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb04159800 0x7feb040b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:12.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b0c80 con 0x7feb040b24f0 2023-10-08T16:10:12.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb040b0f60 con 0x7feb040b1d40 2023-10-08T16:10:12.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb040d10d0 con 0x7feb04159800 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feb040b24f0 0x7feb041590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52312/0 (socket says 172.21.15.12:52312) 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb0259c700 1 -- 172.21.15.12:0/3427371910 learned_addr learned my addr 172.21.15.12:0/3427371910 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.311+0000 7feb01d9b700 1 --2- 172.21.15.12:0/3427371910 >> v2:172.21.15.12:3300/0 conn(0x7feb04159800 0x7feb040b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb0159a700 1 -- 172.21.15.12:0/3427371910 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3421216951 0 0) 0x7feb040b0c80 con 0x7feb040b24f0 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb0159a700 1 -- 172.21.15.12:0/3427371910 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feaec003570 con 0x7feb040b24f0 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb01d9b700 1 -- 172.21.15.12:0/3427371910 >> v1:172.21.15.29:6789/0 conn(0x7feb040b1d40 legacy=0x7feb040b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb01d9b700 1 -- 172.21.15.12:0/3427371910 >> v1:172.21.15.12:6789/0 conn(0x7feb040b24f0 legacy=0x7feb041590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb01d9b700 1 -- 172.21.15.12:0/3427371910 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb040b1240 con 0x7feb04159800 2023-10-08T16:10:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb01d9b700 1 --2- 172.21.15.12:0/3427371910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040b0580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feaf80098e0 tx=0x7feaf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325ebfc08b83a61c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb0159a700 1 -- 172.21.15.12:0/3427371910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800b640 con 0x7feb04159800 2023-10-08T16:10:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb0159a700 1 -- 172.21.15.12:0/3427371910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaf800b7a0 con 0x7feb04159800 2023-10-08T16:10:12.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.312+0000 7feb0159a700 1 -- 172.21.15.12:0/3427371910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf800bb40 con 0x7feb04159800 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 -- 172.21.15.12:0/3427371910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 msgr2=0x7feb040b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 --2- 172.21.15.12:0/3427371910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040b0580 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7feaf80098e0 tx=0x7feaf80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 -- 172.21.15.12:0/3427371910 shutdown_connections 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 --2- 172.21.15.12:0/3427371910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040b0580 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 -- 172.21.15.12:0/3427371910 >> 172.21.15.12:0/3427371910 conn(0x7feb040703a0 msgr2=0x7feb040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:12.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 -- 172.21.15.12:0/3427371910 shutdown_connections 2023-10-08T16:10:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.313+0000 7feb0359e700 1 -- 172.21.15.12:0/3427371910 wait complete. 2023-10-08T16:10:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.314+0000 7feb0359e700 1 Processor -- start 2023-10-08T16:10:12.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 -- start start 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb040b1d40 0x7feb0416a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb040b24f0 0x7feb040ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0416df60 con 0x7feb04159800 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0416a9e0 con 0x7feb040b24f0 2023-10-08T16:10:12.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.315+0000 7feb0359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0416d3e0 con 0x7feb040b1d40 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58736/0 (socket says 172.21.15.12:58736) 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 -- 172.21.15.12:0/1322911263 learned_addr learned my addr 172.21.15.12:0/1322911263 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb01d9b700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb040b24f0 0x7feb040ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb0259c700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb040b1d40 0x7feb0416a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 -- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb040b1d40 msgr2=0x7feb0416a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb040b1d40 0x7feb0416a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 -- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb040b24f0 msgr2=0x7feb040ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb040b24f0 0x7feb040ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.316+0000 7feb02d9d700 1 -- 172.21.15.12:0/1322911263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf8009420 con 0x7feb04159800 2023-10-08T16:10:12.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feb02d9d700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c840 tx=0x7feafc001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:12.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc012630 con 0x7feb04159800 2023-10-08T16:10:12.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feafc0127b0 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feafc012b70 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb0416d6c0 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.317+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb0416dc80 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.318+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0404c3c0 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.319+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feafc01a3a0 con 0x7feb04159800 2023-10-08T16:10:12.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.320+0000 7feaf27fc700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 0x7feae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.320+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5469+0+0 (secure 0 0 0) 0x7feafc084610 con 0x7feb04159800 2023-10-08T16:10:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.320+0000 7feb0259c700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 0x7feae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:12.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.321+0000 7feb0259c700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 0x7feae40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007fd0 tx=0x7feaf4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:12.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.324+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feafc0518d0 con 0x7feb04159800 2023-10-08T16:10:12.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:12.524+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7feb040aff80 con 0x7feb04159800 2023-10-08T16:10:13.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.094+0000 7feaf27fc700 1 -- 172.21.15.12:0/1322911263 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7feafc054ef0 con 0x7feb04159800 2023-10-08T16:10:13.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.098+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 msgr2=0x7feae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:13.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.098+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 0x7feae40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7feaf4007fd0 tx=0x7feaf4009040 comp rx=0 tx=0).stop 2023-10-08T16:10:13.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.098+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 msgr2=0x7feb040c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:13.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.098+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7feafc00c840 tx=0x7feafc001670 comp rx=0 tx=0).stop 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 shutdown_connections 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7feae4066f30 0x7feae40693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb04159800 0x7feb040c6380 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb040b1d40 0x7feb0416a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 --2- 172.21.15.12:0/1322911263 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb040b24f0 0x7feb040ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 >> 172.21.15.12:0/1322911263 conn(0x7feb040703a0 msgr2=0x7feb04154f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 shutdown_connections 2023-10-08T16:10:13.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:13.099+0000 7feb0359e700 1 -- 172.21.15.12:0/1322911263 wait complete. 2023-10-08T16:10:13.101 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:10:13.120 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:10:13.120 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:10:13.121 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:10:13.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:13.121 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:10:13.121 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:10:13.121 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:10:13.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:13.122 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:10:13.122 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:10:13.122 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:10:13.122 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:13.122 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:10:13.122 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:10:13.123 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:10:13.123 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:10:13.140 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:10:13.140 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:10:13.142 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:10:13.142 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:10:13.142 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:10:13.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:10:13.185 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:10:13.186 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:13.186 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:10:13.186 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:13.189 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:10:13.189 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:13.320 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:10:13.320 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:10:13.324 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:10:13.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:13.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:19.141 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:10:19.141 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:10:19.146 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:10:19.147 DEBUG:teuthology.parallel:result is None 2023-10-08T16:10:19.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:10:19.288 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:10:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.347+0000 7f17d899d700 1 Processor -- start 2023-10-08T16:10:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.347+0000 7f17d899d700 1 -- start start 2023-10-08T16:10:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 0x7f17d40b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d406d250 0x7f17d40aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17d40ceac0 0x7f17d40af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40ac840 con 0x7f17d40ceac0 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d40b18f0 con 0x7f17d4157420 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.348+0000 7f17d899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d40abf50 con 0x7f17d406d250 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17d40ceac0 0x7f17d40af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f17d40ceac0 0x7f17d40af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58768/0 (socket says 172.21.15.12:58768) 2023-10-08T16:10:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 -- 172.21.15.12:0/2855911618 learned_addr learned my addr 172.21.15.12:0/2855911618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d37fe700 1 --2- 172.21.15.12:0/2855911618 >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 0x7f17d40b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d2ffd700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d406d250 0x7f17d40aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 -- 172.21.15.12:0/2855911618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d406d250 msgr2=0x7f17d40aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d406d250 0x7f17d40aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 -- 172.21.15.12:0/2855911618 >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 msgr2=0x7f17d40b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 --2- 172.21.15.12:0/2855911618 >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 0x7f17d40b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d3fff700 1 -- 172.21.15.12:0/2855911618 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40aea60 con 0x7f17d40ceac0 2023-10-08T16:10:19.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.349+0000 7f17d37fe700 1 --2- 172.21.15.12:0/2855911618 >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 0x7f17d40b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d3fff700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d40ceac0 0x7f17d40af4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17d40b0e70 tx=0x7f17cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37beca7abefda65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d27fc700 1 -- 172.21.15.12:0/2855911618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00e070 con 0x7f17d40ceac0 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d27fc700 1 -- 172.21.15.12:0/2855911618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00ba50 con 0x7f17d40ceac0 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d27fc700 1 -- 172.21.15.12:0/2855911618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0092e0 con 0x7f17d40ceac0 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 -- 172.21.15.12:0/2855911618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d40ceac0 msgr2=0x7f17d40af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d40ceac0 0x7f17d40af4e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f17d40b0e70 tx=0x7f17cc009840 comp rx=0 tx=0).stop 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 -- 172.21.15.12:0/2855911618 shutdown_connections 2023-10-08T16:10:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d40ceac0 0x7f17d40af4e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 --2- 172.21.15.12:0/2855911618 >> v2:172.21.15.29:3300/0 conn(0x7f17d4157420 0x7f17d40b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 --2- 172.21.15.12:0/2855911618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d406d250 0x7f17d40aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.350+0000 7f17d899d700 1 -- 172.21.15.12:0/2855911618 >> 172.21.15.12:0/2855911618 conn(0x7f17d406ce80 msgr2=0x7f17d40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.351+0000 7f17d899d700 1 -- 172.21.15.12:0/2855911618 shutdown_connections 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.351+0000 7f17d899d700 1 -- 172.21.15.12:0/2855911618 wait complete. 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.352+0000 7f17d899d700 1 Processor -- start 2023-10-08T16:10:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.352+0000 7f17d899d700 1 -- start start 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40ceac0 0x7f17d414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 0x7f17d416d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d406d8e0 con 0x7f17d406d250 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d414dc40 con 0x7f17d40ceac0 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d414df20 con 0x7f17d4157420 2023-10-08T16:10:19.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58778/0 (socket says 172.21.15.12:58778) 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d37fe700 1 -- 172.21.15.12:0/503769768 learned_addr learned my addr 172.21.15.12:0/503769768 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d2ffd700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40ceac0 0x7f17d414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.353+0000 7f17d3fff700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 0x7f17d416d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 -- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 msgr2=0x7f17d416d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 0x7f17d416d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 -- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40ceac0 msgr2=0x7f17d414d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40ceac0 0x7f17d414d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 -- 172.21.15.12:0/503769768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17cc009ae0 con 0x7f17d406d250 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d3fff700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 0x7f17d416d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d37fe700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f17c400d860 tx=0x7f17c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:19.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c40125f0 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c4012750 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d414e200 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4012af0 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.354+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d415a6c0 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.355+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d404c3c0 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.356+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f17c4014430 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.357+0000 7f17bb7fe700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 0x7f17c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.357+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f17c4084670 con 0x7f17d406d250 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.357+0000 7f17d2ffd700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 0x7f17c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.358+0000 7f17d2ffd700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 0x7f17c00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17d409c130 tx=0x7f17c8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:19.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.361+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17c4051b40 con 0x7f17d406d250 2023-10-08T16:10:19.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:19.576+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f17d40ac1f0 con 0x7f17d406d250 2023-10-08T16:10:21.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.116+0000 7f17bb7fe700 1 -- 172.21.15.12:0/503769768 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f17c4055160 con 0x7f17d406d250 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.119+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 msgr2=0x7f17c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.119+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 0x7f17c00693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17d409c130 tx=0x7f17c8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.119+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 msgr2=0x7f17d415a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.119+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f17c400d860 tx=0x7f17c4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 shutdown_connections 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f17c0066f30 0x7f17c00693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17d406d250 0x7f17d415a180 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17d4157420 0x7f17d416d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 --2- 172.21.15.12:0/503769768 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17d40ceac0 0x7f17d414d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 >> 172.21.15.12:0/503769768 conn(0x7f17d406ce80 msgr2=0x7f17d40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 shutdown_connections 2023-10-08T16:10:21.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.120+0000 7f17d899d700 1 -- 172.21.15.12:0/503769768 wait complete. 2023-10-08T16:10:21.122 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:10:21.141 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:10:21.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.331+0000 7f4493fff700 1 Processor -- start 2023-10-08T16:10:21.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.332+0000 7f4493fff700 1 -- start start 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4493fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f449415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4493fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f449415de50 0x7f44940cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4493fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449415afd0 con 0x7f44940cef40 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4493fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449415b2b0 con 0x7f449415de50 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4493fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449415b590 con 0x7f4494153c30 2023-10-08T16:10:21.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f44937fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f44940cef40 0x7f449406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52338/0 (socket says 172.21.15.12:52338) 2023-10-08T16:10:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f44937fe700 1 -- 172.21.15.12:0/1010216504 learned_addr learned my addr 172.21.15.12:0/1010216504 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4492ffd700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f449415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f44927fc700 1 --2- 172.21.15.12:0/1010216504 >> v2:172.21.15.29:3300/0 conn(0x7f449415de50 0x7f44940cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.333+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661973428 0 0) 0x7f449415afd0 con 0x7f44940cef40 2023-10-08T16:10:21.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c003570 con 0x7f44940cef40 2023-10-08T16:10:21.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3046237326 0 0) 0x7f447c003570 con 0x7f44940cef40 2023-10-08T16:10:21.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 msgr2=0x7f449415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f449415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 >> v2:172.21.15.29:3300/0 conn(0x7f449415de50 msgr2=0x7f44940cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 --2- 172.21.15.12:0/1010216504 >> v2:172.21.15.29:3300/0 conn(0x7f449415de50 0x7f44940cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449415b870 con 0x7f44940cef40 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f448c0017f0 con 0x7f44940cef40 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 >> v1:172.21.15.12:6789/0 conn(0x7f44940cef40 legacy=0x7f449406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f447c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f447c003fe0 0x7f447c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415b2b0 con 0x7f447c004d50 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449415b590 con 0x7f447c003fe0 2023-10-08T16:10:21.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c00ba90 con 0x7f4494153c30 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f44937fe700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f44927fc700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f447c003fe0 0x7f447c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.334+0000 7f4492ffd700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f447c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 -- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 msgr2=0x7f447c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4494153c30 0x7f447c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 -- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f447c003fe0 msgr2=0x7f447c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f447c003fe0 0x7f447c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 -- 172.21.15.12:0/1010216504 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c003570 con 0x7f447c004d50 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f44937fe700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f448c00a970 tx=0x7f448c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60387bf237c254e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0070d0 con 0x7f447c004d50 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c007270 con 0x7f447c004d50 2023-10-08T16:10:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.335+0000 7f4491ffb700 1 -- 172.21.15.12:0/1010216504 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c007630 con 0x7f447c004d50 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 -- 172.21.15.12:0/1010216504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 msgr2=0x7f447c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 --2- 172.21.15.12:0/1010216504 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f447c0051c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f448c00a970 tx=0x7f448c002210 comp rx=0 tx=0).stop 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f44937fe700 1 -- 172.21.15.12:0/1010216504 reap_dead start 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 -- 172.21.15.12:0/1010216504 shutdown_connections 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 -- 172.21.15.12:0/1010216504 >> 172.21.15.12:0/1010216504 conn(0x7f44940703a0 msgr2=0x7f44940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 -- 172.21.15.12:0/1010216504 shutdown_connections 2023-10-08T16:10:21.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.336+0000 7f4493fff700 1 -- 172.21.15.12:0/1010216504 wait complete. 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.337+0000 7f4493fff700 1 Processor -- start 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.337+0000 7f4493fff700 1 -- start start 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44940c8d60 0x7f4494151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44940b1250 0x7f44940b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b4110 con 0x7f447c004d50 2023-10-08T16:10:21.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b1c00 con 0x7f44940b1250 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4493fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b42a0 con 0x7f44940c8d60 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4492ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4492ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58790/0 (socket says 172.21.15.12:58790) 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.338+0000 7f4492ffd700 1 -- 172.21.15.12:0/1031757306 learned_addr learned my addr 172.21.15.12:0/1031757306 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f44927fc700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44940c8d60 0x7f4494151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f44937fe700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44940b1250 0x7f44940b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 -- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44940c8d60 msgr2=0x7f4494151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44940c8d60 0x7f4494151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 -- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44940b1250 msgr2=0x7f44940b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44940b1250 0x7f44940b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 -- 172.21.15.12:0/1031757306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940c9590 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4492ffd700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4484011b10 tx=0x7f44840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448400f9f0 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448400fb50 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44940c9870 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.339+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448400fed0 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.340+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940c9e30 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.341+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449404c3c0 con 0x7f447c004d50 2023-10-08T16:10:21.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.341+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4484014650 con 0x7f447c004d50 2023-10-08T16:10:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.342+0000 7f447affd700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.342+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4484018030 con 0x7f447c004d50 2023-10-08T16:10:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.342+0000 7f44927fc700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.343+0000 7f44927fc700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 0x7f44800693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44940b1ef0 tx=0x7f4488008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.347+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4484052280 con 0x7f447c004d50 2023-10-08T16:10:21.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.629+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f44940caef0 con 0x7f447c004d50 2023-10-08T16:10:21.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.630+0000 7f447affd700 1 -- 172.21.15.12:0/1031757306 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4484022090 con 0x7f447c004d50 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.631 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:10:21.632 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.633 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.634 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.635 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.636 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.637 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:10:21.638 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.639 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.640 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.641 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.642 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:10:21.643 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.644 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mds", 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJlaDWCBxAAYJ83qHf808CF+YHpgUyEfg==", 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mds" 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-mgr", 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJlLT+CBxAAzbQREUT1xQPuB6tETMwLdQ==", 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-08T16:10:21.645 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-osd", 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJl4UmCBxAAnUelqFoUbz057ArXOuB0Bg==", 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-osd" 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd", 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJlMVWCBxAAv1oFgzFIUjC+K+kFdrK+Zg==", 2023-10-08T16:10:21.646 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJlgV6CBxAAZ2MlWFSSTwH1/uPeZuUi8A==", 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.647 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.bootstrap-rgw", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAY1CJlr2eCBxAAE6wrf3zpMjKXuvhJvKBXog==", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.648 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:10:21.649 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:10:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 msgr2=0x7f44800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 0x7f44800693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44940b1ef0 tx=0x7f4488008040 comp rx=0 tx=0).stop 2023-10-08T16:10:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 msgr2=0x7f44940cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f4484011b10 tx=0x7f44840091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 shutdown_connections 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4480066f30 0x7f44800693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f447c004d50 0x7f44940cc040 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f44940b1250 0x7f44940b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 --2- 172.21.15.12:0/1031757306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44940c8d60 0x7f4494151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.632+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 >> 172.21.15.12:0/1031757306 conn(0x7f44940703a0 msgr2=0x7f449415a730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.633+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 shutdown_connections 2023-10-08T16:10:21.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.633+0000 7f4493fff700 1 -- 172.21.15.12:0/1031757306 wait complete. 2023-10-08T16:10:21.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-08T16:10:21.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.838+0000 7fd86139d700 1 Processor -- start 2023-10-08T16:10:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.839+0000 7fd86139d700 1 -- start start 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd86139d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd85c153c30 0x7fd85c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd86139d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c15afd0 con 0x7fd85c15de50 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd86139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd85c15b2b0 con 0x7fd85c0cf110 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd86139d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd85c15b590 con 0x7fd85c153c30 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd85b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd85c15de50 0x7fd85c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52344/0 (socket says 172.21.15.12:52344) 2023-10-08T16:10:21.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd85b7fe700 1 -- 172.21.15.12:0/3027741842 learned_addr learned my addr 172.21.15.12:0/3027741842 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.840+0000 7fd85bfff700 1 --2- 172.21.15.12:0/3027741842 >> v2:172.21.15.29:3300/0 conn(0x7fd85c153c30 0x7fd85c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757885473 0 0) 0x7fd85c15afd0 con 0x7fd85c15de50 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd844003570 con 0x7fd85c15de50 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2333572190 0 0) 0x7fd844003570 con 0x7fd85c15de50 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 >> v2:172.21.15.29:3300/0 conn(0x7fd85c153c30 msgr2=0x7fd85c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 --2- 172.21.15.12:0/3027741842 >> v2:172.21.15.29:3300/0 conn(0x7fd85c153c30 0x7fd85c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 >> v1:172.21.15.29:6789/0 conn(0x7fd85c0cf110 legacy=0x7fd85c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c15b870 con 0x7fd85c15de50 2023-10-08T16:10:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fd850001470 con 0x7fd85c15de50 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 >> v1:172.21.15.12:6789/0 conn(0x7fd85c15de50 legacy=0x7fd85c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c15b590 con 0x7fd8440051c0 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c0d0 con 0x7fd844003a60 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd84400c290 con 0x7fd844004810 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd85bfff700 1 --2- 172.21.15.12:0/3027741842 >> v2:172.21.15.29:3300/0 conn(0x7fd85c153c30 0x7fd85c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.841+0000 7fd860b9c700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85b7fe700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85bfff700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 -- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd844004810 msgr2=0x7fd844004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 -- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd844003a60 msgr2=0x7fd844003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 -- 172.21.15.12:0/3027741842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844003570 con 0x7fd8440051c0 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85bfff700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd844003a60 0x7fd844003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85b7fe700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd844004810 0x7fd844004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 -- 172.21.15.12:0/3027741842 reap_dead start 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd860b9c700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd854001fc0 tx=0x7fd854001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc1d50fb61131f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd854001950 con 0x7fd8440051c0 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85400c8b0 con 0x7fd8440051c0 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.842+0000 7fd85affd700 1 -- 172.21.15.12:0/3027741842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85400cc90 con 0x7fd8440051c0 2023-10-08T16:10:21.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 -- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 msgr2=0x7fd84400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd854001fc0 tx=0x7fd854001640 comp rx=0 tx=0).stop 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 -- 172.21.15.12:0/3027741842 shutdown_connections 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 --2- 172.21.15.12:0/3027741842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd84400ba60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 -- 172.21.15.12:0/3027741842 >> 172.21.15.12:0/3027741842 conn(0x7fd85c0703a0 msgr2=0x7fd85c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 -- 172.21.15.12:0/3027741842 shutdown_connections 2023-10-08T16:10:21.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.843+0000 7fd86139d700 1 -- 172.21.15.12:0/3027741842 wait complete. 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.844+0000 7fd86139d700 1 Processor -- start 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 -- start start 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0b4710 0x7fd85c0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c0c75e0 0x7fd85c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c169c40 con 0x7fd8440051c0 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c169f20 con 0x7fd85c0b4710 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.845+0000 7fd86139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c16a200 con 0x7fd85c0c75e0 2023-10-08T16:10:21.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58794/0 (socket says 172.21.15.12:58794) 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 -- 172.21.15.12:0/2201969820 learned_addr learned my addr 172.21.15.12:0/2201969820 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 -- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c0c75e0 msgr2=0x7fd85c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c0c75e0 0x7fd85c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 -- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0b4710 msgr2=0x7fd85c0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0b4710 0x7fd85c0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 -- 172.21.15.12:0/2201969820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd85c16a4e0 con 0x7fd8440051c0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd85bfff700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009170 tx=0x7fd84c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.846+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c011e80 con 0x7fd8440051c0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.847+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84c00f8e0 con 0x7fd8440051c0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.847+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84c00fc60 con 0x7fd8440051c0 2023-10-08T16:10:21.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.847+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c169810 con 0x7fd8440051c0 2023-10-08T16:10:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.847+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c151310 con 0x7fd8440051c0 2023-10-08T16:10:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.848+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c0c7c70 con 0x7fd8440051c0 2023-10-08T16:10:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.848+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd84c015670 con 0x7fd8440051c0 2023-10-08T16:10:21.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.849+0000 7fd843fff700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:21.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.849+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd84c084ba0 con 0x7fd8440051c0 2023-10-08T16:10:21.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.850+0000 7fd85b7fe700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:21.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.850+0000 7fd85b7fe700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd850001200 tx=0x7fd85c15e2d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:21.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:21.854+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd84c0520c0 con 0x7fd8440051c0 2023-10-08T16:10:22.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.136+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fd85c169a00 con 0x7fd8440051c0 2023-10-08T16:10:22.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.139+0000 7fd843fff700 1 -- 172.21.15.12:0/2201969820 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd85c169a00 con 0x7fd8440051c0 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 msgr2=0x7fd8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 0x7fd8480693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd850001200 tx=0x7fd85c15e2d0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 msgr2=0x7fd85c0c6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009170 tx=0x7fd84c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 shutdown_connections 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd848066f30 0x7fd8480693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8440051c0 0x7fd85c0c6960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd85c0c75e0 0x7fd85c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 --2- 172.21.15.12:0/2201969820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd85c0b4710 0x7fd85c0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 >> 172.21.15.12:0/2201969820 conn(0x7fd85c0703a0 msgr2=0x7fd85c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:22.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 shutdown_connections 2023-10-08T16:10:22.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.142+0000 7fd86139d700 1 -- 172.21.15.12:0/2201969820 wait complete. 2023-10-08T16:10:22.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-08T16:10:22.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.346+0000 7f494979d700 1 Processor -- start 2023-10-08T16:10:22.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.346+0000 7f494979d700 1 -- start start 2023-10-08T16:10:22.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.347+0000 7f494979d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4944159a10 0x7f49440ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.347+0000 7f494979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f49440cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.347+0000 7f494979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49440c7420 con 0x7f4944159640 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.347+0000 7f494979d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f494406d820 con 0x7f4944159a10 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.347+0000 7f494979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494406db00 con 0x7f4944070410 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4943fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4944159640 0x7f494406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40152/0 (socket says 172.21.15.12:40152) 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4943fff700 1 -- 172.21.15.12:0/3870380335 learned_addr learned my addr 172.21.15.12:0/3870380335 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f49437fe700 1 --2- 172.21.15.12:0/3870380335 >> v2:172.21.15.12:3300/0 conn(0x7f4944159a10 0x7f49440ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4948f9c700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f49440cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4942ffd700 1 -- 172.21.15.12:0/3870380335 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 307959382 0 0) 0x7f49440c7420 con 0x7f4944159640 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4942ffd700 1 -- 172.21.15.12:0/3870380335 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f492c003570 con 0x7f4944159640 2023-10-08T16:10:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f49437fe700 1 -- 172.21.15.12:0/3870380335 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 msgr2=0x7f49440cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f49437fe700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f49440cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f49437fe700 1 -- 172.21.15.12:0/3870380335 >> v1:172.21.15.12:6789/0 conn(0x7f4944159640 legacy=0x7f494406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f49437fe700 1 -- 172.21.15.12:0/3870380335 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494406dde0 con 0x7f4944159a10 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.348+0000 7f4948f9c700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f49440cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f49437fe700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159a10 0x7f49440ca7b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49380098e0 tx=0x7f49380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9bff4a44bebe3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f4942ffd700 1 -- 172.21.15.12:0/3870380335 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800b640 con 0x7f4944159a10 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f4942ffd700 1 -- 172.21.15.12:0/3870380335 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800b7a0 con 0x7f4944159a10 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f4942ffd700 1 -- 172.21.15.12:0/3870380335 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800bb40 con 0x7f4944159a10 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 -- 172.21.15.12:0/3870380335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159a10 msgr2=0x7f49440ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159a10 0x7f49440ca7b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49380098e0 tx=0x7f49380091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 -- 172.21.15.12:0/3870380335 shutdown_connections 2023-10-08T16:10:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f49440cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 --2- 172.21.15.12:0/3870380335 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159a10 0x7f49440ca7b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 -- 172.21.15.12:0/3870380335 >> 172.21.15.12:0/3870380335 conn(0x7f494406e720 msgr2=0x7f494406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.349+0000 7f494979d700 1 -- 172.21.15.12:0/3870380335 shutdown_connections 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.350+0000 7f494979d700 1 -- 172.21.15.12:0/3870380335 wait complete. 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.351+0000 7f494979d700 1 Processor -- start 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.351+0000 7f494979d700 1 -- start start 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f4944152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 0x7f49440b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c80d0 con 0x7f4944159640 2023-10-08T16:10:22.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c82e0 con 0x7f4944159a10 2023-10-08T16:10:22.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f494979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49440c85c0 con 0x7f4944070410 2023-10-08T16:10:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f49437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f49437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53740/0 (socket says 172.21.15.12:53740) 2023-10-08T16:10:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f49437fe700 1 -- 172.21.15.12:0/2099662995 learned_addr learned my addr 172.21.15.12:0/2099662995 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f4943fff700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f4944152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.352+0000 7f4948f9c700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 0x7f49440b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 -- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 msgr2=0x7f4944152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f4944152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 -- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 msgr2=0x7f49440b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 0x7f49440b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 -- 172.21.15.12:0/2099662995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009420 con 0x7f4944159640 2023-10-08T16:10:22.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f4948f9c700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 0x7f49440b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f49437fe700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4938013000 tx=0x7f4938017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493801bcf0 con 0x7f4944159640 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493801be90 con 0x7f4944159640 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4938011670 con 0x7f4944159640 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49440c88a0 con 0x7f4944159640 2023-10-08T16:10:22.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.353+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49440c8e60 con 0x7f4944159640 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.354+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f494404c3c0 con 0x7f4944159640 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.355+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49380119e0 con 0x7f4944159640 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.356+0000 7f492bfff700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 0x7f49300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.356+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f49380857b0 con 0x7f4944159640 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.356+0000 7f4943fff700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 0x7f49300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.357+0000 7f4943fff700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 0x7f49300693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4934007fd0 tx=0x7f4934009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.360+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4938052cd0 con 0x7f4944159640 2023-10-08T16:10:22.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.642+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4944156fd0 con 0x7f4944159640 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.646+0000 7f492bfff700 1 -- 172.21.15.12:0/2099662995 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f49380562f0 con 0x7f4944159640 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 msgr2=0x7f49300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 0x7f49300693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4934007fd0 tx=0x7f4934009040 comp rx=0 tx=0).stop 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 msgr2=0x7f49440c7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4938013000 tx=0x7f4938017000 comp rx=0 tx=0).stop 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 shutdown_connections 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4944159a10 0x7f49440b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4944070410 0x7f4944152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4930066f30 0x7f49300693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 --2- 172.21.15.12:0/2099662995 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4944159640 0x7f49440c7b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 >> 172.21.15.12:0/2099662995 conn(0x7f494406e720 msgr2=0x7f49441572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 shutdown_connections 2023-10-08T16:10:22.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.648+0000 7f494979d700 1 -- 172.21.15.12:0/2099662995 wait complete. 2023-10-08T16:10:22.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-08T16:10:22.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.860+0000 7fb3c739d700 1 Processor -- start 2023-10-08T16:10:22.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.860+0000 7fb3c739d700 1 -- start start 2023-10-08T16:10:22.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.861+0000 7fb3c739d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3c0159550 0x7fb3c00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.861+0000 7fb3c739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 0x7fb3c00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.861+0000 7fb3c739d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00acc00 con 0x7fb3c0159920 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.861+0000 7fb3c739d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c00abff0 con 0x7fb3c0159550 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.861+0000 7fb3c739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00ac2d0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c5b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 0x7fb3c00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3c0159550 0x7fb3c00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb3c0159550 0x7fb3c00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46088/0 (socket says 172.21.15.12:46088) 2023-10-08T16:10:22.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 -- 172.21.15.12:0/2115867307 learned_addr learned my addr 172.21.15.12:0/2115867307 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:22.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c5b9a700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 0x7fb3c00aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39418/0 (socket says 172.21.15.12:39418) 2023-10-08T16:10:22.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c6b9c700 1 --1- 172.21.15.12:0/2115867307 >> v1:172.21.15.29:6789/0 conn(0x7fb3c0159920 0x7fb3c00ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:56156/0 (socket says 172.21.15.12:56156) 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 -- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 msgr2=0x7fb3c00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 0x7fb3c00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 -- 172.21.15.12:0/2115867307 >> v1:172.21.15.29:6789/0 conn(0x7fb3c0159920 legacy=0x7fb3c00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.862+0000 7fb3c639b700 1 -- 172.21.15.12:0/2115867307 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00ac5b0 con 0x7fb3c0159550 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c639b700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c00ceac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0099b0 tx=0x7fb3bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=811325349b94ee9e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c5399700 1 -- 172.21.15.12:0/2115867307 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc009ea0 con 0x7fb3c0159550 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c5399700 1 -- 172.21.15.12:0/2115867307 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3bc00b860 con 0x7fb3c0159550 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c5399700 1 -- 172.21.15.12:0/2115867307 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3bc00bc00 con 0x7fb3c0159550 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 -- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 msgr2=0x7fb3c00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c00ceac0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0099b0 tx=0x7fb3bc009250 comp rx=0 tx=0).stop 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 -- 172.21.15.12:0/2115867307 shutdown_connections 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c00ceac0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 --2- 172.21.15.12:0/2115867307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c015dfd0 0x7fb3c00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 -- 172.21.15.12:0/2115867307 >> 172.21.15.12:0/2115867307 conn(0x7fb3c006ce80 msgr2=0x7fb3c00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 -- 172.21.15.12:0/2115867307 shutdown_connections 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.863+0000 7fb3c739d700 1 -- 172.21.15.12:0/2115867307 wait complete. 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.865+0000 7fb3c739d700 1 Processor -- start 2023-10-08T16:10:22.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.865+0000 7fb3c739d700 1 -- start start 2023-10-08T16:10:22.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c0148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c0159920 0x7fb3c00cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00ce6d0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c0149420 con 0x7fb3c0159550 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c00cdb50 con 0x7fb3c0159920 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c6b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c6b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53756/0 (socket says 172.21.15.12:53756) 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c6b9c700 1 -- 172.21.15.12:0/4210906890 learned_addr learned my addr 172.21.15.12:0/4210906890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c639b700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c0148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.866+0000 7fb3c5b9a700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c0159920 0x7fb3c00cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 -- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c0159920 msgr2=0x7fb3c00cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c0159920 0x7fb3c00cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 -- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 msgr2=0x7fb3c0148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c0148ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 -- 172.21.15.12:0/4210906890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc0094f0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c639b700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c0148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c6b9c700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800cd00 tx=0x7fb3b8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800ce60 con 0x7fb3c015dfd0 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b8005df0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800ab00 con 0x7fb3c015dfd0 2023-10-08T16:10:22.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c00cde30 con 0x7fb3c015dfd0 2023-10-08T16:10:22.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.867+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c00ce3f0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.868+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c004c3c0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.869+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3b80070f0 con 0x7fb3c015dfd0 2023-10-08T16:10:22.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.870+0000 7fb3b67fc700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:22.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.870+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb3b8084280 con 0x7fb3c015dfd0 2023-10-08T16:10:22.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.871+0000 7fb3c639b700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:22.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.871+0000 7fb3c639b700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 0x7fb3a40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0099b0 tx=0x7fb3bc017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:22.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:22.874+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3b8051820 con 0x7fb3c015dfd0 2023-10-08T16:10:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.161+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fb3c006b8e0 con 0x7fb3c015dfd0 2023-10-08T16:10:23.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.164+0000 7fb3b67fc700 1 -- 172.21.15.12:0/4210906890 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb3b8054e40 con 0x7fb3c015dfd0 2023-10-08T16:10:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 msgr2=0x7fb3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 0x7fb3a40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc0099b0 tx=0x7fb3bc017000 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 msgr2=0x7fb3c00cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800cd00 tx=0x7fb3b8001b10 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 shutdown_connections 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb3a4066f30 0x7fb3a40693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3c015dfd0 0x7fb3c00cb4f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3c0159550 0x7fb3c0148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.166+0000 7fb3c739d700 1 --2- 172.21.15.12:0/4210906890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3c0159920 0x7fb3c00cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.167+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 >> 172.21.15.12:0/4210906890 conn(0x7fb3c006ce80 msgr2=0x7fb3c0158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.167+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 shutdown_connections 2023-10-08T16:10:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.167+0000 7fb3c739d700 1 -- 172.21.15.12:0/4210906890 wait complete. 2023-10-08T16:10:23.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-08T16:10:23.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.372+0000 7fb6e579d700 1 Processor -- start 2023-10-08T16:10:23.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.372+0000 7fb6e579d700 1 -- start start 2023-10-08T16:10:23.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6e579d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e0140a70 0x7fb6e00c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6e579d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6e0140e40 0x7fb6e00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6e579d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00c6d50 con 0x7fb6e00c8330 2023-10-08T16:10:23.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6e579d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00c7030 con 0x7fb6e0140a70 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6e579d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00c7310 con 0x7fb6e0140e40 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6dffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e0140a70 0x7fb6e00c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6dffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb6e0140a70 0x7fb6e00c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53768/0 (socket says 172.21.15.12:53768) 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6dffff700 1 -- 172.21.15.12:0/2417173321 learned_addr learned my addr 172.21.15.12:0/2417173321 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.374+0000 7fb6df7fe700 1 --2- 172.21.15.12:0/2417173321 >> v2:172.21.15.29:3300/0 conn(0x7fb6e0140e40 0x7fb6e00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6dffff700 1 -- 172.21.15.12:0/2417173321 >> v2:172.21.15.29:3300/0 conn(0x7fb6e0140e40 msgr2=0x7fb6e00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6dffff700 1 --2- 172.21.15.12:0/2417173321 >> v2:172.21.15.29:3300/0 conn(0x7fb6e0140e40 0x7fb6e00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6dffff700 1 -- 172.21.15.12:0/2417173321 >> v1:172.21.15.29:6789/0 conn(0x7fb6e00c8330 legacy=0x7fb6e00aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6dffff700 1 -- 172.21.15.12:0/2417173321 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00c75f0 con 0x7fb6e0140a70 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6dffff700 1 --2- 172.21.15.12:0/2417173321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e00c6770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00cc0e0 tx=0x7fb6d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e504d71db02ed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6deffd700 1 -- 172.21.15.12:0/2417173321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000b860 con 0x7fb6e0140a70 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6deffd700 1 -- 172.21.15.12:0/2417173321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000b9c0 con 0x7fb6e0140a70 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.375+0000 7fb6deffd700 1 -- 172.21.15.12:0/2417173321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000bd60 con 0x7fb6e0140a70 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 -- 172.21.15.12:0/2417173321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 msgr2=0x7fb6e00c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 --2- 172.21.15.12:0/2417173321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e00c6770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00cc0e0 tx=0x7fb6d0009250 comp rx=0 tx=0).stop 2023-10-08T16:10:23.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 -- 172.21.15.12:0/2417173321 shutdown_connections 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 --2- 172.21.15.12:0/2417173321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e00c6770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 --2- 172.21.15.12:0/2417173321 >> v2:172.21.15.29:3300/0 conn(0x7fb6e0140e40 0x7fb6e00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 -- 172.21.15.12:0/2417173321 >> 172.21.15.12:0/2417173321 conn(0x7fb6e006d170 msgr2=0x7fb6e00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 -- 172.21.15.12:0/2417173321 shutdown_connections 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.376+0000 7fb6e579d700 1 -- 172.21.15.12:0/2417173321 wait complete. 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.377+0000 7fb6e579d700 1 Processor -- start 2023-10-08T16:10:23.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 -- start start 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e00c8330 0x7fb6e0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 0x7fb6e0158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e016d630 con 0x7fb6e0140a70 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e00ca710 con 0x7fb6e00c8330 2023-10-08T16:10:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.378+0000 7fb6e579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015a4d0 con 0x7fb6e0140e40 2023-10-08T16:10:23.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53772/0 (socket says 172.21.15.12:53772) 2023-10-08T16:10:23.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 -- 172.21.15.12:0/3085867359 learned_addr learned my addr 172.21.15.12:0/3085867359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:23.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6dffff700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e00c8330 0x7fb6e0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6e4f9c700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 0x7fb6e0158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 -- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 msgr2=0x7fb6e0158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 0x7fb6e0158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 -- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e00c8330 msgr2=0x7fb6e0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e00c8330 0x7fb6e0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 -- 172.21.15.12:0/3085867359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00094f0 con 0x7fb6e0140a70 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6e4f9c700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 0x7fb6e0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:23.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.379+0000 7fb6df7fe700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400d890 tx=0x7fb6d4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.380+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4018070 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.380+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4005a00 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.380+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00ca920 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.380+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4005dc0 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.380+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e00caee0 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.381+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e004c3c0 con 0x7fb6e0140a70 2023-10-08T16:10:23.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.382+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6d4012800 con 0x7fb6e0140a70 2023-10-08T16:10:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.382+0000 7fb6c7fff700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.383+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb6d40843b0 con 0x7fb6e0140a70 2023-10-08T16:10:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.383+0000 7fb6dffff700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.383+0000 7fb6dffff700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 0x7fb6cc0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00cc0e0 tx=0x7fb6d0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.387+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6d40518d0 con 0x7fb6e0140a70 2023-10-08T16:10:23.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.667+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb6e00c78d0 con 0x7fb6e0140a70 2023-10-08T16:10:23.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.671+0000 7fb6c7fff700 1 -- 172.21.15.12:0/3085867359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb6d4054ef0 con 0x7fb6e0140a70 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 msgr2=0x7fb6cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 0x7fb6cc0693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00cc0e0 tx=0x7fb6d0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 msgr2=0x7fb6e016d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400d890 tx=0x7fb6d4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 shutdown_connections 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6e0140e40 0x7fb6e0158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6e00c8330 0x7fb6e0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fb6cc066f30 0x7fb6cc0693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 --2- 172.21.15.12:0/3085867359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6e0140a70 0x7fb6e016d0f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 >> 172.21.15.12:0/3085867359 conn(0x7fb6e006d170 msgr2=0x7fb6e00b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 shutdown_connections 2023-10-08T16:10:23.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.674+0000 7fb6e579d700 1 -- 172.21.15.12:0/3085867359 wait complete. 2023-10-08T16:10:23.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-08T16:10:23.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.879+0000 7f1383fff700 1 Processor -- start 2023-10-08T16:10:23.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.879+0000 7f1383fff700 1 -- start start 2023-10-08T16:10:23.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138413fb20 0x7f138415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138413fef0 0x7f13840c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f138406aaa0 0x7f13840c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13840c8410 con 0x7f138413fb20 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f138415ae70 con 0x7f138406aaa0 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.880+0000 7f1383fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138406af60 con 0x7f138413fef0 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138413fb20 0x7f138415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f138413fb20 0x7f138415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53774/0 (socket says 172.21.15.12:53774) 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 -- 172.21.15.12:0/3277068966 learned_addr learned my addr 172.21.15.12:0/3277068966 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f13827fc700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138413fef0 0x7f13840c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f13837fe700 1 --2- 172.21.15.12:0/3277068966 >> v2:172.21.15.29:3300/0 conn(0x7f138406aaa0 0x7f13840c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 -- 172.21.15.12:0/3277068966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138413fef0 msgr2=0x7f13840c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:23.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138413fef0 0x7f13840c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 -- 172.21.15.12:0/3277068966 >> v2:172.21.15.29:3300/0 conn(0x7f138406aaa0 msgr2=0x7f13840c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 --2- 172.21.15.12:0/3277068966 >> v2:172.21.15.29:3300/0 conn(0x7f138406aaa0 0x7f13840c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 -- 172.21.15.12:0/3277068966 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138406b240 con 0x7f138413fb20 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.881+0000 7f1382ffd700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f138415a930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1384156920 tx=0x7f1374009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8557d9188075d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1381ffb700 1 -- 172.21.15.12:0/3277068966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400b860 con 0x7f138413fb20 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1381ffb700 1 -- 172.21.15.12:0/3277068966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137400b9c0 con 0x7f138413fb20 2023-10-08T16:10:23.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1381ffb700 1 -- 172.21.15.12:0/3277068966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f137400bd60 con 0x7f138413fb20 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 -- 172.21.15.12:0/3277068966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 msgr2=0x7f138415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f138415a930 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1384156920 tx=0x7f1374009250 comp rx=0 tx=0).stop 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 -- 172.21.15.12:0/3277068966 shutdown_connections 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 --2- 172.21.15.12:0/3277068966 >> v2:172.21.15.29:3300/0 conn(0x7f138406aaa0 0x7f13840c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f138415a930 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 --2- 172.21.15.12:0/3277068966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138413fef0 0x7f13840c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 -- 172.21.15.12:0/3277068966 >> 172.21.15.12:0/3277068966 conn(0x7f138406d170 msgr2=0x7f13840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:23.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 -- 172.21.15.12:0/3277068966 shutdown_connections 2023-10-08T16:10:23.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.882+0000 7f1383fff700 1 -- 172.21.15.12:0/3277068966 wait complete. 2023-10-08T16:10:23.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.884+0000 7f1383fff700 1 Processor -- start 2023-10-08T16:10:23.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.884+0000 7f1383fff700 1 -- start start 2023-10-08T16:10:23.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138406aaa0 0x7f138416d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 0x7f13841366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138416de50 con 0x7f138413fb20 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1384135b40 con 0x7f138413fef0 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f1383fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13840b00e0 con 0x7f138406aaa0 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53786/0 (socket says 172.21.15.12:53786) 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 -- 172.21.15.12:0/807759776 learned_addr learned my addr 172.21.15.12:0/807759776 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 -- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138406aaa0 msgr2=0x7f138416d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138406aaa0 0x7f138416d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.885+0000 7f13827fc700 1 -- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 msgr2=0x7f13841366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:23.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f13837fe700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 0x7f13841366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f13827fc700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 0x7f13841366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f13827fc700 1 -- 172.21.15.12:0/807759776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740094f0 con 0x7f138413fb20 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f13837fe700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 0x7f13841366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f13827fc700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f137800d8c0 tx=0x7f1378008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378018070 con 0x7f138413fb20 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1378005a00 con 0x7f138413fb20 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1378005da0 con 0x7f138413fb20 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13840b1510 con 0x7f138413fb20 2023-10-08T16:10:23.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.886+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13840ad710 con 0x7f138413fb20 2023-10-08T16:10:23.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.887+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13840b03c0 con 0x7f138413fb20 2023-10-08T16:10:23.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.888+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1378006230 con 0x7f138413fb20 2023-10-08T16:10:23.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.889+0000 7f136affd700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 0x7f13700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:23.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.889+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f13780843a0 con 0x7f138413fb20 2023-10-08T16:10:23.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.889+0000 7f1382ffd700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 0x7f13700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:23.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.890+0000 7f1382ffd700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 0x7f13700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1384156920 tx=0x7f1374017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:23.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:23.893+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13780518c0 con 0x7f138413fb20 2023-10-08T16:10:24.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.183+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f138404c3c0 con 0x7f138413fb20 2023-10-08T16:10:24.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.187+0000 7f136affd700 1 -- 172.21.15.12:0/807759776 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1378054ee0 con 0x7f138413fb20 2023-10-08T16:10:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 msgr2=0x7f13700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 0x7f13700693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1384156920 tx=0x7f1374017000 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 msgr2=0x7f1384135600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f137800d8c0 tx=0x7f1378008040 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 shutdown_connections 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f138413fef0 0x7f13841366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f138406aaa0 0x7f138416d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1370066f30 0x7f13700693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 --2- 172.21.15.12:0/807759776 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f138413fb20 0x7f1384135600 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 >> 172.21.15.12:0/807759776 conn(0x7f138406d170 msgr2=0x7f13840cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 shutdown_connections 2023-10-08T16:10:24.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.189+0000 7f1383fff700 1 -- 172.21.15.12:0/807759776 wait complete. 2023-10-08T16:10:24.207 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-08T16:10:24.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.394+0000 7fdb3cb9d700 1 Processor -- start 2023-10-08T16:10:24.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.394+0000 7fdb3cb9d700 1 -- start start 2023-10-08T16:10:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb3cb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb3815a8c0 0x7fdb3806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb3cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb3806ddd0 0x7fdb380cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb3cb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb3806e240 con 0x7fdb380b2980 2023-10-08T16:10:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb3cb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb380cec30 con 0x7fdb3815a8c0 2023-10-08T16:10:24.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb3cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380ce930 con 0x7fdb3806ddd0 2023-10-08T16:10:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb36ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb3815a8c0 0x7fdb3806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.395+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb3806ddd0 0x7fdb380cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb3815a8c0 0x7fdb3806d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46138/0 (socket says 172.21.15.12:46138) 2023-10-08T16:10:24.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 -- 172.21.15.12:0/3522760465 learned_addr learned my addr 172.21.15.12:0/3522760465 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 -- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb3806ddd0 msgr2=0x7fdb380cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 --2- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb3806ddd0 0x7fdb380cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 -- 172.21.15.12:0/3522760465 >> v1:172.21.15.29:6789/0 conn(0x7fdb380b2980 legacy=0x7fdb380cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 -- 172.21.15.12:0/3522760465 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb380cd510 con 0x7fdb3815a8c0 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.396+0000 7fdb36ffd700 1 --2- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3815a8c0 0x7fdb3806d890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0099b0 tx=0x7fdb2c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe103aabbeeb481 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb367fc700 1 -- 172.21.15.12:0/3522760465 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c009ea0 con 0x7fdb3815a8c0 2023-10-08T16:10:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb367fc700 1 -- 172.21.15.12:0/3522760465 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00b860 con 0x7fdb3815a8c0 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb367fc700 1 -- 172.21.15.12:0/3522760465 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00bc00 con 0x7fdb3815a8c0 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3815a8c0 msgr2=0x7fdb3806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3815a8c0 0x7fdb3806d890 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0099b0 tx=0x7fdb2c009250 comp rx=0 tx=0).stop 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/3522760465 shutdown_connections 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb3806ddd0 0x7fdb380cf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/3522760465 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3815a8c0 0x7fdb3806d890 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/3522760465 >> 172.21.15.12:0/3522760465 conn(0x7fdb380703a0 msgr2=0x7fdb380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/3522760465 shutdown_connections 2023-10-08T16:10:24.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.397+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/3522760465 wait complete. 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.399+0000 7fdb3cb9d700 1 Processor -- start 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.399+0000 7fdb3cb9d700 1 -- start start 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3806ddd0 0x7fdb380b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb3815a8c0 0x7fdb380c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b39c0 con 0x7fdb3815a8c0 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b3ca0 con 0x7fdb3806ddd0 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb3cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb380b3f80 con 0x7fdb380b2980 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb3815a8c0 0x7fdb380c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39454/0 (socket says 172.21.15.12:39454) 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 -- 172.21.15.12:0/4043739234 learned_addr learned my addr 172.21.15.12:0/4043739234 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb377fe700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3806ddd0 0x7fdb380b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 -- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3806ddd0 msgr2=0x7fdb380b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3806ddd0 0x7fdb380b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 -- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb3815a8c0 msgr2=0x7fdb380c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb3815a8c0 0x7fdb380c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.400+0000 7fdb36ffd700 1 -- 172.21.15.12:0/4043739234 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c0094f0 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb36ffd700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb380894a0 tx=0x7fdb2c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c000d10 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00bbe0 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb380b4260 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c01a6a0 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.401+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb380b4a60 con 0x7fdb380b2980 2023-10-08T16:10:24.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.402+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb380b4780 con 0x7fdb380b2980 2023-10-08T16:10:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.403+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb2c01aa10 con 0x7fdb380b2980 2023-10-08T16:10:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.404+0000 7fdb1f7fe700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 0x7fdb240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.404+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdb2c085d30 con 0x7fdb380b2980 2023-10-08T16:10:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.404+0000 7fdb377fe700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 0x7fdb240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.405+0000 7fdb377fe700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 0x7fdb240693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb380b6350 tx=0x7fdb28009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.409+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb2c0532d0 con 0x7fdb380b2980 2023-10-08T16:10:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.691+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fdb380b4780 con 0x7fdb380b2980 2023-10-08T16:10:24.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.696+0000 7fdb1f7fe700 1 -- 172.21.15.12:0/4043739234 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdb380b4780 con 0x7fdb380b2980 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 msgr2=0x7fdb240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 0x7fdb240693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdb380b6350 tx=0x7fdb28009040 comp rx=0 tx=0).stop 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 msgr2=0x7fdb380c9870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdb380894a0 tx=0x7fdb2c017000 comp rx=0 tx=0).stop 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 shutdown_connections 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdb24066f30 0x7fdb240693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb3815a8c0 0x7fdb380c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb3806ddd0 0x7fdb380b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 --2- 172.21.15.12:0/4043739234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb380b2980 0x7fdb380c9870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 >> 172.21.15.12:0/4043739234 conn(0x7fdb380703a0 msgr2=0x7fdb380cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 shutdown_connections 2023-10-08T16:10:24.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.699+0000 7fdb3cb9d700 1 -- 172.21.15.12:0/4043739234 wait complete. 2023-10-08T16:10:24.717 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:24.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.903+0000 7f57b359e700 1 Processor -- start 2023-10-08T16:10:24.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.904+0000 7f57b359e700 1 -- start start 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57b406aaa0 0x7f57b40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b415ae70 con 0x7f57b413fb20 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b406af60 con 0x7f57b406aaa0 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b406b240 con 0x7f57b413fef0 2023-10-08T16:10:24.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57b406aaa0 0x7f57b40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57b406aaa0 0x7f57b40c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53792/0 (socket says 172.21.15.12:53792) 2023-10-08T16:10:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b2d9d700 1 -- 172.21.15.12:0/3328981574 learned_addr learned my addr 172.21.15.12:0/3328981574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:24.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.905+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b2d9d700 1 -- 172.21.15.12:0/3328981574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 msgr2=0x7f57b415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:24.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b2d9d700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b2d9d700 1 -- 172.21.15.12:0/3328981574 >> v1:172.21.15.29:6789/0 conn(0x7f57b413fb20 legacy=0x7f57b40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b2d9d700 1 -- 172.21.15.12:0/3328981574 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b406b520 con 0x7f57b406aaa0 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b2d9d700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b406aaa0 0x7f57b40c9d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009f20 tx=0x7f57ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7313e2d4f0d44edb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b159a700 1 -- 172.21.15.12:0/3328981574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e070 con 0x7f57b406aaa0 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b159a700 1 -- 172.21.15.12:0/3328981574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00ba80 con 0x7f57b406aaa0 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.906+0000 7f57b159a700 1 -- 172.21.15.12:0/3328981574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0092e0 con 0x7f57b406aaa0 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 -- 172.21.15.12:0/3328981574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b406aaa0 msgr2=0x7f57b40c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b406aaa0 0x7f57b40c9d00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f57ac009f20 tx=0x7f57ac009840 comp rx=0 tx=0).stop 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 -- 172.21.15.12:0/3328981574 shutdown_connections 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b406aaa0 0x7f57b40c9d00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 --2- 172.21.15.12:0/3328981574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 -- 172.21.15.12:0/3328981574 >> 172.21.15.12:0/3328981574 conn(0x7f57b406d170 msgr2=0x7f57b40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 -- 172.21.15.12:0/3328981574 shutdown_connections 2023-10-08T16:10:24.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.907+0000 7f57b359e700 1 -- 172.21.15.12:0/3328981574 wait complete. 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.909+0000 7f57b359e700 1 Processor -- start 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.909+0000 7f57b359e700 1 -- start start 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b406aaa0 0x7f57b4155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b4156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40ac380 con 0x7f57b413fb20 2023-10-08T16:10:24.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b415b550 con 0x7f57b406aaa0 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41593f0 con 0x7f57b413fef0 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53804/0 (socket says 172.21.15.12:53804) 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 -- 172.21.15.12:0/3203917408 learned_addr learned my addr 172.21.15.12:0/3203917408 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b259c700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b406aaa0 0x7f57b4155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b2d9d700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b4156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 -- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 msgr2=0x7f57b4156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b4156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 -- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b406aaa0 msgr2=0x7f57b4155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b406aaa0 0x7f57b4155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:24.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.910+0000 7f57b1d9b700 1 -- 172.21.15.12:0/3203917408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac009ae0 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57b1d9b700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57a800d890 tx=0x7f57a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80125f0 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a8012770 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a8012b30 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b40abd30 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.911+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b41596d0 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.912+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b40ac4f0 con 0x7f57b413fb20 2023-10-08T16:10:24.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.913+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57a801e460 con 0x7f57b413fb20 2023-10-08T16:10:24.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.915+0000 7f57a27fc700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.915+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f57a80849a0 con 0x7f57b413fb20 2023-10-08T16:10:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.915+0000 7f57b259c700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.916+0000 7f57b259c700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 0x7f57940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57a4003860 tx=0x7f57a4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:24.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:24.919+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57a8051ec0 con 0x7f57b413fb20 2023-10-08T16:10:25.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.124+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57b404c3c0 con 0x7f57b413fb20 2023-10-08T16:10:25.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.125+0000 7f57a27fc700 1 -- 172.21.15.12:0/3203917408 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12182 (secure 0 0 0) 0x7f57a80554e0 con 0x7f57b413fb20 2023-10-08T16:10:25.126 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:25.126 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":31,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:21.113324+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 msgr2=0x7f57940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 0x7f57940693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f57a4003860 tx=0x7f57a4009040 comp rx=0 tx=0).stop 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 msgr2=0x7f57b415b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f57a800d890 tx=0x7f57a8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 shutdown_connections 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57b413fef0 0x7f57b4156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f57b406aaa0 0x7f57b4155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5794066f30 0x7f57940693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 --2- 172.21.15.12:0/3203917408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57b413fb20 0x7f57b415b010 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 >> 172.21.15.12:0/3203917408 conn(0x7f57b406d170 msgr2=0x7f57b40b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 shutdown_connections 2023-10-08T16:10:25.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.128+0000 7f57b359e700 1 -- 172.21.15.12:0/3203917408 wait complete. 2023-10-08T16:10:25.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:10:25.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:10:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.342+0000 7f175eb9d700 1 Processor -- start 2023-10-08T16:10:25.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.343+0000 7f175eb9d700 1 -- start start 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175eb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f17580ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175eb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f175815dfd0 0x7f17580aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175eb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580acc00 con 0x7f1758159920 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175eb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17580abff0 con 0x7f175815dfd0 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175eb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580ac2d0 con 0x7f1758159550 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175e39c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1758159920 0x7f17580ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40164/0 (socket says 172.21.15.12:40164) 2023-10-08T16:10:25.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175e39c700 1 -- 172.21.15.12:0/179619307 learned_addr learned my addr 172.21.15.12:0/179619307 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175d39a700 1 --2- 172.21.15.12:0/179619307 >> v2:172.21.15.29:3300/0 conn(0x7f175815dfd0 0x7f17580aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175db9b700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f17580ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198727148 0 0) 0x7f17580acc00 con 0x7f1758159920 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.344+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1744003570 con 0x7f1758159920 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1091785639 0 0) 0x7f1744003570 con 0x7f1758159920 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 msgr2=0x7f17580ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f17580ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 >> v2:172.21.15.29:3300/0 conn(0x7f175815dfd0 msgr2=0x7f17580aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 --2- 172.21.15.12:0/179619307 >> v2:172.21.15.29:3300/0 conn(0x7f175815dfd0 0x7f17580aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17580ac5b0 con 0x7f1758159920 2023-10-08T16:10:25.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f17500017f0 con 0x7f1758159920 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 >> v1:172.21.15.12:6789/0 conn(0x7f1758159920 legacy=0x7f17580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1744003a60 0x7f1744003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f1744004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744004d50 0x7f17440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580abff0 con 0x7f1744003a60 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580ac2d0 con 0x7f1744004d50 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174400ba60 con 0x7f1758159550 2023-10-08T16:10:25.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175db9b700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1744003a60 0x7f1744003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175d39a700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f1744004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.345+0000 7f175e39c700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744004d50 0x7f17440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 -- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 msgr2=0x7f1744004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1758159550 0x7f1744004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 -- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744004d50 msgr2=0x7f17440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744004d50 0x7f17440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 -- 172.21.15.12:0/179619307 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1744003570 con 0x7f1744003a60 2023-10-08T16:10:25.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175db9b700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1744003a60 0x7f1744003e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1754009c00 tx=0x7f17540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c6573641f99155 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400e6b0 con 0x7f1744003a60 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175400e810 con 0x7f1744003a60 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.346+0000 7f175cb99700 1 -- 172.21.15.12:0/179619307 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175400ebd0 con 0x7f1744003a60 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 -- 172.21.15.12:0/179619307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1744003a60 msgr2=0x7f1744003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 --2- 172.21.15.12:0/179619307 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1744003a60 0x7f1744003e70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1754009c00 tx=0x7f17540091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175e39c700 1 -- 172.21.15.12:0/179619307 reap_dead start 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 -- 172.21.15.12:0/179619307 shutdown_connections 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 -- 172.21.15.12:0/179619307 >> 172.21.15.12:0/179619307 conn(0x7f175806ce80 msgr2=0x7f17580ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 -- 172.21.15.12:0/179619307 shutdown_connections 2023-10-08T16:10:25.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.347+0000 7f175eb9d700 1 -- 172.21.15.12:0/179619307 wait complete. 2023-10-08T16:10:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.348+0000 7f175eb9d700 1 Processor -- start 2023-10-08T16:10:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.348+0000 7f175eb9d700 1 -- start start 2023-10-08T16:10:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744003a60 0x7f175814d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580b1150 0x7f17580c9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580c7c50 con 0x7f17580c9d40 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175814da40 con 0x7f17580b1150 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.349+0000 7f175eb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580ca2a0 con 0x7f1744003a60 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53828/0 (socket says 172.21.15.12:53828) 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 -- 172.21.15.12:0/1106629259 learned_addr learned my addr 172.21.15.12:0/1106629259 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175db9b700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744003a60 0x7f175814d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175d39a700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580b1150 0x7f17580c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 -- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744003a60 msgr2=0x7f175814d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744003a60 0x7f175814d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 -- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580b1150 msgr2=0x7f17580c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580b1150 0x7f17580c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 -- 172.21.15.12:0/1106629259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175814dc90 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f175e39c700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f175809c1f0 tx=0x7f1750001860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750017070 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.350+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f175000eb10 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.351+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f175000eed0 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.351+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175814df70 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.351+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f175814d600 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.352+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f175814e490 con 0x7f17580c9d40 2023-10-08T16:10:25.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.352+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1750013630 con 0x7f17580c9d40 2023-10-08T16:10:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.353+0000 7f174dffb700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 0x7f173c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.353+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f17500842b0 con 0x7f17580c9d40 2023-10-08T16:10:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.354+0000 7f175db9b700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 0x7f173c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.354+0000 7f175db9b700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 0x7f173c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17540091e0 tx=0x7f175401a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.357+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f175814e490 con 0x7f17580c9d40 2023-10-08T16:10:25.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.559+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f175814e490 con 0x7f17580c9d40 2023-10-08T16:10:25.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.560+0000 7f174dffb700 1 -- 172.21.15.12:0/1106629259 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f175814e490 con 0x7f17580c9d40 2023-10-08T16:10:25.561 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:10:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 msgr2=0x7f173c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 0x7f173c0693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f17540091e0 tx=0x7f175401a000 comp rx=0 tx=0).stop 2023-10-08T16:10:25.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 msgr2=0x7f175814e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f175809c1f0 tx=0x7f1750001860 comp rx=0 tx=0).stop 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 shutdown_connections 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f173c066f30 0x7f173c0693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f17580c9d40 0x7f175814e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744003a60 0x7f175814d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 --2- 172.21.15.12:0/1106629259 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f17580b1150 0x7f17580c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 >> 172.21.15.12:0/1106629259 conn(0x7f175806ce80 msgr2=0x7f1758069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 shutdown_connections 2023-10-08T16:10:25.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.562+0000 7f175eb9d700 1 -- 172.21.15.12:0/1106629259 wait complete. 2023-10-08T16:10:25.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:10:25.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.767+0000 7f19cc99d700 1 Processor -- start 2023-10-08T16:10:25.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.767+0000 7f19cc99d700 1 -- start start 2023-10-08T16:10:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.768+0000 7f19cc99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19c80af600 0x7f19c80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.768+0000 7f19cc99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c80c6d50 con 0x7f19c8140a70 2023-10-08T16:10:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.768+0000 7f19cc99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19c80c7030 con 0x7f19c8140e40 2023-10-08T16:10:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.768+0000 7f19cc99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c80c7310 con 0x7f19c80af600 2023-10-08T16:10:25.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19c8140a70 0x7f19c80c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40174/0 (socket says 172.21.15.12:40174) 2023-10-08T16:10:25.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c77fe700 1 -- 172.21.15.12:0/1934708934 learned_addr learned my addr 172.21.15.12:0/1934708934 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:25.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c7fff700 1 --2- 172.21.15.12:0/1934708934 >> v2:172.21.15.29:3300/0 conn(0x7f19c80af600 0x7f19c80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c67fc700 1 -- 172.21.15.12:0/1934708934 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040135740 0 0) 0x7f19c80c6d50 con 0x7f19c8140a70 2023-10-08T16:10:25.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c67fc700 1 -- 172.21.15.12:0/1934708934 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19b0003570 con 0x7f19c8140a70 2023-10-08T16:10:25.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c7fff700 1 -- 172.21.15.12:0/1934708934 >> v1:172.21.15.29:6789/0 conn(0x7f19c8140e40 legacy=0x7f19c80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c7fff700 1 -- 172.21.15.12:0/1934708934 >> v1:172.21.15.12:6789/0 conn(0x7f19c8140a70 legacy=0x7f19c80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.769+0000 7f19c7fff700 1 -- 172.21.15.12:0/1934708934 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80c75f0 con 0x7f19c80af600 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19c7fff700 1 --2- 172.21.15.12:0/1934708934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c80c6770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009e60 tx=0x7f19c0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83b68fedfe6eb772 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19c67fc700 1 -- 172.21.15.12:0/1934708934 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c000e070 con 0x7f19c80af600 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19c67fc700 1 -- 172.21.15.12:0/1934708934 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c000bb60 con 0x7f19c80af600 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19c67fc700 1 -- 172.21.15.12:0/1934708934 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0012430 con 0x7f19c80af600 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19cc99d700 1 -- 172.21.15.12:0/1934708934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 msgr2=0x7f19c80c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.770+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1934708934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c80c6770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009e60 tx=0x7f19c0009780 comp rx=0 tx=0).stop 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.771+0000 7f19cc99d700 1 -- 172.21.15.12:0/1934708934 shutdown_connections 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.771+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1934708934 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c80c6770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.771+0000 7f19cc99d700 1 -- 172.21.15.12:0/1934708934 >> 172.21.15.12:0/1934708934 conn(0x7f19c806d170 msgr2=0x7f19c80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.771+0000 7f19cc99d700 1 -- 172.21.15.12:0/1934708934 shutdown_connections 2023-10-08T16:10:25.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.771+0000 7f19cc99d700 1 -- 172.21.15.12:0/1934708934 wait complete. 2023-10-08T16:10:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.772+0000 7f19cc99d700 1 Processor -- start 2023-10-08T16:10:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.772+0000 7f19cc99d700 1 -- start start 2023-10-08T16:10:25.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c816cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19c8140a70 0x7f19c8169c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c816d070 con 0x7f19c8140e40 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c8157660 con 0x7f19c80af600 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19cc99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c816a160 con 0x7f19c8140a70 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53836/0 (socket says 172.21.15.12:53836) 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19c7fff700 1 -- 172.21.15.12:0/1873950194 learned_addr learned my addr 172.21.15.12:0/1873950194 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19c77fe700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c816cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.773+0000 7f19c6ffd700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19c8140a70 0x7f19c8169c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 -- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19c8140a70 msgr2=0x7f19c8169c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19c8140a70 0x7f19c8169c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 -- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 msgr2=0x7f19c816cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c816cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 -- 172.21.15.12:0/1873950194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c0009a20 con 0x7f19c8140e40 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19c7fff700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f19c8071320 tx=0x7f19c0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.774+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c0027470 con 0x7f19c8140e40 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.775+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c00275f0 con 0x7f19c8140e40 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.775+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00279b0 con 0x7f19c8140e40 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.775+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c815c2e0 con 0x7f19c8140e40 2023-10-08T16:10:25.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.775+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c815c670 con 0x7f19c8140e40 2023-10-08T16:10:25.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.776+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c804c3c0 con 0x7f19c8140e40 2023-10-08T16:10:25.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.777+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19c0024070 con 0x7f19c8140e40 2023-10-08T16:10:25.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.777+0000 7f19af7fe700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:25.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.777+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f19c0086c50 con 0x7f19c8140e40 2023-10-08T16:10:25.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.778+0000 7f19c77fe700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:25.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.778+0000 7f19c77fe700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 0x7f19b40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007fd0 tx=0x7f19b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:25.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.782+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c0054170 con 0x7f19c8140e40 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.985+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f19c80681e0 con 0x7f19c8140e40 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.985+0000 7f19af7fe700 1 -- 172.21.15.12:0/1873950194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f19c002c060 con 0x7f19c8140e40 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:10:25.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:25.987 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:10:25.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 msgr2=0x7f19b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 0x7f19b40693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007fd0 tx=0x7f19b8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 msgr2=0x7f19c8159b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f19c8071320 tx=0x7f19c0019000 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 shutdown_connections 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19b4066f30 0x7f19b40693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19c8140e40 0x7f19c8159b50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19c80af600 0x7f19c816cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.987+0000 7f19cc99d700 1 --2- 172.21.15.12:0/1873950194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19c8140a70 0x7f19c8169c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.988+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 >> 172.21.15.12:0/1873950194 conn(0x7f19c806d170 msgr2=0x7f19c813fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:25.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.988+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 shutdown_connections 2023-10-08T16:10:25.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:25.988+0000 7f19cc99d700 1 -- 172.21.15.12:0/1873950194 wait complete. 2023-10-08T16:10:26.006 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:10:26.006 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:10:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.197+0000 7f2890d9d700 1 Processor -- start 2023-10-08T16:10:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.197+0000 7f2890d9d700 1 -- start start 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f2890d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f288c157380 0x7f288c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f2890d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f288c157750 0x7f288c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f2890d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f288c0c8680 con 0x7f288c15b1a0 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f2890d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c06a7f0 con 0x7f288c157750 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f2890d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288c0c7270 con 0x7f288c157380 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f288bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f288c157750 0x7f288c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f288bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f288c157750 0x7f288c0ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53842/0 (socket says 172.21.15.12:53842) 2023-10-08T16:10:26.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.198+0000 7f288bfff700 1 -- 172.21.15.12:0/1459958803 learned_addr learned my addr 172.21.15.12:0/1459958803 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288b7fe700 1 --2- 172.21.15.12:0/1459958803 >> v2:172.21.15.29:3300/0 conn(0x7f288c157380 0x7f288c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288bfff700 1 -- 172.21.15.12:0/1459958803 >> v2:172.21.15.29:3300/0 conn(0x7f288c157380 msgr2=0x7f288c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288bfff700 1 --2- 172.21.15.12:0/1459958803 >> v2:172.21.15.29:3300/0 conn(0x7f288c157380 0x7f288c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288bfff700 1 -- 172.21.15.12:0/1459958803 >> v1:172.21.15.29:6789/0 conn(0x7f288c15b1a0 legacy=0x7f288c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288bfff700 1 -- 172.21.15.12:0/1459958803 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c158b30 con 0x7f288c157750 2023-10-08T16:10:26.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288bfff700 1 --2- 172.21.15.12:0/1459958803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c157750 0x7f288c0ae080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f288c0cd220 tx=0x7f2884009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98fc738068168d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288a7fc700 1 -- 172.21.15.12:0/1459958803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288400e070 con 0x7f288c157750 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288a7fc700 1 -- 172.21.15.12:0/1459958803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288400ba00 con 0x7f288c157750 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.199+0000 7f288a7fc700 1 -- 172.21.15.12:0/1459958803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840092e0 con 0x7f288c157750 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 -- 172.21.15.12:0/1459958803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c157750 msgr2=0x7f288c0ae080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 --2- 172.21.15.12:0/1459958803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c157750 0x7f288c0ae080 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f288c0cd220 tx=0x7f2884009840 comp rx=0 tx=0).stop 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 -- 172.21.15.12:0/1459958803 shutdown_connections 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 --2- 172.21.15.12:0/1459958803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c157750 0x7f288c0ae080 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 --2- 172.21.15.12:0/1459958803 >> v2:172.21.15.29:3300/0 conn(0x7f288c157380 0x7f288c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 -- 172.21.15.12:0/1459958803 >> 172.21.15.12:0/1459958803 conn(0x7f288c06c6a0 msgr2=0x7f288c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 -- 172.21.15.12:0/1459958803 shutdown_connections 2023-10-08T16:10:26.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.200+0000 7f2890d9d700 1 -- 172.21.15.12:0/1459958803 wait complete. 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.201+0000 7f2890d9d700 1 Processor -- start 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 -- start start 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f288c157380 0x7f288c0c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f288c157750 0x7f288c148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c25a0 con 0x7f288c15b1a0 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c1990 con 0x7f288c157750 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.202+0000 7f2890d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288c0c1c70 con 0x7f288c157380 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53848/0 (socket says 172.21.15.12:53848) 2023-10-08T16:10:26.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 -- 172.21.15.12:0/2477799991 learned_addr learned my addr 172.21.15.12:0/2477799991 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288affd700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f288c157750 0x7f288c148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288b7fe700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f288c157380 0x7f288c0c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 -- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f288c157380 msgr2=0x7f288c0c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f288c157380 0x7f288c0c2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 -- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f288c157750 msgr2=0x7f288c148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f288c157750 0x7f288c148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 -- 172.21.15.12:0/2477799991 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2884009ae0 con 0x7f288c15b1a0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.203+0000 7f288bfff700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f288c069680 tx=0x7f2884017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.204+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28840032f0 con 0x7f288c15b1a0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.204+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2884012d00 con 0x7f288c15b1a0 2023-10-08T16:10:26.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.204+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288401d670 con 0x7f288c15b1a0 2023-10-08T16:10:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.204+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f288c0c1f50 con 0x7f288c15b1a0 2023-10-08T16:10:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.204+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f288c1496f0 con 0x7f288c15b1a0 2023-10-08T16:10:26.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.205+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288c0c2f70 con 0x7f288c15b1a0 2023-10-08T16:10:26.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.206+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f288401da60 con 0x7f288c15b1a0 2023-10-08T16:10:26.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.207+0000 7f28737fe700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 0x7f2878069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:26.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.207+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2884085910 con 0x7f288c15b1a0 2023-10-08T16:10:26.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.207+0000 7f288b7fe700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 0x7f2878069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:26.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.208+0000 7f288b7fe700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 0x7f2878069460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f287c006fd0 tx=0x7f287c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:26.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.211+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2884052e30 con 0x7f288c15b1a0 2023-10-08T16:10:26.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:26.414+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f288c157e40 con 0x7f288c15b1a0 2023-10-08T16:10:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.138+0000 7f28737fe700 1 -- 172.21.15.12:0/2477799991 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2884056450 con 0x7f288c15b1a0 2023-10-08T16:10:27.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 msgr2=0x7f2878069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 0x7f2878069460 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f287c006fd0 tx=0x7f287c008040 comp rx=0 tx=0).stop 2023-10-08T16:10:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 msgr2=0x7f288c0c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f288c069680 tx=0x7f2884017000 comp rx=0 tx=0).stop 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 shutdown_connections 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2878066fb0 0x7f2878069460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f288c15b1a0 0x7f288c0c0ef0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f288c157380 0x7f288c0c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 --2- 172.21.15.12:0/2477799991 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f288c157750 0x7f288c148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.142+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 >> 172.21.15.12:0/2477799991 conn(0x7f288c06c6a0 msgr2=0x7f288c0c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.143+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 shutdown_connections 2023-10-08T16:10:27.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.145+0000 7f2890d9d700 1 -- 172.21.15.12:0/2477799991 wait complete. 2023-10-08T16:10:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:10:27.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:10:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.364+0000 7fa3d259d700 1 Processor -- start 2023-10-08T16:10:27.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.364+0000 7fa3d259d700 1 -- start start 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.365+0000 7fa3d259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3cc142fd0 0x7fa3cc0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3cc06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d259d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0ca480 con 0x7fa3cc142c00 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c8220 con 0x7fa3cc142fd0 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15e240 con 0x7fa3cc0c7dc0 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d159b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa3cc142c00 0x7fa3cc06b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40176/0 (socket says 172.21.15.12:40176) 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d159b700 1 -- 172.21.15.12:0/1580289572 learned_addr learned my addr 172.21.15.12:0/1580289572 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:27.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d1d9c700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3cc06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3d0d9a700 1 --2- 172.21.15.12:0/1580289572 >> v2:172.21.15.29:3300/0 conn(0x7fa3cc142fd0 0x7fa3cc0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410440656 0 0) 0x7fa3cc0ca480 con 0x7fa3cc142c00 2023-10-08T16:10:27.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.366+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3b8003570 con 0x7fa3cc142c00 2023-10-08T16:10:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 232136149 0 0) 0x7fa3b8003570 con 0x7fa3cc142c00 2023-10-08T16:10:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 msgr2=0x7fa3cc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:27.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3cc06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 >> v2:172.21.15.29:3300/0 conn(0x7fa3cc142fd0 msgr2=0x7fa3cc0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 --2- 172.21.15.12:0/1580289572 >> v2:172.21.15.29:3300/0 conn(0x7fa3cc142fd0 0x7fa3cc0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc06b350 con 0x7fa3cc142c00 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fa3c8001470 con 0x7fa3cc142c00 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3d1d9c700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3cc06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 >> v1:172.21.15.12:6789/0 conn(0x7fa3cc142c00 legacy=0x7fa3cc06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3b8004810 0x7fa3b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c8220 con 0x7fa3b8003a60 2023-10-08T16:10:27.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc15e240 con 0x7fa3b8004810 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b800ba60 con 0x7fa3cc0c7dc0 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3d159b700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3d0d9a700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3b8004810 0x7fa3b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.367+0000 7fa3d1d9c700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 -- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 msgr2=0x7fa3b80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c7dc0 0x7fa3b80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 -- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3b8004810 msgr2=0x7fa3b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3b8004810 0x7fa3b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 -- 172.21.15.12:0/1580289572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009a20 con 0x7fa3b8003a60 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3d159b700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3b8003e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c3c0 tx=0x7fa3cc06b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91a7ce8ef961100 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800ccb0 con 0x7fa3b8003a60 2023-10-08T16:10:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c800ce10 con 0x7fa3b8003a60 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.368+0000 7fa3c3fff700 1 -- 172.21.15.12:0/1580289572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8005b70 con 0x7fa3b8003a60 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 -- 172.21.15.12:0/1580289572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 msgr2=0x7fa3b8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 --2- 172.21.15.12:0/1580289572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3b8003e70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c3c0 tx=0x7fa3cc06b2c0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d1d9c700 1 -- 172.21.15.12:0/1580289572 reap_dead start 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 -- 172.21.15.12:0/1580289572 shutdown_connections 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 -- 172.21.15.12:0/1580289572 >> 172.21.15.12:0/1580289572 conn(0x7fa3cc0675a0 msgr2=0x7fa3cc0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 -- 172.21.15.12:0/1580289572 shutdown_connections 2023-10-08T16:10:27.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.369+0000 7fa3d259d700 1 -- 172.21.15.12:0/1580289572 wait complete. 2023-10-08T16:10:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.370+0000 7fa3d259d700 1 Processor -- start 2023-10-08T16:10:27.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.370+0000 7fa3d259d700 1 -- start start 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c4590 0x7fa3cc13da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3cc0c4a00 0x7fa3cc13dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0b0bc0 con 0x7fa3b8003a60 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c7260 con 0x7fa3cc0c4a00 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c7540 con 0x7fa3cc0c4590 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.371+0000 7fa3d159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53860/0 (socket says 172.21.15.12:53860) 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 -- 172.21.15.12:0/3605365691 learned_addr learned my addr 172.21.15.12:0/3605365691 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d1d9c700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3cc0c4a00 0x7fa3cc13dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d0d9a700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c4590 0x7fa3cc13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 -- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c4590 msgr2=0x7fa3cc13da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c4590 0x7fa3cc13da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 -- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3cc0c4a00 msgr2=0x7fa3cc13dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3cc0c4a00 0x7fa3cc13dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 -- 172.21.15.12:0/3605365691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0b0570 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d159b700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8011000 tx=0x7fa3c8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c800ccb0 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8000f50 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc0b0850 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.372+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8007320 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.373+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc13e510 con 0x7fa3b8003a60 2023-10-08T16:10:27.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.374+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc0b0ea0 con 0x7fa3b8003a60 2023-10-08T16:10:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.375+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3c8028460 con 0x7fa3b8003a60 2023-10-08T16:10:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.376+0000 7fa3c17fa700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 0x7fa3b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.376+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fa3c8085840 con 0x7fa3b8003a60 2023-10-08T16:10:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.376+0000 7fa3d0d9a700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 0x7fa3b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:27.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.376+0000 7fa3d0d9a700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 0x7fa3b00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0cc850 tx=0x7fa3bc0091a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:27.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.380+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3c8052bf0 con 0x7fa3b8003a60 2023-10-08T16:10:27.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:27.580+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa3cc04c3c0 con 0x7fa3b8003a60 2023-10-08T16:10:28.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.147+0000 7fa3c17fa700 1 -- 172.21.15.12:0/3605365691 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa3c8056210 con 0x7fa3b8003a60 2023-10-08T16:10:28.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.157+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 msgr2=0x7fa3b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.157+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 0x7fa3b00693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc0cc850 tx=0x7fa3bc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.157+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 msgr2=0x7fa3cc1586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.157+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8011000 tx=0x7fa3c8012000 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 shutdown_connections 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa3b0066f30 0x7fa3b00693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3b8003a60 0x7fa3cc1586b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3cc0c4a00 0x7fa3cc13dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 --2- 172.21.15.12:0/3605365691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3cc0c4590 0x7fa3cc13da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.158+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 >> 172.21.15.12:0/3605365691 conn(0x7fa3cc0675a0 msgr2=0x7fa3cc0cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.159+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 shutdown_connections 2023-10-08T16:10:28.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.160+0000 7fa3d259d700 1 -- 172.21.15.12:0/3605365691 wait complete. 2023-10-08T16:10:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:10:28.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:10:28.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.379+0000 7f20b49fe700 1 Processor -- start 2023-10-08T16:10:28.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.380+0000 7f20b49fe700 1 -- start start 2023-10-08T16:10:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20b49fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20b0159550 0x7f20b00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20b49fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f20b015dfd0 0x7f20b00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20b49fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b00acc00 con 0x7f20b0159920 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20b49fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00abff0 con 0x7f20b0159550 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20b49fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b00ac2d0 con 0x7f20b015dfd0 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20aed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20b0159550 0x7f20b00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20aed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f20b0159550 0x7f20b00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53872/0 (socket says 172.21.15.12:53872) 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20aed9d700 1 -- 172.21.15.12:0/1964766285 learned_addr learned my addr 172.21.15.12:0/1964766285 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.381+0000 7f20ae59c700 1 --2- 172.21.15.12:0/1964766285 >> v2:172.21.15.29:3300/0 conn(0x7f20b015dfd0 0x7f20b00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20aed9d700 1 -- 172.21.15.12:0/1964766285 >> v2:172.21.15.29:3300/0 conn(0x7f20b015dfd0 msgr2=0x7f20b00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20aed9d700 1 --2- 172.21.15.12:0/1964766285 >> v2:172.21.15.29:3300/0 conn(0x7f20b015dfd0 0x7f20b00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20aed9d700 1 -- 172.21.15.12:0/1964766285 >> v1:172.21.15.29:6789/0 conn(0x7f20b0159920 legacy=0x7f20b00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20aed9d700 1 -- 172.21.15.12:0/1964766285 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b00ac5b0 con 0x7f20b0159550 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20add9b700 1 -- 172.21.15.12:0/1964766285 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556456376 0 0) 0x7f20b00acc00 con 0x7f20b0159920 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20aed9d700 1 --2- 172.21.15.12:0/1964766285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b0159550 0x7f20b00ceac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20b006c180 tx=0x7f20a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d882bad7fb69f903 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20add9b700 1 -- 172.21.15.12:0/1964766285 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a0009e70 con 0x7f20b0159550 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20add9b700 1 -- 172.21.15.12:0/1964766285 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000b860 con 0x7f20b0159550 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.382+0000 7f20add9b700 1 -- 172.21.15.12:0/1964766285 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000bc00 con 0x7f20b0159550 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 -- 172.21.15.12:0/1964766285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b0159550 msgr2=0x7f20b00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 --2- 172.21.15.12:0/1964766285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b0159550 0x7f20b00ceac0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f20b006c180 tx=0x7f20a0009250 comp rx=0 tx=0).stop 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 -- 172.21.15.12:0/1964766285 shutdown_connections 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 --2- 172.21.15.12:0/1964766285 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b0159550 0x7f20b00ceac0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 --2- 172.21.15.12:0/1964766285 >> v2:172.21.15.29:3300/0 conn(0x7f20b015dfd0 0x7f20b00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 -- 172.21.15.12:0/1964766285 >> 172.21.15.12:0/1964766285 conn(0x7f20b006ce80 msgr2=0x7f20b00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 -- 172.21.15.12:0/1964766285 shutdown_connections 2023-10-08T16:10:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.383+0000 7f20b49fe700 1 -- 172.21.15.12:0/1964766285 wait complete. 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.384+0000 7f20b49fe700 1 Processor -- start 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.385+0000 7f20b49fe700 1 -- start start 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.385+0000 7f20b49fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f20b0159550 0x7f20b0154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.385+0000 7f20b49fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20b0159920 0x7f20b0147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20b49fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20b49fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00cbdd0 con 0x7f20b015dfd0 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20b49fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00cc390 con 0x7f20b0159920 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20b49fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00ce680 con 0x7f20b0159550 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53880/0 (socket says 172.21.15.12:53880) 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 -- 172.21.15.12:0/4208168421 learned_addr learned my addr 172.21.15.12:0/4208168421 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20ae59c700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20b0159920 0x7f20b0147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20aed9d700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f20b0159550 0x7f20b0154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 -- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f20b0159550 msgr2=0x7f20b0154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f20b0159550 0x7f20b0154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 -- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20b0159920 msgr2=0x7f20b0147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20b0159920 0x7f20b0147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 -- 172.21.15.12:0/4208168421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a00094f0 con 0x7f20b015dfd0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.386+0000 7f20af59e700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20a800cb60 tx=0x7f20a8001770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.387+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800a770 con 0x7f20b015dfd0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.387+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800a8d0 con 0x7f20b015dfd0 2023-10-08T16:10:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.387+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800ac90 con 0x7f20b015dfd0 2023-10-08T16:10:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.387+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b00ce960 con 0x7f20b015dfd0 2023-10-08T16:10:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.387+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b0148410 con 0x7f20b015dfd0 2023-10-08T16:10:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.388+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b00cc520 con 0x7f20b015dfd0 2023-10-08T16:10:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.389+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20a8012630 con 0x7f20b015dfd0 2023-10-08T16:10:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.390+0000 7f2096ffd700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 0x7f209c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.390+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f20a80848c0 con 0x7f20b015dfd0 2023-10-08T16:10:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.390+0000 7f20aed9d700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 0x7f209c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.391+0000 7f20aed9d700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 0x7f209c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20b006c180 tx=0x7f20a0017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.394+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20a8051af0 con 0x7f20b015dfd0 2023-10-08T16:10:28.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:28.642+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f20b004c3c0 con 0x7f20b015dfd0 2023-10-08T16:10:29.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.149+0000 7f2096ffd700 1 -- 172.21.15.12:0/4208168421 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f20a8055110 con 0x7f20b015dfd0 2023-10-08T16:10:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.156+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 msgr2=0x7f209c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.156+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 0x7f209c0693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20b006c180 tx=0x7f20a0017000 comp rx=0 tx=0).stop 2023-10-08T16:10:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.156+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 msgr2=0x7f20b00c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.156+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f20a800cb60 tx=0x7f20a8001770 comp rx=0 tx=0).stop 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 shutdown_connections 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f209c066f30 0x7f209c0693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20b015dfd0 0x7f20b00c8af0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f20b0159550 0x7f20b0154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 --2- 172.21.15.12:0/4208168421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f20b0159920 0x7f20b0147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.157+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 >> 172.21.15.12:0/4208168421 conn(0x7f20b006ce80 msgr2=0x7f20b0154100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.159+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 shutdown_connections 2023-10-08T16:10:29.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.168+0000 7f20b49fe700 1 -- 172.21.15.12:0/4208168421 wait complete. 2023-10-08T16:10:29.174 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 4 and data pool 5 2023-10-08T16:10:29.197 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:29.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.384+0000 7f2d8af9d700 1 Processor -- start 2023-10-08T16:10:29.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.384+0000 7f2d8af9d700 1 -- start start 2023-10-08T16:10:29.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8af9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 0x7f2d840cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8af9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d8406e240 con 0x7f2d840b2980 2023-10-08T16:10:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8af9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d840cec30 con 0x7f2d8415a8c0 2023-10-08T16:10:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840ce930 con 0x7f2d8406ddd0 2023-10-08T16:10:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8979a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8a79c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 0x7f2d840cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8979a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46280/0 (socket says 172.21.15.12:46280) 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d8979a700 1 -- 172.21.15.12:0/1811377936 learned_addr learned my addr 172.21.15.12:0/1811377936 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.386+0000 7f2d89f9b700 1 --1- 172.21.15.12:0/1811377936 >> v1:172.21.15.29:6789/0 conn(0x7f2d840b2980 0x7f2d840cce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:56220/0 (socket says 172.21.15.12:56220) 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d88f99700 1 -- 172.21.15.12:0/1811377936 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1447199051 0 0) 0x7f2d8406e240 con 0x7f2d840b2980 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d88f99700 1 -- 172.21.15.12:0/1811377936 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d70003570 con 0x7f2d840b2980 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8a79c700 1 -- 172.21.15.12:0/1811377936 >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 msgr2=0x7f2d8406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8a79c700 1 --2- 172.21.15.12:0/1811377936 >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8a79c700 1 -- 172.21.15.12:0/1811377936 >> v1:172.21.15.29:6789/0 conn(0x7f2d840b2980 legacy=0x7f2d840cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8a79c700 1 -- 172.21.15.12:0/1811377936 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d840cd510 con 0x7f2d8406ddd0 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8979a700 1 --2- 172.21.15.12:0/1811377936 >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d8a79c700 1 --2- 172.21.15.12:0/1811377936 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 0x7f2d840cf0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009e60 tx=0x7f2d7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9744b8c4646c5d02 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d88f99700 1 -- 172.21.15.12:0/1811377936 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00e070 con 0x7f2d8406ddd0 2023-10-08T16:10:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d88f99700 1 -- 172.21.15.12:0/1811377936 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c00bab0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.387+0000 7f2d88f99700 1 -- 172.21.15.12:0/1811377936 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00be70 con 0x7f2d8406ddd0 2023-10-08T16:10:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1811377936 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 msgr2=0x7f2d840cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1811377936 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 0x7f2d840cf0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009e60 tx=0x7f2d7c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1811377936 shutdown_connections 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1811377936 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8406ddd0 0x7f2d840cf0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1811377936 >> v2:172.21.15.29:3300/0 conn(0x7f2d8415a8c0 0x7f2d8406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1811377936 >> 172.21.15.12:0/1811377936 conn(0x7f2d840703a0 msgr2=0x7f2d840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1811377936 shutdown_connections 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.388+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1811377936 wait complete. 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.390+0000 7f2d8af9d700 1 Processor -- start 2023-10-08T16:10:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.390+0000 7f2d8af9d700 1 -- start start 2023-10-08T16:10:29.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.390+0000 7f2d8af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840b2980 0x7f2d841530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8415a8c0 0x7f2d84151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840c7f70 con 0x7f2d8406ddd0 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d840ca670 con 0x7f2d840b2980 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d84152510 con 0x7f2d8415a8c0 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53892/0 (socket says 172.21.15.12:53892) 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 -- 172.21.15.12:0/1891006471 learned_addr learned my addr 172.21.15.12:0/1891006471 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8979a700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840b2980 0x7f2d841530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d8a79c700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8415a8c0 0x7f2d84151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 -- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8415a8c0 msgr2=0x7f2d84151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8415a8c0 0x7f2d84151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 -- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840b2980 msgr2=0x7f2d841530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840b2980 0x7f2d841530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.391+0000 7f2d89f9b700 1 -- 172.21.15.12:0/1891006471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d740094f0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d89f9b700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c7c0 tx=0x7f2d80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80005a70 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d80005bf0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800070d0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7c009a20 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.392+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d840c7920 con 0x7f2d8406ddd0 2023-10-08T16:10:29.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.393+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8404c3c0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.394+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d80007480 con 0x7f2d8406ddd0 2023-10-08T16:10:29.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.395+0000 7f2d79ffb700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 0x7f2d680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.395+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d80083ac0 con 0x7f2d8406ddd0 2023-10-08T16:10:29.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.395+0000 7f2d8979a700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 0x7f2d680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.396+0000 7f2d8979a700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 0x7f2d680693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d84150f40 tx=0x7f2d74009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.400+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d80050c90 con 0x7f2d8406ddd0 2023-10-08T16:10:29.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.600+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d840ce470 con 0x7f2d8406ddd0 2023-10-08T16:10:29.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.601+0000 7f2d79ffb700 1 -- 172.21.15.12:0/1891006471 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f2d80017020 con 0x7f2d8406ddd0 2023-10-08T16:10:29.602 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:29.602 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:28.643795+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 msgr2=0x7f2d680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 0x7f2d680693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2d84150f40 tx=0x7f2d74009250 comp rx=0 tx=0).stop 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 msgr2=0x7f2d84169560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c7c0 tx=0x7f2d80007e00 comp rx=0 tx=0).stop 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 shutdown_connections 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2d68066f30 0x7f2d680693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d8406ddd0 0x7f2d84169560 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d8415a8c0 0x7f2d84151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 --2- 172.21.15.12:0/1891006471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d840b2980 0x7f2d841530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 >> 172.21.15.12:0/1891006471 conn(0x7f2d840703a0 msgr2=0x7f2d8414fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 shutdown_connections 2023-10-08T16:10:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.604+0000 7f2d8af9d700 1 -- 172.21.15.12:0/1891006471 wait complete. 2023-10-08T16:10:29.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:29.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.809+0000 7f1d7919d700 1 Processor -- start 2023-10-08T16:10:29.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.809+0000 7f1d7919d700 1 -- start start 2023-10-08T16:10:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.810+0000 7f1d7919d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d7413fef0 0x7f1d7415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.810+0000 7f1d7919d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7406aaa0 0x7f1d740c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.810+0000 7f1d7919d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d7415ae70 con 0x7f1d7413fb20 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.810+0000 7f1d7919d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7406af60 con 0x7f1d7406aaa0 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.810+0000 7f1d7919d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d7406b240 con 0x7f1d7413fef0 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7406aaa0 0x7f1d740c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d73fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1d7413fb20 0x7f1d740c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40184/0 (socket says 172.21.15.12:40184) 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d7406aaa0 0x7f1d740c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53896/0 (socket says 172.21.15.12:53896) 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d73fff700 1 -- 172.21.15.12:0/388327003 learned_addr learned my addr 172.21.15.12:0/388327003 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d737fe700 1 --2- 172.21.15.12:0/388327003 >> v2:172.21.15.29:3300/0 conn(0x7f1d7413fef0 0x7f1d7415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 -- 172.21.15.12:0/388327003 >> v2:172.21.15.29:3300/0 conn(0x7f1d7413fef0 msgr2=0x7f1d7415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 --2- 172.21.15.12:0/388327003 >> v2:172.21.15.29:3300/0 conn(0x7f1d7413fef0 0x7f1d7415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 -- 172.21.15.12:0/388327003 >> v1:172.21.15.12:6789/0 conn(0x7f1d7413fb20 legacy=0x7f1d740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d72ffd700 1 -- 172.21.15.12:0/388327003 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805109106 0 0) 0x7f1d64001110 con 0x7f1d7413fb20 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.811+0000 7f1d7899c700 1 -- 172.21.15.12:0/388327003 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7406b520 con 0x7f1d7406aaa0 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7899c700 1 --2- 172.21.15.12:0/388327003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740c9d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d7406a5e0 tx=0x7f1d6c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d94149a135acd38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d72ffd700 1 -- 172.21.15.12:0/388327003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c010070 con 0x7f1d7406aaa0 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d72ffd700 1 -- 172.21.15.12:0/388327003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6c00ddc0 con 0x7f1d7406aaa0 2023-10-08T16:10:29.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d72ffd700 1 -- 172.21.15.12:0/388327003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6c00b320 con 0x7f1d7406aaa0 2023-10-08T16:10:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 -- 172.21.15.12:0/388327003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 msgr2=0x7f1d740c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 --2- 172.21.15.12:0/388327003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740c9d00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1d7406a5e0 tx=0x7f1d6c00b990 comp rx=0 tx=0).stop 2023-10-08T16:10:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 -- 172.21.15.12:0/388327003 shutdown_connections 2023-10-08T16:10:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 --2- 172.21.15.12:0/388327003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740c9d00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 --2- 172.21.15.12:0/388327003 >> v2:172.21.15.29:3300/0 conn(0x7f1d7413fef0 0x7f1d7415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 -- 172.21.15.12:0/388327003 >> 172.21.15.12:0/388327003 conn(0x7f1d7406d170 msgr2=0x7f1d740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.812+0000 7f1d7919d700 1 -- 172.21.15.12:0/388327003 shutdown_connections 2023-10-08T16:10:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.813+0000 7f1d7919d700 1 -- 172.21.15.12:0/388327003 wait complete. 2023-10-08T16:10:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.814+0000 7f1d7919d700 1 Processor -- start 2023-10-08T16:10:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.814+0000 7f1d7919d700 1 -- start start 2023-10-08T16:10:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7413fb20 0x7f1d740abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7413fef0 0x7f1d7415ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7416ca70 con 0x7f1d7406aaa0 2023-10-08T16:10:29.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ac590 con 0x7f1d7413fb20 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740ac870 con 0x7f1d7413fef0 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d73fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53900/0 (socket says 172.21.15.12:53900) 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d73fff700 1 -- 172.21.15.12:0/2452675072 learned_addr learned my addr 172.21.15.12:0/2452675072 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d737fe700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7413fb20 0x7f1d740abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.815+0000 7f1d7899c700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7413fef0 0x7f1d7415ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 -- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7413fef0 msgr2=0x7f1d7415ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7413fef0 0x7f1d7415ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 -- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7413fb20 msgr2=0x7f1d740abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7413fb20 0x7f1d740abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 -- 172.21.15.12:0/2452675072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c00bc30 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d73fff700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c810 tx=0x7f1d64007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64005b30 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d64005c90 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740acb50 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64007300 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.816+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d7415f250 con 0x7f1d7406aaa0 2023-10-08T16:10:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.817+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d7416d970 con 0x7f1d7406aaa0 2023-10-08T16:10:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.818+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1d6401b3b0 con 0x7f1d7406aaa0 2023-10-08T16:10:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.819+0000 7f1d5bfff700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.819+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d640838f0 con 0x7f1d7406aaa0 2023-10-08T16:10:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.819+0000 7f1d737fe700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:29.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.820+0000 7f1d737fe700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d740abd50 tx=0x7f1d68008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:29.823+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d7416d970 con 0x7f1d7406aaa0 2023-10-08T16:10:30.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.025+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d7415ae70 con 0x7f1d7406aaa0 2023-10-08T16:10:30.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.026+0000 7f1d5bfff700 1 -- 172.21.15.12:0/2452675072 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+15411 (secure 0 0 0) 0x7f1d7415ae70 con 0x7f1d7406aaa0 2023-10-08T16:10:30.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:30.027 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:28.643795+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:30.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 msgr2=0x7f1d600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 0x7f1d600693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d740abd50 tx=0x7f1d68008040 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 msgr2=0x7f1d740ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c810 tx=0x7f1d64007c50 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 shutdown_connections 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.028+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d60066f30 0x7f1d600693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d7406aaa0 0x7f1d740ab740 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d7413fef0 0x7f1d7415ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 --2- 172.21.15.12:0/2452675072 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d7413fb20 0x7f1d740abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 >> 172.21.15.12:0/2452675072 conn(0x7f1d7406d170 msgr2=0x7f1d740c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 shutdown_connections 2023-10-08T16:10:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.029+0000 7f1d7919d700 1 -- 172.21.15.12:0/2452675072 wait complete. 2023-10-08T16:10:30.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:10:30.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.237+0000 7fbe0719d700 1 Processor -- start 2023-10-08T16:10:30.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.237+0000 7fbe0719d700 1 -- start start 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe0006a210 0x7fbe000c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe0006de50 0x7fbe000c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0719d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe0015b640 con 0x7fbe00140a70 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe000c6800 con 0x7fbe0006de50 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0015b920 con 0x7fbe0006a210 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe0006de50 0x7fbe000c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbe0006de50 0x7fbe000c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53904/0 (socket says 172.21.15.12:53904) 2023-10-08T16:10:30.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.239+0000 7fbe0699c700 1 -- 172.21.15.12:0/2383203821 learned_addr learned my addr 172.21.15.12:0/2383203821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0599a700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe0006a210 0x7fbe000c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0699c700 1 -- 172.21.15.12:0/2383203821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe0006a210 msgr2=0x7fbe000c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0699c700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe0006a210 0x7fbe000c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0699c700 1 -- 172.21.15.12:0/2383203821 >> v1:172.21.15.29:6789/0 conn(0x7fbe00140a70 legacy=0x7fbe00069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0699c700 1 -- 172.21.15.12:0/2383203821 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0015bc00 con 0x7fbe0006de50 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe0699c700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006de50 0x7fbe000c7190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009f20 tx=0x7fbdf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8eb1da3045bcd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe05199700 1 -- 172.21.15.12:0/2383203821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800e070 con 0x7fbe0006de50 2023-10-08T16:10:30.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe05199700 1 -- 172.21.15.12:0/2383203821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf800ba80 con 0x7fbe0006de50 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.240+0000 7fbe05199700 1 -- 172.21.15.12:0/2383203821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf80092e0 con 0x7fbe0006de50 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 -- 172.21.15.12:0/2383203821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006de50 msgr2=0x7fbe000c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006de50 0x7fbe000c7190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009f20 tx=0x7fbdf8009840 comp rx=0 tx=0).stop 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 -- 172.21.15.12:0/2383203821 shutdown_connections 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006de50 0x7fbe000c7190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2383203821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe0006a210 0x7fbe000c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 -- 172.21.15.12:0/2383203821 >> 172.21.15.12:0/2383203821 conn(0x7fbe0006d110 msgr2=0x7fbe000cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 -- 172.21.15.12:0/2383203821 shutdown_connections 2023-10-08T16:10:30.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.241+0000 7fbe0719d700 1 -- 172.21.15.12:0/2383203821 wait complete. 2023-10-08T16:10:30.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.242+0000 7fbe0719d700 1 Processor -- start 2023-10-08T16:10:30.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.243+0000 7fbe0719d700 1 -- start start 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.243+0000 7fbe0719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.243+0000 7fbe0719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe0006de50 0x7fbe000c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.243+0000 7fbe0719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe00140a70 0x7fbe000c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000c4260 con 0x7fbe0006a210 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000af9a0 con 0x7fbe0006de50 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe000af070 con 0x7fbe00140a70 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53918/0 (socket says 172.21.15.12:53918) 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 -- 172.21.15.12:0/2804601035 learned_addr learned my addr 172.21.15.12:0/2804601035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0599a700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe0006de50 0x7fbe000c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0699c700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe00140a70 0x7fbe000c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 -- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe00140a70 msgr2=0x7fbe000c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe00140a70 0x7fbe000c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 -- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe0006de50 msgr2=0x7fbe000c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe0006de50 0x7fbe000c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.244+0000 7fbe0619b700 1 -- 172.21.15.12:0/2804601035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009ae0 con 0x7fbe0006a210 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbe0619b700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c4e0 tx=0x7fbdfc00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011590 con 0x7fbe0006a210 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdfc011710 con 0x7fbe0006a210 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc011ad0 con 0x7fbe0006a210 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe000af350 con 0x7fbe0006a210 2023-10-08T16:10:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.245+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe000c3f70 con 0x7fbe0006a210 2023-10-08T16:10:30.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.246+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0004c3c0 con 0x7fbe0006a210 2023-10-08T16:10:30.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.247+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdfc01b3b0 con 0x7fbe0006a210 2023-10-08T16:10:30.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.248+0000 7fbdf67fc700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 0x7fbde40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.248+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbdfc083990 con 0x7fbe0006a210 2023-10-08T16:10:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.248+0000 7fbe0599a700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 0x7fbde40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.249+0000 7fbe0599a700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 0x7fbde40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe0013dfc0 tx=0x7fbdf0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:30.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.252+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdfc050b60 con 0x7fbe0006a210 2023-10-08T16:10:30.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:30.499+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbe0015bee0 con 0x7fbe0006a210 2023-10-08T16:10:31.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.169+0000 7fbdf67fc700 1 -- 172.21.15.12:0/2804601035 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbdfc017070 con 0x7fbe0006a210 2023-10-08T16:10:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 msgr2=0x7fbde40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 0x7fbde40693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe0013dfc0 tx=0x7fbdf0008040 comp rx=0 tx=0).stop 2023-10-08T16:10:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 msgr2=0x7fbe001676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc00c4e0 tx=0x7fbdfc00c7f0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 shutdown_connections 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbde4066f30 0x7fbde40693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe0006a210 0x7fbe001676a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe00140a70 0x7fbe000c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 --2- 172.21.15.12:0/2804601035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe0006de50 0x7fbe000c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 >> 172.21.15.12:0/2804601035 conn(0x7fbe0006d110 msgr2=0x7fbe000c1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 shutdown_connections 2023-10-08T16:10:31.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.172+0000 7fbe0719d700 1 -- 172.21.15.12:0/2804601035 wait complete. 2023-10-08T16:10:31.193 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:10:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.387+0000 7f28e47ff700 1 Processor -- start 2023-10-08T16:10:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.387+0000 7f28e47ff700 1 -- start start 2023-10-08T16:10:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.388+0000 7f28e47ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28dc159530 0x7f28dc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.388+0000 7f28e47ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.388+0000 7f28e47ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28dc0ccfd0 con 0x7f28dc06e0e0 2023-10-08T16:10:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.388+0000 7f28e47ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0cf0e0 con 0x7f28dc159530 2023-10-08T16:10:31.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e47ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc15a3d0 con 0x7f28dc06dc70 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28dc159530 0x7f28dc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28dc159530 0x7f28dc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53920/0 (socket says 172.21.15.12:53920) 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 -- 172.21.15.12:0/3244875071 learned_addr learned my addr 172.21.15.12:0/3244875071 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e1d9a700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 -- 172.21.15.12:0/3244875071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 msgr2=0x7f28dc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 -- 172.21.15.12:0/3244875071 >> v1:172.21.15.12:6789/0 conn(0x7f28dc06e0e0 legacy=0x7f28dc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e259b700 1 -- 172.21.15.12:0/3244875071 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc15a6b0 con 0x7f28dc159530 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.389+0000 7f28e1599700 1 -- 172.21.15.12:0/3244875071 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576401005 0 0) 0x7f28dc0ccfd0 con 0x7f28dc06e0e0 2023-10-08T16:10:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e259b700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc0ceba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f28d80099b0 tx=0x7f28d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad6c7b46a4dfef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e1599700 1 -- 172.21.15.12:0/3244875071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800b860 con 0x7f28dc159530 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e1599700 1 -- 172.21.15.12:0/3244875071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800b9c0 con 0x7f28dc159530 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e1599700 1 -- 172.21.15.12:0/3244875071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800bd60 con 0x7f28dc159530 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 -- 172.21.15.12:0/3244875071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 msgr2=0x7f28dc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc0ceba0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f28d80099b0 tx=0x7f28d8009250 comp rx=0 tx=0).stop 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 -- 172.21.15.12:0/3244875071 shutdown_connections 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc0ceba0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 --2- 172.21.15.12:0/3244875071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.390+0000 7f28e47ff700 1 -- 172.21.15.12:0/3244875071 >> 172.21.15.12:0/3244875071 conn(0x7f28dc0703a0 msgr2=0x7f28dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.391+0000 7f28e47ff700 1 -- 172.21.15.12:0/3244875071 shutdown_connections 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.391+0000 7f28e47ff700 1 -- 172.21.15.12:0/3244875071 wait complete. 2023-10-08T16:10:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.392+0000 7f28e47ff700 1 Processor -- start 2023-10-08T16:10:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.392+0000 7f28e47ff700 1 -- start start 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28dc06e0e0 0x7f28dc152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0b3480 con 0x7f28dc159530 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0b4000 con 0x7f28dc06e0e0 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e47ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc0b6490 con 0x7f28dc06dc70 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e2d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e2d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53930/0 (socket says 172.21.15.12:53930) 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.393+0000 7f28e2d9c700 1 -- 172.21.15.12:0/2087256152 learned_addr learned my addr 172.21.15.12:0/2087256152 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:31.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e259b700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e1d9a700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28dc06e0e0 0x7f28dc152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 -- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 msgr2=0x7f28dc0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 -- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28dc06e0e0 msgr2=0x7f28dc152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28dc06e0e0 0x7f28dc152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 -- 172.21.15.12:0/2087256152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d80094f0 con 0x7f28dc159530 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e2d9c700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c930 tx=0x7f28d40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4012630 con 0x7f28dc159530 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d40127b0 con 0x7f28dc159530 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0b36d0 con 0x7f28dc159530 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.394+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4012b70 con 0x7f28dc159530 2023-10-08T16:10:31.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.395+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc0b3c90 con 0x7f28dc159530 2023-10-08T16:10:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.396+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc04c3c0 con 0x7f28dc159530 2023-10-08T16:10:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.396+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d4003030 con 0x7f28dc159530 2023-10-08T16:10:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.397+0000 7f28d27fc700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 0x7f28c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.397+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28d4084460 con 0x7f28dc159530 2023-10-08T16:10:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.398+0000 7f28e259b700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 0x7f28c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:31.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.398+0000 7f28e259b700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 0x7f28c00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28d80099b0 tx=0x7f28d8017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:31.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.402+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d4051630 con 0x7f28dc159530 2023-10-08T16:10:31.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:31.647+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f28dc15a990 con 0x7f28dc159530 2023-10-08T16:10:32.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.175+0000 7f28d27fc700 1 -- 172.21.15.12:0/2087256152 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f28d4054c50 con 0x7f28dc159530 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 msgr2=0x7f28c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 0x7f28c00693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f28d80099b0 tx=0x7f28d8017000 comp rx=0 tx=0).stop 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 msgr2=0x7f28dc155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c930 tx=0x7f28d40016f0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 shutdown_connections 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f28c0066f30 0x7f28c00693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28dc159530 0x7f28dc155c40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28dc06dc70 0x7f28dc0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 --2- 172.21.15.12:0/2087256152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28dc06e0e0 0x7f28dc152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 >> 172.21.15.12:0/2087256152 conn(0x7f28dc0703a0 msgr2=0x7f28dc153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 shutdown_connections 2023-10-08T16:10:32.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.178+0000 7f28e47ff700 1 -- 172.21.15.12:0/2087256152 wait complete. 2023-10-08T16:10:32.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:32.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.387+0000 7f60449fe700 1 Processor -- start 2023-10-08T16:10:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.387+0000 7f60449fe700 1 -- start start 2023-10-08T16:10:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f604006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 0x7f60400c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040142fd0 0x7f60400c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60400ca480 con 0x7f6040142fd0 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f604015e240 con 0x7f604006bd20 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f60449fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604006b350 con 0x7f6040142c00 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f603f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040142fd0 0x7f60400c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f603f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6040142fd0 0x7f60400c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54560/0 (socket says 172.21.15.12:54560) 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.388+0000 7f603f59e700 1 -- 172.21.15.12:0/1195780976 learned_addr learned my addr 172.21.15.12:0/1195780976 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603e59c700 1 --2- 172.21.15.12:0/1195780976 >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 0x7f60400c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603ed9d700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f604006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 -- 172.21.15.12:0/1195780976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 msgr2=0x7f604006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f604006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 -- 172.21.15.12:0/1195780976 >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 msgr2=0x7f60400c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 --2- 172.21.15.12:0/1195780976 >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 0x7f60400c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 -- 172.21.15.12:0/1195780976 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604015df60 con 0x7f6040142fd0 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603e59c700 1 --2- 172.21.15.12:0/1195780976 >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 0x7f60400c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603f59e700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f60400c7dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f604006a5e0 tx=0x7f6038009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e746be8e0df97e6a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603dd9b700 1 -- 172.21.15.12:0/1195780976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800e070 con 0x7f6040142fd0 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603dd9b700 1 -- 172.21.15.12:0/1195780976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800ba50 con 0x7f6040142fd0 2023-10-08T16:10:32.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.389+0000 7f603dd9b700 1 -- 172.21.15.12:0/1195780976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60380092e0 con 0x7f6040142fd0 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 -- 172.21.15.12:0/1195780976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 msgr2=0x7f60400c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f60400c7dc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f604006a5e0 tx=0x7f6038009840 comp rx=0 tx=0).stop 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 -- 172.21.15.12:0/1195780976 shutdown_connections 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f60400c7dc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 --2- 172.21.15.12:0/1195780976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f604006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 --2- 172.21.15.12:0/1195780976 >> v2:172.21.15.29:3300/0 conn(0x7f604006bd20 0x7f60400c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 -- 172.21.15.12:0/1195780976 >> 172.21.15.12:0/1195780976 conn(0x7f60400675a0 msgr2=0x7f60400679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 -- 172.21.15.12:0/1195780976 shutdown_connections 2023-10-08T16:10:32.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.390+0000 7f60449fe700 1 -- 172.21.15.12:0/1195780976 wait complete. 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.391+0000 7f60449fe700 1 Processor -- start 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 -- start start 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604006bd20 0x7f604013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f60400b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400b1d40 con 0x7f6040142fd0 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60400c4cd0 con 0x7f604006bd20 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.392+0000 7f60449fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604013e670 con 0x7f6040142c00 2023-10-08T16:10:32.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54574/0 (socket says 172.21.15.12:54574) 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 -- 172.21.15.12:0/2338863258 learned_addr learned my addr 172.21.15.12:0/2338863258 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603e59c700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f60400b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603ed9d700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604006bd20 0x7f604013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 -- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 msgr2=0x7f60400b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f60400b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 -- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604006bd20 msgr2=0x7f604013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604006bd20 0x7f604013d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.393+0000 7f603f59e700 1 -- 172.21.15.12:0/2338863258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6038009ae0 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f603f59e700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6038009fd0 tx=0x7f6038018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800bec0 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60380092e0 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60400b26c0 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038007040 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.394+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f604013e390 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.395+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f604004c3c0 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.396+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6038003050 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.397+0000 7f6026ffd700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 0x7f602c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.397+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6038085e70 con 0x7f6040142fd0 2023-10-08T16:10:32.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.397+0000 7f603ed9d700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 0x7f602c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.398+0000 7f603ed9d700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 0x7f602c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6030006fd0 tx=0x7f6030008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.401+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6038053040 con 0x7f6040142fd0 2023-10-08T16:10:32.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.646+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f604006ad00 con 0x7f6040142fd0 2023-10-08T16:10:32.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.647+0000 7f6026ffd700 1 -- 172.21.15.12:0/2338863258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f6038056660 con 0x7f6040142fd0 2023-10-08T16:10:32.648 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:32.648 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:10:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 msgr2=0x7f602c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 0x7f602c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6030006fd0 tx=0x7f6030008040 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 msgr2=0x7f604013bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6038009fd0 tx=0x7f6038018000 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 shutdown_connections 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f602c066f30 0x7f602c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6040142fd0 0x7f604013bbc0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f604006bd20 0x7f604013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 --2- 172.21.15.12:0/2338863258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6040142c00 0x7f60400b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.649+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 >> 172.21.15.12:0/2338863258 conn(0x7f60400675a0 msgr2=0x7f6040140300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.650+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 shutdown_connections 2023-10-08T16:10:32.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.650+0000 7f60449fe700 1 -- 172.21.15.12:0/2338863258 wait complete. 2023-10-08T16:10:32.652 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:10:32.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:10:32.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.854+0000 7faba359e700 1 Processor -- start 2023-10-08T16:10:32.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.854+0000 7faba359e700 1 -- start start 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7faba406f3a0 0x7faba414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba406a490 con 0x7faba406e0a0 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40c7230 con 0x7faba406e470 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40c7490 con 0x7faba406f3a0 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faba406e0a0 0x7faba40c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41616/0 (socket says 172.21.15.12:41616) 2023-10-08T16:10:32.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.855+0000 7faba259c700 1 -- 172.21.15.12:0/4045688850 learned_addr learned my addr 172.21.15.12:0/4045688850 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba1d9b700 1 --2- 172.21.15.12:0/4045688850 >> v2:172.21.15.29:3300/0 conn(0x7faba406f3a0 0x7faba414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366441696 0 0) 0x7faba406a490 con 0x7faba406e0a0 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab8c003570 con 0x7faba406e0a0 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159581686 0 0) 0x7fab8c003570 con 0x7faba406e0a0 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 >> v2:172.21.15.29:3300/0 conn(0x7faba406f3a0 msgr2=0x7faba414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 --2- 172.21.15.12:0/4045688850 >> v2:172.21.15.29:3300/0 conn(0x7faba406f3a0 0x7faba414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 >> v1:172.21.15.29:6789/0 conn(0x7faba406e470 legacy=0x7faba406a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40c7770 con 0x7faba406e0a0 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fab94001470 con 0x7faba406e0a0 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 >> v1:172.21.15.12:6789/0 conn(0x7faba406e0a0 legacy=0x7faba40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c003ab0 0x7fab8c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab8c004810 0x7fab8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 0x7fab8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba40c7490 con 0x7fab8c005210 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00c130 con 0x7fab8c003ab0 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.856+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c00c2f0 con 0x7fab8c004810 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 0x7fab8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba259c700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c003ab0 0x7fab8c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba1d9b700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab8c004810 0x7fab8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 -- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab8c004810 msgr2=0x7fab8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab8c004810 0x7fab8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 -- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c003ab0 msgr2=0x7fab8c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c003ab0 0x7fab8c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 -- 172.21.15.12:0/4045688850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c003570 con 0x7fab8c005210 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 -- 172.21.15.12:0/4045688850 reap_dead start 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba2d9d700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 0x7fab8c00ba60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab9c001fc0 tx=0x7fab9c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e806b61a81ce3a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c001950 con 0x7fab8c005210 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c00c8b0 con 0x7fab8c005210 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.857+0000 7faba159a700 1 -- 172.21.15.12:0/4045688850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c00cc90 con 0x7fab8c005210 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 -- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 msgr2=0x7fab8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 0x7fab8c00ba60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fab9c001fc0 tx=0x7fab9c001640 comp rx=0 tx=0).stop 2023-10-08T16:10:32.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 -- 172.21.15.12:0/4045688850 shutdown_connections 2023-10-08T16:10:32.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 --2- 172.21.15.12:0/4045688850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab8c005210 0x7fab8c00ba60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 -- 172.21.15.12:0/4045688850 >> 172.21.15.12:0/4045688850 conn(0x7faba406d170 msgr2=0x7faba40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:32.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 -- 172.21.15.12:0/4045688850 shutdown_connections 2023-10-08T16:10:32.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.858+0000 7faba359e700 1 -- 172.21.15.12:0/4045688850 wait complete. 2023-10-08T16:10:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.860+0000 7faba359e700 1 Processor -- start 2023-10-08T16:10:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.860+0000 7faba359e700 1 -- start start 2023-10-08T16:10:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c005210 0x7faba40c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faba416a9b0 0x7faba41561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba414b510 con 0x7faba40c4320 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4156f10 con 0x7fab8c005210 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba41571f0 con 0x7faba416a9b0 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54590/0 (socket says 172.21.15.12:54590) 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 -- 172.21.15.12:0/1489161603 learned_addr learned my addr 172.21.15.12:0/1489161603 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba259c700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c005210 0x7faba40c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba2d9d700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faba416a9b0 0x7faba41561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 -- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faba416a9b0 msgr2=0x7faba41561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faba416a9b0 0x7faba41561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 -- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c005210 msgr2=0x7faba40c2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c005210 0x7faba40c2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.861+0000 7faba1d9b700 1 -- 172.21.15.12:0/1489161603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba41574d0 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7faba1d9b700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab98011a40 tx=0x7fab98009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98011e80 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab98005c10 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9800f730 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba41579f0 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.862+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba4156720 con 0x7faba40c4320 2023-10-08T16:10:32.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.863+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba404c3c0 con 0x7faba40c4320 2023-10-08T16:10:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.864+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab9800fb80 con 0x7faba40c4320 2023-10-08T16:10:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.865+0000 7fab927fc700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.865+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab98084e50 con 0x7faba40c4320 2023-10-08T16:10:32.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.865+0000 7faba259c700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:32.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.866+0000 7faba259c700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 0x7fab840693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab94001e90 tx=0x7fab94001d80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:32.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:32.869+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab98052020 con 0x7faba40c4320 2023-10-08T16:10:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.071+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba40c7a50 con 0x7faba40c4320 2023-10-08T16:10:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.072+0000 7fab927fc700 1 -- 172.21.15.12:0/1489161603 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+15398 (secure 0 0 0) 0x7fab98021090 con 0x7faba40c4320 2023-10-08T16:10:33.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:33.074 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":35,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:10:30.156328+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 msgr2=0x7fab840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 0x7fab840693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fab94001e90 tx=0x7fab94001d80 comp rx=0 tx=0).stop 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 msgr2=0x7faba40c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fab98011a40 tx=0x7fab98009120 comp rx=0 tx=0).stop 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 shutdown_connections 2023-10-08T16:10:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faba416a9b0 0x7faba41561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab8c005210 0x7faba40c2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab84066f30 0x7fab840693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 --2- 172.21.15.12:0/1489161603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faba40c4320 0x7faba40c2870 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 >> 172.21.15.12:0/1489161603 conn(0x7faba406d170 msgr2=0x7faba414d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 shutdown_connections 2023-10-08T16:10:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.075+0000 7faba359e700 1 -- 172.21.15.12:0/1489161603 wait complete. 2023-10-08T16:10:33.094 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:10:33.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:33.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.280+0000 7f4d2219d700 1 Processor -- start 2023-10-08T16:10:33.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.281+0000 7f4d2219d700 1 -- start start 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d1c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2219d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c15ae70 con 0x7f4d1c13fb20 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2219d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c06af60 con 0x7f4d1c13fef0 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c06b240 con 0x7f4d1c06aaa0 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2119b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d1c13fb20 0x7f4d1c0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41626/0 (socket says 172.21.15.12:41626) 2023-10-08T16:10:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.282+0000 7f4d2119b700 1 -- 172.21.15.12:0/3881151685 learned_addr learned my addr 172.21.15.12:0/3881151685 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d2199c700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d1c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926886400 0 0) 0x7f4d18001110 con 0x7f4d1c13fb20 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d08003570 con 0x7f4d1c13fb20 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3609646751 0 0) 0x7f4d08003570 con 0x7f4d1c13fb20 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 msgr2=0x7f4d1c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d1c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 >> v1:172.21.15.29:6789/0 conn(0x7f4d1c13fef0 legacy=0x7f4d1c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c06b520 con 0x7f4d1c13fb20 2023-10-08T16:10:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f4d18001600 con 0x7f4d1c13fb20 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 >> v1:172.21.15.12:6789/0 conn(0x7f4d1c13fb20 legacy=0x7f4d1c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d08003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d08004d50 0x7f4d080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c06b240 con 0x7f4d08004060 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0800bc20 con 0x7f4d08004d50 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0800bde0 con 0x7f4d1c06aaa0 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d2099a700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.283+0000 7f4d2119b700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d08003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2199c700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d08004d50 0x7f4d080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 -- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 msgr2=0x7f4d08003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c06aaa0 0x7f4d08003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 -- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d08004d50 msgr2=0x7f4d080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d08004d50 0x7f4d080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 -- 172.21.15.12:0/3881151685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d08003570 con 0x7f4d08004060 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d2099a700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d08004810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0cd200 tx=0x7f4d0c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394681c2a2c9096b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c001290 con 0x7f4d08004060 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c0104a0 con 0x7f4d08004060 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.284+0000 7f4d13fff700 1 -- 172.21.15.12:0/3881151685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c010650 con 0x7f4d08004060 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 -- 172.21.15.12:0/3881151685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 msgr2=0x7f4d08004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 --2- 172.21.15.12:0/3881151685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d08004810 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0cd200 tx=0x7f4d0c007d80 comp rx=0 tx=0).stop 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2199c700 1 -- 172.21.15.12:0/3881151685 reap_dead start 2023-10-08T16:10:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 -- 172.21.15.12:0/3881151685 shutdown_connections 2023-10-08T16:10:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 -- 172.21.15.12:0/3881151685 >> 172.21.15.12:0/3881151685 conn(0x7f4d1c06d170 msgr2=0x7f4d1c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 -- 172.21.15.12:0/3881151685 shutdown_connections 2023-10-08T16:10:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.285+0000 7f4d2219d700 1 -- 172.21.15.12:0/3881151685 wait complete. 2023-10-08T16:10:33.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.286+0000 7f4d2219d700 1 Processor -- start 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.286+0000 7f4d2219d700 1 -- start start 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c0b0b00 0x7f4d1c0ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d1c16b2a0 0x7f4d1c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b0f70 con 0x7f4d08004060 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b07b0 con 0x7f4d1c16b2a0 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.287+0000 7f4d2219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c16a270 con 0x7f4d1c0b0b00 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54610/0 (socket says 172.21.15.12:54610) 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 -- 172.21.15.12:0/307055487 learned_addr learned my addr 172.21.15.12:0/307055487 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 -- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c0b0b00 msgr2=0x7f4d1c0ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c0b0b00 0x7f4d1c0ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 -- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d1c16b2a0 msgr2=0x7f4d1c154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d1c16b2a0 0x7f4d1c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 -- 172.21.15.12:0/307055487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c0af4b0 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d2119b700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007390 tx=0x7f4d180079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.288+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d18018030 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.289+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800f8d0 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.289+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800fcb0 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.289+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c0af790 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.289+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c0afd50 con 0x7f4d08004060 2023-10-08T16:10:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.290+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c04c3c0 con 0x7f4d08004060 2023-10-08T16:10:33.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.291+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d1801b070 con 0x7f4d08004060 2023-10-08T16:10:33.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.291+0000 7f4d117fa700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 0x7f4d000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.292+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4d18019070 con 0x7f4d08004060 2023-10-08T16:10:33.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.292+0000 7f4d2099a700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 0x7f4d000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.292+0000 7f4d2099a700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 0x7f4d000693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0cd200 tx=0x7f4d0c017000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.295+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d180515f0 con 0x7f4d08004060 2023-10-08T16:10:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.494+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d1c0aeb30 con 0x7f4d00066f30 2023-10-08T16:10:33.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.505+0000 7f4d117fa700 1 -- 172.21.15.12:0/307055487 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285388 (secure 0 0 0) 0x7f4d1c0aeb30 con 0x7f4d00066f30 2023-10-08T16:10:33.509 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 msgr2=0x7f4d000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 0x7f4d000693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0cd200 tx=0x7f4d0c017000 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 msgr2=0x7f4d1c0aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f4d18007390 tx=0x7f4d180079d0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 shutdown_connections 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4d00066f30 0x7f4d000693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d08004060 0x7f4d1c0aeed0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d1c16b2a0 0x7f4d1c154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 --2- 172.21.15.12:0/307055487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d1c0b0b00 0x7f4d1c0ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.509+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 >> 172.21.15.12:0/307055487 conn(0x7f4d1c06d170 msgr2=0x7f4d1c155e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.510+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 shutdown_connections 2023-10-08T16:10:33.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.510+0000 7f4d2219d700 1 -- 172.21.15.12:0/307055487 wait complete. 2023-10-08T16:10:33.513 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:10:33.527 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2023-10-08T16:10:31.925616+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398748,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575972,"statfs":{"total":773094113280,"available":770637795328,"internally_reserved":0,"allocated":4157440,"data_stored":2319145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.787646"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154591+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150704+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156667+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162799+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157260+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156856+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159615+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149682+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161834+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156527+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148715+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163063+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161426+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156008+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156081+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158982+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158809+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155124+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154442+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148569+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156925+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153697+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148574+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158543+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152661+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161369+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153815+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163373+0000","last_change":"2023-10-08T16:10:28.163373+0000","last_active":"2023-10-08T16:10:28.163373+0000","last_peered":"2023-10-08T16:10:28.163373+0000","last_clean":"2023-10-08T16:10:28.163373+0000","last_became_active":"2023-10-08T16:10:28.163089+0000","last_became_peered":"2023-10-08T16:10:28.163089+0000","last_unstale":"2023-10-08T16:10:28.163373+0000","last_undegraded":"2023-10-08T16:10:28.163373+0000","last_fullsized":"2023-10-08T16:10:28.163373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:53.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153918+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167459+0000","last_change":"2023-10-08T16:10:28.167459+0000","last_active":"2023-10-08T16:10:28.167459+0000","last_peered":"2023-10-08T16:10:28.167459+0000","last_clean":"2023-10-08T16:10:28.167459+0000","last_became_active":"2023-10-08T16:10:28.167128+0000","last_became_peered":"2023-10-08T16:10:28.167128+0000","last_unstale":"2023-10-08T16:10:28.167459+0000","last_undegraded":"2023-10-08T16:10:28.167459+0000","last_fullsized":"2023-10-08T16:10:28.167459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159269+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175091+0000","last_change":"2023-10-08T16:10:28.175091+0000","last_active":"2023-10-08T16:10:28.175091+0000","last_peered":"2023-10-08T16:10:28.175091+0000","last_clean":"2023-10-08T16:10:28.175091+0000","last_became_active":"2023-10-08T16:10:28.174670+0000","last_became_peered":"2023-10-08T16:10:28.174670+0000","last_unstale":"2023-10-08T16:10:28.175091+0000","last_undegraded":"2023-10-08T16:10:28.175091+0000","last_fullsized":"2023-10-08T16:10:28.175091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:16.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152648+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173996+0000","last_change":"2023-10-08T16:10:28.173996+0000","last_active":"2023-10-08T16:10:28.173996+0000","last_peered":"2023-10-08T16:10:28.173996+0000","last_clean":"2023-10-08T16:10:28.173996+0000","last_became_active":"2023-10-08T16:10:28.173677+0000","last_became_peered":"2023-10-08T16:10:28.173677+0000","last_unstale":"2023-10-08T16:10:28.173996+0000","last_undegraded":"2023-10-08T16:10:28.173996+0000","last_fullsized":"2023-10-08T16:10:28.173996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158028+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170707+0000","last_change":"2023-10-08T16:10:28.170707+0000","last_active":"2023-10-08T16:10:28.170707+0000","last_peered":"2023-10-08T16:10:28.170707+0000","last_clean":"2023-10-08T16:10:28.170707+0000","last_became_active":"2023-10-08T16:10:28.170362+0000","last_became_peered":"2023-10-08T16:10:28.170362+0000","last_unstale":"2023-10-08T16:10:28.170707+0000","last_undegraded":"2023-10-08T16:10:28.170707+0000","last_fullsized":"2023-10-08T16:10:28.170707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150126+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162755+0000","last_change":"2023-10-08T16:10:28.162755+0000","last_active":"2023-10-08T16:10:28.162755+0000","last_peered":"2023-10-08T16:10:28.162755+0000","last_clean":"2023-10-08T16:10:28.162755+0000","last_became_active":"2023-10-08T16:10:28.162471+0000","last_became_peered":"2023-10-08T16:10:28.162471+0000","last_unstale":"2023-10-08T16:10:28.162755+0000","last_undegraded":"2023-10-08T16:10:28.162755+0000","last_fullsized":"2023-10-08T16:10:28.162755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:43.527707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157446+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166722+0000","last_change":"2023-10-08T16:10:28.166722+0000","last_active":"2023-10-08T16:10:28.166722+0000","last_peered":"2023-10-08T16:10:28.166722+0000","last_clean":"2023-10-08T16:10:28.166722+0000","last_became_active":"2023-10-08T16:10:28.166405+0000","last_became_peered":"2023-10-08T16:10:28.166405+0000","last_unstale":"2023-10-08T16:10:28.166722+0000","last_undegraded":"2023-10-08T16:10:28.166722+0000","last_fullsized":"2023-10-08T16:10:28.166722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152525+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162067+0000","last_change":"2023-10-08T16:10:28.162067+0000","last_active":"2023-10-08T16:10:28.162067+0000","last_peered":"2023-10-08T16:10:28.162067+0000","last_clean":"2023-10-08T16:10:28.162067+0000","last_became_active":"2023-10-08T16:10:28.160294+0000","last_became_peered":"2023-10-08T16:10:28.160294+0000","last_unstale":"2023-10-08T16:10:28.162067+0000","last_undegraded":"2023-10-08T16:10:28.162067+0000","last_fullsized":"2023-10-08T16:10:28.162067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:57.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148675+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169908+0000","last_change":"2023-10-08T16:10:28.169908+0000","last_active":"2023-10-08T16:10:28.169908+0000","last_peered":"2023-10-08T16:10:28.169908+0000","last_clean":"2023-10-08T16:10:28.169908+0000","last_became_active":"2023-10-08T16:10:28.169556+0000","last_became_peered":"2023-10-08T16:10:28.169556+0000","last_unstale":"2023-10-08T16:10:28.169908+0000","last_undegraded":"2023-10-08T16:10:28.169908+0000","last_fullsized":"2023-10-08T16:10:28.169908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:27.880370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155261+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.156574+0000","last_change":"2023-10-08T16:10:28.156574+0000","last_active":"2023-10-08T16:10:28.156574+0000","last_peered":"2023-10-08T16:10:28.156574+0000","last_clean":"2023-10-08T16:10:28.156574+0000","last_became_active":"2023-10-08T16:10:28.156307+0000","last_became_peered":"2023-10-08T16:10:28.156307+0000","last_unstale":"2023-10-08T16:10:28.156574+0000","last_undegraded":"2023-10-08T16:10:28.156574+0000","last_fullsized":"2023-10-08T16:10:28.156574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154678+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163938+0000","last_change":"2023-10-08T16:10:28.163938+0000","last_active":"2023-10-08T16:10:28.163938+0000","last_peered":"2023-10-08T16:10:28.163938+0000","last_clean":"2023-10-08T16:10:28.163938+0000","last_became_active":"2023-10-08T16:10:28.163610+0000","last_became_peered":"2023-10-08T16:10:28.163610+0000","last_unstale":"2023-10-08T16:10:28.163938+0000","last_undegraded":"2023-10-08T16:10:28.163938+0000","last_fullsized":"2023-10-08T16:10:28.163938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149730+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175309+0000","last_change":"2023-10-08T16:10:28.175309+0000","last_active":"2023-10-08T16:10:28.175309+0000","last_peered":"2023-10-08T16:10:28.175309+0000","last_clean":"2023-10-08T16:10:28.175309+0000","last_became_active":"2023-10-08T16:10:28.174518+0000","last_became_peered":"2023-10-08T16:10:28.174518+0000","last_unstale":"2023-10-08T16:10:28.175309+0000","last_undegraded":"2023-10-08T16:10:28.175309+0000","last_fullsized":"2023-10-08T16:10:28.175309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151902+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166308+0000","last_change":"2023-10-08T16:10:28.166308+0000","last_active":"2023-10-08T16:10:28.166308+0000","last_peered":"2023-10-08T16:10:28.166308+0000","last_clean":"2023-10-08T16:10:28.166308+0000","last_became_active":"2023-10-08T16:10:28.166083+0000","last_became_peered":"2023-10-08T16:10:28.166083+0000","last_unstale":"2023-10-08T16:10:28.166308+0000","last_undegraded":"2023-10-08T16:10:28.166308+0000","last_fullsized":"2023-10-08T16:10:28.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:20.571265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153985+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.157812+0000","last_change":"2023-10-08T16:10:28.157812+0000","last_active":"2023-10-08T16:10:28.157812+0000","last_peered":"2023-10-08T16:10:28.157812+0000","last_clean":"2023-10-08T16:10:28.157812+0000","last_became_active":"2023-10-08T16:10:28.157471+0000","last_became_peered":"2023-10-08T16:10:28.157471+0000","last_unstale":"2023-10-08T16:10:28.157812+0000","last_undegraded":"2023-10-08T16:10:28.157812+0000","last_fullsized":"2023-10-08T16:10:28.157812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162055+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169436+0000","last_change":"2023-10-08T16:10:28.169436+0000","last_active":"2023-10-08T16:10:28.169436+0000","last_peered":"2023-10-08T16:10:28.169436+0000","last_clean":"2023-10-08T16:10:28.169436+0000","last_became_active":"2023-10-08T16:10:28.169084+0000","last_became_peered":"2023-10-08T16:10:28.169084+0000","last_unstale":"2023-10-08T16:10:28.169436+0000","last_undegraded":"2023-10-08T16:10:28.169436+0000","last_fullsized":"2023-10-08T16:10:28.169436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:12.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153407+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175109+0000","last_change":"2023-10-08T16:10:28.175109+0000","last_active":"2023-10-08T16:10:28.175109+0000","last_peered":"2023-10-08T16:10:28.175109+0000","last_clean":"2023-10-08T16:10:28.175109+0000","last_became_active":"2023-10-08T16:10:28.174868+0000","last_became_peered":"2023-10-08T16:10:28.174868+0000","last_unstale":"2023-10-08T16:10:28.175109+0000","last_undegraded":"2023-10-08T16:10:28.175109+0000","last_fullsized":"2023-10-08T16:10:28.175109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156736+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170494+0000","last_change":"2023-10-08T16:10:28.170494+0000","last_active":"2023-10-08T16:10:28.170494+0000","last_peered":"2023-10-08T16:10:28.170494+0000","last_clean":"2023-10-08T16:10:28.170494+0000","last_became_active":"2023-10-08T16:10:28.170192+0000","last_became_peered":"2023-10-08T16:10:28.170192+0000","last_unstale":"2023-10-08T16:10:28.170494+0000","last_undegraded":"2023-10-08T16:10:28.170494+0000","last_fullsized":"2023-10-08T16:10:28.170494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148836+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.165759+0000","last_change":"2023-10-08T16:10:28.165759+0000","last_active":"2023-10-08T16:10:28.165759+0000","last_peered":"2023-10-08T16:10:28.165759+0000","last_clean":"2023-10-08T16:10:28.165759+0000","last_became_active":"2023-10-08T16:10:28.165359+0000","last_became_peered":"2023-10-08T16:10:28.165359+0000","last_unstale":"2023-10-08T16:10:28.165759+0000","last_undegraded":"2023-10-08T16:10:28.165759+0000","last_fullsized":"2023-10-08T16:10:28.165759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.409925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151914+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.174109+0000","last_change":"2023-10-08T16:10:28.174109+0000","last_active":"2023-10-08T16:10:28.174109+0000","last_peered":"2023-10-08T16:10:28.174109+0000","last_clean":"2023-10-08T16:10:28.174109+0000","last_became_active":"2023-10-08T16:10:28.173827+0000","last_became_peered":"2023-10-08T16:10:28.173827+0000","last_unstale":"2023-10-08T16:10:28.174109+0000","last_undegraded":"2023-10-08T16:10:28.174109+0000","last_fullsized":"2023-10-08T16:10:28.174109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:33.288290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154267+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:21.577209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170218+0000","last_change":"2023-10-08T16:10:28.170218+0000","last_active":"2023-10-08T16:10:28.170218+0000","last_peered":"2023-10-08T16:10:28.170218+0000","last_clean":"2023-10-08T16:10:28.170218+0000","last_became_active":"2023-10-08T16:10:28.169946+0000","last_became_peered":"2023-10-08T16:10:28.169946+0000","last_unstale":"2023-10-08T16:10:28.170218+0000","last_undegraded":"2023-10-08T16:10:28.170218+0000","last_fullsized":"2023-10-08T16:10:28.170218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:46.251322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154860+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:57.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159695+0000","last_change":"2023-10-08T16:10:28.159695+0000","last_active":"2023-10-08T16:10:28.159695+0000","last_peered":"2023-10-08T16:10:28.159695+0000","last_clean":"2023-10-08T16:10:28.159695+0000","last_became_active":"2023-10-08T16:10:28.159455+0000","last_became_peered":"2023-10-08T16:10:28.159455+0000","last_unstale":"2023-10-08T16:10:28.159695+0000","last_undegraded":"2023-10-08T16:10:28.159695+0000","last_fullsized":"2023-10-08T16:10:28.159695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154071+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:15.415869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.168599+0000","last_change":"2023-10-08T16:10:28.168599+0000","last_active":"2023-10-08T16:10:28.168599+0000","last_peered":"2023-10-08T16:10:28.168599+0000","last_clean":"2023-10-08T16:10:28.168599+0000","last_became_active":"2023-10-08T16:10:28.168106+0000","last_became_peered":"2023-10-08T16:10:28.168106+0000","last_unstale":"2023-10-08T16:10:28.168599+0000","last_undegraded":"2023-10-08T16:10:28.168599+0000","last_fullsized":"2023-10-08T16:10:28.168599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:26.677198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154793+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:58.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.172381+0000","last_change":"2023-10-08T16:10:28.172381+0000","last_active":"2023-10-08T16:10:28.172381+0000","last_peered":"2023-10-08T16:10:28.172381+0000","last_clean":"2023-10-08T16:10:28.172381+0000","last_became_active":"2023-10-08T16:10:28.172119+0000","last_became_peered":"2023-10-08T16:10:28.172119+0000","last_unstale":"2023-10-08T16:10:28.172381+0000","last_undegraded":"2023-10-08T16:10:28.172381+0000","last_fullsized":"2023-10-08T16:10:28.172381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:39:29.599550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156741+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169590+0000","last_change":"2023-10-08T16:10:28.169590+0000","last_active":"2023-10-08T16:10:28.169590+0000","last_peered":"2023-10-08T16:10:28.169590+0000","last_clean":"2023-10-08T16:10:28.169590+0000","last_became_active":"2023-10-08T16:10:28.169122+0000","last_became_peered":"2023-10-08T16:10:28.169122+0000","last_unstale":"2023-10-08T16:10:28.169590+0000","last_undegraded":"2023-10-08T16:10:28.169590+0000","last_fullsized":"2023-10-08T16:10:28.169590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153627+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:34.294234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160833+0000","last_change":"2023-10-08T16:10:28.160833+0000","last_active":"2023-10-08T16:10:28.160833+0000","last_peered":"2023-10-08T16:10:28.160833+0000","last_clean":"2023-10-08T16:10:28.160833+0000","last_became_active":"2023-10-08T16:10:28.160500+0000","last_became_peered":"2023-10-08T16:10:28.160500+0000","last_unstale":"2023-10-08T16:10:28.160833+0000","last_undegraded":"2023-10-08T16:10:28.160833+0000","last_fullsized":"2023-10-08T16:10:28.160833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151581+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159791+0000","last_change":"2023-10-08T16:10:28.159791+0000","last_active":"2023-10-08T16:10:28.159791+0000","last_peered":"2023-10-08T16:10:28.159791+0000","last_clean":"2023-10-08T16:10:28.159791+0000","last_became_active":"2023-10-08T16:10:28.159411+0000","last_became_peered":"2023-10-08T16:10:28.159411+0000","last_unstale":"2023-10-08T16:10:28.159791+0000","last_undegraded":"2023-10-08T16:10:28.159791+0000","last_fullsized":"2023-10-08T16:10:28.159791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153023+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173314+0000","last_change":"2023-10-08T16:10:28.173314+0000","last_active":"2023-10-08T16:10:28.173314+0000","last_peered":"2023-10-08T16:10:28.173314+0000","last_clean":"2023-10-08T16:10:28.173314+0000","last_became_active":"2023-10-08T16:10:28.172896+0000","last_became_peered":"2023-10-08T16:10:28.172896+0000","last_unstale":"2023-10-08T16:10:28.173314+0000","last_undegraded":"2023-10-08T16:10:28.173314+0000","last_fullsized":"2023-10-08T16:10:28.173314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153421+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.155737+0000","last_change":"2023-10-08T16:10:28.155737+0000","last_active":"2023-10-08T16:10:28.155737+0000","last_peered":"2023-10-08T16:10:28.155737+0000","last_clean":"2023-10-08T16:10:28.155737+0000","last_became_active":"2023-10-08T16:10:28.155453+0000","last_became_peered":"2023-10-08T16:10:28.155453+0000","last_unstale":"2023-10-08T16:10:28.155737+0000","last_undegraded":"2023-10-08T16:10:28.155737+0000","last_fullsized":"2023-10-08T16:10:28.155737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152352+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160526+0000","last_change":"2023-10-08T16:10:28.160526+0000","last_active":"2023-10-08T16:10:28.160526+0000","last_peered":"2023-10-08T16:10:28.160526+0000","last_clean":"2023-10-08T16:10:28.160526+0000","last_became_active":"2023-10-08T16:10:28.160243+0000","last_became_peered":"2023-10-08T16:10:28.160243+0000","last_unstale":"2023-10-08T16:10:28.160526+0000","last_undegraded":"2023-10-08T16:10:28.160526+0000","last_fullsized":"2023-10-08T16:10:28.160526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153640+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.171416+0000","last_change":"2023-10-08T16:10:28.171416+0000","last_active":"2023-10-08T16:10:28.171416+0000","last_peered":"2023-10-08T16:10:28.171416+0000","last_clean":"2023-10-08T16:10:28.171416+0000","last_became_active":"2023-10-08T16:10:28.171217+0000","last_became_peered":"2023-10-08T16:10:28.171217+0000","last_unstale":"2023-10-08T16:10:28.171416+0000","last_undegraded":"2023-10-08T16:10:28.171416+0000","last_fullsized":"2023-10-08T16:10:28.171416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:26.909856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158863+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169980+0000","last_change":"2023-10-08T16:10:28.169980+0000","last_active":"2023-10-08T16:10:28.169980+0000","last_peered":"2023-10-08T16:10:28.169980+0000","last_clean":"2023-10-08T16:10:28.169980+0000","last_became_active":"2023-10-08T16:10:28.169573+0000","last_became_peered":"2023-10-08T16:10:28.169573+0000","last_unstale":"2023-10-08T16:10:28.169980+0000","last_undegraded":"2023-10-08T16:10:28.169980+0000","last_fullsized":"2023-10-08T16:10:28.169980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:46.425856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.160208+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167624+0000","last_change":"2023-10-08T16:10:28.167624+0000","last_active":"2023-10-08T16:10:28.167624+0000","last_peered":"2023-10-08T16:10:28.167624+0000","last_clean":"2023-10-08T16:10:28.167624+0000","last_became_active":"2023-10-08T16:10:28.167279+0000","last_became_peered":"2023-10-08T16:10:28.167279+0000","last_unstale":"2023-10-08T16:10:28.167624+0000","last_undegraded":"2023-10-08T16:10:28.167624+0000","last_fullsized":"2023-10-08T16:10:28.167624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T16:10:27.145338+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:10:27.145338+0000","last_peered":"2023-10-08T16:10:27.145338+0000","last_clean":"2023-10-08T16:10:27.145338+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:10:27.145338+0000","last_undegraded":"2023-10-08T16:10:27.145338+0000","last_fullsized":"2023-10-08T16:10:27.145338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67600000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.623},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":360448,"data_stored":136828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.623},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.749}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.496}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.443},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.497}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.746},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.054},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.024}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:33.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.753+0000 7f4ce2b9d700 1 Processor -- start 2023-10-08T16:10:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.754+0000 7f4ce2b9d700 1 -- start start 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce2b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc15ae70 con 0x7f4cdc13fef0 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce2b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cdc06af60 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc06b240 con 0x7f4cdc13fb20 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce139a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4cdc13fef0 0x7f4cdc0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41630/0 (socket says 172.21.15.12:41630) 2023-10-08T16:10:33.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce139a700 1 -- 172.21.15.12:0/1032877805 learned_addr learned my addr 172.21.15.12:0/1032877805 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.755+0000 7f4ce1b9b700 1 --2- 172.21.15.12:0/1032877805 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900017821 0 0) 0x7f4ccc001290 con 0x7f4cdc13fef0 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc8003570 con 0x7f4cdc13fef0 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020157213 0 0) 0x7f4cdc06af60 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ccc001290 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/1032877805 >> v1:172.21.15.29:6789/0 conn(0x7f4cdc06aaa0 legacy=0x7f4cdc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/1032877805 >> v1:172.21.15.12:6789/0 conn(0x7f4cdc13fef0 legacy=0x7f4cdc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/1032877805 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc06b520 con 0x7f4cdc13fb20 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.756+0000 7f4ce1b9b700 1 --2- 172.21.15.12:0/1032877805 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc15a930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009910 tx=0x7f4cd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3903321520925c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011630 con 0x7f4cdc13fb20 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8011790 con 0x7f4cdc13fb20 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce0b99700 1 -- 172.21.15.12:0/1032877805 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011b30 con 0x7f4cdc13fb20 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/1032877805 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 msgr2=0x7f4cdc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/1032877805 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc15a930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009910 tx=0x7f4cd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/1032877805 shutdown_connections 2023-10-08T16:10:33.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/1032877805 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc15a930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/1032877805 >> 172.21.15.12:0/1032877805 conn(0x7f4cdc06d170 msgr2=0x7f4cdc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/1032877805 shutdown_connections 2023-10-08T16:10:33.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.757+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/1032877805 wait complete. 2023-10-08T16:10:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.759+0000 7f4ce2b9d700 1 Processor -- start 2023-10-08T16:10:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.759+0000 7f4ce2b9d700 1 -- start start 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 0x7f4cdc0ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc0ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 0x7f4cdc16a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0ae210 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0abdd0 con 0x7f4cdc13fef0 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cdc0ad8e0 con 0x7f4cdc13fb20 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce1b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 0x7f4cdc0ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce239c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 0x7f4cdc16a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce139a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce239c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 0x7f4cdc16a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:58078/0 (socket says 172.21.15.12:58078) 2023-10-08T16:10:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.760+0000 7f4ce239c700 1 -- 172.21.15.12:0/217951919 learned_addr learned my addr 172.21.15.12:0/217951919 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 msgr2=0x7f4cdc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 msgr2=0x7f4cdc16a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 0x7f4cdc16a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 -- 172.21.15.12:0/217951919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd8009420 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce1b9b700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 0x7f4cdc0ae6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8016000 tx=0x7f4cd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd801f070 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd8002f70 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8011900 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cdc0adbc0 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.761+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cdc16a830 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.762+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cdc0ae060 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.763+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4cd8023070 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.764+0000 7f4cd1ffb700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 0x7f4cc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:33.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.764+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4cd80854c0 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.764+0000 7f4ce139a700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 0x7f4cc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.765+0000 7f4ce139a700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 0x7f4cc00693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc001230 tx=0x7f4ccc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:33.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.768+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cd8052690 con 0x7f4cdc06aaa0 2023-10-08T16:10:33.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.966+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4cdc0ae350 con 0x7f4cc0066f30 2023-10-08T16:10:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.975+0000 7f4cd1ffb700 1 -- 172.21.15.12:0/217951919 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285388 (secure 0 0 0) 0x7f4ccc002050 con 0x7f4cc0066f30 2023-10-08T16:10:33.979 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:33.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 msgr2=0x7f4cc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 0x7f4cc00693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc001230 tx=0x7f4ccc009040 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 msgr2=0x7f4cdc0ae6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 0x7f4cdc0ae6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8016000 tx=0x7f4cd8017000 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 shutdown_connections 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4cc0066f30 0x7f4cc00693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4cdc06aaa0 0x7f4cdc0ae6a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4cdc13fef0 0x7f4cdc16a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 --2- 172.21.15.12:0/217951919 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4cdc13fb20 0x7f4cdc0ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 >> 172.21.15.12:0/217951919 conn(0x7f4cdc06d170 msgr2=0x7f4cdc0cab30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.979+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 shutdown_connections 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:33.980+0000 7f4ce2b9d700 1 -- 172.21.15.12:0/217951919 wait complete. 2023-10-08T16:10:33.982 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:10:33.998 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-10-08T16:10:33.925921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398748,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575972,"statfs":{"total":773094113280,"available":770637795328,"internally_reserved":0,"allocated":4157440,"data_stored":2319145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154591+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150704+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156667+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162799+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157260+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156856+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159615+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149682+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161834+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156527+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148715+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163063+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161426+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156008+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156081+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158982+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158809+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155124+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154442+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148569+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156925+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153697+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148574+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158543+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152661+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161369+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153815+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163373+0000","last_change":"2023-10-08T16:10:28.163373+0000","last_active":"2023-10-08T16:10:28.163373+0000","last_peered":"2023-10-08T16:10:28.163373+0000","last_clean":"2023-10-08T16:10:28.163373+0000","last_became_active":"2023-10-08T16:10:28.163089+0000","last_became_peered":"2023-10-08T16:10:28.163089+0000","last_unstale":"2023-10-08T16:10:28.163373+0000","last_undegraded":"2023-10-08T16:10:28.163373+0000","last_fullsized":"2023-10-08T16:10:28.163373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:53.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153918+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167459+0000","last_change":"2023-10-08T16:10:28.167459+0000","last_active":"2023-10-08T16:10:28.167459+0000","last_peered":"2023-10-08T16:10:28.167459+0000","last_clean":"2023-10-08T16:10:28.167459+0000","last_became_active":"2023-10-08T16:10:28.167128+0000","last_became_peered":"2023-10-08T16:10:28.167128+0000","last_unstale":"2023-10-08T16:10:28.167459+0000","last_undegraded":"2023-10-08T16:10:28.167459+0000","last_fullsized":"2023-10-08T16:10:28.167459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159269+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175091+0000","last_change":"2023-10-08T16:10:28.175091+0000","last_active":"2023-10-08T16:10:28.175091+0000","last_peered":"2023-10-08T16:10:28.175091+0000","last_clean":"2023-10-08T16:10:28.175091+0000","last_became_active":"2023-10-08T16:10:28.174670+0000","last_became_peered":"2023-10-08T16:10:28.174670+0000","last_unstale":"2023-10-08T16:10:28.175091+0000","last_undegraded":"2023-10-08T16:10:28.175091+0000","last_fullsized":"2023-10-08T16:10:28.175091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:16.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152648+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173996+0000","last_change":"2023-10-08T16:10:28.173996+0000","last_active":"2023-10-08T16:10:28.173996+0000","last_peered":"2023-10-08T16:10:28.173996+0000","last_clean":"2023-10-08T16:10:28.173996+0000","last_became_active":"2023-10-08T16:10:28.173677+0000","last_became_peered":"2023-10-08T16:10:28.173677+0000","last_unstale":"2023-10-08T16:10:28.173996+0000","last_undegraded":"2023-10-08T16:10:28.173996+0000","last_fullsized":"2023-10-08T16:10:28.173996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158028+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170707+0000","last_change":"2023-10-08T16:10:28.170707+0000","last_active":"2023-10-08T16:10:28.170707+0000","last_peered":"2023-10-08T16:10:28.170707+0000","last_clean":"2023-10-08T16:10:28.170707+0000","last_became_active":"2023-10-08T16:10:28.170362+0000","last_became_peered":"2023-10-08T16:10:28.170362+0000","last_unstale":"2023-10-08T16:10:28.170707+0000","last_undegraded":"2023-10-08T16:10:28.170707+0000","last_fullsized":"2023-10-08T16:10:28.170707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150126+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162755+0000","last_change":"2023-10-08T16:10:28.162755+0000","last_active":"2023-10-08T16:10:28.162755+0000","last_peered":"2023-10-08T16:10:28.162755+0000","last_clean":"2023-10-08T16:10:28.162755+0000","last_became_active":"2023-10-08T16:10:28.162471+0000","last_became_peered":"2023-10-08T16:10:28.162471+0000","last_unstale":"2023-10-08T16:10:28.162755+0000","last_undegraded":"2023-10-08T16:10:28.162755+0000","last_fullsized":"2023-10-08T16:10:28.162755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:43.527707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157446+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166722+0000","last_change":"2023-10-08T16:10:28.166722+0000","last_active":"2023-10-08T16:10:28.166722+0000","last_peered":"2023-10-08T16:10:28.166722+0000","last_clean":"2023-10-08T16:10:28.166722+0000","last_became_active":"2023-10-08T16:10:28.166405+0000","last_became_peered":"2023-10-08T16:10:28.166405+0000","last_unstale":"2023-10-08T16:10:28.166722+0000","last_undegraded":"2023-10-08T16:10:28.166722+0000","last_fullsized":"2023-10-08T16:10:28.166722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152525+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162067+0000","last_change":"2023-10-08T16:10:28.162067+0000","last_active":"2023-10-08T16:10:28.162067+0000","last_peered":"2023-10-08T16:10:28.162067+0000","last_clean":"2023-10-08T16:10:28.162067+0000","last_became_active":"2023-10-08T16:10:28.160294+0000","last_became_peered":"2023-10-08T16:10:28.160294+0000","last_unstale":"2023-10-08T16:10:28.162067+0000","last_undegraded":"2023-10-08T16:10:28.162067+0000","last_fullsized":"2023-10-08T16:10:28.162067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:57.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148675+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169908+0000","last_change":"2023-10-08T16:10:28.169908+0000","last_active":"2023-10-08T16:10:28.169908+0000","last_peered":"2023-10-08T16:10:28.169908+0000","last_clean":"2023-10-08T16:10:28.169908+0000","last_became_active":"2023-10-08T16:10:28.169556+0000","last_became_peered":"2023-10-08T16:10:28.169556+0000","last_unstale":"2023-10-08T16:10:28.169908+0000","last_undegraded":"2023-10-08T16:10:28.169908+0000","last_fullsized":"2023-10-08T16:10:28.169908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:27.880370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155261+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.156574+0000","last_change":"2023-10-08T16:10:28.156574+0000","last_active":"2023-10-08T16:10:28.156574+0000","last_peered":"2023-10-08T16:10:28.156574+0000","last_clean":"2023-10-08T16:10:28.156574+0000","last_became_active":"2023-10-08T16:10:28.156307+0000","last_became_peered":"2023-10-08T16:10:28.156307+0000","last_unstale":"2023-10-08T16:10:28.156574+0000","last_undegraded":"2023-10-08T16:10:28.156574+0000","last_fullsized":"2023-10-08T16:10:28.156574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154678+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163938+0000","last_change":"2023-10-08T16:10:28.163938+0000","last_active":"2023-10-08T16:10:28.163938+0000","last_peered":"2023-10-08T16:10:28.163938+0000","last_clean":"2023-10-08T16:10:28.163938+0000","last_became_active":"2023-10-08T16:10:28.163610+0000","last_became_peered":"2023-10-08T16:10:28.163610+0000","last_unstale":"2023-10-08T16:10:28.163938+0000","last_undegraded":"2023-10-08T16:10:28.163938+0000","last_fullsized":"2023-10-08T16:10:28.163938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149730+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175309+0000","last_change":"2023-10-08T16:10:28.175309+0000","last_active":"2023-10-08T16:10:28.175309+0000","last_peered":"2023-10-08T16:10:28.175309+0000","last_clean":"2023-10-08T16:10:28.175309+0000","last_became_active":"2023-10-08T16:10:28.174518+0000","last_became_peered":"2023-10-08T16:10:28.174518+0000","last_unstale":"2023-10-08T16:10:28.175309+0000","last_undegraded":"2023-10-08T16:10:28.175309+0000","last_fullsized":"2023-10-08T16:10:28.175309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151902+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166308+0000","last_change":"2023-10-08T16:10:28.166308+0000","last_active":"2023-10-08T16:10:28.166308+0000","last_peered":"2023-10-08T16:10:28.166308+0000","last_clean":"2023-10-08T16:10:28.166308+0000","last_became_active":"2023-10-08T16:10:28.166083+0000","last_became_peered":"2023-10-08T16:10:28.166083+0000","last_unstale":"2023-10-08T16:10:28.166308+0000","last_undegraded":"2023-10-08T16:10:28.166308+0000","last_fullsized":"2023-10-08T16:10:28.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:20.571265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153985+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.157812+0000","last_change":"2023-10-08T16:10:28.157812+0000","last_active":"2023-10-08T16:10:28.157812+0000","last_peered":"2023-10-08T16:10:28.157812+0000","last_clean":"2023-10-08T16:10:28.157812+0000","last_became_active":"2023-10-08T16:10:28.157471+0000","last_became_peered":"2023-10-08T16:10:28.157471+0000","last_unstale":"2023-10-08T16:10:28.157812+0000","last_undegraded":"2023-10-08T16:10:28.157812+0000","last_fullsized":"2023-10-08T16:10:28.157812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162055+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169436+0000","last_change":"2023-10-08T16:10:28.169436+0000","last_active":"2023-10-08T16:10:28.169436+0000","last_peered":"2023-10-08T16:10:28.169436+0000","last_clean":"2023-10-08T16:10:28.169436+0000","last_became_active":"2023-10-08T16:10:28.169084+0000","last_became_peered":"2023-10-08T16:10:28.169084+0000","last_unstale":"2023-10-08T16:10:28.169436+0000","last_undegraded":"2023-10-08T16:10:28.169436+0000","last_fullsized":"2023-10-08T16:10:28.169436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:12.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153407+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175109+0000","last_change":"2023-10-08T16:10:28.175109+0000","last_active":"2023-10-08T16:10:28.175109+0000","last_peered":"2023-10-08T16:10:28.175109+0000","last_clean":"2023-10-08T16:10:28.175109+0000","last_became_active":"2023-10-08T16:10:28.174868+0000","last_became_peered":"2023-10-08T16:10:28.174868+0000","last_unstale":"2023-10-08T16:10:28.175109+0000","last_undegraded":"2023-10-08T16:10:28.175109+0000","last_fullsized":"2023-10-08T16:10:28.175109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156736+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170494+0000","last_change":"2023-10-08T16:10:28.170494+0000","last_active":"2023-10-08T16:10:28.170494+0000","last_peered":"2023-10-08T16:10:28.170494+0000","last_clean":"2023-10-08T16:10:28.170494+0000","last_became_active":"2023-10-08T16:10:28.170192+0000","last_became_peered":"2023-10-08T16:10:28.170192+0000","last_unstale":"2023-10-08T16:10:28.170494+0000","last_undegraded":"2023-10-08T16:10:28.170494+0000","last_fullsized":"2023-10-08T16:10:28.170494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148836+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.165759+0000","last_change":"2023-10-08T16:10:28.165759+0000","last_active":"2023-10-08T16:10:28.165759+0000","last_peered":"2023-10-08T16:10:28.165759+0000","last_clean":"2023-10-08T16:10:28.165759+0000","last_became_active":"2023-10-08T16:10:28.165359+0000","last_became_peered":"2023-10-08T16:10:28.165359+0000","last_unstale":"2023-10-08T16:10:28.165759+0000","last_undegraded":"2023-10-08T16:10:28.165759+0000","last_fullsized":"2023-10-08T16:10:28.165759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.409925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151914+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.174109+0000","last_change":"2023-10-08T16:10:28.174109+0000","last_active":"2023-10-08T16:10:28.174109+0000","last_peered":"2023-10-08T16:10:28.174109+0000","last_clean":"2023-10-08T16:10:28.174109+0000","last_became_active":"2023-10-08T16:10:28.173827+0000","last_became_peered":"2023-10-08T16:10:28.173827+0000","last_unstale":"2023-10-08T16:10:28.174109+0000","last_undegraded":"2023-10-08T16:10:28.174109+0000","last_fullsized":"2023-10-08T16:10:28.174109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:33.288290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154267+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:21.577209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170218+0000","last_change":"2023-10-08T16:10:28.170218+0000","last_active":"2023-10-08T16:10:28.170218+0000","last_peered":"2023-10-08T16:10:28.170218+0000","last_clean":"2023-10-08T16:10:28.170218+0000","last_became_active":"2023-10-08T16:10:28.169946+0000","last_became_peered":"2023-10-08T16:10:28.169946+0000","last_unstale":"2023-10-08T16:10:28.170218+0000","last_undegraded":"2023-10-08T16:10:28.170218+0000","last_fullsized":"2023-10-08T16:10:28.170218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:46.251322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154860+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:57.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159695+0000","last_change":"2023-10-08T16:10:28.159695+0000","last_active":"2023-10-08T16:10:28.159695+0000","last_peered":"2023-10-08T16:10:28.159695+0000","last_clean":"2023-10-08T16:10:28.159695+0000","last_became_active":"2023-10-08T16:10:28.159455+0000","last_became_peered":"2023-10-08T16:10:28.159455+0000","last_unstale":"2023-10-08T16:10:28.159695+0000","last_undegraded":"2023-10-08T16:10:28.159695+0000","last_fullsized":"2023-10-08T16:10:28.159695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154071+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:15.415869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.168599+0000","last_change":"2023-10-08T16:10:28.168599+0000","last_active":"2023-10-08T16:10:28.168599+0000","last_peered":"2023-10-08T16:10:28.168599+0000","last_clean":"2023-10-08T16:10:28.168599+0000","last_became_active":"2023-10-08T16:10:28.168106+0000","last_became_peered":"2023-10-08T16:10:28.168106+0000","last_unstale":"2023-10-08T16:10:28.168599+0000","last_undegraded":"2023-10-08T16:10:28.168599+0000","last_fullsized":"2023-10-08T16:10:28.168599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:26.677198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154793+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:58.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.172381+0000","last_change":"2023-10-08T16:10:28.172381+0000","last_active":"2023-10-08T16:10:28.172381+0000","last_peered":"2023-10-08T16:10:28.172381+0000","last_clean":"2023-10-08T16:10:28.172381+0000","last_became_active":"2023-10-08T16:10:28.172119+0000","last_became_peered":"2023-10-08T16:10:28.172119+0000","last_unstale":"2023-10-08T16:10:28.172381+0000","last_undegraded":"2023-10-08T16:10:28.172381+0000","last_fullsized":"2023-10-08T16:10:28.172381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:39:29.599550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156741+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169590+0000","last_change":"2023-10-08T16:10:28.169590+0000","last_active":"2023-10-08T16:10:28.169590+0000","last_peered":"2023-10-08T16:10:28.169590+0000","last_clean":"2023-10-08T16:10:28.169590+0000","last_became_active":"2023-10-08T16:10:28.169122+0000","last_became_peered":"2023-10-08T16:10:28.169122+0000","last_unstale":"2023-10-08T16:10:28.169590+0000","last_undegraded":"2023-10-08T16:10:28.169590+0000","last_fullsized":"2023-10-08T16:10:28.169590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153627+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:34.294234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160833+0000","last_change":"2023-10-08T16:10:28.160833+0000","last_active":"2023-10-08T16:10:28.160833+0000","last_peered":"2023-10-08T16:10:28.160833+0000","last_clean":"2023-10-08T16:10:28.160833+0000","last_became_active":"2023-10-08T16:10:28.160500+0000","last_became_peered":"2023-10-08T16:10:28.160500+0000","last_unstale":"2023-10-08T16:10:28.160833+0000","last_undegraded":"2023-10-08T16:10:28.160833+0000","last_fullsized":"2023-10-08T16:10:28.160833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151581+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159791+0000","last_change":"2023-10-08T16:10:28.159791+0000","last_active":"2023-10-08T16:10:28.159791+0000","last_peered":"2023-10-08T16:10:28.159791+0000","last_clean":"2023-10-08T16:10:28.159791+0000","last_became_active":"2023-10-08T16:10:28.159411+0000","last_became_peered":"2023-10-08T16:10:28.159411+0000","last_unstale":"2023-10-08T16:10:28.159791+0000","last_undegraded":"2023-10-08T16:10:28.159791+0000","last_fullsized":"2023-10-08T16:10:28.159791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153023+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173314+0000","last_change":"2023-10-08T16:10:28.173314+0000","last_active":"2023-10-08T16:10:28.173314+0000","last_peered":"2023-10-08T16:10:28.173314+0000","last_clean":"2023-10-08T16:10:28.173314+0000","last_became_active":"2023-10-08T16:10:28.172896+0000","last_became_peered":"2023-10-08T16:10:28.172896+0000","last_unstale":"2023-10-08T16:10:28.173314+0000","last_undegraded":"2023-10-08T16:10:28.173314+0000","last_fullsized":"2023-10-08T16:10:28.173314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153421+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.155737+0000","last_change":"2023-10-08T16:10:28.155737+0000","last_active":"2023-10-08T16:10:28.155737+0000","last_peered":"2023-10-08T16:10:28.155737+0000","last_clean":"2023-10-08T16:10:28.155737+0000","last_became_active":"2023-10-08T16:10:28.155453+0000","last_became_peered":"2023-10-08T16:10:28.155453+0000","last_unstale":"2023-10-08T16:10:28.155737+0000","last_undegraded":"2023-10-08T16:10:28.155737+0000","last_fullsized":"2023-10-08T16:10:28.155737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152352+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160526+0000","last_change":"2023-10-08T16:10:28.160526+0000","last_active":"2023-10-08T16:10:28.160526+0000","last_peered":"2023-10-08T16:10:28.160526+0000","last_clean":"2023-10-08T16:10:28.160526+0000","last_became_active":"2023-10-08T16:10:28.160243+0000","last_became_peered":"2023-10-08T16:10:28.160243+0000","last_unstale":"2023-10-08T16:10:28.160526+0000","last_undegraded":"2023-10-08T16:10:28.160526+0000","last_fullsized":"2023-10-08T16:10:28.160526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153640+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.171416+0000","last_change":"2023-10-08T16:10:28.171416+0000","last_active":"2023-10-08T16:10:28.171416+0000","last_peered":"2023-10-08T16:10:28.171416+0000","last_clean":"2023-10-08T16:10:28.171416+0000","last_became_active":"2023-10-08T16:10:28.171217+0000","last_became_peered":"2023-10-08T16:10:28.171217+0000","last_unstale":"2023-10-08T16:10:28.171416+0000","last_undegraded":"2023-10-08T16:10:28.171416+0000","last_fullsized":"2023-10-08T16:10:28.171416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:26.909856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158863+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169980+0000","last_change":"2023-10-08T16:10:28.169980+0000","last_active":"2023-10-08T16:10:28.169980+0000","last_peered":"2023-10-08T16:10:28.169980+0000","last_clean":"2023-10-08T16:10:28.169980+0000","last_became_active":"2023-10-08T16:10:28.169573+0000","last_became_peered":"2023-10-08T16:10:28.169573+0000","last_unstale":"2023-10-08T16:10:28.169980+0000","last_undegraded":"2023-10-08T16:10:28.169980+0000","last_fullsized":"2023-10-08T16:10:28.169980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:46.425856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.160208+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167624+0000","last_change":"2023-10-08T16:10:28.167624+0000","last_active":"2023-10-08T16:10:28.167624+0000","last_peered":"2023-10-08T16:10:28.167624+0000","last_clean":"2023-10-08T16:10:28.167624+0000","last_became_active":"2023-10-08T16:10:28.167279+0000","last_became_peered":"2023-10-08T16:10:28.167279+0000","last_unstale":"2023-10-08T16:10:28.167624+0000","last_undegraded":"2023-10-08T16:10:28.167624+0000","last_fullsized":"2023-10-08T16:10:28.167624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T16:10:27.145338+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:10:27.145338+0000","last_peered":"2023-10-08T16:10:27.145338+0000","last_clean":"2023-10-08T16:10:27.145338+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:10:27.145338+0000","last_undegraded":"2023-10-08T16:10:27.145338+0000","last_fullsized":"2023-10-08T16:10:27.145338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67600000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.623},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":360448,"data_stored":136828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.623},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.749}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.496}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.443},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.497}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.746},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.054},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.024}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:34.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:34.106 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-10-08T16:10:34.105+0000 7f2a635f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:10:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.226+0000 7fab3af9d700 1 Processor -- start 2023-10-08T16:10:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.226+0000 7fab3af9d700 1 -- start start 2023-10-08T16:10:34.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3af9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fab3415de50 0x7fab340cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab340cef40 0x7fab3415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3af9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab340cf3c0 con 0x7fab34153c30 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3415afd0 con 0x7fab340cef40 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3af9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3415b2b0 con 0x7fab3415de50 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab3a79c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fab340cef40 0x7fab3415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab39f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fab34153c30 0x7fab3415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41644/0 (socket says 172.21.15.12:41644) 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.227+0000 7fab39f9b700 1 -- 172.21.15.12:0/3591035336 learned_addr learned my addr 172.21.15.12:0/3591035336 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3979a700 1 --2- 172.21.15.12:0/3591035336 >> v2:172.21.15.29:3300/0 conn(0x7fab3415de50 0x7fab340cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3a79c700 1 -- 172.21.15.12:0/3591035336 >> v2:172.21.15.29:3300/0 conn(0x7fab3415de50 msgr2=0x7fab340cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3a79c700 1 --2- 172.21.15.12:0/3591035336 >> v2:172.21.15.29:3300/0 conn(0x7fab3415de50 0x7fab340cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3a79c700 1 -- 172.21.15.12:0/3591035336 >> v1:172.21.15.12:6789/0 conn(0x7fab34153c30 legacy=0x7fab3415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3a79c700 1 -- 172.21.15.12:0/3591035336 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3415b590 con 0x7fab340cef40 2023-10-08T16:10:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab38f99700 1 -- 172.21.15.12:0/3591035336 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266348986 0 0) 0x7fab340cf3c0 con 0x7fab34153c30 2023-10-08T16:10:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab3a79c700 1 --2- 172.21.15.12:0/3591035336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab340cef40 0x7fab3415c070 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab340713a0 tx=0x7fab2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d7bbc5b17280751 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab38f99700 1 -- 172.21.15.12:0/3591035336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c00e070 con 0x7fab340cef40 2023-10-08T16:10:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab38f99700 1 -- 172.21.15.12:0/3591035336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c00bc30 con 0x7fab340cef40 2023-10-08T16:10:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.228+0000 7fab38f99700 1 -- 172.21.15.12:0/3591035336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c012430 con 0x7fab340cef40 2023-10-08T16:10:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 -- 172.21.15.12:0/3591035336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab340cef40 msgr2=0x7fab3415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 --2- 172.21.15.12:0/3591035336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab340cef40 0x7fab3415c070 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fab340713a0 tx=0x7fab2c009780 comp rx=0 tx=0).stop 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 -- 172.21.15.12:0/3591035336 shutdown_connections 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 --2- 172.21.15.12:0/3591035336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab340cef40 0x7fab3415c070 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 --2- 172.21.15.12:0/3591035336 >> v2:172.21.15.29:3300/0 conn(0x7fab3415de50 0x7fab340cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 -- 172.21.15.12:0/3591035336 >> 172.21.15.12:0/3591035336 conn(0x7fab340703a0 msgr2=0x7fab340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 -- 172.21.15.12:0/3591035336 shutdown_connections 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.229+0000 7fab3af9d700 1 -- 172.21.15.12:0/3591035336 wait complete. 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.230+0000 7fab3af9d700 1 Processor -- start 2023-10-08T16:10:34.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 -- start start 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab340cef40 0x7fab340b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab34153c30 0x7fab340c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab340ca4b0 con 0x7fab3415de50 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab34154110 con 0x7fab340cef40 2023-10-08T16:10:34.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.231+0000 7fab3af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab340b4f80 con 0x7fab34153c30 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54646/0 (socket says 172.21.15.12:54646) 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 -- 172.21.15.12:0/4257051857 learned_addr learned my addr 172.21.15.12:0/4257051857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3979a700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab34153c30 0x7fab340c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab39f9b700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab340cef40 0x7fab340b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 -- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab34153c30 msgr2=0x7fab340c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab34153c30 0x7fab340c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 -- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab340cef40 msgr2=0x7fab340b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab340cef40 0x7fab340b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 -- 172.21.15.12:0/4257051857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c009a20 con 0x7fab3415de50 2023-10-08T16:10:34.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.232+0000 7fab3a79c700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009fd0 tx=0x7fab2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.233+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c012ea0 con 0x7fab3415de50 2023-10-08T16:10:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.233+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2c01e630 con 0x7fab3415de50 2023-10-08T16:10:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.233+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab340b4370 con 0x7fab3415de50 2023-10-08T16:10:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.233+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2c01ea10 con 0x7fab3415de50 2023-10-08T16:10:34.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.233+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab340b4930 con 0x7fab3415de50 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.234+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3404c3c0 con 0x7fab3415de50 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.235+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab2c024070 con 0x7fab3415de50 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.235+0000 7fab29ffb700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.236+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fab2c086f20 con 0x7fab3415de50 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.236+0000 7fab39f9b700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.236+0000 7fab39f9b700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 0x7fab180693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c8f0 tx=0x7fab30009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.240+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab2c0540f0 con 0x7fab3415de50 2023-10-08T16:10:34.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.439+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab340caef0 con 0x7fab18066f30 2023-10-08T16:10:34.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.448+0000 7fab29ffb700 1 -- 172.21.15.12:0/4257051857 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285388 (secure 0 0 0) 0x7fab340caef0 con 0x7fab18066f30 2023-10-08T16:10:34.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.452+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 msgr2=0x7fab180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.452+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 0x7fab180693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab3000c8f0 tx=0x7fab30009040 comp rx=0 tx=0).stop 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.452+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 msgr2=0x7fab341519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.452+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fab2c009fd0 tx=0x7fab2c019000 comp rx=0 tx=0).stop 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 shutdown_connections 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fab3415de50 0x7fab341519c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fab340cef40 0x7fab340b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 --2- 172.21.15.12:0/4257051857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fab34153c30 0x7fab340c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 >> 172.21.15.12:0/4257051857 conn(0x7fab340703a0 msgr2=0x7fab34070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 shutdown_connections 2023-10-08T16:10:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.453+0000 7fab3af9d700 1 -- 172.21.15.12:0/4257051857 wait complete. 2023-10-08T16:10:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:10:34.471 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-10-08T16:10:33.925921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398748,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575972,"statfs":{"total":773094113280,"available":770637795328,"internally_reserved":0,"allocated":4157440,"data_stored":2319145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154591+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150704+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156667+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162799+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157260+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156856+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159615+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149682+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161834+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156527+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148715+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163063+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161426+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156008+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156081+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158982+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158809+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155124+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154442+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148569+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156925+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153697+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148574+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158543+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152661+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161369+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153815+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163373+0000","last_change":"2023-10-08T16:10:28.163373+0000","last_active":"2023-10-08T16:10:28.163373+0000","last_peered":"2023-10-08T16:10:28.163373+0000","last_clean":"2023-10-08T16:10:28.163373+0000","last_became_active":"2023-10-08T16:10:28.163089+0000","last_became_peered":"2023-10-08T16:10:28.163089+0000","last_unstale":"2023-10-08T16:10:28.163373+0000","last_undegraded":"2023-10-08T16:10:28.163373+0000","last_fullsized":"2023-10-08T16:10:28.163373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:53.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153918+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167459+0000","last_change":"2023-10-08T16:10:28.167459+0000","last_active":"2023-10-08T16:10:28.167459+0000","last_peered":"2023-10-08T16:10:28.167459+0000","last_clean":"2023-10-08T16:10:28.167459+0000","last_became_active":"2023-10-08T16:10:28.167128+0000","last_became_peered":"2023-10-08T16:10:28.167128+0000","last_unstale":"2023-10-08T16:10:28.167459+0000","last_undegraded":"2023-10-08T16:10:28.167459+0000","last_fullsized":"2023-10-08T16:10:28.167459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159269+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175091+0000","last_change":"2023-10-08T16:10:28.175091+0000","last_active":"2023-10-08T16:10:28.175091+0000","last_peered":"2023-10-08T16:10:28.175091+0000","last_clean":"2023-10-08T16:10:28.175091+0000","last_became_active":"2023-10-08T16:10:28.174670+0000","last_became_peered":"2023-10-08T16:10:28.174670+0000","last_unstale":"2023-10-08T16:10:28.175091+0000","last_undegraded":"2023-10-08T16:10:28.175091+0000","last_fullsized":"2023-10-08T16:10:28.175091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:16.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152648+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173996+0000","last_change":"2023-10-08T16:10:28.173996+0000","last_active":"2023-10-08T16:10:28.173996+0000","last_peered":"2023-10-08T16:10:28.173996+0000","last_clean":"2023-10-08T16:10:28.173996+0000","last_became_active":"2023-10-08T16:10:28.173677+0000","last_became_peered":"2023-10-08T16:10:28.173677+0000","last_unstale":"2023-10-08T16:10:28.173996+0000","last_undegraded":"2023-10-08T16:10:28.173996+0000","last_fullsized":"2023-10-08T16:10:28.173996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158028+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170707+0000","last_change":"2023-10-08T16:10:28.170707+0000","last_active":"2023-10-08T16:10:28.170707+0000","last_peered":"2023-10-08T16:10:28.170707+0000","last_clean":"2023-10-08T16:10:28.170707+0000","last_became_active":"2023-10-08T16:10:28.170362+0000","last_became_peered":"2023-10-08T16:10:28.170362+0000","last_unstale":"2023-10-08T16:10:28.170707+0000","last_undegraded":"2023-10-08T16:10:28.170707+0000","last_fullsized":"2023-10-08T16:10:28.170707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150126+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162755+0000","last_change":"2023-10-08T16:10:28.162755+0000","last_active":"2023-10-08T16:10:28.162755+0000","last_peered":"2023-10-08T16:10:28.162755+0000","last_clean":"2023-10-08T16:10:28.162755+0000","last_became_active":"2023-10-08T16:10:28.162471+0000","last_became_peered":"2023-10-08T16:10:28.162471+0000","last_unstale":"2023-10-08T16:10:28.162755+0000","last_undegraded":"2023-10-08T16:10:28.162755+0000","last_fullsized":"2023-10-08T16:10:28.162755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:43.527707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157446+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166722+0000","last_change":"2023-10-08T16:10:28.166722+0000","last_active":"2023-10-08T16:10:28.166722+0000","last_peered":"2023-10-08T16:10:28.166722+0000","last_clean":"2023-10-08T16:10:28.166722+0000","last_became_active":"2023-10-08T16:10:28.166405+0000","last_became_peered":"2023-10-08T16:10:28.166405+0000","last_unstale":"2023-10-08T16:10:28.166722+0000","last_undegraded":"2023-10-08T16:10:28.166722+0000","last_fullsized":"2023-10-08T16:10:28.166722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152525+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162067+0000","last_change":"2023-10-08T16:10:28.162067+0000","last_active":"2023-10-08T16:10:28.162067+0000","last_peered":"2023-10-08T16:10:28.162067+0000","last_clean":"2023-10-08T16:10:28.162067+0000","last_became_active":"2023-10-08T16:10:28.160294+0000","last_became_peered":"2023-10-08T16:10:28.160294+0000","last_unstale":"2023-10-08T16:10:28.162067+0000","last_undegraded":"2023-10-08T16:10:28.162067+0000","last_fullsized":"2023-10-08T16:10:28.162067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:57.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148675+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169908+0000","last_change":"2023-10-08T16:10:28.169908+0000","last_active":"2023-10-08T16:10:28.169908+0000","last_peered":"2023-10-08T16:10:28.169908+0000","last_clean":"2023-10-08T16:10:28.169908+0000","last_became_active":"2023-10-08T16:10:28.169556+0000","last_became_peered":"2023-10-08T16:10:28.169556+0000","last_unstale":"2023-10-08T16:10:28.169908+0000","last_undegraded":"2023-10-08T16:10:28.169908+0000","last_fullsized":"2023-10-08T16:10:28.169908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:27.880370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155261+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.156574+0000","last_change":"2023-10-08T16:10:28.156574+0000","last_active":"2023-10-08T16:10:28.156574+0000","last_peered":"2023-10-08T16:10:28.156574+0000","last_clean":"2023-10-08T16:10:28.156574+0000","last_became_active":"2023-10-08T16:10:28.156307+0000","last_became_peered":"2023-10-08T16:10:28.156307+0000","last_unstale":"2023-10-08T16:10:28.156574+0000","last_undegraded":"2023-10-08T16:10:28.156574+0000","last_fullsized":"2023-10-08T16:10:28.156574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154678+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163938+0000","last_change":"2023-10-08T16:10:28.163938+0000","last_active":"2023-10-08T16:10:28.163938+0000","last_peered":"2023-10-08T16:10:28.163938+0000","last_clean":"2023-10-08T16:10:28.163938+0000","last_became_active":"2023-10-08T16:10:28.163610+0000","last_became_peered":"2023-10-08T16:10:28.163610+0000","last_unstale":"2023-10-08T16:10:28.163938+0000","last_undegraded":"2023-10-08T16:10:28.163938+0000","last_fullsized":"2023-10-08T16:10:28.163938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149730+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175309+0000","last_change":"2023-10-08T16:10:28.175309+0000","last_active":"2023-10-08T16:10:28.175309+0000","last_peered":"2023-10-08T16:10:28.175309+0000","last_clean":"2023-10-08T16:10:28.175309+0000","last_became_active":"2023-10-08T16:10:28.174518+0000","last_became_peered":"2023-10-08T16:10:28.174518+0000","last_unstale":"2023-10-08T16:10:28.175309+0000","last_undegraded":"2023-10-08T16:10:28.175309+0000","last_fullsized":"2023-10-08T16:10:28.175309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151902+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166308+0000","last_change":"2023-10-08T16:10:28.166308+0000","last_active":"2023-10-08T16:10:28.166308+0000","last_peered":"2023-10-08T16:10:28.166308+0000","last_clean":"2023-10-08T16:10:28.166308+0000","last_became_active":"2023-10-08T16:10:28.166083+0000","last_became_peered":"2023-10-08T16:10:28.166083+0000","last_unstale":"2023-10-08T16:10:28.166308+0000","last_undegraded":"2023-10-08T16:10:28.166308+0000","last_fullsized":"2023-10-08T16:10:28.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:20.571265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153985+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.157812+0000","last_change":"2023-10-08T16:10:28.157812+0000","last_active":"2023-10-08T16:10:28.157812+0000","last_peered":"2023-10-08T16:10:28.157812+0000","last_clean":"2023-10-08T16:10:28.157812+0000","last_became_active":"2023-10-08T16:10:28.157471+0000","last_became_peered":"2023-10-08T16:10:28.157471+0000","last_unstale":"2023-10-08T16:10:28.157812+0000","last_undegraded":"2023-10-08T16:10:28.157812+0000","last_fullsized":"2023-10-08T16:10:28.157812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162055+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169436+0000","last_change":"2023-10-08T16:10:28.169436+0000","last_active":"2023-10-08T16:10:28.169436+0000","last_peered":"2023-10-08T16:10:28.169436+0000","last_clean":"2023-10-08T16:10:28.169436+0000","last_became_active":"2023-10-08T16:10:28.169084+0000","last_became_peered":"2023-10-08T16:10:28.169084+0000","last_unstale":"2023-10-08T16:10:28.169436+0000","last_undegraded":"2023-10-08T16:10:28.169436+0000","last_fullsized":"2023-10-08T16:10:28.169436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:12.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153407+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175109+0000","last_change":"2023-10-08T16:10:28.175109+0000","last_active":"2023-10-08T16:10:28.175109+0000","last_peered":"2023-10-08T16:10:28.175109+0000","last_clean":"2023-10-08T16:10:28.175109+0000","last_became_active":"2023-10-08T16:10:28.174868+0000","last_became_peered":"2023-10-08T16:10:28.174868+0000","last_unstale":"2023-10-08T16:10:28.175109+0000","last_undegraded":"2023-10-08T16:10:28.175109+0000","last_fullsized":"2023-10-08T16:10:28.175109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156736+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170494+0000","last_change":"2023-10-08T16:10:28.170494+0000","last_active":"2023-10-08T16:10:28.170494+0000","last_peered":"2023-10-08T16:10:28.170494+0000","last_clean":"2023-10-08T16:10:28.170494+0000","last_became_active":"2023-10-08T16:10:28.170192+0000","last_became_peered":"2023-10-08T16:10:28.170192+0000","last_unstale":"2023-10-08T16:10:28.170494+0000","last_undegraded":"2023-10-08T16:10:28.170494+0000","last_fullsized":"2023-10-08T16:10:28.170494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148836+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.165759+0000","last_change":"2023-10-08T16:10:28.165759+0000","last_active":"2023-10-08T16:10:28.165759+0000","last_peered":"2023-10-08T16:10:28.165759+0000","last_clean":"2023-10-08T16:10:28.165759+0000","last_became_active":"2023-10-08T16:10:28.165359+0000","last_became_peered":"2023-10-08T16:10:28.165359+0000","last_unstale":"2023-10-08T16:10:28.165759+0000","last_undegraded":"2023-10-08T16:10:28.165759+0000","last_fullsized":"2023-10-08T16:10:28.165759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.409925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151914+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.174109+0000","last_change":"2023-10-08T16:10:28.174109+0000","last_active":"2023-10-08T16:10:28.174109+0000","last_peered":"2023-10-08T16:10:28.174109+0000","last_clean":"2023-10-08T16:10:28.174109+0000","last_became_active":"2023-10-08T16:10:28.173827+0000","last_became_peered":"2023-10-08T16:10:28.173827+0000","last_unstale":"2023-10-08T16:10:28.174109+0000","last_undegraded":"2023-10-08T16:10:28.174109+0000","last_fullsized":"2023-10-08T16:10:28.174109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:33.288290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154267+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:21.577209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170218+0000","last_change":"2023-10-08T16:10:28.170218+0000","last_active":"2023-10-08T16:10:28.170218+0000","last_peered":"2023-10-08T16:10:28.170218+0000","last_clean":"2023-10-08T16:10:28.170218+0000","last_became_active":"2023-10-08T16:10:28.169946+0000","last_became_peered":"2023-10-08T16:10:28.169946+0000","last_unstale":"2023-10-08T16:10:28.170218+0000","last_undegraded":"2023-10-08T16:10:28.170218+0000","last_fullsized":"2023-10-08T16:10:28.170218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:46.251322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154860+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:57.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159695+0000","last_change":"2023-10-08T16:10:28.159695+0000","last_active":"2023-10-08T16:10:28.159695+0000","last_peered":"2023-10-08T16:10:28.159695+0000","last_clean":"2023-10-08T16:10:28.159695+0000","last_became_active":"2023-10-08T16:10:28.159455+0000","last_became_peered":"2023-10-08T16:10:28.159455+0000","last_unstale":"2023-10-08T16:10:28.159695+0000","last_undegraded":"2023-10-08T16:10:28.159695+0000","last_fullsized":"2023-10-08T16:10:28.159695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154071+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:15.415869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.168599+0000","last_change":"2023-10-08T16:10:28.168599+0000","last_active":"2023-10-08T16:10:28.168599+0000","last_peered":"2023-10-08T16:10:28.168599+0000","last_clean":"2023-10-08T16:10:28.168599+0000","last_became_active":"2023-10-08T16:10:28.168106+0000","last_became_peered":"2023-10-08T16:10:28.168106+0000","last_unstale":"2023-10-08T16:10:28.168599+0000","last_undegraded":"2023-10-08T16:10:28.168599+0000","last_fullsized":"2023-10-08T16:10:28.168599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:26.677198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154793+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:58.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.172381+0000","last_change":"2023-10-08T16:10:28.172381+0000","last_active":"2023-10-08T16:10:28.172381+0000","last_peered":"2023-10-08T16:10:28.172381+0000","last_clean":"2023-10-08T16:10:28.172381+0000","last_became_active":"2023-10-08T16:10:28.172119+0000","last_became_peered":"2023-10-08T16:10:28.172119+0000","last_unstale":"2023-10-08T16:10:28.172381+0000","last_undegraded":"2023-10-08T16:10:28.172381+0000","last_fullsized":"2023-10-08T16:10:28.172381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:39:29.599550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156741+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169590+0000","last_change":"2023-10-08T16:10:28.169590+0000","last_active":"2023-10-08T16:10:28.169590+0000","last_peered":"2023-10-08T16:10:28.169590+0000","last_clean":"2023-10-08T16:10:28.169590+0000","last_became_active":"2023-10-08T16:10:28.169122+0000","last_became_peered":"2023-10-08T16:10:28.169122+0000","last_unstale":"2023-10-08T16:10:28.169590+0000","last_undegraded":"2023-10-08T16:10:28.169590+0000","last_fullsized":"2023-10-08T16:10:28.169590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153627+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:34.294234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160833+0000","last_change":"2023-10-08T16:10:28.160833+0000","last_active":"2023-10-08T16:10:28.160833+0000","last_peered":"2023-10-08T16:10:28.160833+0000","last_clean":"2023-10-08T16:10:28.160833+0000","last_became_active":"2023-10-08T16:10:28.160500+0000","last_became_peered":"2023-10-08T16:10:28.160500+0000","last_unstale":"2023-10-08T16:10:28.160833+0000","last_undegraded":"2023-10-08T16:10:28.160833+0000","last_fullsized":"2023-10-08T16:10:28.160833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151581+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159791+0000","last_change":"2023-10-08T16:10:28.159791+0000","last_active":"2023-10-08T16:10:28.159791+0000","last_peered":"2023-10-08T16:10:28.159791+0000","last_clean":"2023-10-08T16:10:28.159791+0000","last_became_active":"2023-10-08T16:10:28.159411+0000","last_became_peered":"2023-10-08T16:10:28.159411+0000","last_unstale":"2023-10-08T16:10:28.159791+0000","last_undegraded":"2023-10-08T16:10:28.159791+0000","last_fullsized":"2023-10-08T16:10:28.159791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153023+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173314+0000","last_change":"2023-10-08T16:10:28.173314+0000","last_active":"2023-10-08T16:10:28.173314+0000","last_peered":"2023-10-08T16:10:28.173314+0000","last_clean":"2023-10-08T16:10:28.173314+0000","last_became_active":"2023-10-08T16:10:28.172896+0000","last_became_peered":"2023-10-08T16:10:28.172896+0000","last_unstale":"2023-10-08T16:10:28.173314+0000","last_undegraded":"2023-10-08T16:10:28.173314+0000","last_fullsized":"2023-10-08T16:10:28.173314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153421+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.155737+0000","last_change":"2023-10-08T16:10:28.155737+0000","last_active":"2023-10-08T16:10:28.155737+0000","last_peered":"2023-10-08T16:10:28.155737+0000","last_clean":"2023-10-08T16:10:28.155737+0000","last_became_active":"2023-10-08T16:10:28.155453+0000","last_became_peered":"2023-10-08T16:10:28.155453+0000","last_unstale":"2023-10-08T16:10:28.155737+0000","last_undegraded":"2023-10-08T16:10:28.155737+0000","last_fullsized":"2023-10-08T16:10:28.155737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152352+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160526+0000","last_change":"2023-10-08T16:10:28.160526+0000","last_active":"2023-10-08T16:10:28.160526+0000","last_peered":"2023-10-08T16:10:28.160526+0000","last_clean":"2023-10-08T16:10:28.160526+0000","last_became_active":"2023-10-08T16:10:28.160243+0000","last_became_peered":"2023-10-08T16:10:28.160243+0000","last_unstale":"2023-10-08T16:10:28.160526+0000","last_undegraded":"2023-10-08T16:10:28.160526+0000","last_fullsized":"2023-10-08T16:10:28.160526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153640+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.171416+0000","last_change":"2023-10-08T16:10:28.171416+0000","last_active":"2023-10-08T16:10:28.171416+0000","last_peered":"2023-10-08T16:10:28.171416+0000","last_clean":"2023-10-08T16:10:28.171416+0000","last_became_active":"2023-10-08T16:10:28.171217+0000","last_became_peered":"2023-10-08T16:10:28.171217+0000","last_unstale":"2023-10-08T16:10:28.171416+0000","last_undegraded":"2023-10-08T16:10:28.171416+0000","last_fullsized":"2023-10-08T16:10:28.171416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:26.909856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158863+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169980+0000","last_change":"2023-10-08T16:10:28.169980+0000","last_active":"2023-10-08T16:10:28.169980+0000","last_peered":"2023-10-08T16:10:28.169980+0000","last_clean":"2023-10-08T16:10:28.169980+0000","last_became_active":"2023-10-08T16:10:28.169573+0000","last_became_peered":"2023-10-08T16:10:28.169573+0000","last_unstale":"2023-10-08T16:10:28.169980+0000","last_undegraded":"2023-10-08T16:10:28.169980+0000","last_fullsized":"2023-10-08T16:10:28.169980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:46.425856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.160208+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167624+0000","last_change":"2023-10-08T16:10:28.167624+0000","last_active":"2023-10-08T16:10:28.167624+0000","last_peered":"2023-10-08T16:10:28.167624+0000","last_clean":"2023-10-08T16:10:28.167624+0000","last_became_active":"2023-10-08T16:10:28.167279+0000","last_became_peered":"2023-10-08T16:10:28.167279+0000","last_unstale":"2023-10-08T16:10:28.167624+0000","last_undegraded":"2023-10-08T16:10:28.167624+0000","last_fullsized":"2023-10-08T16:10:28.167624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T16:10:27.145338+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:10:27.145338+0000","last_peered":"2023-10-08T16:10:27.145338+0000","last_clean":"2023-10-08T16:10:27.145338+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:10:27.145338+0000","last_undegraded":"2023-10-08T16:10:27.145338+0000","last_fullsized":"2023-10-08T16:10:27.145338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67600000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.623},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":360448,"data_stored":136828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.623},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.749}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.496}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.443},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.497}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.746},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.054},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.024}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:34.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-10-08T16:10:34.479 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154591+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:10:34.479 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158524+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.150704+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156667+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.162799+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.157260+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.480 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.157324+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.163524+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.157408+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156856+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.159615+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.481 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.149682+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.161834+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156527+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.148715+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-10-08T16:10:34.482 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.163063+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.161426+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156008+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156081+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158982+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-10-08T16:10:34.483 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158809+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.155124+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154442+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.148569+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-10-08T16:10:34.484 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156925+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.155408+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153697+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.148574+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158324+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-10-08T16:10:34.485 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158543+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.152661+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.161369+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153815+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-08T16:10:34.486 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153918+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.159269+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.152648+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158028+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.150126+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-08T16:10:34.487 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.157446+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.152525+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.148675+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.155261+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154678+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.488 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.149730+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.151902+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153985+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.162055+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153407+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:10:34.489 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156736+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.148836+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.151914+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154267+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:06:21.577209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-10-08T16:10:34.490 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154860+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:55:57.324536+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154071+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:35:15.415869+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.154793+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:37:58.926501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.156741+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153627+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:23:34.294234+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T16:10:34.491 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.151581+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153023+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153421+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-08T16:10:34.492 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.152352+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.153640+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.158863+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-10-08T16:10:34.493 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:10:28.138158+0000', 'last_change': '2023-10-08T16:10:28.160208+0000', 'last_active': '2023-10-08T16:10:28.138158+0000', 'last_peered': '2023-10-08T16:10:28.138158+0000', 'last_clean': '2023-10-08T16:10:28.138158+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:10:28.138158+0000', 'last_undegraded': '2023-10-08T16:10:28.138158+0000', 'last_fullsized': '2023-10-08T16:10:28.138158+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'last_clean_scrub_stamp': '2023-10-08T16:10:28.138158+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:10:34.494 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:10:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.696+0000 7f19bd59d700 1 Processor -- start 2023-10-08T16:10:34.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.696+0000 7f19bd59d700 1 -- start start 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19bd59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f19b80c7f90 0x7f19b806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19bd59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b80ca480 con 0x7f19b8142fd0 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19bd59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b815e240 con 0x7f19b8142c00 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19bd59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b806b350 con 0x7f19b80c7f90 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19b77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f19b8142fd0 0x7f19b80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41648/0 (socket says 172.21.15.12:41648) 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19b77fe700 1 -- 172.21.15.12:0/1226639177 learned_addr learned my addr 172.21.15.12:0/1226639177 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:34.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19bcd9c700 1 --2- 172.21.15.12:0/1226639177 >> v2:172.21.15.29:3300/0 conn(0x7f19b80c7f90 0x7f19b806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492195827 0 0) 0x7f19b80ca480 con 0x7f19b8142fd0 2023-10-08T16:10:34.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.698+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19a0003570 con 0x7f19b8142fd0 2023-10-08T16:10:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949797268 0 0) 0x7f19a0003570 con 0x7f19b8142fd0 2023-10-08T16:10:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 >> v2:172.21.15.29:3300/0 conn(0x7f19b80c7f90 msgr2=0x7f19b806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 --2- 172.21.15.12:0/1226639177 >> v2:172.21.15.29:3300/0 conn(0x7f19b80c7f90 0x7f19b806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 >> v1:172.21.15.29:6789/0 conn(0x7f19b8142c00 legacy=0x7f19b806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b815df60 con 0x7f19b8142fd0 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f19ac001470 con 0x7f19b8142fd0 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 >> v1:172.21.15.12:6789/0 conn(0x7f19b8142fd0 legacy=0x7f19b80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19a0003ab0 0x7f19a0003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 0x7f19a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0005210 0x7f19a000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b806b350 con 0x7f19a0004810 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a000c1b0 con 0x7f19a0005210 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a000c370 con 0x7f19a0003ab0 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 0x7f19a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19b7fff700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19a0003ab0 0x7f19a0003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.699+0000 7f19bcd9c700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0005210 0x7f19a000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 -- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19a0003ab0 msgr2=0x7f19a0003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19a0003ab0 0x7f19a0003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 -- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0005210 msgr2=0x7f19a000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0005210 0x7f19a000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 -- 172.21.15.12:0/1226639177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0003570 con 0x7f19a0004810 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19bcd9c700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0005210 0x7f19a000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19bcd9c700 1 -- 172.21.15.12:0/1226639177 reap_dead start 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 0x7f19a0004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c2a0 tx=0x7f19b806b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9c766801d54543 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00cb70 con 0x7f19a0004810 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac00ccd0 con 0x7f19a0004810 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.700+0000 7f19b6ffd700 1 -- 172.21.15.12:0/1226639177 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac005b70 con 0x7f19a0004810 2023-10-08T16:10:34.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 -- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 msgr2=0x7f19a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 0x7f19a0004c80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00c2a0 tx=0x7f19b806b490 comp rx=0 tx=0).stop 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 -- 172.21.15.12:0/1226639177 shutdown_connections 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1226639177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19a0004810 0x7f19a0004c80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 -- 172.21.15.12:0/1226639177 >> 172.21.15.12:0/1226639177 conn(0x7f19b80675a0 msgr2=0x7f19b80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 -- 172.21.15.12:0/1226639177 shutdown_connections 2023-10-08T16:10:34.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.701+0000 7f19bd59d700 1 -- 172.21.15.12:0/1226639177 wait complete. 2023-10-08T16:10:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.702+0000 7f19bd59d700 1 Processor -- start 2023-10-08T16:10:34.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.702+0000 7f19bd59d700 1 -- start start 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 0x7f19b80affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 0x7f19b80c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80c4360 con 0x7f19b80c5da0 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b2280 con 0x7f19a0004810 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19bd59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b80b05c0 con 0x7f19b8169ba0 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.703+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54654/0 (socket says 172.21.15.12:54654) 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 -- 172.21.15.12:0/1938009940 learned_addr learned my addr 172.21.15.12:0/1938009940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b7fff700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 0x7f19b80affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19bcd9c700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 0x7f19b80c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 -- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 msgr2=0x7f19b80c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 0x7f19b80c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 -- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 msgr2=0x7f19b80affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 0x7f19b80affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 -- 172.21.15.12:0/1938009940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b80b08a0 con 0x7f19b80c5da0 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19bcd9c700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 0x7f19b80c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b7fff700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 0x7f19b80affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19b77fe700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c180 tx=0x7f19ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac022070 con 0x7f19b80c5da0 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ac004e90 con 0x7f19b80c5da0 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac007320 con 0x7f19b80c5da0 2023-10-08T16:10:34.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.704+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b80b0b80 con 0x7f19b80c5da0 2023-10-08T16:10:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.705+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b80c6210 con 0x7f19b80c5da0 2023-10-08T16:10:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.706+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b80b1020 con 0x7f19b80c5da0 2023-10-08T16:10:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.707+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19ac01e430 con 0x7f19b80c5da0 2023-10-08T16:10:34.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.707+0000 7f199ffff700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 0x7f19a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.708+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19ac0855d0 con 0x7f19b80c5da0 2023-10-08T16:10:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.708+0000 7f19b7fff700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 0x7f19a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:34.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.708+0000 7f19b7fff700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 0x7f19a40693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f19b80ca450 tx=0x7f19a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:34.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.712+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19ac052840 con 0x7f19b80c5da0 2023-10-08T16:10:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.994+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f19b80c44a0 con 0x7f19b80c5da0 2023-10-08T16:10:34.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.994+0000 7f199ffff700 1 -- 172.21.15.12:0/1938009940 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1454 (secure 0 0 0) 0x7f19b80c44a0 con 0x7f19b80c5da0 2023-10-08T16:10:34.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:34.996 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2456317952,"bytes_avail":770637795328,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4962}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-08T16:10:17.923438+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 msgr2=0x7f19a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 0x7f19a40693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f19b80ca450 tx=0x7f19a8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 msgr2=0x7f19b80b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f19a000c180 tx=0x7f19ac015000 comp rx=0 tx=0).stop 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 shutdown_connections 2023-10-08T16:10:34.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f19b8169ba0 0x7f19b80c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f19a0004810 0x7f19b80affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f19a4066f30 0x7f19a40693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 --2- 172.21.15.12:0/1938009940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19b80c5da0 0x7f19b80b1d40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 >> 172.21.15.12:0/1938009940 conn(0x7f19b80675a0 msgr2=0x7f19b80c2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 shutdown_connections 2023-10-08T16:10:34.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:34.997+0000 7f19bd59d700 1 -- 172.21.15.12:0/1938009940 wait complete. 2023-10-08T16:10:35.015 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:10:35.015 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.202+0000 7fd8bbfff700 1 Processor -- start 2023-10-08T16:10:35.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.202+0000 7fd8bbfff700 1 -- start start 2023-10-08T16:10:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.203+0000 7fd8bbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd8bc06aaa0 0x7fd8bc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.203+0000 7fd8bbfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc15ae70 con 0x7fd8bc13fb20 2023-10-08T16:10:35.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.203+0000 7fd8bbfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc06af60 con 0x7fd8bc13fef0 2023-10-08T16:10:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.203+0000 7fd8bbfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc06b240 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8baffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd8bc13fb20 0x7fd8bc0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41654/0 (socket says 172.21.15.12:41654) 2023-10-08T16:10:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8baffd700 1 -- 172.21.15.12:0/439534641 learned_addr learned my addr 172.21.15.12:0/439534641 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8bb7fe700 1 --2- 172.21.15.12:0/439534641 >> v2:172.21.15.12:3300/0 conn(0x7fd8bc06aaa0 0x7fd8bc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8b9ffb700 1 -- 172.21.15.12:0/439534641 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 981862448 0 0) 0x7fd8ac001110 con 0x7fd8bc13fb20 2023-10-08T16:10:35.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8b9ffb700 1 -- 172.21.15.12:0/439534641 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a4003570 con 0x7fd8bc13fb20 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/439534641 >> v1:172.21.15.29:6789/0 conn(0x7fd8bc13fef0 legacy=0x7fd8bc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/439534641 >> v1:172.21.15.12:6789/0 conn(0x7fd8bc13fb20 legacy=0x7fd8bc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/439534641 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc06b520 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.204+0000 7fd8bb7fe700 1 --2- 172.21.15.12:0/439534641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc15a930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009e60 tx=0x7fd8b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ba35f7ef74f07c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8b9ffb700 1 -- 172.21.15.12:0/439534641 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400e070 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8b9ffb700 1 -- 172.21.15.12:0/439534641 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400bb60 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8b9ffb700 1 -- 172.21.15.12:0/439534641 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4012430 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 -- 172.21.15.12:0/439534641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc06aaa0 msgr2=0x7fd8bc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/439534641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc15a930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009e60 tx=0x7fd8b4009780 comp rx=0 tx=0).stop 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 -- 172.21.15.12:0/439534641 shutdown_connections 2023-10-08T16:10:35.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/439534641 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc15a930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 -- 172.21.15.12:0/439534641 >> 172.21.15.12:0/439534641 conn(0x7fd8bc06d170 msgr2=0x7fd8bc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 -- 172.21.15.12:0/439534641 shutdown_connections 2023-10-08T16:10:35.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.205+0000 7fd8bbfff700 1 -- 172.21.15.12:0/439534641 wait complete. 2023-10-08T16:10:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.207+0000 7fd8bbfff700 1 Processor -- start 2023-10-08T16:10:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.207+0000 7fd8bbfff700 1 -- start start 2023-10-08T16:10:35.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc1559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd8bc13fb20 0x7fd8bc1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0ac070 con 0x7fd8bc13fef0 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc15bf20 con 0x7fd8bc06aaa0 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0ab740 con 0x7fd8bc13fb20 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54672/0 (socket says 172.21.15.12:54672) 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/586430418 learned_addr learned my addr 172.21.15.12:0/586430418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:35.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8baffd700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc1559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8ba7fc700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd8bc13fb20 0x7fd8bc1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd8bc13fb20 msgr2=0x7fd8bc1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.208+0000 7fd8bb7fe700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd8bc13fb20 0x7fd8bc1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8bc06aaa0 msgr2=0x7fd8bc1559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bb7fe700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc1559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bb7fe700 1 -- 172.21.15.12:0/586430418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4009a20 con 0x7fd8bc13fef0 2023-10-08T16:10:35.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bb7fe700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4013000 tx=0x7fd8b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4027470 con 0x7fd8bc13fef0 2023-10-08T16:10:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b40275f0 con 0x7fd8bc13fef0 2023-10-08T16:10:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b40279b0 con 0x7fd8bc13fef0 2023-10-08T16:10:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0aba20 con 0x7fd8bc13fef0 2023-10-08T16:10:35.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.209+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc157b10 con 0x7fd8bc13fef0 2023-10-08T16:10:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.210+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8bc0ac220 con 0x7fd8bc13fef0 2023-10-08T16:10:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.211+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8b4024070 con 0x7fd8bc13fef0 2023-10-08T16:10:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.212+0000 7fd8a2ffd700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 0x7fd8a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.212+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8b4086f50 con 0x7fd8bc13fef0 2023-10-08T16:10:35.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.212+0000 7fd8baffd700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 0x7fd8a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:35.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.213+0000 7fd8baffd700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 0x7fd8a80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ae7b0 tx=0x7fd8ac007bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:35.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.216+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8bc0ac220 con 0x7fd8bc13fef0 2023-10-08T16:10:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.413+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8bc04c3c0 con 0x7fd8a8066f30 2023-10-08T16:10:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.422+0000 7fd8a2ffd700 1 -- 172.21.15.12:0/586430418 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285388 (secure 0 0 0) 0x7fd8bc04c3c0 con 0x7fd8a8066f30 2023-10-08T16:10:35.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 msgr2=0x7fd8a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 0x7fd8a80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0ae7b0 tx=0x7fd8ac007bf0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 msgr2=0x7fd8bc15cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4013000 tx=0x7fd8b4019000 comp rx=0 tx=0).stop 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 shutdown_connections 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd8a8066f30 0x7fd8a80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd8bc13fef0 0x7fd8bc15cc80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd8bc06aaa0 0x7fd8bc1559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 --2- 172.21.15.12:0/586430418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd8bc13fb20 0x7fd8bc1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 >> 172.21.15.12:0/586430418 conn(0x7fd8bc06d170 msgr2=0x7fd8bc0b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 shutdown_connections 2023-10-08T16:10:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:35.426+0000 7fd8bbfff700 1 -- 172.21.15.12:0/586430418 wait complete. 2023-10-08T16:10:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:10:35.444 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2023-10-08T16:10:33.925921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":37,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398748,"kb_used_data":4060,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575972,"statfs":{"total":773094113280,"available":770637795328,"internally_reserved":0,"allocated":4157440,"data_stored":2319145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001014"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154591+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150704+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156667+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162799+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157260+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163524+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156856+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159615+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149682+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161834+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156527+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148715+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.163063+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161426+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156008+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156081+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158982+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158809+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155124+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:00:13.140454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154442+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148569+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156925+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155408+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153697+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148574+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158324+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158543+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152661+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.161369+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153815+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163373+0000","last_change":"2023-10-08T16:10:28.163373+0000","last_active":"2023-10-08T16:10:28.163373+0000","last_peered":"2023-10-08T16:10:28.163373+0000","last_clean":"2023-10-08T16:10:28.163373+0000","last_became_active":"2023-10-08T16:10:28.163089+0000","last_became_peered":"2023-10-08T16:10:28.163089+0000","last_unstale":"2023-10-08T16:10:28.163373+0000","last_undegraded":"2023-10-08T16:10:28.163373+0000","last_fullsized":"2023-10-08T16:10:28.163373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:53.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153918+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167459+0000","last_change":"2023-10-08T16:10:28.167459+0000","last_active":"2023-10-08T16:10:28.167459+0000","last_peered":"2023-10-08T16:10:28.167459+0000","last_clean":"2023-10-08T16:10:28.167459+0000","last_became_active":"2023-10-08T16:10:28.167128+0000","last_became_peered":"2023-10-08T16:10:28.167128+0000","last_unstale":"2023-10-08T16:10:28.167459+0000","last_undegraded":"2023-10-08T16:10:28.167459+0000","last_fullsized":"2023-10-08T16:10:28.167459+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.159269+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175091+0000","last_change":"2023-10-08T16:10:28.175091+0000","last_active":"2023-10-08T16:10:28.175091+0000","last_peered":"2023-10-08T16:10:28.175091+0000","last_clean":"2023-10-08T16:10:28.175091+0000","last_became_active":"2023-10-08T16:10:28.174670+0000","last_became_peered":"2023-10-08T16:10:28.174670+0000","last_unstale":"2023-10-08T16:10:28.175091+0000","last_undegraded":"2023-10-08T16:10:28.175091+0000","last_fullsized":"2023-10-08T16:10:28.175091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:16.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152648+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173996+0000","last_change":"2023-10-08T16:10:28.173996+0000","last_active":"2023-10-08T16:10:28.173996+0000","last_peered":"2023-10-08T16:10:28.173996+0000","last_clean":"2023-10-08T16:10:28.173996+0000","last_became_active":"2023-10-08T16:10:28.173677+0000","last_became_peered":"2023-10-08T16:10:28.173677+0000","last_unstale":"2023-10-08T16:10:28.173996+0000","last_undegraded":"2023-10-08T16:10:28.173996+0000","last_fullsized":"2023-10-08T16:10:28.173996+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158028+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170707+0000","last_change":"2023-10-08T16:10:28.170707+0000","last_active":"2023-10-08T16:10:28.170707+0000","last_peered":"2023-10-08T16:10:28.170707+0000","last_clean":"2023-10-08T16:10:28.170707+0000","last_became_active":"2023-10-08T16:10:28.170362+0000","last_became_peered":"2023-10-08T16:10:28.170362+0000","last_unstale":"2023-10-08T16:10:28.170707+0000","last_undegraded":"2023-10-08T16:10:28.170707+0000","last_fullsized":"2023-10-08T16:10:28.170707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.150126+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162755+0000","last_change":"2023-10-08T16:10:28.162755+0000","last_active":"2023-10-08T16:10:28.162755+0000","last_peered":"2023-10-08T16:10:28.162755+0000","last_clean":"2023-10-08T16:10:28.162755+0000","last_became_active":"2023-10-08T16:10:28.162471+0000","last_became_peered":"2023-10-08T16:10:28.162471+0000","last_unstale":"2023-10-08T16:10:28.162755+0000","last_undegraded":"2023-10-08T16:10:28.162755+0000","last_fullsized":"2023-10-08T16:10:28.162755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:43.527707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.157446+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166722+0000","last_change":"2023-10-08T16:10:28.166722+0000","last_active":"2023-10-08T16:10:28.166722+0000","last_peered":"2023-10-08T16:10:28.166722+0000","last_clean":"2023-10-08T16:10:28.166722+0000","last_became_active":"2023-10-08T16:10:28.166405+0000","last_became_peered":"2023-10-08T16:10:28.166405+0000","last_unstale":"2023-10-08T16:10:28.166722+0000","last_undegraded":"2023-10-08T16:10:28.166722+0000","last_fullsized":"2023-10-08T16:10:28.166722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152525+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.162067+0000","last_change":"2023-10-08T16:10:28.162067+0000","last_active":"2023-10-08T16:10:28.162067+0000","last_peered":"2023-10-08T16:10:28.162067+0000","last_clean":"2023-10-08T16:10:28.162067+0000","last_became_active":"2023-10-08T16:10:28.160294+0000","last_became_peered":"2023-10-08T16:10:28.160294+0000","last_unstale":"2023-10-08T16:10:28.162067+0000","last_undegraded":"2023-10-08T16:10:28.162067+0000","last_fullsized":"2023-10-08T16:10:28.162067+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:57.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148675+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169908+0000","last_change":"2023-10-08T16:10:28.169908+0000","last_active":"2023-10-08T16:10:28.169908+0000","last_peered":"2023-10-08T16:10:28.169908+0000","last_clean":"2023-10-08T16:10:28.169908+0000","last_became_active":"2023-10-08T16:10:28.169556+0000","last_became_peered":"2023-10-08T16:10:28.169556+0000","last_unstale":"2023-10-08T16:10:28.169908+0000","last_undegraded":"2023-10-08T16:10:28.169908+0000","last_fullsized":"2023-10-08T16:10:28.169908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:27.880370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.155261+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.156574+0000","last_change":"2023-10-08T16:10:28.156574+0000","last_active":"2023-10-08T16:10:28.156574+0000","last_peered":"2023-10-08T16:10:28.156574+0000","last_clean":"2023-10-08T16:10:28.156574+0000","last_became_active":"2023-10-08T16:10:28.156307+0000","last_became_peered":"2023-10-08T16:10:28.156307+0000","last_unstale":"2023-10-08T16:10:28.156574+0000","last_undegraded":"2023-10-08T16:10:28.156574+0000","last_fullsized":"2023-10-08T16:10:28.156574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154678+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.163938+0000","last_change":"2023-10-08T16:10:28.163938+0000","last_active":"2023-10-08T16:10:28.163938+0000","last_peered":"2023-10-08T16:10:28.163938+0000","last_clean":"2023-10-08T16:10:28.163938+0000","last_became_active":"2023-10-08T16:10:28.163610+0000","last_became_peered":"2023-10-08T16:10:28.163610+0000","last_unstale":"2023-10-08T16:10:28.163938+0000","last_undegraded":"2023-10-08T16:10:28.163938+0000","last_fullsized":"2023-10-08T16:10:28.163938+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.149730+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175309+0000","last_change":"2023-10-08T16:10:28.175309+0000","last_active":"2023-10-08T16:10:28.175309+0000","last_peered":"2023-10-08T16:10:28.175309+0000","last_clean":"2023-10-08T16:10:28.175309+0000","last_became_active":"2023-10-08T16:10:28.174518+0000","last_became_peered":"2023-10-08T16:10:28.174518+0000","last_unstale":"2023-10-08T16:10:28.175309+0000","last_undegraded":"2023-10-08T16:10:28.175309+0000","last_fullsized":"2023-10-08T16:10:28.175309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151902+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.166308+0000","last_change":"2023-10-08T16:10:28.166308+0000","last_active":"2023-10-08T16:10:28.166308+0000","last_peered":"2023-10-08T16:10:28.166308+0000","last_clean":"2023-10-08T16:10:28.166308+0000","last_became_active":"2023-10-08T16:10:28.166083+0000","last_became_peered":"2023-10-08T16:10:28.166083+0000","last_unstale":"2023-10-08T16:10:28.166308+0000","last_undegraded":"2023-10-08T16:10:28.166308+0000","last_fullsized":"2023-10-08T16:10:28.166308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:20.571265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153985+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.157812+0000","last_change":"2023-10-08T16:10:28.157812+0000","last_active":"2023-10-08T16:10:28.157812+0000","last_peered":"2023-10-08T16:10:28.157812+0000","last_clean":"2023-10-08T16:10:28.157812+0000","last_became_active":"2023-10-08T16:10:28.157471+0000","last_became_peered":"2023-10-08T16:10:28.157471+0000","last_unstale":"2023-10-08T16:10:28.157812+0000","last_undegraded":"2023-10-08T16:10:28.157812+0000","last_fullsized":"2023-10-08T16:10:28.157812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.162055+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169436+0000","last_change":"2023-10-08T16:10:28.169436+0000","last_active":"2023-10-08T16:10:28.169436+0000","last_peered":"2023-10-08T16:10:28.169436+0000","last_clean":"2023-10-08T16:10:28.169436+0000","last_became_active":"2023-10-08T16:10:28.169084+0000","last_became_peered":"2023-10-08T16:10:28.169084+0000","last_unstale":"2023-10-08T16:10:28.169436+0000","last_undegraded":"2023-10-08T16:10:28.169436+0000","last_fullsized":"2023-10-08T16:10:28.169436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:12.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153407+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.175109+0000","last_change":"2023-10-08T16:10:28.175109+0000","last_active":"2023-10-08T16:10:28.175109+0000","last_peered":"2023-10-08T16:10:28.175109+0000","last_clean":"2023-10-08T16:10:28.175109+0000","last_became_active":"2023-10-08T16:10:28.174868+0000","last_became_peered":"2023-10-08T16:10:28.174868+0000","last_unstale":"2023-10-08T16:10:28.175109+0000","last_undegraded":"2023-10-08T16:10:28.175109+0000","last_fullsized":"2023-10-08T16:10:28.175109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156736+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:18:40.537607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170494+0000","last_change":"2023-10-08T16:10:28.170494+0000","last_active":"2023-10-08T16:10:28.170494+0000","last_peered":"2023-10-08T16:10:28.170494+0000","last_clean":"2023-10-08T16:10:28.170494+0000","last_became_active":"2023-10-08T16:10:28.170192+0000","last_became_peered":"2023-10-08T16:10:28.170192+0000","last_unstale":"2023-10-08T16:10:28.170494+0000","last_undegraded":"2023-10-08T16:10:28.170494+0000","last_fullsized":"2023-10-08T16:10:28.170494+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.148836+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.165759+0000","last_change":"2023-10-08T16:10:28.165759+0000","last_active":"2023-10-08T16:10:28.165759+0000","last_peered":"2023-10-08T16:10:28.165759+0000","last_clean":"2023-10-08T16:10:28.165759+0000","last_became_active":"2023-10-08T16:10:28.165359+0000","last_became_peered":"2023-10-08T16:10:28.165359+0000","last_unstale":"2023-10-08T16:10:28.165759+0000","last_undegraded":"2023-10-08T16:10:28.165759+0000","last_fullsized":"2023-10-08T16:10:28.165759+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.409925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151914+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.174109+0000","last_change":"2023-10-08T16:10:28.174109+0000","last_active":"2023-10-08T16:10:28.174109+0000","last_peered":"2023-10-08T16:10:28.174109+0000","last_clean":"2023-10-08T16:10:28.174109+0000","last_became_active":"2023-10-08T16:10:28.173827+0000","last_became_peered":"2023-10-08T16:10:28.173827+0000","last_unstale":"2023-10-08T16:10:28.174109+0000","last_undegraded":"2023-10-08T16:10:28.174109+0000","last_fullsized":"2023-10-08T16:10:28.174109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:33.288290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154267+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:21.577209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.170218+0000","last_change":"2023-10-08T16:10:28.170218+0000","last_active":"2023-10-08T16:10:28.170218+0000","last_peered":"2023-10-08T16:10:28.170218+0000","last_clean":"2023-10-08T16:10:28.170218+0000","last_became_active":"2023-10-08T16:10:28.169946+0000","last_became_peered":"2023-10-08T16:10:28.169946+0000","last_unstale":"2023-10-08T16:10:28.170218+0000","last_undegraded":"2023-10-08T16:10:28.170218+0000","last_fullsized":"2023-10-08T16:10:28.170218+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:46.251322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154860+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:57.324536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159695+0000","last_change":"2023-10-08T16:10:28.159695+0000","last_active":"2023-10-08T16:10:28.159695+0000","last_peered":"2023-10-08T16:10:28.159695+0000","last_clean":"2023-10-08T16:10:28.159695+0000","last_became_active":"2023-10-08T16:10:28.159455+0000","last_became_peered":"2023-10-08T16:10:28.159455+0000","last_unstale":"2023-10-08T16:10:28.159695+0000","last_undegraded":"2023-10-08T16:10:28.159695+0000","last_fullsized":"2023-10-08T16:10:28.159695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154071+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:15.415869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.168599+0000","last_change":"2023-10-08T16:10:28.168599+0000","last_active":"2023-10-08T16:10:28.168599+0000","last_peered":"2023-10-08T16:10:28.168599+0000","last_clean":"2023-10-08T16:10:28.168599+0000","last_became_active":"2023-10-08T16:10:28.168106+0000","last_became_peered":"2023-10-08T16:10:28.168106+0000","last_unstale":"2023-10-08T16:10:28.168599+0000","last_undegraded":"2023-10-08T16:10:28.168599+0000","last_fullsized":"2023-10-08T16:10:28.168599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:26.677198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.154793+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:58.926501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.172381+0000","last_change":"2023-10-08T16:10:28.172381+0000","last_active":"2023-10-08T16:10:28.172381+0000","last_peered":"2023-10-08T16:10:28.172381+0000","last_clean":"2023-10-08T16:10:28.172381+0000","last_became_active":"2023-10-08T16:10:28.172119+0000","last_became_peered":"2023-10-08T16:10:28.172119+0000","last_unstale":"2023-10-08T16:10:28.172381+0000","last_undegraded":"2023-10-08T16:10:28.172381+0000","last_fullsized":"2023-10-08T16:10:28.172381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:39:29.599550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.156741+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:40:21.244213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169590+0000","last_change":"2023-10-08T16:10:28.169590+0000","last_active":"2023-10-08T16:10:28.169590+0000","last_peered":"2023-10-08T16:10:28.169590+0000","last_clean":"2023-10-08T16:10:28.169590+0000","last_became_active":"2023-10-08T16:10:28.169122+0000","last_became_peered":"2023-10-08T16:10:28.169122+0000","last_unstale":"2023-10-08T16:10:28.169590+0000","last_undegraded":"2023-10-08T16:10:28.169590+0000","last_fullsized":"2023-10-08T16:10:28.169590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153627+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:34.294234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160833+0000","last_change":"2023-10-08T16:10:28.160833+0000","last_active":"2023-10-08T16:10:28.160833+0000","last_peered":"2023-10-08T16:10:28.160833+0000","last_clean":"2023-10-08T16:10:28.160833+0000","last_became_active":"2023-10-08T16:10:28.160500+0000","last_became_peered":"2023-10-08T16:10:28.160500+0000","last_unstale":"2023-10-08T16:10:28.160833+0000","last_undegraded":"2023-10-08T16:10:28.160833+0000","last_fullsized":"2023-10-08T16:10:28.160833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.151581+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.159791+0000","last_change":"2023-10-08T16:10:28.159791+0000","last_active":"2023-10-08T16:10:28.159791+0000","last_peered":"2023-10-08T16:10:28.159791+0000","last_clean":"2023-10-08T16:10:28.159791+0000","last_became_active":"2023-10-08T16:10:28.159411+0000","last_became_peered":"2023-10-08T16:10:28.159411+0000","last_unstale":"2023-10-08T16:10:28.159791+0000","last_undegraded":"2023-10-08T16:10:28.159791+0000","last_fullsized":"2023-10-08T16:10:28.159791+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153023+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.173314+0000","last_change":"2023-10-08T16:10:28.173314+0000","last_active":"2023-10-08T16:10:28.173314+0000","last_peered":"2023-10-08T16:10:28.173314+0000","last_clean":"2023-10-08T16:10:28.173314+0000","last_became_active":"2023-10-08T16:10:28.172896+0000","last_became_peered":"2023-10-08T16:10:28.172896+0000","last_unstale":"2023-10-08T16:10:28.173314+0000","last_undegraded":"2023-10-08T16:10:28.173314+0000","last_fullsized":"2023-10-08T16:10:28.173314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153421+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.155737+0000","last_change":"2023-10-08T16:10:28.155737+0000","last_active":"2023-10-08T16:10:28.155737+0000","last_peered":"2023-10-08T16:10:28.155737+0000","last_clean":"2023-10-08T16:10:28.155737+0000","last_became_active":"2023-10-08T16:10:28.155453+0000","last_became_peered":"2023-10-08T16:10:28.155453+0000","last_unstale":"2023-10-08T16:10:28.155737+0000","last_undegraded":"2023-10-08T16:10:28.155737+0000","last_fullsized":"2023-10-08T16:10:28.155737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.152352+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.160526+0000","last_change":"2023-10-08T16:10:28.160526+0000","last_active":"2023-10-08T16:10:28.160526+0000","last_peered":"2023-10-08T16:10:28.160526+0000","last_clean":"2023-10-08T16:10:28.160526+0000","last_became_active":"2023-10-08T16:10:28.160243+0000","last_became_peered":"2023-10-08T16:10:28.160243+0000","last_unstale":"2023-10-08T16:10:28.160526+0000","last_undegraded":"2023-10-08T16:10:28.160526+0000","last_fullsized":"2023-10-08T16:10:28.160526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.153640+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.171416+0000","last_change":"2023-10-08T16:10:28.171416+0000","last_active":"2023-10-08T16:10:28.171416+0000","last_peered":"2023-10-08T16:10:28.171416+0000","last_clean":"2023-10-08T16:10:28.171416+0000","last_became_active":"2023-10-08T16:10:28.171217+0000","last_became_peered":"2023-10-08T16:10:28.171217+0000","last_unstale":"2023-10-08T16:10:28.171416+0000","last_undegraded":"2023-10-08T16:10:28.171416+0000","last_fullsized":"2023-10-08T16:10:28.171416+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:26.909856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.158863+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:27.683142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.169980+0000","last_change":"2023-10-08T16:10:28.169980+0000","last_active":"2023-10-08T16:10:28.169980+0000","last_peered":"2023-10-08T16:10:28.169980+0000","last_clean":"2023-10-08T16:10:28.169980+0000","last_became_active":"2023-10-08T16:10:28.169573+0000","last_became_peered":"2023-10-08T16:10:28.169573+0000","last_unstale":"2023-10-08T16:10:28.169980+0000","last_undegraded":"2023-10-08T16:10:28.169980+0000","last_fullsized":"2023-10-08T16:10:28.169980+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:46.425856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:10:28.138158+0000","last_change":"2023-10-08T16:10:28.160208+0000","last_active":"2023-10-08T16:10:28.138158+0000","last_peered":"2023-10-08T16:10:28.138158+0000","last_clean":"2023-10-08T16:10:28.138158+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:10:28.138158+0000","last_undegraded":"2023-10-08T16:10:28.138158+0000","last_fullsized":"2023-10-08T16:10:28.138158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":8,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-10-08T16:10:28.167624+0000","last_change":"2023-10-08T16:10:28.167624+0000","last_active":"2023-10-08T16:10:28.167624+0000","last_peered":"2023-10-08T16:10:28.167624+0000","last_clean":"2023-10-08T16:10:28.167624+0000","last_became_active":"2023-10-08T16:10:28.167279+0000","last_became_peered":"2023-10-08T16:10:28.167279+0000","last_unstale":"2023-10-08T16:10:28.167624+0000","last_undegraded":"2023-10-08T16:10:28.167624+0000","last_fullsized":"2023-10-08T16:10:28.167624+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-08T16:10:27.145338+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:10:27.145338+0000","last_peered":"2023-10-08T16:10:27.145338+0000","last_clean":"2023-10-08T16:10:27.145338+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:10:27.145338+0000","last_undegraded":"2023-10-08T16:10:27.145338+0000","last_fullsized":"2023-10-08T16:10:27.145338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302328,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069512,"statfs":{"total":96636764160,"available":96327180288,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.67600000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.72299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.79000000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.83899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.623},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.878},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82499999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.85799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301736,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070104,"statfs":{"total":96636764160,"available":96327786496,"internally_reserved":0,"allocated":360448,"data_stored":136828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.5}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.64500000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.623},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.749}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.71499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298232,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073608,"statfs":{"total":96636764160,"available":96331374592,"internally_reserved":0,"allocated":966656,"data_stored":733451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.496}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.61799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.60799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.38},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.40799999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.443},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.75600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.97399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297652,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074188,"statfs":{"total":96636764160,"available":96331968512,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.35299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.497}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.441},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.68700000000000006}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.82599999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.879}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.75700000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.871},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.746},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301748,"kb_used_data":364,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070092,"statfs":{"total":96636764160,"available":96327774208,"internally_reserved":0,"allocated":372736,"data_stored":143083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.85299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61899999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.90300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.054},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.024}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:38.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:10:38.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.648+0000 7f15ab59e700 1 Processor -- start 2023-10-08T16:10:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.649+0000 7f15ab59e700 1 -- start start 2023-10-08T16:10:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15ab59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15ac15de50 0x7f15ac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15ab59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cf3c0 con 0x7f15ac153c30 2023-10-08T16:10:38.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15ab59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac15afd0 con 0x7f15ac0cef40 2023-10-08T16:10:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15ab59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac15b2b0 con 0x7f15ac15de50 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15a9d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f15ac15de50 0x7f15ac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15aa59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f15ac153c30 0x7f15ac15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41670/0 (socket says 172.21.15.12:41670) 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15aa59c700 1 -- 172.21.15.12:0/231240391 learned_addr learned my addr 172.21.15.12:0/231240391 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15a9d9b700 1 -- 172.21.15.12:0/231240391 >> v1:172.21.15.29:6789/0 conn(0x7f15ac0cef40 legacy=0x7f15ac15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a9d9b700 1 -- 172.21.15.12:0/231240391 >> v1:172.21.15.12:6789/0 conn(0x7f15ac153c30 legacy=0x7f15ac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.650+0000 7f15a959a700 1 -- 172.21.15.12:0/231240391 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996625997 0 0) 0x7f15ac0cf3c0 con 0x7f15ac153c30 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a9d9b700 1 -- 172.21.15.12:0/231240391 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac15b590 con 0x7f15ac15de50 2023-10-08T16:10:38.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a9d9b700 1 --2- 172.21.15.12:0/231240391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac15de50 0x7f15ac0cea00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f15a00098e0 tx=0x7f15a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611e77f12a30aa87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a959a700 1 -- 172.21.15.12:0/231240391 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a0009e80 con 0x7f15ac15de50 2023-10-08T16:10:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a959a700 1 -- 172.21.15.12:0/231240391 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000b820 con 0x7f15ac15de50 2023-10-08T16:10:38.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.651+0000 7f15a959a700 1 -- 172.21.15.12:0/231240391 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000bba0 con 0x7f15ac15de50 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 -- 172.21.15.12:0/231240391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac15de50 msgr2=0x7f15ac0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 --2- 172.21.15.12:0/231240391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac15de50 0x7f15ac0cea00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f15a00098e0 tx=0x7f15a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 -- 172.21.15.12:0/231240391 shutdown_connections 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 --2- 172.21.15.12:0/231240391 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac15de50 0x7f15ac0cea00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 -- 172.21.15.12:0/231240391 >> 172.21.15.12:0/231240391 conn(0x7f15ac0703a0 msgr2=0x7f15ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 -- 172.21.15.12:0/231240391 shutdown_connections 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.652+0000 7f15ab59e700 1 -- 172.21.15.12:0/231240391 wait complete. 2023-10-08T16:10:38.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.653+0000 7f15ab59e700 1 Processor -- start 2023-10-08T16:10:38.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.653+0000 7f15ab59e700 1 -- start start 2023-10-08T16:10:38.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 0x7f15ac0b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15ac15de50 0x7f15ac0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0b56c0 con 0x7f15ac0cef40 2023-10-08T16:10:38.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c9270 con 0x7f15ac153c30 2023-10-08T16:10:38.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15ab59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac0c9550 con 0x7f15ac15de50 2023-10-08T16:10:38.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.654+0000 7f15aa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54688/0 (socket says 172.21.15.12:54688) 2023-10-08T16:10:38.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 -- 172.21.15.12:0/3366365202 learned_addr learned my addr 172.21.15.12:0/3366365202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15a9d9b700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 0x7f15ac0b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 -- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15ac15de50 msgr2=0x7f15ac0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15ac15de50 0x7f15ac0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 -- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 msgr2=0x7f15ac0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 0x7f15ac0b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 -- 172.21.15.12:0/3366365202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a0009420 con 0x7f15ac0cef40 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15a9d9b700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 0x7f15ac0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15aa59c700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c7e0 tx=0x7f159c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c005b30 con 0x7f15ac0cef40 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159c005c90 con 0x7f15ac0cef40 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159c007300 con 0x7f15ac0cef40 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.655+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac0c9830 con 0x7f15ac0cef40 2023-10-08T16:10:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.656+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0c9df0 con 0x7f15ac0cef40 2023-10-08T16:10:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.657+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac0ca010 con 0x7f15ac0cef40 2023-10-08T16:10:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.657+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f159c01b400 con 0x7f15ac0cef40 2023-10-08T16:10:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.658+0000 7f159a7fc700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.659+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f159c084070 con 0x7f15ac0cef40 2023-10-08T16:10:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.659+0000 7f15a9d9b700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:38.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.659+0000 7f15a9d9b700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15a00030c0 tx=0x7f15a0016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:38.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.662+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f159c051370 con 0x7f15ac0cef40 2023-10-08T16:10:38.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.860+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15ac04c3c0 con 0x7f158c066f30 2023-10-08T16:10:38.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.869+0000 7f159a7fc700 1 -- 172.21.15.12:0/3366365202 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288327 (secure 0 0 0) 0x7f15ac04c3c0 con 0x7f158c066f30 2023-10-08T16:10:38.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 msgr2=0x7f158c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 0x7f158c0693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f15a00030c0 tx=0x7f15a0016000 comp rx=0 tx=0).stop 2023-10-08T16:10:38.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 msgr2=0x7f15ac146de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f159c00c7e0 tx=0x7f159c007df0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 shutdown_connections 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f158c066f30 0x7f158c0693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15ac0cef40 0x7f15ac146de0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15ac15de50 0x7f15ac0b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 --2- 172.21.15.12:0/3366365202 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15ac153c30 0x7f15ac0b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 >> 172.21.15.12:0/3366365202 conn(0x7f15ac0703a0 msgr2=0x7f15ac152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 shutdown_connections 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:38.874+0000 7f15ab59e700 1 -- 172.21.15.12:0/3366365202 wait complete. 2023-10-08T16:10:38.877 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:10:38.892 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2023-10-08T16:10:37.926906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399016,"kb_used_data":4328,"kb_used_omap":0,"kb_used_meta":2394624,"kb_avail":752575704,"statfs":{"total":773094113280,"available":770637520896,"internally_reserved":0,"allocated":4431872,"data_stored":2434420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2452094976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.779892"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.169214+0000","last_change":"2023-10-08T16:10:29.165955+0000","last_active":"2023-10-08T16:10:29.169214+0000","last_peered":"2023-10-08T16:10:29.169214+0000","last_clean":"2023-10-08T16:10:29.169214+0000","last_became_active":"2023-10-08T16:10:29.165582+0000","last_became_peered":"2023-10-08T16:10:29.165582+0000","last_unstale":"2023-10-08T16:10:29.169214+0000","last_undegraded":"2023-10-08T16:10:29.169214+0000","last_fullsized":"2023-10-08T16:10:29.169214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190030+0000","last_change":"2023-10-08T16:10:29.177528+0000","last_active":"2023-10-08T16:10:29.190030+0000","last_peered":"2023-10-08T16:10:29.190030+0000","last_clean":"2023-10-08T16:10:29.190030+0000","last_became_active":"2023-10-08T16:10:29.173657+0000","last_became_peered":"2023-10-08T16:10:29.173657+0000","last_unstale":"2023-10-08T16:10:29.190030+0000","last_undegraded":"2023-10-08T16:10:29.190030+0000","last_fullsized":"2023-10-08T16:10:29.190030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:52.664259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175841+0000","last_change":"2023-10-08T16:10:29.171378+0000","last_active":"2023-10-08T16:10:29.175841+0000","last_peered":"2023-10-08T16:10:29.175841+0000","last_clean":"2023-10-08T16:10:29.175841+0000","last_became_active":"2023-10-08T16:10:29.168510+0000","last_became_peered":"2023-10-08T16:10:29.168510+0000","last_unstale":"2023-10-08T16:10:29.175841+0000","last_undegraded":"2023-10-08T16:10:29.175841+0000","last_fullsized":"2023-10-08T16:10:29.175841+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172508+0000","last_change":"2023-10-08T16:10:29.168171+0000","last_active":"2023-10-08T16:10:29.172508+0000","last_peered":"2023-10-08T16:10:29.172508+0000","last_clean":"2023-10-08T16:10:29.172508+0000","last_became_active":"2023-10-08T16:10:29.167872+0000","last_became_peered":"2023-10-08T16:10:29.167872+0000","last_unstale":"2023-10-08T16:10:29.172508+0000","last_undegraded":"2023-10-08T16:10:29.172508+0000","last_fullsized":"2023-10-08T16:10:29.172508+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.176513+0000","last_change":"2023-10-08T16:10:29.174857+0000","last_active":"2023-10-08T16:10:29.176513+0000","last_peered":"2023-10-08T16:10:29.176513+0000","last_clean":"2023-10-08T16:10:29.176513+0000","last_became_active":"2023-10-08T16:10:29.174598+0000","last_became_peered":"2023-10-08T16:10:29.174598+0000","last_unstale":"2023-10-08T16:10:29.176513+0000","last_undegraded":"2023-10-08T16:10:29.176513+0000","last_fullsized":"2023-10-08T16:10:29.176513+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:12.445783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190739+0000","last_change":"2023-10-08T16:10:29.183406+0000","last_active":"2023-10-08T16:10:29.190739+0000","last_peered":"2023-10-08T16:10:29.190739+0000","last_clean":"2023-10-08T16:10:29.190739+0000","last_became_active":"2023-10-08T16:10:29.183154+0000","last_became_peered":"2023-10-08T16:10:29.183154+0000","last_unstale":"2023-10-08T16:10:29.190739+0000","last_undegraded":"2023-10-08T16:10:29.190739+0000","last_fullsized":"2023-10-08T16:10:29.190739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:51.816061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.173468+0000","last_change":"2023-10-08T16:10:29.168823+0000","last_active":"2023-10-08T16:10:29.173468+0000","last_peered":"2023-10-08T16:10:29.173468+0000","last_clean":"2023-10-08T16:10:29.173468+0000","last_became_active":"2023-10-08T16:10:29.168512+0000","last_became_peered":"2023-10-08T16:10:29.168512+0000","last_unstale":"2023-10-08T16:10:29.173468+0000","last_undegraded":"2023-10-08T16:10:29.173468+0000","last_fullsized":"2023-10-08T16:10:29.173468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:21.850638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.166994+0000","last_change":"2023-10-08T16:10:29.160786+0000","last_active":"2023-10-08T16:10:29.166994+0000","last_peered":"2023-10-08T16:10:29.166994+0000","last_clean":"2023-10-08T16:10:29.166994+0000","last_became_active":"2023-10-08T16:10:29.160222+0000","last_became_peered":"2023-10-08T16:10:29.160222+0000","last_unstale":"2023-10-08T16:10:29.166994+0000","last_undegraded":"2023-10-08T16:10:29.166994+0000","last_fullsized":"2023-10-08T16:10:29.166994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:53:46.325126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.174562+0000","last_change":"2023-10-08T16:10:29.168286+0000","last_active":"2023-10-08T16:10:29.174562+0000","last_peered":"2023-10-08T16:10:29.174562+0000","last_clean":"2023-10-08T16:10:29.174562+0000","last_became_active":"2023-10-08T16:10:29.168001+0000","last_became_peered":"2023-10-08T16:10:29.168001+0000","last_unstale":"2023-10-08T16:10:29.174562+0000","last_undegraded":"2023-10-08T16:10:29.174562+0000","last_fullsized":"2023-10-08T16:10:29.174562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.179278+0000","last_change":"2023-10-08T16:10:29.177561+0000","last_active":"2023-10-08T16:10:29.179278+0000","last_peered":"2023-10-08T16:10:29.179278+0000","last_clean":"2023-10-08T16:10:29.179278+0000","last_became_active":"2023-10-08T16:10:29.177300+0000","last_became_peered":"2023-10-08T16:10:29.177300+0000","last_unstale":"2023-10-08T16:10:29.179278+0000","last_undegraded":"2023-10-08T16:10:29.179278+0000","last_fullsized":"2023-10-08T16:10:29.179278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:52.664259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.158981+0000","last_change":"2023-10-08T16:10:29.155942+0000","last_active":"2023-10-08T16:10:29.158981+0000","last_peered":"2023-10-08T16:10:29.158981+0000","last_clean":"2023-10-08T16:10:29.158981+0000","last_became_active":"2023-10-08T16:10:29.155655+0000","last_became_peered":"2023-10-08T16:10:29.155655+0000","last_unstale":"2023-10-08T16:10:29.158981+0000","last_undegraded":"2023-10-08T16:10:29.158981+0000","last_fullsized":"2023-10-08T16:10:29.158981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:51.816061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.183830+0000","last_change":"2023-10-08T16:10:29.183104+0000","last_active":"2023-10-08T16:10:29.183830+0000","last_peered":"2023-10-08T16:10:29.183830+0000","last_clean":"2023-10-08T16:10:29.183830+0000","last_became_active":"2023-10-08T16:10:29.182801+0000","last_became_peered":"2023-10-08T16:10:29.182801+0000","last_unstale":"2023-10-08T16:10:29.183830+0000","last_undegraded":"2023-10-08T16:10:29.183830+0000","last_fullsized":"2023-10-08T16:10:29.183830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172679+0000","last_change":"2023-10-08T16:10:29.166605+0000","last_active":"2023-10-08T16:10:29.172679+0000","last_peered":"2023-10-08T16:10:29.172679+0000","last_clean":"2023-10-08T16:10:29.172679+0000","last_became_active":"2023-10-08T16:10:29.166257+0000","last_became_peered":"2023-10-08T16:10:29.166257+0000","last_unstale":"2023-10-08T16:10:29.172679+0000","last_undegraded":"2023-10-08T16:10:29.172679+0000","last_fullsized":"2023-10-08T16:10:29.172679+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.189930+0000","last_change":"2023-10-08T16:10:29.176586+0000","last_active":"2023-10-08T16:10:29.189930+0000","last_peered":"2023-10-08T16:10:29.189930+0000","last_clean":"2023-10-08T16:10:29.189930+0000","last_became_active":"2023-10-08T16:10:29.176323+0000","last_became_peered":"2023-10-08T16:10:29.176323+0000","last_unstale":"2023-10-08T16:10:29.189930+0000","last_undegraded":"2023-10-08T16:10:29.189930+0000","last_fullsized":"2023-10-08T16:10:29.189930+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:52:27.384734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.174291+0000","last_change":"2023-10-08T16:10:29.166528+0000","last_active":"2023-10-08T16:10:29.174291+0000","last_peered":"2023-10-08T16:10:29.174291+0000","last_clean":"2023-10-08T16:10:29.174291+0000","last_became_active":"2023-10-08T16:10:29.166221+0000","last_became_peered":"2023-10-08T16:10:29.166221+0000","last_unstale":"2023-10-08T16:10:29.174291+0000","last_undegraded":"2023-10-08T16:10:29.174291+0000","last_fullsized":"2023-10-08T16:10:29.174291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.177701+0000","last_change":"2023-10-08T16:10:29.175451+0000","last_active":"2023-10-08T16:10:29.177701+0000","last_peered":"2023-10-08T16:10:29.177701+0000","last_clean":"2023-10-08T16:10:29.177701+0000","last_became_active":"2023-10-08T16:10:29.175152+0000","last_became_peered":"2023-10-08T16:10:29.175152+0000","last_unstale":"2023-10-08T16:10:29.177701+0000","last_undegraded":"2023-10-08T16:10:29.177701+0000","last_fullsized":"2023-10-08T16:10:29.177701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:38.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.173623+0000","last_change":"2023-10-08T16:10:29.169669+0000","last_active":"2023-10-08T16:10:29.173623+0000","last_peered":"2023-10-08T16:10:29.173623+0000","last_clean":"2023-10-08T16:10:29.173623+0000","last_became_active":"2023-10-08T16:10:29.169346+0000","last_became_peered":"2023-10-08T16:10:29.169346+0000","last_unstale":"2023-10-08T16:10:29.173623+0000","last_undegraded":"2023-10-08T16:10:29.173623+0000","last_fullsized":"2023-10-08T16:10:29.173623+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:58.435944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190011+0000","last_change":"2023-10-08T16:10:29.177390+0000","last_active":"2023-10-08T16:10:29.190011+0000","last_peered":"2023-10-08T16:10:29.190011+0000","last_clean":"2023-10-08T16:10:29.190011+0000","last_became_active":"2023-10-08T16:10:29.174103+0000","last_became_peered":"2023-10-08T16:10:29.174103+0000","last_unstale":"2023-10-08T16:10:29.190011+0000","last_undegraded":"2023-10-08T16:10:29.190011+0000","last_fullsized":"2023-10-08T16:10:29.190011+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:41:38.963709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190145+0000","last_change":"2023-10-08T16:10:29.178005+0000","last_active":"2023-10-08T16:10:29.190145+0000","last_peered":"2023-10-08T16:10:29.190145+0000","last_clean":"2023-10-08T16:10:29.190145+0000","last_became_active":"2023-10-08T16:10:29.174231+0000","last_became_peered":"2023-10-08T16:10:29.174231+0000","last_unstale":"2023-10-08T16:10:29.190145+0000","last_undegraded":"2023-10-08T16:10:29.190145+0000","last_fullsized":"2023-10-08T16:10:29.190145+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:58.435944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187462+0000","last_change":"2023-10-08T16:10:29.177419+0000","last_active":"2023-10-08T16:10:29.187462+0000","last_peered":"2023-10-08T16:10:29.187462+0000","last_clean":"2023-10-08T16:10:29.187462+0000","last_became_active":"2023-10-08T16:10:29.177148+0000","last_became_peered":"2023-10-08T16:10:29.177148+0000","last_unstale":"2023-10-08T16:10:29.187462+0000","last_undegraded":"2023-10-08T16:10:29.187462+0000","last_fullsized":"2023-10-08T16:10:29.187462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:32.417335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.165326+0000","last_change":"2023-10-08T16:10:29.162546+0000","last_active":"2023-10-08T16:10:29.165326+0000","last_peered":"2023-10-08T16:10:29.165326+0000","last_clean":"2023-10-08T16:10:29.165326+0000","last_became_active":"2023-10-08T16:10:29.162242+0000","last_became_peered":"2023-10-08T16:10:29.162242+0000","last_unstale":"2023-10-08T16:10:29.165326+0000","last_undegraded":"2023-10-08T16:10:29.165326+0000","last_fullsized":"2023-10-08T16:10:29.165326+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:11.386731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.183424+0000","last_change":"2023-10-08T16:10:29.182610+0000","last_active":"2023-10-08T16:10:29.183424+0000","last_peered":"2023-10-08T16:10:29.183424+0000","last_clean":"2023-10-08T16:10:29.183424+0000","last_became_active":"2023-10-08T16:10:29.182356+0000","last_became_peered":"2023-10-08T16:10:29.182356+0000","last_unstale":"2023-10-08T16:10:29.183424+0000","last_undegraded":"2023-10-08T16:10:29.183424+0000","last_fullsized":"2023-10-08T16:10:29.183424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:47.431801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.165668+0000","last_change":"2023-10-08T16:10:29.157969+0000","last_active":"2023-10-08T16:10:29.165668+0000","last_peered":"2023-10-08T16:10:29.165668+0000","last_clean":"2023-10-08T16:10:29.165668+0000","last_became_active":"2023-10-08T16:10:29.157732+0000","last_became_peered":"2023-10-08T16:10:29.157732+0000","last_unstale":"2023-10-08T16:10:29.165668+0000","last_undegraded":"2023-10-08T16:10:29.165668+0000","last_fullsized":"2023-10-08T16:10:29.165668+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:35:14.602855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.180619+0000","last_change":"2023-10-08T16:10:29.176882+0000","last_active":"2023-10-08T16:10:29.180619+0000","last_peered":"2023-10-08T16:10:29.180619+0000","last_clean":"2023-10-08T16:10:29.180619+0000","last_became_active":"2023-10-08T16:10:29.176619+0000","last_became_peered":"2023-10-08T16:10:29.176619+0000","last_unstale":"2023-10-08T16:10:29.180619+0000","last_undegraded":"2023-10-08T16:10:29.180619+0000","last_fullsized":"2023-10-08T16:10:29.180619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.164974+0000","last_change":"2023-10-08T16:10:29.157637+0000","last_active":"2023-10-08T16:10:29.164974+0000","last_peered":"2023-10-08T16:10:29.164974+0000","last_clean":"2023-10-08T16:10:29.164974+0000","last_became_active":"2023-10-08T16:10:29.156777+0000","last_became_peered":"2023-10-08T16:10:29.156777+0000","last_unstale":"2023-10-08T16:10:29.164974+0000","last_undegraded":"2023-10-08T16:10:29.164974+0000","last_fullsized":"2023-10-08T16:10:29.164974+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:58.377010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190214+0000","last_change":"2023-10-08T16:10:29.180672+0000","last_active":"2023-10-08T16:10:29.190214+0000","last_peered":"2023-10-08T16:10:29.190214+0000","last_clean":"2023-10-08T16:10:29.190214+0000","last_became_active":"2023-10-08T16:10:29.180413+0000","last_became_peered":"2023-10-08T16:10:29.180413+0000","last_unstale":"2023-10-08T16:10:29.190214+0000","last_undegraded":"2023-10-08T16:10:29.190214+0000","last_fullsized":"2023-10-08T16:10:29.190214+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:42:12.387010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172428+0000","last_change":"2023-10-08T16:10:29.167955+0000","last_active":"2023-10-08T16:10:29.172428+0000","last_peered":"2023-10-08T16:10:29.172428+0000","last_clean":"2023-10-08T16:10:29.172428+0000","last_became_active":"2023-10-08T16:10:29.167272+0000","last_became_peered":"2023-10-08T16:10:29.167272+0000","last_unstale":"2023-10-08T16:10:29.172428+0000","last_undegraded":"2023-10-08T16:10:29.172428+0000","last_fullsized":"2023-10-08T16:10:29.172428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:46.508183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.176125+0000","last_change":"2023-10-08T16:10:29.171653+0000","last_active":"2023-10-08T16:10:29.176125+0000","last_peered":"2023-10-08T16:10:29.176125+0000","last_clean":"2023-10-08T16:10:29.176125+0000","last_became_active":"2023-10-08T16:10:29.170310+0000","last_became_peered":"2023-10-08T16:10:29.170310+0000","last_unstale":"2023-10-08T16:10:29.176125+0000","last_undegraded":"2023-10-08T16:10:29.176125+0000","last_fullsized":"2023-10-08T16:10:29.176125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.178704+0000","last_change":"2023-10-08T16:10:29.175091+0000","last_active":"2023-10-08T16:10:29.178704+0000","last_peered":"2023-10-08T16:10:29.178704+0000","last_clean":"2023-10-08T16:10:29.178704+0000","last_became_active":"2023-10-08T16:10:29.174361+0000","last_became_peered":"2023-10-08T16:10:29.174361+0000","last_unstale":"2023-10-08T16:10:29.178704+0000","last_undegraded":"2023-10-08T16:10:29.178704+0000","last_fullsized":"2023-10-08T16:10:29.178704+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:13.611417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.173531+0000","last_change":"2023-10-08T16:10:29.168823+0000","last_active":"2023-10-08T16:10:29.173531+0000","last_peered":"2023-10-08T16:10:29.173531+0000","last_clean":"2023-10-08T16:10:29.173531+0000","last_became_active":"2023-10-08T16:10:29.168571+0000","last_became_peered":"2023-10-08T16:10:29.168571+0000","last_unstale":"2023-10-08T16:10:29.173531+0000","last_undegraded":"2023-10-08T16:10:29.173531+0000","last_fullsized":"2023-10-08T16:10:29.173531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:04.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168664+0000","last_change":"2023-10-08T16:10:29.167138+0000","last_active":"2023-10-08T16:10:29.168664+0000","last_peered":"2023-10-08T16:10:29.168664+0000","last_clean":"2023-10-08T16:10:29.168664+0000","last_became_active":"2023-10-08T16:10:29.165947+0000","last_became_peered":"2023-10-08T16:10:29.165947+0000","last_unstale":"2023-10-08T16:10:29.168664+0000","last_undegraded":"2023-10-08T16:10:29.168664+0000","last_fullsized":"2023-10-08T16:10:29.168664+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.174968+0000","last_change":"2023-10-08T16:10:29.171302+0000","last_active":"2023-10-08T16:10:29.174968+0000","last_peered":"2023-10-08T16:10:29.174968+0000","last_clean":"2023-10-08T16:10:29.174968+0000","last_became_active":"2023-10-08T16:10:29.169459+0000","last_became_peered":"2023-10-08T16:10:29.169459+0000","last_unstale":"2023-10-08T16:10:29.174968+0000","last_undegraded":"2023-10-08T16:10:29.174968+0000","last_fullsized":"2023-10-08T16:10:29.174968+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:43.242885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.165805+0000","last_change":"2023-10-08T16:10:29.158605+0000","last_active":"2023-10-08T16:10:29.165805+0000","last_peered":"2023-10-08T16:10:29.165805+0000","last_clean":"2023-10-08T16:10:29.165805+0000","last_became_active":"2023-10-08T16:10:29.158357+0000","last_became_peered":"2023-10-08T16:10:29.158357+0000","last_unstale":"2023-10-08T16:10:29.165805+0000","last_undegraded":"2023-10-08T16:10:29.165805+0000","last_fullsized":"2023-10-08T16:10:29.165805+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:03.176692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.181056+0000","last_change":"2023-10-08T16:10:28.163373+0000","last_active":"2023-10-08T16:10:29.181056+0000","last_peered":"2023-10-08T16:10:29.181056+0000","last_clean":"2023-10-08T16:10:29.181056+0000","last_became_active":"2023-10-08T16:10:28.163089+0000","last_became_peered":"2023-10-08T16:10:28.163089+0000","last_unstale":"2023-10-08T16:10:29.181056+0000","last_undegraded":"2023-10-08T16:10:29.181056+0000","last_fullsized":"2023-10-08T16:10:29.181056+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:53.708892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.173557+0000","last_change":"2023-10-08T16:10:29.169367+0000","last_active":"2023-10-08T16:10:29.173557+0000","last_peered":"2023-10-08T16:10:29.173557+0000","last_clean":"2023-10-08T16:10:29.173557+0000","last_became_active":"2023-10-08T16:10:29.169034+0000","last_became_peered":"2023-10-08T16:10:29.169034+0000","last_unstale":"2023-10-08T16:10:29.173557+0000","last_undegraded":"2023-10-08T16:10:29.173557+0000","last_fullsized":"2023-10-08T16:10:29.173557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.180396+0000","last_change":"2023-10-08T16:10:28.167459+0000","last_active":"2023-10-08T16:10:29.180396+0000","last_peered":"2023-10-08T16:10:29.180396+0000","last_clean":"2023-10-08T16:10:29.180396+0000","last_became_active":"2023-10-08T16:10:28.167128+0000","last_became_peered":"2023-10-08T16:10:28.167128+0000","last_unstale":"2023-10-08T16:10:29.180396+0000","last_undegraded":"2023-10-08T16:10:29.180396+0000","last_fullsized":"2023-10-08T16:10:29.180396+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.183786+0000","last_change":"2023-10-08T16:10:29.182778+0000","last_active":"2023-10-08T16:10:29.183786+0000","last_peered":"2023-10-08T16:10:29.183786+0000","last_clean":"2023-10-08T16:10:29.183786+0000","last_became_active":"2023-10-08T16:10:29.182462+0000","last_became_peered":"2023-10-08T16:10:29.182462+0000","last_unstale":"2023-10-08T16:10:29.183786+0000","last_undegraded":"2023-10-08T16:10:29.183786+0000","last_fullsized":"2023-10-08T16:10:29.183786+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:17.889729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190697+0000","last_change":"2023-10-08T16:10:28.175091+0000","last_active":"2023-10-08T16:10:29.190697+0000","last_peered":"2023-10-08T16:10:29.190697+0000","last_clean":"2023-10-08T16:10:29.190697+0000","last_became_active":"2023-10-08T16:10:28.174670+0000","last_became_peered":"2023-10-08T16:10:28.174670+0000","last_unstale":"2023-10-08T16:10:29.190697+0000","last_undegraded":"2023-10-08T16:10:29.190697+0000","last_fullsized":"2023-10-08T16:10:29.190697+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:56:16.883784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172449+0000","last_change":"2023-10-08T16:10:29.168201+0000","last_active":"2023-10-08T16:10:29.172449+0000","last_peered":"2023-10-08T16:10:29.172449+0000","last_clean":"2023-10-08T16:10:29.172449+0000","last_became_active":"2023-10-08T16:10:29.167670+0000","last_became_peered":"2023-10-08T16:10:29.167670+0000","last_unstale":"2023-10-08T16:10:29.172449+0000","last_undegraded":"2023-10-08T16:10:29.172449+0000","last_fullsized":"2023-10-08T16:10:29.172449+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187387+0000","last_change":"2023-10-08T16:10:28.173996+0000","last_active":"2023-10-08T16:10:29.187387+0000","last_peered":"2023-10-08T16:10:29.187387+0000","last_clean":"2023-10-08T16:10:29.187387+0000","last_became_active":"2023-10-08T16:10:28.173677+0000","last_became_peered":"2023-10-08T16:10:28.173677+0000","last_unstale":"2023-10-08T16:10:29.187387+0000","last_undegraded":"2023-10-08T16:10:29.187387+0000","last_fullsized":"2023-10-08T16:10:29.187387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168997+0000","last_change":"2023-10-08T16:10:29.165933+0000","last_active":"2023-10-08T16:10:29.168997+0000","last_peered":"2023-10-08T16:10:29.168997+0000","last_clean":"2023-10-08T16:10:29.168997+0000","last_became_active":"2023-10-08T16:10:29.165323+0000","last_became_peered":"2023-10-08T16:10:29.165323+0000","last_unstale":"2023-10-08T16:10:29.168997+0000","last_undegraded":"2023-10-08T16:10:29.168997+0000","last_fullsized":"2023-10-08T16:10:29.168997+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:14:58.761067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190119+0000","last_change":"2023-10-08T16:10:28.170707+0000","last_active":"2023-10-08T16:10:29.190119+0000","last_peered":"2023-10-08T16:10:29.190119+0000","last_clean":"2023-10-08T16:10:29.190119+0000","last_became_active":"2023-10-08T16:10:28.170362+0000","last_became_peered":"2023-10-08T16:10:28.170362+0000","last_unstale":"2023-10-08T16:10:29.190119+0000","last_undegraded":"2023-10-08T16:10:29.190119+0000","last_fullsized":"2023-10-08T16:10:29.190119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:32:55.086366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175915+0000","last_change":"2023-10-08T16:10:29.171859+0000","last_active":"2023-10-08T16:10:29.175915+0000","last_peered":"2023-10-08T16:10:29.175915+0000","last_clean":"2023-10-08T16:10:29.175915+0000","last_became_active":"2023-10-08T16:10:29.170448+0000","last_became_peered":"2023-10-08T16:10:29.170448+0000","last_unstale":"2023-10-08T16:10:29.175915+0000","last_undegraded":"2023-10-08T16:10:29.175915+0000","last_fullsized":"2023-10-08T16:10:29.175915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:58:37.639687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187576+0000","last_change":"2023-10-08T16:10:28.162755+0000","last_active":"2023-10-08T16:10:29.187576+0000","last_peered":"2023-10-08T16:10:29.187576+0000","last_clean":"2023-10-08T16:10:29.187576+0000","last_became_active":"2023-10-08T16:10:28.162471+0000","last_became_peered":"2023-10-08T16:10:28.162471+0000","last_unstale":"2023-10-08T16:10:29.187576+0000","last_undegraded":"2023-10-08T16:10:29.187576+0000","last_fullsized":"2023-10-08T16:10:29.187576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:43.527707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168567+0000","last_change":"2023-10-08T16:10:29.164963+0000","last_active":"2023-10-08T16:10:29.168567+0000","last_peered":"2023-10-08T16:10:29.168567+0000","last_clean":"2023-10-08T16:10:29.168567+0000","last_became_active":"2023-10-08T16:10:29.164690+0000","last_became_peered":"2023-10-08T16:10:29.164690+0000","last_unstale":"2023-10-08T16:10:29.168567+0000","last_undegraded":"2023-10-08T16:10:29.168567+0000","last_fullsized":"2023-10-08T16:10:29.168567+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.163831+0000","last_change":"2023-10-08T16:10:28.166722+0000","last_active":"2023-10-08T16:10:29.163831+0000","last_peered":"2023-10-08T16:10:29.163831+0000","last_clean":"2023-10-08T16:10:29.163831+0000","last_became_active":"2023-10-08T16:10:28.166405+0000","last_became_peered":"2023-10-08T16:10:28.166405+0000","last_unstale":"2023-10-08T16:10:29.163831+0000","last_undegraded":"2023-10-08T16:10:29.163831+0000","last_fullsized":"2023-10-08T16:10:29.163831+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172336+0000","last_change":"2023-10-08T16:10:29.166320+0000","last_active":"2023-10-08T16:10:29.172336+0000","last_peered":"2023-10-08T16:10:29.172336+0000","last_clean":"2023-10-08T16:10:29.172336+0000","last_became_active":"2023-10-08T16:10:29.165991+0000","last_became_peered":"2023-10-08T16:10:29.165991+0000","last_unstale":"2023-10-08T16:10:29.172336+0000","last_undegraded":"2023-10-08T16:10:29.172336+0000","last_fullsized":"2023-10-08T16:10:29.172336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:42:08.469559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.150927+0000","last_change":"2023-10-08T16:10:28.162067+0000","last_active":"2023-10-08T16:10:29.150927+0000","last_peered":"2023-10-08T16:10:29.150927+0000","last_clean":"2023-10-08T16:10:29.150927+0000","last_became_active":"2023-10-08T16:10:28.160294+0000","last_became_peered":"2023-10-08T16:10:28.160294+0000","last_unstale":"2023-10-08T16:10:29.150927+0000","last_undegraded":"2023-10-08T16:10:29.150927+0000","last_fullsized":"2023-10-08T16:10:29.150927+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:57.920556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.183775+0000","last_change":"2023-10-08T16:10:29.182866+0000","last_active":"2023-10-08T16:10:29.183775+0000","last_peered":"2023-10-08T16:10:29.183775+0000","last_clean":"2023-10-08T16:10:29.183775+0000","last_became_active":"2023-10-08T16:10:29.182630+0000","last_became_peered":"2023-10-08T16:10:29.182630+0000","last_unstale":"2023-10-08T16:10:29.183775+0000","last_undegraded":"2023-10-08T16:10:29.183775+0000","last_fullsized":"2023-10-08T16:10:29.183775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.163293+0000","last_change":"2023-10-08T16:10:28.169908+0000","last_active":"2023-10-08T16:10:29.163293+0000","last_peered":"2023-10-08T16:10:29.163293+0000","last_clean":"2023-10-08T16:10:29.163293+0000","last_became_active":"2023-10-08T16:10:28.169556+0000","last_became_peered":"2023-10-08T16:10:28.169556+0000","last_unstale":"2023-10-08T16:10:29.163293+0000","last_undegraded":"2023-10-08T16:10:29.163293+0000","last_fullsized":"2023-10-08T16:10:29.163293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:27.880370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187358+0000","last_change":"2023-10-08T16:10:29.174093+0000","last_active":"2023-10-08T16:10:29.187358+0000","last_peered":"2023-10-08T16:10:29.187358+0000","last_clean":"2023-10-08T16:10:29.187358+0000","last_became_active":"2023-10-08T16:10:29.173821+0000","last_became_peered":"2023-10-08T16:10:29.173821+0000","last_unstale":"2023-10-08T16:10:29.187358+0000","last_undegraded":"2023-10-08T16:10:29.187358+0000","last_fullsized":"2023-10-08T16:10:29.187358+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:59.216063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.152149+0000","last_change":"2023-10-08T16:10:28.156574+0000","last_active":"2023-10-08T16:10:29.152149+0000","last_peered":"2023-10-08T16:10:29.152149+0000","last_clean":"2023-10-08T16:10:29.152149+0000","last_became_active":"2023-10-08T16:10:28.156307+0000","last_became_peered":"2023-10-08T16:10:28.156307+0000","last_unstale":"2023-10-08T16:10:29.152149+0000","last_undegraded":"2023-10-08T16:10:29.152149+0000","last_fullsized":"2023-10-08T16:10:29.152149+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190058+0000","last_change":"2023-10-08T16:10:29.177162+0000","last_active":"2023-10-08T16:10:29.190058+0000","last_peered":"2023-10-08T16:10:29.190058+0000","last_clean":"2023-10-08T16:10:29.190058+0000","last_became_active":"2023-10-08T16:10:29.176915+0000","last_became_peered":"2023-10-08T16:10:29.176915+0000","last_unstale":"2023-10-08T16:10:29.190058+0000","last_undegraded":"2023-10-08T16:10:29.190058+0000","last_fullsized":"2023-10-08T16:10:29.190058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:21.850638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.181458+0000","last_change":"2023-10-08T16:10:28.163938+0000","last_active":"2023-10-08T16:10:29.181458+0000","last_peered":"2023-10-08T16:10:29.181458+0000","last_clean":"2023-10-08T16:10:29.181458+0000","last_became_active":"2023-10-08T16:10:28.163610+0000","last_became_peered":"2023-10-08T16:10:28.163610+0000","last_unstale":"2023-10-08T16:10:29.181458+0000","last_undegraded":"2023-10-08T16:10:29.181458+0000","last_fullsized":"2023-10-08T16:10:29.181458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175869+0000","last_change":"2023-10-08T16:10:29.171578+0000","last_active":"2023-10-08T16:10:29.175869+0000","last_peered":"2023-10-08T16:10:29.175869+0000","last_clean":"2023-10-08T16:10:29.175869+0000","last_became_active":"2023-10-08T16:10:29.171098+0000","last_became_peered":"2023-10-08T16:10:29.171098+0000","last_unstale":"2023-10-08T16:10:29.175869+0000","last_undegraded":"2023-10-08T16:10:29.175869+0000","last_fullsized":"2023-10-08T16:10:29.175869+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:52.664259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.195473+0000","last_change":"2023-10-08T16:10:28.175309+0000","last_active":"2023-10-08T16:10:29.195473+0000","last_peered":"2023-10-08T16:10:29.195473+0000","last_clean":"2023-10-08T16:10:29.195473+0000","last_became_active":"2023-10-08T16:10:28.174518+0000","last_became_peered":"2023-10-08T16:10:28.174518+0000","last_unstale":"2023-10-08T16:10:29.195473+0000","last_undegraded":"2023-10-08T16:10:29.195473+0000","last_fullsized":"2023-10-08T16:10:29.195473+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172918+0000","last_change":"2023-10-08T16:10:29.168433+0000","last_active":"2023-10-08T16:10:29.172918+0000","last_peered":"2023-10-08T16:10:29.172918+0000","last_clean":"2023-10-08T16:10:29.172918+0000","last_became_active":"2023-10-08T16:10:29.166774+0000","last_became_peered":"2023-10-08T16:10:29.166774+0000","last_unstale":"2023-10-08T16:10:29.172918+0000","last_undegraded":"2023-10-08T16:10:29.172918+0000","last_fullsized":"2023-10-08T16:10:29.172918+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:18.554051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.179191+0000","last_change":"2023-10-08T16:10:28.166308+0000","last_active":"2023-10-08T16:10:29.179191+0000","last_peered":"2023-10-08T16:10:29.179191+0000","last_clean":"2023-10-08T16:10:29.179191+0000","last_became_active":"2023-10-08T16:10:28.166083+0000","last_became_peered":"2023-10-08T16:10:28.166083+0000","last_unstale":"2023-10-08T16:10:29.179191+0000","last_undegraded":"2023-10-08T16:10:29.179191+0000","last_fullsized":"2023-10-08T16:10:29.179191+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:20.571265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187778+0000","last_change":"2023-10-08T16:10:29.173677+0000","last_active":"2023-10-08T16:10:29.187778+0000","last_peered":"2023-10-08T16:10:29.187778+0000","last_clean":"2023-10-08T16:10:29.187778+0000","last_became_active":"2023-10-08T16:10:29.173409+0000","last_became_peered":"2023-10-08T16:10:29.173409+0000","last_unstale":"2023-10-08T16:10:29.187778+0000","last_undegraded":"2023-10-08T16:10:29.187778+0000","last_fullsized":"2023-10-08T16:10:29.187778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.107023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.152082+0000","last_change":"2023-10-08T16:10:28.157812+0000","last_active":"2023-10-08T16:10:29.152082+0000","last_peered":"2023-10-08T16:10:29.152082+0000","last_clean":"2023-10-08T16:10:29.152082+0000","last_became_active":"2023-10-08T16:10:28.157471+0000","last_became_peered":"2023-10-08T16:10:28.157471+0000","last_unstale":"2023-10-08T16:10:29.152082+0000","last_undegraded":"2023-10-08T16:10:29.152082+0000","last_fullsized":"2023-10-08T16:10:29.152082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:16:11.439838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.174949+0000","last_change":"2023-10-08T16:10:29.167119+0000","last_active":"2023-10-08T16:10:29.174949+0000","last_peered":"2023-10-08T16:10:29.174949+0000","last_clean":"2023-10-08T16:10:29.174949+0000","last_became_active":"2023-10-08T16:10:29.166547+0000","last_became_peered":"2023-10-08T16:10:29.166547+0000","last_unstale":"2023-10-08T16:10:29.174949+0000","last_undegraded":"2023-10-08T16:10:29.174949+0000","last_fullsized":"2023-10-08T16:10:29.174949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:55:42.743569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.163934+0000","last_change":"2023-10-08T16:10:28.169436+0000","last_active":"2023-10-08T16:10:29.163934+0000","last_peered":"2023-10-08T16:10:29.163934+0000","last_clean":"2023-10-08T16:10:29.163934+0000","last_became_active":"2023-10-08T16:10:28.169084+0000","last_became_peered":"2023-10-08T16:10:28.169084+0000","last_unstale":"2023-10-08T16:10:29.163934+0000","last_undegraded":"2023-10-08T16:10:29.163934+0000","last_fullsized":"2023-10-08T16:10:29.163934+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:12.605473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.173294+0000","last_change":"2023-10-08T16:10:29.169314+0000","last_active":"2023-10-08T16:10:29.173294+0000","last_peered":"2023-10-08T16:10:29.173294+0000","last_clean":"2023-10-08T16:10:29.173294+0000","last_became_active":"2023-10-08T16:10:29.169050+0000","last_became_peered":"2023-10-08T16:10:29.169050+0000","last_unstale":"2023-10-08T16:10:29.173294+0000","last_undegraded":"2023-10-08T16:10:29.173294+0000","last_fullsized":"2023-10-08T16:10:29.173294+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.190834+0000","last_change":"2023-10-08T16:10:28.175109+0000","last_active":"2023-10-08T16:10:29.190834+0000","last_peered":"2023-10-08T16:10:29.190834+0000","last_clean":"2023-10-08T16:10:29.190834+0000","last_became_active":"2023-10-08T16:10:28.174868+0000","last_became_peered":"2023-10-08T16:10:28.174868+0000","last_unstale":"2023-10-08T16:10:29.190834+0000","last_undegraded":"2023-10-08T16:10:29.190834+0000","last_fullsized":"2023-10-08T16:10:29.190834+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.170795+0000","last_change":"2023-10-08T16:10:29.165921+0000","last_active":"2023-10-08T16:10:29.170795+0000","last_peered":"2023-10-08T16:10:29.170795+0000","last_clean":"2023-10-08T16:10:29.170795+0000","last_became_active":"2023-10-08T16:10:29.165504+0000","last_became_peered":"2023-10-08T16:10:29.165504+0000","last_unstale":"2023-10-08T16:10:29.170795+0000","last_undegraded":"2023-10-08T16:10:29.170795+0000","last_fullsized":"2023-10-08T16:10:29.170795+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.180812+0000","last_change":"2023-10-08T16:10:28.170494+0000","last_active":"2023-10-08T16:10:29.180812+0000","last_peered":"2023-10-08T16:10:29.180812+0000","last_clean":"2023-10-08T16:10:29.180812+0000","last_became_active":"2023-10-08T16:10:28.170192+0000","last_became_peered":"2023-10-08T16:10:28.170192+0000","last_unstale":"2023-10-08T16:10:29.180812+0000","last_undegraded":"2023-10-08T16:10:29.180812+0000","last_fullsized":"2023-10-08T16:10:29.180812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175766+0000","last_change":"2023-10-08T16:10:29.168208+0000","last_active":"2023-10-08T16:10:29.175766+0000","last_peered":"2023-10-08T16:10:29.175766+0000","last_clean":"2023-10-08T16:10:29.175766+0000","last_became_active":"2023-10-08T16:10:29.167967+0000","last_became_peered":"2023-10-08T16:10:29.167967+0000","last_unstale":"2023-10-08T16:10:29.175766+0000","last_undegraded":"2023-10-08T16:10:29.175766+0000","last_fullsized":"2023-10-08T16:10:29.175766+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:54:21.850638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.178099+0000","last_change":"2023-10-08T16:10:28.165759+0000","last_active":"2023-10-08T16:10:29.178099+0000","last_peered":"2023-10-08T16:10:29.178099+0000","last_clean":"2023-10-08T16:10:29.178099+0000","last_became_active":"2023-10-08T16:10:28.165359+0000","last_became_peered":"2023-10-08T16:10:28.165359+0000","last_unstale":"2023-10-08T16:10:29.178099+0000","last_undegraded":"2023-10-08T16:10:29.178099+0000","last_fullsized":"2023-10-08T16:10:29.178099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:35:14.409925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172526+0000","last_change":"2023-10-08T16:10:29.168813+0000","last_active":"2023-10-08T16:10:29.172526+0000","last_peered":"2023-10-08T16:10:29.172526+0000","last_clean":"2023-10-08T16:10:29.172526+0000","last_became_active":"2023-10-08T16:10:29.168539+0000","last_became_peered":"2023-10-08T16:10:29.168539+0000","last_unstale":"2023-10-08T16:10:29.172526+0000","last_undegraded":"2023-10-08T16:10:29.172526+0000","last_fullsized":"2023-10-08T16:10:29.172526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:27.588687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.178858+0000","last_change":"2023-10-08T16:10:28.174109+0000","last_active":"2023-10-08T16:10:29.178858+0000","last_peered":"2023-10-08T16:10:29.178858+0000","last_clean":"2023-10-08T16:10:29.178858+0000","last_became_active":"2023-10-08T16:10:28.173827+0000","last_became_peered":"2023-10-08T16:10:28.173827+0000","last_unstale":"2023-10-08T16:10:29.178858+0000","last_undegraded":"2023-10-08T16:10:29.178858+0000","last_fullsized":"2023-10-08T16:10:29.178858+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:33.288290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168204+0000","last_change":"2023-10-08T16:10:29.160497+0000","last_active":"2023-10-08T16:10:29.168204+0000","last_peered":"2023-10-08T16:10:29.168204+0000","last_clean":"2023-10-08T16:10:29.168204+0000","last_became_active":"2023-10-08T16:10:29.160198+0000","last_became_peered":"2023-10-08T16:10:29.160198+0000","last_unstale":"2023-10-08T16:10:29.168204+0000","last_undegraded":"2023-10-08T16:10:29.168204+0000","last_fullsized":"2023-10-08T16:10:29.168204+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:31.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.153654+0000","last_change":"2023-10-08T16:10:28.170218+0000","last_active":"2023-10-08T16:10:29.153654+0000","last_peered":"2023-10-08T16:10:29.153654+0000","last_clean":"2023-10-08T16:10:29.153654+0000","last_became_active":"2023-10-08T16:10:28.169946+0000","last_became_peered":"2023-10-08T16:10:28.169946+0000","last_unstale":"2023-10-08T16:10:29.153654+0000","last_undegraded":"2023-10-08T16:10:29.153654+0000","last_fullsized":"2023-10-08T16:10:29.153654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:46.251322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172030+0000","last_change":"2023-10-08T16:10:29.166399+0000","last_active":"2023-10-08T16:10:29.172030+0000","last_peered":"2023-10-08T16:10:29.172030+0000","last_clean":"2023-10-08T16:10:29.172030+0000","last_became_active":"2023-10-08T16:10:29.166095+0000","last_became_peered":"2023-10-08T16:10:29.166095+0000","last_unstale":"2023-10-08T16:10:29.172030+0000","last_undegraded":"2023-10-08T16:10:29.172030+0000","last_fullsized":"2023-10-08T16:10:29.172030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:53.795856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.185757+0000","last_change":"2023-10-08T16:10:28.159695+0000","last_active":"2023-10-08T16:10:29.185757+0000","last_peered":"2023-10-08T16:10:29.185757+0000","last_clean":"2023-10-08T16:10:29.185757+0000","last_became_active":"2023-10-08T16:10:28.159455+0000","last_became_peered":"2023-10-08T16:10:28.159455+0000","last_unstale":"2023-10-08T16:10:29.185757+0000","last_undegraded":"2023-10-08T16:10:29.185757+0000","last_fullsized":"2023-10-08T16:10:29.185757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.172660+0000","last_change":"2023-10-08T16:10:29.165933+0000","last_active":"2023-10-08T16:10:29.172660+0000","last_peered":"2023-10-08T16:10:29.172660+0000","last_clean":"2023-10-08T16:10:29.172660+0000","last_became_active":"2023-10-08T16:10:29.165615+0000","last_became_peered":"2023-10-08T16:10:29.165615+0000","last_unstale":"2023-10-08T16:10:29.172660+0000","last_undegraded":"2023-10-08T16:10:29.172660+0000","last_fullsized":"2023-10-08T16:10:29.172660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:05.503603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.157359+0000","last_change":"2023-10-08T16:10:28.168599+0000","last_active":"2023-10-08T16:10:29.157359+0000","last_peered":"2023-10-08T16:10:29.157359+0000","last_clean":"2023-10-08T16:10:29.157359+0000","last_became_active":"2023-10-08T16:10:28.168106+0000","last_became_peered":"2023-10-08T16:10:28.168106+0000","last_unstale":"2023-10-08T16:10:29.157359+0000","last_undegraded":"2023-10-08T16:10:29.157359+0000","last_fullsized":"2023-10-08T16:10:29.157359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:26.677198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175015+0000","last_change":"2023-10-08T16:10:29.172515+0000","last_active":"2023-10-08T16:10:29.175015+0000","last_peered":"2023-10-08T16:10:29.175015+0000","last_clean":"2023-10-08T16:10:29.175015+0000","last_became_active":"2023-10-08T16:10:29.171733+0000","last_became_peered":"2023-10-08T16:10:29.171733+0000","last_unstale":"2023-10-08T16:10:29.175015+0000","last_undegraded":"2023-10-08T16:10:29.175015+0000","last_fullsized":"2023-10-08T16:10:29.175015+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:54.714837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.155244+0000","last_change":"2023-10-08T16:10:28.172381+0000","last_active":"2023-10-08T16:10:29.155244+0000","last_peered":"2023-10-08T16:10:29.155244+0000","last_clean":"2023-10-08T16:10:29.155244+0000","last_became_active":"2023-10-08T16:10:28.172119+0000","last_became_peered":"2023-10-08T16:10:28.172119+0000","last_unstale":"2023-10-08T16:10:29.155244+0000","last_undegraded":"2023-10-08T16:10:29.155244+0000","last_fullsized":"2023-10-08T16:10:29.155244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:39:29.599550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168988+0000","last_change":"2023-10-08T16:10:29.164545+0000","last_active":"2023-10-08T16:10:29.168988+0000","last_peered":"2023-10-08T16:10:29.168988+0000","last_clean":"2023-10-08T16:10:29.168988+0000","last_became_active":"2023-10-08T16:10:29.164211+0000","last_became_peered":"2023-10-08T16:10:29.164211+0000","last_unstale":"2023-10-08T16:10:29.168988+0000","last_undegraded":"2023-10-08T16:10:29.168988+0000","last_fullsized":"2023-10-08T16:10:29.168988+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:52.664259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.157853+0000","last_change":"2023-10-08T16:10:28.169590+0000","last_active":"2023-10-08T16:10:29.157853+0000","last_peered":"2023-10-08T16:10:29.157853+0000","last_clean":"2023-10-08T16:10:29.157853+0000","last_became_active":"2023-10-08T16:10:28.169122+0000","last_became_peered":"2023-10-08T16:10:28.169122+0000","last_unstale":"2023-10-08T16:10:29.157853+0000","last_undegraded":"2023-10-08T16:10:29.157853+0000","last_fullsized":"2023-10-08T16:10:29.157853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:52.789912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.187453+0000","last_change":"2023-10-08T16:10:29.178516+0000","last_active":"2023-10-08T16:10:29.187453+0000","last_peered":"2023-10-08T16:10:29.187453+0000","last_clean":"2023-10-08T16:10:29.187453+0000","last_became_active":"2023-10-08T16:10:29.178067+0000","last_became_peered":"2023-10-08T16:10:29.178067+0000","last_unstale":"2023-10-08T16:10:29.187453+0000","last_undegraded":"2023-10-08T16:10:29.187453+0000","last_fullsized":"2023-10-08T16:10:29.187453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:22.358614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.176658+0000","last_change":"2023-10-08T16:10:28.160833+0000","last_active":"2023-10-08T16:10:29.176658+0000","last_peered":"2023-10-08T16:10:29.176658+0000","last_clean":"2023-10-08T16:10:29.176658+0000","last_became_active":"2023-10-08T16:10:28.160500+0000","last_became_peered":"2023-10-08T16:10:28.160500+0000","last_unstale":"2023-10-08T16:10:29.176658+0000","last_undegraded":"2023-10-08T16:10:29.176658+0000","last_fullsized":"2023-10-08T16:10:29.176658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:10.380786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.175864+0000","last_change":"2023-10-08T16:10:29.171403+0000","last_active":"2023-10-08T16:10:29.175864+0000","last_peered":"2023-10-08T16:10:29.175864+0000","last_clean":"2023-10-08T16:10:29.175864+0000","last_became_active":"2023-10-08T16:10:29.171110+0000","last_became_peered":"2023-10-08T16:10:29.171110+0000","last_unstale":"2023-10-08T16:10:29.175864+0000","last_undegraded":"2023-10-08T16:10:29.175864+0000","last_fullsized":"2023-10-08T16:10:29.175864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:02:51.816061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-08T16:10:30.799725+0000","last_change":"2023-10-08T16:10:28.159791+0000","last_active":"2023-10-08T16:10:30.799725+0000","last_peered":"2023-10-08T16:10:30.799725+0000","last_clean":"2023-10-08T16:10:30.799725+0000","last_became_active":"2023-10-08T16:10:28.159411+0000","last_became_peered":"2023-10-08T16:10:28.159411+0000","last_unstale":"2023-10-08T16:10:30.799725+0000","last_undegraded":"2023-10-08T16:10:30.799725+0000","last_fullsized":"2023-10-08T16:10:30.799725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.165774+0000","last_change":"2023-10-08T16:10:29.161656+0000","last_active":"2023-10-08T16:10:29.165774+0000","last_peered":"2023-10-08T16:10:29.165774+0000","last_clean":"2023-10-08T16:10:29.165774+0000","last_became_active":"2023-10-08T16:10:29.161362+0000","last_became_peered":"2023-10-08T16:10:29.161362+0000","last_unstale":"2023-10-08T16:10:29.165774+0000","last_undegraded":"2023-10-08T16:10:29.165774+0000","last_fullsized":"2023-10-08T16:10:29.165774+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:21.466570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.152955+0000","last_change":"2023-10-08T16:10:28.173314+0000","last_active":"2023-10-08T16:10:29.152955+0000","last_peered":"2023-10-08T16:10:29.152955+0000","last_clean":"2023-10-08T16:10:29.152955+0000","last_became_active":"2023-10-08T16:10:28.172896+0000","last_became_peered":"2023-10-08T16:10:28.172896+0000","last_unstale":"2023-10-08T16:10:29.152955+0000","last_undegraded":"2023-10-08T16:10:29.152955+0000","last_fullsized":"2023-10-08T16:10:29.152955+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:59:31.411390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.177719+0000","last_change":"2023-10-08T16:10:29.174298+0000","last_active":"2023-10-08T16:10:29.177719+0000","last_peered":"2023-10-08T16:10:29.177719+0000","last_clean":"2023-10-08T16:10:29.177719+0000","last_became_active":"2023-10-08T16:10:29.173923+0000","last_became_peered":"2023-10-08T16:10:29.173923+0000","last_unstale":"2023-10-08T16:10:29.177719+0000","last_undegraded":"2023-10-08T16:10:29.177719+0000","last_fullsized":"2023-10-08T16:10:29.177719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.151853+0000","last_change":"2023-10-08T16:10:28.155737+0000","last_active":"2023-10-08T16:10:29.151853+0000","last_peered":"2023-10-08T16:10:29.151853+0000","last_clean":"2023-10-08T16:10:29.151853+0000","last_became_active":"2023-10-08T16:10:28.155453+0000","last_became_peered":"2023-10-08T16:10:28.155453+0000","last_unstale":"2023-10-08T16:10:29.151853+0000","last_undegraded":"2023-10-08T16:10:29.151853+0000","last_fullsized":"2023-10-08T16:10:29.151853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.174122+0000","last_change":"2023-10-08T16:10:29.170386+0000","last_active":"2023-10-08T16:10:29.174122+0000","last_peered":"2023-10-08T16:10:29.174122+0000","last_clean":"2023-10-08T16:10:29.174122+0000","last_became_active":"2023-10-08T16:10:29.170075+0000","last_became_peered":"2023-10-08T16:10:29.170075+0000","last_unstale":"2023-10-08T16:10:29.174122+0000","last_undegraded":"2023-10-08T16:10:29.174122+0000","last_fullsized":"2023-10-08T16:10:29.174122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:44:32.035046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.152194+0000","last_change":"2023-10-08T16:10:28.160526+0000","last_active":"2023-10-08T16:10:29.152194+0000","last_peered":"2023-10-08T16:10:29.152194+0000","last_clean":"2023-10-08T16:10:29.152194+0000","last_became_active":"2023-10-08T16:10:28.160243+0000","last_became_peered":"2023-10-08T16:10:28.160243+0000","last_unstale":"2023-10-08T16:10:29.152194+0000","last_undegraded":"2023-10-08T16:10:29.152194+0000","last_fullsized":"2023-10-08T16:10:29.152194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:30.214475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.189937+0000","last_change":"2023-10-08T16:10:29.176627+0000","last_active":"2023-10-08T16:10:29.189937+0000","last_peered":"2023-10-08T16:10:29.189937+0000","last_clean":"2023-10-08T16:10:29.189937+0000","last_became_active":"2023-10-08T16:10:29.174184+0000","last_became_peered":"2023-10-08T16:10:29.174184+0000","last_unstale":"2023-10-08T16:10:29.189937+0000","last_undegraded":"2023-10-08T16:10:29.189937+0000","last_fullsized":"2023-10-08T16:10:29.189937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:11:04.215489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.155350+0000","last_change":"2023-10-08T16:10:28.171416+0000","last_active":"2023-10-08T16:10:29.155350+0000","last_peered":"2023-10-08T16:10:29.155350+0000","last_clean":"2023-10-08T16:10:29.155350+0000","last_became_active":"2023-10-08T16:10:28.171217+0000","last_became_peered":"2023-10-08T16:10:28.171217+0000","last_unstale":"2023-10-08T16:10:29.155350+0000","last_undegraded":"2023-10-08T16:10:29.155350+0000","last_fullsized":"2023-10-08T16:10:29.155350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:26.909856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.179724+0000","last_change":"2023-10-08T16:10:29.175715+0000","last_active":"2023-10-08T16:10:29.179724+0000","last_peered":"2023-10-08T16:10:29.179724+0000","last_clean":"2023-10-08T16:10:29.179724+0000","last_became_active":"2023-10-08T16:10:29.175465+0000","last_became_peered":"2023-10-08T16:10:29.175465+0000","last_unstale":"2023-10-08T16:10:29.179724+0000","last_undegraded":"2023-10-08T16:10:29.179724+0000","last_fullsized":"2023-10-08T16:10:29.179724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:28.886315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168638+0000","last_change":"2023-10-08T16:10:28.169980+0000","last_active":"2023-10-08T16:10:29.168638+0000","last_peered":"2023-10-08T16:10:29.168638+0000","last_clean":"2023-10-08T16:10:29.168638+0000","last_became_active":"2023-10-08T16:10:28.169573+0000","last_became_peered":"2023-10-08T16:10:28.169573+0000","last_unstale":"2023-10-08T16:10:29.168638+0000","last_undegraded":"2023-10-08T16:10:29.168638+0000","last_fullsized":"2023-10-08T16:10:29.168638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:27:46.425856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.168985+0000","last_change":"2023-10-08T16:10:29.164259+0000","last_active":"2023-10-08T16:10:29.168985+0000","last_peered":"2023-10-08T16:10:29.168985+0000","last_clean":"2023-10-08T16:10:29.168985+0000","last_became_active":"2023-10-08T16:10:29.163955+0000","last_became_peered":"2023-10-08T16:10:29.163955+0000","last_unstale":"2023-10-08T16:10:29.168985+0000","last_undegraded":"2023-10-08T16:10:29.168985+0000","last_fullsized":"2023-10-08T16:10:29.168985+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:28.138158+0000","last_clean_scrub_stamp":"2023-10-08T16:10:28.138158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:24.418745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.157682+0000","last_change":"2023-10-08T16:10:28.167624+0000","last_active":"2023-10-08T16:10:29.157682+0000","last_peered":"2023-10-08T16:10:29.157682+0000","last_clean":"2023-10-08T16:10:29.157682+0000","last_became_active":"2023-10-08T16:10:28.167279+0000","last_became_peered":"2023-10-08T16:10:28.167279+0000","last_unstale":"2023-10-08T16:10:29.157682+0000","last_undegraded":"2023-10-08T16:10:29.157682+0000","last_fullsized":"2023-10-08T16:10:29.157682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:10:27.132214+0000","last_clean_scrub_stamp":"2023-10-08T16:10:27.132214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:21.352669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-08T16:10:29.152419+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:10:29.152419+0000","last_peered":"2023-10-08T16:10:29.152419+0000","last_clean":"2023-10-08T16:10:29.152419+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:10:29.152419+0000","last_undegraded":"2023-10-08T16:10:29.152419+0000","last_fullsized":"2023-10-08T16:10:29.152419+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302356,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069484,"statfs":{"total":96636764160,"available":96327151616,"internally_reserved":0,"allocated":995328,"data_stored":746592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.78900000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.871}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.81799999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.90600000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.093},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":1.075}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301780,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070060,"statfs":{"total":96636764160,"available":96327741440,"internally_reserved":0,"allocated":405504,"data_stored":156722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.51600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77300000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.68200000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"last":0.625}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.45300000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.745},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":157692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.38100000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.472,"5min":1.472,"15min":1.472},"last":0.41399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.755}]},{"osd":5,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:10:10 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":746502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.524,"5min":1.524,"15min":1.524},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.51000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.5569999999999999,"5min":1.5569999999999999,"15min":1.5569999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.52000000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.325,"5min":1.325,"15min":1.325},"last":0.73899999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.63},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.72599999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":0.752}]},{"osd":7,"last update":"Sun Oct 8 16:10:09 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.76300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":156204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.501}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.39300000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.44},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.47099999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.54200000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.544,"5min":1.544,"15min":1.544},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.755}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":157692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53200000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.66000000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:10:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301780,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070060,"statfs":{"total":96636764160,"available":96327741440,"internally_reserved":0,"allocated":405504,"data_stored":156238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.752},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.61799999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.79600000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.01},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":1.036}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.93899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":1.0660000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.91700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301780,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94070060,"statfs":{"total":96636764160,"available":96327741440,"internally_reserved":0,"allocated":405504,"data_stored":156778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.51200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.98999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3360000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.82199999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.96299999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:10:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.014},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":1.0720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:10:38.898 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:10:38.898 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:10:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.126+0000 7f63e7fff700 1 Processor -- start 2023-10-08T16:10:39.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.126+0000 7f63e7fff700 1 -- start start 2023-10-08T16:10:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63e8142c00 0x7f63e806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f63e806bd20 0x7f63e80c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63e80ca480 con 0x7f63e8142fd0 2023-10-08T16:10:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e815e240 con 0x7f63e8142c00 2023-10-08T16:10:39.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e806b350 con 0x7f63e806bd20 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63e8142c00 0x7f63e806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f63e8142c00 0x7f63e806b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54704/0 (socket says 172.21.15.12:54704) 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 -- 172.21.15.12:0/3215409875 learned_addr learned my addr 172.21.15.12:0/3215409875 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e67fc700 1 --2- 172.21.15.12:0/3215409875 >> v2:172.21.15.29:3300/0 conn(0x7f63e806bd20 0x7f63e80c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 -- 172.21.15.12:0/3215409875 >> v2:172.21.15.29:3300/0 conn(0x7f63e806bd20 msgr2=0x7f63e80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 --2- 172.21.15.12:0/3215409875 >> v2:172.21.15.29:3300/0 conn(0x7f63e806bd20 0x7f63e80c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 -- 172.21.15.12:0/3215409875 >> v1:172.21.15.29:6789/0 conn(0x7f63e8142fd0 legacy=0x7f63e806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.128+0000 7f63e6ffd700 1 -- 172.21.15.12:0/3215409875 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e815df60 con 0x7f63e8142c00 2023-10-08T16:10:39.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e6ffd700 1 --2- 172.21.15.12:0/3215409875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142c00 0x7f63e806b7e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d750 tx=0x7f63d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7255f2f1882b8bd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e5ffb700 1 -- 172.21.15.12:0/3215409875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800b820 con 0x7f63e8142c00 2023-10-08T16:10:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e5ffb700 1 -- 172.21.15.12:0/3215409875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d800b980 con 0x7f63e8142c00 2023-10-08T16:10:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e5ffb700 1 -- 172.21.15.12:0/3215409875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d800bd20 con 0x7f63e8142c00 2023-10-08T16:10:39.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e7fff700 1 -- 172.21.15.12:0/3215409875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142c00 msgr2=0x7f63e806b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.129+0000 7f63e7fff700 1 --2- 172.21.15.12:0/3215409875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142c00 0x7f63e806b7e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d750 tx=0x7f63d8009250 comp rx=0 tx=0).stop 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 -- 172.21.15.12:0/3215409875 shutdown_connections 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 --2- 172.21.15.12:0/3215409875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142c00 0x7f63e806b7e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 --2- 172.21.15.12:0/3215409875 >> v2:172.21.15.29:3300/0 conn(0x7f63e806bd20 0x7f63e80c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 -- 172.21.15.12:0/3215409875 >> 172.21.15.12:0/3215409875 conn(0x7f63e80675a0 msgr2=0x7f63e80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 -- 172.21.15.12:0/3215409875 shutdown_connections 2023-10-08T16:10:39.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.130+0000 7f63e7fff700 1 -- 172.21.15.12:0/3215409875 wait complete. 2023-10-08T16:10:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.131+0000 7f63e7fff700 1 Processor -- start 2023-10-08T16:10:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.131+0000 7f63e7fff700 1 -- start start 2023-10-08T16:10:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f63e806bd20 0x7f63e80b1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63e8142c00 0x7f63e813d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e813ddf0 con 0x7f63e8142fd0 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c51f0 con 0x7f63e8142c00 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80c5470 con 0x7f63e806bd20 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54708/0 (socket says 172.21.15.12:54708) 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e6ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f63e806bd20 0x7f63e80b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e77fe700 1 -- 172.21.15.12:0/2313389381 learned_addr learned my addr 172.21.15.12:0/2313389381 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.132+0000 7f63e67fc700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63e8142c00 0x7f63e813d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 -- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f63e806bd20 msgr2=0x7f63e80b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f63e806bd20 0x7f63e80b1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 -- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63e8142c00 msgr2=0x7f63e813d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63e8142c00 0x7f63e813d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 -- 172.21.15.12:0/2313389381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d80094f0 con 0x7f63e8142fd0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e77fe700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f63e000bc30 tx=0x7f63e0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000c840 con 0x7f63e8142fd0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000c9e0 con 0x7f63e8142fd0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000cda0 con 0x7f63e8142fd0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.133+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e80c5750 con 0x7f63e8142fd0 2023-10-08T16:10:39.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.134+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e80c5d10 con 0x7f63e8142fd0 2023-10-08T16:10:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.134+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e804c3c0 con 0x7f63e8142fd0 2023-10-08T16:10:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.135+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63e0014620 con 0x7f63e8142fd0 2023-10-08T16:10:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.136+0000 7f63ceffd700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.137+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63e0084500 con 0x7f63e8142fd0 2023-10-08T16:10:39.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.137+0000 7f63e6ffd700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.137+0000 7f63e6ffd700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 0x7f63d40693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d750 tx=0x7f63d8016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.140+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e00516d0 con 0x7f63e8142fd0 2023-10-08T16:10:39.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.421+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f63e806ad00 con 0x7f63e8142fd0 2023-10-08T16:10:39.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.427+0000 7f63ceffd700 1 -- 172.21.15.12:0/2313389381 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7f63e0054cf0 con 0x7f63e8142fd0 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 msgr2=0x7f63d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 0x7f63d40693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63e806d750 tx=0x7f63d8016000 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 msgr2=0x7f63e80c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f63e000bc30 tx=0x7f63e0009820 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 shutdown_connections 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f63d4066f30 0x7f63d40693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f63e8142fd0 0x7f63e80c4cb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f63e806bd20 0x7f63e80b1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 --2- 172.21.15.12:0/2313389381 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f63e8142c00 0x7f63e813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.429+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 >> 172.21.15.12:0/2313389381 conn(0x7f63e80675a0 msgr2=0x7f63e80c87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.430+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 shutdown_connections 2023-10-08T16:10:39.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.430+0000 7f63e7fff700 1 -- 172.21.15.12:0/2313389381 wait complete. 2023-10-08T16:10:39.432 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:10:39.448 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:10:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.634+0000 7faac099d700 1 Processor -- start 2023-10-08T16:10:39.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.634+0000 7faac099d700 1 -- start start 2023-10-08T16:10:39.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.635+0000 7faac099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 0x7faabc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.635+0000 7faac099d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faabc13fef0 0x7faabc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faac099d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc15ae70 con 0x7faabc06aaa0 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faac099d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc06af60 con 0x7faabc13fef0 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faac099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc06b240 con 0x7faabc13fb20 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faabc13fef0 0x7faabc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7faabc13fef0 0x7faabc0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54710/0 (socket says 172.21.15.12:54710) 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 -- 172.21.15.12:0/2136936631 learned_addr learned my addr 172.21.15.12:0/2136936631 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:39.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faabc06aaa0 0x7faabc0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41682/0 (socket says 172.21.15.12:41682) 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabb7fe700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 0x7faabc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 -- 172.21.15.12:0/2136936631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 msgr2=0x7faabc15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 0x7faabc15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 -- 172.21.15.12:0/2136936631 >> v1:172.21.15.12:6789/0 conn(0x7faabc06aaa0 legacy=0x7faabc0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faaba7fc700 1 -- 172.21.15.12:0/2136936631 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 489946009 0 0) 0x7faab4001490 con 0x7faabc06aaa0 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabaffd700 1 -- 172.21.15.12:0/2136936631 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc06b520 con 0x7faabc13fef0 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.636+0000 7faabb7fe700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 0x7faabc15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faabaffd700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fef0 0x7faabc0c7990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faab0009990 tx=0x7faab0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6cbf19db3c4ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faaba7fc700 1 -- 172.21.15.12:0/2136936631 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0005c10 con 0x7faabc13fef0 2023-10-08T16:10:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faaba7fc700 1 -- 172.21.15.12:0/2136936631 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0005d70 con 0x7faabc13fef0 2023-10-08T16:10:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faaba7fc700 1 -- 172.21.15.12:0/2136936631 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab000b880 con 0x7faabc13fef0 2023-10-08T16:10:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 -- 172.21.15.12:0/2136936631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fef0 msgr2=0x7faabc0c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fef0 0x7faabc0c7990 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faab0009990 tx=0x7faab0009220 comp rx=0 tx=0).stop 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 -- 172.21.15.12:0/2136936631 shutdown_connections 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fb20 0x7faabc15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 --2- 172.21.15.12:0/2136936631 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fef0 0x7faabc0c7990 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.637+0000 7faac099d700 1 -- 172.21.15.12:0/2136936631 >> 172.21.15.12:0/2136936631 conn(0x7faabc06d170 msgr2=0x7faabc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.638+0000 7faac099d700 1 -- 172.21.15.12:0/2136936631 shutdown_connections 2023-10-08T16:10:39.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.638+0000 7faac099d700 1 -- 172.21.15.12:0/2136936631 wait complete. 2023-10-08T16:10:39.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.639+0000 7faac099d700 1 Processor -- start 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.639+0000 7faac099d700 1 -- start start 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faabc06aaa0 0x7faabc0ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fef0 0x7faabc13dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0c7970 con 0x7faabc13fb20 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0c7f30 con 0x7faabc06aaa0 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faac099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc159b50 con 0x7faabc13fef0 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faabaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faabaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54724/0 (socket says 172.21.15.12:54724) 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.640+0000 7faabaffd700 1 -- 172.21.15.12:0/2717566021 learned_addr learned my addr 172.21.15.12:0/2717566021 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:39.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabbfff700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fef0 0x7faabc13dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabb7fe700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faabc06aaa0 0x7faabc0ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 -- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fef0 msgr2=0x7faabc13dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fef0 0x7faabc13dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 -- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faabc06aaa0 msgr2=0x7faabc0ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faabc06aaa0 0x7faabc0ac710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 -- 172.21.15.12:0/2717566021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab0009480 con 0x7faabc13fb20 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faabaffd700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faab000b3c0 tx=0x7faab0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab001e070 con 0x7faabc13fb20 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab0010ba0 con 0x7faabc13fb20 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab0019430 con 0x7faabc13fb20 2023-10-08T16:10:39.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.641+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc159e30 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.642+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc159860 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.642+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0c80c0 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.643+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faab0019820 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.644+0000 7faaa37fe700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 0x7faaa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.644+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faab0014030 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.644+0000 7faabb7fe700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 0x7faaa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.645+0000 7faabb7fe700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 0x7faaa80693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaac00ac00 tx=0x7faaac006f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.648+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faab0052ce0 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.892+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faabc159fc0 con 0x7faabc13fb20 2023-10-08T16:10:39.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.893+0000 7faaa37fe700 1 -- 172.21.15.12:0/2717566021 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7faab0027070 con 0x7faabc13fb20 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:10:39.904 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 msgr2=0x7faaa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 0x7faaa80693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faaac00ac00 tx=0x7faaac006f90 comp rx=0 tx=0).stop 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 msgr2=0x7faabc156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faab000b3c0 tx=0x7faab0018000 comp rx=0 tx=0).stop 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 shutdown_connections 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faabc13fef0 0x7faabc13dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faabc06aaa0 0x7faabc0ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7faaa8066f30 0x7faaa80693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 --2- 172.21.15.12:0/2717566021 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faabc13fb20 0x7faabc156950 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.895+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 >> 172.21.15.12:0/2717566021 conn(0x7faabc06d170 msgr2=0x7faabc0cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.896+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 shutdown_connections 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:39.896+0000 7faac099d700 1 -- 172.21.15.12:0/2717566021 wait complete. 2023-10-08T16:10:39.906 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:10:40.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:10:28.644116+0000', 'modified': '2023-10-08T16:10:32.169146+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4962}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4962': {'gid': 4962, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.12:6836/2487834528', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 2487834528}, {'type': 'v1', 'addr': '172.21.15.12:6836', 'nonce': 2487834528}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:10:40.317 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:10:40.318 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:10:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.507+0000 7fbbbab9d700 1 Processor -- start 2023-10-08T16:10:40.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.507+0000 7fbbbab9d700 1 -- start start 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbbab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbbab9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb415ae70 con 0x7fbbb406aaa0 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbbab9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb406af60 con 0x7fbbb413fb20 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbbab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb406b240 con 0x7fbbb413fef0 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbba39c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbbb406aaa0 0x7fbbb40c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41684/0 (socket says 172.21.15.12:41684) 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbba39c700 1 -- 172.21.15.12:0/972399754 learned_addr learned my addr 172.21.15.12:0/972399754 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:40.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbb939a700 1 --2- 172.21.15.12:0/972399754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.509+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921409499 0 0) 0x7fbbac001490 con 0x7fbbb406aaa0 2023-10-08T16:10:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba0003570 con 0x7fbbb406aaa0 2023-10-08T16:10:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 168871168 0 0) 0x7fbbb406af60 con 0x7fbbb413fb20 2023-10-08T16:10:40.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbac001490 con 0x7fbbb413fb20 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb939a700 1 -- 172.21.15.12:0/972399754 >> v1:172.21.15.29:6789/0 conn(0x7fbbb413fb20 legacy=0x7fbbb40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb939a700 1 -- 172.21.15.12:0/972399754 >> v1:172.21.15.12:6789/0 conn(0x7fbbb406aaa0 legacy=0x7fbbb40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb939a700 1 -- 172.21.15.12:0/972399754 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb406b520 con 0x7fbbb413fef0 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb939a700 1 --2- 172.21.15.12:0/972399754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb415a930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009900 tx=0x7fbba4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=863026a8edb5fd0a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4005c10 con 0x7fbbb413fef0 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4005d70 con 0x7fbbb413fef0 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.510+0000 7fbbb8b99700 1 -- 172.21.15.12:0/972399754 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4006260 con 0x7fbbb413fef0 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 -- 172.21.15.12:0/972399754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 msgr2=0x7fbbb415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/972399754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb415a930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009900 tx=0x7fbba4009120 comp rx=0 tx=0).stop 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 -- 172.21.15.12:0/972399754 shutdown_connections 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/972399754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb415a930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 -- 172.21.15.12:0/972399754 >> 172.21.15.12:0/972399754 conn(0x7fbbb406d170 msgr2=0x7fbbb40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 -- 172.21.15.12:0/972399754 shutdown_connections 2023-10-08T16:10:40.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.511+0000 7fbbbab9d700 1 -- 172.21.15.12:0/972399754 wait complete. 2023-10-08T16:10:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.513+0000 7fbbbab9d700 1 Processor -- start 2023-10-08T16:10:40.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.513+0000 7fbbbab9d700 1 -- start start 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.513+0000 7fbbbab9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.513+0000 7fbbbab9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 0x7fbbb4137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbbab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb4137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbbab9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb41569c0 con 0x7fbbb406aaa0 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbbab9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4157540 con 0x7fbbb413fb20 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbbab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb4156c10 con 0x7fbbb413fef0 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54736/0 (socket says 172.21.15.12:54736) 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 -- 172.21.15.12:0/1444996355 learned_addr learned my addr 172.21.15.12:0/1444996355 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb939a700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 0x7fbbb4137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbba39c700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb4137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 -- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 msgr2=0x7fbbb4137cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb4137cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 -- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 msgr2=0x7fbbb4137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 0x7fbbb4137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 -- 172.21.15.12:0/1444996355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba40093c0 con 0x7fbbb406aaa0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbba39c700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb4137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb939a700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 0x7fbbb4137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.514+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c790 tx=0x7fbbb0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.515+0000 7fbba9ffb700 1 -- 172.21.15.12:0/1444996355 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010510 con 0x7fbbb406aaa0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.515+0000 7fbba9ffb700 1 -- 172.21.15.12:0/1444996355 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb0010670 con 0x7fbbb406aaa0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.515+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb4156ef0 con 0x7fbbb406aaa0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.515+0000 7fbba9ffb700 1 -- 172.21.15.12:0/1444996355 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0010a10 con 0x7fbbb406aaa0 2023-10-08T16:10:40.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.515+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb41507e0 con 0x7fbbb406aaa0 2023-10-08T16:10:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.517+0000 7fbba9ffb700 1 -- 172.21.15.12:0/1444996355 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbb001b400 con 0x7fbbb406aaa0 2023-10-08T16:10:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.518+0000 7fbba9ffb700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.518+0000 7fbba9ffb700 1 -- 172.21.15.12:0/1444996355 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbb00843a0 con 0x7fbbb406aaa0 2023-10-08T16:10:40.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.518+0000 7fbbb939a700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.519+0000 7fbbb939a700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 0x7fbb980693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4069580 tx=0x7fbba4016000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.520+0000 7fbbca457b80 1 Processor -- start 2023-10-08T16:10:40.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.520+0000 7fbbca457b80 1 -- start start 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1940a480 0x556e193e97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bd5f0 0x556e1940a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e19316a70 con 0x556e193bfb80 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e19314270 con 0x556e1940a480 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e19310060 con 0x556e193bd5f0 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54750/0 (socket says 172.21.15.12:54750) 2023-10-08T16:10:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbba39c700 1 -- 172.21.15.12:0/3970234461 learned_addr learned my addr 172.21.15.12:0/3970234461 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1940a480 0x556e193e97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.521+0000 7fbbb939a700 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bd5f0 0x556e1940a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 -- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bd5f0 msgr2=0x556e1940a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bd5f0 0x556e1940a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 -- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1940a480 msgr2=0x556e193e97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1940a480 0x556e193e97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 -- 172.21.15.12:0/3970234461 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e191aa270 con 0x556e193bfb80 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbbac002210 tx=0x7fbbac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3e20ab0ab05365 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbb9effd700 1 -- 172.21.15.12:0/3970234461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00b070 con 0x556e193bfb80 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbb9effd700 1 -- 172.21.15.12:0/3970234461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00dc60 con 0x556e193bfb80 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.522+0000 7fbb9effd700 1 -- 172.21.15.12:0/3970234461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac013470 con 0x556e193bfb80 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 -- 172.21.15.12:0/3970234461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 msgr2=0x556e193bfff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbbac002210 tx=0x7fbbac009040 comp rx=0 tx=0).stop 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 -- 172.21.15.12:0/3970234461 shutdown_connections 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e193bfb80 0x556e193bfff0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e1940a480 0x556e193e97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3970234461 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bd5f0 0x556e1940a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 -- 172.21.15.12:0/3970234461 >> 172.21.15.12:0/3970234461 conn(0x556e193c10c0 msgr2=0x556e193c18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 -- 172.21.15.12:0/3970234461 shutdown_connections 2023-10-08T16:10:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.523+0000 7fbbca457b80 1 -- 172.21.15.12:0/3970234461 wait complete. 2023-10-08T16:10:40.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.524+0000 7fbbca457b80 1 -- start start 2023-10-08T16:10:40.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.524+0000 7fbbca457b80 1 Processor -- start 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193e6840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193d90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e192bb890 con 0x556e1940a480 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e192d6ea0 con 0x556e193bd5f0 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e19192e30 con 0x556e193bfb80 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbca457b80 10 client.0 _ll_register_callbacks cb 0x556e193832c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbb939a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193d90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbb9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193e6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54764/0 (socket says 172.21.15.12:54764) 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.525+0000 7fbbba39c700 1 -- 172.21.15.12:0/2252466618 learned_addr learned my addr 172.21.15.12:0/2252466618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 -- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 msgr2=0x556e193d90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193d90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 -- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 msgr2=0x556e193e6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193e6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 -- 172.21.15.12:0/2252466618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba0003570 con 0x556e1940a480 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbba39c700 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbbac012000 tx=0x7fbbac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ffe2f0fb1a56c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbb93fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00ddd0 con 0x556e1940a480 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e193b4cd0 con 0x556e1940a480 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.526+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbac01e420 con 0x556e1940a480 2023-10-08T16:10:40.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbac01e7f0 con 0x556e1940a480 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 10 client.5166 fetch_fsmap learned FSMap version 18 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x556e1914cfe0 con 0x556e1940a480 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e193b4cd0 con 0x556e1940a480 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbac01e950 con 0x556e1940a480 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 10 client.5166 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 10 client.5166 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 20 client.5166 populate_metadata read hostname 'smithi012' 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e1941e050 0x556e1941e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 4 client.5166 mds_command: new command op to 4962 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 --> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e19391aa0 con 0x556e1941e050 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.527+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e1941e050 0x556e1941e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.528+0000 7fbb93fff700 10 client.5166 ms_handle_connect on v2:172.21.15.12:6834/2487834528 2023-10-08T16:10:40.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.528+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e1941e050 0x556e1941e420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9a256097af72af9 server_cookie=206139241c5894eb in_seq=0 out_seq=0 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.528+0000 7fbb93fff700 1 -- 172.21.15.12:0/2252466618 <== mds.0 v2:172.21.15.12:6834/2487834528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556e19391aa0 con 0x556e1941e050 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.528+0000 7fbb93fff700 10 client.5166 handle_command_reply: tid=0 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.528+0000 7fbbca457b80 1 client.5166 shutdown 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 msgr2=0x556e193d9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbbac012000 tx=0x7fbbac018000 comp rx=0 tx=0).stop 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 shutdown_connections 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e1941e050 0x556e1941e420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193d9630 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193e6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbb93fff700 0 client.5166 ms_handle_reset on v2:172.21.15.12:6834/2487834528 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 --2- 172.21.15.12:0/2252466618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193d90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 >> 172.21.15.12:0/2252466618 conn(0x556e193c10c0 msgr2=0x556e193bbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 shutdown_connections 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 1 -- 172.21.15.12:0/2252466618 wait complete. 2023-10-08T16:10:40.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.529+0000 7fbbca457b80 20 client.5166 trim_cache size 0 max 16384 2023-10-08T16:10:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.546+0000 7fbbca457b80 1 Processor -- start 2023-10-08T16:10:40.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 -- start start 2023-10-08T16:10:40.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193ef9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193b7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e193e5af0 con 0x556e1940a480 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e1940a110 con 0x556e193bd5f0 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.547+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e193ed930 con 0x556e193bfb80 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54780/0 (socket says 172.21.15.12:54780) 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 -- 172.21.15.12:0/3944262107 learned_addr learned my addr 172.21.15.12:0/3944262107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbb939a700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193ef9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 -- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 msgr2=0x556e193b7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193b7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 -- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 msgr2=0x556e193ef9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193ef9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 -- 172.21.15.12:0/3944262107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e192de780 con 0x556e1940a480 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:40.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.548+0000 7fbbba39c700 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbbac001420 tx=0x7fbbac01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41635ed4c07999a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbb9f7fe700 1 -- 172.21.15.12:0/3944262107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac00ddd0 con 0x556e1940a480 2023-10-08T16:10:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbb9f7fe700 1 -- 172.21.15.12:0/3944262107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac01e420 con 0x556e1940a480 2023-10-08T16:10:40.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbb9f7fe700 1 -- 172.21.15.12:0/3944262107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac01e7f0 con 0x556e1940a480 2023-10-08T16:10:40.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 -- 172.21.15.12:0/3944262107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 msgr2=0x556e193bcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbbac001420 tx=0x7fbbac01e000 comp rx=0 tx=0).stop 2023-10-08T16:10:40.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 -- 172.21.15.12:0/3944262107 shutdown_connections 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e193bcbd0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193ef9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 --2- 172.21.15.12:0/3944262107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193b7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 -- 172.21.15.12:0/3944262107 >> 172.21.15.12:0/3944262107 conn(0x556e193c10c0 msgr2=0x556e193eb140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 -- 172.21.15.12:0/3944262107 shutdown_connections 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.549+0000 7fbbca457b80 1 -- 172.21.15.12:0/3944262107 wait complete. 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.550+0000 7fbbca457b80 1 -- start start 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.550+0000 7fbbca457b80 1 Processor -- start 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e194048c0 con 0x556e1940a480 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e193ea150 con 0x556e193bd5f0 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e19471050 con 0x556e193bfb80 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbca457b80 10 client.0 _ll_register_callbacks cb 0x556e193832c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbb9b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbb939a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbba39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54794/0 (socket says 172.21.15.12:54794) 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.551+0000 7fbbba39c700 1 -- 172.21.15.12:0/825456715 learned_addr learned my addr 172.21.15.12:0/825456715 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 -- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 msgr2=0x556e193dcb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193dcb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 -- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 msgr2=0x556e193dc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193dc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 -- 172.21.15.12:0/825456715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e1914cfe0 con 0x556e1940a480 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbba39c700 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbbac000f60 tx=0x7fbbac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eab91f3c980e8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbb93fff700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbac001d20 con 0x556e1940a480 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbac00dc60 con 0x556e1940a480 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.552+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbac03a450 con 0x556e1940a480 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbac001e80 con 0x556e1940a480 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 10 client.5172 fetch_fsmap learned FSMap version 18 2023-10-08T16:10:40.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x556e192c5470 con 0x556e1940a480 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbac00dc60 con 0x556e1940a480 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 18) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbac03a820 con 0x556e1940a480 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 10 client.5172 fetch_fsmap finished waiting for FSMap version 18 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 10 client.5172 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 20 client.5172 populate_metadata read hostname 'smithi012' 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e193b5f40 0x556e19405250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 4 client.5172 mds_command: new command op to 4962 tid=0[{"prefix": "status"}] 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 --> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e192b2e00 con 0x556e193b5f40 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.553+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e193b5f40 0x556e19405250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbb9b9b700 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e193b5f40 0x556e19405250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e19bebdc00d71fc server_cookie=96b8aded9265354c in_seq=0 out_seq=0 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbb93fff700 10 client.5172 ms_handle_connect on v2:172.21.15.12:6834/2487834528 2023-10-08T16:10:40.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbb93fff700 1 -- 172.21.15.12:0/825456715 <== mds.0 v2:172.21.15.12:6834/2487834528 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556e192b2e00 con 0x556e193b5f40 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbb93fff700 10 client.5172 handle_command_reply: tid=0 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 client.5172 shutdown 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 msgr2=0x556e19404d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fbbac000f60 tx=0x7fbbac009040 comp rx=0 tx=0).stop 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 shutdown_connections 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:6834/2487834528,v1:172.21.15.12:6836/2487834528] conn(0x556e193b5f40 0x556e19405250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x556e1940a480 0x556e19404d10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x556e193bd5f0 0x556e193dc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 --2- 172.21.15.12:0/825456715 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x556e193bfb80 0x556e193dcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbb93fff700 0 client.5172 ms_handle_reset on v2:172.21.15.12:6834/2487834528 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 >> 172.21.15.12:0/825456715 conn(0x556e193c10c0 msgr2=0x556e193bcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 shutdown_connections 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.554+0000 7fbbca457b80 1 -- 172.21.15.12:0/825456715 wait complete. 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbca457b80 20 client.5172 trim_cache size 0 max 16384 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 4962, 2023-10-08T16:10:40.562 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.408530406000001, 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 18, 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 35, 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 35, 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 27.230071838000001 2023-10-08T16:10:40.563 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:10:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 msgr2=0x7fbb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 0x7fbb980693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4069580 tx=0x7fbba4016000 comp rx=0 tx=0).stop 2023-10-08T16:10:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 msgr2=0x7fbbb414eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000c790 tx=0x7fbbb0007e10 comp rx=0 tx=0).stop 2023-10-08T16:10:40.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 shutdown_connections 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbb98066f30 0x7fbb980693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbbb406aaa0 0x7fbbb414eb10 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbbb413fef0 0x7fbbb4137cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 --2- 172.21.15.12:0/1444996355 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbbb413fb20 0x7fbbb4137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 >> 172.21.15.12:0/1444996355 conn(0x7fbbb406d170 msgr2=0x7fbbb40b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 shutdown_connections 2023-10-08T16:10:40.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.555+0000 7fbbbab9d700 1 -- 172.21.15.12:0/1444996355 wait complete. 2023-10-08T16:10:40.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:10:40.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.760+0000 7f034dd9d700 1 Processor -- start 2023-10-08T16:10:40.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.760+0000 7f034dd9d700 1 -- start start 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034dd9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f034813fb20 0x7f034815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034dd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f034806aaa0 0x7f03480c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034dd9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f034815ae70 con 0x7f034813fef0 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034dd9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034806af60 con 0x7f034813fb20 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034dd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f034806b240 con 0x7f034806aaa0 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034cd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f034813fb20 0x7f034815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f0347fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f034813fef0 0x7f03480c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41686/0 (socket says 172.21.15.12:41686) 2023-10-08T16:10:40.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034cd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f034813fb20 0x7f034815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54806/0 (socket says 172.21.15.12:54806) 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f0347fff700 1 -- 172.21.15.12:0/869658669 learned_addr learned my addr 172.21.15.12:0/869658669 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.762+0000 7f034d59c700 1 --2- 172.21.15.12:0/869658669 >> v2:172.21.15.29:3300/0 conn(0x7f034806aaa0 0x7f03480c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f034cd9b700 1 -- 172.21.15.12:0/869658669 >> v2:172.21.15.29:3300/0 conn(0x7f034806aaa0 msgr2=0x7f03480c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f034cd9b700 1 --2- 172.21.15.12:0/869658669 >> v2:172.21.15.29:3300/0 conn(0x7f034806aaa0 0x7f03480c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f034cd9b700 1 -- 172.21.15.12:0/869658669 >> v1:172.21.15.12:6789/0 conn(0x7f034813fef0 legacy=0x7f03480c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f03477fe700 1 -- 172.21.15.12:0/869658669 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389312626 0 0) 0x7f0334001290 con 0x7f034813fef0 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f034cd9b700 1 -- 172.21.15.12:0/869658669 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034806b520 con 0x7f034813fb20 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f034cd9b700 1 --2- 172.21.15.12:0/869658669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034813fb20 0x7f034815a930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0348069d40 tx=0x7f033c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf33ba97fda5f3d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f03477fe700 1 -- 172.21.15.12:0/869658669 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00db40 con 0x7f034813fb20 2023-10-08T16:10:40.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f03477fe700 1 -- 172.21.15.12:0/869658669 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00dca0 con 0x7f034813fb20 2023-10-08T16:10:40.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.763+0000 7f03477fe700 1 -- 172.21.15.12:0/869658669 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c0196b0 con 0x7f034813fb20 2023-10-08T16:10:40.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 -- 172.21.15.12:0/869658669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034813fb20 msgr2=0x7f034815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 --2- 172.21.15.12:0/869658669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034813fb20 0x7f034815a930 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0348069d40 tx=0x7f033c00b430 comp rx=0 tx=0).stop 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 -- 172.21.15.12:0/869658669 shutdown_connections 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 --2- 172.21.15.12:0/869658669 >> v2:172.21.15.29:3300/0 conn(0x7f034806aaa0 0x7f03480c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 --2- 172.21.15.12:0/869658669 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034813fb20 0x7f034815a930 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 -- 172.21.15.12:0/869658669 >> 172.21.15.12:0/869658669 conn(0x7f034806d170 msgr2=0x7f03480cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 -- 172.21.15.12:0/869658669 shutdown_connections 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.764+0000 7f034dd9d700 1 -- 172.21.15.12:0/869658669 wait complete. 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.765+0000 7f034dd9d700 1 Processor -- start 2023-10-08T16:10:40.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.766+0000 7f034dd9d700 1 -- start start 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.766+0000 7f034dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.766+0000 7f034dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f034813fb20 0x7f0348155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034dd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034813fef0 0x7f034813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348157a60 con 0x7f034806aaa0 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034dd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0348156e50 con 0x7f034813fef0 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0348157130 con 0x7f034813fb20 2023-10-08T16:10:40.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54810/0 (socket says 172.21.15.12:54810) 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 -- 172.21.15.12:0/2396447378 learned_addr learned my addr 172.21.15.12:0/2396447378 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 -- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f034813fb20 msgr2=0x7f0348155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f034813fb20 0x7f0348155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 -- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034813fef0 msgr2=0x7f034813c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034813fef0 0x7f034813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 -- 172.21.15.12:0/2396447378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c00b6d0 con 0x7f034806aaa0 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.767+0000 7f034cd9b700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f033c00b2c0 tx=0x7f033c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.768+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c010540 con 0x7f034806aaa0 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.768+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c0106c0 con 0x7f034806aaa0 2023-10-08T16:10:40.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.768+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c010a80 con 0x7f034806aaa0 2023-10-08T16:10:40.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.768+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0348157410 con 0x7f034806aaa0 2023-10-08T16:10:40.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.768+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03480adb70 con 0x7f034806aaa0 2023-10-08T16:10:40.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.769+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f034804c3c0 con 0x7f034806aaa0 2023-10-08T16:10:40.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.770+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f033c024420 con 0x7f034806aaa0 2023-10-08T16:10:40.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.771+0000 7f0344ff9700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 0x7f032c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:40.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.771+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f033c020070 con 0x7f034806aaa0 2023-10-08T16:10:40.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.771+0000 7f0347fff700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 0x7f032c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:40.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.771+0000 7f0347fff700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 0x7f032c0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f03481399c0 tx=0x7f0334007a30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:40.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:40.775+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f033c053a90 con 0x7f034806aaa0 2023-10-08T16:10:41.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.027+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f034806b800 con 0x7f034806aaa0 2023-10-08T16:10:41.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.027+0000 7f0344ff9700 1 -- 172.21.15.12:0/2396447378 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7f033c0570b0 con 0x7f034806aaa0 2023-10-08T16:10:41.030 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 msgr2=0x7f032c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 0x7f032c0693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f03481399c0 tx=0x7f0334007a30 comp rx=0 tx=0).stop 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 msgr2=0x7f03480ad630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f033c00b2c0 tx=0x7f033c01b000 comp rx=0 tx=0).stop 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 shutdown_connections 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f032c066f30 0x7f032c0693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f034806aaa0 0x7f03480ad630 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f034813fef0 0x7f034813c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 --2- 172.21.15.12:0/2396447378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f034813fb20 0x7f0348155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 >> 172.21.15.12:0/2396447378 conn(0x7f034806d170 msgr2=0x7f03480cae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 shutdown_connections 2023-10-08T16:10:41.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:41.030+0000 7f034dd9d700 1 -- 172.21.15.12:0/2396447378 wait complete. 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:41.048 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:10:41.049 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:10:41.049 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:10:41.049 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:41.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.049 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:10:41.086 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:41.087 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 42101sec preferred_lft 42101sec 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:10:41.088 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:10:41.089 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:10:41.090 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:10:41.090 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:10:41.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.090 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:10:41.187 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:10:41.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.190 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:10:41.230 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:10:41.230 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:10:41.231 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:10:41.231 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:10:41.231 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:10:41.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.231 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:10:41.231 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:10:41.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:10:41.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:10:41.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:10:41.232 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:10:41.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.429 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:10:41.466 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:10:41.466 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:10:41.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:41.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:10:41.569 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:41.569 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:41.606 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:10:41.607 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:10:41.607 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:41.683 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:10:41.683 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:10:41.683 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:41.814 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:41.815 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:41.843 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:10:41.843 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:10:41.843 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:10:41.843 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:10:41.844 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:10:41.848 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:10:41.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:10:41.848 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:10:41.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:10:42.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.098+0000 7fdd50d9d700 1 Processor -- start 2023-10-08T16:10:42.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.099+0000 7fdd50d9d700 1 -- start start 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd50d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd50d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c0ca480 con 0x7fdd4c142fd0 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd50d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c15e240 con 0x7fdd4c142c00 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd50d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c06b350 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd4bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd4affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdd4c142fd0 0x7fdd4c0c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38432/0 (socket says 172.21.15.12:38432) 2023-10-08T16:10:42.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd4affd700 1 -- 172.21.15.12:0/1970619884 learned_addr learned my addr 172.21.15.12:0/1970619884 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:42.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.100+0000 7fdd4bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54702/0 (socket says 172.21.15.12:54702) 2023-10-08T16:10:42.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4bfff700 1 -- 172.21.15.12:0/1970619884 >> v1:172.21.15.29:6789/0 conn(0x7fdd4c142c00 legacy=0x7fdd4c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4bfff700 1 -- 172.21.15.12:0/1970619884 >> v1:172.21.15.12:6789/0 conn(0x7fdd4c142fd0 legacy=0x7fdd4c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4bfff700 1 -- 172.21.15.12:0/1970619884 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c15df60 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4bfff700 1 --2- 172.21.15.12:0/1970619884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009e60 tx=0x7fdd44009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714e98d878f0b48d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4a7fc700 1 -- 172.21.15.12:0/1970619884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400e070 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4a7fc700 1 -- 172.21.15.12:0/1970619884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400bc30 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.101+0000 7fdd4a7fc700 1 -- 172.21.15.12:0/1970619884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44012430 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 -- 172.21.15.12:0/1970619884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c0c7f90 msgr2=0x7fdd4c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/1970619884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009e60 tx=0x7fdd44009780 comp rx=0 tx=0).stop 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 -- 172.21.15.12:0/1970619884 shutdown_connections 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/1970619884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c06c6a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 -- 172.21.15.12:0/1970619884 >> 172.21.15.12:0/1970619884 conn(0x7fdd4c0675a0 msgr2=0x7fdd4c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 -- 172.21.15.12:0/1970619884 shutdown_connections 2023-10-08T16:10:42.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.102+0000 7fdd50d9d700 1 -- 172.21.15.12:0/1970619884 wait complete. 2023-10-08T16:10:42.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.103+0000 7fdd50d9d700 1 Processor -- start 2023-10-08T16:10:42.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 -- start start 2023-10-08T16:10:42.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 0x7fdd4c0c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c5a40 con 0x7fdd4c142c00 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c0c7160 con 0x7fdd4c0c7f90 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.104+0000 7fdd50d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c141610 con 0x7fdd4c142fd0 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54712/0 (socket says 172.21.15.12:54712) 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 -- 172.21.15.12:0/2232694020 learned_addr learned my addr 172.21.15.12:0/2232694020 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4b7fe700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 -- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 msgr2=0x7fdd4c0c4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4bfff700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 0x7fdd4c0c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 0x7fdd4c0c4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 -- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 msgr2=0x7fdd4c1410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c1410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 -- 172.21.15.12:0/2232694020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009a20 con 0x7fdd4c142c00 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4b7fe700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c1410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4bfff700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 0x7fdd4c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd4affd700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c560 tx=0x7fdd40001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40005b30 con 0x7fdd4c142c00 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.105+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd40005cb0 con 0x7fdd4c142c00 2023-10-08T16:10:42.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.106+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c0c5430 con 0x7fdd4c142c00 2023-10-08T16:10:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.106+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40007320 con 0x7fdd4c142c00 2023-10-08T16:10:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.106+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c0c56d0 con 0x7fdd4c142c00 2023-10-08T16:10:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.107+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c0c5bb0 con 0x7fdd4c142c00 2023-10-08T16:10:42.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.107+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd4001b3b0 con 0x7fdd4c142c00 2023-10-08T16:10:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.108+0000 7fdd337fe700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.108+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdd40083af0 con 0x7fdd4c142c00 2023-10-08T16:10:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.109+0000 7fdd4b7fe700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.109+0000 7fdd4b7fe700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 0x7fdd380693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007fd0 tx=0x7fdd3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.113+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd40050cc0 con 0x7fdd4c142c00 2023-10-08T16:10:42.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.347+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd4c04c3c0 con 0x7fdd38066f30 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.348+0000 7fdd337fe700 1 -- 172.21.15.12:0/2232694020 <== mgr.4110 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdd4c04c3c0 con 0x7fdd38066f30 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:10:42.349 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 msgr2=0x7fdd380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 0x7fdd380693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c007fd0 tx=0x7fdd3c009040 comp rx=0 tx=0).stop 2023-10-08T16:10:42.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 msgr2=0x7fdd4c0c42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000c560 tx=0x7fdd40001020 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 shutdown_connections 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd4c142fd0 0x7fdd4c0c4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd4c0c7f90 0x7fdd4c1410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fdd38066f30 0x7fdd380693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 --2- 172.21.15.12:0/2232694020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd4c142c00 0x7fdd4c0c42f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.350+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 >> 172.21.15.12:0/2232694020 conn(0x7fdd4c0675a0 msgr2=0x7fdd4c0c3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.351+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 shutdown_connections 2023-10-08T16:10:42.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.351+0000 7fdd50d9d700 1 -- 172.21.15.12:0/2232694020 wait complete. 2023-10-08T16:10:42.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:10:42.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.556+0000 7f8c08d9d700 1 Processor -- start 2023-10-08T16:10:42.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.557+0000 7f8c08d9d700 1 -- start start 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8c040c7930 0x7f8c0406a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cc840 0x7f8c04155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c040cccb0 0x7f8c0406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0406b790 con 0x7f8c040cccb0 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0406a8e0 con 0x7f8c040c7930 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c08d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0406ab80 con 0x7f8c040cc840 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c03fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c040cccb0 0x7f8c0406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c03fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8c040cccb0 0x7f8c0406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54714/0 (socket says 172.21.15.12:54714) 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.558+0000 7f8c03fff700 1 -- 172.21.15.12:0/1575390520 learned_addr learned my addr 172.21.15.12:0/1575390520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c037fe700 1 --2- 172.21.15.12:0/1575390520 >> v2:172.21.15.29:3300/0 conn(0x7f8c040c7930 0x7f8c0406a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c02ffd700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cc840 0x7f8c04155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 -- 172.21.15.12:0/1575390520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cc840 msgr2=0x7f8c04155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cc840 0x7f8c04155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 -- 172.21.15.12:0/1575390520 >> v2:172.21.15.29:3300/0 conn(0x7f8c040c7930 msgr2=0x7f8c0406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 --2- 172.21.15.12:0/1575390520 >> v2:172.21.15.29:3300/0 conn(0x7f8c040c7930 0x7f8c0406a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 -- 172.21.15.12:0/1575390520 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0406ae60 con 0x7f8c040cccb0 2023-10-08T16:10:42.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c03fff700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cccb0 0x7f8c0406de50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009f20 tx=0x7f8bfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b4fa203652bf1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c027fc700 1 -- 172.21.15.12:0/1575390520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc00e070 con 0x7f8c040cccb0 2023-10-08T16:10:42.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c027fc700 1 -- 172.21.15.12:0/1575390520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc00ba40 con 0x7f8c040cccb0 2023-10-08T16:10:42.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.559+0000 7f8c027fc700 1 -- 172.21.15.12:0/1575390520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0092e0 con 0x7f8c040cccb0 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 -- 172.21.15.12:0/1575390520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cccb0 msgr2=0x7f8c0406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cccb0 0x7f8c0406de50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009f20 tx=0x7f8bfc009840 comp rx=0 tx=0).stop 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 -- 172.21.15.12:0/1575390520 shutdown_connections 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cccb0 0x7f8c0406de50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/1575390520 >> v2:172.21.15.29:3300/0 conn(0x7f8c040c7930 0x7f8c0406a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/1575390520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cc840 0x7f8c04155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 -- 172.21.15.12:0/1575390520 >> 172.21.15.12:0/1575390520 conn(0x7f8c0406d110 msgr2=0x7f8c040cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 -- 172.21.15.12:0/1575390520 shutdown_connections 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.560+0000 7f8c08d9d700 1 -- 172.21.15.12:0/1575390520 wait complete. 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.562+0000 7f8c08d9d700 1 Processor -- start 2023-10-08T16:10:42.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.562+0000 7f8c08d9d700 1 -- start start 2023-10-08T16:10:42.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c040c7930 0x7f8c0414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 0x7f8c041711b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0414ff40 con 0x7f8c040cc840 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04171db0 con 0x7f8c040c7930 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c08d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c04155890 con 0x7f8c040cccb0 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c02ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54728/0 (socket says 172.21.15.12:54728) 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c02ffd700 1 -- 172.21.15.12:0/2487567075 learned_addr learned my addr 172.21.15.12:0/2487567075 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c037fe700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c040c7930 0x7f8c0414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.563+0000 7f8c03fff700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 0x7f8c041711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 -- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 msgr2=0x7f8c041711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 0x7f8c041711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 -- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c040c7930 msgr2=0x7f8c0414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c040c7930 0x7f8c0414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 -- 172.21.15.12:0/2487567075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009ae0 con 0x7f8c040cc840 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c03fff700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 0x7f8c041711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c02ffd700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800d860 tx=0x7f8bf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf80125f0 con 0x7f8c040cc840 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf8012770 con 0x7f8c040cc840 2023-10-08T16:10:42.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8012b30 con 0x7f8c040cc840 2023-10-08T16:10:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c04155b70 con 0x7f8c040cc840 2023-10-08T16:10:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.564+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c04156410 con 0x7f8c040cc840 2023-10-08T16:10:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.565+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0404c3c0 con 0x7f8c040cc840 2023-10-08T16:10:42.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.566+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bf801e460 con 0x7f8c040cc840 2023-10-08T16:10:42.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.567+0000 7f8beb7fe700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:42.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.568+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bf8084be0 con 0x7f8c040cc840 2023-10-08T16:10:42.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.568+0000 7f8c037fe700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:42.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.568+0000 7f8c037fe700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 0x7f8bf00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4006fd0 tx=0x7f8bf4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:42.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.572+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bf8051db0 con 0x7f8c040cc840 2023-10-08T16:10:42.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:42.828+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8c0406f170 con 0x7f8c040cc840 2023-10-08T16:10:43.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.444+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f8bf8052180 con 0x7f8c040cc840 2023-10-08T16:10:43.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.446+0000 7f8beb7fe700 1 -- 172.21.15.12:0/2487567075 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8bf8051db0 con 0x7f8c040cc840 2023-10-08T16:10:43.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 msgr2=0x7f8bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 0x7f8bf00693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4006fd0 tx=0x7f8bf4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 msgr2=0x7f8c040b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800d860 tx=0x7f8bf8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 shutdown_connections 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8c040cccb0 0x7f8c041711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8c040c7930 0x7f8c0414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bf0066f30 0x7f8bf00693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 --2- 172.21.15.12:0/2487567075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8c040cc840 0x7f8c040b1710 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 >> 172.21.15.12:0/2487567075 conn(0x7f8c0406d110 msgr2=0x7f8c040c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.448+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 shutdown_connections 2023-10-08T16:10:43.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.449+0000 7f8c08d9d700 1 -- 172.21.15.12:0/2487567075 wait complete. 2023-10-08T16:10:43.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:10:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.667+0000 7f87b6b9d700 1 Processor -- start 2023-10-08T16:10:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.667+0000 7f87b6b9d700 1 -- start start 2023-10-08T16:10:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.668+0000 7f87b6b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87b0153a00 0x7f87b0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.668+0000 7f87b6b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87b015de50 0x7f87b015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.668+0000 7f87b6b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b015af60 con 0x7f87b00cea00 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.668+0000 7f87b6b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b015d010 con 0x7f87b0153a00 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.668+0000 7f87b6b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b015b240 con 0x7f87b015de50 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b5b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f87b0153a00 0x7f87b0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b639c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f87b00cea00 0x7f87b00cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38436/0 (socket says 172.21.15.12:38436) 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b639c700 1 -- 172.21.15.12:0/2279582438 learned_addr learned my addr 172.21.15.12:0/2279582438 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b539a700 1 --2- 172.21.15.12:0/2279582438 >> v2:172.21.15.29:3300/0 conn(0x7f87b015de50 0x7f87b015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2279582438 >> v2:172.21.15.29:3300/0 conn(0x7f87b015de50 msgr2=0x7f87b015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b5b9b700 1 --2- 172.21.15.12:0/2279582438 >> v2:172.21.15.29:3300/0 conn(0x7f87b015de50 0x7f87b015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b4b99700 1 -- 172.21.15.12:0/2279582438 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716256849 0 0) 0x7f87b015af60 con 0x7f87b00cea00 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2279582438 >> v1:172.21.15.12:6789/0 conn(0x7f87b00cea00 legacy=0x7f87b00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.669+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2279582438 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b015b520 con 0x7f87b0153a00 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b5b9b700 1 --2- 172.21.15.12:0/2279582438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0153a00 0x7f87b0153dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87b00b3070 tx=0x7f87ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beabed8f185fd14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b4b99700 1 -- 172.21.15.12:0/2279582438 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac011630 con 0x7f87b0153a00 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b4b99700 1 -- 172.21.15.12:0/2279582438 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac011790 con 0x7f87b0153a00 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b4b99700 1 -- 172.21.15.12:0/2279582438 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac011b30 con 0x7f87b0153a00 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2279582438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0153a00 msgr2=0x7f87b0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.670+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2279582438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0153a00 0x7f87b0153dd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87b00b3070 tx=0x7f87ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2279582438 shutdown_connections 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2279582438 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b0153a00 0x7f87b0153dd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2279582438 >> v2:172.21.15.29:3300/0 conn(0x7f87b015de50 0x7f87b015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2279582438 >> 172.21.15.12:0/2279582438 conn(0x7f87b00703a0 msgr2=0x7f87b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2279582438 shutdown_connections 2023-10-08T16:10:43.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.671+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2279582438 wait complete. 2023-10-08T16:10:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.672+0000 7f87b6b9d700 1 Processor -- start 2023-10-08T16:10:43.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.672+0000 7f87b6b9d700 1 -- start start 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b0153a00 0x7f87b014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b015de50 0x7f87b014fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b016d7a0 con 0x7f87b00cea00 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00b22d0 con 0x7f87b015de50 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b016d150 con 0x7f87b0153a00 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b5b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b5b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54760/0 (socket says 172.21.15.12:54760) 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2579234220 learned_addr learned my addr 172.21.15.12:0/2579234220 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b639c700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b015de50 0x7f87b014fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.673+0000 7f87b539a700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b0153a00 0x7f87b014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:43.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b0153a00 msgr2=0x7f87b014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b0153a00 0x7f87b014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b015de50 msgr2=0x7f87b014fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b015de50 0x7f87b014fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 -- 172.21.15.12:0/2579234220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac009420 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b5b9b700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f87b006eb00 tx=0x7f87ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac000d10 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ac011b10 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ac025640 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.674+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b016d430 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.675+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b014b4d0 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.676+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b016cfb0 con 0x7f87b00cea00 2023-10-08T16:10:43.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.677+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f87ac025a30 con 0x7f87b00cea00 2023-10-08T16:10:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.677+0000 7f87a5ffb700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 0x7f8794069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.677+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f87ac085d50 con 0x7f87b00cea00 2023-10-08T16:10:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.677+0000 7f87b539a700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 msgr2=0x7f8794069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:43.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.678+0000 7f87b539a700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 0x7f8794069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:10:43.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.686+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87b016cfb0 con 0x7f87b00cea00 2023-10-08T16:10:43.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:43.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:10:43.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.879+0000 7f87b539a700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 msgr2=0x7f8794069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:43.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.879+0000 7f87b539a700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 0x7f8794069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:10:43.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.904+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f87b016cfb0 con 0x7f87b00cea00 2023-10-08T16:10:43.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.908+0000 7f87a5ffb700 1 -- 172.21.15.12:0/2579234220 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7f87b016cfb0 con 0x7f87b00cea00 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.910+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 msgr2=0x7f8794069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.910+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 0x7f8794069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.910+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 msgr2=0x7f87b00b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.910+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f87b006eb00 tx=0x7f87ac017000 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 shutdown_connections 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8794066f80 0x7f8794069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b00cea00 0x7f87b00b1a80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b015de50 0x7f87b014fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 --2- 172.21.15.12:0/2579234220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b0153a00 0x7f87b014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 >> 172.21.15.12:0/2579234220 conn(0x7f87b00703a0 msgr2=0x7f87b0152280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:43.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 shutdown_connections 2023-10-08T16:10:43.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:43.911+0000 7f87b6b9d700 1 -- 172.21.15.12:0/2579234220 wait complete. 2023-10-08T16:10:43.930 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:10:44.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.168+0000 7fe868d9d700 1 Processor -- start 2023-10-08T16:10:44.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.168+0000 7fe868d9d700 1 -- start start 2023-10-08T16:10:44.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.169+0000 7fe868d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe868d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86415ac50 con 0x7fe8640cea00 2023-10-08T16:10:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe868d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86415d010 con 0x7fe86415de50 2023-10-08T16:10:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe868d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86415af60 con 0x7fe864153a00 2023-10-08T16:10:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe8637fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe863fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe8640cea00 0x7fe8640cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38448/0 (socket says 172.21.15.12:38448) 2023-10-08T16:10:44.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe863fff700 1 -- 172.21.15.12:0/45931208 learned_addr learned my addr 172.21.15.12:0/45931208 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe8637fe700 1 -- 172.21.15.12:0/45931208 >> v1:172.21.15.29:6789/0 conn(0x7fe86415de50 legacy=0x7fe86415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe8637fe700 1 -- 172.21.15.12:0/45931208 >> v1:172.21.15.12:6789/0 conn(0x7fe8640cea00 legacy=0x7fe8640cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.170+0000 7fe8637fe700 1 -- 172.21.15.12:0/45931208 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86415b240 con 0x7fe864153a00 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.171+0000 7fe8637fe700 1 --2- 172.21.15.12:0/45931208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe8540098e0 tx=0x7fe8540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdce596b757530 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.171+0000 7fe8627fc700 1 -- 172.21.15.12:0/45931208 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854009e80 con 0x7fe864153a00 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.171+0000 7fe8627fc700 1 -- 172.21.15.12:0/45931208 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85400b860 con 0x7fe864153a00 2023-10-08T16:10:44.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.171+0000 7fe8627fc700 1 -- 172.21.15.12:0/45931208 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe85400bbe0 con 0x7fe864153a00 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 -- 172.21.15.12:0/45931208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 msgr2=0x7fe864153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 --2- 172.21.15.12:0/45931208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe8540098e0 tx=0x7fe8540091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 -- 172.21.15.12:0/45931208 shutdown_connections 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 --2- 172.21.15.12:0/45931208 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 -- 172.21.15.12:0/45931208 >> 172.21.15.12:0/45931208 conn(0x7fe8640703a0 msgr2=0x7fe8640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 -- 172.21.15.12:0/45931208 shutdown_connections 2023-10-08T16:10:44.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.172+0000 7fe868d9d700 1 -- 172.21.15.12:0/45931208 wait complete. 2023-10-08T16:10:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.174+0000 7fe868d9d700 1 Processor -- start 2023-10-08T16:10:44.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.174+0000 7fe868d9d700 1 -- start start 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 0x7fe86406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864141100 con 0x7fe864153a00 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe864154090 con 0x7fe8640cea00 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe868d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86416d950 con 0x7fe86415de50 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe8637fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 0x7fe86406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54766/0 (socket says 172.21.15.12:54766) 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 -- 172.21.15.12:0/1473206337 learned_addr learned my addr 172.21.15.12:0/1473206337 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe863fff700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 msgr2=0x7fe864140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 msgr2=0x7fe86406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 0x7fe86406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.175+0000 7fe862ffd700 1 -- 172.21.15.12:0/1473206337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe854009420 con 0x7fe864153a00 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe863fff700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe8637fe700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 0x7fe86406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c7c0 tx=0x7fe858007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011590 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe858011710 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86416dc30 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858011ad0 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.176+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86416dfc0 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.177+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8640b2f00 con 0x7fe864153a00 2023-10-08T16:10:44.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.179+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe85801b3b0 con 0x7fe864153a00 2023-10-08T16:10:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.179+0000 7fe84b7fe700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 0x7fe850069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.180+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe858083bc0 con 0x7fe864153a00 2023-10-08T16:10:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.180+0000 7fe8637fe700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 msgr2=0x7fe850069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.180+0000 7fe8637fe700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 0x7fe850069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:10:44.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.184+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe858050d90 con 0x7fe864153a00 2023-10-08T16:10:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.381+0000 7fe8637fe700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 msgr2=0x7fe850069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.381+0000 7fe8637fe700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 0x7fe850069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:10:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.387+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe86404c3c0 con 0x7fe864153a00 2023-10-08T16:10:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.392+0000 7fe84b7fe700 1 -- 172.21.15.12:0/1473206337 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe858017020 con 0x7fe864153a00 2023-10-08T16:10:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 msgr2=0x7fe850069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:10:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 0x7fe850069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 msgr2=0x7fe864140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe85800c7c0 tx=0x7fe858007f60 comp rx=0 tx=0).stop 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 shutdown_connections 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8640cea00 0x7fe86406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe850066f80 0x7fe850069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 --2- 172.21.15.12:0/1473206337 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe864153a00 0x7fe864140680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 >> 172.21.15.12:0/1473206337 conn(0x7fe8640703a0 msgr2=0x7fe8640c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 shutdown_connections 2023-10-08T16:10:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.394+0000 7fe868d9d700 1 -- 172.21.15.12:0/1473206337 wait complete. 2023-10-08T16:10:44.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:44.413 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T16:10:44.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:44.457 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-10-08T16:10:44.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-10-08T16:10:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.771+0000 7f7aacdff700 1 Processor -- start 2023-10-08T16:10:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.771+0000 7f7aacdff700 1 -- start start 2023-10-08T16:10:44.773 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:44.773+0000 7f407a4f1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:10:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.772+0000 7f7aacdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.772+0000 7f7aacdff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7aa806eaa0 0x7f7aa80ae1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.772+0000 7f7aacdff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa80af090 con 0x7f7aa80ae6f0 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.772+0000 7f7aacdff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa806a950 con 0x7f7aa806eaa0 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.772+0000 7f7aacdff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa80aeb70 con 0x7f7aa81575a0 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa6d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7aa80ae6f0 0x7f7aa815b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38450/0 (socket says 172.21.15.12:38450) 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa6d9d700 1 -- 172.21.15.12:0/780724412 learned_addr learned my addr 172.21.15.12:0/780724412 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/780724412 >> v2:172.21.15.29:3300/0 conn(0x7f7aa806eaa0 0x7f7aa80ae1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa659c700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa559a700 1 -- 172.21.15.12:0/780724412 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4211555415 0 0) 0x7f7aa80af090 con 0x7f7aa80ae6f0 2023-10-08T16:10:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa559a700 1 -- 172.21.15.12:0/780724412 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a90003570 con 0x7f7aa80ae6f0 2023-10-08T16:10:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 msgr2=0x7f7aa8069dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa8069dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/780724412 >> v1:172.21.15.12:6789/0 conn(0x7f7aa80ae6f0 legacy=0x7f7aa815b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.773+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/780724412 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80c7100 con 0x7f7aa806eaa0 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.774+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa80ae1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009910 tx=0x7f7a9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=840dbd83b3f56582 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.774+0000 7f7aa559a700 1 -- 172.21.15.12:0/780724412 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011630 con 0x7f7aa806eaa0 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.774+0000 7f7aa559a700 1 -- 172.21.15.12:0/780724412 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c011790 con 0x7f7aa806eaa0 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.774+0000 7f7aa559a700 1 -- 172.21.15.12:0/780724412 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c011b10 con 0x7f7aa806eaa0 2023-10-08T16:10:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 -- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 msgr2=0x7f7aa80ae1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa80ae1b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c009910 tx=0x7f7a9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 -- 172.21.15.12:0/780724412 shutdown_connections 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa8069dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 --2- 172.21.15.12:0/780724412 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa80ae1b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 -- 172.21.15.12:0/780724412 >> 172.21.15.12:0/780724412 conn(0x7f7aa806d170 msgr2=0x7f7aa80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 -- 172.21.15.12:0/780724412 shutdown_connections 2023-10-08T16:10:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.775+0000 7f7aacdff700 1 -- 172.21.15.12:0/780724412 wait complete. 2023-10-08T16:10:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.776+0000 7f7aacdff700 1 Processor -- start 2023-10-08T16:10:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.777+0000 7f7aacdff700 1 -- start start 2023-10-08T16:10:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa8141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 0x7f7aa8168950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa816a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8169e60 con 0x7f7aa80ae6f0 2023-10-08T16:10:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8169250 con 0x7f7aa806eaa0 2023-10-08T16:10:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aacdff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8169530 con 0x7f7aa81575a0 2023-10-08T16:10:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 0x7f7aa8168950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa8141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 0x7f7aa8168950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54778/0 (socket says 172.21.15.12:54778) 2023-10-08T16:10:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 learned_addr learned my addr 172.21.15.12:0/4219540787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa6d9d700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa816a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 msgr2=0x7f7aa816a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa816a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 msgr2=0x7f7aa8168950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 0x7f7aa8168950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.778+0000 7f7aa659c700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c009420 con 0x7f7aa806eaa0 2023-10-08T16:10:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7aa659c700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa8141ef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800ea50 tx=0x7f7a980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800ee90 con 0x7f7aa806eaa0 2023-10-08T16:10:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9800c7f0 con 0x7f7aa806eaa0 2023-10-08T16:10:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9800cb90 con 0x7f7aa806eaa0 2023-10-08T16:10:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8169810 con 0x7f7aa806eaa0 2023-10-08T16:10:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.779+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa8142430 con 0x7f7aa806eaa0 2023-10-08T16:10:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.781+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa804c3c0 con 0x7f7aa806eaa0 2023-10-08T16:10:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.781+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 6) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7a98013470 con 0x7f7aa806eaa0 2023-10-08T16:10:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.782+0000 7f7a967fc700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.782+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a98084770 con 0x7f7aa806eaa0 2023-10-08T16:10:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.782+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.782+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:10:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.791+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a98051940 con 0x7f7aa806eaa0 2023-10-08T16:10:44.838 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:44.838+0000 7fabbf9a2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:10:44.947 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:44.947+0000 7f407a4f1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:10:44.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.983+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:44.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:44.983+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:10:45.010 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.009+0000 7fabbf9a2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:10:45.035 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.035+0000 7f407a4f1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:10:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:45.040+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7aa806a670 con 0x7f7a88066f80 2023-10-08T16:10:45.098 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.097+0000 7fabbf9a2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:10:45.268 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.268+0000 7f407a4f1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:10:45.331 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.331+0000 7fabbf9a2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:10:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:45.384+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:45.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:45.384+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:10:45.452 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.451+0000 7f407a4f1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:10:45.515 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.514+0000 7fabbf9a2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:10:45.546 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.546+0000 7f407a4f1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:10:45.610 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.609+0000 7fabbf9a2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:10:45.712 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.712+0000 7f407a4f1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:10:45.776 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.775+0000 7fabbf9a2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:10:45.817 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:45.817+0000 7f407a4f1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:10:45.879 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:45.879+0000 7fabbf9a2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:10:46.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:46.185+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:46.185+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:10:46.319 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:46.319+0000 7f407a4f1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:10:46.382 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:46.381+0000 7fabbf9a2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:10:46.416 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:46.416+0000 7f407a4f1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:10:46.479 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:46.478+0000 7fabbf9a2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:10:46.509 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:46.509+0000 7f407a4f1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:10:46.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:46.572+0000 7fabbf9a2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:10:47.155 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:47.155+0000 7f407a4f1180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:10:47.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:47.220+0000 7fabbf9a2180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:10:47.332 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:47.331+0000 7f407a4f1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:10:47.398 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:47.397+0000 7fabbf9a2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:10:47.430 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:47.429+0000 7f407a4f1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:10:47.497 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:47.496+0000 7fabbf9a2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:10:47.729 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:47.728+0000 7f407a4f1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:10:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:47.787+0000 7f7aa5d9b700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:10:47.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:47.787+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:10:47.795 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:47.795+0000 7fabbf9a2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:10:47.827 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:47.826+0000 7f407a4f1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:10:47.894 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:47.894+0000 7fabbf9a2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:10:48.555 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:48.554+0000 7f407a4f1180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:10:48.625 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:48.624+0000 7fabbf9a2180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:10:48.845 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:48.844+0000 7f407a4f1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:10:48.916 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:48.915+0000 7fabbf9a2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:10:48.941 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:48.939+0000 7f407a4f1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:10:49.011 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.010+0000 7fabbf9a2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:10:49.099 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.098+0000 7f407a4f1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:10:49.171 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.170+0000 7fabbf9a2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:10:49.207 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.206+0000 7f407a4f1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:10:49.278 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.277+0000 7fabbf9a2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:10:49.401 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.400+0000 7f407a4f1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:10:49.471 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.470+0000 7fabbf9a2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:10:49.527 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.495+0000 7f407a4f1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:10:49.566 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.565+0000 7fabbf9a2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:10:49.589 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.588+0000 7f407a4f1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:10:49.662 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.658+0000 7fabbf9a2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:10:49.684 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:10:49.683+0000 7f407a4f1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:10:49.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:49.743+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 7) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7a98051d10 con 0x7f7aa806eaa0 2023-10-08T16:10:49.758 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.757+0000 7fabbf9a2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:10:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:49.767+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 8) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f7a980710c0 con 0x7f7aa806eaa0 2023-10-08T16:10:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:49.767+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a88069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:10:49.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:49.767+0000 7f7a967fc700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a88069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:49.888 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab34536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab34536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab34536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab34536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab34536700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab30d2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.990 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab30d2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.990 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab30d2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.990 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab30d2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:49.990 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:10:49.887+0000 7fab30d2f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:10:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.774+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mon.1 v2:172.21.15.29:3300/0 9 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f7a980525e0 con 0x7f7aa806eaa0 2023-10-08T16:10:50.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.775+0000 7f7a967fc700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a880693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:50.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.775+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7aa806a670 con 0x7f7a88066f80 2023-10-08T16:10:50.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.776+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a880693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:50.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.781+0000 7f7aa5d9b700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a880693b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80c55e0 tx=0x7f7a9c017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:50.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.866+0000 7f7a967fc700 1 -- 172.21.15.12:0/4219540787 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f7aa806a670 con 0x7f7a88066f80 2023-10-08T16:10:50.916 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir0 2023-10-08T16:10:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.868+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 msgr2=0x7f7a880693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.868+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a880693b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80c55e0 tx=0x7f7a9c017000 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 msgr2=0x7f7aa8141ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa8141ef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800ea50 tx=0x7f7a980091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 shutdown_connections 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7aa81575a0 0x7f7aa816a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7aa806eaa0 0x7f7aa8141ef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7a88066f80 0x7f7a880693b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 --2- 172.21.15.12:0/4219540787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7aa80ae6f0 0x7f7aa8168950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 >> 172.21.15.12:0/4219540787 conn(0x7f7aa806d170 msgr2=0x7f7aa806e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 shutdown_connections 2023-10-08T16:10:50.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:50.869+0000 7f7aacdff700 1 -- 172.21.15.12:0/4219540787 wait complete. 2023-10-08T16:10:50.919 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-10-08T16:10:50.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:50.919 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-10-08T16:10:50.958 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-10-08T16:10:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.191+0000 7fad91f9d700 1 Processor -- start 2023-10-08T16:10:51.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.191+0000 7fad91f9d700 1 -- start start 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad91f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad8c067ec0 0x7fad8c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad91f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 0x7fad8c1633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad91f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8c0c1a30 con 0x7fad8c1597d0 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad91f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8c15a820 con 0x7fad8c067ec0 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad91f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0c7120 con 0x7fad8c0c7760 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad90f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fad8c1597d0 0x7fad8c0677b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38466/0 (socket says 172.21.15.12:38466) 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad90f9b700 1 -- 172.21.15.12:0/3811542352 learned_addr learned my addr 172.21.15.12:0/3811542352 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad9179c700 1 --2- 172.21.15.12:0/3811542352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 0x7fad8c1633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad8bfff700 1 --2- 172.21.15.12:0/3811542352 >> v2:172.21.15.29:3300/0 conn(0x7fad8c067ec0 0x7fad8c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.193+0000 7fad8b7fe700 1 -- 172.21.15.12:0/3811542352 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725097861 0 0) 0x7fad8c0c1a30 con 0x7fad8c1597d0 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad8b7fe700 1 -- 172.21.15.12:0/3811542352 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c003570 con 0x7fad8c1597d0 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad9179c700 1 -- 172.21.15.12:0/3811542352 >> v2:172.21.15.29:3300/0 conn(0x7fad8c067ec0 msgr2=0x7fad8c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad9179c700 1 --2- 172.21.15.12:0/3811542352 >> v2:172.21.15.29:3300/0 conn(0x7fad8c067ec0 0x7fad8c0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad9179c700 1 -- 172.21.15.12:0/3811542352 >> v1:172.21.15.12:6789/0 conn(0x7fad8c1597d0 legacy=0x7fad8c0677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad9179c700 1 -- 172.21.15.12:0/3811542352 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c15aa30 con 0x7fad8c0c7760 2023-10-08T16:10:51.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad9179c700 1 --2- 172.21.15.12:0/3811542352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 0x7fad8c1633d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e60 tx=0x7fad84009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab2554c393493b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad8b7fe700 1 -- 172.21.15.12:0/3811542352 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400e070 con 0x7fad8c0c7760 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad8b7fe700 1 -- 172.21.15.12:0/3811542352 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8400bab0 con 0x7fad8c0c7760 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.194+0000 7fad8b7fe700 1 -- 172.21.15.12:0/3811542352 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8400be70 con 0x7fad8c0c7760 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 -- 172.21.15.12:0/3811542352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 msgr2=0x7fad8c1633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 --2- 172.21.15.12:0/3811542352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 0x7fad8c1633d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fad84009e60 tx=0x7fad84009780 comp rx=0 tx=0).stop 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 -- 172.21.15.12:0/3811542352 shutdown_connections 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 --2- 172.21.15.12:0/3811542352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c0c7760 0x7fad8c1633d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 --2- 172.21.15.12:0/3811542352 >> v2:172.21.15.29:3300/0 conn(0x7fad8c067ec0 0x7fad8c0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 -- 172.21.15.12:0/3811542352 >> 172.21.15.12:0/3811542352 conn(0x7fad8c06f330 msgr2=0x7fad8c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 -- 172.21.15.12:0/3811542352 shutdown_connections 2023-10-08T16:10:51.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.195+0000 7fad91f9d700 1 -- 172.21.15.12:0/3811542352 wait complete. 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.196+0000 7fad91f9d700 1 Processor -- start 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.197+0000 7fad91f9d700 1 -- start start 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 0x7fad8c0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 0x7fad8c0c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c0b20f0 con 0x7fad8c067ec0 2023-10-08T16:10:51.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c169550 con 0x7fad8c0c7760 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad91f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8c156830 con 0x7fad8c1597d0 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54936/0 (socket says 172.21.15.12:54936) 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 -- 172.21.15.12:0/1634911560 learned_addr learned my addr 172.21.15.12:0/1634911560 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad8bfff700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 0x7fad8c0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad9179c700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 0x7fad8c0c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 -- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 msgr2=0x7fad8c0c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 0x7fad8c0c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 -- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 msgr2=0x7fad8c0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 0x7fad8c0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 -- 172.21.15.12:0/1634911560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84009a20 con 0x7fad8c067ec0 2023-10-08T16:10:51.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad8bfff700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 0x7fad8c0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad9179c700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 0x7fad8c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.198+0000 7fad90f9b700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c7c0 tx=0x7fad80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.199+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80005b30 con 0x7fad8c067ec0 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.199+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad80005c90 con 0x7fad8c067ec0 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.199+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad80007340 con 0x7fad8c067ec0 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.199+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8c156b10 con 0x7fad8c067ec0 2023-10-08T16:10:51.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.199+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8c1570d0 con 0x7fad8c067ec0 2023-10-08T16:10:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.200+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad8c04c3c0 con 0x7fad8c067ec0 2023-10-08T16:10:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.201+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fad8001b400 con 0x7fad8c067ec0 2023-10-08T16:10:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.202+0000 7fad88ff9700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 0x7fad70069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.202+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fad80083e50 con 0x7fad8c067ec0 2023-10-08T16:10:51.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.202+0000 7fad8bfff700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 0x7fad70069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.203+0000 7fad8bfff700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 0x7fad70069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0cbbe0 tx=0x7fad78008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.206+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad800512f0 con 0x7fad8c067ec0 2023-10-08T16:10:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.435+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad8c169360 con 0x7fad70066dd0 2023-10-08T16:10:51.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.514+0000 7fad88ff9700 1 -- 172.21.15.12:0/1634911560 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fad8c169360 con 0x7fad70066dd0 2023-10-08T16:10:51.515 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir1 2023-10-08T16:10:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 msgr2=0x7fad70069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 0x7fad70069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0cbbe0 tx=0x7fad78008040 comp rx=0 tx=0).stop 2023-10-08T16:10:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 msgr2=0x7fad8c154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad8000c7c0 tx=0x7fad80007e00 comp rx=0 tx=0).stop 2023-10-08T16:10:51.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 shutdown_connections 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad70066dd0 0x7fad70069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad8c067ec0 0x7fad8c154470 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad8c1597d0 0x7fad8c0c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 --2- 172.21.15.12:0/1634911560 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad8c0c7760 0x7fad8c0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 >> 172.21.15.12:0/1634911560 conn(0x7fad8c06f330 msgr2=0x7fad8c06a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 shutdown_connections 2023-10-08T16:10:51.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.516+0000 7fad91f9d700 1 -- 172.21.15.12:0/1634911560 wait complete. 2023-10-08T16:10:51.535 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-10-08T16:10:51.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:51.535 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-10-08T16:10:51.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-10-08T16:10:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.808+0000 7fe4f199d700 1 Processor -- start 2023-10-08T16:10:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.808+0000 7fe4f199d700 1 -- start start 2023-10-08T16:10:51.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4ec0c2a90 0x7fe4ec156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec1579b0 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4ec0c1390 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.809+0000 7fe4f199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec1573f0 con 0x7fe4ec0c8200 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54944/0 (socket says 172.21.15.12:54944) 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 -- 172.21.15.12:0/4055228657 learned_addr learned my addr 172.21.15.12:0/4055228657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f099b700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4ebfff700 1 --2- 172.21.15.12:0/4055228657 >> v2:172.21.15.29:3300/0 conn(0x7fe4ec0c2a90 0x7fe4ec156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 -- 172.21.15.12:0/4055228657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 msgr2=0x7fe4ec0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 -- 172.21.15.12:0/4055228657 >> v2:172.21.15.29:3300/0 conn(0x7fe4ec0c2a90 msgr2=0x7fe4ec156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 --2- 172.21.15.12:0/4055228657 >> v2:172.21.15.29:3300/0 conn(0x7fe4ec0c2a90 0x7fe4ec156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 -- 172.21.15.12:0/4055228657 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec1576d0 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4f119c700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0c9dd0 tx=0x7fe4e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515c67a6cdc1c554 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.810+0000 7fe4eb7fe700 1 -- 172.21.15.12:0/4055228657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e400e070 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4eb7fe700 1 -- 172.21.15.12:0/4055228657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e400ba50 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4eb7fe700 1 -- 172.21.15.12:0/4055228657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e40092e0 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 -- 172.21.15.12:0/4055228657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c85d0 msgr2=0x7fe4ec0cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec0c9dd0 tx=0x7fe4e4009840 comp rx=0 tx=0).stop 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 -- 172.21.15.12:0/4055228657 shutdown_connections 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0cc2f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 --2- 172.21.15.12:0/4055228657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 --2- 172.21.15.12:0/4055228657 >> v2:172.21.15.29:3300/0 conn(0x7fe4ec0c2a90 0x7fe4ec156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 -- 172.21.15.12:0/4055228657 >> 172.21.15.12:0/4055228657 conn(0x7fe4ec06c6a0 msgr2=0x7fe4ec06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 -- 172.21.15.12:0/4055228657 shutdown_connections 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.811+0000 7fe4f199d700 1 -- 172.21.15.12:0/4055228657 wait complete. 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.813+0000 7fe4f199d700 1 Processor -- start 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.813+0000 7fe4f199d700 1 -- start start 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec14af60 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec14f8c0 con 0x7fe4ec0c85d0 2023-10-08T16:10:51.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4ec14fba0 con 0x7fe4ec0c8200 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54950/0 (socket says 172.21.15.12:54950) 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 -- 172.21.15.12:0/1726816373 learned_addr learned my addr 172.21.15.12:0/1726816373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 -- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 msgr2=0x7fe4ec14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4ebfff700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f119c700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 -- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 msgr2=0x7fe4ec0b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f099b700 1 -- 172.21.15.12:0/1726816373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e4009ae0 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4ebfff700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.814+0000 7fe4f119c700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4f099b700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000d890 tx=0x7fe4e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000b600 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e000b760 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4ec14fe80 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e000bae0 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.815+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4ec13d140 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.816+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4ec06d300 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.817+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 9) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fe4e001e460 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.818+0000 7fe4e8ff9700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 0x7fe4d0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.818+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe4e0084ac0 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.819+0000 7fe4ebfff700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 0x7fe4d0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:51.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.819+0000 7fe4ebfff700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 0x7fe4d0069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:51.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.823+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4e0051e10 con 0x7fe4ec0c2a90 2023-10-08T16:10:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:51.930+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fe4e00521e0 con 0x7fe4ec0c2a90 2023-10-08T16:10:52.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.053+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4ec14b0a0 con 0x7fe4d0066dd0 2023-10-08T16:10:52.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.132+0000 7fe4e8ff9700 1 -- 172.21.15.12:0/1726816373 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe4d80097d0 con 0x7fe4d0066dd0 2023-10-08T16:10:52.133 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir2 2023-10-08T16:10:52.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 msgr2=0x7fe4d0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 0x7fe4d0069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8006fd0 tx=0x7fe4d8008040 comp rx=0 tx=0).stop 2023-10-08T16:10:52.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 msgr2=0x7fe4ec13cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fe4e000d890 tx=0x7fe4e0008040 comp rx=0 tx=0).stop 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 shutdown_connections 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe4d0066dd0 0x7fe4d0069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4ec0c2a90 0x7fe4ec13cc00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4ec0c85d0 0x7fe4ec0b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 --2- 172.21.15.12:0/1726816373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4ec0c8200 0x7fe4ec14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 >> 172.21.15.12:0/1726816373 conn(0x7fe4ec06c6a0 msgr2=0x7fe4ec0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 shutdown_connections 2023-10-08T16:10:52.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.134+0000 7fe4f199d700 1 -- 172.21.15.12:0/1726816373 wait complete. 2023-10-08T16:10:52.152 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-10-08T16:10:52.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:52.153 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-10-08T16:10:52.192 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-10-08T16:10:52.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.423+0000 7f2fdbdff700 1 Processor -- start 2023-10-08T16:10:52.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.423+0000 7f2fdbdff700 1 -- start start 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fdbdff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 0x7f2fd406b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fdbdff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2fd406bcc0 0x7f2fd40ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fdbdff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd406b2f0 con 0x7f2fd4156480 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fdbdff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd4157b60 con 0x7f2fd406bcc0 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fdbdff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd406ace0 con 0x7f2fd4157710 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fda39c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2fd406bcc0 0x7f2fd40ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fda39c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2fd406bcc0 0x7f2fd40ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51096/0 (socket says 172.21.15.12:51096) 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fda39c700 1 -- 172.21.15.12:0/3088520848 learned_addr learned my addr 172.21.15.12:0/3088520848 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:52.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.425+0000 7f2fd939a700 1 --2- 172.21.15.12:0/3088520848 >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 0x7f2fd406b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fda39c700 1 -- 172.21.15.12:0/3088520848 >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 msgr2=0x7f2fd406b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fda39c700 1 --2- 172.21.15.12:0/3088520848 >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 0x7f2fd406b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fda39c700 1 -- 172.21.15.12:0/3088520848 >> v1:172.21.15.29:6789/0 conn(0x7f2fd4156480 legacy=0x7f2fd40c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fda39c700 1 -- 172.21.15.12:0/3088520848 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40c8310 con 0x7f2fd406bcc0 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fd939a700 1 --2- 172.21.15.12:0/3088520848 >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 0x7f2fd406b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fda39c700 1 --2- 172.21.15.12:0/3088520848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd406bcc0 0x7f2fd40ae140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40645e0 tx=0x7f2fcc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77470c59d61798d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fd8b99700 1 -- 172.21.15.12:0/3088520848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc00e070 con 0x7f2fd406bcc0 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fd8b99700 1 -- 172.21.15.12:0/3088520848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc00ba10 con 0x7f2fd406bcc0 2023-10-08T16:10:52.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.426+0000 7f2fd8b99700 1 -- 172.21.15.12:0/3088520848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0092e0 con 0x7f2fd406bcc0 2023-10-08T16:10:52.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 -- 172.21.15.12:0/3088520848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd406bcc0 msgr2=0x7f2fd40ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/3088520848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd406bcc0 0x7f2fd40ae140 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2fd40645e0 tx=0x7f2fcc009840 comp rx=0 tx=0).stop 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 -- 172.21.15.12:0/3088520848 shutdown_connections 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/3088520848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd406bcc0 0x7f2fd40ae140 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/3088520848 >> v2:172.21.15.29:3300/0 conn(0x7f2fd4157710 0x7f2fd406b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 -- 172.21.15.12:0/3088520848 >> 172.21.15.12:0/3088520848 conn(0x7f2fd406d170 msgr2=0x7f2fd40cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 -- 172.21.15.12:0/3088520848 shutdown_connections 2023-10-08T16:10:52.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.427+0000 7f2fdbdff700 1 -- 172.21.15.12:0/3088520848 wait complete. 2023-10-08T16:10:52.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.428+0000 7f2fdbdff700 1 Processor -- start 2023-10-08T16:10:52.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.428+0000 7f2fdbdff700 1 -- start start 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 0x7f2fd41383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 0x7f2fd40af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40c3ae0 con 0x7f2fd4157710 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40c3d30 con 0x7f2fd406bcc0 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.429+0000 7f2fdbdff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40c4010 con 0x7f2fd4156480 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51098/0 (socket says 172.21.15.12:51098) 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 -- 172.21.15.12:0/2035613933 learned_addr learned my addr 172.21.15.12:0/2035613933 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:52.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fd939a700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 0x7f2fd40af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fd9b9b700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 0x7f2fd41383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 -- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 msgr2=0x7f2fd40af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 0x7f2fd40af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 -- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 msgr2=0x7f2fd41383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 0x7f2fd41383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 -- 172.21.15.12:0/2035613933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009ae0 con 0x7f2fd4157710 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fd9b9b700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 0x7f2fd41383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fd939a700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 0x7f2fd40af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fda39c700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2fd406d5c0 tx=0x7f2fcc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.430+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0032f0 con 0x7f2fd4157710 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.431+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc012e60 con 0x7f2fd4157710 2023-10-08T16:10:52.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.431+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc01d670 con 0x7f2fd4157710 2023-10-08T16:10:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.431+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd40c42f0 con 0x7f2fd4157710 2023-10-08T16:10:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.431+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd4138920 con 0x7f2fd4157710 2023-10-08T16:10:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.432+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40c4810 con 0x7f2fd4157710 2023-10-08T16:10:52.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.432+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f2fcc01daa0 con 0x7f2fd4157710 2023-10-08T16:10:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.433+0000 7f2fc9ffb700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 0x7f2fb80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.433+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f2fcc086450 con 0x7f2fd4157710 2023-10-08T16:10:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.434+0000 7f2fd9b9b700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 0x7f2fb80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:52.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.434+0000 7f2fd9b9b700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 0x7f2fb80695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0007fd0 tx=0x7f2fd0009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:52.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.438+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fd40c4810 con 0x7f2fd4157710 2023-10-08T16:10:52.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.668+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fd40c4810 con 0x7f2fb8067130 2023-10-08T16:10:52.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.740+0000 7f2fc9ffb700 1 -- 172.21.15.12:0/2035613933 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f2fd40c4810 con 0x7f2fb8067130 2023-10-08T16:10:52.741 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir3 2023-10-08T16:10:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 msgr2=0x7f2fb80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 0x7f2fb80695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0007fd0 tx=0x7f2fd0009040 comp rx=0 tx=0).stop 2023-10-08T16:10:52.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 msgr2=0x7f2fd40af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2fd406d5c0 tx=0x7f2fcc017000 comp rx=0 tx=0).stop 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 shutdown_connections 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2fb8067130 0x7f2fb80695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd4157710 0x7f2fd40af5d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd406bcc0 0x7f2fd41383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 --2- 172.21.15.12:0/2035613933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd4156480 0x7f2fd40af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 >> 172.21.15.12:0/2035613933 conn(0x7f2fd406d170 msgr2=0x7f2fd414f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 shutdown_connections 2023-10-08T16:10:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:52.742+0000 7f2fdbdff700 1 -- 172.21.15.12:0/2035613933 wait complete. 2023-10-08T16:10:52.760 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-10-08T16:10:52.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:52.761 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-10-08T16:10:52.799 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-10-08T16:10:53.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.031+0000 7f8be2b9d700 1 Processor -- start 2023-10-08T16:10:53.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.031+0000 7f8be2b9d700 1 -- start start 2023-10-08T16:10:53.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 0x7f8bdc0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be2b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8bdc157750 0x7f8bdc0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be2b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bdc0c8680 con 0x7f8bdc157380 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be2b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc06a7f0 con 0x7f8bdc157750 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc15b6a0 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be1b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8bdc157380 0x7f8bdc1585f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40444/0 (socket says 172.21.15.12:40444) 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be1b9b700 1 -- 172.21.15.12:0/1656610439 learned_addr learned my addr 172.21.15.12:0/1656610439 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be139a700 1 --2- 172.21.15.12:0/1656610439 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 0x7f8bdc0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be239c700 1 --2- 172.21.15.12:0/1656610439 >> v2:172.21.15.29:3300/0 conn(0x7f8bdc157750 0x7f8bdc0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.033+0000 7f8be0b99700 1 -- 172.21.15.12:0/1656610439 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896731118 0 0) 0x7f8bdc0c8680 con 0x7f8bdc157380 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be0b99700 1 -- 172.21.15.12:0/1656610439 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bc8003570 con 0x7f8bdc157380 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be139a700 1 -- 172.21.15.12:0/1656610439 >> v2:172.21.15.29:3300/0 conn(0x7f8bdc157750 msgr2=0x7f8bdc0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be139a700 1 --2- 172.21.15.12:0/1656610439 >> v2:172.21.15.29:3300/0 conn(0x7f8bdc157750 0x7f8bdc0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be139a700 1 -- 172.21.15.12:0/1656610439 >> v1:172.21.15.12:6789/0 conn(0x7f8bdc157380 legacy=0x7f8bdc1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be139a700 1 -- 172.21.15.12:0/1656610439 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc15b980 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be139a700 1 --2- 172.21.15.12:0/1656610439 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 0x7f8bdc0c6b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0098e0 tx=0x7f8bcc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426688e5a9b24d8c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be0b99700 1 -- 172.21.15.12:0/1656610439 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc011630 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be0b99700 1 -- 172.21.15.12:0/1656610439 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bcc011790 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.034+0000 7f8be0b99700 1 -- 172.21.15.12:0/1656610439 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bcc011b30 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 -- 172.21.15.12:0/1656610439 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 msgr2=0x7f8bdc0c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/1656610439 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 0x7f8bdc0c6b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc0098e0 tx=0x7f8bcc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 -- 172.21.15.12:0/1656610439 shutdown_connections 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/1656610439 >> v2:172.21.15.29:3300/0 conn(0x7f8bdc157750 0x7f8bdc0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/1656610439 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc15b1a0 0x7f8bdc0c6b60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 -- 172.21.15.12:0/1656610439 >> 172.21.15.12:0/1656610439 conn(0x7f8bdc06c6a0 msgr2=0x7f8bdc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 -- 172.21.15.12:0/1656610439 shutdown_connections 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.035+0000 7f8be2b9d700 1 -- 172.21.15.12:0/1656610439 wait complete. 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.036+0000 7f8be2b9d700 1 Processor -- start 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 -- start start 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc157380 0x7f8bdc0acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc157750 0x7f8bdc0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0b0210 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0af600 con 0x7f8bdc157380 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.037+0000 7f8be2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0af8e0 con 0x7f8bdc157750 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51100/0 (socket says 172.21.15.12:51100) 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 -- 172.21.15.12:0/2530102119 learned_addr learned my addr 172.21.15.12:0/2530102119 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be139a700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc157750 0x7f8bdc0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be1b9b700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc157380 0x7f8bdc0acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 -- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc157750 msgr2=0x7f8bdc0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc157750 0x7f8bdc0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 -- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc157380 msgr2=0x7f8bdc0acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc157380 0x7f8bdc0acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.038+0000 7f8be239c700 1 -- 172.21.15.12:0/2530102119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bcc009420 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8be239c700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009e90 tx=0x7f8bd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400cc00 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc0afbc0 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400f040 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4014480 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.039+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc146020 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.040+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bdc0b0380 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.041+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f8bd4014830 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.042+0000 7f8bd1ffb700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 0x7f8bc00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.042+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8bd4085620 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.042+0000 7f8be1b9b700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 0x7f8bc00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.043+0000 7f8be1b9b700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 0x7f8bc00695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007fd0 tx=0x7f8bd8009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.046+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bd4055df0 con 0x7f8bdc15b1a0 2023-10-08T16:10:53.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.281+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bdc04c3c0 con 0x7f8bc0067130 2023-10-08T16:10:53.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.355+0000 7f8bd1ffb700 1 -- 172.21.15.12:0/2530102119 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f8bdc04c3c0 con 0x7f8bc0067130 2023-10-08T16:10:53.357 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir4 2023-10-08T16:10:53.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 msgr2=0x7f8bc00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 0x7f8bc00695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bd8007fd0 tx=0x7f8bd8009040 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 msgr2=0x7f8bdc145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009e90 tx=0x7f8bd400b040 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 shutdown_connections 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8bc0067130 0x7f8bc00695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bdc15b1a0 0x7f8bdc145ae0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bdc157380 0x7f8bdc0acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 --2- 172.21.15.12:0/2530102119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bdc157750 0x7f8bdc0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 >> 172.21.15.12:0/2530102119 conn(0x7f8bdc06c6a0 msgr2=0x7f8bdc152960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 shutdown_connections 2023-10-08T16:10:53.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.358+0000 7f8be2b9d700 1 -- 172.21.15.12:0/2530102119 wait complete. 2023-10-08T16:10:53.376 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-10-08T16:10:53.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:53.377 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-10-08T16:10:53.416 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-10-08T16:10:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.647+0000 7f9f2499d700 1 Processor -- start 2023-10-08T16:10:53.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.647+0000 7f9f2499d700 1 -- start start 2023-10-08T16:10:53.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.648+0000 7f9f2499d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f20153660 0x7f9f200c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.648+0000 7f9f2499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.648+0000 7f9f2499d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f200c2200 con 0x7f9f200c8980 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.648+0000 7f9f2499d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f20157250 con 0x7f9f20153660 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.648+0000 7f9f2499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200c15f0 con 0x7f9f20153a30 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f20153660 0x7f9f200c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f20153660 0x7f9f200c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51116/0 (socket says 172.21.15.12:51116) 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2161833654 learned_addr learned my addr 172.21.15.12:0/2161833654 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:53.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1effd700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2161833654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 msgr2=0x7f9f20156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2161833654 >> v1:172.21.15.29:6789/0 conn(0x7f9f200c8980 legacy=0x7f9f200c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2161833654 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f200c18d0 con 0x7f9f20153660 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.649+0000 7f9f1f7fe700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f20153660 0x7f9f200c0ef0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9f100099b0 tx=0x7f9f10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b78ca11607ce0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f1e7fc700 1 -- 172.21.15.12:0/2161833654 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000b860 con 0x7f9f20153660 2023-10-08T16:10:53.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f1e7fc700 1 -- 172.21.15.12:0/2161833654 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f1000b9c0 con 0x7f9f20153660 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f1e7fc700 1 -- 172.21.15.12:0/2161833654 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000bd60 con 0x7f9f20153660 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 -- 172.21.15.12:0/2161833654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f20153660 msgr2=0x7f9f200c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f20153660 0x7f9f200c0ef0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f9f100099b0 tx=0x7f9f10009250 comp rx=0 tx=0).stop 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 -- 172.21.15.12:0/2161833654 shutdown_connections 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f20153660 0x7f9f200c0ef0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2161833654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 -- 172.21.15.12:0/2161833654 >> 172.21.15.12:0/2161833654 conn(0x7f9f2006c6a0 msgr2=0x7f9f2006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 -- 172.21.15.12:0/2161833654 shutdown_connections 2023-10-08T16:10:53.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.650+0000 7f9f2499d700 1 -- 172.21.15.12:0/2161833654 wait complete. 2023-10-08T16:10:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.652+0000 7f9f2499d700 1 Processor -- start 2023-10-08T16:10:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.652+0000 7f9f2499d700 1 -- start start 2023-10-08T16:10:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f20153660 0x7f9f201502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2013b6f0 con 0x7f9f200c8980 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f200ca180 con 0x7f9f20153660 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f2499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2014de60 con 0x7f9f20153a30 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51130/0 (socket says 172.21.15.12:51130) 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2121571210 learned_addr learned my addr 172.21.15.12:0/2121571210 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 msgr2=0x7f9f20150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f20153660 msgr2=0x7f9f201502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f20153660 0x7f9f201502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.653+0000 7f9f1f7fe700 1 -- 172.21.15.12:0/2121571210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f100094f0 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f1f7fe700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9f20067f90 tx=0x7f9f10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10024440 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f100245c0 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f10024980 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f20150e90 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.654+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f20151450 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.655+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f2004c3c0 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.656+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f9f1001a420 con 0x7f9f200c8980 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.657+0000 7f9f077fe700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 0x7f9f0c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.657+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9f10086820 con 0x7f9f200c8980 2023-10-08T16:10:53.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.657+0000 7f9f1effd700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 0x7f9f0c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:53.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.658+0000 7f9f1effd700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 0x7f9f0c0695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9f2014e410 tx=0x7f9f14008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:53.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.661+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f10053670 con 0x7f9f200c8980 2023-10-08T16:10:53.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.888+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f200ca2c0 con 0x7f9f0c067130 2023-10-08T16:10:53.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.971+0000 7f9f077fe700 1 -- 172.21.15.12:0/2121571210 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9f14009640 con 0x7f9f0c067130 2023-10-08T16:10:53.972 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir5 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.973+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 msgr2=0x7f9f0c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 0x7f9f0c0695e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9f2014e410 tx=0x7f9f14008040 comp rx=0 tx=0).stop 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 msgr2=0x7f9f2014d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9f20067f90 tx=0x7f9f10017000 comp rx=0 tx=0).stop 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 shutdown_connections 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9f0c067130 0x7f9f0c0695e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f200c8980 0x7f9f2014d920 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f20153a30 0x7f9f20150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 --2- 172.21.15.12:0/2121571210 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f20153660 0x7f9f201502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 >> 172.21.15.12:0/2121571210 conn(0x7f9f2006c6a0 msgr2=0x7f9f200c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 shutdown_connections 2023-10-08T16:10:53.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:53.974+0000 7f9f2499d700 1 -- 172.21.15.12:0/2121571210 wait complete. 2023-10-08T16:10:53.991 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-10-08T16:10:53.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:53.992 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-10-08T16:10:54.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-10-08T16:10:54.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.263+0000 7f6cddb9d700 1 Processor -- start 2023-10-08T16:10:54.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.264+0000 7f6cddb9d700 1 -- start start 2023-10-08T16:10:54.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cddb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 0x7f6cd8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cddb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cddb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd81579b0 con 0x7f6cd80c8200 2023-10-08T16:10:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cddb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd80c1390 con 0x7f6cd80c2a90 2023-10-08T16:10:54.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cddb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd81573f0 con 0x7f6cd80c85d0 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cdd39c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cd7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 0x7f6cd8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cdd39c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38540/0 (socket says 172.21.15.12:38540) 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.265+0000 7f6cdd39c700 1 -- 172.21.15.12:0/1610425763 learned_addr learned my addr 172.21.15.12:0/1610425763 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cdd39c700 1 -- 172.21.15.12:0/1610425763 >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 msgr2=0x7f6cd8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cdd39c700 1 --2- 172.21.15.12:0/1610425763 >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 0x7f6cd8156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cdd39c700 1 -- 172.21.15.12:0/1610425763 >> v1:172.21.15.29:6789/0 conn(0x7f6cd80c8200 legacy=0x7f6cd80c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cdd39c700 1 -- 172.21.15.12:0/1610425763 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd81576d0 con 0x7f6cd80c85d0 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cd7fff700 1 --2- 172.21.15.12:0/1610425763 >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 0x7f6cd8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:54.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cdd39c700 1 --2- 172.21.15.12:0/1610425763 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009f20 tx=0x7f6cd0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39526999bddd129d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.266+0000 7f6cd77fe700 1 -- 172.21.15.12:0/1610425763 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd000e070 con 0x7f6cd80c85d0 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cd77fe700 1 -- 172.21.15.12:0/1610425763 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd000b9d0 con 0x7f6cd80c85d0 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cd77fe700 1 -- 172.21.15.12:0/1610425763 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd00092e0 con 0x7f6cd80c85d0 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 -- 172.21.15.12:0/1610425763 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 msgr2=0x7f6cd80cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/1610425763 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6cd0009f20 tx=0x7f6cd0009840 comp rx=0 tx=0).stop 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 -- 172.21.15.12:0/1610425763 shutdown_connections 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/1610425763 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c85d0 0x7f6cd80cc2f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/1610425763 >> v2:172.21.15.29:3300/0 conn(0x7f6cd80c2a90 0x7f6cd8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 -- 172.21.15.12:0/1610425763 >> 172.21.15.12:0/1610425763 conn(0x7f6cd806c6a0 msgr2=0x7f6cd806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 -- 172.21.15.12:0/1610425763 shutdown_connections 2023-10-08T16:10:54.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.267+0000 7f6cddb9d700 1 -- 172.21.15.12:0/1610425763 wait complete. 2023-10-08T16:10:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.269+0000 7f6cddb9d700 1 Processor -- start 2023-10-08T16:10:54.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.269+0000 7f6cddb9d700 1 -- start start 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c2a90 0x7f6cd814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 0x7f6cd814bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80ac6f0 con 0x7f6cd80c8200 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80abae0 con 0x7f6cd80c85d0 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cddb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd80abdc0 con 0x7f6cd80c2a90 2023-10-08T16:10:54.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cd7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51138/0 (socket says 172.21.15.12:51138) 2023-10-08T16:10:54.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cd7fff700 1 -- 172.21.15.12:0/4223550577 learned_addr learned my addr 172.21.15.12:0/4223550577 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:54.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cdcb9b700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c2a90 0x7f6cd814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.270+0000 7f6cdd39c700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 0x7f6cd814bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 -- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c2a90 msgr2=0x7f6cd814f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c2a90 0x7f6cd814f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 -- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 msgr2=0x7f6cd814bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 0x7f6cd814bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 -- 172.21.15.12:0/4223550577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc400b6d0 con 0x7f6cd80c8200 2023-10-08T16:10:54.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cdd39c700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 0x7f6cd814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd7fff700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400e360 tx=0x7f6cc400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4011450 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc40115b0 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd0009ae0 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.271+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc4011950 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.272+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd80ac380 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.273+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd80ac8a0 con 0x7f6cd80c8200 2023-10-08T16:10:54.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.274+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f6cc4011cc0 con 0x7f6cd80c8200 2023-10-08T16:10:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.274+0000 7f6cd4ff9700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 0x7f6cbc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.274+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f6cc4087710 con 0x7f6cd80c8200 2023-10-08T16:10:54.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.275+0000 7f6cdcb9b700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 0x7f6cbc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.275+0000 7f6cdcb9b700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 0x7f6cbc0695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc003a80 tx=0x7f6ccc007ec0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.278+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cd80ac8a0 con 0x7f6cd80c8200 2023-10-08T16:10:54.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.504+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cd80ac8a0 con 0x7f6cbc067130 2023-10-08T16:10:54.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.581+0000 7f6cd4ff9700 1 -- 172.21.15.12:0/4223550577 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6cd80ac8a0 con 0x7f6cbc067130 2023-10-08T16:10:54.582 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir6 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 msgr2=0x7f6cbc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 0x7f6cbc0695e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6ccc003a80 tx=0x7f6ccc007ec0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 msgr2=0x7f6cd80acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6cc400e360 tx=0x7f6cc400b430 comp rx=0 tx=0).stop 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 shutdown_connections 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd80c85d0 0x7f6cd814bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd80c2a90 0x7f6cd814f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6cbc067130 0x7f6cbc0695e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 --2- 172.21.15.12:0/4223550577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cd80c8200 0x7f6cd80acb80 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.583+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 >> 172.21.15.12:0/4223550577 conn(0x7f6cd806c6a0 msgr2=0x7f6cd80c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:54.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.584+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 shutdown_connections 2023-10-08T16:10:54.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.584+0000 7f6cddb9d700 1 -- 172.21.15.12:0/4223550577 wait complete. 2023-10-08T16:10:54.602 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-10-08T16:10:54.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:54.602 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-10-08T16:10:54.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-10-08T16:10:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.873+0000 7f9be299d700 1 Processor -- start 2023-10-08T16:10:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.873+0000 7f9be299d700 1 -- start start 2023-10-08T16:10:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bdc156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9bdc0c85d0 0x7f9bdc0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be299d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bdc1579b0 con 0x7f9bdc0c8200 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bdc0c1390 con 0x7f9bdc0c85d0 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1573f0 con 0x7f9bdc0c2a90 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be199b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9bdc0c8200 0x7f9bdc0c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40450/0 (socket says 172.21.15.12:40450) 2023-10-08T16:10:54.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be199b700 1 -- 172.21.15.12:0/3498287450 learned_addr learned my addr 172.21.15.12:0/3498287450 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be219c700 1 --2- 172.21.15.12:0/3498287450 >> v2:172.21.15.29:3300/0 conn(0x7f9bdc0c85d0 0x7f9bdc0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be119a700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bdc156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441501004 0 0) 0x7f9bdc1579b0 con 0x7f9bdc0c8200 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.875+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bc8003570 con 0x7f9bdc0c8200 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3276557727 0 0) 0x7f9bc8003570 con 0x7f9bdc0c8200 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 msgr2=0x7f9bdc156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bdc156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 >> v2:172.21.15.29:3300/0 conn(0x7f9bdc0c85d0 msgr2=0x7f9bdc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 --2- 172.21.15.12:0/3498287450 >> v2:172.21.15.29:3300/0 conn(0x7f9bdc0c85d0 0x7f9bdc0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc1576d0 con 0x7f9bdc0c8200 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f9bd8001470 con 0x7f9bdc0c8200 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 >> v1:172.21.15.12:6789/0 conn(0x7f9bdc0c8200 legacy=0x7f9bdc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bc8004810 0x7f9bc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc0c1390 con 0x7f9bc8003a60 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc1573f0 con 0x7f9bc8004810 2023-10-08T16:10:54.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc800ba60 con 0x7f9bdc0c2a90 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be199b700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be119a700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bc8004810 0x7f9bc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.876+0000 7f9be219c700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 -- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 msgr2=0x7f9bc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc0c2a90 0x7f9bc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 -- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bc8004810 msgr2=0x7f9bc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bc8004810 0x7f9bc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 -- 172.21.15.12:0/3498287450 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8003570 con 0x7f9bc8003a60 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be199b700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bc8003e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007d00 tx=0x7f9bdc069d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9ad044a9575624 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd800cc50 con 0x7f9bc8003a60 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd800cdf0 con 0x7f9bc8003a60 2023-10-08T16:10:54.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.877+0000 7f9be0999700 1 -- 172.21.15.12:0/3498287450 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8005b70 con 0x7f9bc8003a60 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 -- 172.21.15.12:0/3498287450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 msgr2=0x7f9bc8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 --2- 172.21.15.12:0/3498287450 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bc8003e70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8007d00 tx=0x7f9bdc069d50 comp rx=0 tx=0).stop 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be219c700 1 -- 172.21.15.12:0/3498287450 reap_dead start 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 -- 172.21.15.12:0/3498287450 shutdown_connections 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 -- 172.21.15.12:0/3498287450 >> 172.21.15.12:0/3498287450 conn(0x7f9bdc06c6a0 msgr2=0x7f9bdc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 -- 172.21.15.12:0/3498287450 shutdown_connections 2023-10-08T16:10:54.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.878+0000 7f9be299d700 1 -- 172.21.15.12:0/3498287450 wait complete. 2023-10-08T16:10:54.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.879+0000 7f9be299d700 1 Processor -- start 2023-10-08T16:10:54.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.880+0000 7f9be299d700 1 -- start start 2023-10-08T16:10:54.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.880+0000 7f9be299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.880+0000 7f9be299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bdc14bef0 0x7f9bdc143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc143aa0 0x7f9bdc0ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc0b0450 con 0x7f9bc8003a60 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc143850 con 0x7f9bdc14bef0 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bdc14c380 con 0x7f9bdc143aa0 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51164/0 (socket says 172.21.15.12:51164) 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 -- 172.21.15.12:0/599347899 learned_addr learned my addr 172.21.15.12:0/599347899 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be219c700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc143aa0 0x7f9bdc0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be119a700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bdc14bef0 0x7f9bdc143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 -- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc143aa0 msgr2=0x7f9bdc0ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc143aa0 0x7f9bdc0ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 -- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bdc14bef0 msgr2=0x7f9bdc143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bdc14bef0 0x7f9bdc143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 -- 172.21.15.12:0/599347899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc14c660 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.881+0000 7f9be199b700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80046d0 tx=0x7f9bd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.882+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8022070 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.882+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd8000f50 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.882+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc14c940 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.882+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8007510 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.882+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bdc14cf00 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.883+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bdc04c3c0 con 0x7f9bc8003a60 2023-10-08T16:10:54.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.884+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f9bd8011470 con 0x7f9bc8003a60 2023-10-08T16:10:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.885+0000 7f9bd1ffb700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 0x7f9bc00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.885+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9bd8087f30 con 0x7f9bc8003a60 2023-10-08T16:10:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.885+0000 7f9be119a700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 0x7f9bc00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:54.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.886+0000 7f9be119a700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 0x7f9bc00695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc1504c0 tx=0x7f9bcc008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:54.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:54.889+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bd8054e20 con 0x7f9bc8003a60 2023-10-08T16:10:55.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.118+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bdc0c2280 con 0x7f9bc0067130 2023-10-08T16:10:55.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.179+0000 7f9bd1ffb700 1 -- 172.21.15.12:0/599347899 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9bdc0c2280 con 0x7f9bc0067130 2023-10-08T16:10:55.180 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir7 2023-10-08T16:10:55.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 msgr2=0x7f9bc00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 0x7f9bc00695e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc1504c0 tx=0x7f9bcc008040 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 msgr2=0x7f9bdc14d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80046d0 tx=0x7f9bd8017000 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 shutdown_connections 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9bc0067130 0x7f9bc00695e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9bc8003a60 0x7f9bdc14d420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9bdc143aa0 0x7f9bdc0ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.181+0000 7f9be299d700 1 --2- 172.21.15.12:0/599347899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9bdc14bef0 0x7f9bdc143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.182+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 >> 172.21.15.12:0/599347899 conn(0x7f9bdc06c6a0 msgr2=0x7f9bdc144b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.182+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 shutdown_connections 2023-10-08T16:10:55.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.182+0000 7f9be299d700 1 -- 172.21.15.12:0/599347899 wait complete. 2023-10-08T16:10:55.200 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-10-08T16:10:55.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:55.201 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-10-08T16:10:55.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-10-08T16:10:55.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.472+0000 7f5745d9d700 1 Processor -- start 2023-10-08T16:10:55.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.472+0000 7f5745d9d700 1 -- start start 2023-10-08T16:10:55.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.473+0000 7f5745d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5740142ca0 0x7f574015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.473+0000 7f5745d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57400cb450 0x7f57400cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.473+0000 7f5745d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574015d8d0 con 0x7f5740143070 2023-10-08T16:10:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.473+0000 7f5745d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574015d2f0 con 0x7f57400cb450 2023-10-08T16:10:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.473+0000 7f5745d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cc630 con 0x7f5740142ca0 2023-10-08T16:10:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57400cb450 0x7f57400cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f57400cb450 0x7f57400cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51170/0 (socket says 172.21.15.12:51170) 2023-10-08T16:10:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 -- 172.21.15.12:0/2476804416 learned_addr learned my addr 172.21.15.12:0/2476804416 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f5744d9b700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5740142ca0 0x7f574015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 -- 172.21.15.12:0/2476804416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5740142ca0 msgr2=0x7f574015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5740142ca0 0x7f574015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 -- 172.21.15.12:0/2476804416 >> v1:172.21.15.29:6789/0 conn(0x7f5740143070 legacy=0x7f57400cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 -- 172.21.15.12:0/2476804416 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574015d560 con 0x7f57400cb450 2023-10-08T16:10:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.474+0000 7f574559c700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57400cb450 0x7f57400cbf30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5738009f20 tx=0x7f5738009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf1ca058e480410 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f573f7fe700 1 -- 172.21.15.12:0/2476804416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800e070 con 0x7f57400cb450 2023-10-08T16:10:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f573f7fe700 1 -- 172.21.15.12:0/2476804416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800ba80 con 0x7f57400cb450 2023-10-08T16:10:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f573f7fe700 1 -- 172.21.15.12:0/2476804416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380092e0 con 0x7f57400cb450 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 -- 172.21.15.12:0/2476804416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57400cb450 msgr2=0x7f57400cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57400cb450 0x7f57400cbf30 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5738009f20 tx=0x7f5738009840 comp rx=0 tx=0).stop 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 -- 172.21.15.12:0/2476804416 shutdown_connections 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f57400cb450 0x7f57400cbf30 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 --2- 172.21.15.12:0/2476804416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5740142ca0 0x7f574015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 -- 172.21.15.12:0/2476804416 >> 172.21.15.12:0/2476804416 conn(0x7f5740067c80 msgr2=0x7f5740068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 -- 172.21.15.12:0/2476804416 shutdown_connections 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.475+0000 7f5745d9d700 1 -- 172.21.15.12:0/2476804416 wait complete. 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.477+0000 7f5745d9d700 1 Processor -- start 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.477+0000 7f5745d9d700 1 -- start start 2023-10-08T16:10:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57400cb450 0x7f574016a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 0x7f574016cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400b3e20 con 0x7f5740143070 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574016ada0 con 0x7f5740142ca0 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5745d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400b3210 con 0x7f57400cb450 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51182/0 (socket says 172.21.15.12:51182) 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 -- 172.21.15.12:0/498493615 learned_addr learned my addr 172.21.15.12:0/498493615 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f5744d9b700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57400cb450 0x7f574016a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f573ffff700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 0x7f574016cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 -- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57400cb450 msgr2=0x7f574016a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57400cb450 0x7f574016a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 -- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 msgr2=0x7f574016cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 0x7f574016cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f574559c700 1 -- 172.21.15.12:0/498493615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009ae0 con 0x7f5740143070 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.478+0000 7f573ffff700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 0x7f574016cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f574559c700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5738012000 tx=0x7f5738018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380032f0 con 0x7f5740143070 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5738008e80 con 0x7f5740143070 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400b34f0 con 0x7f5740143070 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738026690 con 0x7f5740143070 2023-10-08T16:10:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.479+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400b3ab0 con 0x7f5740143070 2023-10-08T16:10:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.480+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574004c3c0 con 0x7f5740143070 2023-10-08T16:10:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.481+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f5738003040 con 0x7f5740143070 2023-10-08T16:10:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.482+0000 7f573cff9700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 0x7f57240695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.482+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5738086cc0 con 0x7f5740143070 2023-10-08T16:10:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.482+0000 7f5744d9b700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 0x7f57240695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.483+0000 7f5744d9b700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 0x7f57240695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5734006fd0 tx=0x7f5734008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.486+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f573808d080 con 0x7f5740143070 2023-10-08T16:10:55.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.712+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f57400cb910 con 0x7f5724067130 2023-10-08T16:10:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.779+0000 7f573cff9700 1 -- 172.21.15.12:0/498493615 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f57400cb910 con 0x7f5724067130 2023-10-08T16:10:55.780 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir8 2023-10-08T16:10:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 msgr2=0x7f57240695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 0x7f57240695e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5734006fd0 tx=0x7f5734008040 comp rx=0 tx=0).stop 2023-10-08T16:10:55.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 msgr2=0x7f5740140a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5738012000 tx=0x7f5738018000 comp rx=0 tx=0).stop 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 shutdown_connections 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5724067130 0x7f57240695e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5740143070 0x7f5740140a80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57400cb450 0x7f574016a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 --2- 172.21.15.12:0/498493615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5740142ca0 0x7f574016cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 >> 172.21.15.12:0/498493615 conn(0x7f5740067c80 msgr2=0x7f57400c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 shutdown_connections 2023-10-08T16:10:55.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:55.781+0000 7f5745d9d700 1 -- 172.21.15.12:0/498493615 wait complete. 2023-10-08T16:10:55.800 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-10-08T16:10:55.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:10:55.800 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-10-08T16:10:55.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-10-08T16:10:56.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.072+0000 7efdc579d700 1 Processor -- start 2023-10-08T16:10:56.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.072+0000 7efdc579d700 1 -- start start 2023-10-08T16:10:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc579d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdc00c85d0 0x7efdc00cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc579d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdc01579b0 con 0x7efdc00c8200 2023-10-08T16:10:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc579d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdc00c1390 con 0x7efdc00c85d0 2023-10-08T16:10:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc01573f0 con 0x7efdc00c2a90 2023-10-08T16:10:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdc4f9c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efdc00c85d0 0x7efdc00cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdbffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7efdc00c8200 0x7efdc00c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:39344/0 (socket says 172.21.15.12:39344) 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdbffff700 1 -- 172.21.15.12:0/2026280393 learned_addr learned my addr 172.21.15.12:0/2026280393 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.074+0000 7efdbf7fe700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdc4f9c700 1 -- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 msgr2=0x7efdc0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdc4f9c700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdc4f9c700 1 -- 172.21.15.12:0/2026280393 >> v1:172.21.15.29:6789/0 conn(0x7efdc00c8200 legacy=0x7efdc00c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdc4f9c700 1 -- 172.21.15.12:0/2026280393 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc01576d0 con 0x7efdc00c85d0 2023-10-08T16:10:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdc4f9c700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c85d0 0x7efdc00cc2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009e60 tx=0x7efdb8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8031f896a0a92e0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.075+0000 7efdbeffd700 1 -- 172.21.15.12:0/2026280393 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb800e070 con 0x7efdc00c85d0 2023-10-08T16:10:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdbeffd700 1 -- 172.21.15.12:0/2026280393 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb800bb60 con 0x7efdc00c85d0 2023-10-08T16:10:56.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdbeffd700 1 -- 172.21.15.12:0/2026280393 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8012430 con 0x7efdc00c85d0 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 -- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c85d0 msgr2=0x7efdc00cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c85d0 0x7efdc00cc2f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efdb8009e60 tx=0x7efdb8009780 comp rx=0 tx=0).stop 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 -- 172.21.15.12:0/2026280393 shutdown_connections 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c85d0 0x7efdc00cc2f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 --2- 172.21.15.12:0/2026280393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 -- 172.21.15.12:0/2026280393 >> 172.21.15.12:0/2026280393 conn(0x7efdc006c6a0 msgr2=0x7efdc006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 -- 172.21.15.12:0/2026280393 shutdown_connections 2023-10-08T16:10:56.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.076+0000 7efdc579d700 1 -- 172.21.15.12:0/2026280393 wait complete. 2023-10-08T16:10:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.078+0000 7efdc579d700 1 Processor -- start 2023-10-08T16:10:56.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.078+0000 7efdc579d700 1 -- start start 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c8200 0x7efdc00ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00accc0 con 0x7efdc00c85d0 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00ac0b0 con 0x7efdc00c8200 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdc00ac390 con 0x7efdc00c2a90 2023-10-08T16:10:56.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51184/0 (socket says 172.21.15.12:51184) 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 -- 172.21.15.12:0/1404863046 learned_addr learned my addr 172.21.15.12:0/1404863046 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdbffff700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdbf7fe700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c8200 0x7efdc00ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 -- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 msgr2=0x7efdc0148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 -- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c8200 msgr2=0x7efdc00ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.079+0000 7efdc4f9c700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c8200 0x7efdc00ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efdc4f9c700 1 -- 172.21.15.12:0/1404863046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8009a20 con 0x7efdc00c85d0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efdc4f9c700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efdc00697c0 tx=0x7efdb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb8027470 con 0x7efdc00c85d0 2023-10-08T16:10:56.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdb80275f0 con 0x7efdc00c85d0 2023-10-08T16:10:56.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdb80279b0 con 0x7efdc00c85d0 2023-10-08T16:10:56.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdc00ac670 con 0x7efdc00c85d0 2023-10-08T16:10:56.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.080+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdc0148640 con 0x7efdc00c85d0 2023-10-08T16:10:56.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.081+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdc00ace70 con 0x7efdc00c85d0 2023-10-08T16:10:56.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.082+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7efdb8024070 con 0x7efdc00c85d0 2023-10-08T16:10:56.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.083+0000 7efda7fff700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 0x7efdac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.083+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7efdb8087440 con 0x7efdc00c85d0 2023-10-08T16:10:56.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.083+0000 7efdbffff700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 0x7efdac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.084+0000 7efdbffff700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 0x7efdac0695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007130 tx=0x7efdb0007eb0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.088+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdc00ace70 con 0x7efdc00c85d0 2023-10-08T16:10:56.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.317+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7efdc004c3c0 con 0x7efdac067130 2023-10-08T16:10:56.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.382+0000 7efda7fff700 1 -- 172.21.15.12:0/1404863046 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7efdc004c3c0 con 0x7efdac067130 2023-10-08T16:10:56.385 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/dir9 2023-10-08T16:10:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 msgr2=0x7efdac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 0x7efdac0695e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7efdb0007130 tx=0x7efdb0007eb0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 msgr2=0x7efdc00ad150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7efdc00697c0 tx=0x7efdb8019000 comp rx=0 tx=0).stop 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 shutdown_connections 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7efdac067130 0x7efdac0695e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdc00c85d0 0x7efdc00ad150 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdc00c2a90 0x7efdc0148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 --2- 172.21.15.12:0/1404863046 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdc00c8200 0x7efdc00ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 >> 172.21.15.12:0/1404863046 conn(0x7efdc006c6a0 msgr2=0x7efdc0158590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 shutdown_connections 2023-10-08T16:10:56.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.384+0000 7efdc579d700 1 -- 172.21.15.12:0/1404863046 wait complete. 2023-10-08T16:10:56.402 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-10-08T16:10:56.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-08T16:10:56.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.593+0000 7f04e93ff700 1 Processor -- start 2023-10-08T16:10:56.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.594+0000 7f04e93ff700 1 -- start start 2023-10-08T16:10:56.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e93ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 0x7f04e4157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e93ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e93ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e406b2f0 con 0x7f04e406bcc0 2023-10-08T16:10:56.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e93ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e406ace0 con 0x7f04e4156480 2023-10-08T16:10:56.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e93ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40c8310 con 0x7f04e40c7b30 2023-10-08T16:10:56.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e2ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 0x7f04e4157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e27fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e27fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38636/0 (socket says 172.21.15.12:38636) 2023-10-08T16:10:56.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f04e406bcc0 0x7f04e40ae140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:39352/0 (socket says 172.21.15.12:39352) 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.595+0000 7f04e27fc700 1 -- 172.21.15.12:0/4196446578 learned_addr learned my addr 172.21.15.12:0/4196446578 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e1ffb700 1 -- 172.21.15.12:0/4196446578 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360472698 0 0) 0x7f04e406b2f0 con 0x7f04e406bcc0 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e1ffb700 1 -- 172.21.15.12:0/4196446578 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc003570 con 0x7f04e406bcc0 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e27fc700 1 -- 172.21.15.12:0/4196446578 >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 msgr2=0x7f04e4157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e27fc700 1 --2- 172.21.15.12:0/4196446578 >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 0x7f04e4157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e27fc700 1 -- 172.21.15.12:0/4196446578 >> v1:172.21.15.29:6789/0 conn(0x7f04e406bcc0 legacy=0x7f04e40ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e27fc700 1 -- 172.21.15.12:0/4196446578 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40c85f0 con 0x7f04e40c7b30 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e2ffd700 1 --2- 172.21.15.12:0/4196446578 >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 0x7f04e4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.596+0000 7f04e27fc700 1 --2- 172.21.15.12:0/4196446578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a887745e0b33e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e1ffb700 1 -- 172.21.15.12:0/4196446578 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800b680 con 0x7f04e40c7b30 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e1ffb700 1 -- 172.21.15.12:0/4196446578 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800b7e0 con 0x7f04e40c7b30 2023-10-08T16:10:56.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e1ffb700 1 -- 172.21.15.12:0/4196446578 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800bb80 con 0x7f04e40c7b30 2023-10-08T16:10:56.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 -- 172.21.15.12:0/4196446578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 msgr2=0x7f04e406b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 --2- 172.21.15.12:0/4196446578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f04d80099b0 tx=0x7f04d8009250 comp rx=0 tx=0).stop 2023-10-08T16:10:56.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 -- 172.21.15.12:0/4196446578 shutdown_connections 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 --2- 172.21.15.12:0/4196446578 >> v2:172.21.15.29:3300/0 conn(0x7f04e4156480 0x7f04e4157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 --2- 172.21.15.12:0/4196446578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e40c7b30 0x7f04e406b780 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 -- 172.21.15.12:0/4196446578 >> 172.21.15.12:0/4196446578 conn(0x7f04e406d170 msgr2=0x7f04e40cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 -- 172.21.15.12:0/4196446578 shutdown_connections 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.597+0000 7f04e93ff700 1 -- 172.21.15.12:0/4196446578 wait complete. 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.599+0000 7f04e93ff700 1 Processor -- start 2023-10-08T16:10:56.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.599+0000 7f04e93ff700 1 -- start start 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 0x7f04e4143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 0x7f04e40b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41443d0 con 0x7f04e40c7b30 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e414a910 con 0x7f04e4156480 2023-10-08T16:10:56.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e93ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e4149a60 con 0x7f04e406bcc0 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51198/0 (socket says 172.21.15.12:51198) 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e27fc700 1 -- 172.21.15.12:0/1286540409 learned_addr learned my addr 172.21.15.12:0/1286540409 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e2ffd700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 0x7f04e4143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.600+0000 7f04e37fe700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 0x7f04e40b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 -- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 msgr2=0x7f04e4143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 0x7f04e4143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 -- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 msgr2=0x7f04e40b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 0x7f04e40b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 -- 172.21.15.12:0/1286540409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d4009420 con 0x7f04e40c7b30 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e2ffd700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 0x7f04e4143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e37fe700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 0x7f04e40b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:56.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e27fc700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009290 tx=0x7f04d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d800b950 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d800bab0 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d801a680 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d80094f0 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.601+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e4149fe0 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.602+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e404c3c0 con 0x7f04e40c7b30 2023-10-08T16:10:56.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.603+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f04d801aa30 con 0x7f04e40c7b30 2023-10-08T16:10:56.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.605+0000 7f04caffd700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 0x7f04d00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:56.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.605+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f04d80867e0 con 0x7f04e40c7b30 2023-10-08T16:10:56.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.605+0000 7f04e2ffd700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 0x7f04d00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:56.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.606+0000 7f04e2ffd700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 0x7f04d00695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04d40093f0 tx=0x7f04d4008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:56.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.609+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04d8053630 con 0x7f04e40c7b30 2023-10-08T16:10:56.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.839+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f04e406af80 con 0x7f04d0067130 2023-10-08T16:10:56.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.887+0000 7f04caffd700 1 -- 172.21.15.12:0/1286540409 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f04e406af80 con 0x7f04d0067130 2023-10-08T16:10:56.888 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-10-08T16:10:56.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 msgr2=0x7f04d00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 0x7f04d00695e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f04d40093f0 tx=0x7f04d4008040 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 msgr2=0x7f04e40c5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f04d8009290 tx=0x7f04d8017000 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 shutdown_connections 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04e4156480 0x7f04e40b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04e406bcc0 0x7f04e4143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f04d0067130 0x7f04d00695e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 --2- 172.21.15.12:0/1286540409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04e40c7b30 0x7f04e40c5550 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 >> 172.21.15.12:0/1286540409 conn(0x7f04e406d170 msgr2=0x7f04e414c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.889+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 shutdown_connections 2023-10-08T16:10:56.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:56.890+0000 7f04e93ff700 1 -- 172.21.15.12:0/1286540409 wait complete. 2023-10-08T16:10:56.908 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-10-08T16:10:56.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-08T16:10:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.101+0000 7fd53b59d700 1 Processor -- start 2023-10-08T16:10:57.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.101+0000 7fd53b59d700 1 -- start start 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 0x7fd53406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53b59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53406d040 con 0x7fd53415cb90 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53b59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340c2fa0 con 0x7fd53406cbe0 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340ccdf0 con 0x7fd5340c7870 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53a59b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd53415cb90 0x7fd53415dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40466/0 (socket says 172.21.15.12:40466) 2023-10-08T16:10:57.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd53a59b700 1 -- 172.21.15.12:0/1780785790 learned_addr learned my addr 172.21.15.12:0/1780785790 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539d9a700 1 --2- 172.21.15.12:0/1780785790 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 0x7fd53406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670807223 0 0) 0x7fd530001110 con 0x7fd53415cb90 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd520003570 con 0x7fd53415cb90 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3738702386 0 0) 0x7fd520003570 con 0x7fd53415cb90 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539d9a700 1 -- 172.21.15.12:0/1780785790 >> v1:172.21.15.29:6789/0 conn(0x7fd53406cbe0 legacy=0x7fd5340c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539d9a700 1 -- 172.21.15.12:0/1780785790 >> v1:172.21.15.12:6789/0 conn(0x7fd53415cb90 legacy=0x7fd53415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539d9a700 1 -- 172.21.15.12:0/1780785790 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340c7ce0 con 0x7fd5340c7870 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539d9a700 1 --2- 172.21.15.12:0/1780785790 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 0x7fd53406c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd5240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad42577b07f47cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530001600 con 0x7fd5340c7870 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd524011420 con 0x7fd5340c7870 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.104+0000 7fd539599700 1 -- 172.21.15.12:0/1780785790 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5240117e0 con 0x7fd5340c7870 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 -- 172.21.15.12:0/1780785790 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 msgr2=0x7fd53406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 --2- 172.21.15.12:0/1780785790 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 0x7fd53406c6a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd5240091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 -- 172.21.15.12:0/1780785790 shutdown_connections 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 --2- 172.21.15.12:0/1780785790 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5340c7870 0x7fd53406c6a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 -- 172.21.15.12:0/1780785790 >> 172.21.15.12:0/1780785790 conn(0x7fd5340cd230 msgr2=0x7fd5340cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 -- 172.21.15.12:0/1780785790 shutdown_connections 2023-10-08T16:10:57.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.105+0000 7fd53b59d700 1 -- 172.21.15.12:0/1780785790 wait complete. 2023-10-08T16:10:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.107+0000 7fd53b59d700 1 Processor -- start 2023-10-08T16:10:57.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.107+0000 7fd53b59d700 1 -- start start 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5340c7870 0x7fd53416a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 0x7fd5340c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53416b190 con 0x7fd53406cbe0 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53416b860 con 0x7fd5340c7870 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53416abd0 con 0x7fd53415cb90 2023-10-08T16:10:57.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51214/0 (socket says 172.21.15.12:51214) 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 -- 172.21.15.12:0/695891056 learned_addr learned my addr 172.21.15.12:0/695891056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53ad9c700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 0x7fd5340c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd539d9a700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5340c7870 0x7fd53416a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 -- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 msgr2=0x7fd5340c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 0x7fd5340c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 -- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5340c7870 msgr2=0x7fd53416a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5340c7870 0x7fd53416a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53a59b700 1 -- 172.21.15.12:0/695891056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524009420 con 0x7fd53406cbe0 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.108+0000 7fd53ad9c700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 0x7fd5340c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:57.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd53a59b700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c810 tx=0x7fd530001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530007360 con 0x7fd53406cbe0 2023-10-08T16:10:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5300074c0 con 0x7fd53406cbe0 2023-10-08T16:10:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530004830 con 0x7fd53406cbe0 2023-10-08T16:10:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53416aeb0 con 0x7fd53406cbe0 2023-10-08T16:10:57.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.109+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5341592c0 con 0x7fd53406cbe0 2023-10-08T16:10:57.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.110+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd534067630 con 0x7fd53406cbe0 2023-10-08T16:10:57.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.111+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd530004c40 con 0x7fd53406cbe0 2023-10-08T16:10:57.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.112+0000 7fd52a7fc700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 0x7fd5180695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.112+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd5300840a0 con 0x7fd53406cbe0 2023-10-08T16:10:57.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.112+0000 7fd539d9a700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 0x7fd5180695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.113+0000 7fd539d9a700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 0x7fd5180695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd524009860 tx=0x7fd524016000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.116+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd530050f70 con 0x7fd53406cbe0 2023-10-08T16:10:57.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.348+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd53406d040 con 0x7fd518067130 2023-10-08T16:10:57.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.403+0000 7fd52a7fc700 1 -- 172.21.15.12:0/695891056 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd53406d040 con 0x7fd518067130 2023-10-08T16:10:57.406 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 msgr2=0x7fd5180695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 0x7fd5180695e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd524009860 tx=0x7fd524016000 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 msgr2=0x7fd534158d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd53000c810 tx=0x7fd530001a30 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 shutdown_connections 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd518067130 0x7fd5180695e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd53406cbe0 0x7fd534158d80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd53415cb90 0x7fd5340c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 --2- 172.21.15.12:0/695891056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5340c7870 0x7fd53416a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 >> 172.21.15.12:0/695891056 conn(0x7fd5340cd230 msgr2=0x7fd53415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.405+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 shutdown_connections 2023-10-08T16:10:57.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.406+0000 7fd53b59d700 1 -- 172.21.15.12:0/695891056 wait complete. 2023-10-08T16:10:57.423 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-10-08T16:10:57.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-08T16:10:57.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.615+0000 7f497e19d700 1 Processor -- start 2023-10-08T16:10:57.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.616+0000 7f497e19d700 1 -- start start 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c8200 0x7f49780c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f49780c2a90 0x7f4978156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49780c85d0 0x7f49780cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49781579b0 con 0x7f49780c85d0 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49780c1390 con 0x7f49780c2a90 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49781573f0 con 0x7f49780c8200 2023-10-08T16:10:57.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497d99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49780c85d0 0x7f49780cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497d99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49780c85d0 0x7f49780cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51226/0 (socket says 172.21.15.12:51226) 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497d99c700 1 -- 172.21.15.12:0/936049933 learned_addr learned my addr 172.21.15.12:0/936049933 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497d19b700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c8200 0x7f49780c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.617+0000 7f497c99a700 1 --2- 172.21.15.12:0/936049933 >> v2:172.21.15.29:3300/0 conn(0x7f49780c2a90 0x7f4978156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 -- 172.21.15.12:0/936049933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c8200 msgr2=0x7f49780c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c8200 0x7f49780c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 -- 172.21.15.12:0/936049933 >> v2:172.21.15.29:3300/0 conn(0x7f49780c2a90 msgr2=0x7f4978156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 --2- 172.21.15.12:0/936049933 >> v2:172.21.15.29:3300/0 conn(0x7f49780c2a90 0x7f4978156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 -- 172.21.15.12:0/936049933 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49781576d0 con 0x7f49780c85d0 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f497d99c700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c85d0 0x7f49780cc2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49780c9dd0 tx=0x7f4970009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a99055dbdfc6d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f496ffff700 1 -- 172.21.15.12:0/936049933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497000e070 con 0x7f49780c85d0 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f496ffff700 1 -- 172.21.15.12:0/936049933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497000b930 con 0x7f49780c85d0 2023-10-08T16:10:57.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.618+0000 7f496ffff700 1 -- 172.21.15.12:0/936049933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49700092e0 con 0x7f49780c85d0 2023-10-08T16:10:57.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 -- 172.21.15.12:0/936049933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c85d0 msgr2=0x7f49780cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c85d0 0x7f49780cc2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f49780c9dd0 tx=0x7f4970009840 comp rx=0 tx=0).stop 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 -- 172.21.15.12:0/936049933 shutdown_connections 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c85d0 0x7f49780cc2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 --2- 172.21.15.12:0/936049933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c8200 0x7f49780c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 --2- 172.21.15.12:0/936049933 >> v2:172.21.15.29:3300/0 conn(0x7f49780c2a90 0x7f4978156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 -- 172.21.15.12:0/936049933 >> 172.21.15.12:0/936049933 conn(0x7f497806c6a0 msgr2=0x7f497806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 -- 172.21.15.12:0/936049933 shutdown_connections 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.619+0000 7f497e19d700 1 -- 172.21.15.12:0/936049933 wait complete. 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.620+0000 7f497e19d700 1 Processor -- start 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.621+0000 7f497e19d700 1 -- start start 2023-10-08T16:10:57.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.621+0000 7f497e19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49780c2a90 0x7f49780adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.621+0000 7f497e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.621+0000 7f497e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 0x7f497816a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497e19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49781360c0 con 0x7f49780c8200 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497e19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49780ad810 con 0x7f49780c2a90 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49780ac9a0 con 0x7f49780c85d0 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51234/0 (socket says 172.21.15.12:51234) 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 -- 172.21.15.12:0/4183917264 learned_addr learned my addr 172.21.15.12:0/4183917264 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497d19b700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49780c2a90 0x7f49780adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497d99c700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 0x7f497816a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 -- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 msgr2=0x7f497816a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 0x7f497816a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 -- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49780c2a90 msgr2=0x7f49780adca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49780c2a90 0x7f49780adca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 -- 172.21.15.12:0/4183917264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4970009ae0 con 0x7f49780c8200 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497d99c700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 0x7f497816a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.622+0000 7f497c99a700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f496800ec80 tx=0x7f49680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.623+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496800c9d0 con 0x7f49780c8200 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.623+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496800cb50 con 0x7f49780c8200 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.623+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49780acc40 con 0x7f49780c8200 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.623+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968013470 con 0x7f49780c8200 2023-10-08T16:10:57.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.623+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49780acee0 con 0x7f49780c8200 2023-10-08T16:10:57.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.624+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49780ad9a0 con 0x7f49780c8200 2023-10-08T16:10:57.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.625+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4968013820 con 0x7f49780c8200 2023-10-08T16:10:57.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.626+0000 7f496d7fa700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 0x7f495c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:57.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.626+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f49680850e0 con 0x7f49780c8200 2023-10-08T16:10:57.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.626+0000 7f497d19b700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 0x7f495c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:57.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.627+0000 7f497d19b700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 0x7f495c0695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49780c9a70 tx=0x7f4974008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:57.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.631+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4968051fd0 con 0x7f49780c8200 2023-10-08T16:10:57.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.860+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f497804c3c0 con 0x7f495c067130 2023-10-08T16:10:57.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.915+0000 7f496d7fa700 1 -- 172.21.15.12:0/4183917264 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f497804c3c0 con 0x7f495c067130 2023-10-08T16:10:57.916 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 msgr2=0x7f495c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 0x7f495c0695e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49780c9a70 tx=0x7f4974008040 comp rx=0 tx=0).stop 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 msgr2=0x7f4978135b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f496800ec80 tx=0x7f49680091a0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 shutdown_connections 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49780c85d0 0x7f497816a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49780c2a90 0x7f49780adca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f495c067130 0x7f495c0695e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 --2- 172.21.15.12:0/4183917264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49780c8200 0x7f4978135b80 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:57.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 >> 172.21.15.12:0/4183917264 conn(0x7f497806c6a0 msgr2=0x7f49781592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:57.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 shutdown_connections 2023-10-08T16:10:57.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:57.918+0000 7f497e19d700 1 -- 172.21.15.12:0/4183917264 wait complete. 2023-10-08T16:10:57.936 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-10-08T16:10:57.936 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-08T16:10:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.128+0000 7f7183fff700 1 Processor -- start 2023-10-08T16:10:58.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.129+0000 7f7183fff700 1 -- start start 2023-10-08T16:10:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7183fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f718415cb90 0x7f71840c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7183fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840c2fa0 con 0x7f718415dc10 2023-10-08T16:10:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7183fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71840c2390 con 0x7f718406cdb0 2023-10-08T16:10:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7183fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71840ccdf0 con 0x7f718415cb90 2023-10-08T16:10:58.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f71827fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f718415dc10 0x7f718406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40474/0 (socket says 172.21.15.12:40474) 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f71827fc700 1 -- 172.21.15.12:0/3968927176 learned_addr learned my addr 172.21.15.12:0/3968927176 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7182ffd700 1 --2- 172.21.15.12:0/3968927176 >> v2:172.21.15.29:3300/0 conn(0x7f718415cb90 0x7f71840c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469226342 0 0) 0x7f71840c2fa0 con 0x7f718415dc10 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f716c003570 con 0x7f718415dc10 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3498473544 0 0) 0x7f716c003570 con 0x7f718415dc10 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 >> v2:172.21.15.29:3300/0 conn(0x7f718415cb90 msgr2=0x7f71840c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 --2- 172.21.15.12:0/3968927176 >> v2:172.21.15.29:3300/0 conn(0x7f718415cb90 0x7f71840c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 >> v1:172.21.15.29:6789/0 conn(0x7f718406cdb0 legacy=0x7f71840c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840c2670 con 0x7f718415dc10 2023-10-08T16:10:58.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f7178001470 con 0x7f718415dc10 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 >> v1:172.21.15.12:6789/0 conn(0x7f718415dc10 legacy=0x7f718406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f716c003ab0 0x7f716c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 0x7f716c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c005210 0x7f716c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71840ccdf0 con 0x7f716c004810 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c00c130 con 0x7f716c005210 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c00c2f0 con 0x7f716c003ab0 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.131+0000 7f71827fc700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 0x7f716c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71837fe700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c005210 0x7f716c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f7182ffd700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f716c003ab0 0x7f716c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 -- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f716c003ab0 msgr2=0x7f716c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f716c003ab0 0x7f716c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 -- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c005210 msgr2=0x7f716c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c005210 0x7f716c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 -- 172.21.15.12:0/3968927176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c003570 con 0x7f716c004810 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f7182ffd700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f716c003ab0 0x7f716c003ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71837fe700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c005210 0x7f716c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:58.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71837fe700 1 -- 172.21.15.12:0/3968927176 reap_dead start 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f71827fc700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 0x7f716c004c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f717800c2d0 tx=0x7f7178001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864a079233483b7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717800cba0 con 0x7f716c004810 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800cd00 con 0x7f716c004810 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.132+0000 7f7181ffb700 1 -- 172.21.15.12:0/3968927176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178005b70 con 0x7f716c004810 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 -- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 msgr2=0x7f716c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 0x7f716c004c80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f717800c2d0 tx=0x7f7178001d80 comp rx=0 tx=0).stop 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 -- 172.21.15.12:0/3968927176 shutdown_connections 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 --2- 172.21.15.12:0/3968927176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f716c004810 0x7f716c004c80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 -- 172.21.15.12:0/3968927176 >> 172.21.15.12:0/3968927176 conn(0x7f71840cd230 msgr2=0x7f71840cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 -- 172.21.15.12:0/3968927176 shutdown_connections 2023-10-08T16:10:58.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.133+0000 7f7183fff700 1 -- 172.21.15.12:0/3968927176 wait complete. 2023-10-08T16:10:58.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 Processor -- start 2023-10-08T16:10:58.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 -- start start 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c004810 0x7f71840c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f718414e270 0x7f718414e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718413d820 con 0x7f718416cec0 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718416d680 con 0x7f716c004810 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7183fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718416d960 con 0x7f718414e270 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51258/0 (socket says 172.21.15.12:51258) 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 -- 172.21.15.12:0/559791977 learned_addr learned my addr 172.21.15.12:0/559791977 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:58.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71837fe700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f718414e270 0x7f718414e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f7182ffd700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c004810 0x7f71840c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 -- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f718414e270 msgr2=0x7f718414e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f718414e270 0x7f718414e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 -- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c004810 msgr2=0x7f71840c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c004810 0x7f71840c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.136+0000 7f71827fc700 1 -- 172.21.15.12:0/559791977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718416dc40 con 0x7f718416cec0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f71827fc700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717800c8c0 tx=0x7f7178015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178022070 con 0x7f718416cec0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717800ce70 con 0x7f718416cec0 2023-10-08T16:10:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178007320 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718413da70 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.137+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718416d330 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.138+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718416ddd0 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.139+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f717801e430 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.140+0000 7f716affd700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 0x7f71700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.140+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f71780855c0 con 0x7f718416cec0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.140+0000 7f7182ffd700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 0x7f71700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.141+0000 7f7182ffd700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 0x7f71700695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71740093f0 tx=0x7f7174008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.144+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7178052410 con 0x7f718416cec0 2023-10-08T16:10:58.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.374+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f718413dc60 con 0x7f7170067130 2023-10-08T16:10:58.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.424+0000 7f716affd700 1 -- 172.21.15.12:0/559791977 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f718413dc60 con 0x7f7170067130 2023-10-08T16:10:58.425 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-10-08T16:10:58.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 msgr2=0x7f71700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 0x7f71700695e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71740093f0 tx=0x7f7174008040 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 msgr2=0x7f718415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f717800c8c0 tx=0x7f7178015000 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 shutdown_connections 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f718414e270 0x7f718414e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f716c004810 0x7f71840c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7170067130 0x7f71700695e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 --2- 172.21.15.12:0/559791977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f718416cec0 0x7f718415d200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 >> 172.21.15.12:0/559791977 conn(0x7f71840cd230 msgr2=0x7f71840c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 shutdown_connections 2023-10-08T16:10:58.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.427+0000 7f7183fff700 1 -- 172.21.15.12:0/559791977 wait complete. 2023-10-08T16:10:58.444 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-10-08T16:10:58.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-08T16:10:58.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.637+0000 7fa8249fe700 1 Processor -- start 2023-10-08T16:10:58.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.637+0000 7fa8249fe700 1 -- start start 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 0x7fa82015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8200cb450 0x7fa8200cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82015d8d0 con 0x7fa820143070 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa82015d2f0 con 0x7fa8200cb450 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8200cc630 con 0x7fa820142ca0 2023-10-08T16:10:58.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8200cb450 0x7fa8200cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8200cb450 0x7fa8200cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51272/0 (socket says 172.21.15.12:51272) 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 -- 172.21.15.12:0/978134652 learned_addr learned my addr 172.21.15.12:0/978134652 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81ed9d700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 0x7fa82015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 -- 172.21.15.12:0/978134652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 msgr2=0x7fa82015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 0x7fa82015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 -- 172.21.15.12:0/978134652 >> v1:172.21.15.29:6789/0 conn(0x7fa820143070 legacy=0x7fa8200cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 -- 172.21.15.12:0/978134652 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82015d560 con 0x7fa8200cb450 2023-10-08T16:10:58.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81ed9d700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 0x7fa82015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:10:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81f59e700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8200cb450 0x7fa8200cbf30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa818009f20 tx=0x7fa818009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963fe07f9e5a8904 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81dd9b700 1 -- 172.21.15.12:0/978134652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800e070 con 0x7fa8200cb450 2023-10-08T16:10:58.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81dd9b700 1 -- 172.21.15.12:0/978134652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81800ba80 con 0x7fa8200cb450 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa81dd9b700 1 -- 172.21.15.12:0/978134652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180092e0 con 0x7fa8200cb450 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 -- 172.21.15.12:0/978134652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8200cb450 msgr2=0x7fa8200cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.639+0000 7fa8249fe700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8200cb450 0x7fa8200cbf30 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa818009f20 tx=0x7fa818009840 comp rx=0 tx=0).stop 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 -- 172.21.15.12:0/978134652 shutdown_connections 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8200cb450 0x7fa8200cbf30 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 --2- 172.21.15.12:0/978134652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa820142ca0 0x7fa82015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 -- 172.21.15.12:0/978134652 >> 172.21.15.12:0/978134652 conn(0x7fa820067c80 msgr2=0x7fa820068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 -- 172.21.15.12:0/978134652 shutdown_connections 2023-10-08T16:10:58.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.640+0000 7fa8249fe700 1 -- 172.21.15.12:0/978134652 wait complete. 2023-10-08T16:10:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.641+0000 7fa8249fe700 1 Processor -- start 2023-10-08T16:10:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.641+0000 7fa8249fe700 1 -- start start 2023-10-08T16:10:58.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8200cb450 0x7fa8200b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa820143070 0x7fa820140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82016ac50 con 0x7fa820142ca0 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82016a3b0 con 0x7fa820143070 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa8249fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa82016a690 con 0x7fa8200cb450 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa81e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa81e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51276/0 (socket says 172.21.15.12:51276) 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa81e59c700 1 -- 172.21.15.12:0/2927827803 learned_addr learned my addr 172.21.15.12:0/2927827803 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa81ed9d700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8200cb450 0x7fa8200b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.642+0000 7fa81f59e700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa820143070 0x7fa820140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 -- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8200cb450 msgr2=0x7fa8200b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8200cb450 0x7fa8200b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 -- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa820143070 msgr2=0x7fa820140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa820143070 0x7fa820140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 -- 172.21.15.12:0/2927827803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa818009ae0 con 0x7fa820142ca0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa81e59c700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c4e0 tx=0x7fa81400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011590 con 0x7fa820142ca0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa814011710 con 0x7fa820142ca0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa82016a970 con 0x7fa820142ca0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.643+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa814011ad0 con 0x7fa820142ca0 2023-10-08T16:10:58.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.644+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa820141390 con 0x7fa820142ca0 2023-10-08T16:10:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.646+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8201415b0 con 0x7fa820142ca0 2023-10-08T16:10:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.646+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fa81401b3b0 con 0x7fa820142ca0 2023-10-08T16:10:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.646+0000 7fa806ffd700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 0x7fa80c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.646+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa814083d40 con 0x7fa820142ca0 2023-10-08T16:10:58.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.647+0000 7fa81ed9d700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 0x7fa80c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:58.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.647+0000 7fa81ed9d700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 0x7fa80c0695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa810006f00 tx=0x7fa810008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:58.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.651+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa814050c30 con 0x7fa820142ca0 2023-10-08T16:10:58.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.881+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa8200b1100 con 0x7fa80c067130 2023-10-08T16:10:58.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.934+0000 7fa806ffd700 1 -- 172.21.15.12:0/2927827803 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa8200b1100 con 0x7fa80c067130 2023-10-08T16:10:58.935 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.936+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 msgr2=0x7fa80c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.936+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 0x7fa80c0695e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa810006f00 tx=0x7fa810008040 comp rx=0 tx=0).stop 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.936+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 msgr2=0x7fa820169cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.936+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa81400c4e0 tx=0x7fa81400c7f0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 shutdown_connections 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa820143070 0x7fa820140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8200cb450 0x7fa8200b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa80c067130 0x7fa80c0695e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 --2- 172.21.15.12:0/2927827803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa820142ca0 0x7fa820169cb0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 >> 172.21.15.12:0/2927827803 conn(0x7fa820067c80 msgr2=0x7fa82015b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 shutdown_connections 2023-10-08T16:10:58.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:58.937+0000 7fa8249fe700 1 -- 172.21.15.12:0/2927827803 wait complete. 2023-10-08T16:10:58.956 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-10-08T16:10:58.956 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-08T16:10:59.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.148+0000 7f410bfff700 1 Processor -- start 2023-10-08T16:10:59.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 -- start start 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f410c159fb0 0x7f410c15a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 0x7f410c0cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410c0cd7c0 con 0x7f410c0cd3d0 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c15e180 con 0x7f410c159fb0 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410c15d570 con 0x7f410c15a8c0 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f410c159fb0 0x7f410c15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f410c159fb0 0x7f410c15a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51280/0 (socket says 172.21.15.12:51280) 2023-10-08T16:10:59.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.150+0000 7f410affd700 1 -- 172.21.15.12:0/2987100116 learned_addr learned my addr 172.21.15.12:0/2987100116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410affd700 1 -- 172.21.15.12:0/2987100116 >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 msgr2=0x7f410c0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410a7fc700 1 --2- 172.21.15.12:0/2987100116 >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 0x7f410c0cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410affd700 1 --2- 172.21.15.12:0/2987100116 >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 0x7f410c0cce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410affd700 1 -- 172.21.15.12:0/2987100116 >> v1:172.21.15.29:6789/0 conn(0x7f410c0cd3d0 legacy=0x7f410c06d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410affd700 1 -- 172.21.15.12:0/2987100116 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f410c15d850 con 0x7f410c159fb0 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410a7fc700 1 --2- 172.21.15.12:0/2987100116 >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 0x7f410c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410affd700 1 --2- 172.21.15.12:0/2987100116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c15a380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f410c0d04b0 tx=0x7f40fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee0f9fe4cf956a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f4109ffb700 1 -- 172.21.15.12:0/2987100116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc00b820 con 0x7f410c159fb0 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f4109ffb700 1 -- 172.21.15.12:0/2987100116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40fc00b980 con 0x7f410c159fb0 2023-10-08T16:10:59.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f4109ffb700 1 -- 172.21.15.12:0/2987100116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40fc00bd20 con 0x7f410c159fb0 2023-10-08T16:10:59.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 -- 172.21.15.12:0/2987100116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 msgr2=0x7f410c15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 --2- 172.21.15.12:0/2987100116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c15a380 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f410c0d04b0 tx=0x7f40fc009250 comp rx=0 tx=0).stop 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 -- 172.21.15.12:0/2987100116 shutdown_connections 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 --2- 172.21.15.12:0/2987100116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c15a380 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 --2- 172.21.15.12:0/2987100116 >> v2:172.21.15.29:3300/0 conn(0x7f410c15a8c0 0x7f410c0cce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 -- 172.21.15.12:0/2987100116 >> 172.21.15.12:0/2987100116 conn(0x7f410c0703a0 msgr2=0x7f410c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 -- 172.21.15.12:0/2987100116 shutdown_connections 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.152+0000 7f410bfff700 1 -- 172.21.15.12:0/2987100116 wait complete. 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.153+0000 7f410bfff700 1 Processor -- start 2023-10-08T16:10:59.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 -- start start 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f410c0cd3d0 0x7f410c142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f410c15a8c0 0x7f410c150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c16d8c0 con 0x7f410c159fb0 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f410c0b2170 con 0x7f410c0cd3d0 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.154+0000 7f410bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f410c16cf90 con 0x7f410c15a8c0 2023-10-08T16:10:59.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51282/0 (socket says 172.21.15.12:51282) 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 -- 172.21.15.12:0/1749019370 learned_addr learned my addr 172.21.15.12:0/1749019370 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410affd700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f410c0cd3d0 0x7f410c142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410b7fe700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f410c15a8c0 0x7f410c150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 -- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f410c15a8c0 msgr2=0x7f410c150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f410c15a8c0 0x7f410c150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 -- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f410c0cd3d0 msgr2=0x7f410c142f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f410c0cd3d0 0x7f410c142f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 -- 172.21.15.12:0/1749019370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40fc0094f0 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.155+0000 7f410a7fc700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f410000c800 tx=0x7f4100008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011600 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4100011760 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4100011ae0 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f410c16d270 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f410c16dd50 con 0x7f410c159fb0 2023-10-08T16:10:59.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.157+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410c04c3c0 con 0x7f410c159fb0 2023-10-08T16:10:59.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.158+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4100010350 con 0x7f410c159fb0 2023-10-08T16:10:59.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.161+0000 7f40f2ffd700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.161+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4100084b10 con 0x7f410c159fb0 2023-10-08T16:10:59.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.161+0000 7f410affd700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.162+0000 7f410affd700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 0x7f40f80695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f410c0d04b0 tx=0x7f40fc016000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.164+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4100051850 con 0x7f410c159fb0 2023-10-08T16:10:59.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.396+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f410c0d1010 con 0x7f40f8067130 2023-10-08T16:10:59.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.452+0000 7f40f2ffd700 1 -- 172.21.15.12:0/1749019370 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f410c0d1010 con 0x7f40f8067130 2023-10-08T16:10:59.453 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 msgr2=0x7f40f80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 0x7f40f80695e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f410c0d04b0 tx=0x7f40fc016000 comp rx=0 tx=0).stop 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 msgr2=0x7f410c14fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f410000c800 tx=0x7f4100008040 comp rx=0 tx=0).stop 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 shutdown_connections 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f410c15a8c0 0x7f410c150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f410c0cd3d0 0x7f410c142f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f40f8067130 0x7f40f80695e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 --2- 172.21.15.12:0/1749019370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f410c159fb0 0x7f410c14fbf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 >> 172.21.15.12:0/1749019370 conn(0x7f410c0703a0 msgr2=0x7f410c14f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 shutdown_connections 2023-10-08T16:10:59.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.455+0000 7f410bfff700 1 -- 172.21.15.12:0/1749019370 wait complete. 2023-10-08T16:10:59.472 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-10-08T16:10:59.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-08T16:10:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.665+0000 7ff61b59e700 1 Processor -- start 2023-10-08T16:10:59.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.666+0000 7ff61b59e700 1 -- start start 2023-10-08T16:10:59.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c06c6a0 0x7ff61c06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff61c0cacb0 0x7ff61c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61b59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c06d740 con 0x7ff61c159770 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c159b40 con 0x7ff61c0cacb0 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c06cb30 con 0x7ff61c06c6a0 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff61c0cacb0 0x7ff61c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff61c159770 0x7ff61c0ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40480/0 (socket says 172.21.15.12:40480) 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff61a59c700 1 -- 172.21.15.12:0/423696320 learned_addr learned my addr 172.21.15.12:0/423696320 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.667+0000 7ff619d9b700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c06c6a0 0x7ff61c06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61ad9d700 1 -- 172.21.15.12:0/423696320 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c06c6a0 msgr2=0x7ff61c06dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61ad9d700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c06c6a0 0x7ff61c06dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61ad9d700 1 -- 172.21.15.12:0/423696320 >> v1:172.21.15.12:6789/0 conn(0x7ff61c159770 legacy=0x7ff61c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61ad9d700 1 -- 172.21.15.12:0/423696320 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c06ce10 con 0x7ff61c0cacb0 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61959a700 1 -- 172.21.15.12:0/423696320 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492797880 0 0) 0x7ff61c06d740 con 0x7ff61c159770 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61ad9d700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c0cacb0 0x7ff61c0c7010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff614009e60 tx=0x7ff614009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d913d0a3e381275 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61959a700 1 -- 172.21.15.12:0/423696320 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400e070 con 0x7ff61c0cacb0 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61959a700 1 -- 172.21.15.12:0/423696320 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400bc30 con 0x7ff61c0cacb0 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.668+0000 7ff61959a700 1 -- 172.21.15.12:0/423696320 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614012430 con 0x7ff61c0cacb0 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 -- 172.21.15.12:0/423696320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c0cacb0 msgr2=0x7ff61c0c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c0cacb0 0x7ff61c0c7010 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff614009e60 tx=0x7ff614009780 comp rx=0 tx=0).stop 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 -- 172.21.15.12:0/423696320 shutdown_connections 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c0cacb0 0x7ff61c0c7010 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 --2- 172.21.15.12:0/423696320 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c06c6a0 0x7ff61c06dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 -- 172.21.15.12:0/423696320 >> 172.21.15.12:0/423696320 conn(0x7ff61c06e790 msgr2=0x7ff61c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 -- 172.21.15.12:0/423696320 shutdown_connections 2023-10-08T16:10:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.669+0000 7ff61b59e700 1 -- 172.21.15.12:0/423696320 wait complete. 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.670+0000 7ff61b59e700 1 Processor -- start 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.671+0000 7ff61b59e700 1 -- start start 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.671+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff61c06c6a0 0x7ff61c1522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.671+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c0cacb0 0x7ff61c152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.671+0000 7ff61b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15d450 con 0x7ff61c159770 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15b810 con 0x7ff61c06c6a0 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15baf0 con 0x7ff61c0cacb0 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51300/0 (socket says 172.21.15.12:51300) 2023-10-08T16:10:59.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 -- 172.21.15.12:0/2953509832 learned_addr learned my addr 172.21.15.12:0/2953509832 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61a59c700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff61c06c6a0 0x7ff61c1522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff619d9b700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c0cacb0 0x7ff61c152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 -- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c0cacb0 msgr2=0x7ff61c152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c0cacb0 0x7ff61c152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 -- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff61c06c6a0 msgr2=0x7ff61c1522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff61c06c6a0 0x7ff61c1522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.672+0000 7ff61ad9d700 1 -- 172.21.15.12:0/2953509832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614009a20 con 0x7ff61c159770 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff61ad9d700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff614013000 tx=0x7ff614019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614027470 con 0x7ff61c159770 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614027610 con 0x7ff61c159770 2023-10-08T16:10:59.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140279d0 con 0x7ff61c159770 2023-10-08T16:10:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c15bdd0 con 0x7ff61c159770 2023-10-08T16:10:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.673+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c15c390 con 0x7ff61c159770 2023-10-08T16:10:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.674+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c15c5b0 con 0x7ff61c159770 2023-10-08T16:10:59.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.675+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ff614024070 con 0x7ff61c159770 2023-10-08T16:10:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.676+0000 7ff60a7fc700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 0x7ff5fc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:10:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.676+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7ff614087090 con 0x7ff61c159770 2023-10-08T16:10:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.676+0000 7ff61a59c700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 0x7ff5fc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:10:59.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.676+0000 7ff61a59c700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 0x7ff5fc0695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007160 tx=0x7ff60c007f50 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:10:59.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.680+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff614053ee0 con 0x7ff61c159770 2023-10-08T16:10:59.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.911+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff61c04c3c0 con 0x7ff5fc067130 2023-10-08T16:10:59.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.967+0000 7ff60a7fc700 1 -- 172.21.15.12:0/2953509832 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff61c04c3c0 con 0x7ff5fc067130 2023-10-08T16:10:59.970 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-10-08T16:10:59.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.969+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 msgr2=0x7ff5fc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.969+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 0x7ff5fc0695e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff60c007160 tx=0x7ff60c007f50 comp rx=0 tx=0).stop 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.969+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 msgr2=0x7ff61c0c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff614013000 tx=0x7ff614019000 comp rx=0 tx=0).stop 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 shutdown_connections 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7ff5fc067130 0x7ff5fc0695e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff61c159770 0x7ff61c0c7f90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff61c06c6a0 0x7ff61c1522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 --2- 172.21.15.12:0/2953509832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff61c0cacb0 0x7ff61c152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:10:59.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 >> 172.21.15.12:0/2953509832 conn(0x7ff61c06e790 msgr2=0x7ff61c0b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:10:59.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 shutdown_connections 2023-10-08T16:10:59.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:10:59.970+0000 7ff61b59e700 1 -- 172.21.15.12:0/2953509832 wait complete. 2023-10-08T16:10:59.987 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-10-08T16:10:59.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-08T16:11:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.181+0000 7f4f9219d700 1 Processor -- start 2023-10-08T16:11:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.181+0000 7f4f9219d700 1 -- start start 2023-10-08T16:11:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 0x7f4f8c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b1d40 0x7f4f8c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f8c0b28c0 0x7f4f8c159630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c0d10d0 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f8c159b70 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0b0c80 con 0x7f4f8c0b1d40 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9199c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f8c0b28c0 0x7f4f8c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9199c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4f8c0b28c0 0x7f4f8c159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51306/0 (socket says 172.21.15.12:51306) 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9199c700 1 -- 172.21.15.12:0/4108572290 learned_addr learned my addr 172.21.15.12:0/4108572290 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9099a700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b1d40 0x7f4f8c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.183+0000 7f4f9119b700 1 --2- 172.21.15.12:0/4108572290 >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 0x7f4f8c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 -- 172.21.15.12:0/4108572290 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b1d40 msgr2=0x7f4f8c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b1d40 0x7f4f8c1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 -- 172.21.15.12:0/4108572290 >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 msgr2=0x7f4f8c0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 --2- 172.21.15.12:0/4108572290 >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 0x7f4f8c0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 -- 172.21.15.12:0/4108572290 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0b0f60 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9119b700 1 --2- 172.21.15.12:0/4108572290 >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 0x7f4f8c0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:11:00.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f9199c700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b28c0 0x7f4f8c159630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0d1230 tx=0x7f4f84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3dd37f9719a446e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f83fff700 1 -- 172.21.15.12:0/4108572290 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400e070 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f83fff700 1 -- 172.21.15.12:0/4108572290 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8400ba50 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.184+0000 7f4f83fff700 1 -- 172.21.15.12:0/4108572290 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f840092e0 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 -- 172.21.15.12:0/4108572290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b28c0 msgr2=0x7f4f8c159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b28c0 0x7f4f8c159630 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0d1230 tx=0x7f4f84009840 comp rx=0 tx=0).stop 2023-10-08T16:11:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 -- 172.21.15.12:0/4108572290 shutdown_connections 2023-10-08T16:11:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b28c0 0x7f4f8c159630 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 --2- 172.21.15.12:0/4108572290 >> v2:172.21.15.29:3300/0 conn(0x7f4f8c0b24f0 0x7f4f8c0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 --2- 172.21.15.12:0/4108572290 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b1d40 0x7f4f8c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 -- 172.21.15.12:0/4108572290 >> 172.21.15.12:0/4108572290 conn(0x7f4f8c0703a0 msgr2=0x7f4f8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 -- 172.21.15.12:0/4108572290 shutdown_connections 2023-10-08T16:11:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.185+0000 7f4f9219d700 1 -- 172.21.15.12:0/4108572290 wait complete. 2023-10-08T16:11:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.187+0000 7f4f9219d700 1 Processor -- start 2023-10-08T16:11:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.187+0000 7f4f9219d700 1 -- start start 2023-10-08T16:11:00.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f8c0b1d40 0x7f4f8c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b28c0 0x7f4f8c169a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0af8e0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cade0 con 0x7f4f8c0b1d40 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8c0cb0c0 con 0x7f4f8c0b28c0 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9119b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f8c0b1d40 0x7f4f8c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51328/0 (socket says 172.21.15.12:51328) 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.188+0000 7f4f9099a700 1 -- 172.21.15.12:0/3265078848 learned_addr learned my addr 172.21.15.12:0/3265078848 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9199c700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b28c0 0x7f4f8c169a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 -- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b28c0 msgr2=0x7f4f8c169a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b28c0 0x7f4f8c169a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 -- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f8c0b1d40 msgr2=0x7f4f8c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f8c0b1d40 0x7f4f8c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 -- 172.21.15.12:0/3265078848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f84009ae0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f9099a700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00d890 tx=0x7f4f7c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c0125f0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.189+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c012750 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.190+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8c0cb3a0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.190+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c012af0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.190+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8c0cb960 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.191+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8c0b46c0 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.194 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:11:00.191+0000 7fab20d0f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:11:00.194 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:11:00.191+0000 7fab20d0f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:11:00.194 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:11:00.191+0000 7fab20d0f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:11:00.194 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:11:00.191+0000 7fab20d0f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:11:00.194 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:11:00.191+0000 7fab20d0f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:11:00.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.192+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4f7c01e460 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.193+0000 7f4f817fa700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 0x7f4f700695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.194+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4f7c084f20 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.194+0000 7f4f9119b700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 0x7f4f700695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.194+0000 7f4f9119b700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 0x7f4f700695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f88006f00 tx=0x7f4f88008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.198+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f7c051e10 con 0x7f4f8c0b24f0 2023-10-08T16:11:00.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.455+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f8c04c3c0 con 0x7f4f70067130 2023-10-08T16:11:00.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.689+0000 7f4f817fa700 1 -- 172.21.15.12:0/3265078848 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4f8c04c3c0 con 0x7f4f70067130 2023-10-08T16:11:00.689 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-10-08T16:11:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 msgr2=0x7f4f700695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 0x7f4f700695e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f88006f00 tx=0x7f4f88008040 comp rx=0 tx=0).stop 2023-10-08T16:11:00.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 msgr2=0x7f4f8c0cbe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00d890 tx=0x7f4f7c008040 comp rx=0 tx=0).stop 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 shutdown_connections 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f8c0b28c0 0x7f4f8c169a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f8c0b1d40 0x7f4f8c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f70067130 0x7f4f700695e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 --2- 172.21.15.12:0/3265078848 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f8c0b24f0 0x7f4f8c0cbe80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.691+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 >> 172.21.15.12:0/3265078848 conn(0x7f4f8c0703a0 msgr2=0x7f4f8c0d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.692+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 shutdown_connections 2023-10-08T16:11:00.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.692+0000 7f4f9219d700 1 -- 172.21.15.12:0/3265078848 wait complete. 2023-10-08T16:11:00.709 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-10-08T16:11:00.709 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-08T16:11:00.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.919+0000 7fad1cb9d700 1 Processor -- start 2023-10-08T16:11:00.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.919+0000 7fad1cb9d700 1 -- start start 2023-10-08T16:11:00.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.920+0000 7fad1cb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fad180c8200 0x7fad180c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.920+0000 7fad1cb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad180c2a90 0x7fad18156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad1cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c85d0 0x7fad180cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad1cb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad181579b0 con 0x7fad180c2a90 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad1cb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad180c1390 con 0x7fad180c8200 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad1cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad181573f0 con 0x7fad180c85d0 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad180c2a90 0x7fad18156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad180c2a90 0x7fad18156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51348/0 (socket says 172.21.15.12:51348) 2023-10-08T16:11:00.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 -- 172.21.15.12:0/2562289328 learned_addr learned my addr 172.21.15.12:0/2562289328 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad17fff700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c85d0 0x7fad180cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad177fe700 1 --2- 172.21.15.12:0/2562289328 >> v2:172.21.15.29:3300/0 conn(0x7fad180c8200 0x7fad180c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 -- 172.21.15.12:0/2562289328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c85d0 msgr2=0x7fad180cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c85d0 0x7fad180cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 -- 172.21.15.12:0/2562289328 >> v2:172.21.15.29:3300/0 conn(0x7fad180c8200 msgr2=0x7fad180c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 --2- 172.21.15.12:0/2562289328 >> v2:172.21.15.29:3300/0 conn(0x7fad180c8200 0x7fad180c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.921+0000 7fad16ffd700 1 -- 172.21.15.12:0/2562289328 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad181576d0 con 0x7fad180c2a90 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.922+0000 7fad16ffd700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c2a90 0x7fad18156aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fad180683d0 tx=0x7fad0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e2e2a715946942 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.922+0000 7fad167fc700 1 -- 172.21.15.12:0/2562289328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00b860 con 0x7fad180c2a90 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.922+0000 7fad167fc700 1 -- 172.21.15.12:0/2562289328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c00b9c0 con 0x7fad180c2a90 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.922+0000 7fad167fc700 1 -- 172.21.15.12:0/2562289328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c00bd60 con 0x7fad180c2a90 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 -- 172.21.15.12:0/2562289328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c2a90 msgr2=0x7fad18156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c2a90 0x7fad18156aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fad180683d0 tx=0x7fad0c009250 comp rx=0 tx=0).stop 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 -- 172.21.15.12:0/2562289328 shutdown_connections 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c85d0 0x7fad180cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/2562289328 >> v2:172.21.15.29:3300/0 conn(0x7fad180c8200 0x7fad180c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/2562289328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c2a90 0x7fad18156aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 -- 172.21.15.12:0/2562289328 >> 172.21.15.12:0/2562289328 conn(0x7fad1806c6a0 msgr2=0x7fad1806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:00.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 -- 172.21.15.12:0/2562289328 shutdown_connections 2023-10-08T16:11:00.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.923+0000 7fad1cb9d700 1 -- 172.21.15.12:0/2562289328 wait complete. 2023-10-08T16:11:00.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.925+0000 7fad1cb9d700 1 Processor -- start 2023-10-08T16:11:00.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.925+0000 7fad1cb9d700 1 -- start start 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c2a90 0x7fad1815b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad180c85d0 0x7fad180c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1813b660 con 0x7fad180c8200 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1815c6d0 con 0x7fad180c85d0 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad1cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1815cb60 con 0x7fad180c2a90 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad16ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51350/0 (socket says 172.21.15.12:51350) 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad16ffd700 1 -- 172.21.15.12:0/4189950878 learned_addr learned my addr 172.21.15.12:0/4189950878 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:11:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad177fe700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c2a90 0x7fad1815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.926+0000 7fad17fff700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad180c85d0 0x7fad180c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 -- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c2a90 msgr2=0x7fad1815b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c2a90 0x7fad1815b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 -- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad180c85d0 msgr2=0x7fad180c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad180c85d0 0x7fad180c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 -- 172.21.15.12:0/4189950878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c0094f0 con 0x7fad180c8200 2023-10-08T16:11:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7fad16ffd700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad180697c0 tx=0x7fad0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.927+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c011dc0 con 0x7fad180c8200 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.928+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0c024440 con 0x7fad180c8200 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.928+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1815bac0 con 0x7fad180c8200 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.928+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0c024800 con 0x7fad180c8200 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.928+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad1815c080 con 0x7fad180c8200 2023-10-08T16:11:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.929+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad1804c3c0 con 0x7fad180c8200 2023-10-08T16:11:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.930+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fad0c01a420 con 0x7fad180c8200 2023-10-08T16:11:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.931+0000 7facff7fe700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 0x7fad040695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.931+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fad0c086930 con 0x7fad180c8200 2023-10-08T16:11:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.931+0000 7fad177fe700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 0x7fad040695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.932+0000 7fad177fe700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 0x7fad040695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:00.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:00.936+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad0c053780 con 0x7fad180c8200 2023-10-08T16:11:01.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.213+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad1815c810 con 0x7fad04067130 2023-10-08T16:11:01.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.257+0000 7facff7fe700 1 -- 172.21.15.12:0/4189950878 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fad1815c810 con 0x7fad04067130 2023-10-08T16:11:01.258 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-10-08T16:11:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 msgr2=0x7fad040695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 0x7fad040695e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fad08006fd0 tx=0x7fad08008040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 msgr2=0x7fad18167ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fad180697c0 tx=0x7fad0c017000 comp rx=0 tx=0).stop 2023-10-08T16:11:01.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 shutdown_connections 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad180c85d0 0x7fad180c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad180c2a90 0x7fad1815b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fad04067130 0x7fad040695e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 --2- 172.21.15.12:0/4189950878 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad180c8200 0x7fad18167ed0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 >> 172.21.15.12:0/4189950878 conn(0x7fad1806c6a0 msgr2=0x7fad180c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 shutdown_connections 2023-10-08T16:11:01.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.260+0000 7fad1cb9d700 1 -- 172.21.15.12:0/4189950878 wait complete. 2023-10-08T16:11:01.277 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-10-08T16:11:01.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-08T16:11:01.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.470+0000 7f868b1ff700 1 Processor -- start 2023-10-08T16:11:01.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.471+0000 7f868b1ff700 1 -- start start 2023-10-08T16:11:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f868b1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8684160c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f868b1ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868406a550 con 0x7f8684156fa0 2023-10-08T16:11:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f868b1ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840c75f0 con 0x7f868406e330 2023-10-08T16:11:01.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f868b1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c78d0 con 0x7f86840cba80 2023-10-08T16:11:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f8683fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8684156fa0 0x7f86840cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40496/0 (socket says 172.21.15.12:40496) 2023-10-08T16:11:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f8683fff700 1 -- 172.21.15.12:0/645143455 learned_addr learned my addr 172.21.15.12:0/645143455 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:11:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.472+0000 7f868979c700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8684160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899955984 0 0) 0x7f868406a550 con 0x7f8684156fa0 2023-10-08T16:11:01.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674004680 con 0x7f8684156fa0 2023-10-08T16:11:01.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975900320 0 0) 0x7f86840c75f0 con 0x7f868406e330 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868406a550 con 0x7f868406e330 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2824924539 0 0) 0x7f8674004680 con 0x7f8684156fa0 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 msgr2=0x7f8684160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8684160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 >> v1:172.21.15.29:6789/0 conn(0x7f868406e330 legacy=0x7f86840c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840c7bb0 con 0x7f8684156fa0 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f8670001470 con 0x7f8684156fa0 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 >> v1:172.21.15.12:6789/0 conn(0x7f8684156fa0 legacy=0x7f86840cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8674004d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8674005290 0x7f8674005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8674005e60 0x7f86740062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c78d0 con 0x7f8674005e60 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8674003490 con 0x7f8674005290 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8674003650 con 0x7f86840cba80 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.473+0000 7f868979c700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8674005e60 0x7f86740062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f8683fff700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8674005290 0x7f8674005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f8688f9b700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8674004d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 -- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 msgr2=0x7f8674004d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f86840cba80 0x7f8674004d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 -- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8674005290 msgr2=0x7f8674005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8674005290 0x7f8674005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 -- 172.21.15.12:0/645143455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674004680 con 0x7f8674005e60 2023-10-08T16:11:01.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f868979c700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8674005e60 0x7f86740062d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f86840cbe90 tx=0x7f867c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3e2b88d23fcd92d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ea90 con 0x7f8674005e60 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c00f040 con 0x7f8674005e60 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.474+0000 7f86837fe700 1 -- 172.21.15.12:0/645143455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c00ee40 con 0x7f8674005e60 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 -- 172.21.15.12:0/645143455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8674005e60 msgr2=0x7f86740062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 --2- 172.21.15.12:0/645143455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8674005e60 0x7f86740062d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f86840cbe90 tx=0x7f867c00b040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868979c700 1 -- 172.21.15.12:0/645143455 reap_dead start 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 -- 172.21.15.12:0/645143455 shutdown_connections 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 -- 172.21.15.12:0/645143455 >> 172.21.15.12:0/645143455 conn(0x7f868406d170 msgr2=0x7f86840cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 -- 172.21.15.12:0/645143455 shutdown_connections 2023-10-08T16:11:01.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.475+0000 7f868b1ff700 1 -- 172.21.15.12:0/645143455 wait complete. 2023-10-08T16:11:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.476+0000 7f868b1ff700 1 Processor -- start 2023-10-08T16:11:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.477+0000 7f868b1ff700 1 -- start start 2023-10-08T16:11:01.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8674005e60 0x7f868416d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86840c3d40 0x7f86840c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c5420 con 0x7f8684154d70 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684155700 con 0x7f86840c3d40 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868b1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c4810 con 0x7f8674005e60 2023-10-08T16:11:01.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f8688f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8674005e60 0x7f868416d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51366/0 (socket says 172.21.15.12:51366) 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 -- 172.21.15.12:0/706346088 learned_addr learned my addr 172.21.15.12:0/706346088 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f8683fff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86840c3d40 0x7f86840c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 -- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8674005e60 msgr2=0x7f868416d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8674005e60 0x7f868416d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 -- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86840c3d40 msgr2=0x7f86840c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86840c3d40 0x7f86840c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.478+0000 7f868979c700 1 -- 172.21.15.12:0/706346088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840c4af0 con 0x7f8684154d70 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f868979c700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f867c016000 tx=0x7f867c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c022070 con 0x7f8684154d70 2023-10-08T16:11:01.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c01d630 con 0x7f8684154d70 2023-10-08T16:11:01.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c01da10 con 0x7f8684154d70 2023-10-08T16:11:01.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840c4dd0 con 0x7f8684154d70 2023-10-08T16:11:01.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.479+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840c5e30 con 0x7f8684154d70 2023-10-08T16:11:01.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.480+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868404c3c0 con 0x7f8684154d70 2023-10-08T16:11:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.481+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 10) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f867c0133e0 con 0x7f8684154d70 2023-10-08T16:11:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.482+0000 7f8680ff9700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 0x7f86680695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:11:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.482+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f867c0861e0 con 0x7f8684154d70 2023-10-08T16:11:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.482+0000 7f8688f9b700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 0x7f86680695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:11:01.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.483+0000 7f8688f9b700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 0x7f86680695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f867800c040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:11:01.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.486+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f867c052fc0 con 0x7f8684154d70 2023-10-08T16:11:01.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.720+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8684063460 con 0x7f8668067130 2023-10-08T16:11:01.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.766+0000 7f8680ff9700 1 -- 172.21.15.12:0/706346088 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f8684063460 con 0x7f8668067130 2023-10-08T16:11:01.766 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-10-08T16:11:01.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 msgr2=0x7f86680695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 0x7f86680695e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f867800c040 comp rx=0 tx=0).stop 2023-10-08T16:11:01.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 msgr2=0x7f86841551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f867c016000 tx=0x7f867c01a000 comp rx=0 tx=0).stop 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 shutdown_connections 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8668067130 0x7f86680695e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8684154d70 0x7f86841551c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8674005e60 0x7f868416d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 --2- 172.21.15.12:0/706346088 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f86840c3d40 0x7f86840c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:11:01.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 >> 172.21.15.12:0/706346088 conn(0x7f868406d170 msgr2=0x7f868414e650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:11:01.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 shutdown_connections 2023-10-08T16:11:01.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:11:01.768+0000 7f868b1ff700 1 -- 172.21.15.12:0/706346088 wait complete. 2023-10-08T16:11:01.785 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-10-08T16:11:13.890 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:13.895 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:44.000 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:11:44.006 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:14.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:14.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:44.250 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:12:44.255 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:14.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:14.364 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:44.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:13:44.543 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:14.652 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:14.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:44.767 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:14:44.773 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:14.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:14.898 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:45.126 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:15:45.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:00.130 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:16:00.130+0000 7fab23514700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:16:00.130 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:16:00.130+0000 7fab23514700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:16:00.131 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:16:00.130+0000 7fab23514700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:16:00.131 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:16:00.130+0000 7fab23514700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:16:00.131 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:16:00.130+0000 7fab23514700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:16:15.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:15.263 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:45.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:16:45.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:15.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:15.505 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:45.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:17:45.621 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:18:15.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:18:15.736 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:18:45.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:18:45.872 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:19:15.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:19:15.979 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:19:46.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:19:46.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:20:16.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:20:16.216 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:20:46.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:20:46.329 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:21:16.425 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:21:16.430 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:21:20.787 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-10-08T16:21:20.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.990+0000 7f982e79d700 1 Processor -- start 2023-10-08T16:21:20.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.991+0000 7f982e79d700 1 -- start start 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982e79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98280c7760 0x7f98280c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982e79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280c1a30 con 0x7f9828067ec0 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982e79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280c7120 con 0x7f98281597d0 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982e79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f982815a820 con 0x7f98280c7760 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982cf9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9828067ec0 0x7f98281613c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42336/0 (socket says 172.21.15.12:42336) 2023-10-08T16:21:20.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982cf9a700 1 -- 172.21.15.12:0/1199599306 learned_addr learned my addr 172.21.15.12:0/1199599306 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:20.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.992+0000 7f982df9c700 1 --2- 172.21.15.12:0/1199599306 >> v2:172.21.15.29:3300/0 conn(0x7f98280c7760 0x7f98280c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:20.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f981ffff700 1 -- 172.21.15.12:0/1199599306 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437028847 0 0) 0x7f98280c1a30 con 0x7f9828067ec0 2023-10-08T16:21:20.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f981ffff700 1 -- 172.21.15.12:0/1199599306 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9814003570 con 0x7f9828067ec0 2023-10-08T16:21:20.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f982df9c700 1 -- 172.21.15.12:0/1199599306 >> v1:172.21.15.29:6789/0 conn(0x7f98281597d0 legacy=0x7f98280677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:20.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f982df9c700 1 -- 172.21.15.12:0/1199599306 >> v1:172.21.15.12:6789/0 conn(0x7f9828067ec0 legacy=0x7f98281613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f982df9c700 1 -- 172.21.15.12:0/1199599306 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982815aa30 con 0x7f98280c7760 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f982df9c700 1 --2- 172.21.15.12:0/1199599306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98280c7760 0x7f98280c6be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9820009e60 tx=0x7f9820009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41c181ee876de47d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f981ffff700 1 -- 172.21.15.12:0/1199599306 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000e070 con 0x7f98280c7760 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.993+0000 7f981ffff700 1 -- 172.21.15.12:0/1199599306 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000bb60 con 0x7f98280c7760 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f981ffff700 1 -- 172.21.15.12:0/1199599306 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9820012430 con 0x7f98280c7760 2023-10-08T16:21:20.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 -- 172.21.15.12:0/1199599306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98280c7760 msgr2=0x7f98280c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 --2- 172.21.15.12:0/1199599306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98280c7760 0x7f98280c6be0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9820009e60 tx=0x7f9820009780 comp rx=0 tx=0).stop 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 -- 172.21.15.12:0/1199599306 shutdown_connections 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 --2- 172.21.15.12:0/1199599306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98280c7760 0x7f98280c6be0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 -- 172.21.15.12:0/1199599306 >> 172.21.15.12:0/1199599306 conn(0x7f982806f330 msgr2=0x7f98280cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 -- 172.21.15.12:0/1199599306 shutdown_connections 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.994+0000 7f982e79d700 1 -- 172.21.15.12:0/1199599306 wait complete. 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.996+0000 7f982e79d700 1 Processor -- start 2023-10-08T16:21:21.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.996+0000 7f982e79d700 1 -- start start 2023-10-08T16:21:21.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98280c7760 0x7f9828156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98281597d0 0x7f9828152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828157800 con 0x7f9828067ec0 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9828157520 con 0x7f98281597d0 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98281699c0 con 0x7f98280c7760 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38766/0 (socket says 172.21.15.12:38766) 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 -- 172.21.15.12:0/3920942228 learned_addr learned my addr 172.21.15.12:0/3920942228 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982cf9a700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98280c7760 0x7f9828156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982df9c700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98281597d0 0x7f9828152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 -- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98280c7760 msgr2=0x7f9828156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98280c7760 0x7f9828156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 -- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98281597d0 msgr2=0x7f9828152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.997+0000 7f982d79b700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98281597d0 0x7f9828152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f982d79b700 1 -- 172.21.15.12:0/3920942228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9820009a20 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f982d79b700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f982400c590 tx=0x7f982400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011590 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98240116f0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9828169ca0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824011ab0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.998+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9828157210 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:20.999+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f982816a1c0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.000+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f982401b3b0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.001+0000 7f981d7fa700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 0x7f980c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.001+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f9824083fd0 con 0x7f9828067ec0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.001+0000 7f982cf9a700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 0x7f980c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.002+0000 7f982cf9a700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 0x7f980c0695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98280cba90 tx=0x7f9818009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:21.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.006+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9824050e20 con 0x7f9828067ec0 2023-10-08T16:21:21.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.237+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f982804c3c0 con 0x7f980c067130 2023-10-08T16:21:21.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.311+0000 7f981d7fa700 1 -- 172.21.15.12:0/3920942228 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f982804c3c0 con 0x7f980c067130 2023-10-08T16:21:21.312 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-10-08T16:21:21.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 msgr2=0x7f980c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 0x7f980c0695e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f98280cba90 tx=0x7f9818009040 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 msgr2=0x7f9828156710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f982400c590 tx=0x7f982400c950 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 shutdown_connections 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f980c067130 0x7f980c0695e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9828067ec0 0x7f9828156710 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98281597d0 0x7f9828152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 --2- 172.21.15.12:0/3920942228 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98280c7760 0x7f9828156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 >> 172.21.15.12:0/3920942228 conn(0x7f982806f330 msgr2=0x7f9828154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 shutdown_connections 2023-10-08T16:21:21.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.314+0000 7f982e79d700 1 -- 172.21.15.12:0/3920942228 wait complete. 2023-10-08T16:21:21.332 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-10-08T16:21:21.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-10-08T16:21:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.524+0000 7f906679d700 1 Processor -- start 2023-10-08T16:21:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.524+0000 7f906679d700 1 -- start start 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90600c8200 0x7f90600c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90600c2a90 0x7f9060156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c85d0 0x7f90600cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90601579b0 con 0x7f90600c8200 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90600c1390 con 0x7f90600c2a90 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.525+0000 7f906679d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90601573f0 con 0x7f90600c85d0 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90600c8200 0x7f90600c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f90600c8200 0x7f90600c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38778/0 (socket says 172.21.15.12:38778) 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 -- 172.21.15.12:0/891294884 learned_addr learned my addr 172.21.15.12:0/891294884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:21.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 -- 172.21.15.12:0/891294884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c85d0 msgr2=0x7f90600cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 --2- 172.21.15.12:0/891294884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c85d0 0x7f90600cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 -- 172.21.15.12:0/891294884 >> v2:172.21.15.29:3300/0 conn(0x7f90600c2a90 msgr2=0x7f9060156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 --2- 172.21.15.12:0/891294884 >> v2:172.21.15.29:3300/0 conn(0x7f90600c2a90 0x7f9060156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 -- 172.21.15.12:0/891294884 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90601576d0 con 0x7f90600c8200 2023-10-08T16:21:21.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f906579b700 1 --2- 172.21.15.12:0/891294884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c8200 0x7f90600c1820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f906015b1d0 tx=0x7f905c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4b5f464ba8053 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.526+0000 7f9057fff700 1 -- 172.21.15.12:0/891294884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00b860 con 0x7f90600c8200 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f9057fff700 1 -- 172.21.15.12:0/891294884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c00b9c0 con 0x7f90600c8200 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f9057fff700 1 -- 172.21.15.12:0/891294884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c00bd60 con 0x7f90600c8200 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 -- 172.21.15.12:0/891294884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c8200 msgr2=0x7f90600c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 --2- 172.21.15.12:0/891294884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c8200 0x7f90600c1820 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f906015b1d0 tx=0x7f905c009250 comp rx=0 tx=0).stop 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 -- 172.21.15.12:0/891294884 shutdown_connections 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 --2- 172.21.15.12:0/891294884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c85d0 0x7f90600cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 --2- 172.21.15.12:0/891294884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c8200 0x7f90600c1820 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 --2- 172.21.15.12:0/891294884 >> v2:172.21.15.29:3300/0 conn(0x7f90600c2a90 0x7f9060156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 -- 172.21.15.12:0/891294884 >> 172.21.15.12:0/891294884 conn(0x7f906006c6a0 msgr2=0x7f906006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 -- 172.21.15.12:0/891294884 shutdown_connections 2023-10-08T16:21:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.527+0000 7f906679d700 1 -- 172.21.15.12:0/891294884 wait complete. 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.529+0000 7f906679d700 1 Processor -- start 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.529+0000 7f906679d700 1 -- start start 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90600c2a90 0x7f9060145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c8200 0x7f90600b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060171290 con 0x7f90600c85d0 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90600b08f0 con 0x7f90600c2a90 2023-10-08T16:21:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906679d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600afce0 con 0x7f90600c8200 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f9065f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f9065f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38780/0 (socket says 172.21.15.12:38780) 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f9065f9c700 1 -- 172.21.15.12:0/3111265969 learned_addr learned my addr 172.21.15.12:0/3111265969 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f906579b700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90600c2a90 0x7f9060145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.530+0000 7f9064f9a700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c8200 0x7f90600b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 -- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c8200 msgr2=0x7f90600b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c8200 0x7f90600b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 -- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90600c2a90 msgr2=0x7f9060145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90600c2a90 0x7f9060145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 -- 172.21.15.12:0/3111265969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f905c0094f0 con 0x7f90600c85d0 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f9065f9c700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f905800bc30 tx=0x7f9058009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:21.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90580092e0 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905800c630 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905800ca10 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90600affc0 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.531+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90600b0580 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.532+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600b0a60 con 0x7f90600c85d0 2023-10-08T16:21:21.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.533+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f9058012070 con 0x7f90600c85d0 2023-10-08T16:21:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.534+0000 7f90557fa700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 0x7f90440695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.534+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f90580844d0 con 0x7f90600c85d0 2023-10-08T16:21:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.534+0000 7f906579b700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 0x7f90440695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.535+0000 7f906579b700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 0x7f90440695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f906015b1d0 tx=0x7f905c017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:21.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.539+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90580513c0 con 0x7f90600c85d0 2023-10-08T16:21:21.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.769+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f906004c3c0 con 0x7f9044067130 2023-10-08T16:21:21.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.839+0000 7f90557fa700 1 -- 172.21.15.12:0/3111265969 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f906004c3c0 con 0x7f9044067130 2023-10-08T16:21:21.840 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 msgr2=0x7f90440695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 0x7f90440695e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f906015b1d0 tx=0x7f905c017000 comp rx=0 tx=0).stop 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 msgr2=0x7f90600ace50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f905800bc30 tx=0x7f9058009840 comp rx=0 tx=0).stop 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 shutdown_connections 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9044067130 0x7f90440695e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90600c85d0 0x7f90600ace50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f90600c2a90 0x7f9060145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 --2- 172.21.15.12:0/3111265969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f90600c8200 0x7f90600b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 >> 172.21.15.12:0/3111265969 conn(0x7f906006c6a0 msgr2=0x7f9060147ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 shutdown_connections 2023-10-08T16:21:21.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:21.842+0000 7f906679d700 1 -- 172.21.15.12:0/3111265969 wait complete. 2023-10-08T16:21:21.860 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-10-08T16:21:21.860 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-10-08T16:21:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.051+0000 7f038bfff700 1 Processor -- start 2023-10-08T16:21:22.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.051+0000 7f038bfff700 1 -- start start 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 0x7f038c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0c2200 con 0x7f038c0c9090 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038c0c15f0 con 0x7f038c153a30 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0c18d0 con 0x7f038c153660 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f038c0c9090 0x7f038c06aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42342/0 (socket says 172.21.15.12:42342) 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038b7fe700 1 -- 172.21.15.12:0/2030057740 learned_addr learned my addr 172.21.15.12:0/2030057740 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:22.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f038affd700 1 --2- 172.21.15.12:0/2030057740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 0x7f038c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.053+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 292371055 0 0) 0x7f038c0c2200 con 0x7f038c0c9090 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0374004680 con 0x7f038c0c9090 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258097735 0 0) 0x7f038c0c15f0 con 0x7f038c153a30 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c0c2200 con 0x7f038c153a30 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f038affd700 1 -- 172.21.15.12:0/2030057740 >> v1:172.21.15.29:6789/0 conn(0x7f038c153a30 legacy=0x7f038c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f038affd700 1 -- 172.21.15.12:0/2030057740 >> v1:172.21.15.12:6789/0 conn(0x7f038c0c9090 legacy=0x7f038c06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 814992458 0 0) 0x7f0374004680 con 0x7f038c0c9090 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f038affd700 1 -- 172.21.15.12:0/2030057740 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0c1bb0 con 0x7f038c153660 2023-10-08T16:21:22.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f038affd700 1 --2- 172.21.15.12:0/2030057740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 0x7f038c0c0ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f037c009910 tx=0x7f037c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b164d7256141247e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03840017f0 con 0x7f038c153660 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037c011420 con 0x7f038c153660 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.054+0000 7f0389ffb700 1 -- 172.21.15.12:0/2030057740 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037c0117c0 con 0x7f038c153660 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 -- 172.21.15.12:0/2030057740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 msgr2=0x7f038c0c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 --2- 172.21.15.12:0/2030057740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 0x7f038c0c0ef0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f037c009910 tx=0x7f037c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 -- 172.21.15.12:0/2030057740 shutdown_connections 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 --2- 172.21.15.12:0/2030057740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c153660 0x7f038c0c0ef0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 -- 172.21.15.12:0/2030057740 >> 172.21.15.12:0/2030057740 conn(0x7f038c06c6a0 msgr2=0x7f038c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 -- 172.21.15.12:0/2030057740 shutdown_connections 2023-10-08T16:21:22.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.055+0000 7f038bfff700 1 -- 172.21.15.12:0/2030057740 wait complete. 2023-10-08T16:21:22.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.056+0000 7f038bfff700 1 Processor -- start 2023-10-08T16:21:22.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.057+0000 7f038bfff700 1 -- start start 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.057+0000 7f038bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 0x7f038c152540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 0x7f038c144c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0af430 con 0x7f038c153660 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0af660 con 0x7f038c153a30 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038c0af940 con 0x7f038c0c9090 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38796/0 (socket says 172.21.15.12:38796) 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 -- 172.21.15.12:0/1568496880 learned_addr learned my addr 172.21.15.12:0/1568496880 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038affd700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 0x7f038c152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038b7fe700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 0x7f038c144c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 -- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 msgr2=0x7f038c152540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 0x7f038c152540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 -- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 msgr2=0x7f038c144c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 0x7f038c144c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038a7fc700 1 -- 172.21.15.12:0/1568496880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c009420 con 0x7f038c153660 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038affd700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 0x7f038c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.058+0000 7f038b7fe700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 0x7f038c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f038a7fc700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f038000c590 tx=0x7f0380007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800105c0 con 0x7f038c153660 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0380010740 con 0x7f038c153660 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f038c0afc20 con 0x7f038c153660 2023-10-08T16:21:22.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0380010b00 con 0x7f038c153660 2023-10-08T16:21:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.059+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f038c0b01e0 con 0x7f038c153660 2023-10-08T16:21:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.060+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038c0b0400 con 0x7f038c153660 2023-10-08T16:21:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.061+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0380002030 con 0x7f038c153660 2023-10-08T16:21:22.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.061+0000 7f0372ffd700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 0x7f03780695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.062+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f03800840a0 con 0x7f038c153660 2023-10-08T16:21:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.062+0000 7f038affd700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 0x7f03780695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.062+0000 7f038affd700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 0x7f03780695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f037c0091e0 tx=0x7f037c016000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.066+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0380050ef0 con 0x7f038c153660 2023-10-08T16:21:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.295+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f038c04c3c0 con 0x7f0378067130 2023-10-08T16:21:22.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.359+0000 7f0372ffd700 1 -- 172.21.15.12:0/1568496880 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f038c04c3c0 con 0x7f0378067130 2023-10-08T16:21:22.360 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 msgr2=0x7f03780695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 0x7f03780695e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f037c0091e0 tx=0x7f037c016000 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 msgr2=0x7f038c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f038000c590 tx=0x7f0380007da0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 shutdown_connections 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f038c153a30 0x7f038c144c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f038c0c9090 0x7f038c152540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0378067130 0x7f03780695e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 --2- 172.21.15.12:0/1568496880 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f038c153660 0x7f038c0aeef0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 >> 172.21.15.12:0/1568496880 conn(0x7f038c06c6a0 msgr2=0x7f038c0ca790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:22.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 shutdown_connections 2023-10-08T16:21:22.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.362+0000 7f038bfff700 1 -- 172.21.15.12:0/1568496880 wait complete. 2023-10-08T16:21:22.380 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-10-08T16:21:22.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-10-08T16:21:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.573+0000 7fa27b59e700 1 Processor -- start 2023-10-08T16:21:22.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.573+0000 7fa27b59e700 1 -- start start 2023-10-08T16:21:22.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.574+0000 7fa27b59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa27c153660 0x7fa27c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa27c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27b59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27c0c2200 con 0x7fa27c153a30 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27b59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa27c157250 con 0x7fa27c153660 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c15f0 con 0x7fa27c0c9090 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa279d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa27c153a30 0x7fa27c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51484/0 (socket says 172.21.15.12:51484) 2023-10-08T16:21:22.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa279d9b700 1 -- 172.21.15.12:0/3836757935 learned_addr learned my addr 172.21.15.12:0/3836757935 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27a59c700 1 --2- 172.21.15.12:0/3836757935 >> v2:172.21.15.29:3300/0 conn(0x7fa27c153660 0x7fa27c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291541452 0 0) 0x7fa27c0c2200 con 0x7fa27c153a30 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27ad9d700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa27c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.575+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa264003570 con 0x7fa27c153a30 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361809597 0 0) 0x7fa264003570 con 0x7fa27c153a30 2023-10-08T16:21:22.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 msgr2=0x7fa27c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa27c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 >> v2:172.21.15.29:3300/0 conn(0x7fa27c153660 msgr2=0x7fa27c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 --2- 172.21.15.12:0/3836757935 >> v2:172.21.15.29:3300/0 conn(0x7fa27c153660 0x7fa27c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c0c18d0 con 0x7fa27c153a30 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fa270001470 con 0x7fa27c153a30 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 >> v1:172.21.15.12:6789/0 conn(0x7fa27c153a30 legacy=0x7fa27c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa264003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2640040b0 0x7fa264004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa264004d50 0x7fa2640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c157250 con 0x7fa2640040b0 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0c15f0 con 0x7fa264004d50 2023-10-08T16:21:22.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26400dd70 con 0x7fa27c0c9090 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27a59c700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa264003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa279d9b700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2640040b0 0x7fa264004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27ad9d700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa264004d50 0x7fa2640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.576+0000 7fa27a59c700 1 -- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa264004d50 msgr2=0x7fa2640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27a59c700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa264004d50 0x7fa2640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27a59c700 1 -- 172.21.15.12:0/3836757935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2640040b0 msgr2=0x7fa264004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27a59c700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2640040b0 0x7fa264004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27a59c700 1 -- 172.21.15.12:0/3836757935 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264003570 con 0x7fa27c0c9090 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27a59c700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa264003ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa26c006f00 tx=0x7fa26c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=690d4d312c5a172a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00e710 con 0x7fa27c0c9090 2023-10-08T16:21:22.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26c00e870 con 0x7fa27c0c9090 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.577+0000 7fa27959a700 1 -- 172.21.15.12:0/3836757935 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c00ec30 con 0x7fa27c0c9090 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 -- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 msgr2=0x7fa264003ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 --2- 172.21.15.12:0/3836757935 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c0c9090 0x7fa264003ae0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa26c006f00 tx=0x7fa26c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27ad9d700 1 -- 172.21.15.12:0/3836757935 reap_dead start 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 -- 172.21.15.12:0/3836757935 shutdown_connections 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 -- 172.21.15.12:0/3836757935 >> 172.21.15.12:0/3836757935 conn(0x7fa27c06c6a0 msgr2=0x7fa27c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 -- 172.21.15.12:0/3836757935 shutdown_connections 2023-10-08T16:21:22.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.578+0000 7fa27b59e700 1 -- 172.21.15.12:0/3836757935 wait complete. 2023-10-08T16:21:22.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.579+0000 7fa27b59e700 1 Processor -- start 2023-10-08T16:21:22.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.579+0000 7fa27b59e700 1 -- start start 2023-10-08T16:21:22.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 0x7fa27c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c14efa0 0x7fa27c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c0b1360 con 0x7fa27c0b09b0 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c14f950 con 0x7fa27c0c9090 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa27b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c152850 con 0x7fa27c14efa0 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa279d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa279d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51726/0 (socket says 172.21.15.12:51726) 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.580+0000 7fa279d9b700 1 -- 172.21.15.12:0/1272945603 learned_addr learned my addr 172.21.15.12:0/1272945603 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa27ad9d700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c14efa0 0x7fa27c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa27a59c700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 0x7fa27c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 -- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c14efa0 msgr2=0x7fa27c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c14efa0 0x7fa27c14f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 -- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 msgr2=0x7fa27c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 0x7fa27c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 -- 172.21.15.12:0/1272945603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c1577f0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa27a59c700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 0x7fa27c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa279d9b700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa270000fd0 tx=0x7fa270001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000f8d0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000fa50 con 0x7fa27c0b09b0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27000fe10 con 0x7fa27c0b09b0 2023-10-08T16:21:22.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27c157ad0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.581+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27c158090 con 0x7fa27c0b09b0 2023-10-08T16:21:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.582+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27c04c3c0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.583+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fa270013600 con 0x7fa27c0b09b0 2023-10-08T16:21:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.584+0000 7fa26a7fc700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 0x7fa25c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:22.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.585+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fa270084bf0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.585+0000 7fa27a59c700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 0x7fa25c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:22.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.585+0000 7fa27a59c700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 0x7fa25c0695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0091e0 tx=0x7fa26c01a000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:22.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.588+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa270051ae0 con 0x7fa27c0b09b0 2023-10-08T16:21:22.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.820+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa27c0c81d0 con 0x7fa25c067130 2023-10-08T16:21:22.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.887+0000 7fa26a7fc700 1 -- 172.21.15.12:0/1272945603 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fa27c0c81d0 con 0x7fa25c067130 2023-10-08T16:21:22.888 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 msgr2=0x7fa25c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 0x7fa25c0695e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0091e0 tx=0x7fa26c01a000 comp rx=0 tx=0).stop 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 msgr2=0x7fa27c0b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa270000fd0 tx=0x7fa270001dc0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 shutdown_connections 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa27c14efa0 0x7fa27c14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa27c0c9090 0x7fa27c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fa25c067130 0x7fa25c0695e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 --2- 172.21.15.12:0/1272945603 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa27c0b09b0 0x7fa27c0b0e20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 >> 172.21.15.12:0/1272945603 conn(0x7fa27c06c6a0 msgr2=0x7fa27c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 shutdown_connections 2023-10-08T16:21:22.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:22.890+0000 7fa27b59e700 1 -- 172.21.15.12:0/1272945603 wait complete. 2023-10-08T16:21:22.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-10-08T16:21:22.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-10-08T16:21:23.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.103+0000 7fe318f9d700 1 Processor -- start 2023-10-08T16:21:23.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.103+0000 7fe318f9d700 1 -- start start 2023-10-08T16:21:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe318f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 0x7fe31406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe318f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe3140c7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe318f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31406d740 con 0x7fe31406c6a0 2023-10-08T16:21:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe318f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe314159b40 con 0x7fe314159770 2023-10-08T16:21:23.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe318f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31406cb30 con 0x7fe3140cacb0 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe312ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe31406c6a0 0x7fe3140ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51488/0 (socket says 172.21.15.12:51488) 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.104+0000 7fe312ffd700 1 -- 172.21.15.12:0/828075740 learned_addr learned my addr 172.21.15.12:0/828075740 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe3137fe700 1 --2- 172.21.15.12:0/828075740 >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 0x7fe31406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 --2- 172.21.15.12:0/828075740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe3140c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe3127fc700 1 -- 172.21.15.12:0/828075740 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675782852 0 0) 0x7fe31406d740 con 0x7fe31406c6a0 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe3127fc700 1 -- 172.21.15.12:0/828075740 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2fc003570 con 0x7fe31406c6a0 2023-10-08T16:21:23.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 -- 172.21.15.12:0/828075740 >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 msgr2=0x7fe31406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 --2- 172.21.15.12:0/828075740 >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 0x7fe31406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 -- 172.21.15.12:0/828075740 >> v1:172.21.15.12:6789/0 conn(0x7fe31406c6a0 legacy=0x7fe3140ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 -- 172.21.15.12:0/828075740 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31406ce10 con 0x7fe3140cacb0 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe3137fe700 1 --2- 172.21.15.12:0/828075740 >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 0x7fe31406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.105+0000 7fe313fff700 1 --2- 172.21.15.12:0/828075740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe3140c7010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009e60 tx=0x7fe30c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f5d84130bac31c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe3127fc700 1 -- 172.21.15.12:0/828075740 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00e070 con 0x7fe3140cacb0 2023-10-08T16:21:23.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe3127fc700 1 -- 172.21.15.12:0/828075740 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00bab0 con 0x7fe3140cacb0 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe3127fc700 1 -- 172.21.15.12:0/828075740 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00be70 con 0x7fe3140cacb0 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 -- 172.21.15.12:0/828075740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 msgr2=0x7fe3140c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 --2- 172.21.15.12:0/828075740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe3140c7010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009e60 tx=0x7fe30c009780 comp rx=0 tx=0).stop 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 -- 172.21.15.12:0/828075740 shutdown_connections 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 --2- 172.21.15.12:0/828075740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe3140c7010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 --2- 172.21.15.12:0/828075740 >> v2:172.21.15.29:3300/0 conn(0x7fe314159770 0x7fe31406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 -- 172.21.15.12:0/828075740 >> 172.21.15.12:0/828075740 conn(0x7fe31406e790 msgr2=0x7fe31406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:23.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 -- 172.21.15.12:0/828075740 shutdown_connections 2023-10-08T16:21:23.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.106+0000 7fe318f9d700 1 -- 172.21.15.12:0/828075740 wait complete. 2023-10-08T16:21:23.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.108+0000 7fe318f9d700 1 Processor -- start 2023-10-08T16:21:23.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.108+0000 7fe318f9d700 1 -- start start 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31406c6a0 0x7fe31416a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe314154390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314169fe0 con 0x7fe314159770 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415b040 con 0x7fe31406c6a0 2023-10-08T16:21:23.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe318f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31415b320 con 0x7fe3140cacb0 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe313fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe313fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51732/0 (socket says 172.21.15.12:51732) 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe313fff700 1 -- 172.21.15.12:0/3224922100 learned_addr learned my addr 172.21.15.12:0/3224922100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe312ffd700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe314154390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.109+0000 7fe3137fe700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31406c6a0 0x7fe31416a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 -- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 msgr2=0x7fe314154390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe314154390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 -- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31406c6a0 msgr2=0x7fe31416a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31406c6a0 0x7fe31416a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 -- 172.21.15.12:0/3224922100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009420 con 0x7fe314159770 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe313fff700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe30c013000 tx=0x7fe30c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c012e10 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c027470 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c009a20 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c027830 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.110+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31415b8e0 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.111+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31415bad0 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.112+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe30c024070 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.113+0000 7fe2fb7fe700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 0x7fe3000695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.113+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe30c087380 con 0x7fe314159770 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.113+0000 7fe3137fe700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 0x7fe3000695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.114+0000 7fe3137fe700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 0x7fe3000695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b2820 tx=0x7fe3040091a0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.117+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe30c0541d0 con 0x7fe314159770 2023-10-08T16:21:23.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.346+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe31416a120 con 0x7fe300067130 2023-10-08T16:21:23.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.418+0000 7fe2fb7fe700 1 -- 172.21.15.12:0/3224922100 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe31416a120 con 0x7fe300067130 2023-10-08T16:21:23.420 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 msgr2=0x7fe3000695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 0x7fe3000695e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3140b2820 tx=0x7fe3040091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 msgr2=0x7fe3140c5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe30c013000 tx=0x7fe30c019000 comp rx=0 tx=0).stop 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 shutdown_connections 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe300067130 0x7fe3000695e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe314159770 0x7fe3140c5ff0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31406c6a0 0x7fe31416a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 --2- 172.21.15.12:0/3224922100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3140cacb0 0x7fe314154390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 >> 172.21.15.12:0/3224922100 conn(0x7fe31406e790 msgr2=0x7fe3140b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 shutdown_connections 2023-10-08T16:21:23.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.421+0000 7fe318f9d700 1 -- 172.21.15.12:0/3224922100 wait complete. 2023-10-08T16:21:23.439 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-10-08T16:21:23.439 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-10-08T16:21:23.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.631+0000 7fde26f9d700 1 Processor -- start 2023-10-08T16:21:23.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.631+0000 7fde26f9d700 1 -- start start 2023-10-08T16:21:23.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.632+0000 7fde26f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde200cb450 0x7fde2015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.632+0000 7fde26f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2015d8d0 con 0x7fde20142ca0 2023-10-08T16:21:23.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.632+0000 7fde26f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde2015d2f0 con 0x7fde20143070 2023-10-08T16:21:23.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.632+0000 7fde26f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde200cc630 con 0x7fde200cb450 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde200cb450 0x7fde2015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde200cb450 0x7fde2015dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51740/0 (socket says 172.21.15.12:51740) 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde25f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fde20142ca0 0x7fde200cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51496/0 (socket says 172.21.15.12:51496) 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 -- 172.21.15.12:0/3798357414 learned_addr learned my addr 172.21.15.12:0/3798357414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 -- 172.21.15.12:0/3798357414 >> v1:172.21.15.29:6789/0 conn(0x7fde20143070 legacy=0x7fde2006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 -- 172.21.15.12:0/3798357414 >> v1:172.21.15.12:6789/0 conn(0x7fde20142ca0 legacy=0x7fde200cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 -- 172.21.15.12:0/3798357414 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde2015d560 con 0x7fde200cb450 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde24f99700 1 -- 172.21.15.12:0/3798357414 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162426205 0 0) 0x7fde2015d8d0 con 0x7fde20142ca0 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.633+0000 7fde2579a700 1 --2- 172.21.15.12:0/3798357414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2015dd60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fde100099b0 tx=0x7fde10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c90b7bed019418 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde24f99700 1 -- 172.21.15.12:0/3798357414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000b860 con 0x7fde200cb450 2023-10-08T16:21:23.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde24f99700 1 -- 172.21.15.12:0/3798357414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1000b9c0 con 0x7fde200cb450 2023-10-08T16:21:23.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde24f99700 1 -- 172.21.15.12:0/3798357414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1000bd60 con 0x7fde200cb450 2023-10-08T16:21:23.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 -- 172.21.15.12:0/3798357414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 msgr2=0x7fde2015dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3798357414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2015dd60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fde100099b0 tx=0x7fde10009250 comp rx=0 tx=0).stop 2023-10-08T16:21:23.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 -- 172.21.15.12:0/3798357414 shutdown_connections 2023-10-08T16:21:23.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3798357414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2015dd60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 -- 172.21.15.12:0/3798357414 >> 172.21.15.12:0/3798357414 conn(0x7fde20067c80 msgr2=0x7fde20068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 -- 172.21.15.12:0/3798357414 shutdown_connections 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.634+0000 7fde26f9d700 1 -- 172.21.15.12:0/3798357414 wait complete. 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.636+0000 7fde26f9d700 1 Processor -- start 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.636+0000 7fde26f9d700 1 -- start start 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde20142ca0 0x7fde200b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde20143070 0x7fde20141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde201696f0 con 0x7fde200cb450 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2016a4d0 con 0x7fde20142ca0 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde26f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde20169900 con 0x7fde20143070 2023-10-08T16:21:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51750/0 (socket says 172.21.15.12:51750) 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 -- 172.21.15.12:0/3655167095 learned_addr learned my addr 172.21.15.12:0/3655167095 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde2579a700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde20142ca0 0x7fde200b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde2679c700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde20143070 0x7fde20141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 -- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde20143070 msgr2=0x7fde20141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde20143070 0x7fde20141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 -- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde20142ca0 msgr2=0x7fde200b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde20142ca0 0x7fde200b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.637+0000 7fde25f9b700 1 -- 172.21.15.12:0/3655167095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100094f0 con 0x7fde200cb450 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde25f9b700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c810 tx=0x7fde1c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c005b40 con 0x7fde200cb450 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c005cc0 con 0x7fde200cb450 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c007320 con 0x7fde200cb450 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde20169ba0 con 0x7fde200cb450 2023-10-08T16:21:23.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.638+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde2016a160 con 0x7fde200cb450 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.639+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde2004c3c0 con 0x7fde200cb450 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.640+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fde1c01b3b0 con 0x7fde200cb450 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.641+0000 7fde15ffb700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 0x7fde040695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.641+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fde1c083f60 con 0x7fde200cb450 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.641+0000 7fde2579a700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 0x7fde040695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:23.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.642+0000 7fde2579a700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 0x7fde040695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde100099b0 tx=0x7fde10017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:23.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.645+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde1c050db0 con 0x7fde200cb450 2023-10-08T16:21:23.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.873+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fde200cc910 con 0x7fde04067130 2023-10-08T16:21:23.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.939+0000 7fde15ffb700 1 -- 172.21.15.12:0/3655167095 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fde200cc910 con 0x7fde04067130 2023-10-08T16:21:23.940 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 msgr2=0x7fde040695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 0x7fde040695e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fde100099b0 tx=0x7fde10017000 comp rx=0 tx=0).stop 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 msgr2=0x7fde2013e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c810 tx=0x7fde1c007d90 comp rx=0 tx=0).stop 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 shutdown_connections 2023-10-08T16:21:23.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fde04067130 0x7fde040695e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde200cb450 0x7fde2013e930 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde20143070 0x7fde20141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 --2- 172.21.15.12:0/3655167095 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde20142ca0 0x7fde200b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 >> 172.21.15.12:0/3655167095 conn(0x7fde20067c80 msgr2=0x7fde2015c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 shutdown_connections 2023-10-08T16:21:23.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:23.942+0000 7fde26f9d700 1 -- 172.21.15.12:0/3655167095 wait complete. 2023-10-08T16:21:23.960 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-10-08T16:21:23.960 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-10-08T16:21:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.152+0000 7f5724f9d700 1 Processor -- start 2023-10-08T16:21:24.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.152+0000 7f5724f9d700 1 -- start start 2023-10-08T16:21:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.153+0000 7f5724f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720159fb0 0x7f572015a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.153+0000 7f5724f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57200cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.153+0000 7f5724f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572015d570 con 0x7f572015a8c0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.153+0000 7f5724f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572015e180 con 0x7f5720159fb0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.153+0000 7f5724f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572015d850 con 0x7f57200cd5a0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720159fb0 0x7f572015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5720159fb0 0x7f572015a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51764/0 (socket says 172.21.15.12:51764) 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 -- 172.21.15.12:0/591058950 learned_addr learned my addr 172.21.15.12:0/591058950 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571ffff700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57200cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 -- 172.21.15.12:0/591058950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 msgr2=0x7f57200cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57200cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 -- 172.21.15.12:0/591058950 >> v1:172.21.15.29:6789/0 conn(0x7f572015a8c0 legacy=0x7f57200cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.154+0000 7f571f7fe700 1 -- 172.21.15.12:0/591058950 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572015db30 con 0x7f5720159fb0 2023-10-08T16:21:24.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f571f7fe700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720159fb0 0x7f572015a380 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57100099b0 tx=0x7f5710009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd8959e952f216c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f571e7fc700 1 -- 172.21.15.12:0/591058950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000b820 con 0x7f5720159fb0 2023-10-08T16:21:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f571e7fc700 1 -- 172.21.15.12:0/591058950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000b980 con 0x7f5720159fb0 2023-10-08T16:21:24.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f571e7fc700 1 -- 172.21.15.12:0/591058950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000bd20 con 0x7f5720159fb0 2023-10-08T16:21:24.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 -- 172.21.15.12:0/591058950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720159fb0 msgr2=0x7f572015a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720159fb0 0x7f572015a380 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f57100099b0 tx=0x7f5710009250 comp rx=0 tx=0).stop 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 -- 172.21.15.12:0/591058950 shutdown_connections 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57200cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 --2- 172.21.15.12:0/591058950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5720159fb0 0x7f572015a380 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.155+0000 7f5724f9d700 1 -- 172.21.15.12:0/591058950 >> 172.21.15.12:0/591058950 conn(0x7f57200703a0 msgr2=0x7f57200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.156+0000 7f5724f9d700 1 -- 172.21.15.12:0/591058950 shutdown_connections 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.156+0000 7f5724f9d700 1 -- 172.21.15.12:0/591058950 wait complete. 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.157+0000 7f5724f9d700 1 Processor -- start 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.157+0000 7f5724f9d700 1 -- start start 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57201478d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5720159fb0 0x7f57200b1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572014cfd0 con 0x7f572015a8c0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572016a200 con 0x7f5720159fb0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f5724f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200c8c50 con 0x7f57200cd5a0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f571ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f571ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51774/0 (socket says 172.21.15.12:51774) 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f571ffff700 1 -- 172.21.15.12:0/1755301820 learned_addr learned my addr 172.21.15.12:0/1755301820 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f571f7fe700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57201478d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.158+0000 7f571effd700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5720159fb0 0x7f57200b1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 -- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 msgr2=0x7f57201478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57201478d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 -- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5720159fb0 msgr2=0x7f57200b1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5720159fb0 0x7f57200b1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 -- 172.21.15.12:0/1755301820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57100094f0 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f571ffff700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5718007f20 tx=0x7f57180098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800eb90 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571800ed10 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5718014670 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572014c450 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.159+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572014ca90 con 0x7f572015a8c0 2023-10-08T16:21:24.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.160+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572004c3c0 con 0x7f572015a8c0 2023-10-08T16:21:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.161+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f5718014a60 con 0x7f572015a8c0 2023-10-08T16:21:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.162+0000 7f57077fe700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 0x7f570c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.162+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f5718084fa0 con 0x7f572015a8c0 2023-10-08T16:21:24.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.162+0000 7f571f7fe700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 0x7f570c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.163+0000 7f571f7fe700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 0x7f570c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57100099b0 tx=0x7f5710016000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.166+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5718051e90 con 0x7f572015a8c0 2023-10-08T16:21:24.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.400+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f57200c8de0 con 0x7f570c067130 2023-10-08T16:21:24.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.464+0000 7f57077fe700 1 -- 172.21.15.12:0/1755301820 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f57200c8de0 con 0x7f570c067130 2023-10-08T16:21:24.465 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 msgr2=0x7f570c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 0x7f570c0695e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f57100099b0 tx=0x7f5710016000 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 msgr2=0x7f57200c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5718007f20 tx=0x7f57180098a0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 shutdown_connections 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f570c067130 0x7f570c0695e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f572015a8c0 0x7f57200c62c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f57200cd5a0 0x7f57201478d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 --2- 172.21.15.12:0/1755301820 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5720159fb0 0x7f57200b1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 >> 172.21.15.12:0/1755301820 conn(0x7f57200703a0 msgr2=0x7f57200ccb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 shutdown_connections 2023-10-08T16:21:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.467+0000 7f5724f9d700 1 -- 172.21.15.12:0/1755301820 wait complete. 2023-10-08T16:21:24.485 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-10-08T16:21:24.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-10-08T16:21:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.678+0000 7f3bced9d700 1 Processor -- start 2023-10-08T16:21:24.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.678+0000 7f3bced9d700 1 -- start start 2023-10-08T16:21:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bced9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bc8142ca0 0x7f3bc815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bced9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc80cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bced9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc815d8d0 con 0x7f3bc815a6f0 2023-10-08T16:21:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bced9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc815d2f0 con 0x7f3bc8142ca0 2023-10-08T16:21:24.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bced9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80cc630 con 0x7f3bc8143070 2023-10-08T16:21:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bce59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3bc815a6f0 0x7f3bc80cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51512/0 (socket says 172.21.15.12:51512) 2023-10-08T16:21:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.679+0000 7f3bce59c700 1 -- 172.21.15.12:0/2538571654 learned_addr learned my addr 172.21.15.12:0/2538571654 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/2538571654 >> v2:172.21.15.29:3300/0 conn(0x7f3bc8142ca0 0x7f3bc815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcd59a700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc80cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bccd99700 1 -- 172.21.15.12:0/2538571654 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107517074 0 0) 0x7f3bc815d8d0 con 0x7f3bc815a6f0 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bccd99700 1 -- 172.21.15.12:0/2538571654 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bb4003570 con 0x7f3bc815a6f0 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 msgr2=0x7f3bc80cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc80cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/2538571654 >> v1:172.21.15.12:6789/0 conn(0x7f3bc815a6f0 legacy=0x7f3bc80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/2538571654 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc815d560 con 0x7f3bc8142ca0 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcd59a700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:24.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.680+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc8142ca0 0x7f3bc815dd60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40098e0 tx=0x7f3bc40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e207814d2d59813e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bccd99700 1 -- 172.21.15.12:0/2538571654 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011630 con 0x7f3bc8142ca0 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bccd99700 1 -- 172.21.15.12:0/2538571654 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4011790 con 0x7f3bc8142ca0 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bccd99700 1 -- 172.21.15.12:0/2538571654 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4011b30 con 0x7f3bc8142ca0 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 -- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc8142ca0 msgr2=0x7f3bc815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc8142ca0 0x7f3bc815dd60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40098e0 tx=0x7f3bc40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 -- 172.21.15.12:0/2538571654 shutdown_connections 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc8142ca0 0x7f3bc815dd60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 --2- 172.21.15.12:0/2538571654 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc80cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 -- 172.21.15.12:0/2538571654 >> 172.21.15.12:0/2538571654 conn(0x7f3bc8067c80 msgr2=0x7f3bc8068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:24.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.681+0000 7f3bced9d700 1 -- 172.21.15.12:0/2538571654 shutdown_connections 2023-10-08T16:21:24.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.682+0000 7f3bced9d700 1 -- 172.21.15.12:0/2538571654 wait complete. 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.683+0000 7f3bced9d700 1 Processor -- start 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.683+0000 7f3bced9d700 1 -- start start 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc815a6f0 0x7f3bc806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc816a660 con 0x7f3bc8142ca0 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b1f60 con 0x7f3bc815a6f0 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bced9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b11a0 con 0x7f3bc8143070 2023-10-08T16:21:24.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bcdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bcdd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51786/0 (socket says 172.21.15.12:51786) 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/433294734 learned_addr learned my addr 172.21.15.12:0/433294734 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bce59c700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc815a6f0 0x7f3bc806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.684+0000 7f3bcd59a700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 msgr2=0x7f3bc806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc815a6f0 msgr2=0x7f3bc806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc815a6f0 0x7f3bc806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 -- 172.21.15.12:0/433294734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009420 con 0x7f3bc8142ca0 2023-10-08T16:21:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bcdd9b700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80691a0 tx=0x7f3bc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4000d10 con 0x7f3bc8142ca0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc4011b10 con 0x7f3bc8142ca0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4025660 con 0x7f3bc8142ca0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc4009420 con 0x7f3bc8142ca0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.685+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc80b1760 con 0x7f3bc8142ca0 2023-10-08T16:21:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.686+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc80cd270 con 0x7f3bc8142ca0 2023-10-08T16:21:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.687+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f3bc4025a50 con 0x7f3bc8142ca0 2023-10-08T16:21:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.688+0000 7f3bbdffb700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 0x7f3bac0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.688+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f3bc4086190 con 0x7f3bc8142ca0 2023-10-08T16:21:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.688+0000 7f3bcd59a700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 0x7f3bac0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:24.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.689+0000 7f3bcd59a700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 0x7f3bac0695e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8136150 tx=0x7f3bb80091a0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:24.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.692+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bc4052fe0 con 0x7f3bc8142ca0 2023-10-08T16:21:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.922+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bc804c3c0 con 0x7f3bac067130 2023-10-08T16:21:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.993+0000 7f3bbdffb700 1 -- 172.21.15.12:0/433294734 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3bc804c3c0 con 0x7f3bac067130 2023-10-08T16:21:24.994 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-10-08T16:21:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.995+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 msgr2=0x7f3bac0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.995+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 0x7f3bac0695e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8136150 tx=0x7f3bb80091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 msgr2=0x7f3bc8158e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80691a0 tx=0x7f3bc4017000 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 shutdown_connections 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3bac067130 0x7f3bac0695e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bc8142ca0 0x7f3bc8158e60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bc815a6f0 0x7f3bc806e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 --2- 172.21.15.12:0/433294734 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bc8143070 0x7f3bc806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 >> 172.21.15.12:0/433294734 conn(0x7f3bc8067c80 msgr2=0x7f3bc8141d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 shutdown_connections 2023-10-08T16:21:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:24.996+0000 7f3bced9d700 1 -- 172.21.15.12:0/433294734 wait complete. 2023-10-08T16:21:25.014 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-10-08T16:21:25.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-10-08T16:21:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.207+0000 7fe49a79d700 1 Processor -- start 2023-10-08T16:21:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.207+0000 7fe49a79d700 1 -- start start 2023-10-08T16:21:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49a79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4940c8200 0x7fe4940c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49a79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 0x7fe494156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49a79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4941579b0 con 0x7fe4940c85d0 2023-10-08T16:21:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49a79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940c1390 con 0x7fe4940c8200 2023-10-08T16:21:25.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49a79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4941573f0 con 0x7fe4940c2a90 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4940c8200 0x7fe4940c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4940c8200 0x7fe4940c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51792/0 (socket says 172.21.15.12:51792) 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 -- 172.21.15.12:0/4076248013 learned_addr learned my addr 172.21.15.12:0/4076248013 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe498f9a700 1 --2- 172.21.15.12:0/4076248013 >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 0x7fe494156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 -- 172.21.15.12:0/4076248013 >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 msgr2=0x7fe494156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 --2- 172.21.15.12:0/4076248013 >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 0x7fe494156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 -- 172.21.15.12:0/4076248013 >> v1:172.21.15.29:6789/0 conn(0x7fe4940c85d0 legacy=0x7fe4940cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe49979b700 1 -- 172.21.15.12:0/4076248013 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4941576d0 con 0x7fe4940c8200 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.209+0000 7fe498f9a700 1 --2- 172.21.15.12:0/4076248013 >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 0x7fe494156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:25.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe49979b700 1 --2- 172.21.15.12:0/4076248013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940c1820 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe49415b1d0 tx=0x7fe490009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c649b08d0ad05 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe48bfff700 1 -- 172.21.15.12:0/4076248013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000b860 con 0x7fe4940c8200 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe48bfff700 1 -- 172.21.15.12:0/4076248013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe49000b9c0 con 0x7fe4940c8200 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe48bfff700 1 -- 172.21.15.12:0/4076248013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49000bd60 con 0x7fe4940c8200 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe49a79d700 1 -- 172.21.15.12:0/4076248013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 msgr2=0x7fe4940c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.210+0000 7fe49a79d700 1 --2- 172.21.15.12:0/4076248013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940c1820 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe49415b1d0 tx=0x7fe490009250 comp rx=0 tx=0).stop 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 -- 172.21.15.12:0/4076248013 shutdown_connections 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 --2- 172.21.15.12:0/4076248013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940c1820 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 --2- 172.21.15.12:0/4076248013 >> v2:172.21.15.29:3300/0 conn(0x7fe4940c2a90 0x7fe494156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 -- 172.21.15.12:0/4076248013 >> 172.21.15.12:0/4076248013 conn(0x7fe49406c6a0 msgr2=0x7fe49406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 -- 172.21.15.12:0/4076248013 shutdown_connections 2023-10-08T16:21:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.211+0000 7fe49a79d700 1 -- 172.21.15.12:0/4076248013 wait complete. 2023-10-08T16:21:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.212+0000 7fe49a79d700 1 Processor -- start 2023-10-08T16:21:25.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.212+0000 7fe49a79d700 1 -- start start 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4940c2a90 0x7fe494145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4940c85d0 0x7fe494149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494145fc0 con 0x7fe4940c8200 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940ac4f0 con 0x7fe4940c2a90 2023-10-08T16:21:25.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.213+0000 7fe49a79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940ab8e0 con 0x7fe4940c85d0 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51796/0 (socket says 172.21.15.12:51796) 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 -- 172.21.15.12:0/1880442257 learned_addr learned my addr 172.21.15.12:0/1880442257 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 -- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4940c85d0 msgr2=0x7fe494149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4940c85d0 0x7fe494149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 -- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4940c2a90 msgr2=0x7fe494145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4940c2a90 0x7fe494145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 -- 172.21.15.12:0/1880442257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4900094f0 con 0x7fe4940c8200 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe498f9a700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe48400e8a0 tx=0x7fe484008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48400c430 con 0x7fe4940c8200 2023-10-08T16:21:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48400c590 con 0x7fe4940c8200 2023-10-08T16:21:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48400c950 con 0x7fe4940c8200 2023-10-08T16:21:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.214+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940abbc0 con 0x7fe4940c8200 2023-10-08T16:21:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.215+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4940ac180 con 0x7fe4940c8200 2023-10-08T16:21:25.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.216+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49404c3c0 con 0x7fe4940c8200 2023-10-08T16:21:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.217+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fe48400cd00 con 0x7fe4940c8200 2023-10-08T16:21:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.217+0000 7fe4897fa700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 0x7fe478069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.217+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fe4840847f0 con 0x7fe4940c8200 2023-10-08T16:21:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.218+0000 7fe49979b700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 0x7fe478069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.218+0000 7fe49979b700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 0x7fe478069610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe49415b1d0 tx=0x7fe490017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.222+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4840515d0 con 0x7fe4940c8200 2023-10-08T16:21:25.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.454+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4940ac660 con 0x7fe478067160 2023-10-08T16:21:25.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.525+0000 7fe4897fa700 1 -- 172.21.15.12:0/1880442257 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe4940ac660 con 0x7fe478067160 2023-10-08T16:21:25.526 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 msgr2=0x7fe478069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 0x7fe478069610 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe49415b1d0 tx=0x7fe490017000 comp rx=0 tx=0).stop 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 msgr2=0x7fe4940af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe48400e8a0 tx=0x7fe484008040 comp rx=0 tx=0).stop 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 shutdown_connections 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4940c85d0 0x7fe494149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4940c2a90 0x7fe494145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe478067160 0x7fe478069610 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 --2- 172.21.15.12:0/1880442257 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4940c8200 0x7fe4940af1d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 >> 172.21.15.12:0/1880442257 conn(0x7fe49406c6a0 msgr2=0x7fe4940c1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 shutdown_connections 2023-10-08T16:21:25.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.528+0000 7fe49a79d700 1 -- 172.21.15.12:0/1880442257 wait complete. 2023-10-08T16:21:25.546 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-10-08T16:21:25.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-10-08T16:21:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.738+0000 7f34589fe700 1 Processor -- start 2023-10-08T16:21:25.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.738+0000 7f34589fe700 1 -- start start 2023-10-08T16:21:25.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f34589fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34540c8200 0x7f34540c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f34589fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 0x7f3454156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f34589fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34541579b0 con 0x7f34540c85d0 2023-10-08T16:21:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f34589fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34540c1390 con 0x7f34540c8200 2023-10-08T16:21:25.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f34589fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34541573f0 con 0x7f34540c2a90 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f345259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 0x7f3454156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f3452d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34540c8200 0x7f34540c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f345259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 0x7f3454156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:54112/0 (socket says 172.21.15.12:54112) 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f3452d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34540c8200 0x7f34540c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47790/0 (socket says 172.21.15.12:47790) 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f345259c700 1 -- 172.21.15.12:0/480230163 learned_addr learned my addr 172.21.15.12:0/480230163 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.740+0000 7f345359e700 1 --1- 172.21.15.12:0/480230163 >> v1:172.21.15.29:6789/0 conn(0x7f34540c85d0 0x7f34540cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42050/0 (socket says 172.21.15.12:42050) 2023-10-08T16:21:25.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3452d9d700 1 -- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 msgr2=0x7f3454156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3452d9d700 1 --2- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 0x7f3454156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3452d9d700 1 -- 172.21.15.12:0/480230163 >> v1:172.21.15.29:6789/0 conn(0x7f34540c85d0 legacy=0x7f34540cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3452d9d700 1 -- 172.21.15.12:0/480230163 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34541576d0 con 0x7f34540c8200 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3452d9d700 1 --2- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540c1820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f344400dd10 tx=0x7f344400d630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9eb0c518543168c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3451d9b700 1 -- 172.21.15.12:0/480230163 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444012070 con 0x7f34540c8200 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3451d9b700 1 -- 172.21.15.12:0/480230163 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344400de70 con 0x7f34540c8200 2023-10-08T16:21:25.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.741+0000 7f3451d9b700 1 -- 172.21.15.12:0/480230163 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400fb60 con 0x7f34540c8200 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 -- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 msgr2=0x7f34540c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 --2- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540c1820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f344400dd10 tx=0x7f344400d630 comp rx=0 tx=0).stop 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 -- 172.21.15.12:0/480230163 shutdown_connections 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 --2- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540c1820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 --2- 172.21.15.12:0/480230163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c2a90 0x7f3454156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 -- 172.21.15.12:0/480230163 >> 172.21.15.12:0/480230163 conn(0x7f345406c6a0 msgr2=0x7f345406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 -- 172.21.15.12:0/480230163 shutdown_connections 2023-10-08T16:21:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.742+0000 7f34589fe700 1 -- 172.21.15.12:0/480230163 wait complete. 2023-10-08T16:21:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.743+0000 7f34589fe700 1 Processor -- start 2023-10-08T16:21:25.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.744+0000 7f34589fe700 1 -- start start 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c85d0 0x7f3454158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540ac810 con 0x7f34540c2a90 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34540ac9a0 con 0x7f34540c8200 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f34589fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34540af940 con 0x7f34540c85d0 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51802/0 (socket says 172.21.15.12:51802) 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 -- 172.21.15.12:0/2616749921 learned_addr learned my addr 172.21.15.12:0/2616749921 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:25.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f345259c700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f345359e700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c85d0 0x7f3454158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 -- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c85d0 msgr2=0x7f3454158740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c85d0 0x7f3454158740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 -- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 msgr2=0x7f34540aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 -- 172.21.15.12:0/2616749921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344400d8d0 con 0x7f34540c2a90 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f345259c700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.745+0000 7f3452d9d700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f34540697c0 tx=0x7f344401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.746+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344400ca20 con 0x7f34540c2a90 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.746+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344400cba0 con 0x7f34540c2a90 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.746+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3444020410 con 0x7f34540c2a90 2023-10-08T16:21:25.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.746+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34540afc20 con 0x7f34540c2a90 2023-10-08T16:21:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.746+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34540b01e0 con 0x7f34540c2a90 2023-10-08T16:21:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.747+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f345404c3c0 con 0x7f34540c2a90 2023-10-08T16:21:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.748+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f34440207c0 con 0x7f34540c2a90 2023-10-08T16:21:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.749+0000 7f343affd700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 0x7f34400695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:25.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.749+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f344408a1b0 con 0x7f34540c2a90 2023-10-08T16:21:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.749+0000 7f345259c700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 0x7f34400695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:25.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.750+0000 7f345259c700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 0x7f34400695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3448006d40 tx=0x7f3448008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:25.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.753+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3444056ef0 con 0x7f34540c2a90 2023-10-08T16:21:25.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:25.986+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f34540acae0 con 0x7f3440067130 2023-10-08T16:21:26.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.052+0000 7f343affd700 1 -- 172.21.15.12:0/2616749921 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f3448009a00 con 0x7f3440067130 2023-10-08T16:21:26.053 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 msgr2=0x7f34400695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 0x7f34400695e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3448006d40 tx=0x7f3448008040 comp rx=0 tx=0).stop 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 msgr2=0x7f3454147b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f34540697c0 tx=0x7f344401c000 comp rx=0 tx=0).stop 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 shutdown_connections 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3440067130 0x7f34400695e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34540c2a90 0x7f3454147b10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34540c85d0 0x7f3454158740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 --2- 172.21.15.12:0/2616749921 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34540c8200 0x7f34540aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 >> 172.21.15.12:0/2616749921 conn(0x7f345406c6a0 msgr2=0x7f34540c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 shutdown_connections 2023-10-08T16:21:26.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.054+0000 7f34589fe700 1 -- 172.21.15.12:0/2616749921 wait complete. 2023-10-08T16:21:26.072 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-10-08T16:21:26.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:26.073 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-08T16:21:26.114 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:26.114 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:26.115 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:26.116 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:26.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-10-08T16:21:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.346+0000 7f1c2e99d700 1 Processor -- start 2023-10-08T16:21:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.346+0000 7f1c2e99d700 1 -- start start 2023-10-08T16:21:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c280cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2e99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2815d570 con 0x7f1c280cce90 2023-10-08T16:21:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2e99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c2815d850 con 0x7f1c28159fb0 2023-10-08T16:21:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2815e180 con 0x7f1c280cd330 2023-10-08T16:21:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2d19a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1c280cce90 0x7f1c280cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51518/0 (socket says 172.21.15.12:51518) 2023-10-08T16:21:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2d19a700 1 -- 172.21.15.12:0/3106712625 learned_addr learned my addr 172.21.15.12:0/3106712625 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:26.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c280cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209295366 0 0) 0x7f1c2815d570 con 0x7f1c280cce90 2023-10-08T16:21:26.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.348+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c14003570 con 0x7f1c280cce90 2023-10-08T16:21:26.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661550644 0 0) 0x7f1c2815d850 con 0x7f1c28159fb0 2023-10-08T16:21:26.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c2815d570 con 0x7f1c28159fb0 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1824238844 0 0) 0x7f1c14003570 con 0x7f1c280cce90 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 msgr2=0x7f1c280cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c280cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 >> v1:172.21.15.29:6789/0 conn(0x7f1c28159fb0 legacy=0x7f1c2815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2815db30 con 0x7f1c280cce90 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1c18001470 con 0x7f1c280cce90 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 >> v1:172.21.15.12:6789/0 conn(0x7f1c280cce90 legacy=0x7f1c280cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c14003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c140041d0 0x7f1c14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2815e180 con 0x7f1c14004d50 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1400bbf0 con 0x7f1c140041d0 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1400bdb0 con 0x7f1c280cd330 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2d19a700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c140041d0 0x7f1c14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.349+0000 7f1c2d99b700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c14003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 -- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 msgr2=0x7f1c14003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c14003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 -- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c140041d0 msgr2=0x7f1c14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c140041d0 0x7f1c14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 -- 172.21.15.12:0/3106712625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14003570 con 0x7f1c14004d50 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2d99b700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280cd330 0x7f1c14003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c140051c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000e210 tx=0x7f1c2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac56fa7253507f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000eac0 con 0x7f1c14004d50 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2000f040 con 0x7f1c14004d50 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.350+0000 7f1c2c999700 1 -- 172.21.15.12:0/3106712625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2000ee70 con 0x7f1c14004d50 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3106712625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 msgr2=0x7f1c140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3106712625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c140051c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000e210 tx=0x7f1c2000b040 comp rx=0 tx=0).stop 2023-10-08T16:21:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e19c700 1 -- 172.21.15.12:0/3106712625 reap_dead start 2023-10-08T16:21:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3106712625 shutdown_connections 2023-10-08T16:21:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3106712625 >> 172.21.15.12:0/3106712625 conn(0x7f1c280703a0 msgr2=0x7f1c280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3106712625 shutdown_connections 2023-10-08T16:21:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.351+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3106712625 wait complete. 2023-10-08T16:21:26.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.352+0000 7f1c2e99d700 1 Processor -- start 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 -- start start 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 0x7f1c280c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280b1200 0x7f1c280b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280b01f0 con 0x7f1c14004d50 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280c7850 con 0x7f1c280c9ac0 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.353+0000 7f1c2e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c280b0440 con 0x7f1c280b1200 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51822/0 (socket says 172.21.15.12:51822) 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 -- 172.21.15.12:0/3631964336 learned_addr learned my addr 172.21.15.12:0/3631964336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d19a700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 0x7f1c280c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2e19c700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280b1200 0x7f1c280b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 -- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280b1200 msgr2=0x7f1c280b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280b1200 0x7f1c280b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 -- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 msgr2=0x7f1c280c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 0x7f1c280c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 -- 172.21.15.12:0/3631964336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c280b0720 con 0x7f1c14004d50 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d19a700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 0x7f1c280c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.354+0000 7f1c2d99b700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1c24007fd0 tx=0x7f1c24009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.355+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24006820 con 0x7f1c14004d50 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.355+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c24010040 con 0x7f1c14004d50 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.355+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c24006bb0 con 0x7f1c14004d50 2023-10-08T16:21:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.355+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c280b0a00 con 0x7f1c14004d50 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.355+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2814f4b0 con 0x7f1c14004d50 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.356+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2804c3c0 con 0x7f1c14004d50 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.357+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f1c24007030 con 0x7f1c14004d50 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.358+0000 7f1c1dffb700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 0x7f1c0c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.358+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1c24083dd0 con 0x7f1c14004d50 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.358+0000 7f1c2d19a700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 0x7f1c0c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.358+0000 7f1c2d19a700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 0x7f1c0c0695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1c18001e30 tx=0x7f1c18009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.362+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c2404d5a0 con 0x7f1c14004d50 2023-10-08T16:21:26.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.594+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c280caef0 con 0x7f1c0c067130 2023-10-08T16:21:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.603+0000 7f1c1dffb700 1 -- 172.21.15.12:0/3631964336 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1c280caef0 con 0x7f1c0c067130 2023-10-08T16:21:26.604 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:26.604 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:50", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 msgr2=0x7f1c0c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 0x7f1c0c0695e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1c18001e30 tx=0x7f1c18009040 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 msgr2=0x7f1c28150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1c24007fd0 tx=0x7f1c24009040 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 shutdown_connections 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1c0c067130 0x7f1c0c0695e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c14004d50 0x7f1c28150dc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c280b1200 0x7f1c280b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 --2- 172.21.15.12:0/3631964336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c280c9ac0 0x7f1c280c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.605+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 >> 172.21.15.12:0/3631964336 conn(0x7f1c280703a0 msgr2=0x7f1c28150020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.606+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 shutdown_connections 2023-10-08T16:21:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.606+0000 7f1c2e99d700 1 -- 172.21.15.12:0/3631964336 wait complete. 2023-10-08T16:21:26.623 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:50", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:26.624 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:50', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:26.624 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:26.624 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:26.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:26.624 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-08T16:21:26.662 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:26.662 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:26.662 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:26.662 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:26.662 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:26.663 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:26.664 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:26.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-10-08T16:21:26.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.895+0000 7fba97fff700 1 Processor -- start 2023-10-08T16:21:26.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.895+0000 7fba97fff700 1 -- start start 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba980c8200 0x7fba980c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba98156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba980c85d0 0x7fba980cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba981579b0 con 0x7fba980c85d0 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980c1390 con 0x7fba980c8200 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba97fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba981573f0 con 0x7fba980c2a90 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.896+0000 7fba977fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba980c85d0 0x7fba980cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba980c85d0 0x7fba980cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51824/0 (socket says 172.21.15.12:51824) 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 -- 172.21.15.12:0/2916599909 learned_addr learned my addr 172.21.15.12:0/2916599909 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:26.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba96ffd700 1 --2- 172.21.15.12:0/2916599909 >> v2:172.21.15.29:3300/0 conn(0x7fba980c8200 0x7fba980c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba967fc700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba98156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 -- 172.21.15.12:0/2916599909 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 msgr2=0x7fba98156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba98156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 -- 172.21.15.12:0/2916599909 >> v2:172.21.15.29:3300/0 conn(0x7fba980c8200 msgr2=0x7fba980c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 --2- 172.21.15.12:0/2916599909 >> v2:172.21.15.29:3300/0 conn(0x7fba980c8200 0x7fba980c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 -- 172.21.15.12:0/2916599909 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba981576d0 con 0x7fba980c85d0 2023-10-08T16:21:26.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.897+0000 7fba977fe700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba980cc2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba980683d0 tx=0x7fba90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd41ffdc7b05a127 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba95ffb700 1 -- 172.21.15.12:0/2916599909 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000e070 con 0x7fba980c85d0 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba95ffb700 1 -- 172.21.15.12:0/2916599909 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000b970 con 0x7fba980c85d0 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba95ffb700 1 -- 172.21.15.12:0/2916599909 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900092e0 con 0x7fba980c85d0 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 -- 172.21.15.12:0/2916599909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 msgr2=0x7fba980cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba980cc2f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba980683d0 tx=0x7fba90009840 comp rx=0 tx=0).stop 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 -- 172.21.15.12:0/2916599909 shutdown_connections 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba980cc2f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 --2- 172.21.15.12:0/2916599909 >> v2:172.21.15.29:3300/0 conn(0x7fba980c8200 0x7fba980c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 --2- 172.21.15.12:0/2916599909 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba98156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.898+0000 7fba97fff700 1 -- 172.21.15.12:0/2916599909 >> 172.21.15.12:0/2916599909 conn(0x7fba9806c6a0 msgr2=0x7fba9806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.899+0000 7fba97fff700 1 -- 172.21.15.12:0/2916599909 shutdown_connections 2023-10-08T16:21:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.899+0000 7fba97fff700 1 -- 172.21.15.12:0/2916599909 wait complete. 2023-10-08T16:21:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.900+0000 7fba97fff700 1 Processor -- start 2023-10-08T16:21:26.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.900+0000 7fba97fff700 1 -- start start 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 0x7fba98142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba98159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98143840 con 0x7fba980c85d0 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba98142c30 con 0x7fba980c8200 2023-10-08T16:21:26.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba97fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba98142f10 con 0x7fba980c2a90 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba98159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba96ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:54168/0 (socket says 172.21.15.12:54168) 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba967fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 0x7fba98142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.901+0000 7fba96ffd700 1 -- 172.21.15.12:0/3001959596 learned_addr learned my addr 172.21.15.12:0/3001959596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 -- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 msgr2=0x7fba980b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 -- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 msgr2=0x7fba98142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 0x7fba98142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 -- 172.21.15.12:0/3001959596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba90009ae0 con 0x7fba980c85d0 2023-10-08T16:21:26.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba96ffd700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba967fc700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 0x7fba98142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba977fe700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba98159030 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fba90015000 tx=0x7fba90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90022070 con 0x7fba980c85d0 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba900094e0 con 0x7fba980c85d0 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba981431f0 con 0x7fba980c85d0 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.902+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba900032f0 con 0x7fba980c85d0 2023-10-08T16:21:26.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.903+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba980b1cf0 con 0x7fba980c85d0 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.904+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba98143050 con 0x7fba980c85d0 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.904+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fba90003040 con 0x7fba980c85d0 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.905+0000 7fba7effd700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 0x7fba840695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.905+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fba90089c60 con 0x7fba980c85d0 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.906+0000 7fba96ffd700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 0x7fba840695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:26.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.906+0000 7fba96ffd700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 0x7fba840695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba88009fd0 tx=0x7fba880091a0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:26.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:26.910+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba98143050 con 0x7fba980c85d0 2023-10-08T16:21:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.140+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba98143050 con 0x7fba84067130 2023-10-08T16:21:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.148+0000 7fba7effd700 1 -- 172.21.15.12:0/3001959596 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fba98143050 con 0x7fba84067130 2023-10-08T16:21:27.149 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:27.149 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:51", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 msgr2=0x7fba840695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 0x7fba840695e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fba88009fd0 tx=0x7fba880091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 msgr2=0x7fba98159030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba98159030 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fba90015000 tx=0x7fba90018000 comp rx=0 tx=0).stop 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 shutdown_connections 2023-10-08T16:21:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fba84067130 0x7fba840695e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba980c85d0 0x7fba98159030 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba980c2a90 0x7fba980b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 --2- 172.21.15.12:0/3001959596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba980c8200 0x7fba98142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 >> 172.21.15.12:0/3001959596 conn(0x7fba9806c6a0 msgr2=0x7fba980cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 shutdown_connections 2023-10-08T16:21:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.151+0000 7fba97fff700 1 -- 172.21.15.12:0/3001959596 wait complete. 2023-10-08T16:21:27.169 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:51", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:27.169 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:51', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:27.169 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:27.169 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:27.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:27.170 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-08T16:21:27.207 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:27.208 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:27.209 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:27.210 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-10-08T16:21:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.440+0000 7f1e2759e700 1 Processor -- start 2023-10-08T16:21:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.441+0000 7f1e2759e700 1 -- start start 2023-10-08T16:21:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1e280c2a90 0x7f1e28156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1e280c85d0 0x7f1e280cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e281579b0 con 0x7f1e280c8200 2023-10-08T16:21:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e280c1390 con 0x7f1e280c2a90 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e281573f0 con 0x7f1e280c85d0 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1e280c8200 0x7f1e280c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51532/0 (socket says 172.21.15.12:51532) 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2659c700 1 -- 172.21.15.12:0/1218282020 learned_addr learned my addr 172.21.15.12:0/1218282020 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e25d9b700 1 --2- 172.21.15.12:0/1218282020 >> v2:172.21.15.12:3300/0 conn(0x7f1e280c2a90 0x7f1e28156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e26d9d700 1 --2- 172.21.15.12:0/1218282020 >> v2:172.21.15.29:3300/0 conn(0x7f1e280c85d0 0x7f1e280cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.442+0000 7f1e2559a700 1 -- 172.21.15.12:0/1218282020 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080815148 0 0) 0x7f1e281579b0 con 0x7f1e280c8200 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e2559a700 1 -- 172.21.15.12:0/1218282020 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e10003570 con 0x7f1e280c8200 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e25d9b700 1 -- 172.21.15.12:0/1218282020 >> v2:172.21.15.29:3300/0 conn(0x7f1e280c85d0 msgr2=0x7f1e280cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e25d9b700 1 --2- 172.21.15.12:0/1218282020 >> v2:172.21.15.29:3300/0 conn(0x7f1e280c85d0 0x7f1e280cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e25d9b700 1 -- 172.21.15.12:0/1218282020 >> v1:172.21.15.12:6789/0 conn(0x7f1e280c8200 legacy=0x7f1e280c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e25d9b700 1 -- 172.21.15.12:0/1218282020 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e281576d0 con 0x7f1e280c2a90 2023-10-08T16:21:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e25d9b700 1 --2- 172.21.15.12:0/1218282020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c2a90 0x7f1e28156aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e280c1300 tx=0x7f1e1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e184437be138b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e2559a700 1 -- 172.21.15.12:0/1218282020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c011630 con 0x7f1e280c2a90 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e2559a700 1 -- 172.21.15.12:0/1218282020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c0117b0 con 0x7f1e280c2a90 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.443+0000 7f1e2559a700 1 -- 172.21.15.12:0/1218282020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c011b30 con 0x7f1e280c2a90 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 -- 172.21.15.12:0/1218282020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c2a90 msgr2=0x7f1e28156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 --2- 172.21.15.12:0/1218282020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c2a90 0x7f1e28156aa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e280c1300 tx=0x7f1e1c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 -- 172.21.15.12:0/1218282020 shutdown_connections 2023-10-08T16:21:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 --2- 172.21.15.12:0/1218282020 >> v2:172.21.15.29:3300/0 conn(0x7f1e280c85d0 0x7f1e280cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 --2- 172.21.15.12:0/1218282020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c2a90 0x7f1e28156aa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 -- 172.21.15.12:0/1218282020 >> 172.21.15.12:0/1218282020 conn(0x7f1e2806c6a0 msgr2=0x7f1e2806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 -- 172.21.15.12:0/1218282020 shutdown_connections 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.444+0000 7f1e2759e700 1 -- 172.21.15.12:0/1218282020 wait complete. 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.445+0000 7f1e2759e700 1 Processor -- start 2023-10-08T16:21:27.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.445+0000 7f1e2759e700 1 -- start start 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 0x7f1e280b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e280c8200 0x7f1e280cc200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2816ad90 con 0x7f1e280c85d0 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2816a180 con 0x7f1e280c2a90 2023-10-08T16:21:27.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.446+0000 7f1e2759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2816a460 con 0x7f1e280c8200 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51858/0 (socket says 172.21.15.12:51858) 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 -- 172.21.15.12:0/2103889626 learned_addr learned my addr 172.21.15.12:0/2103889626 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e2659c700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 0x7f1e280b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e25d9b700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e280c8200 0x7f1e280cc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 -- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e280c8200 msgr2=0x7f1e280cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e280c8200 0x7f1e280cc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 -- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 msgr2=0x7f1e280b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 0x7f1e280b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 -- 172.21.15.12:0/2103889626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009420 con 0x7f1e280c85d0 2023-10-08T16:21:27.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e2659c700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 0x7f1e280b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.447+0000 7f1e26d9d700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009df0 tx=0x7f1e2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.448+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000cb50 con 0x7f1e280c85d0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.448+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000f040 con 0x7f1e280c85d0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.448+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e20014480 con 0x7f1e280c85d0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.448+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2816a740 con 0x7f1e280c85d0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.448+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e28143a30 con 0x7f1e280c85d0 2023-10-08T16:21:27.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.449+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2804c3c0 con 0x7f1e280c85d0 2023-10-08T16:21:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.450+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f1e20014830 con 0x7f1e280c85d0 2023-10-08T16:21:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.451+0000 7f1e167fc700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 0x7f1e080695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.451+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f1e20085400 con 0x7f1e280c85d0 2023-10-08T16:21:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.451+0000 7f1e2659c700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 0x7f1e080695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.451+0000 7f1e2659c700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 0x7f1e080695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e180058d0 tx=0x7f1e18009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.454+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e200521e0 con 0x7f1e280c85d0 2023-10-08T16:21:27.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.680+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1e280c2280 con 0x7f1e08067130 2023-10-08T16:21:27.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.688+0000 7f1e167fc700 1 -- 172.21.15.12:0/2103889626 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f1e280c2280 con 0x7f1e08067130 2023-10-08T16:21:27.689 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:27.689 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:52", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 msgr2=0x7f1e080695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 0x7f1e080695e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e180058d0 tx=0x7f1e18009040 comp rx=0 tx=0).stop 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 msgr2=0x7f1e280cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009df0 tx=0x7f1e2000b040 comp rx=0 tx=0).stop 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 shutdown_connections 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1e08067130 0x7f1e080695e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1e280c85d0 0x7f1e280cc740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1e280c2a90 0x7f1e280b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 --2- 172.21.15.12:0/2103889626 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1e280c8200 0x7f1e280cc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 >> 172.21.15.12:0/2103889626 conn(0x7f1e2806c6a0 msgr2=0x7f1e28148fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 shutdown_connections 2023-10-08T16:21:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.691+0000 7f1e2759e700 1 -- 172.21.15.12:0/2103889626 wait complete. 2023-10-08T16:21:27.709 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:52", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:27.709 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:52', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:27.709 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:27.709 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:27.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:27.710 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-08T16:21:27.747 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:27.747 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:27.749 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:27.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-10-08T16:21:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.981+0000 7f29b8f9d700 1 Processor -- start 2023-10-08T16:21:27.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.981+0000 7f29b8f9d700 1 -- start start 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f29b415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b415d8d0 con 0x7f29b40cb450 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b8f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b415d2f0 con 0x7f29b4142ca0 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40cc630 con 0x7f29b4143070 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f29b40cb450 0x7f29b406dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51544/0 (socket says 172.21.15.12:51544) 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b2ffd700 1 -- 172.21.15.12:0/1753489083 learned_addr learned my addr 172.21.15.12:0/1753489083 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.983+0000 7f29b3fff700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f29b415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129179649 0 0) 0x7f29b415d8d0 con 0x7f29b40cb450 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c003570 con 0x7f29b40cb450 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186273135 0 0) 0x7f29b415d2f0 con 0x7f29b4142ca0 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b415d8d0 con 0x7f29b4142ca0 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1746360527 0 0) 0x7f299c003570 con 0x7f29b40cb450 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 msgr2=0x7f29b415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f29b415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 >> v1:172.21.15.29:6789/0 conn(0x7f29b4142ca0 legacy=0x7f29b40cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b415d560 con 0x7f29b40cb450 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f29a8001470 con 0x7f29b40cb450 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 >> v1:172.21.15.12:6789/0 conn(0x7f29b40cb450 legacy=0x7f29b406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f299c003c20 0x7f299c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c004810 0x7f299c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f299c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40cc630 con 0x7f299c003c20 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00bbf0 con 0x7f299c004810 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c00bdb0 con 0x7f29b4143070 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b37fe700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f299c003c20 0x7f299c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b3fff700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f299c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.984+0000 7f29b2ffd700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c004810 0x7f299c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 -- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 msgr2=0x7f299c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b4143070 0x7f299c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 -- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c004810 msgr2=0x7f299c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c004810 0x7f299c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 -- 172.21.15.12:0/1753489083 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c003570 con 0x7f299c003c20 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b37fe700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f299c003c20 0x7f299c004010 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29a4001a10 tx=0x7f29a4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef339ac98d23a23e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400c5d0 con 0x7f299c003c20 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a400c730 con 0x7f299c003c20 2023-10-08T16:21:27.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.985+0000 7f29b27fc700 1 -- 172.21.15.12:0/1753489083 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a400cad0 con 0x7f299c003c20 2023-10-08T16:21:27.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 -- 172.21.15.12:0/1753489083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f299c003c20 msgr2=0x7f299c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/1753489083 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f299c003c20 0x7f299c004010 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f29a4001a10 tx=0x7f29a4007d30 comp rx=0 tx=0).stop 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b3fff700 1 -- 172.21.15.12:0/1753489083 reap_dead start 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 -- 172.21.15.12:0/1753489083 shutdown_connections 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 -- 172.21.15.12:0/1753489083 >> 172.21.15.12:0/1753489083 conn(0x7f29b4067c80 msgr2=0x7f29b4068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 -- 172.21.15.12:0/1753489083 shutdown_connections 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.986+0000 7f29b8f9d700 1 -- 172.21.15.12:0/1753489083 wait complete. 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.987+0000 7f29b8f9d700 1 Processor -- start 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.988+0000 7f29b8f9d700 1 -- start start 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 0x7f29b416a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 0x7f29b4069940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4069e80 con 0x7f29b40adb30 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b416aeb0 con 0x7f299c003c20 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ae0f0 con 0x7f29b40694d0 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51880/0 (socket says 172.21.15.12:51880) 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 -- 172.21.15.12:0/3067756486 learned_addr learned my addr 172.21.15.12:0/3067756486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b3fff700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 0x7f29b4069940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b37fe700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 0x7f29b416a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 -- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 msgr2=0x7f29b4069940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 0x7f29b4069940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 -- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 msgr2=0x7f29b416a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 0x7f29b416a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:27.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b2ffd700 1 -- 172.21.15.12:0/3067756486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40ae3d0 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b3fff700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 0x7f29b4069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.989+0000 7f29b37fe700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 0x7f29b416a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f29b2ffd700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f29a8007390 tx=0x7f29b415d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a8018030 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a8000f80 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a800fac0 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40ae6b0 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.990+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b4169c90 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.991+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40aebd0 con 0x7f29b40adb30 2023-10-08T16:21:27.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.992+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f29a801b070 con 0x7f29b40adb30 2023-10-08T16:21:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.993+0000 7f299b7fe700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 0x7f29a00695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.993+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f29a8019070 con 0x7f29b40adb30 2023-10-08T16:21:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.993+0000 7f29b37fe700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 0x7f29a00695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:27.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.994+0000 7f29b37fe700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 0x7f29a00695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29a4008fd0 tx=0x7f29a4015000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:27.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:27.997+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f29b40aebd0 con 0x7f29b40adb30 2023-10-08T16:21:28.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.228+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29b40aebd0 con 0x7f29a0067130 2023-10-08T16:21:28.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.236+0000 7f299b7fe700 1 -- 172.21.15.12:0/3067756486 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f29b40aebd0 con 0x7f29a0067130 2023-10-08T16:21:28.237 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:28.237 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:52", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 msgr2=0x7f29a00695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 0x7f29a00695e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f29a4008fd0 tx=0x7f29a4015000 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 msgr2=0x7f29b4169750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f29a8007390 tx=0x7f29b415d840 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 shutdown_connections 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f29b40694d0 0x7f29b4069940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f299c003c20 0x7f29b416a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f29a0067130 0x7f29a00695e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 --2- 172.21.15.12:0/3067756486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f29b40adb30 0x7f29b4169750 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 >> 172.21.15.12:0/3067756486 conn(0x7f29b4067c80 msgr2=0x7f29b4141130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 shutdown_connections 2023-10-08T16:21:28.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.239+0000 7f29b8f9d700 1 -- 172.21.15.12:0/3067756486 wait complete. 2023-10-08T16:21:28.257 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:52", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:28.257 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:52', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:28.257 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:28.257 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:28.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:28.258 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:28.296 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:28.297 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:28.297 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:28.297 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:28.298 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:28.298 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-10-08T16:21:28.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.529+0000 7f8e31b9d700 1 Processor -- start 2023-10-08T16:21:28.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.529+0000 7f8e31b9d700 1 -- start start 2023-10-08T16:21:28.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e31b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e2c142ca0 0x7f8e2c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e31b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e31b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c15d8d0 con 0x7f8e2c143070 2023-10-08T16:21:28.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e31b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c15d2f0 con 0x7f8e2c0cb450 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e31b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c0cc630 con 0x7f8e2c142ca0 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.530+0000 7f8e3139c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51894/0 (socket says 172.21.15.12:51894) 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 -- 172.21.15.12:0/1570158034 learned_addr learned my addr 172.21.15.12:0/1570158034 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e30b9b700 1 --2- 172.21.15.12:0/1570158034 >> v2:172.21.15.29:3300/0 conn(0x7f8e2c142ca0 0x7f8e2c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 -- 172.21.15.12:0/1570158034 >> v2:172.21.15.29:3300/0 conn(0x7f8e2c142ca0 msgr2=0x7f8e2c15dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 --2- 172.21.15.12:0/1570158034 >> v2:172.21.15.29:3300/0 conn(0x7f8e2c142ca0 0x7f8e2c15dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 -- 172.21.15.12:0/1570158034 >> v1:172.21.15.29:6789/0 conn(0x7f8e2c143070 legacy=0x7f8e2c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 -- 172.21.15.12:0/1570158034 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c15d560 con 0x7f8e2c0cb450 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e3139c700 1 --2- 172.21.15.12:0/1570158034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06fd50 tx=0x7f8e24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9c5a6f517afbd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:28.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.531+0000 7f8e2b7fe700 1 -- 172.21.15.12:0/1570158034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2400e070 con 0x7f8e2c0cb450 2023-10-08T16:21:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e2b7fe700 1 -- 172.21.15.12:0/1570158034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2400ba10 con 0x7f8e2c0cb450 2023-10-08T16:21:28.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e2b7fe700 1 -- 172.21.15.12:0/1570158034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e240092e0 con 0x7f8e2c0cb450 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1570158034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c0cb450 msgr2=0x7f8e2c0cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1570158034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06fd50 tx=0x7f8e24009840 comp rx=0 tx=0).stop 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1570158034 shutdown_connections 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1570158034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c0cb450 0x7f8e2c0cbf30 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1570158034 >> v2:172.21.15.29:3300/0 conn(0x7f8e2c142ca0 0x7f8e2c15dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1570158034 >> 172.21.15.12:0/1570158034 conn(0x7f8e2c067c80 msgr2=0x7f8e2c068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1570158034 shutdown_connections 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.532+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1570158034 wait complete. 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.534+0000 7f8e31b9d700 1 Processor -- start 2023-10-08T16:21:28.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.534+0000 7f8e31b9d700 1 -- start start 2023-10-08T16:21:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e2c0cb450 0x7f8e2c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 0x7f8e2c141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b07f0 con 0x7f8e2c142ca0 2023-10-08T16:21:28.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b4060 con 0x7f8e2c143070 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e31b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c169fb0 con 0x7f8e2c0cb450 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51898/0 (socket says 172.21.15.12:51898) 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 -- 172.21.15.12:0/1956086965 learned_addr learned my addr 172.21.15.12:0/1956086965 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e30b9b700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e2c0cb450 0x7f8e2c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e3139c700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 0x7f8e2c141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 -- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e2c0cb450 msgr2=0x7f8e2c0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e2c0cb450 0x7f8e2c0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 -- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 msgr2=0x7f8e2c141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 0x7f8e2c141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e2bfff700 1 -- 172.21.15.12:0/1956086965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e24009ae0 con 0x7f8e2c142ca0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.535+0000 7f8e3139c700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 0x7f8e2c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e2bfff700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b5e0 tx=0x7f8e18009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800f510 con 0x7f8e2c142ca0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800f670 con 0x7f8e2c142ca0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c16a290 con 0x7f8e2c142ca0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800fa30 con 0x7f8e2c142ca0 2023-10-08T16:21:28.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.536+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c16a850 con 0x7f8e2c142ca0 2023-10-08T16:21:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.537+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c04c3c0 con 0x7f8e2c142ca0 2023-10-08T16:21:28.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.538+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f8e1801a400 con 0x7f8e2c142ca0 2023-10-08T16:21:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.539+0000 7f8e28ff9700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 0x7f8e100695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.539+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8e18084480 con 0x7f8e2c142ca0 2023-10-08T16:21:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.539+0000 7f8e30b9b700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 0x7f8e100695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:28.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.540+0000 7f8e30b9b700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 0x7f8e100695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e20006fd0 tx=0x7f8e20008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:28.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.543+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e18051350 con 0x7f8e2c142ca0 2023-10-08T16:21:28.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.773+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e2c0cb910 con 0x7f8e10067130 2023-10-08T16:21:28.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.781+0000 7f8e28ff9700 1 -- 172.21.15.12:0/1956086965 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f8e2c0cb910 con 0x7f8e10067130 2023-10-08T16:21:28.782 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:28.782 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:53", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:28.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 msgr2=0x7f8e100695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 0x7f8e100695e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8e20006fd0 tx=0x7f8e20008040 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 msgr2=0x7f8e2c140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800b5e0 tx=0x7f8e18009120 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 shutdown_connections 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e2c143070 0x7f8e2c141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e2c0cb450 0x7f8e2c0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8e10067130 0x7f8e100695e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 --2- 172.21.15.12:0/1956086965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2c142ca0 0x7f8e2c140e20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 >> 172.21.15.12:0/1956086965 conn(0x7f8e2c067c80 msgr2=0x7f8e2c141ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 shutdown_connections 2023-10-08T16:21:28.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:28.783+0000 7f8e31b9d700 1 -- 172.21.15.12:0/1956086965 wait complete. 2023-10-08T16:21:28.802 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:53", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:28.802 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:53', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:28.802 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:28.802 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:28.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:28.803 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:28.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:28.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:28.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:28.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:28.843 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:28.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-10-08T16:21:29.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.075+0000 7f610bfff700 1 Processor -- start 2023-10-08T16:21:29.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.075+0000 7f610bfff700 1 -- start start 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 0x7f610c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f610c0b1d40 0x7f610c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c0b0c80 con 0x7f610c0b28c0 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c0d10d0 con 0x7f610c0b1d40 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0b0f60 con 0x7f610c0b24f0 2023-10-08T16:21:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f610c0b28c0 0x7f610c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51560/0 (socket says 172.21.15.12:51560) 2023-10-08T16:21:29.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.076+0000 7f610b7fe700 1 -- 172.21.15.12:0/345525376 learned_addr learned my addr 172.21.15.12:0/345525376 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:29.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610a7fc700 1 --2- 172.21.15.12:0/345525376 >> v2:172.21.15.29:3300/0 conn(0x7f610c0b1d40 0x7f610c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 --2- 172.21.15.12:0/345525376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 0x7f610c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f6109ffb700 1 -- 172.21.15.12:0/345525376 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625994004 0 0) 0x7f610c0b0c80 con 0x7f610c0b28c0 2023-10-08T16:21:29.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f6109ffb700 1 -- 172.21.15.12:0/345525376 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60f4003570 con 0x7f610c0b28c0 2023-10-08T16:21:29.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 -- 172.21.15.12:0/345525376 >> v2:172.21.15.29:3300/0 conn(0x7f610c0b1d40 msgr2=0x7f610c1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:29.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 --2- 172.21.15.12:0/345525376 >> v2:172.21.15.29:3300/0 conn(0x7f610c0b1d40 0x7f610c1590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 -- 172.21.15.12:0/345525376 >> v1:172.21.15.12:6789/0 conn(0x7f610c0b28c0 legacy=0x7f610c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 -- 172.21.15.12:0/345525376 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c0b1240 con 0x7f610c0b24f0 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.077+0000 7f610affd700 1 --2- 172.21.15.12:0/345525376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 0x7f610c0b0580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0098e0 tx=0x7f60fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ea262687350259 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f6109ffb700 1 -- 172.21.15.12:0/345525376 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc011630 con 0x7f610c0b24f0 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f6109ffb700 1 -- 172.21.15.12:0/345525376 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc011790 con 0x7f610c0b24f0 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f6109ffb700 1 -- 172.21.15.12:0/345525376 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc011b10 con 0x7f610c0b24f0 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 -- 172.21.15.12:0/345525376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 msgr2=0x7f610c0b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 --2- 172.21.15.12:0/345525376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 0x7f610c0b0580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f60fc0098e0 tx=0x7f60fc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 -- 172.21.15.12:0/345525376 shutdown_connections 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 --2- 172.21.15.12:0/345525376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b24f0 0x7f610c0b0580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 --2- 172.21.15.12:0/345525376 >> v2:172.21.15.29:3300/0 conn(0x7f610c0b1d40 0x7f610c1590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 -- 172.21.15.12:0/345525376 >> 172.21.15.12:0/345525376 conn(0x7f610c0703a0 msgr2=0x7f610c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 -- 172.21.15.12:0/345525376 shutdown_connections 2023-10-08T16:21:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.078+0000 7f610bfff700 1 -- 172.21.15.12:0/345525376 wait complete. 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.080+0000 7f610bfff700 1 Processor -- start 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.080+0000 7f610bfff700 1 -- start start 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 0x7f610c154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b28c0 0x7f610c16ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0a7760 con 0x7f610c0b1d40 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c15de10 con 0x7f610c0b24f0 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c0a6e30 con 0x7f610c0b28c0 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51902/0 (socket says 172.21.15.12:51902) 2023-10-08T16:21:29.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 -- 172.21.15.12:0/2365124576 learned_addr learned my addr 172.21.15.12:0/2365124576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610a7fc700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 0x7f610c154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610b7fe700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b28c0 0x7f610c16ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 -- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b28c0 msgr2=0x7f610c16ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b28c0 0x7f610c16ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 -- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 msgr2=0x7f610c154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.081+0000 7f610affd700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 0x7f610c154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f610affd700 1 -- 172.21.15.12:0/2365124576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc009420 con 0x7f610c0b1d40 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f610a7fc700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 0x7f610c154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f610affd700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b10a0 tx=0x7f60fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc011b10 con 0x7f610c0b1d40 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60fc000c90 con 0x7f610c0b1d40 2023-10-08T16:21:29.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60fc01a660 con 0x7f610c0b1d40 2023-10-08T16:21:29.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c0a7110 con 0x7f610c0b1d40 2023-10-08T16:21:29.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.082+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c15e660 con 0x7f610c0b1d40 2023-10-08T16:21:29.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.083+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c04c3c0 con 0x7f610c0b1d40 2023-10-08T16:21:29.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.084+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f60fc01aa50 con 0x7f610c0b1d40 2023-10-08T16:21:29.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.085+0000 7f60f2ffd700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 0x7f60f80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.085+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f60fc0866f0 con 0x7f610c0b1d40 2023-10-08T16:21:29.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.086+0000 7f610a7fc700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 0x7f60f80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.086+0000 7f610a7fc700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 0x7f60f80695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f610c15eb60 tx=0x7f6100008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.089+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60fc053540 con 0x7f610c0b1d40 2023-10-08T16:21:29.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.320+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f610c15df80 con 0x7f60f8067130 2023-10-08T16:21:29.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.327+0000 7f60f2ffd700 1 -- 172.21.15.12:0/2365124576 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6100009e90 con 0x7f60f8067130 2023-10-08T16:21:29.328 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:29.328 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:53", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:29.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 msgr2=0x7f60f80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 0x7f60f80695e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f610c15eb60 tx=0x7f6100008040 comp rx=0 tx=0).stop 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 msgr2=0x7f610c15e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f610c0b10a0 tx=0x7f60fc017000 comp rx=0 tx=0).stop 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 shutdown_connections 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f60f8067130 0x7f60f80695e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f610c0b1d40 0x7f610c15e120 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f610c0b28c0 0x7f610c16ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 --2- 172.21.15.12:0/2365124576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f610c0b24f0 0x7f610c154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 >> 172.21.15.12:0/2365124576 conn(0x7f610c0703a0 msgr2=0x7f610c156000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:29.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 shutdown_connections 2023-10-08T16:21:29.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.330+0000 7f610bfff700 1 -- 172.21.15.12:0/2365124576 wait complete. 2023-10-08T16:21:29.348 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:53", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:29.348 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:53', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:29.348 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:29.349 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:29.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:29.349 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-08T16:21:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_01_UTC 2023-10-08T16:21:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:29.387 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:29.388 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:29.389 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_01_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:29.389 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-10-08T16:21:29.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.620+0000 7f4f8ffff700 1 Processor -- start 2023-10-08T16:21:29.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.620+0000 7f4f8ffff700 1 -- start start 2023-10-08T16:21:29.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.621+0000 7f4f8ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4f90157380 0x7f4f901585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.621+0000 7f4f8ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f900c8680 con 0x7f4f9015b1a0 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.621+0000 7f4f8ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f90158b30 con 0x7f4f90157750 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.621+0000 7f4f8ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9006a7f0 con 0x7f4f90157380 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8e7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4f9015b1a0 0x7f4f900c6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51570/0 (socket says 172.21.15.12:51570) 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8e7fc700 1 -- 172.21.15.12:0/2486599430 learned_addr learned my addr 172.21.15.12:0/2486599430 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8effd700 1 --2- 172.21.15.12:0/2486599430 >> v2:172.21.15.29:3300/0 conn(0x7f4f90157380 0x7f4f901585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562835586 0 0) 0x7f4f900c8680 con 0x7f4f9015b1a0 2023-10-08T16:21:29.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f78003570 con 0x7f4f9015b1a0 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8effd700 1 -- 172.21.15.12:0/2486599430 >> v1:172.21.15.29:6789/0 conn(0x7f4f90157750 legacy=0x7f4f900ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8effd700 1 -- 172.21.15.12:0/2486599430 >> v1:172.21.15.12:6789/0 conn(0x7f4f9015b1a0 legacy=0x7f4f900c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.622+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564872571 0 0) 0x7f4f78003570 con 0x7f4f9015b1a0 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.623+0000 7f4f8effd700 1 -- 172.21.15.12:0/2486599430 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9015b6a0 con 0x7f4f90157380 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.623+0000 7f4f8effd700 1 --2- 172.21.15.12:0/2486599430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f90157380 0x7f4f901585f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098e0 tx=0x7f4f800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8917063a68da1493 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.623+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84001470 con 0x7f4f90157380 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.623+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80011420 con 0x7f4f90157380 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.623+0000 7f4f8dffb700 1 -- 172.21.15.12:0/2486599430 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800117c0 con 0x7f4f90157380 2023-10-08T16:21:29.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 -- 172.21.15.12:0/2486599430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f90157380 msgr2=0x7f4f901585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/2486599430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f90157380 0x7f4f901585f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098e0 tx=0x7f4f800091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 -- 172.21.15.12:0/2486599430 shutdown_connections 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/2486599430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f90157380 0x7f4f901585f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 -- 172.21.15.12:0/2486599430 >> 172.21.15.12:0/2486599430 conn(0x7f4f9006c6a0 msgr2=0x7f4f9006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 -- 172.21.15.12:0/2486599430 shutdown_connections 2023-10-08T16:21:29.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.624+0000 7f4f8ffff700 1 -- 172.21.15.12:0/2486599430 wait complete. 2023-10-08T16:21:29.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.625+0000 7f4f8ffff700 1 Processor -- start 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.625+0000 7f4f8ffff700 1 -- start start 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 0x7f4f900c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 0x7f4f900b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900ab430 con 0x7f4f90157750 2023-10-08T16:21:29.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c5d60 con 0x7f4f9015b1a0 2023-10-08T16:21:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.626+0000 7f4f8ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900c51b0 con 0x7f4f90157380 2023-10-08T16:21:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51910/0 (socket says 172.21.15.12:51910) 2023-10-08T16:21:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 -- 172.21.15.12:0/4121198837 learned_addr learned my addr 172.21.15.12:0/4121198837 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:29.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8effd700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 0x7f4f900c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8f7fe700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 0x7f4f900b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 -- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 msgr2=0x7f4f900c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 0x7f4f900c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 -- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 msgr2=0x7f4f900b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 0x7f4f900b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 -- 172.21.15.12:0/4121198837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009420 con 0x7f4f90157750 2023-10-08T16:21:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8effd700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 0x7f4f900c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8f7fe700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 0x7f4f900b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:29.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.627+0000 7f4f8e7fc700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400cb90 tx=0x7f4f84001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.628+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84007150 con 0x7f4f90157750 2023-10-08T16:21:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.628+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f840072d0 con 0x7f4f90157750 2023-10-08T16:21:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.628+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84007690 con 0x7f4f90157750 2023-10-08T16:21:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.628+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f900c5430 con 0x7f4f90157750 2023-10-08T16:21:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.628+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f900c59f0 con 0x7f4f90157750 2023-10-08T16:21:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.629+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9004c3c0 con 0x7f4f90157750 2023-10-08T16:21:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.630+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f4f84004a40 con 0x7f4f90157750 2023-10-08T16:21:29.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.631+0000 7f4f76ffd700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 0x7f4f7c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:29.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.631+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f4f84083f10 con 0x7f4f90157750 2023-10-08T16:21:29.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.631+0000 7f4f8effd700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 0x7f4f7c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:29.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.632+0000 7f4f8effd700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 0x7f4f7c0695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f90069e20 tx=0x7f4f80016000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:29.635 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.634+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f84050de0 con 0x7f4f90157750 2023-10-08T16:21:29.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.865+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4f900c6940 con 0x7f4f7c067130 2023-10-08T16:21:29.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.873+0000 7f4f76ffd700 1 -- 172.21.15.12:0/4121198837 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f4f900c6940 con 0x7f4f7c067130 2023-10-08T16:21:29.874 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:29.874 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:54", "first": "2023-10-08T16:11:01", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:29.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.875+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 msgr2=0x7f4f7c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.875+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 0x7f4f7c0695e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4f90069e20 tx=0x7f4f80016000 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.875+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 msgr2=0x7f4f900aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.875+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400cb90 tx=0x7f4f84001a30 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.875+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 shutdown_connections 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4f9015b1a0 0x7f4f900b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4f90157380 0x7f4f900c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f4f7c067130 0x7f4f7c0695e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 --2- 172.21.15.12:0/4121198837 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4f90157750 0x7f4f900aaef0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 >> 172.21.15.12:0/4121198837 conn(0x7f4f9006c6a0 msgr2=0x7f4f90151ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 shutdown_connections 2023-10-08T16:21:29.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:29.876+0000 7f4f8ffff700 1 -- 172.21.15.12:0/4121198837 wait complete. 2023-10-08T16:21:29.894 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:54", "first": "2023-10-08T16:11:01", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:29.894 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:54', 'first': '2023-10-08T16:11:01', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:29.894 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:29.895 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:29.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:29.895 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-08T16:21:29.934 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:29.934 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:29.934 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:29.934 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:29.935 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:29.936 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:29.937 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:29.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-10-08T16:21:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.168+0000 7f59effff700 1 Processor -- start 2023-10-08T16:21:30.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.168+0000 7f59effff700 1 -- start start 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59effff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59f00c2a90 0x7f59f0156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59effff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 0x7f59f00cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59effff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f01579b0 con 0x7f59f00c8200 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59effff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00c1390 con 0x7f59f00c2a90 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59effff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f01573f0 con 0x7f59f00c85d0 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59ee7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59f00c2a90 0x7f59f0156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59eeffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f59f00c8200 0x7f59f00c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:42110/0 (socket says 172.21.15.12:42110) 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59eeffd700 1 -- 172.21.15.12:0/125227152 learned_addr learned my addr 172.21.15.12:0/125227152 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:30.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.170+0000 7f59ef7fe700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 0x7f59f00cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ee7fc700 1 -- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 msgr2=0x7f59f00cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ee7fc700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 0x7f59f00cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ee7fc700 1 -- 172.21.15.12:0/125227152 >> v1:172.21.15.29:6789/0 conn(0x7f59f00c8200 legacy=0x7f59f00c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ee7fc700 1 -- 172.21.15.12:0/125227152 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f01576d0 con 0x7f59f00c2a90 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ef7fe700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 0x7f59f00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59ee7fc700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c2a90 0x7f59f0156aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f59e40098e0 tx=0x7f59e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a0e0ecc99a43f2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59edffb700 1 -- 172.21.15.12:0/125227152 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400b640 con 0x7f59f00c2a90 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59edffb700 1 -- 172.21.15.12:0/125227152 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e400b7a0 con 0x7f59f00c2a90 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.171+0000 7f59edffb700 1 -- 172.21.15.12:0/125227152 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e400bb40 con 0x7f59f00c2a90 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 -- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c2a90 msgr2=0x7f59f0156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c2a90 0x7f59f0156aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f59e40098e0 tx=0x7f59e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 -- 172.21.15.12:0/125227152 shutdown_connections 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c85d0 0x7f59f00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 --2- 172.21.15.12:0/125227152 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c2a90 0x7f59f0156aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 -- 172.21.15.12:0/125227152 >> 172.21.15.12:0/125227152 conn(0x7f59f006c6a0 msgr2=0x7f59f006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 -- 172.21.15.12:0/125227152 shutdown_connections 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.172+0000 7f59effff700 1 -- 172.21.15.12:0/125227152 wait complete. 2023-10-08T16:21:30.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.173+0000 7f59effff700 1 Processor -- start 2023-10-08T16:21:30.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.174+0000 7f59effff700 1 -- start start 2023-10-08T16:21:30.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c8200 0x7f59f00afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 0x7f59f015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0158e90 con 0x7f59f00c2a90 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f00ae550 con 0x7f59f00c85d0 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59effff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0158280 con 0x7f59f00c8200 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51920/0 (socket says 172.21.15.12:51920) 2023-10-08T16:21:30.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 -- 172.21.15.12:0/1920862 learned_addr learned my addr 172.21.15.12:0/1920862 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59ef7fe700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 0x7f59f015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 -- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c8200 msgr2=0x7f59f00afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c8200 0x7f59f00afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 -- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 msgr2=0x7f59f015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 0x7f59f015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59eeffd700 1 -- 172.21.15.12:0/1920862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e8009a20 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.175+0000 7f59ef7fe700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 0x7f59f015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59eeffd700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c7c0 tx=0x7f59e0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0005b30 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0005cb0 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e4009420 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0004a80 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.176+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f0158840 con 0x7f59f00c2a90 2023-10-08T16:21:30.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.177+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f004c3c0 con 0x7f59f00c2a90 2023-10-08T16:21:30.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.178+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f59e00070f0 con 0x7f59f00c2a90 2023-10-08T16:21:30.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.179+0000 7f59d6ffd700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 0x7f59dc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.179+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f59e0083e90 con 0x7f59f00c2a90 2023-10-08T16:21:30.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.179+0000 7f59ee7fc700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 0x7f59dc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.180+0000 7f59ee7fc700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 0x7f59dc0695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f59f00c2e90 tx=0x7f59e4017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.183+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59e0050d60 con 0x7f59f00c2a90 2023-10-08T16:21:30.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.411+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59f0158fd0 con 0x7f59dc067130 2023-10-08T16:21:30.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.420+0000 7f59d6ffd700 1 -- 172.21.15.12:0/1920862 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f59e4000bc0 con 0x7f59dc067130 2023-10-08T16:21:30.421 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:30.421 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:55", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:30.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.422+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 msgr2=0x7f59dc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.422+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 0x7f59dc0695e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f59f00c2e90 tx=0x7f59e4017000 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.422+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 msgr2=0x7f59f00ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.422+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f59e000c7c0 tx=0x7f59e0007f70 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 shutdown_connections 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59dc067130 0x7f59dc0695e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59f00c2a90 0x7f59f00ae010 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59f00c85d0 0x7f59f015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 --2- 172.21.15.12:0/1920862 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59f00c8200 0x7f59f00afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 >> 172.21.15.12:0/1920862 conn(0x7f59f006c6a0 msgr2=0x7f59f00c74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 shutdown_connections 2023-10-08T16:21:30.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.423+0000 7f59effff700 1 -- 172.21.15.12:0/1920862 wait complete. 2023-10-08T16:21:30.440 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:55", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:30.441 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:55', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:30.441 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:30.441 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:30.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:30.441 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-08T16:21:30.479 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:30.479 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:30.479 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:30.480 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:30.481 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:30.481 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-10-08T16:21:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.713+0000 7fd425b9d700 1 Processor -- start 2023-10-08T16:21:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.713+0000 7fd425b9d700 1 -- start start 2023-10-08T16:21:30.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.714+0000 7fd425b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd420159800 0x7fd4200b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.714+0000 7fd425b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200b0c80 con 0x7fd4200b24f0 2023-10-08T16:21:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.714+0000 7fd425b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4200b0f60 con 0x7fd4200b1d40 2023-10-08T16:21:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd425b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4200d10d0 con 0x7fd420159800 2023-10-08T16:21:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd424b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd4200b24f0 0x7fd4201590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51576/0 (socket says 172.21.15.12:51576) 2023-10-08T16:21:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd424b9b700 1 -- 172.21.15.12:0/289647326 learned_addr learned my addr 172.21.15.12:0/289647326 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:30.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41ffff700 1 --2- 172.21.15.12:0/289647326 >> v2:172.21.15.29:3300/0 conn(0x7fd420159800 0x7fd4200b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41f7fe700 1 -- 172.21.15.12:0/289647326 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153534201 0 0) 0x7fd4200b0c80 con 0x7fd4200b24f0 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41f7fe700 1 -- 172.21.15.12:0/289647326 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd410003570 con 0x7fd4200b24f0 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41ffff700 1 -- 172.21.15.12:0/289647326 >> v1:172.21.15.29:6789/0 conn(0x7fd4200b1d40 legacy=0x7fd4200b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41ffff700 1 -- 172.21.15.12:0/289647326 >> v1:172.21.15.12:6789/0 conn(0x7fd4200b24f0 legacy=0x7fd4201590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.715+0000 7fd41ffff700 1 -- 172.21.15.12:0/289647326 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4200b1240 con 0x7fd420159800 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.716+0000 7fd41ffff700 1 --2- 172.21.15.12:0/289647326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd420159800 0x7fd4200b0580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0098e0 tx=0x7fd40c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94550dede6b9347e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.716+0000 7fd41f7fe700 1 -- 172.21.15.12:0/289647326 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00b640 con 0x7fd420159800 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.716+0000 7fd41f7fe700 1 -- 172.21.15.12:0/289647326 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd40c00b7a0 con 0x7fd420159800 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.716+0000 7fd41f7fe700 1 -- 172.21.15.12:0/289647326 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd40c00bb40 con 0x7fd420159800 2023-10-08T16:21:30.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 -- 172.21.15.12:0/289647326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd420159800 msgr2=0x7fd4200b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 --2- 172.21.15.12:0/289647326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd420159800 0x7fd4200b0580 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0098e0 tx=0x7fd40c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 -- 172.21.15.12:0/289647326 shutdown_connections 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 --2- 172.21.15.12:0/289647326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd420159800 0x7fd4200b0580 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 -- 172.21.15.12:0/289647326 >> 172.21.15.12:0/289647326 conn(0x7fd4200703a0 msgr2=0x7fd4200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 -- 172.21.15.12:0/289647326 shutdown_connections 2023-10-08T16:21:30.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.717+0000 7fd425b9d700 1 -- 172.21.15.12:0/289647326 wait complete. 2023-10-08T16:21:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.718+0000 7fd425b9d700 1 Processor -- start 2023-10-08T16:21:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.718+0000 7fd425b9d700 1 -- start start 2023-10-08T16:21:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4200b24f0 0x7fd42015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 0x7fd42015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015a280 con 0x7fd4200b1d40 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015a560 con 0x7fd4200b24f0 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.719+0000 7fd425b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd42015a840 con 0x7fd420159800 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51924/0 (socket says 172.21.15.12:51924) 2023-10-08T16:21:30.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 -- 172.21.15.12:0/1184397141 learned_addr learned my addr 172.21.15.12:0/1184397141 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd41ffff700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4200b24f0 0x7fd42015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd42539c700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 0x7fd42015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 -- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 msgr2=0x7fd42015b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 0x7fd42015b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 -- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4200b24f0 msgr2=0x7fd42015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4200b24f0 0x7fd42015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 -- 172.21.15.12:0/1184397141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40c009420 con 0x7fd4200b1d40 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd42539c700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 0x7fd42015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.720+0000 7fd424b9b700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c7c0 tx=0x7fd414007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.721+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414005b30 con 0x7fd4200b1d40 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.721+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd414005c90 con 0x7fd4200b1d40 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.721+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd414007340 con 0x7fd4200b1d40 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.721+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd42015ab20 con 0x7fd4200b1d40 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.721+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4200c65f0 con 0x7fd4200b1d40 2023-10-08T16:21:30.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.722+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42015b040 con 0x7fd4200b1d40 2023-10-08T16:21:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.723+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fd41401b400 con 0x7fd4200b1d40 2023-10-08T16:21:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.724+0000 7fd41cff9700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 0x7fd4040695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.724+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd414084530 con 0x7fd4200b1d40 2023-10-08T16:21:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.724+0000 7fd41ffff700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 0x7fd4040695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.724+0000 7fd41ffff700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 0x7fd4040695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0093f0 tx=0x7fd40c017000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:30.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.727+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd42015b040 con 0x7fd4200b1d40 2023-10-08T16:21:30.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.960+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd42015a6d0 con 0x7fd404067130 2023-10-08T16:21:30.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.968+0000 7fd41cff9700 1 -- 172.21.15.12:0/1184397141 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd42015a6d0 con 0x7fd404067130 2023-10-08T16:21:30.969 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:30.969 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:55", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 msgr2=0x7fd4040695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 0x7fd4040695e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd40c0093f0 tx=0x7fd40c017000 comp rx=0 tx=0).stop 2023-10-08T16:21:30.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 msgr2=0x7fd420159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd41400c7c0 tx=0x7fd414007e00 comp rx=0 tx=0).stop 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 shutdown_connections 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd404067130 0x7fd4040695e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4200b1d40 0x7fd420159ca0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.970+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd420159800 0x7fd42015b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.971+0000 7fd425b9d700 1 --2- 172.21.15.12:0/1184397141 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4200b24f0 0x7fd42015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.971+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 >> 172.21.15.12:0/1184397141 conn(0x7fd4200703a0 msgr2=0x7fd420154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.971+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 shutdown_connections 2023-10-08T16:21:30.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:30.971+0000 7fd425b9d700 1 -- 172.21.15.12:0/1184397141 wait complete. 2023-10-08T16:21:30.988 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:55", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:30.988 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:55', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:30.989 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:30.989 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:30.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:30.989 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-08T16:21:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:31.027 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:31.028 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:31.029 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_11_00_UTC', 'scheduled-2023-10-08-16_12_00_UTC', 'scheduled-2023-10-08-16_13_00_UTC', 'scheduled-2023-10-08-16_14_00_UTC', 'scheduled-2023-10-08-16_15_00_UTC', 'scheduled-2023-10-08-16_16_00_UTC', 'scheduled-2023-10-08-16_17_00_UTC', 'scheduled-2023-10-08-16_18_00_UTC', 'scheduled-2023-10-08-16_19_00_UTC', 'scheduled-2023-10-08-16_20_00_UTC', 'scheduled-2023-10-08-16_21_00_UTC'] 2023-10-08T16:21:31.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-10-08T16:21:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.260+0000 7fd49e79d700 1 Processor -- start 2023-10-08T16:21:31.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.260+0000 7fd49e79d700 1 -- start start 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49e79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd498142ca0 0x7fd49815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49e79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd498143070 0x7fd4980cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49e79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49815d8d0 con 0x7fd49815a6f0 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49e79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd49815d2f0 con 0x7fd498142ca0 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49e79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980cc630 con 0x7fd498143070 2023-10-08T16:21:31.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49d79b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd498142ca0 0x7fd49815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49df9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd49815a6f0 0x7fd4980cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51580/0 (socket says 172.21.15.12:51580) 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49df9c700 1 -- 172.21.15.12:0/3078715852 learned_addr learned my addr 172.21.15.12:0/3078715852 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49cf9a700 1 --2- 172.21.15.12:0/3078715852 >> v2:172.21.15.29:3300/0 conn(0x7fd498143070 0x7fd4980cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49d79b700 1 -- 172.21.15.12:0/3078715852 >> v2:172.21.15.29:3300/0 conn(0x7fd498143070 msgr2=0x7fd4980cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49d79b700 1 --2- 172.21.15.12:0/3078715852 >> v2:172.21.15.29:3300/0 conn(0x7fd498143070 0x7fd4980cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd49d79b700 1 -- 172.21.15.12:0/3078715852 >> v1:172.21.15.12:6789/0 conn(0x7fd49815a6f0 legacy=0x7fd4980cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.262+0000 7fd48ffff700 1 -- 172.21.15.12:0/3078715852 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476746364 0 0) 0x7fd49815d8d0 con 0x7fd49815a6f0 2023-10-08T16:21:31.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.263+0000 7fd49d79b700 1 -- 172.21.15.12:0/3078715852 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49815d560 con 0x7fd498142ca0 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.263+0000 7fd49d79b700 1 --2- 172.21.15.12:0/3078715852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd49815dd60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd498068d50 tx=0x7fd4940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7381dd89d7e9669e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.263+0000 7fd48ffff700 1 -- 172.21.15.12:0/3078715852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400b6b0 con 0x7fd498142ca0 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.263+0000 7fd48ffff700 1 -- 172.21.15.12:0/3078715852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49400b810 con 0x7fd498142ca0 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.263+0000 7fd48ffff700 1 -- 172.21.15.12:0/3078715852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49400bbb0 con 0x7fd498142ca0 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 -- 172.21.15.12:0/3078715852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 msgr2=0x7fd49815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 --2- 172.21.15.12:0/3078715852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd49815dd60 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd498068d50 tx=0x7fd4940091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 -- 172.21.15.12:0/3078715852 shutdown_connections 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 --2- 172.21.15.12:0/3078715852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd49815dd60 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 --2- 172.21.15.12:0/3078715852 >> v2:172.21.15.29:3300/0 conn(0x7fd498143070 0x7fd4980cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 -- 172.21.15.12:0/3078715852 >> 172.21.15.12:0/3078715852 conn(0x7fd498067c80 msgr2=0x7fd498068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:31.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 -- 172.21.15.12:0/3078715852 shutdown_connections 2023-10-08T16:21:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.264+0000 7fd49e79d700 1 -- 172.21.15.12:0/3078715852 wait complete. 2023-10-08T16:21:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.265+0000 7fd49e79d700 1 Processor -- start 2023-10-08T16:21:31.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.265+0000 7fd49e79d700 1 -- start start 2023-10-08T16:21:31.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd498143070 0x7fd4980b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 0x7fd4981418e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980b3f00 con 0x7fd498142ca0 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980aee20 con 0x7fd49815a6f0 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4980b3940 con 0x7fd498143070 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51934/0 (socket says 172.21.15.12:51934) 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.266+0000 7fd49d79b700 1 -- 172.21.15.12:0/1640214306 learned_addr learned my addr 172.21.15.12:0/1640214306 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 -- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd498143070 msgr2=0x7fd4980b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd498143070 0x7fd4980b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 -- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 msgr2=0x7fd4981418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49df9c700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 0x7fd4981418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 0x7fd4981418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 -- 172.21.15.12:0/1640214306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd494009420 con 0x7fd498142ca0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49df9c700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 0x7fd4981418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49d79b700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd4980691a0 tx=0x7fd494017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011420 con 0x7fd498142ca0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd494011580 con 0x7fd498142ca0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd494011940 con 0x7fd498142ca0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.267+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4980b3c20 con 0x7fd498142ca0 2023-10-08T16:21:31.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.268+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd498157e40 con 0x7fd498142ca0 2023-10-08T16:21:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.268+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd49806b460 con 0x7fd498142ca0 2023-10-08T16:21:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.269+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fd494011cf0 con 0x7fd498142ca0 2023-10-08T16:21:31.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.270+0000 7fd48d7fa700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 0x7fd47c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.270+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd494085eb0 con 0x7fd498142ca0 2023-10-08T16:21:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.270+0000 7fd49cf9a700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 0x7fd47c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.271+0000 7fd49cf9a700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 0x7fd47c0695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4980b0b30 tx=0x7fd488008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.275+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd494052d00 con 0x7fd498142ca0 2023-10-08T16:21:31.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.505+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd49804c3c0 con 0x7fd47c067130 2023-10-08T16:21:31.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.514+0000 7fd48d7fa700 1 -- 172.21.15.12:0/1640214306 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fd49804c3c0 con 0x7fd47c067130 2023-10-08T16:21:31.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:31.515 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:56", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 msgr2=0x7fd47c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 0x7fd47c0695e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4980b0b30 tx=0x7fd488008040 comp rx=0 tx=0).stop 2023-10-08T16:21:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 msgr2=0x7fd498157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd4980691a0 tx=0x7fd494017000 comp rx=0 tx=0).stop 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 shutdown_connections 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd47c067130 0x7fd47c0695e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd498142ca0 0x7fd498157900 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd49815a6f0 0x7fd4981418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 --2- 172.21.15.12:0/1640214306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd498143070 0x7fd4980b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 >> 172.21.15.12:0/1640214306 conn(0x7fd498067c80 msgr2=0x7fd4980c4860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 shutdown_connections 2023-10-08T16:21:31.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.516+0000 7fd49e79d700 1 -- 172.21.15.12:0/1640214306 wait complete. 2023-10-08T16:21:31.534 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:10:56", "first": "2023-10-08T16:11:00", "last": "2023-10-08T16:21:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-10-08T16:21:31.534 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:10:56', 'first': '2023-10-08T16:11:00', 'last': '2023-10-08T16:21:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-10-08T16:21:31.534 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T16:21:31.535 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T16:21:31.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-10-08T16:21:31.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.726+0000 7f3b1e19d700 1 Processor -- start 2023-10-08T16:21:31.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.727+0000 7f3b1e19d700 1 -- start start 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1e19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b18159800 0x7f3b180b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1e19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180b0c80 con 0x7f3b180b1d40 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1e19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b180b0f60 con 0x7f3b180b24f0 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1e19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b180d10d0 con 0x7f3b18159800 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1d99c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3b180b1d40 0x7f3b180b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:51596/0 (socket says 172.21.15.12:51596) 2023-10-08T16:21:31.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1d99c700 1 -- 172.21.15.12:0/3444479869 learned_addr learned my addr 172.21.15.12:0/3444479869 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:31.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.728+0000 7f3b1c99a700 1 --2- 172.21.15.12:0/3444479869 >> v2:172.21.15.29:3300/0 conn(0x7f3b18159800 0x7f3b180b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 694064473 0 0) 0x7f3b180b0c80 con 0x7f3b180b1d40 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04003570 con 0x7f3b180b1d40 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1083211204 0 0) 0x7f3b04003570 con 0x7f3b180b1d40 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 >> v2:172.21.15.29:3300/0 conn(0x7f3b18159800 msgr2=0x7f3b180b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 --2- 172.21.15.12:0/3444479869 >> v2:172.21.15.29:3300/0 conn(0x7f3b18159800 0x7f3b180b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 >> v1:172.21.15.29:6789/0 conn(0x7f3b180b24f0 legacy=0x7f3b181590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b180b1240 con 0x7f3b180b1d40 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f3b100017f0 con 0x7f3b180b1d40 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 >> v1:172.21.15.12:6789/0 conn(0x7f3b180b1d40 legacy=0x7f3b180b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04003ab0 0x7f3b04003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 0x7f3b0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180d10d0 con 0x7f3b04005210 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0400c130 con 0x7f3b04004810 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0400c2f0 con 0x7f3b04003ab0 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b1d99c700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 0x7f3b0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.729+0000 7f3b1c99a700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d19b700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04003ab0 0x7f3b04003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 -- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04003ab0 msgr2=0x7f3b04003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04003ab0 0x7f3b04003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 -- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b04004810 msgr2=0x7f3b04004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b04004810 0x7f3b04004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 -- 172.21.15.12:0/3444479869 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b04003570 con 0x7f3b04005210 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 -- 172.21.15.12:0/3444479869 reap_dead start 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b1d99c700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 0x7f3b0400ba60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a860 tx=0x7f3b10002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e192e2a95e7b9f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100070f0 con 0x7f3b04005210 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b10007270 con 0x7f3b04005210 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.730+0000 7f3b0ffff700 1 -- 172.21.15.12:0/3444479869 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b10007630 con 0x7f3b04005210 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 msgr2=0x7f3b0400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 0x7f3b0400ba60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000a860 tx=0x7f3b10002100 comp rx=0 tx=0).stop 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3444479869 shutdown_connections 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3444479869 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b04005210 0x7f3b0400ba60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3444479869 >> 172.21.15.12:0/3444479869 conn(0x7f3b180703a0 msgr2=0x7f3b180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:31.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3444479869 shutdown_connections 2023-10-08T16:21:31.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.731+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3444479869 wait complete. 2023-10-08T16:21:31.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.732+0000 7f3b1e19d700 1 Processor -- start 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.733+0000 7f3b1e19d700 1 -- start start 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04005210 0x7f3b181527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b180c61f0 0x7f3b18169820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1815d630 con 0x7f3b1816a550 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180c66f0 con 0x7f3b180c61f0 2023-10-08T16:21:31.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b180c69d0 con 0x7f3b04005210 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51958/0 (socket says 172.21.15.12:51958) 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 -- 172.21.15.12:0/3648231547 learned_addr learned my addr 172.21.15.12:0/3648231547 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1d19b700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04005210 0x7f3b181527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1d99c700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b180c61f0 0x7f3b18169820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 -- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04005210 msgr2=0x7f3b181527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04005210 0x7f3b181527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 -- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b180c61f0 msgr2=0x7f3b18169820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b180c61f0 0x7f3b18169820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.734+0000 7f3b1c99a700 1 -- 172.21.15.12:0/3648231547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1815d2c0 con 0x7f3b1816a550 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b1c99a700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b08006ac0 tx=0x7f3b080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b08011ec0 con 0x7f3b1816a550 2023-10-08T16:21:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0800f940 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1815a270 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0800fcc0 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.735+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b18169d60 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.736+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b1815d120 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.737+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f3b08014650 con 0x7f3b1816a550 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.738+0000 7f3b0d7fa700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 0x7f3afc0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:31.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.738+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f3b08018030 con 0x7f3b1816a550 2023-10-08T16:21:31.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.738+0000 7f3b1d19b700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 0x7f3afc0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:31.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.739+0000 7f3b1d19b700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 0x7f3afc0695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b180af290 tx=0x7f3b14007d30 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:31.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.742+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b1815d120 con 0x7f3b1816a550 2023-10-08T16:21:31.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:31.969+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b1815d120 con 0x7f3afc067130 2023-10-08T16:21:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.047+0000 7f3b0d7fa700 1 -- 172.21.15.12:0/3648231547 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f3b1815d120 con 0x7f3afc067130 2023-10-08T16:21:32.048 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-10-08T16:21:32.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 msgr2=0x7f3afc0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:32.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 0x7f3afc0695e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3b180af290 tx=0x7f3b14007d30 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 msgr2=0x7f3b180c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b08006ac0 tx=0x7f3b080091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 shutdown_connections 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b180c61f0 0x7f3b18169820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b04005210 0x7f3b181527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f3afc067130 0x7f3afc0695e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 --2- 172.21.15.12:0/3648231547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b1816a550 0x7f3b180c5cb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.049+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 >> 172.21.15.12:0/3648231547 conn(0x7f3b180703a0 msgr2=0x7f3b18158140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.050+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 shutdown_connections 2023-10-08T16:21:32.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:32.050+0000 7f3b1e19d700 1 -- 172.21.15.12:0/3648231547 wait complete. 2023-10-08T16:21:32.067 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-10-08T16:21:32.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.068 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-10-08T16:21:32.105 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:32.105 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:32.105 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:32.105 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:32.106 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:32.107 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:32.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.108 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:32.195 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:32.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.196 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:32.239 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:32.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.239 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:32.323 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:32.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.323 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:32.407 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:32.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.408 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:32.491 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:32.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.491 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:32.574 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:32.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.575 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:32.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:32.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.660 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:32.745 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:32.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.745 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:32.830 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:32.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.831 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:32.916 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:32.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:32.916 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:33.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.001 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-10-08T16:21:33.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-10-08T16:21:33.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.315+0000 7f1204b9d700 1 Processor -- start 2023-10-08T16:21:33.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.315+0000 7f1204b9d700 1 -- start start 2023-10-08T16:21:33.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.316+0000 7f1204b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1200153a30 0x7f12000c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.316+0000 7f1204b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12000c2200 con 0x7f12000c9090 2023-10-08T16:21:33.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.316+0000 7f1204b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12000c15f0 con 0x7f1200153660 2023-10-08T16:21:33.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.316+0000 7f1204b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12000c18d0 con 0x7f1200153a30 2023-10-08T16:21:33.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f12000c9090 0x7f120006aa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45540/0 (socket says 172.21.15.12:45540) 2023-10-08T16:21:33.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fffff700 1 -- 172.21.15.12:0/844844452 learned_addr learned my addr 172.21.15.12:0/844844452 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11feffd700 1 --2- 172.21.15.12:0/844844452 >> v2:172.21.15.29:3300/0 conn(0x7f1200153a30 0x7f12000c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829978505 0 0) 0x7f12000c2200 con 0x7f12000c9090 2023-10-08T16:21:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e8003570 con 0x7f12000c9090 2023-10-08T16:21:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2249092691 0 0) 0x7f11e8003570 con 0x7f12000c9090 2023-10-08T16:21:33.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 >> v2:172.21.15.29:3300/0 conn(0x7f1200153a30 msgr2=0x7f12000c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 --2- 172.21.15.12:0/844844452 >> v2:172.21.15.29:3300/0 conn(0x7f1200153a30 0x7f12000c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 >> v1:172.21.15.29:6789/0 conn(0x7f1200153660 legacy=0x7f12000c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000c1bb0 con 0x7f12000c9090 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f11f80017f0 con 0x7f12000c9090 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 >> v1:172.21.15.12:6789/0 conn(0x7f12000c9090 legacy=0x7f120006aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.317+0000 7f11fe7fc700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 0x7f11e8003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fe7fc700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8004810 0x7f11e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fe7fc700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11e8005210 0x7f11e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c18d0 con 0x7f11e8003ab0 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e800c130 con 0x7f11e8004810 2023-10-08T16:21:33.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e800c2f0 con 0x7f11e8005210 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 0x7f11e8003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fffff700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11e8005210 0x7f11e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11feffd700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8004810 0x7f11e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 -- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11e8005210 msgr2=0x7f11e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11e8005210 0x7f11e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 -- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8004810 msgr2=0x7f11e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8004810 0x7f11e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 -- 172.21.15.12:0/844844452 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e8003570 con 0x7f11e8003ab0 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fffff700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11e8005210 0x7f11e800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11feffd700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8004810 0x7f11e8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:33.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11fffff700 1 -- 172.21.15.12:0/844844452 reap_dead start 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.318+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 0x7f11e8003ec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11f00018b0 tx=0x7f11f0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3910aa73060adc13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0012420 con 0x7f11e8003ab0 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f00125a0 con 0x7f11e8003ab0 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f11fe7fc700 1 -- 172.21.15.12:0/844844452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f0012960 con 0x7f11e8003ab0 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 -- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 msgr2=0x7f11e8003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 0x7f11e8003ec0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f11f00018b0 tx=0x7f11f0007d30 comp rx=0 tx=0).stop 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 -- 172.21.15.12:0/844844452 shutdown_connections 2023-10-08T16:21:33.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 --2- 172.21.15.12:0/844844452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11e8003ab0 0x7f11e8003ec0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 -- 172.21.15.12:0/844844452 >> 172.21.15.12:0/844844452 conn(0x7f120006c6a0 msgr2=0x7f120006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:33.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 -- 172.21.15.12:0/844844452 shutdown_connections 2023-10-08T16:21:33.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.319+0000 7f1204b9d700 1 -- 172.21.15.12:0/844844452 wait complete. 2023-10-08T16:21:33.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.321+0000 7f1204b9d700 1 Processor -- start 2023-10-08T16:21:33.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.321+0000 7f1204b9d700 1 -- start start 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8003ab0 0x7f1200151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12000c60c0 0x7f12000b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c4590 con 0x7f12000c3bb0 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000b1000 con 0x7f11e8003ab0 2023-10-08T16:21:33.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f1204b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000b12e0 con 0x7f12000c60c0 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f11fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f11ff7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8003ab0 0x7f1200151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f11fffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43394/0 (socket says 172.21.15.12:43394) 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f11fffff700 1 -- 172.21.15.12:0/4025669402 learned_addr learned my addr 172.21.15.12:0/4025669402 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.322+0000 7f11feffd700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12000c60c0 0x7f12000b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 -- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12000c60c0 msgr2=0x7f12000b0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12000c60c0 0x7f12000b0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 -- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8003ab0 msgr2=0x7f1200151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8003ab0 0x7f1200151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 -- 172.21.15.12:0/4025669402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000b15c0 con 0x7f12000c3bb0 2023-10-08T16:21:33.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11fffff700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1200153e00 tx=0x7f11f8001820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8007b60 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f800eb10 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000b18a0 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f800eeb0 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.323+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1200151e50 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.324+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12000b1dc0 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.325+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f11f8013630 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.326+0000 7f11e77fe700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 0x7f11ec0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.326+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f11f8084e20 con 0x7f12000c3bb0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.326+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 0x7f11ec0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:33.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.327+0000 7f11ff7fe700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 0x7f11ec0695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f11f0001010 tx=0x7f11f0015000 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:33.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.330+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12000b1dc0 con 0x7f12000c3bb0 2023-10-08T16:21:33.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.561+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f12000b1dc0 con 0x7f11ec067130 2023-10-08T16:21:33.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.691+0000 7f11e77fe700 1 -- 172.21.15.12:0/4025669402 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f12000b1dc0 con 0x7f11ec067130 2023-10-08T16:21:33.692 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-10-08T16:21:33.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.693+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 msgr2=0x7f11ec0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.693+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 0x7f11ec0695e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f11f0001010 tx=0x7f11f0015000 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.693+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 msgr2=0x7f12000c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.693+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1200153e00 tx=0x7f11f8001820 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 shutdown_connections 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11ec067130 0x7f11ec0695e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12000c3bb0 0x7f12000c4050 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11e8003ab0 0x7f1200151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 --2- 172.21.15.12:0/4025669402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12000c60c0 0x7f12000b0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 >> 172.21.15.12:0/4025669402 conn(0x7f120006c6a0 msgr2=0x7f120006cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:33.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 shutdown_connections 2023-10-08T16:21:33.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:33.694+0000 7f1204b9d700 1 -- 172.21.15.12:0/4025669402 wait complete. 2023-10-08T16:21:33.716 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-10-08T16:21:33.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.716 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:33.772 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:33.773 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:33.773 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:33.773 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:33.774 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.774 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:33.819 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:33.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.819 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:33.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:33.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.904 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:33.988 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:33.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:33.988 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:34.073 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:34.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.073 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:34.157 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:34.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.158 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:34.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:34.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.242 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:34.327 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:34.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.327 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:34.411 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:34.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.411 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:34.497 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:34.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.497 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:34.582 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:34.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.583 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:34.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:34.681 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-10-08T16:21:34.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-10-08T16:21:34.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.976+0000 7f9567fff700 1 Processor -- start 2023-10-08T16:21:34.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.976+0000 7f9567fff700 1 -- start start 2023-10-08T16:21:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.977+0000 7f9567fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9568159800 0x7f95680b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.977+0000 7f9567fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 0x7f95680b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.977+0000 7f9567fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680b0c80 con 0x7f95680b24f0 2023-10-08T16:21:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.977+0000 7f9567fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680d10d0 con 0x7f9568159800 2023-10-08T16:21:34.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.977+0000 7f9567fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680b0f60 con 0x7f95680b1d40 2023-10-08T16:21:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9568159800 0x7f95680b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9568159800 0x7f95680b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43410/0 (socket says 172.21.15.12:43410) 2023-10-08T16:21:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 -- 172.21.15.12:0/3137110030 learned_addr learned my addr 172.21.15.12:0/3137110030 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:34.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95677fe700 1 --2- 172.21.15.12:0/3137110030 >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 0x7f95680b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 -- 172.21.15.12:0/3137110030 >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 msgr2=0x7f95680b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 --2- 172.21.15.12:0/3137110030 >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 0x7f95680b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 -- 172.21.15.12:0/3137110030 >> v1:172.21.15.29:6789/0 conn(0x7f95680b24f0 legacy=0x7f95681590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 -- 172.21.15.12:0/3137110030 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680b1240 con 0x7f9568159800 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95677fe700 1 --2- 172.21.15.12:0/3137110030 >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 0x7f95680b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.978+0000 7f95667fc700 1 --2- 172.21.15.12:0/3137110030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9568159800 0x7f95680b0580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f95680d1640 tx=0x7f955c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530328381c7fa3ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9565ffb700 1 -- 172.21.15.12:0/3137110030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00b860 con 0x7f9568159800 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9565ffb700 1 -- 172.21.15.12:0/3137110030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c00b9c0 con 0x7f9568159800 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9565ffb700 1 -- 172.21.15.12:0/3137110030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c00bd60 con 0x7f9568159800 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 -- 172.21.15.12:0/3137110030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9568159800 msgr2=0x7f95680b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 --2- 172.21.15.12:0/3137110030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9568159800 0x7f95680b0580 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f95680d1640 tx=0x7f955c009250 comp rx=0 tx=0).stop 2023-10-08T16:21:34.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 -- 172.21.15.12:0/3137110030 shutdown_connections 2023-10-08T16:21:34.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 --2- 172.21.15.12:0/3137110030 >> v2:172.21.15.29:3300/0 conn(0x7f95680b1d40 0x7f95680b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:34.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 --2- 172.21.15.12:0/3137110030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9568159800 0x7f95680b0580 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:34.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 -- 172.21.15.12:0/3137110030 >> 172.21.15.12:0/3137110030 conn(0x7f95680703a0 msgr2=0x7f95680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:34.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.979+0000 7f9567fff700 1 -- 172.21.15.12:0/3137110030 shutdown_connections 2023-10-08T16:21:34.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.980+0000 7f9567fff700 1 -- 172.21.15.12:0/3137110030 wait complete. 2023-10-08T16:21:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.981+0000 7f9567fff700 1 Processor -- start 2023-10-08T16:21:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.981+0000 7f9567fff700 1 -- start start 2023-10-08T16:21:34.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95680b1d40 0x7f95680a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9568159800 0x7f95680ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680a8bb0 con 0x7f95680b24f0 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680a7fa0 con 0x7f95680b1d40 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9567fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95680a8280 con 0x7f9568159800 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f95667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f95667fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43414/0 (socket says 172.21.15.12:43414) 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f95667fc700 1 -- 172.21.15.12:0/4202623503 learned_addr learned my addr 172.21.15.12:0/4202623503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f95677fe700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9568159800 0x7f95680ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.982+0000 7f9566ffd700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95680b1d40 0x7f95680a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 -- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9568159800 msgr2=0x7f95680ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:34.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9568159800 0x7f95680ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 -- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95680b1d40 msgr2=0x7f95680a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95680b1d40 0x7f95680a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 -- 172.21.15.12:0/4202623503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955c0094f0 con 0x7f95680b24f0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f95667fc700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f955c009290 tx=0x7f955c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c011e60 con 0x7f95680b24f0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955c01f070 con 0x7f95680b24f0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955c01a870 con 0x7f95680b24f0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95680a8560 con 0x7f95680b24f0 2023-10-08T16:21:34.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.983+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95680ad340 con 0x7f95680b24f0 2023-10-08T16:21:34.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.984+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95680a8d60 con 0x7f95680b24f0 2023-10-08T16:21:34.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.985+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f955c01abe0 con 0x7f95680b24f0 2023-10-08T16:21:34.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.986+0000 7f954effd700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 0x7f95540695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:34.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.986+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6195+0+0 (secure 0 0 0) 0x7f955c021070 con 0x7f95680b24f0 2023-10-08T16:21:34.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.987+0000 7f9566ffd700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 0x7f95540695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:34.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.987+0000 7f9566ffd700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 0x7f95540695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9558003860 tx=0x7f9558009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:34.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:34.990+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95680a8d60 con 0x7f95680b24f0 2023-10-08T16:21:35.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.219+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f95680d12a0 con 0x7f9554067130 2023-10-08T16:21:35.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.296+0000 7f954effd700 1 -- 172.21.15.12:0/4202623503 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f95680d12a0 con 0x7f9554067130 2023-10-08T16:21:35.297 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 msgr2=0x7f95540695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 0x7f95540695e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9558003860 tx=0x7f9558009040 comp rx=0 tx=0).stop 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 msgr2=0x7f95680a9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f955c009290 tx=0x7f955c017000 comp rx=0 tx=0).stop 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 shutdown_connections 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9568159800 0x7f95680ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95680b1d40 0x7f95680a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f9554067130 0x7f95540695e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 --2- 172.21.15.12:0/4202623503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95680b24f0 0x7f95680a9580 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 >> 172.21.15.12:0/4202623503 conn(0x7f95680703a0 msgr2=0x7f95680cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 shutdown_connections 2023-10-08T16:21:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:35.299+0000 7f9567fff700 1 -- 172.21.15.12:0/4202623503 wait complete. 2023-10-08T16:21:35.317 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-10-08T16:21:35.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.317 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-10-08T16:21:35.355 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:35.355 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:35.356 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:35.357 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:35.357 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:35.357 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:35.358 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:35.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.358 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:35.445 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:35.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.445 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:35.490 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:35.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.491 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:35.575 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:35.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.575 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:35.687 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:35.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.688 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:35.747 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:35.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.748 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:35.793 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:35.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.794 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:35.882 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:35.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.883 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:35.926 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:35.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:35.927 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:36.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:36.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:36.013 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:36.096 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:36.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:36.097 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:36.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:36.181 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-10-08T16:21:36.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-10-08T16:21:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.492+0000 7f7c37fff700 1 Processor -- start 2023-10-08T16:21:36.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.492+0000 7f7c37fff700 1 -- start start 2023-10-08T16:21:36.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 0x7f7c380c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c38156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c380c85d0 0x7f7c380cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c381579b0 con 0x7f7c380c85d0 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c380c1390 con 0x7f7c380c8200 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c37fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381573f0 con 0x7f7c380c2a90 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c380c85d0 0x7f7c380cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c380c85d0 0x7f7c380cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43420/0 (socket says 172.21.15.12:43420) 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 -- 172.21.15.12:0/2984100710 learned_addr learned my addr 172.21.15.12:0/2984100710 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c367fc700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c38156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c36ffd700 1 --2- 172.21.15.12:0/2984100710 >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 0x7f7c380c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 -- 172.21.15.12:0/2984100710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 msgr2=0x7f7c38156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c38156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 -- 172.21.15.12:0/2984100710 >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 msgr2=0x7f7c380c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:36.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 --2- 172.21.15.12:0/2984100710 >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 0x7f7c380c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c377fe700 1 -- 172.21.15.12:0/2984100710 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c381576d0 con 0x7f7c380c85d0 2023-10-08T16:21:36.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.494+0000 7f7c36ffd700 1 --2- 172.21.15.12:0/2984100710 >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 0x7f7c380c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:36.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.495+0000 7f7c377fe700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c380cc2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7c380683d0 tx=0x7f7c30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4c8126a0355b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.495+0000 7f7c35ffb700 1 -- 172.21.15.12:0/2984100710 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000e070 con 0x7f7c380c85d0 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.495+0000 7f7c35ffb700 1 -- 172.21.15.12:0/2984100710 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000ba20 con 0x7f7c380c85d0 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.495+0000 7f7c35ffb700 1 -- 172.21.15.12:0/2984100710 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300092e0 con 0x7f7c380c85d0 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 -- 172.21.15.12:0/2984100710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 msgr2=0x7f7c380cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c380cc2f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f7c380683d0 tx=0x7f7c30009840 comp rx=0 tx=0).stop 2023-10-08T16:21:36.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 -- 172.21.15.12:0/2984100710 shutdown_connections 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c380cc2f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 --2- 172.21.15.12:0/2984100710 >> v2:172.21.15.29:3300/0 conn(0x7f7c380c8200 0x7f7c380c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 --2- 172.21.15.12:0/2984100710 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c38156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 -- 172.21.15.12:0/2984100710 >> 172.21.15.12:0/2984100710 conn(0x7f7c3806c6a0 msgr2=0x7f7c3806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 -- 172.21.15.12:0/2984100710 shutdown_connections 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.496+0000 7f7c37fff700 1 -- 172.21.15.12:0/2984100710 wait complete. 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.497+0000 7f7c37fff700 1 Processor -- start 2023-10-08T16:21:36.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.497+0000 7f7c37fff700 1 -- start start 2023-10-08T16:21:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c380c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c380c8200 0x7f7c380c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c381675b0 con 0x7f7c380c85d0 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380c4730 con 0x7f7c380c8200 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.498+0000 7f7c37fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c380c4a10 con 0x7f7c380c2a90 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43434/0 (socket says 172.21.15.12:43434) 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 -- 172.21.15.12:0/1998806423 learned_addr learned my addr 172.21.15.12:0/1998806423 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c36ffd700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c380c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c367fc700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c380c8200 0x7f7c380c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 -- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 msgr2=0x7f7c380c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:36.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c380c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 -- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c380c8200 msgr2=0x7f7c380c3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c380c8200 0x7f7c380c3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 -- 172.21.15.12:0/1998806423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c30009ae0 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.499+0000 7f7c377fe700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c380697c0 tx=0x7f7c30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.500+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c300032f0 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.500+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c30007e40 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.500+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3001d650 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.500+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c380c4cf0 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.500+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c380c4fd0 con 0x7f7c380c85d0 2023-10-08T16:21:36.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.501+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c38167720 con 0x7f7c380c85d0 2023-10-08T16:21:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.502+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f7c30003040 con 0x7f7c380c85d0 2023-10-08T16:21:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.503+0000 7f7c1effd700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 0x7f7c240695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.503+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6435+0+0 (secure 0 0 0) 0x7f7c300864f0 con 0x7f7c380c85d0 2023-10-08T16:21:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.503+0000 7f7c36ffd700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 0x7f7c240695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:36.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.504+0000 7f7c36ffd700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 0x7f7c240695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c28006f00 tx=0x7f7c28008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:36.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.507+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c38167720 con 0x7f7c380c85d0 2023-10-08T16:21:36.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.758+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c381673b0 con 0x7f7c24067130 2023-10-08T16:21:36.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.850+0000 7f7c1effd700 1 -- 172.21.15.12:0/1998806423 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7c381673b0 con 0x7f7c24067130 2023-10-08T16:21:36.851 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-10-08T16:21:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 msgr2=0x7f7c240695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 0x7f7c240695e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7c28006f00 tx=0x7f7c28008040 comp rx=0 tx=0).stop 2023-10-08T16:21:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 msgr2=0x7f7c3814db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:36.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f7c380697c0 tx=0x7f7c30018000 comp rx=0 tx=0).stop 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 shutdown_connections 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f7c24067130 0x7f7c240695e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c380c85d0 0x7f7c3814db60 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c380c2a90 0x7f7c380c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 --2- 172.21.15.12:0/1998806423 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c380c8200 0x7f7c380c3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 >> 172.21.15.12:0/1998806423 conn(0x7f7c3806c6a0 msgr2=0x7f7c380ad950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 shutdown_connections 2023-10-08T16:21:36.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:36.852+0000 7f7c37fff700 1 -- 172.21.15.12:0/1998806423 wait complete. 2023-10-08T16:21:36.871 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-10-08T16:21:36.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:36.871 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-10-08T16:21:36.911 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:36.911 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:36.911 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:36.912 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:36.914 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:36.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:36.914 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:37.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:37.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.002 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:37.046 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:37.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.047 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:37.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:37.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.131 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:37.215 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:37.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.215 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:37.299 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:37.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.300 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:37.384 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:37.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.385 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:37.468 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:37.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.469 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:37.552 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:37.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.553 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:37.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:37.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.648 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:37.702 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:37.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.702 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:37.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:37.746 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-10-08T16:21:37.826 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-10-08T16:21:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.058+0000 7f0c609fe700 1 Processor -- start 2023-10-08T16:21:38.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.058+0000 7f0c609fe700 1 -- start start 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.059+0000 7f0c609fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c5c0c8200 0x7f0c5c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.059+0000 7f0c609fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c85d0 0x7f0c5c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.059+0000 7f0c609fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5c1571b0 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.059+0000 7f0c609fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c5c1579b0 con 0x7f0c5c0c8200 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.059+0000 7f0c609fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c0c1390 con 0x7f0c5c0c85d0 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c5c0c8200 0x7f0c5c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0c5c0c8200 0x7f0c5c0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43446/0 (socket says 172.21.15.12:43446) 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/2976988614 learned_addr learned my addr 172.21.15.12:0/2976988614 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5b59e700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c85d0 0x7f0c5c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/2976988614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c85d0 msgr2=0x7f0c5c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c85d0 0x7f0c5c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/2976988614 >> v1:172.21.15.29:6789/0 conn(0x7f0c5c0c2a90 legacy=0x7f0c5c156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.060+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/2976988614 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c1573f0 con 0x7f0c5c0c8200 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c5ad9d700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c8200 0x7f0c5c0c1820 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0099b0 tx=0x7f0c4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23212e8d226a4317 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c59d9b700 1 -- 172.21.15.12:0/2976988614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00b860 con 0x7f0c5c0c8200 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c59d9b700 1 -- 172.21.15.12:0/2976988614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c00b9c0 con 0x7f0c5c0c8200 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c59d9b700 1 -- 172.21.15.12:0/2976988614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c00bd60 con 0x7f0c5c0c8200 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 -- 172.21.15.12:0/2976988614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c8200 msgr2=0x7f0c5c0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c8200 0x7f0c5c0c1820 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0c4c0099b0 tx=0x7f0c4c009250 comp rx=0 tx=0).stop 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 -- 172.21.15.12:0/2976988614 shutdown_connections 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c85d0 0x7f0c5c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 --2- 172.21.15.12:0/2976988614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c8200 0x7f0c5c0c1820 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.061+0000 7f0c609fe700 1 -- 172.21.15.12:0/2976988614 >> 172.21.15.12:0/2976988614 conn(0x7f0c5c06c6a0 msgr2=0x7f0c5c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.062+0000 7f0c609fe700 1 -- 172.21.15.12:0/2976988614 shutdown_connections 2023-10-08T16:21:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.062+0000 7f0c609fe700 1 -- 172.21.15.12:0/2976988614 wait complete. 2023-10-08T16:21:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.063+0000 7f0c609fe700 1 Processor -- start 2023-10-08T16:21:38.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.063+0000 7f0c609fe700 1 -- start start 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c8200 0x7f0c5c14afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 0x7f0c5c0ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c14c340 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c157e50 con 0x7f0c5c0c85d0 2023-10-08T16:21:38.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c609fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5c14baa0 con 0x7f0c5c0c8200 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c5ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c5ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43450/0 (socket says 172.21.15.12:43450) 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.064+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/732731653 learned_addr learned my addr 172.21.15.12:0/732731653 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5b59e700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 0x7f0c5c0ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5a59c700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c8200 0x7f0c5c14afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c8200 msgr2=0x7f0c5c14afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c8200 0x7f0c5c14afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 msgr2=0x7f0c5c0ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 0x7f0c5c0ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 -- 172.21.15.12:0/732731653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c4c0094f0 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5b59e700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 0x7f0c5c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c5ad9d700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0697c0 tx=0x7f0c4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c024440 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4c0245a0 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5c14bd80 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.065+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4c024940 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.066+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5c0a9b20 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.066+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5c158070 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.067+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f0c4c01a420 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.068+0000 7f0c42ffd700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 0x7f0c480695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.068+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0c4c0869f0 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.069+0000 7f0c5a59c700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 0x7f0c480695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:38.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.069+0000 7f0c5a59c700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 0x7f0c480695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0cb3b0 tx=0x7f0c50009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:38.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.073+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c5c158070 con 0x7f0c5c0c2a90 2023-10-08T16:21:38.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.319+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c5c157cd0 con 0x7f0c48067130 2023-10-08T16:21:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.398+0000 7f0c42ffd700 1 -- 172.21.15.12:0/732731653 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f0c50013420 con 0x7f0c48067130 2023-10-08T16:21:38.399 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-10-08T16:21:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 msgr2=0x7f0c480695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 0x7f0c480695e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0cb3b0 tx=0x7f0c50009040 comp rx=0 tx=0).stop 2023-10-08T16:21:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 msgr2=0x7f0c5c143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0697c0 tx=0x7f0c4c017000 comp rx=0 tx=0).stop 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 shutdown_connections 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f0c48067130 0x7f0c480695e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0c5c0c2a90 0x7f0c5c143e90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0c5c0c85d0 0x7f0c5c0ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 --2- 172.21.15.12:0/732731653 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0c5c0c8200 0x7f0c5c14afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 >> 172.21.15.12:0/732731653 conn(0x7f0c5c06c6a0 msgr2=0x7f0c5c15a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 shutdown_connections 2023-10-08T16:21:38.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:38.400+0000 7f0c609fe700 1 -- 172.21.15.12:0/732731653 wait complete. 2023-10-08T16:21:38.418 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-10-08T16:21:38.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.418 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-10-08T16:21:38.456 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:38.457 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:38.458 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:38.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.459 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:38.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:38.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.545 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:38.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:38.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.629 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:38.728 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:38.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.729 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:38.799 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:38.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.800 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:38.844 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:38.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.844 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:38.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:38.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.931 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:38.980 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:38.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:38.981 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:39.025 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:39.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.025 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:39.110 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:39.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.110 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:39.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:39.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.196 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:39.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.298 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-10-08T16:21:39.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.572+0000 7f39f359e700 1 Processor -- start 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.572+0000 7f39f359e700 1 -- start start 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.573+0000 7f39f359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f39f4153a30 0x7f39f40c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.573+0000 7f39f359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f40c9090 0x7f39f4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.573+0000 7f39f359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40c2200 con 0x7f39f4153660 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.573+0000 7f39f359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f4157250 con 0x7f39f4153a30 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.573+0000 7f39f359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40c15f0 con 0x7f39f40c9090 2023-10-08T16:21:39.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f39f4153660 0x7f39f40c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:45544/0 (socket says 172.21.15.12:45544) 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f259c700 1 -- 172.21.15.12:0/3671902717 learned_addr learned my addr 172.21.15.12:0/3671902717 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3671902717 >> v2:172.21.15.29:3300/0 conn(0x7f39f4153a30 0x7f39f40c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f2d9d700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f40c9090 0x7f39f4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f159a700 1 -- 172.21.15.12:0/3671902717 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852557080 0 0) 0x7f39f40c2200 con 0x7f39f4153660 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f159a700 1 -- 172.21.15.12:0/3671902717 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39dc003570 con 0x7f39f4153660 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f40c9090 msgr2=0x7f39f4156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f40c9090 0x7f39f4156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3671902717 >> v1:172.21.15.12:6789/0 conn(0x7f39f4153660 legacy=0x7f39f40c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.574+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3671902717 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40c18d0 con 0x7f39f4153a30 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f4153a30 0x7f39f40c0ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009910 tx=0x7f39e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a111b57aa0babd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f159a700 1 -- 172.21.15.12:0/3671902717 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011630 con 0x7f39f4153a30 2023-10-08T16:21:39.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f159a700 1 -- 172.21.15.12:0/3671902717 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8011790 con 0x7f39f4153a30 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f159a700 1 -- 172.21.15.12:0/3671902717 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011b30 con 0x7f39f4153a30 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f359e700 1 -- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f4153a30 msgr2=0x7f39f40c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.575+0000 7f39f359e700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f4153a30 0x7f39f40c0ef0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f39e8009910 tx=0x7f39e80091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 -- 172.21.15.12:0/3671902717 shutdown_connections 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f40c9090 0x7f39f4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 --2- 172.21.15.12:0/3671902717 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f4153a30 0x7f39f40c0ef0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 -- 172.21.15.12:0/3671902717 >> 172.21.15.12:0/3671902717 conn(0x7f39f406c6a0 msgr2=0x7f39f406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 -- 172.21.15.12:0/3671902717 shutdown_connections 2023-10-08T16:21:39.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.576+0000 7f39f359e700 1 -- 172.21.15.12:0/3671902717 wait complete. 2023-10-08T16:21:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.577+0000 7f39f359e700 1 Processor -- start 2023-10-08T16:21:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.577+0000 7f39f359e700 1 -- start start 2023-10-08T16:21:39.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f40c9090 0x7f39f40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f4153a30 0x7f39f40c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4168560 con 0x7f39f4153660 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4159410 con 0x7f39f40c9090 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f41596f0 con 0x7f39f4153a30 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43454/0 (socket says 172.21.15.12:43454) 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.578+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3979196037 learned_addr learned my addr 172.21.15.12:0/3979196037 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f259c700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f40c9090 0x7f39f40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f2d9d700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f4153a30 0x7f39f40c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f4153a30 msgr2=0x7f39f40c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f4153a30 0x7f39f40c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f40c9090 msgr2=0x7f39f40c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f40c9090 0x7f39f40c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 -- 172.21.15.12:0/3979196037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e8009420 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39f1d9b700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f39f4067f90 tx=0x7f39e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.579+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8011900 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.580+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e8011a60 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.580+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f41599d0 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.580+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e8025670 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.580+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f4159f90 con 0x7f39f4153660 2023-10-08T16:21:39.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.581+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f415a180 con 0x7f39f4153660 2023-10-08T16:21:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.581+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f39e8023070 con 0x7f39f4153660 2023-10-08T16:21:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.582+0000 7f39e27fc700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 0x7f39d40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.582+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6515+0+0 (secure 0 0 0) 0x7f39e80860f0 con 0x7f39f4153660 2023-10-08T16:21:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.583+0000 7f39f259c700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 0x7f39d40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:39.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.583+0000 7f39f259c700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 0x7f39d40695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39e40058d0 tx=0x7f39e4009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:39.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.587+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39e8052db0 con 0x7f39f4153660 2023-10-08T16:21:39.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.821+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f39f404c3c0 con 0x7f39d4067130 2023-10-08T16:21:39.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.911+0000 7f39e27fc700 1 -- 172.21.15.12:0/3979196037 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f39f404c3c0 con 0x7f39d4067130 2023-10-08T16:21:39.912 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-10-08T16:21:39.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 msgr2=0x7f39d40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 0x7f39d40695e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f39e40058d0 tx=0x7f39e4009040 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 msgr2=0x7f39f40c6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f39f4067f90 tx=0x7f39e8017000 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 shutdown_connections 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f39f4153a30 0x7f39f40c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f39f40c9090 0x7f39f40c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f39d4067130 0x7f39d40695e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.913+0000 7f39f359e700 1 --2- 172.21.15.12:0/3979196037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f39f4153660 0x7f39f40c6180 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.914+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 >> 172.21.15.12:0/3979196037 conn(0x7f39f406c6a0 msgr2=0x7f39f40b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.914+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 shutdown_connections 2023-10-08T16:21:39.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:39.914+0000 7f39f359e700 1 -- 172.21.15.12:0/3979196037 wait complete. 2023-10-08T16:21:39.931 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-10-08T16:21:39.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.932 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-10-08T16:21:39.970 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:39.971 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:39.972 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:39.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:39.972 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:40.060 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:40.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.060 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:40.144 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:40.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.144 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:40.229 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:40.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.229 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:40.314 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:40.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.314 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:40.397 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:40.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.397 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:40.481 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:40.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.481 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:40.564 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:40.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.565 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:40.663 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:40.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.664 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:40.738 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:40.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.739 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:40.798 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:40.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.798 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:40.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:40.842 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-10-08T16:21:40.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-10-08T16:21:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.185+0000 7f5e5e79d700 1 Processor -- start 2023-10-08T16:21:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.185+0000 7f5e5e79d700 1 -- start start 2023-10-08T16:21:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e58166630 0x7f5e580c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e58087300 0x7f5e58087720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e580c1a00 con 0x7f5e58087300 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e58087c60 con 0x7f5e58166630 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c94e0 con 0x7f5e58166260 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5df9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e58087300 0x7f5e58087720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5df9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e58087300 0x7f5e58087720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43462/0 (socket says 172.21.15.12:43462) 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.186+0000 7f5e5df9c700 1 -- 172.21.15.12:0/2274394001 learned_addr learned my addr 172.21.15.12:0/2274394001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.187+0000 7f5e5cf9a700 1 --2- 172.21.15.12:0/2274394001 >> v2:172.21.15.29:3300/0 conn(0x7f5e58166630 0x7f5e580c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.187+0000 7f5e5d79b700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.219+0000 7f5e5df9c700 1 -- 172.21.15.12:0/2274394001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 msgr2=0x7f5e580c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.219+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e5df9c700 1 -- 172.21.15.12:0/2274394001 >> v2:172.21.15.29:3300/0 conn(0x7f5e58166630 msgr2=0x7f5e580c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/2274394001 >> v2:172.21.15.29:3300/0 conn(0x7f5e58166630 0x7f5e580c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e5df9c700 1 -- 172.21.15.12:0/2274394001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580c97c0 con 0x7f5e58087300 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58087300 0x7f5e58087720 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5e58069510 tx=0x7f5e50007820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fd74d29c0bcf6d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e4ffff700 1 -- 172.21.15.12:0/2274394001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50008b50 con 0x7f5e58087300 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e4ffff700 1 -- 172.21.15.12:0/2274394001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e50008cb0 con 0x7f5e58087300 2023-10-08T16:21:41.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.220+0000 7f5e4ffff700 1 -- 172.21.15.12:0/2274394001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50014670 con 0x7f5e58087300 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 -- 172.21.15.12:0/2274394001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58087300 msgr2=0x7f5e58087720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58087300 0x7f5e58087720 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f5e58069510 tx=0x7f5e50007820 comp rx=0 tx=0).stop 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 -- 172.21.15.12:0/2274394001 shutdown_connections 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58087300 0x7f5e58087720 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/2274394001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/2274394001 >> v2:172.21.15.29:3300/0 conn(0x7f5e58166630 0x7f5e580c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 -- 172.21.15.12:0/2274394001 >> 172.21.15.12:0/2274394001 conn(0x7f5e5806c6a0 msgr2=0x7f5e5806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 -- 172.21.15.12:0/2274394001 shutdown_connections 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.221+0000 7f5e5e79d700 1 -- 172.21.15.12:0/2274394001 wait complete. 2023-10-08T16:21:41.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.222+0000 7f5e5e79d700 1 Processor -- start 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.223+0000 7f5e5e79d700 1 -- start start 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58087300 0x7f5e580c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580c3850 con 0x7f5e58166630 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e580b0f30 con 0x7f5e58087300 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e581771b0 con 0x7f5e58166260 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43478/0 (socket says 172.21.15.12:43478) 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 -- 172.21.15.12:0/3462596583 learned_addr learned my addr 172.21.15.12:0/3462596583 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5d79b700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58087300 0x7f5e580c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5cf9a700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 -- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 msgr2=0x7f5e580b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 -- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58087300 msgr2=0x7f5e580c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58087300 0x7f5e580c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.224+0000 7f5e5df9c700 1 -- 172.21.15.12:0/3462596583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e50007ac0 con 0x7f5e58166630 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e5df9c700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000d010 tx=0x7f5e50015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5001f470 con 0x7f5e58166630 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5001f5d0 con 0x7f5e58166630 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580b1190 con 0x7f5e58166630 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5001f990 con 0x7f5e58166630 2023-10-08T16:21:41.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.225+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e580c3200 con 0x7f5e58166630 2023-10-08T16:21:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.226+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5804c3c0 con 0x7f5e58166630 2023-10-08T16:21:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.227+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f5e5000b120 con 0x7f5e58166630 2023-10-08T16:21:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.228+0000 7f5e4d7fa700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 0x7f5e3c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.228+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6767+0+0 (secure 0 0 0) 0x7f5e50086ad0 con 0x7f5e58166630 2023-10-08T16:21:41.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.229+0000 7f5e5d79b700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 0x7f5e3c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:41.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.229+0000 7f5e5d79b700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 0x7f5e3c0695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806bd90 tx=0x7f5e54007040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:41.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.233+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e500534f0 con 0x7f5e58166630 2023-10-08T16:21:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.462+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e580c1190 con 0x7f5e3c067130 2023-10-08T16:21:41.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.566+0000 7f5e4d7fa700 1 -- 172.21.15.12:0/3462596583 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5e580c1190 con 0x7f5e3c067130 2023-10-08T16:21:41.567 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-10-08T16:21:41.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 msgr2=0x7f5e3c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 0x7f5e3c0695e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5e5806bd90 tx=0x7f5e54007040 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 msgr2=0x7f5e58164a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000d010 tx=0x7f5e50015000 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 shutdown_connections 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5e3c067130 0x7f5e3c0695e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e58166630 0x7f5e58164a40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e58087300 0x7f5e580c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 --2- 172.21.15.12:0/3462596583 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e58166260 0x7f5e580b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 >> 172.21.15.12:0/3462596583 conn(0x7f5e5806c6a0 msgr2=0x7f5e580cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:41.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 shutdown_connections 2023-10-08T16:21:41.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:41.569+0000 7f5e5e79d700 1 -- 172.21.15.12:0/3462596583 wait complete. 2023-10-08T16:21:41.587 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-10-08T16:21:41.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.587 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_01_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:41.626 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:41.627 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:41.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_11_01_UTC 2023-10-08T16:21:41.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.628 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_11_01_UTC) 2023-10-08T16:21:41.713 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:41.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.713 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:41.797 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:41.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.798 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:41.881 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:41.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.881 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:41.966 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:41.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:41.966 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:42.049 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:42.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.049 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:42.157 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:42.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.158 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:42.201 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:42.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.201 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:42.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:42.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.286 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:42.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:42.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.370 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:42.453 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:42.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.454 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:42.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:42.537 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-10-08T16:21:42.617 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-10-08T16:21:42.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.849+0000 7fd30d99d700 1 Processor -- start 2023-10-08T16:21:42.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.849+0000 7fd30d99d700 1 -- start start 2023-10-08T16:21:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30d99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3080c2a90 0x7fd308156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30d99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3080c85d0 0x7fd3080cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30d99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3081579b0 con 0x7fd3080c8200 2023-10-08T16:21:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30d99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3080c1390 con 0x7fd3080c2a90 2023-10-08T16:21:42.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30d99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3081573f0 con 0x7fd3080c85d0 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd307fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3080c2a90 0x7fd308156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30c99b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd3080c8200 0x7fd3080c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41238/0 (socket says 172.21.15.12:41238) 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.850+0000 7fd30c99b700 1 -- 172.21.15.12:0/661560637 learned_addr learned my addr 172.21.15.12:0/661560637 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd307fff700 1 -- 172.21.15.12:0/661560637 >> v2:172.21.15.29:3300/0 conn(0x7fd3080c85d0 msgr2=0x7fd3080cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd30d19c700 1 --2- 172.21.15.12:0/661560637 >> v2:172.21.15.29:3300/0 conn(0x7fd3080c85d0 0x7fd3080cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd307fff700 1 --2- 172.21.15.12:0/661560637 >> v2:172.21.15.29:3300/0 conn(0x7fd3080c85d0 0x7fd3080cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd307fff700 1 -- 172.21.15.12:0/661560637 >> v1:172.21.15.12:6789/0 conn(0x7fd3080c8200 legacy=0x7fd3080c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:42.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd3077fe700 1 -- 172.21.15.12:0/661560637 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984150479 0 0) 0x7fd3081579b0 con 0x7fd3080c8200 2023-10-08T16:21:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd307fff700 1 -- 172.21.15.12:0/661560637 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3081576d0 con 0x7fd3080c2a90 2023-10-08T16:21:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd307fff700 1 --2- 172.21.15.12:0/661560637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c2a90 0x7fd308156aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c1300 tx=0x7fd2f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41f30e4470c79a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd3077fe700 1 -- 172.21.15.12:0/661560637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400b6b0 con 0x7fd3080c2a90 2023-10-08T16:21:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd3077fe700 1 -- 172.21.15.12:0/661560637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f400b810 con 0x7fd3080c2a90 2023-10-08T16:21:42.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.851+0000 7fd3077fe700 1 -- 172.21.15.12:0/661560637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f400bbb0 con 0x7fd3080c2a90 2023-10-08T16:21:42.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 -- 172.21.15.12:0/661560637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c2a90 msgr2=0x7fd308156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 --2- 172.21.15.12:0/661560637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c2a90 0x7fd308156aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd3080c1300 tx=0x7fd2f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 -- 172.21.15.12:0/661560637 shutdown_connections 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 --2- 172.21.15.12:0/661560637 >> v2:172.21.15.29:3300/0 conn(0x7fd3080c85d0 0x7fd3080cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 --2- 172.21.15.12:0/661560637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c2a90 0x7fd308156aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 -- 172.21.15.12:0/661560637 >> 172.21.15.12:0/661560637 conn(0x7fd30806c6a0 msgr2=0x7fd30806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 -- 172.21.15.12:0/661560637 shutdown_connections 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.852+0000 7fd30d99d700 1 -- 172.21.15.12:0/661560637 wait complete. 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.853+0000 7fd30d99d700 1 Processor -- start 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.854+0000 7fd30d99d700 1 -- start start 2023-10-08T16:21:42.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3080c2a90 0x7fd3080aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 0x7fd308146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3081500b0 con 0x7fd3080c85d0 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd308150390 con 0x7fd3080c8200 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3080abb70 con 0x7fd3080c2a90 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39686/0 (socket says 172.21.15.12:39686) 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 -- 172.21.15.12:0/3636681765 learned_addr learned my addr 172.21.15.12:0/3636681765 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd307fff700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 0x7fd308146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30c99b700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3080c2a90 0x7fd3080aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 -- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3080c2a90 msgr2=0x7fd3080aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3080c2a90 0x7fd3080aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 -- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 msgr2=0x7fd308146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 0x7fd308146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd30d19c700 1 -- 172.21.15.12:0/3636681765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4009420 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.855+0000 7fd307fff700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 0x7fd308146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd30d19c700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd30000cdb0 tx=0x7fd3000077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000aa80 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000abe0 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd300017430 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3080abe50 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.856+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30814ee10 con 0x7fd3080c85d0 2023-10-08T16:21:42.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.857+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3080ac040 con 0x7fd3080c85d0 2023-10-08T16:21:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.858+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fd300003020 con 0x7fd3080c85d0 2023-10-08T16:21:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.859+0000 7fd304ff9700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 0x7fd2ec0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.859+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6419+0+0 (secure 0 0 0) 0x7fd300013070 con 0x7fd3080c85d0 2023-10-08T16:21:42.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.859+0000 7fd30c99b700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 0x7fd2ec0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:42.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.860+0000 7fd30c99b700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 0x7fd2ec0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0011e0 tx=0x7fd2fc009040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:42.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:42.863+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd300051d50 con 0x7fd3080c85d0 2023-10-08T16:21:43.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.094+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3080abce0 con 0x7fd2ec067130 2023-10-08T16:21:43.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.216+0000 7fd304ff9700 1 -- 172.21.15.12:0/3636681765 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fd3080abce0 con 0x7fd2ec067130 2023-10-08T16:21:43.217 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-10-08T16:21:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 msgr2=0x7fd2ec0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 0x7fd2ec0695e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0011e0 tx=0x7fd2fc009040 comp rx=0 tx=0).stop 2023-10-08T16:21:43.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 msgr2=0x7fd30814f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fd30000cdb0 tx=0x7fd3000077d0 comp rx=0 tx=0).stop 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 shutdown_connections 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fd2ec067130 0x7fd2ec0695e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3080c85d0 0x7fd30814f5f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3080c2a90 0x7fd3080aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 --2- 172.21.15.12:0/3636681765 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3080c8200 0x7fd308146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 >> 172.21.15.12:0/3636681765 conn(0x7fd30806c6a0 msgr2=0x7fd30806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.218+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 shutdown_connections 2023-10-08T16:21:43.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:43.219+0000 7fd30d99d700 1 -- 172.21.15.12:0/3636681765 wait complete. 2023-10-08T16:21:43.236 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-10-08T16:21:43.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.236 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-10-08T16:21:43.274 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:43.275 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:43.277 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:43.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.277 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:43.361 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:43.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.361 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:43.446 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:43.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.447 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:43.531 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:43.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.531 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:43.615 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:43.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.616 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:43.699 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:43.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.700 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:43.783 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:43.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.783 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:43.867 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:43.867 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.867 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:43.951 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:43.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:43.951 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:44.035 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:44.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.035 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:44.140 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:44.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.141 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:44.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.184 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-10-08T16:21:44.265 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-10-08T16:21:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.495+0000 7fbdc6f9d700 1 Processor -- start 2023-10-08T16:21:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.496+0000 7fbdc6f9d700 1 -- start start 2023-10-08T16:21:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc6f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbdc0153660 0x7fbdc00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc6f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdc00c9090 0x7fbdc0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc6f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc00c2200 con 0x7fbdc0153a30 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc6f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc0157250 con 0x7fbdc00c9090 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc6f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc00c15f0 con 0x7fbdc0153660 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc679c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdc00c9090 0x7fbdc0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc679c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbdc00c9090 0x7fbdc0156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39690/0 (socket says 172.21.15.12:39690) 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc679c700 1 -- 172.21.15.12:0/1381385222 learned_addr learned my addr 172.21.15.12:0/1381385222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.497+0000 7fbdc5f9b700 1 --2- 172.21.15.12:0/1381385222 >> v2:172.21.15.29:3300/0 conn(0x7fbdc0153660 0x7fbdc00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc679c700 1 -- 172.21.15.12:0/1381385222 >> v2:172.21.15.29:3300/0 conn(0x7fbdc0153660 msgr2=0x7fbdc00c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc679c700 1 --2- 172.21.15.12:0/1381385222 >> v2:172.21.15.29:3300/0 conn(0x7fbdc0153660 0x7fbdc00c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc679c700 1 -- 172.21.15.12:0/1381385222 >> v1:172.21.15.29:6789/0 conn(0x7fbdc0153a30 legacy=0x7fbdc00c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc679c700 1 -- 172.21.15.12:0/1381385222 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc00c18d0 con 0x7fbdc00c9090 2023-10-08T16:21:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc679c700 1 --2- 172.21.15.12:0/1381385222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc00c9090 0x7fbdc0156d10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00c9cd0 tx=0x7fbdb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db139f945e588fa2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc4f99700 1 -- 172.21.15.12:0/1381385222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800ca60 con 0x7fbdc00c9090 2023-10-08T16:21:44.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc4f99700 1 -- 172.21.15.12:0/1381385222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800cbc0 con 0x7fbdc00c9090 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.498+0000 7fbdc4f99700 1 -- 172.21.15.12:0/1381385222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8011400 con 0x7fbdc00c9090 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/1381385222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc00c9090 msgr2=0x7fbdc0156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/1381385222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc00c9090 0x7fbdc0156d10 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbdc00c9cd0 tx=0x7fbdb8009840 comp rx=0 tx=0).stop 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/1381385222 shutdown_connections 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/1381385222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc00c9090 0x7fbdc0156d10 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/1381385222 >> v2:172.21.15.29:3300/0 conn(0x7fbdc0153660 0x7fbdc00c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/1381385222 >> 172.21.15.12:0/1381385222 conn(0x7fbdc006c6a0 msgr2=0x7fbdc006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/1381385222 shutdown_connections 2023-10-08T16:21:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.499+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/1381385222 wait complete. 2023-10-08T16:21:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.500+0000 7fbdc6f9d700 1 Processor -- start 2023-10-08T16:21:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 -- start start 2023-10-08T16:21:44.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 0x7fbdc00b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 0x7fbdc006e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00b0360 con 0x7fbdc0153a30 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc0159f40 con 0x7fbdc0153660 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.501+0000 7fbdc6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc00b1270 con 0x7fbdc00c9090 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39692/0 (socket says 172.21.15.12:39692) 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 -- 172.21.15.12:0/3578773939 learned_addr learned my addr 172.21.15.12:0/3578773939 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc579a700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 0x7fbdc006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc5f9b700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 0x7fbdc00b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 -- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 msgr2=0x7fbdc00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 0x7fbdc00b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 -- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 msgr2=0x7fbdc006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 0x7fbdc006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 -- 172.21.15.12:0/3578773939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb800d040 con 0x7fbdc0153a30 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc579a700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 0x7fbdc006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc5f9b700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 0x7fbdc00b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.502+0000 7fbdc679c700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009880 tx=0x7fbdb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.503+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb801a630 con 0x7fbdc0153a30 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.503+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb801a790 con 0x7fbdc0153a30 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.503+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb801ab50 con 0x7fbdc0153a30 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.503+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc0159330 con 0x7fbdc0153a30 2023-10-08T16:21:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.503+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc01598f0 con 0x7fbdc0153a30 2023-10-08T16:21:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.504+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc004c3c0 con 0x7fbdc0153a30 2023-10-08T16:21:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.505+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fbdb8003050 con 0x7fbdc0153a30 2023-10-08T16:21:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.506+0000 7fbdb5ffb700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 0x7fbda40695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.506+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6435+0+0 (secure 0 0 0) 0x7fbdb80866b0 con 0x7fbdc0153a30 2023-10-08T16:21:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.506+0000 7fbdc5f9b700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 0x7fbda40695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.507+0000 7fbdc5f9b700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 0x7fbda40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc006fd0 tx=0x7fbdbc008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.511+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdb8053210 con 0x7fbdc0153a30 2023-10-08T16:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.763+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdc00c81d0 con 0x7fbda4067130 2023-10-08T16:21:44.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.847+0000 7fbdb5ffb700 1 -- 172.21.15.12:0/3578773939 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fbdc00c81d0 con 0x7fbda4067130 2023-10-08T16:21:44.848 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-10-08T16:21:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 msgr2=0x7fbda40695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 0x7fbda40695e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc006fd0 tx=0x7fbdbc008040 comp rx=0 tx=0).stop 2023-10-08T16:21:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 msgr2=0x7fbdc006ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:44.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009880 tx=0x7fbdb8019000 comp rx=0 tx=0).stop 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 shutdown_connections 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fbda4067130 0x7fbda40695e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbdc0153a30 0x7fbdc006ebc0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbdc00c9090 0x7fbdc00b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 --2- 172.21.15.12:0/3578773939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbdc0153660 0x7fbdc006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 >> 172.21.15.12:0/3578773939 conn(0x7fbdc006c6a0 msgr2=0x7fbdc00cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 shutdown_connections 2023-10-08T16:21:44.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:44.850+0000 7fbdc6f9d700 1 -- 172.21.15.12:0/3578773939 wait complete. 2023-10-08T16:21:44.868 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-10-08T16:21:44.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.868 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-10-08T16:21:44.907 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:44.908 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:44.909 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:44.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.909 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:44.993 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:44.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:44.993 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:45.076 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:45.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.076 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:45.186 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:45.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.186 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:45.236 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:45.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.236 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:45.283 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:45.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.283 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:45.369 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:45.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.369 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:45.454 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:45.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.454 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:45.539 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:45.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.539 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:45.625 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:45.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.625 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:45.710 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:45.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.710 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:45.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:45.795 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-10-08T16:21:45.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-10-08T16:21:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.119+0000 7f38ae19d700 1 Processor -- start 2023-10-08T16:21:46.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.120+0000 7f38ae19d700 1 -- start start 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ae19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38a8153ac0 0x7f38a815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ae19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 0x7f38a806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ae19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a815abf0 con 0x7f38a8153e90 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ae19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a8070940 con 0x7f38a8153ac0 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ae19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a806a330 con 0x7f38a80cacb0 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ad19b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f38a8153ac0 0x7f38a815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ac99a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f38a8153e90 0x7f38a80ca5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41254/0 (socket says 172.21.15.12:41254) 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ac99a700 1 -- 172.21.15.12:0/1864633474 learned_addr learned my addr 172.21.15.12:0/1864633474 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.121+0000 7f38ad99c700 1 --2- 172.21.15.12:0/1864633474 >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 0x7f38a806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad19b700 1 -- 172.21.15.12:0/1864633474 >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 msgr2=0x7f38a806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad19b700 1 --2- 172.21.15.12:0/1864633474 >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 0x7f38a806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad19b700 1 -- 172.21.15.12:0/1864633474 >> v1:172.21.15.12:6789/0 conn(0x7f38a8153e90 legacy=0x7f38a80ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad19b700 1 -- 172.21.15.12:0/1864633474 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a806a610 con 0x7f38a8153ac0 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad99c700 1 --2- 172.21.15.12:0/1864633474 >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 0x7f38a806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f389ffff700 1 -- 172.21.15.12:0/1864633474 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230185328 0 0) 0x7f38a815abf0 con 0x7f38a8153e90 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f38ad19b700 1 --2- 172.21.15.12:0/1864633474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a8153ac0 0x7f38a815a6b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f38a80ca310 tx=0x7f38a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139116e8e6aa3013 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f389ffff700 1 -- 172.21.15.12:0/1864633474 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400b6b0 con 0x7f38a8153ac0 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f389ffff700 1 -- 172.21.15.12:0/1864633474 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a400b810 con 0x7f38a8153ac0 2023-10-08T16:21:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.122+0000 7f389ffff700 1 -- 172.21.15.12:0/1864633474 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400bbb0 con 0x7f38a8153ac0 2023-10-08T16:21:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 -- 172.21.15.12:0/1864633474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a8153ac0 msgr2=0x7f38a815a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 --2- 172.21.15.12:0/1864633474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a8153ac0 0x7f38a815a6b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f38a80ca310 tx=0x7f38a40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 -- 172.21.15.12:0/1864633474 shutdown_connections 2023-10-08T16:21:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 --2- 172.21.15.12:0/1864633474 >> v2:172.21.15.29:3300/0 conn(0x7f38a80cacb0 0x7f38a806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 --2- 172.21.15.12:0/1864633474 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a8153ac0 0x7f38a815a6b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 -- 172.21.15.12:0/1864633474 >> 172.21.15.12:0/1864633474 conn(0x7f38a806e790 msgr2=0x7f38a806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 -- 172.21.15.12:0/1864633474 shutdown_connections 2023-10-08T16:21:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.123+0000 7f38ae19d700 1 -- 172.21.15.12:0/1864633474 wait complete. 2023-10-08T16:21:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.124+0000 7f38ae19d700 1 Processor -- start 2023-10-08T16:21:46.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 -- start start 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38a8153ac0 0x7f38a80c6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 0x7f38a80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80b14b0 con 0x7f38a80cacb0 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a80c9d30 con 0x7f38a8153e90 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.125+0000 7f38ae19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a815d8e0 con 0x7f38a8153ac0 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39710/0 (socket says 172.21.15.12:39710) 2023-10-08T16:21:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 -- 172.21.15.12:0/2147194173 learned_addr learned my addr 172.21.15.12:0/2147194173 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad99c700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 0x7f38a80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 -- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38a8153ac0 msgr2=0x7f38a80c6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38a8153ac0 0x7f38a80c6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 -- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 msgr2=0x7f38a80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 0x7f38a80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 -- 172.21.15.12:0/2147194173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009420 con 0x7f38a80cacb0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad99c700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 0x7f38a80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.126+0000 7f38ad19b700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f38a40091e0 tx=0x7f38a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.127+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a400bb90 con 0x7f38a80cacb0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.127+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a4011420 con 0x7f38a80cacb0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.127+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a815dbc0 con 0x7f38a80cacb0 2023-10-08T16:21:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.127+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a40117c0 con 0x7f38a80cacb0 2023-10-08T16:21:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.127+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a80b1140 con 0x7f38a80cacb0 2023-10-08T16:21:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.128+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a80b0cc0 con 0x7f38a80cacb0 2023-10-08T16:21:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.129+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7f38a4011bb0 con 0x7f38a80cacb0 2023-10-08T16:21:46.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.129+0000 7f389d7fa700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 0x7f388c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.130+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6419+0+0 (secure 0 0 0) 0x7f38a40865b0 con 0x7f38a80cacb0 2023-10-08T16:21:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.130+0000 7f38ac99a700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 0x7f388c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:46.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.130+0000 7f38ac99a700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 0x7f388c0695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38a815d810 tx=0x7f3898007bd0 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:46.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.134+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f38a80b0cc0 con 0x7f38a80cacb0 2023-10-08T16:21:46.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.384+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 --> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f38a80b15f0 con 0x7f388c067130 2023-10-08T16:21:46.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.465+0000 7f389d7fa700 1 -- 172.21.15.12:0/2147194173 <== mgr.5208 v2:172.21.15.12:6832/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f38980058e0 con 0x7f388c067130 2023-10-08T16:21:46.466 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-10-08T16:21:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 msgr2=0x7f388c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 0x7f388c0695e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f38a815d810 tx=0x7f3898007bd0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 msgr2=0x7f38a815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:46.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f38a40091e0 tx=0x7f38a4017000 comp rx=0 tx=0).stop 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 shutdown_connections 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f388c067130 0x7f388c0695e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f38a80cacb0 0x7f38a815d2d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f38a8153e90 0x7f38a80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 --2- 172.21.15.12:0/2147194173 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f38a8153ac0 0x7f38a80c6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 >> 172.21.15.12:0/2147194173 conn(0x7f38a806e790 msgr2=0x7f38a80c4180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 shutdown_connections 2023-10-08T16:21:46.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:46.467+0000 7f38ae19d700 1 -- 172.21.15.12:0/2147194173 wait complete. 2023-10-08T16:21:46.485 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-10-08T16:21:46.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.486 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-10-08T16:21:46.523 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:46.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:46.525 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:46.525 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:46.525 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:46.525 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:46.526 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_11_00_UTC 2023-10-08T16:21:46.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.527 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_11_00_UTC) 2023-10-08T16:21:46.541 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:21:46.574 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:21:46.615 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_12_00_UTC 2023-10-08T16:21:46.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.615 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_12_00_UTC) 2023-10-08T16:21:46.700 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_13_00_UTC 2023-10-08T16:21:46.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.701 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_13_00_UTC) 2023-10-08T16:21:46.786 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_14_00_UTC 2023-10-08T16:21:46.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.786 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_14_00_UTC) 2023-10-08T16:21:46.872 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_15_00_UTC 2023-10-08T16:21:46.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.872 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_15_00_UTC) 2023-10-08T16:21:46.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_16_00_UTC 2023-10-08T16:21:46.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:46.959 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_16_00_UTC) 2023-10-08T16:21:47.045 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_17_00_UTC 2023-10-08T16:21:47.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.045 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_17_00_UTC) 2023-10-08T16:21:47.158 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_18_00_UTC 2023-10-08T16:21:47.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.159 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_18_00_UTC) 2023-10-08T16:21:47.208 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_19_00_UTC 2023-10-08T16:21:47.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.208 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_19_00_UTC) 2023-10-08T16:21:47.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_20_00_UTC 2023-10-08T16:21:47.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.260 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_20_00_UTC) 2023-10-08T16:21:47.305 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_21_00_UTC 2023-10-08T16:21:47.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.305 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-10-08-16_21_00_UTC) 2023-10-08T16:21:47.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:47.393 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-10-08T16:21:47.433 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:21:47.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.661+0000 7fc88b39d700 1 Processor -- start 2023-10-08T16:21:47.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.661+0000 7fc88b39d700 1 -- start start 2023-10-08T16:21:47.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88b39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8840cc840 0x7fc884155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88b39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88406b790 con 0x7fc8840c7930 2023-10-08T16:21:47.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88b39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88406ab80 con 0x7fc8840cc840 2023-10-08T16:21:47.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88406ae60 con 0x7fc8840ccce0 2023-10-08T16:21:47.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88ab9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc889b9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8840cc840 0x7fc884155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88ab9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39874/0 (socket says 172.21.15.12:39874) 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc88ab9c700 1 -- 172.21.15.12:0/3227439981 learned_addr learned my addr 172.21.15.12:0/3227439981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc88ab9c700 1 -- 172.21.15.12:0/3227439981 >> v2:172.21.15.29:3300/0 conn(0x7fc8840cc840 msgr2=0x7fc884155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc88ab9c700 1 --2- 172.21.15.12:0/3227439981 >> v2:172.21.15.29:3300/0 conn(0x7fc8840cc840 0x7fc884155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc88ab9c700 1 -- 172.21.15.12:0/3227439981 >> v1:172.21.15.29:6789/0 conn(0x7fc8840c7930 legacy=0x7fc88406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.663+0000 7fc889399700 1 -- 172.21.15.12:0/3227439981 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1820654746 0 0) 0x7fc88406b790 con 0x7fc8840c7930 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc88ab9c700 1 -- 172.21.15.12:0/3227439981 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88406b140 con 0x7fc8840ccce0 2023-10-08T16:21:47.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc88ab9c700 1 --2- 172.21.15.12:0/3227439981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009f20 tx=0x7fc87c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d35dba8b8f90b81f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:47.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc889399700 1 -- 172.21.15.12:0/3227439981 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c00e070 con 0x7fc8840ccce0 2023-10-08T16:21:47.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc889399700 1 -- 172.21.15.12:0/3227439981 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c00b9d0 con 0x7fc8840ccce0 2023-10-08T16:21:47.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.664+0000 7fc889399700 1 -- 172.21.15.12:0/3227439981 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0092e0 con 0x7fc8840ccce0 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 -- 172.21.15.12:0/3227439981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 msgr2=0x7fc88406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 --2- 172.21.15.12:0/3227439981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009f20 tx=0x7fc87c009840 comp rx=0 tx=0).stop 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 -- 172.21.15.12:0/3227439981 shutdown_connections 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 --2- 172.21.15.12:0/3227439981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840ccce0 0x7fc88406de50 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 --2- 172.21.15.12:0/3227439981 >> v2:172.21.15.29:3300/0 conn(0x7fc8840cc840 0x7fc884155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 -- 172.21.15.12:0/3227439981 >> 172.21.15.12:0/3227439981 conn(0x7fc88406d110 msgr2=0x7fc8840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 -- 172.21.15.12:0/3227439981 shutdown_connections 2023-10-08T16:21:47.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.665+0000 7fc88b39d700 1 -- 172.21.15.12:0/3227439981 wait complete. 2023-10-08T16:21:47.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.667+0000 7fc88b39d700 1 Processor -- start 2023-10-08T16:21:47.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.667+0000 7fc88b39d700 1 -- start start 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8840ccce0 0x7fc88416d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc884169980 con 0x7fc8840cc840 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc884158570 con 0x7fc8840ccce0 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88416de90 con 0x7fc8840c7930 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc889b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88a39b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc889b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39716/0 (socket says 172.21.15.12:39716) 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88a39b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39876/0 (socket says 172.21.15.12:39876) 2023-10-08T16:21:47.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc889b9a700 1 -- 172.21.15.12:0/852504565 learned_addr learned my addr 172.21.15.12:0/852504565 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:47.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88ab9c700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8840ccce0 0x7fc88416d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88a39b700 1 -- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8840ccce0 msgr2=0x7fc88416d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.668+0000 7fc88a39b700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8840ccce0 0x7fc88416d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88a39b700 1 -- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 msgr2=0x7fc88416cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88a39b700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88a39b700 1 -- 172.21.15.12:0/852504565 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c009ae0 con 0x7fc8840c7930 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc889b9a700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88a39b700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8800011e0 tx=0x7fc880007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:47.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880011590 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc880011710 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc88416a1c0 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880011ad0 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.669+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc884169e50 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.670+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc884169fe0 con 0x7fc8840c7930 2023-10-08T16:21:47.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.671+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 13) v1 ==== 84928+0+0 (secure 0 0 0) 0x7fc88001b3b0 con 0x7fc8840c7930 2023-10-08T16:21:47.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.672+0000 7fc87a7fc700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 0x7fc8680695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:47.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.672+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6451+0+0 (secure 0 0 0) 0x7fc880084080 con 0x7fc8840c7930 2023-10-08T16:21:47.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.672+0000 7fc889b9a700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 0x7fc8680695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:47.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.673+0000 7fc889b9a700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 0x7fc8680695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b240 tx=0x7fc874008040 comp rx=0 tx=0).ready entity=mgr.5208 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:47.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.678+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc880050ce0 con 0x7fc8840c7930 2023-10-08T16:21:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:47.937+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fc88404c3c0 con 0x7fc8840c7930 2023-10-08T16:21:48.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.683+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fc8800510b0 con 0x7fc8840c7930 2023-10-08T16:21:48.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.683+0000 7fc87a7fc700 1 -- 172.21.15.12:0/852504565 <== mon.2 v2:172.21.15.29:3301/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) v1 ==== 93+0+0 (secure 0 0 0) 0x7fc880048500 con 0x7fc8840c7930 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 msgr2=0x7fc8680695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 0x7fc8680695e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc87400b240 tx=0x7fc874008040 comp rx=0 tx=0).stop 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 msgr2=0x7fc8840c5a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8800011e0 tx=0x7fc880007d30 comp rx=0 tx=0).stop 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 shutdown_connections 2023-10-08T16:21:48.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc8840ccce0 0x7fc88416d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc8840c7930 0x7fc8840c5a80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fc868067130 0x7fc8680695e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 --2- 172.21.15.12:0/852504565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8840cc840 0x7fc88416cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 >> 172.21.15.12:0/852504565 conn(0x7fc88406d110 msgr2=0x7fc884153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 shutdown_connections 2023-10-08T16:21:48.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:48.686+0000 7fc88b39d700 1 -- 172.21.15.12:0/852504565 wait complete. 2023-10-08T16:21:48.746 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:21:48.747 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:21:48.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:21:48.905 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:21:48.906 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:21:48.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:21:48.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:21:48.998 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:21:48.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:21:48.999 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:21:49.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:21:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.284+0000 7f8da259d700 1 Processor -- start 2023-10-08T16:21:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.285+0000 7f8da259d700 1 -- start start 2023-10-08T16:21:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da259d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d9c140a70 0x7f8d9c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da259d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0c6d50 con 0x7f8d9c06de50 2023-10-08T16:21:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da259d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c0c7030 con 0x7f8d9c140e40 2023-10-08T16:21:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da259d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c0c7310 con 0x7f8d9c140a70 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da159b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8d9c140a70 0x7f8d9c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da1d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8d9c06de50 0x7f8d9c0aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41262/0 (socket says 172.21.15.12:41262) 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.286+0000 7f8da1d9c700 1 -- 172.21.15.12:0/1612782182 learned_addr learned my addr 172.21.15.12:0/1612782182 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8da159b700 1 -- 172.21.15.12:0/1612782182 >> v1:172.21.15.29:6789/0 conn(0x7f8d9c140e40 legacy=0x7f8d9c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8da159b700 1 -- 172.21.15.12:0/1612782182 >> v1:172.21.15.12:6789/0 conn(0x7f8d9c06de50 legacy=0x7f8d9c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8d93fff700 1 -- 172.21.15.12:0/1612782182 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237403099 0 0) 0x7f8d9c0c6d50 con 0x7f8d9c06de50 2023-10-08T16:21:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8da159b700 1 -- 172.21.15.12:0/1612782182 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0c75f0 con 0x7f8d9c140a70 2023-10-08T16:21:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8da159b700 1 --2- 172.21.15.12:0/1612782182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140a70 0x7f8d9c0c6770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d980098e0 tx=0x7f8d980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3400580735613e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.287+0000 7f8d93fff700 1 -- 172.21.15.12:0/1612782182 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98009e80 con 0x7f8d9c140a70 2023-10-08T16:21:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8d93fff700 1 -- 172.21.15.12:0/1612782182 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800b860 con 0x7f8d9c140a70 2023-10-08T16:21:49.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8d93fff700 1 -- 172.21.15.12:0/1612782182 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800bbe0 con 0x7f8d9c140a70 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 -- 172.21.15.12:0/1612782182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140a70 msgr2=0x7f8d9c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 --2- 172.21.15.12:0/1612782182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140a70 0x7f8d9c0c6770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f8d980098e0 tx=0x7f8d980091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 -- 172.21.15.12:0/1612782182 shutdown_connections 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 --2- 172.21.15.12:0/1612782182 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140a70 0x7f8d9c0c6770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 -- 172.21.15.12:0/1612782182 >> 172.21.15.12:0/1612782182 conn(0x7f8d9c06d170 msgr2=0x7f8d9c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 -- 172.21.15.12:0/1612782182 shutdown_connections 2023-10-08T16:21:49.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.288+0000 7f8da259d700 1 -- 172.21.15.12:0/1612782182 wait complete. 2023-10-08T16:21:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.290+0000 7f8da259d700 1 Processor -- start 2023-10-08T16:21:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.290+0000 7f8da259d700 1 -- start start 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d9c140a70 0x7f8d9c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0affc0 con 0x7f8d9c140e40 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c159b90 con 0x7f8d9c140a70 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c16ae80 con 0x7f8d9c06de50 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39898/0 (socket says 172.21.15.12:39898) 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da159b700 1 -- 172.21.15.12:0/1512828138 learned_addr learned my addr 172.21.15.12:0/1512828138 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39738/0 (socket says 172.21.15.12:39738) 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.291+0000 7f8da0d9a700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d9c140a70 0x7f8d9c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d9c140a70 msgr2=0x7f8d9c13e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d9c140a70 0x7f8d9c13e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 msgr2=0x7f8d9c0b0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 -- 172.21.15.12:0/1512828138 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009420 con 0x7f8d9c06de50 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da1d9c700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da159b700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c071320 tx=0x7f8d98017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:49.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800bbe0 con 0x7f8d9c06de50 2023-10-08T16:21:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98011420 con 0x7f8d9c06de50 2023-10-08T16:21:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c0af3b0 con 0x7f8d9c06de50 2023-10-08T16:21:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.292+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d980117e0 con 0x7f8d9c06de50 2023-10-08T16:21:49.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.293+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c0af970 con 0x7f8d9c06de50 2023-10-08T16:21:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.293+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c04c3c0 con 0x7f8d9c06de50 2023-10-08T16:21:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.294+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f8d98011b50 con 0x7f8d9c06de50 2023-10-08T16:21:49.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.295+0000 7f8d917fa700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 0x7f8d80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.295+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6387+0+0 (secure 0 0 0) 0x7f8d980865d0 con 0x7f8d9c06de50 2023-10-08T16:21:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.295+0000 7f8da0d9a700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 msgr2=0x7f8d80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:49.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.295+0000 7f8da0d9a700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 0x7f8d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:49.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.299+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d98053270 con 0x7f8d9c06de50 2023-10-08T16:21:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.496+0000 7f8da0d9a700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 msgr2=0x7f8d80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.496+0000 7f8da0d9a700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 0x7f8d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:49.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.573+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d9c0c78d0 con 0x7f8d9c06de50 2023-10-08T16:21:49.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.574+0000 7f8d917fa700 1 -- 172.21.15.12:0/1512828138 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f8d98056890 con 0x7f8d9c06de50 2023-10-08T16:21:49.575 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:49.575 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 msgr2=0x7f8d80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 0x7f8d80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 msgr2=0x7f8d9c16a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c071320 tx=0x7f8d98017000 comp rx=0 tx=0).stop 2023-10-08T16:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 shutdown_connections 2023-10-08T16:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f8d800670e0 0x7f8d80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8d9c140e40 0x7f8d9c0b0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8d9c06de50 0x7f8d9c16a940 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 --2- 172.21.15.12:0/1512828138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8d9c140a70 0x7f8d9c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 >> 172.21.15.12:0/1512828138 conn(0x7f8d9c06d170 msgr2=0x7f8d9c069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 shutdown_connections 2023-10-08T16:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.576+0000 7f8da259d700 1 -- 172.21.15.12:0/1512828138 wait complete. 2023-10-08T16:21:49.580 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:21:49.596 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:21:49.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.786+0000 7f1d8619d700 1 Processor -- start 2023-10-08T16:21:49.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.786+0000 7f1d8619d700 1 -- start start 2023-10-08T16:21:49.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8619d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1d8006f3a0 0x7f1d8014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8619d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d8006e470 0x7f1d801501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8619d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8006a490 con 0x7f1d8006e0a0 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8619d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d800c7230 con 0x7f1d8006e470 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8619d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8006b930 con 0x7f1d8006f3a0 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8519b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1d8006e0a0 0x7f1d800c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41264/0 (socket says 172.21.15.12:41264) 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8599c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d8006e470 0x7f1d801501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.787+0000 7f1d8519b700 1 -- 172.21.15.12:0/966957215 learned_addr learned my addr 172.21.15.12:0/966957215 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8499a700 1 --2- 172.21.15.12:0/966957215 >> v2:172.21.15.29:3300/0 conn(0x7f1d8006f3a0 0x7f1d8014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d77fff700 1 -- 172.21.15.12:0/966957215 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196095911 0 0) 0x7f1d8006a490 con 0x7f1d8006e0a0 2023-10-08T16:21:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d77fff700 1 -- 172.21.15.12:0/966957215 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d6c003570 con 0x7f1d8006e0a0 2023-10-08T16:21:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8599c700 1 -- 172.21.15.12:0/966957215 >> v2:172.21.15.29:3300/0 conn(0x7f1d8006f3a0 msgr2=0x7f1d8014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8599c700 1 --2- 172.21.15.12:0/966957215 >> v2:172.21.15.29:3300/0 conn(0x7f1d8006f3a0 0x7f1d8014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8599c700 1 -- 172.21.15.12:0/966957215 >> v1:172.21.15.12:6789/0 conn(0x7f1d8006e0a0 legacy=0x7f1d800c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8599c700 1 -- 172.21.15.12:0/966957215 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d800c7490 con 0x7f1d8006e470 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.788+0000 7f1d8599c700 1 --2- 172.21.15.12:0/966957215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d801501b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d80156140 tx=0x7f1d7800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4993e0b4f0bce564 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d77fff700 1 -- 172.21.15.12:0/966957215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800f070 con 0x7f1d8006e470 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d77fff700 1 -- 172.21.15.12:0/966957215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7800a2e0 con 0x7f1d8006e470 2023-10-08T16:21:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d77fff700 1 -- 172.21.15.12:0/966957215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7800cbc0 con 0x7f1d8006e470 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 -- 172.21.15.12:0/966957215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 msgr2=0x7f1d801501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 --2- 172.21.15.12:0/966957215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d801501b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f1d80156140 tx=0x7f1d7800a890 comp rx=0 tx=0).stop 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 -- 172.21.15.12:0/966957215 shutdown_connections 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 --2- 172.21.15.12:0/966957215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d801501b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 --2- 172.21.15.12:0/966957215 >> v2:172.21.15.29:3300/0 conn(0x7f1d8006f3a0 0x7f1d8014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 -- 172.21.15.12:0/966957215 >> 172.21.15.12:0/966957215 conn(0x7f1d8006d170 msgr2=0x7f1d800cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.789+0000 7f1d8619d700 1 -- 172.21.15.12:0/966957215 shutdown_connections 2023-10-08T16:21:49.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.790+0000 7f1d8619d700 1 -- 172.21.15.12:0/966957215 wait complete. 2023-10-08T16:21:49.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.791+0000 7f1d8619d700 1 Processor -- start 2023-10-08T16:21:49.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.791+0000 7f1d8619d700 1 -- start start 2023-10-08T16:21:49.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d8006e0a0 0x7f1d800b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8006f3a0 0x7f1d800afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d80156830 con 0x7f1d8006e470 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d800af220 con 0x7f1d8006f3a0 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8619d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8014a4b0 con 0x7f1d8006e0a0 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39762/0 (socket says 172.21.15.12:39762) 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8499a700 1 -- 172.21.15.12:0/2600302930 learned_addr learned my addr 172.21.15.12:0/2600302930 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8519b700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d8006e0a0 0x7f1d800b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.792+0000 7f1d8599c700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8006f3a0 0x7f1d800afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d8006e0a0 msgr2=0x7f1d800b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d8006e0a0 0x7f1d800b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8006f3a0 msgr2=0x7f1d800afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8006f3a0 0x7f1d800afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 -- 172.21.15.12:0/2600302930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7800ab30 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8499a700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000ea30 tx=0x7f1d70009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000ee70 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7000c850 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d801498c0 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7000cbd0 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.793+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8014a140 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.794+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d80149c90 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.795+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f1d70013470 con 0x7f1d8006e470 2023-10-08T16:21:49.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.796+0000 7f1d757fa700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 0x7f1d64069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.796+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6387+0+0 (secure 0 0 0) 0x7f1d700850b0 con 0x7f1d8006e470 2023-10-08T16:21:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.796+0000 7f1d8519b700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 msgr2=0x7f1d64069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.796+0000 7f1d8519b700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 0x7f1d64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:49.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.801+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d70051d50 con 0x7f1d8006e470 2023-10-08T16:21:49.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.997+0000 7f1d8519b700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 msgr2=0x7f1d64069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:49.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:49.997+0000 7f1d8519b700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 0x7f1d64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:50.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.003+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8004c3c0 con 0x7f1d8006e470 2023-10-08T16:21:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.004+0000 7f1d757fa700 1 -- 172.21.15.12:0/2600302930 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16433 (secure 0 0 0) 0x7f1d70017090 con 0x7f1d8006e470 2023-10-08T16:21:50.005 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:50.005 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":53,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:21:49.093284+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6833/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:6832/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3799372723":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3105973545":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/2568382938":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/1489576806":"2023-10-09T16:10:49.760609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":2,"length":2},{"begin":5,"length":3},{"begin":9,"length":7},{"begin":17,"length":4},{"begin":23,"length":4},{"begin":28,"length":4},{"begin":33,"length":4},{"begin":38,"length":5},{"begin":44,"length":4},{"begin":49,"length":5},{"begin":55,"length":4},{"begin":60,"length":5},{"begin":66,"length":4},{"begin":71,"length":5},{"begin":77,"length":10},{"begin":88,"length":9},{"begin":98,"length":8},{"begin":108,"length":4},{"begin":123,"length":98}]}],"new_removed_snaps":[{"pool":5,"snaps":[{"begin":53,"length":1},{"begin":64,"length":1},{"begin":75,"length":1},{"begin":86,"length":1},{"begin":96,"length":1},{"begin":216,"length":5}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 msgr2=0x7f1d64069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 0x7f1d64069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 msgr2=0x7f1d80157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000ea30 tx=0x7f1d70009120 comp rx=0 tx=0).stop 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 shutdown_connections 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d8006f3a0 0x7f1d800afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d8006e0a0 0x7f1d800b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f1d640670e0 0x7f1d64069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 --2- 172.21.15.12:0/2600302930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d8006e470 0x7f1d80157640 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 >> 172.21.15.12:0/2600302930 conn(0x7f1d8006d170 msgr2=0x7f1d80154b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:50.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 shutdown_connections 2023-10-08T16:21:50.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.006+0000 7f1d8619d700 1 -- 172.21.15.12:0/2600302930 wait complete. 2023-10-08T16:21:50.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:10:26.454842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:10:27.620750+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 220, 'snap_epoch': 53, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:21:50.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:21:50.056 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.056+0000 7fafff49f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:21:50.084 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.083+0000 7f496b571180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:21:50.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.227+0000 7f5a4259d700 1 Processor -- start 2023-10-08T16:21:50.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.228+0000 7f5a4259d700 1 -- start start 2023-10-08T16:21:50.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4259d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3c0acc00 con 0x7f5a3c159920 2023-10-08T16:21:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3c0abff0 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c0ac2d0 con 0x7f5a3c159550 2023-10-08T16:21:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a40d9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a41d9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f5a3c159920 0x7f5a3c0ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:54892/0 (socket says 172.21.15.12:54892) 2023-10-08T16:21:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a4159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39928/0 (socket says 172.21.15.12:39928) 2023-10-08T16:21:50.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a40d9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47116/0 (socket says 172.21.15.12:47116) 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.229+0000 7f5a41d9c700 1 -- 172.21.15.12:0/4192212 learned_addr learned my addr 172.21.15.12:0/4192212 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a40d9a700 1 -- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 msgr2=0x7f5a3c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a40d9a700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a40d9a700 1 -- 172.21.15.12:0/4192212 >> v1:172.21.15.29:6789/0 conn(0x7f5a3c159920 legacy=0x7f5a3c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a40d9a700 1 -- 172.21.15.12:0/4192212 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3c0ac5b0 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a4159b700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a40d9a700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0098e0 tx=0x7f5a2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc9d43871f06fc65 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a33fff700 1 -- 172.21.15.12:0/4192212 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00b640 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.230+0000 7f5a33fff700 1 -- 172.21.15.12:0/4192212 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00b7a0 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a33fff700 1 -- 172.21.15.12:0/4192212 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00bb40 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 -- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c15dfd0 msgr2=0x7f5a3c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c0098e0 tx=0x7f5a2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 -- 172.21.15.12:0/4192212 shutdown_connections 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c159550 0x7f5a3c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 --2- 172.21.15.12:0/4192212 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c15dfd0 0x7f5a3c0aedb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 -- 172.21.15.12:0/4192212 >> 172.21.15.12:0/4192212 conn(0x7f5a3c06ce80 msgr2=0x7f5a3c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 -- 172.21.15.12:0/4192212 shutdown_connections 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.231+0000 7f5a4259d700 1 -- 172.21.15.12:0/4192212 wait complete. 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.233+0000 7f5a4259d700 1 Processor -- start 2023-10-08T16:21:50.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.233+0000 7f5a4259d700 1 -- start start 2023-10-08T16:21:50.239 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.235+0000 7fafff49f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 0x7f5a3c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c15dfd0 0x7f5a3c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c156c00 con 0x7f5a3c159920 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c156030 con 0x7f5a3c159550 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3c1562d0 con 0x7f5a3c15dfd0 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a40d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 0x7f5a3c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a40d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39778/0 (socket says 172.21.15.12:39778) 2023-10-08T16:21:50.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a40d9a700 1 -- 172.21.15.12:0/403209904 learned_addr learned my addr 172.21.15.12:0/403209904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a41d9c700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c15dfd0 0x7f5a3c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c15dfd0 msgr2=0x7f5a3c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c15dfd0 0x7f5a3c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 msgr2=0x7f5a3c1579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a4159b700 1 -- 172.21.15.12:0/403209904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a38009420 con 0x7f5a3c159550 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.234+0000 7f5a40d9a700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a4159b700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 0x7f5a3c153140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ea00 tx=0x7f5a380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800c6a0 con 0x7f5a3c159550 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800c800 con 0x7f5a3c159550 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a2c009420 con 0x7f5a3c159550 2023-10-08T16:21:50.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800cba0 con 0x7f5a3c159550 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.235+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3c156890 con 0x7f5a3c159550 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.236+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3c04c3c0 con 0x7f5a3c159550 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.237+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f5a38013470 con 0x7f5a3c159550 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.238+0000 7f5a317fa700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 0x7f5a20069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.238+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f5a38084d60 con 0x7f5a3c159550 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.238+0000 7f5a40d9a700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 msgr2=0x7f5a20069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.238+0000 7f5a40d9a700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 0x7f5a20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:50.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.243+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a38051a40 con 0x7f5a3c159550 2023-10-08T16:21:50.270 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.269+0000 7f496b571180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:21:50.328 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.328+0000 7fafff49f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:21:50.359 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.358+0000 7f496b571180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.439+0000 7f5a40d9a700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 msgr2=0x7f5a20069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:50.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.439+0000 7f5a40d9a700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 0x7f5a20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.452+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a3c06e7c0 con 0x7f5a3c159550 2023-10-08T16:21:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.453+0000 7f5a317fa700 1 -- 172.21.15.12:0/403209904 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a38055060 con 0x7f5a3c159550 2023-10-08T16:21:50.453 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:21:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 msgr2=0x7f5a20069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 0x7f5a20069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 msgr2=0x7f5a3c153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 0x7f5a3c153140 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5a3800ea00 tx=0x7f5a380091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 shutdown_connections 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a3c15dfd0 0x7f5a3c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a3c159550 0x7f5a3c153140 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f5a200670e0 0x7f5a20069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 --2- 172.21.15.12:0/403209904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3c159920 0x7f5a3c1579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 >> 172.21.15.12:0/403209904 conn(0x7f5a3c06ce80 msgr2=0x7f5a3c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 shutdown_connections 2023-10-08T16:21:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.455+0000 7f5a4259d700 1 -- 172.21.15.12:0/403209904 wait complete. 2023-10-08T16:21:50.474 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:21:50.559 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.559+0000 7fafff49f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:21:50.594 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.594+0000 7f496b571180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:21:50.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.665+0000 7f2267bff700 1 Processor -- start 2023-10-08T16:21:50.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.665+0000 7f2267bff700 1 -- start start 2023-10-08T16:21:50.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.666+0000 7f2267bff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2260159530 0x7f22600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f2267bff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600ccfd0 con 0x7f226006dc70 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f2267bff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22600cf0e0 con 0x7f226006e0e0 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f2267bff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226015a3d0 con 0x7f2260159530 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2260159530 0x7f22600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2260159530 0x7f22600ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39794/0 (socket says 172.21.15.12:39794) 2023-10-08T16:21:50.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 -- 172.21.15.12:0/2692513692 learned_addr learned my addr 172.21.15.12:0/2692513692 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 -- 172.21.15.12:0/2692513692 >> v1:172.21.15.29:6789/0 conn(0x7f226006e0e0 legacy=0x7f22600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 -- 172.21.15.12:0/2692513692 >> v1:172.21.15.12:6789/0 conn(0x7f226006dc70 legacy=0x7f2260159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.667+0000 7f226599b700 1 -- 172.21.15.12:0/2692513692 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226015a6b0 con 0x7f2260159530 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f226599b700 1 --2- 172.21.15.12:0/2692513692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2260159530 0x7f22600ceba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f225c0099b0 tx=0x7f225c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943c18de1a1b2dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f2264999700 1 -- 172.21.15.12:0/2692513692 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00b860 con 0x7f2260159530 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f2264999700 1 -- 172.21.15.12:0/2692513692 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c00b9c0 con 0x7f2260159530 2023-10-08T16:21:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f2264999700 1 -- 172.21.15.12:0/2692513692 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00bd60 con 0x7f2260159530 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f2267bff700 1 -- 172.21.15.12:0/2692513692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2260159530 msgr2=0x7f22600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.668+0000 7f2267bff700 1 --2- 172.21.15.12:0/2692513692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2260159530 0x7f22600ceba0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f225c0099b0 tx=0x7f225c009250 comp rx=0 tx=0).stop 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.669+0000 7f2267bff700 1 -- 172.21.15.12:0/2692513692 shutdown_connections 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.669+0000 7f2267bff700 1 --2- 172.21.15.12:0/2692513692 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2260159530 0x7f22600ceba0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.669+0000 7f2267bff700 1 -- 172.21.15.12:0/2692513692 >> 172.21.15.12:0/2692513692 conn(0x7f22600703a0 msgr2=0x7f22600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.669+0000 7f2267bff700 1 -- 172.21.15.12:0/2692513692 shutdown_connections 2023-10-08T16:21:50.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.669+0000 7f2267bff700 1 -- 172.21.15.12:0/2692513692 wait complete. 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.670+0000 7f2267bff700 1 Processor -- start 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.671+0000 7f2267bff700 1 -- start start 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.671+0000 7f2267bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.671+0000 7f2267bff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226006e0e0 0x7f22600c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f2267bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 0x7f2260147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f2267bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600c7790 con 0x7f226006dc70 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f2267bff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22600b6580 con 0x7f226006e0e0 2023-10-08T16:21:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f2267bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226016d960 con 0x7f2260159530 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39804/0 (socket says 172.21.15.12:39804) 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 -- 172.21.15.12:0/2629736602 learned_addr learned my addr 172.21.15.12:0/2629736602 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226519a700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226006e0e0 0x7f22600c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226619c700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 0x7f2260147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 msgr2=0x7f2260147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 0x7f2260147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226006e0e0 msgr2=0x7f22600c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226006e0e0 0x7f22600c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226599b700 1 -- 172.21.15.12:0/2629736602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0094f0 con 0x7f226006dc70 2023-10-08T16:21:50.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.672+0000 7f226619c700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 0x7f2260147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:50.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f226599b700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f225c0094c0 tx=0x7f225c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c024440 con 0x7f226006dc70 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c0245a0 con 0x7f226006dc70 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c024960 con 0x7f226006dc70 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226016dc40 con 0x7f226006dc70 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.673+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226016e280 con 0x7f226006dc70 2023-10-08T16:21:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.674+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22600c9130 con 0x7f226006dc70 2023-10-08T16:21:50.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.676+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f225c01a420 con 0x7f226006dc70 2023-10-08T16:21:50.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.677+0000 7f2255ffb700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 0x7f22440695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:50.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.677+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6323+0+0 (secure 0 0 0) 0x7f225c086840 con 0x7f226006dc70 2023-10-08T16:21:50.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.677+0000 7f226519a700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 msgr2=0x7f22440695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:50.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.677+0000 7f226519a700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 0x7f22440695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:50.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.681+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f225c0535c0 con 0x7f226006dc70 2023-10-08T16:21:50.744 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.744+0000 7fafff49f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:21:50.784 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.783+0000 7f496b571180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:21:50.839 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:50.839+0000 7fafff49f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.878+0000 7f226519a700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 msgr2=0x7f22440695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.878+0000 7f226519a700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 0x7f22440695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:50.879 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:50.878+0000 7f496b571180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:21:50.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.883+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f226004c3c0 con 0x7f226006dc70 2023-10-08T16:21:50.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.883+0000 7f2255ffb700 1 -- 172.21.15.12:0/2629736602 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f225c056be0 con 0x7f226006dc70 2023-10-08T16:21:50.884 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.885+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 msgr2=0x7f22440695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 0x7f22440695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 msgr2=0x7f22600b6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f225c0094c0 tx=0x7f225c017000 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 shutdown_connections 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2244067110 0x7f22440695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f226006dc70 0x7f22600b6040 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2260159530 0x7f2260147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 --2- 172.21.15.12:0/2629736602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f226006e0e0 0x7f22600c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 >> 172.21.15.12:0/2629736602 conn(0x7f22600703a0 msgr2=0x7f22600d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 shutdown_connections 2023-10-08T16:21:50.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:50.886+0000 7f2267bff700 1 -- 172.21.15.12:0/2629736602 wait complete. 2023-10-08T16:21:50.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:21:51.005 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:51.005+0000 7fafff49f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:21:51.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:51.048+0000 7f496b571180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:21:51.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.104+0000 7f59409fe700 1 Processor -- start 2023-10-08T16:21:51.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.104+0000 7f59409fe700 1 -- start start 2023-10-08T16:21:51.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.105+0000 7f59409fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 0x7f593c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.105+0000 7f59409fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f593c0caec0 0x7f593c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.105+0000 7f59409fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c15ada0 con 0x7f593c06db20 2023-10-08T16:21:51.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f59409fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c06ca80 con 0x7f593c0caec0 2023-10-08T16:21:51.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f59409fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c06cd60 con 0x7f593c153c90 2023-10-08T16:21:51.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f593c06db20 0x7f593c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41290/0 (socket says 172.21.15.12:41290) 2023-10-08T16:21:51.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593a59c700 1 -- 172.21.15.12:0/1035292103 learned_addr learned my addr 172.21.15.12:0/1035292103 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:51.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1035292103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 0x7f593c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593b59e700 1 --2- 172.21.15.12:0/1035292103 >> v2:172.21.15.29:3300/0 conn(0x7f593c0caec0 0x7f593c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593ad9d700 1 -- 172.21.15.12:0/1035292103 >> v2:172.21.15.29:3300/0 conn(0x7f593c0caec0 msgr2=0x7f593c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1035292103 >> v2:172.21.15.29:3300/0 conn(0x7f593c0caec0 0x7f593c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593ad9d700 1 -- 172.21.15.12:0/1035292103 >> v1:172.21.15.12:6789/0 conn(0x7f593c06db20 legacy=0x7f593c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f593ad9d700 1 -- 172.21.15.12:0/1035292103 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c06d040 con 0x7f593c153c90 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.106+0000 7f5939d9b700 1 -- 172.21.15.12:0/1035292103 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776901741 0 0) 0x7f5930001110 con 0x7f593c06db20 2023-10-08T16:21:51.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.107+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1035292103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 0x7f593c15a860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f592c0098e0 tx=0x7f592c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5503ccb58502a70 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.107+0000 7f5939d9b700 1 -- 172.21.15.12:0/1035292103 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00b640 con 0x7f593c153c90 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.107+0000 7f5939d9b700 1 -- 172.21.15.12:0/1035292103 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c00b7a0 con 0x7f593c153c90 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.107+0000 7f5939d9b700 1 -- 172.21.15.12:0/1035292103 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c00bb40 con 0x7f593c153c90 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.107+0000 7f59409fe700 1 -- 172.21.15.12:0/1035292103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 msgr2=0x7f593c15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 --2- 172.21.15.12:0/1035292103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 0x7f593c15a860 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f592c0098e0 tx=0x7f592c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 -- 172.21.15.12:0/1035292103 shutdown_connections 2023-10-08T16:21:51.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 --2- 172.21.15.12:0/1035292103 >> v2:172.21.15.29:3300/0 conn(0x7f593c0caec0 0x7f593c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 --2- 172.21.15.12:0/1035292103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c153c90 0x7f593c15a860 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 -- 172.21.15.12:0/1035292103 >> 172.21.15.12:0/1035292103 conn(0x7f593c06e720 msgr2=0x7f593c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:51.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 -- 172.21.15.12:0/1035292103 shutdown_connections 2023-10-08T16:21:51.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.108+0000 7f59409fe700 1 -- 172.21.15.12:0/1035292103 wait complete. 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.109+0000 7f59409fe700 1 Processor -- start 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.109+0000 7f59409fe700 1 -- start start 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f593c153c90 0x7f593c16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c4090 con 0x7f593c0caec0 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c4a60 con 0x7f593c153c90 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.110+0000 7f59409fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0c3a80 con 0x7f593c06db20 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593ad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593ad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:39974/0 (socket says 172.21.15.12:39974) 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39820/0 (socket says 172.21.15.12:39820) 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593ad9d700 1 -- 172.21.15.12:0/1115954042 learned_addr learned my addr 172.21.15.12:0/1115954042 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593b59e700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f593c153c90 0x7f593c16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 msgr2=0x7f593c0c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f593c153c90 msgr2=0x7f593c16d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f593c153c90 0x7f593c16d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 -- 172.21.15.12:0/1115954042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c009420 con 0x7f593c0caec0 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.111+0000 7f593a59c700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f593000c4c0 tx=0x7f5930007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:51.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.112+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000ce70 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.112+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930005b30 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.112+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c16e020 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.112+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59300070d0 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.112+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c16e3b0 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.113+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c0c4240 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.114+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f59300074c0 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.115+0000 7f5922ffd700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 0x7f5928069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.115+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f5930083de0 con 0x7f593c0caec0 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.115+0000 7f593ad9d700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 msgr2=0x7f5928069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:51.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.115+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 0x7f5928069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:51.121 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:51.115+0000 7fafff49f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:21:51.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.120+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f593c0c4240 con 0x7f593c0caec0 2023-10-08T16:21:51.158 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:51.157+0000 7f496b571180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:21:51.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.316+0000 7f593ad9d700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 msgr2=0x7f5928069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:51.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.316+0000 7f593ad9d700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 0x7f5928069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.324+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f593c15ada0 con 0x7f593c0caec0 2023-10-08T16:21:51.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.324+0000 7f5922ffd700 1 -- 172.21.15.12:0/1115954042 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f593c15ada0 con 0x7f593c0caec0 2023-10-08T16:21:51.326 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:21:51.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 msgr2=0x7f5928069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 0x7f5928069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 msgr2=0x7f593c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f593000c4c0 tx=0x7f5930007f50 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 shutdown_connections 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f593c153c90 0x7f593c16d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f593c06db20 0x7f593c0c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f59280670e0 0x7f5928069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 --2- 172.21.15.12:0/1115954042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f593c0caec0 0x7f593c152650 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 >> 172.21.15.12:0/1115954042 conn(0x7f593c06e720 msgr2=0x7f593c1531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 shutdown_connections 2023-10-08T16:21:51.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.327+0000 7f59409fe700 1 -- 172.21.15.12:0/1115954042 wait complete. 2023-10-08T16:21:51.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:21:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.543+0000 7f12089fe700 1 Processor -- start 2023-10-08T16:21:51.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.543+0000 7f12089fe700 1 -- start start 2023-10-08T16:21:51.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f12089fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1204153c30 0x7f120415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f12089fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f12040cf110 0x7f120415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f12089fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120415afd0 con 0x7f120415de50 2023-10-08T16:21:51.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f12089fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120415b2b0 con 0x7f1204153c30 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f12089fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120415b590 con 0x7f12040cf110 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f1202d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1204153c30 0x7f120415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f120259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f120415de50 0x7f12040cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41296/0 (socket says 172.21.15.12:41296) 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f1202d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1204153c30 0x7f120415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39828/0 (socket says 172.21.15.12:39828) 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f120259c700 1 -- 172.21.15.12:0/3701199007 learned_addr learned my addr 172.21.15.12:0/3701199007 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:51.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f120359e700 1 --2- 172.21.15.12:0/3701199007 >> v2:172.21.15.29:3300/0 conn(0x7f12040cf110 0x7f120415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f1202d9d700 1 -- 172.21.15.12:0/3701199007 >> v2:172.21.15.29:3300/0 conn(0x7f12040cf110 msgr2=0x7f120415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1202d9d700 1 --2- 172.21.15.12:0/3701199007 >> v2:172.21.15.29:3300/0 conn(0x7f12040cf110 0x7f120415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1202d9d700 1 -- 172.21.15.12:0/3701199007 >> v1:172.21.15.12:6789/0 conn(0x7f120415de50 legacy=0x7f12040cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.545+0000 7f1201d9b700 1 -- 172.21.15.12:0/3701199007 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647182636 0 0) 0x7f120415afd0 con 0x7f120415de50 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1202d9d700 1 -- 172.21.15.12:0/3701199007 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120415b870 con 0x7f1204153c30 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1202d9d700 1 --2- 172.21.15.12:0/3701199007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1204153c30 0x7f120415a5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f12040cdab0 tx=0x7f11f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243caf77075545de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1201d9b700 1 -- 172.21.15.12:0/3701199007 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4011630 con 0x7f1204153c30 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1201d9b700 1 -- 172.21.15.12:0/3701199007 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f4011790 con 0x7f1204153c30 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.546+0000 7f1201d9b700 1 -- 172.21.15.12:0/3701199007 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f4011b30 con 0x7f1204153c30 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 -- 172.21.15.12:0/3701199007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1204153c30 msgr2=0x7f120415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 --2- 172.21.15.12:0/3701199007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1204153c30 0x7f120415a5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f12040cdab0 tx=0x7f11f40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 -- 172.21.15.12:0/3701199007 shutdown_connections 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 --2- 172.21.15.12:0/3701199007 >> v2:172.21.15.29:3300/0 conn(0x7f12040cf110 0x7f120415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 --2- 172.21.15.12:0/3701199007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1204153c30 0x7f120415a5e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 -- 172.21.15.12:0/3701199007 >> 172.21.15.12:0/3701199007 conn(0x7f12040703a0 msgr2=0x7f12040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 -- 172.21.15.12:0/3701199007 shutdown_connections 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.547+0000 7f12089fe700 1 -- 172.21.15.12:0/3701199007 wait complete. 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.548+0000 7f12089fe700 1 Processor -- start 2023-10-08T16:21:51.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.548+0000 7f12089fe700 1 -- start start 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 0x7f12040c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1204153c30 0x7f12040b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c8d90 con 0x7f120415de50 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c9070 con 0x7f12040cf110 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f12089fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12040c9350 con 0x7f1204153c30 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.549+0000 7f120359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39836/0 (socket says 172.21.15.12:39836) 2023-10-08T16:21:51.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 -- 172.21.15.12:0/1739281522 learned_addr learned my addr 172.21.15.12:0/1739281522 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120259c700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1204153c30 0x7f12040b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f1202d9d700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 0x7f12040c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1204153c30 msgr2=0x7f12040b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1204153c30 0x7f12040b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 msgr2=0x7f12040c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 0x7f12040c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 -- 172.21.15.12:0/1739281522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4009420 con 0x7f120415de50 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f1202d9d700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 0x7f12040c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f120359e700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009e90 tx=0x7f11fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00cc20 con 0x7f120415de50 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.550+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00f040 con 0x7f120415de50 2023-10-08T16:21:51.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.551+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc014480 con 0x7f120415de50 2023-10-08T16:21:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.551+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12040c9630 con 0x7f120415de50 2023-10-08T16:21:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.551+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12040ca370 con 0x7f120415de50 2023-10-08T16:21:51.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.552+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120404c3c0 con 0x7f120415de50 2023-10-08T16:21:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.553+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f11fc014830 con 0x7f120415de50 2023-10-08T16:21:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.554+0000 7f11eaffd700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 0x7f11f0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.554+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f11fc0857b0 con 0x7f120415de50 2023-10-08T16:21:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.554+0000 7f1202d9d700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 msgr2=0x7f11f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:51.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.554+0000 7f1202d9d700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 0x7f11f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:51.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.558+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11fc055d40 con 0x7f120415de50 2023-10-08T16:21:51.620 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:51.620+0000 7fafff49f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:21:51.675 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:51.675+0000 7f496b571180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:21:51.717 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:51.717+0000 7fafff49f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:21:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.755+0000 7f1202d9d700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 msgr2=0x7f11f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:51.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.755+0000 7f1202d9d700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 0x7f11f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:51.774 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:51.773+0000 7f496b571180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:21:51.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.809+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f120415bb50 con 0x7f120415de50 2023-10-08T16:21:51.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.810+0000 7f11eaffd700 1 -- 172.21.15.12:0/1739281522 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f11fc0558d0 con 0x7f120415de50 2023-10-08T16:21:51.810 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:51.810 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:21:51.811 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:51.812+0000 7fafff49f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:21:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 msgr2=0x7f11f0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 0x7f11f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 msgr2=0x7f1204152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009e90 tx=0x7f11fc00b040 comp rx=0 tx=0).stop 2023-10-08T16:21:51.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 shutdown_connections 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f11f00670e0 0x7f11f0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f120415de50 0x7f1204152f60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12040cf110 0x7f12040c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 --2- 172.21.15.12:0/1739281522 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1204153c30 0x7f12040b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 >> 172.21.15.12:0/1739281522 conn(0x7f12040703a0 msgr2=0x7f12040d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 shutdown_connections 2023-10-08T16:21:51.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:51.812+0000 7f12089fe700 1 -- 172.21.15.12:0/1739281522 wait complete. 2023-10-08T16:21:51.815 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:21:51.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:21:51.871 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:51.870+0000 7f496b571180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:21:52.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.021+0000 7fe89999d700 1 Processor -- start 2023-10-08T16:21:52.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.021+0000 7fe89999d700 1 -- start start 2023-10-08T16:21:52.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe89415dfd0 0x7fe8940aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89999d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940acc00 con 0x7fe894159550 2023-10-08T16:21:52.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8940abff0 con 0x7fe894159920 2023-10-08T16:21:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940ac2d0 con 0x7fe89415dfd0 2023-10-08T16:21:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89899b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe894159550 0x7fe8940ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41308/0 (socket says 172.21.15.12:41308) 2023-10-08T16:21:52.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe89899b700 1 -- 172.21.15.12:0/3260906414 learned_addr learned my addr 172.21.15.12:0/3260906414 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe893fff700 1 --2- 172.21.15.12:0/3260906414 >> v2:172.21.15.29:3300/0 conn(0x7fe89415dfd0 0x7fe8940aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772409515 0 0) 0x7fe8940acc00 con 0x7fe894159550 2023-10-08T16:21:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe884003570 con 0x7fe894159550 2023-10-08T16:21:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540271315 0 0) 0x7fe8940abff0 con 0x7fe894159920 2023-10-08T16:21:52.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.023+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8940acc00 con 0x7fe894159920 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038655602 0 0) 0x7fe884003570 con 0x7fe894159550 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe893fff700 1 -- 172.21.15.12:0/3260906414 >> v1:172.21.15.29:6789/0 conn(0x7fe894159920 legacy=0x7fe8940ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe893fff700 1 -- 172.21.15.12:0/3260906414 >> v1:172.21.15.12:6789/0 conn(0x7fe894159550 legacy=0x7fe8940ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe893fff700 1 -- 172.21.15.12:0/3260906414 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940ac5b0 con 0x7fe89415dfd0 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe893fff700 1 --2- 172.21.15.12:0/3260906414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe89415dfd0 0x7fe8940aedb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8800098e0 tx=0x7fe8800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60dc9ceb64134887 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe888001470 con 0x7fe89415dfd0 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe880011420 con 0x7fe89415dfd0 2023-10-08T16:21:52.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.024+0000 7fe8937fe700 1 -- 172.21.15.12:0/3260906414 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8800117c0 con 0x7fe89415dfd0 2023-10-08T16:21:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 -- 172.21.15.12:0/3260906414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe89415dfd0 msgr2=0x7fe8940aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 --2- 172.21.15.12:0/3260906414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe89415dfd0 0x7fe8940aedb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe8800098e0 tx=0x7fe8800091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 -- 172.21.15.12:0/3260906414 shutdown_connections 2023-10-08T16:21:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 --2- 172.21.15.12:0/3260906414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe89415dfd0 0x7fe8940aedb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 -- 172.21.15.12:0/3260906414 >> 172.21.15.12:0/3260906414 conn(0x7fe89406ce80 msgr2=0x7fe8940ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 -- 172.21.15.12:0/3260906414 shutdown_connections 2023-10-08T16:21:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.025+0000 7fe89999d700 1 -- 172.21.15.12:0/3260906414 wait complete. 2023-10-08T16:21:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.027+0000 7fe89999d700 1 Processor -- start 2023-10-08T16:21:52.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.027+0000 7fe89999d700 1 -- start start 2023-10-08T16:21:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe894159550 0x7fe8940ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe894159920 0x7fe89406e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89414e710 con 0x7fe89415dfd0 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89414db40 con 0x7fe894159920 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89414dde0 con 0x7fe894159550 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89899b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe894159550 0x7fe8940ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39842/0 (socket says 172.21.15.12:39842) 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 -- 172.21.15.12:0/2714935976 learned_addr learned my addr 172.21.15.12:0/2714935976 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe893fff700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe894159920 0x7fe89406e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe894159550 msgr2=0x7fe8940ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe894159550 0x7fe8940ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe894159920 msgr2=0x7fe89406e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe894159920 0x7fe89406e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.028+0000 7fe89919c700 1 -- 172.21.15.12:0/2714935976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe880009420 con 0x7fe89415dfd0 2023-10-08T16:21:52.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe89919c700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c910 tx=0x7fe88c0027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012630 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c0127b0 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012b70 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89414e0c0 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.029+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89414eba0 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.030+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89404c3c0 con 0x7fe89415dfd0 2023-10-08T16:21:52.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.031+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7fe88c01b400 con 0x7fe89415dfd0 2023-10-08T16:21:52.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.032+0000 7fe890ff9700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 0x7fe878069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.032+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fe88c0850d0 con 0x7fe89415dfd0 2023-10-08T16:21:52.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.032+0000 7fe89899b700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 msgr2=0x7fe878069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:52.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.032+0000 7fe89899b700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 0x7fe878069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:52.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.040+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe88c051c40 con 0x7fe89415dfd0 2023-10-08T16:21:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.233+0000 7fe89899b700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 msgr2=0x7fe878069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.233+0000 7fe89899b700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 0x7fe878069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:52.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.244+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe894153290 con 0x7fe89415dfd0 2023-10-08T16:21:52.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.247+0000 7fe890ff9700 1 -- 172.21.15.12:0/2714935976 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16891 (secure 0 0 0) 0x7fe88c016090 con 0x7fe89415dfd0 2023-10-08T16:21:52.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:52.247 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:21:51.077167+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6833/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:6832/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3799372723":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3105973545":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/2568382938":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/1489576806":"2023-10-09T16:10:49.760609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":2},{"begin":9,"length":6},{"begin":17,"length":3},{"begin":23,"length":3},{"begin":28,"length":3},{"begin":33,"length":3},{"begin":38,"length":3},{"begin":44,"length":3},{"begin":49,"length":4},{"begin":55,"length":3},{"begin":60,"length":4},{"begin":66,"length":3},{"begin":71,"length":4},{"begin":77,"length":3},{"begin":81,"length":4},{"begin":88,"length":3},{"begin":92,"length":3},{"begin":98,"length":3},{"begin":102,"length":3},{"begin":108,"length":3},{"begin":123,"length":74}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:21:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 msgr2=0x7fe878069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 0x7fe878069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 msgr2=0x7fe89406ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00c910 tx=0x7fe88c0027a0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 shutdown_connections 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7fe8780670e0 0x7fe878069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe89415dfd0 0x7fe89406ef20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe894159550 0x7fe8940ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 --2- 172.21.15.12:0/2714935976 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe894159920 0x7fe89406e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 >> 172.21.15.12:0/2714935976 conn(0x7fe89406ce80 msgr2=0x7fe8940af730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:52.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.248+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 shutdown_connections 2023-10-08T16:21:52.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.250+0000 7fe89999d700 1 -- 172.21.15.12:0/2714935976 wait complete. 2023-10-08T16:21:52.268 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:21:52.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:21:52.461 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:52.461+0000 7fafff49f180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:21:52.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.527+0000 7f6aa199d700 1 Processor -- start 2023-10-08T16:21:52.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.527+0000 7f6aa199d700 1 -- start start 2023-10-08T16:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.528+0000 7f6aa199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 0x7f6a9c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.528+0000 7f6aa199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a9c0cef40 0x7f6a9c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.528+0000 7f6aa199d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c15afd0 con 0x7f6a9c153c30 2023-10-08T16:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.528+0000 7f6aa199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c15b2b0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.528+0000 7f6aa199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c15b590 con 0x7f6a9c15de50 2023-10-08T16:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6a9bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 0x7f6a9c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa099b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f6a9c153c30 0x7f6a9c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:37256/0 (socket says 172.21.15.12:37256) 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa099b700 1 -- 172.21.15.12:0/243996917 learned_addr learned my addr 172.21.15.12:0/243996917 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa119c700 1 --2- 172.21.15.12:0/243996917 >> v2:172.21.15.29:3300/0 conn(0x7f6a9c0cef40 0x7f6a9c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6a9b7fe700 1 -- 172.21.15.12:0/243996917 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818987318 0 0) 0x7f6a9c15afd0 con 0x7f6a9c153c30 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6a9b7fe700 1 -- 172.21.15.12:0/243996917 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a8c003570 con 0x7f6a9c153c30 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa119c700 1 -- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 msgr2=0x7f6a9c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa119c700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 0x7f6a9c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa119c700 1 -- 172.21.15.12:0/243996917 >> v1:172.21.15.29:6789/0 conn(0x7f6a9c153c30 legacy=0x7f6a9c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6aa119c700 1 -- 172.21.15.12:0/243996917 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c15b870 con 0x7f6a9c0cef40 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.529+0000 7f6a9bfff700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 0x7f6a9c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:52.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa119c700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c0cef40 0x7f6a9c15c070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009e60 tx=0x7f6a94009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=940891072cb2e469 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6a9b7fe700 1 -- 172.21.15.12:0/243996917 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400e070 con 0x7f6a9c0cef40 2023-10-08T16:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6a9b7fe700 1 -- 172.21.15.12:0/243996917 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400bab0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6a9b7fe700 1 -- 172.21.15.12:0/243996917 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400be70 con 0x7f6a9c0cef40 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 -- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c0cef40 msgr2=0x7f6a9c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c0cef40 0x7f6a9c15c070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009e60 tx=0x7f6a94009780 comp rx=0 tx=0).stop 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 -- 172.21.15.12:0/243996917 shutdown_connections 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c0cef40 0x7f6a9c15c070 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 --2- 172.21.15.12:0/243996917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c15de50 0x7f6a9c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 -- 172.21.15.12:0/243996917 >> 172.21.15.12:0/243996917 conn(0x7f6a9c0703a0 msgr2=0x7f6a9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 -- 172.21.15.12:0/243996917 shutdown_connections 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.530+0000 7f6aa199d700 1 -- 172.21.15.12:0/243996917 wait complete. 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.532+0000 7f6aa199d700 1 Processor -- start 2023-10-08T16:21:52.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.532+0000 7f6aa199d700 1 -- start start 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 0x7f6a9c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c15de50 0x7f6a9c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cc120 con 0x7f6a9c153c30 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cb110 con 0x7f6a9c15de50 2023-10-08T16:21:52.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0cbc90 con 0x7f6a9c0cef40 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6a9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa099b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 0x7f6a9c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6a9bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48652/0 (socket says 172.21.15.12:48652) 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6a9bfff700 1 -- 172.21.15.12:0/3282056302 learned_addr learned my addr 172.21.15.12:0/3282056302 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.533+0000 7f6aa119c700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c15de50 0x7f6a9c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c15de50 msgr2=0x7f6a9c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c15de50 0x7f6a9c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 msgr2=0x7f6a9c0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 -- 172.21.15.12:0/3282056302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88009420 con 0x7f6a9c0cef40 2023-10-08T16:21:52.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6a9bfff700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa099b700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 0x7f6a9c151c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c580 tx=0x7f6a90007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90005b30 con 0x7f6a9c0cef40 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a90005cb0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90007320 con 0x7f6a9c0cef40 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a94009a20 con 0x7f6a9c0cef40 2023-10-08T16:21:52.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.534+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0cb360 con 0x7f6a9c0cef40 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.535+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c04c3c0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.536+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f6a9001b3b0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.537+0000 7f6a98ff9700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 0x7f6a80069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.537+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f6a90084100 con 0x7f6a9c0cef40 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.537+0000 7f6a9bfff700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 msgr2=0x7f6a80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:52.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.537+0000 7f6a9bfff700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 0x7f6a80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:52.541 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:52.541+0000 7f496b571180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:21:52.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.542+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a90050c70 con 0x7f6a9c0cef40 2023-10-08T16:21:52.640 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:52.640+0000 7fafff49f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:21:52.722 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:52.722+0000 7f496b571180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:21:52.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.738+0000 7f6a9bfff700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 msgr2=0x7f6a80069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:52.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.738+0000 7f6a9bfff700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 0x7f6a80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:52.741 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:52.741+0000 7fafff49f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:21:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.788+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a9c0caef0 con 0x7f6a9c0cef40 2023-10-08T16:21:52.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.788+0000 7f6a98ff9700 1 -- 172.21.15.12:0/3282056302 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f6a90017090 con 0x7f6a9c0cef40 2023-10-08T16:21:52.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:52.789 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:21:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 msgr2=0x7f6a80069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 0x7f6a80069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 msgr2=0x7f6a9c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 0x7f6a9c151c10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6a9000c580 tx=0x7f6a90007d50 comp rx=0 tx=0).stop 2023-10-08T16:21:52.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 shutdown_connections 2023-10-08T16:21:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a9c15de50 0x7f6a9c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a9c0cef40 0x7f6a9c151c10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f6a800670e0 0x7f6a80069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 --2- 172.21.15.12:0/3282056302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a9c153c30 0x7f6a9c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:52.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 >> 172.21.15.12:0/3282056302 conn(0x7f6a9c0703a0 msgr2=0x7f6a9c0638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 shutdown_connections 2023-10-08T16:21:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:52.791+0000 7f6aa199d700 1 -- 172.21.15.12:0/3282056302 wait complete. 2023-10-08T16:21:52.794 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:21:52.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:21:52.823 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:52.823+0000 7f496b571180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:21:53.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.004+0000 7f822bbff700 1 Processor -- start 2023-10-08T16:21:53.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.004+0000 7f822bbff700 1 -- start start 2023-10-08T16:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8224159850 0x7f82240adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8224159c20 0x7f82240ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82240b0930 0x7f82240b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82240ccdc0 con 0x7f8224159850 2023-10-08T16:21:53.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82240b12f0 con 0x7f8224159c20 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822bbff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82240adb20 con 0x7f82240b0930 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.005+0000 7f822999b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8224159850 0x7f82240adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8224159850 0x7f82240adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48666/0 (socket says 172.21.15.12:48666) 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 -- 172.21.15.12:0/3804193945 learned_addr learned my addr 172.21.15.12:0/3804193945 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822a19c700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82240b0930 0x7f82240b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822919a700 1 --2- 172.21.15.12:0/3804193945 >> v2:172.21.15.29:3300/0 conn(0x7f8224159c20 0x7f82240ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 -- 172.21.15.12:0/3804193945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82240b0930 msgr2=0x7f82240b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82240b0930 0x7f82240b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 -- 172.21.15.12:0/3804193945 >> v2:172.21.15.29:3300/0 conn(0x7f8224159c20 msgr2=0x7f82240ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 --2- 172.21.15.12:0/3804193945 >> v2:172.21.15.29:3300/0 conn(0x7f8224159c20 0x7f82240ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 -- 172.21.15.12:0/3804193945 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82240acf10 con 0x7f8224159850 2023-10-08T16:21:53.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.006+0000 7f822999b700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8224159850 0x7f82240adfb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f822406c0c0 tx=0x7f8220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f2a2125715cc2e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f8228999700 1 -- 172.21.15.12:0/3804193945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000b640 con 0x7f8224159850 2023-10-08T16:21:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f8228999700 1 -- 172.21.15.12:0/3804193945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822000b7a0 con 0x7f8224159850 2023-10-08T16:21:53.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f8228999700 1 -- 172.21.15.12:0/3804193945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000bb40 con 0x7f8224159850 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 -- 172.21.15.12:0/3804193945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8224159850 msgr2=0x7f82240adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8224159850 0x7f82240adfb0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f822406c0c0 tx=0x7f8220009250 comp rx=0 tx=0).stop 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 -- 172.21.15.12:0/3804193945 shutdown_connections 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82240b0930 0x7f82240b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 --2- 172.21.15.12:0/3804193945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8224159850 0x7f82240adfb0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.007+0000 7f822bbff700 1 --2- 172.21.15.12:0/3804193945 >> v2:172.21.15.29:3300/0 conn(0x7f8224159c20 0x7f82240ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.008+0000 7f822bbff700 1 -- 172.21.15.12:0/3804193945 >> 172.21.15.12:0/3804193945 conn(0x7f822406d170 msgr2=0x7f82240cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.008+0000 7f822bbff700 1 -- 172.21.15.12:0/3804193945 shutdown_connections 2023-10-08T16:21:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.008+0000 7f822bbff700 1 -- 172.21.15.12:0/3804193945 wait complete. 2023-10-08T16:21:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.009+0000 7f822bbff700 1 Processor -- start 2023-10-08T16:21:53.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.009+0000 7f822bbff700 1 -- start start 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8224159850 0x7f8224158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8224159c20 0x7f8224152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224160170 con 0x7f82240b0930 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8224145690 con 0x7f8224159c20 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.010+0000 7f822bbff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8224144ac0 con 0x7f8224159850 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48672/0 (socket says 172.21.15.12:48672) 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 -- 172.21.15.12:0/889991010 learned_addr learned my addr 172.21.15.12:0/889991010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:53.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822919a700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8224159850 0x7f8224158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822a19c700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8224159c20 0x7f8224152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8224159850 msgr2=0x7f8224158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8224159850 0x7f8224158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8224159c20 msgr2=0x7f8224152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8224159c20 0x7f8224152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 -- 172.21.15.12:0/889991010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200094f0 con 0x7f82240b0930 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.011+0000 7f822999b700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f8220017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.012+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000bb20 con 0x7f82240b0930 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.012+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220000c90 con 0x7f82240b0930 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.012+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8224144d60 con 0x7f82240b0930 2023-10-08T16:21:53.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.012+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8220011630 con 0x7f82240b0930 2023-10-08T16:21:53.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.012+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8224145320 con 0x7f82240b0930 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.013+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822404c3c0 con 0x7f82240b0930 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.014+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f8220011a60 con 0x7f82240b0930 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.015+0000 7f8219ffb700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 0x7f8208069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.015+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f8220086150 con 0x7f82240b0930 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.015+0000 7f822919a700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 msgr2=0x7f8208069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:53.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.015+0000 7f822919a700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 0x7f8208069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:53.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.019+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8220052cc0 con 0x7f82240b0930 2023-10-08T16:21:53.041 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:53.041+0000 7fafff49f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:21:53.129 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:53.129+0000 7f496b571180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:21:53.140 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:53.141+0000 7fafff49f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:21:53.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.216+0000 7f822919a700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 msgr2=0x7f8208069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:53.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.216+0000 7f822919a700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 0x7f8208069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:53.229 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:53.229+0000 7f496b571180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:21:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.265+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82240ad1f0 con 0x7f82240b0930 2023-10-08T16:21:53.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.266+0000 7f8219ffb700 1 -- 172.21.15.12:0/889991010 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f82200562e0 con 0x7f82240b0930 2023-10-08T16:21:53.266 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:53.266 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:10:28.644116+0000","modified":"2023-10-08T16:10:32.169146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4962},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4962":{"gid":4962,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6836/2487834528","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2487834528},{"type":"v1","addr":"172.21.15.12:6836","nonce":2487834528}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-08T16:21:53.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.268+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 msgr2=0x7f8208069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.268+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 0x7f8208069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.268+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 msgr2=0x7f82241441d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.268+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8220009fd0 tx=0x7f8220017000 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 shutdown_connections 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f82080670e0 0x7f8208069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82240b0930 0x7f82241441d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8224159c20 0x7f8224152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 --2- 172.21.15.12:0/889991010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8224159850 0x7f8224158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 >> 172.21.15.12:0/889991010 conn(0x7f822406d170 msgr2=0x7f8224069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:53.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 shutdown_connections 2023-10-08T16:21:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.269+0000 7f822bbff700 1 -- 172.21.15.12:0/889991010 wait complete. 2023-10-08T16:21:53.270 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 18 2023-10-08T16:21:53.286 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:21:53.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.518+0000 7f18d09fe700 1 Processor -- start 2023-10-08T16:21:53.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.518+0000 7f18d09fe700 1 -- start start 2023-10-08T16:21:53.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.519+0000 7f18d09fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18cc0cf110 0x7f18cc164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.519+0000 7f18d09fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc15afd0 con 0x7f18cc15de50 2023-10-08T16:21:53.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.519+0000 7f18d09fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18cc15b2b0 con 0x7f18cc153c30 2023-10-08T16:21:53.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.519+0000 7f18d09fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18cc15b590 con 0x7f18cc0cf110 2023-10-08T16:21:53.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18ca59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f18cc15de50 0x7f18cc0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46948/0 (socket says 172.21.15.12:46948) 2023-10-08T16:21:53.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18ca59c700 1 -- 172.21.15.12:0/141511901 learned_addr learned my addr 172.21.15.12:0/141511901 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18cb59e700 1 --2- 172.21.15.12:0/141511901 >> v2:172.21.15.29:3300/0 conn(0x7f18cc0cf110 0x7f18cc164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204029106 0 0) 0x7f18cc15afd0 con 0x7f18cc15de50 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b4003570 con 0x7f18cc15de50 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646893970 0 0) 0x7f18cc15b2b0 con 0x7f18cc153c30 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18cc15afd0 con 0x7f18cc153c30 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18cb59e700 1 -- 172.21.15.12:0/141511901 >> v1:172.21.15.29:6789/0 conn(0x7f18cc153c30 legacy=0x7f18cc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18cb59e700 1 -- 172.21.15.12:0/141511901 >> v1:172.21.15.12:6789/0 conn(0x7f18cc15de50 legacy=0x7f18cc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.520+0000 7f18cb59e700 1 -- 172.21.15.12:0/141511901 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc15b870 con 0x7f18cc0cf110 2023-10-08T16:21:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.521+0000 7f18cb59e700 1 --2- 172.21.15.12:0/141511901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc164600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e60 tx=0x7f18c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b4bd6f4b30e7e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.521+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400e070 con 0x7f18cc0cf110 2023-10-08T16:21:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.521+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c400bab0 con 0x7f18cc0cf110 2023-10-08T16:21:53.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.521+0000 7f18c9d9b700 1 -- 172.21.15.12:0/141511901 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c400be70 con 0x7f18cc0cf110 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 -- 172.21.15.12:0/141511901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 msgr2=0x7f18cc164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 --2- 172.21.15.12:0/141511901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc164600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009e60 tx=0x7f18c4009780 comp rx=0 tx=0).stop 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 -- 172.21.15.12:0/141511901 shutdown_connections 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 --2- 172.21.15.12:0/141511901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc164600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 -- 172.21.15.12:0/141511901 >> 172.21.15.12:0/141511901 conn(0x7f18cc0703a0 msgr2=0x7f18cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 -- 172.21.15.12:0/141511901 shutdown_connections 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.522+0000 7f18d09fe700 1 -- 172.21.15.12:0/141511901 wait complete. 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.523+0000 7f18d09fe700 1 Processor -- start 2023-10-08T16:21:53.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.523+0000 7f18d09fe700 1 -- start start 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18cc153c30 0x7f18cc151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0c8940 con 0x7f18cc15de50 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0b4900 con 0x7f18cc0cf110 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.524+0000 7f18d09fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc0b4be0 con 0x7f18cc153c30 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48682/0 (socket says 172.21.15.12:48682) 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18ca59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18cc153c30 0x7f18cc151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 -- 172.21.15.12:0/2181638770 learned_addr learned my addr 172.21.15.12:0/2181638770 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:53.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cad9d700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18cc153c30 msgr2=0x7f18cc151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18cc153c30 0x7f18cc151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 msgr2=0x7f18cc169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 -- 172.21.15.12:0/2181638770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c4009a20 con 0x7f18cc15de50 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.525+0000 7f18cb59e700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009460 tx=0x7f18c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.526+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4012dd0 con 0x7f18cc15de50 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.526+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4026480 con 0x7f18cc15de50 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.526+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc0b4ec0 con 0x7f18cc15de50 2023-10-08T16:21:53.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.526+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4026840 con 0x7f18cc15de50 2023-10-08T16:21:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.526+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc0c8c20 con 0x7f18cc15de50 2023-10-08T16:21:53.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.527+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0b5100 con 0x7f18cc15de50 2023-10-08T16:21:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.528+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f18c401c400 con 0x7f18cc15de50 2023-10-08T16:21:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.529+0000 7f18b2ffd700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 0x7f18b8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.529+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f18c40870d0 con 0x7f18cc15de50 2023-10-08T16:21:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.529+0000 7f18cad9d700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 msgr2=0x7f18b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:53.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.529+0000 7f18cad9d700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 0x7f18b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:53.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.533+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18c4053bd0 con 0x7f18cc15de50 2023-10-08T16:21:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.730+0000 7f18cad9d700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 msgr2=0x7f18b8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:53.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.730+0000 7f18cad9d700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 0x7f18b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.739+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18cc04c3c0 con 0x7f18cc15de50 2023-10-08T16:21:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.740+0000 7f18b2ffd700 1 -- 172.21.15.12:0/2181638770 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+16891 (secure 0 0 0) 0x7f18c40571f0 con 0x7f18cc15de50 2023-10-08T16:21:53.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:21:53.740 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":55,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:21:51.077167+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:10:26.454842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-08T16:10:27.620750+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":221,"snap_epoch":54,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6833/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:6832/115415":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3799372723":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/3105973545":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/2568382938":"2023-10-09T16:10:49.760609+0000","172.21.15.12:0/1489576806":"2023-10-09T16:10:49.760609+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":5,"length":2},{"begin":9,"length":6},{"begin":17,"length":3},{"begin":23,"length":3},{"begin":28,"length":3},{"begin":33,"length":3},{"begin":38,"length":3},{"begin":44,"length":3},{"begin":49,"length":4},{"begin":55,"length":3},{"begin":60,"length":4},{"begin":66,"length":3},{"begin":71,"length":4},{"begin":77,"length":3},{"begin":81,"length":4},{"begin":88,"length":3},{"begin":92,"length":3},{"begin":98,"length":3},{"begin":102,"length":3},{"begin":108,"length":3},{"begin":123,"length":74}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:21:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 msgr2=0x7f18b8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 0x7f18b8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 msgr2=0x7f18cc0c7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f18c4009460 tx=0x7f18c4019000 comp rx=0 tx=0).stop 2023-10-08T16:21:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 shutdown_connections 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f18b80670e0 0x7f18b8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18cc15de50 0x7f18cc0c7fa0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18cc0cf110 0x7f18cc169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 --2- 172.21.15.12:0/2181638770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18cc153c30 0x7f18cc151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 >> 172.21.15.12:0/2181638770 conn(0x7f18cc0703a0 msgr2=0x7f18cc0ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 shutdown_connections 2023-10-08T16:21:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.742+0000 7f18d09fe700 1 -- 172.21.15.12:0/2181638770 wait complete. 2023-10-08T16:21:53.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:21:53.877 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:53.877+0000 7fafff49f180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:21:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.952+0000 7f2dded9d700 1 Processor -- start 2023-10-08T16:21:53.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.952+0000 7f2dded9d700 1 -- start start 2023-10-08T16:21:53.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.953+0000 7f2dded9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 0x7f2dd80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.953+0000 7f2dded9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2dd80cef40 0x7f2dd815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.953+0000 7f2dded9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd815afd0 con 0x7f2dd8153c30 2023-10-08T16:21:53.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.953+0000 7f2dded9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd815b2b0 con 0x7f2dd80cef40 2023-10-08T16:21:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.953+0000 7f2dded9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815b590 con 0x7f2dd815de50 2023-10-08T16:21:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2dddd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2dd8153c30 0x7f2dd815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46958/0 (socket says 172.21.15.12:46958) 2023-10-08T16:21:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2dddd9b700 1 -- 172.21.15.12:0/2860863808 learned_addr learned my addr 172.21.15.12:0/2860863808 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/2860863808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 0x7f2dd80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2dde59c700 1 --2- 172.21.15.12:0/2860863808 >> v2:172.21.15.29:3300/0 conn(0x7f2dd80cef40 0x7f2dd815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddcd99700 1 -- 172.21.15.12:0/2860863808 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019913395 0 0) 0x7f2dd815afd0 con 0x7f2dd8153c30 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddcd99700 1 -- 172.21.15.12:0/2860863808 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc4003570 con 0x7f2dd8153c30 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddd59a700 1 -- 172.21.15.12:0/2860863808 >> v2:172.21.15.29:3300/0 conn(0x7f2dd80cef40 msgr2=0x7f2dd815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/2860863808 >> v2:172.21.15.29:3300/0 conn(0x7f2dd80cef40 0x7f2dd815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddd59a700 1 -- 172.21.15.12:0/2860863808 >> v1:172.21.15.12:6789/0 conn(0x7f2dd8153c30 legacy=0x7f2dd815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.954+0000 7f2ddd59a700 1 -- 172.21.15.12:0/2860863808 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd815b870 con 0x7f2dd815de50 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/2860863808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 0x7f2dd80cea00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098e0 tx=0x7f2dc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58e43d2e7d49dcb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2ddcd99700 1 -- 172.21.15.12:0/2860863808 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011630 con 0x7f2dd815de50 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2ddcd99700 1 -- 172.21.15.12:0/2860863808 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8011790 con 0x7f2dd815de50 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2ddcd99700 1 -- 172.21.15.12:0/2860863808 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8011b30 con 0x7f2dd815de50 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2dded9d700 1 -- 172.21.15.12:0/2860863808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 msgr2=0x7f2dd80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.955+0000 7f2dded9d700 1 --2- 172.21.15.12:0/2860863808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 0x7f2dd80cea00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80098e0 tx=0x7f2dc80091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 -- 172.21.15.12:0/2860863808 shutdown_connections 2023-10-08T16:21:53.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 --2- 172.21.15.12:0/2860863808 >> v2:172.21.15.29:3300/0 conn(0x7f2dd80cef40 0x7f2dd815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 --2- 172.21.15.12:0/2860863808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd815de50 0x7f2dd80cea00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 -- 172.21.15.12:0/2860863808 >> 172.21.15.12:0/2860863808 conn(0x7f2dd80703a0 msgr2=0x7f2dd80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 -- 172.21.15.12:0/2860863808 shutdown_connections 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.956+0000 7f2dded9d700 1 -- 172.21.15.12:0/2860863808 wait complete. 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.957+0000 7f2dded9d700 1 Processor -- start 2023-10-08T16:21:53.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.957+0000 7f2dded9d700 1 -- start start 2023-10-08T16:21:53.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd80cef40 0x7f2dd8145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 0x7f2dd80b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c8e80 con 0x7f2dd8153c30 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c9ce0 con 0x7f2dd815de50 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2dded9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd80c90d0 con 0x7f2dd80cef40 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.958+0000 7f2ddd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48684/0 (socket says 172.21.15.12:48684) 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 -- 172.21.15.12:0/141454418 learned_addr learned my addr 172.21.15.12:0/141454418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2dddd9b700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd80cef40 0x7f2dd8145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2dde59c700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 0x7f2dd80b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd80cef40 msgr2=0x7f2dd8145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd80cef40 0x7f2dd8145f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 msgr2=0x7f2dd80b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:53.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 0x7f2dd80b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 -- 172.21.15.12:0/141454418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc8009420 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2dde59c700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 0x7f2dd80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2ddd59a700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009ed0 tx=0x7f2dc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.959+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8000cc0 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.960+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc8011900 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.960+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc8025420 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.960+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd80c93b0 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.960+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd80c9970 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.961+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd804c3c0 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.962+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f2dc8023070 con 0x7f2dd8153c30 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.962+0000 7f2dcdffb700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:53.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.963+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f2dc8086080 con 0x7f2dd8153c30 2023-10-08T16:21:53.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.963+0000 7f2dddd9b700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:53.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.963+0000 7f2dddd9b700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:21:53.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:53.967+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2dc8052c90 con 0x7f2dd8153c30 2023-10-08T16:21:53.981 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:53.982+0000 7f496b571180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:21:54.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.164+0000 7f2dddd9b700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6832/115415 2023-10-08T16:21:54.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.164+0000 7f2dddd9b700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:21:54.166 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.166+0000 7fafff49f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:21:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.215+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2dd80cf550 con 0x7f2dd8153c30 2023-10-08T16:21:54.215 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:21:54.216+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:21:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.220+0000 7f2dcdffb700 1 -- 172.21.15.12:0/141454418 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2dc8015090 con 0x7f2dd8153c30 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 msgr2=0x7f2dbc069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 msgr2=0x7f2dd80b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2dc8009ed0 tx=0x7f2dc8017000 comp rx=0 tx=0).stop 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 shutdown_connections 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2dd815de50 0x7f2dd80b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2dd80cef40 0x7f2dd8145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f2dbc0670e0 0x7f2dbc069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 --2- 172.21.15.12:0/141454418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2dd8153c30 0x7f2dd80b5bf0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.222+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 >> 172.21.15.12:0/141454418 conn(0x7f2dd80703a0 msgr2=0x7f2dd80c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:54.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.223+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 shutdown_connections 2023-10-08T16:21:54.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.223+0000 7f2dded9d700 1 -- 172.21.15.12:0/141454418 wait complete. 2023-10-08T16:21:54.224 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:21:54.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:21:54.264 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.264+0000 7fafff49f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:21:54.276 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.277+0000 7f496b571180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:21:54.281 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:21:54.380 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.381+0000 7f496b571180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:21:54.427 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.427+0000 7fafff49f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:21:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.440+0000 7f58cab9d700 1 Processor -- start 2023-10-08T16:21:54.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.440+0000 7f58cab9d700 1 -- start start 2023-10-08T16:21:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58cab9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58c4155c60 0x7f58c40c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58cab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c406de50 0x7f58c406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58cab9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40c7e70 con 0x7f58c4155890 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58cab9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c406e810 con 0x7f58c4155c60 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58cab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c406b790 con 0x7f58c406de50 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58c939a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f58c4155c60 0x7f58c40c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58c9b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f58c4155890 0x7f58c406a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46964/0 (socket says 172.21.15.12:46964) 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58c9b9b700 1 -- 172.21.15.12:0/356987362 learned_addr learned my addr 172.21.15.12:0/356987362 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58ca39c700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c406de50 0x7f58c406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.442+0000 7f58c939a700 1 -- 172.21.15.12:0/356987362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c406de50 msgr2=0x7f58c406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c939a700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c406de50 0x7f58c406e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c939a700 1 -- 172.21.15.12:0/356987362 >> v1:172.21.15.12:6789/0 conn(0x7f58c4155890 legacy=0x7f58c406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c8b99700 1 -- 172.21.15.12:0/356987362 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079220119 0 0) 0x7f58c40c7e70 con 0x7f58c4155890 2023-10-08T16:21:54.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c939a700 1 -- 172.21.15.12:0/356987362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c406ab80 con 0x7f58c4155c60 2023-10-08T16:21:54.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c939a700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155c60 0x7f58c40c7930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009910 tx=0x7f58b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f610bc35b129d826 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c8b99700 1 -- 172.21.15.12:0/356987362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400f6b0 con 0x7f58c4155c60 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c8b99700 1 -- 172.21.15.12:0/356987362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400f810 con 0x7f58c4155c60 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.443+0000 7f58c8b99700 1 -- 172.21.15.12:0/356987362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400fbd0 con 0x7f58c4155c60 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 -- 172.21.15.12:0/356987362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155c60 msgr2=0x7f58c40c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155c60 0x7f58c40c7930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f58b4009910 tx=0x7f58b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 -- 172.21.15.12:0/356987362 shutdown_connections 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c406de50 0x7f58c406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 --2- 172.21.15.12:0/356987362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155c60 0x7f58c40c7930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 -- 172.21.15.12:0/356987362 >> 172.21.15.12:0/356987362 conn(0x7f58c406d110 msgr2=0x7f58c40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:54.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 -- 172.21.15.12:0/356987362 shutdown_connections 2023-10-08T16:21:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.444+0000 7f58cab9d700 1 -- 172.21.15.12:0/356987362 wait complete. 2023-10-08T16:21:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.446+0000 7f58cab9d700 1 Processor -- start 2023-10-08T16:21:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.446+0000 7f58cab9d700 1 -- start start 2023-10-08T16:21:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c406de50 0x7f58c416d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c4155c60 0x7f58c40ae190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4169a70 con 0x7f58c4155890 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40c3720 con 0x7f58c406de50 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58cab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40c39f0 con 0x7f58c4155c60 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48718/0 (socket says 172.21.15.12:48718) 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 -- 172.21.15.12:0/2469462380 learned_addr learned my addr 172.21.15.12:0/2469462380 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58ca39c700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c4155c60 0x7f58c40ae190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c9b9b700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c406de50 0x7f58c416d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 -- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c4155c60 msgr2=0x7f58c40ae190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:54.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c4155c60 0x7f58c40ae190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 -- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c406de50 msgr2=0x7f58c416d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c406de50 0x7f58c416d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.447+0000 7f58c939a700 1 -- 172.21.15.12:0/2469462380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009420 con 0x7f58c4155890 2023-10-08T16:21:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58c939a700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f58b4015000 tx=0x7f58b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400f980 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400fb00 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40106c0 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40c3cd0 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.448+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c41696d0 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.449+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c4169be0 con 0x7f58c4155890 2023-10-08T16:21:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.451+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 14) v1 ==== 84911+0+0 (secure 0 0 0) 0x7f58b40243f0 con 0x7f58c4155890 2023-10-08T16:21:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58b9ffb700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6413+0+0 (secure 0 0 0) 0x7f58b4014070 con 0x7f58c4155890 2023-10-08T16:21:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58c9b9b700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:54.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58c9b9b700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-10-08T16:21:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58c9b9b700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 msgr2=0x7f58a8069590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-08T16:21:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.452+0000 7f58b9ffb700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.456+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58b4053290 con 0x7f58c4155890 2023-10-08T16:21:54.536 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.536+0000 7fafff49f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:21:54.545 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.546+0000 7f496b571180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:21:54.655 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.656+0000 7f496b571180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:21:54.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:54.702+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58c404c3c0 con 0x7f58c4155890 2023-10-08T16:21:54.733 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.733+0000 7fafff49f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:21:54.830 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.830+0000 7fafff49f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:21:54.852 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.853+0000 7f496b571180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:21:54.926 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:54.926+0000 7fafff49f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:21:54.948 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:54.948+0000 7f496b571180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:21:55.024 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:21:55.024+0000 7fafff49f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:21:55.045 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.045+0000 7f496b571180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:21:55.141 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.141+0000 7f496b571180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:21:55.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.152+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 15) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f58b4053660 con 0x7f58c4155890 2023-10-08T16:21:55.220 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e5140700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.220 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e5140700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.220 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e5140700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.220 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e5140700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e5140700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e9949700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e9949700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e9949700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e9949700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.219+0000 7f48e9949700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:21:55.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.221+0000 7f58b9ffb700 1 -- 172.21.15.12:0/2469462380 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f58b4056d20 con 0x7f58c4155890 2023-10-08T16:21:55.222 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.222+0000 7f48e9949700 -1 client.5548 mdsmap subscription failed: (2) No such file or directory 2023-10-08T16:21:55.223 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:21:55.223+0000 7f48e5140700 -1 client.5231 mdsmap subscription failed: (2) No such file or directory 2023-10-08T16:21:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 msgr2=0x7f58c40c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f58b4015000 tx=0x7f58b4019000 comp rx=0 tx=0).stop 2023-10-08T16:21:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 shutdown_connections 2023-10-08T16:21:55.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f58c4155c60 0x7f58c40ae190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f58c406de50 0x7f58c416d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:6832/115415,v1:172.21.15.12:6833/115415] conn(0x7f58a80670e0 0x7f58a8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 --2- 172.21.15.12:0/2469462380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f58c4155890 0x7f58c40c31e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.224+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 >> 172.21.15.12:0/2469462380 conn(0x7f58c406d110 msgr2=0x7f58c40cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.225+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 shutdown_connections 2023-10-08T16:21:55.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.225+0000 7f58cab9d700 1 -- 172.21.15.12:0/2469462380 wait complete. 2023-10-08T16:21:55.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:21:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.476+0000 7f3aab59e700 1 Processor -- start 2023-10-08T16:21:55.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.476+0000 7f3aab59e700 1 -- start start 2023-10-08T16:21:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.477+0000 7f3aab59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3aac159800 0x7f3aac0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.477+0000 7f3aab59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.477+0000 7f3aab59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aac0b0c80 con 0x7f3aac0b24f0 2023-10-08T16:21:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.477+0000 7f3aab59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aac0d10d0 con 0x7f3aac159800 2023-10-08T16:21:55.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.477+0000 7f3aab59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0b0f60 con 0x7f3aac0b1d40 2023-10-08T16:21:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aa9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3aac159800 0x7f3aac0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:55.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaa59c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3aac0b24f0 0x7f3aac1590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:37276/0 (socket says 172.21.15.12:37276) 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaa59c700 1 -- 172.21.15.12:0/1904463448 learned_addr learned my addr 172.21.15.12:0/1904463448 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 -- 172.21.15.12:0/1904463448 >> v2:172.21.15.29:3300/0 conn(0x7f3aac159800 msgr2=0x7f3aac0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 --2- 172.21.15.12:0/1904463448 >> v2:172.21.15.29:3300/0 conn(0x7f3aac159800 0x7f3aac0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aa959a700 1 -- 172.21.15.12:0/1904463448 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198339926 0 0) 0x7f3aac0b0c80 con 0x7f3aac0b24f0 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 -- 172.21.15.12:0/1904463448 >> v1:172.21.15.29:6789/0 conn(0x7f3aac0b24f0 legacy=0x7f3aac1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 -- 172.21.15.12:0/1904463448 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac0b1240 con 0x7f3aac0b1d40 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.478+0000 7f3aaad9d700 1 --2- 172.21.15.12:0/1904463448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac0b4ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009e60 tx=0x7f3aa4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=287fbd6292d6d2d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aa959a700 1 -- 172.21.15.12:0/1904463448 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa400e070 con 0x7f3aac0b1d40 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aa959a700 1 -- 172.21.15.12:0/1904463448 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa400bb60 con 0x7f3aac0b1d40 2023-10-08T16:21:55.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aa959a700 1 -- 172.21.15.12:0/1904463448 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4012430 con 0x7f3aac0b1d40 2023-10-08T16:21:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 -- 172.21.15.12:0/1904463448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 msgr2=0x7f3aac0b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 --2- 172.21.15.12:0/1904463448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac0b4ae0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009e60 tx=0x7f3aa4009780 comp rx=0 tx=0).stop 2023-10-08T16:21:55.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 -- 172.21.15.12:0/1904463448 shutdown_connections 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 --2- 172.21.15.12:0/1904463448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac0b4ae0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 --2- 172.21.15.12:0/1904463448 >> v2:172.21.15.29:3300/0 conn(0x7f3aac159800 0x7f3aac0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 -- 172.21.15.12:0/1904463448 >> 172.21.15.12:0/1904463448 conn(0x7f3aac0703a0 msgr2=0x7f3aac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 -- 172.21.15.12:0/1904463448 shutdown_connections 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.479+0000 7f3aab59e700 1 -- 172.21.15.12:0/1904463448 wait complete. 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.481+0000 7f3aab59e700 1 Processor -- start 2023-10-08T16:21:55.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.481+0000 7f3aab59e700 1 -- start start 2023-10-08T16:21:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3aac0b24f0 0x7f3aac159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac15ac70 con 0x7f3aac159800 2023-10-08T16:21:55.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac0c6020 con 0x7f3aac0b24f0 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aab59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aac15a6b0 con 0x7f3aac0b1d40 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aaad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aaad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48838/0 (socket says 172.21.15.12:48838) 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aaad9d700 1 -- 172.21.15.12:0/4226007185 learned_addr learned my addr 172.21.15.12:0/4226007185 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aa9d9b700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3aac0b24f0 0x7f3aac159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.482+0000 7f3aaa59c700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 -- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 msgr2=0x7f3aac15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 -- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3aac0b24f0 msgr2=0x7f3aac159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3aac0b24f0 0x7f3aac159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 -- 172.21.15.12:0/4226007185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa4009a20 con 0x7f3aac159800 2023-10-08T16:21:55.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aaad9d700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3aac089370 tx=0x7f3aa4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4012ea0 con 0x7f3aac159800 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa4027470 con 0x7f3aac159800 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aac15a990 con 0x7f3aac159800 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4027830 con 0x7f3aac159800 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.483+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aac15fad0 con 0x7f3aac159800 2023-10-08T16:21:55.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.484+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aac15fcf0 con 0x7f3aac159800 2023-10-08T16:21:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.485+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 15) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f3aa4024070 con 0x7f3aac159800 2023-10-08T16:21:55.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.486+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f3aa4086c30 con 0x7f3aac159800 2023-10-08T16:21:55.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.490+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aa4053d80 con 0x7f3aac159800 2023-10-08T16:21:55.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:55.693+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3aac0c6190 con 0x7f3aac159800 2023-10-08T16:21:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.157+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 16) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f3aa4003040 con 0x7f3aac159800 2023-10-08T16:21:56.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.158+0000 7f3a9a7fc700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 0x7f3a8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.159+0000 7f3aaa59c700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 0x7f3a8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.163+0000 7f3aaa59c700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 0x7f3a8c06ede0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c007fd0 tx=0x7f3a9c007d30 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:56.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.689+0000 7f3a9a7fc700 1 -- 172.21.15.12:0/4226007185 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3aa406f1c0 con 0x7f3aac159800 2023-10-08T16:21:56.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.692+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 msgr2=0x7f3a8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.692+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 0x7f3a8c06ede0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c007fd0 tx=0x7f3a9c007d30 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.692+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 msgr2=0x7f3aac169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.692+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3aac089370 tx=0x7f3aa4019000 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 shutdown_connections 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3a8c06ca00 0x7f3a8c06ede0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3aac159800 0x7f3aac169970 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3aac0b1d40 0x7f3aac15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 --2- 172.21.15.12:0/4226007185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3aac0b24f0 0x7f3aac159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 >> 172.21.15.12:0/4226007185 conn(0x7f3aac0703a0 msgr2=0x7f3aac0ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:56.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 shutdown_connections 2023-10-08T16:21:56.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.693+0000 7f3aab59e700 1 -- 172.21.15.12:0/4226007185 wait complete. 2023-10-08T16:21:56.694 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:21:56.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:21:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.912+0000 7f7bc699d700 1 Processor -- start 2023-10-08T16:21:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.913+0000 7f7bc699d700 1 -- start start 2023-10-08T16:21:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc00cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc699d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7bc00c8980 0x7f7bc00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc699d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc00c2200 con 0x7f7bc00c0ef0 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc699d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc00c15f0 con 0x7f7bc00c8980 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc00c18d0 con 0x7f7bc0156d10 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc599b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7bc00c0ef0 0x7f7bc0153660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46972/0 (socket says 172.21.15.12:46972) 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc599b700 1 -- 172.21.15.12:0/468414181 learned_addr learned my addr 172.21.15.12:0/468414181 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.914+0000 7f7bc619c700 1 --2- 172.21.15.12:0/468414181 >> v2:172.21.15.12:3300/0 conn(0x7f7bc00c8980 0x7f7bc00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc519a700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc00cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc619c700 1 -- 172.21.15.12:0/468414181 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 msgr2=0x7f7bc00cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc619c700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc00cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc619c700 1 -- 172.21.15.12:0/468414181 >> v1:172.21.15.12:6789/0 conn(0x7f7bc00c0ef0 legacy=0x7f7bc0153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc619c700 1 -- 172.21.15.12:0/468414181 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00c1bb0 con 0x7f7bc00c8980 2023-10-08T16:21:56.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc619c700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc00c8e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e60 tx=0x7f7bb8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8655daaac3f655c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc4999700 1 -- 172.21.15.12:0/468414181 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb800e070 con 0x7f7bc00c8980 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc4999700 1 -- 172.21.15.12:0/468414181 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb800bc30 con 0x7f7bc00c8980 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.915+0000 7f7bc4999700 1 -- 172.21.15.12:0/468414181 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8012430 con 0x7f7bc00c8980 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 -- 172.21.15.12:0/468414181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 msgr2=0x7f7bc00c8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc00c8e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009e60 tx=0x7f7bb8009780 comp rx=0 tx=0).stop 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 -- 172.21.15.12:0/468414181 shutdown_connections 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc00c8e00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 --2- 172.21.15.12:0/468414181 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc00cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 -- 172.21.15.12:0/468414181 >> 172.21.15.12:0/468414181 conn(0x7f7bc006c6a0 msgr2=0x7f7bc006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 -- 172.21.15.12:0/468414181 shutdown_connections 2023-10-08T16:21:56.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.916+0000 7f7bc699d700 1 -- 172.21.15.12:0/468414181 wait complete. 2023-10-08T16:21:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.917+0000 7f7bc699d700 1 Processor -- start 2023-10-08T16:21:56.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.918+0000 7f7bc699d700 1 -- start start 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c0ef0 0x7f7bc014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc01555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc015a070 con 0x7f7bc00c8980 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0159460 con 0x7f7bc00c0ef0 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0159740 con 0x7f7bc0156d10 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48852/0 (socket says 172.21.15.12:48852) 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 -- 172.21.15.12:0/3434200857 learned_addr learned my addr 172.21.15.12:0/3434200857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc599b700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c0ef0 0x7f7bc014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc619c700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc01555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 -- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 msgr2=0x7f7bc01555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc01555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 -- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c0ef0 msgr2=0x7f7bc014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:56.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c0ef0 0x7f7bc014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc519a700 1 -- 172.21.15.12:0/3434200857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb8009a20 con 0x7f7bc00c8980 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.919+0000 7f7bc619c700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bc519a700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000d860 tx=0x7f7bb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00125f0 con 0x7f7bc00c8980 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb0012750 con 0x7f7bc00c8980 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc0159a20 con 0x7f7bc00c8980 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0012b10 con 0x7f7bc00c8980 2023-10-08T16:21:56.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.920+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc014e830 con 0x7f7bc00c8980 2023-10-08T16:21:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.921+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc015a1e0 con 0x7f7bc00c8980 2023-10-08T16:21:56.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.922+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 16) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f7bb001e460 con 0x7f7bc00c8980 2023-10-08T16:21:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.923+0000 7f7bb5ffb700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 0x7f7ba4069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.923+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6276+0+0 (secure 0 0 0) 0x7f7bb0084a60 con 0x7f7bc00c8980 2023-10-08T16:21:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.923+0000 7f7bc599b700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 0x7f7ba4069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:56.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.924+0000 7f7bc599b700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 0x7f7ba4069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc007130 tx=0x7f7bbc007eb0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:56.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:56.927+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bb0051c70 con 0x7f7bc00c8980 2023-10-08T16:21:57.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.133+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7bc004c3c0 con 0x7f7bc00c8980 2023-10-08T16:21:57.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.694+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bb0052040 con 0x7f7bc00c8980 2023-10-08T16:21:57.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.700+0000 7f7bb5ffb700 1 -- 172.21.15.12:0/3434200857 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7bb0055470 con 0x7f7bc00c8980 2023-10-08T16:21:57.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 msgr2=0x7f7ba4069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 0x7f7ba4069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc007130 tx=0x7f7bbc007eb0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 msgr2=0x7f7bc01550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7bb000d860 tx=0x7f7bb0008040 comp rx=0 tx=0).stop 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 shutdown_connections 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7ba4066d80 0x7f7ba4069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bc0156d10 0x7f7bc01555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bc00c0ef0 0x7f7bc014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 --2- 172.21.15.12:0/3434200857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bc00c8980 0x7f7bc01550b0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 >> 172.21.15.12:0/3434200857 conn(0x7f7bc006c6a0 msgr2=0x7f7bc006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 shutdown_connections 2023-10-08T16:21:57.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.703+0000 7f7bc699d700 1 -- 172.21.15.12:0/3434200857 wait complete. 2023-10-08T16:21:57.705 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:21:57.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:21:57.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.922+0000 7f26b959d700 1 Processor -- start 2023-10-08T16:21:57.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.922+0000 7f26b959d700 1 -- start start 2023-10-08T16:21:57.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26b406de50 0x7f26b40c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b415b640 con 0x7f26b406a210 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b959d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26b415b920 con 0x7f26b4140a70 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26b40c6800 con 0x7f26b406de50 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f26b406a210 0x7f26b40c6c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46986/0 (socket says 172.21.15.12:46986) 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b37fe700 1 -- 172.21.15.12:0/3722825490 learned_addr learned my addr 172.21.15.12:0/3722825490 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:57.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b8d9c700 1 --2- 172.21.15.12:0/3722825490 >> v2:172.21.15.12:3300/0 conn(0x7f26b406de50 0x7f26b40c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b8d9c700 1 -- 172.21.15.12:0/3722825490 >> v1:172.21.15.29:6789/0 conn(0x7f26b4140a70 legacy=0x7f26b4069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.924+0000 7f26b8d9c700 1 -- 172.21.15.12:0/3722825490 >> v1:172.21.15.12:6789/0 conn(0x7f26b406a210 legacy=0x7f26b40c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.925+0000 7f26b8d9c700 1 -- 172.21.15.12:0/3722825490 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b415bc00 con 0x7f26b406de50 2023-10-08T16:21:57.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.925+0000 7f26b8d9c700 1 --2- 172.21.15.12:0/3722825490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406de50 0x7f26b40c7360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009e60 tx=0x7f26ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf744abd3a0cb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.925+0000 7f26b2ffd700 1 -- 172.21.15.12:0/3722825490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac00e070 con 0x7f26b406de50 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.925+0000 7f26b2ffd700 1 -- 172.21.15.12:0/3722825490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ac00bc30 con 0x7f26b406de50 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.925+0000 7f26b2ffd700 1 -- 172.21.15.12:0/3722825490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ac012430 con 0x7f26b406de50 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 -- 172.21.15.12:0/3722825490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406de50 msgr2=0x7f26b40c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 --2- 172.21.15.12:0/3722825490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406de50 0x7f26b40c7360 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f26ac009e60 tx=0x7f26ac009780 comp rx=0 tx=0).stop 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 -- 172.21.15.12:0/3722825490 shutdown_connections 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 --2- 172.21.15.12:0/3722825490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406de50 0x7f26b40c7360 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 -- 172.21.15.12:0/3722825490 >> 172.21.15.12:0/3722825490 conn(0x7f26b406d110 msgr2=0x7f26b40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 -- 172.21.15.12:0/3722825490 shutdown_connections 2023-10-08T16:21:57.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.926+0000 7f26b959d700 1 -- 172.21.15.12:0/3722825490 wait complete. 2023-10-08T16:21:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.927+0000 7f26b959d700 1 Processor -- start 2023-10-08T16:21:57.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.927+0000 7f26b959d700 1 -- start start 2023-10-08T16:21:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26b406de50 0x7f26b40c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 0x7f26b4157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4168890 con 0x7f26b406a210 2023-10-08T16:21:57.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4167d10 con 0x7f26b406de50 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.928+0000 7f26b959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b4167ff0 con 0x7f26b4140a70 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48872/0 (socket says 172.21.15.12:48872) 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 -- 172.21.15.12:0/1627035190 learned_addr learned my addr 172.21.15.12:0/1627035190 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b37fe700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26b406de50 0x7f26b40c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b8d9c700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 0x7f26b4157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 -- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 msgr2=0x7f26b4157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 0x7f26b4157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 -- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26b406de50 msgr2=0x7f26b40c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26b406de50 0x7f26b40c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:57.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 -- 172.21.15.12:0/1627035190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ac009a20 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b8d9c700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 0x7f26b4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.929+0000 7f26b3fff700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c590 tx=0x7f26a4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.930+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4011590 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.930+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a4011730 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.930+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a4011af0 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.930+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26b41682d0 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.930+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b40c3f00 con 0x7f26b406a210 2023-10-08T16:21:57.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.931+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26b404c3c0 con 0x7f26b406a210 2023-10-08T16:21:57.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.932+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f26a4012420 con 0x7f26b406a210 2023-10-08T16:21:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.933+0000 7f269bfff700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.933+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f26a4083910 con 0x7f26b406a210 2023-10-08T16:21:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.933+0000 7f26b37fe700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:57.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.934+0000 7f26b37fe700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 0x7f26a00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26b40c6710 tx=0x7f26a8007eb0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:57.938+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26a404b5a0 con 0x7f26b406a210 2023-10-08T16:21:58.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.145+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f26b415bee0 con 0x7f26b406a210 2023-10-08T16:21:58.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.149+0000 7f269bfff700 1 -- 172.21.15.12:0/1627035190 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v13) v1 ==== 120+0+0 (secure 0 0 0) 0x7f26a4017020 con 0x7f26b406a210 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 msgr2=0x7f26a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 0x7f26a00693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f26b40c6710 tx=0x7f26a8007eb0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 msgr2=0x7f26b40c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f26a400c590 tx=0x7f26a4007f30 comp rx=0 tx=0).stop 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 shutdown_connections 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f26a0066f30 0x7f26a00693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26b406a210 0x7f26b40c31e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26b4140a70 0x7f26b4157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 --2- 172.21.15.12:0/1627035190 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26b406de50 0x7f26b40c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 >> 172.21.15.12:0/1627035190 conn(0x7f26b406d110 msgr2=0x7f26b40cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 shutdown_connections 2023-10-08T16:21:58.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.152+0000 7f26b959d700 1 -- 172.21.15.12:0/1627035190 wait complete. 2023-10-08T16:21:58.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:21:58.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.360+0000 7f3788f9d700 1 Processor -- start 2023-10-08T16:21:58.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.360+0000 7f3788f9d700 1 -- start start 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f3788f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3784153a00 0x7f3784153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f3788f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f37840cea00 0x7f37840cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f3788f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378415ac50 con 0x7f378415de50 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f3788f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378415d010 con 0x7f3784153a00 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f3788f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37840cf3c0 con 0x7f37840cea00 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.361+0000 7f37837fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3784153a00 0x7f3784153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3784153a00 0x7f3784153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48878/0 (socket says 172.21.15.12:48878) 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 -- 172.21.15.12:0/320762124 learned_addr learned my addr 172.21.15.12:0/320762124 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f3783fff700 1 --2- 172.21.15.12:0/320762124 >> v2:172.21.15.29:3300/0 conn(0x7f37840cea00 0x7f37840cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 -- 172.21.15.12:0/320762124 >> v2:172.21.15.29:3300/0 conn(0x7f37840cea00 msgr2=0x7f37840cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 --2- 172.21.15.12:0/320762124 >> v2:172.21.15.29:3300/0 conn(0x7f37840cea00 0x7f37840cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 -- 172.21.15.12:0/320762124 >> v1:172.21.15.29:6789/0 conn(0x7f378415de50 legacy=0x7f378415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 -- 172.21.15.12:0/320762124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378415af60 con 0x7f3784153a00 2023-10-08T16:21:58.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37837fe700 1 --2- 172.21.15.12:0/320762124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3784153a00 0x7f3784153dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37840d03e0 tx=0x7f3774009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbe480b0be01ea2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.362+0000 7f37827fc700 1 -- 172.21.15.12:0/320762124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400b860 con 0x7f3784153a00 2023-10-08T16:21:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f37827fc700 1 -- 172.21.15.12:0/320762124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400b9c0 con 0x7f3784153a00 2023-10-08T16:21:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f37827fc700 1 -- 172.21.15.12:0/320762124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377400bd60 con 0x7f3784153a00 2023-10-08T16:21:58.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 -- 172.21.15.12:0/320762124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3784153a00 msgr2=0x7f3784153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 --2- 172.21.15.12:0/320762124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3784153a00 0x7f3784153dd0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f37840d03e0 tx=0x7f3774009250 comp rx=0 tx=0).stop 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 -- 172.21.15.12:0/320762124 shutdown_connections 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 --2- 172.21.15.12:0/320762124 >> v2:172.21.15.29:3300/0 conn(0x7f37840cea00 0x7f37840cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 --2- 172.21.15.12:0/320762124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3784153a00 0x7f3784153dd0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 -- 172.21.15.12:0/320762124 >> 172.21.15.12:0/320762124 conn(0x7f37840703a0 msgr2=0x7f37840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 -- 172.21.15.12:0/320762124 shutdown_connections 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.363+0000 7f3788f9d700 1 -- 172.21.15.12:0/320762124 wait complete. 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.365+0000 7f3788f9d700 1 Processor -- start 2023-10-08T16:21:58.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.365+0000 7f3788f9d700 1 -- start start 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37840cea00 0x7f3784151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3784153a00 0x7f378416a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378416a540 con 0x7f378415de50 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37840ca400 con 0x7f3784153a00 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3788f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37840c9e40 con 0x7f37840cea00 2023-10-08T16:21:58.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48880/0 (socket says 172.21.15.12:48880) 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 -- 172.21.15.12:0/1163447706 learned_addr learned my addr 172.21.15.12:0/1163447706 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f37837fe700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37840cea00 0x7f3784151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3782ffd700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3784153a00 0x7f378416a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 -- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37840cea00 msgr2=0x7f3784151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37840cea00 0x7f3784151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 -- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3784153a00 msgr2=0x7f378416a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3784153a00 0x7f378416a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.366+0000 7f3783fff700 1 -- 172.21.15.12:0/1163447706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740094f0 con 0x7f378415de50 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f3783fff700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f377c007f20 tx=0x7f377c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c00ebf0 con 0x7f378415de50 2023-10-08T16:21:58.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c00ed70 con 0x7f378415de50 2023-10-08T16:21:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377c014670 con 0x7f378415de50 2023-10-08T16:21:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37840ca120 con 0x7f378415de50 2023-10-08T16:21:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.367+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37840cc4f0 con 0x7f378415de50 2023-10-08T16:21:58.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.368+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f378404c3c0 con 0x7f378415de50 2023-10-08T16:21:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.369+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f377c0149e0 con 0x7f378415de50 2023-10-08T16:21:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.370+0000 7f376b7fe700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.370+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f377c084c40 con 0x7f378415de50 2023-10-08T16:21:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.370+0000 7f37837fe700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.371+0000 7f37837fe700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 0x7f37700693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37840d03e0 tx=0x7f3774017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.374+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f377c051d70 con 0x7f378415de50 2023-10-08T16:21:58.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.576+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3784152610 con 0x7f378415de50 2023-10-08T16:21:58.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.581+0000 7f376b7fe700 1 -- 172.21.15.12:0/1163447706 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v14) v1 ==== 104+0+0 (secure 0 0 0) 0x7f377c055390 con 0x7f378415de50 2023-10-08T16:21:58.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 msgr2=0x7f37700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 0x7f37700693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f37840d03e0 tx=0x7f3774017000 comp rx=0 tx=0).stop 2023-10-08T16:21:58.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 msgr2=0x7f37840cca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f377c007f20 tx=0x7f377c009860 comp rx=0 tx=0).stop 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 shutdown_connections 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3770066f30 0x7f37700693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f378415de50 0x7f37840cca10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37840cea00 0x7f3784151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 --2- 172.21.15.12:0/1163447706 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3784153a00 0x7f378416a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 >> 172.21.15.12:0/1163447706 conn(0x7f37840703a0 msgr2=0x7f378415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.583+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 shutdown_connections 2023-10-08T16:21:58.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.584+0000 7f3788f9d700 1 -- 172.21.15.12:0/1163447706 wait complete. 2023-10-08T16:21:58.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:21:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.790+0000 7f0f53fff700 1 Processor -- start 2023-10-08T16:21:58.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.790+0000 7f0f53fff700 1 -- start start 2023-10-08T16:21:58.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f53fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0f5406e0a0 0x7f0f54146f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f53fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f54069ee0 con 0x7f0f5406e470 2023-10-08T16:21:58.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f53fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f541478b0 con 0x7f0f54147450 2023-10-08T16:21:58.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f53fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f540cb7f0 con 0x7f0f5406e0a0 2023-10-08T16:21:58.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f527fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f5406e470 0x7f0f5406a370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46990/0 (socket says 172.21.15.12:46990) 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f527fc700 1 -- 172.21.15.12:0/3877483753 learned_addr learned my addr 172.21.15.12:0/3877483753 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f52ffd700 1 --2- 172.21.15.12:0/3877483753 >> v2:172.21.15.29:3300/0 conn(0x7f0f5406e0a0 0x7f0f54146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.792+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469904358 0 0) 0x7f0f54069ee0 con 0x7f0f5406e470 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f3c003570 con 0x7f0f5406e470 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f52ffd700 1 -- 172.21.15.12:0/3877483753 >> v1:172.21.15.29:6789/0 conn(0x7f0f54147450 legacy=0x7f0f540cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f52ffd700 1 -- 172.21.15.12:0/3877483753 >> v1:172.21.15.12:6789/0 conn(0x7f0f5406e470 legacy=0x7f0f5406a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617431046 0 0) 0x7f0f3c003570 con 0x7f0f5406e470 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f52ffd700 1 -- 172.21.15.12:0/3877483753 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f540cbad0 con 0x7f0f5406e0a0 2023-10-08T16:21:58.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f52ffd700 1 --2- 172.21.15.12:0/3877483753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f54146f10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098e0 tx=0x7f0f440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3845e536087fa0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.793+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f48001470 con 0x7f0f5406e0a0 2023-10-08T16:21:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44011420 con 0x7f0f5406e0a0 2023-10-08T16:21:58.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f51ffb700 1 -- 172.21.15.12:0/3877483753 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440117c0 con 0x7f0f5406e0a0 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 -- 172.21.15.12:0/3877483753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 msgr2=0x7f0f54146f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 --2- 172.21.15.12:0/3877483753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f54146f10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0f440098e0 tx=0x7f0f440091a0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 -- 172.21.15.12:0/3877483753 shutdown_connections 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 --2- 172.21.15.12:0/3877483753 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f54146f10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 -- 172.21.15.12:0/3877483753 >> 172.21.15.12:0/3877483753 conn(0x7f0f5406d110 msgr2=0x7f0f540cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 -- 172.21.15.12:0/3877483753 shutdown_connections 2023-10-08T16:21:58.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.794+0000 7f0f53fff700 1 -- 172.21.15.12:0/3877483753 wait complete. 2023-10-08T16:21:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.796+0000 7f0f53fff700 1 Processor -- start 2023-10-08T16:21:58.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.796+0000 7f0f53fff700 1 -- start start 2023-10-08T16:21:58.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.796+0000 7f0f53fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f540c5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f53fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5406e470 0x7f0f54145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f53fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f53fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c6050 con 0x7f0f54147450 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f53fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c3970 con 0x7f0f5406e0a0 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f53fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f540c3c50 con 0x7f0f5406e470 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48894/0 (socket says 172.21.15.12:48894) 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 -- 172.21.15.12:0/4204643500 learned_addr learned my addr 172.21.15.12:0/4204643500 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f52ffd700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f540c5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f527fc700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5406e470 0x7f0f54145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 -- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5406e470 msgr2=0x7f0f54145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5406e470 0x7f0f54145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 -- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 msgr2=0x7f0f540c5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f540c5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.797+0000 7f0f537fe700 1 -- 172.21.15.12:0/4204643500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f44009420 con 0x7f0f54147450 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f537fe700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c840 tx=0x7f0f4c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c012630 con 0x7f0f54147450 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c0127b0 con 0x7f0f54147450 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f540c3f30 con 0x7f0f54147450 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c012b70 con 0x7f0f54147450 2023-10-08T16:21:58.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.798+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f540c44f0 con 0x7f0f54147450 2023-10-08T16:21:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.799+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f540c4710 con 0x7f0f54147450 2023-10-08T16:21:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.800+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f4c01a3a0 con 0x7f0f54147450 2023-10-08T16:21:58.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.801+0000 7f0f3affd700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 0x7f0f400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.801+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f0f4c0847a0 con 0x7f0f54147450 2023-10-08T16:21:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.801+0000 7f0f52ffd700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 0x7f0f400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:58.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.802+0000 7f0f52ffd700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 0x7f0f400693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f440091e0 tx=0x7f0f44016000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:58.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:58.805+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f4c0518d0 con 0x7f0f54147450 2023-10-08T16:21:59.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.007+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f0f540b0590 con 0x7f0f54147450 2023-10-08T16:21:59.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.011+0000 7f0f3affd700 1 -- 172.21.15.12:0/4204643500 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0f4c054ef0 con 0x7f0f54147450 2023-10-08T16:21:59.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 msgr2=0x7f0f400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 0x7f0f400693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0f440091e0 tx=0x7f0f44016000 comp rx=0 tx=0).stop 2023-10-08T16:21:59.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 msgr2=0x7f0f540cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c840 tx=0x7f0f4c001670 comp rx=0 tx=0).stop 2023-10-08T16:21:59.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 shutdown_connections 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0f40066f30 0x7f0f400693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f54147450 0x7f0f540cc100 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f5406e0a0 0x7f0f540c5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 --2- 172.21.15.12:0/4204643500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5406e470 0x7f0f54145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 >> 172.21.15.12:0/4204643500 conn(0x7f0f5406d110 msgr2=0x7f0f540c1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.013+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 shutdown_connections 2023-10-08T16:21:59.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.014+0000 7f0f53fff700 1 -- 172.21.15.12:0/4204643500 wait complete. 2023-10-08T16:21:59.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-10-08T16:21:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.220+0000 7f314cb9d700 1 Processor -- start 2023-10-08T16:21:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.220+0000 7f314cb9d700 1 -- start start 2023-10-08T16:21:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.221+0000 7f314cb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f314813fb20 0x7f314815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.221+0000 7f314cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 0x7f31480c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.221+0000 7f314cb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314815ae70 con 0x7f314806aaa0 2023-10-08T16:21:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.221+0000 7f314cb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314806af60 con 0x7f314813fb20 2023-10-08T16:21:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.221+0000 7f314cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314806b240 con 0x7f314813fef0 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f314813fb20 0x7f314815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f314813fb20 0x7f314815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48904/0 (socket says 172.21.15.12:48904) 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 -- 172.21.15.12:0/1400224362 learned_addr learned my addr 172.21.15.12:0/1400224362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 -- 172.21.15.12:0/1400224362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 msgr2=0x7f31480c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f3146ffd700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 0x7f31480c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 0x7f31480c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 -- 172.21.15.12:0/1400224362 >> v1:172.21.15.29:6789/0 conn(0x7f314806aaa0 legacy=0x7f31480c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 -- 172.21.15.12:0/1400224362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314806b520 con 0x7f314813fb20 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f3146ffd700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 0x7f31480c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.222+0000 7f31477fe700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fb20 0x7f314815a930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f313800bc50 tx=0x7f313800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd9dffd3299da1a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f31467fc700 1 -- 172.21.15.12:0/1400224362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313800be60 con 0x7f314813fb20 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f31467fc700 1 -- 172.21.15.12:0/1400224362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313800ddc0 con 0x7f314813fb20 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f31467fc700 1 -- 172.21.15.12:0/1400224362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380106a0 con 0x7f314813fb20 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 -- 172.21.15.12:0/1400224362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fb20 msgr2=0x7f314815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fb20 0x7f314815a930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f313800bc50 tx=0x7f313800b4f0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 -- 172.21.15.12:0/1400224362 shutdown_connections 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fb20 0x7f314815a930 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 --2- 172.21.15.12:0/1400224362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314813fef0 0x7f31480c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 -- 172.21.15.12:0/1400224362 >> 172.21.15.12:0/1400224362 conn(0x7f314806d170 msgr2=0x7f31480cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 -- 172.21.15.12:0/1400224362 shutdown_connections 2023-10-08T16:21:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.223+0000 7f314cb9d700 1 -- 172.21.15.12:0/1400224362 wait complete. 2023-10-08T16:21:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.225+0000 7f314cb9d700 1 Processor -- start 2023-10-08T16:21:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.225+0000 7f314cb9d700 1 -- start start 2023-10-08T16:21:59.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314806aaa0 0x7f3148165560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f314813fb20 0x7f3148155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148157d20 con 0x7f314813fef0 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148156e90 con 0x7f314813fb20 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f314cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3148157110 con 0x7f314806aaa0 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48914/0 (socket says 172.21.15.12:48914) 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 -- 172.21.15.12:0/2221405849 learned_addr learned my addr 172.21.15.12:0/2221405849 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3146ffd700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f314813fb20 0x7f3148155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f31477fe700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314806aaa0 0x7f3148165560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 -- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314806aaa0 msgr2=0x7f3148165560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314806aaa0 0x7f3148165560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 -- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f314813fb20 msgr2=0x7f3148155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f314813fb20 0x7f3148155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.226+0000 7f3147fff700 1 -- 172.21.15.12:0/2221405849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313800b790 con 0x7f314813fef0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f3147fff700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f314000bb60 tx=0x7f31400097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000c7e0 con 0x7f314813fef0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000c960 con 0x7f314813fef0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31481573f0 con 0x7f314813fef0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314000cd20 con 0x7f314813fef0 2023-10-08T16:21:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.227+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31481579b0 con 0x7f314813fef0 2023-10-08T16:21:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.228+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314804c3c0 con 0x7f314813fef0 2023-10-08T16:21:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.229+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3140014620 con 0x7f314813fef0 2023-10-08T16:21:59.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.230+0000 7f312f7fe700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 0x7f31340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.230+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f31400844a0 con 0x7f314813fef0 2023-10-08T16:21:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.230+0000 7f31477fe700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 0x7f31340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.231+0000 7f31477fe700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 0x7f31340693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f313800bc50 tx=0x7f313801a000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.234+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f314004c5a0 con 0x7f314813fef0 2023-10-08T16:21:59.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.516+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f3148069ac0 con 0x7f314813fef0 2023-10-08T16:21:59.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.703+0000 7f312f7fe700 1 -- 172.21.15.12:0/2221405849 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v463) v1 ==== 158+0+0 (secure 0 0 0) 0x7f3140051670 con 0x7f314813fef0 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 msgr2=0x7f31340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 0x7f31340693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f313800bc50 tx=0x7f313801a000 comp rx=0 tx=0).stop 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 msgr2=0x7f3148156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f314000bb60 tx=0x7f31400097f0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 shutdown_connections 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3134066f30 0x7f31340693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f314813fef0 0x7f3148156950 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f314806aaa0 0x7f3148165560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 --2- 172.21.15.12:0/2221405849 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f314813fb20 0x7f3148155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 >> 172.21.15.12:0/2221405849 conn(0x7f314806d170 msgr2=0x7f314813c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 shutdown_connections 2023-10-08T16:21:59.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.706+0000 7f314cb9d700 1 -- 172.21.15.12:0/2221405849 wait complete. 2023-10-08T16:21:59.723 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-10-08T16:21:59.724 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-10-08T16:21:59.724 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:21:59.724 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-08T16:21:59.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.912+0000 7ffabaf9d700 1 Processor -- start 2023-10-08T16:21:59.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.912+0000 7ffabaf9d700 1 -- start start 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffabaf9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab4140e40 0x7ffab40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffabaf9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffab406de50 0x7ffab40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffabaf9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab40c6d50 con 0x7ffab4140a70 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffabaf9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40c7030 con 0x7ffab4140e40 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffabaf9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40c7310 con 0x7ffab406de50 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffab979a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab4140e40 0x7ffab40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffab979a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffab4140e40 0x7ffab40c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48918/0 (socket says 172.21.15.12:48918) 2023-10-08T16:21:59.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.913+0000 7ffab979a700 1 -- 172.21.15.12:0/51659668 learned_addr learned my addr 172.21.15.12:0/51659668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:59.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffaba79c700 1 --2- 172.21.15.12:0/51659668 >> v2:172.21.15.29:3300/0 conn(0x7ffab406de50 0x7ffab40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab979a700 1 -- 172.21.15.12:0/51659668 >> v2:172.21.15.29:3300/0 conn(0x7ffab406de50 msgr2=0x7ffab40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab979a700 1 --2- 172.21.15.12:0/51659668 >> v2:172.21.15.29:3300/0 conn(0x7ffab406de50 0x7ffab40aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab979a700 1 -- 172.21.15.12:0/51659668 >> v1:172.21.15.29:6789/0 conn(0x7ffab4140a70 legacy=0x7ffab40c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab979a700 1 -- 172.21.15.12:0/51659668 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40c75f0 con 0x7ffab4140e40 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab979a700 1 --2- 172.21.15.12:0/51659668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140e40 0x7ffab40c6770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffab40aec50 tx=0x7ffaa4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8932cb5726bea46c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab8f99700 1 -- 172.21.15.12:0/51659668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4005c10 con 0x7ffab4140e40 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab8f99700 1 -- 172.21.15.12:0/51659668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4005d70 con 0x7ffab4140e40 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.914+0000 7ffab8f99700 1 -- 172.21.15.12:0/51659668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400b880 con 0x7ffab4140e40 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 -- 172.21.15.12:0/51659668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140e40 msgr2=0x7ffab40c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/51659668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140e40 0x7ffab40c6770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ffab40aec50 tx=0x7ffaa4009220 comp rx=0 tx=0).stop 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 -- 172.21.15.12:0/51659668 shutdown_connections 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/51659668 >> v2:172.21.15.29:3300/0 conn(0x7ffab406de50 0x7ffab40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/51659668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140e40 0x7ffab40c6770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 -- 172.21.15.12:0/51659668 >> 172.21.15.12:0/51659668 conn(0x7ffab406d170 msgr2=0x7ffab40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 -- 172.21.15.12:0/51659668 shutdown_connections 2023-10-08T16:21:59.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.915+0000 7ffabaf9d700 1 -- 172.21.15.12:0/51659668 wait complete. 2023-10-08T16:21:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.917+0000 7ffabaf9d700 1 Processor -- start 2023-10-08T16:21:59.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.917+0000 7ffabaf9d700 1 -- start start 2023-10-08T16:21:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab406de50 0x7ffab40c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffab4140e40 0x7ffab4158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4159600 con 0x7ffab4140a70 2023-10-08T16:21:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4157ad0 con 0x7ffab406de50 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffabaf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab4158090 con 0x7ffab4140e40 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48924/0 (socket says 172.21.15.12:48924) 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 -- 172.21.15.12:0/2304728001 learned_addr learned my addr 172.21.15.12:0/2304728001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab9f9b700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab406de50 0x7ffab40c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffaba79c700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffab4140e40 0x7ffab4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 -- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffab4140e40 msgr2=0x7ffab4158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffab4140e40 0x7ffab4158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 -- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab406de50 msgr2=0x7ffab40c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab406de50 0x7ffab40c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:21:59.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.918+0000 7ffab979a700 1 -- 172.21.15.12:0/2304728001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4009480 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffab979a700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4012000 tx=0x7ffaa4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40118e0 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa4020070 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4011cb0 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab4158a60 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.919+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab40c4880 con 0x7ffab4140a70 2023-10-08T16:21:59.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.920+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab4158240 con 0x7ffab4140a70 2023-10-08T16:21:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.921+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffaa4022030 con 0x7ffab4140a70 2023-10-08T16:21:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.922+0000 7ffaa9ffb700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 0x7ffa980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:21:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.922+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7ffaa4086280 con 0x7ffab4140a70 2023-10-08T16:21:59.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.923+0000 7ffab9f9b700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 0x7ffa980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:21:59.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.923+0000 7ffab9f9b700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 0x7ffa980693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffab4158e20 tx=0x7ffab0009040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:21:59.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:21:59.927+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffab4158240 con 0x7ffab4140a70 2023-10-08T16:22:00.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.209+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7ffab4158200 con 0x7ffab4140a70 2023-10-08T16:22:00.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.708+0000 7ffaa9ffb700 1 -- 172.21.15.12:0/2304728001 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v464) v1 ==== 157+0+0 (secure 0 0 0) 0x7ffaa40533b0 con 0x7ffab4140a70 2023-10-08T16:22:00.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 msgr2=0x7ffa980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 0x7ffa980693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ffab4158e20 tx=0x7ffab0009040 comp rx=0 tx=0).stop 2023-10-08T16:22:00.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 msgr2=0x7ffab41590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4012000 tx=0x7ffaa4016000 comp rx=0 tx=0).stop 2023-10-08T16:22:00.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 shutdown_connections 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ffa98066f30 0x7ffa980693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffab4140e40 0x7ffab4158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffab406de50 0x7ffab40c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 --2- 172.21.15.12:0/2304728001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffab4140a70 0x7ffab41590c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.710+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 >> 172.21.15.12:0/2304728001 conn(0x7ffab406d170 msgr2=0x7ffab40c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.711+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 shutdown_connections 2023-10-08T16:22:00.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.711+0000 7ffabaf9d700 1 -- 172.21.15.12:0/2304728001 wait complete. 2023-10-08T16:22:00.730 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:22:00.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.922+0000 7f1dae39d700 1 Processor -- start 2023-10-08T16:22:00.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.922+0000 7f1dae39d700 1 -- start start 2023-10-08T16:22:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dae39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1da806e560 0x7f1da80c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dae39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80c7e70 con 0x7f1da8155c60 2023-10-08T16:22:00.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dae39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da806b790 con 0x7f1da8155890 2023-10-08T16:22:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dae39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da806ab80 con 0x7f1da806e560 2023-10-08T16:22:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dacb9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1da8155c60 0x7f1da806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46994/0 (socket says 172.21.15.12:46994) 2023-10-08T16:22:00.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dacb9a700 1 -- 172.21.15.12:0/3388352685 learned_addr learned my addr 172.21.15.12:0/3388352685 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1dadb9c700 1 --2- 172.21.15.12:0/3388352685 >> v2:172.21.15.29:3300/0 conn(0x7f1da806e560 0x7f1da80c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886235170 0 0) 0x7f1da80c7e70 con 0x7f1da8155c60 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.924+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d94003570 con 0x7f1da8155c60 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910511231 0 0) 0x7f1d94003570 con 0x7f1da8155c60 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 >> v2:172.21.15.29:3300/0 conn(0x7f1da806e560 msgr2=0x7f1da80c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 --2- 172.21.15.12:0/3388352685 >> v2:172.21.15.29:3300/0 conn(0x7f1da806e560 0x7f1da80c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 >> v1:172.21.15.29:6789/0 conn(0x7f1da8155890 legacy=0x7f1da806a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da806ae60 con 0x7f1da8155c60 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1d98001470 con 0x7f1da8155c60 2023-10-08T16:22:00.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 >> v1:172.21.15.12:6789/0 conn(0x7f1da8155c60 legacy=0x7f1da806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d94003ab0 0x7f1d94003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94004810 0x7f1d94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1d9400dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da806ab80 con 0x7f1d94005210 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9400e3c0 con 0x7f1d94004810 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9400e580 con 0x7f1d94003ab0 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dadb9c700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1d9400dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dacb9a700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94004810 0x7f1d94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dad39b700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d94003ab0 0x7f1d94003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dadb9c700 1 -- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d94003ab0 msgr2=0x7f1d94003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dadb9c700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d94003ab0 0x7f1d94003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dadb9c700 1 -- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94004810 msgr2=0x7f1d94004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.925+0000 7f1dadb9c700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d94004810 0x7f1d94004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1dadb9c700 1 -- 172.21.15.12:0/3388352685 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d94003570 con 0x7f1d94005210 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1dadb9c700 1 -- 172.21.15.12:0/3388352685 reap_dead start 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1dadb9c700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1d9400dc70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1da806f870 tx=0x7f1da000a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181828efd3eeffbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da000acc0 con 0x7f1d94005210 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0010040 con 0x7f1d94005210 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.926+0000 7f1d9ffff700 1 -- 172.21.15.12:0/3388352685 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0009dd0 con 0x7f1d94005210 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 -- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 msgr2=0x7f1d9400dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1d9400dc70 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f1da806f870 tx=0x7f1da000a890 comp rx=0 tx=0).stop 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 -- 172.21.15.12:0/3388352685 shutdown_connections 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 --2- 172.21.15.12:0/3388352685 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1d9400dc70 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 -- 172.21.15.12:0/3388352685 >> 172.21.15.12:0/3388352685 conn(0x7f1da806d110 msgr2=0x7f1da80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 -- 172.21.15.12:0/3388352685 shutdown_connections 2023-10-08T16:22:00.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.927+0000 7f1dae39d700 1 -- 172.21.15.12:0/3388352685 wait complete. 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.928+0000 7f1dae39d700 1 Processor -- start 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.928+0000 7f1dae39d700 1 -- start start 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da81638e0 0x7f1da81582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1da8163d50 0x7f1da8158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80afec0 con 0x7f1d94005210 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80b0c50 con 0x7f1da81638e0 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dae39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80af2b0 con 0x7f1da8163d50 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.929+0000 7f1dad39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48936/0 (socket says 172.21.15.12:48936) 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 -- 172.21.15.12:0/4183668342 learned_addr learned my addr 172.21.15.12:0/4183668342 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 -- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1da8163d50 msgr2=0x7f1da8158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1da8163d50 0x7f1da8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 -- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da81638e0 msgr2=0x7f1da81582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da81638e0 0x7f1da81582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 -- 172.21.15.12:0/4183668342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80af590 con 0x7f1d94005210 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dad39b700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1da4002950 tx=0x7f1da4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4002e90 con 0x7f1d94005210 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400f8d0 con 0x7f1d94005210 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80af870 con 0x7f1d94005210 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.930+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400fc90 con 0x7f1d94005210 2023-10-08T16:22:00.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.931+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da816aa10 con 0x7f1d94005210 2023-10-08T16:22:00.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.932+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da80afd10 con 0x7f1d94005210 2023-10-08T16:22:00.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.932+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1da4006820 con 0x7f1d94005210 2023-10-08T16:22:00.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.933+0000 7f1d9d7fa700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 0x7f1d8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:00.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.933+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f1da4084740 con 0x7f1d94005210 2023-10-08T16:22:00.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.934+0000 7f1dacb9a700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 0x7f1d8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:00.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.934+0000 7f1dacb9a700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 0x7f1d8c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d98001e90 tx=0x7f1d98001d80 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:00.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:00.938+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1da4051910 con 0x7f1d94005210 2023-10-08T16:22:01.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.140+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1da804c3c0 con 0x7f1d94005210 2023-10-08T16:22:01.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.145+0000 7f1d9d7fa700 1 -- 172.21.15.12:0/4183668342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1da4054f30 con 0x7f1d94005210 2023-10-08T16:22:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 msgr2=0x7f1d8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 0x7f1d8c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1d98001e90 tx=0x7f1d98001d80 comp rx=0 tx=0).stop 2023-10-08T16:22:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 msgr2=0x7f1da816a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1da4002950 tx=0x7f1da4007d30 comp rx=0 tx=0).stop 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 shutdown_connections 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1d8c066f30 0x7f1d8c0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d94005210 0x7f1da816a4d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1da8163d50 0x7f1da8158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 --2- 172.21.15.12:0/4183668342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1da81638e0 0x7f1da81582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 >> 172.21.15.12:0/4183668342 conn(0x7f1da806d110 msgr2=0x7f1da80caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 shutdown_connections 2023-10-08T16:22:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.148+0000 7f1dae39d700 1 -- 172.21.15.12:0/4183668342 wait complete. 2023-10-08T16:22:01.166 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:22:01.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:22:01.246 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:22:01.339 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:22:01.339 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:22:01.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:22:01.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.527+0000 7f621739d700 1 Processor -- start 2023-10-08T16:22:01.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.528+0000 7f621739d700 1 -- start start 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621739d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6210140a70 0x7f62100c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621739d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100c6d50 con 0x7f621006de50 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621739d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100c7030 con 0x7f6210140e40 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621739d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100c7310 con 0x7f6210140a70 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621639b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6210140a70 0x7f62100c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621639b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6210140a70 0x7f62100c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48940/0 (socket says 172.21.15.12:48940) 2023-10-08T16:22:01.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.529+0000 7f621639b700 1 -- 172.21.15.12:0/4198521667 learned_addr learned my addr 172.21.15.12:0/4198521667 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f621639b700 1 -- 172.21.15.12:0/4198521667 >> v1:172.21.15.29:6789/0 conn(0x7f6210140e40 legacy=0x7f62100c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f621639b700 1 -- 172.21.15.12:0/4198521667 >> v1:172.21.15.12:6789/0 conn(0x7f621006de50 legacy=0x7f62100aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f621639b700 1 -- 172.21.15.12:0/4198521667 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100c75f0 con 0x7f6210140a70 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f621639b700 1 --2- 172.21.15.12:0/4198521667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f62100c6770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f620c0099b0 tx=0x7f620c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0d5984a6ae60a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f6215399700 1 -- 172.21.15.12:0/4198521667 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00b860 con 0x7f6210140a70 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f6215399700 1 -- 172.21.15.12:0/4198521667 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00b9c0 con 0x7f6210140a70 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.530+0000 7f6215399700 1 -- 172.21.15.12:0/4198521667 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00bd60 con 0x7f6210140a70 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 -- 172.21.15.12:0/4198521667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 msgr2=0x7f62100c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 --2- 172.21.15.12:0/4198521667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f62100c6770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f620c0099b0 tx=0x7f620c009250 comp rx=0 tx=0).stop 2023-10-08T16:22:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 -- 172.21.15.12:0/4198521667 shutdown_connections 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 --2- 172.21.15.12:0/4198521667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f62100c6770 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 -- 172.21.15.12:0/4198521667 >> 172.21.15.12:0/4198521667 conn(0x7f621006d170 msgr2=0x7f62100cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 -- 172.21.15.12:0/4198521667 shutdown_connections 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.531+0000 7f621739d700 1 -- 172.21.15.12:0/4198521667 wait complete. 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.533+0000 7f621739d700 1 Processor -- start 2023-10-08T16:22:01.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.533+0000 7f621739d700 1 -- start start 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621006de50 0x7f62100c5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 0x7f62100ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621015a3c0 con 0x7f6210140a70 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62101597b0 con 0x7f621006de50 2023-10-08T16:22:01.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6210159a90 con 0x7f6210140e40 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48954/0 (socket says 172.21.15.12:48954) 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 -- 172.21.15.12:0/750585550 learned_addr learned my addr 172.21.15.12:0/750585550 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f621639b700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621006de50 0x7f62100c5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6216b9c700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 0x7f62100ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 -- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 msgr2=0x7f62100ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 0x7f62100ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 -- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621006de50 msgr2=0x7f62100c5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621006de50 0x7f62100c5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6215b9a700 1 -- 172.21.15.12:0/750585550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620c0094f0 con 0x7f6210140a70 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.534+0000 7f6216b9c700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 0x7f62100ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:01.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f6215b9a700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f620000c510 tx=0x7f6200001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:01.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200011590 con 0x7f6210140a70 2023-10-08T16:22:01.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62000116f0 con 0x7f6210140a70 2023-10-08T16:22:01.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200011ab0 con 0x7f6210140a70 2023-10-08T16:22:01.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210159d70 con 0x7f6210140a70 2023-10-08T16:22:01.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.535+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62100c6440 con 0x7f6210140a70 2023-10-08T16:22:01.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.536+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621015a210 con 0x7f6210140a70 2023-10-08T16:22:01.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.537+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f620001b3b0 con 0x7f6210140a70 2023-10-08T16:22:01.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.538+0000 7f62067fc700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 0x7f61f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:01.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.538+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f6200083a20 con 0x7f6210140a70 2023-10-08T16:22:01.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.538+0000 7f621639b700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 0x7f61f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:01.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.539+0000 7f621639b700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 0x7f61f40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f620c0099b0 tx=0x7f620c017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:01.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.542+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6200050c00 con 0x7f6210140a70 2023-10-08T16:22:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.788+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f621004c3c0 con 0x7f6210140a70 2023-10-08T16:22:01.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.788+0000 7f62067fc700 1 -- 172.21.15.12:0/750585550 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f6200017070 con 0x7f6210140a70 2023-10-08T16:22:01.788 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:01.788 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6837/1159134165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":1159134165},{"type":"v1","addr":"172.21.15.12:6837","nonce":1159134165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4703,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/913556761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":913556761},{"type":"v1","addr":"172.21.15.29:6833","nonce":913556761}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4709,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1149609271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1149609271},{"type":"v1","addr":"172.21.15.29:6835","nonce":1149609271}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13},{"gid":5198,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/792554251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":792554251},{"type":"v1","addr":"172.21.15.12:6833","nonce":792554251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-08T16:22:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 msgr2=0x7f61f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 0x7f61f40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f620c0099b0 tx=0x7f620c017000 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 msgr2=0x7f621016b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f620000c510 tx=0x7f6200001070 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 shutdown_connections 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f61f4066f30 0x7f61f40693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6210140e40 0x7f62100ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f621006de50 0x7f62100c5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 --2- 172.21.15.12:0/750585550 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6210140a70 0x7f621016b6d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 >> 172.21.15.12:0/750585550 conn(0x7f621006d170 msgr2=0x7f62100b18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 shutdown_connections 2023-10-08T16:22:01.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:01.791+0000 7f621739d700 1 -- 172.21.15.12:0/750585550 wait complete. 2023-10-08T16:22:01.793 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 20 2023-10-08T16:22:01.808 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:22:01.809 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:22:01.809 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:22:01.809 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:22:01.809 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:22:01.809 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:22:01.809 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:22:01.809 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:22:01.810 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:22:01.810 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:22:01.810 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:22:01.810 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:22:01.810 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:22:01.810 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:22:01.810 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:22:01.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:22:01.823 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:22:01.823 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:22:01.824 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:22:01.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:22:01.826 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:22:01.827 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:22:01.828 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:22:01.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:22:01.868 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:22:01.868 DEBUG:teuthology.parallel:result is None 2023-10-08T16:22:01.871 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:22:01.871 DEBUG:teuthology.parallel:result is None 2023-10-08T16:22:01.872 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:22:01.872 DEBUG:teuthology.parallel:result is None 2023-10-08T16:22:01.875 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:22:01.875 DEBUG:teuthology.parallel:result is None 2023-10-08T16:22:01.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:22:02.003 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:22:02.007 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:22:02.013 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:22:02.014 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:22:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.077+0000 7f5249b9d700 1 Processor -- start 2023-10-08T16:22:02.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.077+0000 7f5249b9d700 1 -- start start 2023-10-08T16:22:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5249b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52440cf110 0x7f5244164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5249b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415afd0 con 0x7f5244153c30 2023-10-08T16:22:02.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5249b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f524415b2b0 con 0x7f524415de50 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5249b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f524415b590 con 0x7f52440cf110 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5248b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5244153c30 0x7f524415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47034/0 (socket says 172.21.15.12:47034) 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.078+0000 7f5248b9b700 1 -- 172.21.15.12:0/1446956759 learned_addr learned my addr 172.21.15.12:0/1446956759 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f524939c700 1 --2- 172.21.15.12:0/1446956759 >> v2:172.21.15.29:3300/0 conn(0x7f52440cf110 0x7f5244164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653580266 0 0) 0x7f524415afd0 con 0x7f5244153c30 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5234003570 con 0x7f5244153c30 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625688989 0 0) 0x7f524415b2b0 con 0x7f524415de50 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f524939c700 1 -- 172.21.15.12:0/1446956759 >> v1:172.21.15.29:6789/0 conn(0x7f524415de50 legacy=0x7f52440cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f524939c700 1 -- 172.21.15.12:0/1446956759 >> v1:172.21.15.12:6789/0 conn(0x7f5244153c30 legacy=0x7f524415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:02.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f524939c700 1 -- 172.21.15.12:0/1446956759 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524415b870 con 0x7f52440cf110 2023-10-08T16:22:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.079+0000 7f524939c700 1 --2- 172.21.15.12:0/1446956759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244164600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f523c009e60 tx=0x7f523c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60077d8397663d42 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c00e070 con 0x7f52440cf110 2023-10-08T16:22:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c00bb60 con 0x7f52440cf110 2023-10-08T16:22:02.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f52437fe700 1 -- 172.21.15.12:0/1446956759 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c012430 con 0x7f52440cf110 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 -- 172.21.15.12:0/1446956759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 msgr2=0x7f5244164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 --2- 172.21.15.12:0/1446956759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244164600 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f523c009e60 tx=0x7f523c009780 comp rx=0 tx=0).stop 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 -- 172.21.15.12:0/1446956759 shutdown_connections 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 --2- 172.21.15.12:0/1446956759 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244164600 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 -- 172.21.15.12:0/1446956759 >> 172.21.15.12:0/1446956759 conn(0x7f52440703a0 msgr2=0x7f52440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 -- 172.21.15.12:0/1446956759 shutdown_connections 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.080+0000 7f5249b9d700 1 -- 172.21.15.12:0/1446956759 wait complete. 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.082+0000 7f5249b9d700 1 Processor -- start 2023-10-08T16:22:02.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.082+0000 7f5249b9d700 1 -- start start 2023-10-08T16:22:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 0x7f52440af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:02.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f524415de50 0x7f524406b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52441520f0 con 0x7f5244153c30 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52440b3c70 con 0x7f52440cf110 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5249b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52440ca030 con 0x7f524415de50 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5248b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5243fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 0x7f52440af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5248b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:60956/0 (socket says 172.21.15.12:60956) 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f5248b9b700 1 -- 172.21.15.12:0/175581382 learned_addr learned my addr 172.21.15.12:0/175581382 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.083+0000 7f524939c700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f524415de50 0x7f524406b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 -- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f524415de50 msgr2=0x7f524406b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f524415de50 0x7f524406b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:02.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 -- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 msgr2=0x7f52440af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 0x7f52440af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 -- 172.21.15.12:0/175581382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009a20 con 0x7f52440cf110 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5243fff700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 0x7f52440af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5248b9b700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f523800c790 tx=0x7f5238007df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238005b30 con 0x7f52440cf110 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5238005c90 con 0x7f52440cf110 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52440ca310 con 0x7f52440cf110 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5238007320 con 0x7f52440cf110 2023-10-08T16:22:02.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.084+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52440cd810 con 0x7f52440cf110 2023-10-08T16:22:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.085+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52440b3fa0 con 0x7f52440cf110 2023-10-08T16:22:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.086+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5238007690 con 0x7f52440cf110 2023-10-08T16:22:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.087+0000 7f5240ff9700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.087+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f5238083a80 con 0x7f52440cf110 2023-10-08T16:22:02.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.087+0000 7f5243fff700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:02.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.088+0000 7f5243fff700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 0x7f52280693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52440cd490 tx=0x7f5230009040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:02.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.092+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5238050bb0 con 0x7f52440cf110 2023-10-08T16:22:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:02.314+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f524404c3c0 con 0x7f52440cf110 2023-10-08T16:22:03.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.178+0000 7f5240ff9700 1 -- 172.21.15.12:0/175581382 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5238017020 con 0x7f52440cf110 2023-10-08T16:22:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 msgr2=0x7f52280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 0x7f52280693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f52440cd490 tx=0x7f5230009040 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 msgr2=0x7f5244151bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f523800c790 tx=0x7f5238007df0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 shutdown_connections 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f5228066f30 0x7f52280693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f524415de50 0x7f524406b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52440cf110 0x7f5244151bb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 --2- 172.21.15.12:0/175581382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5244153c30 0x7f52440af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.181+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 >> 172.21.15.12:0/175581382 conn(0x7f52440703a0 msgr2=0x7f524406d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.182+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 shutdown_connections 2023-10-08T16:22:03.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.182+0000 7f5249b9d700 1 -- 172.21.15.12:0/175581382 wait complete. 2023-10-08T16:22:03.183 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:22:03.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:22:03.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.392+0000 7f884bfff700 1 Processor -- start 2023-10-08T16:22:03.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.392+0000 7f884bfff700 1 -- start start 2023-10-08T16:22:03.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.393+0000 7f884bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f884c0c1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.393+0000 7f884bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f884c159910 0x7f884c0677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.393+0000 7f884bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c068250 con 0x7f884c067cf0 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.393+0000 7f884bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c068530 con 0x7f884c159910 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.393+0000 7f884bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c068810 con 0x7f884c159540 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f884b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f884c067cf0 0x7f884c0c6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33058/0 (socket says 172.21.15.12:33058) 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f884b7fe700 1 -- 172.21.15.12:0/3494840894 learned_addr learned my addr 172.21.15.12:0/3494840894 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f884affd700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f884c0c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f884a7fc700 1 --2- 172.21.15.12:0/3494840894 >> v2:172.21.15.29:3300/0 conn(0x7f884c159910 0x7f884c0677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895457215 0 0) 0x7f884c068250 con 0x7f884c067cf0 2023-10-08T16:22:03.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8834003570 con 0x7f884c067cf0 2023-10-08T16:22:03.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829298448 0 0) 0x7f8834003570 con 0x7f884c067cf0 2023-10-08T16:22:03.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 msgr2=0x7f884c0c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f884c0c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 >> v2:172.21.15.29:3300/0 conn(0x7f884c159910 msgr2=0x7f884c0677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 --2- 172.21.15.12:0/3494840894 >> v2:172.21.15.29:3300/0 conn(0x7f884c159910 0x7f884c0677b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0a9ca0 con 0x7f884c067cf0 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f88440017f0 con 0x7f884c067cf0 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.394+0000 7f884a7fc700 1 --2- 172.21.15.12:0/3494840894 >> v2:172.21.15.29:3300/0 conn(0x7f884c159910 0x7f884c0677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 >> v1:172.21.15.12:6789/0 conn(0x7f884c067cf0 legacy=0x7f884c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f8834003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8834004810 0x7f8834004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f88340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c068530 con 0x7f8834003a60 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c068810 con 0x7f8834004810 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883400ba60 con 0x7f884c159540 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f8834003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884b7fe700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f88340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884a7fc700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8834004810 0x7f8834004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 -- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 msgr2=0x7f88340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f88340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 -- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8834004810 msgr2=0x7f8834004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8834004810 0x7f8834004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884affd700 1 -- 172.21.15.12:0/3494840894 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8834003570 con 0x7f8834003a60 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.395+0000 7f884b7fe700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c159540 0x7f88340051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884affd700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f8834003e70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f883c009c30 tx=0x7f883c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ef9208f0fde866 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00e710 con 0x7f8834003a60 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00e870 con 0x7f8834003a60 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f8849ffb700 1 -- 172.21.15.12:0/3494840894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c00ec30 con 0x7f8834003a60 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 -- 172.21.15.12:0/3494840894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 msgr2=0x7f8834003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 --2- 172.21.15.12:0/3494840894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f8834003e70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f883c009c30 tx=0x7f883c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884b7fe700 1 -- 172.21.15.12:0/3494840894 reap_dead start 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 -- 172.21.15.12:0/3494840894 shutdown_connections 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 -- 172.21.15.12:0/3494840894 >> 172.21.15.12:0/3494840894 conn(0x7f884c06f310 msgr2=0x7f884c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 -- 172.21.15.12:0/3494840894 shutdown_connections 2023-10-08T16:22:03.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.396+0000 7f884bfff700 1 -- 172.21.15.12:0/3494840894 wait complete. 2023-10-08T16:22:03.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.398+0000 7f884bfff700 1 Processor -- start 2023-10-08T16:22:03.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.398+0000 7f884bfff700 1 -- start start 2023-10-08T16:22:03.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 0x7f884c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 0x7f884c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c15c160 con 0x7f8834003a60 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c14cc50 con 0x7f884c1585e0 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c06b150 con 0x7f884c15b780 2023-10-08T16:22:03.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33796/0 (socket says 172.21.15.12:33796) 2023-10-08T16:22:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 -- 172.21.15.12:0/1522193713 learned_addr learned my addr 172.21.15.12:0/1522193713 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884a7fc700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 0x7f884c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884b7fe700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 0x7f884c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 -- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 msgr2=0x7f884c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 0x7f884c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 -- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 msgr2=0x7f884c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 0x7f884c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.399+0000 7f884affd700 1 -- 172.21.15.12:0/1522193713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c06a540 con 0x7f8834003a60 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f884a7fc700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 0x7f884c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f884b7fe700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 0x7f884c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f884affd700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f88340046d0 tx=0x7f883c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c022070 con 0x7f8834003a60 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c00ebf0 con 0x7f8834003a60 2023-10-08T16:22:03.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c01c680 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c06a820 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.400+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c06ade0 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.401+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c04c3c0 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.402+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f883c01ca70 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.403+0000 7f8832ffd700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.403+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f883c085c70 con 0x7f8834003a60 2023-10-08T16:22:03.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.403+0000 7f884a7fc700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.404+0000 7f884a7fc700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8840006f00 tx=0x7f8840008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.407+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f883c053020 con 0x7f8834003a60 2023-10-08T16:22:03.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.688+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f884c0cd170 con 0x7f8834003a60 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.688+0000 7f8832ffd700 1 -- 172.21.15.12:0/1522193713 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f883c02b090 con 0x7f8834003a60 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.688 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:22:03.689 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:22:03.691 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.694 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:22:03.695 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.697 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.698 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.699 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.700 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:22:03.701 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.702 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.703 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:22:03.704 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:22:03.705 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.706 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:03.707 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:22:03.707 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:22:03.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 msgr2=0x7f88380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 0x7f88380693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8840006f00 tx=0x7f8840008040 comp rx=0 tx=0).stop 2023-10-08T16:22:03.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 msgr2=0x7f884c069f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f88340046d0 tx=0x7f883c01a000 comp rx=0 tx=0).stop 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 shutdown_connections 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8838066f30 0x7f88380693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8834003a60 0x7f884c069f60 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f884c15b780 0x7f884c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 --2- 172.21.15.12:0/1522193713 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f884c1585e0 0x7f884c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 >> 172.21.15.12:0/1522193713 conn(0x7f884c06f310 msgr2=0x7f884c14e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 shutdown_connections 2023-10-08T16:22:03.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.691+0000 7f884bfff700 1 -- 172.21.15.12:0/1522193713 wait complete. 2023-10-08T16:22:03.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:22:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.897+0000 7f2fd85ff700 1 Processor -- start 2023-10-08T16:22:03.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.897+0000 7f2fd85ff700 1 -- start start 2023-10-08T16:22:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.898+0000 7f2fd85ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fd00cb5a0 0x7f2fd00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.898+0000 7f2fd85ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.898+0000 7f2fd85ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd015ae40 con 0x7f2fd00cde50 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.898+0000 7f2fd85ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00d13f0 con 0x7f2fd00cb5a0 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.898+0000 7f2fd85ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd015ab60 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44538/0 (socket says 172.21.15.12:44538) 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/3366304040 learned_addr learned my addr 172.21.15.12:0/3366304040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd639b700 1 --2- 172.21.15.12:0/3366304040 >> v2:172.21.15.29:3300/0 conn(0x7f2fd00cb5a0 0x7f2fd00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/3366304040 >> v2:172.21.15.29:3300/0 conn(0x7f2fd00cb5a0 msgr2=0x7f2fd00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 --2- 172.21.15.12:0/3366304040 >> v2:172.21.15.29:3300/0 conn(0x7f2fd00cb5a0 0x7f2fd00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/3366304040 >> v1:172.21.15.29:6789/0 conn(0x7f2fd00cde50 legacy=0x7f2fd0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.899+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/3366304040 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00ccf00 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd5b9a700 1 --2- 172.21.15.12:0/3366304040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00099b0 tx=0x7f2fc0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e385fa32d3c5e59d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd5399700 1 -- 172.21.15.12:0/3366304040 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0009ea0 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd5399700 1 -- 172.21.15.12:0/3366304040 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000b860 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd5399700 1 -- 172.21.15.12:0/3366304040 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000bc00 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd85ff700 1 -- 172.21.15.12:0/3366304040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 msgr2=0x7f2fd0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.900+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/3366304040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2fc00099b0 tx=0x7f2fc0009250 comp rx=0 tx=0).stop 2023-10-08T16:22:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 -- 172.21.15.12:0/3366304040 shutdown_connections 2023-10-08T16:22:03.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/3366304040 >> v2:172.21.15.29:3300/0 conn(0x7f2fd00cb5a0 0x7f2fd00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/3366304040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00cd9e0 0x7f2fd0159ec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 -- 172.21.15.12:0/3366304040 >> 172.21.15.12:0/3366304040 conn(0x7f2fd0070e30 msgr2=0x7f2fd00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 -- 172.21.15.12:0/3366304040 shutdown_connections 2023-10-08T16:22:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.901+0000 7f2fd85ff700 1 -- 172.21.15.12:0/3366304040 wait complete. 2023-10-08T16:22:03.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.902+0000 7f2fd85ff700 1 Processor -- start 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.902+0000 7f2fd85ff700 1 -- start start 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd00cb5a0 0x7f2fd0153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00b5340 0x7f2fd00c9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0153570 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01576d0 con 0x7f2fd00cb5a0 2023-10-08T16:22:03.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd85ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd01579b0 con 0x7f2fd00b5340 2023-10-08T16:22:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33808/0 (socket says 172.21.15.12:33808) 2023-10-08T16:22:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/990859194 learned_addr learned my addr 172.21.15.12:0/990859194 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:03.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd639b700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd00cb5a0 0x7f2fd0153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.903+0000 7f2fd6b9c700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00b5340 0x7f2fd00c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00b5340 msgr2=0x7f2fd00c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00b5340 0x7f2fd00c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd00cb5a0 msgr2=0x7f2fd0153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd00cb5a0 0x7f2fd0153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 -- 172.21.15.12:0/990859194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc00094f0 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fd5b9a700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2fd015aca0 tx=0x7f2fc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0000d10 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.904+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000bbe0 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.905+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0011670 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.905+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd0157c90 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.905+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0158250 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.906+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd0158470 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.906+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fc0011aa0 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.907+0000 7f2fc67fc700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.907+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f2fc0085c50 con 0x7f2fd00cd9e0 2023-10-08T16:22:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.907+0000 7f2fd639b700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:03.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.908+0000 7f2fd639b700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 0x7f2fb40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009d10 tx=0x7f2fcc0091a0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:03.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:03.912+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fc0053000 con 0x7f2fd00cd9e0 2023-10-08T16:22:04.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.116+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fd004c3c0 con 0x7f2fd00cd9e0 2023-10-08T16:22:04.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.116+0000 7f2fc67fc700 1 -- 172.21.15.12:0/990859194 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+12733 (secure 0 0 0) 0x7f2fc0056620 con 0x7f2fd00cd9e0 2023-10-08T16:22:04.116 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:04.116 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":64,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:22:03.171741+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:22:04.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 msgr2=0x7f2fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 0x7f2fb40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009d10 tx=0x7f2fcc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 msgr2=0x7f2fd00b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2fd015aca0 tx=0x7f2fc0017000 comp rx=0 tx=0).stop 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 shutdown_connections 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f2fb4066f30 0x7f2fb40693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd00b5340 0x7f2fd00c9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd00cb5a0 0x7f2fd0153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 --2- 172.21.15.12:0/990859194 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd00cd9e0 0x7f2fd00b4e00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 >> 172.21.15.12:0/990859194 conn(0x7f2fd0070e30 msgr2=0x7f2fd00cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 shutdown_connections 2023-10-08T16:22:04.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.119+0000 7f2fd85ff700 1 -- 172.21.15.12:0/990859194 wait complete. 2023-10-08T16:22:04.136 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:22:04.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:22:04.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.327+0000 7f9f9559d700 1 Processor -- start 2023-10-08T16:22:04.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.327+0000 7f9f9559d700 1 -- start start 2023-10-08T16:22:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.328+0000 7f9f9559d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9f9006db20 0x7f9f9015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.328+0000 7f9f9559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.328+0000 7f9f9559d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f9015ada0 con 0x7f9f90153c90 2023-10-08T16:22:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.328+0000 7f9f9559d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9006ca80 con 0x7f9f9006db20 2023-10-08T16:22:04.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.328+0000 7f9f9559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9006cd60 con 0x7f9f900caec0 2023-10-08T16:22:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f8ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f9f90153c90 0x7f9f900ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40976/0 (socket says 172.21.15.12:40976) 2023-10-08T16:22:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f8f7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9f9006db20 0x7f9f9015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f8ffff700 1 -- 172.21.15.12:0/3377214939 learned_addr learned my addr 172.21.15.12:0/3377214939 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:04.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 --2- 172.21.15.12:0/3377214939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44554/0 (socket says 172.21.15.12:44554) 2023-10-08T16:22:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 -- 172.21.15.12:0/3377214939 >> v2:172.21.15.29:3300/0 conn(0x7f9f9006db20 msgr2=0x7f9f9015a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 --2- 172.21.15.12:0/3377214939 >> v2:172.21.15.29:3300/0 conn(0x7f9f9006db20 0x7f9f9015a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 -- 172.21.15.12:0/3377214939 >> v1:172.21.15.29:6789/0 conn(0x7f9f90153c90 legacy=0x7f9f900ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.329+0000 7f9f94d9c700 1 -- 172.21.15.12:0/3377214939 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9006d040 con 0x7f9f900caec0 2023-10-08T16:22:04.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.330+0000 7f9f94d9c700 1 --2- 172.21.15.12:0/3377214939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009e60 tx=0x7f9f88009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=351bf3b1a7c8ff95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.330+0000 7f9f8effd700 1 -- 172.21.15.12:0/3377214939 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8800e070 con 0x7f9f900caec0 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.330+0000 7f9f8effd700 1 -- 172.21.15.12:0/3377214939 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8800bb60 con 0x7f9f900caec0 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.330+0000 7f9f8effd700 1 -- 172.21.15.12:0/3377214939 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88012430 con 0x7f9f900caec0 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 -- 172.21.15.12:0/3377214939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 msgr2=0x7f9f9015afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 --2- 172.21.15.12:0/3377214939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009e60 tx=0x7f9f88009780 comp rx=0 tx=0).stop 2023-10-08T16:22:04.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 -- 172.21.15.12:0/3377214939 shutdown_connections 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 --2- 172.21.15.12:0/3377214939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f9015afb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 --2- 172.21.15.12:0/3377214939 >> v2:172.21.15.29:3300/0 conn(0x7f9f9006db20 0x7f9f9015a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 -- 172.21.15.12:0/3377214939 >> 172.21.15.12:0/3377214939 conn(0x7f9f9006e720 msgr2=0x7f9f9006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 -- 172.21.15.12:0/3377214939 shutdown_connections 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.331+0000 7f9f9559d700 1 -- 172.21.15.12:0/3377214939 wait complete. 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.332+0000 7f9f9559d700 1 Processor -- start 2023-10-08T16:22:04.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.332+0000 7f9f9559d700 1 -- start start 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f900b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f90153c90 0x7f9f90169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900ae5a0 con 0x7f9f9006db20 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b18f0 con 0x7f9f90153c90 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.333+0000 7f9f9559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f900b0ce0 con 0x7f9f900caec0 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33822/0 (socket says 172.21.15.12:33822) 2023-10-08T16:22:04.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 -- 172.21.15.12:0/177281652 learned_addr learned my addr 172.21.15.12:0/177281652 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f94d9c700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f90153c90 0x7f9f90169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8f7fe700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f900b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 -- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 msgr2=0x7f9f900b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f900b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 -- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f90153c90 msgr2=0x7f9f90169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f90153c90 0x7f9f90169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 -- 172.21.15.12:0/177281652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f88009a20 con 0x7f9f9006db20 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8f7fe700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f900b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.334+0000 7f9f8ffff700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c560 tx=0x7f9f80001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.335+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80005b30 con 0x7f9f9006db20 2023-10-08T16:22:04.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.335+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f80005cb0 con 0x7f9f9006db20 2023-10-08T16:22:04.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.335+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f900b0fc0 con 0x7f9f9006db20 2023-10-08T16:22:04.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.335+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f80007320 con 0x7f9f9006db20 2023-10-08T16:22:04.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.335+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f900b1580 con 0x7f9f9006db20 2023-10-08T16:22:04.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.336+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9004c3c0 con 0x7f9f9006db20 2023-10-08T16:22:04.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.337+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f8001b3b0 con 0x7f9f9006db20 2023-10-08T16:22:04.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.337+0000 7f9f77fff700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 0x7f9f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.338+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f9f800836f0 con 0x7f9f9006db20 2023-10-08T16:22:04.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.338+0000 7f9f8f7fe700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 0x7f9f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.338+0000 7f9f8f7fe700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 0x7f9f7c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f84006f00 tx=0x7f9f84008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.342+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f80050b40 con 0x7f9f9006db20 2023-10-08T16:22:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.542+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f9015ada0 con 0x7f9f9006db20 2023-10-08T16:22:04.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.543+0000 7f9f77fff700 1 -- 172.21.15.12:0/177281652 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f80017020 con 0x7f9f9006db20 2023-10-08T16:22:04.542 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:22:04.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 msgr2=0x7f9f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 0x7f9f7c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9f84006f00 tx=0x7f9f84008040 comp rx=0 tx=0).stop 2023-10-08T16:22:04.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 msgr2=0x7f9f900ae060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9f8000c560 tx=0x7f9f80001020 comp rx=0 tx=0).stop 2023-10-08T16:22:04.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 shutdown_connections 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9f7c066f30 0x7f9f7c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f9006db20 0x7f9f900ae060 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f90153c90 0x7f9f90169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 --2- 172.21.15.12:0/177281652 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f900caec0 0x7f9f900b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 >> 172.21.15.12:0/177281652 conn(0x7f9f9006e720 msgr2=0x7f9f9015b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 shutdown_connections 2023-10-08T16:22:04.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.545+0000 7f9f9559d700 1 -- 172.21.15.12:0/177281652 wait complete. 2023-10-08T16:22:04.562 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:22:04.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.751+0000 7f0a4bfff700 1 Processor -- start 2023-10-08T16:22:04.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.751+0000 7f0a4bfff700 1 -- start start 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.752+0000 7f0a4bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a4c153c30 0x7f0a4c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.752+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c0cf110 0x7f0a4c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.752+0000 7f0a4bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a4c15afd0 con 0x7f0a4c15de50 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.752+0000 7f0a4bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4c15b2b0 con 0x7f0a4c153c30 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c15b590 con 0x7f0a4c0cf110 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a4c153c30 0x7f0a4c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a4c153c30 0x7f0a4c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33830/0 (socket says 172.21.15.12:33830) 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 -- 172.21.15.12:0/2073345762 learned_addr learned my addr 172.21.15.12:0/2073345762 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 -- 172.21.15.12:0/2073345762 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c0cf110 msgr2=0x7f0a4c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:04.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 --2- 172.21.15.12:0/2073345762 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c0cf110 0x7f0a4c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 -- 172.21.15.12:0/2073345762 >> v1:172.21.15.29:6789/0 conn(0x7f0a4c15de50 legacy=0x7f0a4c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:04.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 -- 172.21.15.12:0/2073345762 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4c15b870 con 0x7f0a4c153c30 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.753+0000 7f0a4affd700 1 --2- 172.21.15.12:0/2073345762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c153c30 0x7f0a4c15a5e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0099b0 tx=0x7f0a3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd4449b2a78cc3e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a49ffb700 1 -- 172.21.15.12:0/2073345762 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00b820 con 0x7f0a4c153c30 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a49ffb700 1 -- 172.21.15.12:0/2073345762 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c00b980 con 0x7f0a4c153c30 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a49ffb700 1 -- 172.21.15.12:0/2073345762 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c00bd20 con 0x7f0a4c153c30 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 -- 172.21.15.12:0/2073345762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c153c30 msgr2=0x7f0a4c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/2073345762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c153c30 0x7f0a4c15a5e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0099b0 tx=0x7f0a3c009250 comp rx=0 tx=0).stop 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 -- 172.21.15.12:0/2073345762 shutdown_connections 2023-10-08T16:22:04.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/2073345762 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c0cf110 0x7f0a4c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/2073345762 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c153c30 0x7f0a4c15a5e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 -- 172.21.15.12:0/2073345762 >> 172.21.15.12:0/2073345762 conn(0x7f0a4c0703a0 msgr2=0x7f0a4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:04.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.754+0000 7f0a4bfff700 1 -- 172.21.15.12:0/2073345762 shutdown_connections 2023-10-08T16:22:04.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.755+0000 7f0a4bfff700 1 -- 172.21.15.12:0/2073345762 wait complete. 2023-10-08T16:22:04.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.756+0000 7f0a4bfff700 1 Processor -- start 2023-10-08T16:22:04.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.756+0000 7f0a4bfff700 1 -- start start 2023-10-08T16:22:04.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c153c30 0x7f0a4c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c15de50 0x7f0a4c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c16da70 con 0x7f0a4c0cf110 2023-10-08T16:22:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c159cd0 con 0x7f0a4c15de50 2023-10-08T16:22:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c0c8370 con 0x7f0a4c153c30 2023-10-08T16:22:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33838/0 (socket says 172.21.15.12:33838) 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4affd700 1 -- 172.21.15.12:0/538805183 learned_addr learned my addr 172.21.15.12:0/538805183 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4b7fe700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c15de50 0x7f0a4c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.757+0000 7f0a4a7fc700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c153c30 0x7f0a4c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 -- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c153c30 msgr2=0x7f0a4c0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c153c30 0x7f0a4c0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 -- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c15de50 msgr2=0x7f0a4c0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c15de50 0x7f0a4c0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 -- 172.21.15.12:0/538805183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0094f0 con 0x7f0a4c0cf110 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4affd700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009290 tx=0x7f0a3c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c011e40 con 0x7f0a4c0cf110 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c01f070 con 0x7f0a4c0cf110 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c0266d0 con 0x7f0a4c0cf110 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c16d140 con 0x7f0a4c0cf110 2023-10-08T16:22:04.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.758+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c16d700 con 0x7f0a4c0cf110 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.759+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c16dd50 con 0x7f0a4c0cf110 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.760+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a3c01a440 con 0x7f0a4c0cf110 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.761+0000 7f0a32ffd700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 0x7f0a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.761+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f0a3c021070 con 0x7f0a4c0cf110 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.762+0000 7f0a4a7fc700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 0x7f0a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:04.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.762+0000 7f0a4a7fc700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 0x7f0a380693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0b23f0 tx=0x7f0a40009060 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:04.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.765+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a3c0537f0 con 0x7f0a4c0cf110 2023-10-08T16:22:04.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.970+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0a4c04c3c0 con 0x7f0a4c0cf110 2023-10-08T16:22:04.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.971+0000 7f0a32ffd700 1 -- 172.21.15.12:0/538805183 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0a3c056e10 con 0x7f0a4c0cf110 2023-10-08T16:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:04.970 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:04.971 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:22:04.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 msgr2=0x7f0a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 0x7f0a380693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c0b23f0 tx=0x7f0a40009060 comp rx=0 tx=0).stop 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 msgr2=0x7f0a4c159790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009290 tx=0x7f0a3c016000 comp rx=0 tx=0).stop 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 shutdown_connections 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0a38066f30 0x7f0a380693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a4c0cf110 0x7f0a4c159790 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a4c15de50 0x7f0a4c0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 --2- 172.21.15.12:0/538805183 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a4c153c30 0x7f0a4c0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:04.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 >> 172.21.15.12:0/538805183 conn(0x7f0a4c0703a0 msgr2=0x7f0a4c1509c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:04.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 shutdown_connections 2023-10-08T16:22:04.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:04.973+0000 7f0a4bfff700 1 -- 172.21.15.12:0/538805183 wait complete. 2023-10-08T16:22:04.990 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:22:04.990 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:22:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.182+0000 7f98c359e700 1 Processor -- start 2023-10-08T16:22:05.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.182+0000 7f98c359e700 1 -- start start 2023-10-08T16:22:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153660 0x7f98c40c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 0x7f98c4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98c40cc150 0x7f98c40c8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c4157250 con 0x7f98c40cc150 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40c2200 con 0x7f98c4153a30 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.183+0000 7f98c359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40c15f0 con 0x7f98c4153660 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98c40cc150 0x7f98c40c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c1d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 0x7f98c4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98c40cc150 0x7f98c40c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33850/0 (socket says 172.21.15.12:33850) 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 -- 172.21.15.12:0/1929030739 learned_addr learned my addr 172.21.15.12:0/1929030739 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:05.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c259c700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153660 0x7f98c40c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 -- 172.21.15.12:0/1929030739 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153660 msgr2=0x7f98c40c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153660 0x7f98c40c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 -- 172.21.15.12:0/1929030739 >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 msgr2=0x7f98c4156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 --2- 172.21.15.12:0/1929030739 >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 0x7f98c4156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c2d9d700 1 -- 172.21.15.12:0/1929030739 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40c18d0 con 0x7f98c40cc150 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.184+0000 7f98c1d9b700 1 --2- 172.21.15.12:0/1929030739 >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 0x7f98c4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:05.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c2d9d700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c40cc150 0x7f98c40c8980 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f98c40c9e30 tx=0x7f98bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df9b42e3162a3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c159a700 1 -- 172.21.15.12:0/1929030739 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc00e070 con 0x7f98c40cc150 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c159a700 1 -- 172.21.15.12:0/1929030739 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc00b970 con 0x7f98c40cc150 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c159a700 1 -- 172.21.15.12:0/1929030739 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0092e0 con 0x7f98c40cc150 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c359e700 1 -- 172.21.15.12:0/1929030739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c40cc150 msgr2=0x7f98c40c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c359e700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c40cc150 0x7f98c40c8980 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f98c40c9e30 tx=0x7f98bc009840 comp rx=0 tx=0).stop 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.185+0000 7f98c359e700 1 -- 172.21.15.12:0/1929030739 shutdown_connections 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c40cc150 0x7f98c40c8980 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 --2- 172.21.15.12:0/1929030739 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153660 0x7f98c40c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 --2- 172.21.15.12:0/1929030739 >> v2:172.21.15.29:3300/0 conn(0x7f98c4153a30 0x7f98c4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 -- 172.21.15.12:0/1929030739 >> 172.21.15.12:0/1929030739 conn(0x7f98c406c6a0 msgr2=0x7f98c406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 -- 172.21.15.12:0/1929030739 shutdown_connections 2023-10-08T16:22:05.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.186+0000 7f98c359e700 1 -- 172.21.15.12:0/1929030739 wait complete. 2023-10-08T16:22:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.187+0000 7f98c359e700 1 Processor -- start 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.187+0000 7f98c359e700 1 -- start start 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 0x7f98c40aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153a30 0x7f98c40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4159870 con 0x7f98c4153660 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40af430 con 0x7f98c40cc150 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40b0270 con 0x7f98c4153a30 2023-10-08T16:22:05.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.188+0000 7f98c1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33866/0 (socket says 172.21.15.12:33866) 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 -- 172.21.15.12:0/3339352977 learned_addr learned my addr 172.21.15.12:0/3339352977 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c2d9d700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153a30 0x7f98c40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c259c700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 0x7f98c40aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 -- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153a30 msgr2=0x7f98c40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153a30 0x7f98c40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 -- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 msgr2=0x7f98c40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 0x7f98c40aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 -- 172.21.15.12:0/3339352977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8009420 con 0x7f98c4153660 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c259c700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 0x7f98c40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98c1d9b700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f98b800ecb0 tx=0x7f98b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.189+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800c850 con 0x7f98c4153660 2023-10-08T16:22:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.190+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b800c9b0 con 0x7f98c4153660 2023-10-08T16:22:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.190+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc009ae0 con 0x7f98c4153660 2023-10-08T16:22:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.190+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b800cd50 con 0x7f98c4153660 2023-10-08T16:22:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.190+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c40af940 con 0x7f98c4153660 2023-10-08T16:22:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.191+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c404c3c0 con 0x7f98c4153660 2023-10-08T16:22:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.192+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98b8013680 con 0x7f98c4153660 2023-10-08T16:22:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.192+0000 7f98b27fc700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 0x7f98a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.193+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5217+0+0 (secure 0 0 0) 0x7f98b8084370 con 0x7f98c4153660 2023-10-08T16:22:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.193+0000 7f98c259c700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 0x7f98a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.193+0000 7f98c259c700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 0x7f98a40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009d80 tx=0x7f98b4008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.197+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98b80517c0 con 0x7f98c4153660 2023-10-08T16:22:05.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.398+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f98c40b03b0 con 0x7f98c4153660 2023-10-08T16:22:05.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.727+0000 7f98b27fc700 1 -- 172.21.15.12:0/3339352977 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7f98b8054de0 con 0x7f98c4153660 2023-10-08T16:22:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.732+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 msgr2=0x7f98a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.732+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 0x7f98a40693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009d80 tx=0x7f98b4008040 comp rx=0 tx=0).stop 2023-10-08T16:22:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.732+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 msgr2=0x7f98c40ae120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.732+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f98b800ecb0 tx=0x7f98b80091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 shutdown_connections 2023-10-08T16:22:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f98a4066f30 0x7f98a40693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98c4153a30 0x7f98c40b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98c40cc150 0x7f98c40aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 --2- 172.21.15.12:0/3339352977 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98c4153660 0x7f98c40ae120 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.733+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 >> 172.21.15.12:0/3339352977 conn(0x7f98c406c6a0 msgr2=0x7f98c40c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.734+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 shutdown_connections 2023-10-08T16:22:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.734+0000 7f98c359e700 1 -- 172.21.15.12:0/3339352977 wait complete. 2023-10-08T16:22:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:22:05.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:22:05.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.948+0000 7f1476d9d700 1 Processor -- start 2023-10-08T16:22:05.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.948+0000 7f1476d9d700 1 -- start start 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1476d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1470153c30 0x7f147015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1476d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f147015de50 0x7f14700cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1476d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700cf3c0 con 0x7f14700cef40 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1476d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147015afd0 con 0x7f1470153c30 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1476d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f147015b2b0 con 0x7f147015de50 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f1475d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1470153c30 0x7f147015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.949+0000 7f147659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f14700cef40 0x7f147006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33074/0 (socket says 172.21.15.12:33074) 2023-10-08T16:22:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f147659c700 1 -- 172.21.15.12:0/1652446852 learned_addr learned my addr 172.21.15.12:0/1652446852 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:05.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f147559a700 1 --2- 172.21.15.12:0/1652446852 >> v2:172.21.15.29:3300/0 conn(0x7f147015de50 0x7f14700cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1475d9b700 1 -- 172.21.15.12:0/1652446852 >> v2:172.21.15.29:3300/0 conn(0x7f147015de50 msgr2=0x7f14700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:05.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1475d9b700 1 --2- 172.21.15.12:0/1652446852 >> v2:172.21.15.29:3300/0 conn(0x7f147015de50 0x7f14700cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1475d9b700 1 -- 172.21.15.12:0/1652446852 >> v1:172.21.15.12:6789/0 conn(0x7f14700cef40 legacy=0x7f147006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1475d9b700 1 -- 172.21.15.12:0/1652446852 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015b590 con 0x7f1470153c30 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1474d99700 1 -- 172.21.15.12:0/1652446852 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932022884 0 0) 0x7f14700cf3c0 con 0x7f14700cef40 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.950+0000 7f1475d9b700 1 --2- 172.21.15.12:0/1652446852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1470153c30 0x7f147015a5e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f14700713a0 tx=0x7f146c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab035c6727442761 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1474d99700 1 -- 172.21.15.12:0/1652446852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00b6b0 con 0x7f1470153c30 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1474d99700 1 -- 172.21.15.12:0/1652446852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00b810 con 0x7f1470153c30 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1474d99700 1 -- 172.21.15.12:0/1652446852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00bbb0 con 0x7f1470153c30 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 -- 172.21.15.12:0/1652446852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1470153c30 msgr2=0x7f147015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1652446852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1470153c30 0x7f147015a5e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f14700713a0 tx=0x7f146c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 -- 172.21.15.12:0/1652446852 shutdown_connections 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1652446852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1470153c30 0x7f147015a5e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1652446852 >> v2:172.21.15.29:3300/0 conn(0x7f147015de50 0x7f14700cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 -- 172.21.15.12:0/1652446852 >> 172.21.15.12:0/1652446852 conn(0x7f14700703a0 msgr2=0x7f14700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:05.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 -- 172.21.15.12:0/1652446852 shutdown_connections 2023-10-08T16:22:05.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.951+0000 7f1476d9d700 1 -- 172.21.15.12:0/1652446852 wait complete. 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.953+0000 7f1476d9d700 1 Processor -- start 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.953+0000 7f1476d9d700 1 -- start start 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14700cef40 0x7f147013e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1470153c30 0x7f14700b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c7910 con 0x7f147015de50 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c75e0 con 0x7f1470153c30 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1476d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700b5a20 con 0x7f14700cef40 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33888/0 (socket says 172.21.15.12:33888) 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 -- 172.21.15.12:0/1559913077 learned_addr learned my addr 172.21.15.12:0/1559913077 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f1475d9b700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14700cef40 0x7f147013e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147559a700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1470153c30 0x7f14700b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 -- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14700cef40 msgr2=0x7f147013e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14700cef40 0x7f147013e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 -- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1470153c30 msgr2=0x7f14700b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1470153c30 0x7f14700b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.954+0000 7f147659c700 1 -- 172.21.15.12:0/1559913077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146c009420 con 0x7f147015de50 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f147659c700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f146800cc10 tx=0x7f1468001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800a850 con 0x7f147015de50 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800a9d0 con 0x7f147015de50 2023-10-08T16:22:05.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146800ad90 con 0x7f147015de50 2023-10-08T16:22:05.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14700b5d00 con 0x7f147015de50 2023-10-08T16:22:05.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.955+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147013ed60 con 0x7f147015de50 2023-10-08T16:22:05.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.956+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14700c7a80 con 0x7f147015de50 2023-10-08T16:22:05.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.957+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1468007300 con 0x7f147015de50 2023-10-08T16:22:05.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.959+0000 7f1465ffb700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:05.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.959+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5587+0+0 (secure 0 0 0) 0x7f14680852d0 con 0x7f147015de50 2023-10-08T16:22:05.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.959+0000 7f1475d9b700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:05.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.960+0000 7f1475d9b700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f146c0093f0 tx=0x7f146c017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:05.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:05.963+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1468052610 con 0x7f147015de50 2023-10-08T16:22:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.170+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f147004c3c0 con 0x7f147015de50 2023-10-08T16:22:06.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.735+0000 7f1465ffb700 1 -- 172.21.15.12:0/1559913077 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1468055c30 con 0x7f147015de50 2023-10-08T16:22:06.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.748+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 msgr2=0x7f14540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.749+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f146c0093f0 tx=0x7f146c017000 comp rx=0 tx=0).stop 2023-10-08T16:22:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.749+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 msgr2=0x7f14700cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.749+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f146800cc10 tx=0x7f1468001970 comp rx=0 tx=0).stop 2023-10-08T16:22:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.751+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 shutdown_connections 2023-10-08T16:22:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.751+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.751+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f147015de50 0x7f14700cc290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.752+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14700cef40 0x7f147013e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.752+0000 7f1476d9d700 1 --2- 172.21.15.12:0/1559913077 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1470153c30 0x7f14700b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.752+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 >> 172.21.15.12:0/1559913077 conn(0x7f14700703a0 msgr2=0x7f14700b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:06.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.753+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 shutdown_connections 2023-10-08T16:22:06.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.753+0000 7f1476d9d700 1 -- 172.21.15.12:0/1559913077 wait complete. 2023-10-08T16:22:06.756 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:22:06.773 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:22:06.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.964+0000 7fe04e99d700 1 Processor -- start 2023-10-08T16:22:06.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.964+0000 7fe04e99d700 1 -- start start 2023-10-08T16:22:06.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.965+0000 7fe04e99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe048155c60 0x7fe0480c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04e99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0480c7e70 con 0x7fe048155890 2023-10-08T16:22:06.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04e99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04806b790 con 0x7fe04806de50 2023-10-08T16:22:06.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04e99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04806ab80 con 0x7fe048155c60 2023-10-08T16:22:06.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04d99b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe048155890 0x7fe04806a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33082/0 (socket says 172.21.15.12:33082) 2023-10-08T16:22:06.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04d99b700 1 -- 172.21.15.12:0/1301147648 learned_addr learned my addr 172.21.15.12:0/1301147648 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04d19a700 1 --2- 172.21.15.12:0/1301147648 >> v2:172.21.15.29:3300/0 conn(0x7fe048155c60 0x7fe0480c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802264580 0 0) 0x7fe0480c7e70 con 0x7fe048155890 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.966+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe034003570 con 0x7fe048155890 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 375246636 0 0) 0x7fe034003570 con 0x7fe048155890 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 >> v2:172.21.15.29:3300/0 conn(0x7fe048155c60 msgr2=0x7fe0480c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 --2- 172.21.15.12:0/1301147648 >> v2:172.21.15.29:3300/0 conn(0x7fe048155c60 0x7fe0480c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 >> v1:172.21.15.29:6789/0 conn(0x7fe04806de50 legacy=0x7fe0480c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04806ae60 con 0x7fe048155890 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe044001470 con 0x7fe048155890 2023-10-08T16:22:06.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 >> v1:172.21.15.12:6789/0 conn(0x7fe048155890 legacy=0x7fe04806a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe034003a60 0x7fe034003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe034004810 0x7fe034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe03400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04806ab80 con 0x7fe0340051c0 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03400d270 con 0x7fe034003a60 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe034005ab0 con 0x7fe034004810 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04e19c700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe03400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04d19a700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe034004810 0x7fe034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.967+0000 7fe04d99b700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe034003a60 0x7fe034003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 -- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe034004810 msgr2=0x7fe034004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe034004810 0x7fe034004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 -- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe034003a60 msgr2=0x7fe034003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe034003a60 0x7fe034003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 -- 172.21.15.12:0/1301147648 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe034003570 con 0x7fe0340051c0 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 -- 172.21.15.12:0/1301147648 reap_dead start 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04e19c700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe03400cb70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe040001fc0 tx=0x7fe040001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3fe7c5f414a505 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040001950 con 0x7fe0340051c0 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04000c8b0 con 0x7fe0340051c0 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.968+0000 7fe04c999700 1 -- 172.21.15.12:0/1301147648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000cc90 con 0x7fe0340051c0 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 -- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 msgr2=0x7fe03400cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe03400cb70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe040001fc0 tx=0x7fe040001640 comp rx=0 tx=0).stop 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 -- 172.21.15.12:0/1301147648 shutdown_connections 2023-10-08T16:22:06.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1301147648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe03400cb70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 -- 172.21.15.12:0/1301147648 >> 172.21.15.12:0/1301147648 conn(0x7fe04806d110 msgr2=0x7fe0480cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:06.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 -- 172.21.15.12:0/1301147648 shutdown_connections 2023-10-08T16:22:06.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.969+0000 7fe04e99d700 1 -- 172.21.15.12:0/1301147648 wait complete. 2023-10-08T16:22:06.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.970+0000 7fe04e99d700 1 Processor -- start 2023-10-08T16:22:06.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.970+0000 7fe04e99d700 1 -- start start 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0480c1d70 0x7fe0480c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe048150e40 0x7fe0481512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480c2720 con 0x7fe0340051c0 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048152780 con 0x7fe048150e40 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0481690c0 con 0x7fe0480c1d70 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.971+0000 7fe04d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33912/0 (socket says 172.21.15.12:33912) 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 -- 172.21.15.12:0/1076130749 learned_addr learned my addr 172.21.15.12:0/1076130749 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 -- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0480c1d70 msgr2=0x7fe0480c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0480c1d70 0x7fe0480c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 -- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe048150e40 msgr2=0x7fe0481512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe048150e40 0x7fe0481512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 -- 172.21.15.12:0/1076130749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048151b70 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04d99b700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe0440073c0 tx=0x7fe044001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe044018030 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe044001040 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe048151e50 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.972+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04400fb20 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.973+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe048152410 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.973+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04804c3c0 con 0x7fe0340051c0 2023-10-08T16:22:06.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.975+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe04401b070 con 0x7fe0340051c0 2023-10-08T16:22:06.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.976+0000 7fe03dffb700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 0x7fe02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:06.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.976+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5969+0+0 (secure 0 0 0) 0x7fe044019070 con 0x7fe0340051c0 2023-10-08T16:22:06.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.977+0000 7fe04d19a700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 0x7fe02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:06.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.977+0000 7fe04d19a700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 0x7fe02c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe038009170 tx=0x7fe0380091a0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:06.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:06.980+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe044052080 con 0x7fe0340051c0 2023-10-08T16:22:07.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.228+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe04806f170 con 0x7fe0340051c0 2023-10-08T16:22:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.750+0000 7fe03dffb700 1 -- 172.21.15.12:0/1076130749 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v22) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe0440556a0 con 0x7fe0340051c0 2023-10-08T16:22:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 msgr2=0x7fe02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 0x7fe02c0693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe038009170 tx=0x7fe0380091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 msgr2=0x7fe048168b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fe0440073c0 tx=0x7fe044001e50 comp rx=0 tx=0).stop 2023-10-08T16:22:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 shutdown_connections 2023-10-08T16:22:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe02c066f30 0x7fe02c0693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0340051c0 0x7fe048168b80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe048150e40 0x7fe0481512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 --2- 172.21.15.12:0/1076130749 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0480c1d70 0x7fe0480c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.765+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 >> 172.21.15.12:0/1076130749 conn(0x7fe04806d110 msgr2=0x7fe0481587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.766+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 shutdown_connections 2023-10-08T16:22:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.766+0000 7fe04e99d700 1 -- 172.21.15.12:0/1076130749 wait complete. 2023-10-08T16:22:07.769 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 6 and data pool 7 2023-10-08T16:22:07.792 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:22:07.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.981+0000 7f469359e700 1 Processor -- start 2023-10-08T16:22:07.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.981+0000 7f469359e700 1 -- start start 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46940af600 0x7f46940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940c6d50 con 0x7f4694140a70 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940c7030 con 0x7f4694140e40 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46940c7310 con 0x7f46940af600 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4694140a70 0x7f46940c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33096/0 (socket says 172.21.15.12:33096) 2023-10-08T16:22:07.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.982+0000 7f469259c700 1 -- 172.21.15.12:0/438661961 learned_addr learned my addr 172.21.15.12:0/438661961 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f4692d9d700 1 --2- 172.21.15.12:0/438661961 >> v2:172.21.15.29:3300/0 conn(0x7f46940af600 0x7f46940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769526500 0 0) 0x7f46940c6d50 con 0x7f4694140a70 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c003570 con 0x7f4694140a70 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2742933337 0 0) 0x7f467c003570 con 0x7f4694140a70 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 >> v2:172.21.15.29:3300/0 conn(0x7f46940af600 msgr2=0x7f46940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 --2- 172.21.15.12:0/438661961 >> v2:172.21.15.29:3300/0 conn(0x7f46940af600 0x7f46940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 >> v1:172.21.15.29:6789/0 conn(0x7f4694140e40 legacy=0x7f46940aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940c75f0 con 0x7f4694140a70 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f4684001470 con 0x7f4694140a70 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 >> v1:172.21.15.12:6789/0 conn(0x7f4694140a70 legacy=0x7f46940c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c003a60 0x7f467c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 0x7f467c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f467c0051c0 0x7f467c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c7310 con 0x7f467c004810 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00c050 con 0x7f467c003a60 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.983+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00c210 con 0x7f467c0051c0 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 0x7f467c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f469259c700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c003a60 0x7f467c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4692d9d700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f467c0051c0 0x7f467c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 -- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f467c0051c0 msgr2=0x7f467c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f467c0051c0 0x7f467c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 -- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c003a60 msgr2=0x7f467c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c003a60 0x7f467c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 -- 172.21.15.12:0/438661961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c003570 con 0x7f467c004810 2023-10-08T16:22:07.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4692d9d700 1 -- 172.21.15.12:0/438661961 reap_dead start 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f4691d9b700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 0x7f467c004c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f46941412a0 tx=0x7f4688007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f17b6ab7f6e861 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688001330 con 0x7f467c004810 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468800c5d0 con 0x7f467c004810 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.984+0000 7f469159a700 1 -- 172.21.15.12:0/438661961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468800c970 con 0x7f467c004810 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 -- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 msgr2=0x7f467c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 0x7f467c004c80 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f46941412a0 tx=0x7f4688007d60 comp rx=0 tx=0).stop 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 -- 172.21.15.12:0/438661961 shutdown_connections 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 --2- 172.21.15.12:0/438661961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f467c004810 0x7f467c004c80 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 -- 172.21.15.12:0/438661961 >> 172.21.15.12:0/438661961 conn(0x7f469406d170 msgr2=0x7f46940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 -- 172.21.15.12:0/438661961 shutdown_connections 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.985+0000 7f469359e700 1 -- 172.21.15.12:0/438661961 wait complete. 2023-10-08T16:22:07.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.987+0000 7f469359e700 1 Processor -- start 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.987+0000 7f469359e700 1 -- start start 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.987+0000 7f469359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c004810 0x7f46941657f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 0x7f46940c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469413ce00 con 0x7f469413c440 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694165d30 con 0x7f467c004810 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940c91c0 con 0x7f46940c5c70 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33928/0 (socket says 172.21.15.12:33928) 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 -- 172.21.15.12:0/3480007518 learned_addr learned my addr 172.21.15.12:0/3480007518 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f469259c700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c004810 0x7f46941657f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4691d9b700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 0x7f46940c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 -- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 msgr2=0x7f46940c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 0x7f46940c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 -- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c004810 msgr2=0x7f46941657f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c004810 0x7f46941657f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4692d9d700 1 -- 172.21.15.12:0/3480007518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940c9460 con 0x7f469413c440 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.988+0000 7f4691d9b700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 0x7f46940c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f4692d9d700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f469406f940 tx=0x7f468c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:07.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00e040 con 0x7f469413c440 2023-10-08T16:22:07.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c00f040 con 0x7f469413c440 2023-10-08T16:22:07.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00fdc0 con 0x7f469413c440 2023-10-08T16:22:07.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940c9740 con 0x7f469413c440 2023-10-08T16:22:07.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.989+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940c9d00 con 0x7f469413c440 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.990+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469404c3c0 con 0x7f469413c440 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.991+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f468c015640 con 0x7f469413c440 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.992+0000 7f46827fc700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.992+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f468c084ed0 con 0x7f469413c440 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.992+0000 7f469259c700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:07.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.993+0000 7f469259c700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 0x7f46740693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4684001d00 tx=0x7f4684001e70 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:07.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:07.996+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f468c051ff0 con 0x7f469413c440 2023-10-08T16:22:08.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.199+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46940c78d0 con 0x7f469413c440 2023-10-08T16:22:08.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.200+0000 7f46827fc700 1 -- 172.21.15.12:0/3480007518 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15962 (secure 0 0 0) 0x7f468c055610 con 0x7f469413c440 2023-10-08T16:22:08.200 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:08.200 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:22:07.229020+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 msgr2=0x7f46740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 0x7f46740693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4684001d00 tx=0x7f4684001e70 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 msgr2=0x7f469413c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f469406f940 tx=0x7f468c00b040 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 shutdown_connections 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4674066f30 0x7f46740693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f469413c440 0x7f469413c8c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f467c004810 0x7f46941657f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 --2- 172.21.15.12:0/3480007518 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46940c5c70 0x7f46940c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 >> 172.21.15.12:0/3480007518 conn(0x7f469406d170 msgr2=0x7f4694069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:08.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 shutdown_connections 2023-10-08T16:22:08.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.203+0000 7f469359e700 1 -- 172.21.15.12:0/3480007518 wait complete. 2023-10-08T16:22:08.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:22:08.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.409+0000 7fce7ef9d700 1 Processor -- start 2023-10-08T16:22:08.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.409+0000 7fce7ef9d700 1 -- start start 2023-10-08T16:22:08.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.410+0000 7fce7ef9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce7815dfd0 0x7fce780aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.410+0000 7fce7ef9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fce78159920 0x7fce780ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.410+0000 7fce7ef9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce780acc00 con 0x7fce78159550 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.410+0000 7fce7ef9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce780abff0 con 0x7fce7815dfd0 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.410+0000 7fce7ef9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce780ac2d0 con 0x7fce78159920 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce7815dfd0 0x7fce780aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7df9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fce78159550 0x7fce780ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33104/0 (socket says 172.21.15.12:33104) 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7df9b700 1 -- 172.21.15.12:0/2822043409 learned_addr learned my addr 172.21.15.12:0/2822043409 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:08.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7e79c700 1 --2- 172.21.15.12:0/2822043409 >> v2:172.21.15.29:3300/0 conn(0x7fce78159920 0x7fce780ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7cf99700 1 -- 172.21.15.12:0/2822043409 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412595434 0 0) 0x7fce780acc00 con 0x7fce78159550 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 -- 172.21.15.12:0/2822043409 >> v2:172.21.15.29:3300/0 conn(0x7fce78159920 msgr2=0x7fce780ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 --2- 172.21.15.12:0/2822043409 >> v2:172.21.15.29:3300/0 conn(0x7fce78159920 0x7fce780ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 -- 172.21.15.12:0/2822043409 >> v1:172.21.15.12:6789/0 conn(0x7fce78159550 legacy=0x7fce780ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 -- 172.21.15.12:0/2822043409 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce780ac5b0 con 0x7fce7815dfd0 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.411+0000 7fce7d79a700 1 --2- 172.21.15.12:0/2822043409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce7815dfd0 0x7fce780aedb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fce7806b0f0 tx=0x7fce680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99769ef68fa47fb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7cf99700 1 -- 172.21.15.12:0/2822043409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011630 con 0x7fce7815dfd0 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7cf99700 1 -- 172.21.15.12:0/2822043409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce68011790 con 0x7fce7815dfd0 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7cf99700 1 -- 172.21.15.12:0/2822043409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce68011b30 con 0x7fce7815dfd0 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 -- 172.21.15.12:0/2822043409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce7815dfd0 msgr2=0x7fce780aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/2822043409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce7815dfd0 0x7fce780aedb0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fce7806b0f0 tx=0x7fce680091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 -- 172.21.15.12:0/2822043409 shutdown_connections 2023-10-08T16:22:08.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/2822043409 >> v2:172.21.15.29:3300/0 conn(0x7fce78159920 0x7fce780ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/2822043409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce7815dfd0 0x7fce780aedb0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 -- 172.21.15.12:0/2822043409 >> 172.21.15.12:0/2822043409 conn(0x7fce7806ce80 msgr2=0x7fce780ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:08.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 -- 172.21.15.12:0/2822043409 shutdown_connections 2023-10-08T16:22:08.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.412+0000 7fce7ef9d700 1 -- 172.21.15.12:0/2822043409 wait complete. 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.414+0000 7fce7ef9d700 1 Processor -- start 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.414+0000 7fce7ef9d700 1 -- start start 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce78159920 0x7fce780cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce7815dfd0 0x7fce780cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce780ca280 con 0x7fce78159550 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce781697f0 con 0x7fce78159920 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7ef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce780c8400 con 0x7fce7815dfd0 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7df9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7df9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33944/0 (socket says 172.21.15.12:33944) 2023-10-08T16:22:08.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7df9b700 1 -- 172.21.15.12:0/3805734023 learned_addr learned my addr 172.21.15.12:0/3805734023 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7d79a700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce78159920 0x7fce780cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.415+0000 7fce7e79c700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce7815dfd0 0x7fce780cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 -- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce7815dfd0 msgr2=0x7fce780cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce7815dfd0 0x7fce780cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 -- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce78159920 msgr2=0x7fce780cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce78159920 0x7fce780cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 -- 172.21.15.12:0/3805734023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce68009420 con 0x7fce78159550 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7df9b700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c7e0 tx=0x7fce74007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74005b30 con 0x7fce78159550 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74005c90 con 0x7fce78159550 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce780c86e0 con 0x7fce78159550 2023-10-08T16:22:08.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce74007300 con 0x7fce78159550 2023-10-08T16:22:08.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.416+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce780c8ca0 con 0x7fce78159550 2023-10-08T16:22:08.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.417+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce7804c3c0 con 0x7fce78159550 2023-10-08T16:22:08.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.418+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce7401b3b0 con 0x7fce78159550 2023-10-08T16:22:08.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.419+0000 7fce6dffb700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.419+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fce74083ff0 con 0x7fce78159550 2023-10-08T16:22:08.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.420+0000 7fce7d79a700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.420+0000 7fce7d79a700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 0x7fce5c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce680093f0 tx=0x7fce68017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.423+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce74051170 con 0x7fce78159550 2023-10-08T16:22:08.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.628+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce7806e7c0 con 0x7fce78159550 2023-10-08T16:22:08.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.629+0000 7fce6dffb700 1 -- 172.21.15.12:0/3805734023 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+15962 (secure 0 0 0) 0x7fce74017090 con 0x7fce78159550 2023-10-08T16:22:08.628 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:08.629 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:22:07.229020+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 msgr2=0x7fce5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 0x7fce5c0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fce680093f0 tx=0x7fce68017000 comp rx=0 tx=0).stop 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 msgr2=0x7fce78151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fce7400c7e0 tx=0x7fce74007df0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 shutdown_connections 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fce5c066f30 0x7fce5c0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce78159550 0x7fce78151d40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce7815dfd0 0x7fce780cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 --2- 172.21.15.12:0/3805734023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce78159920 0x7fce780cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 >> 172.21.15.12:0/3805734023 conn(0x7fce7806ce80 msgr2=0x7fce78152ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:08.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 shutdown_connections 2023-10-08T16:22:08.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.631+0000 7fce7ef9d700 1 -- 172.21.15.12:0/3805734023 wait complete. 2023-10-08T16:22:08.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:22:08.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.841+0000 7fb19139d700 1 Processor -- start 2023-10-08T16:22:08.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.841+0000 7fb19139d700 1 -- start start 2023-10-08T16:22:08.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb19139d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb18c140a70 0x7fb18c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb19139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c06de50 0x7fb18c06a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb19139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c15b640 con 0x7fb18c15b0a0 2023-10-08T16:22:08.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb19139d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0c6800 con 0x7fb18c140a70 2023-10-08T16:22:08.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb19139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c15b920 con 0x7fb18c06de50 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb18b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c06de50 0x7fb18c06a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb18bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb18c140a70 0x7fb18c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb190b9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb18c15b0a0 0x7fb18c157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41008/0 (socket says 172.21.15.12:41008) 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.843+0000 7fb190b9c700 1 -- 172.21.15.12:0/525243418 learned_addr learned my addr 172.21.15.12:0/525243418 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18bfff700 1 -- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c06de50 msgr2=0x7fb18c06a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18bfff700 1 --2- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c06de50 0x7fb18c06a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18bfff700 1 -- 172.21.15.12:0/525243418 >> v1:172.21.15.29:6789/0 conn(0x7fb18c15b0a0 legacy=0x7fb18c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18bfff700 1 -- 172.21.15.12:0/525243418 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c15bc00 con 0x7fb18c140a70 2023-10-08T16:22:08.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18bfff700 1 --2- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c140a70 0x7fb18c069b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0098e0 tx=0x7fb17c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46912c4fafa4cc76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.844+0000 7fb18affd700 1 -- 172.21.15.12:0/525243418 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00b640 con 0x7fb18c140a70 2023-10-08T16:22:08.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb18affd700 1 -- 172.21.15.12:0/525243418 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c00b7a0 con 0x7fb18c140a70 2023-10-08T16:22:08.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb18affd700 1 -- 172.21.15.12:0/525243418 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00bb40 con 0x7fb18c140a70 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 -- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c140a70 msgr2=0x7fb18c069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 --2- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c140a70 0x7fb18c069b00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb17c0098e0 tx=0x7fb17c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 -- 172.21.15.12:0/525243418 shutdown_connections 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 --2- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c140a70 0x7fb18c069b00 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 --2- 172.21.15.12:0/525243418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c06de50 0x7fb18c06a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 -- 172.21.15.12:0/525243418 >> 172.21.15.12:0/525243418 conn(0x7fb18c06d110 msgr2=0x7fb18c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:08.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 -- 172.21.15.12:0/525243418 shutdown_connections 2023-10-08T16:22:08.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.845+0000 7fb19139d700 1 -- 172.21.15.12:0/525243418 wait complete. 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.847+0000 7fb19139d700 1 Processor -- start 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.847+0000 7fb19139d700 1 -- start start 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 0x7fb18c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c15b0a0 0x7fb18c13f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c38e0 con 0x7fb18c06de50 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c3bc0 con 0x7fb18c15b0a0 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb19139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c3ea0 con 0x7fb18c140a70 2023-10-08T16:22:08.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33952/0 (socket says 172.21.15.12:33952) 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 -- 172.21.15.12:0/667188613 learned_addr learned my addr 172.21.15.12:0/667188613 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb190b9c700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c15b0a0 0x7fb18c13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18b7fe700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 0x7fb18c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 -- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 msgr2=0x7fb18c0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 0x7fb18c0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 -- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c15b0a0 msgr2=0x7fb18c13f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c15b0a0 0x7fb18c13f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18bfff700 1 -- 172.21.15.12:0/667188613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb17c009420 con 0x7fb18c06de50 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.848+0000 7fb18b7fe700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 0x7fb18c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb18bfff700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0cc000 tx=0x7fb17c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c01bcd0 con 0x7fb18c06de50 2023-10-08T16:22:08.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c01be30 con 0x7fb18c06de50 2023-10-08T16:22:08.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0c4180 con 0x7fb18c06de50 2023-10-08T16:22:08.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c011670 con 0x7fb18c06de50 2023-10-08T16:22:08.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.849+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c13fad0 con 0x7fb18c06de50 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.850+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c13fd80 con 0x7fb18c06de50 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.851+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb17c011a20 con 0x7fb18c06de50 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.852+0000 7fb173fff700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.852+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fb17c085ca0 con 0x7fb18c06de50 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.852+0000 7fb18b7fe700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:08.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.853+0000 7fb18b7fe700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb180006f00 tx=0x7fb180008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:08.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:08.856+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb17c052d00 con 0x7fb18c06de50 2023-10-08T16:22:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.106+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb18c04c3c0 con 0x7fb18c06de50 2023-10-08T16:22:09.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.758+0000 7fb173fff700 1 -- 172.21.15.12:0/667188613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb17c056320 con 0x7fb18c06de50 2023-10-08T16:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 msgr2=0x7fb1780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 0x7fb1780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb180006f00 tx=0x7fb180008040 comp rx=0 tx=0).stop 2023-10-08T16:22:09.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 msgr2=0x7fb18c0c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0cc000 tx=0x7fb17c017000 comp rx=0 tx=0).stop 2023-10-08T16:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 shutdown_connections 2023-10-08T16:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fb178066f30 0x7fb1780693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb18c06de50 0x7fb18c0c31e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb18c15b0a0 0x7fb18c13f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 --2- 172.21.15.12:0/667188613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb18c140a70 0x7fb18c0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.761+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 >> 172.21.15.12:0/667188613 conn(0x7fb18c06d110 msgr2=0x7fb18c13d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.762+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 shutdown_connections 2023-10-08T16:22:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.762+0000 7fb19139d700 1 -- 172.21.15.12:0/667188613 wait complete. 2023-10-08T16:22:09.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:22:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.976+0000 7fdb1959d700 1 Processor -- start 2023-10-08T16:22:09.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.976+0000 7fdb1959d700 1 -- start start 2023-10-08T16:22:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.977+0000 7fdb1959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 0x7fdb140ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.977+0000 7fdb1959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 0x7fdb140aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.977+0000 7fdb1959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb140acc00 con 0x7fdb14159920 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.977+0000 7fdb1959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb140abff0 con 0x7fdb1415dfd0 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.977+0000 7fdb1959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140ac2d0 con 0x7fdb14159550 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb18d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdb14159920 0x7fdb140ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33116/0 (socket says 172.21.15.12:33116) 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb18d9c700 1 -- 172.21.15.12:0/1657928847 learned_addr learned my addr 172.21.15.12:0/1657928847 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb137fe700 1 --2- 172.21.15.12:0/1657928847 >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 0x7fdb140aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb13fff700 1 --2- 172.21.15.12:0/1657928847 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 0x7fdb140ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb12ffd700 1 -- 172.21.15.12:0/1657928847 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349066364 0 0) 0x7fdb140acc00 con 0x7fdb14159920 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb12ffd700 1 -- 172.21.15.12:0/1657928847 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdafc003570 con 0x7fdb14159920 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb13fff700 1 -- 172.21.15.12:0/1657928847 >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 msgr2=0x7fdb140aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb13fff700 1 --2- 172.21.15.12:0/1657928847 >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 0x7fdb140aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb13fff700 1 -- 172.21.15.12:0/1657928847 >> v1:172.21.15.12:6789/0 conn(0x7fdb14159920 legacy=0x7fdb140ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb13fff700 1 -- 172.21.15.12:0/1657928847 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb140ac5b0 con 0x7fdb14159550 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.978+0000 7fdb137fe700 1 --2- 172.21.15.12:0/1657928847 >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 0x7fdb140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb13fff700 1 --2- 172.21.15.12:0/1657928847 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 0x7fdb140ceac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb040098e0 tx=0x7fdb040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b6d7149ee9d01c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb12ffd700 1 -- 172.21.15.12:0/1657928847 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011630 con 0x7fdb14159550 2023-10-08T16:22:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb12ffd700 1 -- 172.21.15.12:0/1657928847 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb04011790 con 0x7fdb14159550 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb12ffd700 1 -- 172.21.15.12:0/1657928847 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011b30 con 0x7fdb14159550 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb1959d700 1 -- 172.21.15.12:0/1657928847 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 msgr2=0x7fdb140ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.979+0000 7fdb1959d700 1 --2- 172.21.15.12:0/1657928847 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 0x7fdb140ceac0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb040098e0 tx=0x7fdb040091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 -- 172.21.15.12:0/1657928847 shutdown_connections 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 --2- 172.21.15.12:0/1657928847 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159550 0x7fdb140ceac0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 --2- 172.21.15.12:0/1657928847 >> v2:172.21.15.29:3300/0 conn(0x7fdb1415dfd0 0x7fdb140aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 -- 172.21.15.12:0/1657928847 >> 172.21.15.12:0/1657928847 conn(0x7fdb1406ce80 msgr2=0x7fdb140ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 -- 172.21.15.12:0/1657928847 shutdown_connections 2023-10-08T16:22:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.980+0000 7fdb1959d700 1 -- 172.21.15.12:0/1657928847 wait complete. 2023-10-08T16:22:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.981+0000 7fdb1959d700 1 Processor -- start 2023-10-08T16:22:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.981+0000 7fdb1959d700 1 -- start start 2023-10-08T16:22:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb14159550 0x7fdb1414c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159920 0x7fdb140b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140b36a0 con 0x7fdb1415dfd0 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140b2a90 con 0x7fdb14159550 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb1959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb140b2d70 con 0x7fdb14159920 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb18d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb18d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33966/0 (socket says 172.21.15.12:33966) 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb18d9c700 1 -- 172.21.15.12:0/2844637793 learned_addr learned my addr 172.21.15.12:0/2844637793 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb13fff700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb14159550 0x7fdb1414c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.982+0000 7fdb137fe700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159920 0x7fdb140b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 -- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159920 msgr2=0x7fdb140b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159920 0x7fdb140b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 -- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb14159550 msgr2=0x7fdb1414c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb14159550 0x7fdb1414c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 -- 172.21.15.12:0/2844637793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08009420 con 0x7fdb1415dfd0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb18d9c700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c001460 tx=0x7fdb0c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00a890 con 0x7fdb1415dfd0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00a9f0 con 0x7fdb1415dfd0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb04009420 con 0x7fdb1415dfd0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.983+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00ad70 con 0x7fdb1415dfd0 2023-10-08T16:22:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.984+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb140b3330 con 0x7fdb1415dfd0 2023-10-08T16:22:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.984+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1404c3c0 con 0x7fdb1415dfd0 2023-10-08T16:22:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.985+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb0c007300 con 0x7fdb1415dfd0 2023-10-08T16:22:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.987+0000 7fdafbfff700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.987+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fdb0c084b30 con 0x7fdb1415dfd0 2023-10-08T16:22:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.987+0000 7fdb13fff700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.987+0000 7fdb13fff700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb040091e0 tx=0x7fdb04017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:09.991+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb0c051c10 con 0x7fdb1415dfd0 2023-10-08T16:22:10.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.241+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdb140b37e0 con 0x7fdb1415dfd0 2023-10-08T16:22:10.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.759+0000 7fdafbfff700 1 -- 172.21.15.12:0/2844637793 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb0c055230 con 0x7fdb1415dfd0 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 msgr2=0x7fdb000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 0x7fdb000693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdb040091e0 tx=0x7fdb04017000 comp rx=0 tx=0).stop 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 msgr2=0x7fdb140cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c001460 tx=0x7fdb0c001ae0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 shutdown_connections 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fdb00066f30 0x7fdb000693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdb1415dfd0 0x7fdb140cb520 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdb14159550 0x7fdb1414c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 --2- 172.21.15.12:0/2844637793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdb14159920 0x7fdb140b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 >> 172.21.15.12:0/2844637793 conn(0x7fdb1406ce80 msgr2=0x7fdb14154000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:10.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 shutdown_connections 2023-10-08T16:22:10.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.762+0000 7fdb1959d700 1 -- 172.21.15.12:0/2844637793 wait complete. 2023-10-08T16:22:10.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:22:10.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.973+0000 7f31c09fe700 1 Processor -- start 2023-10-08T16:22:10.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.973+0000 7f31c09fe700 1 -- start start 2023-10-08T16:22:10.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31c09fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc15de50 0x7f31bc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31c09fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31bc0cef40 0x7f31bc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31c09fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc15afd0 con 0x7f31bc153c30 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31c09fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc15b2b0 con 0x7f31bc0cef40 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31c09fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc15b590 con 0x7f31bc15de50 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31bad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f31bc153c30 0x7f31bc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33118/0 (socket says 172.21.15.12:33118) 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31bad9d700 1 -- 172.21.15.12:0/598728672 learned_addr learned my addr 172.21.15.12:0/598728672 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.974+0000 7f31bb59e700 1 --2- 172.21.15.12:0/598728672 >> v2:172.21.15.29:3300/0 conn(0x7f31bc0cef40 0x7f31bc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31ba59c700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc15de50 0x7f31bc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31b9d9b700 1 -- 172.21.15.12:0/598728672 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3139876142 0 0) 0x7f31bc15afd0 con 0x7f31bc153c30 2023-10-08T16:22:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31b9d9b700 1 -- 172.21.15.12:0/598728672 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31a4003570 con 0x7f31bc153c30 2023-10-08T16:22:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31bb59e700 1 -- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc15de50 msgr2=0x7f31bc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31bb59e700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc15de50 0x7f31bc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31bb59e700 1 -- 172.21.15.12:0/598728672 >> v1:172.21.15.12:6789/0 conn(0x7f31bc153c30 legacy=0x7f31bc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31bb59e700 1 -- 172.21.15.12:0/598728672 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc15b870 con 0x7f31bc0cef40 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.975+0000 7f31bb59e700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc0cef40 0x7f31bc15c070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009e60 tx=0x7f31b4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a4ffd01099a991 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31b9d9b700 1 -- 172.21.15.12:0/598728672 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400e070 con 0x7f31bc0cef40 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31b9d9b700 1 -- 172.21.15.12:0/598728672 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b400bab0 con 0x7f31bc0cef40 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31b9d9b700 1 -- 172.21.15.12:0/598728672 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400be30 con 0x7f31bc0cef40 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 -- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc0cef40 msgr2=0x7f31bc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc0cef40 0x7f31bc15c070 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f31b4009e60 tx=0x7f31b4009780 comp rx=0 tx=0).stop 2023-10-08T16:22:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 -- 172.21.15.12:0/598728672 shutdown_connections 2023-10-08T16:22:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc0cef40 0x7f31bc15c070 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 --2- 172.21.15.12:0/598728672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc15de50 0x7f31bc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 -- 172.21.15.12:0/598728672 >> 172.21.15.12:0/598728672 conn(0x7f31bc0703a0 msgr2=0x7f31bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 -- 172.21.15.12:0/598728672 shutdown_connections 2023-10-08T16:22:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.976+0000 7f31c09fe700 1 -- 172.21.15.12:0/598728672 wait complete. 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.978+0000 7f31c09fe700 1 Processor -- start 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.978+0000 7f31c09fe700 1 -- start start 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc0cef40 0x7f31bc14c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc153c30 0x7f31bc0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0ca4a0 con 0x7f31bc15de50 2023-10-08T16:22:10.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0c7b90 con 0x7f31bc153c30 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31c09fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0ca1c0 con 0x7f31bc0cef40 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31bb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31bb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33976/0 (socket says 172.21.15.12:33976) 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31bb59e700 1 -- 172.21.15.12:0/3608754322 learned_addr learned my addr 172.21.15.12:0/3608754322 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31ba59c700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc153c30 0x7f31bc0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.979+0000 7f31bad9d700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc0cef40 0x7f31bc14c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 -- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc0cef40 msgr2=0x7f31bc14c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc0cef40 0x7f31bc14c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 -- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc153c30 msgr2=0x7f31bc0c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc153c30 0x7f31bc0c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 -- 172.21.15.12:0/3608754322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4009a20 con 0x7f31bc15de50 2023-10-08T16:22:10.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31bb59e700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f31bc06eb00 tx=0x7f31b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4012e10 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4027470 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4027830 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0cb2b0 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.980+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc0cb870 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.981+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc0cba90 con 0x7f31bc15de50 2023-10-08T16:22:10.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.982+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31b4024070 con 0x7f31bc15de50 2023-10-08T16:22:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.984+0000 7f31a2ffd700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.984+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f31b4086d40 con 0x7f31bc15de50 2023-10-08T16:22:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.984+0000 7f31bad9d700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:10.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.985+0000 7f31bad9d700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 0x7f31a80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31ac007fd0 tx=0x7f31ac009040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:10.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:10.988+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31b4053da0 con 0x7f31bc15de50 2023-10-08T16:22:11.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.238+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31bc04c3c0 con 0x7f31bc15de50 2023-10-08T16:22:11.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.238+0000 7f31a2ffd700 1 -- 172.21.15.12:0/3608754322 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f31b402c090 con 0x7f31bc15de50 2023-10-08T16:22:11.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:11.238 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 msgr2=0x7f31a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 0x7f31a80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31ac007fd0 tx=0x7f31ac009040 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 msgr2=0x7f31bc0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f31bc06eb00 tx=0x7f31b4019000 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 shutdown_connections 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f31a8066f30 0x7f31a80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31bc15de50 0x7f31bc0b32d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31bc0cef40 0x7f31bc14c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 --2- 172.21.15.12:0/3608754322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31bc153c30 0x7f31bc0c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 >> 172.21.15.12:0/3608754322 conn(0x7f31bc0703a0 msgr2=0x7f31bc0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:11.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 shutdown_connections 2023-10-08T16:22:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.241+0000 7f31c09fe700 1 -- 172.21.15.12:0/3608754322 wait complete. 2023-10-08T16:22:11.242 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:22:11.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:22:11.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.445+0000 7f7d8359e700 1 Processor -- start 2023-10-08T16:22:11.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.446+0000 7f7d8359e700 1 -- start start 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8413fb20 0x7f7d8415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7d8413fef0 0x7f7d840c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8415ae70 con 0x7f7d8406aaa0 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8406af60 con 0x7f7d8413fef0 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8406b240 con 0x7f7d8413fb20 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d82d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7d8406aaa0 0x7f7d840c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33124/0 (socket says 172.21.15.12:33124) 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d82d9d700 1 -- 172.21.15.12:0/3193285219 learned_addr learned my addr 172.21.15.12:0/3193285219 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d81d9b700 1 --2- 172.21.15.12:0/3193285219 >> v2:172.21.15.29:3300/0 conn(0x7f7d8413fef0 0x7f7d840c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.447+0000 7f7d8259c700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8413fb20 0x7f7d8415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d8159a700 1 -- 172.21.15.12:0/3193285219 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678879191 0 0) 0x7f7d7c001490 con 0x7f7d8406aaa0 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d8159a700 1 -- 172.21.15.12:0/3193285219 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d6c003570 con 0x7f7d8406aaa0 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d81d9b700 1 -- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8413fb20 msgr2=0x7f7d8415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d81d9b700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8413fb20 0x7f7d8415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d81d9b700 1 -- 172.21.15.12:0/3193285219 >> v1:172.21.15.12:6789/0 conn(0x7f7d8406aaa0 legacy=0x7f7d840c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d81d9b700 1 -- 172.21.15.12:0/3193285219 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8406b520 con 0x7f7d8413fef0 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d81d9b700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fef0 0x7f7d840c7990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d780098d0 tx=0x7f7d78009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de9a3f20c6e7975d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d8159a700 1 -- 172.21.15.12:0/3193285219 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78005c10 con 0x7f7d8413fef0 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d8159a700 1 -- 172.21.15.12:0/3193285219 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d78005d70 con 0x7f7d8413fef0 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.448+0000 7f7d8159a700 1 -- 172.21.15.12:0/3193285219 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d78006260 con 0x7f7d8413fef0 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 -- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fef0 msgr2=0x7f7d840c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fef0 0x7f7d840c7990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7d780098d0 tx=0x7f7d78009120 comp rx=0 tx=0).stop 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 -- 172.21.15.12:0/3193285219 shutdown_connections 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8413fb20 0x7f7d8415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3193285219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fef0 0x7f7d840c7990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 -- 172.21.15.12:0/3193285219 >> 172.21.15.12:0/3193285219 conn(0x7f7d8406d170 msgr2=0x7f7d840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 -- 172.21.15.12:0/3193285219 shutdown_connections 2023-10-08T16:22:11.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.449+0000 7f7d8359e700 1 -- 172.21.15.12:0/3193285219 wait complete. 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.450+0000 7f7d8359e700 1 Processor -- start 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.451+0000 7f7d8359e700 1 -- start start 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.451+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8406aaa0 0x7f7d84155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.451+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fb20 0x7f7d84157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.451+0000 7f7d8359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.451+0000 7f7d8359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84158fd0 con 0x7f7d8413fef0 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d8359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841583c0 con 0x7f7d8413fb20 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d8359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841586a0 con 0x7f7d8406aaa0 2023-10-08T16:22:11.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33986/0 (socket says 172.21.15.12:33986) 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 -- 172.21.15.12:0/3117016032 learned_addr learned my addr 172.21.15.12:0/3117016032 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d8259c700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8406aaa0 0x7f7d84155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d81d9b700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fb20 0x7f7d84157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 -- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8406aaa0 msgr2=0x7f7d84155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8406aaa0 0x7f7d84155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 -- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fb20 msgr2=0x7f7d84157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fb20 0x7f7d84157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.452+0000 7f7d82d9d700 1 -- 172.21.15.12:0/3117016032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780093c0 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d82d9d700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0015f0 tx=0x7f7d7c001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00a8b0 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00aa10 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d84158980 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ad90 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.453+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d841561c0 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.454+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d84159180 con 0x7f7d8413fef0 2023-10-08T16:22:11.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.455+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d7c007300 con 0x7f7d8413fef0 2023-10-08T16:22:11.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.456+0000 7f7d727fc700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.456+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7d7c084920 con 0x7f7d8413fef0 2023-10-08T16:22:11.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.456+0000 7f7d8259c700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.456+0000 7f7d8259c700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 0x7f7d640693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009db0 tx=0x7f7d740091a0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.460+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d84159180 con 0x7f7d8413fef0 2023-10-08T16:22:11.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.661+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d8415ae70 con 0x7f7d8413fef0 2023-10-08T16:22:11.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.662+0000 7f7d727fc700 1 -- 172.21.15.12:0/3117016032 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+15949 (secure 0 0 0) 0x7f7d8415ae70 con 0x7f7d8413fef0 2023-10-08T16:22:11.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:11.662 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":68,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:22:08.735254+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:22:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 msgr2=0x7f7d640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 0x7f7d640693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009db0 tx=0x7f7d740091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 msgr2=0x7f7d840c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0015f0 tx=0x7f7d7c001ab0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 shutdown_connections 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7d64066f30 0x7f7d640693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d8413fef0 0x7f7d840c1430 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d8406aaa0 0x7f7d84155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 --2- 172.21.15.12:0/3117016032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d8413fb20 0x7f7d84157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 >> 172.21.15.12:0/3117016032 conn(0x7f7d8406d170 msgr2=0x7f7d840b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 shutdown_connections 2023-10-08T16:22:11.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.664+0000 7f7d8359e700 1 -- 172.21.15.12:0/3117016032 wait complete. 2023-10-08T16:22:11.682 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:22:11.682 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:22:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.870+0000 7f6b8e99d700 1 Processor -- start 2023-10-08T16:22:11.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.871+0000 7f6b8e99d700 1 -- start start 2023-10-08T16:22:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 0x7f6b8815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8e99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8815ae70 con 0x7f6b8813fb20 2023-10-08T16:22:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8e99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8806af60 con 0x7f6b8806aaa0 2023-10-08T16:22:11.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8806b240 con 0x7f6b8813fef0 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8d99b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6b8813fb20 0x7f6b880c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33128/0 (socket says 172.21.15.12:33128) 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8d99b700 1 -- 172.21.15.12:0/2034098395 learned_addr learned my addr 172.21.15.12:0/2034098395 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.872+0000 7f6b8d19a700 1 --2- 172.21.15.12:0/2034098395 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 0x7f6b8815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088090216 0 0) 0x7f6b84001110 con 0x7f6b8813fb20 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b74003570 con 0x7f6b8813fb20 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328335575 0 0) 0x7f6b8806af60 con 0x7f6b8806aaa0 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b84001110 con 0x7f6b8806aaa0 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528138869 0 0) 0x7f6b74003570 con 0x7f6b8813fb20 2023-10-08T16:22:11.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8d19a700 1 -- 172.21.15.12:0/2034098395 >> v1:172.21.15.29:6789/0 conn(0x7f6b8806aaa0 legacy=0x7f6b880c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8d19a700 1 -- 172.21.15.12:0/2034098395 >> v1:172.21.15.12:6789/0 conn(0x7f6b8813fb20 legacy=0x7f6b880c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8d19a700 1 -- 172.21.15.12:0/2034098395 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8806b520 con 0x7f6b8813fef0 2023-10-08T16:22:11.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.873+0000 7f6b8d19a700 1 --2- 172.21.15.12:0/2034098395 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 0x7f6b8815a930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009900 tx=0x7f6b78009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d29124d623d19056 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84001600 con 0x7f6b8813fef0 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b78011420 con 0x7f6b8813fef0 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8c999700 1 -- 172.21.15.12:0/2034098395 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b780117c0 con 0x7f6b8813fef0 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 -- 172.21.15.12:0/2034098395 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 msgr2=0x7f6b8815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/2034098395 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 0x7f6b8815a930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6b78009900 tx=0x7f6b78009120 comp rx=0 tx=0).stop 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 -- 172.21.15.12:0/2034098395 shutdown_connections 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/2034098395 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fef0 0x7f6b8815a930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 -- 172.21.15.12:0/2034098395 >> 172.21.15.12:0/2034098395 conn(0x7f6b8806d170 msgr2=0x7f6b880cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 -- 172.21.15.12:0/2034098395 shutdown_connections 2023-10-08T16:22:11.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.874+0000 7f6b8e99d700 1 -- 172.21.15.12:0/2034098395 wait complete. 2023-10-08T16:22:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.876+0000 7f6b8e99d700 1 Processor -- start 2023-10-08T16:22:11.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.876+0000 7f6b8e99d700 1 -- start start 2023-10-08T16:22:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fb20 0x7f6b880add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b8813fef0 0x7f6b88158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881572f0 con 0x7f6b8806aaa0 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880ae7e0 con 0x7f6b8813fef0 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881569c0 con 0x7f6b8813fb20 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33996/0 (socket says 172.21.15.12:33996) 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8d99b700 1 -- 172.21.15.12:0/3477128910 learned_addr learned my addr 172.21.15.12:0/3477128910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8d19a700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fb20 0x7f6b880add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.877+0000 7f6b8e19c700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b8813fef0 0x7f6b88158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 -- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fb20 msgr2=0x7f6b880add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fb20 0x7f6b880add40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 -- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b8813fef0 msgr2=0x7f6b88158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b8813fef0 0x7f6b88158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 -- 172.21.15.12:0/3477128910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b780093c0 con 0x7f6b8806aaa0 2023-10-08T16:22:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8d99b700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400cb60 tx=0x7f6b84001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400ce70 con 0x7f6b8806aaa0 2023-10-08T16:22:11.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b84007360 con 0x7f6b8806aaa0 2023-10-08T16:22:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b84004830 con 0x7f6b8806aaa0 2023-10-08T16:22:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b88156ca0 con 0x7f6b8806aaa0 2023-10-08T16:22:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.878+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8813cc40 con 0x7f6b8806aaa0 2023-10-08T16:22:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.879+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8804c3c0 con 0x7f6b8806aaa0 2023-10-08T16:22:11.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.880+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6b84004c60 con 0x7f6b8806aaa0 2023-10-08T16:22:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.881+0000 7f6b7dffb700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 0x7f6b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.882+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f6b84083d90 con 0x7f6b8806aaa0 2023-10-08T16:22:11.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.882+0000 7f6b8d19a700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 0x7f6b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:11.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.882+0000 7f6b8d19a700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 0x7f6b6c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b88069580 tx=0x7f6b78016000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:11.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:11.886+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b8404c5a0 con 0x7f6b8806aaa0 2023-10-08T16:22:12.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.082+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b88157430 con 0x7f6b6c066f30 2023-10-08T16:22:12.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.093+0000 7f6b7dffb700 1 -- 172.21.15.12:0/3477128910 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283546 (secure 0 0 0) 0x7f6b78011590 con 0x7f6b6c066f30 2023-10-08T16:22:12.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 msgr2=0x7f6b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 0x7f6b6c0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b88069580 tx=0x7f6b78016000 comp rx=0 tx=0).stop 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 msgr2=0x7f6b8813c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400cb60 tx=0x7f6b84001c40 comp rx=0 tx=0).stop 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 shutdown_connections 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f6b6c066f30 0x7f6b6c0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b8806aaa0 0x7f6b8813c700 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b8813fef0 0x7f6b88158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 --2- 172.21.15.12:0/3477128910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b8813fb20 0x7f6b880add40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 >> 172.21.15.12:0/3477128910 conn(0x7f6b8806d170 msgr2=0x7f6b8813e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:12.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 shutdown_connections 2023-10-08T16:22:12.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.097+0000 7f6b8e99d700 1 -- 172.21.15.12:0/3477128910 wait complete. 2023-10-08T16:22:12.100 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:22:12.114 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:22:11.164598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":229,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2430736,"kb_used_data":7376,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543984,"statfs":{"total":773094113280,"available":770605039616,"internally_reserved":0,"allocated":7553024,"data_stored":4155991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.438309"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764559+0000","last_change":"2023-10-08T16:22:07.758756+0000","last_active":"2023-10-08T16:22:07.764559+0000","last_peered":"2023-10-08T16:22:07.764559+0000","last_clean":"2023-10-08T16:22:07.764559+0000","last_became_active":"2023-10-08T16:22:07.758515+0000","last_became_peered":"2023-10-08T16:22:07.758515+0000","last_unstale":"2023-10-08T16:22:07.764559+0000","last_undegraded":"2023-10-08T16:22:07.764559+0000","last_fullsized":"2023-10-08T16:22:07.764559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:28.093357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.759608+0000","last_change":"2023-10-08T16:22:07.752292+0000","last_active":"2023-10-08T16:22:07.759608+0000","last_peered":"2023-10-08T16:22:07.759608+0000","last_clean":"2023-10-08T16:22:07.759608+0000","last_became_active":"2023-10-08T16:22:07.752022+0000","last_became_peered":"2023-10-08T16:22:07.752022+0000","last_unstale":"2023-10-08T16:22:07.759608+0000","last_undegraded":"2023-10-08T16:22:07.759608+0000","last_fullsized":"2023-10-08T16:22:07.759608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:20.346245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766634+0000","last_change":"2023-10-08T16:22:07.763751+0000","last_active":"2023-10-08T16:22:07.766634+0000","last_peered":"2023-10-08T16:22:07.766634+0000","last_clean":"2023-10-08T16:22:07.766634+0000","last_became_active":"2023-10-08T16:22:07.763447+0000","last_became_peered":"2023-10-08T16:22:07.763447+0000","last_unstale":"2023-10-08T16:22:07.766634+0000","last_undegraded":"2023-10-08T16:22:07.766634+0000","last_fullsized":"2023-10-08T16:22:07.766634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:33.626750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764588+0000","last_change":"2023-10-08T16:22:07.760102+0000","last_active":"2023-10-08T16:22:07.764588+0000","last_peered":"2023-10-08T16:22:07.764588+0000","last_clean":"2023-10-08T16:22:07.764588+0000","last_became_active":"2023-10-08T16:22:07.759849+0000","last_became_peered":"2023-10-08T16:22:07.759849+0000","last_unstale":"2023-10-08T16:22:07.764588+0000","last_undegraded":"2023-10-08T16:22:07.764588+0000","last_fullsized":"2023-10-08T16:22:07.764588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:08.987271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764857+0000","last_change":"2023-10-08T16:22:07.759897+0000","last_active":"2023-10-08T16:22:07.764857+0000","last_peered":"2023-10-08T16:22:07.764857+0000","last_clean":"2023-10-08T16:22:07.764857+0000","last_became_active":"2023-10-08T16:22:07.759646+0000","last_became_peered":"2023-10-08T16:22:07.759646+0000","last_unstale":"2023-10-08T16:22:07.764857+0000","last_undegraded":"2023-10-08T16:22:07.764857+0000","last_fullsized":"2023-10-08T16:22:07.764857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.312679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764496+0000","last_change":"2023-10-08T16:22:07.757527+0000","last_active":"2023-10-08T16:22:07.764496+0000","last_peered":"2023-10-08T16:22:07.764496+0000","last_clean":"2023-10-08T16:22:07.764496+0000","last_became_active":"2023-10-08T16:22:07.757256+0000","last_became_peered":"2023-10-08T16:22:07.757256+0000","last_unstale":"2023-10-08T16:22:07.764496+0000","last_undegraded":"2023-10-08T16:22:07.764496+0000","last_fullsized":"2023-10-08T16:22:07.764496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767316+0000","last_change":"2023-10-08T16:22:07.764241+0000","last_active":"2023-10-08T16:22:07.767316+0000","last_peered":"2023-10-08T16:22:07.767316+0000","last_clean":"2023-10-08T16:22:07.767316+0000","last_became_active":"2023-10-08T16:22:07.763964+0000","last_became_peered":"2023-10-08T16:22:07.763964+0000","last_unstale":"2023-10-08T16:22:07.767316+0000","last_undegraded":"2023-10-08T16:22:07.767316+0000","last_fullsized":"2023-10-08T16:22:07.767316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764613+0000","last_change":"2023-10-08T16:22:07.756830+0000","last_active":"2023-10-08T16:22:07.764613+0000","last_peered":"2023-10-08T16:22:07.764613+0000","last_clean":"2023-10-08T16:22:07.764613+0000","last_became_active":"2023-10-08T16:22:07.756549+0000","last_became_peered":"2023-10-08T16:22:07.756549+0000","last_unstale":"2023-10-08T16:22:07.764613+0000","last_undegraded":"2023-10-08T16:22:07.764613+0000","last_fullsized":"2023-10-08T16:22:07.764613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:13.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.753568+0000","last_change":"2023-10-08T16:22:07.750512+0000","last_active":"2023-10-08T16:22:07.753568+0000","last_peered":"2023-10-08T16:22:07.753568+0000","last_clean":"2023-10-08T16:22:07.753568+0000","last_became_active":"2023-10-08T16:22:07.750237+0000","last_became_peered":"2023-10-08T16:22:07.750237+0000","last_unstale":"2023-10-08T16:22:07.753568+0000","last_undegraded":"2023-10-08T16:22:07.753568+0000","last_fullsized":"2023-10-08T16:22:07.753568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:07.835319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757234+0000","last_change":"2023-10-08T16:22:07.753272+0000","last_active":"2023-10-08T16:22:07.757234+0000","last_peered":"2023-10-08T16:22:07.757234+0000","last_clean":"2023-10-08T16:22:07.757234+0000","last_became_active":"2023-10-08T16:22:07.752966+0000","last_became_peered":"2023-10-08T16:22:07.752966+0000","last_unstale":"2023-10-08T16:22:07.757234+0000","last_undegraded":"2023-10-08T16:22:07.757234+0000","last_fullsized":"2023-10-08T16:22:07.757234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770865+0000","last_change":"2023-10-08T16:22:07.762024+0000","last_active":"2023-10-08T16:22:07.770865+0000","last_peered":"2023-10-08T16:22:07.770865+0000","last_clean":"2023-10-08T16:22:07.770865+0000","last_became_active":"2023-10-08T16:22:07.761772+0000","last_became_peered":"2023-10-08T16:22:07.761772+0000","last_unstale":"2023-10-08T16:22:07.770865+0000","last_undegraded":"2023-10-08T16:22:07.770865+0000","last_fullsized":"2023-10-08T16:22:07.770865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:09.885712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765325+0000","last_change":"2023-10-08T16:22:07.761449+0000","last_active":"2023-10-08T16:22:07.765325+0000","last_peered":"2023-10-08T16:22:07.765325+0000","last_clean":"2023-10-08T16:22:07.765325+0000","last_became_active":"2023-10-08T16:22:07.761173+0000","last_became_peered":"2023-10-08T16:22:07.761173+0000","last_unstale":"2023-10-08T16:22:07.765325+0000","last_undegraded":"2023-10-08T16:22:07.765325+0000","last_fullsized":"2023-10-08T16:22:07.765325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:38.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770557+0000","last_change":"2023-10-08T16:22:07.765513+0000","last_active":"2023-10-08T16:22:07.770557+0000","last_peered":"2023-10-08T16:22:07.770557+0000","last_clean":"2023-10-08T16:22:07.770557+0000","last_became_active":"2023-10-08T16:22:07.765132+0000","last_became_peered":"2023-10-08T16:22:07.765132+0000","last_unstale":"2023-10-08T16:22:07.770557+0000","last_undegraded":"2023-10-08T16:22:07.770557+0000","last_fullsized":"2023-10-08T16:22:07.770557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757793+0000","last_change":"2023-10-08T16:22:07.755753+0000","last_active":"2023-10-08T16:22:07.757793+0000","last_peered":"2023-10-08T16:22:07.757793+0000","last_clean":"2023-10-08T16:22:07.757793+0000","last_became_active":"2023-10-08T16:22:07.755364+0000","last_became_peered":"2023-10-08T16:22:07.755364+0000","last_unstale":"2023-10-08T16:22:07.757793+0000","last_undegraded":"2023-10-08T16:22:07.757793+0000","last_fullsized":"2023-10-08T16:22:07.757793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:41.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767204+0000","last_change":"2023-10-08T16:22:07.761256+0000","last_active":"2023-10-08T16:22:07.767204+0000","last_peered":"2023-10-08T16:22:07.767204+0000","last_clean":"2023-10-08T16:22:07.767204+0000","last_became_active":"2023-10-08T16:22:07.760995+0000","last_became_peered":"2023-10-08T16:22:07.760995+0000","last_unstale":"2023-10-08T16:22:07.767204+0000","last_undegraded":"2023-10-08T16:22:07.767204+0000","last_fullsized":"2023-10-08T16:22:07.767204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760210+0000","last_change":"2023-10-08T16:22:07.758889+0000","last_active":"2023-10-08T16:22:07.760210+0000","last_peered":"2023-10-08T16:22:07.760210+0000","last_clean":"2023-10-08T16:22:07.760210+0000","last_became_active":"2023-10-08T16:22:07.758586+0000","last_became_peered":"2023-10-08T16:22:07.758586+0000","last_unstale":"2023-10-08T16:22:07.760210+0000","last_undegraded":"2023-10-08T16:22:07.760210+0000","last_fullsized":"2023-10-08T16:22:07.760210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:59.843696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779240+0000","last_change":"2023-10-08T16:22:06.756675+0000","last_active":"2023-10-08T16:22:07.779240+0000","last_peered":"2023-10-08T16:22:07.779240+0000","last_clean":"2023-10-08T16:22:07.779240+0000","last_became_active":"2023-10-08T16:22:06.756367+0000","last_became_peered":"2023-10-08T16:22:06.756367+0000","last_unstale":"2023-10-08T16:22:07.779240+0000","last_undegraded":"2023-10-08T16:22:07.779240+0000","last_fullsized":"2023-10-08T16:22:07.779240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730079+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.774313+0000","last_change":"2023-10-08T16:22:06.754215+0000","last_active":"2023-10-08T16:22:07.774313+0000","last_peered":"2023-10-08T16:22:07.774313+0000","last_clean":"2023-10-08T16:22:07.774313+0000","last_became_active":"2023-10-08T16:22:06.753791+0000","last_became_peered":"2023-10-08T16:22:06.753791+0000","last_unstale":"2023-10-08T16:22:07.774313+0000","last_undegraded":"2023-10-08T16:22:07.774313+0000","last_fullsized":"2023-10-08T16:22:07.774313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760979+0000","last_change":"2023-10-08T16:22:07.759986+0000","last_active":"2023-10-08T16:22:07.760979+0000","last_peered":"2023-10-08T16:22:07.760979+0000","last_clean":"2023-10-08T16:22:07.760979+0000","last_became_active":"2023-10-08T16:22:07.759691+0000","last_became_peered":"2023-10-08T16:22:07.759691+0000","last_unstale":"2023-10-08T16:22:07.760979+0000","last_undegraded":"2023-10-08T16:22:07.760979+0000","last_fullsized":"2023-10-08T16:22:07.760979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:34.572274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.732295+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:23.006570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778229+0000","last_change":"2023-10-08T16:22:06.751312+0000","last_active":"2023-10-08T16:22:07.778229+0000","last_peered":"2023-10-08T16:22:07.778229+0000","last_clean":"2023-10-08T16:22:07.778229+0000","last_became_active":"2023-10-08T16:22:06.751047+0000","last_became_peered":"2023-10-08T16:22:06.751047+0000","last_unstale":"2023-10-08T16:22:07.778229+0000","last_undegraded":"2023-10-08T16:22:07.778229+0000","last_fullsized":"2023-10-08T16:22:07.778229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764951+0000","last_change":"2023-10-08T16:22:07.758292+0000","last_active":"2023-10-08T16:22:07.764951+0000","last_peered":"2023-10-08T16:22:07.764951+0000","last_clean":"2023-10-08T16:22:07.764951+0000","last_became_active":"2023-10-08T16:22:07.758005+0000","last_became_peered":"2023-10-08T16:22:07.758005+0000","last_unstale":"2023-10-08T16:22:07.764951+0000","last_undegraded":"2023-10-08T16:22:07.764951+0000","last_fullsized":"2023-10-08T16:22:07.764951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:57.243118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729679+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766652+0000","last_change":"2023-10-08T16:22:07.763807+0000","last_active":"2023-10-08T16:22:07.766652+0000","last_peered":"2023-10-08T16:22:07.766652+0000","last_clean":"2023-10-08T16:22:07.766652+0000","last_became_active":"2023-10-08T16:22:07.761035+0000","last_became_peered":"2023-10-08T16:22:07.761035+0000","last_unstale":"2023-10-08T16:22:07.766652+0000","last_undegraded":"2023-10-08T16:22:07.766652+0000","last_fullsized":"2023-10-08T16:22:07.766652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:45.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728903+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749042+0000","last_change":"2023-10-08T16:22:06.748984+0000","last_active":"2023-10-08T16:22:07.749042+0000","last_peered":"2023-10-08T16:22:07.749042+0000","last_clean":"2023-10-08T16:22:07.749042+0000","last_became_active":"2023-10-08T16:22:06.748582+0000","last_became_peered":"2023-10-08T16:22:06.748582+0000","last_unstale":"2023-10-08T16:22:07.749042+0000","last_undegraded":"2023-10-08T16:22:07.749042+0000","last_fullsized":"2023-10-08T16:22:07.749042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:20.846032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729521+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:50.588725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749030+0000","last_change":"2023-10-08T16:22:06.744862+0000","last_active":"2023-10-08T16:22:07.749030+0000","last_peered":"2023-10-08T16:22:07.749030+0000","last_clean":"2023-10-08T16:22:07.749030+0000","last_became_active":"2023-10-08T16:22:06.744599+0000","last_became_peered":"2023-10-08T16:22:06.744599+0000","last_unstale":"2023-10-08T16:22:07.749030+0000","last_undegraded":"2023-10-08T16:22:07.749030+0000","last_fullsized":"2023-10-08T16:22:07.749030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:35.219631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765126+0000","last_change":"2023-10-08T16:22:07.759240+0000","last_active":"2023-10-08T16:22:07.765126+0000","last_peered":"2023-10-08T16:22:07.765126+0000","last_clean":"2023-10-08T16:22:07.765126+0000","last_became_active":"2023-10-08T16:22:07.758975+0000","last_became_peered":"2023-10-08T16:22:07.758975+0000","last_unstale":"2023-10-08T16:22:07.765126+0000","last_undegraded":"2023-10-08T16:22:07.765126+0000","last_fullsized":"2023-10-08T16:22:07.765126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.150111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.731599+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:53.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.780562+0000","last_change":"2023-10-08T16:22:06.752726+0000","last_active":"2023-10-08T16:22:07.780562+0000","last_peered":"2023-10-08T16:22:07.780562+0000","last_clean":"2023-10-08T16:22:07.780562+0000","last_became_active":"2023-10-08T16:22:06.752376+0000","last_became_peered":"2023-10-08T16:22:06.752376+0000","last_unstale":"2023-10-08T16:22:07.780562+0000","last_undegraded":"2023-10-08T16:22:07.780562+0000","last_fullsized":"2023-10-08T16:22:07.780562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779396+0000","last_change":"2023-10-08T16:22:06.754410+0000","last_active":"2023-10-08T16:22:07.779396+0000","last_peered":"2023-10-08T16:22:07.779396+0000","last_clean":"2023-10-08T16:22:07.779396+0000","last_became_active":"2023-10-08T16:22:06.753839+0000","last_became_peered":"2023-10-08T16:22:06.753839+0000","last_unstale":"2023-10-08T16:22:07.779396+0000","last_undegraded":"2023-10-08T16:22:07.779396+0000","last_fullsized":"2023-10-08T16:22:07.779396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:56.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762251+0000","last_change":"2023-10-08T16:22:07.749665+0000","last_active":"2023-10-08T16:22:07.762251+0000","last_peered":"2023-10-08T16:22:07.762251+0000","last_clean":"2023-10-08T16:22:07.762251+0000","last_became_active":"2023-10-08T16:22:07.749419+0000","last_became_peered":"2023-10-08T16:22:07.749419+0000","last_unstale":"2023-10-08T16:22:07.762251+0000","last_undegraded":"2023-10-08T16:22:07.762251+0000","last_fullsized":"2023-10-08T16:22:07.762251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:54.684827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730914+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:39.745733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765000+0000","last_change":"2023-10-08T16:22:07.757922+0000","last_active":"2023-10-08T16:22:07.765000+0000","last_peered":"2023-10-08T16:22:07.765000+0000","last_clean":"2023-10-08T16:22:07.765000+0000","last_became_active":"2023-10-08T16:22:07.757672+0000","last_became_peered":"2023-10-08T16:22:07.757672+0000","last_unstale":"2023-10-08T16:22:07.765000+0000","last_undegraded":"2023-10-08T16:22:07.765000+0000","last_fullsized":"2023-10-08T16:22:07.765000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:50.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743546+0000","last_change":"2023-10-08T16:22:06.750046+0000","last_active":"2023-10-08T16:22:07.743546+0000","last_peered":"2023-10-08T16:22:07.743546+0000","last_clean":"2023-10-08T16:22:07.743546+0000","last_became_active":"2023-10-08T16:22:06.749762+0000","last_became_peered":"2023-10-08T16:22:06.749762+0000","last_unstale":"2023-10-08T16:22:07.743546+0000","last_undegraded":"2023-10-08T16:22:07.743546+0000","last_fullsized":"2023-10-08T16:22:07.743546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:27.086771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779040+0000","last_change":"2023-10-08T16:22:06.748832+0000","last_active":"2023-10-08T16:22:07.779040+0000","last_peered":"2023-10-08T16:22:07.779040+0000","last_clean":"2023-10-08T16:22:07.779040+0000","last_became_active":"2023-10-08T16:22:06.748243+0000","last_became_peered":"2023-10-08T16:22:06.748243+0000","last_unstale":"2023-10-08T16:22:07.779040+0000","last_undegraded":"2023-10-08T16:22:07.779040+0000","last_fullsized":"2023-10-08T16:22:07.779040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757181+0000","last_change":"2023-10-08T16:22:07.753126+0000","last_active":"2023-10-08T16:22:07.757181+0000","last_peered":"2023-10-08T16:22:07.757181+0000","last_clean":"2023-10-08T16:22:07.757181+0000","last_became_active":"2023-10-08T16:22:07.752761+0000","last_became_peered":"2023-10-08T16:22:07.752761+0000","last_unstale":"2023-10-08T16:22:07.757181+0000","last_undegraded":"2023-10-08T16:22:07.757181+0000","last_fullsized":"2023-10-08T16:22:07.757181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.775396+0000","last_change":"2023-10-08T16:22:06.754333+0000","last_active":"2023-10-08T16:22:07.775396+0000","last_peered":"2023-10-08T16:22:07.775396+0000","last_clean":"2023-10-08T16:22:07.775396+0000","last_became_active":"2023-10-08T16:22:06.754015+0000","last_became_peered":"2023-10-08T16:22:06.754015+0000","last_unstale":"2023-10-08T16:22:07.775396+0000","last_undegraded":"2023-10-08T16:22:07.775396+0000","last_fullsized":"2023-10-08T16:22:07.775396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764706+0000","last_change":"2023-10-08T16:22:07.761350+0000","last_active":"2023-10-08T16:22:07.764706+0000","last_peered":"2023-10-08T16:22:07.764706+0000","last_clean":"2023-10-08T16:22:07.764706+0000","last_became_active":"2023-10-08T16:22:07.761049+0000","last_became_peered":"2023-10-08T16:22:07.761049+0000","last_unstale":"2023-10-08T16:22:07.764706+0000","last_undegraded":"2023-10-08T16:22:07.764706+0000","last_fullsized":"2023-10-08T16:22:07.764706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:13.143629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730636+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729375+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:33.565687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743100+0000","last_change":"2023-10-08T16:22:06.757272+0000","last_active":"2023-10-08T16:22:07.743100+0000","last_peered":"2023-10-08T16:22:07.743100+0000","last_clean":"2023-10-08T16:22:07.743100+0000","last_became_active":"2023-10-08T16:22:06.756950+0000","last_became_peered":"2023-10-08T16:22:06.756950+0000","last_unstale":"2023-10-08T16:22:07.743100+0000","last_undegraded":"2023-10-08T16:22:07.743100+0000","last_fullsized":"2023-10-08T16:22:07.743100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:37.155145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765040+0000","last_change":"2023-10-08T16:22:07.757241+0000","last_active":"2023-10-08T16:22:07.765040+0000","last_peered":"2023-10-08T16:22:07.765040+0000","last_clean":"2023-10-08T16:22:07.765040+0000","last_became_active":"2023-10-08T16:22:07.756871+0000","last_became_peered":"2023-10-08T16:22:07.756871+0000","last_unstale":"2023-10-08T16:22:07.765040+0000","last_undegraded":"2023-10-08T16:22:07.765040+0000","last_fullsized":"2023-10-08T16:22:07.765040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:16.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778838+0000","last_change":"2023-10-08T16:22:06.751189+0000","last_active":"2023-10-08T16:22:07.778838+0000","last_peered":"2023-10-08T16:22:07.778838+0000","last_clean":"2023-10-08T16:22:07.778838+0000","last_became_active":"2023-10-08T16:22:06.750938+0000","last_became_peered":"2023-10-08T16:22:06.750938+0000","last_unstale":"2023-10-08T16:22:07.778838+0000","last_undegraded":"2023-10-08T16:22:07.778838+0000","last_fullsized":"2023-10-08T16:22:07.778838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.747082+0000","last_change":"2023-10-08T16:22:07.743521+0000","last_active":"2023-10-08T16:22:07.747082+0000","last_peered":"2023-10-08T16:22:07.747082+0000","last_clean":"2023-10-08T16:22:07.747082+0000","last_became_active":"2023-10-08T16:22:07.743242+0000","last_became_peered":"2023-10-08T16:22:07.743242+0000","last_unstale":"2023-10-08T16:22:07.747082+0000","last_undegraded":"2023-10-08T16:22:07.747082+0000","last_fullsized":"2023-10-08T16:22:07.747082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:11.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728968+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757689+0000","last_change":"2023-10-08T16:22:07.753369+0000","last_active":"2023-10-08T16:22:07.757689+0000","last_peered":"2023-10-08T16:22:07.757689+0000","last_clean":"2023-10-08T16:22:07.757689+0000","last_became_active":"2023-10-08T16:22:07.753039+0000","last_became_peered":"2023-10-08T16:22:07.753039+0000","last_unstale":"2023-10-08T16:22:07.757689+0000","last_undegraded":"2023-10-08T16:22:07.757689+0000","last_fullsized":"2023-10-08T16:22:07.757689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748156+0000","last_change":"2023-10-08T16:22:06.744681+0000","last_active":"2023-10-08T16:22:07.748156+0000","last_peered":"2023-10-08T16:22:07.748156+0000","last_clean":"2023-10-08T16:22:07.748156+0000","last_became_active":"2023-10-08T16:22:06.744415+0000","last_became_peered":"2023-10-08T16:22:06.744415+0000","last_unstale":"2023-10-08T16:22:07.748156+0000","last_undegraded":"2023-10-08T16:22:07.748156+0000","last_fullsized":"2023-10-08T16:22:07.748156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:42.103131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764647+0000","last_change":"2023-10-08T16:22:07.760720+0000","last_active":"2023-10-08T16:22:07.764647+0000","last_peered":"2023-10-08T16:22:07.764647+0000","last_clean":"2023-10-08T16:22:07.764647+0000","last_became_active":"2023-10-08T16:22:07.760449+0000","last_became_peered":"2023-10-08T16:22:07.760449+0000","last_unstale":"2023-10-08T16:22:07.764647+0000","last_undegraded":"2023-10-08T16:22:07.764647+0000","last_fullsized":"2023-10-08T16:22:07.764647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:15.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730233+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:59.480613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.746196+0000","last_change":"2023-10-08T16:22:06.751649+0000","last_active":"2023-10-08T16:22:07.746196+0000","last_peered":"2023-10-08T16:22:07.746196+0000","last_clean":"2023-10-08T16:22:07.746196+0000","last_became_active":"2023-10-08T16:22:06.751384+0000","last_became_peered":"2023-10-08T16:22:06.751384+0000","last_unstale":"2023-10-08T16:22:07.746196+0000","last_undegraded":"2023-10-08T16:22:07.746196+0000","last_fullsized":"2023-10-08T16:22:07.746196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764542+0000","last_change":"2023-10-08T16:22:07.758165+0000","last_active":"2023-10-08T16:22:07.764542+0000","last_peered":"2023-10-08T16:22:07.764542+0000","last_clean":"2023-10-08T16:22:07.764542+0000","last_became_active":"2023-10-08T16:22:07.756570+0000","last_became_peered":"2023-10-08T16:22:07.756570+0000","last_unstale":"2023-10-08T16:22:07.764542+0000","last_undegraded":"2023-10-08T16:22:07.764542+0000","last_fullsized":"2023-10-08T16:22:07.764542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:24.013156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729449+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:44.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737504+0000","last_change":"2023-10-08T16:22:06.753864+0000","last_active":"2023-10-08T16:22:07.737504+0000","last_peered":"2023-10-08T16:22:07.737504+0000","last_clean":"2023-10-08T16:22:07.737504+0000","last_became_active":"2023-10-08T16:22:06.753562+0000","last_became_peered":"2023-10-08T16:22:06.753562+0000","last_unstale":"2023-10-08T16:22:07.737504+0000","last_undegraded":"2023-10-08T16:22:07.737504+0000","last_fullsized":"2023-10-08T16:22:07.737504+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765058+0000","last_change":"2023-10-08T16:22:07.759697+0000","last_active":"2023-10-08T16:22:07.765058+0000","last_peered":"2023-10-08T16:22:07.765058+0000","last_clean":"2023-10-08T16:22:07.765058+0000","last_became_active":"2023-10-08T16:22:07.757100+0000","last_became_peered":"2023-10-08T16:22:07.757100+0000","last_unstale":"2023-10-08T16:22:07.765058+0000","last_undegraded":"2023-10-08T16:22:07.765058+0000","last_fullsized":"2023-10-08T16:22:07.765058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:02.407878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729428+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:52.541301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765143+0000","last_change":"2023-10-08T16:22:07.758872+0000","last_active":"2023-10-08T16:22:07.765143+0000","last_peered":"2023-10-08T16:22:07.765143+0000","last_clean":"2023-10-08T16:22:07.765143+0000","last_became_active":"2023-10-08T16:22:07.758629+0000","last_became_peered":"2023-10-08T16:22:07.758629+0000","last_unstale":"2023-10-08T16:22:07.765143+0000","last_undegraded":"2023-10-08T16:22:07.765143+0000","last_fullsized":"2023-10-08T16:22:07.765143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:33.524423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729022+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:21.424736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737566+0000","last_change":"2023-10-08T16:22:06.757296+0000","last_active":"2023-10-08T16:22:07.737566+0000","last_peered":"2023-10-08T16:22:07.737566+0000","last_clean":"2023-10-08T16:22:07.737566+0000","last_became_active":"2023-10-08T16:22:06.757040+0000","last_became_peered":"2023-10-08T16:22:06.757040+0000","last_unstale":"2023-10-08T16:22:07.737566+0000","last_undegraded":"2023-10-08T16:22:07.737566+0000","last_fullsized":"2023-10-08T16:22:07.737566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748936+0000","last_change":"2023-10-08T16:22:06.751787+0000","last_active":"2023-10-08T16:22:07.748936+0000","last_peered":"2023-10-08T16:22:07.748936+0000","last_clean":"2023-10-08T16:22:07.748936+0000","last_became_active":"2023-10-08T16:22:06.751514+0000","last_became_peered":"2023-10-08T16:22:06.751514+0000","last_unstale":"2023-10-08T16:22:07.748936+0000","last_undegraded":"2023-10-08T16:22:07.748936+0000","last_fullsized":"2023-10-08T16:22:07.748936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764839+0000","last_change":"2023-10-08T16:22:07.759404+0000","last_active":"2023-10-08T16:22:07.764839+0000","last_peered":"2023-10-08T16:22:07.764839+0000","last_clean":"2023-10-08T16:22:07.764839+0000","last_became_active":"2023-10-08T16:22:07.759138+0000","last_became_peered":"2023-10-08T16:22:07.759138+0000","last_unstale":"2023-10-08T16:22:07.764839+0000","last_undegraded":"2023-10-08T16:22:07.764839+0000","last_fullsized":"2023-10-08T16:22:07.764839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730411+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:10.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":282,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-08T16:22:04.614533+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:22:04.614533+0000","last_peered":"2023-10-08T16:22:04.614533+0000","last_clean":"2023-10-08T16:22:04.614533+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:22:04.614533+0000","last_undegraded":"2023-10-08T16:22:04.614533+0000","last_fullsized":"2023-10-08T16:22:04.614533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1368064,"data_stored":952563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.103,"15min":1.103},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.99199999999999999,"15min":1.089},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.41299999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.997,"5min":0.997,"15min":1.1160000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98099999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.05,"15min":1.1000000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":5.5590000000000002},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.234},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.3919999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.432,"15min":0.40600000000000003},"max":{"1min":0.97299999999999998,"5min":1.101,"15min":1.3680000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.4319999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.014,"15min":1.323},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98699999999999999,"5min":1,"15min":1.448},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.995,"15min":1.125},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1,"5min":1.0429999999999999,"15min":1.0600000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94299999999999995,"5min":1.0369999999999999,"15min":1.365},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":1.004,"15min":1.0549999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.58299999999999996,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.038,"5min":1.0700000000000001,"15min":1.552},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.4570000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.069},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.497},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.619},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0249999999999999,"15min":1.0389999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73099999999999998,"15min":0.77400000000000002},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.5900000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64700000000000002,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.0109999999999999,"15min":1.1240000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":0.91600000000000004,"5min":0.98099999999999998,"15min":1.0600000000000001},"last":0.87}]},{"osd":7,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0569999999999999,"15min":1.222},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":0.94199999999999995,"5min":1.073,"15min":1.3080000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":0.873},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.38100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.498,"5min":0.498,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":0.95199999999999996,"15min":1.472},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.66100000000000003,"5min":0.56200000000000006,"15min":0.45500000000000002},"max":{"1min":1.0129999999999999,"5min":1.0669999999999999,"15min":1.373},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":1.2230000000000001,"15min":1.375},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.046,"5min":1.157,"15min":1.276},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83899999999999997,"15min":0.80500000000000005},"min":{"1min":0.64300000000000002,"5min":0.63300000000000001,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.107,"15min":1.224},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.206,"15min":1.429},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.52200000000000002},"max":{"1min":1.0269999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.67700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.1839999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.302,"15min":1.514},"last":0.97599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":972995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.498},"min":{"1min":0.38,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.65700000000000003,"5min":0.88800000000000001,"15min":1.524},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":1.679},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.82799999999999996,"15min":1.5569999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.33800000000000002},"max":{"1min":0.60399999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.371},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.84999999999999998,"5min":0.872,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.40300000000000002},"max":{"1min":1.018,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.135,"15min":1.325},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83299999999999996,"15min":0.80100000000000005},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":0.98599999999999999,"5min":1.1439999999999999,"15min":1.153},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":0.96399999999999997,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.52900000000000003},"max":{"1min":0.97999999999999998,"5min":1.1950000000000001,"15min":1.288},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.59599999999999997,"15min":0.51600000000000001},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.262},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.012,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.501},"max":{"1min":1.03,"5min":1.202,"15min":1.4079999999999999},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":827392,"data_stored":384151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64300000000000002,"5min":1.046,"15min":1.046},"last":0.436},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.68999999999999995,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60899999999999999,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.497},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78100000000000003,"5min":1.1160000000000001,"15min":1.448},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88500000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0169999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"max":{"1min":1.0429999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":0.97899999999999998,"5min":1.321,"15min":1.3959999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.84199999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":0.875},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59299999999999997},"max":{"1min":0.95999999999999996,"5min":1.4410000000000001,"15min":1.734},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.286,"15min":1.655},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306284,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065556,"statfs":{"total":96636764160,"available":96323129344,"internally_reserved":0,"allocated":823296,"data_stored":383203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.66600000000000004,"15min":0.83899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.89200000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.92700000000000005,"15min":0.93000000000000005},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.2869999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0620000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85799999999999998,"15min":0.83699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.55600000000000005},"max":{"1min":1.153,"5min":1.23,"15min":1.306},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.1950000000000001,"15min":1.321},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":356026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.36599999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.751,"15min":0.745},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.92500000000000004,"5min":1.071,"15min":1.071},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.379},"max":{"1min":1.032,"5min":1.032,"15min":1.28},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.94999999999999996,"5min":1.1060000000000001,"15min":1.216},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":1.1339999999999999,"15min":1.1479999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.49299999999999999},"max":{"1min":0.86899999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.84799999999999998,"5min":0.995,"15min":1.381},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97099999999999997,"15min":1.2769999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.497,"5min":0.434,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.89100000000000001,"15min":1.002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.0409999999999999,"15min":1.6839999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.78100000000000003},"min":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.5169999999999999},"last":1.036},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.304},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.0669999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":1.022,"15min":1.079},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0089999999999999,"5min":1.05,"15min":1.05},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.0389999999999999,"15min":1.121},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.012},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.071,"15min":1.4770000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.625},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.095},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":0.91300000000000003,"5min":1.056,"15min":1.5389999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.012,"15min":1.522},"last":0.87},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70699999999999996},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.204},"last":0.81200000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":2.1309999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76400000000000001,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.038,"5min":1.0429999999999999,"15min":1.9890000000000001},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:22:12.121 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:22:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.341+0000 7f3e5759d700 1 Processor -- start 2023-10-08T16:22:12.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.341+0000 7f3e5759d700 1 -- start start 2023-10-08T16:22:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.342+0000 7f3e5759d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e5013fb20 0x7f3e5015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.342+0000 7f3e5759d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5015ae70 con 0x7f3e5006aaa0 2023-10-08T16:22:12.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.342+0000 7f3e5759d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5006af60 con 0x7f3e5013fef0 2023-10-08T16:22:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.342+0000 7f3e5759d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e5006b240 con 0x7f3e5013fb20 2023-10-08T16:22:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e5659b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3e5013fb20 0x7f3e5015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e56d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3e5006aaa0 0x7f3e500c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40872/0 (socket says 172.21.15.12:40872) 2023-10-08T16:22:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e56d9c700 1 -- 172.21.15.12:0/791380949 learned_addr learned my addr 172.21.15.12:0/791380949 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e5659b700 1 -- 172.21.15.12:0/791380949 >> v1:172.21.15.29:6789/0 conn(0x7f3e5013fef0 legacy=0x7f3e500c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e5659b700 1 -- 172.21.15.12:0/791380949 >> v1:172.21.15.12:6789/0 conn(0x7f3e5006aaa0 legacy=0x7f3e500c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e5659b700 1 -- 172.21.15.12:0/791380949 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5006b520 con 0x7f3e5013fb20 2023-10-08T16:22:12.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.343+0000 7f3e5659b700 1 --2- 172.21.15.12:0/791380949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5013fb20 0x7f3e5015a930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098e0 tx=0x7f3e4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbda3b9cf99a66db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e55599700 1 -- 172.21.15.12:0/791380949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c009e80 con 0x7f3e5013fb20 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e55599700 1 -- 172.21.15.12:0/791380949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c00b860 con 0x7f3e5013fb20 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e55599700 1 -- 172.21.15.12:0/791380949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00bbe0 con 0x7f3e5013fb20 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 -- 172.21.15.12:0/791380949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5013fb20 msgr2=0x7f3e5015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 --2- 172.21.15.12:0/791380949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5013fb20 0x7f3e5015a930 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0098e0 tx=0x7f3e4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 -- 172.21.15.12:0/791380949 shutdown_connections 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 --2- 172.21.15.12:0/791380949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5013fb20 0x7f3e5015a930 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 -- 172.21.15.12:0/791380949 >> 172.21.15.12:0/791380949 conn(0x7f3e5006d170 msgr2=0x7f3e500cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 -- 172.21.15.12:0/791380949 shutdown_connections 2023-10-08T16:22:12.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.344+0000 7f3e5759d700 1 -- 172.21.15.12:0/791380949 wait complete. 2023-10-08T16:22:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.346+0000 7f3e5759d700 1 Processor -- start 2023-10-08T16:22:12.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.346+0000 7f3e5759d700 1 -- start start 2023-10-08T16:22:12.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3e5013fb20 0x7f3e500ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e5013fef0 0x7f3e50152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500af450 con 0x7f3e5006aaa0 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500af730 con 0x7f3e5013fef0 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500afa10 con 0x7f3e5013fb20 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5659b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5659b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45046/0 (socket says 172.21.15.12:45046) 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e5659b700 1 -- 172.21.15.12:0/2560983422 learned_addr learned my addr 172.21.15.12:0/2560983422 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e56d9c700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e5013fef0 0x7f3e50152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.347+0000 7f3e55d9a700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3e5013fb20 0x7f3e500ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 -- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3e5013fb20 msgr2=0x7f3e500ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3e5013fb20 0x7f3e500ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 -- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e5013fef0 msgr2=0x7f3e50152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e5013fef0 0x7f3e50152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 -- 172.21.15.12:0/2560983422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e4c009420 con 0x7f3e5006aaa0 2023-10-08T16:22:12.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5659b700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0091e0 tx=0x7f3e4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00bbe0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4c011420 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c0117e0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.348+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e500afcf0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.349+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e501587b0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.349+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5004c3c0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.350+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e4c011bd0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.351+0000 7f3e467fc700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.351+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3e4c086140 con 0x7f3e5006aaa0 2023-10-08T16:22:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.351+0000 7f3e55d9a700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.352+0000 7f3e55d9a700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 0x7f3e340693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e5015f2a0 tx=0x7f3e40007eb0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.356+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e4c0531a0 con 0x7f3e5006aaa0 2023-10-08T16:22:12.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.552+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e5006b800 con 0x7f3e34066f30 2023-10-08T16:22:12.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.560+0000 7f3e467fc700 1 -- 172.21.15.12:0/2560983422 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283546 (secure 0 0 0) 0x7f3e5006b800 con 0x7f3e34066f30 2023-10-08T16:22:12.563 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:12.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 msgr2=0x7f3e340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 0x7f3e340693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3e5015f2a0 tx=0x7f3e40007eb0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 msgr2=0x7f3e500b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0091e0 tx=0x7f3e4c017000 comp rx=0 tx=0).stop 2023-10-08T16:22:12.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 shutdown_connections 2023-10-08T16:22:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3e34066f30 0x7f3e340693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3e5006aaa0 0x7f3e500b04f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3e5013fef0 0x7f3e50152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 --2- 172.21.15.12:0/2560983422 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3e5013fb20 0x7f3e500ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.564+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 >> 172.21.15.12:0/2560983422 conn(0x7f3e5006d170 msgr2=0x7f3e500cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.565+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 shutdown_connections 2023-10-08T16:22:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.565+0000 7f3e5759d700 1 -- 172.21.15.12:0/2560983422 wait complete. 2023-10-08T16:22:12.568 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:22:12.582 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:22:11.164598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":229,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2430736,"kb_used_data":7376,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543984,"statfs":{"total":773094113280,"available":770605039616,"internally_reserved":0,"allocated":7553024,"data_stored":4155991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.438309"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764559+0000","last_change":"2023-10-08T16:22:07.758756+0000","last_active":"2023-10-08T16:22:07.764559+0000","last_peered":"2023-10-08T16:22:07.764559+0000","last_clean":"2023-10-08T16:22:07.764559+0000","last_became_active":"2023-10-08T16:22:07.758515+0000","last_became_peered":"2023-10-08T16:22:07.758515+0000","last_unstale":"2023-10-08T16:22:07.764559+0000","last_undegraded":"2023-10-08T16:22:07.764559+0000","last_fullsized":"2023-10-08T16:22:07.764559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:28.093357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.759608+0000","last_change":"2023-10-08T16:22:07.752292+0000","last_active":"2023-10-08T16:22:07.759608+0000","last_peered":"2023-10-08T16:22:07.759608+0000","last_clean":"2023-10-08T16:22:07.759608+0000","last_became_active":"2023-10-08T16:22:07.752022+0000","last_became_peered":"2023-10-08T16:22:07.752022+0000","last_unstale":"2023-10-08T16:22:07.759608+0000","last_undegraded":"2023-10-08T16:22:07.759608+0000","last_fullsized":"2023-10-08T16:22:07.759608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:20.346245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766634+0000","last_change":"2023-10-08T16:22:07.763751+0000","last_active":"2023-10-08T16:22:07.766634+0000","last_peered":"2023-10-08T16:22:07.766634+0000","last_clean":"2023-10-08T16:22:07.766634+0000","last_became_active":"2023-10-08T16:22:07.763447+0000","last_became_peered":"2023-10-08T16:22:07.763447+0000","last_unstale":"2023-10-08T16:22:07.766634+0000","last_undegraded":"2023-10-08T16:22:07.766634+0000","last_fullsized":"2023-10-08T16:22:07.766634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:33.626750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764588+0000","last_change":"2023-10-08T16:22:07.760102+0000","last_active":"2023-10-08T16:22:07.764588+0000","last_peered":"2023-10-08T16:22:07.764588+0000","last_clean":"2023-10-08T16:22:07.764588+0000","last_became_active":"2023-10-08T16:22:07.759849+0000","last_became_peered":"2023-10-08T16:22:07.759849+0000","last_unstale":"2023-10-08T16:22:07.764588+0000","last_undegraded":"2023-10-08T16:22:07.764588+0000","last_fullsized":"2023-10-08T16:22:07.764588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:08.987271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764857+0000","last_change":"2023-10-08T16:22:07.759897+0000","last_active":"2023-10-08T16:22:07.764857+0000","last_peered":"2023-10-08T16:22:07.764857+0000","last_clean":"2023-10-08T16:22:07.764857+0000","last_became_active":"2023-10-08T16:22:07.759646+0000","last_became_peered":"2023-10-08T16:22:07.759646+0000","last_unstale":"2023-10-08T16:22:07.764857+0000","last_undegraded":"2023-10-08T16:22:07.764857+0000","last_fullsized":"2023-10-08T16:22:07.764857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.312679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764496+0000","last_change":"2023-10-08T16:22:07.757527+0000","last_active":"2023-10-08T16:22:07.764496+0000","last_peered":"2023-10-08T16:22:07.764496+0000","last_clean":"2023-10-08T16:22:07.764496+0000","last_became_active":"2023-10-08T16:22:07.757256+0000","last_became_peered":"2023-10-08T16:22:07.757256+0000","last_unstale":"2023-10-08T16:22:07.764496+0000","last_undegraded":"2023-10-08T16:22:07.764496+0000","last_fullsized":"2023-10-08T16:22:07.764496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767316+0000","last_change":"2023-10-08T16:22:07.764241+0000","last_active":"2023-10-08T16:22:07.767316+0000","last_peered":"2023-10-08T16:22:07.767316+0000","last_clean":"2023-10-08T16:22:07.767316+0000","last_became_active":"2023-10-08T16:22:07.763964+0000","last_became_peered":"2023-10-08T16:22:07.763964+0000","last_unstale":"2023-10-08T16:22:07.767316+0000","last_undegraded":"2023-10-08T16:22:07.767316+0000","last_fullsized":"2023-10-08T16:22:07.767316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764613+0000","last_change":"2023-10-08T16:22:07.756830+0000","last_active":"2023-10-08T16:22:07.764613+0000","last_peered":"2023-10-08T16:22:07.764613+0000","last_clean":"2023-10-08T16:22:07.764613+0000","last_became_active":"2023-10-08T16:22:07.756549+0000","last_became_peered":"2023-10-08T16:22:07.756549+0000","last_unstale":"2023-10-08T16:22:07.764613+0000","last_undegraded":"2023-10-08T16:22:07.764613+0000","last_fullsized":"2023-10-08T16:22:07.764613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:13.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.753568+0000","last_change":"2023-10-08T16:22:07.750512+0000","last_active":"2023-10-08T16:22:07.753568+0000","last_peered":"2023-10-08T16:22:07.753568+0000","last_clean":"2023-10-08T16:22:07.753568+0000","last_became_active":"2023-10-08T16:22:07.750237+0000","last_became_peered":"2023-10-08T16:22:07.750237+0000","last_unstale":"2023-10-08T16:22:07.753568+0000","last_undegraded":"2023-10-08T16:22:07.753568+0000","last_fullsized":"2023-10-08T16:22:07.753568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:07.835319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757234+0000","last_change":"2023-10-08T16:22:07.753272+0000","last_active":"2023-10-08T16:22:07.757234+0000","last_peered":"2023-10-08T16:22:07.757234+0000","last_clean":"2023-10-08T16:22:07.757234+0000","last_became_active":"2023-10-08T16:22:07.752966+0000","last_became_peered":"2023-10-08T16:22:07.752966+0000","last_unstale":"2023-10-08T16:22:07.757234+0000","last_undegraded":"2023-10-08T16:22:07.757234+0000","last_fullsized":"2023-10-08T16:22:07.757234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770865+0000","last_change":"2023-10-08T16:22:07.762024+0000","last_active":"2023-10-08T16:22:07.770865+0000","last_peered":"2023-10-08T16:22:07.770865+0000","last_clean":"2023-10-08T16:22:07.770865+0000","last_became_active":"2023-10-08T16:22:07.761772+0000","last_became_peered":"2023-10-08T16:22:07.761772+0000","last_unstale":"2023-10-08T16:22:07.770865+0000","last_undegraded":"2023-10-08T16:22:07.770865+0000","last_fullsized":"2023-10-08T16:22:07.770865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:09.885712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765325+0000","last_change":"2023-10-08T16:22:07.761449+0000","last_active":"2023-10-08T16:22:07.765325+0000","last_peered":"2023-10-08T16:22:07.765325+0000","last_clean":"2023-10-08T16:22:07.765325+0000","last_became_active":"2023-10-08T16:22:07.761173+0000","last_became_peered":"2023-10-08T16:22:07.761173+0000","last_unstale":"2023-10-08T16:22:07.765325+0000","last_undegraded":"2023-10-08T16:22:07.765325+0000","last_fullsized":"2023-10-08T16:22:07.765325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:38.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770557+0000","last_change":"2023-10-08T16:22:07.765513+0000","last_active":"2023-10-08T16:22:07.770557+0000","last_peered":"2023-10-08T16:22:07.770557+0000","last_clean":"2023-10-08T16:22:07.770557+0000","last_became_active":"2023-10-08T16:22:07.765132+0000","last_became_peered":"2023-10-08T16:22:07.765132+0000","last_unstale":"2023-10-08T16:22:07.770557+0000","last_undegraded":"2023-10-08T16:22:07.770557+0000","last_fullsized":"2023-10-08T16:22:07.770557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757793+0000","last_change":"2023-10-08T16:22:07.755753+0000","last_active":"2023-10-08T16:22:07.757793+0000","last_peered":"2023-10-08T16:22:07.757793+0000","last_clean":"2023-10-08T16:22:07.757793+0000","last_became_active":"2023-10-08T16:22:07.755364+0000","last_became_peered":"2023-10-08T16:22:07.755364+0000","last_unstale":"2023-10-08T16:22:07.757793+0000","last_undegraded":"2023-10-08T16:22:07.757793+0000","last_fullsized":"2023-10-08T16:22:07.757793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:41.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767204+0000","last_change":"2023-10-08T16:22:07.761256+0000","last_active":"2023-10-08T16:22:07.767204+0000","last_peered":"2023-10-08T16:22:07.767204+0000","last_clean":"2023-10-08T16:22:07.767204+0000","last_became_active":"2023-10-08T16:22:07.760995+0000","last_became_peered":"2023-10-08T16:22:07.760995+0000","last_unstale":"2023-10-08T16:22:07.767204+0000","last_undegraded":"2023-10-08T16:22:07.767204+0000","last_fullsized":"2023-10-08T16:22:07.767204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760210+0000","last_change":"2023-10-08T16:22:07.758889+0000","last_active":"2023-10-08T16:22:07.760210+0000","last_peered":"2023-10-08T16:22:07.760210+0000","last_clean":"2023-10-08T16:22:07.760210+0000","last_became_active":"2023-10-08T16:22:07.758586+0000","last_became_peered":"2023-10-08T16:22:07.758586+0000","last_unstale":"2023-10-08T16:22:07.760210+0000","last_undegraded":"2023-10-08T16:22:07.760210+0000","last_fullsized":"2023-10-08T16:22:07.760210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:59.843696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779240+0000","last_change":"2023-10-08T16:22:06.756675+0000","last_active":"2023-10-08T16:22:07.779240+0000","last_peered":"2023-10-08T16:22:07.779240+0000","last_clean":"2023-10-08T16:22:07.779240+0000","last_became_active":"2023-10-08T16:22:06.756367+0000","last_became_peered":"2023-10-08T16:22:06.756367+0000","last_unstale":"2023-10-08T16:22:07.779240+0000","last_undegraded":"2023-10-08T16:22:07.779240+0000","last_fullsized":"2023-10-08T16:22:07.779240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730079+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.774313+0000","last_change":"2023-10-08T16:22:06.754215+0000","last_active":"2023-10-08T16:22:07.774313+0000","last_peered":"2023-10-08T16:22:07.774313+0000","last_clean":"2023-10-08T16:22:07.774313+0000","last_became_active":"2023-10-08T16:22:06.753791+0000","last_became_peered":"2023-10-08T16:22:06.753791+0000","last_unstale":"2023-10-08T16:22:07.774313+0000","last_undegraded":"2023-10-08T16:22:07.774313+0000","last_fullsized":"2023-10-08T16:22:07.774313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760979+0000","last_change":"2023-10-08T16:22:07.759986+0000","last_active":"2023-10-08T16:22:07.760979+0000","last_peered":"2023-10-08T16:22:07.760979+0000","last_clean":"2023-10-08T16:22:07.760979+0000","last_became_active":"2023-10-08T16:22:07.759691+0000","last_became_peered":"2023-10-08T16:22:07.759691+0000","last_unstale":"2023-10-08T16:22:07.760979+0000","last_undegraded":"2023-10-08T16:22:07.760979+0000","last_fullsized":"2023-10-08T16:22:07.760979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:34.572274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.732295+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:23.006570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778229+0000","last_change":"2023-10-08T16:22:06.751312+0000","last_active":"2023-10-08T16:22:07.778229+0000","last_peered":"2023-10-08T16:22:07.778229+0000","last_clean":"2023-10-08T16:22:07.778229+0000","last_became_active":"2023-10-08T16:22:06.751047+0000","last_became_peered":"2023-10-08T16:22:06.751047+0000","last_unstale":"2023-10-08T16:22:07.778229+0000","last_undegraded":"2023-10-08T16:22:07.778229+0000","last_fullsized":"2023-10-08T16:22:07.778229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764951+0000","last_change":"2023-10-08T16:22:07.758292+0000","last_active":"2023-10-08T16:22:07.764951+0000","last_peered":"2023-10-08T16:22:07.764951+0000","last_clean":"2023-10-08T16:22:07.764951+0000","last_became_active":"2023-10-08T16:22:07.758005+0000","last_became_peered":"2023-10-08T16:22:07.758005+0000","last_unstale":"2023-10-08T16:22:07.764951+0000","last_undegraded":"2023-10-08T16:22:07.764951+0000","last_fullsized":"2023-10-08T16:22:07.764951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:57.243118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729679+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766652+0000","last_change":"2023-10-08T16:22:07.763807+0000","last_active":"2023-10-08T16:22:07.766652+0000","last_peered":"2023-10-08T16:22:07.766652+0000","last_clean":"2023-10-08T16:22:07.766652+0000","last_became_active":"2023-10-08T16:22:07.761035+0000","last_became_peered":"2023-10-08T16:22:07.761035+0000","last_unstale":"2023-10-08T16:22:07.766652+0000","last_undegraded":"2023-10-08T16:22:07.766652+0000","last_fullsized":"2023-10-08T16:22:07.766652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:45.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728903+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749042+0000","last_change":"2023-10-08T16:22:06.748984+0000","last_active":"2023-10-08T16:22:07.749042+0000","last_peered":"2023-10-08T16:22:07.749042+0000","last_clean":"2023-10-08T16:22:07.749042+0000","last_became_active":"2023-10-08T16:22:06.748582+0000","last_became_peered":"2023-10-08T16:22:06.748582+0000","last_unstale":"2023-10-08T16:22:07.749042+0000","last_undegraded":"2023-10-08T16:22:07.749042+0000","last_fullsized":"2023-10-08T16:22:07.749042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:20.846032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729521+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:50.588725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749030+0000","last_change":"2023-10-08T16:22:06.744862+0000","last_active":"2023-10-08T16:22:07.749030+0000","last_peered":"2023-10-08T16:22:07.749030+0000","last_clean":"2023-10-08T16:22:07.749030+0000","last_became_active":"2023-10-08T16:22:06.744599+0000","last_became_peered":"2023-10-08T16:22:06.744599+0000","last_unstale":"2023-10-08T16:22:07.749030+0000","last_undegraded":"2023-10-08T16:22:07.749030+0000","last_fullsized":"2023-10-08T16:22:07.749030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:35.219631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765126+0000","last_change":"2023-10-08T16:22:07.759240+0000","last_active":"2023-10-08T16:22:07.765126+0000","last_peered":"2023-10-08T16:22:07.765126+0000","last_clean":"2023-10-08T16:22:07.765126+0000","last_became_active":"2023-10-08T16:22:07.758975+0000","last_became_peered":"2023-10-08T16:22:07.758975+0000","last_unstale":"2023-10-08T16:22:07.765126+0000","last_undegraded":"2023-10-08T16:22:07.765126+0000","last_fullsized":"2023-10-08T16:22:07.765126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.150111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.731599+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:53.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.780562+0000","last_change":"2023-10-08T16:22:06.752726+0000","last_active":"2023-10-08T16:22:07.780562+0000","last_peered":"2023-10-08T16:22:07.780562+0000","last_clean":"2023-10-08T16:22:07.780562+0000","last_became_active":"2023-10-08T16:22:06.752376+0000","last_became_peered":"2023-10-08T16:22:06.752376+0000","last_unstale":"2023-10-08T16:22:07.780562+0000","last_undegraded":"2023-10-08T16:22:07.780562+0000","last_fullsized":"2023-10-08T16:22:07.780562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779396+0000","last_change":"2023-10-08T16:22:06.754410+0000","last_active":"2023-10-08T16:22:07.779396+0000","last_peered":"2023-10-08T16:22:07.779396+0000","last_clean":"2023-10-08T16:22:07.779396+0000","last_became_active":"2023-10-08T16:22:06.753839+0000","last_became_peered":"2023-10-08T16:22:06.753839+0000","last_unstale":"2023-10-08T16:22:07.779396+0000","last_undegraded":"2023-10-08T16:22:07.779396+0000","last_fullsized":"2023-10-08T16:22:07.779396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:56.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762251+0000","last_change":"2023-10-08T16:22:07.749665+0000","last_active":"2023-10-08T16:22:07.762251+0000","last_peered":"2023-10-08T16:22:07.762251+0000","last_clean":"2023-10-08T16:22:07.762251+0000","last_became_active":"2023-10-08T16:22:07.749419+0000","last_became_peered":"2023-10-08T16:22:07.749419+0000","last_unstale":"2023-10-08T16:22:07.762251+0000","last_undegraded":"2023-10-08T16:22:07.762251+0000","last_fullsized":"2023-10-08T16:22:07.762251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:54.684827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730914+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:39.745733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765000+0000","last_change":"2023-10-08T16:22:07.757922+0000","last_active":"2023-10-08T16:22:07.765000+0000","last_peered":"2023-10-08T16:22:07.765000+0000","last_clean":"2023-10-08T16:22:07.765000+0000","last_became_active":"2023-10-08T16:22:07.757672+0000","last_became_peered":"2023-10-08T16:22:07.757672+0000","last_unstale":"2023-10-08T16:22:07.765000+0000","last_undegraded":"2023-10-08T16:22:07.765000+0000","last_fullsized":"2023-10-08T16:22:07.765000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:50.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743546+0000","last_change":"2023-10-08T16:22:06.750046+0000","last_active":"2023-10-08T16:22:07.743546+0000","last_peered":"2023-10-08T16:22:07.743546+0000","last_clean":"2023-10-08T16:22:07.743546+0000","last_became_active":"2023-10-08T16:22:06.749762+0000","last_became_peered":"2023-10-08T16:22:06.749762+0000","last_unstale":"2023-10-08T16:22:07.743546+0000","last_undegraded":"2023-10-08T16:22:07.743546+0000","last_fullsized":"2023-10-08T16:22:07.743546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:27.086771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779040+0000","last_change":"2023-10-08T16:22:06.748832+0000","last_active":"2023-10-08T16:22:07.779040+0000","last_peered":"2023-10-08T16:22:07.779040+0000","last_clean":"2023-10-08T16:22:07.779040+0000","last_became_active":"2023-10-08T16:22:06.748243+0000","last_became_peered":"2023-10-08T16:22:06.748243+0000","last_unstale":"2023-10-08T16:22:07.779040+0000","last_undegraded":"2023-10-08T16:22:07.779040+0000","last_fullsized":"2023-10-08T16:22:07.779040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757181+0000","last_change":"2023-10-08T16:22:07.753126+0000","last_active":"2023-10-08T16:22:07.757181+0000","last_peered":"2023-10-08T16:22:07.757181+0000","last_clean":"2023-10-08T16:22:07.757181+0000","last_became_active":"2023-10-08T16:22:07.752761+0000","last_became_peered":"2023-10-08T16:22:07.752761+0000","last_unstale":"2023-10-08T16:22:07.757181+0000","last_undegraded":"2023-10-08T16:22:07.757181+0000","last_fullsized":"2023-10-08T16:22:07.757181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.775396+0000","last_change":"2023-10-08T16:22:06.754333+0000","last_active":"2023-10-08T16:22:07.775396+0000","last_peered":"2023-10-08T16:22:07.775396+0000","last_clean":"2023-10-08T16:22:07.775396+0000","last_became_active":"2023-10-08T16:22:06.754015+0000","last_became_peered":"2023-10-08T16:22:06.754015+0000","last_unstale":"2023-10-08T16:22:07.775396+0000","last_undegraded":"2023-10-08T16:22:07.775396+0000","last_fullsized":"2023-10-08T16:22:07.775396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764706+0000","last_change":"2023-10-08T16:22:07.761350+0000","last_active":"2023-10-08T16:22:07.764706+0000","last_peered":"2023-10-08T16:22:07.764706+0000","last_clean":"2023-10-08T16:22:07.764706+0000","last_became_active":"2023-10-08T16:22:07.761049+0000","last_became_peered":"2023-10-08T16:22:07.761049+0000","last_unstale":"2023-10-08T16:22:07.764706+0000","last_undegraded":"2023-10-08T16:22:07.764706+0000","last_fullsized":"2023-10-08T16:22:07.764706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:13.143629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730636+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729375+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:33.565687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743100+0000","last_change":"2023-10-08T16:22:06.757272+0000","last_active":"2023-10-08T16:22:07.743100+0000","last_peered":"2023-10-08T16:22:07.743100+0000","last_clean":"2023-10-08T16:22:07.743100+0000","last_became_active":"2023-10-08T16:22:06.756950+0000","last_became_peered":"2023-10-08T16:22:06.756950+0000","last_unstale":"2023-10-08T16:22:07.743100+0000","last_undegraded":"2023-10-08T16:22:07.743100+0000","last_fullsized":"2023-10-08T16:22:07.743100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:37.155145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765040+0000","last_change":"2023-10-08T16:22:07.757241+0000","last_active":"2023-10-08T16:22:07.765040+0000","last_peered":"2023-10-08T16:22:07.765040+0000","last_clean":"2023-10-08T16:22:07.765040+0000","last_became_active":"2023-10-08T16:22:07.756871+0000","last_became_peered":"2023-10-08T16:22:07.756871+0000","last_unstale":"2023-10-08T16:22:07.765040+0000","last_undegraded":"2023-10-08T16:22:07.765040+0000","last_fullsized":"2023-10-08T16:22:07.765040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:16.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778838+0000","last_change":"2023-10-08T16:22:06.751189+0000","last_active":"2023-10-08T16:22:07.778838+0000","last_peered":"2023-10-08T16:22:07.778838+0000","last_clean":"2023-10-08T16:22:07.778838+0000","last_became_active":"2023-10-08T16:22:06.750938+0000","last_became_peered":"2023-10-08T16:22:06.750938+0000","last_unstale":"2023-10-08T16:22:07.778838+0000","last_undegraded":"2023-10-08T16:22:07.778838+0000","last_fullsized":"2023-10-08T16:22:07.778838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.747082+0000","last_change":"2023-10-08T16:22:07.743521+0000","last_active":"2023-10-08T16:22:07.747082+0000","last_peered":"2023-10-08T16:22:07.747082+0000","last_clean":"2023-10-08T16:22:07.747082+0000","last_became_active":"2023-10-08T16:22:07.743242+0000","last_became_peered":"2023-10-08T16:22:07.743242+0000","last_unstale":"2023-10-08T16:22:07.747082+0000","last_undegraded":"2023-10-08T16:22:07.747082+0000","last_fullsized":"2023-10-08T16:22:07.747082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:11.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728968+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757689+0000","last_change":"2023-10-08T16:22:07.753369+0000","last_active":"2023-10-08T16:22:07.757689+0000","last_peered":"2023-10-08T16:22:07.757689+0000","last_clean":"2023-10-08T16:22:07.757689+0000","last_became_active":"2023-10-08T16:22:07.753039+0000","last_became_peered":"2023-10-08T16:22:07.753039+0000","last_unstale":"2023-10-08T16:22:07.757689+0000","last_undegraded":"2023-10-08T16:22:07.757689+0000","last_fullsized":"2023-10-08T16:22:07.757689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748156+0000","last_change":"2023-10-08T16:22:06.744681+0000","last_active":"2023-10-08T16:22:07.748156+0000","last_peered":"2023-10-08T16:22:07.748156+0000","last_clean":"2023-10-08T16:22:07.748156+0000","last_became_active":"2023-10-08T16:22:06.744415+0000","last_became_peered":"2023-10-08T16:22:06.744415+0000","last_unstale":"2023-10-08T16:22:07.748156+0000","last_undegraded":"2023-10-08T16:22:07.748156+0000","last_fullsized":"2023-10-08T16:22:07.748156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:42.103131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764647+0000","last_change":"2023-10-08T16:22:07.760720+0000","last_active":"2023-10-08T16:22:07.764647+0000","last_peered":"2023-10-08T16:22:07.764647+0000","last_clean":"2023-10-08T16:22:07.764647+0000","last_became_active":"2023-10-08T16:22:07.760449+0000","last_became_peered":"2023-10-08T16:22:07.760449+0000","last_unstale":"2023-10-08T16:22:07.764647+0000","last_undegraded":"2023-10-08T16:22:07.764647+0000","last_fullsized":"2023-10-08T16:22:07.764647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:15.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730233+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:59.480613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.746196+0000","last_change":"2023-10-08T16:22:06.751649+0000","last_active":"2023-10-08T16:22:07.746196+0000","last_peered":"2023-10-08T16:22:07.746196+0000","last_clean":"2023-10-08T16:22:07.746196+0000","last_became_active":"2023-10-08T16:22:06.751384+0000","last_became_peered":"2023-10-08T16:22:06.751384+0000","last_unstale":"2023-10-08T16:22:07.746196+0000","last_undegraded":"2023-10-08T16:22:07.746196+0000","last_fullsized":"2023-10-08T16:22:07.746196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764542+0000","last_change":"2023-10-08T16:22:07.758165+0000","last_active":"2023-10-08T16:22:07.764542+0000","last_peered":"2023-10-08T16:22:07.764542+0000","last_clean":"2023-10-08T16:22:07.764542+0000","last_became_active":"2023-10-08T16:22:07.756570+0000","last_became_peered":"2023-10-08T16:22:07.756570+0000","last_unstale":"2023-10-08T16:22:07.764542+0000","last_undegraded":"2023-10-08T16:22:07.764542+0000","last_fullsized":"2023-10-08T16:22:07.764542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:24.013156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729449+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:44.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737504+0000","last_change":"2023-10-08T16:22:06.753864+0000","last_active":"2023-10-08T16:22:07.737504+0000","last_peered":"2023-10-08T16:22:07.737504+0000","last_clean":"2023-10-08T16:22:07.737504+0000","last_became_active":"2023-10-08T16:22:06.753562+0000","last_became_peered":"2023-10-08T16:22:06.753562+0000","last_unstale":"2023-10-08T16:22:07.737504+0000","last_undegraded":"2023-10-08T16:22:07.737504+0000","last_fullsized":"2023-10-08T16:22:07.737504+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765058+0000","last_change":"2023-10-08T16:22:07.759697+0000","last_active":"2023-10-08T16:22:07.765058+0000","last_peered":"2023-10-08T16:22:07.765058+0000","last_clean":"2023-10-08T16:22:07.765058+0000","last_became_active":"2023-10-08T16:22:07.757100+0000","last_became_peered":"2023-10-08T16:22:07.757100+0000","last_unstale":"2023-10-08T16:22:07.765058+0000","last_undegraded":"2023-10-08T16:22:07.765058+0000","last_fullsized":"2023-10-08T16:22:07.765058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:02.407878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729428+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:52.541301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765143+0000","last_change":"2023-10-08T16:22:07.758872+0000","last_active":"2023-10-08T16:22:07.765143+0000","last_peered":"2023-10-08T16:22:07.765143+0000","last_clean":"2023-10-08T16:22:07.765143+0000","last_became_active":"2023-10-08T16:22:07.758629+0000","last_became_peered":"2023-10-08T16:22:07.758629+0000","last_unstale":"2023-10-08T16:22:07.765143+0000","last_undegraded":"2023-10-08T16:22:07.765143+0000","last_fullsized":"2023-10-08T16:22:07.765143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:33.524423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729022+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:21.424736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737566+0000","last_change":"2023-10-08T16:22:06.757296+0000","last_active":"2023-10-08T16:22:07.737566+0000","last_peered":"2023-10-08T16:22:07.737566+0000","last_clean":"2023-10-08T16:22:07.737566+0000","last_became_active":"2023-10-08T16:22:06.757040+0000","last_became_peered":"2023-10-08T16:22:06.757040+0000","last_unstale":"2023-10-08T16:22:07.737566+0000","last_undegraded":"2023-10-08T16:22:07.737566+0000","last_fullsized":"2023-10-08T16:22:07.737566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748936+0000","last_change":"2023-10-08T16:22:06.751787+0000","last_active":"2023-10-08T16:22:07.748936+0000","last_peered":"2023-10-08T16:22:07.748936+0000","last_clean":"2023-10-08T16:22:07.748936+0000","last_became_active":"2023-10-08T16:22:06.751514+0000","last_became_peered":"2023-10-08T16:22:06.751514+0000","last_unstale":"2023-10-08T16:22:07.748936+0000","last_undegraded":"2023-10-08T16:22:07.748936+0000","last_fullsized":"2023-10-08T16:22:07.748936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764839+0000","last_change":"2023-10-08T16:22:07.759404+0000","last_active":"2023-10-08T16:22:07.764839+0000","last_peered":"2023-10-08T16:22:07.764839+0000","last_clean":"2023-10-08T16:22:07.764839+0000","last_became_active":"2023-10-08T16:22:07.759138+0000","last_became_peered":"2023-10-08T16:22:07.759138+0000","last_unstale":"2023-10-08T16:22:07.764839+0000","last_undegraded":"2023-10-08T16:22:07.764839+0000","last_fullsized":"2023-10-08T16:22:07.764839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730411+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:10.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":282,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-08T16:22:04.614533+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:22:04.614533+0000","last_peered":"2023-10-08T16:22:04.614533+0000","last_clean":"2023-10-08T16:22:04.614533+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:22:04.614533+0000","last_undegraded":"2023-10-08T16:22:04.614533+0000","last_fullsized":"2023-10-08T16:22:04.614533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1368064,"data_stored":952563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.103,"15min":1.103},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.99199999999999999,"15min":1.089},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.41299999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.997,"5min":0.997,"15min":1.1160000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98099999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.05,"15min":1.1000000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":5.5590000000000002},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.234},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.3919999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.432,"15min":0.40600000000000003},"max":{"1min":0.97299999999999998,"5min":1.101,"15min":1.3680000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.4319999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.014,"15min":1.323},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98699999999999999,"5min":1,"15min":1.448},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.995,"15min":1.125},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1,"5min":1.0429999999999999,"15min":1.0600000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94299999999999995,"5min":1.0369999999999999,"15min":1.365},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":1.004,"15min":1.0549999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.58299999999999996,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.038,"5min":1.0700000000000001,"15min":1.552},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.4570000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.069},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.497},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.619},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0249999999999999,"15min":1.0389999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73099999999999998,"15min":0.77400000000000002},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.5900000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64700000000000002,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.0109999999999999,"15min":1.1240000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":0.91600000000000004,"5min":0.98099999999999998,"15min":1.0600000000000001},"last":0.87}]},{"osd":7,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0569999999999999,"15min":1.222},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":0.94199999999999995,"5min":1.073,"15min":1.3080000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":0.873},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.38100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.498,"5min":0.498,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":0.95199999999999996,"15min":1.472},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.66100000000000003,"5min":0.56200000000000006,"15min":0.45500000000000002},"max":{"1min":1.0129999999999999,"5min":1.0669999999999999,"15min":1.373},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":1.2230000000000001,"15min":1.375},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.046,"5min":1.157,"15min":1.276},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83899999999999997,"15min":0.80500000000000005},"min":{"1min":0.64300000000000002,"5min":0.63300000000000001,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.107,"15min":1.224},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.206,"15min":1.429},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.52200000000000002},"max":{"1min":1.0269999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.67700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.1839999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.302,"15min":1.514},"last":0.97599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":972995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.498},"min":{"1min":0.38,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.65700000000000003,"5min":0.88800000000000001,"15min":1.524},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":1.679},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.82799999999999996,"15min":1.5569999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.33800000000000002},"max":{"1min":0.60399999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.371},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.84999999999999998,"5min":0.872,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.40300000000000002},"max":{"1min":1.018,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.135,"15min":1.325},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83299999999999996,"15min":0.80100000000000005},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":0.98599999999999999,"5min":1.1439999999999999,"15min":1.153},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":0.96399999999999997,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.52900000000000003},"max":{"1min":0.97999999999999998,"5min":1.1950000000000001,"15min":1.288},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.59599999999999997,"15min":0.51600000000000001},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.262},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.012,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.501},"max":{"1min":1.03,"5min":1.202,"15min":1.4079999999999999},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":827392,"data_stored":384151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64300000000000002,"5min":1.046,"15min":1.046},"last":0.436},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.68999999999999995,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60899999999999999,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.497},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78100000000000003,"5min":1.1160000000000001,"15min":1.448},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88500000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0169999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"max":{"1min":1.0429999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":0.97899999999999998,"5min":1.321,"15min":1.3959999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.84199999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":0.875},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59299999999999997},"max":{"1min":0.95999999999999996,"5min":1.4410000000000001,"15min":1.734},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.286,"15min":1.655},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306284,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065556,"statfs":{"total":96636764160,"available":96323129344,"internally_reserved":0,"allocated":823296,"data_stored":383203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.66600000000000004,"15min":0.83899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.89200000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.92700000000000005,"15min":0.93000000000000005},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.2869999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0620000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85799999999999998,"15min":0.83699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.55600000000000005},"max":{"1min":1.153,"5min":1.23,"15min":1.306},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.1950000000000001,"15min":1.321},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":356026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.36599999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.751,"15min":0.745},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.92500000000000004,"5min":1.071,"15min":1.071},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.379},"max":{"1min":1.032,"5min":1.032,"15min":1.28},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.94999999999999996,"5min":1.1060000000000001,"15min":1.216},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":1.1339999999999999,"15min":1.1479999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.49299999999999999},"max":{"1min":0.86899999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.84799999999999998,"5min":0.995,"15min":1.381},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97099999999999997,"15min":1.2769999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.497,"5min":0.434,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.89100000000000001,"15min":1.002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.0409999999999999,"15min":1.6839999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.78100000000000003},"min":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.5169999999999999},"last":1.036},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.304},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.0669999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":1.022,"15min":1.079},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0089999999999999,"5min":1.05,"15min":1.05},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.0389999999999999,"15min":1.121},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.012},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.071,"15min":1.4770000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.625},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.095},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":0.91300000000000003,"5min":1.056,"15min":1.5389999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.012,"15min":1.522},"last":0.87},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70699999999999996},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.204},"last":0.81200000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":2.1309999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76400000000000001,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.038,"5min":1.0429999999999999,"15min":1.9890000000000001},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:22:12.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:22:12.719 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-08T16:22:12.719+0000 7fa157bf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:22:12.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.810+0000 7f359ffff700 1 Processor -- start 2023-10-08T16:22:12.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.810+0000 7f359ffff700 1 -- start start 2023-10-08T16:22:12.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.811+0000 7f359ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.811+0000 7f359ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a015ae70 con 0x7f35a013fef0 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.811+0000 7f359ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a006af60 con 0x7f35a013fb20 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.811+0000 7f359ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a006b240 con 0x7f35a006aaa0 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359e7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35a013fef0 0x7f35a00c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40886/0 (socket says 172.21.15.12:40886) 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359e7fc700 1 -- 172.21.15.12:0/477263486 learned_addr learned my addr 172.21.15.12:0/477263486 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359f7fe700 1 --2- 172.21.15.12:0/477263486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066972918 0 0) 0x7f3594001290 con 0x7f35a013fef0 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003570 con 0x7f35a013fef0 2023-10-08T16:22:12.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3313568772 0 0) 0x7f35a006af60 con 0x7f35a013fb20 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3594001290 con 0x7f35a013fb20 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359f7fe700 1 -- 172.21.15.12:0/477263486 >> v1:172.21.15.29:6789/0 conn(0x7f35a013fb20 legacy=0x7f35a00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359f7fe700 1 -- 172.21.15.12:0/477263486 >> v1:172.21.15.12:6789/0 conn(0x7f35a013fef0 legacy=0x7f35a00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.812+0000 7f359f7fe700 1 -- 172.21.15.12:0/477263486 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a006b520 con 0x7f35a006aaa0 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359f7fe700 1 --2- 172.21.15.12:0/477263486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a015a930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3598009e90 tx=0x7f3598009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8290c6f6d3abf839 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359800e070 con 0x7f35a006aaa0 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800bb80 con 0x7f35a006aaa0 2023-10-08T16:22:12.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359dffb700 1 -- 172.21.15.12:0/477263486 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3598012430 con 0x7f35a006aaa0 2023-10-08T16:22:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359ffff700 1 -- 172.21.15.12:0/477263486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 msgr2=0x7f35a015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.813+0000 7f359ffff700 1 --2- 172.21.15.12:0/477263486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a015a930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3598009e90 tx=0x7f3598009780 comp rx=0 tx=0).stop 2023-10-08T16:22:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.814+0000 7f359ffff700 1 -- 172.21.15.12:0/477263486 shutdown_connections 2023-10-08T16:22:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.814+0000 7f359ffff700 1 --2- 172.21.15.12:0/477263486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a015a930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.814+0000 7f359ffff700 1 -- 172.21.15.12:0/477263486 >> 172.21.15.12:0/477263486 conn(0x7f35a006d170 msgr2=0x7f35a00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.814+0000 7f359ffff700 1 -- 172.21.15.12:0/477263486 shutdown_connections 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.814+0000 7f359ffff700 1 -- 172.21.15.12:0/477263486 wait complete. 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.815+0000 7f359ffff700 1 Processor -- start 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.815+0000 7f359ffff700 1 -- start start 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a00ad130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35a013fb20 0x7f35a0155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a01563d0 con 0x7f35a013fef0 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00acca0 con 0x7f35a013fb20 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.816+0000 7f359ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a00ac090 con 0x7f35a006aaa0 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a00ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45050/0 (socket says 172.21.15.12:45050) 2023-10-08T16:22:12.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 -- 172.21.15.12:0/4289718563 learned_addr learned my addr 172.21.15.12:0/4289718563 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:12.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359e7fc700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35a013fb20 0x7f35a0155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 -- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 msgr2=0x7f35a00ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a00ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 -- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35a013fb20 msgr2=0x7f35a0155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35a013fb20 0x7f35a0155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 -- 172.21.15.12:0/4289718563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3598009a20 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.817+0000 7f359f7fe700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3598013000 tx=0x7f3598019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.818+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359801b420 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.818+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359801b5a0 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.818+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359801b960 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.818+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a00ac370 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.818+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a00ac930 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.819+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a00ace30 con 0x7f35a013fef0 2023-10-08T16:22:12.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.820+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f359801bd50 con 0x7f35a013fef0 2023-10-08T16:22:12.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.821+0000 7f3586ffd700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:12.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.821+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3598085ff0 con 0x7f35a013fef0 2023-10-08T16:22:12.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.821+0000 7f359effd700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:12.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.822+0000 7f359effd700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3590007fd0 tx=0x7f3590007d50 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:12.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:12.825+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3598053160 con 0x7f35a013fef0 2023-10-08T16:22:13.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.024+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35a004c3c0 con 0x7f358c066f30 2023-10-08T16:22:13.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.032+0000 7f3586ffd700 1 -- 172.21.15.12:0/4289718563 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283546 (secure 0 0 0) 0x7f35a004c3c0 con 0x7f358c066f30 2023-10-08T16:22:13.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:13.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 msgr2=0x7f358c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 0x7f358c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3590007fd0 tx=0x7f3590007d50 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 msgr2=0x7f35a00ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3598013000 tx=0x7f3598019000 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 shutdown_connections 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f358c066f30 0x7f358c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35a013fef0 0x7f35a00ab740 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35a006aaa0 0x7f35a00ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 --2- 172.21.15.12:0/4289718563 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35a013fb20 0x7f35a0155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 >> 172.21.15.12:0/4289718563 conn(0x7f35a006d170 msgr2=0x7f35a00afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:13.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 shutdown_connections 2023-10-08T16:22:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.037+0000 7f359ffff700 1 -- 172.21.15.12:0/4289718563 wait complete. 2023-10-08T16:22:13.040 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:22:13.054 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:22:11.164598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592514,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":229,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":130,"acting":130,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":101,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2430736,"kb_used_data":7376,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543984,"statfs":{"total":773094113280,"available":770605039616,"internally_reserved":0,"allocated":7553024,"data_stored":4155991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.438309"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764559+0000","last_change":"2023-10-08T16:22:07.758756+0000","last_active":"2023-10-08T16:22:07.764559+0000","last_peered":"2023-10-08T16:22:07.764559+0000","last_clean":"2023-10-08T16:22:07.764559+0000","last_became_active":"2023-10-08T16:22:07.758515+0000","last_became_peered":"2023-10-08T16:22:07.758515+0000","last_unstale":"2023-10-08T16:22:07.764559+0000","last_undegraded":"2023-10-08T16:22:07.764559+0000","last_fullsized":"2023-10-08T16:22:07.764559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:28.093357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.759608+0000","last_change":"2023-10-08T16:22:07.752292+0000","last_active":"2023-10-08T16:22:07.759608+0000","last_peered":"2023-10-08T16:22:07.759608+0000","last_clean":"2023-10-08T16:22:07.759608+0000","last_became_active":"2023-10-08T16:22:07.752022+0000","last_became_peered":"2023-10-08T16:22:07.752022+0000","last_unstale":"2023-10-08T16:22:07.759608+0000","last_undegraded":"2023-10-08T16:22:07.759608+0000","last_fullsized":"2023-10-08T16:22:07.759608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:20.346245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766634+0000","last_change":"2023-10-08T16:22:07.763751+0000","last_active":"2023-10-08T16:22:07.766634+0000","last_peered":"2023-10-08T16:22:07.766634+0000","last_clean":"2023-10-08T16:22:07.766634+0000","last_became_active":"2023-10-08T16:22:07.763447+0000","last_became_peered":"2023-10-08T16:22:07.763447+0000","last_unstale":"2023-10-08T16:22:07.766634+0000","last_undegraded":"2023-10-08T16:22:07.766634+0000","last_fullsized":"2023-10-08T16:22:07.766634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:33.626750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764588+0000","last_change":"2023-10-08T16:22:07.760102+0000","last_active":"2023-10-08T16:22:07.764588+0000","last_peered":"2023-10-08T16:22:07.764588+0000","last_clean":"2023-10-08T16:22:07.764588+0000","last_became_active":"2023-10-08T16:22:07.759849+0000","last_became_peered":"2023-10-08T16:22:07.759849+0000","last_unstale":"2023-10-08T16:22:07.764588+0000","last_undegraded":"2023-10-08T16:22:07.764588+0000","last_fullsized":"2023-10-08T16:22:07.764588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:08.987271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764857+0000","last_change":"2023-10-08T16:22:07.759897+0000","last_active":"2023-10-08T16:22:07.764857+0000","last_peered":"2023-10-08T16:22:07.764857+0000","last_clean":"2023-10-08T16:22:07.764857+0000","last_became_active":"2023-10-08T16:22:07.759646+0000","last_became_peered":"2023-10-08T16:22:07.759646+0000","last_unstale":"2023-10-08T16:22:07.764857+0000","last_undegraded":"2023-10-08T16:22:07.764857+0000","last_fullsized":"2023-10-08T16:22:07.764857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.312679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764496+0000","last_change":"2023-10-08T16:22:07.757527+0000","last_active":"2023-10-08T16:22:07.764496+0000","last_peered":"2023-10-08T16:22:07.764496+0000","last_clean":"2023-10-08T16:22:07.764496+0000","last_became_active":"2023-10-08T16:22:07.757256+0000","last_became_peered":"2023-10-08T16:22:07.757256+0000","last_unstale":"2023-10-08T16:22:07.764496+0000","last_undegraded":"2023-10-08T16:22:07.764496+0000","last_fullsized":"2023-10-08T16:22:07.764496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767316+0000","last_change":"2023-10-08T16:22:07.764241+0000","last_active":"2023-10-08T16:22:07.767316+0000","last_peered":"2023-10-08T16:22:07.767316+0000","last_clean":"2023-10-08T16:22:07.767316+0000","last_became_active":"2023-10-08T16:22:07.763964+0000","last_became_peered":"2023-10-08T16:22:07.763964+0000","last_unstale":"2023-10-08T16:22:07.767316+0000","last_undegraded":"2023-10-08T16:22:07.767316+0000","last_fullsized":"2023-10-08T16:22:07.767316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764613+0000","last_change":"2023-10-08T16:22:07.756830+0000","last_active":"2023-10-08T16:22:07.764613+0000","last_peered":"2023-10-08T16:22:07.764613+0000","last_clean":"2023-10-08T16:22:07.764613+0000","last_became_active":"2023-10-08T16:22:07.756549+0000","last_became_peered":"2023-10-08T16:22:07.756549+0000","last_unstale":"2023-10-08T16:22:07.764613+0000","last_undegraded":"2023-10-08T16:22:07.764613+0000","last_fullsized":"2023-10-08T16:22:07.764613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:13.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.753568+0000","last_change":"2023-10-08T16:22:07.750512+0000","last_active":"2023-10-08T16:22:07.753568+0000","last_peered":"2023-10-08T16:22:07.753568+0000","last_clean":"2023-10-08T16:22:07.753568+0000","last_became_active":"2023-10-08T16:22:07.750237+0000","last_became_peered":"2023-10-08T16:22:07.750237+0000","last_unstale":"2023-10-08T16:22:07.753568+0000","last_undegraded":"2023-10-08T16:22:07.753568+0000","last_fullsized":"2023-10-08T16:22:07.753568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:07.835319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757234+0000","last_change":"2023-10-08T16:22:07.753272+0000","last_active":"2023-10-08T16:22:07.757234+0000","last_peered":"2023-10-08T16:22:07.757234+0000","last_clean":"2023-10-08T16:22:07.757234+0000","last_became_active":"2023-10-08T16:22:07.752966+0000","last_became_peered":"2023-10-08T16:22:07.752966+0000","last_unstale":"2023-10-08T16:22:07.757234+0000","last_undegraded":"2023-10-08T16:22:07.757234+0000","last_fullsized":"2023-10-08T16:22:07.757234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770865+0000","last_change":"2023-10-08T16:22:07.762024+0000","last_active":"2023-10-08T16:22:07.770865+0000","last_peered":"2023-10-08T16:22:07.770865+0000","last_clean":"2023-10-08T16:22:07.770865+0000","last_became_active":"2023-10-08T16:22:07.761772+0000","last_became_peered":"2023-10-08T16:22:07.761772+0000","last_unstale":"2023-10-08T16:22:07.770865+0000","last_undegraded":"2023-10-08T16:22:07.770865+0000","last_fullsized":"2023-10-08T16:22:07.770865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:09.885712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765325+0000","last_change":"2023-10-08T16:22:07.761449+0000","last_active":"2023-10-08T16:22:07.765325+0000","last_peered":"2023-10-08T16:22:07.765325+0000","last_clean":"2023-10-08T16:22:07.765325+0000","last_became_active":"2023-10-08T16:22:07.761173+0000","last_became_peered":"2023-10-08T16:22:07.761173+0000","last_unstale":"2023-10-08T16:22:07.765325+0000","last_undegraded":"2023-10-08T16:22:07.765325+0000","last_fullsized":"2023-10-08T16:22:07.765325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:38.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770557+0000","last_change":"2023-10-08T16:22:07.765513+0000","last_active":"2023-10-08T16:22:07.770557+0000","last_peered":"2023-10-08T16:22:07.770557+0000","last_clean":"2023-10-08T16:22:07.770557+0000","last_became_active":"2023-10-08T16:22:07.765132+0000","last_became_peered":"2023-10-08T16:22:07.765132+0000","last_unstale":"2023-10-08T16:22:07.770557+0000","last_undegraded":"2023-10-08T16:22:07.770557+0000","last_fullsized":"2023-10-08T16:22:07.770557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757793+0000","last_change":"2023-10-08T16:22:07.755753+0000","last_active":"2023-10-08T16:22:07.757793+0000","last_peered":"2023-10-08T16:22:07.757793+0000","last_clean":"2023-10-08T16:22:07.757793+0000","last_became_active":"2023-10-08T16:22:07.755364+0000","last_became_peered":"2023-10-08T16:22:07.755364+0000","last_unstale":"2023-10-08T16:22:07.757793+0000","last_undegraded":"2023-10-08T16:22:07.757793+0000","last_fullsized":"2023-10-08T16:22:07.757793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:41.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767204+0000","last_change":"2023-10-08T16:22:07.761256+0000","last_active":"2023-10-08T16:22:07.767204+0000","last_peered":"2023-10-08T16:22:07.767204+0000","last_clean":"2023-10-08T16:22:07.767204+0000","last_became_active":"2023-10-08T16:22:07.760995+0000","last_became_peered":"2023-10-08T16:22:07.760995+0000","last_unstale":"2023-10-08T16:22:07.767204+0000","last_undegraded":"2023-10-08T16:22:07.767204+0000","last_fullsized":"2023-10-08T16:22:07.767204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760210+0000","last_change":"2023-10-08T16:22:07.758889+0000","last_active":"2023-10-08T16:22:07.760210+0000","last_peered":"2023-10-08T16:22:07.760210+0000","last_clean":"2023-10-08T16:22:07.760210+0000","last_became_active":"2023-10-08T16:22:07.758586+0000","last_became_peered":"2023-10-08T16:22:07.758586+0000","last_unstale":"2023-10-08T16:22:07.760210+0000","last_undegraded":"2023-10-08T16:22:07.760210+0000","last_fullsized":"2023-10-08T16:22:07.760210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:59.843696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779240+0000","last_change":"2023-10-08T16:22:06.756675+0000","last_active":"2023-10-08T16:22:07.779240+0000","last_peered":"2023-10-08T16:22:07.779240+0000","last_clean":"2023-10-08T16:22:07.779240+0000","last_became_active":"2023-10-08T16:22:06.756367+0000","last_became_peered":"2023-10-08T16:22:06.756367+0000","last_unstale":"2023-10-08T16:22:07.779240+0000","last_undegraded":"2023-10-08T16:22:07.779240+0000","last_fullsized":"2023-10-08T16:22:07.779240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730079+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.774313+0000","last_change":"2023-10-08T16:22:06.754215+0000","last_active":"2023-10-08T16:22:07.774313+0000","last_peered":"2023-10-08T16:22:07.774313+0000","last_clean":"2023-10-08T16:22:07.774313+0000","last_became_active":"2023-10-08T16:22:06.753791+0000","last_became_peered":"2023-10-08T16:22:06.753791+0000","last_unstale":"2023-10-08T16:22:07.774313+0000","last_undegraded":"2023-10-08T16:22:07.774313+0000","last_fullsized":"2023-10-08T16:22:07.774313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760979+0000","last_change":"2023-10-08T16:22:07.759986+0000","last_active":"2023-10-08T16:22:07.760979+0000","last_peered":"2023-10-08T16:22:07.760979+0000","last_clean":"2023-10-08T16:22:07.760979+0000","last_became_active":"2023-10-08T16:22:07.759691+0000","last_became_peered":"2023-10-08T16:22:07.759691+0000","last_unstale":"2023-10-08T16:22:07.760979+0000","last_undegraded":"2023-10-08T16:22:07.760979+0000","last_fullsized":"2023-10-08T16:22:07.760979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:34.572274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.732295+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:23.006570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778229+0000","last_change":"2023-10-08T16:22:06.751312+0000","last_active":"2023-10-08T16:22:07.778229+0000","last_peered":"2023-10-08T16:22:07.778229+0000","last_clean":"2023-10-08T16:22:07.778229+0000","last_became_active":"2023-10-08T16:22:06.751047+0000","last_became_peered":"2023-10-08T16:22:06.751047+0000","last_unstale":"2023-10-08T16:22:07.778229+0000","last_undegraded":"2023-10-08T16:22:07.778229+0000","last_fullsized":"2023-10-08T16:22:07.778229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764951+0000","last_change":"2023-10-08T16:22:07.758292+0000","last_active":"2023-10-08T16:22:07.764951+0000","last_peered":"2023-10-08T16:22:07.764951+0000","last_clean":"2023-10-08T16:22:07.764951+0000","last_became_active":"2023-10-08T16:22:07.758005+0000","last_became_peered":"2023-10-08T16:22:07.758005+0000","last_unstale":"2023-10-08T16:22:07.764951+0000","last_undegraded":"2023-10-08T16:22:07.764951+0000","last_fullsized":"2023-10-08T16:22:07.764951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:57.243118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729679+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766652+0000","last_change":"2023-10-08T16:22:07.763807+0000","last_active":"2023-10-08T16:22:07.766652+0000","last_peered":"2023-10-08T16:22:07.766652+0000","last_clean":"2023-10-08T16:22:07.766652+0000","last_became_active":"2023-10-08T16:22:07.761035+0000","last_became_peered":"2023-10-08T16:22:07.761035+0000","last_unstale":"2023-10-08T16:22:07.766652+0000","last_undegraded":"2023-10-08T16:22:07.766652+0000","last_fullsized":"2023-10-08T16:22:07.766652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:45.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728903+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749042+0000","last_change":"2023-10-08T16:22:06.748984+0000","last_active":"2023-10-08T16:22:07.749042+0000","last_peered":"2023-10-08T16:22:07.749042+0000","last_clean":"2023-10-08T16:22:07.749042+0000","last_became_active":"2023-10-08T16:22:06.748582+0000","last_became_peered":"2023-10-08T16:22:06.748582+0000","last_unstale":"2023-10-08T16:22:07.749042+0000","last_undegraded":"2023-10-08T16:22:07.749042+0000","last_fullsized":"2023-10-08T16:22:07.749042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:20.846032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729521+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:50.588725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749030+0000","last_change":"2023-10-08T16:22:06.744862+0000","last_active":"2023-10-08T16:22:07.749030+0000","last_peered":"2023-10-08T16:22:07.749030+0000","last_clean":"2023-10-08T16:22:07.749030+0000","last_became_active":"2023-10-08T16:22:06.744599+0000","last_became_peered":"2023-10-08T16:22:06.744599+0000","last_unstale":"2023-10-08T16:22:07.749030+0000","last_undegraded":"2023-10-08T16:22:07.749030+0000","last_fullsized":"2023-10-08T16:22:07.749030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:35.219631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765126+0000","last_change":"2023-10-08T16:22:07.759240+0000","last_active":"2023-10-08T16:22:07.765126+0000","last_peered":"2023-10-08T16:22:07.765126+0000","last_clean":"2023-10-08T16:22:07.765126+0000","last_became_active":"2023-10-08T16:22:07.758975+0000","last_became_peered":"2023-10-08T16:22:07.758975+0000","last_unstale":"2023-10-08T16:22:07.765126+0000","last_undegraded":"2023-10-08T16:22:07.765126+0000","last_fullsized":"2023-10-08T16:22:07.765126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.150111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.731599+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:53.678241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.780562+0000","last_change":"2023-10-08T16:22:06.752726+0000","last_active":"2023-10-08T16:22:07.780562+0000","last_peered":"2023-10-08T16:22:07.780562+0000","last_clean":"2023-10-08T16:22:07.780562+0000","last_became_active":"2023-10-08T16:22:06.752376+0000","last_became_peered":"2023-10-08T16:22:06.752376+0000","last_unstale":"2023-10-08T16:22:07.780562+0000","last_undegraded":"2023-10-08T16:22:07.780562+0000","last_fullsized":"2023-10-08T16:22:07.780562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779396+0000","last_change":"2023-10-08T16:22:06.754410+0000","last_active":"2023-10-08T16:22:07.779396+0000","last_peered":"2023-10-08T16:22:07.779396+0000","last_clean":"2023-10-08T16:22:07.779396+0000","last_became_active":"2023-10-08T16:22:06.753839+0000","last_became_peered":"2023-10-08T16:22:06.753839+0000","last_unstale":"2023-10-08T16:22:07.779396+0000","last_undegraded":"2023-10-08T16:22:07.779396+0000","last_fullsized":"2023-10-08T16:22:07.779396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:56.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762251+0000","last_change":"2023-10-08T16:22:07.749665+0000","last_active":"2023-10-08T16:22:07.762251+0000","last_peered":"2023-10-08T16:22:07.762251+0000","last_clean":"2023-10-08T16:22:07.762251+0000","last_became_active":"2023-10-08T16:22:07.749419+0000","last_became_peered":"2023-10-08T16:22:07.749419+0000","last_unstale":"2023-10-08T16:22:07.762251+0000","last_undegraded":"2023-10-08T16:22:07.762251+0000","last_fullsized":"2023-10-08T16:22:07.762251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:54.684827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730914+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:39.745733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765000+0000","last_change":"2023-10-08T16:22:07.757922+0000","last_active":"2023-10-08T16:22:07.765000+0000","last_peered":"2023-10-08T16:22:07.765000+0000","last_clean":"2023-10-08T16:22:07.765000+0000","last_became_active":"2023-10-08T16:22:07.757672+0000","last_became_peered":"2023-10-08T16:22:07.757672+0000","last_unstale":"2023-10-08T16:22:07.765000+0000","last_undegraded":"2023-10-08T16:22:07.765000+0000","last_fullsized":"2023-10-08T16:22:07.765000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:50.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743546+0000","last_change":"2023-10-08T16:22:06.750046+0000","last_active":"2023-10-08T16:22:07.743546+0000","last_peered":"2023-10-08T16:22:07.743546+0000","last_clean":"2023-10-08T16:22:07.743546+0000","last_became_active":"2023-10-08T16:22:06.749762+0000","last_became_peered":"2023-10-08T16:22:06.749762+0000","last_unstale":"2023-10-08T16:22:07.743546+0000","last_undegraded":"2023-10-08T16:22:07.743546+0000","last_fullsized":"2023-10-08T16:22:07.743546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:27.086771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779040+0000","last_change":"2023-10-08T16:22:06.748832+0000","last_active":"2023-10-08T16:22:07.779040+0000","last_peered":"2023-10-08T16:22:07.779040+0000","last_clean":"2023-10-08T16:22:07.779040+0000","last_became_active":"2023-10-08T16:22:06.748243+0000","last_became_peered":"2023-10-08T16:22:06.748243+0000","last_unstale":"2023-10-08T16:22:07.779040+0000","last_undegraded":"2023-10-08T16:22:07.779040+0000","last_fullsized":"2023-10-08T16:22:07.779040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757181+0000","last_change":"2023-10-08T16:22:07.753126+0000","last_active":"2023-10-08T16:22:07.757181+0000","last_peered":"2023-10-08T16:22:07.757181+0000","last_clean":"2023-10-08T16:22:07.757181+0000","last_became_active":"2023-10-08T16:22:07.752761+0000","last_became_peered":"2023-10-08T16:22:07.752761+0000","last_unstale":"2023-10-08T16:22:07.757181+0000","last_undegraded":"2023-10-08T16:22:07.757181+0000","last_fullsized":"2023-10-08T16:22:07.757181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.775396+0000","last_change":"2023-10-08T16:22:06.754333+0000","last_active":"2023-10-08T16:22:07.775396+0000","last_peered":"2023-10-08T16:22:07.775396+0000","last_clean":"2023-10-08T16:22:07.775396+0000","last_became_active":"2023-10-08T16:22:06.754015+0000","last_became_peered":"2023-10-08T16:22:06.754015+0000","last_unstale":"2023-10-08T16:22:07.775396+0000","last_undegraded":"2023-10-08T16:22:07.775396+0000","last_fullsized":"2023-10-08T16:22:07.775396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764706+0000","last_change":"2023-10-08T16:22:07.761350+0000","last_active":"2023-10-08T16:22:07.764706+0000","last_peered":"2023-10-08T16:22:07.764706+0000","last_clean":"2023-10-08T16:22:07.764706+0000","last_became_active":"2023-10-08T16:22:07.761049+0000","last_became_peered":"2023-10-08T16:22:07.761049+0000","last_unstale":"2023-10-08T16:22:07.764706+0000","last_undegraded":"2023-10-08T16:22:07.764706+0000","last_fullsized":"2023-10-08T16:22:07.764706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:13.143629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730636+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729375+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:33.565687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743100+0000","last_change":"2023-10-08T16:22:06.757272+0000","last_active":"2023-10-08T16:22:07.743100+0000","last_peered":"2023-10-08T16:22:07.743100+0000","last_clean":"2023-10-08T16:22:07.743100+0000","last_became_active":"2023-10-08T16:22:06.756950+0000","last_became_peered":"2023-10-08T16:22:06.756950+0000","last_unstale":"2023-10-08T16:22:07.743100+0000","last_undegraded":"2023-10-08T16:22:07.743100+0000","last_fullsized":"2023-10-08T16:22:07.743100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:37.155145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765040+0000","last_change":"2023-10-08T16:22:07.757241+0000","last_active":"2023-10-08T16:22:07.765040+0000","last_peered":"2023-10-08T16:22:07.765040+0000","last_clean":"2023-10-08T16:22:07.765040+0000","last_became_active":"2023-10-08T16:22:07.756871+0000","last_became_peered":"2023-10-08T16:22:07.756871+0000","last_unstale":"2023-10-08T16:22:07.765040+0000","last_undegraded":"2023-10-08T16:22:07.765040+0000","last_fullsized":"2023-10-08T16:22:07.765040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:16.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778838+0000","last_change":"2023-10-08T16:22:06.751189+0000","last_active":"2023-10-08T16:22:07.778838+0000","last_peered":"2023-10-08T16:22:07.778838+0000","last_clean":"2023-10-08T16:22:07.778838+0000","last_became_active":"2023-10-08T16:22:06.750938+0000","last_became_peered":"2023-10-08T16:22:06.750938+0000","last_unstale":"2023-10-08T16:22:07.778838+0000","last_undegraded":"2023-10-08T16:22:07.778838+0000","last_fullsized":"2023-10-08T16:22:07.778838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.747082+0000","last_change":"2023-10-08T16:22:07.743521+0000","last_active":"2023-10-08T16:22:07.747082+0000","last_peered":"2023-10-08T16:22:07.747082+0000","last_clean":"2023-10-08T16:22:07.747082+0000","last_became_active":"2023-10-08T16:22:07.743242+0000","last_became_peered":"2023-10-08T16:22:07.743242+0000","last_unstale":"2023-10-08T16:22:07.747082+0000","last_undegraded":"2023-10-08T16:22:07.747082+0000","last_fullsized":"2023-10-08T16:22:07.747082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:11.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.728968+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757689+0000","last_change":"2023-10-08T16:22:07.753369+0000","last_active":"2023-10-08T16:22:07.757689+0000","last_peered":"2023-10-08T16:22:07.757689+0000","last_clean":"2023-10-08T16:22:07.757689+0000","last_became_active":"2023-10-08T16:22:07.753039+0000","last_became_peered":"2023-10-08T16:22:07.753039+0000","last_unstale":"2023-10-08T16:22:07.757689+0000","last_undegraded":"2023-10-08T16:22:07.757689+0000","last_fullsized":"2023-10-08T16:22:07.757689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748156+0000","last_change":"2023-10-08T16:22:06.744681+0000","last_active":"2023-10-08T16:22:07.748156+0000","last_peered":"2023-10-08T16:22:07.748156+0000","last_clean":"2023-10-08T16:22:07.748156+0000","last_became_active":"2023-10-08T16:22:06.744415+0000","last_became_peered":"2023-10-08T16:22:06.744415+0000","last_unstale":"2023-10-08T16:22:07.748156+0000","last_undegraded":"2023-10-08T16:22:07.748156+0000","last_fullsized":"2023-10-08T16:22:07.748156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:42.103131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764647+0000","last_change":"2023-10-08T16:22:07.760720+0000","last_active":"2023-10-08T16:22:07.764647+0000","last_peered":"2023-10-08T16:22:07.764647+0000","last_clean":"2023-10-08T16:22:07.764647+0000","last_became_active":"2023-10-08T16:22:07.760449+0000","last_became_peered":"2023-10-08T16:22:07.760449+0000","last_unstale":"2023-10-08T16:22:07.764647+0000","last_undegraded":"2023-10-08T16:22:07.764647+0000","last_fullsized":"2023-10-08T16:22:07.764647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:15.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730233+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:09:59.480613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.746196+0000","last_change":"2023-10-08T16:22:06.751649+0000","last_active":"2023-10-08T16:22:07.746196+0000","last_peered":"2023-10-08T16:22:07.746196+0000","last_clean":"2023-10-08T16:22:07.746196+0000","last_became_active":"2023-10-08T16:22:06.751384+0000","last_became_peered":"2023-10-08T16:22:06.751384+0000","last_unstale":"2023-10-08T16:22:07.746196+0000","last_undegraded":"2023-10-08T16:22:07.746196+0000","last_fullsized":"2023-10-08T16:22:07.746196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764542+0000","last_change":"2023-10-08T16:22:07.758165+0000","last_active":"2023-10-08T16:22:07.764542+0000","last_peered":"2023-10-08T16:22:07.764542+0000","last_clean":"2023-10-08T16:22:07.764542+0000","last_became_active":"2023-10-08T16:22:07.756570+0000","last_became_peered":"2023-10-08T16:22:07.756570+0000","last_unstale":"2023-10-08T16:22:07.764542+0000","last_undegraded":"2023-10-08T16:22:07.764542+0000","last_fullsized":"2023-10-08T16:22:07.764542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:24.013156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729449+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:44.903537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737504+0000","last_change":"2023-10-08T16:22:06.753864+0000","last_active":"2023-10-08T16:22:07.737504+0000","last_peered":"2023-10-08T16:22:07.737504+0000","last_clean":"2023-10-08T16:22:07.737504+0000","last_became_active":"2023-10-08T16:22:06.753562+0000","last_became_peered":"2023-10-08T16:22:06.753562+0000","last_unstale":"2023-10-08T16:22:07.737504+0000","last_undegraded":"2023-10-08T16:22:07.737504+0000","last_fullsized":"2023-10-08T16:22:07.737504+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765058+0000","last_change":"2023-10-08T16:22:07.759697+0000","last_active":"2023-10-08T16:22:07.765058+0000","last_peered":"2023-10-08T16:22:07.765058+0000","last_clean":"2023-10-08T16:22:07.765058+0000","last_became_active":"2023-10-08T16:22:07.757100+0000","last_became_peered":"2023-10-08T16:22:07.757100+0000","last_unstale":"2023-10-08T16:22:07.765058+0000","last_undegraded":"2023-10-08T16:22:07.765058+0000","last_fullsized":"2023-10-08T16:22:07.765058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:02.407878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729428+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:10:52.541301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765143+0000","last_change":"2023-10-08T16:22:07.758872+0000","last_active":"2023-10-08T16:22:07.765143+0000","last_peered":"2023-10-08T16:22:07.765143+0000","last_clean":"2023-10-08T16:22:07.765143+0000","last_became_active":"2023-10-08T16:22:07.758629+0000","last_became_peered":"2023-10-08T16:22:07.758629+0000","last_unstale":"2023-10-08T16:22:07.765143+0000","last_undegraded":"2023-10-08T16:22:07.765143+0000","last_fullsized":"2023-10-08T16:22:07.765143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:33.524423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.729022+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:21.424736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737566+0000","last_change":"2023-10-08T16:22:06.757296+0000","last_active":"2023-10-08T16:22:07.737566+0000","last_peered":"2023-10-08T16:22:07.737566+0000","last_clean":"2023-10-08T16:22:07.737566+0000","last_became_active":"2023-10-08T16:22:06.757040+0000","last_became_peered":"2023-10-08T16:22:06.757040+0000","last_unstale":"2023-10-08T16:22:07.737566+0000","last_undegraded":"2023-10-08T16:22:07.737566+0000","last_fullsized":"2023-10-08T16:22:07.737566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:22:06.726086+0000","last_change":"2023-10-08T16:22:06.726086+0000","last_active":"2023-10-08T16:22:06.726086+0000","last_peered":"2023-10-08T16:22:06.726086+0000","last_clean":"2023-10-08T16:22:06.726086+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:06.726086+0000","last_undegraded":"2023-10-08T16:22:06.726086+0000","last_fullsized":"2023-10-08T16:22:06.726086+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748936+0000","last_change":"2023-10-08T16:22:06.751787+0000","last_active":"2023-10-08T16:22:07.748936+0000","last_peered":"2023-10-08T16:22:07.748936+0000","last_clean":"2023-10-08T16:22:07.748936+0000","last_became_active":"2023-10-08T16:22:06.751514+0000","last_became_peered":"2023-10-08T16:22:06.751514+0000","last_unstale":"2023-10-08T16:22:07.748936+0000","last_undegraded":"2023-10-08T16:22:07.748936+0000","last_fullsized":"2023-10-08T16:22:07.748936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764839+0000","last_change":"2023-10-08T16:22:07.759404+0000","last_active":"2023-10-08T16:22:07.764839+0000","last_peered":"2023-10-08T16:22:07.764839+0000","last_clean":"2023-10-08T16:22:07.764839+0000","last_became_active":"2023-10-08T16:22:07.759138+0000","last_became_peered":"2023-10-08T16:22:07.759138+0000","last_unstale":"2023-10-08T16:22:07.764839+0000","last_undegraded":"2023-10-08T16:22:07.764839+0000","last_fullsized":"2023-10-08T16:22:07.764839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:22:05.719499+0000","last_change":"2023-10-08T16:22:05.730411+0000","last_active":"2023-10-08T16:22:05.719499+0000","last_peered":"2023-10-08T16:22:05.719499+0000","last_clean":"2023-10-08T16:22:05.719499+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:22:05.719499+0000","last_undegraded":"2023-10-08T16:22:05.719499+0000","last_fullsized":"2023-10-08T16:22:05.719499+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:10.455414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":282,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-10-08T16:22:04.614533+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:22:04.614533+0000","last_peered":"2023-10-08T16:22:04.614533+0000","last_clean":"2023-10-08T16:22:04.614533+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:22:04.614533+0000","last_undegraded":"2023-10-08T16:22:04.614533+0000","last_fullsized":"2023-10-08T16:22:04.614533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2146,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306816,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065024,"statfs":{"total":96636764160,"available":96322584576,"internally_reserved":0,"allocated":1368064,"data_stored":952563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.103,"15min":1.103},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.99199999999999999,"15min":1.089},"last":0.78500000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.41299999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.997,"5min":0.997,"15min":1.1160000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98099999999999998},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.05,"15min":1.1000000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":5.5590000000000002},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.234},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.3919999999999999},"last":0.81999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.432,"15min":0.40600000000000003},"max":{"1min":0.97299999999999998,"5min":1.101,"15min":1.3680000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.4319999999999999},"last":0.99299999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.014,"15min":1.323},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98699999999999999,"5min":1,"15min":1.448},"last":0.877}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.995,"15min":1.125},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1,"5min":1.0429999999999999,"15min":1.0600000000000001},"last":0.83099999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94299999999999995,"5min":1.0369999999999999,"15min":1.365},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":1.004,"15min":1.0549999999999999},"last":0.64000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.58299999999999996,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.038,"5min":1.0700000000000001,"15min":1.552},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.4570000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.069},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.497},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.619},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0249999999999999,"15min":1.0389999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73099999999999998,"15min":0.77400000000000002},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.5900000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64700000000000002,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.0109999999999999,"15min":1.1240000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":0.91600000000000004,"5min":0.98099999999999998,"15min":1.0600000000000001},"last":0.87}]},{"osd":7,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0569999999999999,"15min":1.222},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":0.94199999999999995,"5min":1.073,"15min":1.3080000000000001},"last":0.69599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":0.873},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.38100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.498,"5min":0.498,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":0.95199999999999996,"15min":1.472},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.66100000000000003,"5min":0.56200000000000006,"15min":0.45500000000000002},"max":{"1min":1.0129999999999999,"5min":1.0669999999999999,"15min":1.373},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":1.2230000000000001,"15min":1.375},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.046,"5min":1.157,"15min":1.276},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83899999999999997,"15min":0.80500000000000005},"min":{"1min":0.64300000000000002,"5min":0.63300000000000001,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.107,"15min":1.224},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.206,"15min":1.429},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.52200000000000002},"max":{"1min":1.0269999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.67700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.1839999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.302,"15min":1.514},"last":0.97599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":972995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.498},"min":{"1min":0.38,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.65700000000000003,"5min":0.88800000000000001,"15min":1.524},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":1.679},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.82799999999999996,"15min":1.5569999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.33800000000000002},"max":{"1min":0.60399999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.371},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.84999999999999998,"5min":0.872,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.40300000000000002},"max":{"1min":1.018,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.135,"15min":1.325},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83299999999999996,"15min":0.80100000000000005},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":0.98599999999999999,"5min":1.1439999999999999,"15min":1.153},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":0.96399999999999997,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.52900000000000003},"max":{"1min":0.97999999999999998,"5min":1.1950000000000001,"15min":1.288},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.59599999999999997,"15min":0.51600000000000001},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.262},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.012,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.501},"max":{"1min":1.03,"5min":1.202,"15min":1.4079999999999999},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":827392,"data_stored":384151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64300000000000002,"5min":1.046,"15min":1.046},"last":0.436},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.68999999999999995,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60899999999999999,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.497},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78100000000000003,"5min":1.1160000000000001,"15min":1.448},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88500000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0169999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"max":{"1min":1.0429999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":0.97899999999999998,"5min":1.321,"15min":1.3959999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.84199999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":0.875},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59299999999999997},"max":{"1min":0.95999999999999996,"5min":1.4410000000000001,"15min":1.734},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.286,"15min":1.655},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306284,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065556,"statfs":{"total":96636764160,"available":96323129344,"internally_reserved":0,"allocated":823296,"data_stored":383203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.66600000000000004,"15min":0.83899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.89200000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.92700000000000005,"15min":0.93000000000000005},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.2869999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0620000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85799999999999998,"15min":0.83699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.55600000000000005},"max":{"1min":1.153,"5min":1.23,"15min":1.306},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.1950000000000001,"15min":1.321},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":356026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.36599999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.751,"15min":0.745},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.92500000000000004,"5min":1.071,"15min":1.071},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.379},"max":{"1min":1.032,"5min":1.032,"15min":1.28},"last":0.83999999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.94999999999999996,"5min":1.1060000000000001,"15min":1.216},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":1.1339999999999999,"15min":1.1479999999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.49299999999999999},"max":{"1min":0.86899999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.84799999999999998,"5min":0.995,"15min":1.381},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97099999999999997,"15min":1.2769999999999999},"last":0.98799999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.497,"5min":0.434,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.89100000000000001,"15min":1.002},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.0409999999999999,"15min":1.6839999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.78100000000000003},"min":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.5169999999999999},"last":1.036},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.304},"last":1.0089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306236,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065604,"statfs":{"total":96636764160,"available":96323178496,"internally_reserved":0,"allocated":774144,"data_stored":362195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.0669999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":1.022,"15min":1.079},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0089999999999999,"5min":1.05,"15min":1.05},"last":0.57299999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.0389999999999999,"15min":1.121},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.012},"last":0.61799999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.071,"15min":1.4770000000000001},"last":0.74299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.625},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.095},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":0.91300000000000003,"5min":1.056,"15min":1.5389999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.012,"15min":1.522},"last":0.87},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70699999999999996},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.204},"last":0.81200000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":2.1309999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76400000000000001,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.038,"5min":1.0429999999999999,"15min":1.9890000000000001},"last":0.90200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:22:13.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-10-08T16:22:13.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-10-08T16:22:13.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-10-08T16:22:13.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-10-08T16:22:13.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.730079+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.732295+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T16:28:23.006570+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729679+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.728903+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-08T16:22:13.066 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729521+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:16:50.588725+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-08T16:22:13.067 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.731599+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:32:53.678241+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.730914+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:13:39.745733+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.068 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.730636+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729375+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T03:11:33.565687+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-08T16:22:13.069 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.728968+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.730233+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:09:59.480613+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729449+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:55:44.903537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-10-08T16:22:13.070 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729428+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:10:52.541301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.729022+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:27:21.424736+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:22:06.726086+0000', 'last_change': '2023-10-08T16:22:06.726086+0000', 'last_active': '2023-10-08T16:22:06.726086+0000', 'last_peered': '2023-10-08T16:22:06.726086+0000', 'last_clean': '2023-10-08T16:22:06.726086+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:06.726086+0000', 'last_undegraded': '2023-10-08T16:22:06.726086+0000', 'last_fullsized': '2023-10-08T16:22:06.726086+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:06.726086+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-08T16:22:13.071 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:22:05.719499+0000', 'last_change': '2023-10-08T16:22:05.730411+0000', 'last_active': '2023-10-08T16:22:05.719499+0000', 'last_peered': '2023-10-08T16:22:05.719499+0000', 'last_clean': '2023-10-08T16:22:05.719499+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:22:05.719499+0000', 'last_undegraded': '2023-10-08T16:22:05.719499+0000', 'last_fullsized': '2023-10-08T16:22:05.719499+0000', 'mapping_epoch': 65, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 65, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'last_clean_scrub_stamp': '2023-10-08T16:22:05.719499+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:02:10.455414+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:22:13.072 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:22:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.282+0000 7f7c9699d700 1 Processor -- start 2023-10-08T16:22:13.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.282+0000 7f7c9699d700 1 -- start start 2023-10-08T16:22:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.283+0000 7f7c9699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c90159550 0x7f7c900ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.283+0000 7f7c9699d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c90159920 0x7f7c900ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.283+0000 7f7c9699d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900acc00 con 0x7f7c9015dfd0 2023-10-08T16:22:13.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.283+0000 7f7c9699d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c900abff0 con 0x7f7c90159920 2023-10-08T16:22:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.283+0000 7f7c9699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900ac2d0 con 0x7f7c90159550 2023-10-08T16:22:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c90159920 0x7f7c900ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c90159920 0x7f7c900ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45062/0 (socket says 172.21.15.12:45062) 2023-10-08T16:22:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 -- 172.21.15.12:0/493151052 learned_addr learned my addr 172.21.15.12:0/493151052 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:13.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9599b700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c90159550 0x7f7c900ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 -- 172.21.15.12:0/493151052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c90159550 msgr2=0x7f7c900ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c90159550 0x7f7c900ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 -- 172.21.15.12:0/493151052 >> v1:172.21.15.29:6789/0 conn(0x7f7c9015dfd0 legacy=0x7f7c900aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 -- 172.21.15.12:0/493151052 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900ac5b0 con 0x7f7c90159920 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.284+0000 7f7c9619c700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159920 0x7f7c900ad090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009f20 tx=0x7f7c88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3100c10d91134f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c94999700 1 -- 172.21.15.12:0/493151052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8800e070 con 0x7f7c90159920 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c94999700 1 -- 172.21.15.12:0/493151052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8800b9d0 con 0x7f7c90159920 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c94999700 1 -- 172.21.15.12:0/493151052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880092e0 con 0x7f7c90159920 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 -- 172.21.15.12:0/493151052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159920 msgr2=0x7f7c900ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159920 0x7f7c900ad090 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009f20 tx=0x7f7c88009840 comp rx=0 tx=0).stop 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 -- 172.21.15.12:0/493151052 shutdown_connections 2023-10-08T16:22:13.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159920 0x7f7c900ad090 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 --2- 172.21.15.12:0/493151052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c90159550 0x7f7c900ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 -- 172.21.15.12:0/493151052 >> 172.21.15.12:0/493151052 conn(0x7f7c9006ce80 msgr2=0x7f7c900ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 -- 172.21.15.12:0/493151052 shutdown_connections 2023-10-08T16:22:13.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.285+0000 7f7c9699d700 1 -- 172.21.15.12:0/493151052 wait complete. 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.287+0000 7f7c9699d700 1 Processor -- start 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.287+0000 7f7c9699d700 1 -- start start 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c90159920 0x7f7c9014ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c9015dfd0 0x7f7c9014d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c9240 con 0x7f7c90159550 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c9520 con 0x7f7c90159920 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c9800 con 0x7f7c9015dfd0 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45078/0 (socket says 172.21.15.12:45078) 2023-10-08T16:22:13.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 -- 172.21.15.12:0/3737706886 learned_addr learned my addr 172.21.15.12:0/3737706886 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9619c700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c9015dfd0 0x7f7c9014d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9519a700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c90159920 0x7f7c9014ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 -- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c9015dfd0 msgr2=0x7f7c9014d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c9015dfd0 0x7f7c9014d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 -- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c90159920 msgr2=0x7f7c9014ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c90159920 0x7f7c9014ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.288+0000 7f7c9599b700 1 -- 172.21.15.12:0/3737706886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88009ae0 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c9599b700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e930 tx=0x7f7c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00eed0 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00c850 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00cbf0 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c900c9ae0 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.289+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9014f200 con 0x7f7c90159550 2023-10-08T16:22:13.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.290+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9004c3c0 con 0x7f7c90159550 2023-10-08T16:22:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.291+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c8c013470 con 0x7f7c90159550 2023-10-08T16:22:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.292+0000 7f7c85ffb700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.293+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f7c8c084930 con 0x7f7c90159550 2023-10-08T16:22:13.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.293+0000 7f7c9519a700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.293+0000 7f7c9519a700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c90158be0 tx=0x7f7c80009040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.297+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c8c051990 con 0x7f7c90159550 2023-10-08T16:22:13.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.580+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7c900cab90 con 0x7f7c90159550 2023-10-08T16:22:13.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.581+0000 7f7c85ffb700 1 -- 172.21.15.12:0/3737706886 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1177 (secure 0 0 0) 0x7f7c8c054fb0 con 0x7f7c90159550 2023-10-08T16:22:13.580 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:13.581 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":797,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":50},{"state_name":"unknown","count":32},{"state_name":"creating+peering","count":15}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592514,"bytes_used":2489073664,"bytes_avail":770605039616,"bytes_total":773094113280,"unknown_pgs_ratio":0.32989689707756042,"inactive_pgs_ratio":0.15463916957378387,"write_bytes_sec":2071,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":26,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5796}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-08T16:11:51.791931+0000","services":{}},"progress_events":{}} 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 msgr2=0x7f7c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 0x7f7c740693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7c90158be0 tx=0x7f7c80009040 comp rx=0 tx=0).stop 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 msgr2=0x7f7c900ca2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c00e930 tx=0x7f7c8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 shutdown_connections 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f7c74066f30 0x7f7c740693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c90159550 0x7f7c900ca2e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c9015dfd0 0x7f7c9014d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 --2- 172.21.15.12:0/3737706886 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c90159920 0x7f7c9014ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 >> 172.21.15.12:0/3737706886 conn(0x7f7c9006ce80 msgr2=0x7f7c900af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:13.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 shutdown_connections 2023-10-08T16:22:13.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.583+0000 7f7c9699d700 1 -- 172.21.15.12:0/3737706886 wait complete. 2023-10-08T16:22:13.600 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:22:13.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:22:13.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.789+0000 7f4da6f9d700 1 Processor -- start 2023-10-08T16:22:13.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.789+0000 7f4da6f9d700 1 -- start start 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4da013fb20 0x7f4da015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4da013fef0 0x7f4da00c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da00c8410 con 0x7f4da013fef0 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da015ae70 con 0x7f4da013fb20 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da006af60 con 0x7f4da006aaa0 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da579a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4da013fef0 0x7f4da00c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da579a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4da013fef0 0x7f4da00c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45080/0 (socket says 172.21.15.12:45080) 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.790+0000 7f4da579a700 1 -- 172.21.15.12:0/4136063184 learned_addr learned my addr 172.21.15.12:0/4136063184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da5f9b700 1 --2- 172.21.15.12:0/4136063184 >> v2:172.21.15.29:3300/0 conn(0x7f4da013fb20 0x7f4da015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da679c700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 -- 172.21.15.12:0/4136063184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 msgr2=0x7f4da00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 -- 172.21.15.12:0/4136063184 >> v2:172.21.15.29:3300/0 conn(0x7f4da013fb20 msgr2=0x7f4da015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 --2- 172.21.15.12:0/4136063184 >> v2:172.21.15.29:3300/0 conn(0x7f4da013fb20 0x7f4da015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 -- 172.21.15.12:0/4136063184 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da006b240 con 0x7f4da013fef0 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da679c700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da579a700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fef0 0x7f4da00c7990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4da00695b0 tx=0x7f4d9000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30247c309641b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da4f99700 1 -- 172.21.15.12:0/4136063184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90005c10 con 0x7f4da013fef0 2023-10-08T16:22:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da4f99700 1 -- 172.21.15.12:0/4136063184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d90005d70 con 0x7f4da013fef0 2023-10-08T16:22:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.791+0000 7f4da4f99700 1 -- 172.21.15.12:0/4136063184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000db80 con 0x7f4da013fef0 2023-10-08T16:22:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 -- 172.21.15.12:0/4136063184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fef0 msgr2=0x7f4da00c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fef0 0x7f4da00c7990 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4da00695b0 tx=0x7f4d9000b4c0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 -- 172.21.15.12:0/4136063184 shutdown_connections 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/4136063184 >> v2:172.21.15.29:3300/0 conn(0x7f4da013fb20 0x7f4da015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/4136063184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fef0 0x7f4da00c7990 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 -- 172.21.15.12:0/4136063184 >> 172.21.15.12:0/4136063184 conn(0x7f4da006d170 msgr2=0x7f4da00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 -- 172.21.15.12:0/4136063184 shutdown_connections 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.792+0000 7f4da6f9d700 1 -- 172.21.15.12:0/4136063184 wait complete. 2023-10-08T16:22:13.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.794+0000 7f4da6f9d700 1 Processor -- start 2023-10-08T16:22:13.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.794+0000 7f4da6f9d700 1 -- start start 2023-10-08T16:22:13.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da01391f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da013fef0 0x7f4da00b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00af830 con 0x7f4da013fb20 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0138d60 con 0x7f4da013fef0 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0139730 con 0x7f4da006aaa0 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45084/0 (socket says 172.21.15.12:45084) 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 -- 172.21.15.12:0/1547245698 learned_addr learned my addr 172.21.15.12:0/1547245698 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:13.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da679c700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da013fef0 0x7f4da00b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da5f9b700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da01391f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 -- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 msgr2=0x7f4da01391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da01391f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 -- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da013fef0 msgr2=0x7f4da00b1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da013fef0 0x7f4da00b1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.795+0000 7f4da579a700 1 -- 172.21.15.12:0/1547245698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9000b720 con 0x7f4da013fb20 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4da579a700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4d90014000 tx=0x7f4d9001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000d950 con 0x7f4da013fb20 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9001d070 con 0x7f4da013fb20 2023-10-08T16:22:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90024440 con 0x7f4da013fb20 2023-10-08T16:22:13.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da00afa80 con 0x7f4da013fb20 2023-10-08T16:22:13.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.796+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da01389f0 con 0x7f4da013fb20 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.797+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da004c3c0 con 0x7f4da013fb20 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.798+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d900247d0 con 0x7f4da013fb20 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.799+0000 7f4d95ffb700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.799+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f4d90014030 con 0x7f4da013fb20 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.799+0000 7f4da5f9b700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.800+0000 7f4da5f9b700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 0x7f4d840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009d10 tx=0x7f4d9c0091a0 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:13.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.804+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d90055e40 con 0x7f4da013fb20 2023-10-08T16:22:13.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:13.999+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4da00aeb30 con 0x7f4d84066f30 2023-10-08T16:22:14.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.007+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1547245698 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289009 (secure 0 0 0) 0x7f4da00aeb30 con 0x7f4d84066f30 2023-10-08T16:22:14.011 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 msgr2=0x7f4d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 0x7f4d840693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c009d10 tx=0x7f4d9c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 msgr2=0x7f4da0155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4d90014000 tx=0x7f4d9001a000 comp rx=0 tx=0).stop 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 shutdown_connections 2023-10-08T16:22:14.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f4d84066f30 0x7f4d840693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4da013fef0 0x7f4da00b1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4da006aaa0 0x7f4da01391f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 --2- 172.21.15.12:0/1547245698 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4da013fb20 0x7f4da0155b50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 >> 172.21.15.12:0/1547245698 conn(0x7f4da006d170 msgr2=0x7f4da013bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 shutdown_connections 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:14.012+0000 7f4da6f9d700 1 -- 172.21.15.12:0/1547245698 wait complete. 2023-10-08T16:22:14.014 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:22:14.029 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:22:13.164952+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":243,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":177,"ondisk_log_size":177,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430920,"kb_used_data":7560,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543800,"statfs":{"total":773094113280,"available":770604851200,"internally_reserved":0,"allocated":7741440,"data_stored":4246092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.431508"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761372+0000","last_change":"2023-10-08T16:22:07.752311+0000","last_active":"2023-10-08T16:22:07.761372+0000","last_peered":"2023-10-08T16:22:07.761372+0000","last_clean":"2023-10-08T16:22:07.761372+0000","last_became_active":"2023-10-08T16:22:07.752029+0000","last_became_peered":"2023-10-08T16:22:07.752029+0000","last_unstale":"2023-10-08T16:22:07.761372+0000","last_undegraded":"2023-10-08T16:22:07.761372+0000","last_fullsized":"2023-10-08T16:22:07.761372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:40.040536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763672+0000","last_change":"2023-10-08T16:22:07.761173+0000","last_active":"2023-10-08T16:22:07.763672+0000","last_peered":"2023-10-08T16:22:07.763672+0000","last_clean":"2023-10-08T16:22:07.763672+0000","last_became_active":"2023-10-08T16:22:07.760266+0000","last_became_peered":"2023-10-08T16:22:07.760266+0000","last_unstale":"2023-10-08T16:22:07.763672+0000","last_undegraded":"2023-10-08T16:22:07.763672+0000","last_fullsized":"2023-10-08T16:22:07.763672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.755865+0000","last_change":"2023-10-08T16:22:07.754545+0000","last_active":"2023-10-08T16:22:07.755865+0000","last_peered":"2023-10-08T16:22:07.755865+0000","last_clean":"2023-10-08T16:22:07.755865+0000","last_became_active":"2023-10-08T16:22:07.754217+0000","last_became_peered":"2023-10-08T16:22:07.754217+0000","last_unstale":"2023-10-08T16:22:07.755865+0000","last_undegraded":"2023-10-08T16:22:07.755865+0000","last_fullsized":"2023-10-08T16:22:07.755865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764559+0000","last_change":"2023-10-08T16:22:07.758756+0000","last_active":"2023-10-08T16:22:07.764559+0000","last_peered":"2023-10-08T16:22:07.764559+0000","last_clean":"2023-10-08T16:22:07.764559+0000","last_became_active":"2023-10-08T16:22:07.758515+0000","last_became_peered":"2023-10-08T16:22:07.758515+0000","last_unstale":"2023-10-08T16:22:07.764559+0000","last_undegraded":"2023-10-08T16:22:07.764559+0000","last_fullsized":"2023-10-08T16:22:07.764559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:28.093357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762060+0000","last_change":"2023-10-08T16:22:07.752424+0000","last_active":"2023-10-08T16:22:07.762060+0000","last_peered":"2023-10-08T16:22:07.762060+0000","last_clean":"2023-10-08T16:22:07.762060+0000","last_became_active":"2023-10-08T16:22:07.752118+0000","last_became_peered":"2023-10-08T16:22:07.752118+0000","last_unstale":"2023-10-08T16:22:07.762060+0000","last_undegraded":"2023-10-08T16:22:07.762060+0000","last_fullsized":"2023-10-08T16:22:07.762060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.759608+0000","last_change":"2023-10-08T16:22:07.752292+0000","last_active":"2023-10-08T16:22:07.759608+0000","last_peered":"2023-10-08T16:22:07.759608+0000","last_clean":"2023-10-08T16:22:07.759608+0000","last_became_active":"2023-10-08T16:22:07.752022+0000","last_became_peered":"2023-10-08T16:22:07.752022+0000","last_unstale":"2023-10-08T16:22:07.759608+0000","last_undegraded":"2023-10-08T16:22:07.759608+0000","last_fullsized":"2023-10-08T16:22:07.759608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:20.346245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763087+0000","last_change":"2023-10-08T16:22:07.759813+0000","last_active":"2023-10-08T16:22:07.763087+0000","last_peered":"2023-10-08T16:22:07.763087+0000","last_clean":"2023-10-08T16:22:07.763087+0000","last_became_active":"2023-10-08T16:22:07.759555+0000","last_became_peered":"2023-10-08T16:22:07.759555+0000","last_unstale":"2023-10-08T16:22:07.763087+0000","last_undegraded":"2023-10-08T16:22:07.763087+0000","last_fullsized":"2023-10-08T16:22:07.763087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:59.265208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766634+0000","last_change":"2023-10-08T16:22:07.763751+0000","last_active":"2023-10-08T16:22:07.766634+0000","last_peered":"2023-10-08T16:22:07.766634+0000","last_clean":"2023-10-08T16:22:07.766634+0000","last_became_active":"2023-10-08T16:22:07.763447+0000","last_became_peered":"2023-10-08T16:22:07.763447+0000","last_unstale":"2023-10-08T16:22:07.766634+0000","last_undegraded":"2023-10-08T16:22:07.766634+0000","last_fullsized":"2023-10-08T16:22:07.766634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:33.626750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764588+0000","last_change":"2023-10-08T16:22:07.760102+0000","last_active":"2023-10-08T16:22:07.764588+0000","last_peered":"2023-10-08T16:22:07.764588+0000","last_clean":"2023-10-08T16:22:07.764588+0000","last_became_active":"2023-10-08T16:22:07.759849+0000","last_became_peered":"2023-10-08T16:22:07.759849+0000","last_unstale":"2023-10-08T16:22:07.764588+0000","last_undegraded":"2023-10-08T16:22:07.764588+0000","last_fullsized":"2023-10-08T16:22:07.764588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:08.987271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764857+0000","last_change":"2023-10-08T16:22:07.759897+0000","last_active":"2023-10-08T16:22:07.764857+0000","last_peered":"2023-10-08T16:22:07.764857+0000","last_clean":"2023-10-08T16:22:07.764857+0000","last_became_active":"2023-10-08T16:22:07.759646+0000","last_became_peered":"2023-10-08T16:22:07.759646+0000","last_unstale":"2023-10-08T16:22:07.764857+0000","last_undegraded":"2023-10-08T16:22:07.764857+0000","last_fullsized":"2023-10-08T16:22:07.764857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.312679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764496+0000","last_change":"2023-10-08T16:22:07.757527+0000","last_active":"2023-10-08T16:22:07.764496+0000","last_peered":"2023-10-08T16:22:07.764496+0000","last_clean":"2023-10-08T16:22:07.764496+0000","last_became_active":"2023-10-08T16:22:07.757256+0000","last_became_peered":"2023-10-08T16:22:07.757256+0000","last_unstale":"2023-10-08T16:22:07.764496+0000","last_undegraded":"2023-10-08T16:22:07.764496+0000","last_fullsized":"2023-10-08T16:22:07.764496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761852+0000","last_change":"2023-10-08T16:22:07.753914+0000","last_active":"2023-10-08T16:22:07.761852+0000","last_peered":"2023-10-08T16:22:07.761852+0000","last_clean":"2023-10-08T16:22:07.761852+0000","last_became_active":"2023-10-08T16:22:07.753589+0000","last_became_peered":"2023-10-08T16:22:07.753589+0000","last_unstale":"2023-10-08T16:22:07.761852+0000","last_undegraded":"2023-10-08T16:22:07.761852+0000","last_fullsized":"2023-10-08T16:22:07.761852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767316+0000","last_change":"2023-10-08T16:22:07.764241+0000","last_active":"2023-10-08T16:22:07.767316+0000","last_peered":"2023-10-08T16:22:07.767316+0000","last_clean":"2023-10-08T16:22:07.767316+0000","last_became_active":"2023-10-08T16:22:07.763964+0000","last_became_peered":"2023-10-08T16:22:07.763964+0000","last_unstale":"2023-10-08T16:22:07.767316+0000","last_undegraded":"2023-10-08T16:22:07.767316+0000","last_fullsized":"2023-10-08T16:22:07.767316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764613+0000","last_change":"2023-10-08T16:22:07.756830+0000","last_active":"2023-10-08T16:22:07.764613+0000","last_peered":"2023-10-08T16:22:07.764613+0000","last_clean":"2023-10-08T16:22:07.764613+0000","last_became_active":"2023-10-08T16:22:07.756549+0000","last_became_peered":"2023-10-08T16:22:07.756549+0000","last_unstale":"2023-10-08T16:22:07.764613+0000","last_undegraded":"2023-10-08T16:22:07.764613+0000","last_fullsized":"2023-10-08T16:22:07.764613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:13.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.753568+0000","last_change":"2023-10-08T16:22:07.750512+0000","last_active":"2023-10-08T16:22:07.753568+0000","last_peered":"2023-10-08T16:22:07.753568+0000","last_clean":"2023-10-08T16:22:07.753568+0000","last_became_active":"2023-10-08T16:22:07.750237+0000","last_became_peered":"2023-10-08T16:22:07.750237+0000","last_unstale":"2023-10-08T16:22:07.753568+0000","last_undegraded":"2023-10-08T16:22:07.753568+0000","last_fullsized":"2023-10-08T16:22:07.753568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:07.835319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769621+0000","last_change":"2023-10-08T16:22:07.768293+0000","last_active":"2023-10-08T16:22:07.769621+0000","last_peered":"2023-10-08T16:22:07.769621+0000","last_clean":"2023-10-08T16:22:07.769621+0000","last_became_active":"2023-10-08T16:22:07.767929+0000","last_became_peered":"2023-10-08T16:22:07.767929+0000","last_unstale":"2023-10-08T16:22:07.769621+0000","last_undegraded":"2023-10-08T16:22:07.769621+0000","last_fullsized":"2023-10-08T16:22:07.769621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.750213+0000","last_change":"2023-10-08T16:22:07.745608+0000","last_active":"2023-10-08T16:22:07.750213+0000","last_peered":"2023-10-08T16:22:07.750213+0000","last_clean":"2023-10-08T16:22:07.750213+0000","last_became_active":"2023-10-08T16:22:07.745274+0000","last_became_peered":"2023-10-08T16:22:07.745274+0000","last_unstale":"2023-10-08T16:22:07.750213+0000","last_undegraded":"2023-10-08T16:22:07.750213+0000","last_fullsized":"2023-10-08T16:22:07.750213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766444+0000","last_change":"2023-10-08T16:22:07.765650+0000","last_active":"2023-10-08T16:22:07.766444+0000","last_peered":"2023-10-08T16:22:07.766444+0000","last_clean":"2023-10-08T16:22:07.766444+0000","last_became_active":"2023-10-08T16:22:07.765345+0000","last_became_peered":"2023-10-08T16:22:07.765345+0000","last_unstale":"2023-10-08T16:22:07.766444+0000","last_undegraded":"2023-10-08T16:22:07.766444+0000","last_fullsized":"2023-10-08T16:22:07.766444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769167+0000","last_change":"2023-10-08T16:22:07.767763+0000","last_active":"2023-10-08T16:22:07.769167+0000","last_peered":"2023-10-08T16:22:07.769167+0000","last_clean":"2023-10-08T16:22:07.769167+0000","last_became_active":"2023-10-08T16:22:07.767468+0000","last_became_peered":"2023-10-08T16:22:07.767468+0000","last_unstale":"2023-10-08T16:22:07.769167+0000","last_undegraded":"2023-10-08T16:22:07.769167+0000","last_fullsized":"2023-10-08T16:22:07.769167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757234+0000","last_change":"2023-10-08T16:22:07.753272+0000","last_active":"2023-10-08T16:22:07.757234+0000","last_peered":"2023-10-08T16:22:07.757234+0000","last_clean":"2023-10-08T16:22:07.757234+0000","last_became_active":"2023-10-08T16:22:07.752966+0000","last_became_peered":"2023-10-08T16:22:07.752966+0000","last_unstale":"2023-10-08T16:22:07.757234+0000","last_undegraded":"2023-10-08T16:22:07.757234+0000","last_fullsized":"2023-10-08T16:22:07.757234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770865+0000","last_change":"2023-10-08T16:22:07.762024+0000","last_active":"2023-10-08T16:22:07.770865+0000","last_peered":"2023-10-08T16:22:07.770865+0000","last_clean":"2023-10-08T16:22:07.770865+0000","last_became_active":"2023-10-08T16:22:07.761772+0000","last_became_peered":"2023-10-08T16:22:07.761772+0000","last_unstale":"2023-10-08T16:22:07.770865+0000","last_undegraded":"2023-10-08T16:22:07.770865+0000","last_fullsized":"2023-10-08T16:22:07.770865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:09.885712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765325+0000","last_change":"2023-10-08T16:22:07.761449+0000","last_active":"2023-10-08T16:22:07.765325+0000","last_peered":"2023-10-08T16:22:07.765325+0000","last_clean":"2023-10-08T16:22:07.765325+0000","last_became_active":"2023-10-08T16:22:07.761173+0000","last_became_peered":"2023-10-08T16:22:07.761173+0000","last_unstale":"2023-10-08T16:22:07.765325+0000","last_undegraded":"2023-10-08T16:22:07.765325+0000","last_fullsized":"2023-10-08T16:22:07.765325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:38.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763772+0000","last_change":"2023-10-08T16:22:07.759147+0000","last_active":"2023-10-08T16:22:07.763772+0000","last_peered":"2023-10-08T16:22:07.763772+0000","last_clean":"2023-10-08T16:22:07.763772+0000","last_became_active":"2023-10-08T16:22:07.758887+0000","last_became_peered":"2023-10-08T16:22:07.758887+0000","last_unstale":"2023-10-08T16:22:07.763772+0000","last_undegraded":"2023-10-08T16:22:07.763772+0000","last_fullsized":"2023-10-08T16:22:07.763772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763164+0000","last_change":"2023-10-08T16:22:07.759699+0000","last_active":"2023-10-08T16:22:07.763164+0000","last_peered":"2023-10-08T16:22:07.763164+0000","last_clean":"2023-10-08T16:22:07.763164+0000","last_became_active":"2023-10-08T16:22:07.759428+0000","last_became_peered":"2023-10-08T16:22:07.759428+0000","last_unstale":"2023-10-08T16:22:07.763164+0000","last_undegraded":"2023-10-08T16:22:07.763164+0000","last_fullsized":"2023-10-08T16:22:07.763164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764898+0000","last_change":"2023-10-08T16:22:07.763416+0000","last_active":"2023-10-08T16:22:07.764898+0000","last_peered":"2023-10-08T16:22:07.764898+0000","last_clean":"2023-10-08T16:22:07.764898+0000","last_became_active":"2023-10-08T16:22:07.762064+0000","last_became_peered":"2023-10-08T16:22:07.762064+0000","last_unstale":"2023-10-08T16:22:07.764898+0000","last_undegraded":"2023-10-08T16:22:07.764898+0000","last_fullsized":"2023-10-08T16:22:07.764898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770557+0000","last_change":"2023-10-08T16:22:07.765513+0000","last_active":"2023-10-08T16:22:07.770557+0000","last_peered":"2023-10-08T16:22:07.770557+0000","last_clean":"2023-10-08T16:22:07.770557+0000","last_became_active":"2023-10-08T16:22:07.765132+0000","last_became_peered":"2023-10-08T16:22:07.765132+0000","last_unstale":"2023-10-08T16:22:07.770557+0000","last_undegraded":"2023-10-08T16:22:07.770557+0000","last_fullsized":"2023-10-08T16:22:07.770557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744915+0000","last_change":"2023-10-08T16:22:07.744054+0000","last_active":"2023-10-08T16:22:07.744915+0000","last_peered":"2023-10-08T16:22:07.744915+0000","last_clean":"2023-10-08T16:22:07.744915+0000","last_became_active":"2023-10-08T16:22:07.743758+0000","last_became_peered":"2023-10-08T16:22:07.743758+0000","last_unstale":"2023-10-08T16:22:07.744915+0000","last_undegraded":"2023-10-08T16:22:07.744915+0000","last_fullsized":"2023-10-08T16:22:07.744915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:55.671583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761877+0000","last_change":"2023-10-08T16:22:07.755396+0000","last_active":"2023-10-08T16:22:07.761877+0000","last_peered":"2023-10-08T16:22:07.761877+0000","last_clean":"2023-10-08T16:22:07.761877+0000","last_became_active":"2023-10-08T16:22:07.755020+0000","last_became_peered":"2023-10-08T16:22:07.755020+0000","last_unstale":"2023-10-08T16:22:07.761877+0000","last_undegraded":"2023-10-08T16:22:07.761877+0000","last_fullsized":"2023-10-08T16:22:07.761877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:37.842650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763524+0000","last_change":"2023-10-08T16:22:07.761040+0000","last_active":"2023-10-08T16:22:07.763524+0000","last_peered":"2023-10-08T16:22:07.763524+0000","last_clean":"2023-10-08T16:22:07.763524+0000","last_became_active":"2023-10-08T16:22:07.760745+0000","last_became_peered":"2023-10-08T16:22:07.760745+0000","last_unstale":"2023-10-08T16:22:07.763524+0000","last_undegraded":"2023-10-08T16:22:07.763524+0000","last_fullsized":"2023-10-08T16:22:07.763524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.754326+0000","last_change":"2023-10-08T16:22:07.751456+0000","last_active":"2023-10-08T16:22:07.754326+0000","last_peered":"2023-10-08T16:22:07.754326+0000","last_clean":"2023-10-08T16:22:07.754326+0000","last_became_active":"2023-10-08T16:22:07.751189+0000","last_became_peered":"2023-10-08T16:22:07.751189+0000","last_unstale":"2023-10-08T16:22:07.754326+0000","last_undegraded":"2023-10-08T16:22:07.754326+0000","last_fullsized":"2023-10-08T16:22:07.754326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:09.760322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757793+0000","last_change":"2023-10-08T16:22:07.755753+0000","last_active":"2023-10-08T16:22:07.757793+0000","last_peered":"2023-10-08T16:22:07.757793+0000","last_clean":"2023-10-08T16:22:07.757793+0000","last_became_active":"2023-10-08T16:22:07.755364+0000","last_became_peered":"2023-10-08T16:22:07.755364+0000","last_unstale":"2023-10-08T16:22:07.757793+0000","last_undegraded":"2023-10-08T16:22:07.757793+0000","last_fullsized":"2023-10-08T16:22:07.757793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:41.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767204+0000","last_change":"2023-10-08T16:22:07.761256+0000","last_active":"2023-10-08T16:22:07.767204+0000","last_peered":"2023-10-08T16:22:07.767204+0000","last_clean":"2023-10-08T16:22:07.767204+0000","last_became_active":"2023-10-08T16:22:07.760995+0000","last_became_peered":"2023-10-08T16:22:07.760995+0000","last_unstale":"2023-10-08T16:22:07.767204+0000","last_undegraded":"2023-10-08T16:22:07.767204+0000","last_fullsized":"2023-10-08T16:22:07.767204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760210+0000","last_change":"2023-10-08T16:22:07.758889+0000","last_active":"2023-10-08T16:22:07.760210+0000","last_peered":"2023-10-08T16:22:07.760210+0000","last_clean":"2023-10-08T16:22:07.760210+0000","last_became_active":"2023-10-08T16:22:07.758586+0000","last_became_peered":"2023-10-08T16:22:07.758586+0000","last_unstale":"2023-10-08T16:22:07.760210+0000","last_undegraded":"2023-10-08T16:22:07.760210+0000","last_fullsized":"2023-10-08T16:22:07.760210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:59.843696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779240+0000","last_change":"2023-10-08T16:22:06.756675+0000","last_active":"2023-10-08T16:22:07.779240+0000","last_peered":"2023-10-08T16:22:07.779240+0000","last_clean":"2023-10-08T16:22:07.779240+0000","last_became_active":"2023-10-08T16:22:06.756367+0000","last_became_peered":"2023-10-08T16:22:06.756367+0000","last_unstale":"2023-10-08T16:22:07.779240+0000","last_undegraded":"2023-10-08T16:22:07.779240+0000","last_fullsized":"2023-10-08T16:22:07.779240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761011+0000","last_change":"2023-10-08T16:22:07.758150+0000","last_active":"2023-10-08T16:22:07.761011+0000","last_peered":"2023-10-08T16:22:07.761011+0000","last_clean":"2023-10-08T16:22:07.761011+0000","last_became_active":"2023-10-08T16:22:07.757850+0000","last_became_peered":"2023-10-08T16:22:07.757850+0000","last_unstale":"2023-10-08T16:22:07.761011+0000","last_undegraded":"2023-10-08T16:22:07.761011+0000","last_fullsized":"2023-10-08T16:22:07.761011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:55.671583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778758+0000","last_change":"2023-10-08T16:22:06.757008+0000","last_active":"2023-10-08T16:22:07.778758+0000","last_peered":"2023-10-08T16:22:07.778758+0000","last_clean":"2023-10-08T16:22:07.778758+0000","last_became_active":"2023-10-08T16:22:06.756705+0000","last_became_peered":"2023-10-08T16:22:06.756705+0000","last_unstale":"2023-10-08T16:22:07.778758+0000","last_undegraded":"2023-10-08T16:22:07.778758+0000","last_fullsized":"2023-10-08T16:22:07.778758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.755202+0000","last_change":"2023-10-08T16:22:07.750997+0000","last_active":"2023-10-08T16:22:07.755202+0000","last_peered":"2023-10-08T16:22:07.755202+0000","last_clean":"2023-10-08T16:22:07.755202+0000","last_became_active":"2023-10-08T16:22:07.750651+0000","last_became_peered":"2023-10-08T16:22:07.750651+0000","last_unstale":"2023-10-08T16:22:07.755202+0000","last_undegraded":"2023-10-08T16:22:07.755202+0000","last_fullsized":"2023-10-08T16:22:07.755202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.774313+0000","last_change":"2023-10-08T16:22:06.754215+0000","last_active":"2023-10-08T16:22:07.774313+0000","last_peered":"2023-10-08T16:22:07.774313+0000","last_clean":"2023-10-08T16:22:07.774313+0000","last_became_active":"2023-10-08T16:22:06.753791+0000","last_became_peered":"2023-10-08T16:22:06.753791+0000","last_unstale":"2023-10-08T16:22:07.774313+0000","last_undegraded":"2023-10-08T16:22:07.774313+0000","last_fullsized":"2023-10-08T16:22:07.774313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760979+0000","last_change":"2023-10-08T16:22:07.759986+0000","last_active":"2023-10-08T16:22:07.760979+0000","last_peered":"2023-10-08T16:22:07.760979+0000","last_clean":"2023-10-08T16:22:07.760979+0000","last_became_active":"2023-10-08T16:22:07.759691+0000","last_became_peered":"2023-10-08T16:22:07.759691+0000","last_unstale":"2023-10-08T16:22:07.760979+0000","last_undegraded":"2023-10-08T16:22:07.760979+0000","last_fullsized":"2023-10-08T16:22:07.760979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:34.572274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777723+0000","last_change":"2023-10-08T16:22:06.749271+0000","last_active":"2023-10-08T16:22:07.777723+0000","last_peered":"2023-10-08T16:22:07.777723+0000","last_clean":"2023-10-08T16:22:07.777723+0000","last_became_active":"2023-10-08T16:22:06.748949+0000","last_became_peered":"2023-10-08T16:22:06.748949+0000","last_unstale":"2023-10-08T16:22:07.777723+0000","last_undegraded":"2023-10-08T16:22:07.777723+0000","last_fullsized":"2023-10-08T16:22:07.777723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761283+0000","last_change":"2023-10-08T16:22:07.760036+0000","last_active":"2023-10-08T16:22:07.761283+0000","last_peered":"2023-10-08T16:22:07.761283+0000","last_clean":"2023-10-08T16:22:07.761283+0000","last_became_active":"2023-10-08T16:22:07.759735+0000","last_became_peered":"2023-10-08T16:22:07.759735+0000","last_unstale":"2023-10-08T16:22:07.761283+0000","last_undegraded":"2023-10-08T16:22:07.761283+0000","last_fullsized":"2023-10-08T16:22:07.761283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778229+0000","last_change":"2023-10-08T16:22:06.751312+0000","last_active":"2023-10-08T16:22:07.778229+0000","last_peered":"2023-10-08T16:22:07.778229+0000","last_clean":"2023-10-08T16:22:07.778229+0000","last_became_active":"2023-10-08T16:22:06.751047+0000","last_became_peered":"2023-10-08T16:22:06.751047+0000","last_unstale":"2023-10-08T16:22:07.778229+0000","last_undegraded":"2023-10-08T16:22:07.778229+0000","last_fullsized":"2023-10-08T16:22:07.778229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764951+0000","last_change":"2023-10-08T16:22:07.758292+0000","last_active":"2023-10-08T16:22:07.764951+0000","last_peered":"2023-10-08T16:22:07.764951+0000","last_clean":"2023-10-08T16:22:07.764951+0000","last_became_active":"2023-10-08T16:22:07.758005+0000","last_became_peered":"2023-10-08T16:22:07.758005+0000","last_unstale":"2023-10-08T16:22:07.764951+0000","last_undegraded":"2023-10-08T16:22:07.764951+0000","last_fullsized":"2023-10-08T16:22:07.764951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:57.243118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777905+0000","last_change":"2023-10-08T16:22:06.754872+0000","last_active":"2023-10-08T16:22:07.777905+0000","last_peered":"2023-10-08T16:22:07.777905+0000","last_clean":"2023-10-08T16:22:07.777905+0000","last_became_active":"2023-10-08T16:22:06.754581+0000","last_became_peered":"2023-10-08T16:22:06.754581+0000","last_unstale":"2023-10-08T16:22:07.777905+0000","last_undegraded":"2023-10-08T16:22:07.777905+0000","last_fullsized":"2023-10-08T16:22:07.777905+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766652+0000","last_change":"2023-10-08T16:22:07.763807+0000","last_active":"2023-10-08T16:22:07.766652+0000","last_peered":"2023-10-08T16:22:07.766652+0000","last_clean":"2023-10-08T16:22:07.766652+0000","last_became_active":"2023-10-08T16:22:07.761035+0000","last_became_peered":"2023-10-08T16:22:07.761035+0000","last_unstale":"2023-10-08T16:22:07.766652+0000","last_undegraded":"2023-10-08T16:22:07.766652+0000","last_fullsized":"2023-10-08T16:22:07.766652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:45.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.739465+0000","last_change":"2023-10-08T16:22:06.751843+0000","last_active":"2023-10-08T16:22:07.739465+0000","last_peered":"2023-10-08T16:22:07.739465+0000","last_clean":"2023-10-08T16:22:07.739465+0000","last_became_active":"2023-10-08T16:22:06.751468+0000","last_became_peered":"2023-10-08T16:22:06.751468+0000","last_unstale":"2023-10-08T16:22:07.739465+0000","last_undegraded":"2023-10-08T16:22:07.739465+0000","last_fullsized":"2023-10-08T16:22:07.739465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:21.649959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762905+0000","last_change":"2023-10-08T16:22:07.758404+0000","last_active":"2023-10-08T16:22:07.762905+0000","last_peered":"2023-10-08T16:22:07.762905+0000","last_clean":"2023-10-08T16:22:07.762905+0000","last_became_active":"2023-10-08T16:22:07.758125+0000","last_became_peered":"2023-10-08T16:22:07.758125+0000","last_unstale":"2023-10-08T16:22:07.762905+0000","last_undegraded":"2023-10-08T16:22:07.762905+0000","last_fullsized":"2023-10-08T16:22:07.762905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749042+0000","last_change":"2023-10-08T16:22:06.748984+0000","last_active":"2023-10-08T16:22:07.749042+0000","last_peered":"2023-10-08T16:22:07.749042+0000","last_clean":"2023-10-08T16:22:07.749042+0000","last_became_active":"2023-10-08T16:22:06.748582+0000","last_became_peered":"2023-10-08T16:22:06.748582+0000","last_unstale":"2023-10-08T16:22:07.749042+0000","last_undegraded":"2023-10-08T16:22:07.749042+0000","last_fullsized":"2023-10-08T16:22:07.749042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:20.846032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766455+0000","last_change":"2023-10-08T16:22:07.765780+0000","last_active":"2023-10-08T16:22:07.766455+0000","last_peered":"2023-10-08T16:22:07.766455+0000","last_clean":"2023-10-08T16:22:07.766455+0000","last_became_active":"2023-10-08T16:22:07.765455+0000","last_became_peered":"2023-10-08T16:22:07.765455+0000","last_unstale":"2023-10-08T16:22:07.766455+0000","last_undegraded":"2023-10-08T16:22:07.766455+0000","last_fullsized":"2023-10-08T16:22:07.766455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.739213+0000","last_change":"2023-10-08T16:22:06.750209+0000","last_active":"2023-10-08T16:22:07.739213+0000","last_peered":"2023-10-08T16:22:07.739213+0000","last_clean":"2023-10-08T16:22:07.739213+0000","last_became_active":"2023-10-08T16:22:06.749911+0000","last_became_peered":"2023-10-08T16:22:06.749911+0000","last_unstale":"2023-10-08T16:22:07.739213+0000","last_undegraded":"2023-10-08T16:22:07.739213+0000","last_fullsized":"2023-10-08T16:22:07.739213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761393+0000","last_change":"2023-10-08T16:22:07.756369+0000","last_active":"2023-10-08T16:22:07.761393+0000","last_peered":"2023-10-08T16:22:07.761393+0000","last_clean":"2023-10-08T16:22:07.761393+0000","last_became_active":"2023-10-08T16:22:07.756100+0000","last_became_peered":"2023-10-08T16:22:07.756100+0000","last_unstale":"2023-10-08T16:22:07.761393+0000","last_undegraded":"2023-10-08T16:22:07.761393+0000","last_fullsized":"2023-10-08T16:22:07.761393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:14.268045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749030+0000","last_change":"2023-10-08T16:22:06.744862+0000","last_active":"2023-10-08T16:22:07.749030+0000","last_peered":"2023-10-08T16:22:07.749030+0000","last_clean":"2023-10-08T16:22:07.749030+0000","last_became_active":"2023-10-08T16:22:06.744599+0000","last_became_peered":"2023-10-08T16:22:06.744599+0000","last_unstale":"2023-10-08T16:22:07.749030+0000","last_undegraded":"2023-10-08T16:22:07.749030+0000","last_fullsized":"2023-10-08T16:22:07.749030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:35.219631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765126+0000","last_change":"2023-10-08T16:22:07.759240+0000","last_active":"2023-10-08T16:22:07.765126+0000","last_peered":"2023-10-08T16:22:07.765126+0000","last_clean":"2023-10-08T16:22:07.765126+0000","last_became_active":"2023-10-08T16:22:07.758975+0000","last_became_peered":"2023-10-08T16:22:07.758975+0000","last_unstale":"2023-10-08T16:22:07.765126+0000","last_undegraded":"2023-10-08T16:22:07.765126+0000","last_fullsized":"2023-10-08T16:22:07.765126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.150111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778857+0000","last_change":"2023-10-08T16:22:06.757675+0000","last_active":"2023-10-08T16:22:07.778857+0000","last_peered":"2023-10-08T16:22:07.778857+0000","last_clean":"2023-10-08T16:22:07.778857+0000","last_became_active":"2023-10-08T16:22:06.757404+0000","last_became_peered":"2023-10-08T16:22:06.757404+0000","last_unstale":"2023-10-08T16:22:07.778857+0000","last_undegraded":"2023-10-08T16:22:07.778857+0000","last_fullsized":"2023-10-08T16:22:07.778857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762323+0000","last_change":"2023-10-08T16:22:07.759189+0000","last_active":"2023-10-08T16:22:07.762323+0000","last_peered":"2023-10-08T16:22:07.762323+0000","last_clean":"2023-10-08T16:22:07.762323+0000","last_became_active":"2023-10-08T16:22:07.758933+0000","last_became_peered":"2023-10-08T16:22:07.758933+0000","last_unstale":"2023-10-08T16:22:07.762323+0000","last_undegraded":"2023-10-08T16:22:07.762323+0000","last_fullsized":"2023-10-08T16:22:07.762323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:03.259617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.780562+0000","last_change":"2023-10-08T16:22:06.752726+0000","last_active":"2023-10-08T16:22:07.780562+0000","last_peered":"2023-10-08T16:22:07.780562+0000","last_clean":"2023-10-08T16:22:07.780562+0000","last_became_active":"2023-10-08T16:22:06.752376+0000","last_became_peered":"2023-10-08T16:22:06.752376+0000","last_unstale":"2023-10-08T16:22:07.780562+0000","last_undegraded":"2023-10-08T16:22:07.780562+0000","last_fullsized":"2023-10-08T16:22:07.780562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769211+0000","last_change":"2023-10-08T16:22:07.767737+0000","last_active":"2023-10-08T16:22:07.769211+0000","last_peered":"2023-10-08T16:22:07.769211+0000","last_clean":"2023-10-08T16:22:07.769211+0000","last_became_active":"2023-10-08T16:22:07.767295+0000","last_became_peered":"2023-10-08T16:22:07.767295+0000","last_unstale":"2023-10-08T16:22:07.769211+0000","last_undegraded":"2023-10-08T16:22:07.769211+0000","last_fullsized":"2023-10-08T16:22:07.769211+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:09.760322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779396+0000","last_change":"2023-10-08T16:22:06.754410+0000","last_active":"2023-10-08T16:22:07.779396+0000","last_peered":"2023-10-08T16:22:07.779396+0000","last_clean":"2023-10-08T16:22:07.779396+0000","last_became_active":"2023-10-08T16:22:06.753839+0000","last_became_peered":"2023-10-08T16:22:06.753839+0000","last_unstale":"2023-10-08T16:22:07.779396+0000","last_undegraded":"2023-10-08T16:22:07.779396+0000","last_fullsized":"2023-10-08T16:22:07.779396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:56.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762251+0000","last_change":"2023-10-08T16:22:07.749665+0000","last_active":"2023-10-08T16:22:07.762251+0000","last_peered":"2023-10-08T16:22:07.762251+0000","last_clean":"2023-10-08T16:22:07.762251+0000","last_became_active":"2023-10-08T16:22:07.749419+0000","last_became_peered":"2023-10-08T16:22:07.749419+0000","last_unstale":"2023-10-08T16:22:07.762251+0000","last_undegraded":"2023-10-08T16:22:07.762251+0000","last_fullsized":"2023-10-08T16:22:07.762251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:54.684827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744524+0000","last_change":"2023-10-08T16:22:06.748078+0000","last_active":"2023-10-08T16:22:07.744524+0000","last_peered":"2023-10-08T16:22:07.744524+0000","last_clean":"2023-10-08T16:22:07.744524+0000","last_became_active":"2023-10-08T16:22:06.747724+0000","last_became_peered":"2023-10-08T16:22:06.747724+0000","last_unstale":"2023-10-08T16:22:07.744524+0000","last_undegraded":"2023-10-08T16:22:07.744524+0000","last_fullsized":"2023-10-08T16:22:07.744524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:12.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765000+0000","last_change":"2023-10-08T16:22:07.757922+0000","last_active":"2023-10-08T16:22:07.765000+0000","last_peered":"2023-10-08T16:22:07.765000+0000","last_clean":"2023-10-08T16:22:07.765000+0000","last_became_active":"2023-10-08T16:22:07.757672+0000","last_became_peered":"2023-10-08T16:22:07.757672+0000","last_unstale":"2023-10-08T16:22:07.765000+0000","last_undegraded":"2023-10-08T16:22:07.765000+0000","last_fullsized":"2023-10-08T16:22:07.765000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:50.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743546+0000","last_change":"2023-10-08T16:22:06.750046+0000","last_active":"2023-10-08T16:22:07.743546+0000","last_peered":"2023-10-08T16:22:07.743546+0000","last_clean":"2023-10-08T16:22:07.743546+0000","last_became_active":"2023-10-08T16:22:06.749762+0000","last_became_peered":"2023-10-08T16:22:06.749762+0000","last_unstale":"2023-10-08T16:22:07.743546+0000","last_undegraded":"2023-10-08T16:22:07.743546+0000","last_fullsized":"2023-10-08T16:22:07.743546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:27.086771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762268+0000","last_change":"2023-10-08T16:22:07.758348+0000","last_active":"2023-10-08T16:22:07.762268+0000","last_peered":"2023-10-08T16:22:07.762268+0000","last_clean":"2023-10-08T16:22:07.762268+0000","last_became_active":"2023-10-08T16:22:07.758017+0000","last_became_peered":"2023-10-08T16:22:07.758017+0000","last_unstale":"2023-10-08T16:22:07.762268+0000","last_undegraded":"2023-10-08T16:22:07.762268+0000","last_fullsized":"2023-10-08T16:22:07.762268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:36.899810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779040+0000","last_change":"2023-10-08T16:22:06.748832+0000","last_active":"2023-10-08T16:22:07.779040+0000","last_peered":"2023-10-08T16:22:07.779040+0000","last_clean":"2023-10-08T16:22:07.779040+0000","last_became_active":"2023-10-08T16:22:06.748243+0000","last_became_peered":"2023-10-08T16:22:06.748243+0000","last_unstale":"2023-10-08T16:22:07.779040+0000","last_undegraded":"2023-10-08T16:22:07.779040+0000","last_fullsized":"2023-10-08T16:22:07.779040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757181+0000","last_change":"2023-10-08T16:22:07.753126+0000","last_active":"2023-10-08T16:22:07.757181+0000","last_peered":"2023-10-08T16:22:07.757181+0000","last_clean":"2023-10-08T16:22:07.757181+0000","last_became_active":"2023-10-08T16:22:07.752761+0000","last_became_peered":"2023-10-08T16:22:07.752761+0000","last_unstale":"2023-10-08T16:22:07.757181+0000","last_undegraded":"2023-10-08T16:22:07.757181+0000","last_fullsized":"2023-10-08T16:22:07.757181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.775396+0000","last_change":"2023-10-08T16:22:06.754333+0000","last_active":"2023-10-08T16:22:07.775396+0000","last_peered":"2023-10-08T16:22:07.775396+0000","last_clean":"2023-10-08T16:22:07.775396+0000","last_became_active":"2023-10-08T16:22:06.754015+0000","last_became_peered":"2023-10-08T16:22:06.754015+0000","last_unstale":"2023-10-08T16:22:07.775396+0000","last_undegraded":"2023-10-08T16:22:07.775396+0000","last_fullsized":"2023-10-08T16:22:07.775396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764706+0000","last_change":"2023-10-08T16:22:07.761350+0000","last_active":"2023-10-08T16:22:07.764706+0000","last_peered":"2023-10-08T16:22:07.764706+0000","last_clean":"2023-10-08T16:22:07.764706+0000","last_became_active":"2023-10-08T16:22:07.761049+0000","last_became_peered":"2023-10-08T16:22:07.761049+0000","last_unstale":"2023-10-08T16:22:07.764706+0000","last_undegraded":"2023-10-08T16:22:07.764706+0000","last_fullsized":"2023-10-08T16:22:07.764706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:13.143629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777767+0000","last_change":"2023-10-08T16:22:06.750281+0000","last_active":"2023-10-08T16:22:07.777767+0000","last_peered":"2023-10-08T16:22:07.777767+0000","last_clean":"2023-10-08T16:22:07.777767+0000","last_became_active":"2023-10-08T16:22:06.749973+0000","last_became_peered":"2023-10-08T16:22:06.749973+0000","last_unstale":"2023-10-08T16:22:07.777767+0000","last_undegraded":"2023-10-08T16:22:07.777767+0000","last_fullsized":"2023-10-08T16:22:07.777767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:29.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761670+0000","last_change":"2023-10-08T16:22:07.757974+0000","last_active":"2023-10-08T16:22:07.761670+0000","last_peered":"2023-10-08T16:22:07.761670+0000","last_clean":"2023-10-08T16:22:07.761670+0000","last_became_active":"2023-10-08T16:22:07.757377+0000","last_became_peered":"2023-10-08T16:22:07.757377+0000","last_unstale":"2023-10-08T16:22:07.761670+0000","last_undegraded":"2023-10-08T16:22:07.761670+0000","last_fullsized":"2023-10-08T16:22:07.761670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:35.900546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.776444+0000","last_change":"2023-10-08T16:22:06.752707+0000","last_active":"2023-10-08T16:22:07.776444+0000","last_peered":"2023-10-08T16:22:07.776444+0000","last_clean":"2023-10-08T16:22:07.776444+0000","last_became_active":"2023-10-08T16:22:06.752230+0000","last_became_peered":"2023-10-08T16:22:06.752230+0000","last_unstale":"2023-10-08T16:22:07.776444+0000","last_undegraded":"2023-10-08T16:22:07.776444+0000","last_fullsized":"2023-10-08T16:22:07.776444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:34.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764367+0000","last_change":"2023-10-08T16:22:07.762634+0000","last_active":"2023-10-08T16:22:07.764367+0000","last_peered":"2023-10-08T16:22:07.764367+0000","last_clean":"2023-10-08T16:22:07.764367+0000","last_became_active":"2023-10-08T16:22:07.762340+0000","last_became_peered":"2023-10-08T16:22:07.762340+0000","last_unstale":"2023-10-08T16:22:07.764367+0000","last_undegraded":"2023-10-08T16:22:07.764367+0000","last_fullsized":"2023-10-08T16:22:07.764367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743100+0000","last_change":"2023-10-08T16:22:06.757272+0000","last_active":"2023-10-08T16:22:07.743100+0000","last_peered":"2023-10-08T16:22:07.743100+0000","last_clean":"2023-10-08T16:22:07.743100+0000","last_became_active":"2023-10-08T16:22:06.756950+0000","last_became_peered":"2023-10-08T16:22:06.756950+0000","last_unstale":"2023-10-08T16:22:07.743100+0000","last_undegraded":"2023-10-08T16:22:07.743100+0000","last_fullsized":"2023-10-08T16:22:07.743100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:37.155145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765040+0000","last_change":"2023-10-08T16:22:07.757241+0000","last_active":"2023-10-08T16:22:07.765040+0000","last_peered":"2023-10-08T16:22:07.765040+0000","last_clean":"2023-10-08T16:22:07.765040+0000","last_became_active":"2023-10-08T16:22:07.756871+0000","last_became_peered":"2023-10-08T16:22:07.756871+0000","last_unstale":"2023-10-08T16:22:07.765040+0000","last_undegraded":"2023-10-08T16:22:07.765040+0000","last_fullsized":"2023-10-08T16:22:07.765040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:16.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778838+0000","last_change":"2023-10-08T16:22:06.751189+0000","last_active":"2023-10-08T16:22:07.778838+0000","last_peered":"2023-10-08T16:22:07.778838+0000","last_clean":"2023-10-08T16:22:07.778838+0000","last_became_active":"2023-10-08T16:22:06.750938+0000","last_became_peered":"2023-10-08T16:22:06.750938+0000","last_unstale":"2023-10-08T16:22:07.778838+0000","last_undegraded":"2023-10-08T16:22:07.778838+0000","last_fullsized":"2023-10-08T16:22:07.778838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.747082+0000","last_change":"2023-10-08T16:22:07.743521+0000","last_active":"2023-10-08T16:22:07.747082+0000","last_peered":"2023-10-08T16:22:07.747082+0000","last_clean":"2023-10-08T16:22:07.747082+0000","last_became_active":"2023-10-08T16:22:07.743242+0000","last_became_peered":"2023-10-08T16:22:07.743242+0000","last_unstale":"2023-10-08T16:22:07.747082+0000","last_undegraded":"2023-10-08T16:22:07.747082+0000","last_fullsized":"2023-10-08T16:22:07.747082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:11.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.740177+0000","last_change":"2023-10-08T16:22:06.757337+0000","last_active":"2023-10-08T16:22:07.740177+0000","last_peered":"2023-10-08T16:22:07.740177+0000","last_clean":"2023-10-08T16:22:07.740177+0000","last_became_active":"2023-10-08T16:22:06.757028+0000","last_became_peered":"2023-10-08T16:22:06.757028+0000","last_unstale":"2023-10-08T16:22:07.740177+0000","last_undegraded":"2023-10-08T16:22:07.740177+0000","last_fullsized":"2023-10-08T16:22:07.740177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757689+0000","last_change":"2023-10-08T16:22:07.753369+0000","last_active":"2023-10-08T16:22:07.757689+0000","last_peered":"2023-10-08T16:22:07.757689+0000","last_clean":"2023-10-08T16:22:07.757689+0000","last_became_active":"2023-10-08T16:22:07.753039+0000","last_became_peered":"2023-10-08T16:22:07.753039+0000","last_unstale":"2023-10-08T16:22:07.757689+0000","last_undegraded":"2023-10-08T16:22:07.757689+0000","last_fullsized":"2023-10-08T16:22:07.757689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748156+0000","last_change":"2023-10-08T16:22:06.744681+0000","last_active":"2023-10-08T16:22:07.748156+0000","last_peered":"2023-10-08T16:22:07.748156+0000","last_clean":"2023-10-08T16:22:07.748156+0000","last_became_active":"2023-10-08T16:22:06.744415+0000","last_became_peered":"2023-10-08T16:22:06.744415+0000","last_unstale":"2023-10-08T16:22:07.748156+0000","last_undegraded":"2023-10-08T16:22:07.748156+0000","last_fullsized":"2023-10-08T16:22:07.748156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:42.103131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764647+0000","last_change":"2023-10-08T16:22:07.760720+0000","last_active":"2023-10-08T16:22:07.764647+0000","last_peered":"2023-10-08T16:22:07.764647+0000","last_clean":"2023-10-08T16:22:07.764647+0000","last_became_active":"2023-10-08T16:22:07.760449+0000","last_became_peered":"2023-10-08T16:22:07.760449+0000","last_unstale":"2023-10-08T16:22:07.764647+0000","last_undegraded":"2023-10-08T16:22:07.764647+0000","last_fullsized":"2023-10-08T16:22:07.764647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:15.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744073+0000","last_change":"2023-10-08T16:22:06.749253+0000","last_active":"2023-10-08T16:22:07.744073+0000","last_peered":"2023-10-08T16:22:07.744073+0000","last_clean":"2023-10-08T16:22:07.744073+0000","last_became_active":"2023-10-08T16:22:06.748919+0000","last_became_peered":"2023-10-08T16:22:06.748919+0000","last_unstale":"2023-10-08T16:22:07.744073+0000","last_undegraded":"2023-10-08T16:22:07.744073+0000","last_fullsized":"2023-10-08T16:22:07.744073+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:14.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769256+0000","last_change":"2023-10-08T16:22:07.767868+0000","last_active":"2023-10-08T16:22:07.769256+0000","last_peered":"2023-10-08T16:22:07.769256+0000","last_clean":"2023-10-08T16:22:07.769256+0000","last_became_active":"2023-10-08T16:22:07.767242+0000","last_became_peered":"2023-10-08T16:22:07.767242+0000","last_unstale":"2023-10-08T16:22:07.769256+0000","last_undegraded":"2023-10-08T16:22:07.769256+0000","last_fullsized":"2023-10-08T16:22:07.769256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.746196+0000","last_change":"2023-10-08T16:22:06.751649+0000","last_active":"2023-10-08T16:22:07.746196+0000","last_peered":"2023-10-08T16:22:07.746196+0000","last_clean":"2023-10-08T16:22:07.746196+0000","last_became_active":"2023-10-08T16:22:06.751384+0000","last_became_peered":"2023-10-08T16:22:06.751384+0000","last_unstale":"2023-10-08T16:22:07.746196+0000","last_undegraded":"2023-10-08T16:22:07.746196+0000","last_fullsized":"2023-10-08T16:22:07.746196+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764542+0000","last_change":"2023-10-08T16:22:07.758165+0000","last_active":"2023-10-08T16:22:07.764542+0000","last_peered":"2023-10-08T16:22:07.764542+0000","last_clean":"2023-10-08T16:22:07.764542+0000","last_became_active":"2023-10-08T16:22:07.756570+0000","last_became_peered":"2023-10-08T16:22:07.756570+0000","last_unstale":"2023-10-08T16:22:07.764542+0000","last_undegraded":"2023-10-08T16:22:07.764542+0000","last_fullsized":"2023-10-08T16:22:07.764542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:24.013156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.745547+0000","last_change":"2023-10-08T16:22:06.756940+0000","last_active":"2023-10-08T16:22:07.745547+0000","last_peered":"2023-10-08T16:22:07.745547+0000","last_clean":"2023-10-08T16:22:07.745547+0000","last_became_active":"2023-10-08T16:22:06.756599+0000","last_became_peered":"2023-10-08T16:22:06.756599+0000","last_unstale":"2023-10-08T16:22:07.745547+0000","last_undegraded":"2023-10-08T16:22:07.745547+0000","last_fullsized":"2023-10-08T16:22:07.745547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762589+0000","last_change":"2023-10-08T16:22:07.760751+0000","last_active":"2023-10-08T16:22:07.762589+0000","last_peered":"2023-10-08T16:22:07.762589+0000","last_clean":"2023-10-08T16:22:07.762589+0000","last_became_active":"2023-10-08T16:22:07.760474+0000","last_became_peered":"2023-10-08T16:22:07.760474+0000","last_unstale":"2023-10-08T16:22:07.762589+0000","last_undegraded":"2023-10-08T16:22:07.762589+0000","last_fullsized":"2023-10-08T16:22:07.762589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:03.213562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737504+0000","last_change":"2023-10-08T16:22:06.753864+0000","last_active":"2023-10-08T16:22:07.737504+0000","last_peered":"2023-10-08T16:22:07.737504+0000","last_clean":"2023-10-08T16:22:07.737504+0000","last_became_active":"2023-10-08T16:22:06.753562+0000","last_became_peered":"2023-10-08T16:22:06.753562+0000","last_unstale":"2023-10-08T16:22:07.737504+0000","last_undegraded":"2023-10-08T16:22:07.737504+0000","last_fullsized":"2023-10-08T16:22:07.737504+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765058+0000","last_change":"2023-10-08T16:22:07.759697+0000","last_active":"2023-10-08T16:22:07.765058+0000","last_peered":"2023-10-08T16:22:07.765058+0000","last_clean":"2023-10-08T16:22:07.765058+0000","last_became_active":"2023-10-08T16:22:07.757100+0000","last_became_peered":"2023-10-08T16:22:07.757100+0000","last_unstale":"2023-10-08T16:22:07.765058+0000","last_undegraded":"2023-10-08T16:22:07.765058+0000","last_fullsized":"2023-10-08T16:22:07.765058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:02.407878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744173+0000","last_change":"2023-10-08T16:22:06.758349+0000","last_active":"2023-10-08T16:22:07.744173+0000","last_peered":"2023-10-08T16:22:07.744173+0000","last_clean":"2023-10-08T16:22:07.744173+0000","last_became_active":"2023-10-08T16:22:06.758073+0000","last_became_peered":"2023-10-08T16:22:06.758073+0000","last_unstale":"2023-10-08T16:22:07.744173+0000","last_undegraded":"2023-10-08T16:22:07.744173+0000","last_fullsized":"2023-10-08T16:22:07.744173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765143+0000","last_change":"2023-10-08T16:22:07.758872+0000","last_active":"2023-10-08T16:22:07.765143+0000","last_peered":"2023-10-08T16:22:07.765143+0000","last_clean":"2023-10-08T16:22:07.765143+0000","last_became_active":"2023-10-08T16:22:07.758629+0000","last_became_peered":"2023-10-08T16:22:07.758629+0000","last_unstale":"2023-10-08T16:22:07.765143+0000","last_undegraded":"2023-10-08T16:22:07.765143+0000","last_fullsized":"2023-10-08T16:22:07.765143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:33.524423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.740414+0000","last_change":"2023-10-08T16:22:06.748980+0000","last_active":"2023-10-08T16:22:07.740414+0000","last_peered":"2023-10-08T16:22:07.740414+0000","last_clean":"2023-10-08T16:22:07.740414+0000","last_became_active":"2023-10-08T16:22:06.748697+0000","last_became_peered":"2023-10-08T16:22:06.748697+0000","last_unstale":"2023-10-08T16:22:07.740414+0000","last_undegraded":"2023-10-08T16:22:07.740414+0000","last_fullsized":"2023-10-08T16:22:07.740414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763440+0000","last_change":"2023-10-08T16:22:07.760193+0000","last_active":"2023-10-08T16:22:07.763440+0000","last_peered":"2023-10-08T16:22:07.763440+0000","last_clean":"2023-10-08T16:22:07.763440+0000","last_became_active":"2023-10-08T16:22:07.759882+0000","last_became_peered":"2023-10-08T16:22:07.759882+0000","last_unstale":"2023-10-08T16:22:07.763440+0000","last_undegraded":"2023-10-08T16:22:07.763440+0000","last_fullsized":"2023-10-08T16:22:07.763440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737566+0000","last_change":"2023-10-08T16:22:06.757296+0000","last_active":"2023-10-08T16:22:07.737566+0000","last_peered":"2023-10-08T16:22:07.737566+0000","last_clean":"2023-10-08T16:22:07.737566+0000","last_became_active":"2023-10-08T16:22:06.757040+0000","last_became_peered":"2023-10-08T16:22:06.757040+0000","last_unstale":"2023-10-08T16:22:07.737566+0000","last_undegraded":"2023-10-08T16:22:07.737566+0000","last_fullsized":"2023-10-08T16:22:07.737566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.756063+0000","last_change":"2023-10-08T16:22:07.752832+0000","last_active":"2023-10-08T16:22:07.756063+0000","last_peered":"2023-10-08T16:22:07.756063+0000","last_clean":"2023-10-08T16:22:07.756063+0000","last_became_active":"2023-10-08T16:22:07.752574+0000","last_became_peered":"2023-10-08T16:22:07.752574+0000","last_unstale":"2023-10-08T16:22:07.756063+0000","last_undegraded":"2023-10-08T16:22:07.756063+0000","last_fullsized":"2023-10-08T16:22:07.756063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748936+0000","last_change":"2023-10-08T16:22:06.751787+0000","last_active":"2023-10-08T16:22:07.748936+0000","last_peered":"2023-10-08T16:22:07.748936+0000","last_clean":"2023-10-08T16:22:07.748936+0000","last_became_active":"2023-10-08T16:22:06.751514+0000","last_became_peered":"2023-10-08T16:22:06.751514+0000","last_unstale":"2023-10-08T16:22:07.748936+0000","last_undegraded":"2023-10-08T16:22:07.748936+0000","last_fullsized":"2023-10-08T16:22:07.748936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764839+0000","last_change":"2023-10-08T16:22:07.759404+0000","last_active":"2023-10-08T16:22:07.764839+0000","last_peered":"2023-10-08T16:22:07.764839+0000","last_clean":"2023-10-08T16:22:07.764839+0000","last_became_active":"2023-10-08T16:22:07.759138+0000","last_became_peered":"2023-10-08T16:22:07.759138+0000","last_unstale":"2023-10-08T16:22:07.764839+0000","last_undegraded":"2023-10-08T16:22:07.764839+0000","last_fullsized":"2023-10-08T16:22:07.764839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779615+0000","last_change":"2023-10-08T16:22:06.751434+0000","last_active":"2023-10-08T16:22:07.779615+0000","last_peered":"2023-10-08T16:22:07.779615+0000","last_clean":"2023-10-08T16:22:07.779615+0000","last_became_active":"2023-10-08T16:22:06.751148+0000","last_became_peered":"2023-10-08T16:22:06.751148+0000","last_unstale":"2023-10-08T16:22:07.779615+0000","last_undegraded":"2023-10-08T16:22:07.779615+0000","last_fullsized":"2023-10-08T16:22:07.779615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":285,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744181+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:22:07.744181+0000","last_peered":"2023-10-08T16:22:07.744181+0000","last_clean":"2023-10-08T16:22:07.744181+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:22:07.744181+0000","last_undegraded":"2023-10-08T16:22:07.744181+0000","last_fullsized":"2023-10-08T16:22:07.744181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306856,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064984,"statfs":{"total":96636764160,"available":96322543616,"internally_reserved":0,"allocated":1409024,"data_stored":973051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.103,"15min":1.103},"last":0.627},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.99199999999999999,"15min":1.089},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.41299999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.997,"5min":0.997,"15min":1.1160000000000001},"last":0.65400000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98099999999999998},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.05,"15min":1.1000000000000001},"last":0.56000000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":5.5590000000000002},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.234},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.3919999999999999},"last":0.47399999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.432,"15min":0.40600000000000003},"max":{"1min":0.97299999999999998,"5min":1.101,"15min":1.3680000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.4319999999999999},"last":0.57599999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.014,"15min":1.323},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98699999999999999,"5min":1,"15min":1.448},"last":0.67600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":383237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.995,"15min":1.125},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1,"5min":1.0429999999999999,"15min":1.0600000000000001},"last":0.433}]},{"osd":1,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94299999999999995,"5min":1.0369999999999999,"15min":1.365},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":1.004,"15min":1.0549999999999999},"last":0.41899999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.58299999999999996,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.038,"5min":1.0700000000000001,"15min":1.552},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.4570000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.069},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.497},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.619},"last":0.57299999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0249999999999999,"15min":1.0389999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73099999999999998,"15min":0.77400000000000002},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.5900000000000001},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64700000000000002,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.0109999999999999,"15min":1.1240000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":0.91600000000000004,"5min":0.98099999999999998,"15min":1.0600000000000001},"last":0.82999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0569999999999999,"15min":1.222},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":0.94199999999999995,"5min":1.073,"15min":1.3080000000000001},"last":0.64300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":0.873},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.38100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.498,"5min":0.498,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":0.95199999999999996,"15min":1.472},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.66100000000000003,"5min":0.56200000000000006,"15min":0.45500000000000002},"max":{"1min":1.0129999999999999,"5min":1.0669999999999999,"15min":1.373},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":1.2230000000000001,"15min":1.375},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.046,"5min":1.157,"15min":1.276},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83899999999999997,"15min":0.80500000000000005},"min":{"1min":0.64300000000000002,"5min":0.63300000000000001,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.107,"15min":1.224},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.206,"15min":1.429},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.52200000000000002},"max":{"1min":1.0269999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.67700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.1839999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.302,"15min":1.514},"last":0.97599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":972995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.498},"min":{"1min":0.38,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.65700000000000003,"5min":0.88800000000000001,"15min":1.524},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":1.679},"last":0.45200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.82799999999999996,"15min":1.5569999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.33800000000000002},"max":{"1min":0.60399999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.371},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.84999999999999998,"5min":0.872,"15min":1.2470000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.40300000000000002},"max":{"1min":1.018,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.135,"15min":1.325},"last":0.622}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83299999999999996,"15min":0.80100000000000005},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":0.98599999999999999,"5min":1.1439999999999999,"15min":1.153},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":0.96399999999999997,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.57699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.52900000000000003},"max":{"1min":0.97999999999999998,"5min":1.1950000000000001,"15min":1.288},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.59599999999999997,"15min":0.51600000000000001},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.262},"last":0.68700000000000006}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.012,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.501},"max":{"1min":1.03,"5min":1.202,"15min":1.4079999999999999},"last":0.52400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":827392,"data_stored":384151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64300000000000002,"5min":1.046,"15min":1.046},"last":0.436},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.68999999999999995,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.40699999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60899999999999999,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.497},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78100000000000003,"5min":1.1160000000000001,"15min":1.448},"last":0.53100000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88500000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0169999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"max":{"1min":1.0429999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.79100000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":0.97899999999999998,"5min":1.321,"15min":1.3959999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.84199999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":0.875},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59299999999999997},"max":{"1min":0.95999999999999996,"5min":1.4410000000000001,"15min":1.734},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.286,"15min":1.655},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306284,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065556,"statfs":{"total":96636764160,"available":96323129344,"internally_reserved":0,"allocated":823296,"data_stored":383203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.66600000000000004,"15min":0.83899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.89200000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.92700000000000005,"15min":0.93000000000000005},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.2869999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0620000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85799999999999998,"15min":0.83699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.55600000000000005},"max":{"1min":1.153,"5min":1.23,"15min":1.306},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.1950000000000001,"15min":1.321},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":384129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.36599999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.751,"15min":0.745},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.92500000000000004,"5min":1.071,"15min":1.071},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.379},"max":{"1min":1.032,"5min":1.032,"15min":1.28},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.872},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.94999999999999996,"5min":1.1060000000000001,"15min":1.216},"last":0.81899999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":1.1339999999999999,"15min":1.1479999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.49299999999999999},"max":{"1min":0.86899999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.84799999999999998,"5min":0.995,"15min":1.381},"last":0.624},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97099999999999997,"15min":1.2769999999999999},"last":0.76400000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.497,"5min":0.434,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.89100000000000001,"15min":1.002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.0409999999999999,"15min":1.6839999999999999},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.78100000000000003},"min":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.5169999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.304},"last":0.90500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306276,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065564,"statfs":{"total":96636764160,"available":96323137536,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.0669999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":1.022,"15min":1.079},"last":0.72199999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0089999999999999,"5min":1.05,"15min":1.05},"last":0.78800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.0389999999999999,"15min":1.121},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.012},"last":0.81799999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.071,"15min":1.4770000000000001},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.625},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.095},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":0.91300000000000003,"5min":1.056,"15min":1.5389999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.012,"15min":1.522},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70699999999999996},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.204},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":2.1309999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76400000000000001,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.038,"5min":1.0429999999999999,"15min":1.9890000000000001},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:22:16.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:22:16.705 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:22:17.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:22:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.232+0000 7fe8c339d700 1 Processor -- start 2023-10-08T16:22:17.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.232+0000 7fe8c339d700 1 -- start start 2023-10-08T16:22:17.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c339d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c339d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8bc0cf110 0x7fe8bc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c339d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8bc15afd0 con 0x7fe8bc15de50 2023-10-08T16:22:17.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c339d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8bc15b2b0 con 0x7fe8bc0cf110 2023-10-08T16:22:17.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c339d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc15b590 con 0x7fe8bc153c30 2023-10-08T16:22:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c1b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe8bc15de50 0x7fe8bc0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40900/0 (socket says 172.21.15.12:40900) 2023-10-08T16:22:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.233+0000 7fe8c2b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8bc0cf110 0x7fe8bc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c1b9a700 1 -- 172.21.15.12:0/3503111186 learned_addr learned my addr 172.21.15.12:0/3503111186 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:17.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c239b700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c1399700 1 -- 172.21.15.12:0/3503111186 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575718930 0 0) 0x7fe8bc15afd0 con 0x7fe8bc15de50 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/3503111186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 msgr2=0x7fe8bc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c2b9c700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/3503111186 >> v1:172.21.15.12:6789/0 conn(0x7fe8bc15de50 legacy=0x7fe8bc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/3503111186 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8bc15b870 con 0x7fe8bc0cf110 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c2b9c700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc15c070 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009e60 tx=0x7fe8b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b11cc8f4ed3a1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.234+0000 7fe8c1399700 1 -- 172.21.15.12:0/3503111186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400e070 con 0x7fe8bc0cf110 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c1399700 1 -- 172.21.15.12:0/3503111186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400bc30 con 0x7fe8bc0cf110 2023-10-08T16:22:17.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c1399700 1 -- 172.21.15.12:0/3503111186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4012430 con 0x7fe8bc0cf110 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 -- 172.21.15.12:0/3503111186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc0cf110 msgr2=0x7fe8bc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc15c070 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009e60 tx=0x7fe8b4009780 comp rx=0 tx=0).stop 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 -- 172.21.15.12:0/3503111186 shutdown_connections 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc15c070 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 --2- 172.21.15.12:0/3503111186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 -- 172.21.15.12:0/3503111186 >> 172.21.15.12:0/3503111186 conn(0x7fe8bc0703a0 msgr2=0x7fe8bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 -- 172.21.15.12:0/3503111186 shutdown_connections 2023-10-08T16:22:17.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.235+0000 7fe8c339d700 1 -- 172.21.15.12:0/3503111186 wait complete. 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.237+0000 7fe8c339d700 1 Processor -- start 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.237+0000 7fe8c339d700 1 -- start start 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cbec0 con 0x7fe8bc15de50 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cb2b0 con 0x7fe8bc0cf110 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c339d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8bc0cb590 con 0x7fe8bc153c30 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45112/0 (socket says 172.21.15.12:45112) 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/725231857 learned_addr learned my addr 172.21.15.12:0/725231857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 msgr2=0x7fe8bc151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8bc0cf110 msgr2=0x7fe8bc0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.238+0000 7fe8c2b9c700 1 -- 172.21.15.12:0/725231857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009a20 con 0x7fe8bc15de50 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8c2b9c700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4013000 tx=0x7fe8b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4012e50 con 0x7fe8bc15de50 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b401d630 con 0x7fe8bc15de50 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b401da10 con 0x7fe8bc15de50 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8bc0cb870 con 0x7fe8bc15de50 2023-10-08T16:22:17.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.239+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8bc152390 con 0x7fe8bc15de50 2023-10-08T16:22:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.240+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8bc04c3c0 con 0x7fe8bc15de50 2023-10-08T16:22:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.241+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8b4024070 con 0x7fe8bc15de50 2023-10-08T16:22:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.242+0000 7fe8b27fc700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 0x7fe8a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.242+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fe8b4086f60 con 0x7fe8bc15de50 2023-10-08T16:22:17.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.242+0000 7fe8c239b700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 0x7fe8a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.243+0000 7fe8c239b700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 0x7fe8a00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009a60 tx=0x7fe8b8008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.247+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8b4053fc0 con 0x7fe8bc15de50 2023-10-08T16:22:17.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.445+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8bc0cc000 con 0x7fe8a0066f30 2023-10-08T16:22:17.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.454+0000 7fe8b27fc700 1 -- 172.21.15.12:0/725231857 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288925 (secure 0 0 0) 0x7fe8bc0cc000 con 0x7fe8a0066f30 2023-10-08T16:22:17.457 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 msgr2=0x7fe8a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 0x7fe8a00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009a60 tx=0x7fe8b8008040 comp rx=0 tx=0).stop 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 msgr2=0x7fe8bc0cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4013000 tx=0x7fe8b4019000 comp rx=0 tx=0).stop 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 shutdown_connections 2023-10-08T16:22:17.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fe8a0066f30 0x7fe8a00693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8bc15de50 0x7fe8bc0cc350 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8bc0cf110 0x7fe8bc0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 --2- 172.21.15.12:0/725231857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8bc153c30 0x7fe8bc151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 >> 172.21.15.12:0/725231857 conn(0x7fe8bc0703a0 msgr2=0x7fe8bc0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 shutdown_connections 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.458+0000 7fe8c339d700 1 -- 172.21.15.12:0/725231857 wait complete. 2023-10-08T16:22:17.461 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:22:17.475 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:22:17.165691+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430920,"kb_used_data":7560,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752543800,"statfs":{"total":773094113280,"available":770604851200,"internally_reserved":0,"allocated":7741440,"data_stored":4246092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.429808"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761372+0000","last_change":"2023-10-08T16:22:07.752311+0000","last_active":"2023-10-08T16:22:07.761372+0000","last_peered":"2023-10-08T16:22:07.761372+0000","last_clean":"2023-10-08T16:22:07.761372+0000","last_became_active":"2023-10-08T16:22:07.752029+0000","last_became_peered":"2023-10-08T16:22:07.752029+0000","last_unstale":"2023-10-08T16:22:07.761372+0000","last_undegraded":"2023-10-08T16:22:07.761372+0000","last_fullsized":"2023-10-08T16:22:07.761372+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:06:40.040536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763672+0000","last_change":"2023-10-08T16:22:07.761173+0000","last_active":"2023-10-08T16:22:07.763672+0000","last_peered":"2023-10-08T16:22:07.763672+0000","last_clean":"2023-10-08T16:22:07.763672+0000","last_became_active":"2023-10-08T16:22:07.760266+0000","last_became_peered":"2023-10-08T16:22:07.760266+0000","last_unstale":"2023-10-08T16:22:07.763672+0000","last_undegraded":"2023-10-08T16:22:07.763672+0000","last_fullsized":"2023-10-08T16:22:07.763672+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.755865+0000","last_change":"2023-10-08T16:22:07.754545+0000","last_active":"2023-10-08T16:22:07.755865+0000","last_peered":"2023-10-08T16:22:07.755865+0000","last_clean":"2023-10-08T16:22:07.755865+0000","last_became_active":"2023-10-08T16:22:07.754217+0000","last_became_peered":"2023-10-08T16:22:07.754217+0000","last_unstale":"2023-10-08T16:22:07.755865+0000","last_undegraded":"2023-10-08T16:22:07.755865+0000","last_fullsized":"2023-10-08T16:22:07.755865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764559+0000","last_change":"2023-10-08T16:22:07.758756+0000","last_active":"2023-10-08T16:22:07.764559+0000","last_peered":"2023-10-08T16:22:07.764559+0000","last_clean":"2023-10-08T16:22:07.764559+0000","last_became_active":"2023-10-08T16:22:07.758515+0000","last_became_peered":"2023-10-08T16:22:07.758515+0000","last_unstale":"2023-10-08T16:22:07.764559+0000","last_undegraded":"2023-10-08T16:22:07.764559+0000","last_fullsized":"2023-10-08T16:22:07.764559+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:28.093357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762060+0000","last_change":"2023-10-08T16:22:07.752424+0000","last_active":"2023-10-08T16:22:07.762060+0000","last_peered":"2023-10-08T16:22:07.762060+0000","last_clean":"2023-10-08T16:22:07.762060+0000","last_became_active":"2023-10-08T16:22:07.752118+0000","last_became_peered":"2023-10-08T16:22:07.752118+0000","last_unstale":"2023-10-08T16:22:07.762060+0000","last_undegraded":"2023-10-08T16:22:07.762060+0000","last_fullsized":"2023-10-08T16:22:07.762060+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.759608+0000","last_change":"2023-10-08T16:22:07.752292+0000","last_active":"2023-10-08T16:22:07.759608+0000","last_peered":"2023-10-08T16:22:07.759608+0000","last_clean":"2023-10-08T16:22:07.759608+0000","last_became_active":"2023-10-08T16:22:07.752022+0000","last_became_peered":"2023-10-08T16:22:07.752022+0000","last_unstale":"2023-10-08T16:22:07.759608+0000","last_undegraded":"2023-10-08T16:22:07.759608+0000","last_fullsized":"2023-10-08T16:22:07.759608+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:53:20.346245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763087+0000","last_change":"2023-10-08T16:22:07.759813+0000","last_active":"2023-10-08T16:22:07.763087+0000","last_peered":"2023-10-08T16:22:07.763087+0000","last_clean":"2023-10-08T16:22:07.763087+0000","last_became_active":"2023-10-08T16:22:07.759555+0000","last_became_peered":"2023-10-08T16:22:07.759555+0000","last_unstale":"2023-10-08T16:22:07.763087+0000","last_undegraded":"2023-10-08T16:22:07.763087+0000","last_fullsized":"2023-10-08T16:22:07.763087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:01:59.265208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766634+0000","last_change":"2023-10-08T16:22:07.763751+0000","last_active":"2023-10-08T16:22:07.766634+0000","last_peered":"2023-10-08T16:22:07.766634+0000","last_clean":"2023-10-08T16:22:07.766634+0000","last_became_active":"2023-10-08T16:22:07.763447+0000","last_became_peered":"2023-10-08T16:22:07.763447+0000","last_unstale":"2023-10-08T16:22:07.766634+0000","last_undegraded":"2023-10-08T16:22:07.766634+0000","last_fullsized":"2023-10-08T16:22:07.766634+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:33.626750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764588+0000","last_change":"2023-10-08T16:22:07.760102+0000","last_active":"2023-10-08T16:22:07.764588+0000","last_peered":"2023-10-08T16:22:07.764588+0000","last_clean":"2023-10-08T16:22:07.764588+0000","last_became_active":"2023-10-08T16:22:07.759849+0000","last_became_peered":"2023-10-08T16:22:07.759849+0000","last_unstale":"2023-10-08T16:22:07.764588+0000","last_undegraded":"2023-10-08T16:22:07.764588+0000","last_fullsized":"2023-10-08T16:22:07.764588+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:08.987271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764857+0000","last_change":"2023-10-08T16:22:07.759897+0000","last_active":"2023-10-08T16:22:07.764857+0000","last_peered":"2023-10-08T16:22:07.764857+0000","last_clean":"2023-10-08T16:22:07.764857+0000","last_became_active":"2023-10-08T16:22:07.759646+0000","last_became_peered":"2023-10-08T16:22:07.759646+0000","last_unstale":"2023-10-08T16:22:07.764857+0000","last_undegraded":"2023-10-08T16:22:07.764857+0000","last_fullsized":"2023-10-08T16:22:07.764857+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.312679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764496+0000","last_change":"2023-10-08T16:22:07.757527+0000","last_active":"2023-10-08T16:22:07.764496+0000","last_peered":"2023-10-08T16:22:07.764496+0000","last_clean":"2023-10-08T16:22:07.764496+0000","last_became_active":"2023-10-08T16:22:07.757256+0000","last_became_peered":"2023-10-08T16:22:07.757256+0000","last_unstale":"2023-10-08T16:22:07.764496+0000","last_undegraded":"2023-10-08T16:22:07.764496+0000","last_fullsized":"2023-10-08T16:22:07.764496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.407714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761852+0000","last_change":"2023-10-08T16:22:07.753914+0000","last_active":"2023-10-08T16:22:07.761852+0000","last_peered":"2023-10-08T16:22:07.761852+0000","last_clean":"2023-10-08T16:22:07.761852+0000","last_became_active":"2023-10-08T16:22:07.753589+0000","last_became_peered":"2023-10-08T16:22:07.753589+0000","last_unstale":"2023-10-08T16:22:07.761852+0000","last_undegraded":"2023-10-08T16:22:07.761852+0000","last_fullsized":"2023-10-08T16:22:07.761852+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:37:20.656871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767316+0000","last_change":"2023-10-08T16:22:07.764241+0000","last_active":"2023-10-08T16:22:07.767316+0000","last_peered":"2023-10-08T16:22:07.767316+0000","last_clean":"2023-10-08T16:22:07.767316+0000","last_became_active":"2023-10-08T16:22:07.763964+0000","last_became_peered":"2023-10-08T16:22:07.763964+0000","last_unstale":"2023-10-08T16:22:07.767316+0000","last_undegraded":"2023-10-08T16:22:07.767316+0000","last_fullsized":"2023-10-08T16:22:07.767316+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764613+0000","last_change":"2023-10-08T16:22:07.756830+0000","last_active":"2023-10-08T16:22:07.764613+0000","last_peered":"2023-10-08T16:22:07.764613+0000","last_clean":"2023-10-08T16:22:07.764613+0000","last_became_active":"2023-10-08T16:22:07.756549+0000","last_became_peered":"2023-10-08T16:22:07.756549+0000","last_unstale":"2023-10-08T16:22:07.764613+0000","last_undegraded":"2023-10-08T16:22:07.764613+0000","last_fullsized":"2023-10-08T16:22:07.764613+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:13.466511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.753568+0000","last_change":"2023-10-08T16:22:07.750512+0000","last_active":"2023-10-08T16:22:07.753568+0000","last_peered":"2023-10-08T16:22:07.753568+0000","last_clean":"2023-10-08T16:22:07.753568+0000","last_became_active":"2023-10-08T16:22:07.750237+0000","last_became_peered":"2023-10-08T16:22:07.750237+0000","last_unstale":"2023-10-08T16:22:07.753568+0000","last_undegraded":"2023-10-08T16:22:07.753568+0000","last_fullsized":"2023-10-08T16:22:07.753568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:07.835319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769621+0000","last_change":"2023-10-08T16:22:07.768293+0000","last_active":"2023-10-08T16:22:07.769621+0000","last_peered":"2023-10-08T16:22:07.769621+0000","last_clean":"2023-10-08T16:22:07.769621+0000","last_became_active":"2023-10-08T16:22:07.767929+0000","last_became_peered":"2023-10-08T16:22:07.767929+0000","last_unstale":"2023-10-08T16:22:07.769621+0000","last_undegraded":"2023-10-08T16:22:07.769621+0000","last_fullsized":"2023-10-08T16:22:07.769621+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.750213+0000","last_change":"2023-10-08T16:22:07.745608+0000","last_active":"2023-10-08T16:22:07.750213+0000","last_peered":"2023-10-08T16:22:07.750213+0000","last_clean":"2023-10-08T16:22:07.750213+0000","last_became_active":"2023-10-08T16:22:07.745274+0000","last_became_peered":"2023-10-08T16:22:07.745274+0000","last_unstale":"2023-10-08T16:22:07.750213+0000","last_undegraded":"2023-10-08T16:22:07.750213+0000","last_fullsized":"2023-10-08T16:22:07.750213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766444+0000","last_change":"2023-10-08T16:22:07.765650+0000","last_active":"2023-10-08T16:22:07.766444+0000","last_peered":"2023-10-08T16:22:07.766444+0000","last_clean":"2023-10-08T16:22:07.766444+0000","last_became_active":"2023-10-08T16:22:07.765345+0000","last_became_peered":"2023-10-08T16:22:07.765345+0000","last_unstale":"2023-10-08T16:22:07.766444+0000","last_undegraded":"2023-10-08T16:22:07.766444+0000","last_fullsized":"2023-10-08T16:22:07.766444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769167+0000","last_change":"2023-10-08T16:22:07.767763+0000","last_active":"2023-10-08T16:22:07.769167+0000","last_peered":"2023-10-08T16:22:07.769167+0000","last_clean":"2023-10-08T16:22:07.769167+0000","last_became_active":"2023-10-08T16:22:07.767468+0000","last_became_peered":"2023-10-08T16:22:07.767468+0000","last_unstale":"2023-10-08T16:22:07.769167+0000","last_undegraded":"2023-10-08T16:22:07.769167+0000","last_fullsized":"2023-10-08T16:22:07.769167+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757234+0000","last_change":"2023-10-08T16:22:07.753272+0000","last_active":"2023-10-08T16:22:07.757234+0000","last_peered":"2023-10-08T16:22:07.757234+0000","last_clean":"2023-10-08T16:22:07.757234+0000","last_became_active":"2023-10-08T16:22:07.752966+0000","last_became_peered":"2023-10-08T16:22:07.752966+0000","last_unstale":"2023-10-08T16:22:07.757234+0000","last_undegraded":"2023-10-08T16:22:07.757234+0000","last_fullsized":"2023-10-08T16:22:07.757234+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770865+0000","last_change":"2023-10-08T16:22:07.762024+0000","last_active":"2023-10-08T16:22:07.770865+0000","last_peered":"2023-10-08T16:22:07.770865+0000","last_clean":"2023-10-08T16:22:07.770865+0000","last_became_active":"2023-10-08T16:22:07.761772+0000","last_became_peered":"2023-10-08T16:22:07.761772+0000","last_unstale":"2023-10-08T16:22:07.770865+0000","last_undegraded":"2023-10-08T16:22:07.770865+0000","last_fullsized":"2023-10-08T16:22:07.770865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:09.885712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765325+0000","last_change":"2023-10-08T16:22:07.761449+0000","last_active":"2023-10-08T16:22:07.765325+0000","last_peered":"2023-10-08T16:22:07.765325+0000","last_clean":"2023-10-08T16:22:07.765325+0000","last_became_active":"2023-10-08T16:22:07.761173+0000","last_became_peered":"2023-10-08T16:22:07.761173+0000","last_unstale":"2023-10-08T16:22:07.765325+0000","last_undegraded":"2023-10-08T16:22:07.765325+0000","last_fullsized":"2023-10-08T16:22:07.765325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:38.161731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763772+0000","last_change":"2023-10-08T16:22:07.759147+0000","last_active":"2023-10-08T16:22:07.763772+0000","last_peered":"2023-10-08T16:22:07.763772+0000","last_clean":"2023-10-08T16:22:07.763772+0000","last_became_active":"2023-10-08T16:22:07.758887+0000","last_became_peered":"2023-10-08T16:22:07.758887+0000","last_unstale":"2023-10-08T16:22:07.763772+0000","last_undegraded":"2023-10-08T16:22:07.763772+0000","last_fullsized":"2023-10-08T16:22:07.763772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:36.226217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763164+0000","last_change":"2023-10-08T16:22:07.759699+0000","last_active":"2023-10-08T16:22:07.763164+0000","last_peered":"2023-10-08T16:22:07.763164+0000","last_clean":"2023-10-08T16:22:07.763164+0000","last_became_active":"2023-10-08T16:22:07.759428+0000","last_became_peered":"2023-10-08T16:22:07.759428+0000","last_unstale":"2023-10-08T16:22:07.763164+0000","last_undegraded":"2023-10-08T16:22:07.763164+0000","last_fullsized":"2023-10-08T16:22:07.763164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764898+0000","last_change":"2023-10-08T16:22:07.763416+0000","last_active":"2023-10-08T16:22:07.764898+0000","last_peered":"2023-10-08T16:22:07.764898+0000","last_clean":"2023-10-08T16:22:07.764898+0000","last_became_active":"2023-10-08T16:22:07.762064+0000","last_became_peered":"2023-10-08T16:22:07.762064+0000","last_unstale":"2023-10-08T16:22:07.764898+0000","last_undegraded":"2023-10-08T16:22:07.764898+0000","last_fullsized":"2023-10-08T16:22:07.764898+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:49.173133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.770557+0000","last_change":"2023-10-08T16:22:07.765513+0000","last_active":"2023-10-08T16:22:07.770557+0000","last_peered":"2023-10-08T16:22:07.770557+0000","last_clean":"2023-10-08T16:22:07.770557+0000","last_became_active":"2023-10-08T16:22:07.765132+0000","last_became_peered":"2023-10-08T16:22:07.765132+0000","last_unstale":"2023-10-08T16:22:07.770557+0000","last_undegraded":"2023-10-08T16:22:07.770557+0000","last_fullsized":"2023-10-08T16:22:07.770557+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:13.663202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744915+0000","last_change":"2023-10-08T16:22:07.744054+0000","last_active":"2023-10-08T16:22:07.744915+0000","last_peered":"2023-10-08T16:22:07.744915+0000","last_clean":"2023-10-08T16:22:07.744915+0000","last_became_active":"2023-10-08T16:22:07.743758+0000","last_became_peered":"2023-10-08T16:22:07.743758+0000","last_unstale":"2023-10-08T16:22:07.744915+0000","last_undegraded":"2023-10-08T16:22:07.744915+0000","last_fullsized":"2023-10-08T16:22:07.744915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:55.671583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761877+0000","last_change":"2023-10-08T16:22:07.755396+0000","last_active":"2023-10-08T16:22:07.761877+0000","last_peered":"2023-10-08T16:22:07.761877+0000","last_clean":"2023-10-08T16:22:07.761877+0000","last_became_active":"2023-10-08T16:22:07.755020+0000","last_became_peered":"2023-10-08T16:22:07.755020+0000","last_unstale":"2023-10-08T16:22:07.761877+0000","last_undegraded":"2023-10-08T16:22:07.761877+0000","last_fullsized":"2023-10-08T16:22:07.761877+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:05:37.842650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763524+0000","last_change":"2023-10-08T16:22:07.761040+0000","last_active":"2023-10-08T16:22:07.763524+0000","last_peered":"2023-10-08T16:22:07.763524+0000","last_clean":"2023-10-08T16:22:07.763524+0000","last_became_active":"2023-10-08T16:22:07.760745+0000","last_became_peered":"2023-10-08T16:22:07.760745+0000","last_unstale":"2023-10-08T16:22:07.763524+0000","last_undegraded":"2023-10-08T16:22:07.763524+0000","last_fullsized":"2023-10-08T16:22:07.763524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.754326+0000","last_change":"2023-10-08T16:22:07.751456+0000","last_active":"2023-10-08T16:22:07.754326+0000","last_peered":"2023-10-08T16:22:07.754326+0000","last_clean":"2023-10-08T16:22:07.754326+0000","last_became_active":"2023-10-08T16:22:07.751189+0000","last_became_peered":"2023-10-08T16:22:07.751189+0000","last_unstale":"2023-10-08T16:22:07.754326+0000","last_undegraded":"2023-10-08T16:22:07.754326+0000","last_fullsized":"2023-10-08T16:22:07.754326+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:09.760322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757793+0000","last_change":"2023-10-08T16:22:07.755753+0000","last_active":"2023-10-08T16:22:07.757793+0000","last_peered":"2023-10-08T16:22:07.757793+0000","last_clean":"2023-10-08T16:22:07.757793+0000","last_became_active":"2023-10-08T16:22:07.755364+0000","last_became_peered":"2023-10-08T16:22:07.755364+0000","last_unstale":"2023-10-08T16:22:07.757793+0000","last_undegraded":"2023-10-08T16:22:07.757793+0000","last_fullsized":"2023-10-08T16:22:07.757793+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:41.334149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.767204+0000","last_change":"2023-10-08T16:22:07.761256+0000","last_active":"2023-10-08T16:22:07.767204+0000","last_peered":"2023-10-08T16:22:07.767204+0000","last_clean":"2023-10-08T16:22:07.767204+0000","last_became_active":"2023-10-08T16:22:07.760995+0000","last_became_peered":"2023-10-08T16:22:07.760995+0000","last_unstale":"2023-10-08T16:22:07.767204+0000","last_undegraded":"2023-10-08T16:22:07.767204+0000","last_fullsized":"2023-10-08T16:22:07.767204+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760210+0000","last_change":"2023-10-08T16:22:07.758889+0000","last_active":"2023-10-08T16:22:07.760210+0000","last_peered":"2023-10-08T16:22:07.760210+0000","last_clean":"2023-10-08T16:22:07.760210+0000","last_became_active":"2023-10-08T16:22:07.758586+0000","last_became_peered":"2023-10-08T16:22:07.758586+0000","last_unstale":"2023-10-08T16:22:07.760210+0000","last_undegraded":"2023-10-08T16:22:07.760210+0000","last_fullsized":"2023-10-08T16:22:07.760210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:59.843696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"67'4","reported_seq":14,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779240+0000","last_change":"2023-10-08T16:22:06.756675+0000","last_active":"2023-10-08T16:22:07.779240+0000","last_peered":"2023-10-08T16:22:07.779240+0000","last_clean":"2023-10-08T16:22:07.779240+0000","last_became_active":"2023-10-08T16:22:06.756367+0000","last_became_peered":"2023-10-08T16:22:06.756367+0000","last_unstale":"2023-10-08T16:22:07.779240+0000","last_undegraded":"2023-10-08T16:22:07.779240+0000","last_fullsized":"2023-10-08T16:22:07.779240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761011+0000","last_change":"2023-10-08T16:22:07.758150+0000","last_active":"2023-10-08T16:22:07.761011+0000","last_peered":"2023-10-08T16:22:07.761011+0000","last_clean":"2023-10-08T16:22:07.761011+0000","last_became_active":"2023-10-08T16:22:07.757850+0000","last_became_peered":"2023-10-08T16:22:07.757850+0000","last_unstale":"2023-10-08T16:22:07.761011+0000","last_undegraded":"2023-10-08T16:22:07.761011+0000","last_fullsized":"2023-10-08T16:22:07.761011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:20:55.671583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778758+0000","last_change":"2023-10-08T16:22:06.757008+0000","last_active":"2023-10-08T16:22:07.778758+0000","last_peered":"2023-10-08T16:22:07.778758+0000","last_clean":"2023-10-08T16:22:07.778758+0000","last_became_active":"2023-10-08T16:22:06.756705+0000","last_became_peered":"2023-10-08T16:22:06.756705+0000","last_unstale":"2023-10-08T16:22:07.778758+0000","last_undegraded":"2023-10-08T16:22:07.778758+0000","last_fullsized":"2023-10-08T16:22:07.778758+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:58.837110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.755202+0000","last_change":"2023-10-08T16:22:07.750997+0000","last_active":"2023-10-08T16:22:07.755202+0000","last_peered":"2023-10-08T16:22:07.755202+0000","last_clean":"2023-10-08T16:22:07.755202+0000","last_became_active":"2023-10-08T16:22:07.750651+0000","last_became_peered":"2023-10-08T16:22:07.750651+0000","last_unstale":"2023-10-08T16:22:07.755202+0000","last_undegraded":"2023-10-08T16:22:07.755202+0000","last_fullsized":"2023-10-08T16:22:07.755202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.774313+0000","last_change":"2023-10-08T16:22:06.754215+0000","last_active":"2023-10-08T16:22:07.774313+0000","last_peered":"2023-10-08T16:22:07.774313+0000","last_clean":"2023-10-08T16:22:07.774313+0000","last_became_active":"2023-10-08T16:22:06.753791+0000","last_became_peered":"2023-10-08T16:22:06.753791+0000","last_unstale":"2023-10-08T16:22:07.774313+0000","last_undegraded":"2023-10-08T16:22:07.774313+0000","last_fullsized":"2023-10-08T16:22:07.774313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:51:34.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.760979+0000","last_change":"2023-10-08T16:22:07.759986+0000","last_active":"2023-10-08T16:22:07.760979+0000","last_peered":"2023-10-08T16:22:07.760979+0000","last_clean":"2023-10-08T16:22:07.760979+0000","last_became_active":"2023-10-08T16:22:07.759691+0000","last_became_peered":"2023-10-08T16:22:07.759691+0000","last_unstale":"2023-10-08T16:22:07.760979+0000","last_undegraded":"2023-10-08T16:22:07.760979+0000","last_fullsized":"2023-10-08T16:22:07.760979+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:11:34.572274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777723+0000","last_change":"2023-10-08T16:22:06.749271+0000","last_active":"2023-10-08T16:22:07.777723+0000","last_peered":"2023-10-08T16:22:07.777723+0000","last_clean":"2023-10-08T16:22:07.777723+0000","last_became_active":"2023-10-08T16:22:06.748949+0000","last_became_peered":"2023-10-08T16:22:06.748949+0000","last_unstale":"2023-10-08T16:22:07.777723+0000","last_undegraded":"2023-10-08T16:22:07.777723+0000","last_fullsized":"2023-10-08T16:22:07.777723+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761283+0000","last_change":"2023-10-08T16:22:07.760036+0000","last_active":"2023-10-08T16:22:07.761283+0000","last_peered":"2023-10-08T16:22:07.761283+0000","last_clean":"2023-10-08T16:22:07.761283+0000","last_became_active":"2023-10-08T16:22:07.759735+0000","last_became_peered":"2023-10-08T16:22:07.759735+0000","last_unstale":"2023-10-08T16:22:07.761283+0000","last_undegraded":"2023-10-08T16:22:07.761283+0000","last_fullsized":"2023-10-08T16:22:07.761283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778229+0000","last_change":"2023-10-08T16:22:06.751312+0000","last_active":"2023-10-08T16:22:07.778229+0000","last_peered":"2023-10-08T16:22:07.778229+0000","last_clean":"2023-10-08T16:22:07.778229+0000","last_became_active":"2023-10-08T16:22:06.751047+0000","last_became_peered":"2023-10-08T16:22:06.751047+0000","last_unstale":"2023-10-08T16:22:07.778229+0000","last_undegraded":"2023-10-08T16:22:07.778229+0000","last_fullsized":"2023-10-08T16:22:07.778229+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764951+0000","last_change":"2023-10-08T16:22:07.758292+0000","last_active":"2023-10-08T16:22:07.764951+0000","last_peered":"2023-10-08T16:22:07.764951+0000","last_clean":"2023-10-08T16:22:07.764951+0000","last_became_active":"2023-10-08T16:22:07.758005+0000","last_became_peered":"2023-10-08T16:22:07.758005+0000","last_unstale":"2023-10-08T16:22:07.764951+0000","last_undegraded":"2023-10-08T16:22:07.764951+0000","last_fullsized":"2023-10-08T16:22:07.764951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:57.243118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777905+0000","last_change":"2023-10-08T16:22:06.754872+0000","last_active":"2023-10-08T16:22:07.777905+0000","last_peered":"2023-10-08T16:22:07.777905+0000","last_clean":"2023-10-08T16:22:07.777905+0000","last_became_active":"2023-10-08T16:22:06.754581+0000","last_became_peered":"2023-10-08T16:22:06.754581+0000","last_unstale":"2023-10-08T16:22:07.777905+0000","last_undegraded":"2023-10-08T16:22:07.777905+0000","last_fullsized":"2023-10-08T16:22:07.777905+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766652+0000","last_change":"2023-10-08T16:22:07.763807+0000","last_active":"2023-10-08T16:22:07.766652+0000","last_peered":"2023-10-08T16:22:07.766652+0000","last_clean":"2023-10-08T16:22:07.766652+0000","last_became_active":"2023-10-08T16:22:07.761035+0000","last_became_peered":"2023-10-08T16:22:07.761035+0000","last_unstale":"2023-10-08T16:22:07.766652+0000","last_undegraded":"2023-10-08T16:22:07.766652+0000","last_fullsized":"2023-10-08T16:22:07.766652+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:45.098848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.739465+0000","last_change":"2023-10-08T16:22:06.751843+0000","last_active":"2023-10-08T16:22:07.739465+0000","last_peered":"2023-10-08T16:22:07.739465+0000","last_clean":"2023-10-08T16:22:07.739465+0000","last_became_active":"2023-10-08T16:22:06.751468+0000","last_became_peered":"2023-10-08T16:22:06.751468+0000","last_unstale":"2023-10-08T16:22:07.739465+0000","last_undegraded":"2023-10-08T16:22:07.739465+0000","last_fullsized":"2023-10-08T16:22:07.739465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:21.649959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762905+0000","last_change":"2023-10-08T16:22:07.758404+0000","last_active":"2023-10-08T16:22:07.762905+0000","last_peered":"2023-10-08T16:22:07.762905+0000","last_clean":"2023-10-08T16:22:07.762905+0000","last_became_active":"2023-10-08T16:22:07.758125+0000","last_became_peered":"2023-10-08T16:22:07.758125+0000","last_unstale":"2023-10-08T16:22:07.762905+0000","last_undegraded":"2023-10-08T16:22:07.762905+0000","last_fullsized":"2023-10-08T16:22:07.762905+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:43.109717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749042+0000","last_change":"2023-10-08T16:22:06.748984+0000","last_active":"2023-10-08T16:22:07.749042+0000","last_peered":"2023-10-08T16:22:07.749042+0000","last_clean":"2023-10-08T16:22:07.749042+0000","last_became_active":"2023-10-08T16:22:06.748582+0000","last_became_peered":"2023-10-08T16:22:06.748582+0000","last_unstale":"2023-10-08T16:22:07.749042+0000","last_undegraded":"2023-10-08T16:22:07.749042+0000","last_fullsized":"2023-10-08T16:22:07.749042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:20.846032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.766455+0000","last_change":"2023-10-08T16:22:07.765780+0000","last_active":"2023-10-08T16:22:07.766455+0000","last_peered":"2023-10-08T16:22:07.766455+0000","last_clean":"2023-10-08T16:22:07.766455+0000","last_became_active":"2023-10-08T16:22:07.765455+0000","last_became_peered":"2023-10-08T16:22:07.765455+0000","last_unstale":"2023-10-08T16:22:07.766455+0000","last_undegraded":"2023-10-08T16:22:07.766455+0000","last_fullsized":"2023-10-08T16:22:07.766455+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.739213+0000","last_change":"2023-10-08T16:22:06.750209+0000","last_active":"2023-10-08T16:22:07.739213+0000","last_peered":"2023-10-08T16:22:07.739213+0000","last_clean":"2023-10-08T16:22:07.739213+0000","last_became_active":"2023-10-08T16:22:06.749911+0000","last_became_peered":"2023-10-08T16:22:06.749911+0000","last_unstale":"2023-10-08T16:22:07.739213+0000","last_undegraded":"2023-10-08T16:22:07.739213+0000","last_fullsized":"2023-10-08T16:22:07.739213+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761393+0000","last_change":"2023-10-08T16:22:07.756369+0000","last_active":"2023-10-08T16:22:07.761393+0000","last_peered":"2023-10-08T16:22:07.761393+0000","last_clean":"2023-10-08T16:22:07.761393+0000","last_became_active":"2023-10-08T16:22:07.756100+0000","last_became_peered":"2023-10-08T16:22:07.756100+0000","last_unstale":"2023-10-08T16:22:07.761393+0000","last_undegraded":"2023-10-08T16:22:07.761393+0000","last_fullsized":"2023-10-08T16:22:07.761393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:31:14.268045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.749030+0000","last_change":"2023-10-08T16:22:06.744862+0000","last_active":"2023-10-08T16:22:07.749030+0000","last_peered":"2023-10-08T16:22:07.749030+0000","last_clean":"2023-10-08T16:22:07.749030+0000","last_became_active":"2023-10-08T16:22:06.744599+0000","last_became_peered":"2023-10-08T16:22:06.744599+0000","last_unstale":"2023-10-08T16:22:07.749030+0000","last_undegraded":"2023-10-08T16:22:07.749030+0000","last_fullsized":"2023-10-08T16:22:07.749030+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:35.219631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765126+0000","last_change":"2023-10-08T16:22:07.759240+0000","last_active":"2023-10-08T16:22:07.765126+0000","last_peered":"2023-10-08T16:22:07.765126+0000","last_clean":"2023-10-08T16:22:07.765126+0000","last_became_active":"2023-10-08T16:22:07.758975+0000","last_became_peered":"2023-10-08T16:22:07.758975+0000","last_unstale":"2023-10-08T16:22:07.765126+0000","last_undegraded":"2023-10-08T16:22:07.765126+0000","last_fullsized":"2023-10-08T16:22:07.765126+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:02.150111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"67'3","reported_seq":13,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778857+0000","last_change":"2023-10-08T16:22:06.757675+0000","last_active":"2023-10-08T16:22:07.778857+0000","last_peered":"2023-10-08T16:22:07.778857+0000","last_clean":"2023-10-08T16:22:07.778857+0000","last_became_active":"2023-10-08T16:22:06.757404+0000","last_became_peered":"2023-10-08T16:22:06.757404+0000","last_unstale":"2023-10-08T16:22:07.778857+0000","last_undegraded":"2023-10-08T16:22:07.778857+0000","last_fullsized":"2023-10-08T16:22:07.778857+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:12.137043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762323+0000","last_change":"2023-10-08T16:22:07.759189+0000","last_active":"2023-10-08T16:22:07.762323+0000","last_peered":"2023-10-08T16:22:07.762323+0000","last_clean":"2023-10-08T16:22:07.762323+0000","last_became_active":"2023-10-08T16:22:07.758933+0000","last_became_peered":"2023-10-08T16:22:07.758933+0000","last_unstale":"2023-10-08T16:22:07.762323+0000","last_undegraded":"2023-10-08T16:22:07.762323+0000","last_fullsized":"2023-10-08T16:22:07.762323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:58:03.259617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"67'6","reported_seq":16,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.780562+0000","last_change":"2023-10-08T16:22:06.752726+0000","last_active":"2023-10-08T16:22:07.780562+0000","last_peered":"2023-10-08T16:22:07.780562+0000","last_clean":"2023-10-08T16:22:07.780562+0000","last_became_active":"2023-10-08T16:22:06.752376+0000","last_became_peered":"2023-10-08T16:22:06.752376+0000","last_unstale":"2023-10-08T16:22:07.780562+0000","last_undegraded":"2023-10-08T16:22:07.780562+0000","last_fullsized":"2023-10-08T16:22:07.780562+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:40.836860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769211+0000","last_change":"2023-10-08T16:22:07.767737+0000","last_active":"2023-10-08T16:22:07.769211+0000","last_peered":"2023-10-08T16:22:07.769211+0000","last_clean":"2023-10-08T16:22:07.769211+0000","last_became_active":"2023-10-08T16:22:07.767295+0000","last_became_peered":"2023-10-08T16:22:07.767295+0000","last_unstale":"2023-10-08T16:22:07.769211+0000","last_undegraded":"2023-10-08T16:22:07.769211+0000","last_fullsized":"2023-10-08T16:22:07.769211+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:52:09.760322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779396+0000","last_change":"2023-10-08T16:22:06.754410+0000","last_active":"2023-10-08T16:22:07.779396+0000","last_peered":"2023-10-08T16:22:07.779396+0000","last_clean":"2023-10-08T16:22:07.779396+0000","last_became_active":"2023-10-08T16:22:06.753839+0000","last_became_peered":"2023-10-08T16:22:06.753839+0000","last_unstale":"2023-10-08T16:22:07.779396+0000","last_undegraded":"2023-10-08T16:22:07.779396+0000","last_fullsized":"2023-10-08T16:22:07.779396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:56.236532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762251+0000","last_change":"2023-10-08T16:22:07.749665+0000","last_active":"2023-10-08T16:22:07.762251+0000","last_peered":"2023-10-08T16:22:07.762251+0000","last_clean":"2023-10-08T16:22:07.762251+0000","last_became_active":"2023-10-08T16:22:07.749419+0000","last_became_peered":"2023-10-08T16:22:07.749419+0000","last_unstale":"2023-10-08T16:22:07.762251+0000","last_undegraded":"2023-10-08T16:22:07.762251+0000","last_fullsized":"2023-10-08T16:22:07.762251+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:32:54.684827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744524+0000","last_change":"2023-10-08T16:22:06.748078+0000","last_active":"2023-10-08T16:22:07.744524+0000","last_peered":"2023-10-08T16:22:07.744524+0000","last_clean":"2023-10-08T16:22:07.744524+0000","last_became_active":"2023-10-08T16:22:06.747724+0000","last_became_peered":"2023-10-08T16:22:06.747724+0000","last_unstale":"2023-10-08T16:22:07.744524+0000","last_undegraded":"2023-10-08T16:22:07.744524+0000","last_fullsized":"2023-10-08T16:22:07.744524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:38:12.459924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765000+0000","last_change":"2023-10-08T16:22:07.757922+0000","last_active":"2023-10-08T16:22:07.765000+0000","last_peered":"2023-10-08T16:22:07.765000+0000","last_clean":"2023-10-08T16:22:07.765000+0000","last_became_active":"2023-10-08T16:22:07.757672+0000","last_became_peered":"2023-10-08T16:22:07.757672+0000","last_unstale":"2023-10-08T16:22:07.765000+0000","last_undegraded":"2023-10-08T16:22:07.765000+0000","last_fullsized":"2023-10-08T16:22:07.765000+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:50.830616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743546+0000","last_change":"2023-10-08T16:22:06.750046+0000","last_active":"2023-10-08T16:22:07.743546+0000","last_peered":"2023-10-08T16:22:07.743546+0000","last_clean":"2023-10-08T16:22:07.743546+0000","last_became_active":"2023-10-08T16:22:06.749762+0000","last_became_peered":"2023-10-08T16:22:06.749762+0000","last_unstale":"2023-10-08T16:22:07.743546+0000","last_undegraded":"2023-10-08T16:22:07.743546+0000","last_fullsized":"2023-10-08T16:22:07.743546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:27.086771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762268+0000","last_change":"2023-10-08T16:22:07.758348+0000","last_active":"2023-10-08T16:22:07.762268+0000","last_peered":"2023-10-08T16:22:07.762268+0000","last_clean":"2023-10-08T16:22:07.762268+0000","last_became_active":"2023-10-08T16:22:07.758017+0000","last_became_peered":"2023-10-08T16:22:07.758017+0000","last_unstale":"2023-10-08T16:22:07.762268+0000","last_undegraded":"2023-10-08T16:22:07.762268+0000","last_fullsized":"2023-10-08T16:22:07.762268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:39:36.899810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"67'8","reported_seq":18,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779040+0000","last_change":"2023-10-08T16:22:06.748832+0000","last_active":"2023-10-08T16:22:07.779040+0000","last_peered":"2023-10-08T16:22:07.779040+0000","last_clean":"2023-10-08T16:22:07.779040+0000","last_became_active":"2023-10-08T16:22:06.748243+0000","last_became_peered":"2023-10-08T16:22:06.748243+0000","last_unstale":"2023-10-08T16:22:07.779040+0000","last_undegraded":"2023-10-08T16:22:07.779040+0000","last_fullsized":"2023-10-08T16:22:07.779040+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757181+0000","last_change":"2023-10-08T16:22:07.753126+0000","last_active":"2023-10-08T16:22:07.757181+0000","last_peered":"2023-10-08T16:22:07.757181+0000","last_clean":"2023-10-08T16:22:07.757181+0000","last_became_active":"2023-10-08T16:22:07.752761+0000","last_became_peered":"2023-10-08T16:22:07.752761+0000","last_unstale":"2023-10-08T16:22:07.757181+0000","last_undegraded":"2023-10-08T16:22:07.757181+0000","last_fullsized":"2023-10-08T16:22:07.757181+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:23:47.367401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.775396+0000","last_change":"2023-10-08T16:22:06.754333+0000","last_active":"2023-10-08T16:22:07.775396+0000","last_peered":"2023-10-08T16:22:07.775396+0000","last_clean":"2023-10-08T16:22:07.775396+0000","last_became_active":"2023-10-08T16:22:06.754015+0000","last_became_peered":"2023-10-08T16:22:06.754015+0000","last_unstale":"2023-10-08T16:22:07.775396+0000","last_undegraded":"2023-10-08T16:22:07.775396+0000","last_fullsized":"2023-10-08T16:22:07.775396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:27:24.501162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764706+0000","last_change":"2023-10-08T16:22:07.761350+0000","last_active":"2023-10-08T16:22:07.764706+0000","last_peered":"2023-10-08T16:22:07.764706+0000","last_clean":"2023-10-08T16:22:07.764706+0000","last_became_active":"2023-10-08T16:22:07.761049+0000","last_became_peered":"2023-10-08T16:22:07.761049+0000","last_unstale":"2023-10-08T16:22:07.764706+0000","last_undegraded":"2023-10-08T16:22:07.764706+0000","last_fullsized":"2023-10-08T16:22:07.764706+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:13.143629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.777767+0000","last_change":"2023-10-08T16:22:06.750281+0000","last_active":"2023-10-08T16:22:07.777767+0000","last_peered":"2023-10-08T16:22:07.777767+0000","last_clean":"2023-10-08T16:22:07.777767+0000","last_became_active":"2023-10-08T16:22:06.749973+0000","last_became_peered":"2023-10-08T16:22:06.749973+0000","last_unstale":"2023-10-08T16:22:07.777767+0000","last_undegraded":"2023-10-08T16:22:07.777767+0000","last_fullsized":"2023-10-08T16:22:07.777767+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:29.245456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.761670+0000","last_change":"2023-10-08T16:22:07.757974+0000","last_active":"2023-10-08T16:22:07.761670+0000","last_peered":"2023-10-08T16:22:07.761670+0000","last_clean":"2023-10-08T16:22:07.761670+0000","last_became_active":"2023-10-08T16:22:07.757377+0000","last_became_peered":"2023-10-08T16:22:07.757377+0000","last_unstale":"2023-10-08T16:22:07.761670+0000","last_undegraded":"2023-10-08T16:22:07.761670+0000","last_fullsized":"2023-10-08T16:22:07.761670+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:35.900546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"67'1","reported_seq":11,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.776444+0000","last_change":"2023-10-08T16:22:06.752707+0000","last_active":"2023-10-08T16:22:07.776444+0000","last_peered":"2023-10-08T16:22:07.776444+0000","last_clean":"2023-10-08T16:22:07.776444+0000","last_became_active":"2023-10-08T16:22:06.752230+0000","last_became_peered":"2023-10-08T16:22:06.752230+0000","last_unstale":"2023-10-08T16:22:07.776444+0000","last_undegraded":"2023-10-08T16:22:07.776444+0000","last_fullsized":"2023-10-08T16:22:07.776444+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:34.893960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764367+0000","last_change":"2023-10-08T16:22:07.762634+0000","last_active":"2023-10-08T16:22:07.764367+0000","last_peered":"2023-10-08T16:22:07.764367+0000","last_clean":"2023-10-08T16:22:07.764367+0000","last_became_active":"2023-10-08T16:22:07.762340+0000","last_became_peered":"2023-10-08T16:22:07.762340+0000","last_unstale":"2023-10-08T16:22:07.764367+0000","last_undegraded":"2023-10-08T16:22:07.764367+0000","last_fullsized":"2023-10-08T16:22:07.764367+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:25.950778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.743100+0000","last_change":"2023-10-08T16:22:06.757272+0000","last_active":"2023-10-08T16:22:07.743100+0000","last_peered":"2023-10-08T16:22:07.743100+0000","last_clean":"2023-10-08T16:22:07.743100+0000","last_became_active":"2023-10-08T16:22:06.756950+0000","last_became_peered":"2023-10-08T16:22:06.756950+0000","last_unstale":"2023-10-08T16:22:07.743100+0000","last_undegraded":"2023-10-08T16:22:07.743100+0000","last_fullsized":"2023-10-08T16:22:07.743100+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:37.155145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765040+0000","last_change":"2023-10-08T16:22:07.757241+0000","last_active":"2023-10-08T16:22:07.765040+0000","last_peered":"2023-10-08T16:22:07.765040+0000","last_clean":"2023-10-08T16:22:07.765040+0000","last_became_active":"2023-10-08T16:22:07.756871+0000","last_became_peered":"2023-10-08T16:22:07.756871+0000","last_unstale":"2023-10-08T16:22:07.765040+0000","last_undegraded":"2023-10-08T16:22:07.765040+0000","last_fullsized":"2023-10-08T16:22:07.765040+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:16.124618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.778838+0000","last_change":"2023-10-08T16:22:06.751189+0000","last_active":"2023-10-08T16:22:07.778838+0000","last_peered":"2023-10-08T16:22:07.778838+0000","last_clean":"2023-10-08T16:22:07.778838+0000","last_became_active":"2023-10-08T16:22:06.750938+0000","last_became_peered":"2023-10-08T16:22:06.750938+0000","last_unstale":"2023-10-08T16:22:07.778838+0000","last_undegraded":"2023-10-08T16:22:07.778838+0000","last_fullsized":"2023-10-08T16:22:07.778838+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.747082+0000","last_change":"2023-10-08T16:22:07.743521+0000","last_active":"2023-10-08T16:22:07.747082+0000","last_peered":"2023-10-08T16:22:07.747082+0000","last_clean":"2023-10-08T16:22:07.747082+0000","last_became_active":"2023-10-08T16:22:07.743242+0000","last_became_peered":"2023-10-08T16:22:07.743242+0000","last_unstale":"2023-10-08T16:22:07.747082+0000","last_undegraded":"2023-10-08T16:22:07.747082+0000","last_fullsized":"2023-10-08T16:22:07.747082+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:02:11.462001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.740177+0000","last_change":"2023-10-08T16:22:06.757337+0000","last_active":"2023-10-08T16:22:07.740177+0000","last_peered":"2023-10-08T16:22:07.740177+0000","last_clean":"2023-10-08T16:22:07.740177+0000","last_became_active":"2023-10-08T16:22:06.757028+0000","last_became_peered":"2023-10-08T16:22:06.757028+0000","last_unstale":"2023-10-08T16:22:07.740177+0000","last_undegraded":"2023-10-08T16:22:07.740177+0000","last_fullsized":"2023-10-08T16:22:07.740177+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:20.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.757689+0000","last_change":"2023-10-08T16:22:07.753369+0000","last_active":"2023-10-08T16:22:07.757689+0000","last_peered":"2023-10-08T16:22:07.757689+0000","last_clean":"2023-10-08T16:22:07.757689+0000","last_became_active":"2023-10-08T16:22:07.753039+0000","last_became_peered":"2023-10-08T16:22:07.753039+0000","last_unstale":"2023-10-08T16:22:07.757689+0000","last_undegraded":"2023-10-08T16:22:07.757689+0000","last_fullsized":"2023-10-08T16:22:07.757689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:37:21.852618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748156+0000","last_change":"2023-10-08T16:22:06.744681+0000","last_active":"2023-10-08T16:22:07.748156+0000","last_peered":"2023-10-08T16:22:07.748156+0000","last_clean":"2023-10-08T16:22:07.748156+0000","last_became_active":"2023-10-08T16:22:06.744415+0000","last_became_peered":"2023-10-08T16:22:06.744415+0000","last_unstale":"2023-10-08T16:22:07.748156+0000","last_undegraded":"2023-10-08T16:22:07.748156+0000","last_fullsized":"2023-10-08T16:22:07.748156+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:42:42.103131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764647+0000","last_change":"2023-10-08T16:22:07.760720+0000","last_active":"2023-10-08T16:22:07.764647+0000","last_peered":"2023-10-08T16:22:07.764647+0000","last_clean":"2023-10-08T16:22:07.764647+0000","last_became_active":"2023-10-08T16:22:07.760449+0000","last_became_peered":"2023-10-08T16:22:07.760449+0000","last_unstale":"2023-10-08T16:22:07.764647+0000","last_undegraded":"2023-10-08T16:22:07.764647+0000","last_fullsized":"2023-10-08T16:22:07.764647+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:15.869680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744073+0000","last_change":"2023-10-08T16:22:06.749253+0000","last_active":"2023-10-08T16:22:07.744073+0000","last_peered":"2023-10-08T16:22:07.744073+0000","last_clean":"2023-10-08T16:22:07.744073+0000","last_became_active":"2023-10-08T16:22:06.748919+0000","last_became_peered":"2023-10-08T16:22:06.748919+0000","last_unstale":"2023-10-08T16:22:07.744073+0000","last_undegraded":"2023-10-08T16:22:07.744073+0000","last_fullsized":"2023-10-08T16:22:07.744073+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:14.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.769256+0000","last_change":"2023-10-08T16:22:07.767868+0000","last_active":"2023-10-08T16:22:07.769256+0000","last_peered":"2023-10-08T16:22:07.769256+0000","last_clean":"2023-10-08T16:22:07.769256+0000","last_became_active":"2023-10-08T16:22:07.767242+0000","last_became_peered":"2023-10-08T16:22:07.767242+0000","last_unstale":"2023-10-08T16:22:07.769256+0000","last_undegraded":"2023-10-08T16:22:07.769256+0000","last_fullsized":"2023-10-08T16:22:07.769256+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"68'1","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-10-08T16:22:09.060240+0000","last_change":"2023-10-08T16:22:06.751649+0000","last_active":"2023-10-08T16:22:09.060240+0000","last_peered":"2023-10-08T16:22:09.060240+0000","last_clean":"2023-10-08T16:22:09.060240+0000","last_became_active":"2023-10-08T16:22:06.751384+0000","last_became_peered":"2023-10-08T16:22:06.751384+0000","last_unstale":"2023-10-08T16:22:09.060240+0000","last_undegraded":"2023-10-08T16:22:09.060240+0000","last_fullsized":"2023-10-08T16:22:09.060240+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.401128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764542+0000","last_change":"2023-10-08T16:22:07.758165+0000","last_active":"2023-10-08T16:22:07.764542+0000","last_peered":"2023-10-08T16:22:07.764542+0000","last_clean":"2023-10-08T16:22:07.764542+0000","last_became_active":"2023-10-08T16:22:07.756570+0000","last_became_peered":"2023-10-08T16:22:07.756570+0000","last_unstale":"2023-10-08T16:22:07.764542+0000","last_undegraded":"2023-10-08T16:22:07.764542+0000","last_fullsized":"2023-10-08T16:22:07.764542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:24.013156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.745547+0000","last_change":"2023-10-08T16:22:06.756940+0000","last_active":"2023-10-08T16:22:07.745547+0000","last_peered":"2023-10-08T16:22:07.745547+0000","last_clean":"2023-10-08T16:22:07.745547+0000","last_became_active":"2023-10-08T16:22:06.756599+0000","last_became_peered":"2023-10-08T16:22:06.756599+0000","last_unstale":"2023-10-08T16:22:07.745547+0000","last_undegraded":"2023-10-08T16:22:07.745547+0000","last_fullsized":"2023-10-08T16:22:07.745547+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.306092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.762589+0000","last_change":"2023-10-08T16:22:07.760751+0000","last_active":"2023-10-08T16:22:07.762589+0000","last_peered":"2023-10-08T16:22:07.762589+0000","last_clean":"2023-10-08T16:22:07.762589+0000","last_became_active":"2023-10-08T16:22:07.760474+0000","last_became_peered":"2023-10-08T16:22:07.760474+0000","last_unstale":"2023-10-08T16:22:07.762589+0000","last_undegraded":"2023-10-08T16:22:07.762589+0000","last_fullsized":"2023-10-08T16:22:07.762589+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:03.213562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737504+0000","last_change":"2023-10-08T16:22:06.753864+0000","last_active":"2023-10-08T16:22:07.737504+0000","last_peered":"2023-10-08T16:22:07.737504+0000","last_clean":"2023-10-08T16:22:07.737504+0000","last_became_active":"2023-10-08T16:22:06.753562+0000","last_became_peered":"2023-10-08T16:22:06.753562+0000","last_unstale":"2023-10-08T16:22:07.737504+0000","last_undegraded":"2023-10-08T16:22:07.737504+0000","last_fullsized":"2023-10-08T16:22:07.737504+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:59:14.494203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765058+0000","last_change":"2023-10-08T16:22:07.759697+0000","last_active":"2023-10-08T16:22:07.765058+0000","last_peered":"2023-10-08T16:22:07.765058+0000","last_clean":"2023-10-08T16:22:07.765058+0000","last_became_active":"2023-10-08T16:22:07.757100+0000","last_became_peered":"2023-10-08T16:22:07.757100+0000","last_unstale":"2023-10-08T16:22:07.765058+0000","last_undegraded":"2023-10-08T16:22:07.765058+0000","last_fullsized":"2023-10-08T16:22:07.765058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:21:02.407878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744173+0000","last_change":"2023-10-08T16:22:06.758349+0000","last_active":"2023-10-08T16:22:07.744173+0000","last_peered":"2023-10-08T16:22:07.744173+0000","last_clean":"2023-10-08T16:22:07.744173+0000","last_became_active":"2023-10-08T16:22:06.758073+0000","last_became_peered":"2023-10-08T16:22:06.758073+0000","last_unstale":"2023-10-08T16:22:07.744173+0000","last_undegraded":"2023-10-08T16:22:07.744173+0000","last_fullsized":"2023-10-08T16:22:07.744173+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:27:07.980684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.765143+0000","last_change":"2023-10-08T16:22:07.758872+0000","last_active":"2023-10-08T16:22:07.765143+0000","last_peered":"2023-10-08T16:22:07.765143+0000","last_clean":"2023-10-08T16:22:07.765143+0000","last_became_active":"2023-10-08T16:22:07.758629+0000","last_became_peered":"2023-10-08T16:22:07.758629+0000","last_unstale":"2023-10-08T16:22:07.765143+0000","last_undegraded":"2023-10-08T16:22:07.765143+0000","last_fullsized":"2023-10-08T16:22:07.765143+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:04:33.524423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.740414+0000","last_change":"2023-10-08T16:22:06.748980+0000","last_active":"2023-10-08T16:22:07.740414+0000","last_peered":"2023-10-08T16:22:07.740414+0000","last_clean":"2023-10-08T16:22:07.740414+0000","last_became_active":"2023-10-08T16:22:06.748697+0000","last_became_peered":"2023-10-08T16:22:06.748697+0000","last_unstale":"2023-10-08T16:22:07.740414+0000","last_undegraded":"2023-10-08T16:22:07.740414+0000","last_fullsized":"2023-10-08T16:22:07.740414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:20:50.114057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.763440+0000","last_change":"2023-10-08T16:22:07.760193+0000","last_active":"2023-10-08T16:22:07.763440+0000","last_peered":"2023-10-08T16:22:07.763440+0000","last_clean":"2023-10-08T16:22:07.763440+0000","last_became_active":"2023-10-08T16:22:07.759882+0000","last_became_peered":"2023-10-08T16:22:07.759882+0000","last_unstale":"2023-10-08T16:22:07.763440+0000","last_undegraded":"2023-10-08T16:22:07.763440+0000","last_fullsized":"2023-10-08T16:22:07.763440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:13:05.920402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.737566+0000","last_change":"2023-10-08T16:22:06.757296+0000","last_active":"2023-10-08T16:22:07.737566+0000","last_peered":"2023-10-08T16:22:07.737566+0000","last_clean":"2023-10-08T16:22:07.737566+0000","last_became_active":"2023-10-08T16:22:06.757040+0000","last_became_peered":"2023-10-08T16:22:06.757040+0000","last_unstale":"2023-10-08T16:22:07.737566+0000","last_undegraded":"2023-10-08T16:22:07.737566+0000","last_fullsized":"2023-10-08T16:22:07.737566+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:52.923912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.756063+0000","last_change":"2023-10-08T16:22:07.752832+0000","last_active":"2023-10-08T16:22:07.756063+0000","last_peered":"2023-10-08T16:22:07.756063+0000","last_clean":"2023-10-08T16:22:07.756063+0000","last_became_active":"2023-10-08T16:22:07.752574+0000","last_became_peered":"2023-10-08T16:22:07.752574+0000","last_unstale":"2023-10-08T16:22:07.756063+0000","last_undegraded":"2023-10-08T16:22:07.756063+0000","last_fullsized":"2023-10-08T16:22:07.756063+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:40.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.748936+0000","last_change":"2023-10-08T16:22:06.751787+0000","last_active":"2023-10-08T16:22:07.748936+0000","last_peered":"2023-10-08T16:22:07.748936+0000","last_clean":"2023-10-08T16:22:07.748936+0000","last_became_active":"2023-10-08T16:22:06.751514+0000","last_became_peered":"2023-10-08T16:22:06.751514+0000","last_unstale":"2023-10-08T16:22:07.748936+0000","last_undegraded":"2023-10-08T16:22:07.748936+0000","last_fullsized":"2023-10-08T16:22:07.748936+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.764839+0000","last_change":"2023-10-08T16:22:07.759404+0000","last_active":"2023-10-08T16:22:07.764839+0000","last_peered":"2023-10-08T16:22:07.764839+0000","last_clean":"2023-10-08T16:22:07.764839+0000","last_became_active":"2023-10-08T16:22:07.759138+0000","last_became_peered":"2023-10-08T16:22:07.759138+0000","last_unstale":"2023-10-08T16:22:07.764839+0000","last_undegraded":"2023-10-08T16:22:07.764839+0000","last_fullsized":"2023-10-08T16:22:07.764839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:06.726086+0000","last_clean_scrub_stamp":"2023-10-08T16:22:06.726086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:39:15.296196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"67'2","reported_seq":12,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.779615+0000","last_change":"2023-10-08T16:22:06.751434+0000","last_active":"2023-10-08T16:22:07.779615+0000","last_peered":"2023-10-08T16:22:07.779615+0000","last_clean":"2023-10-08T16:22:07.779615+0000","last_became_active":"2023-10-08T16:22:06.751148+0000","last_became_peered":"2023-10-08T16:22:06.751148+0000","last_unstale":"2023-10-08T16:22:07.779615+0000","last_undegraded":"2023-10-08T16:22:07.779615+0000","last_fullsized":"2023-10-08T16:22:07.779615+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:22:05.719499+0000","last_clean_scrub_stamp":"2023-10-08T16:22:05.719499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:12.656615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"57'139","reported_seq":285,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-10-08T16:22:07.744181+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:22:07.744181+0000","last_peered":"2023-10-08T16:22:07.744181+0000","last_clean":"2023-10-08T16:22:07.744181+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:22:07.744181+0000","last_undegraded":"2023-10-08T16:22:07.744181+0000","last_fullsized":"2023-10-08T16:22:07.744181+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306856,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064984,"statfs":{"total":96636764160,"available":96322543616,"internally_reserved":0,"allocated":1409024,"data_stored":973051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72899999999999998,"15min":0.72499999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.95499999999999996,"5min":1.103,"15min":1.103},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73199999999999998,"15min":0.72699999999999998},"min":{"1min":0.52200000000000002,"5min":0.45500000000000002,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.99199999999999999,"15min":1.089},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.79900000000000004,"15min":0.77500000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.41299999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.997,"5min":0.997,"15min":1.1160000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.90000000000000002,"5min":0.96299999999999997,"15min":0.98099999999999998},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.57399999999999995,"5min":0.51800000000000002,"15min":0.51300000000000001},"max":{"1min":0.97099999999999997,"5min":1.05,"15min":1.1000000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.74099999999999999,"15min":0.73599999999999999},"min":{"1min":0.56299999999999994,"5min":0.52400000000000002,"15min":0.48499999999999999},"max":{"1min":0.95199999999999996,"5min":0.95599999999999996,"15min":1.006},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.48199999999999998},"max":{"1min":1.0209999999999999,"5min":1.0780000000000001,"15min":5.5590000000000002},"last":0.622}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.40699999999999997,"5min":0.39500000000000002,"15min":0.38700000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.234},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65500000000000003,"15min":0.68600000000000005},"min":{"1min":0.50800000000000001,"5min":0.45100000000000001,"15min":0.437},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":1.3919999999999999},"last":0.76000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.68500000000000005,"15min":0.71299999999999997},"min":{"1min":0.496,"5min":0.432,"15min":0.40600000000000003},"max":{"1min":0.97299999999999998,"5min":1.101,"15min":1.3680000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70199999999999996,"15min":0.73999999999999999},"min":{"1min":0.499,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.4319999999999999},"last":0.745}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.47099999999999997,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.014,"15min":1.323},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72999999999999998,"15min":0.76200000000000001},"min":{"1min":0.54500000000000004,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98699999999999999,"5min":1,"15min":1.448},"last":0.81299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306280,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065560,"statfs":{"total":96636764160,"available":96323133440,"internally_reserved":0,"allocated":819200,"data_stored":383237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.72599999999999998,"15min":0.71699999999999997},"min":{"1min":0.54500000000000004,"5min":0.433,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.995,"15min":1.125},"last":0.626},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.71999999999999997},"min":{"1min":0.41399999999999998,"5min":0.40200000000000002,"15min":0.375},"max":{"1min":1,"5min":1.0429999999999999,"15min":1.0600000000000001},"last":0.40100000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.94299999999999995,"5min":1.0369999999999999,"15min":1.365},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.51000000000000001,"5min":0.45800000000000002,"15min":0.379},"max":{"1min":0.92000000000000004,"5min":1.004,"15min":1.0549999999999999},"last":0.69399999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79500000000000004,"15min":0.77400000000000002},"min":{"1min":0.58299999999999996,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.038,"5min":1.0700000000000001,"15min":1.552},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78100000000000003},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.98699999999999999,"5min":1.0069999999999999,"15min":1.4570000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.069},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77100000000000002,"15min":0.78500000000000003},"min":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.497},"max":{"1min":0.97099999999999997,"5min":1.0209999999999999,"15min":1.619},"last":0.54900000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.65200000000000002,"15min":0.66900000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.92000000000000004,"5min":1.0249999999999999,"15min":1.0389999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73099999999999998,"15min":0.77400000000000002},"min":{"1min":0.5,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.5900000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.64700000000000002,"15min":0.67600000000000005},"min":{"1min":0.438,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90300000000000002,"5min":1.0109999999999999,"15min":1.1240000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69699999999999995,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.42999999999999999},"max":{"1min":0.91600000000000004,"5min":0.98099999999999998,"15min":1.0600000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:21:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71099999999999997,"15min":0.745},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.42399999999999999},"max":{"1min":0.96999999999999997,"5min":1.0569999999999999,"15min":1.222},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.75800000000000001},"min":{"1min":0.48799999999999999,"5min":0.48599999999999999,"15min":0.45100000000000001},"max":{"1min":0.94199999999999995,"5min":1.073,"15min":1.3080000000000001},"last":0.83799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302180,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069660,"statfs":{"total":96636764160,"available":96327331840,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47899999999999998,"15min":0.45300000000000001},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.27700000000000002},"max":{"1min":0.75600000000000001,"5min":0.873,"15min":0.873},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.50700000000000001,"15min":0.497},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.317},"max":{"1min":0.80700000000000005,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.82199999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49399999999999999,"15min":0.47999999999999998},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27800000000000002},"max":{"1min":0.66100000000000003,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59699999999999998,"15min":0.58099999999999996},"min":{"1min":0.44,"5min":0.41899999999999998,"15min":0.38100000000000001},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.65500000000000003,"15min":0.624},"min":{"1min":0.498,"5min":0.498,"15min":0.42099999999999999},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59999999999999998,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.372,"15min":0.33700000000000002},"max":{"1min":0.71899999999999997,"5min":0.95199999999999996,"15min":1.472},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79500000000000004,"15min":0.77300000000000002},"min":{"1min":0.66100000000000003,"5min":0.56200000000000006,"15min":0.45500000000000002},"max":{"1min":1.0129999999999999,"5min":1.0669999999999999,"15min":1.373},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.56399999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.98999999999999999,"5min":1.2230000000000001,"15min":1.375},"last":0.79800000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80100000000000005,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.48999999999999999},"max":{"1min":1.046,"5min":1.157,"15min":1.276},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83899999999999997,"15min":0.80500000000000005},"min":{"1min":0.64300000000000002,"5min":0.63300000000000001,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.107,"15min":1.224},"last":0.71899999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.83799999999999997,"15min":0.81799999999999995},"min":{"1min":0.60799999999999998,"5min":0.54900000000000004,"15min":0.52300000000000002},"max":{"1min":1.01,"5min":1.206,"15min":1.429},"last":0.745},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82799999999999996,"15min":0.81200000000000006},"min":{"1min":0.63,"5min":0.55800000000000005,"15min":0.52200000000000002},"max":{"1min":1.0269999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.86699999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:21:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.67700000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.0249999999999999,"5min":1.0900000000000001,"15min":1.1839999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85499999999999998,"15min":0.84199999999999997},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0960000000000001,"5min":1.302,"15min":1.514},"last":0.86199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298664,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073176,"statfs":{"total":96636764160,"available":96330932224,"internally_reserved":0,"allocated":1409024,"data_stored":972995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.505,"15min":0.498},"min":{"1min":0.38,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.65700000000000003,"5min":0.88800000000000001,"15min":1.524},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.57599999999999996,"15min":0.57299999999999995},"min":{"1min":0.44900000000000001,"5min":0.39100000000000001,"15min":0.36199999999999999},"max":{"1min":0.81100000000000005,"5min":0.86699999999999999,"15min":1.679},"last":0.63900000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.377,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.72899999999999998,"5min":0.82799999999999996,"15min":1.5569999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.39200000000000002,"5min":0.35399999999999998,"15min":0.33800000000000002},"max":{"1min":0.60399999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":1.371},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64700000000000002,"15min":0.64000000000000001},"min":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.42899999999999999},"max":{"1min":0.84999999999999998,"5min":0.872,"15min":1.2470000000000001},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.77800000000000002,"15min":0.77500000000000002},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.40300000000000002},"max":{"1min":1.018,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.82199999999999995,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.55300000000000005,"15min":0.46400000000000002},"max":{"1min":0.996,"5min":1.135,"15min":1.325},"last":0.81499999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.83299999999999996,"15min":0.80100000000000005},"min":{"1min":0.67900000000000005,"5min":0.57399999999999995,"15min":0.47899999999999998},"max":{"1min":0.98599999999999999,"5min":1.1439999999999999,"15min":1.153},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.81499999999999995},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"max":{"1min":0.96399999999999997,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.83699999999999997,"15min":0.82799999999999996},"min":{"1min":0.66900000000000004,"5min":0.57699999999999996,"15min":0.52900000000000003},"max":{"1min":0.97999999999999998,"5min":1.1950000000000001,"15min":1.288},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84299999999999997,"15min":0.82899999999999996},"min":{"1min":0.66100000000000003,"5min":0.59599999999999997,"15min":0.51600000000000001},"max":{"1min":0.94499999999999995,"5min":1.212,"15min":1.262},"last":0.95299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.85199999999999998,"15min":0.83699999999999997},"min":{"1min":0.60099999999999998,"5min":0.59699999999999998,"15min":0.55000000000000004},"max":{"1min":1.012,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.84099999999999997,"15min":0.82499999999999996},"min":{"1min":0.67900000000000005,"5min":0.61299999999999999,"15min":0.501},"max":{"1min":1.03,"5min":1.202,"15min":1.4079999999999999},"last":0.84299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":827392,"data_stored":384151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.47599999999999998,"15min":0.48399999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64300000000000002,"5min":1.046,"15min":1.046},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44900000000000001,"5min":0.41999999999999998,"15min":0.377},"max":{"1min":0.68999999999999995,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52500000000000002,"15min":0.53700000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.60899999999999999,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52800000000000002,"15min":0.53100000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.61499999999999999,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.41099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.53800000000000003},"min":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.34300000000000003},"max":{"1min":0.77200000000000002,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.63500000000000001,"15min":0.64900000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.78100000000000003,"5min":1.1160000000000001,"15min":1.448},"last":0.47199999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.96199999999999997,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.88500000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.85399999999999998,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0169999999999999,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.81499999999999995,"15min":0.84399999999999997},"min":{"1min":0.56399999999999995,"5min":0.54000000000000004,"15min":0.53300000000000003},"max":{"1min":1.0429999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":0.97899999999999998,"5min":1.321,"15min":1.3959999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83399999999999996,"15min":0.84199999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95799999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.96099999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:21:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.85599999999999998,"15min":0.875},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.59299999999999997},"max":{"1min":0.95999999999999996,"5min":1.4410000000000001,"15min":1.734},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.87,"15min":0.89200000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.98399999999999999,"5min":1.286,"15min":1.655},"last":0.747}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306284,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065556,"statfs":{"total":96636764160,"available":96323129344,"internally_reserved":0,"allocated":823296,"data_stored":383203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.46100000000000002},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.28399999999999997},"max":{"1min":0.628,"5min":0.66600000000000004,"15min":0.83899999999999997},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51800000000000002,"15min":0.51100000000000001},"min":{"1min":0.40000000000000002,"5min":0.33500000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.89200000000000002,"15min":0.90200000000000002},"last":0.36899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.47199999999999998},"min":{"1min":0.31900000000000001,"5min":0.27300000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73299999999999998,"5min":0.879,"15min":0.879},"last":0.41699999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.626,"15min":0.60499999999999998},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.38500000000000001},"max":{"1min":0.89800000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66200000000000003,"15min":0.64400000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.39800000000000002},"max":{"1min":0.878,"5min":0.92700000000000005,"15min":0.93000000000000005},"last":0.71899999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.749},"min":{"1min":0.50700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.78700000000000003},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0760000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80600000000000005,"15min":0.79400000000000004},"min":{"1min":0.57199999999999995,"5min":0.53900000000000003,"15min":0.51100000000000001},"max":{"1min":1.1319999999999999,"5min":1.2110000000000001,"15min":1.2869999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78900000000000003,"15min":0.78800000000000003},"min":{"1min":0.52400000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.093,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.48799999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.0620000000000001,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.85799999999999998,"15min":0.83699999999999997},"min":{"1min":0.60499999999999998,"5min":0.56499999999999995,"15min":0.51900000000000002},"max":{"1min":1.1799999999999999,"5min":1.397,"15min":1.397},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:21:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.86399999999999999,"15min":0.85699999999999998},"min":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.55600000000000005},"max":{"1min":1.153,"5min":1.23,"15min":1.306},"last":0.745},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54000000000000004},"max":{"1min":1.103,"5min":1.1950000000000001,"15min":1.321},"last":0.71299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298092,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073748,"statfs":{"total":96636764160,"available":96331517952,"internally_reserved":0,"allocated":823296,"data_stored":384129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72999999999999998,"15min":0.70399999999999996},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.71599999999999997,"15min":0.72699999999999998},"min":{"1min":0.48599999999999999,"5min":0.436,"15min":0.36599999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.61599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.751,"15min":0.745},"min":{"1min":0.55000000000000004,"5min":0.436,"15min":0.436},"max":{"1min":0.92500000000000004,"5min":1.071,"15min":1.071},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.745,"15min":0.73199999999999998},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.379},"max":{"1min":1.032,"5min":1.032,"15min":1.28},"last":0.59199999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.749,"15min":0.73699999999999999},"min":{"1min":0.57099999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.96799999999999997,"15min":0.98999999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.57699999999999996,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":0.94999999999999996,"5min":1.1060000000000001,"15min":1.216},"last":0.55300000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.995,"5min":1.1339999999999999,"15min":1.1479999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.753,"15min":0.72499999999999998},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.49299999999999999},"max":{"1min":0.86899999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.625,"15min":0.64200000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40699999999999997},"max":{"1min":0.84799999999999998,"5min":0.995,"15min":1.381},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.66000000000000003,"15min":0.70299999999999996},"min":{"1min":0.46400000000000002,"5min":0.44800000000000001,"15min":0.42999999999999999},"max":{"1min":0.92700000000000005,"5min":0.97099999999999997,"15min":1.2769999999999999},"last":0.68000000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.63600000000000001},"min":{"1min":0.497,"5min":0.434,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.89100000000000001,"15min":1.002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71399999999999997,"15min":0.74099999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.878,"5min":1.0409999999999999,"15min":1.6839999999999999},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:21:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74299999999999999,"15min":0.78100000000000003},"min":{"1min":0.52800000000000002,"5min":0.51400000000000001,"15min":0.497},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.5169999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.53800000000000003,"5min":0.502,"15min":0.502},"max":{"1min":0.82699999999999996,"5min":0.98499999999999999,"15min":1.304},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306276,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065564,"statfs":{"total":96636764160,"available":96323137536,"internally_reserved":0,"allocated":815104,"data_stored":382663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72299999999999998,"15min":0.70299999999999996},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.0669999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.73199999999999998,"15min":0.72599999999999998},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":0.97399999999999998,"5min":1.022,"15min":1.079},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.76300000000000001,"15min":0.748},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0089999999999999,"5min":1.05,"15min":1.05},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.57499999999999996,"5min":0.49399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97599999999999998,"5min":1.0389999999999999,"15min":1.121},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.52100000000000002,"15min":0.48399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.012},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.74399999999999999,"15min":0.75800000000000001},"min":{"1min":0.59299999999999997,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.3360000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77800000000000002,"15min":0.78400000000000003},"min":{"1min":0.57999999999999996,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.042,"5min":1.071,"15min":1.4770000000000001},"last":0.77200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57799999999999996,"15min":0.625},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":1.095},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.65800000000000003,"15min":0.69499999999999995},"min":{"1min":0.48599999999999999,"5min":0.442,"15min":0.38800000000000001},"max":{"1min":0.91300000000000003,"5min":1.056,"15min":1.5389999999999999},"last":0.75}]},{"osd":6,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.70899999999999996},"min":{"1min":0.47999999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.995,"5min":1.012,"15min":1.522},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.66800000000000004,"15min":0.70699999999999996},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.204},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:21:28 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73199999999999998,"15min":0.77800000000000002},"min":{"1min":0.52400000000000002,"5min":0.443,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0269999999999999,"15min":2.1309999999999998},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.76400000000000001,"15min":0.79300000000000004},"min":{"1min":0.56599999999999995,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.038,"5min":1.0429999999999999,"15min":1.9890000000000001},"last":0.85899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:22:17.481 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:22:17.482 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:22:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.710+0000 7f957cf9d700 1 Processor -- start 2023-10-08T16:22:17.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.710+0000 7f957cf9d700 1 -- start start 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f957cf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957813fb20 0x7f957815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f957cf9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f957806aaa0 0x7f95780c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f957cf9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957815ae70 con 0x7f957813fef0 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f957cf9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f957806af60 con 0x7f957806aaa0 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f957cf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957806b240 con 0x7f957813fb20 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.711+0000 7f9577fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f957806aaa0 0x7f95780c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f957806aaa0 0x7f95780c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45122/0 (socket says 172.21.15.12:45122) 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 -- 172.21.15.12:0/3777287416 learned_addr learned my addr 172.21.15.12:0/3777287416 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:17.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f95777fe700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957813fb20 0x7f957815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9576ffd700 1 --1- 172.21.15.12:0/3777287416 >> v1:172.21.15.29:6789/0 conn(0x7f957813fef0 0x7f95780c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:57882/0 (socket says 172.21.15.12:57882) 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 -- 172.21.15.12:0/3777287416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957813fb20 msgr2=0x7f957815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957813fb20 0x7f957815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 -- 172.21.15.12:0/3777287416 >> v1:172.21.15.29:6789/0 conn(0x7f957813fef0 legacy=0x7f95780c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 -- 172.21.15.12:0/3777287416 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957806b520 con 0x7f957806aaa0 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f9577fff700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957806aaa0 0x7f95780c9d00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9570009f20 tx=0x7f9570009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201ef848a20182b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.712+0000 7f95767fc700 1 -- 172.21.15.12:0/3777287416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000e070 con 0x7f957806aaa0 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f95767fc700 1 -- 172.21.15.12:0/3777287416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000b9d0 con 0x7f957806aaa0 2023-10-08T16:22:17.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f95767fc700 1 -- 172.21.15.12:0/3777287416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700092e0 con 0x7f957806aaa0 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 -- 172.21.15.12:0/3777287416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957806aaa0 msgr2=0x7f95780c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957806aaa0 0x7f95780c9d00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f9570009f20 tx=0x7f9570009840 comp rx=0 tx=0).stop 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 -- 172.21.15.12:0/3777287416 shutdown_connections 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957806aaa0 0x7f95780c9d00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 --2- 172.21.15.12:0/3777287416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957813fb20 0x7f957815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 -- 172.21.15.12:0/3777287416 >> 172.21.15.12:0/3777287416 conn(0x7f957806d170 msgr2=0x7f95780cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 -- 172.21.15.12:0/3777287416 shutdown_connections 2023-10-08T16:22:17.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.713+0000 7f957cf9d700 1 -- 172.21.15.12:0/3777287416 wait complete. 2023-10-08T16:22:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.715+0000 7f957cf9d700 1 Processor -- start 2023-10-08T16:22:17.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.715+0000 7f957cf9d700 1 -- start start 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957806aaa0 0x7f957815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957813fb20 0x7f95780ac080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780ad4a0 con 0x7f957813fef0 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95780ac5c0 con 0x7f957813fb20 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f957cf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95780ac890 con 0x7f957806aaa0 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45134/0 (socket says 172.21.15.12:45134) 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 -- 172.21.15.12:0/4128882288 learned_addr learned my addr 172.21.15.12:0/4128882288 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:17.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f95777fe700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957806aaa0 0x7f957815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9576ffd700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957813fb20 0x7f95780ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 -- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957806aaa0 msgr2=0x7f957815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957806aaa0 0x7f957815b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 -- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957813fb20 msgr2=0x7f95780ac080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957813fb20 0x7f95780ac080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.716+0000 7f9577fff700 1 -- 172.21.15.12:0/4128882288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570009ae0 con 0x7f957813fef0 2023-10-08T16:22:17.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f9577fff700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9578071320 tx=0x7f9570018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570008c30 con 0x7f957813fef0 2023-10-08T16:22:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9570008d90 con 0x7f957813fef0 2023-10-08T16:22:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95700266b0 con 0x7f957813fef0 2023-10-08T16:22:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95780acb70 con 0x7f957813fef0 2023-10-08T16:22:17.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.717+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95780ad130 con 0x7f957813fef0 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.718+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957804c3c0 con 0x7f957813fef0 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.719+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9570003040 con 0x7f957813fef0 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.720+0000 7f955f7fe700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.720+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f9570086150 con 0x7f957813fef0 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.720+0000 7f95777fe700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:17.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.721+0000 7f95777fe700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab910 tx=0x7f9568008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:17.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:17.724+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95700531b0 con 0x7f957813fef0 2023-10-08T16:22:18.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.008+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f95780ad5e0 con 0x7f957813fef0 2023-10-08T16:22:18.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.012+0000 7f955f7fe700 1 -- 172.21.15.12:0/4128882288 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7f95700567d0 con 0x7f957813fef0 2023-10-08T16:22:18.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.014+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 msgr2=0x7f95640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.014+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 0x7f95640693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab910 tx=0x7f9568008040 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.014+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 msgr2=0x7f95780afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.014+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9578071320 tx=0x7f9570018000 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 shutdown_connections 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f9564066f30 0x7f95640693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f957813fef0 0x7f95780afea0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f957806aaa0 0x7f957815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 --2- 172.21.15.12:0/4128882288 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f957813fb20 0x7f95780ac080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 >> 172.21.15.12:0/4128882288 conn(0x7f957806d170 msgr2=0x7f95780c8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:18.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 shutdown_connections 2023-10-08T16:22:18.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.015+0000 7f957cf9d700 1 -- 172.21.15.12:0/4128882288 wait complete. 2023-10-08T16:22:18.016 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:22:18.032 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:22:18.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.220+0000 7fcfbf19d700 1 Processor -- start 2023-10-08T16:22:18.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.221+0000 7fcfbf19d700 1 -- start start 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbf19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcfb806f3a0 0x7fcfb814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbf19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcfb806e470 0x7fcfb81501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbf19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb806a490 con 0x7fcfb806e0a0 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbf19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb80c7230 con 0x7fcfb806e470 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbf19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb806b930 con 0x7fcfb806f3a0 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbe99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcfb806e470 0x7fcfb81501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbe99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcfb806e470 0x7fcfb81501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45138/0 (socket says 172.21.15.12:45138) 2023-10-08T16:22:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.222+0000 7fcfbe99c700 1 -- 172.21.15.12:0/994871202 learned_addr learned my addr 172.21.15.12:0/994871202 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:18.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbd99a700 1 --2- 172.21.15.12:0/994871202 >> v2:172.21.15.29:3300/0 conn(0x7fcfb806f3a0 0x7fcfb814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbe99c700 1 -- 172.21.15.12:0/994871202 >> v2:172.21.15.29:3300/0 conn(0x7fcfb806f3a0 msgr2=0x7fcfb814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:18.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbe99c700 1 --2- 172.21.15.12:0/994871202 >> v2:172.21.15.29:3300/0 conn(0x7fcfb806f3a0 0x7fcfb814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbe99c700 1 -- 172.21.15.12:0/994871202 >> v1:172.21.15.29:6789/0 conn(0x7fcfb806e0a0 legacy=0x7fcfb80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbe99c700 1 -- 172.21.15.12:0/994871202 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80c7490 con 0x7fcfb806e470 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbe99c700 1 --2- 172.21.15.12:0/994871202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806e470 0x7fcfb81501b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8156140 tx=0x7fcfb000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa4b51f0e4cf2b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbd199700 1 -- 172.21.15.12:0/994871202 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0010070 con 0x7fcfb806e470 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbd199700 1 -- 172.21.15.12:0/994871202 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000dc80 con 0x7fcfb806e470 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.223+0000 7fcfbd199700 1 -- 172.21.15.12:0/994871202 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0016400 con 0x7fcfb806e470 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 -- 172.21.15.12:0/994871202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806e470 msgr2=0x7fcfb81501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/994871202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806e470 0x7fcfb81501b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8156140 tx=0x7fcfb000ba50 comp rx=0 tx=0).stop 2023-10-08T16:22:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 -- 172.21.15.12:0/994871202 shutdown_connections 2023-10-08T16:22:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/994871202 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806e470 0x7fcfb81501b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/994871202 >> v2:172.21.15.29:3300/0 conn(0x7fcfb806f3a0 0x7fcfb814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 -- 172.21.15.12:0/994871202 >> 172.21.15.12:0/994871202 conn(0x7fcfb806d170 msgr2=0x7fcfb80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 -- 172.21.15.12:0/994871202 shutdown_connections 2023-10-08T16:22:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.224+0000 7fcfbf19d700 1 -- 172.21.15.12:0/994871202 wait complete. 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.225+0000 7fcfbf19d700 1 Processor -- start 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 -- start start 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcfb806e0a0 0x7fcfb8169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfb806e470 0x7fcfb8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb816a320 con 0x7fcfb806f3a0 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8157cf0 con 0x7fcfb806e470 2023-10-08T16:22:18.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.226+0000 7fcfbf19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb8157fd0 con 0x7fcfb806e0a0 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45154/0 (socket says 172.21.15.12:45154) 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 -- 172.21.15.12:0/3427680379 learned_addr learned my addr 172.21.15.12:0/3427680379 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe19b700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcfb806e0a0 0x7fcfb8169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbd99a700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfb806e470 0x7fcfb8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 -- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcfb806e0a0 msgr2=0x7fcfb8169de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcfb806e0a0 0x7fcfb8169de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 -- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfb806e470 msgr2=0x7fcfb8156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfb806e470 0x7fcfb8156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 -- 172.21.15.12:0/3427680379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb000bcf0 con 0x7fcfb806f3a0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.227+0000 7fcfbe99c700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ba90 tx=0x7fcfb001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.228+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0016400 con 0x7fcfb806f3a0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.228+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000b4f0 con 0x7fcfb806f3a0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.228+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0008870 con 0x7fcfb806f3a0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.228+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb81582b0 con 0x7fcfb806f3a0 2023-10-08T16:22:18.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.228+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8158870 con 0x7fcfb806f3a0 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.229+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb804c3c0 con 0x7fcfb806f3a0 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.230+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfb0003040 con 0x7fcfb806f3a0 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.230+0000 7fcfae7fc700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 0x7fcf9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.231+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fcfb0085b30 con 0x7fcfb806f3a0 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.231+0000 7fcfbe19b700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 0x7fcf9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:18.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.231+0000 7fcfbe19b700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 0x7fcf9c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4003860 tx=0x7fcfb4009040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:18.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.235+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfb0052c40 con 0x7fcfb806f3a0 2023-10-08T16:22:18.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.481+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcfb80c7770 con 0x7fcfb806f3a0 2023-10-08T16:22:18.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.482+0000 7fcfae7fc700 1 -- 172.21.15.12:0/3427680379 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fcfb001a090 con 0x7fcfb806f3a0 2023-10-08T16:22:18.482 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:18.482 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:22:18.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 msgr2=0x7fcf9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 0x7fcf9c0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4003860 tx=0x7fcfb4009040 comp rx=0 tx=0).stop 2023-10-08T16:22:18.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 msgr2=0x7fcfb814bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000ba90 tx=0x7fcfb001b000 comp rx=0 tx=0).stop 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 shutdown_connections 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcf9c066f30 0x7fcf9c0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcfb806f3a0 0x7fcfb814bae0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcfb806e0a0 0x7fcfb8169de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 --2- 172.21.15.12:0/3427680379 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcfb806e470 0x7fcfb8156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 >> 172.21.15.12:0/3427680379 conn(0x7fcfb806d170 msgr2=0x7fcfb80ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 shutdown_connections 2023-10-08T16:22:18.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:18.484+0000 7fcfbf19d700 1 -- 172.21.15.12:0/3427680379 wait complete. 2023-10-08T16:22:18.486 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:22:18.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:22:07.229377+0000', 'modified': '2023-10-08T16:22:10.755952+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5796}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5796': {'gid': 5796, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6837/2511741328', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6835', 'nonce': 2511741328}, {'type': 'v1', 'addr': '172.21.15.12:6837', 'nonce': 2511741328}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:22:18.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:22:18.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:22:19.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.095+0000 7fd56f59e700 1 Processor -- start 2023-10-08T16:22:19.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.095+0000 7fd56f59e700 1 -- start start 2023-10-08T16:22:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.096+0000 7fd56f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd57015dfd0 0x7fd5700aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.096+0000 7fd56f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 0x7fd5700ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.096+0000 7fd56f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5700acc00 con 0x7fd570159550 2023-10-08T16:22:19.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.096+0000 7fd56f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5700abff0 con 0x7fd57015dfd0 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.096+0000 7fd56f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5700ac2d0 con 0x7fd570159920 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd57015dfd0 0x7fd5700aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd57015dfd0 0x7fd5700aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45162/0 (socket says 172.21.15.12:45162) 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 -- 172.21.15.12:0/266427490 learned_addr learned my addr 172.21.15.12:0/266427490 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/266427490 >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 0x7fd5700ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 -- 172.21.15.12:0/266427490 >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 msgr2=0x7fd5700ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/266427490 >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 0x7fd5700ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 -- 172.21.15.12:0/266427490 >> v1:172.21.15.29:6789/0 conn(0x7fd570159550 legacy=0x7fd5700ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 -- 172.21.15.12:0/266427490 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5700ac5b0 con 0x7fd57015dfd0 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/266427490 >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 0x7fd5700ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.097+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/266427490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57015dfd0 0x7fd5700aedb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b0f0 tx=0x7fd564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551ab16bc282eb1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56d59a700 1 -- 172.21.15.12:0/266427490 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400b860 con 0x7fd57015dfd0 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56d59a700 1 -- 172.21.15.12:0/266427490 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b9c0 con 0x7fd57015dfd0 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56d59a700 1 -- 172.21.15.12:0/266427490 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400bd60 con 0x7fd57015dfd0 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 -- 172.21.15.12:0/266427490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57015dfd0 msgr2=0x7fd5700aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 --2- 172.21.15.12:0/266427490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57015dfd0 0x7fd5700aedb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b0f0 tx=0x7fd564009250 comp rx=0 tx=0).stop 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 -- 172.21.15.12:0/266427490 shutdown_connections 2023-10-08T16:22:19.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 --2- 172.21.15.12:0/266427490 >> v2:172.21.15.29:3300/0 conn(0x7fd570159920 0x7fd5700ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 --2- 172.21.15.12:0/266427490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd57015dfd0 0x7fd5700aedb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 -- 172.21.15.12:0/266427490 >> 172.21.15.12:0/266427490 conn(0x7fd57006ce80 msgr2=0x7fd5700ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 -- 172.21.15.12:0/266427490 shutdown_connections 2023-10-08T16:22:19.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.098+0000 7fd56f59e700 1 -- 172.21.15.12:0/266427490 wait complete. 2023-10-08T16:22:19.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.100+0000 7fd56f59e700 1 Processor -- start 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.100+0000 7fd56f59e700 1 -- start start 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 0x7fd5700c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd57015dfd0 0x7fd57014f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700c8850 con 0x7fd570159550 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700c8b30 con 0x7fd570159920 2023-10-08T16:22:19.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700c8e10 con 0x7fd57015dfd0 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45168/0 (socket says 172.21.15.12:45168) 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56e59c700 1 -- 172.21.15.12:0/2196990036 learned_addr learned my addr 172.21.15.12:0/2196990036 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd57015dfd0 0x7fd57014f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.101+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 0x7fd5700c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 -- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd57015dfd0 msgr2=0x7fd57014f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd57015dfd0 0x7fd57014f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 -- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 msgr2=0x7fd5700c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 0x7fd5700c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 -- 172.21.15.12:0/2196990036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5640094f0 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 0x7fd5700c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56e59c700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c590 tx=0x7fd56000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd55e7fc700 1 -- 172.21.15.12:0/2196990036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011590 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd55e7fc700 1 -- 172.21.15.12:0/2196990036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560011710 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd55e7fc700 1 -- 172.21.15.12:0/2196990036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011ad0 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd57014b090 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.102+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700c84b0 con 0x7fd570159550 2023-10-08T16:22:19.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.105+0000 7fd55e7fc700 1 -- 172.21.15.12:0/2196990036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd56001b3b0 con 0x7fd570159550 2023-10-08T16:22:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.106+0000 7fd55e7fc700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 0x7fd5500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.106+0000 7fd55e7fc700 1 -- 172.21.15.12:0/2196990036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd560083c70 con 0x7fd570159550 2023-10-08T16:22:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.106+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 0x7fd5500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.107+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 0x7fd5500693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b0f0 tx=0x7fd564017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.108+0000 7fd583378b80 1 Processor -- start 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.108+0000 7fd583378b80 1 -- start start 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e9177d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e844a70 con 0x55d75e8eb5f0 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e842270 con 0x55d75e8edb80 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d75e83e060 con 0x55d75e938480 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd56dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd56dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45170/0 (socket says 172.21.15.12:45170) 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1707026614 learned_addr learned my addr 172.21.15.12:0/1707026614 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e9177d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.109+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 msgr2=0x55d75e9177d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e9177d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 msgr2=0x55d75e8edff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1707026614 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d75e6d8270 con 0x55d75e8eb5f0 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd5640030c0 tx=0x7fd56401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb28af6f6b8c987e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd54f7fe700 1 -- 172.21.15.12:0/1707026614 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56402b070 con 0x55d75e8eb5f0 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd54f7fe700 1 -- 172.21.15.12:0/1707026614 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564006b10 con 0x55d75e8eb5f0 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.110+0000 7fd54f7fe700 1 -- 172.21.15.12:0/1707026614 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56401f070 con 0x55d75e8eb5f0 2023-10-08T16:22:19.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 -- 172.21.15.12:0/1707026614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 msgr2=0x55d75e938850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd5640030c0 tx=0x7fd56401f000 comp rx=0 tx=0).stop 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 -- 172.21.15.12:0/1707026614 shutdown_connections 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e9177d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 --2- 172.21.15.12:0/1707026614 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e938850 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 -- 172.21.15.12:0/1707026614 >> 172.21.15.12:0/1707026614 conn(0x55d75e8ef0c0 msgr2=0x55d75e8ef8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 -- 172.21.15.12:0/1707026614 shutdown_connections 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.111+0000 7fd583378b80 1 -- 172.21.15.12:0/1707026614 wait complete. 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.112+0000 7fd583378b80 1 -- start start 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.112+0000 7fd583378b80 1 Processor -- start 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e91a740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8e4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e7e9890 con 0x55d75e938480 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e804ea0 con 0x55d75e8edb80 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d75e6c0e30 con 0x55d75e8eb5f0 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd583378b80 10 client.0 _ll_register_callbacks cb 0x55d75e8b12c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e91a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45172/0 (socket says 172.21.15.12:45172) 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56ed9d700 1 -- 172.21.15.12:0/859316989 learned_addr learned my addr 172.21.15.12:0/859316989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e91a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:57026/0 (socket says 172.21.15.12:57026) 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.113+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8e4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 -- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 msgr2=0x55d75e91a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e91a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 -- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 msgr2=0x55d75e8e4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8e4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 -- 172.21.15.12:0/859316989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700ac5b0 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd568002f40 tx=0x7fd568009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b2a18c544da523c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd54cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568013a80 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd568013be0 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d75e8e2cd0 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd568016430 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd583378b80 10 client.5949 fetch_fsmap learned FSMap version 26 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.114+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d75e67afe0 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d75e8e2cd0 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd568016590 con 0x55d75e938480 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 10 client.5949 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T16:22:19.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 10 client.5949 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 20 client.5949 populate_metadata read hostname 'smithi012' 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e937480 0x55d75e946400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 4 client.5949 mds_command: new command op to 5796 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 --> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d75e8bfaa0 con 0x55d75e937480 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.115+0000 7fd56e59c700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e937480 0x55d75e946400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.116+0000 7fd54cff9700 10 client.5949 ms_handle_connect on v2:172.21.15.12:6835/2511741328 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.116+0000 7fd56e59c700 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e937480 0x55d75e946400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26a0e1967df1e3ed server_cookie=ba5b4b3b15e5bc66 in_seq=0 out_seq=0 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.116+0000 7fd54cff9700 1 -- 172.21.15.12:0/859316989 <== mds.0 v2:172.21.15.12:6835/2511741328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d75e8bfaa0 con 0x55d75e937480 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.116+0000 7fd54cff9700 10 client.5949 handle_command_reply: tid=0 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.116+0000 7fd583378b80 1 client.5949 shutdown 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 msgr2=0x55d75e8e4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd568002f40 tx=0x7fd568009990 comp rx=0 tx=0).stop 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 shutdown_connections 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e937480 0x55d75e946400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e938480 0x55d75e8e4f60 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e91a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 --2- 172.21.15.12:0/859316989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8e4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd54cff9700 0 client.5949 ms_handle_reset on v2:172.21.15.12:6835/2511741328 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 >> 172.21.15.12:0/859316989 conn(0x55d75e8ef0c0 msgr2=0x55d75e8ef8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 shutdown_connections 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 1 -- 172.21.15.12:0/859316989 wait complete. 2023-10-08T16:22:19.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.117+0000 7fd583378b80 20 client.5949 trim_cache size 0 max 16384 2023-10-08T16:22:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.135+0000 7fd583378b80 1 Processor -- start 2023-10-08T16:22:19.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.135+0000 7fd583378b80 1 -- start start 2023-10-08T16:22:19.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e8e69e0 con 0x55d75e8eb5f0 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e912120 con 0x55d75e8edb80 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d75e8e54d0 con 0x55d75e938480 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45182/0 (socket says 172.21.15.12:45182) 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 -- 172.21.15.12:0/1685683619 learned_addr learned my addr 172.21.15.12:0/1685683619 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 -- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 msgr2=0x55d75e8ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 -- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 msgr2=0x55d75e8edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 -- 172.21.15.12:0/1685683619 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d75e80c780 con 0x55d75e8eb5f0 2023-10-08T16:22:19.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.136+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd5600548d0 tx=0x7fd560057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91cd844150182089 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd54ffff700 1 -- 172.21.15.12:0/1685683619 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560011e80 con 0x55d75e8eb5f0 2023-10-08T16:22:19.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd54ffff700 1 -- 172.21.15.12:0/1685683619 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560052ad0 con 0x55d75e8eb5f0 2023-10-08T16:22:19.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd54ffff700 1 -- 172.21.15.12:0/1685683619 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560082090 con 0x55d75e8eb5f0 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 -- 172.21.15.12:0/1685683619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 msgr2=0x55d75e8efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fd5600548d0 tx=0x7fd560057040 comp rx=0 tx=0).stop 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 -- 172.21.15.12:0/1685683619 shutdown_connections 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8eb5f0 0x55d75e8efcd0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 --2- 172.21.15.12:0/1685683619 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 -- 172.21.15.12:0/1685683619 >> 172.21.15.12:0/1685683619 conn(0x55d75e8ef0c0 msgr2=0x55d75e8eaa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 -- 172.21.15.12:0/1685683619 shutdown_connections 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.137+0000 7fd583378b80 1 -- 172.21.15.12:0/1685683619 wait complete. 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.138+0000 7fd583378b80 1 -- start start 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.138+0000 7fd583378b80 1 Processor -- start 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e999b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e99a4a0 con 0x55d75e8edb80 2023-10-08T16:22:19.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d75e943ca0 con 0x55d75e938480 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d75e944540 con 0x55d75e8eb5f0 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd583378b80 10 client.0 _ll_register_callbacks cb 0x55d75e8b12c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd56dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd56dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45190/0 (socket says 172.21.15.12:45190) 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.139+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1116160437 learned_addr learned my addr 172.21.15.12:0/1116160437 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e999b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56ed9d700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 msgr2=0x55d75e999b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e999b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e938480 msgr2=0x55d75e8ee490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 -- 172.21.15.12:0/1116160437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5700c84b0 con 0x55d75e8edb80 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd56dd9b700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd56400bc10 tx=0x7fd564028070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3887e87ae340e1d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd54cff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56402b040 con 0x55d75e8edb80 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7fd5640308d0 con 0x55d75e8edb80 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd57014dce0 con 0x55d75e8edb80 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.140+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd56401f040 con 0x55d75e8edb80 2023-10-08T16:22:19.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 10 client.5955 fetch_fsmap learned FSMap version 26 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55d75e7f3470 con 0x55d75e8edb80 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57014dce0 con 0x55d75e8edb80 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 26) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd564030ca0 con 0x55d75e8edb80 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 10 client.5955 fetch_fsmap finished waiting for FSMap version 26 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 10 client.5955 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 20 client.5955 populate_metadata read hostname 'smithi012' 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e932ae0 0x55d75e932eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 4 client.5955 mds_command: new command op to 5796 tid=0[{"prefix": "status"}] 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 --> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd564006b10 con 0x55d75e932ae0 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.141+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e932ae0 0x55d75e932eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd56e59c700 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e932ae0 0x55d75e932eb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791d667d0df39d5 server_cookie=44c9ff013fe28672 in_seq=0 out_seq=0 2023-10-08T16:22:19.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd54cff9700 10 client.5955 ms_handle_connect on v2:172.21.15.12:6835/2511741328 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd54cff9700 1 -- 172.21.15.12:0/1116160437 <== mds.0 v2:172.21.15.12:6835/2511741328 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7fd564006b10 con 0x55d75e932ae0 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd54cff9700 10 client.5955 handle_command_reply: tid=0 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 client.5955 shutdown 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 msgr2=0x55d75e8edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fd56400bc10 tx=0x7fd564028070 comp rx=0 tx=0).stop 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 shutdown_connections 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d75e938480 0x55d75e8ee490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d75e8eb5f0 0x55d75e999b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:6835/2511741328,v1:172.21.15.12:6837/2511741328] conn(0x55d75e932ae0 0x55d75e932eb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 --2- 172.21.15.12:0/1116160437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d75e8edb80 0x55d75e8edf50 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 >> 172.21.15.12:0/1116160437 conn(0x55d75e8ef0c0 msgr2=0x55d75e8eaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd54cff9700 0 client.5955 ms_handle_reset on v2:172.21.15.12:6835/2511741328 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 shutdown_connections 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 1 -- 172.21.15.12:0/1116160437 wait complete. 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.142+0000 7fd583378b80 20 client.5955 trim_cache size 0 max 16384 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 5796, 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:22:19.150 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.395684832000001, 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 26, 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 68, 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 68, 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.127785384999999 2023-10-08T16:22:19.151 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 msgr2=0x7fd5500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 0x7fd5500693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd57006b0f0 tx=0x7fd564017000 comp rx=0 tx=0).stop 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 msgr2=0x7fd570149e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c590 tx=0x7fd56000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 shutdown_connections 2023-10-08T16:22:19.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd550066f30 0x7fd5500693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd570159550 0x7fd570149e10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd57015dfd0 0x7fd57014f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 --2- 172.21.15.12:0/2196990036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd570159920 0x7fd5700c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 >> 172.21.15.12:0/2196990036 conn(0x7fd57006ce80 msgr2=0x7fd57006d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 shutdown_connections 2023-10-08T16:22:19.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.143+0000 7fd56f59e700 1 -- 172.21.15.12:0/2196990036 wait complete. 2023-10-08T16:22:19.161 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:22:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.347+0000 7f042959d700 1 Processor -- start 2023-10-08T16:22:19.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.347+0000 7f042959d700 1 -- start start 2023-10-08T16:22:19.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.348+0000 7f042959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.348+0000 7f042959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f042413fef0 0x7f04240c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.348+0000 7f042959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042415ae70 con 0x7f042406aaa0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.348+0000 7f042959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042406af60 con 0x7f042413fef0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.348+0000 7f042959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042406b240 con 0x7f042413fb20 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0428d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f042406aaa0 0x7f04240c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40916/0 (socket says 172.21.15.12:40916) 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0428d9c700 1 -- 172.21.15.12:0/3729056913 learned_addr learned my addr 172.21.15.12:0/3729056913 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0423fff700 1 --2- 172.21.15.12:0/3729056913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f04237fe700 1 --2- 172.21.15.12:0/3729056913 >> v2:172.21.15.29:3300/0 conn(0x7f042413fef0 0x7f04240c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0422ffd700 1 -- 172.21.15.12:0/3729056913 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541659171 0 0) 0x7f041c001490 con 0x7f042406aaa0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0422ffd700 1 -- 172.21.15.12:0/3729056913 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f040c003570 con 0x7f042406aaa0 2023-10-08T16:22:19.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0423fff700 1 -- 172.21.15.12:0/3729056913 >> v2:172.21.15.29:3300/0 conn(0x7f042413fef0 msgr2=0x7f04240c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0423fff700 1 --2- 172.21.15.12:0/3729056913 >> v2:172.21.15.29:3300/0 conn(0x7f042413fef0 0x7f04240c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0423fff700 1 -- 172.21.15.12:0/3729056913 >> v1:172.21.15.12:6789/0 conn(0x7f042406aaa0 legacy=0x7f04240c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.349+0000 7f0423fff700 1 -- 172.21.15.12:0/3729056913 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042406b520 con 0x7f042413fb20 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f0423fff700 1 --2- 172.21.15.12:0/3729056913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042415a930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04140098e0 tx=0x7f04140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0073609f2c0332d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f0422ffd700 1 -- 172.21.15.12:0/3729056913 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414011630 con 0x7f042413fb20 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f0422ffd700 1 -- 172.21.15.12:0/3729056913 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414011790 con 0x7f042413fb20 2023-10-08T16:22:19.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f0422ffd700 1 -- 172.21.15.12:0/3729056913 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414011b10 con 0x7f042413fb20 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 -- 172.21.15.12:0/3729056913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 msgr2=0x7f042415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 --2- 172.21.15.12:0/3729056913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042415a930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f04140098e0 tx=0x7f04140091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 -- 172.21.15.12:0/3729056913 shutdown_connections 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 --2- 172.21.15.12:0/3729056913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042415a930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 --2- 172.21.15.12:0/3729056913 >> v2:172.21.15.29:3300/0 conn(0x7f042413fef0 0x7f04240c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.350+0000 7f042959d700 1 -- 172.21.15.12:0/3729056913 >> 172.21.15.12:0/3729056913 conn(0x7f042406d170 msgr2=0x7f04240cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.351+0000 7f042959d700 1 -- 172.21.15.12:0/3729056913 shutdown_connections 2023-10-08T16:22:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.351+0000 7f042959d700 1 -- 172.21.15.12:0/3729056913 wait complete. 2023-10-08T16:22:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.352+0000 7f042959d700 1 Processor -- start 2023-10-08T16:22:19.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.352+0000 7f042959d700 1 -- start start 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f042413fef0 0x7f04240acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042415eff0 con 0x7f042406aaa0 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240ac850 con 0x7f042413fef0 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f042959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04241586d0 con 0x7f042413fb20 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f0423fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f0423fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45202/0 (socket says 172.21.15.12:45202) 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f0423fff700 1 -- 172.21.15.12:0/2499063499 learned_addr learned my addr 172.21.15.12:0/2499063499 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f04237fe700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.353+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f042413fef0 0x7f04240acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 -- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 msgr2=0x7f042413c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042413c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 -- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f042413fef0 msgr2=0x7f04240acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f042413fef0 0x7f04240acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 -- 172.21.15.12:0/2499063499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414009420 con 0x7f042406aaa0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f0423fff700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0414009ed0 tx=0x7f0414017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0414011b10 con 0x7f042406aaa0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0414000d10 con 0x7f042406aaa0 2023-10-08T16:22:19.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042413cdf0 con 0x7f042406aaa0 2023-10-08T16:22:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041401a660 con 0x7f042406aaa0 2023-10-08T16:22:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.354+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240abf20 con 0x7f042406aaa0 2023-10-08T16:22:19.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.356+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042404c3c0 con 0x7f042406aaa0 2023-10-08T16:22:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.356+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f041401aa90 con 0x7f042406aaa0 2023-10-08T16:22:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.357+0000 7f040bfff700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 0x7f04100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.357+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f0414086360 con 0x7f042406aaa0 2023-10-08T16:22:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.357+0000 7f04237fe700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 0x7f04100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:19.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.358+0000 7f04237fe700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 0x7f04100693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0424158080 tx=0x7f0418008040 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:19.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.361+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0414053460 con 0x7f042406aaa0 2023-10-08T16:22:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.608+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f042415a1f0 con 0x7f042406aaa0 2023-10-08T16:22:19.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.609+0000 7f040bfff700 1 -- 172.21.15.12:0/2499063499 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0414056a80 con 0x7f042406aaa0 2023-10-08T16:22:19.610 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 msgr2=0x7f04100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 0x7f04100693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0424158080 tx=0x7f0418008040 comp rx=0 tx=0).stop 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 msgr2=0x7f042415eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0414009ed0 tx=0x7f0414017000 comp rx=0 tx=0).stop 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 shutdown_connections 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0410066f30 0x7f04100693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042406aaa0 0x7f042415eab0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f042413fef0 0x7f04240acce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 --2- 172.21.15.12:0/2499063499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042413fb20 0x7f042413c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 >> 172.21.15.12:0/2499063499 conn(0x7f042406d170 msgr2=0x7f042413e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 shutdown_connections 2023-10-08T16:22:19.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:19.611+0000 7f042959d700 1 -- 172.21.15.12:0/2499063499 wait complete. 2023-10-08T16:22:19.629 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:22:19.630 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:22:19.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:19.631 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:22:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:22:19.668 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:22:19.669 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41402sec preferred_lft 41402sec 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:22:19.670 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.671 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:22:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:22:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:22:19.672 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:22:19.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:19.672 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:22:19.768 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:22:19.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:19.771 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:22:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:22:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:22:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:22:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:22:19.811 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:22:19.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:19.812 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:22:19.812 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:22:19.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:22:19.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:22:19.813 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:22:19.813 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:22:20.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:20.012 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:22:20.049 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:22:20.050 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:22:20.050 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:22:20.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:20.050 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:22:20.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:22:20.152 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:22:20.189 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:22:20.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:22:20.189 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:22:20.265 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:22:20.266 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:22:20.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:22:20.398 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:22:20.398 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:22:20.427 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:22:20.427 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:22:20.427 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:22:20.427 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:22:20.427 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:22:20.432 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:22:20.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:22:20.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:22:20.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:22:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.681+0000 7ff4c7fff700 1 Processor -- start 2023-10-08T16:22:20.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.682+0000 7ff4c7fff700 1 -- start start 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c815ca70 0x7ff4c806aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 0x7ff4c806b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c806d5b0 con 0x7ff4c80c7750 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c80b00b0 con 0x7ff4c815ca70 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c806b6b0 con 0x7ff4c815ce40 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c815ca70 0x7ff4c806aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4c815ca70 0x7ff4c806aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45206/0 (socket says 172.21.15.12:45206) 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c6ffd700 1 -- 172.21.15.12:0/1738320730 learned_addr learned my addr 172.21.15.12:0/1738320730 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:20.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.683+0000 7ff4c67fc700 1 --2- 172.21.15.12:0/1738320730 >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 0x7ff4c806b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c6ffd700 1 -- 172.21.15.12:0/1738320730 >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 msgr2=0x7ff4c806b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:20.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c6ffd700 1 --2- 172.21.15.12:0/1738320730 >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 0x7ff4c806b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c6ffd700 1 -- 172.21.15.12:0/1738320730 >> v1:172.21.15.29:6789/0 conn(0x7ff4c80c7750 legacy=0x7ff4c80c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c6ffd700 1 -- 172.21.15.12:0/1738320730 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c806b990 con 0x7ff4c815ca70 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c67fc700 1 --2- 172.21.15.12:0/1738320730 >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 0x7ff4c806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c6ffd700 1 --2- 172.21.15.12:0/1738320730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ca70 0x7ff4c806aad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806a8c0 tx=0x7ff4b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585f447c4b96e2bc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c5ffb700 1 -- 172.21.15.12:0/1738320730 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800b860 con 0x7ff4c815ca70 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c5ffb700 1 -- 172.21.15.12:0/1738320730 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b800b9c0 con 0x7ff4c815ca70 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.684+0000 7ff4c5ffb700 1 -- 172.21.15.12:0/1738320730 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800bd60 con 0x7ff4c815ca70 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 -- 172.21.15.12:0/1738320730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ca70 msgr2=0x7ff4c806aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/1738320730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ca70 0x7ff4c806aad0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806a8c0 tx=0x7ff4b8009250 comp rx=0 tx=0).stop 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 -- 172.21.15.12:0/1738320730 shutdown_connections 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/1738320730 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ca70 0x7ff4c806aad0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/1738320730 >> v2:172.21.15.29:3300/0 conn(0x7ff4c815ce40 0x7ff4c806b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 -- 172.21.15.12:0/1738320730 >> 172.21.15.12:0/1738320730 conn(0x7ff4c80675a0 msgr2=0x7ff4c80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:20.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 -- 172.21.15.12:0/1738320730 shutdown_connections 2023-10-08T16:22:20.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.685+0000 7ff4c7fff700 1 -- 172.21.15.12:0/1738320730 wait complete. 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.686+0000 7ff4c7fff700 1 Processor -- start 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.686+0000 7ff4c7fff700 1 -- start start 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4c80c7750 0x7ff4c80c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c815ca70 0x7ff4c806d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c2730 con 0x7ff4c815ce40 2023-10-08T16:22:20.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c2a10 con 0x7ff4c815ca70 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.687+0000 7ff4c7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c2cf0 con 0x7ff4c80c7750 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c6ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4c80c7750 0x7ff4c80c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45216/0 (socket says 172.21.15.12:45216) 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 -- 172.21.15.12:0/2057926751 learned_addr learned my addr 172.21.15.12:0/2057926751 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c67fc700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c815ca70 0x7ff4c806d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 -- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4c80c7750 msgr2=0x7ff4c80c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4c80c7750 0x7ff4c80c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 -- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c815ca70 msgr2=0x7ff4c806d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c815ca70 0x7ff4c806d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 -- 172.21.15.12:0/2057926751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80094f0 con 0x7ff4c815ce40 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.688+0000 7ff4c77fe700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c8e0 tx=0x7ff4c0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.689+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0012630 con 0x7ff4c815ce40 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.689+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c0012790 con 0x7ff4c815ce40 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.689+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c0012b50 con 0x7ff4c815ce40 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.689+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80c2fd0 con 0x7ff4c815ce40 2023-10-08T16:22:20.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.689+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c806df30 con 0x7ff4c815ce40 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.690+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c80c34f0 con 0x7ff4c815ce40 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.691+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4c001a3a0 con 0x7ff4c815ce40 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.692+0000 7ff4aeffd700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 0x7ff4b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.692+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff4c00848b0 con 0x7ff4c815ce40 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.692+0000 7ff4c6ffd700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 0x7ff4b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:20.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.693+0000 7ff4c6ffd700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 0x7ff4b40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806a8c0 tx=0x7ff4b8017000 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:20.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.696+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4c80c34f0 con 0x7ff4c815ce40 2023-10-08T16:22:20.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.927+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4c80c34f0 con 0x7ff4b4066f30 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.928+0000 7ff4aeffd700 1 -- 172.21.15.12:0/2057926751 <== mgr.5598 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff4c80c34f0 con 0x7ff4b4066f30 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:22:20.929 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:22:20.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.930+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 msgr2=0x7ff4b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.930+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 0x7ff4b40693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4c806a8c0 tx=0x7ff4b8017000 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.930+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 msgr2=0x7ff4c8158550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.930+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff4c000c8e0 tx=0x7ff4c0001710 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 shutdown_connections 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4b4066f30 0x7ff4b40693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4c815ce40 0x7ff4c8158550 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4c80c7750 0x7ff4c80c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 --2- 172.21.15.12:0/2057926751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4c815ca70 0x7ff4c806d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 >> 172.21.15.12:0/2057926751 conn(0x7ff4c80675a0 msgr2=0x7ff4c815d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 shutdown_connections 2023-10-08T16:22:20.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:20.931+0000 7ff4c7fff700 1 -- 172.21.15.12:0/2057926751 wait complete. 2023-10-08T16:22:20.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:22:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.138+0000 7f65db39d700 1 Processor -- start 2023-10-08T16:22:21.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.138+0000 7f65db39d700 1 -- start start 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65db39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f65d4140a70 0x7f65d4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65db39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 0x7f65d406a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65db39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d415b640 con 0x7f65d415b0a0 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65db39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40c6800 con 0x7f65d4140a70 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65db39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d415b920 con 0x7f65d406de50 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65d9b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 0x7f65d406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65d9b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 0x7f65d406a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:57096/0 (socket says 172.21.15.12:57096) 2023-10-08T16:22:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65d9b9a700 1 -- 172.21.15.12:0/2803753133 learned_addr learned my addr 172.21.15.12:0/2803753133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65da39b700 1 --2- 172.21.15.12:0/2803753133 >> v2:172.21.15.29:3300/0 conn(0x7f65d4140a70 0x7f65d4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.140+0000 7f65dab9c700 1 --1- 172.21.15.12:0/2803753133 >> v1:172.21.15.29:6789/0 conn(0x7f65d415b0a0 0x7f65d4157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:57930/0 (socket says 172.21.15.12:57930) 2023-10-08T16:22:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65da39b700 1 -- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 msgr2=0x7f65d406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65da39b700 1 --2- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 0x7f65d406a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65da39b700 1 -- 172.21.15.12:0/2803753133 >> v1:172.21.15.29:6789/0 conn(0x7f65d415b0a0 legacy=0x7f65d4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65da39b700 1 -- 172.21.15.12:0/2803753133 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d415bc00 con 0x7f65d4140a70 2023-10-08T16:22:21.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65da39b700 1 --2- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d4069b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65d00098e0 tx=0x7f65d00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b16d8e325978a1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.141+0000 7f65d9399700 1 -- 172.21.15.12:0/2803753133 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000b640 con 0x7f65d4140a70 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65d9399700 1 -- 172.21.15.12:0/2803753133 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d000b7a0 con 0x7f65d4140a70 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65d9399700 1 -- 172.21.15.12:0/2803753133 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d000bb40 con 0x7f65d4140a70 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 -- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 msgr2=0x7f65d4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 --2- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d4069b00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f65d00098e0 tx=0x7f65d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 -- 172.21.15.12:0/2803753133 shutdown_connections 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 --2- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d4069b00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 --2- 172.21.15.12:0/2803753133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d406de50 0x7f65d406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 -- 172.21.15.12:0/2803753133 >> 172.21.15.12:0/2803753133 conn(0x7f65d406d110 msgr2=0x7f65d40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 -- 172.21.15.12:0/2803753133 shutdown_connections 2023-10-08T16:22:21.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.142+0000 7f65db39d700 1 -- 172.21.15.12:0/2803753133 wait complete. 2023-10-08T16:22:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.144+0000 7f65db39d700 1 Processor -- start 2023-10-08T16:22:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.144+0000 7f65db39d700 1 -- start start 2023-10-08T16:22:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d415b0a0 0x7f65d40c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d414f8f0 con 0x7f65d406de50 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40affa0 con 0x7f65d4140a70 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65db39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d40b0280 con 0x7f65d415b0a0 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45226/0 (socket says 172.21.15.12:45226) 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 -- 172.21.15.12:0/319938315 learned_addr learned my addr 172.21.15.12:0/319938315 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65dab9c700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d415b0a0 0x7f65d40c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65d9b9a700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 -- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d415b0a0 msgr2=0x7f65d40c1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d415b0a0 0x7f65d40c1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 -- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 msgr2=0x7f65d413da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d413da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.145+0000 7f65da39b700 1 -- 172.21.15.12:0/319938315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d0009420 con 0x7f65d406de50 2023-10-08T16:22:21.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65da39b700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cc000 tx=0x7f65d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d001bc40 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d001bdc0 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d40b0560 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d0011670 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.146+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d414fc80 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.147+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d404c3c0 con 0x7f65d406de50 2023-10-08T16:22:21.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.148+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 17) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65d0011a20 con 0x7f65d406de50 2023-10-08T16:22:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.149+0000 7f65ca7fc700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.149+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f65d0085cf0 con 0x7f65d406de50 2023-10-08T16:22:21.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.150+0000 7f65d9b9a700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:21.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.150+0000 7f65d9b9a700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 0x7f65b80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cbee0 tx=0x7f65c4009250 comp rx=0 tx=0).ready entity=mgr.5598 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:21.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.154+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65d0052d50 con 0x7f65d406de50 2023-10-08T16:22:21.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:21.415+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f65d415bee0 con 0x7f65d406de50 2023-10-08T16:22:22.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.100+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f65d000fdc0 con 0x7f65d406de50 2023-10-08T16:22:22.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.101+0000 7f65ca7fc700 1 -- 172.21.15.12:0/319938315 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) v1 ==== 92+0+0 (secure 0 0 0) 0x7f65d00567e0 con 0x7f65d406de50 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 msgr2=0x7f65b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 0x7f65b80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cbee0 tx=0x7f65c4009250 comp rx=0 tx=0).stop 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 msgr2=0x7f65d416d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f65d40cc000 tx=0x7f65d0017000 comp rx=0 tx=0).stop 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 shutdown_connections 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f65b8066f30 0x7f65b80693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65d406de50 0x7f65d416d950 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65d415b0a0 0x7f65d40c1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 --2- 172.21.15.12:0/319938315 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65d4140a70 0x7f65d413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 >> 172.21.15.12:0/319938315 conn(0x7f65d406d110 msgr2=0x7f65d413fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 shutdown_connections 2023-10-08T16:22:22.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.104+0000 7f65db39d700 1 -- 172.21.15.12:0/319938315 wait complete. 2023-10-08T16:22:22.125 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:22:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.321+0000 7f3beef9d700 1 Processor -- start 2023-10-08T16:22:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.321+0000 7f3beef9d700 1 -- start start 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3beef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be8153a00 0x7f3be8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3beef9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3be815de50 0x7f3be815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3beef9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be815af60 con 0x7f3be80cea00 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3beef9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be815d010 con 0x7f3be815de50 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3beef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be815b240 con 0x7f3be8153a00 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3bed79a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3be815de50 0x7f3be815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3bee79c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3be80cea00 0x7f3be80cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41612/0 (socket says 172.21.15.12:41612) 2023-10-08T16:22:22.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.322+0000 7f3bee79c700 1 -- 172.21.15.12:0/558443441 learned_addr learned my addr 172.21.15.12:0/558443441 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bedf9b700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be8153a00 0x7f3be8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bed79a700 1 -- 172.21.15.12:0/558443441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be8153a00 msgr2=0x7f3be8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bed79a700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be8153a00 0x7f3be8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bed79a700 1 -- 172.21.15.12:0/558443441 >> v1:172.21.15.12:6789/0 conn(0x7f3be80cea00 legacy=0x7f3be80cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bed79a700 1 -- 172.21.15.12:0/558443441 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be815b520 con 0x7f3be815de50 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3becf99700 1 -- 172.21.15.12:0/558443441 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685139277 0 0) 0x7f3be815af60 con 0x7f3be80cea00 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3bed79a700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be815de50 0x7f3be815a540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80098e0 tx=0x7f3bd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0a3604089b6f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.323+0000 7f3becf99700 1 -- 172.21.15.12:0/558443441 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800b640 con 0x7f3be815de50 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3becf99700 1 -- 172.21.15.12:0/558443441 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800b7a0 con 0x7f3be815de50 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3becf99700 1 -- 172.21.15.12:0/558443441 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800bb40 con 0x7f3be815de50 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 -- 172.21.15.12:0/558443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be815de50 msgr2=0x7f3be815a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be815de50 0x7f3be815a540 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3bd80098e0 tx=0x7f3bd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 -- 172.21.15.12:0/558443441 shutdown_connections 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be8153a00 0x7f3be8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 --2- 172.21.15.12:0/558443441 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be815de50 0x7f3be815a540 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 -- 172.21.15.12:0/558443441 >> 172.21.15.12:0/558443441 conn(0x7f3be80703a0 msgr2=0x7f3be80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 -- 172.21.15.12:0/558443441 shutdown_connections 2023-10-08T16:22:22.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.324+0000 7f3beef9d700 1 -- 172.21.15.12:0/558443441 wait complete. 2023-10-08T16:22:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.326+0000 7f3beef9d700 1 Processor -- start 2023-10-08T16:22:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.326+0000 7f3beef9d700 1 -- start start 2023-10-08T16:22:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3be80cea00 0x7f3be8152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be815de50 0x7f3be80b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b5d10 con 0x7f3be8153a00 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80b5ff0 con 0x7f3be80cea00 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3beef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80c7780 con 0x7f3be815de50 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3bed79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3bed79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53640/0 (socket says 172.21.15.12:53640) 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3bed79a700 1 -- 172.21.15.12:0/3550429111 learned_addr learned my addr 172.21.15.12:0/3550429111 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3bedf9b700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3be80cea00 0x7f3be8152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.327+0000 7f3bee79c700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be815de50 0x7f3be80b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be815de50 msgr2=0x7f3be80b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be815de50 0x7f3be80b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3be80cea00 msgr2=0x7f3be8152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3be80cea00 0x7f3be8152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 -- 172.21.15.12:0/3550429111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bd8009420 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bed79a700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009f80 tx=0x7f3bd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd800b910 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd800ba70 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8024670 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.328+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be80c7a60 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.329+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be80b5890 con 0x7f3be8153a00 2023-10-08T16:22:22.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.330+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be80c75e0 con 0x7f3be8153a00 2023-10-08T16:22:22.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.331+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3bd8024aa0 con 0x7f3be8153a00 2023-10-08T16:22:22.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.332+0000 7f3bddffb700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 0x7f3bcc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.332+0000 7f3bedf9b700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 msgr2=0x7f3bcc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:22.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.332+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f3bd80860b0 con 0x7f3be8153a00 2023-10-08T16:22:22.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.332+0000 7f3bedf9b700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 0x7f3bcc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:22:22.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.336+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3be80c75e0 con 0x7f3be8153a00 2023-10-08T16:22:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.533+0000 7f3bedf9b700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 msgr2=0x7f3bcc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.533+0000 7f3bedf9b700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 0x7f3bcc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:22:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.544+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f3be80c75e0 con 0x7f3be8153a00 2023-10-08T16:22:22.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.549+0000 7f3bddffb700 1 -- 172.21.15.12:0/3550429111 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3be80c75e0 con 0x7f3be8153a00 2023-10-08T16:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 msgr2=0x7f3bcc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 0x7f3bcc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 msgr2=0x7f3be80b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8009f80 tx=0x7f3bd8017000 comp rx=0 tx=0).stop 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 shutdown_connections 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3bcc066f80 0x7f3bcc069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3be815de50 0x7f3be80b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3be80cea00 0x7f3be8152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 --2- 172.21.15.12:0/3550429111 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3be8153a00 0x7f3be80b5350 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.551+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 >> 172.21.15.12:0/3550429111 conn(0x7f3be80703a0 msgr2=0x7f3be8152d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.552+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 shutdown_connections 2023-10-08T16:22:22.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.552+0000 7f3beef9d700 1 -- 172.21.15.12:0/3550429111 wait complete. 2023-10-08T16:22:22.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:22:22.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.764+0000 7f77ed59d700 1 Processor -- start 2023-10-08T16:22:22.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.764+0000 7f77ed59d700 1 -- start start 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.766+0000 7f77ed59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f77e8153dd0 0x7f77e815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ed59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f77e80cea00 0x7f77e80ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ed59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e815ac50 con 0x7f77e8153a00 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ed59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e815d010 con 0x7f77e80cea00 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ed59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e80cf3e0 con 0x7f77e8153dd0 2023-10-08T16:22:22.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77e7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f77e8153a00 0x7f77e815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41616/0 (socket says 172.21.15.12:41616) 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77e7fff700 1 -- 172.21.15.12:0/3784845138 learned_addr learned my addr 172.21.15.12:0/3784845138 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ecd9c700 1 --2- 172.21.15.12:0/3784845138 >> v2:172.21.15.12:3300/0 conn(0x7f77e80cea00 0x7f77e80ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77e77fe700 1 --2- 172.21.15.12:0/3784845138 >> v2:172.21.15.29:3300/0 conn(0x7f77e8153dd0 0x7f77e815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77e6ffd700 1 -- 172.21.15.12:0/3784845138 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393631261 0 0) 0x7f77e815ac50 con 0x7f77e8153a00 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77e6ffd700 1 -- 172.21.15.12:0/3784845138 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77d0003570 con 0x7f77e8153a00 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ecd9c700 1 -- 172.21.15.12:0/3784845138 >> v2:172.21.15.29:3300/0 conn(0x7f77e8153dd0 msgr2=0x7f77e815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ecd9c700 1 --2- 172.21.15.12:0/3784845138 >> v2:172.21.15.29:3300/0 conn(0x7f77e8153dd0 0x7f77e815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ecd9c700 1 -- 172.21.15.12:0/3784845138 >> v1:172.21.15.12:6789/0 conn(0x7f77e8153a00 legacy=0x7f77e815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.767+0000 7f77ecd9c700 1 -- 172.21.15.12:0/3784845138 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e815af60 con 0x7f77e80cea00 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.768+0000 7f77ecd9c700 1 --2- 172.21.15.12:0/3784845138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ceea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b3070 tx=0x7f77e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4b40c35be895e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.768+0000 7f77e6ffd700 1 -- 172.21.15.12:0/3784845138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000e070 con 0x7f77e80cea00 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.768+0000 7f77e6ffd700 1 -- 172.21.15.12:0/3784845138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e000bab0 con 0x7f77e80cea00 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.768+0000 7f77e6ffd700 1 -- 172.21.15.12:0/3784845138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e000be30 con 0x7f77e80cea00 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 -- 172.21.15.12:0/3784845138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 msgr2=0x7f77e80ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 --2- 172.21.15.12:0/3784845138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ceea0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f77e80b3070 tx=0x7f77e0009780 comp rx=0 tx=0).stop 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 -- 172.21.15.12:0/3784845138 shutdown_connections 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 --2- 172.21.15.12:0/3784845138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ceea0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 --2- 172.21.15.12:0/3784845138 >> v2:172.21.15.29:3300/0 conn(0x7f77e8153dd0 0x7f77e815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 -- 172.21.15.12:0/3784845138 >> 172.21.15.12:0/3784845138 conn(0x7f77e80703a0 msgr2=0x7f77e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 -- 172.21.15.12:0/3784845138 shutdown_connections 2023-10-08T16:22:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.769+0000 7f77ed59d700 1 -- 172.21.15.12:0/3784845138 wait complete. 2023-10-08T16:22:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.771+0000 7f77ed59d700 1 Processor -- start 2023-10-08T16:22:22.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.772+0000 7f77ed59d700 1 -- start start 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 0x7f77e80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77e8153dd0 0x7f77e815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c7b20 con 0x7f77e80cea00 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c91e0 con 0x7f77e8153a00 2023-10-08T16:22:22.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77ed59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e80c9410 con 0x7f77e8153dd0 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53658/0 (socket says 172.21.15.12:53658) 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.773+0000 7f77e7fff700 1 -- 172.21.15.12:0/1385419990 learned_addr learned my addr 172.21.15.12:0/1385419990 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e77fe700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 0x7f77e80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77ecd9c700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77e8153dd0 0x7f77e815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77e8153dd0 msgr2=0x7f77e815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77e8153dd0 0x7f77e815f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 msgr2=0x7f77e80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 0x7f77e80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 -- 172.21.15.12:0/1385419990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e0009a20 con 0x7f77e80cea00 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e77fe700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 0x7f77e80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:22.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77e7fff700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f77d80011e0 tx=0x7f77d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8005b30 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d8005c90 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.774+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e80c96f0 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.775+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d8007300 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.775+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e80c9d30 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.776+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e80c7dd0 con 0x7f77e80cea00 2023-10-08T16:22:22.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.776+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f77d8007670 con 0x7f77e80cea00 2023-10-08T16:22:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.777+0000 7f77cffff700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 0x7f77d4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.777+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f77d8083bb0 con 0x7f77e80cea00 2023-10-08T16:22:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.777+0000 7f77e77fe700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 msgr2=0x7f77d4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:22.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.777+0000 7f77e77fe700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 0x7f77d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:22:22.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.781+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77d8050c10 con 0x7f77e80cea00 2023-10-08T16:22:22.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.978+0000 7f77e77fe700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 msgr2=0x7f77d4069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:22.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.978+0000 7f77e77fe700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 0x7f77d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:22:22.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:22.999+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f77e815b240 con 0x7f77e80cea00 2023-10-08T16:22:23.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.004+0000 7f77cffff700 1 -- 172.21.15.12:0/1385419990 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7f77d8017020 con 0x7f77e80cea00 2023-10-08T16:22:23.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 msgr2=0x7f77d4069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 0x7f77d4069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 msgr2=0x7f77e80ccca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f77d80011e0 tx=0x7f77d8007df0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 shutdown_connections 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f77d4066f80 0x7f77d4069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f77e80cea00 0x7f77e80ccca0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f77e8153dd0 0x7f77e815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.006+0000 7f77ed59d700 1 --2- 172.21.15.12:0/1385419990 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f77e8153a00 0x7f77e80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.007+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 >> 172.21.15.12:0/1385419990 conn(0x7f77e80703a0 msgr2=0x7f77e80d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.007+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 shutdown_connections 2023-10-08T16:22:23.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.007+0000 7f77ed59d700 1 -- 172.21.15.12:0/1385419990 wait complete. 2023-10-08T16:22:23.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:23.026 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T16:22:23.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-08T16:22:23.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.301+0000 7ff29a99d700 1 Processor -- start 2023-10-08T16:22:23.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.301+0000 7ff29a99d700 1 -- start start 2023-10-08T16:22:23.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.302+0000 7ff29a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff2940b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.302+0000 7ff29a99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b0c80 con 0x7ff2940b24f0 2023-10-08T16:22:23.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff29a99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2940b0f60 con 0x7ff2940b1d40 2023-10-08T16:22:23.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff29a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940d10d0 con 0x7ff294159800 2023-10-08T16:22:23.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff29999b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff2940b24f0 0x7ff2941590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41626/0 (socket says 172.21.15.12:41626) 2023-10-08T16:22:23.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff29999b700 1 -- 172.21.15.12:0/339266981 learned_addr learned my addr 172.21.15.12:0/339266981 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:22:23.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff29919a700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff2940b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776455463 0 0) 0x7ff2940b0c80 con 0x7ff2940b24f0 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff280003570 con 0x7ff2940b24f0 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608390742 0 0) 0x7ff2940b0f60 con 0x7ff2940b1d40 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2940b0c80 con 0x7ff2940b1d40 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3479424034 0 0) 0x7ff280003570 con 0x7ff2940b24f0 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 msgr2=0x7ff2940b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff2940b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.303+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 >> v1:172.21.15.29:6789/0 conn(0x7ff2940b1d40 legacy=0x7ff2940b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2940b1240 con 0x7ff2940b24f0 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7ff290001470 con 0x7ff2940b24f0 2023-10-08T16:22:23.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29919a700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff2940b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 >> v1:172.21.15.12:6789/0 conn(0x7ff2940b24f0 legacy=0x7ff2941590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff280004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff280004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2940d10d0 con 0x7ff280003c20 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000bba0 con 0x7ff280004d50 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28000bd60 con 0x7ff294159800 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff280004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29a19c700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29919a700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff280004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 -- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 msgr2=0x7ff280004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:23.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff294159800 0x7ff280004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 -- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff280004d50 msgr2=0x7ff2800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff280004d50 0x7ff2800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.304+0000 7ff29999b700 1 -- 172.21.15.12:0/339266981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff284009420 con 0x7ff280003c20 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff29999b700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff280004010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c1e0 tx=0x7ff290001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872d33ea34a415d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29000cb10 con 0x7ff280003c20 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29000cc70 con 0x7ff280003c20 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff298999700 1 -- 172.21.15.12:0/339266981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290005920 con 0x7ff280003c20 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff29a99d700 1 -- 172.21.15.12:0/339266981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 msgr2=0x7ff280004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff29a99d700 1 --2- 172.21.15.12:0/339266981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff280004010 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c1e0 tx=0x7ff290001d40 comp rx=0 tx=0).stop 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.305+0000 7ff29a19c700 1 -- 172.21.15.12:0/339266981 reap_dead start 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.306+0000 7ff29a99d700 1 -- 172.21.15.12:0/339266981 shutdown_connections 2023-10-08T16:22:23.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.306+0000 7ff29a99d700 1 -- 172.21.15.12:0/339266981 >> 172.21.15.12:0/339266981 conn(0x7ff2940703a0 msgr2=0x7ff2940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.306+0000 7ff29a99d700 1 -- 172.21.15.12:0/339266981 shutdown_connections 2023-10-08T16:22:23.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.306+0000 7ff29a99d700 1 -- 172.21.15.12:0/339266981 wait complete. 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.307+0000 7ff29a99d700 1 Processor -- start 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.307+0000 7ff29a99d700 1 -- start start 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff29414cdc0 0x7ff29414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff29415dff0 0x7ff29415e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29414e3e0 con 0x7ff280003c20 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff29415e990 con 0x7ff29415dff0 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff29414d860 con 0x7ff29414cdc0 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53680/0 (socket says 172.21.15.12:53680) 2023-10-08T16:22:23.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29999b700 1 -- 172.21.15.12:0/1954568126 learned_addr learned my addr 172.21.15.12:0/1954568126 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.308+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff29414cdc0 0x7ff29414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29a19c700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff29415dff0 0x7ff29415e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff29414cdc0 msgr2=0x7ff29414d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff29414cdc0 0x7ff29414d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff29415dff0 msgr2=0x7ff29415e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff29415dff0 0x7ff29415e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29414db40 con 0x7ff280003c20 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29999b700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c7d0 tx=0x7ff290015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290000bc0 con 0x7ff280003c20 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290005d10 con 0x7ff280003c20 2023-10-08T16:22:23.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290000d20 con 0x7ff280003c20 2023-10-08T16:22:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.309+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff29414de20 con 0x7ff280003c20 2023-10-08T16:22:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.310+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29416a080 con 0x7ff280003c20 2023-10-08T16:22:23.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.311+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29404c3c0 con 0x7ff280003c20 2023-10-08T16:22:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.311+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 18) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff290004a40 con 0x7ff280003c20 2023-10-08T16:22:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.312+0000 7ff289ffb700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.312+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6069+0+0 (secure 0 0 0) 0x7ff2900856c0 con 0x7ff280003c20 2023-10-08T16:22:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.312+0000 7ff29919a700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:23.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.312+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:22:23.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.320+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff290052720 con 0x7ff280003c20 2023-10-08T16:22:23.427 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:23.427+0000 7fd522f63180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:22:23.482 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:23.481+0000 7f20690f9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:22:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.514+0000 7ff29919a700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:23.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.514+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:22:23.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.549+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2940b1520 con 0x7ff278066f80 2023-10-08T16:22:23.598 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:23.597+0000 7fd522f63180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:22:23.652 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:23.652+0000 7f20690f9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:22:23.686 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:23.685+0000 7fd522f63180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:22:23.741 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:23.741+0000 7f20690f9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:22:23.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.915+0000 7ff29919a700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:23.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:23.915+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:22:23.919 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:23.918+0000 7fd522f63180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:22:23.976 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:23.976+0000 7f20690f9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:22:24.102 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:24.101+0000 7fd522f63180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:22:24.161 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:24.160+0000 7f20690f9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:22:24.197 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:24.196+0000 7fd522f63180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:22:24.256 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:24.255+0000 7f20690f9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:22:24.362 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:24.361+0000 7fd522f63180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:22:24.422 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:24.421+0000 7f20690f9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:22:24.467 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:24.466+0000 7fd522f63180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:22:24.526 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:24.525+0000 7f20690f9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:22:24.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:24.716+0000 7ff29919a700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:24.716+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:22:24.965 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:24.964+0000 7fd522f63180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:22:25.028 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:25.028+0000 7f20690f9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:22:25.062 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:25.061+0000 7fd522f63180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:22:25.126 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:25.126+0000 7f20690f9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:22:25.155 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:25.154+0000 7fd522f63180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:22:25.221 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:25.221+0000 7f20690f9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:22:25.799 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:25.798+0000 7fd522f63180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:22:25.868 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:25.868+0000 7f20690f9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:22:25.977 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:25.976+0000 7fd522f63180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:22:26.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:26.047+0000 7f20690f9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:22:26.075 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:26.075+0000 7fd522f63180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:22:26.147 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:26.147+0000 7f20690f9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:22:26.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:26.318+0000 7ff29919a700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:22:26.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:26.318+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:22:26.377 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:26.376+0000 7fd522f63180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:22:26.448 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:26.447+0000 7f20690f9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:22:26.477 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:26.476+0000 7fd522f63180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:22:26.547 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:26.547+0000 7f20690f9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:22:27.210 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:27.209+0000 7fd522f63180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:22:27.283 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:27.283+0000 7f20690f9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:22:27.501 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:27.500+0000 7fd522f63180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:22:27.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:27.573+0000 7f20690f9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:22:27.595 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:27.594+0000 7fd522f63180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:22:27.670 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:27.669+0000 7f20690f9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:22:27.755 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:27.754+0000 7fd522f63180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:22:27.831 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:27.830+0000 7f20690f9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:22:27.863 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:27.862+0000 7fd522f63180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:22:27.942 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:27.941+0000 7f20690f9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:22:28.058 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:28.057+0000 7fd522f63180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:22:28.138 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.138+0000 7f20690f9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:22:28.153 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:28.152+0000 7fd522f63180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:22:28.234 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.233+0000 7f20690f9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:22:28.248 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:28.247+0000 7fd522f63180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:22:28.329 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.328+0000 7f20690f9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:22:28.343 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:22:28.343+0000 7fd522f63180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:22:28.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:28.404+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 19) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff290004cf0 con 0x7ff280003c20 2023-10-08T16:22:28.429 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.428+0000 7f20690f9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:22:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:28.439+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 20) v1 ==== 84468+0+0 (secure 0 0 0) 0x7ff290071f20 con 0x7ff280003c20 2023-10-08T16:22:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:28.440+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff278069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:22:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:28.440+0000 7ff289ffb700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff278069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.560+0000 7f1fde437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fda42f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fda42f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fda42f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fda42f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fda42f700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.562 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fde437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.563 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fde437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.563 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fde437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:28.563 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:22:28.561+0000 7f1fde437700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:22:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.447+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ff2900533c0 con 0x7ff280003c20 2023-10-08T16:22:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.447+0000 7ff289ffb700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff2780693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.447+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2940b1520 con 0x7ff278066f80 2023-10-08T16:22:29.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.449+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff2780693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.452+0000 7ff29919a700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff2780693b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff284006f00 tx=0x7ff2840091a0 comp rx=0 tx=0).ready entity=mgr.5833 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:29.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.514+0000 7ff289ffb700 1 -- 172.21.15.12:0/1954568126 <== mgr.5833 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff2940b1520 con 0x7ff278066f80 2023-10-08T16:22:29.515 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 msgr2=0x7ff2780693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff2780693b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff284006f00 tx=0x7ff2840091a0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 msgr2=0x7ff29414c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c7d0 tx=0x7ff290015000 comp rx=0 tx=0).stop 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 shutdown_connections 2023-10-08T16:22:29.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff278066f80 0x7ff2780693b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff280003c20 0x7ff29414c0b0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff29415dff0 0x7ff29415e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 --2- 172.21.15.12:0/1954568126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff29414cdc0 0x7ff29414d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 >> 172.21.15.12:0/1954568126 conn(0x7ff2940703a0 msgr2=0x7ff2940d0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 shutdown_connections 2023-10-08T16:22:29.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.517+0000 7ff29a99d700 1 -- 172.21.15.12:0/1954568126 wait complete. 2023-10-08T16:22:29.537 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T16:22:29.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-10-08T16:22:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.730+0000 7f332299d700 1 Processor -- start 2023-10-08T16:22:29.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.730+0000 7f332299d700 1 -- start start 2023-10-08T16:22:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 0x7f331c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f331c15b1a0 0x7f331c0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332299d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f331c0c8680 con 0x7f331c157750 2023-10-08T16:22:29.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c06a7f0 con 0x7f331c15b1a0 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331c158b30 con 0x7f331c157380 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f331c15b1a0 0x7f331c0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f331c15b1a0 0x7f331c0c6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53816/0 (socket says 172.21.15.12:53816) 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 -- 172.21.15.12:0/207157294 learned_addr learned my addr 172.21.15.12:0/207157294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332199b700 1 --2- 172.21.15.12:0/207157294 >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 0x7f331c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 -- 172.21.15.12:0/207157294 >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 msgr2=0x7f331c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 --2- 172.21.15.12:0/207157294 >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 0x7f331c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 -- 172.21.15.12:0/207157294 >> v1:172.21.15.29:6789/0 conn(0x7f331c157750 legacy=0x7f331c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332119a700 1 -- 172.21.15.12:0/207157294 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331c15b6a0 con 0x7f331c15b1a0 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.732+0000 7f332199b700 1 --2- 172.21.15.12:0/207157294 >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 0x7f331c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:29.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f332119a700 1 --2- 172.21.15.12:0/207157294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c15b1a0 0x7f331c0c6b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f331c0cd220 tx=0x7f330c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6341f535718cae60 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f3320999700 1 -- 172.21.15.12:0/207157294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00b820 con 0x7f331c15b1a0 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f3320999700 1 -- 172.21.15.12:0/207157294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c00b980 con 0x7f331c15b1a0 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f3320999700 1 -- 172.21.15.12:0/207157294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c00bd20 con 0x7f331c15b1a0 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f332299d700 1 -- 172.21.15.12:0/207157294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c15b1a0 msgr2=0x7f331c0c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.733+0000 7f332299d700 1 --2- 172.21.15.12:0/207157294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c15b1a0 0x7f331c0c6b60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f331c0cd220 tx=0x7f330c009250 comp rx=0 tx=0).stop 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 -- 172.21.15.12:0/207157294 shutdown_connections 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 --2- 172.21.15.12:0/207157294 >> v2:172.21.15.29:3300/0 conn(0x7f331c157380 0x7f331c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 --2- 172.21.15.12:0/207157294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c15b1a0 0x7f331c0c6b60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 -- 172.21.15.12:0/207157294 >> 172.21.15.12:0/207157294 conn(0x7f331c06c6a0 msgr2=0x7f331c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 -- 172.21.15.12:0/207157294 shutdown_connections 2023-10-08T16:22:29.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.734+0000 7f332299d700 1 -- 172.21.15.12:0/207157294 wait complete. 2023-10-08T16:22:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.735+0000 7f332299d700 1 Processor -- start 2023-10-08T16:22:29.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.735+0000 7f332299d700 1 -- start start 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f331c157380 0x7f331c159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 0x7f331c0c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c159a40 con 0x7f331c157750 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f331c0ab240 con 0x7f331c157380 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331c15a410 con 0x7f331c15b1a0 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53832/0 (socket says 172.21.15.12:53832) 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.736+0000 7f332119a700 1 -- 172.21.15.12:0/214522052 learned_addr learned my addr 172.21.15.12:0/214522052 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332199b700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f331c157380 0x7f331c159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 -- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 msgr2=0x7f331c0c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:29.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332219c700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 0x7f331c0c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 0x7f331c0c1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 -- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f331c157380 msgr2=0x7f331c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f331c157380 0x7f331c159ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 -- 172.21.15.12:0/214522052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330c0094f0 con 0x7f331c157750 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332219c700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 0x7f331c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332119a700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f330c0030c0 tx=0x7f330c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c011e60 con 0x7f331c157750 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f330c01b680 con 0x7f331c157750 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f331c148030 con 0x7f331c157750 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.737+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f330c01ba20 con 0x7f331c157750 2023-10-08T16:22:29.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.738+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331c159110 con 0x7f331c157750 2023-10-08T16:22:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.738+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f331c04c3c0 con 0x7f331c157750 2023-10-08T16:22:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.739+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f330c01c450 con 0x7f331c157750 2023-10-08T16:22:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.740+0000 7f3311ffb700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 0x7f3300069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.740+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6327+0+0 (secure 0 0 0) 0x7f330c0862e0 con 0x7f331c157750 2023-10-08T16:22:29.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.741+0000 7f332199b700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 0x7f3300069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:29.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.741+0000 7f332199b700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 0x7f3300069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3318006fd0 tx=0x7f3318008040 comp rx=0 tx=0).ready entity=mgr.5833 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.745+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f330c0534c0 con 0x7f331c157750 2023-10-08T16:22:29.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:29.975+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7f331c0c2ee0 con 0x7f3300066dd0 2023-10-08T16:22:30.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.034+0000 7f3311ffb700 1 -- 172.21.15.12:0/214522052 <== mgr.5833 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f331c0c2ee0 con 0x7f3300066dd0 2023-10-08T16:22:30.035 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T16:22:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.036+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 msgr2=0x7f3300069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.036+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 0x7f3300069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3318006fd0 tx=0x7f3318008040 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.036+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 msgr2=0x7f331c147350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.036+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f330c0030c0 tx=0x7f330c016000 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.036+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 shutdown_connections 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f3300066dd0 0x7f3300069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f331c15b1a0 0x7f331c0c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f331c157380 0x7f331c159ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 --2- 172.21.15.12:0/214522052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f331c157750 0x7f331c147350 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 >> 172.21.15.12:0/214522052 conn(0x7f331c06c6a0 msgr2=0x7f331c153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 shutdown_connections 2023-10-08T16:22:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.037+0000 7f332299d700 1 -- 172.21.15.12:0/214522052 wait complete. 2023-10-08T16:22:30.055 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T16:22:30.055 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-08-16_23_00 in ~30s... 2023-10-08T16:22:30.055 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-08-16_24_00 in ~90s... 2023-10-08T16:22:30.056 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-10-08T16:22:30.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-08T16:22:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.246+0000 7f093a39d700 1 Processor -- start 2023-10-08T16:22:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.246+0000 7f093a39d700 1 -- start start 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.247+0000 7f093a39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0934153660 0x7f09340c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.247+0000 7f093a39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153a30 0x7f0934156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.247+0000 7f093a39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09340c2200 con 0x7f09340c8980 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.247+0000 7f093a39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0934157250 con 0x7f0934153660 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.247+0000 7f093a39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09340c15f0 con 0x7f0934153a30 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0934153660 0x7f09340c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0934153660 0x7f09340c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53848/0 (socket says 172.21.15.12:53848) 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 -- 172.21.15.12:0/934197381 learned_addr learned my addr 172.21.15.12:0/934197381 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f0938b9a700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153a30 0x7f0934156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 -- 172.21.15.12:0/934197381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153a30 msgr2=0x7f0934156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:22:30.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153a30 0x7f0934156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 -- 172.21.15.12:0/934197381 >> v1:172.21.15.29:6789/0 conn(0x7f09340c8980 legacy=0x7f09340c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 -- 172.21.15.12:0/934197381 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340c18d0 con 0x7f0934153660 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.248+0000 7f093939b700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0934153660 0x7f09340c0ef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f09300099b0 tx=0x7f0930009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b1fba3d737aa1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f092bfff700 1 -- 172.21.15.12:0/934197381 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0930009ea0 con 0x7f0934153660 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f092bfff700 1 -- 172.21.15.12:0/934197381 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093000b860 con 0x7f0934153660 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f092bfff700 1 -- 172.21.15.12:0/934197381 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000bc00 con 0x7f0934153660 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 -- 172.21.15.12:0/934197381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0934153660 msgr2=0x7f09340c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0934153660 0x7f09340c0ef0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f09300099b0 tx=0x7f0930009250 comp rx=0 tx=0).stop 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 -- 172.21.15.12:0/934197381 shutdown_connections 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0934153660 0x7f09340c0ef0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 --2- 172.21.15.12:0/934197381 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153a30 0x7f0934156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.249+0000 7f093a39d700 1 -- 172.21.15.12:0/934197381 >> 172.21.15.12:0/934197381 conn(0x7f093406c6a0 msgr2=0x7f093406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.250+0000 7f093a39d700 1 -- 172.21.15.12:0/934197381 shutdown_connections 2023-10-08T16:22:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.250+0000 7f093a39d700 1 -- 172.21.15.12:0/934197381 wait complete. 2023-10-08T16:22:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.251+0000 7f093a39d700 1 Processor -- start 2023-10-08T16:22:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.251+0000 7f093a39d700 1 -- start start 2023-10-08T16:22:30.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153660 0x7f0934154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0934153a30 0x7f09340b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09341556e0 con 0x7f09340c8980 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0934154ad0 con 0x7f0934153a30 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093a39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0934154db0 con 0x7f0934153660 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53862/0 (socket says 172.21.15.12:53862) 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f093939b700 1 -- 172.21.15.12:0/2665869073 learned_addr learned my addr 172.21.15.12:0/2665869073 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.252+0000 7f0938b9a700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153660 0x7f0934154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f0939b9c700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0934153a30 0x7f09340b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 -- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153660 msgr2=0x7f0934154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153660 0x7f0934154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 -- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0934153a30 msgr2=0x7f09340b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0934153a30 0x7f09340b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 -- 172.21.15.12:0/2665869073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09300094f0 con 0x7f09340c8980 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093939b700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0934067f90 tx=0x7f0930018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093000bbe0 con 0x7f09340c8980 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09300233f0 con 0x7f09340c8980 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09300237b0 con 0x7f09340c8980 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0934155090 con 0x7f09340c8980 2023-10-08T16:22:30.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.253+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09341578e0 con 0x7f09340c8980 2023-10-08T16:22:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.254+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093404c3c0 con 0x7f09340c8980 2023-10-08T16:22:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.255+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 21) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0930023be0 con 0x7f09340c8980 2023-10-08T16:22:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.256+0000 7f09297fa700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 0x7f0918069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:22:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.256+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6327+0+0 (secure 0 0 0) 0x7f0930085cf0 con 0x7f09340c8980 2023-10-08T16:22:30.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.256+0000 7f0938b9a700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 0x7f0918069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:22:30.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.257+0000 7f0938b9a700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 0x7f0918069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f09340b2000 tx=0x7f0924008040 comp rx=0 tx=0).ready entity=mgr.5833 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:22:30.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.261+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0930052ed0 con 0x7f09340c8980 2023-10-08T16:22:30.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.452+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 22) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f09300532a0 con 0x7f09340c8980 2023-10-08T16:22:30.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.496+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0934155820 con 0x7f0918066dd0 2023-10-08T16:22:30.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.504+0000 7f09297fa700 1 -- 172.21.15.12:0/2665869073 <== mgr.5833 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f0924009db0 con 0x7f0918066dd0 2023-10-08T16:22:30.505 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:22:30.505 INFO:teuthology.orchestra.run.smithi012.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-08T16:22:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 msgr2=0x7f0918069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 0x7f0918069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f09340b2000 tx=0x7f0924008040 comp rx=0 tx=0).stop 2023-10-08T16:22:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 msgr2=0x7f0934146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:22:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f0934067f90 tx=0x7f0930018000 comp rx=0 tx=0).stop 2023-10-08T16:22:30.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 shutdown_connections 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0918066dd0 0x7f0918069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09340c8980 0x7f0934146af0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0934153a30 0x7f09340b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 --2- 172.21.15.12:0/2665869073 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0934153660 0x7f0934154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 >> 172.21.15.12:0/2665869073 conn(0x7f093406c6a0 msgr2=0x7f09340aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 shutdown_connections 2023-10-08T16:22:30.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:22:30.506+0000 7f093a39d700 1 -- 172.21.15.12:0/2665869073 wait complete. 2023-10-08T16:22:30.525 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-10-08T16:22:30.525 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-10-08T16:22:30.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:30.525 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:30.564 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:30.564 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:30.564 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:31.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:31.565 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:31.606 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:31.606 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:31.607 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:32.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:32.608 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:32.651 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:32.651 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:32.651 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:33.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:33.653 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:33.696 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:33.696 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:33.696 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:34.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:34.697 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:34.740 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:34.741 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:34.741 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:35.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:35.742 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:35.785 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:35.785 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:35.786 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:36.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:36.787 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:36.830 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:36.830 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:36.830 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:37.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:37.831 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:37.875 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:37.875 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:37.875 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:38.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:38.876 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:38.920 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:38.920 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:38.920 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:39.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:39.922 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:39.965 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:39.965 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:39.965 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:40.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:40.967 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:41.010 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:41.011 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:41.011 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:42.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:42.012 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:42.055 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:42.055 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:42.056 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:43.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:43.056 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:43.100 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:43.100 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:43.100 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:44.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:44.101 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:44.145 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:44.145 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:44.145 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:45.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:45.146 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:45.190 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:45.190 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:45.190 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:46.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:46.191 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:46.235 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:46.235 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:46.235 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:46.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:22:46.816 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:22:47.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:47.237 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:47.279 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:47.280 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:47.280 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:48.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:48.281 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:48.324 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:48.324 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:48.324 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:49.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:49.326 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:49.369 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:49.369 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:49.370 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:50.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:50.371 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:50.415 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:50.415 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:50.415 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:51.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:51.416 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:51.459 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:51.459 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:51.459 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:52.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:52.461 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:52.504 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:52.504 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:52.504 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:53.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:53.505 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:53.548 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:53.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:53.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:54.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:54.549 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:54.593 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:54.593 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:54.593 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:55.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:55.595 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:55.638 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:55.638 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:55.638 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:56.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:56.639 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:56.681 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:56.682 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:56.682 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:57.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:57.683 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:57.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:57.727 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:57.727 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:58.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:58.728 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:58.772 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:58.772 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:58.772 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:22:59.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:22:59.773 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:22:59.816 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:22:59.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:22:59.816 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:00.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:23:00.047+0000 7f1fcd415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:23:00.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:23:00.047+0000 7f1fcd415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:23:00.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:23:00.047+0000 7f1fcd415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:23:00.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:23:00.047+0000 7f1fcd415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:23:00.048 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:23:00.047+0000 7f1fcd415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:23:00.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:00.817 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:00.860 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:00.861 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:00.861 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:00.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:00.861 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-08-16_23_00_UTC'] 2023-10-08T16:23:00.861 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696782150.055739, now = 1696782180.8615403, timo = 30 2023-10-08T16:23:01.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:01.862 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:01.904 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:01.905 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:01.907 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:01.907 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:02.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:02.908 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:02.951 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:02.952 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:02.952 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:02.952 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:03.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:03.953 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:03.995 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:03.996 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:03.996 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:03.996 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:04.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:04.997 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:05.039 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:05.040 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:05.040 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:05.041 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:06.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:06.042 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:06.084 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:06.086 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:06.086 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:06.086 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:07.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:07.087 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:07.130 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:07.131 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:07.131 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:07.131 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:08.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:08.132 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:08.175 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:08.176 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:08.177 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:08.177 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:09.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:09.178 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:09.220 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:09.221 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:09.221 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:09.221 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:10.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:10.223 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:10.265 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:10.266 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:10.266 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:10.266 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:11.267 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:11.268 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:11.310 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:11.311 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:11.311 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:11.311 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:12.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:12.312 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:12.355 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:12.356 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:12.356 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:12.356 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:13.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:13.357 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:13.398 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:13.399 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:13.400 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:13.400 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:14.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:14.401 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:14.443 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:14.444 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:14.444 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:14.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:15.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:15.445 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:15.488 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:15.489 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:15.489 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:15.489 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:16.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:16.490 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:16.534 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:16.535 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:16.535 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:16.535 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:16.927 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:16.932 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:17.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:17.537 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:17.579 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:17.580 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:17.580 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:17.580 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:18.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:18.581 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:18.623 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:18.625 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:18.625 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:18.625 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:19.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:19.626 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:19.668 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:19.669 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:19.669 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:19.669 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:20.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:20.670 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:20.712 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:20.713 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:20.714 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:20.714 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:21.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:21.715 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:21.757 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:21.758 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:21.758 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:21.758 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:22.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:22.760 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:22.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:22.803 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:22.803 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:22.803 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:23.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:23.804 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:23.847 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:23.848 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:23.848 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:23.848 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:24.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:24.849 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:24.891 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:24.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:24.892 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:24.892 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:25.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:25.893 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:25.936 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:25.937 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:25.937 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:25.937 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:26.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:26.938 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:26.980 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:26.981 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:26.981 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:26.981 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:27.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:27.982 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:28.026 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:28.026 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:28.026 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:28.026 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:29.027 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:29.027 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:29.070 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:29.071 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:29.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:29.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:30.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:30.072 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:30.114 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:30.115 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:30.115 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:30.115 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:31.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:31.117 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:31.161 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:31.161 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:31.161 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:31.161 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:32.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:32.162 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:32.204 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:32.205 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:32.205 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:32.205 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:33.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:33.206 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:33.249 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:33.250 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:33.250 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:33.250 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:34.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:34.251 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:34.294 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:34.295 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:34.295 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:34.295 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:35.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:35.297 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:35.339 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:35.340 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:35.340 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:35.340 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:36.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:36.342 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:36.386 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:36.386 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:36.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:36.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:37.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:37.388 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:37.430 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:37.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:37.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:37.431 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:38.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:38.432 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:38.474 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:38.475 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:38.476 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:38.476 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:39.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:39.477 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:39.519 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:39.520 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:39.520 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:39.520 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:40.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:40.522 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:40.564 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:40.565 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:40.565 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:40.565 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:41.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:41.566 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:41.608 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:41.609 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:41.609 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:41.610 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:42.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:42.611 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:42.653 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:42.654 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:42.654 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:42.654 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:43.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:43.774 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:43.816 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:43.817 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:43.817 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:43.817 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:44.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:44.818 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:44.860 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:44.861 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:44.861 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:44.861 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:45.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:45.863 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:45.905 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:45.906 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:45.906 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:45.906 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:46.907 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:46.907 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:46.949 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:46.950 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:46.951 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:46.951 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:47.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:47.058 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:23:47.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:47.952 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:47.994 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:47.995 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:47.995 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:47.995 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:48.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:48.997 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:49.040 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:49.041 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:49.041 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:49.041 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:50.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:50.042 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:50.085 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:50.086 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:50.086 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:50.086 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:51.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:51.087 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:51.129 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:51.133 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:51.133 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:51.133 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:52.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:52.135 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:52.178 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:52.179 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:52.179 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:52.179 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:53.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:53.180 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:53.223 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:53.224 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:53.224 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:53.224 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:54.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:54.225 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:54.267 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:54.268 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:54.268 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:54.268 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:55.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:55.269 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:55.312 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:55.313 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:55.313 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:55.313 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:56.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:56.314 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:56.358 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:56.359 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:56.359 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:56.359 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:57.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:57.360 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:57.402 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:57.403 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:57.403 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:57.403 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:58.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:58.405 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:58.447 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:58.448 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:58.448 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:58.448 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:23:59.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:23:59.449 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:23:59.492 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:23:59.493 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:23:59.493 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:23:59.493 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:24:00.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:00.494 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:24:00.536 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:24:00.536 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_24_00_UTC 2023-10-08T16:24:00.537 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_24_00_UTC', 'scheduled-2023-10-08-16_23_00_UTC'} 2023-10-08T16:24:00.537 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-08-16_24_00_UTC'} 2023-10-08T16:24:00.537 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:24:00.537 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-08-16_24_00_UTC'] 2023-10-08T16:24:00.537 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696782150.055739, now = 1696782240.5377762, timo = 90 2023-10-08T16:24:01.539 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-08T16:24:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.742+0000 7f414999d700 1 Processor -- start 2023-10-08T16:24:01.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.742+0000 7f414999d700 1 -- start start 2023-10-08T16:24:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.743+0000 7f414999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41440cb450 0x7f414415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.743+0000 7f414999d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414415d8d0 con 0x7f4144143070 2023-10-08T16:24:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.743+0000 7f414999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414415d2f0 con 0x7f4144142ca0 2023-10-08T16:24:01.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.743+0000 7f414999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41440cc630 con 0x7f41440cb450 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f414919c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4144143070 0x7f414406dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59418/0 (socket says 172.21.15.12:59418) 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f414919c700 1 -- 172.21.15.12:0/2986607695 learned_addr learned my addr 172.21.15.12:0/2986607695 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f4143fff700 1 --2- 172.21.15.12:0/2986607695 >> v2:172.21.15.29:3300/0 conn(0x7f41440cb450 0x7f414415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830460203 0 0) 0x7f414415d8d0 con 0x7f4144143070 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4134003570 con 0x7f4144143070 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2209098300 0 0) 0x7f414415d2f0 con 0x7f4144142ca0 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f414415d8d0 con 0x7f4144142ca0 2023-10-08T16:24:01.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000383108 0 0) 0x7f4134003570 con 0x7f4144143070 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 >> v2:172.21.15.29:3300/0 conn(0x7f41440cb450 msgr2=0x7f414415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 --2- 172.21.15.12:0/2986607695 >> v2:172.21.15.29:3300/0 conn(0x7f41440cb450 0x7f414415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 >> v1:172.21.15.29:6789/0 conn(0x7f4144142ca0 legacy=0x7f41440cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414415d560 con 0x7f4144143070 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f413c0017f0 con 0x7f4144143070 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 >> v1:172.21.15.12:6789/0 conn(0x7f4144143070 legacy=0x7f414406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:01.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4134003c40 0x7f4134004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.744+0000 7f41437fe700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4134004810 0x7f4134004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f41437fe700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f413400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440cc630 con 0x7f4134005210 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413400c130 con 0x7f4134004810 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413400c2c0 con 0x7f4134003c40 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f413400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f4143fff700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4134004810 0x7f4134004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414899b700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4134003c40 0x7f4134004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 -- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4134003c40 msgr2=0x7f4134004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4134003c40 0x7f4134004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 -- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4134004810 msgr2=0x7f4134004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:01.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4134004810 0x7f4134004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 -- 172.21.15.12:0/2986607695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134003570 con 0x7f4134005210 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414899b700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4134003c40 0x7f4134004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.745+0000 7f414919c700 1 -- 172.21.15.12:0/2986607695 reap_dead start 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414919c700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f413400ba60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a830 tx=0x7f413c0020a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f98814f2c41718b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c002110 con 0x7f4134005210 2023-10-08T16:24:01.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0071a0 con 0x7f4134005210 2023-10-08T16:24:01.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f41437fe700 1 -- 172.21.15.12:0/2986607695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c007560 con 0x7f4134005210 2023-10-08T16:24:01.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 -- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 msgr2=0x7f413400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:01.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f413400ba60 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f413c00a830 tx=0x7f413c0020a0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 -- 172.21.15.12:0/2986607695 shutdown_connections 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 --2- 172.21.15.12:0/2986607695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f413400ba60 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 -- 172.21.15.12:0/2986607695 >> 172.21.15.12:0/2986607695 conn(0x7f4144067c80 msgr2=0x7f4144068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.746+0000 7f414999d700 1 -- 172.21.15.12:0/2986607695 shutdown_connections 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.747+0000 7f414999d700 1 -- 172.21.15.12:0/2986607695 wait complete. 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.748+0000 7f414999d700 1 Processor -- start 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.748+0000 7f414999d700 1 -- start start 2023-10-08T16:24:01.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41440b25d0 0x7f41440ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41440b2a40 0x7f41440aba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440aeff0 con 0x7f4134005210 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440af9c0 con 0x7f41440b2a40 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41440ae3e0 con 0x7f41440b25d0 2023-10-08T16:24:01.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60938/0 (socket says 172.21.15.12:60938) 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 -- 172.21.15.12:0/251274051 learned_addr learned my addr 172.21.15.12:0/251274051 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f4143fff700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41440b25d0 0x7f41440ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414919c700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41440b2a40 0x7f41440aba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 -- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41440b25d0 msgr2=0x7f41440ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41440b25d0 0x7f41440ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 -- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41440b2a40 msgr2=0x7f41440aba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41440b2a40 0x7f41440aba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.749+0000 7f414899b700 1 -- 172.21.15.12:0/251274051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440ae6c0 con 0x7f4134005210 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f414899b700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f413800fc00 tx=0x7f4138007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800d920 con 0x7f4134005210 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800da80 con 0x7f4134005210 2023-10-08T16:24:01.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41440ae9a0 con 0x7f4134005210 2023-10-08T16:24:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800de00 con 0x7f4134005210 2023-10-08T16:24:01.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.750+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41440adf90 con 0x7f4134005210 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.751+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f414404c3c0 con 0x7f4134005210 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.752+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f4138006a30 con 0x7f4134005210 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.753+0000 7f4140ff9700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 0x7f4128069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.753+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f4138084b00 con 0x7f4134005210 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.753+0000 7f4143fff700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 0x7f4128069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.754+0000 7f4143fff700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 0x7f4128069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f414406c080 tx=0x7f4130008040 comp rx=0 tx=0).ready entity=mgr.5833 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:01.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.757+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4138086e60 con 0x7f4134005210 2023-10-08T16:24:01.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:01.987+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 --> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f41440af130 con 0x7f41280670a0 2023-10-08T16:24:02.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.050+0000 7f4140ff9700 1 -- 172.21.15.12:0/251274051 <== mgr.5833 v2:172.21.15.12:6834/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f41300099f0 con 0x7f41280670a0 2023-10-08T16:24:02.050 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path snap_test_dir1 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 msgr2=0x7f4128069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 0x7f4128069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f414406c080 tx=0x7f4130008040 comp rx=0 tx=0).stop 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 msgr2=0x7f41440af480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f413800fc00 tx=0x7f4138007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 shutdown_connections 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f41280670a0 0x7f4128069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4134005210 0x7f41440af480 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41440b2a40 0x7f41440aba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 --2- 172.21.15.12:0/251274051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41440b25d0 0x7f41440ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 >> 172.21.15.12:0/251274051 conn(0x7f4144067c80 msgr2=0x7f414413fd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 shutdown_connections 2023-10-08T16:24:02.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.053+0000 7f414999d700 1 -- 172.21.15.12:0/251274051 wait complete. 2023-10-08T16:24:02.071 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-08T16:24:02.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:02.071 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:24:02.110 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:24:02.111 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_24_00_UTC 2023-10-08T16:24:02.112 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_23_00_UTC 2023-10-08T16:24:02.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:02.112 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_23_00_UTC) 2023-10-08T16:24:02.197 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_24_00_UTC 2023-10-08T16:24:02.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:02.198 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_24_00_UTC) 2023-10-08T16:24:02.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:02.283 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T16:24:02.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:24:02.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.602+0000 7f83795ff700 1 Processor -- start 2023-10-08T16:24:02.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.603+0000 7f83795ff700 1 -- start start 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8374155b60 0x7f83740b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8374155f30 0x7f8374156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83741599d0 0x7f8374159e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837415a3b0 con 0x7f8374155b60 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83741575a0 con 0x7f8374155f30 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83795ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8374156990 con 0x7f83741599d0 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f8372ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8374155b60 0x7f83740b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f8372ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8374155b60 0x7f83740b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60762/0 (socket says 172.21.15.12:60762) 2023-10-08T16:24:02.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f8372ffd700 1 -- 172.21.15.12:0/2122124814 learned_addr learned my addr 172.21.15.12:0/2122124814 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:02.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83737fe700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83741599d0 0x7f8374159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.605+0000 7f83727fc700 1 --2- 172.21.15.12:0/2122124814 >> v2:172.21.15.29:3300/0 conn(0x7f8374155f30 0x7f8374156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 -- 172.21.15.12:0/2122124814 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83741599d0 msgr2=0x7f8374159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:02.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83741599d0 0x7f8374159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 -- 172.21.15.12:0/2122124814 >> v2:172.21.15.29:3300/0 conn(0x7f8374155f30 msgr2=0x7f8374156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:02.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 --2- 172.21.15.12:0/2122124814 >> v2:172.21.15.29:3300/0 conn(0x7f8374155f30 0x7f8374156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 -- 172.21.15.12:0/2122124814 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374156c70 con 0x7f8374155b60 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8372ffd700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155b60 0x7f83740b0730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2450 tx=0x7f836400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51b12f074c1a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8371ffb700 1 -- 172.21.15.12:0/2122124814 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836400db00 con 0x7f8374155b60 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8371ffb700 1 -- 172.21.15.12:0/2122124814 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836400dc60 con 0x7f8374155b60 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.606+0000 7f8371ffb700 1 -- 172.21.15.12:0/2122124814 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8364019480 con 0x7f8374155b60 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 -- 172.21.15.12:0/2122124814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155b60 msgr2=0x7f83740b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155b60 0x7f83740b0730 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2450 tx=0x7f836400b4f0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 -- 172.21.15.12:0/2122124814 shutdown_connections 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83741599d0 0x7f8374159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 --2- 172.21.15.12:0/2122124814 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155b60 0x7f83740b0730 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 --2- 172.21.15.12:0/2122124814 >> v2:172.21.15.29:3300/0 conn(0x7f8374155f30 0x7f8374156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 -- 172.21.15.12:0/2122124814 >> 172.21.15.12:0/2122124814 conn(0x7f837406d170 msgr2=0x7f83740cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:02.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 -- 172.21.15.12:0/2122124814 shutdown_connections 2023-10-08T16:24:02.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.607+0000 7f83795ff700 1 -- 172.21.15.12:0/2122124814 wait complete. 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.609+0000 7f83795ff700 1 Processor -- start 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.609+0000 7f83795ff700 1 -- start start 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8374155b60 0x7f837414a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83741599d0 0x7f837414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837416cdc0 con 0x7f8374155f30 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837414adc0 con 0x7f83741599d0 2023-10-08T16:24:02.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83795ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8374169ef0 con 0x7f8374155b60 2023-10-08T16:24:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83727fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83737fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83741599d0 0x7f837414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83727fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60766/0 (socket says 172.21.15.12:60766) 2023-10-08T16:24:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f8372ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8374155b60 0x7f837414a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.610+0000 7f83727fc700 1 -- 172.21.15.12:0/3288458260 learned_addr learned my addr 172.21.15.12:0/3288458260 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 -- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8374155b60 msgr2=0x7f837414a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8374155b60 0x7f837414a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 -- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83741599d0 msgr2=0x7f837414d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83741599d0 0x7f837414d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 -- 172.21.15.12:0/3288458260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836400b790 con 0x7f8374155f30 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83727fc700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f836800ec50 tx=0x7f83680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800c850 con 0x7f8374155f30 2023-10-08T16:24:02.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800c9b0 con 0x7f8374155f30 2023-10-08T16:24:02.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836800cd70 con 0x7f8374155f30 2023-10-08T16:24:02.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837414e840 con 0x7f8374155f30 2023-10-08T16:24:02.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.611+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8374151040 con 0x7f8374155f30 2023-10-08T16:24:02.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.612+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837404c3c0 con 0x7f8374155f30 2023-10-08T16:24:02.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.613+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 24) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f8368013680 con 0x7f8374155f30 2023-10-08T16:24:02.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.615+0000 7f835affd700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 0x7f8360069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:02.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.615+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f8368084c90 con 0x7f8374155f30 2023-10-08T16:24:02.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.616+0000 7f8372ffd700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 0x7f8360069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:02.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.616+0000 7f8372ffd700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 0x7f8360069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2450 tx=0x7f836401b000 comp rx=0 tx=0).ready entity=mgr.5833 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:02.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.619+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8368051aa0 con 0x7f8374155f30 2023-10-08T16:24:02.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:02.876+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8374156fe0 con 0x7f8374155f30 2023-10-08T16:24:03.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.183+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f83680840a0 con 0x7f8374155f30 2023-10-08T16:24:03.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.184+0000 7f835affd700 1 -- 172.21.15.12:0/3288458260 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v25) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8368051aa0 con 0x7f8374155f30 2023-10-08T16:24:03.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 msgr2=0x7f8360069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 0x7f8360069550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2450 tx=0x7f836401b000 comp rx=0 tx=0).stop 2023-10-08T16:24:03.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 msgr2=0x7f83741699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f836800ec50 tx=0x7f83680091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 shutdown_connections 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f83600670a0 0x7f8360069550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83741599d0 0x7f837414d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8374155b60 0x7f837414a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 --2- 172.21.15.12:0/3288458260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8374155f30 0x7f83741699b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 >> 172.21.15.12:0/3288458260 conn(0x7f837406d170 msgr2=0x7f8374069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 shutdown_connections 2023-10-08T16:24:03.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.188+0000 7f83795ff700 1 -- 172.21.15.12:0/3288458260 wait complete. 2023-10-08T16:24:03.206 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:24:03.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:03.295 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:03.375 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:24:03.376 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:24:03.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:03.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:03.465 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:24:03.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:03.466 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:24:03.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.746+0000 7f88a759e700 1 Processor -- start 2023-10-08T16:24:03.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.746+0000 7f88a759e700 1 -- start start 2023-10-08T16:24:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.748+0000 7f88a759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88a813fb20 0x7f88a815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:03.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a815ae70 con 0x7f88a806aaa0 2023-10-08T16:24:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a806af60 con 0x7f88a813fef0 2023-10-08T16:24:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a806b240 con 0x7f88a813fb20 2023-10-08T16:24:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f88a813fb20 0x7f88a815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a6d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f88a806aaa0 0x7f88a80c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52456/0 (socket says 172.21.15.12:52456) 2023-10-08T16:24:03.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a6d9d700 1 -- 172.21.15.12:0/506769683 learned_addr learned my addr 172.21.15.12:0/506769683 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a659c700 1 -- 172.21.15.12:0/506769683 >> v1:172.21.15.29:6789/0 conn(0x7f88a813fef0 legacy=0x7f88a80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a659c700 1 -- 172.21.15.12:0/506769683 >> v1:172.21.15.12:6789/0 conn(0x7f88a806aaa0 legacy=0x7f88a80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a659c700 1 -- 172.21.15.12:0/506769683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a806b520 con 0x7f88a813fb20 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.749+0000 7f88a559a700 1 -- 172.21.15.12:0/506769683 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697277105 0 0) 0x7f88a806af60 con 0x7f88a813fef0 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.750+0000 7f88a659c700 1 --2- 172.21.15.12:0/506769683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a815a930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f88980098e0 tx=0x7f88980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325a0e3c2351884a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.750+0000 7f88a559a700 1 -- 172.21.15.12:0/506769683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898009e80 con 0x7f88a813fb20 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.750+0000 7f88a559a700 1 -- 172.21.15.12:0/506769683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889800b860 con 0x7f88a813fb20 2023-10-08T16:24:03.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.750+0000 7f88a559a700 1 -- 172.21.15.12:0/506769683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889800bbe0 con 0x7f88a813fb20 2023-10-08T16:24:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 -- 172.21.15.12:0/506769683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 msgr2=0x7f88a815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 --2- 172.21.15.12:0/506769683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a815a930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f88980098e0 tx=0x7f88980091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 -- 172.21.15.12:0/506769683 shutdown_connections 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 --2- 172.21.15.12:0/506769683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a815a930 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 -- 172.21.15.12:0/506769683 >> 172.21.15.12:0/506769683 conn(0x7f88a806d170 msgr2=0x7f88a80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 -- 172.21.15.12:0/506769683 shutdown_connections 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.751+0000 7f88a759e700 1 -- 172.21.15.12:0/506769683 wait complete. 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.752+0000 7f88a759e700 1 Processor -- start 2023-10-08T16:24:03.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.752+0000 7f88a759e700 1 -- start start 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f88a806aaa0 0x7f88a813dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88a813fef0 0x7f88a80c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8169a40 con 0x7f88a813fb20 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8158170 con 0x7f88a813fef0 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.753+0000 7f88a759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a8158450 con 0x7f88a806aaa0 2023-10-08T16:24:03.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f88a806aaa0 0x7f88a813dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60790/0 (socket says 172.21.15.12:60790) 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 -- 172.21.15.12:0/194732126 learned_addr learned my addr 172.21.15.12:0/194732126 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a6d9d700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88a813fef0 0x7f88a80c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f88a806aaa0 msgr2=0x7f88a813dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f88a806aaa0 0x7f88a813dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88a813fef0 msgr2=0x7f88a80c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88a813fef0 0x7f88a80c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 -- 172.21.15.12:0/194732126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898009420 con 0x7f88a813fb20 2023-10-08T16:24:03.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.754+0000 7f88a5d9b700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f889c001f00 tx=0x7f889c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.755+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c011590 con 0x7f88a813fb20 2023-10-08T16:24:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.755+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c0116f0 con 0x7f88a813fb20 2023-10-08T16:24:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.755+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c011ab0 con 0x7f88a813fb20 2023-10-08T16:24:03.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.755+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a8158730 con 0x7f88a813fb20 2023-10-08T16:24:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.755+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a813e120 con 0x7f88a813fb20 2023-10-08T16:24:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.756+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a804c3c0 con 0x7f88a813fb20 2023-10-08T16:24:03.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.757+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f889c01b3b0 con 0x7f88a813fb20 2023-10-08T16:24:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.758+0000 7f88967fc700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 0x7f8888069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.759+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f889c083e60 con 0x7f88a813fb20 2023-10-08T16:24:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.759+0000 7f88a659c700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 msgr2=0x7f8888069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:03.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.759+0000 7f88a659c700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 0x7f8888069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:03.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.766+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f889c050c70 con 0x7f88a813fb20 2023-10-08T16:24:03.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.960+0000 7f88a659c700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 msgr2=0x7f8888069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:03.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:03.960+0000 7f88a659c700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 0x7f8888069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:04.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.014+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88a806b800 con 0x7f88a813fb20 2023-10-08T16:24:04.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.015+0000 7f88967fc700 1 -- 172.21.15.12:0/194732126 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f889c017070 con 0x7f88a813fb20 2023-10-08T16:24:04.015 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:04.015 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:24:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 msgr2=0x7f8888069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 0x7f8888069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 msgr2=0x7f88a80c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f889c001f00 tx=0x7f889c007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 shutdown_connections 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f8888067050 0x7f8888069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f88a813fef0 0x7f88a80c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f88a806aaa0 0x7f88a813dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 --2- 172.21.15.12:0/194732126 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f88a813fb20 0x7f88a80c0ed0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 >> 172.21.15.12:0/194732126 conn(0x7f88a806d170 msgr2=0x7f88a815f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:04.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 shutdown_connections 2023-10-08T16:24:04.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.017+0000 7f88a759e700 1 -- 172.21.15.12:0/194732126 wait complete. 2023-10-08T16:24:04.020 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:24:04.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:04.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.230+0000 7f16f8f9d700 1 Processor -- start 2023-10-08T16:24:04.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.230+0000 7f16f8f9d700 1 -- start start 2023-10-08T16:24:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.232+0000 7f16f8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 0x7f16f40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f40c7420 con 0x7f16f4070410 2023-10-08T16:24:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f8f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16f406d820 con 0x7f16f4159640 2023-10-08T16:24:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f406db00 con 0x7f16f4159a10 2023-10-08T16:24:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f37fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f16f4159640 0x7f16f406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40478/0 (socket says 172.21.15.12:40478) 2023-10-08T16:24:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f37fe700 1 -- 172.21.15.12:0/3416655328 learned_addr learned my addr 172.21.15.12:0/3416655328 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f16f4070410 0x7f16f40c78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52460/0 (socket says 172.21.15.12:52460) 2023-10-08T16:24:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f2ffd700 1 --2- 172.21.15.12:0/3416655328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 0x7f16f40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115966044 0 0) 0x7f16f406d820 con 0x7f16f4159640 2023-10-08T16:24:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16dc003570 con 0x7f16f4159640 2023-10-08T16:24:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3562842836 0 0) 0x7f16f40c7420 con 0x7f16f4070410 2023-10-08T16:24:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f406d820 con 0x7f16f4070410 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f2ffd700 1 -- 172.21.15.12:0/3416655328 >> v1:172.21.15.29:6789/0 conn(0x7f16f4159640 legacy=0x7f16f406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f2ffd700 1 -- 172.21.15.12:0/3416655328 >> v1:172.21.15.12:6789/0 conn(0x7f16f4070410 legacy=0x7f16f40c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.233+0000 7f16f2ffd700 1 -- 172.21.15.12:0/3416655328 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f406dde0 con 0x7f16f4159a10 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.234+0000 7f16f2ffd700 1 --2- 172.21.15.12:0/3416655328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 0x7f16f40ca7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009910 tx=0x7f16e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d834eada137cdf47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.234+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8011630 con 0x7f16f4159a10 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.234+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e8011790 con 0x7f16f4159a10 2023-10-08T16:24:04.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.234+0000 7f16f27fc700 1 -- 172.21.15.12:0/3416655328 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e8011b30 con 0x7f16f4159a10 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 -- 172.21.15.12:0/3416655328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 msgr2=0x7f16f40ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/3416655328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 0x7f16f40ca7b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f16e8009910 tx=0x7f16e80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 -- 172.21.15.12:0/3416655328 shutdown_connections 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/3416655328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159a10 0x7f16f40ca7b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 -- 172.21.15.12:0/3416655328 >> 172.21.15.12:0/3416655328 conn(0x7f16f406e720 msgr2=0x7f16f406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 -- 172.21.15.12:0/3416655328 shutdown_connections 2023-10-08T16:24:04.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.235+0000 7f16f8f9d700 1 -- 172.21.15.12:0/3416655328 wait complete. 2023-10-08T16:24:04.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.237+0000 7f16f8f9d700 1 Processor -- start 2023-10-08T16:24:04.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.237+0000 7f16f8f9d700 1 -- start start 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159640 0x7f16f40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16f4159a10 0x7f16f415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4155380 con 0x7f16f4070410 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16f40c4bc0 con 0x7f16f4159a10 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16f4153680 con 0x7f16f4159640 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60792/0 (socket says 172.21.15.12:60792) 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f37fe700 1 -- 172.21.15.12:0/1199924191 learned_addr learned my addr 172.21.15.12:0/1199924191 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f2ffd700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159640 0x7f16f40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.238+0000 7f16f3fff700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16f4159a10 0x7f16f415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159640 msgr2=0x7f16f40c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159640 0x7f16f40c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16f4159a10 msgr2=0x7f16f415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16f4159a10 0x7f16f415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 -- 172.21.15.12:0/1199924191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8009420 con 0x7f16f4070410 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f37fe700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f16e400c790 tx=0x7f16e4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4005b30 con 0x7f16f4070410 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e4005c90 con 0x7f16f4070410 2023-10-08T16:24:04.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16f4153960 con 0x7f16f4070410 2023-10-08T16:24:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40072e0 con 0x7f16f4070410 2023-10-08T16:24:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.239+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16f4153f20 con 0x7f16f4070410 2023-10-08T16:24:04.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.240+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16f404c3c0 con 0x7f16f4070410 2023-10-08T16:24:04.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.242+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f16e401b3b0 con 0x7f16f4070410 2023-10-08T16:24:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.244+0000 7f16db7fe700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 0x7f16e0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.244+0000 7f16f2ffd700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 msgr2=0x7f16e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:04.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.244+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f16e4083d10 con 0x7f16f4070410 2023-10-08T16:24:04.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.244+0000 7f16f2ffd700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 0x7f16e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:04.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.248+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16e404b5a0 con 0x7f16f4070410 2023-10-08T16:24:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.445+0000 7f16f2ffd700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 msgr2=0x7f16e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:04.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.445+0000 7f16f2ffd700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 0x7f16e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:04.710 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:04.511+0000 7fa63eab4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:04.710 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:04.682+0000 7fa63eab4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:04.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.452+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16f40cb2f0 con 0x7f16f4070410 2023-10-08T16:24:04.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.453+0000 7f16db7fe700 1 -- 172.21.15.12:0/1199924191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16413 (secure 0 0 0) 0x7f16e4017020 con 0x7f16f4070410 2023-10-08T16:24:04.711 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:04.711 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":71,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:23:30.208361+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:6834/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1853410443":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1938819974":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1924999226":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1060060160":"2023-10-09T16:22:28.432182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 msgr2=0x7f16e0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 0x7f16e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 msgr2=0x7f16f414c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f16e400c790 tx=0x7f16e4007ea0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 shutdown_connections 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f16e0067050 0x7f16e0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16f4070410 0x7f16f414c130 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16f4159a10 0x7f16f415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 --2- 172.21.15.12:0/1199924191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16f4159640 0x7f16f40c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 >> 172.21.15.12:0/1199924191 conn(0x7f16f406e720 msgr2=0x7f16f4158920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 shutdown_connections 2023-10-08T16:24:04.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.455+0000 7f16f8f9d700 1 -- 172.21.15.12:0/1199924191 wait complete. 2023-10-08T16:24:04.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:22:05.438150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:22:06.210776+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:24:04.715 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:24:04.715 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:04.585+0000 7f55c9672180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:04.764 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:04.765+0000 7f55c9672180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:04.770 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:04.770+0000 7fa63eab4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:04.855 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:04.855+0000 7f55c9672180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.908+0000 7f12d359e700 1 Processor -- start 2023-10-08T16:24:04.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.909+0000 7f12d359e700 1 -- start start 2023-10-08T16:24:04.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 0x7f12d4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 0x7f12d415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d415af60 con 0x7f12d40cea00 2023-10-08T16:24:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d415d010 con 0x7f12d415de50 2023-10-08T16:24:04.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d415b240 con 0x7f12d4153a00 2023-10-08T16:24:04.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.910+0000 7f12d1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 0x7f12d415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d2d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f12d40cea00 0x7f12d40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40484/0 (socket says 172.21.15.12:40484) 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d2d9d700 1 -- 172.21.15.12:0/2011924082 learned_addr learned my addr 172.21.15.12:0/2011924082 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 --2- 172.21.15.12:0/2011924082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 0x7f12d4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d159a700 1 -- 172.21.15.12:0/2011924082 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3281126431 0 0) 0x7f12d415af60 con 0x7f12d40cea00 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d159a700 1 -- 172.21.15.12:0/2011924082 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12bc003570 con 0x7f12d40cea00 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 -- 172.21.15.12:0/2011924082 >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 msgr2=0x7f12d415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 --2- 172.21.15.12:0/2011924082 >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 0x7f12d415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 -- 172.21.15.12:0/2011924082 >> v1:172.21.15.29:6789/0 conn(0x7f12d40cea00 legacy=0x7f12d40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 -- 172.21.15.12:0/2011924082 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d415b520 con 0x7f12d4153a00 2023-10-08T16:24:04.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d1d9b700 1 --2- 172.21.15.12:0/2011924082 >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 0x7f12d415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.911+0000 7f12d259c700 1 --2- 172.21.15.12:0/2011924082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 0x7f12d4153dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12c40098e0 tx=0x7f12c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe75df255f7a13e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.912+0000 7f12d159a700 1 -- 172.21.15.12:0/2011924082 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011630 con 0x7f12d4153a00 2023-10-08T16:24:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.912+0000 7f12d159a700 1 -- 172.21.15.12:0/2011924082 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4011790 con 0x7f12d4153a00 2023-10-08T16:24:04.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.912+0000 7f12d159a700 1 -- 172.21.15.12:0/2011924082 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011b30 con 0x7f12d4153a00 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.912+0000 7f12d359e700 1 -- 172.21.15.12:0/2011924082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 msgr2=0x7f12d4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.912+0000 7f12d359e700 1 --2- 172.21.15.12:0/2011924082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 0x7f12d4153dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f12c40098e0 tx=0x7f12c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 -- 172.21.15.12:0/2011924082 shutdown_connections 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 --2- 172.21.15.12:0/2011924082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d4153a00 0x7f12d4153dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 --2- 172.21.15.12:0/2011924082 >> v2:172.21.15.12:3300/0 conn(0x7f12d415de50 0x7f12d415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 -- 172.21.15.12:0/2011924082 >> 172.21.15.12:0/2011924082 conn(0x7f12d40703a0 msgr2=0x7f12d40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 -- 172.21.15.12:0/2011924082 shutdown_connections 2023-10-08T16:24:04.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.913+0000 7f12d359e700 1 -- 172.21.15.12:0/2011924082 wait complete. 2023-10-08T16:24:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.914+0000 7f12d359e700 1 Processor -- start 2023-10-08T16:24:04.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.914+0000 7f12d359e700 1 -- start start 2023-10-08T16:24:04.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d4153a00 0x7f12d4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d415de50 0x7f12d415f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d41502b0 con 0x7f12d40cea00 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b25c0 con 0x7f12d4153a00 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.915+0000 7f12d359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d40b16f0 con 0x7f12d415de50 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60824/0 (socket says 172.21.15.12:60824) 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 -- 172.21.15.12:0/1884366702 learned_addr learned my addr 172.21.15.12:0/1884366702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d1d9b700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d4153a00 0x7f12d4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d2d9d700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d415de50 0x7f12d415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:04.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d415de50 msgr2=0x7f12d415f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d415de50 0x7f12d415f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d4153a00 msgr2=0x7f12d4152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d4153a00 0x7f12d4152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 -- 172.21.15.12:0/1884366702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009420 con 0x7f12d40cea00 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.916+0000 7f12d259c700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f12d415b380 tx=0x7f12c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.917+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4011900 con 0x7f12d40cea00 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.917+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c4011a60 con 0x7f12d40cea00 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.917+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c4009420 con 0x7f12d40cea00 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.917+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c4023620 con 0x7f12d40cea00 2023-10-08T16:24:04.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.917+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d40b1c90 con 0x7f12d40cea00 2023-10-08T16:24:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.918+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d404c3c0 con 0x7f12d40cea00 2023-10-08T16:24:04.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.919+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f12c402c3b0 con 0x7f12d40cea00 2023-10-08T16:24:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.920+0000 7f12c27fc700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 0x7f12b4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.920+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f12c4085d50 con 0x7f12d40cea00 2023-10-08T16:24:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.920+0000 7f12d1d9b700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 msgr2=0x7f12b4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:04.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.920+0000 7f12d1d9b700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 0x7f12b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:04.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:04.924+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12c4052be0 con 0x7f12d40cea00 2023-10-08T16:24:05.001 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:05.001+0000 7fa63eab4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:05.090 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:05.090+0000 7f55c9672180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:05.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.121+0000 7f12d1d9b700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 msgr2=0x7f12b4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:05.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.121+0000 7f12d1d9b700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 0x7f12b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:05.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.127+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f12d415b800 con 0x7f12d40cea00 2023-10-08T16:24:05.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.128+0000 7f12c27fc700 1 -- 172.21.15.12:0/1884366702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f12c4015020 con 0x7f12d40cea00 2023-10-08T16:24:05.128 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:24:05.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 msgr2=0x7f12b4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 0x7f12b4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 msgr2=0x7f12d40b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f12d415b380 tx=0x7f12c4017000 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 shutdown_connections 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f12b4067050 0x7f12b4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12d40cea00 0x7f12d40b11b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12d415de50 0x7f12d415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 --2- 172.21.15.12:0/1884366702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12d4153a00 0x7f12d4152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.130+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 >> 172.21.15.12:0/1884366702 conn(0x7f12d40703a0 msgr2=0x7f12d4159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.131+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 shutdown_connections 2023-10-08T16:24:05.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.131+0000 7f12d359e700 1 -- 172.21.15.12:0/1884366702 wait complete. 2023-10-08T16:24:05.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:24:05.187 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:05.187+0000 7fa63eab4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:05.280 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:05.280+0000 7f55c9672180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:05.283 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:05.283+0000 7fa63eab4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:05.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.343+0000 7f017359e700 1 Processor -- start 2023-10-08T16:24:05.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.343+0000 7f017359e700 1 -- start start 2023-10-08T16:24:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0174153dd0 0x7f017415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017415ac50 con 0x7f0174153a00 2023-10-08T16:24:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017415d010 con 0x7f01740cea00 2023-10-08T16:24:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017415af60 con 0x7f0174153dd0 2023-10-08T16:24:05.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0174153dd0 0x7f017415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0174153dd0 0x7f017415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60838/0 (socket says 172.21.15.12:60838) 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 -- 172.21.15.12:0/2879714461 learned_addr learned my addr 172.21.15.12:0/2879714461 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017259c700 1 --1- 172.21.15.12:0/2879714461 >> v1:172.21.15.12:6789/0 conn(0x7f0174153a00 0x7f017415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52470/0 (socket says 172.21.15.12:52470) 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 -- 172.21.15.12:0/2879714461 >> v1:172.21.15.29:6789/0 conn(0x7f01740cea00 legacy=0x7f01740ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 -- 172.21.15.12:0/2879714461 >> v1:172.21.15.12:6789/0 conn(0x7f0174153a00 legacy=0x7f017415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f0171d9b700 1 -- 172.21.15.12:0/2879714461 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017415b240 con 0x7f0174153dd0 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.345+0000 7f017159a700 1 -- 172.21.15.12:0/2879714461 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53312769 0 0) 0x7f017415ac50 con 0x7f0174153a00 2023-10-08T16:24:05.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.346+0000 7f0171d9b700 1 --2- 172.21.15.12:0/2879714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0174153dd0 0x7f017415de50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f00089afa7d6af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.346+0000 7f017159a700 1 -- 172.21.15.12:0/2879714461 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800b860 con 0x7f0174153dd0 2023-10-08T16:24:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.346+0000 7f017159a700 1 -- 172.21.15.12:0/2879714461 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800b9c0 con 0x7f0174153dd0 2023-10-08T16:24:05.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.346+0000 7f017159a700 1 -- 172.21.15.12:0/2879714461 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800bd60 con 0x7f0174153dd0 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 -- 172.21.15.12:0/2879714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0174153dd0 msgr2=0x7f017415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 --2- 172.21.15.12:0/2879714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0174153dd0 0x7f017415de50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f01680099b0 tx=0x7f0168009250 comp rx=0 tx=0).stop 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 -- 172.21.15.12:0/2879714461 shutdown_connections 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 --2- 172.21.15.12:0/2879714461 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0174153dd0 0x7f017415de50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 -- 172.21.15.12:0/2879714461 >> 172.21.15.12:0/2879714461 conn(0x7f01740703a0 msgr2=0x7f01740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 -- 172.21.15.12:0/2879714461 shutdown_connections 2023-10-08T16:24:05.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.347+0000 7f017359e700 1 -- 172.21.15.12:0/2879714461 wait complete. 2023-10-08T16:24:05.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.349+0000 7f017359e700 1 Processor -- start 2023-10-08T16:24:05.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.349+0000 7f017359e700 1 -- start start 2023-10-08T16:24:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153a00 0x7f01740c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0174153dd0 0x7f01740cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740c9000 con 0x7f01740cea00 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01740c52d0 con 0x7f0174153a00 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01740c6130 con 0x7f0174153dd0 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60844/0 (socket says 172.21.15.12:60844) 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f017259c700 1 -- 172.21.15.12:0/190608225 learned_addr learned my addr 172.21.15.12:0/190608225 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f0171d9b700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153a00 0x7f01740c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.351+0000 7f0172d9d700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0174153dd0 0x7f01740cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0174153dd0 msgr2=0x7f01740cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0174153dd0 0x7f01740cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153a00 msgr2=0x7f01740c6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153a00 0x7f01740c6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 -- 172.21.15.12:0/190608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680094f0 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017259c700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f016400c810 tx=0x7f0164007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164005b40 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0164005ca0 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0164007320 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01741519e0 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.352+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01740c5800 con 0x7f01740cea00 2023-10-08T16:24:05.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.354+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017404c3c0 con 0x7f01740cea00 2023-10-08T16:24:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.355+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f016401b3b0 con 0x7f01740cea00 2023-10-08T16:24:05.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.356+0000 7f01627fc700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 0x7f0154069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.356+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7f0164083e10 con 0x7f01740cea00 2023-10-08T16:24:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.356+0000 7f0171d9b700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 msgr2=0x7f0154069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:05.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.356+0000 7f0171d9b700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 0x7f0154069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:05.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.360+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0164050cc0 con 0x7f01740cea00 2023-10-08T16:24:05.382 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:05.382+0000 7f55c9672180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:05.450 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:05.450+0000 7fa63eab4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:05.553 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:05.553+0000 7f55c9672180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:05.554 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:05.554+0000 7fa63eab4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.557+0000 7f0171d9b700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 msgr2=0x7f0154069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.557+0000 7f0171d9b700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 0x7f0154069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:05.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.615+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f017415b520 con 0x7f01740cea00 2023-10-08T16:24:05.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.616+0000 7f01627fc700 1 -- 172.21.15.12:0/190608225 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0164017020 con 0x7f01740cea00 2023-10-08T16:24:05.616 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:24:05.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 msgr2=0x7f0154069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:05.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 0x7f0154069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 msgr2=0x7f01741514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f016400c810 tx=0x7f0164007d90 comp rx=0 tx=0).stop 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 shutdown_connections 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f0154067050 0x7f0154069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01740cea00 0x7f01741514a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0174153dd0 0x7f01740cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 --2- 172.21.15.12:0/190608225 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0174153a00 0x7f01740c6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 >> 172.21.15.12:0/190608225 conn(0x7f01740703a0 msgr2=0x7f01740b1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 shutdown_connections 2023-10-08T16:24:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.619+0000 7f017359e700 1 -- 172.21.15.12:0/190608225 wait complete. 2023-10-08T16:24:05.638 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:24:05.662 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:05.662+0000 7f55c9672180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:05.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.830+0000 7fc2ef19d700 1 Processor -- start 2023-10-08T16:24:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.830+0000 7fc2ef19d700 1 -- start start 2023-10-08T16:24:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ef19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 0x7fc2e8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ef19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc2e80cea00 0x7fc2e80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ef19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e815ac50 con 0x7fc2e815de50 2023-10-08T16:24:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ef19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e815d010 con 0x7fc2e80cea00 2023-10-08T16:24:05.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ef19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e815af60 con 0x7fc2e8153a00 2023-10-08T16:24:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ed99a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc2e815de50 0x7fc2e815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52474/0 (socket says 172.21.15.12:52474) 2023-10-08T16:24:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ed99a700 1 -- 172.21.15.12:0/2125217647 learned_addr learned my addr 172.21.15.12:0/2125217647 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ee99c700 1 --2- 172.21.15.12:0/2125217647 >> v2:172.21.15.12:3300/0 conn(0x7fc2e80cea00 0x7fc2e80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.832+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/2125217647 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 0x7fc2e8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ed199700 1 -- 172.21.15.12:0/2125217647 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769205875 0 0) 0x7fc2e815ac50 con 0x7fc2e815de50 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ed199700 1 -- 172.21.15.12:0/2125217647 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2d4003570 con 0x7fc2e815de50 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ee19b700 1 -- 172.21.15.12:0/2125217647 >> v2:172.21.15.12:3300/0 conn(0x7fc2e80cea00 msgr2=0x7fc2e80cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/2125217647 >> v2:172.21.15.12:3300/0 conn(0x7fc2e80cea00 0x7fc2e80cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ee19b700 1 -- 172.21.15.12:0/2125217647 >> v1:172.21.15.12:6789/0 conn(0x7fc2e815de50 legacy=0x7fc2e815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ee19b700 1 -- 172.21.15.12:0/2125217647 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e815b240 con 0x7fc2e8153a00 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/2125217647 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 0x7fc2e8153dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40098e0 tx=0x7fc2e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5f2c2f7d1f618c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ed199700 1 -- 172.21.15.12:0/2125217647 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4011630 con 0x7fc2e8153a00 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ed199700 1 -- 172.21.15.12:0/2125217647 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e4011790 con 0x7fc2e8153a00 2023-10-08T16:24:05.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.833+0000 7fc2ed199700 1 -- 172.21.15.12:0/2125217647 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4011b30 con 0x7fc2e8153a00 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 -- 172.21.15.12:0/2125217647 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 msgr2=0x7fc2e8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/2125217647 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 0x7fc2e8153dd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc2e40098e0 tx=0x7fc2e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 -- 172.21.15.12:0/2125217647 shutdown_connections 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/2125217647 >> v2:172.21.15.12:3300/0 conn(0x7fc2e80cea00 0x7fc2e80cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/2125217647 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e8153a00 0x7fc2e8153dd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 -- 172.21.15.12:0/2125217647 >> 172.21.15.12:0/2125217647 conn(0x7fc2e80703a0 msgr2=0x7fc2e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.834+0000 7fc2ef19d700 1 -- 172.21.15.12:0/2125217647 shutdown_connections 2023-10-08T16:24:05.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.835+0000 7fc2ef19d700 1 -- 172.21.15.12:0/2125217647 wait complete. 2023-10-08T16:24:05.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.837+0000 7fc2ef19d700 1 Processor -- start 2023-10-08T16:24:05.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.837+0000 7fc2ef19d700 1 -- start start 2023-10-08T16:24:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2e80cea00 0x7fc2e8152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e815de50 0x7fc2e80d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80c9ea0 con 0x7fc2e8153a00 2023-10-08T16:24:05.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e8152950 con 0x7fc2e80cea00 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ef19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e80c9290 con 0x7fc2e815de50 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60860/0 (socket says 172.21.15.12:60860) 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 -- 172.21.15.12:0/1303024657 learned_addr learned my addr 172.21.15.12:0/1303024657 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2e80cea00 0x7fc2e8152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ee99c700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e815de50 0x7fc2e80d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e815de50 msgr2=0x7fc2e80d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e815de50 0x7fc2e80d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2e80cea00 msgr2=0x7fc2e8152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2e80cea00 0x7fc2e8152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.839+0000 7fc2ed99a700 1 -- 172.21.15.12:0/1303024657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e4009420 con 0x7fc2e8153a00 2023-10-08T16:24:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2ed99a700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c590 tx=0x7fc2d8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8005b30 con 0x7fc2e8153a00 2023-10-08T16:24:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d8005cb0 con 0x7fc2e8153a00 2023-10-08T16:24:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8007320 con 0x7fc2e8153a00 2023-10-08T16:24:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e80c9570 con 0x7fc2e8153a00 2023-10-08T16:24:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.840+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e80c9b30 con 0x7fc2e8153a00 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.841+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e80ca230 con 0x7fc2e8153a00 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.842+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc2d801b3b0 con 0x7fc2e8153a00 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.843+0000 7fc2de7fc700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 0x7fc2cc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.843+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fc2d8083e80 con 0x7fc2e8153a00 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.843+0000 7fc2ee19b700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 msgr2=0x7fc2cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:05.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.843+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 0x7fc2cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:05.847+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2d8050c90 con 0x7fc2e8153a00 2023-10-08T16:24:06.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.044+0000 7fc2ee19b700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 msgr2=0x7fc2cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:06.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.044+0000 7fc2ee19b700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 0x7fc2cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:06.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.049+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2e804c3c0 con 0x7fc2e8153a00 2023-10-08T16:24:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.049+0000 7fc2de7fc700 1 -- 172.21.15.12:0/1303024657 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2d8017020 con 0x7fc2e8153a00 2023-10-08T16:24:06.049 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 msgr2=0x7fc2cc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 0x7fc2cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 msgr2=0x7fc2e80c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c590 tx=0x7fc2d8007e00 comp rx=0 tx=0).stop 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 shutdown_connections 2023-10-08T16:24:06.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fc2cc067050 0x7fc2cc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc2e815de50 0x7fc2e80d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc2e80cea00 0x7fc2e8152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 --2- 172.21.15.12:0/1303024657 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc2e8153a00 0x7fc2e80c8260 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 >> 172.21.15.12:0/1303024657 conn(0x7fc2e80703a0 msgr2=0x7fc2e8152c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 shutdown_connections 2023-10-08T16:24:06.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.052+0000 7fc2ef19d700 1 -- 172.21.15.12:0/1303024657 wait complete. 2023-10-08T16:24:06.056 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:06.057+0000 7fa63eab4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:06.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:06.155 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:06.155+0000 7fa63eab4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:06.179 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:06.179+0000 7f55c9672180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:06.249 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:06.249+0000 7fa63eab4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:06.280 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:06.281+0000 7f55c9672180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:06.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.302+0000 7ff50359d700 1 Processor -- start 2023-10-08T16:24:06.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.302+0000 7ff50359d700 1 -- start start 2023-10-08T16:24:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.303+0000 7ff50359d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff4fc15de50 0x7ff4fc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.303+0000 7ff50359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 0x7ff4fc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.303+0000 7ff50359d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc0cf3c0 con 0x7ff4fc153c30 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.303+0000 7ff50359d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4fc15afd0 con 0x7ff4fc15de50 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.303+0000 7ff50359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc15b2b0 con 0x7ff4fc0cef40 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff50259b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff4fc153c30 0x7ff4fc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52480/0 (socket says 172.21.15.12:52480) 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff50259b700 1 -- 172.21.15.12:0/3166597164 learned_addr learned my addr 172.21.15.12:0/3166597164 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501d9a700 1 --2- 172.21.15.12:0/3166597164 >> v2:172.21.15.29:3300/0 conn(0x7ff4fc15de50 0x7ff4fc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff502d9c700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 0x7ff4fc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501599700 1 -- 172.21.15.12:0/3166597164 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844179944 0 0) 0x7ff4fc0cf3c0 con 0x7ff4fc153c30 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501599700 1 -- 172.21.15.12:0/3166597164 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e8003570 con 0x7ff4fc153c30 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501d9a700 1 -- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 msgr2=0x7ff4fc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501d9a700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 0x7ff4fc15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501d9a700 1 -- 172.21.15.12:0/3166597164 >> v1:172.21.15.12:6789/0 conn(0x7ff4fc153c30 legacy=0x7ff4fc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff501d9a700 1 -- 172.21.15.12:0/3166597164 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc15b590 con 0x7ff4fc15de50 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.304+0000 7ff502d9c700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 0x7ff4fc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff501d9a700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0cea00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098e0 tx=0x7ff4ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10761a9db1c29c90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:06.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff501599700 1 -- 172.21.15.12:0/3166597164 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec011630 con 0x7ff4fc15de50 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff501599700 1 -- 172.21.15.12:0/3166597164 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec011790 con 0x7ff4fc15de50 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff501599700 1 -- 172.21.15.12:0/3166597164 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec011b30 con 0x7ff4fc15de50 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff50359d700 1 -- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc15de50 msgr2=0x7ff4fc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.305+0000 7ff50359d700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0cea00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0098e0 tx=0x7ff4ec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 -- 172.21.15.12:0/3166597164 shutdown_connections 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc0cef40 0x7ff4fc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 --2- 172.21.15.12:0/3166597164 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0cea00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 -- 172.21.15.12:0/3166597164 >> 172.21.15.12:0/3166597164 conn(0x7ff4fc0703a0 msgr2=0x7ff4fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 -- 172.21.15.12:0/3166597164 shutdown_connections 2023-10-08T16:24:06.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.306+0000 7ff50359d700 1 -- 172.21.15.12:0/3166597164 wait complete. 2023-10-08T16:24:06.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.307+0000 7ff50359d700 1 Processor -- start 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.307+0000 7ff50359d700 1 -- start start 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc0cef40 0x7ff4fc15fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc153c30 0x7ff4fc14b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0c7af0 con 0x7ff4fc15de50 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc160110 con 0x7ff4fc0cef40 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff50359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b2480 con 0x7ff4fc153c30 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff502d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.308+0000 7ff502d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60874/0 (socket says 172.21.15.12:60874) 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 -- 172.21.15.12:0/116908857 learned_addr learned my addr 172.21.15.12:0/116908857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:06.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff50259b700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc0cef40 0x7ff4fc15fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff501d9a700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc153c30 0x7ff4fc14b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc153c30 msgr2=0x7ff4fc14b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc153c30 0x7ff4fc14b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc0cef40 msgr2=0x7ff4fc15fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc0cef40 0x7ff4fc15fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 -- 172.21.15.12:0/116908857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f4009a20 con 0x7ff4fc15de50 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff502d9c700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009f20 tx=0x7ff4f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400cb70 con 0x7ff4fc15de50 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f400f040 con 0x7ff4fc15de50 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4014480 con 0x7ff4fc15de50 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.309+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4ec009420 con 0x7ff4fc15de50 2023-10-08T16:24:06.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.310+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc0c7780 con 0x7ff4fc15de50 2023-10-08T16:24:06.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.311+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc0b29a0 con 0x7ff4fc15de50 2023-10-08T16:24:06.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.312+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff4f4003020 con 0x7ff4fc15de50 2023-10-08T16:24:06.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.312+0000 7ff4f27fc700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 0x7ff4e0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.313+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7ff4f4085330 con 0x7ff4fc15de50 2023-10-08T16:24:06.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.313+0000 7ff50259b700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 msgr2=0x7ff4e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:06.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.313+0000 7ff50259b700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 0x7ff4e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:06.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.317+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4fc0b29a0 con 0x7ff4fc15de50 2023-10-08T16:24:06.376 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:06.377+0000 7f55c9672180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:06.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.514+0000 7ff50259b700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 msgr2=0x7ff4e0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:06.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.514+0000 7ff50259b700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 0x7ff4e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:06.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.565+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4fc0c75e0 con 0x7ff4fc15de50 2023-10-08T16:24:06.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.566+0000 7ff4f27fc700 1 -- 172.21.15.12:0/116908857 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7ff4fc0c75e0 con 0x7ff4fc15de50 2023-10-08T16:24:06.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:06.566 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:24:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 msgr2=0x7ff4e0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 0x7ff4e0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 msgr2=0x7ff4fc0d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4009f20 tx=0x7ff4f400b040 comp rx=0 tx=0).stop 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 shutdown_connections 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff4e0067050 0x7ff4e0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4fc15de50 0x7ff4fc0d0450 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4fc0cef40 0x7ff4fc15fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 --2- 172.21.15.12:0/116908857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4fc153c30 0x7ff4fc14b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 >> 172.21.15.12:0/116908857 conn(0x7ff4fc0703a0 msgr2=0x7ff4fc1524f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 shutdown_connections 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.568+0000 7ff50359d700 1 -- 172.21.15.12:0/116908857 wait complete. 2023-10-08T16:24:06.569 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:24:06.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:06.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.777+0000 7fbcc239d700 1 Processor -- start 2023-10-08T16:24:06.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.778+0000 7fbcc239d700 1 -- start start 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcbc15de50 0x7fbcbc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc239d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc0cf3c0 con 0x7fbcbc153c30 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc239d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc15afd0 con 0x7fbcbc0cef40 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc239d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc15b2b0 con 0x7fbcbc15de50 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc0b9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcbc15de50 0x7fbcbc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc0b9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbcbc15de50 0x7fbcbc0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60888/0 (socket says 172.21.15.12:60888) 2023-10-08T16:24:06.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc0b9a700 1 -- 172.21.15.12:0/4058912330 learned_addr learned my addr 172.21.15.12:0/4058912330 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:06.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.779+0000 7fbcc139b700 1 --1- 172.21.15.12:0/4058912330 >> v1:172.21.15.12:6789/0 conn(0x7fbcbc153c30 0x7fbcbc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52490/0 (socket says 172.21.15.12:52490) 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcc0b9a700 1 -- 172.21.15.12:0/4058912330 >> v1:172.21.15.29:6789/0 conn(0x7fbcbc0cef40 legacy=0x7fbcbc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcc0b9a700 1 -- 172.21.15.12:0/4058912330 >> v1:172.21.15.12:6789/0 conn(0x7fbcbc153c30 legacy=0x7fbcbc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcc0b9a700 1 -- 172.21.15.12:0/4058912330 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc15b590 con 0x7fbcbc15de50 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcc0b9a700 1 --2- 172.21.15.12:0/4058912330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0cea00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0099b0 tx=0x7fbcac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0734de0825406d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcb3fff700 1 -- 172.21.15.12:0/4058912330 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00b860 con 0x7fbcbc15de50 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcb3fff700 1 -- 172.21.15.12:0/4058912330 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00b9c0 con 0x7fbcbc15de50 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.780+0000 7fbcb3fff700 1 -- 172.21.15.12:0/4058912330 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac00bd60 con 0x7fbcbc15de50 2023-10-08T16:24:06.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 -- 172.21.15.12:0/4058912330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 msgr2=0x7fbcbc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 --2- 172.21.15.12:0/4058912330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0cea00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0099b0 tx=0x7fbcac009250 comp rx=0 tx=0).stop 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 -- 172.21.15.12:0/4058912330 shutdown_connections 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 --2- 172.21.15.12:0/4058912330 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0cea00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 -- 172.21.15.12:0/4058912330 >> 172.21.15.12:0/4058912330 conn(0x7fbcbc0703a0 msgr2=0x7fbcbc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 -- 172.21.15.12:0/4058912330 shutdown_connections 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.781+0000 7fbcc239d700 1 -- 172.21.15.12:0/4058912330 wait complete. 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.783+0000 7fbcc239d700 1 Processor -- start 2023-10-08T16:24:06.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.783+0000 7fbcc239d700 1 -- start start 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcbc0cef40 0x7fbcbc0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbcbc153c30 0x7fbcbc13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0cc300 con 0x7fbcbc15de50 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc13f020 con 0x7fbcbc0cef40 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc0cb6f0 con 0x7fbcbc153c30 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc1b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60902/0 (socket says 172.21.15.12:60902) 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc1b9c700 1 -- 172.21.15.12:0/3921735612 learned_addr learned my addr 172.21.15.12:0/3921735612 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:06.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc139b700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcbc0cef40 0x7fbcbc0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc0b9a700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbcbc153c30 0x7fbcbc13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc1b9c700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbcbc153c30 msgr2=0x7fbcbc13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.784+0000 7fbcc1b9c700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbcbc153c30 0x7fbcbc13eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc1b9c700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcbc0cef40 msgr2=0x7fbcbc0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc1b9c700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcbc0cef40 0x7fbcbc0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc1b9c700 1 -- 172.21.15.12:0/3921735612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0094f0 con 0x7fbcbc15de50 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc1b9c700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c840 tx=0x7fbcb4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4012630 con 0x7fbcbc15de50 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb40127b0 con 0x7fbcbc15de50 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4012b70 con 0x7fbcbc15de50 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc0cb9d0 con 0x7fbcbc15de50 2023-10-08T16:24:06.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.785+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc0cbf90 con 0x7fbcbc15de50 2023-10-08T16:24:06.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.786+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc04c3c0 con 0x7fbcbc15de50 2023-10-08T16:24:06.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.787+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fbcb401a3a0 con 0x7fbcbc15de50 2023-10-08T16:24:06.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.788+0000 7fbcb17fa700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 0x7fbca0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:06.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.788+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6385+0+0 (secure 0 0 0) 0x7fbcb4084a90 con 0x7fbcbc15de50 2023-10-08T16:24:06.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.788+0000 7fbcc139b700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 msgr2=0x7fbca0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:06.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.788+0000 7fbcc139b700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 0x7fbca0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:06.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.792+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcb4051940 con 0x7fbcbc15de50 2023-10-08T16:24:06.901 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:06.901+0000 7fa63eab4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:06.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.989+0000 7fbcc139b700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 msgr2=0x7fbca0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:06.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:06.989+0000 7fbcc139b700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 0x7fbca0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:07.035 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:07.035+0000 7f55c9672180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:07.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.035+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcbc0cc440 con 0x7fbcbc15de50 2023-10-08T16:24:07.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.036+0000 7fbcb17fa700 1 -- 172.21.15.12:0/3921735612 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16413 (secure 0 0 0) 0x7fbcb4054f60 con 0x7fbcbc15de50 2023-10-08T16:24:07.036 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:07.036 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":71,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:23:30.208361+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:6834/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1853410443":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1938819974":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1924999226":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1060060160":"2023-10-09T16:22:28.432182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 msgr2=0x7fbca0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 0x7fbca0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 msgr2=0x7fbcbc0b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400c840 tx=0x7fbcb4001670 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 shutdown_connections 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fbca0067050 0x7fbca0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbcbc15de50 0x7fbcbc0b5ab0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbcbc0cef40 0x7fbcbc0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 --2- 172.21.15.12:0/3921735612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbcbc153c30 0x7fbcbc13eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 >> 172.21.15.12:0/3921735612 conn(0x7fbcbc0703a0 msgr2=0x7fbcbc0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 shutdown_connections 2023-10-08T16:24:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.039+0000 7fbcc239d700 1 -- 172.21.15.12:0/3921735612 wait complete. 2023-10-08T16:24:07.057 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:24:07.057 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:07.080 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:07.080+0000 7fa63eab4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:07.179 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:07.179+0000 7fa63eab4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:07.223 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:07.223+0000 7f55c9672180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.253+0000 7fd32df9d700 1 Processor -- start 2023-10-08T16:24:07.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.253+0000 7fd32df9d700 1 -- start start 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd328153c30 0x7fd32815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3280cef40 0x7fd32806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32815afd0 con 0x7fd3280cef40 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32815b2b0 con 0x7fd328153c30 2023-10-08T16:24:07.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.254+0000 7fd32df9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32815b590 con 0x7fd32815de50 2023-10-08T16:24:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd328153c30 0x7fd32815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd327fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32d79c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3280cef40 0x7fd32806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd328153c30 0x7fd32815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36284/0 (socket says 172.21.15.12:36284) 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd327fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42330/0 (socket says 172.21.15.12:42330) 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 -- 172.21.15.12:0/38232989 learned_addr learned my addr 172.21.15.12:0/38232989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 -- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 msgr2=0x7fd3280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 -- 172.21.15.12:0/38232989 >> v2:172.21.15.12:3300/0 conn(0x7fd3280cef40 msgr2=0x7fd32806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/38232989 >> v2:172.21.15.12:3300/0 conn(0x7fd3280cef40 0x7fd32806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 -- 172.21.15.12:0/38232989 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32815b870 con 0x7fd328153c30 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd327fff700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.255+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd328153c30 0x7fd32815a5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd32806ead0 tx=0x7fd31c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea718488dba62d38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd3277fe700 1 -- 172.21.15.12:0/38232989 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00b640 con 0x7fd328153c30 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd3277fe700 1 -- 172.21.15.12:0/38232989 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c00b7a0 con 0x7fd328153c30 2023-10-08T16:24:07.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd3277fe700 1 -- 172.21.15.12:0/38232989 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c00bb60 con 0x7fd328153c30 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 -- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd328153c30 msgr2=0x7fd32815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd328153c30 0x7fd32815a5e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd32806ead0 tx=0x7fd31c009250 comp rx=0 tx=0).stop 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 -- 172.21.15.12:0/38232989 shutdown_connections 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 --2- 172.21.15.12:0/38232989 >> v2:172.21.15.12:3300/0 conn(0x7fd3280cef40 0x7fd32806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd328153c30 0x7fd32815a5e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 --2- 172.21.15.12:0/38232989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd32815de50 0x7fd3280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.256+0000 7fd32df9d700 1 -- 172.21.15.12:0/38232989 >> 172.21.15.12:0/38232989 conn(0x7fd3280703a0 msgr2=0x7fd3280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.257+0000 7fd32df9d700 1 -- 172.21.15.12:0/38232989 shutdown_connections 2023-10-08T16:24:07.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.257+0000 7fd32df9d700 1 -- 172.21.15.12:0/38232989 wait complete. 2023-10-08T16:24:07.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.258+0000 7fd32df9d700 1 Processor -- start 2023-10-08T16:24:07.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.258+0000 7fd32df9d700 1 -- start start 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3280cef40 0x7fd3280ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd32815de50 0x7fd3280c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b37b0 con 0x7fd328153c30 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b3a90 con 0x7fd32815de50 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32df9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280b3d70 con 0x7fd3280cef40 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd327fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd327fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60924/0 (socket says 172.21.15.12:60924) 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd327fff700 1 -- 172.21.15.12:0/2992195601 learned_addr learned my addr 172.21.15.12:0/2992195601 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3280cef40 0x7fd3280ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.259+0000 7fd32d79c700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd32815de50 0x7fd3280c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3280cef40 msgr2=0x7fd3280ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3280cef40 0x7fd3280ca070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd32815de50 msgr2=0x7fd3280c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd32815de50 0x7fd3280c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 -- 172.21.15.12:0/2992195601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314009420 con 0x7fd328153c30 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd327fff700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd31400ec80 tx=0x7fd3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400c850 con 0x7fd328153c30 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400c9b0 con 0x7fd328153c30 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0094f0 con 0x7fd328153c30 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400cd30 con 0x7fd328153c30 2023-10-08T16:24:07.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.260+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3280b4330 con 0x7fd328153c30 2023-10-08T16:24:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.261+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32804c3c0 con 0x7fd328153c30 2023-10-08T16:24:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.262+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd314013680 con 0x7fd328153c30 2023-10-08T16:24:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.264+0000 7fd324ff9700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 0x7fd30c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.264+0000 7fd32cf9b700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 msgr2=0x7fd30c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.264+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fd314084f70 con 0x7fd328153c30 2023-10-08T16:24:07.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.264+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 0x7fd30c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:07.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.268+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3140557e0 con 0x7fd328153c30 2023-10-08T16:24:07.327 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:07.327+0000 7f55c9672180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:07.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.465+0000 7fd32cf9b700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 msgr2=0x7fd30c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:07.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.465+0000 7fd32cf9b700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 0x7fd30c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:07.487 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:07.487+0000 7fa63eab4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:07.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.524+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd32815bb50 con 0x7fd328153c30 2023-10-08T16:24:07.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.525+0000 7fd324ff9700 1 -- 172.21.15.12:0/2992195601 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fd314017090 con 0x7fd328153c30 2023-10-08T16:24:07.525 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:07.525 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:24:07.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 msgr2=0x7fd30c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:07.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 0x7fd30c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 msgr2=0x7fd3280b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fd31400ec80 tx=0x7fd3140091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 shutdown_connections 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd30c067050 0x7fd30c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd32815de50 0x7fd3280c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3280cef40 0x7fd3280ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 --2- 172.21.15.12:0/2992195601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd328153c30 0x7fd3280b4850 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 >> 172.21.15.12:0/2992195601 conn(0x7fd3280703a0 msgr2=0x7fd328152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:07.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.527+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 shutdown_connections 2023-10-08T16:24:07.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.528+0000 7fd32df9d700 1 -- 172.21.15.12:0/2992195601 wait complete. 2023-10-08T16:24:07.529 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:24:07.546 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:07.588 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:07.588+0000 7fa63eab4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:07.634 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:07.634+0000 7f55c9672180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:07.738 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:07.738+0000 7f55c9672180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:07.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.740+0000 7fcc0d59d700 1 Processor -- start 2023-10-08T16:24:07.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.740+0000 7fcc0d59d700 1 -- start start 2023-10-08T16:24:07.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.741+0000 7fcc0d59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcc0813fb20 0x7fcc0815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.741+0000 7fcc0d59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0815ae70 con 0x7fcc0806aaa0 2023-10-08T16:24:07.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.741+0000 7fcc0d59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc0806af60 con 0x7fcc0813fef0 2023-10-08T16:24:07.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.741+0000 7fcc0d59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0806b240 con 0x7fcc0813fb20 2023-10-08T16:24:07.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.741+0000 7fcc0cd9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcc0806aaa0 0x7fcc080c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52496/0 (socket says 172.21.15.12:52496) 2023-10-08T16:24:07.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc0cd9c700 1 -- 172.21.15.12:0/923465186 learned_addr learned my addr 172.21.15.12:0/923465186 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:07.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc07fff700 1 --2- 172.21.15.12:0/923465186 >> v2:172.21.15.29:3300/0 conn(0x7fcc0813fb20 0x7fcc0815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104170669 0 0) 0x7fcc00001490 con 0x7fcc0806aaa0 2023-10-08T16:24:07.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf0003570 con 0x7fcc0806aaa0 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051680919 0 0) 0x7fcc0806af60 con 0x7fcc0813fef0 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00001490 con 0x7fcc0813fef0 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc07fff700 1 -- 172.21.15.12:0/923465186 >> v1:172.21.15.29:6789/0 conn(0x7fcc0813fef0 legacy=0x7fcc080c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc07fff700 1 -- 172.21.15.12:0/923465186 >> v1:172.21.15.12:6789/0 conn(0x7fcc0806aaa0 legacy=0x7fcc080c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.742+0000 7fcc07fff700 1 -- 172.21.15.12:0/923465186 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc0806b520 con 0x7fcc0813fb20 2023-10-08T16:24:07.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc07fff700 1 --2- 172.21.15.12:0/923465186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fb20 0x7fcc0815a930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80098e0 tx=0x7fcbf80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e444002e47c35393 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8011630 con 0x7fcc0813fb20 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8011790 con 0x7fcc0813fb20 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc06ffd700 1 -- 172.21.15.12:0/923465186 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8011b30 con 0x7fcc0813fb20 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc0d59d700 1 -- 172.21.15.12:0/923465186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fb20 msgr2=0x7fcc0815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.743+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/923465186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fb20 0x7fcc0815a930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fcbf80098e0 tx=0x7fcbf80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.744+0000 7fcc0d59d700 1 -- 172.21.15.12:0/923465186 shutdown_connections 2023-10-08T16:24:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.744+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/923465186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fb20 0x7fcc0815a930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.744+0000 7fcc0d59d700 1 -- 172.21.15.12:0/923465186 >> 172.21.15.12:0/923465186 conn(0x7fcc0806d170 msgr2=0x7fcc080cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.744+0000 7fcc0d59d700 1 -- 172.21.15.12:0/923465186 shutdown_connections 2023-10-08T16:24:07.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.744+0000 7fcc0d59d700 1 -- 172.21.15.12:0/923465186 wait complete. 2023-10-08T16:24:07.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.745+0000 7fcc0d59d700 1 Processor -- start 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.745+0000 7fcc0d59d700 1 -- start start 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc0813fb20 0x7fcc080adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fef0 0x7fcc08157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc08169740 con 0x7fcc0806aaa0 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0813b950 con 0x7fcc0813fef0 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.746+0000 7fcc0d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0813cd00 con 0x7fcc0813fb20 2023-10-08T16:24:07.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60930/0 (socket says 172.21.15.12:60930) 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 -- 172.21.15.12:0/4063502165 learned_addr learned my addr 172.21.15.12:0/4063502165 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc0cd9c700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fef0 0x7fcc08157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc077fe700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc0813fb20 0x7fcc080adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc0813fb20 msgr2=0x7fcc080adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc0813fb20 0x7fcc080adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fef0 msgr2=0x7fcc08157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:07.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fef0 0x7fcc08157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 -- 172.21.15.12:0/4063502165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf8009420 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.747+0000 7fcc07fff700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcc08071320 tx=0x7fcbf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.748+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf801f070 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.748+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf8011900 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.748+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc08169930 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.748+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8023410 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.748+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0813c240 con 0x7fcc0806aaa0 2023-10-08T16:24:07.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.749+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0813c430 con 0x7fcc0806aaa0 2023-10-08T16:24:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.750+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fcbf802c3b0 con 0x7fcc0806aaa0 2023-10-08T16:24:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.751+0000 7fcbeffff700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 0x7fcbf4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.751+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fcbf8085cc0 con 0x7fcc0806aaa0 2023-10-08T16:24:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.751+0000 7fcc077fe700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 msgr2=0x7fcbf4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:07.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.751+0000 7fcc077fe700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 0x7fcbf4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:07.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.755+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbf808c080 con 0x7fcc0806aaa0 2023-10-08T16:24:07.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.952+0000 7fcc077fe700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 msgr2=0x7fcbf4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:07.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:07.952+0000 7fcc077fe700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 0x7fcbf4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:08.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.013+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc08169ac0 con 0x7fcc0806aaa0 2023-10-08T16:24:08.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.014+0000 7fcbeffff700 1 -- 172.21.15.12:0/4063502165 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fcc08169ac0 con 0x7fcc0806aaa0 2023-10-08T16:24:08.014 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:08.014 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":26,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:22:07.229377+0000","modified":"2023-10-08T16:22:10.755952+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6837/2511741328","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6835","nonce":2511741328},{"type":"v1","addr":"172.21.15.12:6837","nonce":2511741328}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-08T16:24:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.016+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 msgr2=0x7fcbf4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.016+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 0x7fcbf4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.016+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 msgr2=0x7fcc0813ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.016+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcc08071320 tx=0x7fcbf8017000 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 shutdown_connections 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fcbf4067050 0x7fcbf4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcc0806aaa0 0x7fcc0813ed40 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcc0813fef0 0x7fcc08157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 --2- 172.21.15.12:0/4063502165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcc0813fb20 0x7fcc080adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 >> 172.21.15.12:0/4063502165 conn(0x7fcc0806d170 msgr2=0x7fcc0806ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 shutdown_connections 2023-10-08T16:24:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.017+0000 7fcc0d59d700 1 -- 172.21.15.12:0/4063502165 wait complete. 2023-10-08T16:24:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 26 2023-10-08T16:24:08.034 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.231+0000 7f28eefff700 1 Processor -- start 2023-10-08T16:24:08.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.232+0000 7f28eefff700 1 -- start start 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28eefff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28eefff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28e815a5d0 0x7f28e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28eefff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e815ae40 con 0x7f28e80cd9e0 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28eefff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e80d13f0 con 0x7f28e815a5d0 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28eefff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e815ab60 con 0x7f28e80cb5a0 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28e7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28e80cd9e0 0x7f28e8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52500/0 (socket says 172.21.15.12:52500) 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28ed59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28e815a5d0 0x7f28e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28e7fff700 1 -- 172.21.15.12:0/1362914485 learned_addr learned my addr 172.21.15.12:0/1362914485 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:08.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.233+0000 7f28ecd9b700 1 --2- 172.21.15.12:0/1362914485 >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ed59c700 1 -- 172.21.15.12:0/1362914485 >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 msgr2=0x7f28e80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ed59c700 1 --2- 172.21.15.12:0/1362914485 >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ed59c700 1 -- 172.21.15.12:0/1362914485 >> v1:172.21.15.12:6789/0 conn(0x7f28e80cd9e0 legacy=0x7f28e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ed59c700 1 -- 172.21.15.12:0/1362914485 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e80ccf00 con 0x7f28e815a5d0 2023-10-08T16:24:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ecd9b700 1 --2- 172.21.15.12:0/1362914485 >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28e77fe700 1 -- 172.21.15.12:0/1362914485 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737123790 0 0) 0x7f28e815ae40 con 0x7f28e80cd9e0 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28ed59c700 1 --2- 172.21.15.12:0/1362914485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e815a5d0 0x7f28e8156e90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009e60 tx=0x7f28e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52448253d6800344 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28e77fe700 1 -- 172.21.15.12:0/1362914485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e000e070 con 0x7f28e815a5d0 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28e77fe700 1 -- 172.21.15.12:0/1362914485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e000bbf0 con 0x7f28e815a5d0 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.234+0000 7f28e77fe700 1 -- 172.21.15.12:0/1362914485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0012430 con 0x7f28e815a5d0 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 -- 172.21.15.12:0/1362914485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e815a5d0 msgr2=0x7f28e8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 --2- 172.21.15.12:0/1362914485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e815a5d0 0x7f28e8156e90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f28e0009e60 tx=0x7f28e0009780 comp rx=0 tx=0).stop 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 -- 172.21.15.12:0/1362914485 shutdown_connections 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 --2- 172.21.15.12:0/1362914485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e815a5d0 0x7f28e8156e90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 --2- 172.21.15.12:0/1362914485 >> v2:172.21.15.29:3300/0 conn(0x7f28e80cb5a0 0x7f28e80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 -- 172.21.15.12:0/1362914485 >> 172.21.15.12:0/1362914485 conn(0x7f28e8070e30 msgr2=0x7f28e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:08.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 -- 172.21.15.12:0/1362914485 shutdown_connections 2023-10-08T16:24:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.235+0000 7f28eefff700 1 -- 172.21.15.12:0/1362914485 wait complete. 2023-10-08T16:24:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.237+0000 7f28eefff700 1 Processor -- start 2023-10-08T16:24:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.238+0000 7f28eefff700 1 -- start start 2023-10-08T16:24:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28e80cb5a0 0x7f28e81536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28e815a5d0 0x7f28e80c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8157e10 con 0x7f28e80cd9e0 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e8158630 con 0x7f28e80cb5a0 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.239+0000 7f28eefff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80b6510 con 0x7f28e815a5d0 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28ecd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28e80cb5a0 0x7f28e81536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60942/0 (socket says 172.21.15.12:60942) 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 -- 172.21.15.12:0/635412099 learned_addr learned my addr 172.21.15.12:0/635412099 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28ed59c700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28e815a5d0 0x7f28e80c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28e815a5d0 msgr2=0x7f28e80c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28e815a5d0 0x7f28e80c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28e80cb5a0 msgr2=0x7f28e81536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28e80cb5a0 0x7f28e81536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 -- 172.21.15.12:0/635412099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009a20 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.240+0000 7f28e7fff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c810 tx=0x7f28d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.241+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4005b30 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.241+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4005c90 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.241+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4007300 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.241+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e80b5d00 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.241+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e8158300 con 0x7f28e80cd9e0 2023-10-08T16:24:08.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.242+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e81587a0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.243+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f28d401b3b0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.244+0000 7f28e4ff9700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 0x7f28cc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.244+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f28d4083fd0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.244+0000 7f28ecd9b700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 msgr2=0x7f28cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:08.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.244+0000 7f28ecd9b700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 0x7f28cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:08.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.248+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28e81587a0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.332 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:08.332+0000 7fa63eab4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.445+0000 7f28ecd9b700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 msgr2=0x7f28cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:08.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.445+0000 7f28ecd9b700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 0x7f28cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:08.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.454+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28e81587a0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.454+0000 7f28e4ff9700 1 -- 172.21.15.12:0/635412099 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16522 (secure 0 0 0) 0x7f28e81587a0 con 0x7f28e80cd9e0 2023-10-08T16:24:08.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:08.455 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":72,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:07.183542+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:22:05.438150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-10-08T16:22:06.210776+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.3b","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:6834/115415":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1853410443":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1938819974":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1924999226":"2023-10-09T16:22:28.432182+0000","172.21.15.12:0/1060060160":"2023-10-09T16:22:28.432182+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:08.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 msgr2=0x7f28cc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:08.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 0x7f28cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 msgr2=0x7f28e8169c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c810 tx=0x7f28d4007df0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 shutdown_connections 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7f28cc067050 0x7f28cc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28e815a5d0 0x7f28e80c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28e80cb5a0 0x7f28e81536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 --2- 172.21.15.12:0/635412099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28e80cd9e0 0x7f28e8169c10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 >> 172.21.15.12:0/635412099 conn(0x7f28e8070e30 msgr2=0x7f28e80b0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 shutdown_connections 2023-10-08T16:24:08.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.457+0000 7f28eefff700 1 -- 172.21.15.12:0/635412099 wait complete. 2023-10-08T16:24:08.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:24:08.504 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:08.504+0000 7f55c9672180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:08.622 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:08.622+0000 7fa63eab4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:08.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.676+0000 7ff41279d700 1 Processor -- start 2023-10-08T16:24:08.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.676+0000 7ff41279d700 1 -- start start 2023-10-08T16:24:08.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.677+0000 7ff41279d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff40c153c30 0x7ff40c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.677+0000 7ff41279d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff40c15de50 0x7ff40c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.677+0000 7ff41279d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff40c0cf3c0 con 0x7ff40c0cef40 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.677+0000 7ff41279d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c15afd0 con 0x7ff40c15de50 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff41279d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c15b2b0 con 0x7ff40c153c30 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff40c15de50 0x7ff40c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff40c15de50 0x7ff40c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60958/0 (socket says 172.21.15.12:60958) 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 -- 172.21.15.12:0/3956793052 learned_addr learned my addr 172.21.15.12:0/3956793052 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:08.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff41179b700 1 --2- 172.21.15.12:0/3956793052 >> v2:172.21.15.29:3300/0 conn(0x7ff40c153c30 0x7ff40c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 -- 172.21.15.12:0/3956793052 >> v2:172.21.15.29:3300/0 conn(0x7ff40c153c30 msgr2=0x7ff40c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 --2- 172.21.15.12:0/3956793052 >> v2:172.21.15.29:3300/0 conn(0x7ff40c153c30 0x7ff40c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff403fff700 1 -- 172.21.15.12:0/3956793052 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892789359 0 0) 0x7ff40c0cf3c0 con 0x7ff40c0cef40 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 -- 172.21.15.12:0/3956793052 >> v1:172.21.15.29:6789/0 conn(0x7ff40c0cef40 legacy=0x7ff40c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.678+0000 7ff410f9a700 1 -- 172.21.15.12:0/3956793052 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c15b590 con 0x7ff40c15de50 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.679+0000 7ff410f9a700 1 --2- 172.21.15.12:0/3956793052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c15de50 0x7ff40c0cea00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06ead0 tx=0x7ff3fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf23762708b4ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.679+0000 7ff403fff700 1 -- 172.21.15.12:0/3956793052 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc009e70 con 0x7ff40c15de50 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.679+0000 7ff403fff700 1 -- 172.21.15.12:0/3956793052 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc00b860 con 0x7ff40c15de50 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.679+0000 7ff403fff700 1 -- 172.21.15.12:0/3956793052 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc00bc00 con 0x7ff40c15de50 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 -- 172.21.15.12:0/3956793052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c15de50 msgr2=0x7ff40c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 --2- 172.21.15.12:0/3956793052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c15de50 0x7ff40c0cea00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff40c06ead0 tx=0x7ff3fc009250 comp rx=0 tx=0).stop 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 -- 172.21.15.12:0/3956793052 shutdown_connections 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 --2- 172.21.15.12:0/3956793052 >> v2:172.21.15.29:3300/0 conn(0x7ff40c153c30 0x7ff40c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 --2- 172.21.15.12:0/3956793052 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c15de50 0x7ff40c0cea00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 -- 172.21.15.12:0/3956793052 >> 172.21.15.12:0/3956793052 conn(0x7ff40c0703a0 msgr2=0x7ff40c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 -- 172.21.15.12:0/3956793052 shutdown_connections 2023-10-08T16:24:08.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.680+0000 7ff41279d700 1 -- 172.21.15.12:0/3956793052 wait complete. 2023-10-08T16:24:08.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.682+0000 7ff41279d700 1 Processor -- start 2023-10-08T16:24:08.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.682+0000 7ff41279d700 1 -- start start 2023-10-08T16:24:08.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c153c30 0x7ff40c16c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff40c15de50 0x7ff40c0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c16cad0 con 0x7ff40c0cef40 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0b42c0 con 0x7ff40c153c30 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41279d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0b45a0 con 0x7ff40c15de50 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41179b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60966/0 (socket says 172.21.15.12:60966) 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff41179b700 1 -- 172.21.15.12:0/3071656244 learned_addr learned my addr 172.21.15.12:0/3071656244 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff411f9c700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff40c15de50 0x7ff40c0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.683+0000 7ff410f9a700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c153c30 0x7ff40c16c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff40c15de50 msgr2=0x7ff40c0c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff40c15de50 0x7ff40c0c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c153c30 msgr2=0x7ff40c16c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c153c30 0x7ff40c16c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 -- 172.21.15.12:0/3071656244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094f0 con 0x7ff40c0cef40 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41179b700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff40800e930 tx=0x7ff4080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408013680 con 0x7ff40c0cef40 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4080137e0 con 0x7ff40c0cef40 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0b4880 con 0x7ff40c0cef40 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff408013b80 con 0x7ff40c0cef40 2023-10-08T16:24:08.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.684+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c0c9a50 con 0x7ff40c0cef40 2023-10-08T16:24:08.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.685+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c0b4ed0 con 0x7ff40c0cef40 2023-10-08T16:24:08.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.686+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff40800c3e0 con 0x7ff40c0cef40 2023-10-08T16:24:08.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.687+0000 7ff4017fa700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 0x7ff3f0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:08.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.687+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6441+0+0 (secure 0 0 0) 0x7ff408084ba0 con 0x7ff40c0cef40 2023-10-08T16:24:08.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.687+0000 7ff410f9a700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 msgr2=0x7ff3f0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:08.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.687+0000 7ff410f9a700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 0x7ff3f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:08.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.698+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff408051980 con 0x7ff40c0cef40 2023-10-08T16:24:08.721 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:08.720+0000 7fa63eab4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:08.803 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:08.802+0000 7f55c9672180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:08.880 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:08.880+0000 7fa63eab4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.888+0000 7ff410f9a700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 msgr2=0x7ff3f0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6834/115415 2023-10-08T16:24:08.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.888+0000 7ff410f9a700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 0x7ff3f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:08.897 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:08.898+0000 7f55c9672180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:08.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.948+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff40c04c3c0 con 0x7ff40c0cef40 2023-10-08T16:24:08.948 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:24:08.949+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:24:08.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.953+0000 7ff4017fa700 1 -- 172.21.15.12:0/3071656244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff408021090 con 0x7ff40c0cef40 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 msgr2=0x7ff3f0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 0x7ff3f0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 msgr2=0x7ff40c0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff40800e930 tx=0x7ff4080091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 shutdown_connections 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7ff3f0067050 0x7ff3f0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff40c0cef40 0x7ff40c0b3cb0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff40c15de50 0x7ff40c0c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 --2- 172.21.15.12:0/3071656244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff40c153c30 0x7ff40c16c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 >> 172.21.15.12:0/3071656244 conn(0x7ff40c0703a0 msgr2=0x7ff40c152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:08.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 shutdown_connections 2023-10-08T16:24:08.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:08.956+0000 7ff41279d700 1 -- 172.21.15.12:0/3071656244 wait complete. 2023-10-08T16:24:08.957 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:24:08.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:24:08.990 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:08.990+0000 7fa63eab4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:09.034 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:24:09.084 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.084+0000 7f55c9672180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:09.186 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:09.186+0000 7fa63eab4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:09.195 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.195+0000 7f55c9672180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:09.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.208+0000 7fd213fff700 1 Processor -- start 2023-10-08T16:24:09.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.208+0000 7fd213fff700 1 -- start start 2023-10-08T16:24:09.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.209+0000 7fd213fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd214153a00 0x7fd214153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.209+0000 7fd213fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.209+0000 7fd213fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21415af60 con 0x7fd2140cea00 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.209+0000 7fd213fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21415d010 con 0x7fd214153a00 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.209+0000 7fd213fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21415b240 con 0x7fd21415de50 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42410/0 (socket says 172.21.15.12:42410) 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 -- 172.21.15.12:0/2097266146 learned_addr learned my addr 172.21.15.12:0/2097266146 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd212ffd700 1 --2- 172.21.15.12:0/2097266146 >> v2:172.21.15.29:3300/0 conn(0x7fd214153a00 0x7fd214153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2137fe700 1 --1- 172.21.15.12:0/2097266146 >> v1:172.21.15.29:6789/0 conn(0x7fd2140cea00 0x7fd2140cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40544/0 (socket says 172.21.15.12:40544) 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 -- 172.21.15.12:0/2097266146 >> v2:172.21.15.29:3300/0 conn(0x7fd214153a00 msgr2=0x7fd214153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 --2- 172.21.15.12:0/2097266146 >> v2:172.21.15.29:3300/0 conn(0x7fd214153a00 0x7fd214153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 -- 172.21.15.12:0/2097266146 >> v1:172.21.15.29:6789/0 conn(0x7fd2140cea00 legacy=0x7fd2140cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 -- 172.21.15.12:0/2097266146 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21415b520 con 0x7fd21415de50 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.210+0000 7fd2127fc700 1 --2- 172.21.15.12:0/2097266146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2080099b0 tx=0x7fd208009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aac2e5a317db8677 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd211ffb700 1 -- 172.21.15.12:0/2097266146 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208009ea0 con 0x7fd21415de50 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd211ffb700 1 -- 172.21.15.12:0/2097266146 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800b860 con 0x7fd21415de50 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd211ffb700 1 -- 172.21.15.12:0/2097266146 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20800bc00 con 0x7fd21415de50 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 -- 172.21.15.12:0/2097266146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 msgr2=0x7fd21415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 --2- 172.21.15.12:0/2097266146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd2080099b0 tx=0x7fd208009250 comp rx=0 tx=0).stop 2023-10-08T16:24:09.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 -- 172.21.15.12:0/2097266146 shutdown_connections 2023-10-08T16:24:09.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 --2- 172.21.15.12:0/2097266146 >> v2:172.21.15.29:3300/0 conn(0x7fd214153a00 0x7fd214153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 --2- 172.21.15.12:0/2097266146 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd21415de50 0x7fd21415a540 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 -- 172.21.15.12:0/2097266146 >> 172.21.15.12:0/2097266146 conn(0x7fd2140703a0 msgr2=0x7fd2140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:09.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 -- 172.21.15.12:0/2097266146 shutdown_connections 2023-10-08T16:24:09.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.211+0000 7fd213fff700 1 -- 172.21.15.12:0/2097266146 wait complete. 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.213+0000 7fd213fff700 1 Processor -- start 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.213+0000 7fd213fff700 1 -- start start 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 0x7fd2140cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd21415de50 0x7fd2141578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b4de0 con 0x7fd214153a00 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b41d0 con 0x7fd21415de50 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd213fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b44b0 con 0x7fd2140cea00 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd2127fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 0x7fd2140cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd212ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42416/0 (socket says 172.21.15.12:42416) 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd212ffd700 1 -- 172.21.15.12:0/1477100124 learned_addr learned my addr 172.21.15.12:0/1477100124 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.214+0000 7fd2137fe700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd21415de50 0x7fd2141578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 -- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 msgr2=0x7fd214152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:09.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 -- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd21415de50 msgr2=0x7fd2141578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd21415de50 0x7fd2141578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 -- 172.21.15.12:0/1477100124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080094f0 con 0x7fd214153a00 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd212ffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd2127fc700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 0x7fd2140cc830 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd2140d03b0 tx=0x7fd208017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208000d10 con 0x7fd214153a00 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20800bbe0 con 0x7fd214153a00 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20801a6a0 con 0x7fd214153a00 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140b4790 con 0x7fd214153a00 2023-10-08T16:24:09.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.215+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd214152640 con 0x7fd214153a00 2023-10-08T16:24:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.216+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140b4f50 con 0x7fd214153a00 2023-10-08T16:24:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.217+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 25) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fd20801aa50 con 0x7fd214153a00 2023-10-08T16:24:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd1faffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:09.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6499+0+0 (secure 0 0 0) 0x7fd208085de0 con 0x7fd214153a00 2023-10-08T16:24:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd212ffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd212ffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello connection peer type does not match what peer advertises 16 != 2 2023-10-08T16:24:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd212ffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 msgr2=0x7fd200069500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2023-10-08T16:24:09.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.219+0000 7fd1faffd700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.223+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd208052c30 con 0x7fd214153a00 2023-10-08T16:24:09.284 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:09.284+0000 7fa63eab4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:09.379 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:09.379+0000 7fa63eab4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:09.397 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.397+0000 7f55c9672180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:09.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.474+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd2140b45f0 con 0x7fd214153a00 2023-10-08T16:24:09.476 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:09.476+0000 7fa63eab4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:09.495 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.495+0000 7f55c9672180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:09.590 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.590+0000 7f55c9672180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:09.686 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.686+0000 7f55c9672180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:09.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.696+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 26) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fd20801ad00 con 0x7fd214153a00 2023-10-08T16:24:09.766 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55439c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.766 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55439c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55439c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55439c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55439c1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55479c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55479c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55479c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55479c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.767 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:09.766+0000 7f55479c9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:09.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.955+0000 7fd1faffd700 1 -- 172.21.15.12:0/1477100124 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd208052c30 con 0x7fd214153a00 2023-10-08T16:24:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 msgr2=0x7fd2140cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 0x7fd2140cc830 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fd2140d03b0 tx=0x7fd208017000 comp rx=0 tx=0).stop 2023-10-08T16:24:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 shutdown_connections 2023-10-08T16:24:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:6834/115415,v1:172.21.15.12:6836/115415] conn(0x7fd200067050 0x7fd200069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd21415de50 0x7fd2141578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2140cea00 0x7fd214152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 --2- 172.21.15.12:0/1477100124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd214153a00 0x7fd2140cc830 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 >> 172.21.15.12:0/1477100124 conn(0x7fd2140703a0 msgr2=0x7fd2140b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 shutdown_connections 2023-10-08T16:24:09.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:09.957+0000 7fd213fff700 1 -- 172.21.15.12:0/1477100124 wait complete. 2023-10-08T16:24:09.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:24:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.210+0000 7f62f4b9d700 1 Processor -- start 2023-10-08T16:24:10.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.210+0000 7f62f4b9d700 1 -- start start 2023-10-08T16:24:10.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62f4b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f62f00cce90 0x7f62f00cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62f4b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62f4b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62f015d570 con 0x7f62f0159fb0 2023-10-08T16:24:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62f4b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62f015e180 con 0x7f62f00cce90 2023-10-08T16:24:10.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62f4b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00cd870 con 0x7f62f00cb440 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62effff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62effff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:42550/0 (socket says 172.21.15.12:42550) 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62effff700 1 -- 172.21.15.12:0/3543018507 learned_addr learned my addr 172.21.15.12:0/3543018507 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.212+0000 7f62eeffd700 1 --2- 172.21.15.12:0/3543018507 >> v2:172.21.15.29:3300/0 conn(0x7f62f00cce90 0x7f62f00cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62effff700 1 -- 172.21.15.12:0/3543018507 >> v2:172.21.15.29:3300/0 conn(0x7f62f00cce90 msgr2=0x7f62f00cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:10.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62effff700 1 --2- 172.21.15.12:0/3543018507 >> v2:172.21.15.29:3300/0 conn(0x7f62f00cce90 0x7f62f00cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62effff700 1 -- 172.21.15.12:0/3543018507 >> v1:172.21.15.29:6789/0 conn(0x7f62f0159fb0 legacy=0x7f62f015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62effff700 1 -- 172.21.15.12:0/3543018507 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f015d850 con 0x7f62f00cb440 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62ee7fc700 1 -- 172.21.15.12:0/3543018507 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966261603 0 0) 0x7f62f015d570 con 0x7f62f0159fb0 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62effff700 1 --2- 172.21.15.12:0/3543018507 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009f20 tx=0x7f62e8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e69cca1ce4e6a74 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62ee7fc700 1 -- 172.21.15.12:0/3543018507 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e800e070 con 0x7f62f00cb440 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62ee7fc700 1 -- 172.21.15.12:0/3543018507 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e800b9d0 con 0x7f62f00cb440 2023-10-08T16:24:10.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.213+0000 7f62ee7fc700 1 -- 172.21.15.12:0/3543018507 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e80092e0 con 0x7f62f00cb440 2023-10-08T16:24:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3543018507 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 msgr2=0x7f62f00cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3543018507 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009f20 tx=0x7f62e8009840 comp rx=0 tx=0).stop 2023-10-08T16:24:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3543018507 shutdown_connections 2023-10-08T16:24:10.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3543018507 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f00cb860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3543018507 >> v2:172.21.15.29:3300/0 conn(0x7f62f00cce90 0x7f62f00cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3543018507 >> 172.21.15.12:0/3543018507 conn(0x7f62f00703a0 msgr2=0x7f62f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3543018507 shutdown_connections 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.214+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3543018507 wait complete. 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.215+0000 7f62f4b9d700 1 Processor -- start 2023-10-08T16:24:10.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.216+0000 7f62f4b9d700 1 -- start start 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f015ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 0x7f62f0156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f014f1d0 con 0x7f62f0159fb0 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f00c7600 con 0x7f62f00cce90 2023-10-08T16:24:10.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62f4b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62f015b370 con 0x7f62f00cb440 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32872/0 (socket says 172.21.15.12:32872) 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 -- 172.21.15.12:0/3129821535 learned_addr learned my addr 172.21.15.12:0/3129821535 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62eeffd700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 0x7f62f0156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62ef7fe700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f015ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 -- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 msgr2=0x7f62f015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f015ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 -- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 msgr2=0x7f62f0156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:10.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 0x7f62f0156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62effff700 1 -- 172.21.15.12:0/3129821535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e8009ae0 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.217+0000 7f62eeffd700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 0x7f62f0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62effff700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62f006d1f0 tx=0x7f62e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e8008b10 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62e8008c90 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e80266b0 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f015b650 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.218+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f015bc10 con 0x7f62f0159fb0 2023-10-08T16:24:10.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.219+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f00c77b0 con 0x7f62f0159fb0 2023-10-08T16:24:10.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.220+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 26) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f62e8003040 con 0x7f62f0159fb0 2023-10-08T16:24:10.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.221+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6757+0+0 (secure 0 0 0) 0x7f62e8086390 con 0x7f62f0159fb0 2023-10-08T16:24:10.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.225+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62f00c77b0 con 0x7f62f0159fb0 2023-10-08T16:24:10.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.427+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62f00c7770 con 0x7f62f0159fb0 2023-10-08T16:24:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.703+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 27) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f62e8008e00 con 0x7f62f0159fb0 2023-10-08T16:24:10.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.703+0000 7f62d77fe700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 0x7f62dc06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:10.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.704+0000 7f62ef7fe700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 0x7f62dc06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:10.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:10.707+0000 7f62ef7fe700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 0x7f62dc06ee30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62e0003a40 tx=0x7f62e0007ec0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:11.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.204+0000 7f62d77fe700 1 -- 172.21.15.12:0/3129821535 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f62e806a0b0 con 0x7f62f0159fb0 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 msgr2=0x7f62dc06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 0x7f62dc06ee30 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62e0003a40 tx=0x7f62e0007ec0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 msgr2=0x7f62f0155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f62f006d1f0 tx=0x7f62e8018000 comp rx=0 tx=0).stop 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 shutdown_connections 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f62dc06ca50 0x7f62dc06ee30 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f62f0159fb0 0x7f62f0155770 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f62f00cb440 0x7f62f015ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 --2- 172.21.15.12:0/3129821535 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f62f00cce90 0x7f62f0156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 >> 172.21.15.12:0/3129821535 conn(0x7f62f00703a0 msgr2=0x7f62f014fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 shutdown_connections 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.207+0000 7f62f4b9d700 1 -- 172.21.15.12:0/3129821535 wait complete. 2023-10-08T16:24:11.208 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:24:11.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:24:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.422+0000 7fb51539d700 1 Processor -- start 2023-10-08T16:24:11.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.422+0000 7fb51539d700 1 -- start start 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb51539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 0x7fb510156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb51539d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5100c85d0 0x7fb5100cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb51539d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5101579b0 con 0x7fb5100c8200 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb51539d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5100c1390 con 0x7fb5100c85d0 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb51539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5101573f0 con 0x7fb5100c2a90 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb514b9c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb5100c85d0 0x7fb5100cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb50f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 0x7fb510156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb50ffff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb5100c8200 0x7fb5100c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40554/0 (socket says 172.21.15.12:40554) 2023-10-08T16:24:11.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.424+0000 7fb50ffff700 1 -- 172.21.15.12:0/2411945256 learned_addr learned my addr 172.21.15.12:0/2411945256 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb50effd700 1 -- 172.21.15.12:0/2411945256 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3048876307 0 0) 0x7fb5101579b0 con 0x7fb5100c8200 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb514b9c700 1 -- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 msgr2=0x7fb510156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb514b9c700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 0x7fb510156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb514b9c700 1 -- 172.21.15.12:0/2411945256 >> v1:172.21.15.29:6789/0 conn(0x7fb5100c8200 legacy=0x7fb5100c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb514b9c700 1 -- 172.21.15.12:0/2411945256 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5101576d0 con 0x7fb5100c85d0 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb50f7fe700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 0x7fb510156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:11.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb514b9c700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c85d0 0x7fb5100cc2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb508009e60 tx=0x7fb508009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecc1e9a0aa9e6ee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb50effd700 1 -- 172.21.15.12:0/2411945256 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800e070 con 0x7fb5100c85d0 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb50effd700 1 -- 172.21.15.12:0/2411945256 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50800bb60 con 0x7fb5100c85d0 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.425+0000 7fb50effd700 1 -- 172.21.15.12:0/2411945256 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508012430 con 0x7fb5100c85d0 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 -- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c85d0 msgr2=0x7fb5100cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c85d0 0x7fb5100cc2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb508009e60 tx=0x7fb508009780 comp rx=0 tx=0).stop 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 -- 172.21.15.12:0/2411945256 shutdown_connections 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c85d0 0x7fb5100cc2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 --2- 172.21.15.12:0/2411945256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c2a90 0x7fb510156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 -- 172.21.15.12:0/2411945256 >> 172.21.15.12:0/2411945256 conn(0x7fb51006c6a0 msgr2=0x7fb51006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 -- 172.21.15.12:0/2411945256 shutdown_connections 2023-10-08T16:24:11.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.426+0000 7fb51539d700 1 -- 172.21.15.12:0/2411945256 wait complete. 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.428+0000 7fb51539d700 1 Processor -- start 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.428+0000 7fb51539d700 1 -- start start 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c2a90 0x7fb5100ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c85d0 0x7fb51016ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100b1020 con 0x7fb5100c8200 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100b0410 con 0x7fb5100c2a90 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb51539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5100b06f0 con 0x7fb5100c85d0 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32882/0 (socket says 172.21.15.12:32882) 2023-10-08T16:24:11.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 -- 172.21.15.12:0/2072328930 learned_addr learned my addr 172.21.15.12:0/2072328930 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50ffff700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c2a90 0x7fb5100ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb514b9c700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c85d0 0x7fb51016ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 -- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c85d0 msgr2=0x7fb51016ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c85d0 0x7fb51016ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 -- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c2a90 msgr2=0x7fb5100ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c2a90 0x7fb5100ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.429+0000 7fb50f7fe700 1 -- 172.21.15.12:0/2072328930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009420 con 0x7fb5100c8200 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb50f7fe700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb50400ec80 tx=0x7fb5040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400c920 con 0x7fb5100c8200 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400ca80 con 0x7fb5100c8200 2023-10-08T16:24:11.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400ce00 con 0x7fb5100c8200 2023-10-08T16:24:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb508009a20 con 0x7fb5100c8200 2023-10-08T16:24:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.430+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5100b0cb0 con 0x7fb5100c8200 2023-10-08T16:24:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.431+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb51004c3c0 con 0x7fb5100c8200 2023-10-08T16:24:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.432+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 27) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fb504013680 con 0x7fb5100c8200 2023-10-08T16:24:11.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.433+0000 7fb4f7fff700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 0x7fb4fc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.433+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6319+0+0 (secure 0 0 0) 0x7fb504084bd0 con 0x7fb5100c8200 2023-10-08T16:24:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.433+0000 7fb50ffff700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 0x7fb4fc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:11.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.434+0000 7fb50ffff700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 0x7fb4fc069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb51014a260 tx=0x7fb500007d10 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:11.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.437+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb504051dc0 con 0x7fb5100c8200 2023-10-08T16:24:11.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:11.638+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb5100b1160 con 0x7fb5100c8200 2023-10-08T16:24:12.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.211+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb504052190 con 0x7fb5100c8200 2023-10-08T16:24:12.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.219+0000 7fb4f7fff700 1 -- 172.21.15.12:0/2072328930 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb504051dc0 con 0x7fb5100c8200 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.222+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 msgr2=0x7fb4fc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.222+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 0x7fb4fc069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb51014a260 tx=0x7fb500007d10 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.222+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 msgr2=0x7fb5100b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.222+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fb50400ec80 tx=0x7fb5040091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 shutdown_connections 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4fc066d80 0x7fb4fc069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb5100c85d0 0x7fb51016ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb5100c2a90 0x7fb5100ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 --2- 172.21.15.12:0/2072328930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb5100c8200 0x7fb5100b14b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 >> 172.21.15.12:0/2072328930 conn(0x7fb51006c6a0 msgr2=0x7fb5100ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:12.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 shutdown_connections 2023-10-08T16:24:12.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.223+0000 7fb51539d700 1 -- 172.21.15.12:0/2072328930 wait complete. 2023-10-08T16:24:12.224 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:24:12.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:24:12.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.436+0000 7fe4e6b9d700 1 Processor -- start 2023-10-08T16:24:12.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.436+0000 7fe4e6b9d700 1 -- start start 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e6b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4e013fe90 0x7fe4e006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e6b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e006b290 con 0x7fe4e00c7be0 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e6b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4e006b570 con 0x7fe4e00c7fb0 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e6b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4e006bf10 con 0x7fe4e013fe90 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e639c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4e013fe90 0x7fe4e006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e639c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4e013fe90 0x7fe4e006abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57262/0 (socket says 172.21.15.12:57262) 2023-10-08T16:24:12.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.437+0000 7fe4e639c700 1 -- 172.21.15.12:0/2148618422 learned_addr learned my addr 172.21.15.12:0/2148618422 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e639c700 1 -- 172.21.15.12:0/2148618422 >> v1:172.21.15.29:6789/0 conn(0x7fe4e00c7fb0 legacy=0x7fe4e013f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e639c700 1 -- 172.21.15.12:0/2148618422 >> v1:172.21.15.12:6789/0 conn(0x7fe4e00c7be0 legacy=0x7fe4e015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e639c700 1 -- 172.21.15.12:0/2148618422 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e006b850 con 0x7fe4e013fe90 2023-10-08T16:24:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e639c700 1 --2- 172.21.15.12:0/2148618422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e006abd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009f20 tx=0x7fe4d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6f5110aeac9484 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e4b99700 1 -- 172.21.15.12:0/2148618422 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800e070 con 0x7fe4e013fe90 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e4b99700 1 -- 172.21.15.12:0/2148618422 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d800ba40 con 0x7fe4e013fe90 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.438+0000 7fe4e4b99700 1 -- 172.21.15.12:0/2148618422 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80092e0 con 0x7fe4e013fe90 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/2148618422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 msgr2=0x7fe4e006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/2148618422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e006abd0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8009f20 tx=0x7fe4d8009840 comp rx=0 tx=0).stop 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/2148618422 shutdown_connections 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/2148618422 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e006abd0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/2148618422 >> 172.21.15.12:0/2148618422 conn(0x7fe4e006d110 msgr2=0x7fe4e00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/2148618422 shutdown_connections 2023-10-08T16:24:12.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.439+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/2148618422 wait complete. 2023-10-08T16:24:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.440+0000 7fe4e6b9d700 1 Processor -- start 2023-10-08T16:24:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.441+0000 7fe4e6b9d700 1 -- start start 2023-10-08T16:24:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.441+0000 7fe4e6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 0x7fe4e0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.441+0000 7fe4e6b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 0x7fe4e01596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.441+0000 7fe4e6b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e6b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e0155e50 con 0x7fe4e013fe90 2023-10-08T16:24:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e6b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c2e70 con 0x7fe4e00c7fb0 2023-10-08T16:24:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e00c1200 con 0x7fe4e00c7be0 2023-10-08T16:24:12.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57272/0 (socket says 172.21.15.12:57272) 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 -- 172.21.15.12:0/3300411822 learned_addr learned my addr 172.21.15.12:0/3300411822 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e539a700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 0x7fe4e01596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 -- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 msgr2=0x7fe4e0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e5b9b700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 0x7fe4e0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 0x7fe4e0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 -- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 msgr2=0x7fe4e01596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 0x7fe4e01596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e639c700 1 -- 172.21.15.12:0/3300411822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d8009ae0 con 0x7fe4e013fe90 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e539a700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 0x7fe4e01596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.442+0000 7fe4e5b9b700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 0x7fe4e0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4e639c700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8003000 tx=0x7fe4d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d8012e60 con 0x7fe4e013fe90 2023-10-08T16:24:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d80092e0 con 0x7fe4e013fe90 2023-10-08T16:24:12.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e00c14e0 con 0x7fe4e013fe90 2023-10-08T16:24:12.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d801d650 con 0x7fe4e013fe90 2023-10-08T16:24:12.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.443+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e00c1aa0 con 0x7fe4e013fe90 2023-10-08T16:24:12.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.444+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e004c3c0 con 0x7fe4e013fe90 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.445+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4d801da00 con 0x7fe4e013fe90 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.446+0000 7fe4d5ffb700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.446+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7fe4d8086070 con 0x7fe4e013fe90 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.446+0000 7fe4e5b9b700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.446+0000 7fe4e5b9b700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 0x7fe4c40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4e013e570 tx=0x7fe4dc009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.450+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4d80b75a0 con 0x7fe4e013fe90 2023-10-08T16:24:12.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.652+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7fe4e006bb30 con 0x7fe4e013fe90 2023-10-08T16:24:12.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.656+0000 7fe4d5ffb700 1 -- 172.21.15.12:0/3300411822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7fe4d80531b0 con 0x7fe4e013fe90 2023-10-08T16:24:12.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 msgr2=0x7fe4c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 0x7fe4c40693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fe4e013e570 tx=0x7fe4dc009040 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 msgr2=0x7fe4e00c22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8003000 tx=0x7fe4d8017000 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 shutdown_connections 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4c4066f30 0x7fe4c40693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4e013fe90 0x7fe4e00c22a0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4e00c7be0 0x7fe4e0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 --2- 172.21.15.12:0/3300411822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4e00c7fb0 0x7fe4e01596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 >> 172.21.15.12:0/3300411822 conn(0x7fe4e006d110 msgr2=0x7fe4e00af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.658+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 shutdown_connections 2023-10-08T16:24:12.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.659+0000 7fe4e6b9d700 1 -- 172.21.15.12:0/3300411822 wait complete. 2023-10-08T16:24:12.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:24:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.877+0000 7f07bad9d700 1 Processor -- start 2023-10-08T16:24:12.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.877+0000 7f07bad9d700 1 -- start start 2023-10-08T16:24:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.878+0000 7f07bad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07b4153c90 0x7f07b415a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.878+0000 7f07bad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 0x7f07b415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.878+0000 7f07bad9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b415ada0 con 0x7f07b406db20 2023-10-08T16:24:12.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.878+0000 7f07bad9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b406ca80 con 0x7f07b4153c90 2023-10-08T16:24:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.878+0000 7f07bad9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b406cd60 con 0x7f07b40caec0 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.879+0000 7f07b9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07b4153c90 0x7f07b415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.879+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 0x7f07b415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.879+0000 7f07b9d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f07b4153c90 0x7f07b415a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54788/0 (socket says 172.21.15.12:54788) 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.879+0000 7f07ba59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 0x7f07b415afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:37712/0 (socket says 172.21.15.12:37712) 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.879+0000 7f07b9d9b700 1 -- 172.21.15.12:0/4285882039 learned_addr learned my addr 172.21.15.12:0/4285882039 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:12.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b9d9b700 1 -- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 msgr2=0x7f07b415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b9d9b700 1 --2- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 0x7f07b415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b9d9b700 1 -- 172.21.15.12:0/4285882039 >> v1:172.21.15.29:6789/0 conn(0x7f07b406db20 legacy=0x7f07b40ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b8d99700 1 -- 172.21.15.12:0/4285882039 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657689493 0 0) 0x7f07a4001110 con 0x7f07b406db20 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b9d9b700 1 -- 172.21.15.12:0/4285882039 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b406d040 con 0x7f07b4153c90 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b9d9b700 1 --2- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b4153c90 0x7f07b415a860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5e3b3317887dec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b8d99700 1 -- 172.21.15.12:0/4285882039 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0009ea0 con 0x7f07b4153c90 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b8d99700 1 -- 172.21.15.12:0/4285882039 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000b860 con 0x7f07b4153c90 2023-10-08T16:24:12.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.880+0000 7f07b8d99700 1 -- 172.21.15.12:0/4285882039 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000bc00 con 0x7f07b4153c90 2023-10-08T16:24:12.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 -- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b4153c90 msgr2=0x7f07b415a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 --2- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b4153c90 0x7f07b415a860 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099b0 tx=0x7f07b0009250 comp rx=0 tx=0).stop 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 -- 172.21.15.12:0/4285882039 shutdown_connections 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 --2- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b40caec0 0x7f07b415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 --2- 172.21.15.12:0/4285882039 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b4153c90 0x7f07b415a860 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 -- 172.21.15.12:0/4285882039 >> 172.21.15.12:0/4285882039 conn(0x7f07b406e720 msgr2=0x7f07b406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 -- 172.21.15.12:0/4285882039 shutdown_connections 2023-10-08T16:24:12.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.881+0000 7f07bad9d700 1 -- 172.21.15.12:0/4285882039 wait complete. 2023-10-08T16:24:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.882+0000 7f07bad9d700 1 Processor -- start 2023-10-08T16:24:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.883+0000 7f07bad9d700 1 -- start start 2023-10-08T16:24:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.883+0000 7f07bad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07bad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40caec0 0x7f07b41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07bad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b4153c90 0x7f07b40af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07bad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4169fb0 con 0x7f07b406db20 2023-10-08T16:24:12.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07bad9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40c4e60 con 0x7f07b40caec0 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07bad9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b40b19b0 con 0x7f07b4153c90 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57280/0 (socket says 172.21.15.12:57280) 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 -- 172.21.15.12:0/3606191359 learned_addr learned my addr 172.21.15.12:0/3606191359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07ba59c700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b4153c90 0x7f07b40af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b959a700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40caec0 0x7f07b41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 -- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b4153c90 msgr2=0x7f07b40af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b4153c90 0x7f07b40af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 -- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40caec0 msgr2=0x7f07b41533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40caec0 0x7f07b41533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.884+0000 7f07b9d9b700 1 -- 172.21.15.12:0/3606191359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00094f0 con 0x7f07b406db20 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07b9d9b700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006fd0 tx=0x7f07b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b000b9d0 con 0x7f07b406db20 2023-10-08T16:24:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b000bb50 con 0x7f07b406db20 2023-10-08T16:24:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0025670 con 0x7f07b406db20 2023-10-08T16:24:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b40b1c10 con 0x7f07b406db20 2023-10-08T16:24:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.885+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b40c4af0 con 0x7f07b406db20 2023-10-08T16:24:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.886+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40709a0 con 0x7f07b406db20 2023-10-08T16:24:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.887+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07b0023070 con 0x7f07b406db20 2023-10-08T16:24:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.888+0000 7f07a9ffb700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 0x7f07980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.888+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f07b0085b60 con 0x7f07b406db20 2023-10-08T16:24:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.888+0000 7f07b959a700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 0x7f07980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:12.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.889+0000 7f07b959a700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 0x7f07980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07b416d550 tx=0x7f07a4009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:12.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:12.892+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07b0052ca0 con 0x7f07b406db20 2023-10-08T16:24:13.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.095+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f07b404c3c0 con 0x7f07b406db20 2023-10-08T16:24:13.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.099+0000 7f07a9ffb700 1 -- 172.21.15.12:0/3606191359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07b00562c0 con 0x7f07b406db20 2023-10-08T16:24:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 msgr2=0x7f07980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 0x7f07980693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07b416d550 tx=0x7f07a4009040 comp rx=0 tx=0).stop 2023-10-08T16:24:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 msgr2=0x7f07b40b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f07b0006fd0 tx=0x7f07b0017000 comp rx=0 tx=0).stop 2023-10-08T16:24:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 shutdown_connections 2023-10-08T16:24:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0798066f30 0x7f07980693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07b406db20 0x7f07b40b1470 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07b4153c90 0x7f07b40af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 --2- 172.21.15.12:0/3606191359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f07b40caec0 0x7f07b41533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 >> 172.21.15.12:0/3606191359 conn(0x7f07b406e720 msgr2=0x7f07b40c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.101+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 shutdown_connections 2023-10-08T16:24:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.102+0000 7f07bad9d700 1 -- 172.21.15.12:0/3606191359 wait complete. 2023-10-08T16:24:13.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:24:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.309+0000 7f84b899d700 1 Processor -- start 2023-10-08T16:24:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.309+0000 7f84b899d700 1 -- start start 2023-10-08T16:24:13.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f84b406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b899d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b406b290 con 0x7f84b40c7fb0 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b899d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b406b570 con 0x7f84b40c7be0 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b406bf10 con 0x7f84b413fe90 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f84b40c7fb0 0x7f84b413f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39208/0 (socket says 172.21.15.12:39208) 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b2ffd700 1 -- 172.21.15.12:0/3075616930 learned_addr learned my addr 172.21.15.12:0/3075616930 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129482227 0 0) 0x7f84b406b290 con 0x7f84b40c7fb0 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b3fff700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f84b406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.311+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f849c003570 con 0x7f84b40c7fb0 2023-10-08T16:24:13.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3703141792 0 0) 0x7f849c003570 con 0x7f84b40c7fb0 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 msgr2=0x7f84b406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f84b406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 >> v1:172.21.15.29:6789/0 conn(0x7f84b40c7be0 legacy=0x7f84b415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b406b850 con 0x7f84b40c7fb0 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f84a8001470 con 0x7f84b40c7fb0 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 >> v1:172.21.15.12:6789/0 conn(0x7f84b40c7fb0 legacy=0x7f84b413f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f849c003a90 0x7f849c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c004810 0x7f849c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f849c005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b406bf10 con 0x7f849c004810 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00bbf0 con 0x7f849c003a90 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849c00df90 con 0x7f84b413fe90 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c004810 0x7f849c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b3fff700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f849c005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b37fe700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f849c003a90 0x7f849c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b2ffd700 1 -- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 msgr2=0x7f849c005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.312+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84b413fe90 0x7f849c005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b2ffd700 1 -- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f849c003a90 msgr2=0x7f849c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f849c003a90 0x7f849c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b2ffd700 1 -- 172.21.15.12:0/3075616930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c003570 con 0x7f849c004810 2023-10-08T16:24:13.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c004810 0x7f849c004c80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c2d0 tx=0x7f84b406be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384fbb4e93e60d40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a800cb60 con 0x7f849c004810 2023-10-08T16:24:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a800ccc0 con 0x7f849c004810 2023-10-08T16:24:13.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b27fc700 1 -- 172.21.15.12:0/3075616930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a8005b70 con 0x7f849c004810 2023-10-08T16:24:13.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b899d700 1 -- 172.21.15.12:0/3075616930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c004810 msgr2=0x7f849c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b899d700 1 --2- 172.21.15.12:0/3075616930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f849c004810 0x7f849c004c80 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f84a800c2d0 tx=0x7f84b406be10 comp rx=0 tx=0).stop 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.313+0000 7f84b3fff700 1 -- 172.21.15.12:0/3075616930 reap_dead start 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.314+0000 7f84b899d700 1 -- 172.21.15.12:0/3075616930 shutdown_connections 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.314+0000 7f84b899d700 1 -- 172.21.15.12:0/3075616930 >> 172.21.15.12:0/3075616930 conn(0x7f84b406d110 msgr2=0x7f84b40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.314+0000 7f84b899d700 1 -- 172.21.15.12:0/3075616930 shutdown_connections 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.314+0000 7f84b899d700 1 -- 172.21.15.12:0/3075616930 wait complete. 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.315+0000 7f84b899d700 1 Processor -- start 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.315+0000 7f84b899d700 1 -- start start 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 0x7f84b41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 0x7f84b413cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4156520 con 0x7f84b41398d0 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4157800 con 0x7f84b4139460 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b4157ae0 con 0x7f849c004810 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57300/0 (socket says 172.21.15.12:57300) 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b3fff700 1 -- 172.21.15.12:0/540014405 learned_addr learned my addr 172.21.15.12:0/540014405 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.316+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 0x7f84b413cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b37fe700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 0x7f84b41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 -- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 msgr2=0x7f84b41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 0x7f84b41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 -- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 msgr2=0x7f84b413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 0x7f84b413cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 -- 172.21.15.12:0/540014405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4159500 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b2ffd700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 0x7f84b413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b37fe700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 0x7f84b41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b3fff700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f84b40c6720 tx=0x7f84ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00e040 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac00f040 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00fe40 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b41597e0 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.317+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b4155de0 con 0x7f84b41398d0 2023-10-08T16:24:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.318+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b4157d20 con 0x7f84b41398d0 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.319+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84ac015640 con 0x7f84b41398d0 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.320+0000 7f849b7fe700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.320+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f84ac085110 con 0x7f84b41398d0 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.320+0000 7f84b37fe700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.321+0000 7f84b37fe700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f84a4003c00 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.325+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84b4157d20 con 0x7f84b41398d0 2023-10-08T16:24:13.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.529+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f84b4157d20 con 0x7f84b41398d0 2023-10-08T16:24:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.540+0000 7f849b7fe700 1 -- 172.21.15.12:0/540014405 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f84b4157d20 con 0x7f84b41398d0 2023-10-08T16:24:13.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 msgr2=0x7f84a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f84a4003c00 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 msgr2=0x7f84b413d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f84b40c6720 tx=0x7f84ac00b040 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 shutdown_connections 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f84b41398d0 0x7f84b413d440 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f849c004810 0x7f84b41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 --2- 172.21.15.12:0/540014405 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84b4139460 0x7f84b413cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 >> 172.21.15.12:0/540014405 conn(0x7f84b406d110 msgr2=0x7f84b40c93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 shutdown_connections 2023-10-08T16:24:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.542+0000 7f84b899d700 1 -- 172.21.15.12:0/540014405 wait complete. 2023-10-08T16:24:13.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-10-08T16:24:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.748+0000 7f7ad9b9d700 1 Processor -- start 2023-10-08T16:24:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.748+0000 7f7ad9b9d700 1 -- start start 2023-10-08T16:24:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 0x7f7ad40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 0x7f7ad40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ad4159920 0x7f7ad40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40acc00 con 0x7f7ad4159920 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad40abff0 con 0x7f7ad415dfd0 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.749+0000 7f7ad9b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad40ac2d0 con 0x7f7ad4159550 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ad4159920 0x7f7ad40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ad4159920 0x7f7ad40ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57312/0 (socket says 172.21.15.12:57312) 2023-10-08T16:24:13.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 -- 172.21.15.12:0/1859331233 learned_addr learned my addr 172.21.15.12:0/1859331233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:13.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 -- 172.21.15.12:0/1859331233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 msgr2=0x7f7ad40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:13.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad8b9b700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 0x7f7ad40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad3fff700 1 --2- 172.21.15.12:0/1859331233 >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 0x7f7ad40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 0x7f7ad40ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 -- 172.21.15.12:0/1859331233 >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 msgr2=0x7f7ad40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 --2- 172.21.15.12:0/1859331233 >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 0x7f7ad40aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad939c700 1 -- 172.21.15.12:0/1859331233 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad40ac5b0 con 0x7f7ad4159920 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad8b9b700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 0x7f7ad40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.750+0000 7f7ad3fff700 1 --2- 172.21.15.12:0/1859331233 >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 0x7f7ad40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad939c700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159920 0x7f7ad40ad090 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ad406b120 tx=0x7f7acc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=974440bfa6df5e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad37fe700 1 -- 172.21.15.12:0/1859331233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e070 con 0x7f7ad4159920 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad37fe700 1 -- 172.21.15.12:0/1859331233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00ba50 con 0x7f7ad4159920 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad37fe700 1 -- 172.21.15.12:0/1859331233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0092e0 con 0x7f7ad4159920 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/1859331233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159920 msgr2=0x7f7ad40ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159920 0x7f7ad40ad090 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f7ad406b120 tx=0x7f7acc009840 comp rx=0 tx=0).stop 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/1859331233 shutdown_connections 2023-10-08T16:24:13.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159920 0x7f7ad40ad090 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/1859331233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159550 0x7f7ad40ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/1859331233 >> v2:172.21.15.29:3300/0 conn(0x7f7ad415dfd0 0x7f7ad40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/1859331233 >> 172.21.15.12:0/1859331233 conn(0x7f7ad406ce80 msgr2=0x7f7ad40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.751+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/1859331233 shutdown_connections 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.752+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/1859331233 wait complete. 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.753+0000 7f7ad9b9d700 1 Processor -- start 2023-10-08T16:24:13.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.753+0000 7f7ad9b9d700 1 -- start start 2023-10-08T16:24:13.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159920 0x7f7ad41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad415dfd0 0x7f7ad4152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad415dc60 con 0x7f7ad4159550 2023-10-08T16:24:13.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad4158e00 con 0x7f7ad415dfd0 2023-10-08T16:24:13.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad9b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad416e4b0 con 0x7f7ad4159920 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad8b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad8b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57322/0 (socket says 172.21.15.12:57322) 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad8b9b700 1 -- 172.21.15.12:0/4009443786 learned_addr learned my addr 172.21.15.12:0/4009443786 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.754+0000 7f7ad939c700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad415dfd0 0x7f7ad4152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad3fff700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159920 0x7f7ad41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 -- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159920 msgr2=0x7f7ad41588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159920 0x7f7ad41588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 -- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad415dfd0 msgr2=0x7f7ad4152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad415dfd0 0x7f7ad4152880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 -- 172.21.15.12:0/4009443786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009ae0 con 0x7f7ad4159550 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad8b9b700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c880 tx=0x7f7ac8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011600 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac8011760 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8011b20 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad416dc10 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.755+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad416e1d0 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.756+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad40cf350 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.757+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ac8018350 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.758+0000 7f7ad0ff9700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 0x7f7ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.758+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f7ac80844f0 con 0x7f7ad4159550 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.758+0000 7f7ad3fff700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 0x7f7ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:13.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.759+0000 7f7ad3fff700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 0x7f7ab80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0006fd0 tx=0x7f7ac0008040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:13.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:13.762+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ac8051630 con 0x7f7ad4159550 2023-10-08T16:24:14.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.045+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f7ad40acd90 con 0x7f7ad4159550 2023-10-08T16:24:14.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.219+0000 7f7ad0ff9700 1 -- 172.21.15.12:0/4009443786 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v548) v1 ==== 154+0+0 (secure 0 0 0) 0x7f7ac8054c50 con 0x7f7ad4159550 2023-10-08T16:24:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 msgr2=0x7f7ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 0x7f7ab80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0006fd0 tx=0x7f7ac0008040 comp rx=0 tx=0).stop 2023-10-08T16:24:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 msgr2=0x7f7ad416d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800c880 tx=0x7f7ac8008040 comp rx=0 tx=0).stop 2023-10-08T16:24:14.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 shutdown_connections 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ab8066f30 0x7f7ab80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ad4159550 0x7f7ad416d580 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ad415dfd0 0x7f7ad4152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 --2- 172.21.15.12:0/4009443786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ad4159920 0x7f7ad41588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 >> 172.21.15.12:0/4009443786 conn(0x7f7ad406ce80 msgr2=0x7f7ad40b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 shutdown_connections 2023-10-08T16:24:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.222+0000 7f7ad9b9d700 1 -- 172.21.15.12:0/4009443786 wait complete. 2023-10-08T16:24:14.240 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-10-08T16:24:14.240 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-10-08T16:24:14.240 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:24:14.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-08T16:24:14.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.428+0000 7f98ee99d700 1 Processor -- start 2023-10-08T16:24:14.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.428+0000 7f98ee99d700 1 -- start start 2023-10-08T16:24:14.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.429+0000 7f98ee99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f98e8142c00 0x7f98e806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.429+0000 7f98ee99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98e80c7f90 0x7f98e806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.429+0000 7f98ee99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e80ca480 con 0x7f98e806bd20 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.429+0000 7f98ee99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e815e240 con 0x7f98e80c7f90 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.429+0000 7f98ee99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e806b350 con 0x7f98e8142c00 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98e80c7f90 0x7f98e806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f98e80c7f90 0x7f98e806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57324/0 (socket says 172.21.15.12:57324) 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 -- 172.21.15.12:0/38515841 learned_addr learned my addr 172.21.15.12:0/38515841 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:14.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ed99b700 1 --2- 172.21.15.12:0/38515841 >> v2:172.21.15.29:3300/0 conn(0x7f98e8142c00 0x7f98e806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 -- 172.21.15.12:0/38515841 >> v2:172.21.15.29:3300/0 conn(0x7f98e8142c00 msgr2=0x7f98e806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 --2- 172.21.15.12:0/38515841 >> v2:172.21.15.29:3300/0 conn(0x7f98e8142c00 0x7f98e806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 -- 172.21.15.12:0/38515841 >> v1:172.21.15.29:6789/0 conn(0x7f98e806bd20 legacy=0x7f98e80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.430+0000 7f98ee19c700 1 -- 172.21.15.12:0/38515841 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e815df60 con 0x7f98e80c7f90 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee19c700 1 --2- 172.21.15.12:0/38515841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e80c7f90 0x7f98e806c6a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f98e806f490 tx=0x7f98e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0392506af1ad5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ec999700 1 -- 172.21.15.12:0/38515841 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e000e070 con 0x7f98e80c7f90 2023-10-08T16:24:14.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ec999700 1 -- 172.21.15.12:0/38515841 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e000ba20 con 0x7f98e80c7f90 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ec999700 1 -- 172.21.15.12:0/38515841 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00092e0 con 0x7f98e80c7f90 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 -- 172.21.15.12:0/38515841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e80c7f90 msgr2=0x7f98e806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 --2- 172.21.15.12:0/38515841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e80c7f90 0x7f98e806c6a0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f98e806f490 tx=0x7f98e0009840 comp rx=0 tx=0).stop 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 -- 172.21.15.12:0/38515841 shutdown_connections 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 --2- 172.21.15.12:0/38515841 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e80c7f90 0x7f98e806c6a0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 --2- 172.21.15.12:0/38515841 >> v2:172.21.15.29:3300/0 conn(0x7f98e8142c00 0x7f98e806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.431+0000 7f98ee99d700 1 -- 172.21.15.12:0/38515841 >> 172.21.15.12:0/38515841 conn(0x7f98e80675a0 msgr2=0x7f98e80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.432+0000 7f98ee99d700 1 -- 172.21.15.12:0/38515841 shutdown_connections 2023-10-08T16:24:14.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.432+0000 7f98ee99d700 1 -- 172.21.15.12:0/38515841 wait complete. 2023-10-08T16:24:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.433+0000 7f98ee99d700 1 Processor -- start 2023-10-08T16:24:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.433+0000 7f98ee99d700 1 -- start start 2023-10-08T16:24:14.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98e80c7f90 0x7f98e81698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 0x7f98e80c1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80c7260 con 0x7f98e806bd20 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e813f050 con 0x7f98e80c7f90 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ee99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e80c51f0 con 0x7f98e8142c00 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ed99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ed99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57330/0 (socket says 172.21.15.12:57330) 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.434+0000 7f98ed99b700 1 -- 172.21.15.12:0/3538988137 learned_addr learned my addr 172.21.15.12:0/3538988137 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed19a700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98e80c7f90 0x7f98e81698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ee19c700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 0x7f98e80c1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 -- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 msgr2=0x7f98e80c1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 0x7f98e80c1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 -- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98e80c7f90 msgr2=0x7f98e81698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98e80c7f90 0x7f98e81698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 -- 172.21.15.12:0/3538988137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e0009ae0 con 0x7f98e806bd20 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ee19c700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 0x7f98e80c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ed99b700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e950 tx=0x7f98e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4009530 con 0x7f98e806bd20 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e400c850 con 0x7f98e806bd20 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e400cc10 con 0x7f98e806bd20 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.435+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e80c54d0 con 0x7f98e806bd20 2023-10-08T16:24:14.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.436+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e80c5a90 con 0x7f98e806bd20 2023-10-08T16:24:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.437+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80c5cb0 con 0x7f98e806bd20 2023-10-08T16:24:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.438+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98e4013470 con 0x7f98e806bd20 2023-10-08T16:24:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.438+0000 7f98ddffb700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:14.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.439+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f98e4084870 con 0x7f98e806bd20 2023-10-08T16:24:14.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.439+0000 7f98ed19a700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:14.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.439+0000 7f98ed19a700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 0x7f98cc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98e8141340 tx=0x7f98d8009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:14.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.442+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f98e40519b0 con 0x7f98e806bd20 2023-10-08T16:24:14.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:14.730+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f98e804c3c0 con 0x7f98e806bd20 2023-10-08T16:24:15.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.222+0000 7f98ddffb700 1 -- 172.21.15.12:0/3538988137 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v549) v1 ==== 159+0+0 (secure 0 0 0) 0x7f98e4054fd0 con 0x7f98e806bd20 2023-10-08T16:24:15.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 msgr2=0x7f98cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 0x7f98cc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f98e8141340 tx=0x7f98d8009040 comp rx=0 tx=0).stop 2023-10-08T16:24:15.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 msgr2=0x7f98e8158f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f98e400e950 tx=0x7f98e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 shutdown_connections 2023-10-08T16:24:15.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f98cc066f30 0x7f98cc0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f98e806bd20 0x7f98e8158f50 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f98e8142c00 0x7f98e80c1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 --2- 172.21.15.12:0/3538988137 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f98e80c7f90 0x7f98e81698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 >> 172.21.15.12:0/3538988137 conn(0x7f98e80675a0 msgr2=0x7f98e8141d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:15.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 shutdown_connections 2023-10-08T16:24:15.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.225+0000 7f98ee99d700 1 -- 172.21.15.12:0/3538988137 wait complete. 2023-10-08T16:24:15.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:24:15.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.438+0000 7f3abd99d700 1 Processor -- start 2023-10-08T16:24:15.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.438+0000 7f3abd99d700 1 -- start start 2023-10-08T16:24:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.439+0000 7f3abd99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3ab806de50 0x7f3ab80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.439+0000 7f3abd99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab815b640 con 0x7f3ab8140a70 2023-10-08T16:24:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.439+0000 7f3abd99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab815b920 con 0x7f3ab806a210 2023-10-08T16:24:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.439+0000 7f3abd99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab80c6800 con 0x7f3ab806de50 2023-10-08T16:24:15.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abc99b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3ab8140a70 0x7f3ab8069b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39218/0 (socket says 172.21.15.12:39218) 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abc99b700 1 -- 172.21.15.12:0/887323938 learned_addr learned my addr 172.21.15.12:0/887323938 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abd19c700 1 --2- 172.21.15.12:0/887323938 >> v2:172.21.15.29:3300/0 conn(0x7f3ab806de50 0x7f3ab80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3ab77fe700 1 -- 172.21.15.12:0/887323938 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871257985 0 0) 0x7f3ab815b640 con 0x7f3ab8140a70 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3ab77fe700 1 -- 172.21.15.12:0/887323938 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8003570 con 0x7f3ab8140a70 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abd19c700 1 -- 172.21.15.12:0/887323938 >> v1:172.21.15.29:6789/0 conn(0x7f3ab806a210 legacy=0x7f3ab80c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abd19c700 1 -- 172.21.15.12:0/887323938 >> v1:172.21.15.12:6789/0 conn(0x7f3ab8140a70 legacy=0x7f3ab8069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.440+0000 7f3abd19c700 1 -- 172.21.15.12:0/887323938 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab815bc00 con 0x7f3ab806de50 2023-10-08T16:24:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd19c700 1 --2- 172.21.15.12:0/887323938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c7360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009e60 tx=0x7f3ab0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50aa335e698db7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3ab77fe700 1 -- 172.21.15.12:0/887323938 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab000e070 con 0x7f3ab806de50 2023-10-08T16:24:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3ab77fe700 1 -- 172.21.15.12:0/887323938 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab000bb60 con 0x7f3ab806de50 2023-10-08T16:24:15.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3ab77fe700 1 -- 172.21.15.12:0/887323938 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0012430 con 0x7f3ab806de50 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd99d700 1 -- 172.21.15.12:0/887323938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 msgr2=0x7f3ab80c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd99d700 1 --2- 172.21.15.12:0/887323938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c7360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009e60 tx=0x7f3ab0009780 comp rx=0 tx=0).stop 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd99d700 1 -- 172.21.15.12:0/887323938 shutdown_connections 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd99d700 1 --2- 172.21.15.12:0/887323938 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c7360 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.441+0000 7f3abd99d700 1 -- 172.21.15.12:0/887323938 >> 172.21.15.12:0/887323938 conn(0x7f3ab806d110 msgr2=0x7f3ab80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:15.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.442+0000 7f3abd99d700 1 -- 172.21.15.12:0/887323938 shutdown_connections 2023-10-08T16:24:15.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.442+0000 7f3abd99d700 1 -- 172.21.15.12:0/887323938 wait complete. 2023-10-08T16:24:15.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.443+0000 7f3abd99d700 1 Processor -- start 2023-10-08T16:24:15.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.443+0000 7f3abd99d700 1 -- start start 2023-10-08T16:24:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3ab8140a70 0x7f3ab8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80b0650 con 0x7f3ab806a210 2023-10-08T16:24:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8169da0 con 0x7f3ab806de50 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab816a080 con 0x7f3ab8140a70 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abc99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abc99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57346/0 (socket says 172.21.15.12:57346) 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abc99b700 1 -- 172.21.15.12:0/829012923 learned_addr learned my addr 172.21.15.12:0/829012923 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3ab7fff700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:15.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.444+0000 7f3abd19c700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3ab8140a70 0x7f3ab8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 -- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3ab8140a70 msgr2=0x7f3ab8159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3ab8140a70 0x7f3ab8159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 -- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 msgr2=0x7f3ab80c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 -- 172.21.15.12:0/829012923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0009a20 con 0x7f3ab806a210 2023-10-08T16:24:15.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abc99b700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00c590 tx=0x7f3aac007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac005b30 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac005cb0 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac007320 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab816a360 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.445+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab8169a50 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.446+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8140300 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.447+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3aac01b3b0 con 0x7f3ab806a210 2023-10-08T16:24:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.448+0000 7f3ab4ff9700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 0x7f3a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.448+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f3aac083c80 con 0x7f3ab806a210 2023-10-08T16:24:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.448+0000 7f3ab7fff700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 0x7f3a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.449+0000 7f3ab7fff700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 0x7f3a9c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80aea70 tx=0x7f3aa4009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.452+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3aac050dc0 con 0x7f3ab806a210 2023-10-08T16:24:15.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.654+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3ab804c3c0 con 0x7f3ab806a210 2023-10-08T16:24:15.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.658+0000 7f3ab4ff9700 1 -- 172.21.15.12:0/829012923 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3aac017020 con 0x7f3ab806a210 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 msgr2=0x7f3a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 0x7f3a9c0693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3ab80aea70 tx=0x7f3aa4009040 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 msgr2=0x7f3ab80b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3aac00c590 tx=0x7f3aac007e00 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 shutdown_connections 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3a9c066f30 0x7f3a9c0693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3ab806a210 0x7f3ab80b0110 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3ab8140a70 0x7f3ab8159d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 --2- 172.21.15.12:0/829012923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3ab806de50 0x7f3ab80c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 >> 172.21.15.12:0/829012923 conn(0x7f3ab806d110 msgr2=0x7f3ab813f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 shutdown_connections 2023-10-08T16:24:15.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:15.661+0000 7f3abd99d700 1 -- 172.21.15.12:0/829012923 wait complete. 2023-10-08T16:24:15.678 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:24:15.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:15.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:15.859 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:24:15.859 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:24:15.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:16.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.046+0000 7fa20999d700 1 Processor -- start 2023-10-08T16:24:16.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.046+0000 7fa20999d700 1 -- start start 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa20406e0a0 0x7fa2040c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406f3a0 0x7fa20414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20406a490 con 0x7fa20406e470 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa20406b930 con 0x7fa20406e0a0 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c7490 con 0x7fa20406f3a0 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa20406e0a0 0x7fa2040c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa20406e0a0 0x7fa2040c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57352/0 (socket says 172.21.15.12:57352) 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 -- 172.21.15.12:0/3010534215 learned_addr learned my addr 172.21.15.12:0/3010534215 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa203fff700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406f3a0 0x7fa20414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 -- 172.21.15.12:0/3010534215 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406f3a0 msgr2=0x7fa20414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406f3a0 0x7fa20414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 -- 172.21.15.12:0/3010534215 >> v1:172.21.15.29:6789/0 conn(0x7fa20406e470 legacy=0x7fa204159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.048+0000 7fa20899b700 1 -- 172.21.15.12:0/3010534215 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2040c7770 con 0x7fa20406e0a0 2023-10-08T16:24:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa20899b700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406e0a0 0x7fa2040c6b20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80099b0 tx=0x7fa1f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f346d86994a4e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa2037fe700 1 -- 172.21.15.12:0/3010534215 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800b860 con 0x7fa20406e0a0 2023-10-08T16:24:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa2037fe700 1 -- 172.21.15.12:0/3010534215 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f800b9c0 con 0x7fa20406e0a0 2023-10-08T16:24:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa2037fe700 1 -- 172.21.15.12:0/3010534215 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800bd60 con 0x7fa20406e0a0 2023-10-08T16:24:16.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa20999d700 1 -- 172.21.15.12:0/3010534215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406e0a0 msgr2=0x7fa2040c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.049+0000 7fa20999d700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406e0a0 0x7fa2040c6b20 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80099b0 tx=0x7fa1f8009250 comp rx=0 tx=0).stop 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 -- 172.21.15.12:0/3010534215 shutdown_connections 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406e0a0 0x7fa2040c6b20 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 --2- 172.21.15.12:0/3010534215 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406f3a0 0x7fa20414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 -- 172.21.15.12:0/3010534215 >> 172.21.15.12:0/3010534215 conn(0x7fa20406d170 msgr2=0x7fa2040cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 -- 172.21.15.12:0/3010534215 shutdown_connections 2023-10-08T16:24:16.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.050+0000 7fa20999d700 1 -- 172.21.15.12:0/3010534215 wait complete. 2023-10-08T16:24:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.051+0000 7fa20999d700 1 Processor -- start 2023-10-08T16:24:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.051+0000 7fa20999d700 1 -- start start 2023-10-08T16:24:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 0x7fa2040c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 0x7fa204148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c7240 con 0x7fa20406f3a0 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c3c70 con 0x7fa20406e470 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.052+0000 7fa20999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040c3380 con 0x7fa20406e0a0 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57368/0 (socket says 172.21.15.12:57368) 2023-10-08T16:24:16.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 -- 172.21.15.12:0/2036229419 learned_addr learned my addr 172.21.15.12:0/2036229419 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:16.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa203fff700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 0x7fa204148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 -- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 msgr2=0x7fa2040c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20899b700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 0x7fa2040c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 0x7fa2040c4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 -- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 msgr2=0x7fa204148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 0x7fa204148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 -- 172.21.15.12:0/2036229419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80094f0 con 0x7fa20406f3a0 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa203fff700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 0x7fa204148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20899b700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 0x7fa2040c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa20919c700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c910 tx=0x7fa1fc001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.053+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00a830 con 0x7fa20406f3a0 2023-10-08T16:24:16.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.054+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1fc00a990 con 0x7fa20406f3a0 2023-10-08T16:24:16.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.054+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc00ad50 con 0x7fa20406f3a0 2023-10-08T16:24:16.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.054+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2040c3620 con 0x7fa20406f3a0 2023-10-08T16:24:16.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.054+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa204149260 con 0x7fa20406f3a0 2023-10-08T16:24:16.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.055+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa204159500 con 0x7fa20406f3a0 2023-10-08T16:24:16.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.056+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa1fc012630 con 0x7fa20406f3a0 2023-10-08T16:24:16.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.057+0000 7fa200ff9700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 0x7fa1e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.057+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7fa1fc0849d0 con 0x7fa20406f3a0 2023-10-08T16:24:16.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.057+0000 7fa20899b700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 0x7fa1e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.058+0000 7fa20899b700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 0x7fa1e80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80099b0 tx=0x7fa1f8017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.061+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa1fc051b10 con 0x7fa20406f3a0 2023-10-08T16:24:16.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.307+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa20404c3c0 con 0x7fa20406f3a0 2023-10-08T16:24:16.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.308+0000 7fa200ff9700 1 -- 172.21.15.12:0/2036229419 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fa1fc055130 con 0x7fa20406f3a0 2023-10-08T16:24:16.308 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:16.308 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5549,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/951309067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":951309067},{"type":"v1","addr":"172.21.15.12:6835","nonce":951309067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5632,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/4091618237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4091618237},{"type":"v1","addr":"172.21.15.29:6834","nonce":4091618237}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2895256489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2895256489},{"type":"v1","addr":"172.21.15.29:6835","nonce":2895256489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21},{"gid":5787,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3334395496","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3334395496},{"type":"v1","addr":"172.21.15.12:6833","nonce":3334395496}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-10-08T16:24:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 msgr2=0x7fa1e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 0x7fa1e80693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80099b0 tx=0x7fa1f8017000 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 msgr2=0x7fa2040c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c910 tx=0x7fa1fc001710 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 shutdown_connections 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa1e8066f30 0x7fa1e80693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa20406f3a0 0x7fa2040c68f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa20406e0a0 0x7fa2040c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 --2- 172.21.15.12:0/2036229419 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa20406e470 0x7fa204148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 >> 172.21.15.12:0/2036229419 conn(0x7fa20406d170 msgr2=0x7fa20414d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 shutdown_connections 2023-10-08T16:24:16.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.310+0000 7fa20999d700 1 -- 172.21.15.12:0/2036229419 wait complete. 2023-10-08T16:24:16.312 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 28 2023-10-08T16:24:16.328 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:24:16.329 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:24:16.329 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:24:16.329 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:16.329 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:24:16.329 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:24:16.329 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:24:16.329 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:16.330 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:24:16.330 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:24:16.330 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:24:16.330 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:16.330 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:24:16.330 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:24:16.330 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:24:16.331 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:16.343 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:24:16.344 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:24:16.345 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:24:16.345 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:24:16.346 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:24:16.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:24:16.348 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:24:16.348 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:24:16.388 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:24:16.388 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:16.391 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:24:16.391 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:16.392 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:24:16.392 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:16.394 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:24:16.395 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:16.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:24:16.526 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:24:16.527 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:24:16.536 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:24:16.537 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:24:16.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.596+0000 7f6e4999d700 1 Processor -- start 2023-10-08T16:24:16.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.597+0000 7f6e4999d700 1 -- start start 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e44153c30 0x7f6e4415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e440cf110 0x7f6e4415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e4415afd0 con 0x7f6e4415de50 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4415b2b0 con 0x7f6e44153c30 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4415b590 con 0x7f6e440cf110 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e44153c30 0x7f6e4415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e44153c30 0x7f6e4415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57414/0 (socket says 172.21.15.12:57414) 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4899b700 1 -- 172.21.15.12:0/3187360574 learned_addr learned my addr 172.21.15.12:0/3187360574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:16.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.598+0000 7f6e4919c700 1 --2- 172.21.15.12:0/3187360574 >> v2:172.21.15.29:3300/0 conn(0x7f6e440cf110 0x7f6e4415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e4899b700 1 -- 172.21.15.12:0/3187360574 >> v2:172.21.15.29:3300/0 conn(0x7f6e440cf110 msgr2=0x7f6e4415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e4899b700 1 --2- 172.21.15.12:0/3187360574 >> v2:172.21.15.29:3300/0 conn(0x7f6e440cf110 0x7f6e4415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e4899b700 1 -- 172.21.15.12:0/3187360574 >> v1:172.21.15.29:6789/0 conn(0x7f6e4415de50 legacy=0x7f6e440cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e4899b700 1 -- 172.21.15.12:0/3187360574 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4415b870 con 0x7f6e44153c30 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e4899b700 1 --2- 172.21.15.12:0/3187360574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e44153c30 0x7f6e4415a5e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdab0 tx=0x7f6e38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207fe21cd5ac965f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e437fe700 1 -- 172.21.15.12:0/3187360574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e38009e70 con 0x7f6e44153c30 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e437fe700 1 -- 172.21.15.12:0/3187360574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3800b860 con 0x7f6e44153c30 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.599+0000 7f6e437fe700 1 -- 172.21.15.12:0/3187360574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3800bc00 con 0x7f6e44153c30 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 -- 172.21.15.12:0/3187360574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e44153c30 msgr2=0x7f6e4415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 --2- 172.21.15.12:0/3187360574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e44153c30 0x7f6e4415a5e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdab0 tx=0x7f6e38009250 comp rx=0 tx=0).stop 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 -- 172.21.15.12:0/3187360574 shutdown_connections 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 --2- 172.21.15.12:0/3187360574 >> v2:172.21.15.29:3300/0 conn(0x7f6e440cf110 0x7f6e4415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 --2- 172.21.15.12:0/3187360574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e44153c30 0x7f6e4415a5e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 -- 172.21.15.12:0/3187360574 >> 172.21.15.12:0/3187360574 conn(0x7f6e440703a0 msgr2=0x7f6e440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 -- 172.21.15.12:0/3187360574 shutdown_connections 2023-10-08T16:24:16.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.600+0000 7f6e4999d700 1 -- 172.21.15.12:0/3187360574 wait complete. 2023-10-08T16:24:16.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.601+0000 7f6e4999d700 1 Processor -- start 2023-10-08T16:24:16.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.601+0000 7f6e4999d700 1 -- start start 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e440cf110 0x7f6e4413f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e44153c30 0x7f6e440b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4413ee90 con 0x7f6e4415de50 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440c9180 con 0x7f6e44153c30 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.602+0000 7f6e4999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e440b5990 con 0x7f6e440cf110 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57416/0 (socket says 172.21.15.12:57416) 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 -- 172.21.15.12:0/386072028 learned_addr learned my addr 172.21.15.12:0/386072028 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4899b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e440cf110 0x7f6e4413f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e43fff700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e44153c30 0x7f6e440b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 -- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e440cf110 msgr2=0x7f6e4413f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e440cf110 0x7f6e4413f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 -- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e44153c30 msgr2=0x7f6e440b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e44153c30 0x7f6e440b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 -- 172.21.15.12:0/386072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e380094f0 con 0x7f6e4415de50 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e4919c700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e90 tx=0x7f6e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.603+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c00cb70 con 0x7f6e4415de50 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.604+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c00f040 con 0x7f6e4415de50 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.604+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c014480 con 0x7f6e4415de50 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.604+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e440c8570 con 0x7f6e4415de50 2023-10-08T16:24:16.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.604+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e440c8b30 con 0x7f6e4415de50 2023-10-08T16:24:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.605+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e440c9310 con 0x7f6e4415de50 2023-10-08T16:24:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.606+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e3c014830 con 0x7f6e4415de50 2023-10-08T16:24:16.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.607+0000 7f6e40ff9700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 0x7f6e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.607+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5847+0+0 (secure 0 0 0) 0x7f6e3c084ff0 con 0x7f6e4415de50 2023-10-08T16:24:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.607+0000 7f6e4899b700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 0x7f6e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:16.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.608+0000 7f6e4899b700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 0x7f6e280693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdab0 tx=0x7f6e38017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:16.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.611+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e3c052170 con 0x7f6e4415de50 2023-10-08T16:24:16.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:16.832+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6e4404c3c0 con 0x7f6e4415de50 2023-10-08T16:24:17.170 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:24:17.175 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:24:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.685+0000 7f6e40ff9700 1 -- 172.21.15.12:0/386072028 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6e3c055790 con 0x7f6e4415de50 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 msgr2=0x7f6e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 0x7f6e280693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6e440cdab0 tx=0x7f6e38017000 comp rx=0 tx=0).stop 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 msgr2=0x7f6e440c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c009e90 tx=0x7f6e3c00b040 comp rx=0 tx=0).stop 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 shutdown_connections 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e28066f30 0x7f6e280693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e4415de50 0x7f6e440c7ee0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e440cf110 0x7f6e4413f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 --2- 172.21.15.12:0/386072028 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e44153c30 0x7f6e440b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 >> 172.21.15.12:0/386072028 conn(0x7f6e440703a0 msgr2=0x7f6e4415d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:17.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 shutdown_connections 2023-10-08T16:24:17.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.688+0000 7f6e4999d700 1 -- 172.21.15.12:0/386072028 wait complete. 2023-10-08T16:24:17.689 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:24:17.707 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:24:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.894+0000 7f596f59d700 1 Processor -- start 2023-10-08T16:24:17.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.894+0000 7f596f59d700 1 -- start start 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.895+0000 7f596f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.895+0000 7f596f59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5968159a10 0x7f59680ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.895+0000 7f596f59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59680c7420 con 0x7f5968070410 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.895+0000 7f596f59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596806d5a0 con 0x7f5968159a10 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.895+0000 7f596f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596806d820 con 0x7f5968159640 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596dd9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5968159a10 0x7f59680ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596e59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596e59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:37836/0 (socket says 172.21.15.12:37836) 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596dd9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5968159a10 0x7f59680ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54962/0 (socket says 172.21.15.12:54962) 2023-10-08T16:24:17.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596e59b700 1 -- 172.21.15.12:0/2186500714 learned_addr learned my addr 172.21.15.12:0/2186500714 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596dd9a700 1 -- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 msgr2=0x7f596806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.896+0000 7f596dd9a700 1 -- 172.21.15.12:0/2186500714 >> v1:172.21.15.29:6789/0 conn(0x7f5968070410 legacy=0x7f596806a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596dd9a700 1 -- 172.21.15.12:0/2186500714 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596806db00 con 0x7f5968159a10 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596e59b700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159a10 0x7f59680ca7b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7e5978684eb6062 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596d599700 1 -- 172.21.15.12:0/2186500714 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800b640 con 0x7f5968159a10 2023-10-08T16:24:17.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596d599700 1 -- 172.21.15.12:0/2186500714 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595800b7a0 con 0x7f5968159a10 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.897+0000 7f596d599700 1 -- 172.21.15.12:0/2186500714 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595800bb40 con 0x7f5968159a10 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 -- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159a10 msgr2=0x7f59680ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159a10 0x7f59680ca7b0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f59580098e0 tx=0x7f59580091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 -- 172.21.15.12:0/2186500714 shutdown_connections 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159640 0x7f596806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 --2- 172.21.15.12:0/2186500714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159a10 0x7f59680ca7b0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 -- 172.21.15.12:0/2186500714 >> 172.21.15.12:0/2186500714 conn(0x7f596806e720 msgr2=0x7f596806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 -- 172.21.15.12:0/2186500714 shutdown_connections 2023-10-08T16:24:17.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.898+0000 7f596f59d700 1 -- 172.21.15.12:0/2186500714 wait complete. 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.899+0000 7f596f59d700 1 Processor -- start 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.899+0000 7f596f59d700 1 -- start start 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 0x7f59680c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159a10 0x7f59680c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b16f0 con 0x7f5968070410 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b0dc0 con 0x7f5968159640 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.900+0000 7f596f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b10a0 con 0x7f5968159a10 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57418/0 (socket says 172.21.15.12:57418) 2023-10-08T16:24:17.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 -- 172.21.15.12:0/2464367130 learned_addr learned my addr 172.21.15.12:0/2464367130 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 0x7f59680c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596ed9c700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159a10 0x7f59680c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 -- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159a10 msgr2=0x7f59680c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159a10 0x7f59680c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 -- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 msgr2=0x7f59680c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 0x7f59680c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 -- 172.21.15.12:0/2464367130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59640094f0 con 0x7f5968070410 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 0x7f59680c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.901+0000 7f596e59b700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f596400ec50 tx=0x7f5964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.902+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596400c9d0 con 0x7f5968070410 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.902+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596400cb30 con 0x7f5968070410 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.902+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5958009420 con 0x7f5968070410 2023-10-08T16:24:17.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.902+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5964013470 con 0x7f5968070410 2023-10-08T16:24:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.902+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59680b0a70 con 0x7f5968070410 2023-10-08T16:24:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.903+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596804c3c0 con 0x7f5968070410 2023-10-08T16:24:17.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.904+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5964013860 con 0x7f5968070410 2023-10-08T16:24:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.905+0000 7f595e7fc700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.905+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f5964084bc0 con 0x7f5968070410 2023-10-08T16:24:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.905+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:17.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.906+0000 7f596dd9a700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 0x7f594c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59580093f0 tx=0x7f5958017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:17.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:17.909+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5964051f60 con 0x7f5968070410 2023-10-08T16:24:18.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.188+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f59680cb2f0 con 0x7f5968070410 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.188+0000 7f595e7fc700 1 -- 172.21.15.12:0/2464367130 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5964055580 con 0x7f5968070410 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.188 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:24:18.189 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.190 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:18.191 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:18.192 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.193 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.194 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.195 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:24:18.196 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.197 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.198 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:24:18.199 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.200 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.201 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:18.202 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.203 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:18.204 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:24:18.205 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:24:18.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.190+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 msgr2=0x7f594c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.190+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 0x7f594c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f59580093f0 tx=0x7f5958017000 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.190+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 msgr2=0x7f5968152e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.190+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f596400ec50 tx=0x7f5964009250 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 shutdown_connections 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f594c066f30 0x7f594c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5968070410 0x7f5968152e50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5968159a10 0x7f59680c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 --2- 172.21.15.12:0/2464367130 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5968159640 0x7f59680c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 >> 172.21.15.12:0/2464367130 conn(0x7f596806e720 msgr2=0x7f59680ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:18.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 shutdown_connections 2023-10-08T16:24:18.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.191+0000 7f596f59d700 1 -- 172.21.15.12:0/2464367130 wait complete. 2023-10-08T16:24:18.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:18.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.397+0000 7f553979d700 1 Processor -- start 2023-10-08T16:24:18.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.397+0000 7f553979d700 1 -- start start 2023-10-08T16:24:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.398+0000 7f553979d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5534142fd0 0x7f55340c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.398+0000 7f553979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.398+0000 7f553979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55340ca480 con 0x7f5534142c00 2023-10-08T16:24:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.398+0000 7f553979d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55340c8220 con 0x7f5534142fd0 2023-10-08T16:24:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.398+0000 7f553979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553415e240 con 0x7f55340c7dc0 2023-10-08T16:24:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5533fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5534142c00 0x7f553406b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39248/0 (socket says 172.21.15.12:39248) 2023-10-08T16:24:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5533fff700 1 -- 172.21.15.12:0/2960961860 learned_addr learned my addr 172.21.15.12:0/2960961860 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:18.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f55337fe700 1 --2- 172.21.15.12:0/2960961860 >> v2:172.21.15.12:3300/0 conn(0x7f5534142fd0 0x7f55340c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5538f9c700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5532ffd700 1 -- 172.21.15.12:0/2960961860 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307662982 0 0) 0x7f55340ca480 con 0x7f5534142c00 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5532ffd700 1 -- 172.21.15.12:0/2960961860 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f551c003570 con 0x7f5534142c00 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f55337fe700 1 -- 172.21.15.12:0/2960961860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 msgr2=0x7f553406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f55337fe700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f55337fe700 1 -- 172.21.15.12:0/2960961860 >> v1:172.21.15.12:6789/0 conn(0x7f5534142c00 legacy=0x7f553406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f55337fe700 1 -- 172.21.15.12:0/2960961860 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553406b350 con 0x7f5534142fd0 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.399+0000 7f5538f9c700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f55337fe700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55340c7880 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f55280098e0 tx=0x7f55280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4ccd2c8f32bd56 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f5532ffd700 1 -- 172.21.15.12:0/2960961860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552800b640 con 0x7f5534142fd0 2023-10-08T16:24:18.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f5532ffd700 1 -- 172.21.15.12:0/2960961860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552800b7a0 con 0x7f5534142fd0 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f5532ffd700 1 -- 172.21.15.12:0/2960961860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552800bb40 con 0x7f5534142fd0 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 -- 172.21.15.12:0/2960961860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 msgr2=0x7f55340c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55340c7880 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f55280098e0 tx=0x7f55280091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 -- 172.21.15.12:0/2960961860 shutdown_connections 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 --2- 172.21.15.12:0/2960961860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55340c7880 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.400+0000 7f553979d700 1 -- 172.21.15.12:0/2960961860 >> 172.21.15.12:0/2960961860 conn(0x7f55340675a0 msgr2=0x7f55340679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.401+0000 7f553979d700 1 -- 172.21.15.12:0/2960961860 shutdown_connections 2023-10-08T16:24:18.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.401+0000 7f553979d700 1 -- 172.21.15.12:0/2960961860 wait complete. 2023-10-08T16:24:18.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.402+0000 7f553979d700 1 Processor -- start 2023-10-08T16:24:18.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.402+0000 7f553979d700 1 -- start start 2023-10-08T16:24:18.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553413aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 0x7f553413b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553413b550 con 0x7f5534142fd0 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5534159180 con 0x7f5534142c00 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f553979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55340c56f0 con 0x7f55340c7dc0 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f5538f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f5538f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57442/0 (socket says 172.21.15.12:57442) 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.403+0000 7f5538f9c700 1 -- 172.21.15.12:0/1548967551 learned_addr learned my addr 172.21.15.12:0/1548967551 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5533fff700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553413aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f55337fe700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 0x7f553413b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 -- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 msgr2=0x7f553413aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553413aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 -- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 msgr2=0x7f553413b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 0x7f553413b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 -- 172.21.15.12:0/1548967551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5528009420 con 0x7f5534142fd0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f55337fe700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 0x7f553413b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f5538f9c700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f552c00d180 tx=0x7f552c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c00de20 con 0x7f5534142fd0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c00f040 con 0x7f5534142fd0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55340c59d0 con 0x7f5534142fd0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.404+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c015690 con 0x7f5534142fd0 2023-10-08T16:24:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.405+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55340b1290 con 0x7f5534142fd0 2023-10-08T16:24:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.405+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553404c3c0 con 0x7f5534142fd0 2023-10-08T16:24:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.406+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f552c01e3b0 con 0x7f5534142fd0 2023-10-08T16:24:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.407+0000 7f551bfff700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 0x7f55200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.407+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f552c084990 con 0x7f5534142fd0 2023-10-08T16:24:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.407+0000 7f5533fff700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 0x7f55200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.408+0000 7f5533fff700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 0x7f55200693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55240058d0 tx=0x7f5524009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.411+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f552c051d30 con 0x7f5534142fd0 2023-10-08T16:24:18.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.615+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f553415df60 con 0x7f5534142fd0 2023-10-08T16:24:18.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.616+0000 7f551bfff700 1 -- 172.21.15.12:0/1548967551 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12777 (secure 0 0 0) 0x7f552c01a090 con 0x7f5534142fd0 2023-10-08T16:24:18.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:18.616 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":81,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:17.681236+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:18.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 msgr2=0x7f55200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 0x7f55200693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f55240058d0 tx=0x7f5524009040 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 msgr2=0x7f55341699b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f552c00d180 tx=0x7f552c009a50 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 shutdown_connections 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5520066f30 0x7f55200693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5534142fd0 0x7f55341699b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55340c7dc0 0x7f553413aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 --2- 172.21.15.12:0/1548967551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5534142c00 0x7f553413b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.618+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 >> 172.21.15.12:0/1548967551 conn(0x7f55340675a0 msgr2=0x7f553406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.619+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 shutdown_connections 2023-10-08T16:24:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.619+0000 7f553979d700 1 -- 172.21.15.12:0/1548967551 wait complete. 2023-10-08T16:24:18.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:24:18.636 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:24:18.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.827+0000 7f8997fff700 1 Processor -- start 2023-10-08T16:24:18.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.827+0000 7f8997fff700 1 -- start start 2023-10-08T16:24:18.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.828+0000 7f8997fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89981595d0 0x7f89980b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.828+0000 7f8997fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f899806d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.828+0000 7f8997fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f899806d030 con 0x7f89980b0110 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.828+0000 7f8997fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899806c740 con 0x7f89981595d0 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.828+0000 7f8997fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89980b05b0 con 0x7f89980b2d90 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89981595d0 0x7f89980b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89981595d0 0x7f89980b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57444/0 (socket says 172.21.15.12:57444) 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 -- 172.21.15.12:0/2576069988 learned_addr learned my addr 172.21.15.12:0/2576069988 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:18.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f89977fe700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f899806d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 -- 172.21.15.12:0/2576069988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 msgr2=0x7f899806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f899806d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 -- 172.21.15.12:0/2576069988 >> v1:172.21.15.29:6789/0 conn(0x7f89980b0110 legacy=0x7f89980b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8996ffd700 1 -- 172.21.15.12:0/2576069988 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899806c9e0 con 0x7f89981595d0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.829+0000 7f8995ffb700 1 -- 172.21.15.12:0/2576069988 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8010985 0 0) 0x7f899806d030 con 0x7f89980b0110 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8996ffd700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980b0d40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f89880099b0 tx=0x7f8988009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd85fced592c7b57 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8995ffb700 1 -- 172.21.15.12:0/2576069988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988009ea0 con 0x7f89981595d0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8995ffb700 1 -- 172.21.15.12:0/2576069988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800b860 con 0x7f89981595d0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8995ffb700 1 -- 172.21.15.12:0/2576069988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800bc00 con 0x7f89981595d0 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 -- 172.21.15.12:0/2576069988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 msgr2=0x7f89980b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980b0d40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f89880099b0 tx=0x7f8988009250 comp rx=0 tx=0).stop 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 -- 172.21.15.12:0/2576069988 shutdown_connections 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f899806d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 --2- 172.21.15.12:0/2576069988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980b0d40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 -- 172.21.15.12:0/2576069988 >> 172.21.15.12:0/2576069988 conn(0x7f89980675a0 msgr2=0x7f89980679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 -- 172.21.15.12:0/2576069988 shutdown_connections 2023-10-08T16:24:18.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.830+0000 7f8997fff700 1 -- 172.21.15.12:0/2576069988 wait complete. 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.832+0000 7f8997fff700 1 Processor -- start 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.832+0000 7f8997fff700 1 -- start start 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89980b0110 0x7f899816ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f8998169f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89981697c0 con 0x7f89981595d0 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899816d5b0 con 0x7f89980b0110 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8997fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899816d890 con 0x7f89980b2d90 2023-10-08T16:24:18.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f89977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f89977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57456/0 (socket says 172.21.15.12:57456) 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f89977fe700 1 -- 172.21.15.12:0/2603676858 learned_addr learned my addr 172.21.15.12:0/2603676858 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f89967fc700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f8998169f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.833+0000 7f8996ffd700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89980b0110 0x7f899816ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 -- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 msgr2=0x7f8998169f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f8998169f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 -- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89980b0110 msgr2=0x7f899816ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89980b0110 0x7f899816ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 -- 172.21.15.12:0/2603676858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89880094f0 con 0x7f89981595d0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f89977fe700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e90 tx=0x7f899000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899000cb70 con 0x7f89981595d0 2023-10-08T16:24:18.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899000f040 con 0x7f89981595d0 2023-10-08T16:24:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8998169a60 con 0x7f89981595d0 2023-10-08T16:24:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990014480 con 0x7f89981595d0 2023-10-08T16:24:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.834+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899816d1f0 con 0x7f89981595d0 2023-10-08T16:24:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.835+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899804c3c0 con 0x7f89981595d0 2023-10-08T16:24:18.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.836+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8990014830 con 0x7f89981595d0 2023-10-08T16:24:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.837+0000 7f897effd700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 0x7f89840694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.837+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f8990084d80 con 0x7f89981595d0 2023-10-08T16:24:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.837+0000 7f8996ffd700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 0x7f89840694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.838+0000 7f8996ffd700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 0x7f89840694b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89880099b0 tx=0x7f8988017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:18.841+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89900521a0 con 0x7f89981595d0 2023-10-08T16:24:19.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.042+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f899815c3a0 con 0x7f89981595d0 2023-10-08T16:24:19.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.043+0000 7f897effd700 1 -- 172.21.15.12:0/2603676858 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8990018020 con 0x7f89981595d0 2023-10-08T16:24:19.043 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:24:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 msgr2=0x7f89840694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 0x7f89840694b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f89880099b0 tx=0x7f8988017000 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 msgr2=0x7f89980cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8990009e90 tx=0x7f899000b040 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 shutdown_connections 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8984067000 0x7f89840694b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89981595d0 0x7f89980cbbd0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89980b0110 0x7f899816ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 --2- 172.21.15.12:0/2603676858 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89980b2d90 0x7f8998169f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.045+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 >> 172.21.15.12:0/2603676858 conn(0x7f89980675a0 msgr2=0x7f89981599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.046+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 shutdown_connections 2023-10-08T16:24:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.046+0000 7f8997fff700 1 -- 172.21.15.12:0/2603676858 wait complete. 2023-10-08T16:24:19.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:24:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.252+0000 7f1fc7fff700 1 Processor -- start 2023-10-08T16:24:19.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.252+0000 7f1fc7fff700 1 -- start start 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc80aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc7fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fc8156030 0x7f1fc80adae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc80b1f10 con 0x7f1fc80cbbe0 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc7fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc8157ad0 con 0x7f1fc8156030 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8156570 con 0x7f1fc806f450 2023-10-08T16:24:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1fc8156030 0x7f1fc80adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1fc80cbbe0 0x7f1fc806ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39260/0 (socket says 172.21.15.12:39260) 2023-10-08T16:24:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.253+0000 7f1fc6ffd700 1 -- 172.21.15.12:0/55368687 learned_addr learned my addr 172.21.15.12:0/55368687 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:19.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc67fc700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc80aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc77fe700 1 -- 172.21.15.12:0/55368687 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 msgr2=0x7f1fc80aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc77fe700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc80aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc77fe700 1 -- 172.21.15.12:0/55368687 >> v1:172.21.15.12:6789/0 conn(0x7f1fc80cbbe0 legacy=0x7f1fc806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc77fe700 1 -- 172.21.15.12:0/55368687 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8156850 con 0x7f1fc8156030 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc5ffb700 1 -- 172.21.15.12:0/55368687 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960122859 0 0) 0x7f1fc80b1f10 con 0x7f1fc80cbbe0 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc77fe700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc80adae0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009e60 tx=0x7f1fc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f729b6d2caa0a1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc5ffb700 1 -- 172.21.15.12:0/55368687 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc000e070 con 0x7f1fc8156030 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc5ffb700 1 -- 172.21.15.12:0/55368687 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc000bc30 con 0x7f1fc8156030 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.254+0000 7f1fc5ffb700 1 -- 172.21.15.12:0/55368687 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0012430 con 0x7f1fc8156030 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 -- 172.21.15.12:0/55368687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 msgr2=0x7f1fc80adae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc80adae0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009e60 tx=0x7f1fc0009780 comp rx=0 tx=0).stop 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 -- 172.21.15.12:0/55368687 shutdown_connections 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc80adae0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/55368687 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc80aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 -- 172.21.15.12:0/55368687 >> 172.21.15.12:0/55368687 conn(0x7f1fc806d170 msgr2=0x7f1fc80cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 -- 172.21.15.12:0/55368687 shutdown_connections 2023-10-08T16:24:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.255+0000 7f1fc7fff700 1 -- 172.21.15.12:0/55368687 wait complete. 2023-10-08T16:24:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.257+0000 7f1fc7fff700 1 Processor -- start 2023-10-08T16:24:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.257+0000 7f1fc7fff700 1 -- start start 2023-10-08T16:24:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc8159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc80cbbe0 0x7f1fc806def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8167450 con 0x7f1fc8156030 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8158060 con 0x7f1fc80cbbe0 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8158340 con 0x7f1fc806f450 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57480/0 (socket says 172.21.15.12:57480) 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 -- 172.21.15.12:0/2295531824 learned_addr learned my addr 172.21.15.12:0/2295531824 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc6ffd700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc8159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc67fc700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc80cbbe0 0x7f1fc806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 -- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 msgr2=0x7f1fc8159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc8159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 -- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc80cbbe0 msgr2=0x7f1fc806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc80cbbe0 0x7f1fc806def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.258+0000 7f1fc77fe700 1 -- 172.21.15.12:0/2295531824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0009a20 con 0x7f1fc8156030 2023-10-08T16:24:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1fc77fe700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0013000 tx=0x7f1fc0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc0027470 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc0027610 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc8158620 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc00279d0 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.259+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc8158c60 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.260+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc8157dc0 con 0x7f1fc8156030 2023-10-08T16:24:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.261+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fc0024070 con 0x7f1fc8156030 2023-10-08T16:24:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.262+0000 7f1faeffd700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.262+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f1fc0086a90 con 0x7f1fc8156030 2023-10-08T16:24:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.262+0000 7f1fc6ffd700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.263+0000 7f1fc6ffd700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 0x7f1fb40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007fd0 tx=0x7f1fb8007d30 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.266+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fc0053ed0 con 0x7f1fc8156030 2023-10-08T16:24:19.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.470+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1fc804c3c0 con 0x7f1fc8156030 2023-10-08T16:24:19.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.470+0000 7f1faeffd700 1 -- 172.21.15.12:0/2295531824 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1fc00574f0 con 0x7f1fc8156030 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:19.471 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 msgr2=0x7f1fb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 0x7f1fb40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1fb8007fd0 tx=0x7f1fb8007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 msgr2=0x7f1fc813d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0013000 tx=0x7f1fc0019000 comp rx=0 tx=0).stop 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 shutdown_connections 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1fb4066f30 0x7f1fb40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1fc8156030 0x7f1fc813d6d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1fc806f450 0x7f1fc8159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 --2- 172.21.15.12:0/2295531824 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1fc80cbbe0 0x7f1fc806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 >> 172.21.15.12:0/2295531824 conn(0x7f1fc806d170 msgr2=0x7f1fc815ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 shutdown_connections 2023-10-08T16:24:19.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.473+0000 7f1fc7fff700 1 -- 172.21.15.12:0/2295531824 wait complete. 2023-10-08T16:24:19.490 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:24:19.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:24:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.681+0000 7fb39f59e700 1 Processor -- start 2023-10-08T16:24:19.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.681+0000 7fb39f59e700 1 -- start start 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3a0153a30 0x7fb3a00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a00c9090 0x7fb3a0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a00c2200 con 0x7fb3a0153660 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a0157250 con 0x7fb3a0153a30 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00c15f0 con 0x7fb3a00c9090 2023-10-08T16:24:19.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3a0153a30 0x7fb3a00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb3a0153a30 0x7fb3a00c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57492/0 (socket says 172.21.15.12:57492) 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39dd9b700 1 -- 172.21.15.12:0/4251548193 learned_addr learned my addr 172.21.15.12:0/4251548193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39ed9d700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a00c9090 0x7fb3a0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39dd9b700 1 -- 172.21.15.12:0/4251548193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a00c9090 msgr2=0x7fb3a0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.683+0000 7fb39dd9b700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a00c9090 0x7fb3a0156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39dd9b700 1 -- 172.21.15.12:0/4251548193 >> v1:172.21.15.29:6789/0 conn(0x7fb3a0153660 legacy=0x7fb3a00c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39dd9b700 1 -- 172.21.15.12:0/4251548193 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a00c18d0 con 0x7fb3a0153a30 2023-10-08T16:24:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39dd9b700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a00c0ef0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb3940099b0 tx=0x7fb394009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9ffa950d7c73f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39d59a700 1 -- 172.21.15.12:0/4251548193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb394009ea0 con 0x7fb3a0153a30 2023-10-08T16:24:19.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39d59a700 1 -- 172.21.15.12:0/4251548193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39400b860 con 0x7fb3a0153a30 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.684+0000 7fb39d59a700 1 -- 172.21.15.12:0/4251548193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39400bc00 con 0x7fb3a0153a30 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 -- 172.21.15.12:0/4251548193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 msgr2=0x7fb3a00c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a00c0ef0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb3940099b0 tx=0x7fb394009250 comp rx=0 tx=0).stop 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 -- 172.21.15.12:0/4251548193 shutdown_connections 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a00c9090 0x7fb3a0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 --2- 172.21.15.12:0/4251548193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a00c0ef0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 -- 172.21.15.12:0/4251548193 >> 172.21.15.12:0/4251548193 conn(0x7fb3a006c6a0 msgr2=0x7fb3a006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 -- 172.21.15.12:0/4251548193 shutdown_connections 2023-10-08T16:24:19.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.685+0000 7fb39f59e700 1 -- 172.21.15.12:0/4251548193 wait complete. 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.686+0000 7fb39f59e700 1 Processor -- start 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.686+0000 7fb39f59e700 1 -- start start 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3a00c9090 0x7fb3a00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a0153660 0x7fb3a00af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00b1b90 con 0x7fb3a0153a30 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a014ee00 con 0x7fb3a00c9090 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.687+0000 7fb39f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a00af760 con 0x7fb3a0153660 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57508/0 (socket says 172.21.15.12:57508) 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 -- 172.21.15.12:0/1858424794 learned_addr learned my addr 172.21.15.12:0/1858424794 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39dd9b700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a0153660 0x7fb3a00af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39e59c700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3a00c9090 0x7fb3a00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 -- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a0153660 msgr2=0x7fb3a00af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a0153660 0x7fb3a00af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 -- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3a00c9090 msgr2=0x7fb3a00b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3a00c9090 0x7fb3a00b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:19.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 -- 172.21.15.12:0/1858424794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3940094f0 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.688+0000 7fb39ed9d700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb398009ec0 tx=0x7fb39800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.689+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800cb70 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.689+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39800f040 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.689+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb398014480 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.689+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a014e510 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.689+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a014ea90 con 0x7fb3a0153a30 2023-10-08T16:24:19.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.690+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a00c2dc0 con 0x7fb3a0153a30 2023-10-08T16:24:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.691+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb398014830 con 0x7fb3a0153a30 2023-10-08T16:24:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.692+0000 7fb38e7fc700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.692+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fb398084c70 con 0x7fb3a0153a30 2023-10-08T16:24:19.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.692+0000 7fb39e59c700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 0x7fb3800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:19.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.692+0000 7fb39e59c700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb390003a80 tx=0x7fb390007ec0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:19.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.696+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb398052010 con 0x7fb3a0153a30 2023-10-08T16:24:19.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:19.897+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb3a004c3c0 con 0x7fb3a0153a30 2023-10-08T16:24:20.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.243+0000 7fb38e7fc700 1 -- 172.21.15.12:0/1858424794 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb398055630 con 0x7fb3a0153a30 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 msgr2=0x7fb3800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb390003a80 tx=0x7fb390007ec0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 msgr2=0x7fb3a0162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb398009ec0 tx=0x7fb39800b040 comp rx=0 tx=0).stop 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 shutdown_connections 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb380066f30 0x7fb3800693e0 secure :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb390003a80 tx=0x7fb390007ec0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb3a0153a30 0x7fb3a0162d80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb3a00c9090 0x7fb3a00b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 --2- 172.21.15.12:0/1858424794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb3a0153660 0x7fb3a00af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.248+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 >> 172.21.15.12:0/1858424794 conn(0x7fb3a006c6a0 msgr2=0x7fb3a00ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:20.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.249+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 shutdown_connections 2023-10-08T16:24:20.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.249+0000 7fb39f59e700 1 -- 172.21.15.12:0/1858424794 wait complete. 2023-10-08T16:24:20.252 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:24:20.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:24:20.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.464+0000 7f7f2ed9d700 1 Processor -- start 2023-10-08T16:24:20.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.464+0000 7f7f2ed9d700 1 -- start start 2023-10-08T16:24:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.465+0000 7f7f2ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f280cf110 0x7f7f28164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.465+0000 7f7f2ed9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815afd0 con 0x7f7f28153c30 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.465+0000 7f7f2ed9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2815b2b0 con 0x7f7f2815de50 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.465+0000 7f7f2ed9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2815b590 con 0x7f7f280cf110 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f280cf110 0x7f7f28164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7f280cf110 0x7f7f28164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57510/0 (socket says 172.21.15.12:57510) 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2dd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f28153c30 0x7f7f2815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39264/0 (socket says 172.21.15.12:39264) 2023-10-08T16:24:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 -- 172.21.15.12:0/711731004 learned_addr learned my addr 172.21.15.12:0/711731004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 -- 172.21.15.12:0/711731004 >> v1:172.21.15.29:6789/0 conn(0x7f7f2815de50 legacy=0x7f7f280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 -- 172.21.15.12:0/711731004 >> v1:172.21.15.12:6789/0 conn(0x7f7f28153c30 legacy=0x7f7f2815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 -- 172.21.15.12:0/711731004 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2815b870 con 0x7f7f280cf110 2023-10-08T16:24:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2cd99700 1 -- 172.21.15.12:0/711731004 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713986213 0 0) 0x7f7f2815afd0 con 0x7f7f28153c30 2023-10-08T16:24:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.466+0000 7f7f2e59c700 1 --2- 172.21.15.12:0/711731004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f280cf110 0x7f7f28164600 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009f20 tx=0x7f7f20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2d37335a51716b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2cd99700 1 -- 172.21.15.12:0/711731004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000e070 con 0x7f7f280cf110 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2cd99700 1 -- 172.21.15.12:0/711731004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000ba80 con 0x7f7f280cf110 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2cd99700 1 -- 172.21.15.12:0/711731004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200092e0 con 0x7f7f280cf110 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/711731004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f280cf110 msgr2=0x7f7f28164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/711731004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f280cf110 0x7f7f28164600 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7f20009f20 tx=0x7f7f20009840 comp rx=0 tx=0).stop 2023-10-08T16:24:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/711731004 shutdown_connections 2023-10-08T16:24:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/711731004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f280cf110 0x7f7f28164600 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/711731004 >> 172.21.15.12:0/711731004 conn(0x7f7f280703a0 msgr2=0x7f7f280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.467+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/711731004 shutdown_connections 2023-10-08T16:24:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.468+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/711731004 wait complete. 2023-10-08T16:24:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.469+0000 7f7f2ed9d700 1 Processor -- start 2023-10-08T16:24:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.469+0000 7f7f2ed9d700 1 -- start start 2023-10-08T16:24:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f280cf110 0x7f7f280cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f2815de50 0x7f7f28152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b53e0 con 0x7f7f28153c30 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b56c0 con 0x7f7f280cf110 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2ed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280b59a0 con 0x7f7f2815de50 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2d59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2dd9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f280cf110 0x7f7f280cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:20.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2d59a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57520/0 (socket says 172.21.15.12:57520) 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2d59a700 1 -- 172.21.15.12:0/1703312269 learned_addr learned my addr 172.21.15.12:0/1703312269 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.470+0000 7f7f2e59c700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f2815de50 0x7f7f28152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 -- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f2815de50 msgr2=0x7f7f28152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f2815de50 0x7f7f28152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 -- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f280cf110 msgr2=0x7f7f280cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:20.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f280cf110 0x7f7f280cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 -- 172.21.15.12:0/1703312269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009ae0 con 0x7f7f28153c30 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2d59a700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800c4e0 tx=0x7f7f1800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011590 con 0x7f7f28153c30 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18011710 con 0x7f7f28153c30 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280b5c80 con 0x7f7f28153c30 2023-10-08T16:24:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011ad0 con 0x7f7f28153c30 2023-10-08T16:24:20.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.471+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f280cc870 con 0x7f7f28153c30 2023-10-08T16:24:20.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.472+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f280cca90 con 0x7f7f28153c30 2023-10-08T16:24:20.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.474+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f1801b3b0 con 0x7f7f28153c30 2023-10-08T16:24:20.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.475+0000 7f7f1dffb700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:20.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.475+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f7f18083d30 con 0x7f7f28153c30 2023-10-08T16:24:20.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.475+0000 7f7f2dd9b700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:20.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.476+0000 7f7f2dd9b700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 0x7f7f0c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f24007fd0 tx=0x7f7f24007d30 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:20.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.479+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f18050fe0 con 0x7f7f28153c30 2023-10-08T16:24:20.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:20.682+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7f280b61a0 con 0x7f7f28153c30 2023-10-08T16:24:21.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.251+0000 7f7f1dffb700 1 -- 172.21.15.12:0/1703312269 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7f280b61a0 con 0x7f7f28153c30 2023-10-08T16:24:21.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.259+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 msgr2=0x7f7f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.259+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 0x7f7f0c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f24007fd0 tx=0x7f7f24007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:21.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.259+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 msgr2=0x7f7f280b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.259+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800c4e0 tx=0x7f7f1800c7f0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 shutdown_connections 2023-10-08T16:24:21.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f0c066f30 0x7f7f0c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f2815de50 0x7f7f28152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f280cf110 0x7f7f280cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 --2- 172.21.15.12:0/1703312269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f28153c30 0x7f7f280b32d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.264+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 >> 172.21.15.12:0/1703312269 conn(0x7f7f280703a0 msgr2=0x7f7f28070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:21.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.268+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 shutdown_connections 2023-10-08T16:24:21.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.271+0000 7f7f2ed9d700 1 -- 172.21.15.12:0/1703312269 wait complete. 2023-10-08T16:24:21.273 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:24:21.293 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:24:21.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.484+0000 7f7f99b9d700 1 Processor -- start 2023-10-08T16:24:21.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.484+0000 7f7f99b9d700 1 -- start start 2023-10-08T16:24:21.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.485+0000 7f7f99b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 0x7f7f94153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f99b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f9415de50 0x7f7f9415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f99b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f9415af60 con 0x7f7f940cea00 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f99b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f9415d010 con 0x7f7f9415de50 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f99b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9415b240 con 0x7f7f94153a00 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f9939c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7f940cea00 0x7f7f940cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:39276/0 (socket says 172.21.15.12:39276) 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f9939c700 1 -- 172.21.15.12:0/1871279569 learned_addr learned my addr 172.21.15.12:0/1871279569 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f93fff700 1 --2- 172.21.15.12:0/1871279569 >> v2:172.21.15.29:3300/0 conn(0x7f7f9415de50 0x7f7f9415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 0x7f7f94153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f937fe700 1 -- 172.21.15.12:0/1871279569 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146316766 0 0) 0x7f7f9415af60 con 0x7f7f940cea00 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.486+0000 7f7f937fe700 1 -- 172.21.15.12:0/1871279569 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f84003570 con 0x7f7f940cea00 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f93fff700 1 -- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 msgr2=0x7f7f94153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f93fff700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 0x7f7f94153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f93fff700 1 -- 172.21.15.12:0/1871279569 >> v1:172.21.15.12:6789/0 conn(0x7f7f940cea00 legacy=0x7f7f940cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f93fff700 1 -- 172.21.15.12:0/1871279569 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9415b520 con 0x7f7f9415de50 2023-10-08T16:24:21.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 0x7f7f94153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f93fff700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f9415de50 0x7f7f9415a540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098e0 tx=0x7f7f800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8836c58466ea3d11 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f937fe700 1 -- 172.21.15.12:0/1871279569 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011630 con 0x7f7f9415de50 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f937fe700 1 -- 172.21.15.12:0/1871279569 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f80011790 con 0x7f7f9415de50 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.487+0000 7f7f937fe700 1 -- 172.21.15.12:0/1871279569 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011b30 con 0x7f7f9415de50 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 -- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f9415de50 msgr2=0x7f7f9415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f9415de50 0x7f7f9415a540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f7f800098e0 tx=0x7f7f800091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 -- 172.21.15.12:0/1871279569 shutdown_connections 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f94153a00 0x7f7f94153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/1871279569 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f9415de50 0x7f7f9415a540 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 -- 172.21.15.12:0/1871279569 >> 172.21.15.12:0/1871279569 conn(0x7f7f940703a0 msgr2=0x7f7f940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 -- 172.21.15.12:0/1871279569 shutdown_connections 2023-10-08T16:24:21.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.488+0000 7f7f99b9d700 1 -- 172.21.15.12:0/1871279569 wait complete. 2023-10-08T16:24:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.489+0000 7f7f99b9d700 1 Processor -- start 2023-10-08T16:24:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.489+0000 7f7f99b9d700 1 -- start start 2023-10-08T16:24:21.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 0x7f7f940b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 0x7f7f940ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f94152750 con 0x7f7f94153a00 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940cd520 con 0x7f7f940cea00 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.490+0000 7f7f99b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f940c83e0 con 0x7f7f9415de50 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:57522/0 (socket says 172.21.15.12:57522) 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 -- 172.21.15.12:0/2351869743 learned_addr learned my addr 172.21.15.12:0/2351869743 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 -- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 msgr2=0x7f7f940ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 0x7f7f940b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f9939c700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 0x7f7f940ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 0x7f7f940ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 -- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 msgr2=0x7f7f940b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 0x7f7f940b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 -- 172.21.15.12:0/2351869743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f88009420 con 0x7f7f94153a00 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 0x7f7f940b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f9939c700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 0x7f7f940ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.491+0000 7f7f93fff700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009ed0 tx=0x7f7f80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.492+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80011b10 con 0x7f7f94153a00 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.492+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f800233f0 con 0x7f7f94153a00 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.492+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f80023770 con 0x7f7f94153a00 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.492+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f80009420 con 0x7f7f94153a00 2023-10-08T16:24:21.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.492+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f940c7ab0 con 0x7f7f94153a00 2023-10-08T16:24:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.493+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f940c8570 con 0x7f7f94153a00 2023-10-08T16:24:21.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.494+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f8002c3b0 con 0x7f7f94153a00 2023-10-08T16:24:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.495+0000 7f7f90ff9700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.495+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f7f80085f20 con 0x7f7f94153a00 2023-10-08T16:24:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.495+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:21.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.496+0000 7f7f98b9b700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 0x7f7f780693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f880093f0 tx=0x7f7f88008040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:21.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.500+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f800530d0 con 0x7f7f94153a00 2023-10-08T16:24:21.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:21.750+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f9415b800 con 0x7f7f94153a00 2023-10-08T16:24:22.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.267+0000 7f7f90ff9700 1 -- 172.21.15.12:0/2351869743 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v30) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7f800566f0 con 0x7f7f94153a00 2023-10-08T16:24:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.275+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 msgr2=0x7f7f780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.275+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 0x7f7f780693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7f880093f0 tx=0x7f7f88008040 comp rx=0 tx=0).stop 2023-10-08T16:24:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.275+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 msgr2=0x7f7f94152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.275+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f7f80009ed0 tx=0x7f7f80017000 comp rx=0 tx=0).stop 2023-10-08T16:24:22.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 shutdown_connections 2023-10-08T16:24:22.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f78066f30 0x7f7f780693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f9415de50 0x7f7f940ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f940cea00 0x7f7f940b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 --2- 172.21.15.12:0/2351869743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f94153a00 0x7f7f94152210 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.276+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 >> 172.21.15.12:0/2351869743 conn(0x7f7f940703a0 msgr2=0x7f7f94152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:22.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.277+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 shutdown_connections 2023-10-08T16:24:22.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.277+0000 7f7f99b9d700 1 -- 172.21.15.12:0/2351869743 wait complete. 2023-10-08T16:24:22.281 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 8 and data pool 9 2023-10-08T16:24:22.304 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:22.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.491+0000 7f34ebfff700 1 Processor -- start 2023-10-08T16:24:22.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.491+0000 7f34ebfff700 1 -- start start 2023-10-08T16:24:22.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.492+0000 7f34ebfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 0x7f34ec06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.492+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 0x7f34ec0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.492+0000 7f34ebfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec06d3e0 con 0x7f34ec0ca7b0 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.492+0000 7f34ebfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec06c7d0 con 0x7f34ec1596d0 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.492+0000 7f34ebfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06cab0 con 0x7f34ec159aa0 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34eb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f34ec0ca7b0 0x7f34ec0cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36130/0 (socket says 172.21.15.12:36130) 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34eb7fe700 1 -- 172.21.15.12:0/3793050798 learned_addr learned my addr 172.21.15.12:0/3793050798 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34ea7fc700 1 --2- 172.21.15.12:0/3793050798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 0x7f34ec0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34eaffd700 1 --2- 172.21.15.12:0/3793050798 >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 0x7f34ec06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34e9ffb700 1 -- 172.21.15.12:0/3793050798 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012512342 0 0) 0x7f34ec06d3e0 con 0x7f34ec0ca7b0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34e9ffb700 1 -- 172.21.15.12:0/3793050798 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d4003570 con 0x7f34ec0ca7b0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34ea7fc700 1 -- 172.21.15.12:0/3793050798 >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 msgr2=0x7f34ec06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34ea7fc700 1 --2- 172.21.15.12:0/3793050798 >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 0x7f34ec06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34ea7fc700 1 -- 172.21.15.12:0/3793050798 >> v1:172.21.15.12:6789/0 conn(0x7f34ec0ca7b0 legacy=0x7f34ec0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.493+0000 7f34ea7fc700 1 -- 172.21.15.12:0/3793050798 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec06cd90 con 0x7f34ec159aa0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.494+0000 7f34eaffd700 1 --2- 172.21.15.12:0/3793050798 >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 0x7f34ec06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.494+0000 7f34ea7fc700 1 --2- 172.21.15.12:0/3793050798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 0x7f34ec0703a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34e00098e0 tx=0x7f34e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=645eb91bfc1c854b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.494+0000 7f34e9ffb700 1 -- 172.21.15.12:0/3793050798 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011630 con 0x7f34ec159aa0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.494+0000 7f34e9ffb700 1 -- 172.21.15.12:0/3793050798 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e0011790 con 0x7f34ec159aa0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.494+0000 7f34e9ffb700 1 -- 172.21.15.12:0/3793050798 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0011b30 con 0x7f34ec159aa0 2023-10-08T16:24:22.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 -- 172.21.15.12:0/3793050798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 msgr2=0x7f34ec0703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 --2- 172.21.15.12:0/3793050798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 0x7f34ec0703a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f34e00098e0 tx=0x7f34e00091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 -- 172.21.15.12:0/3793050798 shutdown_connections 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 --2- 172.21.15.12:0/3793050798 >> v2:172.21.15.29:3300/0 conn(0x7f34ec1596d0 0x7f34ec06d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 --2- 172.21.15.12:0/3793050798 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec159aa0 0x7f34ec0703a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 -- 172.21.15.12:0/3793050798 >> 172.21.15.12:0/3793050798 conn(0x7f34ec06e720 msgr2=0x7f34ec06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 -- 172.21.15.12:0/3793050798 shutdown_connections 2023-10-08T16:24:22.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.495+0000 7f34ebfff700 1 -- 172.21.15.12:0/3793050798 wait complete. 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.496+0000 7f34ebfff700 1 Processor -- start 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.496+0000 7f34ebfff700 1 -- start start 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 0x7f34ec149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 0x7f34ec157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec14e380 con 0x7f34ec159aa0 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec14d770 con 0x7f34ec1596d0 2023-10-08T16:24:22.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.497+0000 7f34ebfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec14da50 con 0x7f34ec0ca7b0 2023-10-08T16:24:22.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44214/0 (socket says 172.21.15.12:44214) 2023-10-08T16:24:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 -- 172.21.15.12:0/601457176 learned_addr learned my addr 172.21.15.12:0/601457176 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34ea7fc700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 0x7f34ec157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eaffd700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 0x7f34ec149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 -- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 msgr2=0x7f34ec149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 0x7f34ec149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 -- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 msgr2=0x7f34ec157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 0x7f34ec157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 -- 172.21.15.12:0/601457176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34dc009420 con 0x7f34ec159aa0 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34ea7fc700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 0x7f34ec157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:22.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eaffd700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 0x7f34ec149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:22.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.498+0000 7f34eb7fe700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001460 tx=0x7f34e4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.499+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e400ce80 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.499+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e400ab70 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.499+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e0009420 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.499+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40070f0 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.499+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec14e010 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.500+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec04c3c0 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.501+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34e4007520 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.502+0000 7f34d2ffd700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 0x7f34d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.502+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f34e4084c50 con 0x7f34ec159aa0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.502+0000 7f34eaffd700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 0x7f34d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.503+0000 7f34eaffd700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 0x7f34d80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0093f0 tx=0x7f34dc008040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.506+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34e4051d10 con 0x7f34ec159aa0 2023-10-08T16:24:22.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.708+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34ec158e90 con 0x7f34ec159aa0 2023-10-08T16:24:22.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.709+0000 7f34d2ffd700 1 -- 172.21.15.12:0/601457176 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f34e4055330 con 0x7f34ec159aa0 2023-10-08T16:24:22.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:22.710 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:21.750824+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:22.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 msgr2=0x7f34d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 0x7f34d80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0093f0 tx=0x7f34dc008040 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 msgr2=0x7f34ec0c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001460 tx=0x7f34e4001ae0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 shutdown_connections 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f34d8066f30 0x7f34d80693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34ec159aa0 0x7f34ec0c23f0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34ec0ca7b0 0x7f34ec149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 --2- 172.21.15.12:0/601457176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34ec1596d0 0x7f34ec157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 >> 172.21.15.12:0/601457176 conn(0x7f34ec06e720 msgr2=0x7f34ec0638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 shutdown_connections 2023-10-08T16:24:22.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.711+0000 7f34ebfff700 1 -- 172.21.15.12:0/601457176 wait complete. 2023-10-08T16:24:22.731 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.917+0000 7f7010d9d700 1 Processor -- start 2023-10-08T16:24:22.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.917+0000 7f7010d9d700 1 -- start start 2023-10-08T16:24:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.918+0000 7f7010d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 0x7f700c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.918+0000 7f7010d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c0c6d50 con 0x7f700c140e40 2023-10-08T16:24:22.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.918+0000 7f7010d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c0c7030 con 0x7f700c06de50 2023-10-08T16:24:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.918+0000 7f7010d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0c7310 con 0x7f700c140a70 2023-10-08T16:24:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f700c140e40 0x7f700c0c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36134/0 (socket says 172.21.15.12:36134) 2023-10-08T16:24:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700affd700 1 -- 172.21.15.12:0/2577459015 learned_addr learned my addr 172.21.15.12:0/2577459015 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:22.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700b7fe700 1 --2- 172.21.15.12:0/2577459015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 0x7f700c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556922760 0 0) 0x7f700c0c6d50 con 0x7f700c140e40 2023-10-08T16:24:22.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff4003570 con 0x7f700c140e40 2023-10-08T16:24:22.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2005019941 0 0) 0x7f700c0c7030 con 0x7f700c06de50 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f700c0c6d50 con 0x7f700c06de50 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700b7fe700 1 -- 172.21.15.12:0/2577459015 >> v1:172.21.15.29:6789/0 conn(0x7f700c06de50 legacy=0x7f700c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700b7fe700 1 -- 172.21.15.12:0/2577459015 >> v1:172.21.15.12:6789/0 conn(0x7f700c140e40 legacy=0x7f700c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.919+0000 7f700b7fe700 1 -- 172.21.15.12:0/2577459015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0c75f0 con 0x7f700c140a70 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.920+0000 7f700b7fe700 1 --2- 172.21.15.12:0/2577459015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 0x7f700c0c6770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009910 tx=0x7f6ffc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7939b63792eed722 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.920+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc011630 con 0x7f700c140a70 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.920+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc011790 con 0x7f700c140a70 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.920+0000 7f700a7fc700 1 -- 172.21.15.12:0/2577459015 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc011b30 con 0x7f700c140a70 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 -- 172.21.15.12:0/2577459015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 msgr2=0x7f700c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 --2- 172.21.15.12:0/2577459015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 0x7f700c0c6770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009910 tx=0x7f6ffc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 -- 172.21.15.12:0/2577459015 shutdown_connections 2023-10-08T16:24:22.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 --2- 172.21.15.12:0/2577459015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c140a70 0x7f700c0c6770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 -- 172.21.15.12:0/2577459015 >> 172.21.15.12:0/2577459015 conn(0x7f700c06d170 msgr2=0x7f700c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:22.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 -- 172.21.15.12:0/2577459015 shutdown_connections 2023-10-08T16:24:22.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.921+0000 7f7010d9d700 1 -- 172.21.15.12:0/2577459015 wait complete. 2023-10-08T16:24:22.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.922+0000 7f7010d9d700 1 Processor -- start 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.922+0000 7f7010d9d700 1 -- start start 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 0x7f700c13abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c140e40 0x7f700c0b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c157a80 con 0x7f700c140a70 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0c3310 con 0x7f700c140e40 2023-10-08T16:24:22.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f7010d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c13b0f0 con 0x7f700c06de50 2023-10-08T16:24:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.923+0000 7f700affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 0x7f700c13abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44224/0 (socket says 172.21.15.12:44224) 2023-10-08T16:24:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700affd700 1 -- 172.21.15.12:0/395847217 learned_addr learned my addr 172.21.15.12:0/395847217 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:22.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700bfff700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c140e40 0x7f700c0b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 -- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c140e40 msgr2=0x7f700c0b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c140e40 0x7f700c0b09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 -- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 msgr2=0x7f700c0ca6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 -- 172.21.15.12:0/395847217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc009420 con 0x7f700c06de50 2023-10-08T16:24:22.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700affd700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.924+0000 7f700b7fe700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 0x7f700c13abb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc016000 tx=0x7f6ffc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.925+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc01f070 con 0x7f700c06de50 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.925+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc002f70 con 0x7f700c06de50 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.925+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc011900 con 0x7f700c06de50 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.925+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c0cb920 con 0x7f700c06de50 2023-10-08T16:24:22.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.925+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c0cb3e0 con 0x7f700c06de50 2023-10-08T16:24:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.926+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c0cb760 con 0x7f700c06de50 2023-10-08T16:24:22.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.927+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ffc023070 con 0x7f700c06de50 2023-10-08T16:24:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.928+0000 7f6ff37fe700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 0x7f6ff80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.928+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6ffc085960 con 0x7f700c06de50 2023-10-08T16:24:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.928+0000 7f700affd700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 0x7f6ff80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.928+0000 7f700affd700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 0x7f6ff80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f700c13de60 tx=0x7f7000009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:22.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:22.932+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ffc052a20 con 0x7f700c06de50 2023-10-08T16:24:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.134+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f700c04c420 con 0x7f700c06de50 2023-10-08T16:24:23.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.135+0000 7f6ff37fe700 1 -- 172.21.15.12:0/395847217 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16006 (secure 0 0 0) 0x7f6ffc02a090 con 0x7f700c06de50 2023-10-08T16:24:23.136 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:23.136 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":84,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:21.750824+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.137+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 msgr2=0x7f6ff80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.137+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 0x7f6ff80693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f700c13de60 tx=0x7f7000009040 comp rx=0 tx=0).stop 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 msgr2=0x7f700c13abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 0x7f700c13abb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc016000 tx=0x7f6ffc017000 comp rx=0 tx=0).stop 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 shutdown_connections 2023-10-08T16:24:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6ff8066f30 0x7f6ff80693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f700c140e40 0x7f700c0b09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f700c06de50 0x7f700c13abb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 --2- 172.21.15.12:0/395847217 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f700c140a70 0x7f700c0ca6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 >> 172.21.15.12:0/395847217 conn(0x7f700c06d170 msgr2=0x7f700c0c2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 shutdown_connections 2023-10-08T16:24:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.138+0000 7f7010d9d700 1 -- 172.21.15.12:0/395847217 wait complete. 2023-10-08T16:24:23.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:24:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.350+0000 7fe79b59e700 1 Processor -- start 2023-10-08T16:24:23.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.350+0000 7fe79b59e700 1 -- start start 2023-10-08T16:24:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe79b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c153a00 0x7fe79c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe79b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe79c15de50 0x7fe79c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe79b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe79c15af60 con 0x7fe79c0cea00 2023-10-08T16:24:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe79b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe79c15d010 con 0x7fe79c15de50 2023-10-08T16:24:23.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe79b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c15b240 con 0x7fe79c153a00 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe799d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe79c15de50 0x7fe79c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe799d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe79c15de50 0x7fe79c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44238/0 (socket says 172.21.15.12:44238) 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.351+0000 7fe799d9b700 1 -- 172.21.15.12:0/3889976198 learned_addr learned my addr 172.21.15.12:0/3889976198 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe79a59c700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c153a00 0x7fe79c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe799d9b700 1 -- 172.21.15.12:0/3889976198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c153a00 msgr2=0x7fe79c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:23.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe799d9b700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c153a00 0x7fe79c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe799d9b700 1 -- 172.21.15.12:0/3889976198 >> v1:172.21.15.29:6789/0 conn(0x7fe79c0cea00 legacy=0x7fe79c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe799d9b700 1 -- 172.21.15.12:0/3889976198 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe79c15b520 con 0x7fe79c15de50 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe799d9b700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c15de50 0x7fe79c15a540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe7900099b0 tx=0x7fe790009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828182e57f6d9840 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.352+0000 7fe79959a700 1 -- 172.21.15.12:0/3889976198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe790009ea0 con 0x7fe79c15de50 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79959a700 1 -- 172.21.15.12:0/3889976198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe79000b860 con 0x7fe79c15de50 2023-10-08T16:24:23.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79959a700 1 -- 172.21.15.12:0/3889976198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe79000bc00 con 0x7fe79c15de50 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 -- 172.21.15.12:0/3889976198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c15de50 msgr2=0x7fe79c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c15de50 0x7fe79c15a540 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe7900099b0 tx=0x7fe790009250 comp rx=0 tx=0).stop 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 -- 172.21.15.12:0/3889976198 shutdown_connections 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c153a00 0x7fe79c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 --2- 172.21.15.12:0/3889976198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c15de50 0x7fe79c15a540 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 -- 172.21.15.12:0/3889976198 >> 172.21.15.12:0/3889976198 conn(0x7fe79c0703a0 msgr2=0x7fe79c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:23.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 -- 172.21.15.12:0/3889976198 shutdown_connections 2023-10-08T16:24:23.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.353+0000 7fe79b59e700 1 -- 172.21.15.12:0/3889976198 wait complete. 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.355+0000 7fe79b59e700 1 Processor -- start 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.355+0000 7fe79b59e700 1 -- start start 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 0x7fe79c149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c15de50 0x7fe79c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0c63a0 con 0x7fe79c0cea00 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0c5790 con 0x7fe79c153a00 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c0c5a70 con 0x7fe79c15de50 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44254/0 (socket says 172.21.15.12:44254) 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 -- 172.21.15.12:0/2430013289 learned_addr learned my addr 172.21.15.12:0/2430013289 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:23.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe799d9b700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 0x7fe79c149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79ad9d700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c15de50 0x7fe79c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 -- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c15de50 msgr2=0x7fe79c15bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c15de50 0x7fe79c15bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 -- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 msgr2=0x7fe79c149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 0x7fe79c149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:23.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe79a59c700 1 -- 172.21.15.12:0/2430013289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900094f0 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.356+0000 7fe799d9b700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 0x7fe79c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe79a59c700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ec80 tx=0x7fe78c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c00c9d0 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78c00cb30 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c0c5d50 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c013470 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.357+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c14a100 con 0x7fe79c0cea00 2023-10-08T16:24:23.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.358+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c04c3c0 con 0x7fe79c0cea00 2023-10-08T16:24:23.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.360+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe78c013820 con 0x7fe79c0cea00 2023-10-08T16:24:23.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.361+0000 7fe78a7fc700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 0x7fe77c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:23.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.361+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe78c0852c0 con 0x7fe79c0cea00 2023-10-08T16:24:23.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.361+0000 7fe799d9b700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 0x7fe77c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:23.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.362+0000 7fe799d9b700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 0x7fe77c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7900099b0 tx=0x7fe790017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:23.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.364+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe78c052380 con 0x7fe79c0cea00 2023-10-08T16:24:23.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:23.613+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe79c15b800 con 0x7fe79c0cea00 2023-10-08T16:24:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.272+0000 7fe78a7fc700 1 -- 172.21.15.12:0/2430013289 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v33) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe78c0559a0 con 0x7fe79c0cea00 2023-10-08T16:24:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 msgr2=0x7fe77c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 0x7fe77c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe7900099b0 tx=0x7fe790017000 comp rx=0 tx=0).stop 2023-10-08T16:24:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 msgr2=0x7fe79c15fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ec80 tx=0x7fe78c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 shutdown_connections 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe77c066f30 0x7fe77c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe79c0cea00 0x7fe79c15fd90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe79c15de50 0x7fe79c15bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 --2- 172.21.15.12:0/2430013289 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe79c153a00 0x7fe79c149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 >> 172.21.15.12:0/2430013289 conn(0x7fe79c0703a0 msgr2=0x7fe79c0b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.275+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 shutdown_connections 2023-10-08T16:24:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.276+0000 7fe79b59e700 1 -- 172.21.15.12:0/2430013289 wait complete. 2023-10-08T16:24:24.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:24:24.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.490+0000 7f01e7fff700 1 Processor -- start 2023-10-08T16:24:24.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.490+0000 7f01e7fff700 1 -- start start 2023-10-08T16:24:24.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01e80c7be0 0x7f01e806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806b290 con 0x7f01e80c7fb0 2023-10-08T16:24:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806b570 con 0x7f01e813f780 2023-10-08T16:24:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e806bf10 con 0x7f01e80c7be0 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e6ffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f01e80c7be0 0x7f01e806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e77fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f01e813f780 0x7f01e813fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47584/0 (socket says 172.21.15.12:47584) 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.492+0000 7f01e77fe700 1 -- 172.21.15.12:0/4213413197 learned_addr learned my addr 172.21.15.12:0/4213413197 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597440047 0 0) 0x7f01e806b570 con 0x7f01e813f780 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d0003570 con 0x7f01e813f780 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484797365 0 0) 0x7f01e806b290 con 0x7f01e80c7fb0 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01e806b570 con 0x7f01e80c7fb0 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e6ffd700 1 -- 172.21.15.12:0/4213413197 >> v1:172.21.15.29:6789/0 conn(0x7f01e813f780 legacy=0x7f01e813fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e6ffd700 1 -- 172.21.15.12:0/4213413197 >> v1:172.21.15.12:6789/0 conn(0x7f01e80c7fb0 legacy=0x7f01e815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e6ffd700 1 -- 172.21.15.12:0/4213413197 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e806b850 con 0x7f01e80c7be0 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e6ffd700 1 --2- 172.21.15.12:0/4213413197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e806abd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01d80098e0 tx=0x7f01d80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b820614bcb44801 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011630 con 0x7f01e80c7be0 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8011790 con 0x7f01e80c7be0 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.493+0000 7f01e5ffb700 1 -- 172.21.15.12:0/4213413197 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011b30 con 0x7f01e80c7be0 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 -- 172.21.15.12:0/4213413197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 msgr2=0x7f01e806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 --2- 172.21.15.12:0/4213413197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e806abd0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f01d80098e0 tx=0x7f01d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 -- 172.21.15.12:0/4213413197 shutdown_connections 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 --2- 172.21.15.12:0/4213413197 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e806abd0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 -- 172.21.15.12:0/4213413197 >> 172.21.15.12:0/4213413197 conn(0x7f01e806d110 msgr2=0x7f01e80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 -- 172.21.15.12:0/4213413197 shutdown_connections 2023-10-08T16:24:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.494+0000 7f01e7fff700 1 -- 172.21.15.12:0/4213413197 wait complete. 2023-10-08T16:24:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.495+0000 7f01e7fff700 1 Processor -- start 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.496+0000 7f01e7fff700 1 -- start start 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.496+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e8139230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.496+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 0x7f01e8155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.496+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8139a80 con 0x7f01e813f780 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8139d60 con 0x7f01e80c7be0 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e813c610 con 0x7f01e80c7fb0 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44264/0 (socket says 172.21.15.12:44264) 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 -- 172.21.15.12:0/2513210539 learned_addr learned my addr 172.21.15.12:0/2513210539 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e6ffd700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e8139230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e67fc700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 0x7f01e8155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 -- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 msgr2=0x7f01e8155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 0x7f01e8155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 -- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 msgr2=0x7f01e8139230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e8139230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e77fe700 1 -- 172.21.15.12:0/2513210539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8009420 con 0x7f01e813f780 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.497+0000 7f01e67fc700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 0x7f01e8155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01e77fe700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cc20 tx=0x7f01e0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000a8b0 con 0x7f01e813f780 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e000aa10 con 0x7f01e813f780 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e813c8f0 con 0x7f01e813f780 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000add0 con 0x7f01e813f780 2023-10-08T16:24:24.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.498+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e8156240 con 0x7f01e813f780 2023-10-08T16:24:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.499+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e813c470 con 0x7f01e813f780 2023-10-08T16:24:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.500+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f01e0007300 con 0x7f01e813f780 2023-10-08T16:24:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.501+0000 7f01ceffd700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 0x7f01d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.501+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f01e0084b20 con 0x7f01e813f780 2023-10-08T16:24:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.501+0000 7f01e6ffd700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 0x7f01d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.502+0000 7f01e6ffd700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 0x7f01d40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f01d80093f0 tx=0x7f01d8017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.505+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01e813c470 con 0x7f01e813f780 2023-10-08T16:24:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:24.758+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f01e813c470 con 0x7f01e813f780 2023-10-08T16:24:25.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.277+0000 7f01ceffd700 1 -- 172.21.15.12:0/2513210539 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f01e813c470 con 0x7f01e813f780 2023-10-08T16:24:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 msgr2=0x7f01d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 0x7f01d40693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f01d80093f0 tx=0x7f01d8017000 comp rx=0 tx=0).stop 2023-10-08T16:24:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 msgr2=0x7f01e816d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f01e000cc20 tx=0x7f01e0001a40 comp rx=0 tx=0).stop 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 shutdown_connections 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f01d4066f30 0x7f01d40693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f01e813f780 0x7f01e816d730 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f01e80c7be0 0x7f01e8139230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 --2- 172.21.15.12:0/2513210539 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f01e80c7fb0 0x7f01e8155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 >> 172.21.15.12:0/2513210539 conn(0x7f01e806d110 msgr2=0x7f01e80cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 shutdown_connections 2023-10-08T16:24:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.280+0000 7f01e7fff700 1 -- 172.21.15.12:0/2513210539 wait complete. 2023-10-08T16:24:25.301 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:25.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.491+0000 7f5def19d700 1 Processor -- start 2023-10-08T16:24:25.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.491+0000 7f5def19d700 1 -- start start 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5def19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 0x7f5de814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5def19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 0x7f5de81501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5def19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de806a490 con 0x7f5de806e0a0 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5def19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de80c7230 con 0x7f5de806f3a0 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5def19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de806b930 con 0x7f5de806e470 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5dee19b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5de806e0a0 0x7f5de80c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36156/0 (socket says 172.21.15.12:36156) 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5dee19b700 1 -- 172.21.15.12:0/793090025 learned_addr learned my addr 172.21.15.12:0/793090025 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5dee99c700 1 --2- 172.21.15.12:0/793090025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 0x7f5de81501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.492+0000 7f5ded99a700 1 --2- 172.21.15.12:0/793090025 >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 0x7f5de814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250084545 0 0) 0x7f5de806a490 con 0x7f5de806e0a0 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd4003570 con 0x7f5de806e0a0 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5dee99c700 1 -- 172.21.15.12:0/793090025 >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 msgr2=0x7f5de814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5dee99c700 1 --2- 172.21.15.12:0/793090025 >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 0x7f5de814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5dee99c700 1 -- 172.21.15.12:0/793090025 >> v1:172.21.15.12:6789/0 conn(0x7f5de806e0a0 legacy=0x7f5de80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1156587336 0 0) 0x7f5dd4003570 con 0x7f5de806e0a0 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5dee99c700 1 -- 172.21.15.12:0/793090025 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de80c7490 con 0x7f5de806e470 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5ded99a700 1 --2- 172.21.15.12:0/793090025 >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 0x7f5de814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:25.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.493+0000 7f5dee99c700 1 --2- 172.21.15.12:0/793090025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 0x7f5de81501b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e60 tx=0x7f5de0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3762bae0082b60dc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000e070 con 0x7f5de806e470 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000b7a0 con 0x7f5de806e470 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5ded199700 1 -- 172.21.15.12:0/793090025 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4001470 con 0x7f5de806e470 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 -- 172.21.15.12:0/793090025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 msgr2=0x7f5de81501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 --2- 172.21.15.12:0/793090025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 0x7f5de81501b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e60 tx=0x7f5de0009780 comp rx=0 tx=0).stop 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 -- 172.21.15.12:0/793090025 shutdown_connections 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 --2- 172.21.15.12:0/793090025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e470 0x7f5de81501b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 --2- 172.21.15.12:0/793090025 >> v2:172.21.15.29:3300/0 conn(0x7f5de806f3a0 0x7f5de814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 -- 172.21.15.12:0/793090025 >> 172.21.15.12:0/793090025 conn(0x7f5de806d170 msgr2=0x7f5de80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 -- 172.21.15.12:0/793090025 shutdown_connections 2023-10-08T16:24:25.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.494+0000 7f5def19d700 1 -- 172.21.15.12:0/793090025 wait complete. 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.496+0000 7f5def19d700 1 Processor -- start 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.496+0000 7f5def19d700 1 -- start start 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e0a0 0x7f5de814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5de806e470 0x7f5de8156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80b0900 con 0x7f5de806f3a0 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de81574a0 con 0x7f5de806e470 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5def19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80affd0 con 0x7f5de806e0a0 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5dee99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5dee99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44268/0 (socket says 172.21.15.12:44268) 2023-10-08T16:24:25.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5dee99c700 1 -- 172.21.15.12:0/3394215386 learned_addr learned my addr 172.21.15.12:0/3394215386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5ded99a700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5de806e470 0x7f5de8156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.497+0000 7f5dee19b700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e0a0 0x7f5de814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 -- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e0a0 msgr2=0x7f5de814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e0a0 0x7f5de814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 -- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5de806e470 msgr2=0x7f5de8156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5de806e470 0x7f5de8156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 -- 172.21.15.12:0/3394215386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80093c0 con 0x7f5de806f3a0 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dee99c700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b610 tx=0x7f5de0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0012bf0 con 0x7f5de806f3a0 2023-10-08T16:24:25.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de0012d50 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de00276c0 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de0009a20 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.498+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de80b0590 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.499+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de80b0a70 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.500+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5de0024070 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.501+0000 7f5dde7fc700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.502+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5de0086c20 con 0x7f5de806f3a0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.502+0000 7f5dee19b700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.502+0000 7f5dee19b700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 0x7f5dcc0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5de40011e0 tx=0x7f5de4001aa0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:25.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.506+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5de0053c60 con 0x7f5de806f3a0 2023-10-08T16:24:25.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.750+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5de804c3c0 con 0x7f5de806f3a0 2023-10-08T16:24:25.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.750+0000 7f5dde7fc700 1 -- 172.21.15.12:0/3394215386 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5de006c210 con 0x7f5de806f3a0 2023-10-08T16:24:25.808 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:25.808 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 msgr2=0x7f5dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 0x7f5dcc0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5de40011e0 tx=0x7f5de4001aa0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 msgr2=0x7f5de80c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5de000b610 tx=0x7f5de0018000 comp rx=0 tx=0).stop 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 shutdown_connections 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5dcc066f30 0x7f5dcc0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5de806f3a0 0x7f5de80c3fd0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5de806e0a0 0x7f5de814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 --2- 172.21.15.12:0/3394215386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5de806e470 0x7f5de8156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 >> 172.21.15.12:0/3394215386 conn(0x7f5de806d170 msgr2=0x7f5de8154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 shutdown_connections 2023-10-08T16:24:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.753+0000 7f5def19d700 1 -- 172.21.15.12:0/3394215386 wait complete. 2023-10-08T16:24:25.811 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:25.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:26.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.997+0000 7f8bcffff700 1 Processor -- start 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.997+0000 7f8bcffff700 1 -- start start 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.998+0000 7f8bcffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8bd0166380 0x7f8bd006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.998+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.998+0000 7f8bcffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd006f6e0 con 0x7f8bd0165fb0 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.998+0000 7f8bcffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00c80a0 con 0x7f8bd0166380 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.998+0000 7f8bcffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd00af560 con 0x7f8bd006f280 2023-10-08T16:24:26.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bce7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8bd0166380 0x7f8bd006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bcf7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:34580/0 (socket says 172.21.15.12:34580) 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bcf7fe700 1 -- 172.21.15.12:0/3205426048 learned_addr learned my addr 172.21.15.12:0/3205426048 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bce7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8bd0166380 0x7f8bd006ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:49144/0 (socket says 172.21.15.12:49144) 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:25.999+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 597889179 0 0) 0x7f8bc0001110 con 0x7f8bd0165fb0 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bb8003550 con 0x7f8bd0165fb0 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bce7fc700 1 -- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 msgr2=0x7f8bd00c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 <== mon.1 v1:172.21.15.29:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3918635825 0 0) 0x7f8bb8003550 con 0x7f8bd0165fb0 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bce7fc700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bce7fc700 1 -- 172.21.15.12:0/3205426048 >> v1:172.21.15.29:6789/0 conn(0x7f8bd0165fb0 legacy=0x7f8bd00b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bce7fc700 1 -- 172.21.15.12:0/3205426048 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd00af840 con 0x7f8bd0166380 2023-10-08T16:24:26.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.030+0000 7f8bcf7fe700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:26.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.031+0000 7f8bce7fc700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd006ed40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b9a0 tx=0x7f8bc40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e92ee5b2e71cc011 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.031+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0001600 con 0x7f8bd0166380 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.031+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc400c570 con 0x7f8bd0166380 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.031+0000 7f8bcdffb700 1 -- 172.21.15.12:0/3205426048 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc400c910 con 0x7f8bd0166380 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 -- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 msgr2=0x7f8bd006ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd006ed40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8bc400b9a0 tx=0x7f8bc40090f0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 -- 172.21.15.12:0/3205426048 shutdown_connections 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd006f280 0x7f8bd00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 --2- 172.21.15.12:0/3205426048 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd006ed40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 -- 172.21.15.12:0/3205426048 >> 172.21.15.12:0/3205426048 conn(0x7f8bd006d170 msgr2=0x7f8bd00cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 -- 172.21.15.12:0/3205426048 shutdown_connections 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.032+0000 7f8bcffff700 1 -- 172.21.15.12:0/3205426048 wait complete. 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.033+0000 7f8bcffff700 1 Processor -- start 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.033+0000 7f8bcffff700 1 -- start start 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd0165fb0 0x7f8bd0086cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd00c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd016b770 con 0x7f8bd006f280 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd016ab60 con 0x7f8bd0166380 2023-10-08T16:24:26.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bcffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd016ae40 con 0x7f8bd0165fb0 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.034+0000 7f8bceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44280/0 (socket says 172.21.15.12:44280) 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 -- 172.21.15.12:0/2609920253 learned_addr learned my addr 172.21.15.12:0/2609920253 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 -- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd0165fb0 msgr2=0x7f8bd0086cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd0165fb0 0x7f8bd0086cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 -- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 msgr2=0x7f8bd00c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bcf7fe700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd00c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd00c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 -- 172.21.15.12:0/2609920253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc8008ad0 con 0x7f8bd006f280 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bcf7fe700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd00c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:26.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bceffd700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0007c60 tx=0x7f8bc000a500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc000f070 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0007e70 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bc400b4e0 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.035+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0001ce0 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.036+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd016b400 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.036+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd004c3c0 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.037+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bc000cb00 con 0x7f8bd006f280 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.038+0000 7f8bb6ffd700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.038+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8bc0084760 con 0x7f8bd006f280 2023-10-08T16:24:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.038+0000 7f8bce7fc700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.039+0000 7f8bce7fc700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 0x7f8bbc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00c20f0 tx=0x7f8bc4016000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.043+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bc0051820 con 0x7f8bd006f280 2023-10-08T16:24:26.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.250+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bd006f6e0 con 0x7f8bd006f280 2023-10-08T16:24:26.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.251+0000 7f8bb6ffd700 1 -- 172.21.15.12:0/2609920253 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+15993 (secure 0 0 0) 0x7f8bd006f6e0 con 0x7f8bd006f280 2023-10-08T16:24:26.252 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:26.252 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:23.260303+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:26.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 msgr2=0x7f8bbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 0x7f8bbc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8bd00c20f0 tx=0x7f8bc4016000 comp rx=0 tx=0).stop 2023-10-08T16:24:26.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 msgr2=0x7f8bd00c2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0007c60 tx=0x7f8bc000a500 comp rx=0 tx=0).stop 2023-10-08T16:24:26.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 shutdown_connections 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8bbc066f30 0x7f8bbc0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8bd006f280 0x7f8bd00c2af0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8bd0166380 0x7f8bd00c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 --2- 172.21.15.12:0/2609920253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8bd0165fb0 0x7f8bd0086cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 >> 172.21.15.12:0/2609920253 conn(0x7f8bd006d170 msgr2=0x7f8bd00ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 shutdown_connections 2023-10-08T16:24:26.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.254+0000 7f8bcffff700 1 -- 172.21.15.12:0/2609920253 wait complete. 2023-10-08T16:24:26.273 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:24:26.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:24:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.460+0000 7fa3e519d700 1 Processor -- start 2023-10-08T16:24:26.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.460+0000 7fa3e519d700 1 -- start start 2023-10-08T16:24:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.461+0000 7fa3e519d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3e00cf110 0x7fa3e0164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.461+0000 7fa3e519d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e015afd0 con 0x7fa3e0153c30 2023-10-08T16:24:26.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.461+0000 7fa3e519d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e015b2b0 con 0x7fa3e015de50 2023-10-08T16:24:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.461+0000 7fa3e519d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e015b590 con 0x7fa3e00cf110 2023-10-08T16:24:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3e00cf110 0x7fa3e0164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3e00cf110 0x7fa3e0164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44296/0 (socket says 172.21.15.12:44296) 2023-10-08T16:24:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 -- 172.21.15.12:0/2988710518 learned_addr learned my addr 172.21.15.12:0/2988710518 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3dffff700 1 --1- 172.21.15.12:0/2988710518 >> v1:172.21.15.12:6789/0 conn(0x7fa3e0153c30 0x7fa3e015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36170/0 (socket says 172.21.15.12:36170) 2023-10-08T16:24:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 -- 172.21.15.12:0/2988710518 >> v1:172.21.15.29:6789/0 conn(0x7fa3e015de50 legacy=0x7fa3e00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 -- 172.21.15.12:0/2988710518 >> v1:172.21.15.12:6789/0 conn(0x7fa3e0153c30 legacy=0x7fa3e015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3deffd700 1 -- 172.21.15.12:0/2988710518 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004183619 0 0) 0x7fa3e015afd0 con 0x7fa3e0153c30 2023-10-08T16:24:26.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 -- 172.21.15.12:0/2988710518 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e015b870 con 0x7fa3e00cf110 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.462+0000 7fa3e499c700 1 --2- 172.21.15.12:0/2988710518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e00cf110 0x7fa3e0164600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009f20 tx=0x7fa3d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15718dd6ce685ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3deffd700 1 -- 172.21.15.12:0/2988710518 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800e070 con 0x7fa3e00cf110 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3deffd700 1 -- 172.21.15.12:0/2988710518 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d800ba80 con 0x7fa3e00cf110 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3deffd700 1 -- 172.21.15.12:0/2988710518 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80092e0 con 0x7fa3e00cf110 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 -- 172.21.15.12:0/2988710518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e00cf110 msgr2=0x7fa3e0164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 --2- 172.21.15.12:0/2988710518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e00cf110 0x7fa3e0164600 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009f20 tx=0x7fa3d8009840 comp rx=0 tx=0).stop 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 -- 172.21.15.12:0/2988710518 shutdown_connections 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 --2- 172.21.15.12:0/2988710518 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e00cf110 0x7fa3e0164600 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 -- 172.21.15.12:0/2988710518 >> 172.21.15.12:0/2988710518 conn(0x7fa3e00703a0 msgr2=0x7fa3e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 -- 172.21.15.12:0/2988710518 shutdown_connections 2023-10-08T16:24:26.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.463+0000 7fa3e519d700 1 -- 172.21.15.12:0/2988710518 wait complete. 2023-10-08T16:24:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.465+0000 7fa3e519d700 1 Processor -- start 2023-10-08T16:24:26.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.465+0000 7fa3e519d700 1 -- start start 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3e00cf110 0x7fa3e00b5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3e0153c30 0x7fa3e01523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00b6140 con 0x7fa3e015de50 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00b3920 con 0x7fa3e00cf110 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e00b57b0 con 0x7fa3e0153c30 2023-10-08T16:24:26.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e499c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e499c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44312/0 (socket says 172.21.15.12:44312) 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3e499c700 1 -- 172.21.15.12:0/3509543821 learned_addr learned my addr 172.21.15.12:0/3509543821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3dffff700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3e00cf110 0x7fa3e00b5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.466+0000 7fa3df7fe700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3e0153c30 0x7fa3e01523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 -- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3e0153c30 msgr2=0x7fa3e01523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3e0153c30 0x7fa3e01523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 -- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3e00cf110 msgr2=0x7fa3e00b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3e00cf110 0x7fa3e00b5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 -- 172.21.15.12:0/3509543821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d8009ae0 con 0x7fa3e015de50 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e499c700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ab0 tx=0x7fa3d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d800be90 con 0x7fa3e015de50 2023-10-08T16:24:26.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8008d60 con 0x7fa3e015de50 2023-10-08T16:24:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80266b0 con 0x7fa3e015de50 2023-10-08T16:24:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e01528e0 con 0x7fa3e015de50 2023-10-08T16:24:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.467+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e00b3d20 con 0x7fa3e015de50 2023-10-08T16:24:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.468+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e00b5920 con 0x7fa3e015de50 2023-10-08T16:24:26.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.469+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3d8003040 con 0x7fa3e015de50 2023-10-08T16:24:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.470+0000 7fa3c7fff700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.470+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa3d8086170 con 0x7fa3e015de50 2023-10-08T16:24:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.470+0000 7fa3dffff700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.471+0000 7fa3dffff700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 0x7fa3cc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0007fd0 tx=0x7fa3d0007d30 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.475+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3e00b5920 con 0x7fa3e015de50 2023-10-08T16:24:26.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.672+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3e00b5920 con 0x7fa3cc066f30 2023-10-08T16:24:26.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.682+0000 7fa3c7fff700 1 -- 172.21.15.12:0/3509543821 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287107 (secure 0 0 0) 0x7fa3e00b5920 con 0x7fa3cc066f30 2023-10-08T16:24:26.687 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:26.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 msgr2=0x7fa3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 0x7fa3cc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0007fd0 tx=0x7fa3d0007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 msgr2=0x7fa3e00cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009ab0 tx=0x7fa3d8018000 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 shutdown_connections 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3cc066f30 0x7fa3cc0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3e015de50 0x7fa3e00cc0e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3e00cf110 0x7fa3e00b5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 --2- 172.21.15.12:0/3509543821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3e0153c30 0x7fa3e01523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 >> 172.21.15.12:0/3509543821 conn(0x7fa3e00703a0 msgr2=0x7fa3e00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 shutdown_connections 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.687+0000 7fa3e519d700 1 -- 172.21.15.12:0/3509543821 wait complete. 2023-10-08T16:24:26.690 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:24:26.705 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:24:25.712634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":277,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436628,"kb_used_data":9172,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752538092,"statfs":{"total":773094113280,"available":770599006208,"internally_reserved":0,"allocated":9392128,"data_stored":5094320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470190"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279439+0000","last_change":"2023-10-08T16:24:22.277197+0000","last_active":"2023-10-08T16:24:22.279439+0000","last_peered":"2023-10-08T16:24:22.279439+0000","last_clean":"2023-10-08T16:24:22.279439+0000","last_became_active":"2023-10-08T16:24:22.276948+0000","last_became_peered":"2023-10-08T16:24:22.276948+0000","last_unstale":"2023-10-08T16:24:22.279439+0000","last_undegraded":"2023-10-08T16:24:22.279439+0000","last_fullsized":"2023-10-08T16:24:22.279439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:34.105560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276230+0000","last_change":"2023-10-08T16:24:22.272185+0000","last_active":"2023-10-08T16:24:22.276230+0000","last_peered":"2023-10-08T16:24:22.276230+0000","last_clean":"2023-10-08T16:24:22.276230+0000","last_became_active":"2023-10-08T16:24:22.271833+0000","last_became_peered":"2023-10-08T16:24:22.271833+0000","last_unstale":"2023-10-08T16:24:22.276230+0000","last_undegraded":"2023-10-08T16:24:22.276230+0000","last_fullsized":"2023-10-08T16:24:22.276230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:49.759070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270545+0000","last_change":"2023-10-08T16:24:22.265947+0000","last_active":"2023-10-08T16:24:22.270545+0000","last_peered":"2023-10-08T16:24:22.270545+0000","last_clean":"2023-10-08T16:24:22.270545+0000","last_became_active":"2023-10-08T16:24:22.265661+0000","last_became_peered":"2023-10-08T16:24:22.265661+0000","last_unstale":"2023-10-08T16:24:22.270545+0000","last_undegraded":"2023-10-08T16:24:22.270545+0000","last_fullsized":"2023-10-08T16:24:22.270545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:16.359492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269363+0000","last_change":"2023-10-08T16:24:22.267456+0000","last_active":"2023-10-08T16:24:22.269363+0000","last_peered":"2023-10-08T16:24:22.269363+0000","last_clean":"2023-10-08T16:24:22.269363+0000","last_became_active":"2023-10-08T16:24:22.267053+0000","last_became_peered":"2023-10-08T16:24:22.267053+0000","last_unstale":"2023-10-08T16:24:22.269363+0000","last_undegraded":"2023-10-08T16:24:22.269363+0000","last_fullsized":"2023-10-08T16:24:22.269363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:14.141525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273040+0000","last_change":"2023-10-08T16:24:22.268960+0000","last_active":"2023-10-08T16:24:22.273040+0000","last_peered":"2023-10-08T16:24:22.273040+0000","last_clean":"2023-10-08T16:24:22.273040+0000","last_became_active":"2023-10-08T16:24:22.268672+0000","last_became_peered":"2023-10-08T16:24:22.268672+0000","last_unstale":"2023-10-08T16:24:22.273040+0000","last_undegraded":"2023-10-08T16:24:22.273040+0000","last_fullsized":"2023-10-08T16:24:22.273040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285247+0000","last_change":"2023-10-08T16:24:22.278307+0000","last_active":"2023-10-08T16:24:22.285247+0000","last_peered":"2023-10-08T16:24:22.285247+0000","last_clean":"2023-10-08T16:24:22.285247+0000","last_became_active":"2023-10-08T16:24:22.278008+0000","last_became_peered":"2023-10-08T16:24:22.278008+0000","last_unstale":"2023-10-08T16:24:22.285247+0000","last_undegraded":"2023-10-08T16:24:22.285247+0000","last_fullsized":"2023-10-08T16:24:22.285247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:17.572758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276564+0000","last_change":"2023-10-08T16:24:22.266527+0000","last_active":"2023-10-08T16:24:22.276564+0000","last_peered":"2023-10-08T16:24:22.276564+0000","last_clean":"2023-10-08T16:24:22.276564+0000","last_became_active":"2023-10-08T16:24:22.266294+0000","last_became_peered":"2023-10-08T16:24:22.266294+0000","last_unstale":"2023-10-08T16:24:22.276564+0000","last_undegraded":"2023-10-08T16:24:22.276564+0000","last_fullsized":"2023-10-08T16:24:22.276564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:17.676375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277883+0000","last_change":"2023-10-08T16:24:22.274287+0000","last_active":"2023-10-08T16:24:22.277883+0000","last_peered":"2023-10-08T16:24:22.277883+0000","last_clean":"2023-10-08T16:24:22.277883+0000","last_became_active":"2023-10-08T16:24:22.273777+0000","last_became_peered":"2023-10-08T16:24:22.273777+0000","last_unstale":"2023-10-08T16:24:22.277883+0000","last_undegraded":"2023-10-08T16:24:22.277883+0000","last_fullsized":"2023-10-08T16:24:22.277883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:59:33.821077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286835+0000","last_change":"2023-10-08T16:24:22.279365+0000","last_active":"2023-10-08T16:24:22.286835+0000","last_peered":"2023-10-08T16:24:22.286835+0000","last_clean":"2023-10-08T16:24:22.286835+0000","last_became_active":"2023-10-08T16:24:22.279112+0000","last_became_peered":"2023-10-08T16:24:22.279112+0000","last_unstale":"2023-10-08T16:24:22.286835+0000","last_undegraded":"2023-10-08T16:24:22.286835+0000","last_fullsized":"2023-10-08T16:24:22.286835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276348+0000","last_change":"2023-10-08T16:24:22.274687+0000","last_active":"2023-10-08T16:24:22.276348+0000","last_peered":"2023-10-08T16:24:22.276348+0000","last_clean":"2023-10-08T16:24:22.276348+0000","last_became_active":"2023-10-08T16:24:22.274377+0000","last_became_peered":"2023-10-08T16:24:22.274377+0000","last_unstale":"2023-10-08T16:24:22.276348+0000","last_undegraded":"2023-10-08T16:24:22.276348+0000","last_fullsized":"2023-10-08T16:24:22.276348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:24.050092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284637+0000","last_change":"2023-10-08T16:24:22.276137+0000","last_active":"2023-10-08T16:24:22.284637+0000","last_peered":"2023-10-08T16:24:22.284637+0000","last_clean":"2023-10-08T16:24:22.284637+0000","last_became_active":"2023-10-08T16:24:22.275888+0000","last_became_peered":"2023-10-08T16:24:22.275888+0000","last_unstale":"2023-10-08T16:24:22.284637+0000","last_undegraded":"2023-10-08T16:24:22.284637+0000","last_fullsized":"2023-10-08T16:24:22.284637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:20.213695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277280+0000","last_change":"2023-10-08T16:24:22.268139+0000","last_active":"2023-10-08T16:24:22.277280+0000","last_peered":"2023-10-08T16:24:22.277280+0000","last_clean":"2023-10-08T16:24:22.277280+0000","last_became_active":"2023-10-08T16:24:22.267883+0000","last_became_peered":"2023-10-08T16:24:22.267883+0000","last_unstale":"2023-10-08T16:24:22.277280+0000","last_undegraded":"2023-10-08T16:24:22.277280+0000","last_fullsized":"2023-10-08T16:24:22.277280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:03.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269724+0000","last_change":"2023-10-08T16:24:22.264405+0000","last_active":"2023-10-08T16:24:22.269724+0000","last_peered":"2023-10-08T16:24:22.269724+0000","last_clean":"2023-10-08T16:24:22.269724+0000","last_became_active":"2023-10-08T16:24:22.264086+0000","last_became_peered":"2023-10-08T16:24:22.264086+0000","last_unstale":"2023-10-08T16:24:22.269724+0000","last_undegraded":"2023-10-08T16:24:22.269724+0000","last_fullsized":"2023-10-08T16:24:22.269724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:38.493207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279408+0000","last_change":"2023-10-08T16:24:22.277792+0000","last_active":"2023-10-08T16:24:22.279408+0000","last_peered":"2023-10-08T16:24:22.279408+0000","last_clean":"2023-10-08T16:24:22.279408+0000","last_became_active":"2023-10-08T16:24:22.277523+0000","last_became_peered":"2023-10-08T16:24:22.277523+0000","last_unstale":"2023-10-08T16:24:22.279408+0000","last_undegraded":"2023-10-08T16:24:22.279408+0000","last_fullsized":"2023-10-08T16:24:22.279408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:31.347826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276472+0000","last_change":"2023-10-08T16:24:22.267275+0000","last_active":"2023-10-08T16:24:22.276472+0000","last_peered":"2023-10-08T16:24:22.276472+0000","last_clean":"2023-10-08T16:24:22.276472+0000","last_became_active":"2023-10-08T16:24:22.266980+0000","last_became_peered":"2023-10-08T16:24:22.266980+0000","last_unstale":"2023-10-08T16:24:22.276472+0000","last_undegraded":"2023-10-08T16:24:22.276472+0000","last_fullsized":"2023-10-08T16:24:22.276472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:46.525162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273571+0000","last_change":"2023-10-08T16:24:22.268840+0000","last_active":"2023-10-08T16:24:22.273571+0000","last_peered":"2023-10-08T16:24:22.273571+0000","last_clean":"2023-10-08T16:24:22.273571+0000","last_became_active":"2023-10-08T16:24:22.268515+0000","last_became_peered":"2023-10-08T16:24:22.268515+0000","last_unstale":"2023-10-08T16:24:22.273571+0000","last_undegraded":"2023-10-08T16:24:22.273571+0000","last_fullsized":"2023-10-08T16:24:22.273571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286296+0000","last_change":"2023-10-08T16:24:22.281335+0000","last_active":"2023-10-08T16:24:22.286296+0000","last_peered":"2023-10-08T16:24:22.286296+0000","last_clean":"2023-10-08T16:24:22.286296+0000","last_became_active":"2023-10-08T16:24:22.280628+0000","last_became_peered":"2023-10-08T16:24:22.280628+0000","last_unstale":"2023-10-08T16:24:22.286296+0000","last_undegraded":"2023-10-08T16:24:22.286296+0000","last_fullsized":"2023-10-08T16:24:22.286296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:50.269676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274998+0000","last_change":"2023-10-08T16:24:22.269330+0000","last_active":"2023-10-08T16:24:22.274998+0000","last_peered":"2023-10-08T16:24:22.274998+0000","last_clean":"2023-10-08T16:24:22.274998+0000","last_became_active":"2023-10-08T16:24:22.268739+0000","last_became_peered":"2023-10-08T16:24:22.268739+0000","last_unstale":"2023-10-08T16:24:22.274998+0000","last_undegraded":"2023-10-08T16:24:22.274998+0000","last_fullsized":"2023-10-08T16:24:22.274998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:10.064373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273074+0000","last_change":"2023-10-08T16:24:22.270188+0000","last_active":"2023-10-08T16:24:22.273074+0000","last_peered":"2023-10-08T16:24:22.273074+0000","last_clean":"2023-10-08T16:24:22.273074+0000","last_became_active":"2023-10-08T16:24:22.269890+0000","last_became_peered":"2023-10-08T16:24:22.269890+0000","last_unstale":"2023-10-08T16:24:22.273074+0000","last_undegraded":"2023-10-08T16:24:22.273074+0000","last_fullsized":"2023-10-08T16:24:22.273074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:34.696485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275378+0000","last_change":"2023-10-08T16:24:22.271452+0000","last_active":"2023-10-08T16:24:22.275378+0000","last_peered":"2023-10-08T16:24:22.275378+0000","last_clean":"2023-10-08T16:24:22.275378+0000","last_became_active":"2023-10-08T16:24:22.270407+0000","last_became_peered":"2023-10-08T16:24:22.270407+0000","last_unstale":"2023-10-08T16:24:22.275378+0000","last_undegraded":"2023-10-08T16:24:22.275378+0000","last_fullsized":"2023-10-08T16:24:22.275378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:11.469843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285036+0000","last_change":"2023-10-08T16:24:22.275414+0000","last_active":"2023-10-08T16:24:22.285036+0000","last_peered":"2023-10-08T16:24:22.285036+0000","last_clean":"2023-10-08T16:24:22.285036+0000","last_became_active":"2023-10-08T16:24:22.275138+0000","last_became_peered":"2023-10-08T16:24:22.275138+0000","last_unstale":"2023-10-08T16:24:22.285036+0000","last_undegraded":"2023-10-08T16:24:22.285036+0000","last_fullsized":"2023-10-08T16:24:22.285036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:56.116579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277991+0000","last_change":"2023-10-08T16:24:22.275499+0000","last_active":"2023-10-08T16:24:22.277991+0000","last_peered":"2023-10-08T16:24:22.277991+0000","last_clean":"2023-10-08T16:24:22.277991+0000","last_became_active":"2023-10-08T16:24:22.275240+0000","last_became_peered":"2023-10-08T16:24:22.275240+0000","last_unstale":"2023-10-08T16:24:22.277991+0000","last_undegraded":"2023-10-08T16:24:22.277991+0000","last_fullsized":"2023-10-08T16:24:22.277991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276179+0000","last_change":"2023-10-08T16:24:22.268011+0000","last_active":"2023-10-08T16:24:22.276179+0000","last_peered":"2023-10-08T16:24:22.276179+0000","last_clean":"2023-10-08T16:24:22.276179+0000","last_became_active":"2023-10-08T16:24:22.267685+0000","last_became_peered":"2023-10-08T16:24:22.267685+0000","last_unstale":"2023-10-08T16:24:22.276179+0000","last_undegraded":"2023-10-08T16:24:22.276179+0000","last_fullsized":"2023-10-08T16:24:22.276179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.063975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270329+0000","last_change":"2023-10-08T16:24:22.266566+0000","last_active":"2023-10-08T16:24:22.270329+0000","last_peered":"2023-10-08T16:24:22.270329+0000","last_clean":"2023-10-08T16:24:22.270329+0000","last_became_active":"2023-10-08T16:24:22.266154+0000","last_became_peered":"2023-10-08T16:24:22.266154+0000","last_unstale":"2023-10-08T16:24:22.270329+0000","last_undegraded":"2023-10-08T16:24:22.270329+0000","last_fullsized":"2023-10-08T16:24:22.270329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:13.350748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273243+0000","last_change":"2023-10-08T16:24:22.270956+0000","last_active":"2023-10-08T16:24:22.273243+0000","last_peered":"2023-10-08T16:24:22.273243+0000","last_clean":"2023-10-08T16:24:22.273243+0000","last_became_active":"2023-10-08T16:24:22.270612+0000","last_became_peered":"2023-10-08T16:24:22.270612+0000","last_unstale":"2023-10-08T16:24:22.273243+0000","last_undegraded":"2023-10-08T16:24:22.273243+0000","last_fullsized":"2023-10-08T16:24:22.273243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286636+0000","last_change":"2023-10-08T16:24:22.282687+0000","last_active":"2023-10-08T16:24:22.286636+0000","last_peered":"2023-10-08T16:24:22.286636+0000","last_clean":"2023-10-08T16:24:22.286636+0000","last_became_active":"2023-10-08T16:24:22.282416+0000","last_became_peered":"2023-10-08T16:24:22.282416+0000","last_unstale":"2023-10-08T16:24:22.286636+0000","last_undegraded":"2023-10-08T16:24:22.286636+0000","last_fullsized":"2023-10-08T16:24:22.286636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:18.006900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273784+0000","last_change":"2023-10-08T16:24:22.270422+0000","last_active":"2023-10-08T16:24:22.273784+0000","last_peered":"2023-10-08T16:24:22.273784+0000","last_clean":"2023-10-08T16:24:22.273784+0000","last_became_active":"2023-10-08T16:24:22.270165+0000","last_became_peered":"2023-10-08T16:24:22.270165+0000","last_unstale":"2023-10-08T16:24:22.273784+0000","last_undegraded":"2023-10-08T16:24:22.273784+0000","last_fullsized":"2023-10-08T16:24:22.273784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:07.486766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289512+0000","last_change":"2023-10-08T16:24:21.269557+0000","last_active":"2023-10-08T16:24:22.289512+0000","last_peered":"2023-10-08T16:24:22.289512+0000","last_clean":"2023-10-08T16:24:22.289512+0000","last_became_active":"2023-10-08T16:24:21.269263+0000","last_became_peered":"2023-10-08T16:24:21.269263+0000","last_unstale":"2023-10-08T16:24:22.289512+0000","last_undegraded":"2023-10-08T16:24:22.289512+0000","last_fullsized":"2023-10-08T16:24:22.289512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:42:22.448478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288128+0000","last_change":"2023-10-08T16:24:22.282422+0000","last_active":"2023-10-08T16:24:22.288128+0000","last_peered":"2023-10-08T16:24:22.288128+0000","last_clean":"2023-10-08T16:24:22.288128+0000","last_became_active":"2023-10-08T16:24:22.280622+0000","last_became_peered":"2023-10-08T16:24:22.280622+0000","last_unstale":"2023-10-08T16:24:22.288128+0000","last_undegraded":"2023-10-08T16:24:22.288128+0000","last_fullsized":"2023-10-08T16:24:22.288128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291323+0000","last_change":"2023-10-08T16:24:21.271687+0000","last_active":"2023-10-08T16:24:22.291323+0000","last_peered":"2023-10-08T16:24:22.291323+0000","last_clean":"2023-10-08T16:24:22.291323+0000","last_became_active":"2023-10-08T16:24:21.271411+0000","last_became_peered":"2023-10-08T16:24:21.271411+0000","last_unstale":"2023-10-08T16:24:22.291323+0000","last_undegraded":"2023-10-08T16:24:22.291323+0000","last_fullsized":"2023-10-08T16:24:22.291323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:42.094517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285309+0000","last_change":"2023-10-08T16:24:22.274100+0000","last_active":"2023-10-08T16:24:22.285309+0000","last_peered":"2023-10-08T16:24:22.285309+0000","last_clean":"2023-10-08T16:24:22.285309+0000","last_became_active":"2023-10-08T16:24:22.273194+0000","last_became_peered":"2023-10-08T16:24:22.273194+0000","last_unstale":"2023-10-08T16:24:22.285309+0000","last_undegraded":"2023-10-08T16:24:22.285309+0000","last_fullsized":"2023-10-08T16:24:22.285309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:45.645647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288547+0000","last_change":"2023-10-08T16:24:21.276710+0000","last_active":"2023-10-08T16:24:22.288547+0000","last_peered":"2023-10-08T16:24:22.288547+0000","last_clean":"2023-10-08T16:24:22.288547+0000","last_became_active":"2023-10-08T16:24:21.276424+0000","last_became_peered":"2023-10-08T16:24:21.276424+0000","last_unstale":"2023-10-08T16:24:22.288547+0000","last_undegraded":"2023-10-08T16:24:22.288547+0000","last_fullsized":"2023-10-08T16:24:22.288547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:49.830827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268952+0000","last_change":"2023-10-08T16:24:22.266933+0000","last_active":"2023-10-08T16:24:22.268952+0000","last_peered":"2023-10-08T16:24:22.268952+0000","last_clean":"2023-10-08T16:24:22.268952+0000","last_became_active":"2023-10-08T16:24:22.266234+0000","last_became_peered":"2023-10-08T16:24:22.266234+0000","last_unstale":"2023-10-08T16:24:22.268952+0000","last_undegraded":"2023-10-08T16:24:22.268952+0000","last_fullsized":"2023-10-08T16:24:22.268952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:48.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286651+0000","last_change":"2023-10-08T16:24:21.267216+0000","last_active":"2023-10-08T16:24:22.286651+0000","last_peered":"2023-10-08T16:24:22.286651+0000","last_clean":"2023-10-08T16:24:22.286651+0000","last_became_active":"2023-10-08T16:24:21.266898+0000","last_became_peered":"2023-10-08T16:24:21.266898+0000","last_unstale":"2023-10-08T16:24:22.286651+0000","last_undegraded":"2023-10-08T16:24:22.286651+0000","last_fullsized":"2023-10-08T16:24:22.286651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:56.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285851+0000","last_change":"2023-10-08T16:24:22.278368+0000","last_active":"2023-10-08T16:24:22.285851+0000","last_peered":"2023-10-08T16:24:22.285851+0000","last_clean":"2023-10-08T16:24:22.285851+0000","last_became_active":"2023-10-08T16:24:22.277968+0000","last_became_peered":"2023-10-08T16:24:22.277968+0000","last_unstale":"2023-10-08T16:24:22.285851+0000","last_undegraded":"2023-10-08T16:24:22.285851+0000","last_fullsized":"2023-10-08T16:24:22.285851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:28.517572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244052+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276157+0000","last_change":"2023-10-08T16:24:22.267391+0000","last_active":"2023-10-08T16:24:22.276157+0000","last_peered":"2023-10-08T16:24:22.276157+0000","last_clean":"2023-10-08T16:24:22.276157+0000","last_became_active":"2023-10-08T16:24:22.267088+0000","last_became_peered":"2023-10-08T16:24:22.267088+0000","last_unstale":"2023-10-08T16:24:22.276157+0000","last_undegraded":"2023-10-08T16:24:22.276157+0000","last_fullsized":"2023-10-08T16:24:22.276157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:26.983593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286744+0000","last_change":"2023-10-08T16:24:21.275128+0000","last_active":"2023-10-08T16:24:22.286744+0000","last_peered":"2023-10-08T16:24:22.286744+0000","last_clean":"2023-10-08T16:24:22.286744+0000","last_became_active":"2023-10-08T16:24:21.274777+0000","last_became_peered":"2023-10-08T16:24:21.274777+0000","last_unstale":"2023-10-08T16:24:22.286744+0000","last_undegraded":"2023-10-08T16:24:22.286744+0000","last_fullsized":"2023-10-08T16:24:22.286744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:42.367439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257414+0000","last_change":"2023-10-08T16:24:21.268084+0000","last_active":"2023-10-08T16:24:22.257414+0000","last_peered":"2023-10-08T16:24:22.257414+0000","last_clean":"2023-10-08T16:24:22.257414+0000","last_became_active":"2023-10-08T16:24:21.267806+0000","last_became_peered":"2023-10-08T16:24:21.267806+0000","last_unstale":"2023-10-08T16:24:22.257414+0000","last_undegraded":"2023-10-08T16:24:22.257414+0000","last_fullsized":"2023-10-08T16:24:22.257414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:32.960654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276267+0000","last_change":"2023-10-08T16:24:22.266880+0000","last_active":"2023-10-08T16:24:22.276267+0000","last_peered":"2023-10-08T16:24:22.276267+0000","last_clean":"2023-10-08T16:24:22.276267+0000","last_became_active":"2023-10-08T16:24:22.266473+0000","last_became_peered":"2023-10-08T16:24:22.266473+0000","last_unstale":"2023-10-08T16:24:22.276267+0000","last_undegraded":"2023-10-08T16:24:22.276267+0000","last_fullsized":"2023-10-08T16:24:22.276267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:53.937746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244068+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.254209+0000","last_change":"2023-10-08T16:24:21.273603+0000","last_active":"2023-10-08T16:24:22.254209+0000","last_peered":"2023-10-08T16:24:22.254209+0000","last_clean":"2023-10-08T16:24:22.254209+0000","last_became_active":"2023-10-08T16:24:21.273224+0000","last_became_peered":"2023-10-08T16:24:21.273224+0000","last_unstale":"2023-10-08T16:24:22.254209+0000","last_undegraded":"2023-10-08T16:24:22.254209+0000","last_fullsized":"2023-10-08T16:24:22.254209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:49.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276968+0000","last_change":"2023-10-08T16:24:22.273050+0000","last_active":"2023-10-08T16:24:22.276968+0000","last_peered":"2023-10-08T16:24:22.276968+0000","last_clean":"2023-10-08T16:24:22.276968+0000","last_became_active":"2023-10-08T16:24:22.272781+0000","last_became_peered":"2023-10-08T16:24:22.272781+0000","last_unstale":"2023-10-08T16:24:22.276968+0000","last_undegraded":"2023-10-08T16:24:22.276968+0000","last_fullsized":"2023-10-08T16:24:22.276968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258749+0000","last_change":"2023-10-08T16:24:21.269008+0000","last_active":"2023-10-08T16:24:22.258749+0000","last_peered":"2023-10-08T16:24:22.258749+0000","last_clean":"2023-10-08T16:24:22.258749+0000","last_became_active":"2023-10-08T16:24:21.268649+0000","last_became_peered":"2023-10-08T16:24:21.268649+0000","last_unstale":"2023-10-08T16:24:22.258749+0000","last_undegraded":"2023-10-08T16:24:22.258749+0000","last_fullsized":"2023-10-08T16:24:22.258749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:44.638564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284345+0000","last_change":"2023-10-08T16:24:22.276093+0000","last_active":"2023-10-08T16:24:22.284345+0000","last_peered":"2023-10-08T16:24:22.284345+0000","last_clean":"2023-10-08T16:24:22.284345+0000","last_became_active":"2023-10-08T16:24:22.275832+0000","last_became_peered":"2023-10-08T16:24:22.275832+0000","last_unstale":"2023-10-08T16:24:22.284345+0000","last_undegraded":"2023-10-08T16:24:22.284345+0000","last_fullsized":"2023-10-08T16:24:22.284345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:31.162690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287850+0000","last_change":"2023-10-08T16:24:21.272950+0000","last_active":"2023-10-08T16:24:22.287850+0000","last_peered":"2023-10-08T16:24:22.287850+0000","last_clean":"2023-10-08T16:24:22.287850+0000","last_became_active":"2023-10-08T16:24:21.271679+0000","last_became_peered":"2023-10-08T16:24:21.271679+0000","last_unstale":"2023-10-08T16:24:22.287850+0000","last_undegraded":"2023-10-08T16:24:22.287850+0000","last_fullsized":"2023-10-08T16:24:22.287850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:06.461374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277014+0000","last_change":"2023-10-08T16:24:22.275924+0000","last_active":"2023-10-08T16:24:22.277014+0000","last_peered":"2023-10-08T16:24:22.277014+0000","last_clean":"2023-10-08T16:24:22.277014+0000","last_became_active":"2023-10-08T16:24:22.274052+0000","last_became_peered":"2023-10-08T16:24:22.274052+0000","last_unstale":"2023-10-08T16:24:22.277014+0000","last_undegraded":"2023-10-08T16:24:22.277014+0000","last_fullsized":"2023-10-08T16:24:22.277014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:17.163656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244581+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275422+0000","last_change":"2023-10-08T16:24:22.271444+0000","last_active":"2023-10-08T16:24:22.275422+0000","last_peered":"2023-10-08T16:24:22.275422+0000","last_clean":"2023-10-08T16:24:22.275422+0000","last_became_active":"2023-10-08T16:24:22.270764+0000","last_became_peered":"2023-10-08T16:24:22.270764+0000","last_unstale":"2023-10-08T16:24:22.275422+0000","last_undegraded":"2023-10-08T16:24:22.275422+0000","last_fullsized":"2023-10-08T16:24:22.275422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.468457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293566+0000","last_change":"2023-10-08T16:24:21.269602+0000","last_active":"2023-10-08T16:24:22.293566+0000","last_peered":"2023-10-08T16:24:22.293566+0000","last_clean":"2023-10-08T16:24:22.293566+0000","last_became_active":"2023-10-08T16:24:21.269331+0000","last_became_peered":"2023-10-08T16:24:21.269331+0000","last_unstale":"2023-10-08T16:24:22.293566+0000","last_undegraded":"2023-10-08T16:24:22.293566+0000","last_fullsized":"2023-10-08T16:24:22.293566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.991250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269760+0000","last_change":"2023-10-08T16:24:22.264889+0000","last_active":"2023-10-08T16:24:22.269760+0000","last_peered":"2023-10-08T16:24:22.269760+0000","last_clean":"2023-10-08T16:24:22.269760+0000","last_became_active":"2023-10-08T16:24:22.264605+0000","last_became_peered":"2023-10-08T16:24:22.264605+0000","last_unstale":"2023-10-08T16:24:22.269760+0000","last_undegraded":"2023-10-08T16:24:22.269760+0000","last_fullsized":"2023-10-08T16:24:22.269760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:30:46.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253195+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257535+0000","last_change":"2023-10-08T16:24:21.268698+0000","last_active":"2023-10-08T16:24:22.257535+0000","last_peered":"2023-10-08T16:24:22.257535+0000","last_clean":"2023-10-08T16:24:22.257535+0000","last_became_active":"2023-10-08T16:24:21.268390+0000","last_became_peered":"2023-10-08T16:24:21.268390+0000","last_unstale":"2023-10-08T16:24:22.257535+0000","last_undegraded":"2023-10-08T16:24:22.257535+0000","last_fullsized":"2023-10-08T16:24:22.257535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:14.687838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276317+0000","last_change":"2023-10-08T16:24:22.270899+0000","last_active":"2023-10-08T16:24:22.276317+0000","last_peered":"2023-10-08T16:24:22.276317+0000","last_clean":"2023-10-08T16:24:22.276317+0000","last_became_active":"2023-10-08T16:24:22.270208+0000","last_became_peered":"2023-10-08T16:24:22.270208+0000","last_unstale":"2023-10-08T16:24:22.276317+0000","last_undegraded":"2023-10-08T16:24:22.276317+0000","last_fullsized":"2023-10-08T16:24:22.276317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:10.548785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287746+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.287746+0000","last_peered":"2023-10-08T16:24:22.287746+0000","last_clean":"2023-10-08T16:24:22.287746+0000","last_became_active":"2023-10-08T16:24:21.269334+0000","last_became_peered":"2023-10-08T16:24:21.269334+0000","last_unstale":"2023-10-08T16:24:22.287746+0000","last_undegraded":"2023-10-08T16:24:22.287746+0000","last_fullsized":"2023-10-08T16:24:22.287746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:46.119976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269809+0000","last_change":"2023-10-08T16:24:22.266878+0000","last_active":"2023-10-08T16:24:22.269809+0000","last_peered":"2023-10-08T16:24:22.269809+0000","last_clean":"2023-10-08T16:24:22.269809+0000","last_became_active":"2023-10-08T16:24:22.266101+0000","last_became_peered":"2023-10-08T16:24:22.266101+0000","last_unstale":"2023-10-08T16:24:22.269809+0000","last_undegraded":"2023-10-08T16:24:22.269809+0000","last_fullsized":"2023-10-08T16:24:22.269809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.883482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293561+0000","last_change":"2023-10-08T16:24:21.261619+0000","last_active":"2023-10-08T16:24:22.293561+0000","last_peered":"2023-10-08T16:24:22.293561+0000","last_clean":"2023-10-08T16:24:22.293561+0000","last_became_active":"2023-10-08T16:24:21.261364+0000","last_became_peered":"2023-10-08T16:24:21.261364+0000","last_unstale":"2023-10-08T16:24:22.293561+0000","last_undegraded":"2023-10-08T16:24:22.293561+0000","last_fullsized":"2023-10-08T16:24:22.293561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:55.109496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.267650+0000","last_change":"2023-10-08T16:24:22.265540+0000","last_active":"2023-10-08T16:24:22.267650+0000","last_peered":"2023-10-08T16:24:22.267650+0000","last_clean":"2023-10-08T16:24:22.267650+0000","last_became_active":"2023-10-08T16:24:22.265265+0000","last_became_peered":"2023-10-08T16:24:22.265265+0000","last_unstale":"2023-10-08T16:24:22.267650+0000","last_undegraded":"2023-10-08T16:24:22.267650+0000","last_fullsized":"2023-10-08T16:24:22.267650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.566331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289188+0000","last_change":"2023-10-08T16:24:21.268382+0000","last_active":"2023-10-08T16:24:22.289188+0000","last_peered":"2023-10-08T16:24:22.289188+0000","last_clean":"2023-10-08T16:24:22.289188+0000","last_became_active":"2023-10-08T16:24:21.268141+0000","last_became_peered":"2023-10-08T16:24:21.268141+0000","last_unstale":"2023-10-08T16:24:22.289188+0000","last_undegraded":"2023-10-08T16:24:22.289188+0000","last_fullsized":"2023-10-08T16:24:22.289188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:12.547947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276490+0000","last_change":"2023-10-08T16:24:22.270441+0000","last_active":"2023-10-08T16:24:22.276490+0000","last_peered":"2023-10-08T16:24:22.276490+0000","last_clean":"2023-10-08T16:24:22.276490+0000","last_became_active":"2023-10-08T16:24:22.270142+0000","last_became_peered":"2023-10-08T16:24:22.270142+0000","last_unstale":"2023-10-08T16:24:22.276490+0000","last_undegraded":"2023-10-08T16:24:22.276490+0000","last_fullsized":"2023-10-08T16:24:22.276490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:41.764767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286673+0000","last_change":"2023-10-08T16:24:21.267941+0000","last_active":"2023-10-08T16:24:22.286673+0000","last_peered":"2023-10-08T16:24:22.286673+0000","last_clean":"2023-10-08T16:24:22.286673+0000","last_became_active":"2023-10-08T16:24:21.267613+0000","last_became_peered":"2023-10-08T16:24:21.267613+0000","last_unstale":"2023-10-08T16:24:22.286673+0000","last_undegraded":"2023-10-08T16:24:22.286673+0000","last_fullsized":"2023-10-08T16:24:22.286673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:47.872492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276994+0000","last_change":"2023-10-08T16:24:22.274135+0000","last_active":"2023-10-08T16:24:22.276994+0000","last_peered":"2023-10-08T16:24:22.276994+0000","last_clean":"2023-10-08T16:24:22.276994+0000","last_became_active":"2023-10-08T16:24:22.273837+0000","last_became_peered":"2023-10-08T16:24:22.273837+0000","last_unstale":"2023-10-08T16:24:22.276994+0000","last_undegraded":"2023-10-08T16:24:22.276994+0000","last_fullsized":"2023-10-08T16:24:22.276994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:51.668749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257341+0000","last_change":"2023-10-08T16:24:21.276024+0000","last_active":"2023-10-08T16:24:22.257341+0000","last_peered":"2023-10-08T16:24:22.257341+0000","last_clean":"2023-10-08T16:24:22.257341+0000","last_became_active":"2023-10-08T16:24:21.275739+0000","last_became_peered":"2023-10-08T16:24:21.275739+0000","last_unstale":"2023-10-08T16:24:22.257341+0000","last_undegraded":"2023-10-08T16:24:22.257341+0000","last_fullsized":"2023-10-08T16:24:22.257341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:21.350486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275441+0000","last_change":"2023-10-08T16:24:22.271976+0000","last_active":"2023-10-08T16:24:22.275441+0000","last_peered":"2023-10-08T16:24:22.275441+0000","last_clean":"2023-10-08T16:24:22.275441+0000","last_became_active":"2023-10-08T16:24:22.271425+0000","last_became_peered":"2023-10-08T16:24:22.271425+0000","last_unstale":"2023-10-08T16:24:22.275441+0000","last_undegraded":"2023-10-08T16:24:22.275441+0000","last_fullsized":"2023-10-08T16:24:22.275441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:47.127059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291574+0000","last_change":"2023-10-08T16:24:21.267852+0000","last_active":"2023-10-08T16:24:22.291574+0000","last_peered":"2023-10-08T16:24:22.291574+0000","last_clean":"2023-10-08T16:24:22.291574+0000","last_became_active":"2023-10-08T16:24:21.267533+0000","last_became_peered":"2023-10-08T16:24:21.267533+0000","last_unstale":"2023-10-08T16:24:22.291574+0000","last_undegraded":"2023-10-08T16:24:22.291574+0000","last_fullsized":"2023-10-08T16:24:22.291574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284930+0000","last_change":"2023-10-08T16:24:22.274776+0000","last_active":"2023-10-08T16:24:22.284930+0000","last_peered":"2023-10-08T16:24:22.284930+0000","last_clean":"2023-10-08T16:24:22.284930+0000","last_became_active":"2023-10-08T16:24:22.274530+0000","last_became_peered":"2023-10-08T16:24:22.274530+0000","last_unstale":"2023-10-08T16:24:22.284930+0000","last_undegraded":"2023-10-08T16:24:22.284930+0000","last_fullsized":"2023-10-08T16:24:22.284930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.101600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256460+0000","last_change":"2023-10-08T16:24:21.263757+0000","last_active":"2023-10-08T16:24:22.256460+0000","last_peered":"2023-10-08T16:24:22.256460+0000","last_clean":"2023-10-08T16:24:22.256460+0000","last_became_active":"2023-10-08T16:24:21.263272+0000","last_became_peered":"2023-10-08T16:24:21.263272+0000","last_unstale":"2023-10-08T16:24:22.256460+0000","last_undegraded":"2023-10-08T16:24:22.256460+0000","last_fullsized":"2023-10-08T16:24:22.256460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:24.676343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270553+0000","last_change":"2023-10-08T16:24:22.268087+0000","last_active":"2023-10-08T16:24:22.270553+0000","last_peered":"2023-10-08T16:24:22.270553+0000","last_clean":"2023-10-08T16:24:22.270553+0000","last_became_active":"2023-10-08T16:24:22.267829+0000","last_became_peered":"2023-10-08T16:24:22.267829+0000","last_unstale":"2023-10-08T16:24:22.270553+0000","last_undegraded":"2023-10-08T16:24:22.270553+0000","last_fullsized":"2023-10-08T16:24:22.270553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:03.698744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258364+0000","last_change":"2023-10-08T16:24:21.263139+0000","last_active":"2023-10-08T16:24:22.258364+0000","last_peered":"2023-10-08T16:24:22.258364+0000","last_clean":"2023-10-08T16:24:22.258364+0000","last_became_active":"2023-10-08T16:24:21.262842+0000","last_became_peered":"2023-10-08T16:24:21.262842+0000","last_unstale":"2023-10-08T16:24:22.258364+0000","last_undegraded":"2023-10-08T16:24:22.258364+0000","last_fullsized":"2023-10-08T16:24:22.258364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:55.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.278195+0000","last_change":"2023-10-08T16:24:22.277258+0000","last_active":"2023-10-08T16:24:22.278195+0000","last_peered":"2023-10-08T16:24:22.278195+0000","last_clean":"2023-10-08T16:24:22.278195+0000","last_became_active":"2023-10-08T16:24:22.276962+0000","last_became_peered":"2023-10-08T16:24:22.276962+0000","last_unstale":"2023-10-08T16:24:22.278195+0000","last_undegraded":"2023-10-08T16:24:22.278195+0000","last_fullsized":"2023-10-08T16:24:22.278195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:53.296385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291666+0000","last_change":"2023-10-08T16:24:21.269755+0000","last_active":"2023-10-08T16:24:22.291666+0000","last_peered":"2023-10-08T16:24:22.291666+0000","last_clean":"2023-10-08T16:24:22.291666+0000","last_became_active":"2023-10-08T16:24:21.269510+0000","last_became_peered":"2023-10-08T16:24:21.269510+0000","last_unstale":"2023-10-08T16:24:22.291666+0000","last_undegraded":"2023-10-08T16:24:22.291666+0000","last_fullsized":"2023-10-08T16:24:22.291666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:39.883010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276996+0000","last_change":"2023-10-08T16:24:22.275498+0000","last_active":"2023-10-08T16:24:22.276996+0000","last_peered":"2023-10-08T16:24:22.276996+0000","last_clean":"2023-10-08T16:24:22.276996+0000","last_became_active":"2023-10-08T16:24:22.275126+0000","last_became_peered":"2023-10-08T16:24:22.275126+0000","last_unstale":"2023-10-08T16:24:22.276996+0000","last_undegraded":"2023-10-08T16:24:22.276996+0000","last_fullsized":"2023-10-08T16:24:22.276996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:54.012780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257826+0000","last_change":"2023-10-08T16:24:21.272140+0000","last_active":"2023-10-08T16:24:22.257826+0000","last_peered":"2023-10-08T16:24:22.257826+0000","last_clean":"2023-10-08T16:24:22.257826+0000","last_became_active":"2023-10-08T16:24:21.271855+0000","last_became_peered":"2023-10-08T16:24:21.271855+0000","last_unstale":"2023-10-08T16:24:22.257826+0000","last_undegraded":"2023-10-08T16:24:22.257826+0000","last_fullsized":"2023-10-08T16:24:22.257826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:43.513877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284324+0000","last_change":"2023-10-08T16:24:22.275692+0000","last_active":"2023-10-08T16:24:22.284324+0000","last_peered":"2023-10-08T16:24:22.284324+0000","last_clean":"2023-10-08T16:24:22.284324+0000","last_became_active":"2023-10-08T16:24:22.275415+0000","last_became_peered":"2023-10-08T16:24:22.275415+0000","last_unstale":"2023-10-08T16:24:22.284324+0000","last_undegraded":"2023-10-08T16:24:22.284324+0000","last_fullsized":"2023-10-08T16:24:22.284324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:19.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253193+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268257+0000","last_change":"2023-10-08T16:24:22.266562+0000","last_active":"2023-10-08T16:24:22.268257+0000","last_peered":"2023-10-08T16:24:22.268257+0000","last_clean":"2023-10-08T16:24:22.268257+0000","last_became_active":"2023-10-08T16:24:22.265904+0000","last_became_peered":"2023-10-08T16:24:22.265904+0000","last_unstale":"2023-10-08T16:24:22.268257+0000","last_undegraded":"2023-10-08T16:24:22.268257+0000","last_fullsized":"2023-10-08T16:24:22.268257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:42.482305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.259013+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.259013+0000","last_peered":"2023-10-08T16:24:22.259013+0000","last_clean":"2023-10-08T16:24:22.259013+0000","last_became_active":"2023-10-08T16:24:21.269338+0000","last_became_peered":"2023-10-08T16:24:21.269338+0000","last_unstale":"2023-10-08T16:24:22.259013+0000","last_undegraded":"2023-10-08T16:24:22.259013+0000","last_fullsized":"2023-10-08T16:24:22.259013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:51.308472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276204+0000","last_change":"2023-10-08T16:24:22.264942+0000","last_active":"2023-10-08T16:24:22.276204+0000","last_peered":"2023-10-08T16:24:22.276204+0000","last_clean":"2023-10-08T16:24:22.276204+0000","last_became_active":"2023-10-08T16:24:22.264659+0000","last_became_peered":"2023-10-08T16:24:22.264659+0000","last_unstale":"2023-10-08T16:24:22.276204+0000","last_undegraded":"2023-10-08T16:24:22.276204+0000","last_fullsized":"2023-10-08T16:24:22.276204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:28.010725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256572+0000","last_change":"2023-10-08T16:24:21.266315+0000","last_active":"2023-10-08T16:24:22.256572+0000","last_peered":"2023-10-08T16:24:22.256572+0000","last_clean":"2023-10-08T16:24:22.256572+0000","last_became_active":"2023-10-08T16:24:21.266015+0000","last_became_peered":"2023-10-08T16:24:21.266015+0000","last_unstale":"2023-10-08T16:24:22.256572+0000","last_undegraded":"2023-10-08T16:24:22.256572+0000","last_fullsized":"2023-10-08T16:24:22.256572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:43.409719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276286+0000","last_change":"2023-10-08T16:24:22.270477+0000","last_active":"2023-10-08T16:24:22.276286+0000","last_peered":"2023-10-08T16:24:22.276286+0000","last_clean":"2023-10-08T16:24:22.276286+0000","last_became_active":"2023-10-08T16:24:22.270161+0000","last_became_peered":"2023-10-08T16:24:22.270161+0000","last_unstale":"2023-10-08T16:24:22.276286+0000","last_undegraded":"2023-10-08T16:24:22.276286+0000","last_fullsized":"2023-10-08T16:24:22.276286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:55.893986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.245706+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277772+0000","last_change":"2023-10-08T16:24:22.271832+0000","last_active":"2023-10-08T16:24:22.277772+0000","last_peered":"2023-10-08T16:24:22.277772+0000","last_clean":"2023-10-08T16:24:22.277772+0000","last_became_active":"2023-10-08T16:24:22.271501+0000","last_became_peered":"2023-10-08T16:24:22.271501+0000","last_unstale":"2023-10-08T16:24:22.277772+0000","last_undegraded":"2023-10-08T16:24:22.277772+0000","last_fullsized":"2023-10-08T16:24:22.277772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:01.112062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256347+0000","last_change":"2023-10-08T16:24:21.274862+0000","last_active":"2023-10-08T16:24:22.256347+0000","last_peered":"2023-10-08T16:24:22.256347+0000","last_clean":"2023-10-08T16:24:22.256347+0000","last_became_active":"2023-10-08T16:24:21.274569+0000","last_became_peered":"2023-10-08T16:24:21.274569+0000","last_unstale":"2023-10-08T16:24:22.256347+0000","last_undegraded":"2023-10-08T16:24:22.256347+0000","last_fullsized":"2023-10-08T16:24:22.256347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.347897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276246+0000","last_change":"2023-10-08T16:24:22.266748+0000","last_active":"2023-10-08T16:24:22.276246+0000","last_peered":"2023-10-08T16:24:22.276246+0000","last_clean":"2023-10-08T16:24:22.276246+0000","last_became_active":"2023-10-08T16:24:22.266033+0000","last_became_peered":"2023-10-08T16:24:22.266033+0000","last_unstale":"2023-10-08T16:24:22.276246+0000","last_undegraded":"2023-10-08T16:24:22.276246+0000","last_fullsized":"2023-10-08T16:24:22.276246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:59.306851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258344+0000","last_change":"2023-10-08T16:24:21.262446+0000","last_active":"2023-10-08T16:24:22.258344+0000","last_peered":"2023-10-08T16:24:22.258344+0000","last_clean":"2023-10-08T16:24:22.258344+0000","last_became_active":"2023-10-08T16:24:21.262129+0000","last_became_peered":"2023-10-08T16:24:21.262129+0000","last_unstale":"2023-10-08T16:24:22.258344+0000","last_undegraded":"2023-10-08T16:24:22.258344+0000","last_fullsized":"2023-10-08T16:24:22.258344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:16.999817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285817+0000","last_change":"2023-10-08T16:24:22.276248+0000","last_active":"2023-10-08T16:24:22.285817+0000","last_peered":"2023-10-08T16:24:22.285817+0000","last_clean":"2023-10-08T16:24:22.285817+0000","last_became_active":"2023-10-08T16:24:22.275930+0000","last_became_peered":"2023-10-08T16:24:22.275930+0000","last_unstale":"2023-10-08T16:24:22.285817+0000","last_undegraded":"2023-10-08T16:24:22.285817+0000","last_fullsized":"2023-10-08T16:24:22.285817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253049+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'161","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.253357+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:24:22.253357+0000","last_peered":"2023-10-08T16:24:22.253357+0000","last_clean":"2023-10-08T16:24:22.253357+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:24:22.253357+0000","last_undegraded":"2023-10-08T16:24:22.253357+0000","last_fullsized":"2023-10-08T16:24:22.253357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307072,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064768,"statfs":{"total":96636764160,"available":96322322432,"internally_reserved":0,"allocated":1630208,"data_stored":1084462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.48699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":1.103},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":1.089},"last":0.441}]},{"osd":1,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.63900000000000001,"5min":0.49299999999999999,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.70299999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":0.997,"15min":1.1160000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98099999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97599999999999998,"5min":1.032,"15min":1.1000000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":1.006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.61699999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":1.234},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.437},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.3919999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.44900000000000001,"5min":0.434,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.3680000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70799999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.4319999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0409999999999999,"15min":1.323},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48099999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.448},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.96399999999999997,"15min":1.125},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.58499999999999996,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.55700000000000005,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":1.365},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.54200000000000004,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":1.0549999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.72099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.552},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.68500000000000005,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.94299999999999995,"5min":1.034,"15min":1.4570000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0149999999999999,"15min":1.069},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.619},"last":0.97799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":1.272,"15min":1.272},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069448,"statfs":{"total":96636764160,"available":96327114752,"internally_reserved":0,"allocated":1032192,"data_stored":494024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.873,"15min":0.873},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.472},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.64500000000000002,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.373},"last":0.745},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.81999999999999995,"15min":0.79800000000000004},"min":{"1min":0.65900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0680000000000001,"5min":1.2230000000000001,"15min":1.375},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.276},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.80600000000000005},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.107,"15min":1.224},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.429},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81399999999999995},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.52200000000000002},"max":{"1min":1.0840000000000001,"5min":1.2909999999999999,"15min":1.391},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99299999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":0.95899999999999996,"5min":1.0960000000000001,"15min":1.514},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1638400,"data_stored":1086392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.748,"5min":1.1339999999999999,"15min":1.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.442,"5min":0.374,"15min":0.36199999999999999},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":1.679},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":1.093,"15min":1.5569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.72599999999999998,"5min":0.878,"15min":1.371},"last":0.435},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.54700000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":1.21,"15min":1.2470000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.46400000000000002},"max":{"1min":1.054,"5min":1.1899999999999999,"15min":1.325},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81799999999999995,"15min":0.79900000000000004},"min":{"1min":0.65900000000000003,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.083,"5min":1.1439999999999999,"15min":1.153},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57099999999999995},"max":{"1min":1.0720000000000001,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.52900000000000003},"max":{"1min":1.149,"5min":1.1950000000000001,"15min":1.288},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.212,"15min":1.262},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.624,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.163,"5min":1.202,"15min":1.4079999999999999},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67300000000000004,"5min":1.046,"15min":1.046},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.747,"5min":1.1160000000000001,"15min":1.448},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.056,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80900000000000005,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":1.321,"15min":1.3959999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82499999999999996,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0980000000000001,"5min":1.4410000000000001,"15min":1.734},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.272,"15min":1.655},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.83899999999999997},"last":0.38},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.90200000000000002},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.41599999999999998,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.47299999999999998,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.55600000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.77900000000000003,"5min":1,"15min":1},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.50700000000000001,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":1.04,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.51100000000000001},"max":{"1min":0.95299999999999996,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.66200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.3200000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.64500000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.397},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.153,"15min":1.306},"last":0.749},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.63900000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.321},"last":0.85399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.0069999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.62,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.997,"5min":1.012,"15min":1.012},"last":0.628}]},{"osd":1,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.379},"max":{"1min":1.0640000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.109,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.753},"min":{"1min":0.64300000000000002,"5min":0.47999999999999998,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.216},"last":0.91100000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.72599999999999998,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1479999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0980000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.44400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0149999999999999,"5min":1.47,"15min":1.47},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67200000000000004,"15min":0.64700000000000002},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":1.0409999999999999,"5min":2.661,"15min":2.661},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0860000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.117},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.94699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310588,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061252,"statfs":{"total":96636764160,"available":96318722048,"internally_reserved":0,"allocated":1036288,"data_stored":494558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.754,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92900000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0169999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.58099999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":1.05,"15min":1.05},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.121},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.59499999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90800000000000003,"5min":4.931,"15min":4.931},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98099999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.70299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.63900000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":2.024,"15min":2.024},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.436},"max":{"1min":1.0660000000000001,"5min":2.157,"15min":2.157},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":0.94199999999999995,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:24:26.712 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:24:26.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.931+0000 7f162539d700 1 Processor -- start 2023-10-08T16:24:26.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.932+0000 7f162539d700 1 -- start start 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1620140a70 0x7f16200c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 0x7f16200c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16200c8330 0x7f16200aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200c6d50 con 0x7f1620140a70 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16200c7030 con 0x7f1620140e40 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f162539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c7310 con 0x7f16200c8330 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f161ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1620140a70 0x7f16200c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f161ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1620140a70 0x7f16200c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44328/0 (socket says 172.21.15.12:44328) 2023-10-08T16:24:26.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f161ffff700 1 -- 172.21.15.12:0/3479914558 learned_addr learned my addr 172.21.15.12:0/3479914558 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f161f7fe700 1 --2- 172.21.15.12:0/3479914558 >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 0x7f16200c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.933+0000 7f1624b9c700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16200c8330 0x7f16200aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 -- 172.21.15.12:0/3479914558 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16200c8330 msgr2=0x7f16200aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16200c8330 0x7f16200aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 -- 172.21.15.12:0/3479914558 >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 msgr2=0x7f16200c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 --2- 172.21.15.12:0/3479914558 >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 0x7f16200c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 -- 172.21.15.12:0/3479914558 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16200c75f0 con 0x7f1620140a70 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161f7fe700 1 --2- 172.21.15.12:0/3479914558 >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 0x7f16200c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161ffff700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f16200c6770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc0e0 tx=0x7f1610009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5c45c8ea6579a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161effd700 1 -- 172.21.15.12:0/3479914558 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000b640 con 0x7f1620140a70 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161effd700 1 -- 172.21.15.12:0/3479914558 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f161000b7a0 con 0x7f1620140a70 2023-10-08T16:24:26.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.934+0000 7f161effd700 1 -- 172.21.15.12:0/3479914558 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161000bb60 con 0x7f1620140a70 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 -- 172.21.15.12:0/3479914558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 msgr2=0x7f16200c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f16200c6770 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc0e0 tx=0x7f1610009250 comp rx=0 tx=0).stop 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 -- 172.21.15.12:0/3479914558 shutdown_connections 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16200c8330 0x7f16200aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 --2- 172.21.15.12:0/3479914558 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f16200c6770 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 --2- 172.21.15.12:0/3479914558 >> v2:172.21.15.29:3300/0 conn(0x7f1620140e40 0x7f16200c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 -- 172.21.15.12:0/3479914558 >> 172.21.15.12:0/3479914558 conn(0x7f162006d170 msgr2=0x7f16200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 -- 172.21.15.12:0/3479914558 shutdown_connections 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.935+0000 7f162539d700 1 -- 172.21.15.12:0/3479914558 wait complete. 2023-10-08T16:24:26.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.937+0000 7f162539d700 1 Processor -- start 2023-10-08T16:24:26.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.937+0000 7f162539d700 1 -- start start 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 0x7f16201348b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 0x7f162015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200cac20 con 0x7f1620140a70 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16200c9d00 con 0x7f16200c8330 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f162539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1620134df0 con 0x7f1620140e40 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44330/0 (socket says 172.21.15.12:44330) 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 -- 172.21.15.12:0/2227603252 learned_addr learned my addr 172.21.15.12:0/2227603252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f1624b9c700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 0x7f162015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161ffff700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 0x7f16201348b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 -- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 msgr2=0x7f162015a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 0x7f162015a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 -- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 msgr2=0x7f16201348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 0x7f16201348b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161f7fe700 1 -- 172.21.15.12:0/2227603252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16140093c0 con 0x7f1620140a70 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f1624b9c700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 0x7f162015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.938+0000 7f161ffff700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 0x7f16201348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f161f7fe700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f161400ec80 tx=0x7f1614009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1614005a00 con 0x7f1620140a70 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1614005b60 con 0x7f1620140a70 2023-10-08T16:24:26.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16100094f0 con 0x7f1620140a70 2023-10-08T16:24:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f161400c9d0 con 0x7f1620140a70 2023-10-08T16:24:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.939+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16200ca560 con 0x7f1620140a70 2023-10-08T16:24:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.940+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f162004c3c0 con 0x7f1620140a70 2023-10-08T16:24:26.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.941+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1614006030 con 0x7f1620140a70 2023-10-08T16:24:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.942+0000 7f1607fff700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.942+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f1614084c50 con 0x7f1620140a70 2023-10-08T16:24:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.942+0000 7f161ffff700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:26.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.943+0000 7f161ffff700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc0e0 tx=0x7f1610017000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:26.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:26.946+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1614051c90 con 0x7f1620140a70 2023-10-08T16:24:27.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.145+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16200c78d0 con 0x7f160c066f30 2023-10-08T16:24:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.154+0000 7f1607fff700 1 -- 172.21.15.12:0/2227603252 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287107 (secure 0 0 0) 0x7f16200c78d0 con 0x7f160c066f30 2023-10-08T16:24:27.159 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 msgr2=0x7f160c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 0x7f160c0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f16200cc0e0 tx=0x7f1610017000 comp rx=0 tx=0).stop 2023-10-08T16:24:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 msgr2=0x7f162016a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f161400ec80 tx=0x7f1614009120 comp rx=0 tx=0).stop 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 shutdown_connections 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f160c066f30 0x7f160c0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1620140e40 0x7f162015a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16200c8330 0x7f16201348b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 --2- 172.21.15.12:0/2227603252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1620140a70 0x7f162016a240 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 >> 172.21.15.12:0/2227603252 conn(0x7f162006d170 msgr2=0x7f1620069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 shutdown_connections 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.159+0000 7f162539d700 1 -- 172.21.15.12:0/2227603252 wait complete. 2023-10-08T16:24:27.162 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:24:27.178 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:24:25.712634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":277,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436628,"kb_used_data":9172,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752538092,"statfs":{"total":773094113280,"available":770599006208,"internally_reserved":0,"allocated":9392128,"data_stored":5094320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470190"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279439+0000","last_change":"2023-10-08T16:24:22.277197+0000","last_active":"2023-10-08T16:24:22.279439+0000","last_peered":"2023-10-08T16:24:22.279439+0000","last_clean":"2023-10-08T16:24:22.279439+0000","last_became_active":"2023-10-08T16:24:22.276948+0000","last_became_peered":"2023-10-08T16:24:22.276948+0000","last_unstale":"2023-10-08T16:24:22.279439+0000","last_undegraded":"2023-10-08T16:24:22.279439+0000","last_fullsized":"2023-10-08T16:24:22.279439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:34.105560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276230+0000","last_change":"2023-10-08T16:24:22.272185+0000","last_active":"2023-10-08T16:24:22.276230+0000","last_peered":"2023-10-08T16:24:22.276230+0000","last_clean":"2023-10-08T16:24:22.276230+0000","last_became_active":"2023-10-08T16:24:22.271833+0000","last_became_peered":"2023-10-08T16:24:22.271833+0000","last_unstale":"2023-10-08T16:24:22.276230+0000","last_undegraded":"2023-10-08T16:24:22.276230+0000","last_fullsized":"2023-10-08T16:24:22.276230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:49.759070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270545+0000","last_change":"2023-10-08T16:24:22.265947+0000","last_active":"2023-10-08T16:24:22.270545+0000","last_peered":"2023-10-08T16:24:22.270545+0000","last_clean":"2023-10-08T16:24:22.270545+0000","last_became_active":"2023-10-08T16:24:22.265661+0000","last_became_peered":"2023-10-08T16:24:22.265661+0000","last_unstale":"2023-10-08T16:24:22.270545+0000","last_undegraded":"2023-10-08T16:24:22.270545+0000","last_fullsized":"2023-10-08T16:24:22.270545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:16.359492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269363+0000","last_change":"2023-10-08T16:24:22.267456+0000","last_active":"2023-10-08T16:24:22.269363+0000","last_peered":"2023-10-08T16:24:22.269363+0000","last_clean":"2023-10-08T16:24:22.269363+0000","last_became_active":"2023-10-08T16:24:22.267053+0000","last_became_peered":"2023-10-08T16:24:22.267053+0000","last_unstale":"2023-10-08T16:24:22.269363+0000","last_undegraded":"2023-10-08T16:24:22.269363+0000","last_fullsized":"2023-10-08T16:24:22.269363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:14.141525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273040+0000","last_change":"2023-10-08T16:24:22.268960+0000","last_active":"2023-10-08T16:24:22.273040+0000","last_peered":"2023-10-08T16:24:22.273040+0000","last_clean":"2023-10-08T16:24:22.273040+0000","last_became_active":"2023-10-08T16:24:22.268672+0000","last_became_peered":"2023-10-08T16:24:22.268672+0000","last_unstale":"2023-10-08T16:24:22.273040+0000","last_undegraded":"2023-10-08T16:24:22.273040+0000","last_fullsized":"2023-10-08T16:24:22.273040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285247+0000","last_change":"2023-10-08T16:24:22.278307+0000","last_active":"2023-10-08T16:24:22.285247+0000","last_peered":"2023-10-08T16:24:22.285247+0000","last_clean":"2023-10-08T16:24:22.285247+0000","last_became_active":"2023-10-08T16:24:22.278008+0000","last_became_peered":"2023-10-08T16:24:22.278008+0000","last_unstale":"2023-10-08T16:24:22.285247+0000","last_undegraded":"2023-10-08T16:24:22.285247+0000","last_fullsized":"2023-10-08T16:24:22.285247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:17.572758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276564+0000","last_change":"2023-10-08T16:24:22.266527+0000","last_active":"2023-10-08T16:24:22.276564+0000","last_peered":"2023-10-08T16:24:22.276564+0000","last_clean":"2023-10-08T16:24:22.276564+0000","last_became_active":"2023-10-08T16:24:22.266294+0000","last_became_peered":"2023-10-08T16:24:22.266294+0000","last_unstale":"2023-10-08T16:24:22.276564+0000","last_undegraded":"2023-10-08T16:24:22.276564+0000","last_fullsized":"2023-10-08T16:24:22.276564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:17.676375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277883+0000","last_change":"2023-10-08T16:24:22.274287+0000","last_active":"2023-10-08T16:24:22.277883+0000","last_peered":"2023-10-08T16:24:22.277883+0000","last_clean":"2023-10-08T16:24:22.277883+0000","last_became_active":"2023-10-08T16:24:22.273777+0000","last_became_peered":"2023-10-08T16:24:22.273777+0000","last_unstale":"2023-10-08T16:24:22.277883+0000","last_undegraded":"2023-10-08T16:24:22.277883+0000","last_fullsized":"2023-10-08T16:24:22.277883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:59:33.821077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286835+0000","last_change":"2023-10-08T16:24:22.279365+0000","last_active":"2023-10-08T16:24:22.286835+0000","last_peered":"2023-10-08T16:24:22.286835+0000","last_clean":"2023-10-08T16:24:22.286835+0000","last_became_active":"2023-10-08T16:24:22.279112+0000","last_became_peered":"2023-10-08T16:24:22.279112+0000","last_unstale":"2023-10-08T16:24:22.286835+0000","last_undegraded":"2023-10-08T16:24:22.286835+0000","last_fullsized":"2023-10-08T16:24:22.286835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276348+0000","last_change":"2023-10-08T16:24:22.274687+0000","last_active":"2023-10-08T16:24:22.276348+0000","last_peered":"2023-10-08T16:24:22.276348+0000","last_clean":"2023-10-08T16:24:22.276348+0000","last_became_active":"2023-10-08T16:24:22.274377+0000","last_became_peered":"2023-10-08T16:24:22.274377+0000","last_unstale":"2023-10-08T16:24:22.276348+0000","last_undegraded":"2023-10-08T16:24:22.276348+0000","last_fullsized":"2023-10-08T16:24:22.276348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:24.050092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284637+0000","last_change":"2023-10-08T16:24:22.276137+0000","last_active":"2023-10-08T16:24:22.284637+0000","last_peered":"2023-10-08T16:24:22.284637+0000","last_clean":"2023-10-08T16:24:22.284637+0000","last_became_active":"2023-10-08T16:24:22.275888+0000","last_became_peered":"2023-10-08T16:24:22.275888+0000","last_unstale":"2023-10-08T16:24:22.284637+0000","last_undegraded":"2023-10-08T16:24:22.284637+0000","last_fullsized":"2023-10-08T16:24:22.284637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:20.213695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277280+0000","last_change":"2023-10-08T16:24:22.268139+0000","last_active":"2023-10-08T16:24:22.277280+0000","last_peered":"2023-10-08T16:24:22.277280+0000","last_clean":"2023-10-08T16:24:22.277280+0000","last_became_active":"2023-10-08T16:24:22.267883+0000","last_became_peered":"2023-10-08T16:24:22.267883+0000","last_unstale":"2023-10-08T16:24:22.277280+0000","last_undegraded":"2023-10-08T16:24:22.277280+0000","last_fullsized":"2023-10-08T16:24:22.277280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:03.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269724+0000","last_change":"2023-10-08T16:24:22.264405+0000","last_active":"2023-10-08T16:24:22.269724+0000","last_peered":"2023-10-08T16:24:22.269724+0000","last_clean":"2023-10-08T16:24:22.269724+0000","last_became_active":"2023-10-08T16:24:22.264086+0000","last_became_peered":"2023-10-08T16:24:22.264086+0000","last_unstale":"2023-10-08T16:24:22.269724+0000","last_undegraded":"2023-10-08T16:24:22.269724+0000","last_fullsized":"2023-10-08T16:24:22.269724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:38.493207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279408+0000","last_change":"2023-10-08T16:24:22.277792+0000","last_active":"2023-10-08T16:24:22.279408+0000","last_peered":"2023-10-08T16:24:22.279408+0000","last_clean":"2023-10-08T16:24:22.279408+0000","last_became_active":"2023-10-08T16:24:22.277523+0000","last_became_peered":"2023-10-08T16:24:22.277523+0000","last_unstale":"2023-10-08T16:24:22.279408+0000","last_undegraded":"2023-10-08T16:24:22.279408+0000","last_fullsized":"2023-10-08T16:24:22.279408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:31.347826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276472+0000","last_change":"2023-10-08T16:24:22.267275+0000","last_active":"2023-10-08T16:24:22.276472+0000","last_peered":"2023-10-08T16:24:22.276472+0000","last_clean":"2023-10-08T16:24:22.276472+0000","last_became_active":"2023-10-08T16:24:22.266980+0000","last_became_peered":"2023-10-08T16:24:22.266980+0000","last_unstale":"2023-10-08T16:24:22.276472+0000","last_undegraded":"2023-10-08T16:24:22.276472+0000","last_fullsized":"2023-10-08T16:24:22.276472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:46.525162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273571+0000","last_change":"2023-10-08T16:24:22.268840+0000","last_active":"2023-10-08T16:24:22.273571+0000","last_peered":"2023-10-08T16:24:22.273571+0000","last_clean":"2023-10-08T16:24:22.273571+0000","last_became_active":"2023-10-08T16:24:22.268515+0000","last_became_peered":"2023-10-08T16:24:22.268515+0000","last_unstale":"2023-10-08T16:24:22.273571+0000","last_undegraded":"2023-10-08T16:24:22.273571+0000","last_fullsized":"2023-10-08T16:24:22.273571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286296+0000","last_change":"2023-10-08T16:24:22.281335+0000","last_active":"2023-10-08T16:24:22.286296+0000","last_peered":"2023-10-08T16:24:22.286296+0000","last_clean":"2023-10-08T16:24:22.286296+0000","last_became_active":"2023-10-08T16:24:22.280628+0000","last_became_peered":"2023-10-08T16:24:22.280628+0000","last_unstale":"2023-10-08T16:24:22.286296+0000","last_undegraded":"2023-10-08T16:24:22.286296+0000","last_fullsized":"2023-10-08T16:24:22.286296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:50.269676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274998+0000","last_change":"2023-10-08T16:24:22.269330+0000","last_active":"2023-10-08T16:24:22.274998+0000","last_peered":"2023-10-08T16:24:22.274998+0000","last_clean":"2023-10-08T16:24:22.274998+0000","last_became_active":"2023-10-08T16:24:22.268739+0000","last_became_peered":"2023-10-08T16:24:22.268739+0000","last_unstale":"2023-10-08T16:24:22.274998+0000","last_undegraded":"2023-10-08T16:24:22.274998+0000","last_fullsized":"2023-10-08T16:24:22.274998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:10.064373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273074+0000","last_change":"2023-10-08T16:24:22.270188+0000","last_active":"2023-10-08T16:24:22.273074+0000","last_peered":"2023-10-08T16:24:22.273074+0000","last_clean":"2023-10-08T16:24:22.273074+0000","last_became_active":"2023-10-08T16:24:22.269890+0000","last_became_peered":"2023-10-08T16:24:22.269890+0000","last_unstale":"2023-10-08T16:24:22.273074+0000","last_undegraded":"2023-10-08T16:24:22.273074+0000","last_fullsized":"2023-10-08T16:24:22.273074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:34.696485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275378+0000","last_change":"2023-10-08T16:24:22.271452+0000","last_active":"2023-10-08T16:24:22.275378+0000","last_peered":"2023-10-08T16:24:22.275378+0000","last_clean":"2023-10-08T16:24:22.275378+0000","last_became_active":"2023-10-08T16:24:22.270407+0000","last_became_peered":"2023-10-08T16:24:22.270407+0000","last_unstale":"2023-10-08T16:24:22.275378+0000","last_undegraded":"2023-10-08T16:24:22.275378+0000","last_fullsized":"2023-10-08T16:24:22.275378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:11.469843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285036+0000","last_change":"2023-10-08T16:24:22.275414+0000","last_active":"2023-10-08T16:24:22.285036+0000","last_peered":"2023-10-08T16:24:22.285036+0000","last_clean":"2023-10-08T16:24:22.285036+0000","last_became_active":"2023-10-08T16:24:22.275138+0000","last_became_peered":"2023-10-08T16:24:22.275138+0000","last_unstale":"2023-10-08T16:24:22.285036+0000","last_undegraded":"2023-10-08T16:24:22.285036+0000","last_fullsized":"2023-10-08T16:24:22.285036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:56.116579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277991+0000","last_change":"2023-10-08T16:24:22.275499+0000","last_active":"2023-10-08T16:24:22.277991+0000","last_peered":"2023-10-08T16:24:22.277991+0000","last_clean":"2023-10-08T16:24:22.277991+0000","last_became_active":"2023-10-08T16:24:22.275240+0000","last_became_peered":"2023-10-08T16:24:22.275240+0000","last_unstale":"2023-10-08T16:24:22.277991+0000","last_undegraded":"2023-10-08T16:24:22.277991+0000","last_fullsized":"2023-10-08T16:24:22.277991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276179+0000","last_change":"2023-10-08T16:24:22.268011+0000","last_active":"2023-10-08T16:24:22.276179+0000","last_peered":"2023-10-08T16:24:22.276179+0000","last_clean":"2023-10-08T16:24:22.276179+0000","last_became_active":"2023-10-08T16:24:22.267685+0000","last_became_peered":"2023-10-08T16:24:22.267685+0000","last_unstale":"2023-10-08T16:24:22.276179+0000","last_undegraded":"2023-10-08T16:24:22.276179+0000","last_fullsized":"2023-10-08T16:24:22.276179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.063975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270329+0000","last_change":"2023-10-08T16:24:22.266566+0000","last_active":"2023-10-08T16:24:22.270329+0000","last_peered":"2023-10-08T16:24:22.270329+0000","last_clean":"2023-10-08T16:24:22.270329+0000","last_became_active":"2023-10-08T16:24:22.266154+0000","last_became_peered":"2023-10-08T16:24:22.266154+0000","last_unstale":"2023-10-08T16:24:22.270329+0000","last_undegraded":"2023-10-08T16:24:22.270329+0000","last_fullsized":"2023-10-08T16:24:22.270329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:13.350748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273243+0000","last_change":"2023-10-08T16:24:22.270956+0000","last_active":"2023-10-08T16:24:22.273243+0000","last_peered":"2023-10-08T16:24:22.273243+0000","last_clean":"2023-10-08T16:24:22.273243+0000","last_became_active":"2023-10-08T16:24:22.270612+0000","last_became_peered":"2023-10-08T16:24:22.270612+0000","last_unstale":"2023-10-08T16:24:22.273243+0000","last_undegraded":"2023-10-08T16:24:22.273243+0000","last_fullsized":"2023-10-08T16:24:22.273243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286636+0000","last_change":"2023-10-08T16:24:22.282687+0000","last_active":"2023-10-08T16:24:22.286636+0000","last_peered":"2023-10-08T16:24:22.286636+0000","last_clean":"2023-10-08T16:24:22.286636+0000","last_became_active":"2023-10-08T16:24:22.282416+0000","last_became_peered":"2023-10-08T16:24:22.282416+0000","last_unstale":"2023-10-08T16:24:22.286636+0000","last_undegraded":"2023-10-08T16:24:22.286636+0000","last_fullsized":"2023-10-08T16:24:22.286636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:18.006900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273784+0000","last_change":"2023-10-08T16:24:22.270422+0000","last_active":"2023-10-08T16:24:22.273784+0000","last_peered":"2023-10-08T16:24:22.273784+0000","last_clean":"2023-10-08T16:24:22.273784+0000","last_became_active":"2023-10-08T16:24:22.270165+0000","last_became_peered":"2023-10-08T16:24:22.270165+0000","last_unstale":"2023-10-08T16:24:22.273784+0000","last_undegraded":"2023-10-08T16:24:22.273784+0000","last_fullsized":"2023-10-08T16:24:22.273784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:07.486766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289512+0000","last_change":"2023-10-08T16:24:21.269557+0000","last_active":"2023-10-08T16:24:22.289512+0000","last_peered":"2023-10-08T16:24:22.289512+0000","last_clean":"2023-10-08T16:24:22.289512+0000","last_became_active":"2023-10-08T16:24:21.269263+0000","last_became_peered":"2023-10-08T16:24:21.269263+0000","last_unstale":"2023-10-08T16:24:22.289512+0000","last_undegraded":"2023-10-08T16:24:22.289512+0000","last_fullsized":"2023-10-08T16:24:22.289512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:42:22.448478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288128+0000","last_change":"2023-10-08T16:24:22.282422+0000","last_active":"2023-10-08T16:24:22.288128+0000","last_peered":"2023-10-08T16:24:22.288128+0000","last_clean":"2023-10-08T16:24:22.288128+0000","last_became_active":"2023-10-08T16:24:22.280622+0000","last_became_peered":"2023-10-08T16:24:22.280622+0000","last_unstale":"2023-10-08T16:24:22.288128+0000","last_undegraded":"2023-10-08T16:24:22.288128+0000","last_fullsized":"2023-10-08T16:24:22.288128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291323+0000","last_change":"2023-10-08T16:24:21.271687+0000","last_active":"2023-10-08T16:24:22.291323+0000","last_peered":"2023-10-08T16:24:22.291323+0000","last_clean":"2023-10-08T16:24:22.291323+0000","last_became_active":"2023-10-08T16:24:21.271411+0000","last_became_peered":"2023-10-08T16:24:21.271411+0000","last_unstale":"2023-10-08T16:24:22.291323+0000","last_undegraded":"2023-10-08T16:24:22.291323+0000","last_fullsized":"2023-10-08T16:24:22.291323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:42.094517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285309+0000","last_change":"2023-10-08T16:24:22.274100+0000","last_active":"2023-10-08T16:24:22.285309+0000","last_peered":"2023-10-08T16:24:22.285309+0000","last_clean":"2023-10-08T16:24:22.285309+0000","last_became_active":"2023-10-08T16:24:22.273194+0000","last_became_peered":"2023-10-08T16:24:22.273194+0000","last_unstale":"2023-10-08T16:24:22.285309+0000","last_undegraded":"2023-10-08T16:24:22.285309+0000","last_fullsized":"2023-10-08T16:24:22.285309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:45.645647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288547+0000","last_change":"2023-10-08T16:24:21.276710+0000","last_active":"2023-10-08T16:24:22.288547+0000","last_peered":"2023-10-08T16:24:22.288547+0000","last_clean":"2023-10-08T16:24:22.288547+0000","last_became_active":"2023-10-08T16:24:21.276424+0000","last_became_peered":"2023-10-08T16:24:21.276424+0000","last_unstale":"2023-10-08T16:24:22.288547+0000","last_undegraded":"2023-10-08T16:24:22.288547+0000","last_fullsized":"2023-10-08T16:24:22.288547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:49.830827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268952+0000","last_change":"2023-10-08T16:24:22.266933+0000","last_active":"2023-10-08T16:24:22.268952+0000","last_peered":"2023-10-08T16:24:22.268952+0000","last_clean":"2023-10-08T16:24:22.268952+0000","last_became_active":"2023-10-08T16:24:22.266234+0000","last_became_peered":"2023-10-08T16:24:22.266234+0000","last_unstale":"2023-10-08T16:24:22.268952+0000","last_undegraded":"2023-10-08T16:24:22.268952+0000","last_fullsized":"2023-10-08T16:24:22.268952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:48.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286651+0000","last_change":"2023-10-08T16:24:21.267216+0000","last_active":"2023-10-08T16:24:22.286651+0000","last_peered":"2023-10-08T16:24:22.286651+0000","last_clean":"2023-10-08T16:24:22.286651+0000","last_became_active":"2023-10-08T16:24:21.266898+0000","last_became_peered":"2023-10-08T16:24:21.266898+0000","last_unstale":"2023-10-08T16:24:22.286651+0000","last_undegraded":"2023-10-08T16:24:22.286651+0000","last_fullsized":"2023-10-08T16:24:22.286651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:56.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285851+0000","last_change":"2023-10-08T16:24:22.278368+0000","last_active":"2023-10-08T16:24:22.285851+0000","last_peered":"2023-10-08T16:24:22.285851+0000","last_clean":"2023-10-08T16:24:22.285851+0000","last_became_active":"2023-10-08T16:24:22.277968+0000","last_became_peered":"2023-10-08T16:24:22.277968+0000","last_unstale":"2023-10-08T16:24:22.285851+0000","last_undegraded":"2023-10-08T16:24:22.285851+0000","last_fullsized":"2023-10-08T16:24:22.285851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:28.517572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244052+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276157+0000","last_change":"2023-10-08T16:24:22.267391+0000","last_active":"2023-10-08T16:24:22.276157+0000","last_peered":"2023-10-08T16:24:22.276157+0000","last_clean":"2023-10-08T16:24:22.276157+0000","last_became_active":"2023-10-08T16:24:22.267088+0000","last_became_peered":"2023-10-08T16:24:22.267088+0000","last_unstale":"2023-10-08T16:24:22.276157+0000","last_undegraded":"2023-10-08T16:24:22.276157+0000","last_fullsized":"2023-10-08T16:24:22.276157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:26.983593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286744+0000","last_change":"2023-10-08T16:24:21.275128+0000","last_active":"2023-10-08T16:24:22.286744+0000","last_peered":"2023-10-08T16:24:22.286744+0000","last_clean":"2023-10-08T16:24:22.286744+0000","last_became_active":"2023-10-08T16:24:21.274777+0000","last_became_peered":"2023-10-08T16:24:21.274777+0000","last_unstale":"2023-10-08T16:24:22.286744+0000","last_undegraded":"2023-10-08T16:24:22.286744+0000","last_fullsized":"2023-10-08T16:24:22.286744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:42.367439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257414+0000","last_change":"2023-10-08T16:24:21.268084+0000","last_active":"2023-10-08T16:24:22.257414+0000","last_peered":"2023-10-08T16:24:22.257414+0000","last_clean":"2023-10-08T16:24:22.257414+0000","last_became_active":"2023-10-08T16:24:21.267806+0000","last_became_peered":"2023-10-08T16:24:21.267806+0000","last_unstale":"2023-10-08T16:24:22.257414+0000","last_undegraded":"2023-10-08T16:24:22.257414+0000","last_fullsized":"2023-10-08T16:24:22.257414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:32.960654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276267+0000","last_change":"2023-10-08T16:24:22.266880+0000","last_active":"2023-10-08T16:24:22.276267+0000","last_peered":"2023-10-08T16:24:22.276267+0000","last_clean":"2023-10-08T16:24:22.276267+0000","last_became_active":"2023-10-08T16:24:22.266473+0000","last_became_peered":"2023-10-08T16:24:22.266473+0000","last_unstale":"2023-10-08T16:24:22.276267+0000","last_undegraded":"2023-10-08T16:24:22.276267+0000","last_fullsized":"2023-10-08T16:24:22.276267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:53.937746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244068+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.254209+0000","last_change":"2023-10-08T16:24:21.273603+0000","last_active":"2023-10-08T16:24:22.254209+0000","last_peered":"2023-10-08T16:24:22.254209+0000","last_clean":"2023-10-08T16:24:22.254209+0000","last_became_active":"2023-10-08T16:24:21.273224+0000","last_became_peered":"2023-10-08T16:24:21.273224+0000","last_unstale":"2023-10-08T16:24:22.254209+0000","last_undegraded":"2023-10-08T16:24:22.254209+0000","last_fullsized":"2023-10-08T16:24:22.254209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:49.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276968+0000","last_change":"2023-10-08T16:24:22.273050+0000","last_active":"2023-10-08T16:24:22.276968+0000","last_peered":"2023-10-08T16:24:22.276968+0000","last_clean":"2023-10-08T16:24:22.276968+0000","last_became_active":"2023-10-08T16:24:22.272781+0000","last_became_peered":"2023-10-08T16:24:22.272781+0000","last_unstale":"2023-10-08T16:24:22.276968+0000","last_undegraded":"2023-10-08T16:24:22.276968+0000","last_fullsized":"2023-10-08T16:24:22.276968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258749+0000","last_change":"2023-10-08T16:24:21.269008+0000","last_active":"2023-10-08T16:24:22.258749+0000","last_peered":"2023-10-08T16:24:22.258749+0000","last_clean":"2023-10-08T16:24:22.258749+0000","last_became_active":"2023-10-08T16:24:21.268649+0000","last_became_peered":"2023-10-08T16:24:21.268649+0000","last_unstale":"2023-10-08T16:24:22.258749+0000","last_undegraded":"2023-10-08T16:24:22.258749+0000","last_fullsized":"2023-10-08T16:24:22.258749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:44.638564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284345+0000","last_change":"2023-10-08T16:24:22.276093+0000","last_active":"2023-10-08T16:24:22.284345+0000","last_peered":"2023-10-08T16:24:22.284345+0000","last_clean":"2023-10-08T16:24:22.284345+0000","last_became_active":"2023-10-08T16:24:22.275832+0000","last_became_peered":"2023-10-08T16:24:22.275832+0000","last_unstale":"2023-10-08T16:24:22.284345+0000","last_undegraded":"2023-10-08T16:24:22.284345+0000","last_fullsized":"2023-10-08T16:24:22.284345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:31.162690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287850+0000","last_change":"2023-10-08T16:24:21.272950+0000","last_active":"2023-10-08T16:24:22.287850+0000","last_peered":"2023-10-08T16:24:22.287850+0000","last_clean":"2023-10-08T16:24:22.287850+0000","last_became_active":"2023-10-08T16:24:21.271679+0000","last_became_peered":"2023-10-08T16:24:21.271679+0000","last_unstale":"2023-10-08T16:24:22.287850+0000","last_undegraded":"2023-10-08T16:24:22.287850+0000","last_fullsized":"2023-10-08T16:24:22.287850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:06.461374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277014+0000","last_change":"2023-10-08T16:24:22.275924+0000","last_active":"2023-10-08T16:24:22.277014+0000","last_peered":"2023-10-08T16:24:22.277014+0000","last_clean":"2023-10-08T16:24:22.277014+0000","last_became_active":"2023-10-08T16:24:22.274052+0000","last_became_peered":"2023-10-08T16:24:22.274052+0000","last_unstale":"2023-10-08T16:24:22.277014+0000","last_undegraded":"2023-10-08T16:24:22.277014+0000","last_fullsized":"2023-10-08T16:24:22.277014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:17.163656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244581+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275422+0000","last_change":"2023-10-08T16:24:22.271444+0000","last_active":"2023-10-08T16:24:22.275422+0000","last_peered":"2023-10-08T16:24:22.275422+0000","last_clean":"2023-10-08T16:24:22.275422+0000","last_became_active":"2023-10-08T16:24:22.270764+0000","last_became_peered":"2023-10-08T16:24:22.270764+0000","last_unstale":"2023-10-08T16:24:22.275422+0000","last_undegraded":"2023-10-08T16:24:22.275422+0000","last_fullsized":"2023-10-08T16:24:22.275422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.468457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293566+0000","last_change":"2023-10-08T16:24:21.269602+0000","last_active":"2023-10-08T16:24:22.293566+0000","last_peered":"2023-10-08T16:24:22.293566+0000","last_clean":"2023-10-08T16:24:22.293566+0000","last_became_active":"2023-10-08T16:24:21.269331+0000","last_became_peered":"2023-10-08T16:24:21.269331+0000","last_unstale":"2023-10-08T16:24:22.293566+0000","last_undegraded":"2023-10-08T16:24:22.293566+0000","last_fullsized":"2023-10-08T16:24:22.293566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.991250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269760+0000","last_change":"2023-10-08T16:24:22.264889+0000","last_active":"2023-10-08T16:24:22.269760+0000","last_peered":"2023-10-08T16:24:22.269760+0000","last_clean":"2023-10-08T16:24:22.269760+0000","last_became_active":"2023-10-08T16:24:22.264605+0000","last_became_peered":"2023-10-08T16:24:22.264605+0000","last_unstale":"2023-10-08T16:24:22.269760+0000","last_undegraded":"2023-10-08T16:24:22.269760+0000","last_fullsized":"2023-10-08T16:24:22.269760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:30:46.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253195+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257535+0000","last_change":"2023-10-08T16:24:21.268698+0000","last_active":"2023-10-08T16:24:22.257535+0000","last_peered":"2023-10-08T16:24:22.257535+0000","last_clean":"2023-10-08T16:24:22.257535+0000","last_became_active":"2023-10-08T16:24:21.268390+0000","last_became_peered":"2023-10-08T16:24:21.268390+0000","last_unstale":"2023-10-08T16:24:22.257535+0000","last_undegraded":"2023-10-08T16:24:22.257535+0000","last_fullsized":"2023-10-08T16:24:22.257535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:14.687838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276317+0000","last_change":"2023-10-08T16:24:22.270899+0000","last_active":"2023-10-08T16:24:22.276317+0000","last_peered":"2023-10-08T16:24:22.276317+0000","last_clean":"2023-10-08T16:24:22.276317+0000","last_became_active":"2023-10-08T16:24:22.270208+0000","last_became_peered":"2023-10-08T16:24:22.270208+0000","last_unstale":"2023-10-08T16:24:22.276317+0000","last_undegraded":"2023-10-08T16:24:22.276317+0000","last_fullsized":"2023-10-08T16:24:22.276317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:10.548785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287746+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.287746+0000","last_peered":"2023-10-08T16:24:22.287746+0000","last_clean":"2023-10-08T16:24:22.287746+0000","last_became_active":"2023-10-08T16:24:21.269334+0000","last_became_peered":"2023-10-08T16:24:21.269334+0000","last_unstale":"2023-10-08T16:24:22.287746+0000","last_undegraded":"2023-10-08T16:24:22.287746+0000","last_fullsized":"2023-10-08T16:24:22.287746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:46.119976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269809+0000","last_change":"2023-10-08T16:24:22.266878+0000","last_active":"2023-10-08T16:24:22.269809+0000","last_peered":"2023-10-08T16:24:22.269809+0000","last_clean":"2023-10-08T16:24:22.269809+0000","last_became_active":"2023-10-08T16:24:22.266101+0000","last_became_peered":"2023-10-08T16:24:22.266101+0000","last_unstale":"2023-10-08T16:24:22.269809+0000","last_undegraded":"2023-10-08T16:24:22.269809+0000","last_fullsized":"2023-10-08T16:24:22.269809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.883482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293561+0000","last_change":"2023-10-08T16:24:21.261619+0000","last_active":"2023-10-08T16:24:22.293561+0000","last_peered":"2023-10-08T16:24:22.293561+0000","last_clean":"2023-10-08T16:24:22.293561+0000","last_became_active":"2023-10-08T16:24:21.261364+0000","last_became_peered":"2023-10-08T16:24:21.261364+0000","last_unstale":"2023-10-08T16:24:22.293561+0000","last_undegraded":"2023-10-08T16:24:22.293561+0000","last_fullsized":"2023-10-08T16:24:22.293561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:55.109496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.267650+0000","last_change":"2023-10-08T16:24:22.265540+0000","last_active":"2023-10-08T16:24:22.267650+0000","last_peered":"2023-10-08T16:24:22.267650+0000","last_clean":"2023-10-08T16:24:22.267650+0000","last_became_active":"2023-10-08T16:24:22.265265+0000","last_became_peered":"2023-10-08T16:24:22.265265+0000","last_unstale":"2023-10-08T16:24:22.267650+0000","last_undegraded":"2023-10-08T16:24:22.267650+0000","last_fullsized":"2023-10-08T16:24:22.267650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.566331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289188+0000","last_change":"2023-10-08T16:24:21.268382+0000","last_active":"2023-10-08T16:24:22.289188+0000","last_peered":"2023-10-08T16:24:22.289188+0000","last_clean":"2023-10-08T16:24:22.289188+0000","last_became_active":"2023-10-08T16:24:21.268141+0000","last_became_peered":"2023-10-08T16:24:21.268141+0000","last_unstale":"2023-10-08T16:24:22.289188+0000","last_undegraded":"2023-10-08T16:24:22.289188+0000","last_fullsized":"2023-10-08T16:24:22.289188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:12.547947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276490+0000","last_change":"2023-10-08T16:24:22.270441+0000","last_active":"2023-10-08T16:24:22.276490+0000","last_peered":"2023-10-08T16:24:22.276490+0000","last_clean":"2023-10-08T16:24:22.276490+0000","last_became_active":"2023-10-08T16:24:22.270142+0000","last_became_peered":"2023-10-08T16:24:22.270142+0000","last_unstale":"2023-10-08T16:24:22.276490+0000","last_undegraded":"2023-10-08T16:24:22.276490+0000","last_fullsized":"2023-10-08T16:24:22.276490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:41.764767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286673+0000","last_change":"2023-10-08T16:24:21.267941+0000","last_active":"2023-10-08T16:24:22.286673+0000","last_peered":"2023-10-08T16:24:22.286673+0000","last_clean":"2023-10-08T16:24:22.286673+0000","last_became_active":"2023-10-08T16:24:21.267613+0000","last_became_peered":"2023-10-08T16:24:21.267613+0000","last_unstale":"2023-10-08T16:24:22.286673+0000","last_undegraded":"2023-10-08T16:24:22.286673+0000","last_fullsized":"2023-10-08T16:24:22.286673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:47.872492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276994+0000","last_change":"2023-10-08T16:24:22.274135+0000","last_active":"2023-10-08T16:24:22.276994+0000","last_peered":"2023-10-08T16:24:22.276994+0000","last_clean":"2023-10-08T16:24:22.276994+0000","last_became_active":"2023-10-08T16:24:22.273837+0000","last_became_peered":"2023-10-08T16:24:22.273837+0000","last_unstale":"2023-10-08T16:24:22.276994+0000","last_undegraded":"2023-10-08T16:24:22.276994+0000","last_fullsized":"2023-10-08T16:24:22.276994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:51.668749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257341+0000","last_change":"2023-10-08T16:24:21.276024+0000","last_active":"2023-10-08T16:24:22.257341+0000","last_peered":"2023-10-08T16:24:22.257341+0000","last_clean":"2023-10-08T16:24:22.257341+0000","last_became_active":"2023-10-08T16:24:21.275739+0000","last_became_peered":"2023-10-08T16:24:21.275739+0000","last_unstale":"2023-10-08T16:24:22.257341+0000","last_undegraded":"2023-10-08T16:24:22.257341+0000","last_fullsized":"2023-10-08T16:24:22.257341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:21.350486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275441+0000","last_change":"2023-10-08T16:24:22.271976+0000","last_active":"2023-10-08T16:24:22.275441+0000","last_peered":"2023-10-08T16:24:22.275441+0000","last_clean":"2023-10-08T16:24:22.275441+0000","last_became_active":"2023-10-08T16:24:22.271425+0000","last_became_peered":"2023-10-08T16:24:22.271425+0000","last_unstale":"2023-10-08T16:24:22.275441+0000","last_undegraded":"2023-10-08T16:24:22.275441+0000","last_fullsized":"2023-10-08T16:24:22.275441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:47.127059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291574+0000","last_change":"2023-10-08T16:24:21.267852+0000","last_active":"2023-10-08T16:24:22.291574+0000","last_peered":"2023-10-08T16:24:22.291574+0000","last_clean":"2023-10-08T16:24:22.291574+0000","last_became_active":"2023-10-08T16:24:21.267533+0000","last_became_peered":"2023-10-08T16:24:21.267533+0000","last_unstale":"2023-10-08T16:24:22.291574+0000","last_undegraded":"2023-10-08T16:24:22.291574+0000","last_fullsized":"2023-10-08T16:24:22.291574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284930+0000","last_change":"2023-10-08T16:24:22.274776+0000","last_active":"2023-10-08T16:24:22.284930+0000","last_peered":"2023-10-08T16:24:22.284930+0000","last_clean":"2023-10-08T16:24:22.284930+0000","last_became_active":"2023-10-08T16:24:22.274530+0000","last_became_peered":"2023-10-08T16:24:22.274530+0000","last_unstale":"2023-10-08T16:24:22.284930+0000","last_undegraded":"2023-10-08T16:24:22.284930+0000","last_fullsized":"2023-10-08T16:24:22.284930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.101600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256460+0000","last_change":"2023-10-08T16:24:21.263757+0000","last_active":"2023-10-08T16:24:22.256460+0000","last_peered":"2023-10-08T16:24:22.256460+0000","last_clean":"2023-10-08T16:24:22.256460+0000","last_became_active":"2023-10-08T16:24:21.263272+0000","last_became_peered":"2023-10-08T16:24:21.263272+0000","last_unstale":"2023-10-08T16:24:22.256460+0000","last_undegraded":"2023-10-08T16:24:22.256460+0000","last_fullsized":"2023-10-08T16:24:22.256460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:24.676343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270553+0000","last_change":"2023-10-08T16:24:22.268087+0000","last_active":"2023-10-08T16:24:22.270553+0000","last_peered":"2023-10-08T16:24:22.270553+0000","last_clean":"2023-10-08T16:24:22.270553+0000","last_became_active":"2023-10-08T16:24:22.267829+0000","last_became_peered":"2023-10-08T16:24:22.267829+0000","last_unstale":"2023-10-08T16:24:22.270553+0000","last_undegraded":"2023-10-08T16:24:22.270553+0000","last_fullsized":"2023-10-08T16:24:22.270553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:03.698744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258364+0000","last_change":"2023-10-08T16:24:21.263139+0000","last_active":"2023-10-08T16:24:22.258364+0000","last_peered":"2023-10-08T16:24:22.258364+0000","last_clean":"2023-10-08T16:24:22.258364+0000","last_became_active":"2023-10-08T16:24:21.262842+0000","last_became_peered":"2023-10-08T16:24:21.262842+0000","last_unstale":"2023-10-08T16:24:22.258364+0000","last_undegraded":"2023-10-08T16:24:22.258364+0000","last_fullsized":"2023-10-08T16:24:22.258364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:55.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.278195+0000","last_change":"2023-10-08T16:24:22.277258+0000","last_active":"2023-10-08T16:24:22.278195+0000","last_peered":"2023-10-08T16:24:22.278195+0000","last_clean":"2023-10-08T16:24:22.278195+0000","last_became_active":"2023-10-08T16:24:22.276962+0000","last_became_peered":"2023-10-08T16:24:22.276962+0000","last_unstale":"2023-10-08T16:24:22.278195+0000","last_undegraded":"2023-10-08T16:24:22.278195+0000","last_fullsized":"2023-10-08T16:24:22.278195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:53.296385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291666+0000","last_change":"2023-10-08T16:24:21.269755+0000","last_active":"2023-10-08T16:24:22.291666+0000","last_peered":"2023-10-08T16:24:22.291666+0000","last_clean":"2023-10-08T16:24:22.291666+0000","last_became_active":"2023-10-08T16:24:21.269510+0000","last_became_peered":"2023-10-08T16:24:21.269510+0000","last_unstale":"2023-10-08T16:24:22.291666+0000","last_undegraded":"2023-10-08T16:24:22.291666+0000","last_fullsized":"2023-10-08T16:24:22.291666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:39.883010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276996+0000","last_change":"2023-10-08T16:24:22.275498+0000","last_active":"2023-10-08T16:24:22.276996+0000","last_peered":"2023-10-08T16:24:22.276996+0000","last_clean":"2023-10-08T16:24:22.276996+0000","last_became_active":"2023-10-08T16:24:22.275126+0000","last_became_peered":"2023-10-08T16:24:22.275126+0000","last_unstale":"2023-10-08T16:24:22.276996+0000","last_undegraded":"2023-10-08T16:24:22.276996+0000","last_fullsized":"2023-10-08T16:24:22.276996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:54.012780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257826+0000","last_change":"2023-10-08T16:24:21.272140+0000","last_active":"2023-10-08T16:24:22.257826+0000","last_peered":"2023-10-08T16:24:22.257826+0000","last_clean":"2023-10-08T16:24:22.257826+0000","last_became_active":"2023-10-08T16:24:21.271855+0000","last_became_peered":"2023-10-08T16:24:21.271855+0000","last_unstale":"2023-10-08T16:24:22.257826+0000","last_undegraded":"2023-10-08T16:24:22.257826+0000","last_fullsized":"2023-10-08T16:24:22.257826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:43.513877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284324+0000","last_change":"2023-10-08T16:24:22.275692+0000","last_active":"2023-10-08T16:24:22.284324+0000","last_peered":"2023-10-08T16:24:22.284324+0000","last_clean":"2023-10-08T16:24:22.284324+0000","last_became_active":"2023-10-08T16:24:22.275415+0000","last_became_peered":"2023-10-08T16:24:22.275415+0000","last_unstale":"2023-10-08T16:24:22.284324+0000","last_undegraded":"2023-10-08T16:24:22.284324+0000","last_fullsized":"2023-10-08T16:24:22.284324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:19.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253193+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268257+0000","last_change":"2023-10-08T16:24:22.266562+0000","last_active":"2023-10-08T16:24:22.268257+0000","last_peered":"2023-10-08T16:24:22.268257+0000","last_clean":"2023-10-08T16:24:22.268257+0000","last_became_active":"2023-10-08T16:24:22.265904+0000","last_became_peered":"2023-10-08T16:24:22.265904+0000","last_unstale":"2023-10-08T16:24:22.268257+0000","last_undegraded":"2023-10-08T16:24:22.268257+0000","last_fullsized":"2023-10-08T16:24:22.268257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:42.482305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.259013+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.259013+0000","last_peered":"2023-10-08T16:24:22.259013+0000","last_clean":"2023-10-08T16:24:22.259013+0000","last_became_active":"2023-10-08T16:24:21.269338+0000","last_became_peered":"2023-10-08T16:24:21.269338+0000","last_unstale":"2023-10-08T16:24:22.259013+0000","last_undegraded":"2023-10-08T16:24:22.259013+0000","last_fullsized":"2023-10-08T16:24:22.259013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:51.308472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276204+0000","last_change":"2023-10-08T16:24:22.264942+0000","last_active":"2023-10-08T16:24:22.276204+0000","last_peered":"2023-10-08T16:24:22.276204+0000","last_clean":"2023-10-08T16:24:22.276204+0000","last_became_active":"2023-10-08T16:24:22.264659+0000","last_became_peered":"2023-10-08T16:24:22.264659+0000","last_unstale":"2023-10-08T16:24:22.276204+0000","last_undegraded":"2023-10-08T16:24:22.276204+0000","last_fullsized":"2023-10-08T16:24:22.276204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:28.010725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256572+0000","last_change":"2023-10-08T16:24:21.266315+0000","last_active":"2023-10-08T16:24:22.256572+0000","last_peered":"2023-10-08T16:24:22.256572+0000","last_clean":"2023-10-08T16:24:22.256572+0000","last_became_active":"2023-10-08T16:24:21.266015+0000","last_became_peered":"2023-10-08T16:24:21.266015+0000","last_unstale":"2023-10-08T16:24:22.256572+0000","last_undegraded":"2023-10-08T16:24:22.256572+0000","last_fullsized":"2023-10-08T16:24:22.256572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:43.409719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276286+0000","last_change":"2023-10-08T16:24:22.270477+0000","last_active":"2023-10-08T16:24:22.276286+0000","last_peered":"2023-10-08T16:24:22.276286+0000","last_clean":"2023-10-08T16:24:22.276286+0000","last_became_active":"2023-10-08T16:24:22.270161+0000","last_became_peered":"2023-10-08T16:24:22.270161+0000","last_unstale":"2023-10-08T16:24:22.276286+0000","last_undegraded":"2023-10-08T16:24:22.276286+0000","last_fullsized":"2023-10-08T16:24:22.276286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:55.893986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.245706+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277772+0000","last_change":"2023-10-08T16:24:22.271832+0000","last_active":"2023-10-08T16:24:22.277772+0000","last_peered":"2023-10-08T16:24:22.277772+0000","last_clean":"2023-10-08T16:24:22.277772+0000","last_became_active":"2023-10-08T16:24:22.271501+0000","last_became_peered":"2023-10-08T16:24:22.271501+0000","last_unstale":"2023-10-08T16:24:22.277772+0000","last_undegraded":"2023-10-08T16:24:22.277772+0000","last_fullsized":"2023-10-08T16:24:22.277772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:01.112062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256347+0000","last_change":"2023-10-08T16:24:21.274862+0000","last_active":"2023-10-08T16:24:22.256347+0000","last_peered":"2023-10-08T16:24:22.256347+0000","last_clean":"2023-10-08T16:24:22.256347+0000","last_became_active":"2023-10-08T16:24:21.274569+0000","last_became_peered":"2023-10-08T16:24:21.274569+0000","last_unstale":"2023-10-08T16:24:22.256347+0000","last_undegraded":"2023-10-08T16:24:22.256347+0000","last_fullsized":"2023-10-08T16:24:22.256347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.347897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276246+0000","last_change":"2023-10-08T16:24:22.266748+0000","last_active":"2023-10-08T16:24:22.276246+0000","last_peered":"2023-10-08T16:24:22.276246+0000","last_clean":"2023-10-08T16:24:22.276246+0000","last_became_active":"2023-10-08T16:24:22.266033+0000","last_became_peered":"2023-10-08T16:24:22.266033+0000","last_unstale":"2023-10-08T16:24:22.276246+0000","last_undegraded":"2023-10-08T16:24:22.276246+0000","last_fullsized":"2023-10-08T16:24:22.276246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:59.306851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258344+0000","last_change":"2023-10-08T16:24:21.262446+0000","last_active":"2023-10-08T16:24:22.258344+0000","last_peered":"2023-10-08T16:24:22.258344+0000","last_clean":"2023-10-08T16:24:22.258344+0000","last_became_active":"2023-10-08T16:24:21.262129+0000","last_became_peered":"2023-10-08T16:24:21.262129+0000","last_unstale":"2023-10-08T16:24:22.258344+0000","last_undegraded":"2023-10-08T16:24:22.258344+0000","last_fullsized":"2023-10-08T16:24:22.258344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:16.999817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285817+0000","last_change":"2023-10-08T16:24:22.276248+0000","last_active":"2023-10-08T16:24:22.285817+0000","last_peered":"2023-10-08T16:24:22.285817+0000","last_clean":"2023-10-08T16:24:22.285817+0000","last_became_active":"2023-10-08T16:24:22.275930+0000","last_became_peered":"2023-10-08T16:24:22.275930+0000","last_unstale":"2023-10-08T16:24:22.285817+0000","last_undegraded":"2023-10-08T16:24:22.285817+0000","last_fullsized":"2023-10-08T16:24:22.285817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253049+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'161","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.253357+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:24:22.253357+0000","last_peered":"2023-10-08T16:24:22.253357+0000","last_clean":"2023-10-08T16:24:22.253357+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:24:22.253357+0000","last_undegraded":"2023-10-08T16:24:22.253357+0000","last_fullsized":"2023-10-08T16:24:22.253357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307072,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064768,"statfs":{"total":96636764160,"available":96322322432,"internally_reserved":0,"allocated":1630208,"data_stored":1084462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.48699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":1.103},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":1.089},"last":0.441}]},{"osd":1,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.63900000000000001,"5min":0.49299999999999999,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.70299999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":0.997,"15min":1.1160000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98099999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97599999999999998,"5min":1.032,"15min":1.1000000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":1.006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.61699999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":1.234},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.437},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.3919999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.44900000000000001,"5min":0.434,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.3680000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70799999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.4319999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0409999999999999,"15min":1.323},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48099999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.448},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.96399999999999997,"15min":1.125},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.58499999999999996,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.55700000000000005,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":1.365},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.54200000000000004,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":1.0549999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.72099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.552},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.68500000000000005,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.94299999999999995,"5min":1.034,"15min":1.4570000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0149999999999999,"15min":1.069},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.619},"last":0.97799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":1.272,"15min":1.272},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069448,"statfs":{"total":96636764160,"available":96327114752,"internally_reserved":0,"allocated":1032192,"data_stored":494024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.873,"15min":0.873},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.472},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.64500000000000002,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.373},"last":0.745},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.81999999999999995,"15min":0.79800000000000004},"min":{"1min":0.65900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0680000000000001,"5min":1.2230000000000001,"15min":1.375},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.276},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.80600000000000005},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.107,"15min":1.224},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.429},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81399999999999995},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.52200000000000002},"max":{"1min":1.0840000000000001,"5min":1.2909999999999999,"15min":1.391},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99299999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":0.95899999999999996,"5min":1.0960000000000001,"15min":1.514},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1638400,"data_stored":1086392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.748,"5min":1.1339999999999999,"15min":1.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.442,"5min":0.374,"15min":0.36199999999999999},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":1.679},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":1.093,"15min":1.5569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.72599999999999998,"5min":0.878,"15min":1.371},"last":0.435},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.54700000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":1.21,"15min":1.2470000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.46400000000000002},"max":{"1min":1.054,"5min":1.1899999999999999,"15min":1.325},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81799999999999995,"15min":0.79900000000000004},"min":{"1min":0.65900000000000003,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.083,"5min":1.1439999999999999,"15min":1.153},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57099999999999995},"max":{"1min":1.0720000000000001,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.52900000000000003},"max":{"1min":1.149,"5min":1.1950000000000001,"15min":1.288},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.212,"15min":1.262},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.624,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.163,"5min":1.202,"15min":1.4079999999999999},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67300000000000004,"5min":1.046,"15min":1.046},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.747,"5min":1.1160000000000001,"15min":1.448},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.056,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80900000000000005,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":1.321,"15min":1.3959999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82499999999999996,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0980000000000001,"5min":1.4410000000000001,"15min":1.734},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.272,"15min":1.655},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.83899999999999997},"last":0.38},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.90200000000000002},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.41599999999999998,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.47299999999999998,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.55600000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.77900000000000003,"5min":1,"15min":1},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.50700000000000001,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":1.04,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.51100000000000001},"max":{"1min":0.95299999999999996,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.66200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.3200000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.64500000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.397},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.153,"15min":1.306},"last":0.749},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.63900000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.321},"last":0.85399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.0069999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.62,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.997,"5min":1.012,"15min":1.012},"last":0.628}]},{"osd":1,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.379},"max":{"1min":1.0640000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.109,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.753},"min":{"1min":0.64300000000000002,"5min":0.47999999999999998,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.216},"last":0.91100000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.72599999999999998,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1479999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0980000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.44400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0149999999999999,"5min":1.47,"15min":1.47},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67200000000000004,"15min":0.64700000000000002},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":1.0409999999999999,"5min":2.661,"15min":2.661},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0860000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.117},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.94699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310588,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061252,"statfs":{"total":96636764160,"available":96318722048,"internally_reserved":0,"allocated":1036288,"data_stored":494558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.754,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92900000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0169999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.58099999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":1.05,"15min":1.05},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.121},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.59499999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90800000000000003,"5min":4.931,"15min":4.931},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98099999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.70299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.63900000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":2.024,"15min":2.024},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.436},"max":{"1min":1.0660000000000001,"5min":2.157,"15min":2.157},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":0.94199999999999995,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:24:27.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:24:27.237 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-10-08T16:24:27.236+0000 7f09af1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:24:27.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.404+0000 7fddd8f9d700 1 Processor -- start 2023-10-08T16:24:27.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.404+0000 7fddd8f9d700 1 -- start start 2023-10-08T16:24:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd8f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fddd413fef0 0x7fddd415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 0x7fddd40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd415ae70 con 0x7fddd413fb20 2023-10-08T16:24:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd8f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd406af60 con 0x7fddd413fef0 2023-10-08T16:24:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd406b240 con 0x7fddd406aaa0 2023-10-08T16:24:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fddd413fb20 0x7fddd40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36186/0 (socket says 172.21.15.12:36186) 2023-10-08T16:24:27.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd37fe700 1 -- 172.21.15.12:0/484750485 learned_addr learned my addr 172.21.15.12:0/484750485 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd3fff700 1 --2- 172.21.15.12:0/484750485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 0x7fddd40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd2ffd700 1 --2- 172.21.15.12:0/484750485 >> v2:172.21.15.29:3300/0 conn(0x7fddd413fef0 0x7fddd415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd27fc700 1 -- 172.21.15.12:0/484750485 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264904778 0 0) 0x7fddc4001110 con 0x7fddd413fb20 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.406+0000 7fddd27fc700 1 -- 172.21.15.12:0/484750485 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddbc003570 con 0x7fddd413fb20 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd3fff700 1 -- 172.21.15.12:0/484750485 >> v2:172.21.15.29:3300/0 conn(0x7fddd413fef0 msgr2=0x7fddd415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:27.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd3fff700 1 --2- 172.21.15.12:0/484750485 >> v2:172.21.15.29:3300/0 conn(0x7fddd413fef0 0x7fddd415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd3fff700 1 -- 172.21.15.12:0/484750485 >> v1:172.21.15.12:6789/0 conn(0x7fddd413fb20 legacy=0x7fddd40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd3fff700 1 -- 172.21.15.12:0/484750485 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd406b520 con 0x7fddd406aaa0 2023-10-08T16:24:27.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd3fff700 1 --2- 172.21.15.12:0/484750485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 0x7fddd40c9d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009e60 tx=0x7fddcc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfdbc2ea8a47bcfc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd27fc700 1 -- 172.21.15.12:0/484750485 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00e070 con 0x7fddd406aaa0 2023-10-08T16:24:27.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd27fc700 1 -- 172.21.15.12:0/484750485 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc00bab0 con 0x7fddd406aaa0 2023-10-08T16:24:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.407+0000 7fddd27fc700 1 -- 172.21.15.12:0/484750485 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00be70 con 0x7fddd406aaa0 2023-10-08T16:24:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 -- 172.21.15.12:0/484750485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 msgr2=0x7fddd40c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/484750485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 0x7fddd40c9d00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009e60 tx=0x7fddcc009780 comp rx=0 tx=0).stop 2023-10-08T16:24:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 -- 172.21.15.12:0/484750485 shutdown_connections 2023-10-08T16:24:27.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/484750485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd406aaa0 0x7fddd40c9d00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/484750485 >> v2:172.21.15.29:3300/0 conn(0x7fddd413fef0 0x7fddd415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 -- 172.21.15.12:0/484750485 >> 172.21.15.12:0/484750485 conn(0x7fddd406d170 msgr2=0x7fddd40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 -- 172.21.15.12:0/484750485 shutdown_connections 2023-10-08T16:24:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.408+0000 7fddd8f9d700 1 -- 172.21.15.12:0/484750485 wait complete. 2023-10-08T16:24:27.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.409+0000 7fddd8f9d700 1 Processor -- start 2023-10-08T16:24:27.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.410+0000 7fddd8f9d700 1 -- start start 2023-10-08T16:24:27.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.410+0000 7fddd8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fddd406aaa0 0x7fddd41692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd413fef0 0x7fddd4169d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd416ad90 con 0x7fddd413fb20 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd416b070 con 0x7fddd406aaa0 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd416b350 con 0x7fddd413fef0 2023-10-08T16:24:27.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44344/0 (socket says 172.21.15.12:44344) 2023-10-08T16:24:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 -- 172.21.15.12:0/577496701 learned_addr learned my addr 172.21.15.12:0/577496701 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd3fff700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd413fef0 0x7fddd4169d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd37fe700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fddd406aaa0 0x7fddd41692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 -- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd413fef0 msgr2=0x7fddd4169d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd413fef0 0x7fddd4169d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 -- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fddd406aaa0 msgr2=0x7fddd41692f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fddd406aaa0 0x7fddd41692f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.411+0000 7fddd2ffd700 1 -- 172.21.15.12:0/577496701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009a20 con 0x7fddd413fb20 2023-10-08T16:24:27.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddd2ffd700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e9a0 tx=0x7fddc8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8013680 con 0x7fddd413fb20 2023-10-08T16:24:27.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc80137e0 con 0x7fddd413fb20 2023-10-08T16:24:27.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc8013b60 con 0x7fddd413fb20 2023-10-08T16:24:27.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd416b630 con 0x7fddd413fb20 2023-10-08T16:24:27.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.412+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd416aa80 con 0x7fddd413fb20 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.413+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd404c3c0 con 0x7fddd413fb20 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.414+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddc800c460 con 0x7fddd413fb20 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.415+0000 7fddbb7fe700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.415+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fddc8084c20 con 0x7fddd413fb20 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.416+0000 7fddd37fe700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.416+0000 7fddd37fe700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 0x7fddc00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b1b60 tx=0x7fddc4007bf0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.420+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddc8051c60 con 0x7fddd413fb20 2023-10-08T16:24:27.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.617+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fddd40635c0 con 0x7fddc0066f30 2023-10-08T16:24:27.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.626+0000 7fddbb7fe700 1 -- 172.21.15.12:0/577496701 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287107 (secure 0 0 0) 0x7fddd40635c0 con 0x7fddc0066f30 2023-10-08T16:24:27.630 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 msgr2=0x7fddc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 0x7fddc00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddd40b1b60 tx=0x7fddc4007bf0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 msgr2=0x7fddd416a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fddc800e9a0 tx=0x7fddc8009120 comp rx=0 tx=0).stop 2023-10-08T16:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 shutdown_connections 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddc0066f30 0x7fddc00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fddd413fef0 0x7fddd4169d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fddd406aaa0 0x7fddd41692f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 --2- 172.21.15.12:0/577496701 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fddd413fb20 0x7fddd416a540 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 >> 172.21.15.12:0/577496701 conn(0x7fddd406d170 msgr2=0x7fddd413afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 shutdown_connections 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.630+0000 7fddd8f9d700 1 -- 172.21.15.12:0/577496701 wait complete. 2023-10-08T16:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:24:27.648 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:24:25.712634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":277,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":192,"ondisk_log_size":192,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436628,"kb_used_data":9172,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752538092,"statfs":{"total":773094113280,"available":770599006208,"internally_reserved":0,"allocated":9392128,"data_stored":5094320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.470190"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279439+0000","last_change":"2023-10-08T16:24:22.277197+0000","last_active":"2023-10-08T16:24:22.279439+0000","last_peered":"2023-10-08T16:24:22.279439+0000","last_clean":"2023-10-08T16:24:22.279439+0000","last_became_active":"2023-10-08T16:24:22.276948+0000","last_became_peered":"2023-10-08T16:24:22.276948+0000","last_unstale":"2023-10-08T16:24:22.279439+0000","last_undegraded":"2023-10-08T16:24:22.279439+0000","last_fullsized":"2023-10-08T16:24:22.279439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:34.105560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276230+0000","last_change":"2023-10-08T16:24:22.272185+0000","last_active":"2023-10-08T16:24:22.276230+0000","last_peered":"2023-10-08T16:24:22.276230+0000","last_clean":"2023-10-08T16:24:22.276230+0000","last_became_active":"2023-10-08T16:24:22.271833+0000","last_became_peered":"2023-10-08T16:24:22.271833+0000","last_unstale":"2023-10-08T16:24:22.276230+0000","last_undegraded":"2023-10-08T16:24:22.276230+0000","last_fullsized":"2023-10-08T16:24:22.276230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:49.759070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270545+0000","last_change":"2023-10-08T16:24:22.265947+0000","last_active":"2023-10-08T16:24:22.270545+0000","last_peered":"2023-10-08T16:24:22.270545+0000","last_clean":"2023-10-08T16:24:22.270545+0000","last_became_active":"2023-10-08T16:24:22.265661+0000","last_became_peered":"2023-10-08T16:24:22.265661+0000","last_unstale":"2023-10-08T16:24:22.270545+0000","last_undegraded":"2023-10-08T16:24:22.270545+0000","last_fullsized":"2023-10-08T16:24:22.270545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:16.359492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269363+0000","last_change":"2023-10-08T16:24:22.267456+0000","last_active":"2023-10-08T16:24:22.269363+0000","last_peered":"2023-10-08T16:24:22.269363+0000","last_clean":"2023-10-08T16:24:22.269363+0000","last_became_active":"2023-10-08T16:24:22.267053+0000","last_became_peered":"2023-10-08T16:24:22.267053+0000","last_unstale":"2023-10-08T16:24:22.269363+0000","last_undegraded":"2023-10-08T16:24:22.269363+0000","last_fullsized":"2023-10-08T16:24:22.269363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:14.141525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273040+0000","last_change":"2023-10-08T16:24:22.268960+0000","last_active":"2023-10-08T16:24:22.273040+0000","last_peered":"2023-10-08T16:24:22.273040+0000","last_clean":"2023-10-08T16:24:22.273040+0000","last_became_active":"2023-10-08T16:24:22.268672+0000","last_became_peered":"2023-10-08T16:24:22.268672+0000","last_unstale":"2023-10-08T16:24:22.273040+0000","last_undegraded":"2023-10-08T16:24:22.273040+0000","last_fullsized":"2023-10-08T16:24:22.273040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285247+0000","last_change":"2023-10-08T16:24:22.278307+0000","last_active":"2023-10-08T16:24:22.285247+0000","last_peered":"2023-10-08T16:24:22.285247+0000","last_clean":"2023-10-08T16:24:22.285247+0000","last_became_active":"2023-10-08T16:24:22.278008+0000","last_became_peered":"2023-10-08T16:24:22.278008+0000","last_unstale":"2023-10-08T16:24:22.285247+0000","last_undegraded":"2023-10-08T16:24:22.285247+0000","last_fullsized":"2023-10-08T16:24:22.285247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:17.572758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276564+0000","last_change":"2023-10-08T16:24:22.266527+0000","last_active":"2023-10-08T16:24:22.276564+0000","last_peered":"2023-10-08T16:24:22.276564+0000","last_clean":"2023-10-08T16:24:22.276564+0000","last_became_active":"2023-10-08T16:24:22.266294+0000","last_became_peered":"2023-10-08T16:24:22.266294+0000","last_unstale":"2023-10-08T16:24:22.276564+0000","last_undegraded":"2023-10-08T16:24:22.276564+0000","last_fullsized":"2023-10-08T16:24:22.276564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:17.676375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277883+0000","last_change":"2023-10-08T16:24:22.274287+0000","last_active":"2023-10-08T16:24:22.277883+0000","last_peered":"2023-10-08T16:24:22.277883+0000","last_clean":"2023-10-08T16:24:22.277883+0000","last_became_active":"2023-10-08T16:24:22.273777+0000","last_became_peered":"2023-10-08T16:24:22.273777+0000","last_unstale":"2023-10-08T16:24:22.277883+0000","last_undegraded":"2023-10-08T16:24:22.277883+0000","last_fullsized":"2023-10-08T16:24:22.277883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:59:33.821077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286835+0000","last_change":"2023-10-08T16:24:22.279365+0000","last_active":"2023-10-08T16:24:22.286835+0000","last_peered":"2023-10-08T16:24:22.286835+0000","last_clean":"2023-10-08T16:24:22.286835+0000","last_became_active":"2023-10-08T16:24:22.279112+0000","last_became_peered":"2023-10-08T16:24:22.279112+0000","last_unstale":"2023-10-08T16:24:22.286835+0000","last_undegraded":"2023-10-08T16:24:22.286835+0000","last_fullsized":"2023-10-08T16:24:22.286835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276348+0000","last_change":"2023-10-08T16:24:22.274687+0000","last_active":"2023-10-08T16:24:22.276348+0000","last_peered":"2023-10-08T16:24:22.276348+0000","last_clean":"2023-10-08T16:24:22.276348+0000","last_became_active":"2023-10-08T16:24:22.274377+0000","last_became_peered":"2023-10-08T16:24:22.274377+0000","last_unstale":"2023-10-08T16:24:22.276348+0000","last_undegraded":"2023-10-08T16:24:22.276348+0000","last_fullsized":"2023-10-08T16:24:22.276348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:24.050092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284637+0000","last_change":"2023-10-08T16:24:22.276137+0000","last_active":"2023-10-08T16:24:22.284637+0000","last_peered":"2023-10-08T16:24:22.284637+0000","last_clean":"2023-10-08T16:24:22.284637+0000","last_became_active":"2023-10-08T16:24:22.275888+0000","last_became_peered":"2023-10-08T16:24:22.275888+0000","last_unstale":"2023-10-08T16:24:22.284637+0000","last_undegraded":"2023-10-08T16:24:22.284637+0000","last_fullsized":"2023-10-08T16:24:22.284637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:20.213695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277280+0000","last_change":"2023-10-08T16:24:22.268139+0000","last_active":"2023-10-08T16:24:22.277280+0000","last_peered":"2023-10-08T16:24:22.277280+0000","last_clean":"2023-10-08T16:24:22.277280+0000","last_became_active":"2023-10-08T16:24:22.267883+0000","last_became_peered":"2023-10-08T16:24:22.267883+0000","last_unstale":"2023-10-08T16:24:22.277280+0000","last_undegraded":"2023-10-08T16:24:22.277280+0000","last_fullsized":"2023-10-08T16:24:22.277280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:03.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269724+0000","last_change":"2023-10-08T16:24:22.264405+0000","last_active":"2023-10-08T16:24:22.269724+0000","last_peered":"2023-10-08T16:24:22.269724+0000","last_clean":"2023-10-08T16:24:22.269724+0000","last_became_active":"2023-10-08T16:24:22.264086+0000","last_became_peered":"2023-10-08T16:24:22.264086+0000","last_unstale":"2023-10-08T16:24:22.269724+0000","last_undegraded":"2023-10-08T16:24:22.269724+0000","last_fullsized":"2023-10-08T16:24:22.269724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:38.493207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279408+0000","last_change":"2023-10-08T16:24:22.277792+0000","last_active":"2023-10-08T16:24:22.279408+0000","last_peered":"2023-10-08T16:24:22.279408+0000","last_clean":"2023-10-08T16:24:22.279408+0000","last_became_active":"2023-10-08T16:24:22.277523+0000","last_became_peered":"2023-10-08T16:24:22.277523+0000","last_unstale":"2023-10-08T16:24:22.279408+0000","last_undegraded":"2023-10-08T16:24:22.279408+0000","last_fullsized":"2023-10-08T16:24:22.279408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:31.347826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276472+0000","last_change":"2023-10-08T16:24:22.267275+0000","last_active":"2023-10-08T16:24:22.276472+0000","last_peered":"2023-10-08T16:24:22.276472+0000","last_clean":"2023-10-08T16:24:22.276472+0000","last_became_active":"2023-10-08T16:24:22.266980+0000","last_became_peered":"2023-10-08T16:24:22.266980+0000","last_unstale":"2023-10-08T16:24:22.276472+0000","last_undegraded":"2023-10-08T16:24:22.276472+0000","last_fullsized":"2023-10-08T16:24:22.276472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:46.525162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273571+0000","last_change":"2023-10-08T16:24:22.268840+0000","last_active":"2023-10-08T16:24:22.273571+0000","last_peered":"2023-10-08T16:24:22.273571+0000","last_clean":"2023-10-08T16:24:22.273571+0000","last_became_active":"2023-10-08T16:24:22.268515+0000","last_became_peered":"2023-10-08T16:24:22.268515+0000","last_unstale":"2023-10-08T16:24:22.273571+0000","last_undegraded":"2023-10-08T16:24:22.273571+0000","last_fullsized":"2023-10-08T16:24:22.273571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286296+0000","last_change":"2023-10-08T16:24:22.281335+0000","last_active":"2023-10-08T16:24:22.286296+0000","last_peered":"2023-10-08T16:24:22.286296+0000","last_clean":"2023-10-08T16:24:22.286296+0000","last_became_active":"2023-10-08T16:24:22.280628+0000","last_became_peered":"2023-10-08T16:24:22.280628+0000","last_unstale":"2023-10-08T16:24:22.286296+0000","last_undegraded":"2023-10-08T16:24:22.286296+0000","last_fullsized":"2023-10-08T16:24:22.286296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:50.269676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274998+0000","last_change":"2023-10-08T16:24:22.269330+0000","last_active":"2023-10-08T16:24:22.274998+0000","last_peered":"2023-10-08T16:24:22.274998+0000","last_clean":"2023-10-08T16:24:22.274998+0000","last_became_active":"2023-10-08T16:24:22.268739+0000","last_became_peered":"2023-10-08T16:24:22.268739+0000","last_unstale":"2023-10-08T16:24:22.274998+0000","last_undegraded":"2023-10-08T16:24:22.274998+0000","last_fullsized":"2023-10-08T16:24:22.274998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:10.064373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273074+0000","last_change":"2023-10-08T16:24:22.270188+0000","last_active":"2023-10-08T16:24:22.273074+0000","last_peered":"2023-10-08T16:24:22.273074+0000","last_clean":"2023-10-08T16:24:22.273074+0000","last_became_active":"2023-10-08T16:24:22.269890+0000","last_became_peered":"2023-10-08T16:24:22.269890+0000","last_unstale":"2023-10-08T16:24:22.273074+0000","last_undegraded":"2023-10-08T16:24:22.273074+0000","last_fullsized":"2023-10-08T16:24:22.273074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:34.696485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275378+0000","last_change":"2023-10-08T16:24:22.271452+0000","last_active":"2023-10-08T16:24:22.275378+0000","last_peered":"2023-10-08T16:24:22.275378+0000","last_clean":"2023-10-08T16:24:22.275378+0000","last_became_active":"2023-10-08T16:24:22.270407+0000","last_became_peered":"2023-10-08T16:24:22.270407+0000","last_unstale":"2023-10-08T16:24:22.275378+0000","last_undegraded":"2023-10-08T16:24:22.275378+0000","last_fullsized":"2023-10-08T16:24:22.275378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:11.469843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285036+0000","last_change":"2023-10-08T16:24:22.275414+0000","last_active":"2023-10-08T16:24:22.285036+0000","last_peered":"2023-10-08T16:24:22.285036+0000","last_clean":"2023-10-08T16:24:22.285036+0000","last_became_active":"2023-10-08T16:24:22.275138+0000","last_became_peered":"2023-10-08T16:24:22.275138+0000","last_unstale":"2023-10-08T16:24:22.285036+0000","last_undegraded":"2023-10-08T16:24:22.285036+0000","last_fullsized":"2023-10-08T16:24:22.285036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:56.116579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277991+0000","last_change":"2023-10-08T16:24:22.275499+0000","last_active":"2023-10-08T16:24:22.277991+0000","last_peered":"2023-10-08T16:24:22.277991+0000","last_clean":"2023-10-08T16:24:22.277991+0000","last_became_active":"2023-10-08T16:24:22.275240+0000","last_became_peered":"2023-10-08T16:24:22.275240+0000","last_unstale":"2023-10-08T16:24:22.277991+0000","last_undegraded":"2023-10-08T16:24:22.277991+0000","last_fullsized":"2023-10-08T16:24:22.277991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276179+0000","last_change":"2023-10-08T16:24:22.268011+0000","last_active":"2023-10-08T16:24:22.276179+0000","last_peered":"2023-10-08T16:24:22.276179+0000","last_clean":"2023-10-08T16:24:22.276179+0000","last_became_active":"2023-10-08T16:24:22.267685+0000","last_became_peered":"2023-10-08T16:24:22.267685+0000","last_unstale":"2023-10-08T16:24:22.276179+0000","last_undegraded":"2023-10-08T16:24:22.276179+0000","last_fullsized":"2023-10-08T16:24:22.276179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.063975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270329+0000","last_change":"2023-10-08T16:24:22.266566+0000","last_active":"2023-10-08T16:24:22.270329+0000","last_peered":"2023-10-08T16:24:22.270329+0000","last_clean":"2023-10-08T16:24:22.270329+0000","last_became_active":"2023-10-08T16:24:22.266154+0000","last_became_peered":"2023-10-08T16:24:22.266154+0000","last_unstale":"2023-10-08T16:24:22.270329+0000","last_undegraded":"2023-10-08T16:24:22.270329+0000","last_fullsized":"2023-10-08T16:24:22.270329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:13.350748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273243+0000","last_change":"2023-10-08T16:24:22.270956+0000","last_active":"2023-10-08T16:24:22.273243+0000","last_peered":"2023-10-08T16:24:22.273243+0000","last_clean":"2023-10-08T16:24:22.273243+0000","last_became_active":"2023-10-08T16:24:22.270612+0000","last_became_peered":"2023-10-08T16:24:22.270612+0000","last_unstale":"2023-10-08T16:24:22.273243+0000","last_undegraded":"2023-10-08T16:24:22.273243+0000","last_fullsized":"2023-10-08T16:24:22.273243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286636+0000","last_change":"2023-10-08T16:24:22.282687+0000","last_active":"2023-10-08T16:24:22.286636+0000","last_peered":"2023-10-08T16:24:22.286636+0000","last_clean":"2023-10-08T16:24:22.286636+0000","last_became_active":"2023-10-08T16:24:22.282416+0000","last_became_peered":"2023-10-08T16:24:22.282416+0000","last_unstale":"2023-10-08T16:24:22.286636+0000","last_undegraded":"2023-10-08T16:24:22.286636+0000","last_fullsized":"2023-10-08T16:24:22.286636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:18.006900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273784+0000","last_change":"2023-10-08T16:24:22.270422+0000","last_active":"2023-10-08T16:24:22.273784+0000","last_peered":"2023-10-08T16:24:22.273784+0000","last_clean":"2023-10-08T16:24:22.273784+0000","last_became_active":"2023-10-08T16:24:22.270165+0000","last_became_peered":"2023-10-08T16:24:22.270165+0000","last_unstale":"2023-10-08T16:24:22.273784+0000","last_undegraded":"2023-10-08T16:24:22.273784+0000","last_fullsized":"2023-10-08T16:24:22.273784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:07.486766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289512+0000","last_change":"2023-10-08T16:24:21.269557+0000","last_active":"2023-10-08T16:24:22.289512+0000","last_peered":"2023-10-08T16:24:22.289512+0000","last_clean":"2023-10-08T16:24:22.289512+0000","last_became_active":"2023-10-08T16:24:21.269263+0000","last_became_peered":"2023-10-08T16:24:21.269263+0000","last_unstale":"2023-10-08T16:24:22.289512+0000","last_undegraded":"2023-10-08T16:24:22.289512+0000","last_fullsized":"2023-10-08T16:24:22.289512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:42:22.448478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288128+0000","last_change":"2023-10-08T16:24:22.282422+0000","last_active":"2023-10-08T16:24:22.288128+0000","last_peered":"2023-10-08T16:24:22.288128+0000","last_clean":"2023-10-08T16:24:22.288128+0000","last_became_active":"2023-10-08T16:24:22.280622+0000","last_became_peered":"2023-10-08T16:24:22.280622+0000","last_unstale":"2023-10-08T16:24:22.288128+0000","last_undegraded":"2023-10-08T16:24:22.288128+0000","last_fullsized":"2023-10-08T16:24:22.288128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291323+0000","last_change":"2023-10-08T16:24:21.271687+0000","last_active":"2023-10-08T16:24:22.291323+0000","last_peered":"2023-10-08T16:24:22.291323+0000","last_clean":"2023-10-08T16:24:22.291323+0000","last_became_active":"2023-10-08T16:24:21.271411+0000","last_became_peered":"2023-10-08T16:24:21.271411+0000","last_unstale":"2023-10-08T16:24:22.291323+0000","last_undegraded":"2023-10-08T16:24:22.291323+0000","last_fullsized":"2023-10-08T16:24:22.291323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:42.094517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285309+0000","last_change":"2023-10-08T16:24:22.274100+0000","last_active":"2023-10-08T16:24:22.285309+0000","last_peered":"2023-10-08T16:24:22.285309+0000","last_clean":"2023-10-08T16:24:22.285309+0000","last_became_active":"2023-10-08T16:24:22.273194+0000","last_became_peered":"2023-10-08T16:24:22.273194+0000","last_unstale":"2023-10-08T16:24:22.285309+0000","last_undegraded":"2023-10-08T16:24:22.285309+0000","last_fullsized":"2023-10-08T16:24:22.285309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:45.645647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288547+0000","last_change":"2023-10-08T16:24:21.276710+0000","last_active":"2023-10-08T16:24:22.288547+0000","last_peered":"2023-10-08T16:24:22.288547+0000","last_clean":"2023-10-08T16:24:22.288547+0000","last_became_active":"2023-10-08T16:24:21.276424+0000","last_became_peered":"2023-10-08T16:24:21.276424+0000","last_unstale":"2023-10-08T16:24:22.288547+0000","last_undegraded":"2023-10-08T16:24:22.288547+0000","last_fullsized":"2023-10-08T16:24:22.288547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:49.830827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268952+0000","last_change":"2023-10-08T16:24:22.266933+0000","last_active":"2023-10-08T16:24:22.268952+0000","last_peered":"2023-10-08T16:24:22.268952+0000","last_clean":"2023-10-08T16:24:22.268952+0000","last_became_active":"2023-10-08T16:24:22.266234+0000","last_became_peered":"2023-10-08T16:24:22.266234+0000","last_unstale":"2023-10-08T16:24:22.268952+0000","last_undegraded":"2023-10-08T16:24:22.268952+0000","last_fullsized":"2023-10-08T16:24:22.268952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:48.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286651+0000","last_change":"2023-10-08T16:24:21.267216+0000","last_active":"2023-10-08T16:24:22.286651+0000","last_peered":"2023-10-08T16:24:22.286651+0000","last_clean":"2023-10-08T16:24:22.286651+0000","last_became_active":"2023-10-08T16:24:21.266898+0000","last_became_peered":"2023-10-08T16:24:21.266898+0000","last_unstale":"2023-10-08T16:24:22.286651+0000","last_undegraded":"2023-10-08T16:24:22.286651+0000","last_fullsized":"2023-10-08T16:24:22.286651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:56.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285851+0000","last_change":"2023-10-08T16:24:22.278368+0000","last_active":"2023-10-08T16:24:22.285851+0000","last_peered":"2023-10-08T16:24:22.285851+0000","last_clean":"2023-10-08T16:24:22.285851+0000","last_became_active":"2023-10-08T16:24:22.277968+0000","last_became_peered":"2023-10-08T16:24:22.277968+0000","last_unstale":"2023-10-08T16:24:22.285851+0000","last_undegraded":"2023-10-08T16:24:22.285851+0000","last_fullsized":"2023-10-08T16:24:22.285851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:28.517572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244052+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276157+0000","last_change":"2023-10-08T16:24:22.267391+0000","last_active":"2023-10-08T16:24:22.276157+0000","last_peered":"2023-10-08T16:24:22.276157+0000","last_clean":"2023-10-08T16:24:22.276157+0000","last_became_active":"2023-10-08T16:24:22.267088+0000","last_became_peered":"2023-10-08T16:24:22.267088+0000","last_unstale":"2023-10-08T16:24:22.276157+0000","last_undegraded":"2023-10-08T16:24:22.276157+0000","last_fullsized":"2023-10-08T16:24:22.276157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:26.983593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286744+0000","last_change":"2023-10-08T16:24:21.275128+0000","last_active":"2023-10-08T16:24:22.286744+0000","last_peered":"2023-10-08T16:24:22.286744+0000","last_clean":"2023-10-08T16:24:22.286744+0000","last_became_active":"2023-10-08T16:24:21.274777+0000","last_became_peered":"2023-10-08T16:24:21.274777+0000","last_unstale":"2023-10-08T16:24:22.286744+0000","last_undegraded":"2023-10-08T16:24:22.286744+0000","last_fullsized":"2023-10-08T16:24:22.286744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:42.367439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257414+0000","last_change":"2023-10-08T16:24:21.268084+0000","last_active":"2023-10-08T16:24:22.257414+0000","last_peered":"2023-10-08T16:24:22.257414+0000","last_clean":"2023-10-08T16:24:22.257414+0000","last_became_active":"2023-10-08T16:24:21.267806+0000","last_became_peered":"2023-10-08T16:24:21.267806+0000","last_unstale":"2023-10-08T16:24:22.257414+0000","last_undegraded":"2023-10-08T16:24:22.257414+0000","last_fullsized":"2023-10-08T16:24:22.257414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:32.960654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276267+0000","last_change":"2023-10-08T16:24:22.266880+0000","last_active":"2023-10-08T16:24:22.276267+0000","last_peered":"2023-10-08T16:24:22.276267+0000","last_clean":"2023-10-08T16:24:22.276267+0000","last_became_active":"2023-10-08T16:24:22.266473+0000","last_became_peered":"2023-10-08T16:24:22.266473+0000","last_unstale":"2023-10-08T16:24:22.276267+0000","last_undegraded":"2023-10-08T16:24:22.276267+0000","last_fullsized":"2023-10-08T16:24:22.276267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:53.937746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244068+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.254209+0000","last_change":"2023-10-08T16:24:21.273603+0000","last_active":"2023-10-08T16:24:22.254209+0000","last_peered":"2023-10-08T16:24:22.254209+0000","last_clean":"2023-10-08T16:24:22.254209+0000","last_became_active":"2023-10-08T16:24:21.273224+0000","last_became_peered":"2023-10-08T16:24:21.273224+0000","last_unstale":"2023-10-08T16:24:22.254209+0000","last_undegraded":"2023-10-08T16:24:22.254209+0000","last_fullsized":"2023-10-08T16:24:22.254209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:49.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276968+0000","last_change":"2023-10-08T16:24:22.273050+0000","last_active":"2023-10-08T16:24:22.276968+0000","last_peered":"2023-10-08T16:24:22.276968+0000","last_clean":"2023-10-08T16:24:22.276968+0000","last_became_active":"2023-10-08T16:24:22.272781+0000","last_became_peered":"2023-10-08T16:24:22.272781+0000","last_unstale":"2023-10-08T16:24:22.276968+0000","last_undegraded":"2023-10-08T16:24:22.276968+0000","last_fullsized":"2023-10-08T16:24:22.276968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258749+0000","last_change":"2023-10-08T16:24:21.269008+0000","last_active":"2023-10-08T16:24:22.258749+0000","last_peered":"2023-10-08T16:24:22.258749+0000","last_clean":"2023-10-08T16:24:22.258749+0000","last_became_active":"2023-10-08T16:24:21.268649+0000","last_became_peered":"2023-10-08T16:24:21.268649+0000","last_unstale":"2023-10-08T16:24:22.258749+0000","last_undegraded":"2023-10-08T16:24:22.258749+0000","last_fullsized":"2023-10-08T16:24:22.258749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:44.638564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284345+0000","last_change":"2023-10-08T16:24:22.276093+0000","last_active":"2023-10-08T16:24:22.284345+0000","last_peered":"2023-10-08T16:24:22.284345+0000","last_clean":"2023-10-08T16:24:22.284345+0000","last_became_active":"2023-10-08T16:24:22.275832+0000","last_became_peered":"2023-10-08T16:24:22.275832+0000","last_unstale":"2023-10-08T16:24:22.284345+0000","last_undegraded":"2023-10-08T16:24:22.284345+0000","last_fullsized":"2023-10-08T16:24:22.284345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:31.162690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287850+0000","last_change":"2023-10-08T16:24:21.272950+0000","last_active":"2023-10-08T16:24:22.287850+0000","last_peered":"2023-10-08T16:24:22.287850+0000","last_clean":"2023-10-08T16:24:22.287850+0000","last_became_active":"2023-10-08T16:24:21.271679+0000","last_became_peered":"2023-10-08T16:24:21.271679+0000","last_unstale":"2023-10-08T16:24:22.287850+0000","last_undegraded":"2023-10-08T16:24:22.287850+0000","last_fullsized":"2023-10-08T16:24:22.287850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:06.461374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277014+0000","last_change":"2023-10-08T16:24:22.275924+0000","last_active":"2023-10-08T16:24:22.277014+0000","last_peered":"2023-10-08T16:24:22.277014+0000","last_clean":"2023-10-08T16:24:22.277014+0000","last_became_active":"2023-10-08T16:24:22.274052+0000","last_became_peered":"2023-10-08T16:24:22.274052+0000","last_unstale":"2023-10-08T16:24:22.277014+0000","last_undegraded":"2023-10-08T16:24:22.277014+0000","last_fullsized":"2023-10-08T16:24:22.277014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:17.163656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.244581+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275422+0000","last_change":"2023-10-08T16:24:22.271444+0000","last_active":"2023-10-08T16:24:22.275422+0000","last_peered":"2023-10-08T16:24:22.275422+0000","last_clean":"2023-10-08T16:24:22.275422+0000","last_became_active":"2023-10-08T16:24:22.270764+0000","last_became_peered":"2023-10-08T16:24:22.270764+0000","last_unstale":"2023-10-08T16:24:22.275422+0000","last_undegraded":"2023-10-08T16:24:22.275422+0000","last_fullsized":"2023-10-08T16:24:22.275422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.468457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293566+0000","last_change":"2023-10-08T16:24:21.269602+0000","last_active":"2023-10-08T16:24:22.293566+0000","last_peered":"2023-10-08T16:24:22.293566+0000","last_clean":"2023-10-08T16:24:22.293566+0000","last_became_active":"2023-10-08T16:24:21.269331+0000","last_became_peered":"2023-10-08T16:24:21.269331+0000","last_unstale":"2023-10-08T16:24:22.293566+0000","last_undegraded":"2023-10-08T16:24:22.293566+0000","last_fullsized":"2023-10-08T16:24:22.293566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.991250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269760+0000","last_change":"2023-10-08T16:24:22.264889+0000","last_active":"2023-10-08T16:24:22.269760+0000","last_peered":"2023-10-08T16:24:22.269760+0000","last_clean":"2023-10-08T16:24:22.269760+0000","last_became_active":"2023-10-08T16:24:22.264605+0000","last_became_peered":"2023-10-08T16:24:22.264605+0000","last_unstale":"2023-10-08T16:24:22.269760+0000","last_undegraded":"2023-10-08T16:24:22.269760+0000","last_fullsized":"2023-10-08T16:24:22.269760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:30:46.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253195+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:24:21.240807+0000","last_change":"2023-10-08T16:24:21.240807+0000","last_active":"2023-10-08T16:24:21.240807+0000","last_peered":"2023-10-08T16:24:21.240807+0000","last_clean":"2023-10-08T16:24:21.240807+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:21.240807+0000","last_undegraded":"2023-10-08T16:24:21.240807+0000","last_fullsized":"2023-10-08T16:24:21.240807+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257535+0000","last_change":"2023-10-08T16:24:21.268698+0000","last_active":"2023-10-08T16:24:22.257535+0000","last_peered":"2023-10-08T16:24:22.257535+0000","last_clean":"2023-10-08T16:24:22.257535+0000","last_became_active":"2023-10-08T16:24:21.268390+0000","last_became_peered":"2023-10-08T16:24:21.268390+0000","last_unstale":"2023-10-08T16:24:22.257535+0000","last_undegraded":"2023-10-08T16:24:22.257535+0000","last_fullsized":"2023-10-08T16:24:22.257535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:14.687838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276317+0000","last_change":"2023-10-08T16:24:22.270899+0000","last_active":"2023-10-08T16:24:22.276317+0000","last_peered":"2023-10-08T16:24:22.276317+0000","last_clean":"2023-10-08T16:24:22.276317+0000","last_became_active":"2023-10-08T16:24:22.270208+0000","last_became_peered":"2023-10-08T16:24:22.270208+0000","last_unstale":"2023-10-08T16:24:22.276317+0000","last_undegraded":"2023-10-08T16:24:22.276317+0000","last_fullsized":"2023-10-08T16:24:22.276317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:10.548785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287746+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.287746+0000","last_peered":"2023-10-08T16:24:22.287746+0000","last_clean":"2023-10-08T16:24:22.287746+0000","last_became_active":"2023-10-08T16:24:21.269334+0000","last_became_peered":"2023-10-08T16:24:21.269334+0000","last_unstale":"2023-10-08T16:24:22.287746+0000","last_undegraded":"2023-10-08T16:24:22.287746+0000","last_fullsized":"2023-10-08T16:24:22.287746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:46.119976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269809+0000","last_change":"2023-10-08T16:24:22.266878+0000","last_active":"2023-10-08T16:24:22.269809+0000","last_peered":"2023-10-08T16:24:22.269809+0000","last_clean":"2023-10-08T16:24:22.269809+0000","last_became_active":"2023-10-08T16:24:22.266101+0000","last_became_peered":"2023-10-08T16:24:22.266101+0000","last_unstale":"2023-10-08T16:24:22.269809+0000","last_undegraded":"2023-10-08T16:24:22.269809+0000","last_fullsized":"2023-10-08T16:24:22.269809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.883482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293561+0000","last_change":"2023-10-08T16:24:21.261619+0000","last_active":"2023-10-08T16:24:22.293561+0000","last_peered":"2023-10-08T16:24:22.293561+0000","last_clean":"2023-10-08T16:24:22.293561+0000","last_became_active":"2023-10-08T16:24:21.261364+0000","last_became_peered":"2023-10-08T16:24:21.261364+0000","last_unstale":"2023-10-08T16:24:22.293561+0000","last_undegraded":"2023-10-08T16:24:22.293561+0000","last_fullsized":"2023-10-08T16:24:22.293561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:55.109496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.267650+0000","last_change":"2023-10-08T16:24:22.265540+0000","last_active":"2023-10-08T16:24:22.267650+0000","last_peered":"2023-10-08T16:24:22.267650+0000","last_clean":"2023-10-08T16:24:22.267650+0000","last_became_active":"2023-10-08T16:24:22.265265+0000","last_became_peered":"2023-10-08T16:24:22.265265+0000","last_unstale":"2023-10-08T16:24:22.267650+0000","last_undegraded":"2023-10-08T16:24:22.267650+0000","last_fullsized":"2023-10-08T16:24:22.267650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.566331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289188+0000","last_change":"2023-10-08T16:24:21.268382+0000","last_active":"2023-10-08T16:24:22.289188+0000","last_peered":"2023-10-08T16:24:22.289188+0000","last_clean":"2023-10-08T16:24:22.289188+0000","last_became_active":"2023-10-08T16:24:21.268141+0000","last_became_peered":"2023-10-08T16:24:21.268141+0000","last_unstale":"2023-10-08T16:24:22.289188+0000","last_undegraded":"2023-10-08T16:24:22.289188+0000","last_fullsized":"2023-10-08T16:24:22.289188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:12.547947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276490+0000","last_change":"2023-10-08T16:24:22.270441+0000","last_active":"2023-10-08T16:24:22.276490+0000","last_peered":"2023-10-08T16:24:22.276490+0000","last_clean":"2023-10-08T16:24:22.276490+0000","last_became_active":"2023-10-08T16:24:22.270142+0000","last_became_peered":"2023-10-08T16:24:22.270142+0000","last_unstale":"2023-10-08T16:24:22.276490+0000","last_undegraded":"2023-10-08T16:24:22.276490+0000","last_fullsized":"2023-10-08T16:24:22.276490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:41.764767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286673+0000","last_change":"2023-10-08T16:24:21.267941+0000","last_active":"2023-10-08T16:24:22.286673+0000","last_peered":"2023-10-08T16:24:22.286673+0000","last_clean":"2023-10-08T16:24:22.286673+0000","last_became_active":"2023-10-08T16:24:21.267613+0000","last_became_peered":"2023-10-08T16:24:21.267613+0000","last_unstale":"2023-10-08T16:24:22.286673+0000","last_undegraded":"2023-10-08T16:24:22.286673+0000","last_fullsized":"2023-10-08T16:24:22.286673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:47.872492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276994+0000","last_change":"2023-10-08T16:24:22.274135+0000","last_active":"2023-10-08T16:24:22.276994+0000","last_peered":"2023-10-08T16:24:22.276994+0000","last_clean":"2023-10-08T16:24:22.276994+0000","last_became_active":"2023-10-08T16:24:22.273837+0000","last_became_peered":"2023-10-08T16:24:22.273837+0000","last_unstale":"2023-10-08T16:24:22.276994+0000","last_undegraded":"2023-10-08T16:24:22.276994+0000","last_fullsized":"2023-10-08T16:24:22.276994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:51.668749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257341+0000","last_change":"2023-10-08T16:24:21.276024+0000","last_active":"2023-10-08T16:24:22.257341+0000","last_peered":"2023-10-08T16:24:22.257341+0000","last_clean":"2023-10-08T16:24:22.257341+0000","last_became_active":"2023-10-08T16:24:21.275739+0000","last_became_peered":"2023-10-08T16:24:21.275739+0000","last_unstale":"2023-10-08T16:24:22.257341+0000","last_undegraded":"2023-10-08T16:24:22.257341+0000","last_fullsized":"2023-10-08T16:24:22.257341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:21.350486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275441+0000","last_change":"2023-10-08T16:24:22.271976+0000","last_active":"2023-10-08T16:24:22.275441+0000","last_peered":"2023-10-08T16:24:22.275441+0000","last_clean":"2023-10-08T16:24:22.275441+0000","last_became_active":"2023-10-08T16:24:22.271425+0000","last_became_peered":"2023-10-08T16:24:22.271425+0000","last_unstale":"2023-10-08T16:24:22.275441+0000","last_undegraded":"2023-10-08T16:24:22.275441+0000","last_fullsized":"2023-10-08T16:24:22.275441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:47.127059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291574+0000","last_change":"2023-10-08T16:24:21.267852+0000","last_active":"2023-10-08T16:24:22.291574+0000","last_peered":"2023-10-08T16:24:22.291574+0000","last_clean":"2023-10-08T16:24:22.291574+0000","last_became_active":"2023-10-08T16:24:21.267533+0000","last_became_peered":"2023-10-08T16:24:21.267533+0000","last_unstale":"2023-10-08T16:24:22.291574+0000","last_undegraded":"2023-10-08T16:24:22.291574+0000","last_fullsized":"2023-10-08T16:24:22.291574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284930+0000","last_change":"2023-10-08T16:24:22.274776+0000","last_active":"2023-10-08T16:24:22.284930+0000","last_peered":"2023-10-08T16:24:22.284930+0000","last_clean":"2023-10-08T16:24:22.284930+0000","last_became_active":"2023-10-08T16:24:22.274530+0000","last_became_peered":"2023-10-08T16:24:22.274530+0000","last_unstale":"2023-10-08T16:24:22.284930+0000","last_undegraded":"2023-10-08T16:24:22.284930+0000","last_fullsized":"2023-10-08T16:24:22.284930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.101600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256460+0000","last_change":"2023-10-08T16:24:21.263757+0000","last_active":"2023-10-08T16:24:22.256460+0000","last_peered":"2023-10-08T16:24:22.256460+0000","last_clean":"2023-10-08T16:24:22.256460+0000","last_became_active":"2023-10-08T16:24:21.263272+0000","last_became_peered":"2023-10-08T16:24:21.263272+0000","last_unstale":"2023-10-08T16:24:22.256460+0000","last_undegraded":"2023-10-08T16:24:22.256460+0000","last_fullsized":"2023-10-08T16:24:22.256460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:24.676343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270553+0000","last_change":"2023-10-08T16:24:22.268087+0000","last_active":"2023-10-08T16:24:22.270553+0000","last_peered":"2023-10-08T16:24:22.270553+0000","last_clean":"2023-10-08T16:24:22.270553+0000","last_became_active":"2023-10-08T16:24:22.267829+0000","last_became_peered":"2023-10-08T16:24:22.267829+0000","last_unstale":"2023-10-08T16:24:22.270553+0000","last_undegraded":"2023-10-08T16:24:22.270553+0000","last_fullsized":"2023-10-08T16:24:22.270553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:03.698744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258364+0000","last_change":"2023-10-08T16:24:21.263139+0000","last_active":"2023-10-08T16:24:22.258364+0000","last_peered":"2023-10-08T16:24:22.258364+0000","last_clean":"2023-10-08T16:24:22.258364+0000","last_became_active":"2023-10-08T16:24:21.262842+0000","last_became_peered":"2023-10-08T16:24:21.262842+0000","last_unstale":"2023-10-08T16:24:22.258364+0000","last_undegraded":"2023-10-08T16:24:22.258364+0000","last_fullsized":"2023-10-08T16:24:22.258364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:55.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.278195+0000","last_change":"2023-10-08T16:24:22.277258+0000","last_active":"2023-10-08T16:24:22.278195+0000","last_peered":"2023-10-08T16:24:22.278195+0000","last_clean":"2023-10-08T16:24:22.278195+0000","last_became_active":"2023-10-08T16:24:22.276962+0000","last_became_peered":"2023-10-08T16:24:22.276962+0000","last_unstale":"2023-10-08T16:24:22.278195+0000","last_undegraded":"2023-10-08T16:24:22.278195+0000","last_fullsized":"2023-10-08T16:24:22.278195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:53.296385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291666+0000","last_change":"2023-10-08T16:24:21.269755+0000","last_active":"2023-10-08T16:24:22.291666+0000","last_peered":"2023-10-08T16:24:22.291666+0000","last_clean":"2023-10-08T16:24:22.291666+0000","last_became_active":"2023-10-08T16:24:21.269510+0000","last_became_peered":"2023-10-08T16:24:21.269510+0000","last_unstale":"2023-10-08T16:24:22.291666+0000","last_undegraded":"2023-10-08T16:24:22.291666+0000","last_fullsized":"2023-10-08T16:24:22.291666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:39.883010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276996+0000","last_change":"2023-10-08T16:24:22.275498+0000","last_active":"2023-10-08T16:24:22.276996+0000","last_peered":"2023-10-08T16:24:22.276996+0000","last_clean":"2023-10-08T16:24:22.276996+0000","last_became_active":"2023-10-08T16:24:22.275126+0000","last_became_peered":"2023-10-08T16:24:22.275126+0000","last_unstale":"2023-10-08T16:24:22.276996+0000","last_undegraded":"2023-10-08T16:24:22.276996+0000","last_fullsized":"2023-10-08T16:24:22.276996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:54.012780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257826+0000","last_change":"2023-10-08T16:24:21.272140+0000","last_active":"2023-10-08T16:24:22.257826+0000","last_peered":"2023-10-08T16:24:22.257826+0000","last_clean":"2023-10-08T16:24:22.257826+0000","last_became_active":"2023-10-08T16:24:21.271855+0000","last_became_peered":"2023-10-08T16:24:21.271855+0000","last_unstale":"2023-10-08T16:24:22.257826+0000","last_undegraded":"2023-10-08T16:24:22.257826+0000","last_fullsized":"2023-10-08T16:24:22.257826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:43.513877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284324+0000","last_change":"2023-10-08T16:24:22.275692+0000","last_active":"2023-10-08T16:24:22.284324+0000","last_peered":"2023-10-08T16:24:22.284324+0000","last_clean":"2023-10-08T16:24:22.284324+0000","last_became_active":"2023-10-08T16:24:22.275415+0000","last_became_peered":"2023-10-08T16:24:22.275415+0000","last_unstale":"2023-10-08T16:24:22.284324+0000","last_undegraded":"2023-10-08T16:24:22.284324+0000","last_fullsized":"2023-10-08T16:24:22.284324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:19.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253193+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268257+0000","last_change":"2023-10-08T16:24:22.266562+0000","last_active":"2023-10-08T16:24:22.268257+0000","last_peered":"2023-10-08T16:24:22.268257+0000","last_clean":"2023-10-08T16:24:22.268257+0000","last_became_active":"2023-10-08T16:24:22.265904+0000","last_became_peered":"2023-10-08T16:24:22.265904+0000","last_unstale":"2023-10-08T16:24:22.268257+0000","last_undegraded":"2023-10-08T16:24:22.268257+0000","last_fullsized":"2023-10-08T16:24:22.268257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:42.482305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.259013+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.259013+0000","last_peered":"2023-10-08T16:24:22.259013+0000","last_clean":"2023-10-08T16:24:22.259013+0000","last_became_active":"2023-10-08T16:24:21.269338+0000","last_became_peered":"2023-10-08T16:24:21.269338+0000","last_unstale":"2023-10-08T16:24:22.259013+0000","last_undegraded":"2023-10-08T16:24:22.259013+0000","last_fullsized":"2023-10-08T16:24:22.259013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:51.308472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276204+0000","last_change":"2023-10-08T16:24:22.264942+0000","last_active":"2023-10-08T16:24:22.276204+0000","last_peered":"2023-10-08T16:24:22.276204+0000","last_clean":"2023-10-08T16:24:22.276204+0000","last_became_active":"2023-10-08T16:24:22.264659+0000","last_became_peered":"2023-10-08T16:24:22.264659+0000","last_unstale":"2023-10-08T16:24:22.276204+0000","last_undegraded":"2023-10-08T16:24:22.276204+0000","last_fullsized":"2023-10-08T16:24:22.276204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:28.010725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256572+0000","last_change":"2023-10-08T16:24:21.266315+0000","last_active":"2023-10-08T16:24:22.256572+0000","last_peered":"2023-10-08T16:24:22.256572+0000","last_clean":"2023-10-08T16:24:22.256572+0000","last_became_active":"2023-10-08T16:24:21.266015+0000","last_became_peered":"2023-10-08T16:24:21.266015+0000","last_unstale":"2023-10-08T16:24:22.256572+0000","last_undegraded":"2023-10-08T16:24:22.256572+0000","last_fullsized":"2023-10-08T16:24:22.256572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:43.409719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276286+0000","last_change":"2023-10-08T16:24:22.270477+0000","last_active":"2023-10-08T16:24:22.276286+0000","last_peered":"2023-10-08T16:24:22.276286+0000","last_clean":"2023-10-08T16:24:22.276286+0000","last_became_active":"2023-10-08T16:24:22.270161+0000","last_became_peered":"2023-10-08T16:24:22.270161+0000","last_unstale":"2023-10-08T16:24:22.276286+0000","last_undegraded":"2023-10-08T16:24:22.276286+0000","last_fullsized":"2023-10-08T16:24:22.276286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:55.893986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.245706+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277772+0000","last_change":"2023-10-08T16:24:22.271832+0000","last_active":"2023-10-08T16:24:22.277772+0000","last_peered":"2023-10-08T16:24:22.277772+0000","last_clean":"2023-10-08T16:24:22.277772+0000","last_became_active":"2023-10-08T16:24:22.271501+0000","last_became_peered":"2023-10-08T16:24:22.271501+0000","last_unstale":"2023-10-08T16:24:22.277772+0000","last_undegraded":"2023-10-08T16:24:22.277772+0000","last_fullsized":"2023-10-08T16:24:22.277772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:01.112062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256347+0000","last_change":"2023-10-08T16:24:21.274862+0000","last_active":"2023-10-08T16:24:22.256347+0000","last_peered":"2023-10-08T16:24:22.256347+0000","last_clean":"2023-10-08T16:24:22.256347+0000","last_became_active":"2023-10-08T16:24:21.274569+0000","last_became_peered":"2023-10-08T16:24:21.274569+0000","last_unstale":"2023-10-08T16:24:22.256347+0000","last_undegraded":"2023-10-08T16:24:22.256347+0000","last_fullsized":"2023-10-08T16:24:22.256347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.347897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276246+0000","last_change":"2023-10-08T16:24:22.266748+0000","last_active":"2023-10-08T16:24:22.276246+0000","last_peered":"2023-10-08T16:24:22.276246+0000","last_clean":"2023-10-08T16:24:22.276246+0000","last_became_active":"2023-10-08T16:24:22.266033+0000","last_became_peered":"2023-10-08T16:24:22.266033+0000","last_unstale":"2023-10-08T16:24:22.276246+0000","last_undegraded":"2023-10-08T16:24:22.276246+0000","last_fullsized":"2023-10-08T16:24:22.276246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:59.306851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258344+0000","last_change":"2023-10-08T16:24:21.262446+0000","last_active":"2023-10-08T16:24:22.258344+0000","last_peered":"2023-10-08T16:24:22.258344+0000","last_clean":"2023-10-08T16:24:22.258344+0000","last_became_active":"2023-10-08T16:24:21.262129+0000","last_became_peered":"2023-10-08T16:24:21.262129+0000","last_unstale":"2023-10-08T16:24:22.258344+0000","last_undegraded":"2023-10-08T16:24:22.258344+0000","last_fullsized":"2023-10-08T16:24:22.258344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:16.999817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285817+0000","last_change":"2023-10-08T16:24:22.276248+0000","last_active":"2023-10-08T16:24:22.285817+0000","last_peered":"2023-10-08T16:24:22.285817+0000","last_clean":"2023-10-08T16:24:22.285817+0000","last_became_active":"2023-10-08T16:24:22.275930+0000","last_became_peered":"2023-10-08T16:24:22.275930+0000","last_unstale":"2023-10-08T16:24:22.285817+0000","last_undegraded":"2023-10-08T16:24:22.285817+0000","last_fullsized":"2023-10-08T16:24:22.285817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:24:20.233724+0000","last_change":"2023-10-08T16:24:20.253049+0000","last_active":"2023-10-08T16:24:20.233724+0000","last_peered":"2023-10-08T16:24:20.233724+0000","last_clean":"2023-10-08T16:24:20.233724+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:24:20.233724+0000","last_undegraded":"2023-10-08T16:24:20.233724+0000","last_fullsized":"2023-10-08T16:24:20.233724+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'161","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.253357+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:24:22.253357+0000","last_peered":"2023-10-08T16:24:22.253357+0000","last_clean":"2023-10-08T16:24:22.253357+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:24:22.253357+0000","last_undegraded":"2023-10-08T16:24:22.253357+0000","last_fullsized":"2023-10-08T16:24:22.253357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":110,"acting":110,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307072,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064768,"statfs":{"total":96636764160,"available":96322322432,"internally_reserved":0,"allocated":1630208,"data_stored":1084462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.48699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":1.103},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":1.089},"last":0.441}]},{"osd":1,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.63900000000000001,"5min":0.49299999999999999,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.70299999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":0.997,"15min":1.1160000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98099999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97599999999999998,"5min":1.032,"15min":1.1000000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":1.006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.61699999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":1.234},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.437},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.3919999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.44900000000000001,"5min":0.434,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.3680000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70799999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.4319999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0409999999999999,"15min":1.323},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48099999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.448},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306448,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065392,"statfs":{"total":96636764160,"available":96322961408,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.96399999999999997,"15min":1.125},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.58499999999999996,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.93799999999999994}]},{"osd":1,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.55700000000000005,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":1.365},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.54200000000000004,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":1.0549999999999999},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.72099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.552},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.68500000000000005,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.94299999999999995,"5min":1.034,"15min":1.4570000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0149999999999999,"15min":1.069},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.619},"last":0.97799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.85499999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":1.272,"15min":1.272},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069448,"statfs":{"total":96636764160,"available":96327114752,"internally_reserved":0,"allocated":1032192,"data_stored":494024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.873,"15min":0.873},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.472},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.64500000000000002,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.373},"last":0.745},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.81999999999999995,"15min":0.79800000000000004},"min":{"1min":0.65900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0680000000000001,"5min":1.2230000000000001,"15min":1.375},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.276},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.80600000000000005},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.107,"15min":1.224},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.429},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81399999999999995},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.52200000000000002},"max":{"1min":1.0840000000000001,"5min":1.2909999999999999,"15min":1.391},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99299999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":0.95899999999999996,"5min":1.0960000000000001,"15min":1.514},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1638400,"data_stored":1086392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.748,"5min":1.1339999999999999,"15min":1.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.442,"5min":0.374,"15min":0.36199999999999999},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":1.679},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":1.093,"15min":1.5569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.72599999999999998,"5min":0.878,"15min":1.371},"last":0.435},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.54700000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":1.21,"15min":1.2470000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.46400000000000002},"max":{"1min":1.054,"5min":1.1899999999999999,"15min":1.325},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81799999999999995,"15min":0.79900000000000004},"min":{"1min":0.65900000000000003,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.083,"5min":1.1439999999999999,"15min":1.153},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57099999999999995},"max":{"1min":1.0720000000000001,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.52900000000000003},"max":{"1min":1.149,"5min":1.1950000000000001,"15min":1.288},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.212,"15min":1.262},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.624,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.163,"5min":1.202,"15min":1.4079999999999999},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67300000000000004,"5min":1.046,"15min":1.046},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.747,"5min":1.1160000000000001,"15min":1.448},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.056,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80900000000000005,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":1.321,"15min":1.3959999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82499999999999996,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0980000000000001,"5min":1.4410000000000001,"15min":1.734},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.272,"15min":1.655},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.83899999999999997},"last":0.38},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.90200000000000002},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.41599999999999998,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.47299999999999998,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.55600000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.77900000000000003,"5min":1,"15min":1},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.50700000000000001,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":1.04,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.51100000000000001},"max":{"1min":0.95299999999999996,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.66200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.3200000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.64500000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.397},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.153,"15min":1.306},"last":0.749},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.63900000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.321},"last":0.85399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298256,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073584,"statfs":{"total":96636764160,"available":96331350016,"internally_reserved":0,"allocated":991232,"data_stored":473452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.0069999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.62,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.997,"5min":1.012,"15min":1.012},"last":0.628}]},{"osd":1,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.379},"max":{"1min":1.0640000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.60999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.109,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.753},"min":{"1min":0.64300000000000002,"5min":0.47999999999999998,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.216},"last":0.91100000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.72599999999999998,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1479999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0980000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.44400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0149999999999999,"5min":1.47,"15min":1.47},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67200000000000004,"15min":0.64700000000000002},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":1.0409999999999999,"5min":2.661,"15min":2.661},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0860000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.93200000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.117},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.94699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310588,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061252,"statfs":{"total":96636764160,"available":96318722048,"internally_reserved":0,"allocated":1036288,"data_stored":494558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.754,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92900000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0169999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.58099999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":1.05,"15min":1.05},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.121},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.59499999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90800000000000003,"5min":4.931,"15min":4.931},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98099999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.70299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.63900000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":2.024,"15min":2.024},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.436},"max":{"1min":1.0660000000000001,"5min":2.157,"15min":2.157},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":0.94199999999999995,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:24:27.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-10-08T16:24:27.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.244052+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.657 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.244068+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.244581+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:24:27.658 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.253195+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:17:43.310711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:24:21.240807+0000', 'last_change': '2023-10-08T16:24:21.240807+0000', 'last_active': '2023-10-08T16:24:21.240807+0000', 'last_peered': '2023-10-08T16:24:21.240807+0000', 'last_clean': '2023-10-08T16:24:21.240807+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:21.240807+0000', 'last_undegraded': '2023-10-08T16:24:21.240807+0000', 'last_fullsized': '2023-10-08T16:24:21.240807+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:21.240807+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.253193+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.245706+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:47:33.689402+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-08T16:24:27.659 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:24:20.233724+0000', 'last_change': '2023-10-08T16:24:20.253049+0000', 'last_active': '2023-10-08T16:24:20.233724+0000', 'last_peered': '2023-10-08T16:24:20.233724+0000', 'last_clean': '2023-10-08T16:24:20.233724+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:24:20.233724+0000', 'last_undegraded': '2023-10-08T16:24:20.233724+0000', 'last_fullsized': '2023-10-08T16:24:20.233724+0000', 'mapping_epoch': 82, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 82, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'last_clean_scrub_stamp': '2023-10-08T16:24:20.233724+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:27:07.503670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T16:24:27.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:24:27.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.875+0000 7fd726d9d700 1 Processor -- start 2023-10-08T16:24:27.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.875+0000 7fd726d9d700 1 -- start start 2023-10-08T16:24:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd726d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd726d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7200cccb0 0x7fd72006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd726d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd72006b790 con 0x7fd7200c7930 2023-10-08T16:24:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd726d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72006ab80 con 0x7fd7200cccb0 2023-10-08T16:24:27.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd726d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72006ae60 con 0x7fd7200cc840 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.876+0000 7fd72559a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:34640/0 (socket says 172.21.15.12:34640) 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 -- 172.21.15.12:0/2002806437 learned_addr learned my addr 172.21.15.12:0/2002806437 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72659c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7200cccb0 0x7fd72006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 -- 172.21.15.12:0/2002806437 >> v2:172.21.15.29:3300/0 conn(0x7fd7200cccb0 msgr2=0x7fd72006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 --2- 172.21.15.12:0/2002806437 >> v2:172.21.15.29:3300/0 conn(0x7fd7200cccb0 0x7fd72006de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 -- 172.21.15.12:0/2002806437 >> v1:172.21.15.29:6789/0 conn(0x7fd7200c7930 legacy=0x7fd72006a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 -- 172.21.15.12:0/2002806437 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72006b140 con 0x7fd7200cc840 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.877+0000 7fd72559a700 1 --2- 172.21.15.12:0/2002806437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7100099b0 tx=0x7fd710009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72089720dbd34fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd724d99700 1 -- 172.21.15.12:0/2002806437 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd710009ea0 con 0x7fd7200cc840 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd724d99700 1 -- 172.21.15.12:0/2002806437 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71000b860 con 0x7fd7200cc840 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd724d99700 1 -- 172.21.15.12:0/2002806437 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71000bc00 con 0x7fd7200cc840 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 -- 172.21.15.12:0/2002806437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 msgr2=0x7fd720155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 --2- 172.21.15.12:0/2002806437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd7100099b0 tx=0x7fd710009250 comp rx=0 tx=0).stop 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 -- 172.21.15.12:0/2002806437 shutdown_connections 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 --2- 172.21.15.12:0/2002806437 >> v2:172.21.15.29:3300/0 conn(0x7fd7200cccb0 0x7fd72006de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 --2- 172.21.15.12:0/2002806437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200cc840 0x7fd720155890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 -- 172.21.15.12:0/2002806437 >> 172.21.15.12:0/2002806437 conn(0x7fd72006d110 msgr2=0x7fd7200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 -- 172.21.15.12:0/2002806437 shutdown_connections 2023-10-08T16:24:27.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.878+0000 7fd726d9d700 1 -- 172.21.15.12:0/2002806437 wait complete. 2023-10-08T16:24:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.880+0000 7fd726d9d700 1 Processor -- start 2023-10-08T16:24:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.880+0000 7fd726d9d700 1 -- start start 2023-10-08T16:24:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200c7930 0x7fd7200af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7200cc840 0x7fd72014ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72016cf30 con 0x7fd7200cccb0 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd72016c970 con 0x7fd7200cc840 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd726d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd72016cc50 con 0x7fd7200c7930 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd72659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd72659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44350/0 (socket says 172.21.15.12:44350) 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd72659c700 1 -- 172.21.15.12:0/1218951008 learned_addr learned my addr 172.21.15.12:0/1218951008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd725d9b700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200c7930 0x7fd7200af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.881+0000 7fd72559a700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7200cc840 0x7fd72014ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 -- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200c7930 msgr2=0x7fd7200af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200c7930 0x7fd7200af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 -- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7200cc840 msgr2=0x7fd72014ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7200cc840 0x7fd72014ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 -- 172.21.15.12:0/1218951008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100094f0 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd72659c700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd718009ec0 tx=0x7fd71800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71800cb70 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71800f040 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd718014480 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7200af070 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.882+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7200afdb0 con 0x7fd7200cccb0 2023-10-08T16:24:27.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.884+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7200aeed0 con 0x7fd7200cccb0 2023-10-08T16:24:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.884+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7180147f0 con 0x7fd7200cccb0 2023-10-08T16:24:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.885+0000 7fd715ffb700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:27.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.885+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fd718085360 con 0x7fd7200cccb0 2023-10-08T16:24:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.885+0000 7fd725d9b700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:27.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.886+0000 7fd725d9b700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 0x7fd7040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd71c003950 tx=0x7fd71c007ec0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:27.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:27.889+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7200aeed0 con 0x7fd7200cccb0 2023-10-08T16:24:28.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.173+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd7200af590 con 0x7fd7200cccb0 2023-10-08T16:24:28.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.174+0000 7fd715ffb700 1 -- 172.21.15.12:0/1218951008 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1177 (secure 0 0 0) 0x7fd7200af590 con 0x7fd7200cccb0 2023-10-08T16:24:28.175 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:28.175 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":932,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":85,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"unknown","count":9},{"state_name":"creating+peering","count":7}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":591138,"bytes_used":2495107072,"bytes_avail":770599006208,"bytes_total":773094113280,"unknown_pgs_ratio":0.092783503234386444,"inactive_pgs_ratio":0.072164945304393768,"write_bytes_sec":1871,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":34,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":6282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T16:23:30.467427+0000","services":{}},"progress_events":{}} 2023-10-08T16:24:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 msgr2=0x7fd7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 0x7fd7040693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd71c003950 tx=0x7fd71c007ec0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 msgr2=0x7fd72016c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fd718009ec0 tx=0x7fd71800b040 comp rx=0 tx=0).stop 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 shutdown_connections 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd704066f30 0x7fd7040693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7200cccb0 0x7fd72016c020 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7200c7930 0x7fd7200af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 --2- 172.21.15.12:0/1218951008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7200cc840 0x7fd72014ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 >> 172.21.15.12:0/1218951008 conn(0x7fd72006d110 msgr2=0x7fd7200c1ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 shutdown_connections 2023-10-08T16:24:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.176+0000 7fd726d9d700 1 -- 172.21.15.12:0/1218951008 wait complete. 2023-10-08T16:24:28.194 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:24:28.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:24:28.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.382+0000 7f3d7ffff700 1 Processor -- start 2023-10-08T16:24:28.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.382+0000 7f3d7ffff700 1 -- start start 2023-10-08T16:24:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d8015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d8006aaa0 0x7f3d800c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d8015ae70 con 0x7f3d8013fb20 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d8006af60 con 0x7f3d8006aaa0 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8006b240 con 0x7f3d8013fef0 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d8006aaa0 0x7f3d800c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d8006aaa0 0x7f3d800c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44358/0 (socket says 172.21.15.12:44358) 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7f7fe700 1 -- 172.21.15.12:0/609019172 learned_addr learned my addr 172.21.15.12:0/609019172 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7f7fe700 1 -- 172.21.15.12:0/609019172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 msgr2=0x7f3d8015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.384+0000 7f3d7e7fc700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d8015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7f7fe700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d8015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7f7fe700 1 -- 172.21.15.12:0/609019172 >> v1:172.21.15.29:6789/0 conn(0x7f3d8013fb20 legacy=0x7f3d800c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7f7fe700 1 -- 172.21.15.12:0/609019172 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d8006b520 con 0x7f3d8006aaa0 2023-10-08T16:24:28.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7e7fc700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d8015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7f7fe700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8006aaa0 0x7f3d800c9d00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009f20 tx=0x7f3d78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802f8152dceae860 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:28.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7dffb700 1 -- 172.21.15.12:0/609019172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7800e070 con 0x7f3d8006aaa0 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7dffb700 1 -- 172.21.15.12:0/609019172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7800ba40 con 0x7f3d8006aaa0 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.385+0000 7f3d7dffb700 1 -- 172.21.15.12:0/609019172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d780092e0 con 0x7f3d8006aaa0 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 -- 172.21.15.12:0/609019172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8006aaa0 msgr2=0x7f3d800c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8006aaa0 0x7f3d800c9d00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009f20 tx=0x7f3d78009840 comp rx=0 tx=0).stop 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 -- 172.21.15.12:0/609019172 shutdown_connections 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8006aaa0 0x7f3d800c9d00 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/609019172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d8015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 -- 172.21.15.12:0/609019172 >> 172.21.15.12:0/609019172 conn(0x7f3d8006d170 msgr2=0x7f3d800cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 -- 172.21.15.12:0/609019172 shutdown_connections 2023-10-08T16:24:28.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.386+0000 7f3d7ffff700 1 -- 172.21.15.12:0/609019172 wait complete. 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.387+0000 7f3d7ffff700 1 Processor -- start 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.388+0000 7f3d7ffff700 1 -- start start 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.388+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d8006aaa0 0x7f3d8013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.388+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.388+0000 7f3d7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d800c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8013ce80 con 0x7f3d8013fb20 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d800b1250 con 0x7f3d8006aaa0 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8016cf60 con 0x7f3d8013fef0 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44360/0 (socket says 172.21.15.12:44360) 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 -- 172.21.15.12:0/4040628910 learned_addr learned my addr 172.21.15.12:0/4040628910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7effd700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d8006aaa0 0x7f3d8013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7f7fe700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d800c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 -- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 msgr2=0x7f3d800c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d800c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 -- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d8006aaa0 msgr2=0x7f3d8013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d8006aaa0 0x7f3d8013c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.389+0000 7f3d7e7fc700 1 -- 172.21.15.12:0/4040628910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d78009ae0 con 0x7f3d8013fb20 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d7e7fc700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c880 tx=0x7f3d74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74005a00 con 0x7f3d8013fb20 2023-10-08T16:24:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d74005b60 con 0x7f3d8013fb20 2023-10-08T16:24:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d74011600 con 0x7f3d8013fb20 2023-10-08T16:24:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d8016d240 con 0x7f3d8013fb20 2023-10-08T16:24:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.390+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d8016d800 con 0x7f3d8013fb20 2023-10-08T16:24:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.391+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d8016db50 con 0x7f3d8013fb20 2023-10-08T16:24:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.392+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d740119f0 con 0x7f3d8013fb20 2023-10-08T16:24:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.393+0000 7f3d66ffd700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.393+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3d740845e0 con 0x7f3d8013fb20 2023-10-08T16:24:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.393+0000 7f3d7effd700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.394+0000 7f3d7effd700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 0x7f3d6c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d70003a30 tx=0x7f3d70007ea0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.397+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d740550b0 con 0x7f3d8013fb20 2023-10-08T16:24:28.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.594+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d8006ea20 con 0x7f3d6c066f30 2023-10-08T16:24:28.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.603+0000 7f3d66ffd700 1 -- 172.21.15.12:0/4040628910 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288945 (secure 0 0 0) 0x7f3d8006ea20 con 0x7f3d6c066f30 2023-10-08T16:24:28.608 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 msgr2=0x7f3d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 0x7f3d6c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3d70003a30 tx=0x7f3d70007ea0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 msgr2=0x7f3d800b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400c880 tx=0x7f3d74008040 comp rx=0 tx=0).stop 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 shutdown_connections 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d6c066f30 0x7f3d6c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d8013fef0 0x7f3d800c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d8006aaa0 0x7f3d8013c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 --2- 172.21.15.12:0/4040628910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d8013fb20 0x7f3d800b0d10 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 >> 172.21.15.12:0/4040628910 conn(0x7f3d8006d170 msgr2=0x7f3d800cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 shutdown_connections 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:28.608+0000 7f3d7ffff700 1 -- 172.21.15.12:0/4040628910 wait complete. 2023-10-08T16:24:28.611 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:24:28.626 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:24:27.713046+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":283,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":199,"ondisk_log_size":199,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436712,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752538008,"statfs":{"total":773094113280,"available":770598920192,"internally_reserved":0,"allocated":9478144,"data_stored":5136820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.463142"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279439+0000","last_change":"2023-10-08T16:24:22.277197+0000","last_active":"2023-10-08T16:24:22.279439+0000","last_peered":"2023-10-08T16:24:22.279439+0000","last_clean":"2023-10-08T16:24:22.279439+0000","last_became_active":"2023-10-08T16:24:22.276948+0000","last_became_peered":"2023-10-08T16:24:22.276948+0000","last_unstale":"2023-10-08T16:24:22.279439+0000","last_undegraded":"2023-10-08T16:24:22.279439+0000","last_fullsized":"2023-10-08T16:24:22.279439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:34.105560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276230+0000","last_change":"2023-10-08T16:24:22.272185+0000","last_active":"2023-10-08T16:24:22.276230+0000","last_peered":"2023-10-08T16:24:22.276230+0000","last_clean":"2023-10-08T16:24:22.276230+0000","last_became_active":"2023-10-08T16:24:22.271833+0000","last_became_peered":"2023-10-08T16:24:22.271833+0000","last_unstale":"2023-10-08T16:24:22.276230+0000","last_undegraded":"2023-10-08T16:24:22.276230+0000","last_fullsized":"2023-10-08T16:24:22.276230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:49.759070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270545+0000","last_change":"2023-10-08T16:24:22.265947+0000","last_active":"2023-10-08T16:24:22.270545+0000","last_peered":"2023-10-08T16:24:22.270545+0000","last_clean":"2023-10-08T16:24:22.270545+0000","last_became_active":"2023-10-08T16:24:22.265661+0000","last_became_peered":"2023-10-08T16:24:22.265661+0000","last_unstale":"2023-10-08T16:24:22.270545+0000","last_undegraded":"2023-10-08T16:24:22.270545+0000","last_fullsized":"2023-10-08T16:24:22.270545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:16.359492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269363+0000","last_change":"2023-10-08T16:24:22.267456+0000","last_active":"2023-10-08T16:24:22.269363+0000","last_peered":"2023-10-08T16:24:22.269363+0000","last_clean":"2023-10-08T16:24:22.269363+0000","last_became_active":"2023-10-08T16:24:22.267053+0000","last_became_peered":"2023-10-08T16:24:22.267053+0000","last_unstale":"2023-10-08T16:24:22.269363+0000","last_undegraded":"2023-10-08T16:24:22.269363+0000","last_fullsized":"2023-10-08T16:24:22.269363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:14.141525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273040+0000","last_change":"2023-10-08T16:24:22.268960+0000","last_active":"2023-10-08T16:24:22.273040+0000","last_peered":"2023-10-08T16:24:22.273040+0000","last_clean":"2023-10-08T16:24:22.273040+0000","last_became_active":"2023-10-08T16:24:22.268672+0000","last_became_peered":"2023-10-08T16:24:22.268672+0000","last_unstale":"2023-10-08T16:24:22.273040+0000","last_undegraded":"2023-10-08T16:24:22.273040+0000","last_fullsized":"2023-10-08T16:24:22.273040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285247+0000","last_change":"2023-10-08T16:24:22.278307+0000","last_active":"2023-10-08T16:24:22.285247+0000","last_peered":"2023-10-08T16:24:22.285247+0000","last_clean":"2023-10-08T16:24:22.285247+0000","last_became_active":"2023-10-08T16:24:22.278008+0000","last_became_peered":"2023-10-08T16:24:22.278008+0000","last_unstale":"2023-10-08T16:24:22.285247+0000","last_undegraded":"2023-10-08T16:24:22.285247+0000","last_fullsized":"2023-10-08T16:24:22.285247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:17.572758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268810+0000","last_change":"2023-10-08T16:24:22.264950+0000","last_active":"2023-10-08T16:24:22.268810+0000","last_peered":"2023-10-08T16:24:22.268810+0000","last_clean":"2023-10-08T16:24:22.268810+0000","last_became_active":"2023-10-08T16:24:22.264669+0000","last_became_peered":"2023-10-08T16:24:22.264669+0000","last_unstale":"2023-10-08T16:24:22.268810+0000","last_undegraded":"2023-10-08T16:24:22.268810+0000","last_fullsized":"2023-10-08T16:24:22.268810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:16.792997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276564+0000","last_change":"2023-10-08T16:24:22.266527+0000","last_active":"2023-10-08T16:24:22.276564+0000","last_peered":"2023-10-08T16:24:22.276564+0000","last_clean":"2023-10-08T16:24:22.276564+0000","last_became_active":"2023-10-08T16:24:22.266294+0000","last_became_peered":"2023-10-08T16:24:22.266294+0000","last_unstale":"2023-10-08T16:24:22.276564+0000","last_undegraded":"2023-10-08T16:24:22.276564+0000","last_fullsized":"2023-10-08T16:24:22.276564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:17.676375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.271560+0000","last_change":"2023-10-08T16:24:22.265239+0000","last_active":"2023-10-08T16:24:22.271560+0000","last_peered":"2023-10-08T16:24:22.271560+0000","last_clean":"2023-10-08T16:24:22.271560+0000","last_became_active":"2023-10-08T16:24:22.264857+0000","last_became_peered":"2023-10-08T16:24:22.264857+0000","last_unstale":"2023-10-08T16:24:22.271560+0000","last_undegraded":"2023-10-08T16:24:22.271560+0000","last_fullsized":"2023-10-08T16:24:22.271560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:52.593242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277883+0000","last_change":"2023-10-08T16:24:22.274287+0000","last_active":"2023-10-08T16:24:22.277883+0000","last_peered":"2023-10-08T16:24:22.277883+0000","last_clean":"2023-10-08T16:24:22.277883+0000","last_became_active":"2023-10-08T16:24:22.273777+0000","last_became_peered":"2023-10-08T16:24:22.273777+0000","last_unstale":"2023-10-08T16:24:22.277883+0000","last_undegraded":"2023-10-08T16:24:22.277883+0000","last_fullsized":"2023-10-08T16:24:22.277883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:59:33.821077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286835+0000","last_change":"2023-10-08T16:24:22.279365+0000","last_active":"2023-10-08T16:24:22.286835+0000","last_peered":"2023-10-08T16:24:22.286835+0000","last_clean":"2023-10-08T16:24:22.286835+0000","last_became_active":"2023-10-08T16:24:22.279112+0000","last_became_peered":"2023-10-08T16:24:22.279112+0000","last_unstale":"2023-10-08T16:24:22.286835+0000","last_undegraded":"2023-10-08T16:24:22.286835+0000","last_fullsized":"2023-10-08T16:24:22.286835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276348+0000","last_change":"2023-10-08T16:24:22.274687+0000","last_active":"2023-10-08T16:24:22.276348+0000","last_peered":"2023-10-08T16:24:22.276348+0000","last_clean":"2023-10-08T16:24:22.276348+0000","last_became_active":"2023-10-08T16:24:22.274377+0000","last_became_peered":"2023-10-08T16:24:22.274377+0000","last_unstale":"2023-10-08T16:24:22.276348+0000","last_undegraded":"2023-10-08T16:24:22.276348+0000","last_fullsized":"2023-10-08T16:24:22.276348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:24.050092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275854+0000","last_change":"2023-10-08T16:24:22.273849+0000","last_active":"2023-10-08T16:24:22.275854+0000","last_peered":"2023-10-08T16:24:22.275854+0000","last_clean":"2023-10-08T16:24:22.275854+0000","last_became_active":"2023-10-08T16:24:22.273585+0000","last_became_peered":"2023-10-08T16:24:22.273585+0000","last_unstale":"2023-10-08T16:24:22.275854+0000","last_undegraded":"2023-10-08T16:24:22.275854+0000","last_fullsized":"2023-10-08T16:24:22.275854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:52.315555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270239+0000","last_change":"2023-10-08T16:24:22.268393+0000","last_active":"2023-10-08T16:24:22.270239+0000","last_peered":"2023-10-08T16:24:22.270239+0000","last_clean":"2023-10-08T16:24:22.270239+0000","last_became_active":"2023-10-08T16:24:22.268113+0000","last_became_peered":"2023-10-08T16:24:22.268113+0000","last_unstale":"2023-10-08T16:24:22.270239+0000","last_undegraded":"2023-10-08T16:24:22.270239+0000","last_fullsized":"2023-10-08T16:24:22.270239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:48.879575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273195+0000","last_change":"2023-10-08T16:24:22.271625+0000","last_active":"2023-10-08T16:24:22.273195+0000","last_peered":"2023-10-08T16:24:22.273195+0000","last_clean":"2023-10-08T16:24:22.273195+0000","last_became_active":"2023-10-08T16:24:22.271354+0000","last_became_peered":"2023-10-08T16:24:22.271354+0000","last_unstale":"2023-10-08T16:24:22.273195+0000","last_undegraded":"2023-10-08T16:24:22.273195+0000","last_fullsized":"2023-10-08T16:24:22.273195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:20.137541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284637+0000","last_change":"2023-10-08T16:24:22.276137+0000","last_active":"2023-10-08T16:24:22.284637+0000","last_peered":"2023-10-08T16:24:22.284637+0000","last_clean":"2023-10-08T16:24:22.284637+0000","last_became_active":"2023-10-08T16:24:22.275888+0000","last_became_peered":"2023-10-08T16:24:22.275888+0000","last_unstale":"2023-10-08T16:24:22.284637+0000","last_undegraded":"2023-10-08T16:24:22.284637+0000","last_fullsized":"2023-10-08T16:24:22.284637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:20.213695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277280+0000","last_change":"2023-10-08T16:24:22.268139+0000","last_active":"2023-10-08T16:24:22.277280+0000","last_peered":"2023-10-08T16:24:22.277280+0000","last_clean":"2023-10-08T16:24:22.277280+0000","last_became_active":"2023-10-08T16:24:22.267883+0000","last_became_peered":"2023-10-08T16:24:22.267883+0000","last_unstale":"2023-10-08T16:24:22.277280+0000","last_undegraded":"2023-10-08T16:24:22.277280+0000","last_fullsized":"2023-10-08T16:24:22.277280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:03.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269724+0000","last_change":"2023-10-08T16:24:22.264405+0000","last_active":"2023-10-08T16:24:22.269724+0000","last_peered":"2023-10-08T16:24:22.269724+0000","last_clean":"2023-10-08T16:24:22.269724+0000","last_became_active":"2023-10-08T16:24:22.264086+0000","last_became_peered":"2023-10-08T16:24:22.264086+0000","last_unstale":"2023-10-08T16:24:22.269724+0000","last_undegraded":"2023-10-08T16:24:22.269724+0000","last_fullsized":"2023-10-08T16:24:22.269724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:38.493207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279408+0000","last_change":"2023-10-08T16:24:22.277792+0000","last_active":"2023-10-08T16:24:22.279408+0000","last_peered":"2023-10-08T16:24:22.279408+0000","last_clean":"2023-10-08T16:24:22.279408+0000","last_became_active":"2023-10-08T16:24:22.277523+0000","last_became_peered":"2023-10-08T16:24:22.277523+0000","last_unstale":"2023-10-08T16:24:22.279408+0000","last_undegraded":"2023-10-08T16:24:22.279408+0000","last_fullsized":"2023-10-08T16:24:22.279408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:31.347826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276472+0000","last_change":"2023-10-08T16:24:22.267275+0000","last_active":"2023-10-08T16:24:22.276472+0000","last_peered":"2023-10-08T16:24:22.276472+0000","last_clean":"2023-10-08T16:24:22.276472+0000","last_became_active":"2023-10-08T16:24:22.266980+0000","last_became_peered":"2023-10-08T16:24:22.266980+0000","last_unstale":"2023-10-08T16:24:22.276472+0000","last_undegraded":"2023-10-08T16:24:22.276472+0000","last_fullsized":"2023-10-08T16:24:22.276472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:46.525162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273571+0000","last_change":"2023-10-08T16:24:22.268840+0000","last_active":"2023-10-08T16:24:22.273571+0000","last_peered":"2023-10-08T16:24:22.273571+0000","last_clean":"2023-10-08T16:24:22.273571+0000","last_became_active":"2023-10-08T16:24:22.268515+0000","last_became_peered":"2023-10-08T16:24:22.268515+0000","last_unstale":"2023-10-08T16:24:22.273571+0000","last_undegraded":"2023-10-08T16:24:22.273571+0000","last_fullsized":"2023-10-08T16:24:22.273571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286296+0000","last_change":"2023-10-08T16:24:22.281335+0000","last_active":"2023-10-08T16:24:22.286296+0000","last_peered":"2023-10-08T16:24:22.286296+0000","last_clean":"2023-10-08T16:24:22.286296+0000","last_became_active":"2023-10-08T16:24:22.280628+0000","last_became_peered":"2023-10-08T16:24:22.280628+0000","last_unstale":"2023-10-08T16:24:22.286296+0000","last_undegraded":"2023-10-08T16:24:22.286296+0000","last_fullsized":"2023-10-08T16:24:22.286296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:50.269676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274998+0000","last_change":"2023-10-08T16:24:22.269330+0000","last_active":"2023-10-08T16:24:22.274998+0000","last_peered":"2023-10-08T16:24:22.274998+0000","last_clean":"2023-10-08T16:24:22.274998+0000","last_became_active":"2023-10-08T16:24:22.268739+0000","last_became_peered":"2023-10-08T16:24:22.268739+0000","last_unstale":"2023-10-08T16:24:22.274998+0000","last_undegraded":"2023-10-08T16:24:22.274998+0000","last_fullsized":"2023-10-08T16:24:22.274998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:10.064373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274637+0000","last_change":"2023-10-08T16:24:22.272832+0000","last_active":"2023-10-08T16:24:22.274637+0000","last_peered":"2023-10-08T16:24:22.274637+0000","last_clean":"2023-10-08T16:24:22.274637+0000","last_became_active":"2023-10-08T16:24:22.272557+0000","last_became_peered":"2023-10-08T16:24:22.272557+0000","last_unstale":"2023-10-08T16:24:22.274637+0000","last_undegraded":"2023-10-08T16:24:22.274637+0000","last_fullsized":"2023-10-08T16:24:22.274637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:33.967737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273074+0000","last_change":"2023-10-08T16:24:22.270188+0000","last_active":"2023-10-08T16:24:22.273074+0000","last_peered":"2023-10-08T16:24:22.273074+0000","last_clean":"2023-10-08T16:24:22.273074+0000","last_became_active":"2023-10-08T16:24:22.269890+0000","last_became_peered":"2023-10-08T16:24:22.269890+0000","last_unstale":"2023-10-08T16:24:22.273074+0000","last_undegraded":"2023-10-08T16:24:22.273074+0000","last_fullsized":"2023-10-08T16:24:22.273074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:34.696485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275378+0000","last_change":"2023-10-08T16:24:22.271452+0000","last_active":"2023-10-08T16:24:22.275378+0000","last_peered":"2023-10-08T16:24:22.275378+0000","last_clean":"2023-10-08T16:24:22.275378+0000","last_became_active":"2023-10-08T16:24:22.270407+0000","last_became_peered":"2023-10-08T16:24:22.270407+0000","last_unstale":"2023-10-08T16:24:22.275378+0000","last_undegraded":"2023-10-08T16:24:22.275378+0000","last_fullsized":"2023-10-08T16:24:22.275378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:11.469843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285036+0000","last_change":"2023-10-08T16:24:22.275414+0000","last_active":"2023-10-08T16:24:22.285036+0000","last_peered":"2023-10-08T16:24:22.285036+0000","last_clean":"2023-10-08T16:24:22.285036+0000","last_became_active":"2023-10-08T16:24:22.275138+0000","last_became_peered":"2023-10-08T16:24:22.275138+0000","last_unstale":"2023-10-08T16:24:22.285036+0000","last_undegraded":"2023-10-08T16:24:22.285036+0000","last_fullsized":"2023-10-08T16:24:22.285036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:56.116579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277991+0000","last_change":"2023-10-08T16:24:22.275499+0000","last_active":"2023-10-08T16:24:22.277991+0000","last_peered":"2023-10-08T16:24:22.277991+0000","last_clean":"2023-10-08T16:24:22.277991+0000","last_became_active":"2023-10-08T16:24:22.275240+0000","last_became_peered":"2023-10-08T16:24:22.275240+0000","last_unstale":"2023-10-08T16:24:22.277991+0000","last_undegraded":"2023-10-08T16:24:22.277991+0000","last_fullsized":"2023-10-08T16:24:22.277991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276179+0000","last_change":"2023-10-08T16:24:22.268011+0000","last_active":"2023-10-08T16:24:22.276179+0000","last_peered":"2023-10-08T16:24:22.276179+0000","last_clean":"2023-10-08T16:24:22.276179+0000","last_became_active":"2023-10-08T16:24:22.267685+0000","last_became_peered":"2023-10-08T16:24:22.267685+0000","last_unstale":"2023-10-08T16:24:22.276179+0000","last_undegraded":"2023-10-08T16:24:22.276179+0000","last_fullsized":"2023-10-08T16:24:22.276179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.063975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270329+0000","last_change":"2023-10-08T16:24:22.266566+0000","last_active":"2023-10-08T16:24:22.270329+0000","last_peered":"2023-10-08T16:24:22.270329+0000","last_clean":"2023-10-08T16:24:22.270329+0000","last_became_active":"2023-10-08T16:24:22.266154+0000","last_became_peered":"2023-10-08T16:24:22.266154+0000","last_unstale":"2023-10-08T16:24:22.270329+0000","last_undegraded":"2023-10-08T16:24:22.270329+0000","last_fullsized":"2023-10-08T16:24:22.270329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:13.350748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273243+0000","last_change":"2023-10-08T16:24:22.270956+0000","last_active":"2023-10-08T16:24:22.273243+0000","last_peered":"2023-10-08T16:24:22.273243+0000","last_clean":"2023-10-08T16:24:22.273243+0000","last_became_active":"2023-10-08T16:24:22.270612+0000","last_became_peered":"2023-10-08T16:24:22.270612+0000","last_unstale":"2023-10-08T16:24:22.273243+0000","last_undegraded":"2023-10-08T16:24:22.273243+0000","last_fullsized":"2023-10-08T16:24:22.273243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286636+0000","last_change":"2023-10-08T16:24:22.282687+0000","last_active":"2023-10-08T16:24:22.286636+0000","last_peered":"2023-10-08T16:24:22.286636+0000","last_clean":"2023-10-08T16:24:22.286636+0000","last_became_active":"2023-10-08T16:24:22.282416+0000","last_became_peered":"2023-10-08T16:24:22.282416+0000","last_unstale":"2023-10-08T16:24:22.286636+0000","last_undegraded":"2023-10-08T16:24:22.286636+0000","last_fullsized":"2023-10-08T16:24:22.286636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:18.006900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273784+0000","last_change":"2023-10-08T16:24:22.270422+0000","last_active":"2023-10-08T16:24:22.273784+0000","last_peered":"2023-10-08T16:24:22.273784+0000","last_clean":"2023-10-08T16:24:22.273784+0000","last_became_active":"2023-10-08T16:24:22.270165+0000","last_became_peered":"2023-10-08T16:24:22.270165+0000","last_unstale":"2023-10-08T16:24:22.273784+0000","last_undegraded":"2023-10-08T16:24:22.273784+0000","last_fullsized":"2023-10-08T16:24:22.273784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:07.486766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289512+0000","last_change":"2023-10-08T16:24:21.269557+0000","last_active":"2023-10-08T16:24:22.289512+0000","last_peered":"2023-10-08T16:24:22.289512+0000","last_clean":"2023-10-08T16:24:22.289512+0000","last_became_active":"2023-10-08T16:24:21.269263+0000","last_became_peered":"2023-10-08T16:24:21.269263+0000","last_unstale":"2023-10-08T16:24:22.289512+0000","last_undegraded":"2023-10-08T16:24:22.289512+0000","last_fullsized":"2023-10-08T16:24:22.289512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:42:22.448478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288128+0000","last_change":"2023-10-08T16:24:22.282422+0000","last_active":"2023-10-08T16:24:22.288128+0000","last_peered":"2023-10-08T16:24:22.288128+0000","last_clean":"2023-10-08T16:24:22.288128+0000","last_became_active":"2023-10-08T16:24:22.280622+0000","last_became_peered":"2023-10-08T16:24:22.280622+0000","last_unstale":"2023-10-08T16:24:22.288128+0000","last_undegraded":"2023-10-08T16:24:22.288128+0000","last_fullsized":"2023-10-08T16:24:22.288128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291323+0000","last_change":"2023-10-08T16:24:21.271687+0000","last_active":"2023-10-08T16:24:22.291323+0000","last_peered":"2023-10-08T16:24:22.291323+0000","last_clean":"2023-10-08T16:24:22.291323+0000","last_became_active":"2023-10-08T16:24:21.271411+0000","last_became_peered":"2023-10-08T16:24:21.271411+0000","last_unstale":"2023-10-08T16:24:22.291323+0000","last_undegraded":"2023-10-08T16:24:22.291323+0000","last_fullsized":"2023-10-08T16:24:22.291323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:42.094517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285309+0000","last_change":"2023-10-08T16:24:22.274100+0000","last_active":"2023-10-08T16:24:22.285309+0000","last_peered":"2023-10-08T16:24:22.285309+0000","last_clean":"2023-10-08T16:24:22.285309+0000","last_became_active":"2023-10-08T16:24:22.273194+0000","last_became_peered":"2023-10-08T16:24:22.273194+0000","last_unstale":"2023-10-08T16:24:22.285309+0000","last_undegraded":"2023-10-08T16:24:22.285309+0000","last_fullsized":"2023-10-08T16:24:22.285309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:45.645647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288547+0000","last_change":"2023-10-08T16:24:21.276710+0000","last_active":"2023-10-08T16:24:22.288547+0000","last_peered":"2023-10-08T16:24:22.288547+0000","last_clean":"2023-10-08T16:24:22.288547+0000","last_became_active":"2023-10-08T16:24:21.276424+0000","last_became_peered":"2023-10-08T16:24:21.276424+0000","last_unstale":"2023-10-08T16:24:22.288547+0000","last_undegraded":"2023-10-08T16:24:22.288547+0000","last_fullsized":"2023-10-08T16:24:22.288547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:49.830827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268952+0000","last_change":"2023-10-08T16:24:22.266933+0000","last_active":"2023-10-08T16:24:22.268952+0000","last_peered":"2023-10-08T16:24:22.268952+0000","last_clean":"2023-10-08T16:24:22.268952+0000","last_became_active":"2023-10-08T16:24:22.266234+0000","last_became_peered":"2023-10-08T16:24:22.266234+0000","last_unstale":"2023-10-08T16:24:22.268952+0000","last_undegraded":"2023-10-08T16:24:22.268952+0000","last_fullsized":"2023-10-08T16:24:22.268952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:48.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286651+0000","last_change":"2023-10-08T16:24:21.267216+0000","last_active":"2023-10-08T16:24:22.286651+0000","last_peered":"2023-10-08T16:24:22.286651+0000","last_clean":"2023-10-08T16:24:22.286651+0000","last_became_active":"2023-10-08T16:24:21.266898+0000","last_became_peered":"2023-10-08T16:24:21.266898+0000","last_unstale":"2023-10-08T16:24:22.286651+0000","last_undegraded":"2023-10-08T16:24:22.286651+0000","last_fullsized":"2023-10-08T16:24:22.286651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:56.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285851+0000","last_change":"2023-10-08T16:24:22.278368+0000","last_active":"2023-10-08T16:24:22.285851+0000","last_peered":"2023-10-08T16:24:22.285851+0000","last_clean":"2023-10-08T16:24:22.285851+0000","last_became_active":"2023-10-08T16:24:22.277968+0000","last_became_peered":"2023-10-08T16:24:22.277968+0000","last_unstale":"2023-10-08T16:24:22.285851+0000","last_undegraded":"2023-10-08T16:24:22.285851+0000","last_fullsized":"2023-10-08T16:24:22.285851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:28.517572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284459+0000","last_change":"2023-10-08T16:24:21.260127+0000","last_active":"2023-10-08T16:24:22.284459+0000","last_peered":"2023-10-08T16:24:22.284459+0000","last_clean":"2023-10-08T16:24:22.284459+0000","last_became_active":"2023-10-08T16:24:21.259831+0000","last_became_peered":"2023-10-08T16:24:21.259831+0000","last_unstale":"2023-10-08T16:24:22.284459+0000","last_undegraded":"2023-10-08T16:24:22.284459+0000","last_fullsized":"2023-10-08T16:24:22.284459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.879845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276157+0000","last_change":"2023-10-08T16:24:22.267391+0000","last_active":"2023-10-08T16:24:22.276157+0000","last_peered":"2023-10-08T16:24:22.276157+0000","last_clean":"2023-10-08T16:24:22.276157+0000","last_became_active":"2023-10-08T16:24:22.267088+0000","last_became_peered":"2023-10-08T16:24:22.267088+0000","last_unstale":"2023-10-08T16:24:22.276157+0000","last_undegraded":"2023-10-08T16:24:22.276157+0000","last_fullsized":"2023-10-08T16:24:22.276157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:26.983593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286744+0000","last_change":"2023-10-08T16:24:21.275128+0000","last_active":"2023-10-08T16:24:22.286744+0000","last_peered":"2023-10-08T16:24:22.286744+0000","last_clean":"2023-10-08T16:24:22.286744+0000","last_became_active":"2023-10-08T16:24:21.274777+0000","last_became_peered":"2023-10-08T16:24:21.274777+0000","last_unstale":"2023-10-08T16:24:22.286744+0000","last_undegraded":"2023-10-08T16:24:22.286744+0000","last_fullsized":"2023-10-08T16:24:22.286744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:42.367439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275897+0000","last_change":"2023-10-08T16:24:22.274541+0000","last_active":"2023-10-08T16:24:22.275897+0000","last_peered":"2023-10-08T16:24:22.275897+0000","last_clean":"2023-10-08T16:24:22.275897+0000","last_became_active":"2023-10-08T16:24:22.274230+0000","last_became_peered":"2023-10-08T16:24:22.274230+0000","last_unstale":"2023-10-08T16:24:22.275897+0000","last_undegraded":"2023-10-08T16:24:22.275897+0000","last_fullsized":"2023-10-08T16:24:22.275897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:17.305261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257414+0000","last_change":"2023-10-08T16:24:21.268084+0000","last_active":"2023-10-08T16:24:22.257414+0000","last_peered":"2023-10-08T16:24:22.257414+0000","last_clean":"2023-10-08T16:24:22.257414+0000","last_became_active":"2023-10-08T16:24:21.267806+0000","last_became_peered":"2023-10-08T16:24:21.267806+0000","last_unstale":"2023-10-08T16:24:22.257414+0000","last_undegraded":"2023-10-08T16:24:22.257414+0000","last_fullsized":"2023-10-08T16:24:22.257414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:32.960654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276267+0000","last_change":"2023-10-08T16:24:22.266880+0000","last_active":"2023-10-08T16:24:22.276267+0000","last_peered":"2023-10-08T16:24:22.276267+0000","last_clean":"2023-10-08T16:24:22.276267+0000","last_became_active":"2023-10-08T16:24:22.266473+0000","last_became_peered":"2023-10-08T16:24:22.266473+0000","last_unstale":"2023-10-08T16:24:22.276267+0000","last_undegraded":"2023-10-08T16:24:22.276267+0000","last_fullsized":"2023-10-08T16:24:22.276267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:53.937746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256889+0000","last_change":"2023-10-08T16:24:21.259935+0000","last_active":"2023-10-08T16:24:22.256889+0000","last_peered":"2023-10-08T16:24:22.256889+0000","last_clean":"2023-10-08T16:24:22.256889+0000","last_became_active":"2023-10-08T16:24:21.259399+0000","last_became_peered":"2023-10-08T16:24:21.259399+0000","last_unstale":"2023-10-08T16:24:22.256889+0000","last_undegraded":"2023-10-08T16:24:22.256889+0000","last_fullsized":"2023-10-08T16:24:22.256889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:33.098477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.272299+0000","last_change":"2023-10-08T16:24:22.270968+0000","last_active":"2023-10-08T16:24:22.272299+0000","last_peered":"2023-10-08T16:24:22.272299+0000","last_clean":"2023-10-08T16:24:22.272299+0000","last_became_active":"2023-10-08T16:24:22.270705+0000","last_became_peered":"2023-10-08T16:24:22.270705+0000","last_unstale":"2023-10-08T16:24:22.272299+0000","last_undegraded":"2023-10-08T16:24:22.272299+0000","last_fullsized":"2023-10-08T16:24:22.272299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:57.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.254209+0000","last_change":"2023-10-08T16:24:21.273603+0000","last_active":"2023-10-08T16:24:22.254209+0000","last_peered":"2023-10-08T16:24:22.254209+0000","last_clean":"2023-10-08T16:24:22.254209+0000","last_became_active":"2023-10-08T16:24:21.273224+0000","last_became_peered":"2023-10-08T16:24:21.273224+0000","last_unstale":"2023-10-08T16:24:22.254209+0000","last_undegraded":"2023-10-08T16:24:22.254209+0000","last_fullsized":"2023-10-08T16:24:22.254209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:49.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276968+0000","last_change":"2023-10-08T16:24:22.273050+0000","last_active":"2023-10-08T16:24:22.276968+0000","last_peered":"2023-10-08T16:24:22.276968+0000","last_clean":"2023-10-08T16:24:22.276968+0000","last_became_active":"2023-10-08T16:24:22.272781+0000","last_became_peered":"2023-10-08T16:24:22.272781+0000","last_unstale":"2023-10-08T16:24:22.276968+0000","last_undegraded":"2023-10-08T16:24:22.276968+0000","last_fullsized":"2023-10-08T16:24:22.276968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258749+0000","last_change":"2023-10-08T16:24:21.269008+0000","last_active":"2023-10-08T16:24:22.258749+0000","last_peered":"2023-10-08T16:24:22.258749+0000","last_clean":"2023-10-08T16:24:22.258749+0000","last_became_active":"2023-10-08T16:24:21.268649+0000","last_became_peered":"2023-10-08T16:24:21.268649+0000","last_unstale":"2023-10-08T16:24:22.258749+0000","last_undegraded":"2023-10-08T16:24:22.258749+0000","last_fullsized":"2023-10-08T16:24:22.258749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:44.638564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284345+0000","last_change":"2023-10-08T16:24:22.276093+0000","last_active":"2023-10-08T16:24:22.284345+0000","last_peered":"2023-10-08T16:24:22.284345+0000","last_clean":"2023-10-08T16:24:22.284345+0000","last_became_active":"2023-10-08T16:24:22.275832+0000","last_became_peered":"2023-10-08T16:24:22.275832+0000","last_unstale":"2023-10-08T16:24:22.284345+0000","last_undegraded":"2023-10-08T16:24:22.284345+0000","last_fullsized":"2023-10-08T16:24:22.284345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:31.162690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287850+0000","last_change":"2023-10-08T16:24:21.272950+0000","last_active":"2023-10-08T16:24:22.287850+0000","last_peered":"2023-10-08T16:24:22.287850+0000","last_clean":"2023-10-08T16:24:22.287850+0000","last_became_active":"2023-10-08T16:24:21.271679+0000","last_became_peered":"2023-10-08T16:24:21.271679+0000","last_unstale":"2023-10-08T16:24:22.287850+0000","last_undegraded":"2023-10-08T16:24:22.287850+0000","last_fullsized":"2023-10-08T16:24:22.287850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:06.461374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277014+0000","last_change":"2023-10-08T16:24:22.275924+0000","last_active":"2023-10-08T16:24:22.277014+0000","last_peered":"2023-10-08T16:24:22.277014+0000","last_clean":"2023-10-08T16:24:22.277014+0000","last_became_active":"2023-10-08T16:24:22.274052+0000","last_became_peered":"2023-10-08T16:24:22.274052+0000","last_unstale":"2023-10-08T16:24:22.277014+0000","last_undegraded":"2023-10-08T16:24:22.277014+0000","last_fullsized":"2023-10-08T16:24:22.277014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:17.163656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291730+0000","last_change":"2023-10-08T16:24:21.271638+0000","last_active":"2023-10-08T16:24:22.291730+0000","last_peered":"2023-10-08T16:24:22.291730+0000","last_clean":"2023-10-08T16:24:22.291730+0000","last_became_active":"2023-10-08T16:24:21.271359+0000","last_became_peered":"2023-10-08T16:24:21.271359+0000","last_unstale":"2023-10-08T16:24:22.291730+0000","last_undegraded":"2023-10-08T16:24:22.291730+0000","last_fullsized":"2023-10-08T16:24:22.291730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:06:33.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275422+0000","last_change":"2023-10-08T16:24:22.271444+0000","last_active":"2023-10-08T16:24:22.275422+0000","last_peered":"2023-10-08T16:24:22.275422+0000","last_clean":"2023-10-08T16:24:22.275422+0000","last_became_active":"2023-10-08T16:24:22.270764+0000","last_became_peered":"2023-10-08T16:24:22.270764+0000","last_unstale":"2023-10-08T16:24:22.275422+0000","last_undegraded":"2023-10-08T16:24:22.275422+0000","last_fullsized":"2023-10-08T16:24:22.275422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.468457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293566+0000","last_change":"2023-10-08T16:24:21.269602+0000","last_active":"2023-10-08T16:24:22.293566+0000","last_peered":"2023-10-08T16:24:22.293566+0000","last_clean":"2023-10-08T16:24:22.293566+0000","last_became_active":"2023-10-08T16:24:21.269331+0000","last_became_peered":"2023-10-08T16:24:21.269331+0000","last_unstale":"2023-10-08T16:24:22.293566+0000","last_undegraded":"2023-10-08T16:24:22.293566+0000","last_fullsized":"2023-10-08T16:24:22.293566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.991250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269760+0000","last_change":"2023-10-08T16:24:22.264889+0000","last_active":"2023-10-08T16:24:22.269760+0000","last_peered":"2023-10-08T16:24:22.269760+0000","last_clean":"2023-10-08T16:24:22.269760+0000","last_became_active":"2023-10-08T16:24:22.264605+0000","last_became_peered":"2023-10-08T16:24:22.264605+0000","last_unstale":"2023-10-08T16:24:22.269760+0000","last_undegraded":"2023-10-08T16:24:22.269760+0000","last_fullsized":"2023-10-08T16:24:22.269760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:30:46.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257867+0000","last_change":"2023-10-08T16:24:21.265305+0000","last_active":"2023-10-08T16:24:22.257867+0000","last_peered":"2023-10-08T16:24:22.257867+0000","last_clean":"2023-10-08T16:24:22.257867+0000","last_became_active":"2023-10-08T16:24:21.264987+0000","last_became_peered":"2023-10-08T16:24:21.264987+0000","last_unstale":"2023-10-08T16:24:22.257867+0000","last_undegraded":"2023-10-08T16:24:22.257867+0000","last_fullsized":"2023-10-08T16:24:22.257867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275763+0000","last_change":"2023-10-08T16:24:22.274630+0000","last_active":"2023-10-08T16:24:22.275763+0000","last_peered":"2023-10-08T16:24:22.275763+0000","last_clean":"2023-10-08T16:24:22.275763+0000","last_became_active":"2023-10-08T16:24:22.274286+0000","last_became_peered":"2023-10-08T16:24:22.274286+0000","last_unstale":"2023-10-08T16:24:22.275763+0000","last_undegraded":"2023-10-08T16:24:22.275763+0000","last_fullsized":"2023-10-08T16:24:22.275763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:22.357569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257535+0000","last_change":"2023-10-08T16:24:21.268698+0000","last_active":"2023-10-08T16:24:22.257535+0000","last_peered":"2023-10-08T16:24:22.257535+0000","last_clean":"2023-10-08T16:24:22.257535+0000","last_became_active":"2023-10-08T16:24:21.268390+0000","last_became_peered":"2023-10-08T16:24:21.268390+0000","last_unstale":"2023-10-08T16:24:22.257535+0000","last_undegraded":"2023-10-08T16:24:22.257535+0000","last_fullsized":"2023-10-08T16:24:22.257535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:14.687838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276317+0000","last_change":"2023-10-08T16:24:22.270899+0000","last_active":"2023-10-08T16:24:22.276317+0000","last_peered":"2023-10-08T16:24:22.276317+0000","last_clean":"2023-10-08T16:24:22.276317+0000","last_became_active":"2023-10-08T16:24:22.270208+0000","last_became_peered":"2023-10-08T16:24:22.270208+0000","last_unstale":"2023-10-08T16:24:22.276317+0000","last_undegraded":"2023-10-08T16:24:22.276317+0000","last_fullsized":"2023-10-08T16:24:22.276317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:10.548785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287746+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.287746+0000","last_peered":"2023-10-08T16:24:22.287746+0000","last_clean":"2023-10-08T16:24:22.287746+0000","last_became_active":"2023-10-08T16:24:21.269334+0000","last_became_peered":"2023-10-08T16:24:21.269334+0000","last_unstale":"2023-10-08T16:24:22.287746+0000","last_undegraded":"2023-10-08T16:24:22.287746+0000","last_fullsized":"2023-10-08T16:24:22.287746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:46.119976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269809+0000","last_change":"2023-10-08T16:24:22.266878+0000","last_active":"2023-10-08T16:24:22.269809+0000","last_peered":"2023-10-08T16:24:22.269809+0000","last_clean":"2023-10-08T16:24:22.269809+0000","last_became_active":"2023-10-08T16:24:22.266101+0000","last_became_peered":"2023-10-08T16:24:22.266101+0000","last_unstale":"2023-10-08T16:24:22.269809+0000","last_undegraded":"2023-10-08T16:24:22.269809+0000","last_fullsized":"2023-10-08T16:24:22.269809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.883482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293561+0000","last_change":"2023-10-08T16:24:21.261619+0000","last_active":"2023-10-08T16:24:22.293561+0000","last_peered":"2023-10-08T16:24:22.293561+0000","last_clean":"2023-10-08T16:24:22.293561+0000","last_became_active":"2023-10-08T16:24:21.261364+0000","last_became_peered":"2023-10-08T16:24:21.261364+0000","last_unstale":"2023-10-08T16:24:22.293561+0000","last_undegraded":"2023-10-08T16:24:22.293561+0000","last_fullsized":"2023-10-08T16:24:22.293561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:55.109496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.267650+0000","last_change":"2023-10-08T16:24:22.265540+0000","last_active":"2023-10-08T16:24:22.267650+0000","last_peered":"2023-10-08T16:24:22.267650+0000","last_clean":"2023-10-08T16:24:22.267650+0000","last_became_active":"2023-10-08T16:24:22.265265+0000","last_became_peered":"2023-10-08T16:24:22.265265+0000","last_unstale":"2023-10-08T16:24:22.267650+0000","last_undegraded":"2023-10-08T16:24:22.267650+0000","last_fullsized":"2023-10-08T16:24:22.267650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.566331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289188+0000","last_change":"2023-10-08T16:24:21.268382+0000","last_active":"2023-10-08T16:24:22.289188+0000","last_peered":"2023-10-08T16:24:22.289188+0000","last_clean":"2023-10-08T16:24:22.289188+0000","last_became_active":"2023-10-08T16:24:21.268141+0000","last_became_peered":"2023-10-08T16:24:21.268141+0000","last_unstale":"2023-10-08T16:24:22.289188+0000","last_undegraded":"2023-10-08T16:24:22.289188+0000","last_fullsized":"2023-10-08T16:24:22.289188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:12.547947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276490+0000","last_change":"2023-10-08T16:24:22.270441+0000","last_active":"2023-10-08T16:24:22.276490+0000","last_peered":"2023-10-08T16:24:22.276490+0000","last_clean":"2023-10-08T16:24:22.276490+0000","last_became_active":"2023-10-08T16:24:22.270142+0000","last_became_peered":"2023-10-08T16:24:22.270142+0000","last_unstale":"2023-10-08T16:24:22.276490+0000","last_undegraded":"2023-10-08T16:24:22.276490+0000","last_fullsized":"2023-10-08T16:24:22.276490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:41.764767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286673+0000","last_change":"2023-10-08T16:24:21.267941+0000","last_active":"2023-10-08T16:24:22.286673+0000","last_peered":"2023-10-08T16:24:22.286673+0000","last_clean":"2023-10-08T16:24:22.286673+0000","last_became_active":"2023-10-08T16:24:21.267613+0000","last_became_peered":"2023-10-08T16:24:21.267613+0000","last_unstale":"2023-10-08T16:24:22.286673+0000","last_undegraded":"2023-10-08T16:24:22.286673+0000","last_fullsized":"2023-10-08T16:24:22.286673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:47.872492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276994+0000","last_change":"2023-10-08T16:24:22.274135+0000","last_active":"2023-10-08T16:24:22.276994+0000","last_peered":"2023-10-08T16:24:22.276994+0000","last_clean":"2023-10-08T16:24:22.276994+0000","last_became_active":"2023-10-08T16:24:22.273837+0000","last_became_peered":"2023-10-08T16:24:22.273837+0000","last_unstale":"2023-10-08T16:24:22.276994+0000","last_undegraded":"2023-10-08T16:24:22.276994+0000","last_fullsized":"2023-10-08T16:24:22.276994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:51.668749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257341+0000","last_change":"2023-10-08T16:24:21.276024+0000","last_active":"2023-10-08T16:24:22.257341+0000","last_peered":"2023-10-08T16:24:22.257341+0000","last_clean":"2023-10-08T16:24:22.257341+0000","last_became_active":"2023-10-08T16:24:21.275739+0000","last_became_peered":"2023-10-08T16:24:21.275739+0000","last_unstale":"2023-10-08T16:24:22.257341+0000","last_undegraded":"2023-10-08T16:24:22.257341+0000","last_fullsized":"2023-10-08T16:24:22.257341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:21.350486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275441+0000","last_change":"2023-10-08T16:24:22.271976+0000","last_active":"2023-10-08T16:24:22.275441+0000","last_peered":"2023-10-08T16:24:22.275441+0000","last_clean":"2023-10-08T16:24:22.275441+0000","last_became_active":"2023-10-08T16:24:22.271425+0000","last_became_peered":"2023-10-08T16:24:22.271425+0000","last_unstale":"2023-10-08T16:24:22.275441+0000","last_undegraded":"2023-10-08T16:24:22.275441+0000","last_fullsized":"2023-10-08T16:24:22.275441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:47.127059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291574+0000","last_change":"2023-10-08T16:24:21.267852+0000","last_active":"2023-10-08T16:24:22.291574+0000","last_peered":"2023-10-08T16:24:22.291574+0000","last_clean":"2023-10-08T16:24:22.291574+0000","last_became_active":"2023-10-08T16:24:21.267533+0000","last_became_peered":"2023-10-08T16:24:21.267533+0000","last_unstale":"2023-10-08T16:24:22.291574+0000","last_undegraded":"2023-10-08T16:24:22.291574+0000","last_fullsized":"2023-10-08T16:24:22.291574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284930+0000","last_change":"2023-10-08T16:24:22.274776+0000","last_active":"2023-10-08T16:24:22.284930+0000","last_peered":"2023-10-08T16:24:22.284930+0000","last_clean":"2023-10-08T16:24:22.284930+0000","last_became_active":"2023-10-08T16:24:22.274530+0000","last_became_peered":"2023-10-08T16:24:22.274530+0000","last_unstale":"2023-10-08T16:24:22.284930+0000","last_undegraded":"2023-10-08T16:24:22.284930+0000","last_fullsized":"2023-10-08T16:24:22.284930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.101600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256460+0000","last_change":"2023-10-08T16:24:21.263757+0000","last_active":"2023-10-08T16:24:22.256460+0000","last_peered":"2023-10-08T16:24:22.256460+0000","last_clean":"2023-10-08T16:24:22.256460+0000","last_became_active":"2023-10-08T16:24:21.263272+0000","last_became_peered":"2023-10-08T16:24:21.263272+0000","last_unstale":"2023-10-08T16:24:22.256460+0000","last_undegraded":"2023-10-08T16:24:22.256460+0000","last_fullsized":"2023-10-08T16:24:22.256460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:24.676343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270553+0000","last_change":"2023-10-08T16:24:22.268087+0000","last_active":"2023-10-08T16:24:22.270553+0000","last_peered":"2023-10-08T16:24:22.270553+0000","last_clean":"2023-10-08T16:24:22.270553+0000","last_became_active":"2023-10-08T16:24:22.267829+0000","last_became_peered":"2023-10-08T16:24:22.267829+0000","last_unstale":"2023-10-08T16:24:22.270553+0000","last_undegraded":"2023-10-08T16:24:22.270553+0000","last_fullsized":"2023-10-08T16:24:22.270553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:03.698744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258364+0000","last_change":"2023-10-08T16:24:21.263139+0000","last_active":"2023-10-08T16:24:22.258364+0000","last_peered":"2023-10-08T16:24:22.258364+0000","last_clean":"2023-10-08T16:24:22.258364+0000","last_became_active":"2023-10-08T16:24:21.262842+0000","last_became_peered":"2023-10-08T16:24:21.262842+0000","last_unstale":"2023-10-08T16:24:22.258364+0000","last_undegraded":"2023-10-08T16:24:22.258364+0000","last_fullsized":"2023-10-08T16:24:22.258364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:55.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.278195+0000","last_change":"2023-10-08T16:24:22.277258+0000","last_active":"2023-10-08T16:24:22.278195+0000","last_peered":"2023-10-08T16:24:22.278195+0000","last_clean":"2023-10-08T16:24:22.278195+0000","last_became_active":"2023-10-08T16:24:22.276962+0000","last_became_peered":"2023-10-08T16:24:22.276962+0000","last_unstale":"2023-10-08T16:24:22.278195+0000","last_undegraded":"2023-10-08T16:24:22.278195+0000","last_fullsized":"2023-10-08T16:24:22.278195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:53.296385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291666+0000","last_change":"2023-10-08T16:24:21.269755+0000","last_active":"2023-10-08T16:24:22.291666+0000","last_peered":"2023-10-08T16:24:22.291666+0000","last_clean":"2023-10-08T16:24:22.291666+0000","last_became_active":"2023-10-08T16:24:21.269510+0000","last_became_peered":"2023-10-08T16:24:21.269510+0000","last_unstale":"2023-10-08T16:24:22.291666+0000","last_undegraded":"2023-10-08T16:24:22.291666+0000","last_fullsized":"2023-10-08T16:24:22.291666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:39.883010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276996+0000","last_change":"2023-10-08T16:24:22.275498+0000","last_active":"2023-10-08T16:24:22.276996+0000","last_peered":"2023-10-08T16:24:22.276996+0000","last_clean":"2023-10-08T16:24:22.276996+0000","last_became_active":"2023-10-08T16:24:22.275126+0000","last_became_peered":"2023-10-08T16:24:22.275126+0000","last_unstale":"2023-10-08T16:24:22.276996+0000","last_undegraded":"2023-10-08T16:24:22.276996+0000","last_fullsized":"2023-10-08T16:24:22.276996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:54.012780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257826+0000","last_change":"2023-10-08T16:24:21.272140+0000","last_active":"2023-10-08T16:24:22.257826+0000","last_peered":"2023-10-08T16:24:22.257826+0000","last_clean":"2023-10-08T16:24:22.257826+0000","last_became_active":"2023-10-08T16:24:21.271855+0000","last_became_peered":"2023-10-08T16:24:21.271855+0000","last_unstale":"2023-10-08T16:24:22.257826+0000","last_undegraded":"2023-10-08T16:24:22.257826+0000","last_fullsized":"2023-10-08T16:24:22.257826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:43.513877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284324+0000","last_change":"2023-10-08T16:24:22.275692+0000","last_active":"2023-10-08T16:24:22.284324+0000","last_peered":"2023-10-08T16:24:22.284324+0000","last_clean":"2023-10-08T16:24:22.284324+0000","last_became_active":"2023-10-08T16:24:22.275415+0000","last_became_peered":"2023-10-08T16:24:22.275415+0000","last_unstale":"2023-10-08T16:24:22.284324+0000","last_undegraded":"2023-10-08T16:24:22.284324+0000","last_fullsized":"2023-10-08T16:24:22.284324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:19.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257742+0000","last_change":"2023-10-08T16:24:21.267000+0000","last_active":"2023-10-08T16:24:22.257742+0000","last_peered":"2023-10-08T16:24:22.257742+0000","last_clean":"2023-10-08T16:24:22.257742+0000","last_became_active":"2023-10-08T16:24:21.266714+0000","last_became_peered":"2023-10-08T16:24:21.266714+0000","last_unstale":"2023-10-08T16:24:22.257742+0000","last_undegraded":"2023-10-08T16:24:22.257742+0000","last_fullsized":"2023-10-08T16:24:22.257742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.879845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268257+0000","last_change":"2023-10-08T16:24:22.266562+0000","last_active":"2023-10-08T16:24:22.268257+0000","last_peered":"2023-10-08T16:24:22.268257+0000","last_clean":"2023-10-08T16:24:22.268257+0000","last_became_active":"2023-10-08T16:24:22.265904+0000","last_became_peered":"2023-10-08T16:24:22.265904+0000","last_unstale":"2023-10-08T16:24:22.268257+0000","last_undegraded":"2023-10-08T16:24:22.268257+0000","last_fullsized":"2023-10-08T16:24:22.268257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:42.482305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.259013+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.259013+0000","last_peered":"2023-10-08T16:24:22.259013+0000","last_clean":"2023-10-08T16:24:22.259013+0000","last_became_active":"2023-10-08T16:24:21.269338+0000","last_became_peered":"2023-10-08T16:24:21.269338+0000","last_unstale":"2023-10-08T16:24:22.259013+0000","last_undegraded":"2023-10-08T16:24:22.259013+0000","last_fullsized":"2023-10-08T16:24:22.259013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:51.308472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276204+0000","last_change":"2023-10-08T16:24:22.264942+0000","last_active":"2023-10-08T16:24:22.276204+0000","last_peered":"2023-10-08T16:24:22.276204+0000","last_clean":"2023-10-08T16:24:22.276204+0000","last_became_active":"2023-10-08T16:24:22.264659+0000","last_became_peered":"2023-10-08T16:24:22.264659+0000","last_unstale":"2023-10-08T16:24:22.276204+0000","last_undegraded":"2023-10-08T16:24:22.276204+0000","last_fullsized":"2023-10-08T16:24:22.276204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:28.010725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256572+0000","last_change":"2023-10-08T16:24:21.266315+0000","last_active":"2023-10-08T16:24:22.256572+0000","last_peered":"2023-10-08T16:24:22.256572+0000","last_clean":"2023-10-08T16:24:22.256572+0000","last_became_active":"2023-10-08T16:24:21.266015+0000","last_became_peered":"2023-10-08T16:24:21.266015+0000","last_unstale":"2023-10-08T16:24:22.256572+0000","last_undegraded":"2023-10-08T16:24:22.256572+0000","last_fullsized":"2023-10-08T16:24:22.256572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:43.409719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276286+0000","last_change":"2023-10-08T16:24:22.270477+0000","last_active":"2023-10-08T16:24:22.276286+0000","last_peered":"2023-10-08T16:24:22.276286+0000","last_clean":"2023-10-08T16:24:22.276286+0000","last_became_active":"2023-10-08T16:24:22.270161+0000","last_became_peered":"2023-10-08T16:24:22.270161+0000","last_unstale":"2023-10-08T16:24:22.276286+0000","last_undegraded":"2023-10-08T16:24:22.276286+0000","last_fullsized":"2023-10-08T16:24:22.276286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:55.893986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257389+0000","last_change":"2023-10-08T16:24:21.272163+0000","last_active":"2023-10-08T16:24:22.257389+0000","last_peered":"2023-10-08T16:24:22.257389+0000","last_clean":"2023-10-08T16:24:22.257389+0000","last_became_active":"2023-10-08T16:24:21.271808+0000","last_became_peered":"2023-10-08T16:24:21.271808+0000","last_unstale":"2023-10-08T16:24:22.257389+0000","last_undegraded":"2023-10-08T16:24:22.257389+0000","last_fullsized":"2023-10-08T16:24:22.257389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.659785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277772+0000","last_change":"2023-10-08T16:24:22.271832+0000","last_active":"2023-10-08T16:24:22.277772+0000","last_peered":"2023-10-08T16:24:22.277772+0000","last_clean":"2023-10-08T16:24:22.277772+0000","last_became_active":"2023-10-08T16:24:22.271501+0000","last_became_peered":"2023-10-08T16:24:22.271501+0000","last_unstale":"2023-10-08T16:24:22.277772+0000","last_undegraded":"2023-10-08T16:24:22.277772+0000","last_fullsized":"2023-10-08T16:24:22.277772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:01.112062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256347+0000","last_change":"2023-10-08T16:24:21.274862+0000","last_active":"2023-10-08T16:24:22.256347+0000","last_peered":"2023-10-08T16:24:22.256347+0000","last_clean":"2023-10-08T16:24:22.256347+0000","last_became_active":"2023-10-08T16:24:21.274569+0000","last_became_peered":"2023-10-08T16:24:21.274569+0000","last_unstale":"2023-10-08T16:24:22.256347+0000","last_undegraded":"2023-10-08T16:24:22.256347+0000","last_fullsized":"2023-10-08T16:24:22.256347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.347897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276246+0000","last_change":"2023-10-08T16:24:22.266748+0000","last_active":"2023-10-08T16:24:22.276246+0000","last_peered":"2023-10-08T16:24:22.276246+0000","last_clean":"2023-10-08T16:24:22.276246+0000","last_became_active":"2023-10-08T16:24:22.266033+0000","last_became_peered":"2023-10-08T16:24:22.266033+0000","last_unstale":"2023-10-08T16:24:22.276246+0000","last_undegraded":"2023-10-08T16:24:22.276246+0000","last_fullsized":"2023-10-08T16:24:22.276246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:59.306851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258344+0000","last_change":"2023-10-08T16:24:21.262446+0000","last_active":"2023-10-08T16:24:22.258344+0000","last_peered":"2023-10-08T16:24:22.258344+0000","last_clean":"2023-10-08T16:24:22.258344+0000","last_became_active":"2023-10-08T16:24:21.262129+0000","last_became_peered":"2023-10-08T16:24:21.262129+0000","last_unstale":"2023-10-08T16:24:22.258344+0000","last_undegraded":"2023-10-08T16:24:22.258344+0000","last_fullsized":"2023-10-08T16:24:22.258344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:16.999817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285817+0000","last_change":"2023-10-08T16:24:22.276248+0000","last_active":"2023-10-08T16:24:22.285817+0000","last_peered":"2023-10-08T16:24:22.285817+0000","last_clean":"2023-10-08T16:24:22.285817+0000","last_became_active":"2023-10-08T16:24:22.275930+0000","last_became_peered":"2023-10-08T16:24:22.275930+0000","last_unstale":"2023-10-08T16:24:22.285817+0000","last_undegraded":"2023-10-08T16:24:22.285817+0000","last_fullsized":"2023-10-08T16:24:22.285817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258704+0000","last_change":"2023-10-08T16:24:21.269605+0000","last_active":"2023-10-08T16:24:22.258704+0000","last_peered":"2023-10-08T16:24:22.258704+0000","last_clean":"2023-10-08T16:24:22.258704+0000","last_became_active":"2023-10-08T16:24:21.269290+0000","last_became_peered":"2023-10-08T16:24:21.269290+0000","last_unstale":"2023-10-08T16:24:22.258704+0000","last_undegraded":"2023-10-08T16:24:22.258704+0000","last_fullsized":"2023-10-08T16:24:22.258704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:33.098477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'161","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.253357+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:24:22.253357+0000","last_peered":"2023-10-08T16:24:22.253357+0000","last_clean":"2023-10-08T16:24:22.253357+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:24:22.253357+0000","last_undegraded":"2023-10-08T16:24:22.253357+0000","last_fullsized":"2023-10-08T16:24:22.253357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307072,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064768,"statfs":{"total":96636764160,"available":96322322432,"internally_reserved":0,"allocated":1630208,"data_stored":1084462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.48699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":1.103},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":1.089},"last":0.441}]},{"osd":1,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.63900000000000001,"5min":0.49299999999999999,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.70299999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":0.997,"15min":1.1160000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98099999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97599999999999998,"5min":1.032,"15min":1.1000000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":1.006},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.61699999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.79700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":1.234},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.437},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.3919999999999999},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.44900000000000001,"5min":0.434,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.3680000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70799999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.4319999999999999},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0409999999999999,"15min":1.323},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48099999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.448},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306484,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065356,"statfs":{"total":96636764160,"available":96322924544,"internally_reserved":0,"allocated":1028096,"data_stored":493934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.96399999999999997,"15min":1.125},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.58499999999999996,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.73899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.55700000000000005,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":1.365},"last":0.623},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.54200000000000004,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":1.0549999999999999},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.72099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.552},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.68500000000000005,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.94299999999999995,"5min":1.034,"15min":1.4570000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0149999999999999,"15min":1.069},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.619},"last":0.82799999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":1.272,"15min":1.272},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069448,"statfs":{"total":96636764160,"available":96327114752,"internally_reserved":0,"allocated":1032192,"data_stored":494024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.873,"15min":0.873},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.36299999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.437},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.472},"last":0.41799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.64500000000000002,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.373},"last":0.745},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.81999999999999995,"15min":0.79800000000000004},"min":{"1min":0.65900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0680000000000001,"5min":1.2230000000000001,"15min":1.375},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.276},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.80600000000000005},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.107,"15min":1.224},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.429},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81399999999999995},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.52200000000000002},"max":{"1min":1.0840000000000001,"5min":1.2909999999999999,"15min":1.391},"last":0.73299999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99299999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":0.95899999999999996,"5min":1.0960000000000001,"15min":1.514},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1638400,"data_stored":1086392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.748,"5min":1.1339999999999999,"15min":1.524},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.442,"5min":0.374,"15min":0.36199999999999999},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":1.679},"last":0.46300000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":1.093,"15min":1.5569999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.72599999999999998,"5min":0.878,"15min":1.371},"last":0.435},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.54700000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":1.21,"15min":1.2470000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.46400000000000002},"max":{"1min":1.054,"5min":1.1899999999999999,"15min":1.325},"last":0.77000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81799999999999995,"15min":0.79900000000000004},"min":{"1min":0.65900000000000003,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.083,"5min":1.1439999999999999,"15min":1.153},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57099999999999995},"max":{"1min":1.0720000000000001,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.77900000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.52900000000000003},"max":{"1min":1.149,"5min":1.1950000000000001,"15min":1.288},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.212,"15min":1.262},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.624,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.163,"5min":1.202,"15min":1.4079999999999999},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67300000000000004,"5min":1.046,"15min":1.046},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.51300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.747,"5min":1.1160000000000001,"15min":1.448},"last":0.53000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.056,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80900000000000005,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":1.321,"15min":1.3959999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82499999999999996,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0980000000000001,"5min":1.4410000000000001,"15min":1.734},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.272,"15min":1.655},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.83899999999999997},"last":0.38},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.90200000000000002},"last":0.56699999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.41599999999999998,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.47299999999999998,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.52200000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.55600000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.77900000000000003,"5min":1,"15min":1},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.50700000000000001,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":1.04,"15min":1.2789999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.51100000000000001},"max":{"1min":0.95299999999999996,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.66200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.3200000000000001},"last":0.79500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.64500000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.397},"last":0.88200000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.153,"15min":1.306},"last":0.749},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.63900000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.321},"last":0.85399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":495470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.0069999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.62,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.997,"5min":1.012,"15min":1.012},"last":0.70399999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.379},"max":{"1min":1.0640000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.78200000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.109,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.753},"min":{"1min":0.64300000000000002,"5min":0.47999999999999998,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.216},"last":0.76000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.72599999999999998,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1479999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0980000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.73499999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.44400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0149999999999999,"5min":1.47,"15min":1.47},"last":0.879},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":1.0169999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67200000000000004,"15min":0.64700000000000002},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":1.0409999999999999,"5min":2.661,"15min":2.661},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0860000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.92000000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.054},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0660000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310588,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061252,"statfs":{"total":96636764160,"available":96318722048,"internally_reserved":0,"allocated":1036288,"data_stored":494558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.754,"15min":0.72199999999999998},"min":{"1min":0.48999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.92900000000000005,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.54700000000000004,"5min":0.308,"15min":0.308},"max":{"1min":1.0780000000000001,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.73799999999999999,"15min":0.751},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0169999999999999,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.73699999999999999,"15min":0.73399999999999999},"min":{"1min":0.58099999999999996,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.94899999999999995,"5min":1.05,"15min":1.05},"last":0.44600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.47999999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90000000000000002,"5min":0.97599999999999998,"15min":1.121},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.755,"15min":0.74299999999999999},"min":{"1min":0.59499999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90800000000000003,"5min":4.931,"15min":4.931},"last":0.72499999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.752,"15min":0.755},"min":{"1min":0.55300000000000005,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98099999999999998,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.77200000000000002,"15min":0.78200000000000003},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":0.98299999999999998,"5min":1.96,"15min":1.96},"last":0.70299999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.67200000000000004,"15min":0.63900000000000001},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.88600000000000001,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.68899999999999995},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":0.93799999999999994,"5min":2.024,"15min":2.024},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75700000000000001,"15min":0.72299999999999998},"min":{"1min":0.47299999999999998,"5min":0.46200000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":1.0029999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:23:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76600000000000001,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.497,"15min":0.436},"max":{"1min":1.0660000000000001,"5min":2.157,"15min":2.157},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.52700000000000002,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":0.94199999999999995,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.84399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:24:31.634 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:24:31.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.833+0000 7f16ce39d700 1 Processor -- start 2023-10-08T16:24:31.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.833+0000 7f16ce39d700 1 -- start start 2023-10-08T16:24:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.834+0000 7f16ce39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16c8153c30 0x7f16c815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.834+0000 7f16ce39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.834+0000 7f16ce39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c815afd0 con 0x7f16c80cef40 2023-10-08T16:24:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.834+0000 7f16ce39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c815b2b0 con 0x7f16c8153c30 2023-10-08T16:24:31.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.834+0000 7f16ce39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c815b590 con 0x7f16c815de50 2023-10-08T16:24:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16cd39b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f16c8153c30 0x7f16c815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:34680/0 (socket says 172.21.15.12:34680) 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 -- 172.21.15.12:0/940922561 learned_addr learned my addr 172.21.15.12:0/940922561 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16bffff700 1 -- 172.21.15.12:0/940922561 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436985724 0 0) 0x7f16c815afd0 con 0x7f16c80cef40 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16bffff700 1 -- 172.21.15.12:0/940922561 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b4003570 con 0x7f16c80cef40 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 -- 172.21.15.12:0/940922561 >> v2:172.21.15.29:3300/0 conn(0x7f16c8153c30 msgr2=0x7f16c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 --2- 172.21.15.12:0/940922561 >> v2:172.21.15.29:3300/0 conn(0x7f16c8153c30 0x7f16c815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 -- 172.21.15.12:0/940922561 >> v1:172.21.15.29:6789/0 conn(0x7f16c80cef40 legacy=0x7f16c806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.835+0000 7f16ccb9a700 1 -- 172.21.15.12:0/940922561 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c815b870 con 0x7f16c815de50 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16ccb9a700 1 --2- 172.21.15.12:0/940922561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16b80099b0 tx=0x7f16b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c3f9feed93c38c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16bffff700 1 -- 172.21.15.12:0/940922561 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800b680 con 0x7f16c815de50 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16bffff700 1 -- 172.21.15.12:0/940922561 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b800b7e0 con 0x7f16c815de50 2023-10-08T16:24:31.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16bffff700 1 -- 172.21.15.12:0/940922561 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800bb80 con 0x7f16c815de50 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16ce39d700 1 -- 172.21.15.12:0/940922561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 msgr2=0x7f16c80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16ce39d700 1 --2- 172.21.15.12:0/940922561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f16b80099b0 tx=0x7f16b8009250 comp rx=0 tx=0).stop 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16ce39d700 1 -- 172.21.15.12:0/940922561 shutdown_connections 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.836+0000 7f16ce39d700 1 --2- 172.21.15.12:0/940922561 >> v2:172.21.15.29:3300/0 conn(0x7f16c8153c30 0x7f16c815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.837+0000 7f16ce39d700 1 --2- 172.21.15.12:0/940922561 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c815de50 0x7f16c80cea00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.837+0000 7f16ce39d700 1 -- 172.21.15.12:0/940922561 >> 172.21.15.12:0/940922561 conn(0x7f16c80703a0 msgr2=0x7f16c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.837+0000 7f16ce39d700 1 -- 172.21.15.12:0/940922561 shutdown_connections 2023-10-08T16:24:31.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.837+0000 7f16ce39d700 1 -- 172.21.15.12:0/940922561 wait complete. 2023-10-08T16:24:31.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.838+0000 7f16ce39d700 1 Processor -- start 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.838+0000 7f16ce39d700 1 -- start start 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16c80cef40 0x7f16c80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c8153c30 0x7f16c80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80b4710 con 0x7f16c815de50 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8140a70 con 0x7f16c80cef40 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16ce39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80b3b00 con 0x7f16c8153c30 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16cdb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16cdb9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44376/0 (socket says 172.21.15.12:44376) 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.839+0000 7f16cdb9c700 1 -- 172.21.15.12:0/3287584818 learned_addr learned my addr 172.21.15.12:0/3287584818 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16ccb9a700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c8153c30 0x7f16c80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cd39b700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16c80cef40 0x7f16c80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 -- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c8153c30 msgr2=0x7f16c80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c8153c30 0x7f16c80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 -- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16c80cef40 msgr2=0x7f16c80b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16c80cef40 0x7f16c80b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:31.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 -- 172.21.15.12:0/3287584818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b80094f0 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16cdb9c700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c860 tx=0x7f16c0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0002030 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16c00021b0 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0012630 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.840+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c80b3de0 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.841+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c80b43a0 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.841+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c804c3c0 con 0x7f16c815de50 2023-10-08T16:24:31.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.842+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16c0012a20 con 0x7f16c815de50 2023-10-08T16:24:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.843+0000 7f16bd7fa700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.843+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f16c0084670 con 0x7f16c815de50 2023-10-08T16:24:31.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.843+0000 7f16cd39b700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:31.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.844+0000 7f16cd39b700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009db0 tx=0x7f16c40091a0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:31.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:31.848+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16c00516b0 con 0x7f16c815de50 2023-10-08T16:24:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.047+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16c80caef0 con 0x7f16ac066f30 2023-10-08T16:24:32.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.056+0000 7f16bd7fa700 1 -- 172.21.15.12:0/3287584818 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288762 (secure 0 0 0) 0x7f16c80caef0 con 0x7f16ac066f30 2023-10-08T16:24:32.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:32.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 msgr2=0x7f16ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 0x7f16ac0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16c4009db0 tx=0x7f16c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 msgr2=0x7f16c80c7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f16c000c860 tx=0x7f16c0002700 comp rx=0 tx=0).stop 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 shutdown_connections 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f16ac066f30 0x7f16ac0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f16c815de50 0x7f16c80c7b20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f16c80cef40 0x7f16c80b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 --2- 172.21.15.12:0/3287584818 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f16c8153c30 0x7f16c80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 >> 172.21.15.12:0/3287584818 conn(0x7f16c80703a0 msgr2=0x7f16c8153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 shutdown_connections 2023-10-08T16:24:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.061+0000 7f16ce39d700 1 -- 172.21.15.12:0/3287584818 wait complete. 2023-10-08T16:24:32.065 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:24:32.079 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:24:31.713984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2436712,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752538008,"statfs":{"total":773094113280,"available":770598920192,"internally_reserved":0,"allocated":9478144,"data_stored":5136820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.463259"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279439+0000","last_change":"2023-10-08T16:24:22.277197+0000","last_active":"2023-10-08T16:24:22.279439+0000","last_peered":"2023-10-08T16:24:22.279439+0000","last_clean":"2023-10-08T16:24:22.279439+0000","last_became_active":"2023-10-08T16:24:22.276948+0000","last_became_peered":"2023-10-08T16:24:22.276948+0000","last_unstale":"2023-10-08T16:24:22.279439+0000","last_undegraded":"2023-10-08T16:24:22.279439+0000","last_fullsized":"2023-10-08T16:24:22.279439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:34.105560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276230+0000","last_change":"2023-10-08T16:24:22.272185+0000","last_active":"2023-10-08T16:24:22.276230+0000","last_peered":"2023-10-08T16:24:22.276230+0000","last_clean":"2023-10-08T16:24:22.276230+0000","last_became_active":"2023-10-08T16:24:22.271833+0000","last_became_peered":"2023-10-08T16:24:22.271833+0000","last_unstale":"2023-10-08T16:24:22.276230+0000","last_undegraded":"2023-10-08T16:24:22.276230+0000","last_fullsized":"2023-10-08T16:24:22.276230+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:57:49.759070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270545+0000","last_change":"2023-10-08T16:24:22.265947+0000","last_active":"2023-10-08T16:24:22.270545+0000","last_peered":"2023-10-08T16:24:22.270545+0000","last_clean":"2023-10-08T16:24:22.270545+0000","last_became_active":"2023-10-08T16:24:22.265661+0000","last_became_peered":"2023-10-08T16:24:22.265661+0000","last_unstale":"2023-10-08T16:24:22.270545+0000","last_undegraded":"2023-10-08T16:24:22.270545+0000","last_fullsized":"2023-10-08T16:24:22.270545+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:16.359492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269363+0000","last_change":"2023-10-08T16:24:22.267456+0000","last_active":"2023-10-08T16:24:22.269363+0000","last_peered":"2023-10-08T16:24:22.269363+0000","last_clean":"2023-10-08T16:24:22.269363+0000","last_became_active":"2023-10-08T16:24:22.267053+0000","last_became_peered":"2023-10-08T16:24:22.267053+0000","last_unstale":"2023-10-08T16:24:22.269363+0000","last_undegraded":"2023-10-08T16:24:22.269363+0000","last_fullsized":"2023-10-08T16:24:22.269363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:05:14.141525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273040+0000","last_change":"2023-10-08T16:24:22.268960+0000","last_active":"2023-10-08T16:24:22.273040+0000","last_peered":"2023-10-08T16:24:22.273040+0000","last_clean":"2023-10-08T16:24:22.273040+0000","last_became_active":"2023-10-08T16:24:22.268672+0000","last_became_peered":"2023-10-08T16:24:22.268672+0000","last_unstale":"2023-10-08T16:24:22.273040+0000","last_undegraded":"2023-10-08T16:24:22.273040+0000","last_fullsized":"2023-10-08T16:24:22.273040+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285247+0000","last_change":"2023-10-08T16:24:22.278307+0000","last_active":"2023-10-08T16:24:22.285247+0000","last_peered":"2023-10-08T16:24:22.285247+0000","last_clean":"2023-10-08T16:24:22.285247+0000","last_became_active":"2023-10-08T16:24:22.278008+0000","last_became_peered":"2023-10-08T16:24:22.278008+0000","last_unstale":"2023-10-08T16:24:22.285247+0000","last_undegraded":"2023-10-08T16:24:22.285247+0000","last_fullsized":"2023-10-08T16:24:22.285247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:38:17.572758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268810+0000","last_change":"2023-10-08T16:24:22.264950+0000","last_active":"2023-10-08T16:24:22.268810+0000","last_peered":"2023-10-08T16:24:22.268810+0000","last_clean":"2023-10-08T16:24:22.268810+0000","last_became_active":"2023-10-08T16:24:22.264669+0000","last_became_peered":"2023-10-08T16:24:22.264669+0000","last_unstale":"2023-10-08T16:24:22.268810+0000","last_undegraded":"2023-10-08T16:24:22.268810+0000","last_fullsized":"2023-10-08T16:24:22.268810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:16.792997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276564+0000","last_change":"2023-10-08T16:24:22.266527+0000","last_active":"2023-10-08T16:24:22.276564+0000","last_peered":"2023-10-08T16:24:22.276564+0000","last_clean":"2023-10-08T16:24:22.276564+0000","last_became_active":"2023-10-08T16:24:22.266294+0000","last_became_peered":"2023-10-08T16:24:22.266294+0000","last_unstale":"2023-10-08T16:24:22.276564+0000","last_undegraded":"2023-10-08T16:24:22.276564+0000","last_fullsized":"2023-10-08T16:24:22.276564+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:17.676375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.271560+0000","last_change":"2023-10-08T16:24:22.265239+0000","last_active":"2023-10-08T16:24:22.271560+0000","last_peered":"2023-10-08T16:24:22.271560+0000","last_clean":"2023-10-08T16:24:22.271560+0000","last_became_active":"2023-10-08T16:24:22.264857+0000","last_became_peered":"2023-10-08T16:24:22.264857+0000","last_unstale":"2023-10-08T16:24:22.271560+0000","last_undegraded":"2023-10-08T16:24:22.271560+0000","last_fullsized":"2023-10-08T16:24:22.271560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:52.593242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277883+0000","last_change":"2023-10-08T16:24:22.274287+0000","last_active":"2023-10-08T16:24:22.277883+0000","last_peered":"2023-10-08T16:24:22.277883+0000","last_clean":"2023-10-08T16:24:22.277883+0000","last_became_active":"2023-10-08T16:24:22.273777+0000","last_became_peered":"2023-10-08T16:24:22.273777+0000","last_unstale":"2023-10-08T16:24:22.277883+0000","last_undegraded":"2023-10-08T16:24:22.277883+0000","last_fullsized":"2023-10-08T16:24:22.277883+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:59:33.821077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286835+0000","last_change":"2023-10-08T16:24:22.279365+0000","last_active":"2023-10-08T16:24:22.286835+0000","last_peered":"2023-10-08T16:24:22.286835+0000","last_clean":"2023-10-08T16:24:22.286835+0000","last_became_active":"2023-10-08T16:24:22.279112+0000","last_became_peered":"2023-10-08T16:24:22.279112+0000","last_unstale":"2023-10-08T16:24:22.286835+0000","last_undegraded":"2023-10-08T16:24:22.286835+0000","last_fullsized":"2023-10-08T16:24:22.286835+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276348+0000","last_change":"2023-10-08T16:24:22.274687+0000","last_active":"2023-10-08T16:24:22.276348+0000","last_peered":"2023-10-08T16:24:22.276348+0000","last_clean":"2023-10-08T16:24:22.276348+0000","last_became_active":"2023-10-08T16:24:22.274377+0000","last_became_peered":"2023-10-08T16:24:22.274377+0000","last_unstale":"2023-10-08T16:24:22.276348+0000","last_undegraded":"2023-10-08T16:24:22.276348+0000","last_fullsized":"2023-10-08T16:24:22.276348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:24.050092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275854+0000","last_change":"2023-10-08T16:24:22.273849+0000","last_active":"2023-10-08T16:24:22.275854+0000","last_peered":"2023-10-08T16:24:22.275854+0000","last_clean":"2023-10-08T16:24:22.275854+0000","last_became_active":"2023-10-08T16:24:22.273585+0000","last_became_peered":"2023-10-08T16:24:22.273585+0000","last_unstale":"2023-10-08T16:24:22.275854+0000","last_undegraded":"2023-10-08T16:24:22.275854+0000","last_fullsized":"2023-10-08T16:24:22.275854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:52.315555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270239+0000","last_change":"2023-10-08T16:24:22.268393+0000","last_active":"2023-10-08T16:24:22.270239+0000","last_peered":"2023-10-08T16:24:22.270239+0000","last_clean":"2023-10-08T16:24:22.270239+0000","last_became_active":"2023-10-08T16:24:22.268113+0000","last_became_peered":"2023-10-08T16:24:22.268113+0000","last_unstale":"2023-10-08T16:24:22.270239+0000","last_undegraded":"2023-10-08T16:24:22.270239+0000","last_fullsized":"2023-10-08T16:24:22.270239+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:48.879575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273195+0000","last_change":"2023-10-08T16:24:22.271625+0000","last_active":"2023-10-08T16:24:22.273195+0000","last_peered":"2023-10-08T16:24:22.273195+0000","last_clean":"2023-10-08T16:24:22.273195+0000","last_became_active":"2023-10-08T16:24:22.271354+0000","last_became_peered":"2023-10-08T16:24:22.271354+0000","last_unstale":"2023-10-08T16:24:22.273195+0000","last_undegraded":"2023-10-08T16:24:22.273195+0000","last_fullsized":"2023-10-08T16:24:22.273195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:20.137541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284637+0000","last_change":"2023-10-08T16:24:22.276137+0000","last_active":"2023-10-08T16:24:22.284637+0000","last_peered":"2023-10-08T16:24:22.284637+0000","last_clean":"2023-10-08T16:24:22.284637+0000","last_became_active":"2023-10-08T16:24:22.275888+0000","last_became_peered":"2023-10-08T16:24:22.275888+0000","last_unstale":"2023-10-08T16:24:22.284637+0000","last_undegraded":"2023-10-08T16:24:22.284637+0000","last_fullsized":"2023-10-08T16:24:22.284637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:20.213695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277280+0000","last_change":"2023-10-08T16:24:22.268139+0000","last_active":"2023-10-08T16:24:22.277280+0000","last_peered":"2023-10-08T16:24:22.277280+0000","last_clean":"2023-10-08T16:24:22.277280+0000","last_became_active":"2023-10-08T16:24:22.267883+0000","last_became_peered":"2023-10-08T16:24:22.267883+0000","last_unstale":"2023-10-08T16:24:22.277280+0000","last_undegraded":"2023-10-08T16:24:22.277280+0000","last_fullsized":"2023-10-08T16:24:22.277280+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:10:03.340507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269724+0000","last_change":"2023-10-08T16:24:22.264405+0000","last_active":"2023-10-08T16:24:22.269724+0000","last_peered":"2023-10-08T16:24:22.269724+0000","last_clean":"2023-10-08T16:24:22.269724+0000","last_became_active":"2023-10-08T16:24:22.264086+0000","last_became_peered":"2023-10-08T16:24:22.264086+0000","last_unstale":"2023-10-08T16:24:22.269724+0000","last_undegraded":"2023-10-08T16:24:22.269724+0000","last_fullsized":"2023-10-08T16:24:22.269724+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:03:38.493207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.279408+0000","last_change":"2023-10-08T16:24:22.277792+0000","last_active":"2023-10-08T16:24:22.279408+0000","last_peered":"2023-10-08T16:24:22.279408+0000","last_clean":"2023-10-08T16:24:22.279408+0000","last_became_active":"2023-10-08T16:24:22.277523+0000","last_became_peered":"2023-10-08T16:24:22.277523+0000","last_unstale":"2023-10-08T16:24:22.279408+0000","last_undegraded":"2023-10-08T16:24:22.279408+0000","last_fullsized":"2023-10-08T16:24:22.279408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:31.347826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276472+0000","last_change":"2023-10-08T16:24:22.267275+0000","last_active":"2023-10-08T16:24:22.276472+0000","last_peered":"2023-10-08T16:24:22.276472+0000","last_clean":"2023-10-08T16:24:22.276472+0000","last_became_active":"2023-10-08T16:24:22.266980+0000","last_became_peered":"2023-10-08T16:24:22.266980+0000","last_unstale":"2023-10-08T16:24:22.276472+0000","last_undegraded":"2023-10-08T16:24:22.276472+0000","last_fullsized":"2023-10-08T16:24:22.276472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:46.525162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273571+0000","last_change":"2023-10-08T16:24:22.268840+0000","last_active":"2023-10-08T16:24:22.273571+0000","last_peered":"2023-10-08T16:24:22.273571+0000","last_clean":"2023-10-08T16:24:22.273571+0000","last_became_active":"2023-10-08T16:24:22.268515+0000","last_became_peered":"2023-10-08T16:24:22.268515+0000","last_unstale":"2023-10-08T16:24:22.273571+0000","last_undegraded":"2023-10-08T16:24:22.273571+0000","last_fullsized":"2023-10-08T16:24:22.273571+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286296+0000","last_change":"2023-10-08T16:24:22.281335+0000","last_active":"2023-10-08T16:24:22.286296+0000","last_peered":"2023-10-08T16:24:22.286296+0000","last_clean":"2023-10-08T16:24:22.286296+0000","last_became_active":"2023-10-08T16:24:22.280628+0000","last_became_peered":"2023-10-08T16:24:22.280628+0000","last_unstale":"2023-10-08T16:24:22.286296+0000","last_undegraded":"2023-10-08T16:24:22.286296+0000","last_fullsized":"2023-10-08T16:24:22.286296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:43:50.269676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274998+0000","last_change":"2023-10-08T16:24:22.269330+0000","last_active":"2023-10-08T16:24:22.274998+0000","last_peered":"2023-10-08T16:24:22.274998+0000","last_clean":"2023-10-08T16:24:22.274998+0000","last_became_active":"2023-10-08T16:24:22.268739+0000","last_became_peered":"2023-10-08T16:24:22.268739+0000","last_unstale":"2023-10-08T16:24:22.274998+0000","last_undegraded":"2023-10-08T16:24:22.274998+0000","last_fullsized":"2023-10-08T16:24:22.274998+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:10.064373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.274637+0000","last_change":"2023-10-08T16:24:22.272832+0000","last_active":"2023-10-08T16:24:22.274637+0000","last_peered":"2023-10-08T16:24:22.274637+0000","last_clean":"2023-10-08T16:24:22.274637+0000","last_became_active":"2023-10-08T16:24:22.272557+0000","last_became_peered":"2023-10-08T16:24:22.272557+0000","last_unstale":"2023-10-08T16:24:22.274637+0000","last_undegraded":"2023-10-08T16:24:22.274637+0000","last_fullsized":"2023-10-08T16:24:22.274637+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:33.967737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273074+0000","last_change":"2023-10-08T16:24:22.270188+0000","last_active":"2023-10-08T16:24:22.273074+0000","last_peered":"2023-10-08T16:24:22.273074+0000","last_clean":"2023-10-08T16:24:22.273074+0000","last_became_active":"2023-10-08T16:24:22.269890+0000","last_became_peered":"2023-10-08T16:24:22.269890+0000","last_unstale":"2023-10-08T16:24:22.273074+0000","last_undegraded":"2023-10-08T16:24:22.273074+0000","last_fullsized":"2023-10-08T16:24:22.273074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:34.696485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275378+0000","last_change":"2023-10-08T16:24:22.271452+0000","last_active":"2023-10-08T16:24:22.275378+0000","last_peered":"2023-10-08T16:24:22.275378+0000","last_clean":"2023-10-08T16:24:22.275378+0000","last_became_active":"2023-10-08T16:24:22.270407+0000","last_became_peered":"2023-10-08T16:24:22.270407+0000","last_unstale":"2023-10-08T16:24:22.275378+0000","last_undegraded":"2023-10-08T16:24:22.275378+0000","last_fullsized":"2023-10-08T16:24:22.275378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:11.469843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285036+0000","last_change":"2023-10-08T16:24:22.275414+0000","last_active":"2023-10-08T16:24:22.285036+0000","last_peered":"2023-10-08T16:24:22.285036+0000","last_clean":"2023-10-08T16:24:22.285036+0000","last_became_active":"2023-10-08T16:24:22.275138+0000","last_became_peered":"2023-10-08T16:24:22.275138+0000","last_unstale":"2023-10-08T16:24:22.285036+0000","last_undegraded":"2023-10-08T16:24:22.285036+0000","last_fullsized":"2023-10-08T16:24:22.285036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:56.116579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277991+0000","last_change":"2023-10-08T16:24:22.275499+0000","last_active":"2023-10-08T16:24:22.277991+0000","last_peered":"2023-10-08T16:24:22.277991+0000","last_clean":"2023-10-08T16:24:22.277991+0000","last_became_active":"2023-10-08T16:24:22.275240+0000","last_became_peered":"2023-10-08T16:24:22.275240+0000","last_unstale":"2023-10-08T16:24:22.277991+0000","last_undegraded":"2023-10-08T16:24:22.277991+0000","last_fullsized":"2023-10-08T16:24:22.277991+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:17:44.317794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276179+0000","last_change":"2023-10-08T16:24:22.268011+0000","last_active":"2023-10-08T16:24:22.276179+0000","last_peered":"2023-10-08T16:24:22.276179+0000","last_clean":"2023-10-08T16:24:22.276179+0000","last_became_active":"2023-10-08T16:24:22.267685+0000","last_became_peered":"2023-10-08T16:24:22.267685+0000","last_unstale":"2023-10-08T16:24:22.276179+0000","last_undegraded":"2023-10-08T16:24:22.276179+0000","last_fullsized":"2023-10-08T16:24:22.276179+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:29.063975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270329+0000","last_change":"2023-10-08T16:24:22.266566+0000","last_active":"2023-10-08T16:24:22.270329+0000","last_peered":"2023-10-08T16:24:22.270329+0000","last_clean":"2023-10-08T16:24:22.270329+0000","last_became_active":"2023-10-08T16:24:22.266154+0000","last_became_peered":"2023-10-08T16:24:22.266154+0000","last_unstale":"2023-10-08T16:24:22.270329+0000","last_undegraded":"2023-10-08T16:24:22.270329+0000","last_fullsized":"2023-10-08T16:24:22.270329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:13.350748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273243+0000","last_change":"2023-10-08T16:24:22.270956+0000","last_active":"2023-10-08T16:24:22.273243+0000","last_peered":"2023-10-08T16:24:22.273243+0000","last_clean":"2023-10-08T16:24:22.273243+0000","last_became_active":"2023-10-08T16:24:22.270612+0000","last_became_peered":"2023-10-08T16:24:22.270612+0000","last_unstale":"2023-10-08T16:24:22.273243+0000","last_undegraded":"2023-10-08T16:24:22.273243+0000","last_fullsized":"2023-10-08T16:24:22.273243+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:50.861372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286636+0000","last_change":"2023-10-08T16:24:22.282687+0000","last_active":"2023-10-08T16:24:22.286636+0000","last_peered":"2023-10-08T16:24:22.286636+0000","last_clean":"2023-10-08T16:24:22.286636+0000","last_became_active":"2023-10-08T16:24:22.282416+0000","last_became_peered":"2023-10-08T16:24:22.282416+0000","last_unstale":"2023-10-08T16:24:22.286636+0000","last_undegraded":"2023-10-08T16:24:22.286636+0000","last_fullsized":"2023-10-08T16:24:22.286636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:18.006900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.273784+0000","last_change":"2023-10-08T16:24:22.270422+0000","last_active":"2023-10-08T16:24:22.273784+0000","last_peered":"2023-10-08T16:24:22.273784+0000","last_clean":"2023-10-08T16:24:22.273784+0000","last_became_active":"2023-10-08T16:24:22.270165+0000","last_became_peered":"2023-10-08T16:24:22.270165+0000","last_unstale":"2023-10-08T16:24:22.273784+0000","last_undegraded":"2023-10-08T16:24:22.273784+0000","last_fullsized":"2023-10-08T16:24:22.273784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:54:07.486766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289512+0000","last_change":"2023-10-08T16:24:21.269557+0000","last_active":"2023-10-08T16:24:22.289512+0000","last_peered":"2023-10-08T16:24:22.289512+0000","last_clean":"2023-10-08T16:24:22.289512+0000","last_became_active":"2023-10-08T16:24:21.269263+0000","last_became_peered":"2023-10-08T16:24:21.269263+0000","last_unstale":"2023-10-08T16:24:22.289512+0000","last_undegraded":"2023-10-08T16:24:22.289512+0000","last_fullsized":"2023-10-08T16:24:22.289512+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:42:22.448478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288128+0000","last_change":"2023-10-08T16:24:22.282422+0000","last_active":"2023-10-08T16:24:22.288128+0000","last_peered":"2023-10-08T16:24:22.288128+0000","last_clean":"2023-10-08T16:24:22.288128+0000","last_became_active":"2023-10-08T16:24:22.280622+0000","last_became_peered":"2023-10-08T16:24:22.280622+0000","last_unstale":"2023-10-08T16:24:22.288128+0000","last_undegraded":"2023-10-08T16:24:22.288128+0000","last_fullsized":"2023-10-08T16:24:22.288128+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:08.510753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291323+0000","last_change":"2023-10-08T16:24:21.271687+0000","last_active":"2023-10-08T16:24:22.291323+0000","last_peered":"2023-10-08T16:24:22.291323+0000","last_clean":"2023-10-08T16:24:22.291323+0000","last_became_active":"2023-10-08T16:24:21.271411+0000","last_became_peered":"2023-10-08T16:24:21.271411+0000","last_unstale":"2023-10-08T16:24:22.291323+0000","last_undegraded":"2023-10-08T16:24:22.291323+0000","last_fullsized":"2023-10-08T16:24:22.291323+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:42.094517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285309+0000","last_change":"2023-10-08T16:24:22.274100+0000","last_active":"2023-10-08T16:24:22.285309+0000","last_peered":"2023-10-08T16:24:22.285309+0000","last_clean":"2023-10-08T16:24:22.285309+0000","last_became_active":"2023-10-08T16:24:22.273194+0000","last_became_peered":"2023-10-08T16:24:22.273194+0000","last_unstale":"2023-10-08T16:24:22.285309+0000","last_undegraded":"2023-10-08T16:24:22.285309+0000","last_fullsized":"2023-10-08T16:24:22.285309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:45.645647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.288547+0000","last_change":"2023-10-08T16:24:21.276710+0000","last_active":"2023-10-08T16:24:22.288547+0000","last_peered":"2023-10-08T16:24:22.288547+0000","last_clean":"2023-10-08T16:24:22.288547+0000","last_became_active":"2023-10-08T16:24:21.276424+0000","last_became_peered":"2023-10-08T16:24:21.276424+0000","last_unstale":"2023-10-08T16:24:22.288547+0000","last_undegraded":"2023-10-08T16:24:22.288547+0000","last_fullsized":"2023-10-08T16:24:22.288547+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:49.830827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268952+0000","last_change":"2023-10-08T16:24:22.266933+0000","last_active":"2023-10-08T16:24:22.268952+0000","last_peered":"2023-10-08T16:24:22.268952+0000","last_clean":"2023-10-08T16:24:22.268952+0000","last_became_active":"2023-10-08T16:24:22.266234+0000","last_became_peered":"2023-10-08T16:24:22.266234+0000","last_unstale":"2023-10-08T16:24:22.268952+0000","last_undegraded":"2023-10-08T16:24:22.268952+0000","last_fullsized":"2023-10-08T16:24:22.268952+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:48.647506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286651+0000","last_change":"2023-10-08T16:24:21.267216+0000","last_active":"2023-10-08T16:24:22.286651+0000","last_peered":"2023-10-08T16:24:22.286651+0000","last_clean":"2023-10-08T16:24:22.286651+0000","last_became_active":"2023-10-08T16:24:21.266898+0000","last_became_peered":"2023-10-08T16:24:21.266898+0000","last_unstale":"2023-10-08T16:24:22.286651+0000","last_undegraded":"2023-10-08T16:24:22.286651+0000","last_fullsized":"2023-10-08T16:24:22.286651+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:56.136628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285851+0000","last_change":"2023-10-08T16:24:22.278368+0000","last_active":"2023-10-08T16:24:22.285851+0000","last_peered":"2023-10-08T16:24:22.285851+0000","last_clean":"2023-10-08T16:24:22.285851+0000","last_became_active":"2023-10-08T16:24:22.277968+0000","last_became_peered":"2023-10-08T16:24:22.277968+0000","last_unstale":"2023-10-08T16:24:22.285851+0000","last_undegraded":"2023-10-08T16:24:22.285851+0000","last_fullsized":"2023-10-08T16:24:22.285851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:33:28.517572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284459+0000","last_change":"2023-10-08T16:24:21.260127+0000","last_active":"2023-10-08T16:24:22.284459+0000","last_peered":"2023-10-08T16:24:22.284459+0000","last_clean":"2023-10-08T16:24:22.284459+0000","last_became_active":"2023-10-08T16:24:21.259831+0000","last_became_peered":"2023-10-08T16:24:21.259831+0000","last_unstale":"2023-10-08T16:24:22.284459+0000","last_undegraded":"2023-10-08T16:24:22.284459+0000","last_fullsized":"2023-10-08T16:24:22.284459+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.879845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276157+0000","last_change":"2023-10-08T16:24:22.267391+0000","last_active":"2023-10-08T16:24:22.276157+0000","last_peered":"2023-10-08T16:24:22.276157+0000","last_clean":"2023-10-08T16:24:22.276157+0000","last_became_active":"2023-10-08T16:24:22.267088+0000","last_became_peered":"2023-10-08T16:24:22.267088+0000","last_unstale":"2023-10-08T16:24:22.276157+0000","last_undegraded":"2023-10-08T16:24:22.276157+0000","last_fullsized":"2023-10-08T16:24:22.276157+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:32:26.983593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286744+0000","last_change":"2023-10-08T16:24:21.275128+0000","last_active":"2023-10-08T16:24:22.286744+0000","last_peered":"2023-10-08T16:24:22.286744+0000","last_clean":"2023-10-08T16:24:22.286744+0000","last_became_active":"2023-10-08T16:24:21.274777+0000","last_became_peered":"2023-10-08T16:24:21.274777+0000","last_unstale":"2023-10-08T16:24:22.286744+0000","last_undegraded":"2023-10-08T16:24:22.286744+0000","last_fullsized":"2023-10-08T16:24:22.286744+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:42.367439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275897+0000","last_change":"2023-10-08T16:24:22.274541+0000","last_active":"2023-10-08T16:24:22.275897+0000","last_peered":"2023-10-08T16:24:22.275897+0000","last_clean":"2023-10-08T16:24:22.275897+0000","last_became_active":"2023-10-08T16:24:22.274230+0000","last_became_peered":"2023-10-08T16:24:22.274230+0000","last_unstale":"2023-10-08T16:24:22.275897+0000","last_undegraded":"2023-10-08T16:24:22.275897+0000","last_fullsized":"2023-10-08T16:24:22.275897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:25:17.305261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257414+0000","last_change":"2023-10-08T16:24:21.268084+0000","last_active":"2023-10-08T16:24:22.257414+0000","last_peered":"2023-10-08T16:24:22.257414+0000","last_clean":"2023-10-08T16:24:22.257414+0000","last_became_active":"2023-10-08T16:24:21.267806+0000","last_became_peered":"2023-10-08T16:24:21.267806+0000","last_unstale":"2023-10-08T16:24:22.257414+0000","last_undegraded":"2023-10-08T16:24:22.257414+0000","last_fullsized":"2023-10-08T16:24:22.257414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:32.960654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276267+0000","last_change":"2023-10-08T16:24:22.266880+0000","last_active":"2023-10-08T16:24:22.276267+0000","last_peered":"2023-10-08T16:24:22.276267+0000","last_clean":"2023-10-08T16:24:22.276267+0000","last_became_active":"2023-10-08T16:24:22.266473+0000","last_became_peered":"2023-10-08T16:24:22.266473+0000","last_unstale":"2023-10-08T16:24:22.276267+0000","last_undegraded":"2023-10-08T16:24:22.276267+0000","last_fullsized":"2023-10-08T16:24:22.276267+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:29:53.937746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256889+0000","last_change":"2023-10-08T16:24:21.259935+0000","last_active":"2023-10-08T16:24:22.256889+0000","last_peered":"2023-10-08T16:24:22.256889+0000","last_clean":"2023-10-08T16:24:22.256889+0000","last_became_active":"2023-10-08T16:24:21.259399+0000","last_became_peered":"2023-10-08T16:24:21.259399+0000","last_unstale":"2023-10-08T16:24:22.256889+0000","last_undegraded":"2023-10-08T16:24:22.256889+0000","last_fullsized":"2023-10-08T16:24:22.256889+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:33.098477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.272299+0000","last_change":"2023-10-08T16:24:22.270968+0000","last_active":"2023-10-08T16:24:22.272299+0000","last_peered":"2023-10-08T16:24:22.272299+0000","last_clean":"2023-10-08T16:24:22.272299+0000","last_became_active":"2023-10-08T16:24:22.270705+0000","last_became_peered":"2023-10-08T16:24:22.270705+0000","last_unstale":"2023-10-08T16:24:22.272299+0000","last_undegraded":"2023-10-08T16:24:22.272299+0000","last_fullsized":"2023-10-08T16:24:22.272299+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:02:57.143712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.254209+0000","last_change":"2023-10-08T16:24:21.273603+0000","last_active":"2023-10-08T16:24:22.254209+0000","last_peered":"2023-10-08T16:24:22.254209+0000","last_clean":"2023-10-08T16:24:22.254209+0000","last_became_active":"2023-10-08T16:24:21.273224+0000","last_became_peered":"2023-10-08T16:24:21.273224+0000","last_unstale":"2023-10-08T16:24:22.254209+0000","last_undegraded":"2023-10-08T16:24:22.254209+0000","last_fullsized":"2023-10-08T16:24:22.254209+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:12:49.666266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276968+0000","last_change":"2023-10-08T16:24:22.273050+0000","last_active":"2023-10-08T16:24:22.276968+0000","last_peered":"2023-10-08T16:24:22.276968+0000","last_clean":"2023-10-08T16:24:22.276968+0000","last_became_active":"2023-10-08T16:24:22.272781+0000","last_became_peered":"2023-10-08T16:24:22.272781+0000","last_unstale":"2023-10-08T16:24:22.276968+0000","last_undegraded":"2023-10-08T16:24:22.276968+0000","last_fullsized":"2023-10-08T16:24:22.276968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:41.998333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258749+0000","last_change":"2023-10-08T16:24:21.269008+0000","last_active":"2023-10-08T16:24:22.258749+0000","last_peered":"2023-10-08T16:24:22.258749+0000","last_clean":"2023-10-08T16:24:22.258749+0000","last_became_active":"2023-10-08T16:24:21.268649+0000","last_became_peered":"2023-10-08T16:24:21.268649+0000","last_unstale":"2023-10-08T16:24:22.258749+0000","last_undegraded":"2023-10-08T16:24:22.258749+0000","last_fullsized":"2023-10-08T16:24:22.258749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:58:44.638564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284345+0000","last_change":"2023-10-08T16:24:22.276093+0000","last_active":"2023-10-08T16:24:22.284345+0000","last_peered":"2023-10-08T16:24:22.284345+0000","last_clean":"2023-10-08T16:24:22.284345+0000","last_became_active":"2023-10-08T16:24:22.275832+0000","last_became_peered":"2023-10-08T16:24:22.275832+0000","last_unstale":"2023-10-08T16:24:22.284345+0000","last_undegraded":"2023-10-08T16:24:22.284345+0000","last_fullsized":"2023-10-08T16:24:22.284345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:28:31.162690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287850+0000","last_change":"2023-10-08T16:24:21.272950+0000","last_active":"2023-10-08T16:24:22.287850+0000","last_peered":"2023-10-08T16:24:22.287850+0000","last_clean":"2023-10-08T16:24:22.287850+0000","last_became_active":"2023-10-08T16:24:21.271679+0000","last_became_peered":"2023-10-08T16:24:21.271679+0000","last_unstale":"2023-10-08T16:24:22.287850+0000","last_undegraded":"2023-10-08T16:24:22.287850+0000","last_fullsized":"2023-10-08T16:24:22.287850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:06.461374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277014+0000","last_change":"2023-10-08T16:24:22.275924+0000","last_active":"2023-10-08T16:24:22.277014+0000","last_peered":"2023-10-08T16:24:22.277014+0000","last_clean":"2023-10-08T16:24:22.277014+0000","last_became_active":"2023-10-08T16:24:22.274052+0000","last_became_peered":"2023-10-08T16:24:22.274052+0000","last_unstale":"2023-10-08T16:24:22.277014+0000","last_undegraded":"2023-10-08T16:24:22.277014+0000","last_fullsized":"2023-10-08T16:24:22.277014+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:17.163656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291730+0000","last_change":"2023-10-08T16:24:21.271638+0000","last_active":"2023-10-08T16:24:22.291730+0000","last_peered":"2023-10-08T16:24:22.291730+0000","last_clean":"2023-10-08T16:24:22.291730+0000","last_became_active":"2023-10-08T16:24:21.271359+0000","last_became_peered":"2023-10-08T16:24:21.271359+0000","last_unstale":"2023-10-08T16:24:22.291730+0000","last_undegraded":"2023-10-08T16:24:22.291730+0000","last_fullsized":"2023-10-08T16:24:22.291730+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:06:33.259118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275422+0000","last_change":"2023-10-08T16:24:22.271444+0000","last_active":"2023-10-08T16:24:22.275422+0000","last_peered":"2023-10-08T16:24:22.275422+0000","last_clean":"2023-10-08T16:24:22.275422+0000","last_became_active":"2023-10-08T16:24:22.270764+0000","last_became_peered":"2023-10-08T16:24:22.270764+0000","last_unstale":"2023-10-08T16:24:22.275422+0000","last_undegraded":"2023-10-08T16:24:22.275422+0000","last_fullsized":"2023-10-08T16:24:22.275422+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.468457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293566+0000","last_change":"2023-10-08T16:24:21.269602+0000","last_active":"2023-10-08T16:24:22.293566+0000","last_peered":"2023-10-08T16:24:22.293566+0000","last_clean":"2023-10-08T16:24:22.293566+0000","last_became_active":"2023-10-08T16:24:21.269331+0000","last_became_peered":"2023-10-08T16:24:21.269331+0000","last_unstale":"2023-10-08T16:24:22.293566+0000","last_undegraded":"2023-10-08T16:24:22.293566+0000","last_fullsized":"2023-10-08T16:24:22.293566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:40.991250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269760+0000","last_change":"2023-10-08T16:24:22.264889+0000","last_active":"2023-10-08T16:24:22.269760+0000","last_peered":"2023-10-08T16:24:22.269760+0000","last_clean":"2023-10-08T16:24:22.269760+0000","last_became_active":"2023-10-08T16:24:22.264605+0000","last_became_peered":"2023-10-08T16:24:22.264605+0000","last_unstale":"2023-10-08T16:24:22.269760+0000","last_undegraded":"2023-10-08T16:24:22.269760+0000","last_fullsized":"2023-10-08T16:24:22.269760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:30:46.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257867+0000","last_change":"2023-10-08T16:24:21.265305+0000","last_active":"2023-10-08T16:24:22.257867+0000","last_peered":"2023-10-08T16:24:22.257867+0000","last_clean":"2023-10-08T16:24:22.257867+0000","last_became_active":"2023-10-08T16:24:21.264987+0000","last_became_peered":"2023-10-08T16:24:21.264987+0000","last_unstale":"2023-10-08T16:24:22.257867+0000","last_undegraded":"2023-10-08T16:24:22.257867+0000","last_fullsized":"2023-10-08T16:24:22.257867+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:09:30.340743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275763+0000","last_change":"2023-10-08T16:24:22.274630+0000","last_active":"2023-10-08T16:24:22.275763+0000","last_peered":"2023-10-08T16:24:22.275763+0000","last_clean":"2023-10-08T16:24:22.275763+0000","last_became_active":"2023-10-08T16:24:22.274286+0000","last_became_peered":"2023-10-08T16:24:22.274286+0000","last_unstale":"2023-10-08T16:24:22.275763+0000","last_undegraded":"2023-10-08T16:24:22.275763+0000","last_fullsized":"2023-10-08T16:24:22.275763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:22.357569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257535+0000","last_change":"2023-10-08T16:24:21.268698+0000","last_active":"2023-10-08T16:24:22.257535+0000","last_peered":"2023-10-08T16:24:22.257535+0000","last_clean":"2023-10-08T16:24:22.257535+0000","last_became_active":"2023-10-08T16:24:21.268390+0000","last_became_peered":"2023-10-08T16:24:21.268390+0000","last_unstale":"2023-10-08T16:24:22.257535+0000","last_undegraded":"2023-10-08T16:24:22.257535+0000","last_fullsized":"2023-10-08T16:24:22.257535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:22:14.687838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276317+0000","last_change":"2023-10-08T16:24:22.270899+0000","last_active":"2023-10-08T16:24:22.276317+0000","last_peered":"2023-10-08T16:24:22.276317+0000","last_clean":"2023-10-08T16:24:22.276317+0000","last_became_active":"2023-10-08T16:24:22.270208+0000","last_became_peered":"2023-10-08T16:24:22.270208+0000","last_unstale":"2023-10-08T16:24:22.276317+0000","last_undegraded":"2023-10-08T16:24:22.276317+0000","last_fullsized":"2023-10-08T16:24:22.276317+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:10.548785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.287746+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.287746+0000","last_peered":"2023-10-08T16:24:22.287746+0000","last_clean":"2023-10-08T16:24:22.287746+0000","last_became_active":"2023-10-08T16:24:21.269334+0000","last_became_peered":"2023-10-08T16:24:21.269334+0000","last_unstale":"2023-10-08T16:24:22.287746+0000","last_undegraded":"2023-10-08T16:24:22.287746+0000","last_fullsized":"2023-10-08T16:24:22.287746+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:46.119976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.269809+0000","last_change":"2023-10-08T16:24:22.266878+0000","last_active":"2023-10-08T16:24:22.269809+0000","last_peered":"2023-10-08T16:24:22.269809+0000","last_clean":"2023-10-08T16:24:22.269809+0000","last_became_active":"2023-10-08T16:24:22.266101+0000","last_became_peered":"2023-10-08T16:24:22.266101+0000","last_unstale":"2023-10-08T16:24:22.269809+0000","last_undegraded":"2023-10-08T16:24:22.269809+0000","last_fullsized":"2023-10-08T16:24:22.269809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:53.883482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.293561+0000","last_change":"2023-10-08T16:24:21.261619+0000","last_active":"2023-10-08T16:24:22.293561+0000","last_peered":"2023-10-08T16:24:22.293561+0000","last_clean":"2023-10-08T16:24:22.293561+0000","last_became_active":"2023-10-08T16:24:21.261364+0000","last_became_peered":"2023-10-08T16:24:21.261364+0000","last_unstale":"2023-10-08T16:24:22.293561+0000","last_undegraded":"2023-10-08T16:24:22.293561+0000","last_fullsized":"2023-10-08T16:24:22.293561+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:55.109496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.267650+0000","last_change":"2023-10-08T16:24:22.265540+0000","last_active":"2023-10-08T16:24:22.267650+0000","last_peered":"2023-10-08T16:24:22.267650+0000","last_clean":"2023-10-08T16:24:22.267650+0000","last_became_active":"2023-10-08T16:24:22.265265+0000","last_became_peered":"2023-10-08T16:24:22.265265+0000","last_unstale":"2023-10-08T16:24:22.267650+0000","last_undegraded":"2023-10-08T16:24:22.267650+0000","last_fullsized":"2023-10-08T16:24:22.267650+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:27:40.566331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.289188+0000","last_change":"2023-10-08T16:24:21.268382+0000","last_active":"2023-10-08T16:24:22.289188+0000","last_peered":"2023-10-08T16:24:22.289188+0000","last_clean":"2023-10-08T16:24:22.289188+0000","last_became_active":"2023-10-08T16:24:21.268141+0000","last_became_peered":"2023-10-08T16:24:21.268141+0000","last_unstale":"2023-10-08T16:24:22.289188+0000","last_undegraded":"2023-10-08T16:24:22.289188+0000","last_fullsized":"2023-10-08T16:24:22.289188+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:12.547947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276490+0000","last_change":"2023-10-08T16:24:22.270441+0000","last_active":"2023-10-08T16:24:22.276490+0000","last_peered":"2023-10-08T16:24:22.276490+0000","last_clean":"2023-10-08T16:24:22.276490+0000","last_became_active":"2023-10-08T16:24:22.270142+0000","last_became_peered":"2023-10-08T16:24:22.270142+0000","last_unstale":"2023-10-08T16:24:22.276490+0000","last_undegraded":"2023-10-08T16:24:22.276490+0000","last_fullsized":"2023-10-08T16:24:22.276490+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:41.764767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.286673+0000","last_change":"2023-10-08T16:24:21.267941+0000","last_active":"2023-10-08T16:24:22.286673+0000","last_peered":"2023-10-08T16:24:22.286673+0000","last_clean":"2023-10-08T16:24:22.286673+0000","last_became_active":"2023-10-08T16:24:21.267613+0000","last_became_peered":"2023-10-08T16:24:21.267613+0000","last_unstale":"2023-10-08T16:24:22.286673+0000","last_undegraded":"2023-10-08T16:24:22.286673+0000","last_fullsized":"2023-10-08T16:24:22.286673+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:47.872492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276994+0000","last_change":"2023-10-08T16:24:22.274135+0000","last_active":"2023-10-08T16:24:22.276994+0000","last_peered":"2023-10-08T16:24:22.276994+0000","last_clean":"2023-10-08T16:24:22.276994+0000","last_became_active":"2023-10-08T16:24:22.273837+0000","last_became_peered":"2023-10-08T16:24:22.273837+0000","last_unstale":"2023-10-08T16:24:22.276994+0000","last_undegraded":"2023-10-08T16:24:22.276994+0000","last_fullsized":"2023-10-08T16:24:22.276994+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:39:51.668749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257341+0000","last_change":"2023-10-08T16:24:21.276024+0000","last_active":"2023-10-08T16:24:22.257341+0000","last_peered":"2023-10-08T16:24:22.257341+0000","last_clean":"2023-10-08T16:24:22.257341+0000","last_became_active":"2023-10-08T16:24:21.275739+0000","last_became_peered":"2023-10-08T16:24:21.275739+0000","last_unstale":"2023-10-08T16:24:22.257341+0000","last_undegraded":"2023-10-08T16:24:22.257341+0000","last_fullsized":"2023-10-08T16:24:22.257341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:56:21.350486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.275441+0000","last_change":"2023-10-08T16:24:22.271976+0000","last_active":"2023-10-08T16:24:22.275441+0000","last_peered":"2023-10-08T16:24:22.275441+0000","last_clean":"2023-10-08T16:24:22.275441+0000","last_became_active":"2023-10-08T16:24:22.271425+0000","last_became_peered":"2023-10-08T16:24:22.271425+0000","last_unstale":"2023-10-08T16:24:22.275441+0000","last_undegraded":"2023-10-08T16:24:22.275441+0000","last_fullsized":"2023-10-08T16:24:22.275441+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:02:47.127059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291574+0000","last_change":"2023-10-08T16:24:21.267852+0000","last_active":"2023-10-08T16:24:22.291574+0000","last_peered":"2023-10-08T16:24:22.291574+0000","last_clean":"2023-10-08T16:24:22.291574+0000","last_became_active":"2023-10-08T16:24:21.267533+0000","last_became_peered":"2023-10-08T16:24:21.267533+0000","last_unstale":"2023-10-08T16:24:22.291574+0000","last_undegraded":"2023-10-08T16:24:22.291574+0000","last_fullsized":"2023-10-08T16:24:22.291574+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:19.206612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284930+0000","last_change":"2023-10-08T16:24:22.274776+0000","last_active":"2023-10-08T16:24:22.284930+0000","last_peered":"2023-10-08T16:24:22.284930+0000","last_clean":"2023-10-08T16:24:22.284930+0000","last_became_active":"2023-10-08T16:24:22.274530+0000","last_became_peered":"2023-10-08T16:24:22.274530+0000","last_unstale":"2023-10-08T16:24:22.284930+0000","last_undegraded":"2023-10-08T16:24:22.284930+0000","last_fullsized":"2023-10-08T16:24:22.284930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:52:43.101600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256460+0000","last_change":"2023-10-08T16:24:21.263757+0000","last_active":"2023-10-08T16:24:22.256460+0000","last_peered":"2023-10-08T16:24:22.256460+0000","last_clean":"2023-10-08T16:24:22.256460+0000","last_became_active":"2023-10-08T16:24:21.263272+0000","last_became_peered":"2023-10-08T16:24:21.263272+0000","last_unstale":"2023-10-08T16:24:22.256460+0000","last_undegraded":"2023-10-08T16:24:22.256460+0000","last_fullsized":"2023-10-08T16:24:22.256460+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:24.676343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.270553+0000","last_change":"2023-10-08T16:24:22.268087+0000","last_active":"2023-10-08T16:24:22.270553+0000","last_peered":"2023-10-08T16:24:22.270553+0000","last_clean":"2023-10-08T16:24:22.270553+0000","last_became_active":"2023-10-08T16:24:22.267829+0000","last_became_peered":"2023-10-08T16:24:22.267829+0000","last_unstale":"2023-10-08T16:24:22.270553+0000","last_undegraded":"2023-10-08T16:24:22.270553+0000","last_fullsized":"2023-10-08T16:24:22.270553+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:03.698744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258364+0000","last_change":"2023-10-08T16:24:21.263139+0000","last_active":"2023-10-08T16:24:22.258364+0000","last_peered":"2023-10-08T16:24:22.258364+0000","last_clean":"2023-10-08T16:24:22.258364+0000","last_became_active":"2023-10-08T16:24:21.262842+0000","last_became_peered":"2023-10-08T16:24:21.262842+0000","last_unstale":"2023-10-08T16:24:22.258364+0000","last_undegraded":"2023-10-08T16:24:22.258364+0000","last_fullsized":"2023-10-08T16:24:22.258364+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:42:55.758318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.278195+0000","last_change":"2023-10-08T16:24:22.277258+0000","last_active":"2023-10-08T16:24:22.278195+0000","last_peered":"2023-10-08T16:24:22.278195+0000","last_clean":"2023-10-08T16:24:22.278195+0000","last_became_active":"2023-10-08T16:24:22.276962+0000","last_became_peered":"2023-10-08T16:24:22.276962+0000","last_unstale":"2023-10-08T16:24:22.278195+0000","last_undegraded":"2023-10-08T16:24:22.278195+0000","last_fullsized":"2023-10-08T16:24:22.278195+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:24:53.296385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.291666+0000","last_change":"2023-10-08T16:24:21.269755+0000","last_active":"2023-10-08T16:24:22.291666+0000","last_peered":"2023-10-08T16:24:22.291666+0000","last_clean":"2023-10-08T16:24:22.291666+0000","last_became_active":"2023-10-08T16:24:21.269510+0000","last_became_peered":"2023-10-08T16:24:21.269510+0000","last_unstale":"2023-10-08T16:24:22.291666+0000","last_undegraded":"2023-10-08T16:24:22.291666+0000","last_fullsized":"2023-10-08T16:24:22.291666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:39.883010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276996+0000","last_change":"2023-10-08T16:24:22.275498+0000","last_active":"2023-10-08T16:24:22.276996+0000","last_peered":"2023-10-08T16:24:22.276996+0000","last_clean":"2023-10-08T16:24:22.276996+0000","last_became_active":"2023-10-08T16:24:22.275126+0000","last_became_peered":"2023-10-08T16:24:22.275126+0000","last_unstale":"2023-10-08T16:24:22.276996+0000","last_undegraded":"2023-10-08T16:24:22.276996+0000","last_fullsized":"2023-10-08T16:24:22.276996+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:25:54.012780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"85'1","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-10-08T16:24:23.839157+0000","last_change":"2023-10-08T16:24:21.272140+0000","last_active":"2023-10-08T16:24:23.839157+0000","last_peered":"2023-10-08T16:24:23.839157+0000","last_clean":"2023-10-08T16:24:23.839157+0000","last_became_active":"2023-10-08T16:24:21.271855+0000","last_became_peered":"2023-10-08T16:24:21.271855+0000","last_unstale":"2023-10-08T16:24:23.839157+0000","last_undegraded":"2023-10-08T16:24:23.839157+0000","last_fullsized":"2023-10-08T16:24:23.839157+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:43.513877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.284324+0000","last_change":"2023-10-08T16:24:22.275692+0000","last_active":"2023-10-08T16:24:22.284324+0000","last_peered":"2023-10-08T16:24:22.284324+0000","last_clean":"2023-10-08T16:24:22.284324+0000","last_became_active":"2023-10-08T16:24:22.275415+0000","last_became_peered":"2023-10-08T16:24:22.275415+0000","last_unstale":"2023-10-08T16:24:22.284324+0000","last_undegraded":"2023-10-08T16:24:22.284324+0000","last_fullsized":"2023-10-08T16:24:22.284324+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:18:19.155641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257742+0000","last_change":"2023-10-08T16:24:21.267000+0000","last_active":"2023-10-08T16:24:22.257742+0000","last_peered":"2023-10-08T16:24:22.257742+0000","last_clean":"2023-10-08T16:24:22.257742+0000","last_became_active":"2023-10-08T16:24:21.266714+0000","last_became_peered":"2023-10-08T16:24:21.266714+0000","last_unstale":"2023-10-08T16:24:22.257742+0000","last_undegraded":"2023-10-08T16:24:22.257742+0000","last_fullsized":"2023-10-08T16:24:22.257742+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:58.879845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.268257+0000","last_change":"2023-10-08T16:24:22.266562+0000","last_active":"2023-10-08T16:24:22.268257+0000","last_peered":"2023-10-08T16:24:22.268257+0000","last_clean":"2023-10-08T16:24:22.268257+0000","last_became_active":"2023-10-08T16:24:22.265904+0000","last_became_peered":"2023-10-08T16:24:22.265904+0000","last_unstale":"2023-10-08T16:24:22.268257+0000","last_undegraded":"2023-10-08T16:24:22.268257+0000","last_fullsized":"2023-10-08T16:24:22.268257+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:48:42.482305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.259013+0000","last_change":"2023-10-08T16:24:21.269629+0000","last_active":"2023-10-08T16:24:22.259013+0000","last_peered":"2023-10-08T16:24:22.259013+0000","last_clean":"2023-10-08T16:24:22.259013+0000","last_became_active":"2023-10-08T16:24:21.269338+0000","last_became_peered":"2023-10-08T16:24:21.269338+0000","last_unstale":"2023-10-08T16:24:22.259013+0000","last_undegraded":"2023-10-08T16:24:22.259013+0000","last_fullsized":"2023-10-08T16:24:22.259013+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:51.308472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276204+0000","last_change":"2023-10-08T16:24:22.264942+0000","last_active":"2023-10-08T16:24:22.276204+0000","last_peered":"2023-10-08T16:24:22.276204+0000","last_clean":"2023-10-08T16:24:22.276204+0000","last_became_active":"2023-10-08T16:24:22.264659+0000","last_became_peered":"2023-10-08T16:24:22.264659+0000","last_unstale":"2023-10-08T16:24:22.276204+0000","last_undegraded":"2023-10-08T16:24:22.276204+0000","last_fullsized":"2023-10-08T16:24:22.276204+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:56:28.010725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256572+0000","last_change":"2023-10-08T16:24:21.266315+0000","last_active":"2023-10-08T16:24:22.256572+0000","last_peered":"2023-10-08T16:24:22.256572+0000","last_clean":"2023-10-08T16:24:22.256572+0000","last_became_active":"2023-10-08T16:24:21.266015+0000","last_became_peered":"2023-10-08T16:24:21.266015+0000","last_unstale":"2023-10-08T16:24:22.256572+0000","last_undegraded":"2023-10-08T16:24:22.256572+0000","last_fullsized":"2023-10-08T16:24:22.256572+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:43.409719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276286+0000","last_change":"2023-10-08T16:24:22.270477+0000","last_active":"2023-10-08T16:24:22.276286+0000","last_peered":"2023-10-08T16:24:22.276286+0000","last_clean":"2023-10-08T16:24:22.276286+0000","last_became_active":"2023-10-08T16:24:22.270161+0000","last_became_peered":"2023-10-08T16:24:22.270161+0000","last_unstale":"2023-10-08T16:24:22.276286+0000","last_undegraded":"2023-10-08T16:24:22.276286+0000","last_fullsized":"2023-10-08T16:24:22.276286+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:55.893986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.257389+0000","last_change":"2023-10-08T16:24:21.272163+0000","last_active":"2023-10-08T16:24:22.257389+0000","last_peered":"2023-10-08T16:24:22.257389+0000","last_clean":"2023-10-08T16:24:22.257389+0000","last_became_active":"2023-10-08T16:24:21.271808+0000","last_became_peered":"2023-10-08T16:24:21.271808+0000","last_unstale":"2023-10-08T16:24:22.257389+0000","last_undegraded":"2023-10-08T16:24:22.257389+0000","last_fullsized":"2023-10-08T16:24:22.257389+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:24:06.659785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.277772+0000","last_change":"2023-10-08T16:24:22.271832+0000","last_active":"2023-10-08T16:24:22.277772+0000","last_peered":"2023-10-08T16:24:22.277772+0000","last_clean":"2023-10-08T16:24:22.277772+0000","last_became_active":"2023-10-08T16:24:22.271501+0000","last_became_peered":"2023-10-08T16:24:22.271501+0000","last_unstale":"2023-10-08T16:24:22.277772+0000","last_undegraded":"2023-10-08T16:24:22.277772+0000","last_fullsized":"2023-10-08T16:24:22.277772+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:45:01.112062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.256347+0000","last_change":"2023-10-08T16:24:21.274862+0000","last_active":"2023-10-08T16:24:22.256347+0000","last_peered":"2023-10-08T16:24:22.256347+0000","last_clean":"2023-10-08T16:24:22.256347+0000","last_became_active":"2023-10-08T16:24:21.274569+0000","last_became_peered":"2023-10-08T16:24:21.274569+0000","last_unstale":"2023-10-08T16:24:22.256347+0000","last_undegraded":"2023-10-08T16:24:22.256347+0000","last_fullsized":"2023-10-08T16:24:22.256347+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:12.347897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.276246+0000","last_change":"2023-10-08T16:24:22.266748+0000","last_active":"2023-10-08T16:24:22.276246+0000","last_peered":"2023-10-08T16:24:22.276246+0000","last_clean":"2023-10-08T16:24:22.276246+0000","last_became_active":"2023-10-08T16:24:22.266033+0000","last_became_peered":"2023-10-08T16:24:22.266033+0000","last_unstale":"2023-10-08T16:24:22.276246+0000","last_undegraded":"2023-10-08T16:24:22.276246+0000","last_fullsized":"2023-10-08T16:24:22.276246+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:59.306851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258344+0000","last_change":"2023-10-08T16:24:21.262446+0000","last_active":"2023-10-08T16:24:22.258344+0000","last_peered":"2023-10-08T16:24:22.258344+0000","last_clean":"2023-10-08T16:24:22.258344+0000","last_became_active":"2023-10-08T16:24:21.262129+0000","last_became_peered":"2023-10-08T16:24:21.262129+0000","last_unstale":"2023-10-08T16:24:22.258344+0000","last_undegraded":"2023-10-08T16:24:22.258344+0000","last_fullsized":"2023-10-08T16:24:22.258344+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:07:16.999817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.285817+0000","last_change":"2023-10-08T16:24:22.276248+0000","last_active":"2023-10-08T16:24:22.285817+0000","last_peered":"2023-10-08T16:24:22.285817+0000","last_clean":"2023-10-08T16:24:22.285817+0000","last_became_active":"2023-10-08T16:24:22.275930+0000","last_became_peered":"2023-10-08T16:24:22.275930+0000","last_unstale":"2023-10-08T16:24:22.285817+0000","last_undegraded":"2023-10-08T16:24:22.285817+0000","last_fullsized":"2023-10-08T16:24:22.285817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:21.240807+0000","last_clean_scrub_stamp":"2023-10-08T16:24:21.240807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:05.664970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.258704+0000","last_change":"2023-10-08T16:24:21.269605+0000","last_active":"2023-10-08T16:24:22.258704+0000","last_peered":"2023-10-08T16:24:22.258704+0000","last_clean":"2023-10-08T16:24:22.258704+0000","last_became_active":"2023-10-08T16:24:21.269290+0000","last_became_peered":"2023-10-08T16:24:21.269290+0000","last_unstale":"2023-10-08T16:24:22.258704+0000","last_undegraded":"2023-10-08T16:24:22.258704+0000","last_fullsized":"2023-10-08T16:24:22.258704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:24:20.233724+0000","last_clean_scrub_stamp":"2023-10-08T16:24:20.233724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:33.098477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"74'161","reported_seq":378,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-10-08T16:24:22.253357+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:24:22.253357+0000","last_peered":"2023-10-08T16:24:22.253357+0000","last_clean":"2023-10-08T16:24:22.253357+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:24:22.253357+0000","last_undegraded":"2023-10-08T16:24:22.253357+0000","last_fullsized":"2023-10-08T16:24:22.253357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307072,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064768,"statfs":{"total":96636764160,"available":96322322432,"internally_reserved":0,"allocated":1630208,"data_stored":1084462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.48699999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":1.103},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71499999999999997,"15min":0.72099999999999997},"min":{"1min":0.54100000000000004,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88800000000000001,"5min":0.92500000000000004,"15min":1.089},"last":0.73799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.77800000000000002},"min":{"1min":0.63900000000000001,"5min":0.49299999999999999,"15min":0.41299999999999998},"max":{"1min":1.002,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.76600000000000001,"15min":0.78600000000000003},"min":{"1min":0.70299999999999996,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":0.997,"15min":1.1160000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.51700000000000002,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.98099999999999998},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.746},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97599999999999998,"5min":1.032,"15min":1.1000000000000001},"last":0.872}]},{"osd":3,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73399999999999999},"min":{"1min":0.59399999999999997,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.92400000000000004,"5min":0.95199999999999996,"15min":1.006},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76500000000000001,"15min":0.78600000000000003},"min":{"1min":0.61699999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.92100000000000004,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.64300000000000002},"min":{"1min":0.44900000000000001,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.92200000000000004,"5min":0.96699999999999997,"15min":1.234},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.437},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.3919999999999999},"last":0.84199999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.70399999999999996},"min":{"1min":0.44900000000000001,"5min":0.434,"15min":0.40600000000000003},"max":{"1min":0.96499999999999997,"5min":1.101,"15min":1.3680000000000001},"last":0.997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70799999999999996,"15min":0.72499999999999998},"min":{"1min":0.47299999999999998,"5min":0.42599999999999999,"15min":0.40899999999999997},"max":{"1min":1.091,"5min":1.091,"15min":1.4319999999999999},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:23:30 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76300000000000001,"15min":0.77900000000000003},"min":{"1min":0.55800000000000005,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.0369999999999999,"5min":1.0409999999999999,"15min":1.323},"last":1.008},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.75},"min":{"1min":0.54100000000000004,"5min":0.496,"15min":0.48099999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.448},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306484,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065356,"statfs":{"total":96636764160,"available":96322924544,"internally_reserved":0,"allocated":1028096,"data_stored":493934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70299999999999996,"15min":0.71399999999999997},"min":{"1min":0.53700000000000003,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.96399999999999997,"15min":1.125},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.70899999999999996,"15min":0.71899999999999997},"min":{"1min":0.58499999999999996,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.66500000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.69799999999999995,"15min":0.70299999999999996},"min":{"1min":0.55700000000000005,"5min":0.38,"15min":0.38},"max":{"1min":0.97999999999999998,"5min":0.99199999999999999,"15min":1.365},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.72899999999999998,"15min":0.73299999999999998},"min":{"1min":0.54200000000000004,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.997,"5min":0.997,"15min":1.0549999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.72099999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.94299999999999995,"5min":1.071,"15min":1.552},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.78300000000000003},"min":{"1min":0.68500000000000005,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.94299999999999995,"5min":1.034,"15min":1.4570000000000001},"last":0.63200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.60299999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.92900000000000005,"5min":1.0149999999999999,"15min":1.069},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.77400000000000002,"15min":0.78200000000000003},"min":{"1min":0.60699999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":1.619},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.65700000000000003,"15min":0.66000000000000003},"min":{"1min":0.40400000000000003,"5min":0.39500000000000002,"15min":0.39400000000000002},"max":{"1min":0.89700000000000002,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.38700000000000001},"max":{"1min":0.94799999999999995,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.84899999999999998,"5min":1.272,"15min":1.272},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70499999999999996,"15min":0.72599999999999998},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.42999999999999999},"max":{"1min":0.96799999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:23:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.71899999999999997,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.997,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71999999999999997,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302392,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069448,"statfs":{"total":96636764160,"available":96327114752,"internally_reserved":0,"allocated":1032192,"data_stored":494024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46100000000000002,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.58899999999999997,"5min":0.873,"15min":0.873},"last":0.315},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.495,"15min":0.496},"min":{"1min":0.38400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73499999999999999,"5min":0.96599999999999997,"15min":1.0680000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.48699999999999999},"min":{"1min":0.36699999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.44},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.755,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47599999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.629},"min":{"1min":0.48799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.79900000000000004,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.53600000000000003,"5min":0.37,"15min":0.33700000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.472},"last":0.41899999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.64500000000000002,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.98399999999999999,"5min":1.026,"15min":1.373},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.81999999999999995,"15min":0.79800000000000004},"min":{"1min":0.65900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0680000000000001,"5min":1.2230000000000001,"15min":1.375},"last":0.80200000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.80400000000000005,"15min":0.79000000000000004},"min":{"1min":0.56100000000000005,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":1.1140000000000001,"5min":1.157,"15min":1.276},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.83299999999999996,"15min":0.80600000000000005},"min":{"1min":0.69699999999999995,"5min":0.56399999999999995,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.107,"15min":1.224},"last":0.67500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.66200000000000003,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0109999999999999,"5min":1.1220000000000001,"15min":1.429},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.83899999999999997,"15min":0.81399999999999995},"min":{"1min":0.61399999999999999,"5min":0.59299999999999997,"15min":0.52200000000000002},"max":{"1min":1.0840000000000001,"5min":1.2909999999999999,"15min":1.391},"last":0.68500000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:23:39 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84399999999999997,"15min":0.82799999999999996},"min":{"1min":0.75700000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.99299999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.83699999999999997},"min":{"1min":0.69899999999999995,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":0.95899999999999996,"5min":1.0960000000000001,"15min":1.514},"last":0.76500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072952,"statfs":{"total":96636764160,"available":96330702848,"internally_reserved":0,"allocated":1638400,"data_stored":1086392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.25800000000000001},"max":{"1min":0.748,"5min":1.1339999999999999,"15min":1.524},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55700000000000005,"15min":0.56799999999999995},"min":{"1min":0.442,"5min":0.374,"15min":0.36199999999999999},"max":{"1min":0.70399999999999996,"5min":0.81100000000000005,"15min":1.679},"last":0.54200000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52100000000000002},"min":{"1min":0.432,"5min":0.32700000000000001,"15min":0.30099999999999999},"max":{"1min":0.70299999999999996,"5min":1.093,"15min":1.5569999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51700000000000002,"15min":0.53000000000000003},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.37,"5min":0.315,"15min":0.29299999999999998},"max":{"1min":0.72599999999999998,"5min":0.878,"15min":1.371},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63100000000000001,"15min":0.63700000000000001},"min":{"1min":0.54700000000000004,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":1.21,"15min":1.2470000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.58799999999999997,"5min":0.49399999999999999,"15min":0.40300000000000002},"max":{"1min":1.0269999999999999,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81200000000000006,"15min":0.80000000000000004},"min":{"1min":0.623,"5min":0.56999999999999995,"15min":0.46400000000000002},"max":{"1min":1.054,"5min":1.1899999999999999,"15min":1.325},"last":0.59099999999999997}]},{"osd":5,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81799999999999995,"15min":0.79900000000000004},"min":{"1min":0.65900000000000003,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.083,"5min":1.1439999999999999,"15min":1.153},"last":1.026},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80600000000000005,"15min":0.80900000000000005},"min":{"1min":0.57899999999999996,"5min":0.57699999999999996,"15min":0.57099999999999995},"max":{"1min":1.0720000000000001,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81999999999999995},"min":{"1min":0.621,"5min":0.55800000000000005,"15min":0.52900000000000003},"max":{"1min":1.149,"5min":1.1950000000000001,"15min":1.288},"last":0.624},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.51600000000000001},"max":{"1min":1.054,"5min":1.212,"15min":1.262},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:23:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.81899999999999995,"15min":0.83099999999999996},"min":{"1min":0.624,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.1140000000000001,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82699999999999996,"15min":0.82099999999999995},"min":{"1min":0.63500000000000001,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.163,"5min":1.202,"15min":1.4079999999999999},"last":0.73699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67300000000000004,"5min":1.046,"15min":1.046},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.56499999999999995},"min":{"1min":0.443,"5min":0.40300000000000002,"15min":0.377},"max":{"1min":0.79400000000000004,"5min":0.98599999999999999,"15min":1.1279999999999999},"last":0.374}]},{"osd":1,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.75800000000000001,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.88900000000000001,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.443}]},{"osd":3,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52000000000000002,"15min":0.53500000000000003},"min":{"1min":0.372,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.879,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.747,"5min":1.1160000000000001,"15min":1.448},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78200000000000003,"15min":0.78900000000000003},"min":{"1min":0.57899999999999996,"5min":0.434,"15min":0.434},"max":{"1min":0.92300000000000004,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77100000000000002,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.497,"15min":0.497},"max":{"1min":1.056,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.84999999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83099999999999996,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.026,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80900000000000005,"15min":0.83299999999999996},"min":{"1min":0.624,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.0669999999999999,"5min":1.3,"15min":1.3720000000000001},"last":0.73999999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.77900000000000003,"15min":0.80300000000000005},"min":{"1min":0.53900000000000003,"5min":0.51800000000000002,"15min":0.51700000000000002},"max":{"1min":1.0109999999999999,"5min":1.321,"15min":1.3959999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.65500000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95099999999999996,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:46 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82499999999999996,"15min":0.86199999999999999},"min":{"1min":0.60299999999999998,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0980000000000001,"5min":1.4410000000000001,"15min":1.734},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.876},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.103,"5min":1.272,"15min":1.655},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306492,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065348,"statfs":{"total":96636764160,"available":96322916352,"internally_reserved":0,"allocated":1036288,"data_stored":493990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.443,"15min":0.45800000000000002},"min":{"1min":0.33500000000000002,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61099999999999999,"5min":0.66000000000000003,"15min":0.83899999999999997},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.52100000000000002,"15min":0.51800000000000002},"min":{"1min":0.377,"5min":0.36099999999999999,"15min":0.27100000000000002},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.90200000000000002},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.41599999999999998,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.628,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54400000000000004,"15min":0.54800000000000004},"min":{"1min":0.47299999999999998,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.73399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39800000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.61699999999999999,"15min":0.60899999999999999},"min":{"1min":0.48399999999999999,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66000000000000003,"15min":0.65100000000000002},"min":{"1min":0.55600000000000005,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.77900000000000003,"5min":1,"15min":1},"last":0.57099999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73199999999999998,"15min":0.74399999999999999},"min":{"1min":0.57699999999999996,"5min":0.50700000000000001,"15min":0.39200000000000002},"max":{"1min":0.95099999999999996,"5min":1.04,"15min":1.2789999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76500000000000001,"15min":0.77900000000000003},"min":{"1min":0.58799999999999997,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":1.0249999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77400000000000002,"15min":0.78600000000000003},"min":{"1min":0.60599999999999998,"5min":0.56599999999999995,"15min":0.51100000000000001},"max":{"1min":0.95299999999999996,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77700000000000002,"15min":0.78600000000000003},"min":{"1min":0.66200000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.98099999999999998,"5min":1.093,"15min":1.3200000000000001},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.58999999999999997,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.82399999999999995,"15min":0.83399999999999996},"min":{"1min":0.64500000000000002,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.006,"5min":1.1799999999999999,"15min":1.397},"last":0.66500000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:23:38 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.70899999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.05,"5min":1.153,"15min":1.306},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.83199999999999996,"15min":0.84199999999999997},"min":{"1min":0.63900000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.0569999999999999,"5min":1.103,"15min":1.321},"last":0.71799999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575031,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298304,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073536,"statfs":{"total":96636764160,"available":96331300864,"internally_reserved":0,"allocated":1040384,"data_stored":495470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73399999999999999,"15min":0.70999999999999996},"min":{"1min":0.47199999999999998,"5min":0.46400000000000002,"15min":0.38100000000000001},"max":{"1min":1.0069999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.62,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.997,"5min":1.012,"15min":1.012},"last":0.75600000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.57499999999999996,"5min":0.436,"15min":0.436},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.745,"15min":0.73699999999999999},"min":{"1min":0.59999999999999998,"5min":0.504,"15min":0.379},"max":{"1min":1.0640000000000001,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.76600000000000001,"15min":0.74399999999999999},"min":{"1min":0.54900000000000004,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.109,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.879},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.752,"15min":0.753},"min":{"1min":0.64300000000000002,"5min":0.47999999999999998,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.085,"15min":1.216},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.79700000000000004,"15min":0.80500000000000005},"min":{"1min":0.72599999999999998,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.1479999999999999},"last":0.871},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0980000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":1.0309999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63400000000000001,"15min":0.63700000000000001},"min":{"1min":0.44400000000000001,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.0149999999999999,"5min":1.47,"15min":1.47},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68400000000000005,"15min":0.69199999999999995},"min":{"1min":0.50900000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94399999999999995,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67200000000000004,"15min":0.64700000000000002},"min":{"1min":0.497,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":1.0409999999999999,"5min":2.661,"15min":2.661},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.74099999999999999,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0860000000000001,"5min":1.611,"15min":1.6839999999999999},"last":1.0069999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:23:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1499999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54400000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.97299999999999998,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0760000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575030,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310588,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061252,"statfs":{"total":96636764160,"available":96318722048,"internally_reserved":0,"allocated":1036288,"data_stored":494558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.77400000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.65100000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":0.72799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.623}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.745},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.60599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:24:32.087 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:24:32.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:24:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.315+0000 7f4739d9d700 1 Processor -- start 2023-10-08T16:24:32.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.315+0000 7f4739d9d700 1 -- start start 2023-10-08T16:24:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f4739d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4734142c00 0x7f473406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f4739d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340ca480 con 0x7f47340c7f90 2023-10-08T16:24:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f4739d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473415e240 con 0x7f473406bd20 2023-10-08T16:24:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f4739d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473406b350 con 0x7f4734142c00 2023-10-08T16:24:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f473959c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f47340c7f90 0x7f473406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52296/0 (socket says 172.21.15.12:52296) 2023-10-08T16:24:32.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f473959c700 1 -- 172.21.15.12:0/1656509401 learned_addr learned my addr 172.21.15.12:0/1656509401 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f4738d9b700 1 --2- 172.21.15.12:0/1656509401 >> v2:172.21.15.29:3300/0 conn(0x7f4734142c00 0x7f473406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538095193 0 0) 0x7f47340ca480 con 0x7f47340c7f90 2023-10-08T16:24:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.317+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4724003570 con 0x7f47340c7f90 2023-10-08T16:24:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649674559 0 0) 0x7f473415e240 con 0x7f473406bd20 2023-10-08T16:24:32.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47340ca480 con 0x7f473406bd20 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 528847866 0 0) 0x7f4724003570 con 0x7f47340c7f90 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 >> v2:172.21.15.29:3300/0 conn(0x7f4734142c00 msgr2=0x7f473406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 --2- 172.21.15.12:0/1656509401 >> v2:172.21.15.29:3300/0 conn(0x7f4734142c00 0x7f473406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 >> v1:172.21.15.29:6789/0 conn(0x7f473406bd20 legacy=0x7f47340c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473415df60 con 0x7f47340c7f90 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f472c0017f0 con 0x7f47340c7f90 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 >> v1:172.21.15.12:6789/0 conn(0x7f47340c7f90 legacy=0x7f473406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724003c40 0x7f4724004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 0x7f4724004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4724005280 0x7f472400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473406b350 con 0x7f4724004810 2023-10-08T16:24:32.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f472400c250 con 0x7f4724003c40 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f472400c410 con 0x7f4724005280 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f4733fff700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 0x7f4724004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f4738d9b700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724003c40 0x7f4724004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.318+0000 7f473959c700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4724005280 0x7f472400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 -- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4724005280 msgr2=0x7f472400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4724005280 0x7f472400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 -- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724003c40 msgr2=0x7f4724004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724003c40 0x7f4724004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 -- 172.21.15.12:0/1656509401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4724003570 con 0x7f4724004810 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f473959c700 1 -- 172.21.15.12:0/1656509401 reap_dead start 2023-10-08T16:24:32.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f4733fff700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 0x7f4724004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f47200019e0 tx=0x7f4720007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc24162b79df55d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000c5d0 con 0x7f4724004810 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000c730 con 0x7f4724004810 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.319+0000 7f47337fe700 1 -- 172.21.15.12:0/1656509401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000caf0 con 0x7f4724004810 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 -- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 msgr2=0x7f4724004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 0x7f4724004c80 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f47200019e0 tx=0x7f4720007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 -- 172.21.15.12:0/1656509401 shutdown_connections 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 --2- 172.21.15.12:0/1656509401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4724004810 0x7f4724004c80 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 -- 172.21.15.12:0/1656509401 >> 172.21.15.12:0/1656509401 conn(0x7f47340675a0 msgr2=0x7f47340679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 -- 172.21.15.12:0/1656509401 shutdown_connections 2023-10-08T16:24:32.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.320+0000 7f4739d9d700 1 -- 172.21.15.12:0/1656509401 wait complete. 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.321+0000 7f4739d9d700 1 Processor -- start 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.321+0000 7f4739d9d700 1 -- start start 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724004810 0x7f47340c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47340c6390 0x7f47340c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c4540 con 0x7f4734169bc0 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c68b0 con 0x7f4724004810 2023-10-08T16:24:32.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f4739d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340c6b90 con 0x7f47340c6390 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f473959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f473959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60804/0 (socket says 172.21.15.12:60804) 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.322+0000 7f473959c700 1 -- 172.21.15.12:0/2470671031 learned_addr learned my addr 172.21.15.12:0/2470671031 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4733fff700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47340c6390 0x7f47340c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4738d9b700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724004810 0x7f47340c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 -- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47340c6390 msgr2=0x7f47340c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47340c6390 0x7f47340c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 -- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724004810 msgr2=0x7f47340c2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724004810 0x7f47340c2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 -- 172.21.15.12:0/2470671031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340c6e70 con 0x7f4734169bc0 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f473959c700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f47340cc420 tx=0x7f473406b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c007b60 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00abe0 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0133f0 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.323+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47340c7150 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.324+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473416a570 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.324+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473416a7f0 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.325+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f472c0137e0 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.326+0000 7f4730ff9700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 0x7f47180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.326+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f472c084d30 con 0x7f4734169bc0 2023-10-08T16:24:32.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.326+0000 7f4738d9b700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 0x7f47180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.327+0000 7f4738d9b700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 0x7f47180693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4728006f00 tx=0x7f47280091a0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.330+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f472c051e10 con 0x7f4734169bc0 2023-10-08T16:24:32.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.616+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f473404c3c0 con 0x7f4734169bc0 2023-10-08T16:24:32.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.621+0000 7f4730ff9700 1 -- 172.21.15.12:0/2470671031 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f472c055430 con 0x7f4734169bc0 2023-10-08T16:24:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 msgr2=0x7f47180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 0x7f47180693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4728006f00 tx=0x7f47280091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 msgr2=0x7f473416a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f47340cc420 tx=0x7f473406b490 comp rx=0 tx=0).stop 2023-10-08T16:24:32.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 shutdown_connections 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4718066f30 0x7f47180693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4734169bc0 0x7f473416a030 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4724004810 0x7f47340c2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 --2- 172.21.15.12:0/2470671031 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47340c6390 0x7f47340c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 >> 172.21.15.12:0/2470671031 conn(0x7f47340675a0 msgr2=0x7f47340c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 shutdown_connections 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.623+0000 7f4739d9d700 1 -- 172.21.15.12:0/2470671031 wait complete. 2023-10-08T16:24:32.625 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:24:32.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:32.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.830+0000 7f4981f9d700 1 Processor -- start 2023-10-08T16:24:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.830+0000 7f4981f9d700 1 -- start start 2023-10-08T16:24:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4981f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f497c140e40 0x7f497c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4981f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f497c06de50 0x7f497c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4981f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f497c0c6d50 con 0x7f497c140a70 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4981f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0c7030 con 0x7f497c06de50 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4981f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f497c0c7310 con 0x7f497c140e40 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f498179c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f497c06de50 0x7f497c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4980f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f497c140a70 0x7f497c0c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52306/0 (socket says 172.21.15.12:52306) 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.831+0000 7f4980f9b700 1 -- 172.21.15.12:0/3218417683 learned_addr learned my addr 172.21.15.12:0/3218417683 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f497bfff700 1 --2- 172.21.15.12:0/3218417683 >> v2:172.21.15.29:3300/0 conn(0x7f497c140e40 0x7f497c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f498179c700 1 -- 172.21.15.12:0/3218417683 >> v2:172.21.15.29:3300/0 conn(0x7f497c140e40 msgr2=0x7f497c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f497b7fe700 1 -- 172.21.15.12:0/3218417683 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3703305603 0 0) 0x7f497c0c6d50 con 0x7f497c140a70 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f498179c700 1 --2- 172.21.15.12:0/3218417683 >> v2:172.21.15.29:3300/0 conn(0x7f497c140e40 0x7f497c0c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f498179c700 1 -- 172.21.15.12:0/3218417683 >> v1:172.21.15.12:6789/0 conn(0x7f497c140a70 legacy=0x7f497c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f498179c700 1 -- 172.21.15.12:0/3218417683 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f497c0c75f0 con 0x7f497c06de50 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f498179c700 1 --2- 172.21.15.12:0/3218417683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c06de50 0x7f497c0aeef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f497c0cc0e0 tx=0x7f4974009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66465c02116d4fbb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f497b7fe700 1 -- 172.21.15.12:0/3218417683 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400e070 con 0x7f497c06de50 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f497b7fe700 1 -- 172.21.15.12:0/3218417683 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400bc30 con 0x7f497c06de50 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.832+0000 7f497b7fe700 1 -- 172.21.15.12:0/3218417683 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4974012430 con 0x7f497c06de50 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 -- 172.21.15.12:0/3218417683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c06de50 msgr2=0x7f497c0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 --2- 172.21.15.12:0/3218417683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c06de50 0x7f497c0aeef0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f497c0cc0e0 tx=0x7f4974009780 comp rx=0 tx=0).stop 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 -- 172.21.15.12:0/3218417683 shutdown_connections 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 --2- 172.21.15.12:0/3218417683 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c06de50 0x7f497c0aeef0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 --2- 172.21.15.12:0/3218417683 >> v2:172.21.15.29:3300/0 conn(0x7f497c140e40 0x7f497c0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 -- 172.21.15.12:0/3218417683 >> 172.21.15.12:0/3218417683 conn(0x7f497c06d170 msgr2=0x7f497c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 -- 172.21.15.12:0/3218417683 shutdown_connections 2023-10-08T16:24:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.833+0000 7f4981f9d700 1 -- 172.21.15.12:0/3218417683 wait complete. 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.834+0000 7f4981f9d700 1 Processor -- start 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.835+0000 7f4981f9d700 1 -- start start 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f497c06de50 0x7f497c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c140e40 0x7f497c13eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c157ad0 con 0x7f497c140a70 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f497c158650 con 0x7f497c140e40 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4981f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497c157d20 con 0x7f497c06de50 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60826/0 (socket says 172.21.15.12:60826) 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 -- 172.21.15.12:0/1231618007 learned_addr learned my addr 172.21.15.12:0/1231618007 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f498179c700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c140e40 0x7f497c13eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f4980f9b700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f497c06de50 0x7f497c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 -- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f497c06de50 msgr2=0x7f497c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f497c06de50 0x7f497c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 -- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c140e40 msgr2=0x7f497c13eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c140e40 0x7f497c13eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:32.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.836+0000 7f497bfff700 1 -- 172.21.15.12:0/1231618007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009a20 con 0x7f497c140a70 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f497bfff700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f496800d8c0 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968018070 con 0x7f497c140a70 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4968005a00 con 0x7f497c140a70 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c158000 con 0x7f497c140a70 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4968005da0 con 0x7f497c140a70 2023-10-08T16:24:32.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.837+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f497c15a800 con 0x7f497c140a70 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.838+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f497c04c3c0 con 0x7f497c140a70 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.839+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4968006230 con 0x7f497c140a70 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.840+0000 7f4978ff9700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.840+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4968084830 con 0x7f497c140a70 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.840+0000 7f4980f9b700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:32.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.841+0000 7f4980f9b700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 0x7f49600693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f49700011e0 tx=0x7f4970009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:32.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:32.844+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4968051870 con 0x7f497c140a70 2023-10-08T16:24:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.095+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f497c0c78d0 con 0x7f497c140a70 2023-10-08T16:24:33.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.096+0000 7f4978ff9700 1 -- 172.21.15.12:0/1231618007 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f4968054e90 con 0x7f497c140a70 2023-10-08T16:24:33.097 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:33.097 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 msgr2=0x7f49600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 0x7f49600693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f49700011e0 tx=0x7f4970009040 comp rx=0 tx=0).stop 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 msgr2=0x7f497c13e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f496800d8c0 tx=0x7f4968008040 comp rx=0 tx=0).stop 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 shutdown_connections 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4960066f30 0x7f49600693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f497c140e40 0x7f497c13eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f497c06de50 0x7f497c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 --2- 172.21.15.12:0/1231618007 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f497c140a70 0x7f497c13e560 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 >> 172.21.15.12:0/1231618007 conn(0x7f497c06d170 msgr2=0x7f497c0cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.098+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 shutdown_connections 2023-10-08T16:24:33.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.099+0000 7f4981f9d700 1 -- 172.21.15.12:0/1231618007 wait complete. 2023-10-08T16:24:33.101 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:33.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 34, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:24:21.751141+0000', 'modified': '2023-10-08T16:24:25.271821+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6282': {'gid': 6282, 'name': 'c', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6834/2971316211', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 2971316211}, {'type': 'v1', 'addr': '172.21.15.12:6834', 'nonce': 2971316211}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:24:33.520 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:24:33.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:24:33.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.712+0000 7f3f0a19d700 1 Processor -- start 2023-10-08T16:24:33.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.712+0000 7f3f0a19d700 1 -- start start 2023-10-08T16:24:33.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.713+0000 7f3f0a19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 0x7f3f0415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.713+0000 7f3f0a19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.713+0000 7f3f0a19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0415afd0 con 0x7f3f0415de50 2023-10-08T16:24:33.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.713+0000 7f3f0a19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0415b2b0 con 0x7f3f04153c30 2023-10-08T16:24:33.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.713+0000 7f3f0a19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0415b590 con 0x7f3f040cf110 2023-10-08T16:24:33.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0919b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 0x7f3f0415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49034/0 (socket says 172.21.15.12:49034) 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 -- 172.21.15.12:0/3879949233 learned_addr learned my addr 172.21.15.12:0/3879949233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0899a700 1 --1- 172.21.15.12:0/3879949233 >> v1:172.21.15.29:6789/0 conn(0x7f3f0415de50 0x7f3f040cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47834/0 (socket says 172.21.15.12:47834) 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3efbfff700 1 -- 172.21.15.12:0/3879949233 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523661708 0 0) 0x7f3f0415afd0 con 0x7f3f0415de50 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3efbfff700 1 -- 172.21.15.12:0/3879949233 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ef0003570 con 0x7f3f0415de50 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 -- 172.21.15.12:0/3879949233 >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 msgr2=0x7f3f0415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3879949233 >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 0x7f3f0415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 -- 172.21.15.12:0/3879949233 >> v1:172.21.15.29:6789/0 conn(0x7f3f0415de50 legacy=0x7f3f040cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.714+0000 7f3f0999c700 1 -- 172.21.15.12:0/3879949233 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0415b870 con 0x7f3f040cf110 2023-10-08T16:24:33.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.715+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3879949233 >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 0x7f3f0415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:33.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.715+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3879949233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009f20 tx=0x7f3efc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=850732a923053f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.715+0000 7f3efbfff700 1 -- 172.21.15.12:0/3879949233 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc00e070 con 0x7f3f040cf110 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.715+0000 7f3efbfff700 1 -- 172.21.15.12:0/3879949233 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc00b970 con 0x7f3f040cf110 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.715+0000 7f3efbfff700 1 -- 172.21.15.12:0/3879949233 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0092e0 con 0x7f3f040cf110 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 -- 172.21.15.12:0/3879949233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 msgr2=0x7f3f0415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/3879949233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009f20 tx=0x7f3efc009840 comp rx=0 tx=0).stop 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 -- 172.21.15.12:0/3879949233 shutdown_connections 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/3879949233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f0415c070 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/3879949233 >> v2:172.21.15.29:3300/0 conn(0x7f3f04153c30 0x7f3f0415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 -- 172.21.15.12:0/3879949233 >> 172.21.15.12:0/3879949233 conn(0x7f3f040703a0 msgr2=0x7f3f040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 -- 172.21.15.12:0/3879949233 shutdown_connections 2023-10-08T16:24:33.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.716+0000 7f3f0a19d700 1 -- 172.21.15.12:0/3879949233 wait complete. 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.718+0000 7f3f0a19d700 1 Processor -- start 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.718+0000 7f3f0a19d700 1 -- start start 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f040cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0415de50 0x7f3f041508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040ca170 con 0x7f3f04153c30 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f040c9880 con 0x7f3f0415de50 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0a19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f04150e10 con 0x7f3f040cf110 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60840/0 (socket says 172.21.15.12:60840) 2023-10-08T16:24:33.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 -- 172.21.15.12:0/74133464 learned_addr learned my addr 172.21.15.12:0/74133464 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0999c700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0415de50 0x7f3f041508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0919b700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f040cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 -- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 msgr2=0x7f3f040cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f040cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 -- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0415de50 msgr2=0x7f3f041508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0415de50 0x7f3f041508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.719+0000 7f3f0899a700 1 -- 172.21.15.12:0/74133464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00009420 con 0x7f3f04153c30 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3f0899a700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c590 tx=0x7f3ef4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3ef97fa700 1 -- 172.21.15.12:0/74133464 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4005a70 con 0x7f3f04153c30 2023-10-08T16:24:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3ef97fa700 1 -- 172.21.15.12:0/74133464 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4005bf0 con 0x7f3f04153c30 2023-10-08T16:24:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc009ae0 con 0x7f3f04153c30 2023-10-08T16:24:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3ef97fa700 1 -- 172.21.15.12:0/74133464 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40070d0 con 0x7f3f04153c30 2023-10-08T16:24:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.720+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f040c9b20 con 0x7f3f04153c30 2023-10-08T16:24:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.722+0000 7f3ef97fa700 1 -- 172.21.15.12:0/74133464 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ef40074c0 con 0x7f3f04153c30 2023-10-08T16:24:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.723+0000 7f3ef97fa700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 0x7f3ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.723+0000 7f3ef97fa700 1 -- 172.21.15.12:0/74133464 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3ef4083bc0 con 0x7f3f04153c30 2023-10-08T16:24:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.723+0000 7f3f0919b700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 0x7f3ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.724+0000 7f3f0919b700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 0x7f3ee80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f40 tx=0x7f3f000091a0 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.725+0000 7f3f19ab8b80 1 Processor -- start 2023-10-08T16:24:33.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.725+0000 7f3f19ab8b80 1 -- start start 2023-10-08T16:24:33.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade46827d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade4658ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade45afa70 con 0x55ade46565f0 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade45ad270 con 0x55ade4658b80 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ade45a9060 con 0x55ade46a3480 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60850/0 (socket says 172.21.15.12:60850) 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 -- 172.21.15.12:0/3139150108 learned_addr learned my addr 172.21.15.12:0/3139150108 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade4658ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade46827d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 -- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 msgr2=0x55ade46827d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade46827d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 -- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 msgr2=0x55ade4658ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade4658ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0899a700 1 -- 172.21.15.12:0/3139150108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ade4443270 con 0x55ade46565f0 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.726+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade4658ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4050d70 tx=0x7f3ef4081e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3f2ecab537d278 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3eee7fc700 1 -- 172.21.15.12:0/3139150108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40548c0 con 0x55ade46565f0 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3eee7fc700 1 -- 172.21.15.12:0/3139150108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4057b10 con 0x55ade46565f0 2023-10-08T16:24:33.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3eee7fc700 1 -- 172.21.15.12:0/3139150108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef405b860 con 0x55ade46565f0 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3139150108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 msgr2=0x55ade46a3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.727+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4050d70 tx=0x7f3ef4081e10 comp rx=0 tx=0).stop 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3139150108 shutdown_connections 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade4658ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade46827d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3139150108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a3850 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3139150108 >> 172.21.15.12:0/3139150108 conn(0x55ade465a0c0 msgr2=0x55ade465a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3139150108 shutdown_connections 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3139150108 wait complete. 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.728+0000 7f3f19ab8b80 1 -- start start 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.729+0000 7f3f19ab8b80 1 Processor -- start 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade465ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade4554890 con 0x55ade46565f0 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade456fea0 con 0x55ade4658b80 2023-10-08T16:24:33.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ade442be30 con 0x55ade46a3480 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f19ab8b80 10 client.0 _ll_register_callbacks cb 0x55ade461c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60852/0 (socket says 172.21.15.12:60852) 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 -- 172.21.15.12:0/3638193242 learned_addr learned my addr 172.21.15.12:0/3638193242 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade465ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 -- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 msgr2=0x55ade465ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade465ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 -- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 msgr2=0x55ade465a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0919b700 1 -- 172.21.15.12:0/3638193242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f040c9b20 con 0x55ade46565f0 2023-10-08T16:24:33.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.730+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014f70 tx=0x7f3f00016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6812f5d8c94a8d14 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f00011ed0 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3f00013d50 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ade464dcd0 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f00005a00 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3f19ab8b80 10 client.6444 fetch_fsmap learned FSMap version 34 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55ade43e5fe0 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ade464dcd0 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f00005b60 con 0x55ade46565f0 2023-10-08T16:24:33.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.731+0000 7f3f19ab8b80 10 client.6444 fetch_fsmap finished waiting for FSMap version 34 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f19ab8b80 10 client.6444 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f19ab8b80 20 client.6444 populate_metadata read hostname 'smithi012' 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4682d30 0x55ade4683100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f19ab8b80 4 client.6444 mds_command: new command op to 6282 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 --> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ade462aaa0 con 0x55ade4682d30 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4682d30 0x55ade4683100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3ee37fe700 10 client.6444 ms_handle_connect on v2:172.21.15.12:6832/2971316211 2023-10-08T16:24:33.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.732+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4682d30 0x55ade4683100 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66ed141c11d3d5ea server_cookie=b71d2613d8ec06cd in_seq=0 out_seq=0 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3ee37fe700 1 -- 172.21.15.12:0/3638193242 <== mds.0 v2:172.21.15.12:6832/2971316211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ade462aaa0 con 0x55ade4682d30 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3ee37fe700 10 client.6444 handle_command_reply: tid=0 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 client.6444 shutdown 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 msgr2=0x55ade46a28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f3f00014f70 tx=0x7f3f00016000 comp rx=0 tx=0).stop 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 shutdown_connections 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46a28e0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4682d30 0x55ade4683100 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade465ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3638193242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3ee37fe700 0 client.6444 ms_handle_reset on v2:172.21.15.12:6832/2971316211 2023-10-08T16:24:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.733+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 >> 172.21.15.12:0/3638193242 conn(0x55ade465a0c0 msgr2=0x55ade465c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.734+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 shutdown_connections 2023-10-08T16:24:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.734+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3638193242 wait complete. 2023-10-08T16:24:33.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.734+0000 7f3f19ab8b80 20 client.6444 trim_cache size 0 max 16384 2023-10-08T16:24:33.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.751+0000 7f3f19ab8b80 1 Processor -- start 2023-10-08T16:24:33.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.751+0000 7f3f19ab8b80 1 -- start start 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46565f0 0x55ade4682100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade46a3480 0x55ade4655fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade4659180 con 0x55ade4658b80 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade46a1cc0 con 0x55ade46a3480 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ade46b9900 con 0x55ade46565f0 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f0899a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60854/0 (socket says 172.21.15.12:60854) 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f0899a700 1 -- 172.21.15.12:0/3783734396 learned_addr learned my addr 172.21.15.12:0/3783734396 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f0999c700 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade46a3480 0x55ade4655fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.752+0000 7f3f0919b700 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46565f0 0x55ade4682100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 -- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46565f0 msgr2=0x55ade4682100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46565f0 0x55ade4682100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 -- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade46a3480 msgr2=0x55ade4655fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade46a3480 0x55ade4655fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 -- 172.21.15.12:0/3783734396 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ade4577780 con 0x55ade4658b80 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3f0899a700 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4081f40 tx=0x7f3ef407e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a103d2cdbb297 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3eeeffd700 1 -- 172.21.15.12:0/3783734396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40548c0 con 0x55ade4658b80 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3eeeffd700 1 -- 172.21.15.12:0/3783734396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef405b860 con 0x55ade4658b80 2023-10-08T16:24:33.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.753+0000 7f3eeeffd700 1 -- 172.21.15.12:0/3783734396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4052a00 con 0x55ade4658b80 2023-10-08T16:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3783734396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 msgr2=0x55ade4655a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4081f40 tx=0x7f3ef407e040 comp rx=0 tx=0).stop 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3783734396 shutdown_connections 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade46a3480 0x55ade4655fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46565f0 0x55ade4682100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/3783734396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade4658b80 0x55ade4655a70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3783734396 >> 172.21.15.12:0/3783734396 conn(0x55ade465a0c0 msgr2=0x55ade464fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3783734396 shutdown_connections 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/3783734396 wait complete. 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.754+0000 7f3f19ab8b80 1 -- start start 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.755+0000 7f3f19ab8b80 1 Processor -- start 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade4655a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade46bf7e0 con 0x55ade46565f0 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ade46a2f00 con 0x55ade4658b80 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ade46c1de0 con 0x55ade46a3480 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f19ab8b80 10 client.0 _ll_register_callbacks cb 0x55ade461c2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60862/0 (socket says 172.21.15.12:60862) 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 -- 172.21.15.12:0/2888723852 learned_addr learned my addr 172.21.15.12:0/2888723852 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0899a700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0999c700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade4655a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 -- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 msgr2=0x55ade4655a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade4655a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 -- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 msgr2=0x55ade465c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0919b700 1 -- 172.21.15.12:0/2888723852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ade4443270 con 0x55ade46565f0 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.756+0000 7f3f0899a700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3f0919b700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821849a208b57fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3ee37fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f000226b0 con 0x55ade46565f0 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3f00022810 con 0x55ade46565f0 2023-10-08T16:24:33.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f00011ed0 con 0x55ade46565f0 2023-10-08T16:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f00022be0 con 0x55ade46565f0 2023-10-08T16:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3f19ab8b80 10 client.6450 fetch_fsmap learned FSMap version 34 2023-10-08T16:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.757+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55ade455e470 con 0x55ade46565f0 2023-10-08T16:24:33.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f00011ed0 con 0x55ade46565f0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 34) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f00006000 con 0x55ade46565f0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 10 client.6450 fetch_fsmap finished waiting for FSMap version 34 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 10 client.6450 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 20 client.6450 populate_metadata read hostname 'smithi012' 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4655fb0 0x55ade46b8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 4 client.6450 mds_command: new command op to 6282 tid=0[{"prefix": "status"}] 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 --> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f3ef4057b10 con 0x55ade4655fb0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f0899a700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4655fb0 0x55ade46b8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3f0899a700 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4655fb0 0x55ade46b8720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=994dfb3e381e045d server_cookie=d2d209d66bc3043e in_seq=0 out_seq=0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.758+0000 7f3ee37fe700 10 client.6450 ms_handle_connect on v2:172.21.15.12:6832/2971316211 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3ee37fe700 1 -- 172.21.15.12:0/2888723852 <== mds.0 v2:172.21.15.12:6832/2971316211 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f3ef4057b10 con 0x55ade4655fb0 2023-10-08T16:24:33.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3ee37fe700 10 client.6450 handle_command_reply: tid=0 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 client.6450 shutdown 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 msgr2=0x55ade46becf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f3f00000c00 tx=0x7f3f00024000 comp rx=0 tx=0).stop 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 shutdown_connections 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55ade46565f0 0x55ade46becf0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.12:6832/2971316211,v1:172.21.15.12:6834/2971316211] conn(0x55ade4655fb0 0x55ade46b8720 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55ade46a3480 0x55ade4655a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 --2- 172.21.15.12:0/2888723852 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55ade4658b80 0x55ade465c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3ee37fe700 0 client.6450 ms_handle_reset on v2:172.21.15.12:6832/2971316211 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 >> 172.21.15.12:0/2888723852 conn(0x55ade465a0c0 msgr2=0x55ade46ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 shutdown_connections 2023-10-08T16:24:33.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 1 -- 172.21.15.12:0/2888723852 wait complete. 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.759+0000 7f3f19ab8b80 20 client.6450 trim_cache size 0 max 16384 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 6282, 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.498496413, 2023-10-08T16:24:33.765 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 34, 2023-10-08T16:24:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 85, 2023-10-08T16:24:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 85, 2023-10-08T16:24:33.766 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.229752867999999 2023-10-08T16:24:33.766 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 msgr2=0x7f3ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 0x7f3ee80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3f00009f40 tx=0x7f3f000091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 msgr2=0x7f3f04141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c590 tx=0x7f3ef4007e00 comp rx=0 tx=0).stop 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 shutdown_connections 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ee8066f30 0x7f3ee80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f0415de50 0x7f3f041508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f040cf110 0x7f3f040cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 --2- 172.21.15.12:0/74133464 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f04153c30 0x7f3f04141080 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 >> 172.21.15.12:0/74133464 conn(0x7f3f040703a0 msgr2=0x7f3f04151920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 shutdown_connections 2023-10-08T16:24:33.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.760+0000 7f3f0a19d700 1 -- 172.21.15.12:0/74133464 wait complete. 2023-10-08T16:24:33.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:24:33.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.963+0000 7f432759e700 1 Processor -- start 2023-10-08T16:24:33.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.963+0000 7f432759e700 1 -- start start 2023-10-08T16:24:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.964+0000 7f432759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4328153c30 0x7f432815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.964+0000 7f432759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 0x7f43280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.964+0000 7f432759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f432815afd0 con 0x7f43280cef40 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.964+0000 7f432759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432815b2b0 con 0x7f4328153c30 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.964+0000 7f432759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432815b590 con 0x7f432815de50 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f4326d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f43280cef40 0x7f432806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52316/0 (socket says 172.21.15.12:52316) 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f4326d9d700 1 -- 172.21.15.12:0/1066194899 learned_addr learned my addr 172.21.15.12:0/1066194899 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432659c700 1 --2- 172.21.15.12:0/1066194899 >> v2:172.21.15.29:3300/0 conn(0x7f4328153c30 0x7f432815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f4325d9b700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 0x7f43280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222760835 0 0) 0x7f432815afd0 con 0x7f43280cef40 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4310003570 con 0x7f43280cef40 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273402031 0 0) 0x7f4310003570 con 0x7f43280cef40 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432659c700 1 -- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 msgr2=0x7f43280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432659c700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 0x7f43280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432659c700 1 -- 172.21.15.12:0/1066194899 >> v1:172.21.15.12:6789/0 conn(0x7f43280cef40 legacy=0x7f432806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f432659c700 1 -- 172.21.15.12:0/1066194899 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432815b870 con 0x7f4328153c30 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.965+0000 7f4325d9b700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 0x7f43280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.966+0000 7f432659c700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4328153c30 0x7f432815a5e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43180098e0 tx=0x7f43180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49d5f734555a635d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.966+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200017f0 con 0x7f4328153c30 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.966+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4318011420 con 0x7f4328153c30 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.966+0000 7f432559a700 1 -- 172.21.15.12:0/1066194899 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43180117c0 con 0x7f4328153c30 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 -- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4328153c30 msgr2=0x7f432815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4328153c30 0x7f432815a5e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f43180098e0 tx=0x7f43180091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 -- 172.21.15.12:0/1066194899 shutdown_connections 2023-10-08T16:24:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4328153c30 0x7f432815a5e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 --2- 172.21.15.12:0/1066194899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f432815de50 0x7f43280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 -- 172.21.15.12:0/1066194899 >> 172.21.15.12:0/1066194899 conn(0x7f43280703a0 msgr2=0x7f43280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 -- 172.21.15.12:0/1066194899 shutdown_connections 2023-10-08T16:24:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.967+0000 7f432759e700 1 -- 172.21.15.12:0/1066194899 wait complete. 2023-10-08T16:24:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.968+0000 7f432759e700 1 Processor -- start 2023-10-08T16:24:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.968+0000 7f432759e700 1 -- start start 2023-10-08T16:24:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.969+0000 7f432759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 0x7f43280b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.969+0000 7f432759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4328153c30 0x7f43280cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.969+0000 7f432759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f432759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280b5e10 con 0x7f432815de50 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f432759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43280b5200 con 0x7f43280cef40 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f432759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43280b54e0 con 0x7f4328153c30 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60872/0 (socket says 172.21.15.12:60872) 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 -- 172.21.15.12:0/3490826348 learned_addr learned my addr 172.21.15.12:0/3490826348 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4325d9b700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4328153c30 0x7f43280cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f432659c700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 0x7f43280b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 -- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4328153c30 msgr2=0x7f43280cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4328153c30 0x7f43280cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 -- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 msgr2=0x7f43280b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 0x7f43280b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f4326d9d700 1 -- 172.21.15.12:0/3490826348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009420 con 0x7f432815de50 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.970+0000 7f432659c700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 0x7f43280b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f4326d9d700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f432000cbe0 tx=0x7f4320001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320004dc0 con 0x7f432815de50 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000a6b0 con 0x7f432815de50 2023-10-08T16:24:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000aa70 con 0x7f432815de50 2023-10-08T16:24:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4318009420 con 0x7f432815de50 2023-10-08T16:24:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.971+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43280b5aa0 con 0x7f432815de50 2023-10-08T16:24:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.972+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432804c3c0 con 0x7f432815de50 2023-10-08T16:24:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.973+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4320007150 con 0x7f432815de50 2023-10-08T16:24:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.975+0000 7f43167fc700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 0x7f43080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.975+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4320083e20 con 0x7f432815de50 2023-10-08T16:24:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.975+0000 7f432659c700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 0x7f43080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.975+0000 7f432659c700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 0x7f43080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43180030c0 tx=0x7f4318016000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:33.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:33.979+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4320050ee0 con 0x7f432815de50 2023-10-08T16:24:34.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.226+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43280b5f50 con 0x7f432815de50 2023-10-08T16:24:34.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.226+0000 7f43167fc700 1 -- 172.21.15.12:0/3490826348 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v34) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4320018070 con 0x7f432815de50 2023-10-08T16:24:34.227 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:24:34.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.228+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 msgr2=0x7f43080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.228+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 0x7f43080693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f43180030c0 tx=0x7f4318016000 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.228+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 msgr2=0x7f4328152d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.228+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f432000cbe0 tx=0x7f4320001640 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 shutdown_connections 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4308066f30 0x7f43080693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f432815de50 0x7f4328152d00 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43280cef40 0x7f43280b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 --2- 172.21.15.12:0/3490826348 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4328153c30 0x7f43280cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 >> 172.21.15.12:0/3490826348 conn(0x7f43280703a0 msgr2=0x7f4328070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 shutdown_connections 2023-10-08T16:24:34.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:34.229+0000 7f432759e700 1 -- 172.21.15.12:0/3490826348 wait complete. 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:24:34.248 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:24:34.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.249 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:24:34.286 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:24:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:24:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:24:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.286 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41267sec preferred_lft 41267sec 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:24:34.287 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:24:34.288 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:24:34.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.289 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:24:34.388 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:24:34.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.391 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:24:34.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:24:34.432 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:24:34.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.630 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:24:34.666 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:24:34.666 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:24:34.667 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:24:34.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:34.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:24:34.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:24:34.770 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:34.807 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:24:34.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:24:34.808 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:34.884 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:24:34.884 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:24:34.884 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:24:35.017 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:24:35.017 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:24:35.046 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:24:35.046 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:24:35.047 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:24:35.047 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:24:35.047 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:24:35.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:24:35.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:35.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:35.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:24:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.302+0000 7fe9bdb9d700 1 Processor -- start 2023-10-08T16:24:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.302+0000 7fe9bdb9d700 1 -- start start 2023-10-08T16:24:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bdb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9b80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bdb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe9b80ca240 0x7fe9b80c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bdb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9b80ca6b0 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bdb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9b80cb4f0 con 0x7fe9b80ca240 2023-10-08T16:24:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bdb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81601e0 con 0x7fe9b815b5d0 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bd39c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe9b80c6ec0 0x7fe9b806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52330/0 (socket says 172.21.15.12:52330) 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bd39c700 1 -- 172.21.15.12:0/2519500455 learned_addr learned my addr 172.21.15.12:0/2519500455 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/2519500455 >> v2:172.21.15.29:3300/0 conn(0x7fe9b80ca240 0x7fe9b80c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9bcb9b700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9b80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.304+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399120744 0 0) 0x7fe9b80ca6b0 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9a8003570 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2785900454 0 0) 0x7fe9a8003570 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 msgr2=0x7fe9b80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9b80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 >> v2:172.21.15.29:3300/0 conn(0x7fe9b80ca240 msgr2=0x7fe9b80c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 --2- 172.21.15.12:0/2519500455 >> v2:172.21.15.29:3300/0 conn(0x7fe9b80ca240 0x7fe9b80c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b815e390 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe9b00017f0 con 0x7fe9b80c6ec0 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 >> v1:172.21.15.12:6789/0 conn(0x7fe9b80c6ec0 legacy=0x7fe9b806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9a8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9a8004d50 0x7fe9a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80cb4f0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b81601e0 con 0x7fe9a8004d50 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a800ba90 con 0x7fe9b815b5d0 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9bcb9b700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9a8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.305+0000 7fe9bd39c700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9a8004d50 0x7fe9a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 -- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 msgr2=0x7fe9a8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b815b5d0 0x7fe9a8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 -- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9a8004d50 msgr2=0x7fe9a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9a8004d50 0x7fe9a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 -- 172.21.15.12:0/2519500455 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a8003570 con 0x7fe9a8003fe0 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9bd39c700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9a8004d50 0x7fe9a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9a8004810 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009bf0 tx=0x7fe9a4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b096aaf825b75d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4005a00 con 0x7fe9a8003fe0 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4005b60 con 0x7fe9a8003fe0 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.306+0000 7fe9b77fe700 1 -- 172.21.15.12:0/2519500455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a400e6b0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/2519500455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 msgr2=0x7fe9a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/2519500455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9a8004810 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009bf0 tx=0x7fe9a4009120 comp rx=0 tx=0).stop 2023-10-08T16:24:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bd39c700 1 -- 172.21.15.12:0/2519500455 reap_dead start 2023-10-08T16:24:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/2519500455 shutdown_connections 2023-10-08T16:24:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/2519500455 >> 172.21.15.12:0/2519500455 conn(0x7fe9b806d170 msgr2=0x7fe9b80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/2519500455 shutdown_connections 2023-10-08T16:24:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.307+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/2519500455 wait complete. 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.308+0000 7fe9bdb9d700 1 Processor -- start 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.309+0000 7fe9bdb9d700 1 -- start start 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b81584c0 0x7fe9b816ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b814e2d0 0x7fe9b815c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c3bf0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b80c5b70 con 0x7fe9b814e2d0 2023-10-08T16:24:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bdb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b816f270 con 0x7fe9b81584c0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60882/0 (socket says 172.21.15.12:60882) 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 -- 172.21.15.12:0/3729594943 learned_addr learned my addr 172.21.15.12:0/3729594943 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bd39c700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b814e2d0 0x7fe9b815c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b81584c0 0x7fe9b816ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 -- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b81584c0 msgr2=0x7fe9b816ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b81584c0 0x7fe9b816ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 -- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b814e2d0 msgr2=0x7fe9b815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b814e2d0 0x7fe9b815c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 -- 172.21.15.12:0/3729594943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b80c55c0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.310+0000 7fe9bcb9b700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac011da0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.311+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac009e20 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.311+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00fcd0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.311+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac014650 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.311+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b80c5840 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.311+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b80c3e40 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.312+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b80ccfc0 con 0x7fe9a8003fe0 2023-10-08T16:24:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.313+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9ac014a80 con 0x7fe9a8003fe0 2023-10-08T16:24:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.314+0000 7fe9b4ff9700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.314+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fe9ac018030 con 0x7fe9a8003fe0 2023-10-08T16:24:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.314+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.315+0000 7fe9b7fff700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 0x7fe99c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009160 tx=0x7fe9a4019000 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.318+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9ac052280 con 0x7fe9a8003fe0 2023-10-08T16:24:35.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.548+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b80c5cb0 con 0x7fe99c066f30 2023-10-08T16:24:35.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.550+0000 7fe9b4ff9700 1 -- 172.21.15.12:0/3729594943 <== mgr.5923 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe9a400e6b0 con 0x7fe99c066f30 2023-10-08T16:24:35.551 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:24:35.551 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:35.551 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:24:35.551 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:35.551 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:24:35.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 msgr2=0x7fe99c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 0x7fe99c0693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9a4009160 tx=0x7fe9a4019000 comp rx=0 tx=0).stop 2023-10-08T16:24:35.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 msgr2=0x7fe9b816e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac011da0 tx=0x7fe9ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 shutdown_connections 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe99c066f30 0x7fe99c0693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe9a8003fe0 0x7fe9b816e730 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe9b814e2d0 0x7fe9b815c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 --2- 172.21.15.12:0/3729594943 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe9b81584c0 0x7fe9b816ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 >> 172.21.15.12:0/3729594943 conn(0x7fe9b806d170 msgr2=0x7fe9b8159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 shutdown_connections 2023-10-08T16:24:35.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.552+0000 7fe9bdb9d700 1 -- 172.21.15.12:0/3729594943 wait complete. 2023-10-08T16:24:35.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:24:35.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.763+0000 7f7df599d700 1 Processor -- start 2023-10-08T16:24:35.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.763+0000 7f7df599d700 1 -- start start 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df599d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7df0153a00 0x7f7df0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df599d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7df00cea00 0x7f7df00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df599d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df015ac50 con 0x7f7df015de50 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df599d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df015d010 con 0x7f7df0153a00 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df599d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df00cf3c0 con 0x7f7df00cea00 2023-10-08T16:24:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df499b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7df0153a00 0x7f7df0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df499b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7df0153a00 0x7f7df0153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60884/0 (socket says 172.21.15.12:60884) 2023-10-08T16:24:35.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df499b700 1 -- 172.21.15.12:0/3158079519 learned_addr learned my addr 172.21.15.12:0/3158079519 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:35.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.764+0000 7f7df519c700 1 --2- 172.21.15.12:0/3158079519 >> v2:172.21.15.29:3300/0 conn(0x7f7df00cea00 0x7f7df00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7df499b700 1 -- 172.21.15.12:0/3158079519 >> v2:172.21.15.29:3300/0 conn(0x7f7df00cea00 msgr2=0x7f7df00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:35.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7df499b700 1 --2- 172.21.15.12:0/3158079519 >> v2:172.21.15.29:3300/0 conn(0x7f7df00cea00 0x7f7df00cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7df499b700 1 -- 172.21.15.12:0/3158079519 >> v1:172.21.15.29:6789/0 conn(0x7f7df015de50 legacy=0x7f7df015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7df499b700 1 -- 172.21.15.12:0/3158079519 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df015af60 con 0x7f7df0153a00 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7df499b700 1 --2- 172.21.15.12:0/3158079519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df0153a00 0x7f7df0153dd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7df00d03e0 tx=0x7f7de4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1062be2b47d935 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.765+0000 7f7def7fe700 1 -- 172.21.15.12:0/3158079519 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4009e70 con 0x7f7df0153a00 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7def7fe700 1 -- 172.21.15.12:0/3158079519 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de400b860 con 0x7f7df0153a00 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7def7fe700 1 -- 172.21.15.12:0/3158079519 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de400bc00 con 0x7f7df0153a00 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 -- 172.21.15.12:0/3158079519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df0153a00 msgr2=0x7f7df0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 --2- 172.21.15.12:0/3158079519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df0153a00 0x7f7df0153dd0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7df00d03e0 tx=0x7f7de4009250 comp rx=0 tx=0).stop 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 -- 172.21.15.12:0/3158079519 shutdown_connections 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 --2- 172.21.15.12:0/3158079519 >> v2:172.21.15.29:3300/0 conn(0x7f7df00cea00 0x7f7df00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 --2- 172.21.15.12:0/3158079519 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df0153a00 0x7f7df0153dd0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 -- 172.21.15.12:0/3158079519 >> 172.21.15.12:0/3158079519 conn(0x7f7df00703a0 msgr2=0x7f7df00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.766+0000 7f7df599d700 1 -- 172.21.15.12:0/3158079519 shutdown_connections 2023-10-08T16:24:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.767+0000 7f7df599d700 1 -- 172.21.15.12:0/3158079519 wait complete. 2023-10-08T16:24:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.768+0000 7f7df599d700 1 Processor -- start 2023-10-08T16:24:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.768+0000 7f7df599d700 1 -- start start 2023-10-08T16:24:35.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7df0153a00 0x7f7df0169c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 0x7f7df00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00cc0e0 con 0x7f7df00cea00 2023-10-08T16:24:35.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df00cc630 con 0x7f7df015de50 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df599d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df016a690 con 0x7f7df0153a00 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60890/0 (socket says 172.21.15.12:60890) 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.769+0000 7f7df499b700 1 -- 172.21.15.12:0/868156119 learned_addr learned my addr 172.21.15.12:0/868156119 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df519c700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 0x7f7df00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7deffff700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7df0153a00 0x7f7df0169c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 -- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7df0153a00 msgr2=0x7f7df0169c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7df0153a00 0x7f7df0169c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 -- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 msgr2=0x7f7df00b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 0x7f7df00b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 -- 172.21.15.12:0/868156119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40094f0 con 0x7f7df00cea00 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df519c700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 0x7f7df00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df499b700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7df006eb00 tx=0x7f7de4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4011420 con 0x7f7df00cea00 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4011580 con 0x7f7df00cea00 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df016a970 con 0x7f7df00cea00 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.770+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4011940 con 0x7f7df00cea00 2023-10-08T16:24:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.771+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df0144440 con 0x7f7df00cea00 2023-10-08T16:24:35.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.772+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df004c3c0 con 0x7f7df00cea00 2023-10-08T16:24:35.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.773+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 28) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7de4011d30 con 0x7f7df00cea00 2023-10-08T16:24:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.774+0000 7f7decff9700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 0x7f7dd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.774+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7de4085d40 con 0x7f7df00cea00 2023-10-08T16:24:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.774+0000 7f7deffff700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 0x7f7dd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.775+0000 7f7deffff700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 0x7f7dd40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003860 tx=0x7f7ddc009040 comp rx=0 tx=0).ready entity=mgr.5923 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:35.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:35.778+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7de4052d80 con 0x7f7df00cea00 2023-10-08T16:24:36.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.053+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f7df00caef0 con 0x7f7df00cea00 2023-10-08T16:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.778+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7de4053150 con 0x7f7df00cea00 2023-10-08T16:24:36.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.779+0000 7f7decff9700 1 -- 172.21.15.12:0/868156119 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v29) v1 ==== 92+0+0 (secure 0 0 0) 0x7f7de4052d80 con 0x7f7df00cea00 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 msgr2=0x7f7dd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 0x7f7dd40693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc003860 tx=0x7f7ddc009040 comp rx=0 tx=0).stop 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 msgr2=0x7f7df0143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f7df006eb00 tx=0x7f7de4017000 comp rx=0 tx=0).stop 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 shutdown_connections 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7dd4066f30 0x7f7dd40693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7df00cea00 0x7f7df0143f00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:36.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7df015de50 0x7f7df00b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 --2- 172.21.15.12:0/868156119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7df0153a00 0x7f7df0169c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 >> 172.21.15.12:0/868156119 conn(0x7f7df00703a0 msgr2=0x7f7df0152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 shutdown_connections 2023-10-08T16:24:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:36.782+0000 7f7df599d700 1 -- 172.21.15.12:0/868156119 wait complete. 2023-10-08T16:24:36.801 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:24:37.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.002+0000 7f9029f9d700 1 Processor -- start 2023-10-08T16:24:37.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.002+0000 7f9029f9d700 1 -- start start 2023-10-08T16:24:37.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.003+0000 7f9029f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9024157420 0x7f90240b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.003+0000 7f9029f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f90240af6b0 0x7f90240accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.003+0000 7f9029f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90240ac840 con 0x7f902406d250 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.003+0000 7f9029f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90240b18f0 con 0x7f9024157420 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9029f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90240abf50 con 0x7f90240af6b0 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9028f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9024157420 0x7f90240b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9023fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f902406d250 0x7f90240aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52338/0 (socket says 172.21.15.12:52338) 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9023fff700 1 -- 172.21.15.12:0/1230782245 learned_addr learned my addr 172.21.15.12:0/1230782245 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:37.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f902979c700 1 --2- 172.21.15.12:0/1230782245 >> v2:172.21.15.29:3300/0 conn(0x7f90240af6b0 0x7f90240accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9028f9b700 1 -- 172.21.15.12:0/1230782245 >> v2:172.21.15.29:3300/0 conn(0x7f90240af6b0 msgr2=0x7f90240accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9028f9b700 1 --2- 172.21.15.12:0/1230782245 >> v2:172.21.15.29:3300/0 conn(0x7f90240af6b0 0x7f90240accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9028f9b700 1 -- 172.21.15.12:0/1230782245 >> v1:172.21.15.12:6789/0 conn(0x7f902406d250 legacy=0x7f90240aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.004+0000 7f9028f9b700 1 -- 172.21.15.12:0/1230782245 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90240aea60 con 0x7f9024157420 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.005+0000 7f9028f9b700 1 --2- 172.21.15.12:0/1230782245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9024157420 0x7f90240b13b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f902406b0f0 tx=0x7f90180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a1fc8c91114917 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.005+0000 7f90237fe700 1 -- 172.21.15.12:0/1230782245 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011630 con 0x7f9024157420 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.005+0000 7f90237fe700 1 -- 172.21.15.12:0/1230782245 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9018011790 con 0x7f9024157420 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.005+0000 7f90237fe700 1 -- 172.21.15.12:0/1230782245 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018011b30 con 0x7f9024157420 2023-10-08T16:24:37.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 -- 172.21.15.12:0/1230782245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9024157420 msgr2=0x7f90240b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 --2- 172.21.15.12:0/1230782245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9024157420 0x7f90240b13b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f902406b0f0 tx=0x7f90180091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 -- 172.21.15.12:0/1230782245 shutdown_connections 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 --2- 172.21.15.12:0/1230782245 >> v2:172.21.15.29:3300/0 conn(0x7f90240af6b0 0x7f90240accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 --2- 172.21.15.12:0/1230782245 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9024157420 0x7f90240b13b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 -- 172.21.15.12:0/1230782245 >> 172.21.15.12:0/1230782245 conn(0x7f902406ce80 msgr2=0x7f90240ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 -- 172.21.15.12:0/1230782245 shutdown_connections 2023-10-08T16:24:37.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.006+0000 7f9029f9d700 1 -- 172.21.15.12:0/1230782245 wait complete. 2023-10-08T16:24:37.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.007+0000 7f9029f9d700 1 Processor -- start 2023-10-08T16:24:37.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.007+0000 7f9029f9d700 1 -- start start 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 0x7f902414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024153f70 con 0x7f90240af6b0 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024068d40 con 0x7f9024157420 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.008+0000 7f9029f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9024069020 con 0x7f902406d250 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9028f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60932/0 (socket says 172.21.15.12:60932) 2023-10-08T16:24:37.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9028f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49146/0 (socket says 172.21.15.12:49146) 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 -- 172.21.15.12:0/2687617435 learned_addr learned my addr 172.21.15.12:0/2687617435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f902979c700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 0x7f902414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 msgr2=0x7f9024156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 msgr2=0x7f902414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 0x7f902414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 -- 172.21.15.12:0/2687617435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9018009420 con 0x7f90240af6b0 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9028f9b700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f902979c700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 0x7f902414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.009+0000 7f9023fff700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f901000c590 tx=0x7f9010001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.010+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010005b30 con 0x7f90240af6b0 2023-10-08T16:24:37.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.010+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9010005cb0 con 0x7f90240af6b0 2023-10-08T16:24:37.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.010+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010007320 con 0x7f90240af6b0 2023-10-08T16:24:37.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.010+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9024069300 con 0x7f90240af6b0 2023-10-08T16:24:37.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.010+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9024068ab0 con 0x7f90240af6b0 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.011+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9024069800 con 0x7f90240af6b0 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.012+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f901001b3b0 con 0x7f90240af6b0 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.013+0000 7f9020ff9700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 0x7f9008069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.013+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f9010083b10 con 0x7f90240af6b0 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.013+0000 7f9028f9b700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 msgr2=0x7f9008069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.013+0000 7f9028f9b700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 0x7f9008069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.017+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9010050b50 con 0x7f90240af6b0 2023-10-08T16:24:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.214+0000 7f9028f9b700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 msgr2=0x7f9008069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:37.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.214+0000 7f9028f9b700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 0x7f9008069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:37.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.269+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f902404c3c0 con 0x7f90240af6b0 2023-10-08T16:24:37.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.273+0000 7f9020ff9700 1 -- 172.21.15.12:0/2687617435 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f90100170d0 con 0x7f90240af6b0 2023-10-08T16:24:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 msgr2=0x7f9008069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 0x7f9008069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 msgr2=0x7f902414f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f901000c590 tx=0x7f9010001020 comp rx=0 tx=0).stop 2023-10-08T16:24:37.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 shutdown_connections 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9008066f80 0x7f9008069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9024157420 0x7f902414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f902406d250 0x7f9024156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 --2- 172.21.15.12:0/2687617435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f90240af6b0 0x7f902414f600 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 >> 172.21.15.12:0/2687617435 conn(0x7f902406ce80 msgr2=0x7f90240aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 shutdown_connections 2023-10-08T16:24:37.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.276+0000 7f9029f9d700 1 -- 172.21.15.12:0/2687617435 wait complete. 2023-10-08T16:24:37.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:24:37.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.497+0000 7f4372b9d700 1 Processor -- start 2023-10-08T16:24:37.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.498+0000 7f4372b9d700 1 -- start start 2023-10-08T16:24:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f4372b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f436c140a70 0x7f436c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f4372b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c15b640 con 0x7f436c0c7c60 2023-10-08T16:24:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f4372b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c15b920 con 0x7f436c06de50 2023-10-08T16:24:37.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f4372b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c0c6800 con 0x7f436c140a70 2023-10-08T16:24:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f437239c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f436c0c7c60 0x7f436c158190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52350/0 (socket says 172.21.15.12:52350) 2023-10-08T16:24:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f437239c700 1 -- 172.21.15.12:0/1655909103 learned_addr learned my addr 172.21.15.12:0/1655909103 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.499+0000 7f4371b9b700 1 --2- 172.21.15.12:0/1655909103 >> v2:172.21.15.29:3300/0 conn(0x7f436c140a70 0x7f436c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4371b9b700 1 -- 172.21.15.12:0/1655909103 >> v1:172.21.15.29:6789/0 conn(0x7f436c06de50 legacy=0x7f436c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4371b9b700 1 -- 172.21.15.12:0/1655909103 >> v1:172.21.15.12:6789/0 conn(0x7f436c0c7c60 legacy=0x7f436c158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4371b9b700 1 -- 172.21.15.12:0/1655909103 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c15bc00 con 0x7f436c140a70 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4370b99700 1 -- 172.21.15.12:0/1655909103 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955637285 0 0) 0x7f436c15b640 con 0x7f436c0c7c60 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4371b9b700 1 --2- 172.21.15.12:0/1655909103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c140a70 0x7f436c069b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f43680098e0 tx=0x7f43680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97904d442742ca50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.500+0000 7f4370b99700 1 -- 172.21.15.12:0/1655909103 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4368009e80 con 0x7f436c140a70 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4370b99700 1 -- 172.21.15.12:0/1655909103 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436800b860 con 0x7f436c140a70 2023-10-08T16:24:37.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4370b99700 1 -- 172.21.15.12:0/1655909103 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436800bbe0 con 0x7f436c140a70 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 -- 172.21.15.12:0/1655909103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c140a70 msgr2=0x7f436c069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1655909103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c140a70 0x7f436c069b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f43680098e0 tx=0x7f43680091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 -- 172.21.15.12:0/1655909103 shutdown_connections 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1655909103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c140a70 0x7f436c069b00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 -- 172.21.15.12:0/1655909103 >> 172.21.15.12:0/1655909103 conn(0x7f436c06d110 msgr2=0x7f436c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 -- 172.21.15.12:0/1655909103 shutdown_connections 2023-10-08T16:24:37.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.501+0000 7f4372b9d700 1 -- 172.21.15.12:0/1655909103 wait complete. 2023-10-08T16:24:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.503+0000 7f4372b9d700 1 Processor -- start 2023-10-08T16:24:37.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.503+0000 7f4372b9d700 1 -- start start 2023-10-08T16:24:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f436c0c7c60 0x7f436c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c13c9d0 con 0x7f436c140a70 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0cb120 con 0x7f436c06de50 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4372b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c45c0 con 0x7f436c0c7c60 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f437239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4371b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f437239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60944/0 (socket says 172.21.15.12:60944) 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f437239c700 1 -- 172.21.15.12:0/1545176663 learned_addr learned my addr 172.21.15.12:0/1545176663 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f4371b9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:52228/0 (socket says 172.21.15.12:52228) 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.504+0000 7f437139a700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f436c0c7c60 0x7f436c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f436c0c7c60 msgr2=0x7f436c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f436c0c7c60 0x7f436c157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 msgr2=0x7f436c13cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 -- 172.21.15.12:0/1545176663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4368009420 con 0x7f436c140a70 2023-10-08T16:24:37.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f4371b9b700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f437239c700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f436400ccc0 tx=0x7f4364001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400a8a0 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436400aa00 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436400adc0 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.505+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c157dc0 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.506+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c0cae40 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.507+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436c04c3c0 con 0x7f436c140a70 2023-10-08T16:24:37.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.507+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4364007300 con 0x7f436c140a70 2023-10-08T16:24:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.509+0000 7f4361ffb700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 0x7f4350069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.509+0000 7f4371b9b700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 msgr2=0x7f4350069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.509+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4364084ae0 con 0x7f436c140a70 2023-10-08T16:24:37.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.509+0000 7f4371b9b700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 0x7f4350069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:37.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.513+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4364051ba0 con 0x7f436c140a70 2023-10-08T16:24:37.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.710+0000 7f4371b9b700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 msgr2=0x7f4350069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:37.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.710+0000 7f4371b9b700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 0x7f4350069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:37.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.741+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f436c0c4700 con 0x7f436c140a70 2023-10-08T16:24:37.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.745+0000 7f4361ffb700 1 -- 172.21.15.12:0/1545176663 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f43640551c0 con 0x7f436c140a70 2023-10-08T16:24:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 msgr2=0x7f4350069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 0x7f4350069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 msgr2=0x7f436c069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f436400ccc0 tx=0x7f4364001a80 comp rx=0 tx=0).stop 2023-10-08T16:24:37.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 shutdown_connections 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4350066f80 0x7f4350069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f436c140a70 0x7f436c069a00 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f436c06de50 0x7f436c13cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 --2- 172.21.15.12:0/1545176663 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f436c0c7c60 0x7f436c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 >> 172.21.15.12:0/1545176663 conn(0x7f436c06d110 msgr2=0x7f436c0c9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 shutdown_connections 2023-10-08T16:24:37.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:37.748+0000 7f4372b9d700 1 -- 172.21.15.12:0/1545176663 wait complete. 2023-10-08T16:24:37.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:37.767 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T16:24:37.811 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-08T16:24:38.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.045+0000 7ff975bff700 1 Processor -- start 2023-10-08T16:24:38.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.045+0000 7ff975bff700 1 -- start start 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff975bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 0x7ff970159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff975bff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff970159e40 0x7ff9700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff975bff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9700ccfd0 con 0x7ff970159530 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff975bff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff97015a410 con 0x7ff970159e40 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff975bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97015a6f0 con 0x7ff97006dcf0 2023-10-08T16:24:38.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff96f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff970159530 0x7ff9700ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52362/0 (socket says 172.21.15.12:52362) 2023-10-08T16:24:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff96f7fe700 1 -- 172.21.15.12:0/3691704597 learned_addr learned my addr 172.21.15.12:0/3691704597 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.046+0000 7ff96ffff700 1 --2- 172.21.15.12:0/3691704597 >> v2:172.21.15.29:3300/0 conn(0x7ff970159e40 0x7ff9700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:38.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96effd700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 0x7ff970159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96e7fc700 1 -- 172.21.15.12:0/3691704597 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059879053 0 0) 0x7ff9700ccfd0 con 0x7ff970159530 2023-10-08T16:24:38.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96e7fc700 1 -- 172.21.15.12:0/3691704597 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff958003570 con 0x7ff970159530 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96ffff700 1 -- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 msgr2=0x7ff970159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96ffff700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 0x7ff970159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96ffff700 1 -- 172.21.15.12:0/3691704597 >> v1:172.21.15.12:6789/0 conn(0x7ff970159530 legacy=0x7ff9700ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96ffff700 1 -- 172.21.15.12:0/3691704597 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97015a9d0 con 0x7ff970159e40 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96effd700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 0x7ff970159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.047+0000 7ff96ffff700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700cb6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff968009e60 tx=0x7ff968009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=640271b3a8e56737 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff96e7fc700 1 -- 172.21.15.12:0/3691704597 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800e070 con 0x7ff970159e40 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff96e7fc700 1 -- 172.21.15.12:0/3691704597 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96800bab0 con 0x7ff970159e40 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff96e7fc700 1 -- 172.21.15.12:0/3691704597 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96800be70 con 0x7ff970159e40 2023-10-08T16:24:38.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff975bff700 1 -- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 msgr2=0x7ff9700cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff975bff700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700cb6f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff968009e60 tx=0x7ff968009780 comp rx=0 tx=0).stop 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff975bff700 1 -- 172.21.15.12:0/3691704597 shutdown_connections 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff975bff700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700cb6f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.048+0000 7ff975bff700 1 --2- 172.21.15.12:0/3691704597 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff97006dcf0 0x7ff970159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.049+0000 7ff975bff700 1 -- 172.21.15.12:0/3691704597 >> 172.21.15.12:0/3691704597 conn(0x7ff9700703a0 msgr2=0x7ff9700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.049+0000 7ff975bff700 1 -- 172.21.15.12:0/3691704597 shutdown_connections 2023-10-08T16:24:38.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.049+0000 7ff975bff700 1 -- 172.21.15.12:0/3691704597 wait complete. 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.050+0000 7ff975bff700 1 Processor -- start 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.050+0000 7ff975bff700 1 -- start start 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff97006dcf0 0x7ff970150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff970159530 0x7ff9700b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9700b6430 con 0x7ff97006dcf0 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9701513a0 con 0x7ff970159e40 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff975bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97015b600 con 0x7ff970159530 2023-10-08T16:24:38.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff97006dcf0 0x7ff970150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff96f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff97006dcf0 0x7ff970150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60952/0 (socket says 172.21.15.12:60952) 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.051+0000 7ff96f7fe700 1 -- 172.21.15.12:0/2048398008 learned_addr learned my addr 172.21.15.12:0/2048398008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96ffff700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff970159530 0x7ff9700b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff970159530 msgr2=0x7ff9700b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff970159530 0x7ff9700b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 msgr2=0x7ff9700b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff970159e40 0x7ff9700b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009420 con 0x7ff97006dcf0 2023-10-08T16:24:38.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.052+0000 7ff96f7fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff97006dcf0 0x7ff970150e60 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7ff96000c7c0 tx=0x7ff960007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.053+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960005cd0 con 0x7ff97006dcf0 2023-10-08T16:24:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.053+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff960005e30 con 0x7ff97006dcf0 2023-10-08T16:24:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.053+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960007320 con 0x7ff97006dcf0 2023-10-08T16:24:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.053+0000 7ff975bff700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff968009a20 con 0x7ff97006dcf0 2023-10-08T16:24:38.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.053+0000 7ff975bff700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9700b6150 con 0x7ff97006dcf0 2023-10-08T16:24:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.054+0000 7ff975bff700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff97004c3c0 con 0x7ff97006dcf0 2023-10-08T16:24:38.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.055+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 29) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff960007690 con 0x7ff97006dcf0 2023-10-08T16:24:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.056+0000 7ff9577fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.056+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff960083e50 con 0x7ff97006dcf0 2023-10-08T16:24:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.056+0000 7ff96effd700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:38.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.056+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:38.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.060+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff960050e90 con 0x7ff97006dcf0 2023-10-08T16:24:38.114 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.112+0000 7f9af38ca180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:38.208 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.207+0000 7ff9a4539180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:38.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.257+0000 7ff96effd700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:38.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.257+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:38.286 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.285+0000 7f9af38ca180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:38.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.293+0000 7ff975bff700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff97015b740 con 0x7ff95c066f80 2023-10-08T16:24:38.375 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.374+0000 7f9af38ca180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:38.382 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.381+0000 7ff9a4539180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:38.471 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.470+0000 7ff9a4539180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:38.606 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.605+0000 7f9af38ca180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:38.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.658+0000 7ff96effd700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:38.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:38.658+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:24:38.701 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.700+0000 7ff9a4539180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:38.790 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.789+0000 7f9af38ca180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:38.883 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.883+0000 7ff9a4539180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:38.885 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:38.884+0000 7f9af38ca180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:38.978 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:38.977+0000 7ff9a4539180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:39.051 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:39.050+0000 7f9af38ca180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:39.143 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:39.142+0000 7ff9a4539180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:39.154 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:39.153+0000 7f9af38ca180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:39.246 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:39.246+0000 7ff9a4539180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:39.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:39.459+0000 7ff96effd700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:39.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:39.459+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:24:39.655 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:39.654+0000 7f9af38ca180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:39.747 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:39.747+0000 7ff9a4539180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:39.753 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:39.752+0000 7f9af38ca180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:39.844 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:39.844+0000 7ff9a4539180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:39.846 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:39.845+0000 7f9af38ca180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:39.938 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:39.937+0000 7ff9a4539180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:40.497 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:40.496+0000 7f9af38ca180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:40.583 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:40.582+0000 7ff9a4539180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:40.675 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:40.674+0000 7f9af38ca180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:40.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:40.760+0000 7ff9a4539180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:40.775 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:40.774+0000 7f9af38ca180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:40.859 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:40.858+0000 7ff9a4539180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:41.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:41.060+0000 7ff96effd700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:41.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:41.060+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:24:41.078 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:41.077+0000 7f9af38ca180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:41.158 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:41.157+0000 7ff9a4539180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:41.178 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:41.177+0000 7f9af38ca180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:41.257 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:41.256+0000 7ff9a4539180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:41.912 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:41.911+0000 7f9af38ca180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:41.989 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:41.988+0000 7ff9a4539180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:42.203 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.202+0000 7f9af38ca180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:42.277 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.276+0000 7ff9a4539180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:42.299 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.298+0000 7f9af38ca180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:42.372 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.372+0000 7ff9a4539180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:42.462 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.461+0000 7f9af38ca180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:42.532 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.531+0000 7ff9a4539180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:42.570 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.570+0000 7f9af38ca180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:42.640 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.639+0000 7ff9a4539180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:42.766 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.765+0000 7f9af38ca180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:42.833 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.832+0000 7ff9a4539180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:42.861 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.860+0000 7f9af38ca180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:42.928 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:42.927+0000 7ff9a4539180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:42.956 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:42.955+0000 7f9af38ca180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:43.022 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.021+0000 7ff9a4539180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:43.053 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:43.052+0000 7f9af38ca180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:43.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:43.112+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 30) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff960051260 con 0x7ff97006dcf0 2023-10-08T16:24:43.120 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.120+0000 7ff9a4539180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:43.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:43.132+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 31) v1 ==== 84468+0+0 (secure 0 0 0) 0x7ff960058000 con 0x7ff97006dcf0 2023-10-08T16:24:43.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:43.132+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 msgr2=0x7ff95c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:43.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:43.132+0000 7ff9577fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:43.248 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.247+0000 7ff919076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.248 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.247+0000 7ff919076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.248 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.247+0000 7ff919076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.248 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.247+0000 7ff919076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.247+0000 7ff919076700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.248+0000 7ff916871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.248+0000 7ff916871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.248+0000 7ff916871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.248+0000 7ff916871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:43.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:43.248+0000 7ff916871700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:24:44.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.135+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7ff960051b30 con 0x7ff97006dcf0 2023-10-08T16:24:44.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.136+0000 7ff9577fe700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.136+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff95c033140 con 0x7ff95c066f80 2023-10-08T16:24:44.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.140+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.142+0000 7ff96effd700 1 --2- 172.21.15.12:0/2048398008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff95c066f80 0x7ff95c0693b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff970153470 tx=0x7ff9640091a0 comp rx=0 tx=0).ready entity=mgr.6486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:44.153 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:44.152+0000 7ff920885700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-08T16:24:44.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.153+0000 7ff9577fe700 1 -- 172.21.15.12:0/2048398008 <== mgr.6486 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7ff95c033140 con 0x7ff95c066f80 2023-10-08T16:24:44.155 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-08T16:24:44.163 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-08T16:24:44.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:44.164 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T16:24:44.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:24:44.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.438+0000 7f2d3adff700 1 Processor -- start 2023-10-08T16:24:44.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.438+0000 7f2d3adff700 1 -- start start 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d3adff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d340c8800 0x7f2d340c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d3adff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d340b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d3adff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d340adbc0 con 0x7f2d340b0f80 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d3adff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d340b1400 con 0x7f2d340c8800 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d3adff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d340c9d30 con 0x7f2d340c8bd0 2023-10-08T16:24:44.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d340c8800 0x7f2d340c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d340c8800 0x7f2d340c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39738/0 (socket says 172.21.15.12:39738) 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 -- 172.21.15.12:0/708125311 learned_addr learned my addr 172.21.15.12:0/708125311 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d33fff700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d340b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 -- 172.21.15.12:0/708125311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 msgr2=0x7f2d340b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d340b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 -- 172.21.15.12:0/708125311 >> v1:172.21.15.29:6789/0 conn(0x7f2d340b0f80 legacy=0x7f2d340ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.440+0000 7f2d38b9b700 1 -- 172.21.15.12:0/708125311 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d340acfb0 con 0x7f2d340c8800 2023-10-08T16:24:44.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d38b9b700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340c8800 0x7f2d340c94e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de9a8de96f60255 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d337fe700 1 -- 172.21.15.12:0/708125311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800b860 con 0x7f2d340c8800 2023-10-08T16:24:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d337fe700 1 -- 172.21.15.12:0/708125311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2800b9c0 con 0x7f2d340c8800 2023-10-08T16:24:44.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d337fe700 1 -- 172.21.15.12:0/708125311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800bd60 con 0x7f2d340c8800 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d3adff700 1 -- 172.21.15.12:0/708125311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340c8800 msgr2=0x7f2d340c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.441+0000 7f2d3adff700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340c8800 0x7f2d340c94e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f2d280099b0 tx=0x7f2d28009250 comp rx=0 tx=0).stop 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 -- 172.21.15.12:0/708125311 shutdown_connections 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340c8800 0x7f2d340c94e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 --2- 172.21.15.12:0/708125311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d340b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 -- 172.21.15.12:0/708125311 >> 172.21.15.12:0/708125311 conn(0x7f2d3406d170 msgr2=0x7f2d340cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 -- 172.21.15.12:0/708125311 shutdown_connections 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.442+0000 7f2d3adff700 1 -- 172.21.15.12:0/708125311 wait complete. 2023-10-08T16:24:44.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.443+0000 7f2d3adff700 1 Processor -- start 2023-10-08T16:24:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.443+0000 7f2d3adff700 1 -- start start 2023-10-08T16:24:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 0x7f2d34151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d34069da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3414c3b0 con 0x7f2d340b0f80 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3414b7a0 con 0x7f2d340c8800 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3adff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3414ba80 con 0x7f2d340c8bd0 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d38b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d38b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39742/0 (socket says 172.21.15.12:39742) 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d38b9b700 1 -- 172.21.15.12:0/513208176 learned_addr learned my addr 172.21.15.12:0/513208176 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d33fff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 0x7f2d34151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.444+0000 7f2d3939c700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d34069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 -- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 msgr2=0x7f2d34069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d34069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 -- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 msgr2=0x7f2d34151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 0x7f2d34151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:44.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 -- 172.21.15.12:0/513208176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d280094f0 con 0x7f2d340b0f80 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d33fff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 0x7f2d34151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d3939c700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d34069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d38b9b700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406e1f0 tx=0x7f2d28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28024440 con 0x7f2d340b0f80 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d280245c0 con 0x7f2d340b0f80 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d28024980 con 0x7f2d340b0f80 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3414bd60 con 0x7f2d340b0f80 2023-10-08T16:24:44.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.445+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3406bed0 con 0x7f2d340b0f80 2023-10-08T16:24:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.446+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3404c3c0 con 0x7f2d340b0f80 2023-10-08T16:24:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.447+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 32) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f2d2801a420 con 0x7f2d340b0f80 2023-10-08T16:24:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.448+0000 7f2d30ff9700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 0x7f2d180692b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.448+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2d28086380 con 0x7f2d340b0f80 2023-10-08T16:24:44.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.448+0000 7f2d33fff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 0x7f2d180692b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:44.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.449+0000 7f2d33fff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 0x7f2d180692b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d3414d620 tx=0x7f2d20008040 comp rx=0 tx=0).ready entity=mgr.6486 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.453+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d28053540 con 0x7f2d340b0f80 2023-10-08T16:24:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:44.709+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f2d340ab740 con 0x7f2d340b0f80 2023-10-08T16:24:45.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.143+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2d28053910 con 0x7f2d340b0f80 2023-10-08T16:24:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.144+0000 7f2d30ff9700 1 -- 172.21.15.12:0/513208176 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v33) v1 ==== 93+0+0 (secure 0 0 0) 0x7f2d28056fd0 con 0x7f2d340b0f80 2023-10-08T16:24:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 msgr2=0x7f2d180692b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 0x7f2d180692b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2d3414d620 tx=0x7f2d20008040 comp rx=0 tx=0).stop 2023-10-08T16:24:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 msgr2=0x7f2d3406b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f2d3406e1f0 tx=0x7f2d28017000 comp rx=0 tx=0).stop 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 shutdown_connections 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2d18066e00 0x7f2d180692b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d340b0f80 0x7f2d3406b990 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d340c8bd0 0x7f2d34069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 --2- 172.21.15.12:0/513208176 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d340c8800 0x7f2d34151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 >> 172.21.15.12:0/513208176 conn(0x7f2d3406d170 msgr2=0x7f2d3406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:45.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 shutdown_connections 2023-10-08T16:24:45.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.147+0000 7f2d3adff700 1 -- 172.21.15.12:0/513208176 wait complete. 2023-10-08T16:24:45.167 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:24:45.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:45.261 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:45.341 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:24:45.342 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:24:45.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:24:45.342 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:24:45.430 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:24:45.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:24:45.431 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:24:45.469 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.697+0000 7efe8e99d700 1 Processor -- start 2023-10-08T16:24:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.697+0000 7efe8e99d700 1 -- start start 2023-10-08T16:24:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.698+0000 7efe8e99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe88153c30 0x7efe8815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.698+0000 7efe8e99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8815afd0 con 0x7efe880cf110 2023-10-08T16:24:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.698+0000 7efe8e99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8815b2b0 con 0x7efe8815de50 2023-10-08T16:24:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.698+0000 7efe8e99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8815b590 con 0x7efe88153c30 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe88153c30 0x7efe8815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efe88153c30 0x7efe8815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39778/0 (socket says 172.21.15.12:39778) 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8e19c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efe880cf110 0x7efe8815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55134/0 (socket says 172.21.15.12:55134) 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 -- 172.21.15.12:0/3964596394 learned_addr learned my addr 172.21.15.12:0/3964596394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d19a700 1 --1- 172.21.15.12:0/3964596394 >> v1:172.21.15.29:6789/0 conn(0x7efe8815de50 0x7efe880cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47090/0 (socket says 172.21.15.12:47090) 2023-10-08T16:24:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 -- 172.21.15.12:0/3964596394 >> v1:172.21.15.29:6789/0 conn(0x7efe8815de50 legacy=0x7efe880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 -- 172.21.15.12:0/3964596394 >> v1:172.21.15.12:6789/0 conn(0x7efe880cf110 legacy=0x7efe8815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 -- 172.21.15.12:0/3964596394 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8815b870 con 0x7efe88153c30 2023-10-08T16:24:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.699+0000 7efe8d99b700 1 --2- 172.21.15.12:0/3964596394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe88153c30 0x7efe8815a5e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a526807970e20637 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8c999700 1 -- 172.21.15.12:0/3964596394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400b860 con 0x7efe88153c30 2023-10-08T16:24:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8c999700 1 -- 172.21.15.12:0/3964596394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400b9c0 con 0x7efe88153c30 2023-10-08T16:24:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8c999700 1 -- 172.21.15.12:0/3964596394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400bd60 con 0x7efe88153c30 2023-10-08T16:24:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8e99d700 1 -- 172.21.15.12:0/3964596394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe88153c30 msgr2=0x7efe8815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8e99d700 1 --2- 172.21.15.12:0/3964596394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe88153c30 0x7efe8815a5e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7efe840099b0 tx=0x7efe84009250 comp rx=0 tx=0).stop 2023-10-08T16:24:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8e99d700 1 -- 172.21.15.12:0/3964596394 shutdown_connections 2023-10-08T16:24:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8e99d700 1 --2- 172.21.15.12:0/3964596394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe88153c30 0x7efe8815a5e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.700+0000 7efe8e99d700 1 -- 172.21.15.12:0/3964596394 >> 172.21.15.12:0/3964596394 conn(0x7efe880703a0 msgr2=0x7efe880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.701+0000 7efe8e99d700 1 -- 172.21.15.12:0/3964596394 shutdown_connections 2023-10-08T16:24:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.701+0000 7efe8e99d700 1 -- 172.21.15.12:0/3964596394 wait complete. 2023-10-08T16:24:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.702+0000 7efe8e99d700 1 Processor -- start 2023-10-08T16:24:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.702+0000 7efe8e99d700 1 -- start start 2023-10-08T16:24:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe88153c30 0x7efe880c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8815de50 0x7efe880cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe88169f60 con 0x7efe880cf110 2023-10-08T16:24:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe880b4110 con 0x7efe8815de50 2023-10-08T16:24:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe880c91c0 con 0x7efe88153c30 2023-10-08T16:24:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39794/0 (socket says 172.21.15.12:39794) 2023-10-08T16:24:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8d99b700 1 -- 172.21.15.12:0/847871506 learned_addr learned my addr 172.21.15.12:0/847871506 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.703+0000 7efe8e19c700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8815de50 0x7efe880cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d19a700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe88153c30 0x7efe880c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe88153c30 msgr2=0x7efe880c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe88153c30 0x7efe880c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8815de50 msgr2=0x7efe880cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8815de50 0x7efe880cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 -- 172.21.15.12:0/847871506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe840094f0 con 0x7efe880cf110 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8d99b700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efe8806eb00 tx=0x7efe84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84024440 con 0x7efe880cf110 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe840245a0 con 0x7efe880cf110 2023-10-08T16:24:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84024920 con 0x7efe880cf110 2023-10-08T16:24:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.704+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe880c94a0 con 0x7efe880cf110 2023-10-08T16:24:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.705+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe880b43f0 con 0x7efe880cf110 2023-10-08T16:24:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.706+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8804c3c0 con 0x7efe880cf110 2023-10-08T16:24:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.707+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7efe8401a420 con 0x7efe880cf110 2023-10-08T16:24:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.708+0000 7efe7dffb700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 0x7efe6c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.708+0000 7efe8d19a700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 msgr2=0x7efe6c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.708+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7efe840868c0 con 0x7efe880cf110 2023-10-08T16:24:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.708+0000 7efe8d19a700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 0x7efe6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.712+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe84053580 con 0x7efe880cf110 2023-10-08T16:24:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.909+0000 7efe8d19a700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 msgr2=0x7efe6c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:45.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.909+0000 7efe8d19a700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 0x7efe6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:45.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.962+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe880c9940 con 0x7efe880cf110 2023-10-08T16:24:45.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.962+0000 7efe7dffb700 1 -- 172.21.15.12:0/847871506 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7efe84056ba0 con 0x7efe880cf110 2023-10-08T16:24:45.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:45.963 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:45.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.964+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 msgr2=0x7efe6c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.964+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 0x7efe6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.964+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 msgr2=0x7efe880b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.964+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7efe8806eb00 tx=0x7efe84017000 comp rx=0 tx=0).stop 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 shutdown_connections 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe6c0670e0 0x7efe6c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe880cf110 0x7efe880b5a50 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8815de50 0x7efe880cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 --2- 172.21.15.12:0/847871506 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe88153c30 0x7efe880c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 >> 172.21.15.12:0/847871506 conn(0x7efe880703a0 msgr2=0x7efe88151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 shutdown_connections 2023-10-08T16:24:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:45.965+0000 7efe8e99d700 1 -- 172.21.15.12:0/847871506 wait complete. 2023-10-08T16:24:45.967 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:45.984 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:46.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.178+0000 7f6bf5d9d700 1 Processor -- start 2023-10-08T16:24:46.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.178+0000 7f6bf5d9d700 1 -- start start 2023-10-08T16:24:46.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.179+0000 7f6bf5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.179+0000 7f6bf5d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bf00cf110 0x7f6bf015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.179+0000 7f6bf5d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf015afd0 con 0x7f6bf015de50 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.179+0000 7f6bf5d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf015b2b0 con 0x7f6bf00cf110 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.179+0000 7f6bf5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf015b590 con 0x7f6bf0153c30 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6bf00cf110 0x7f6bf015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6beffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6bf015de50 0x7f6bf00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55148/0 (socket says 172.21.15.12:55148) 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6beffff700 1 -- 172.21.15.12:0/2507240662 learned_addr learned my addr 172.21.15.12:0/2507240662 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:46.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf4d9b700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf559c700 1 -- 172.21.15.12:0/2507240662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 msgr2=0x7f6bf015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf559c700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf559c700 1 -- 172.21.15.12:0/2507240662 >> v1:172.21.15.12:6789/0 conn(0x7f6bf015de50 legacy=0x7f6bf00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bf559c700 1 -- 172.21.15.12:0/2507240662 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf015b870 con 0x7f6bf00cf110 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.180+0000 7f6bef7fe700 1 -- 172.21.15.12:0/2507240662 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2757467253 0 0) 0x7f6bf015afd0 con 0x7f6bf015de50 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bf559c700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf00cf110 0x7f6bf015c070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009e60 tx=0x7f6be8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7486094c45b9763 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bef7fe700 1 -- 172.21.15.12:0/2507240662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be800e070 con 0x7f6bf00cf110 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bef7fe700 1 -- 172.21.15.12:0/2507240662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be800bb60 con 0x7f6bf00cf110 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bef7fe700 1 -- 172.21.15.12:0/2507240662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8012430 con 0x7f6bf00cf110 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/2507240662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf00cf110 msgr2=0x7f6bf015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.181+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf00cf110 0x7f6bf015c070 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009e60 tx=0x7f6be8009780 comp rx=0 tx=0).stop 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/2507240662 shutdown_connections 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf00cf110 0x7f6bf015c070 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/2507240662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/2507240662 >> 172.21.15.12:0/2507240662 conn(0x7f6bf00703a0 msgr2=0x7f6bf00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/2507240662 shutdown_connections 2023-10-08T16:24:46.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.182+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/2507240662 wait complete. 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.183+0000 7f6bf5d9d700 1 Processor -- start 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.183+0000 7f6bf5d9d700 1 -- start start 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf00cf110 0x7f6bf00c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00c86a0 con 0x7f6bf015de50 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00cc150 con 0x7f6bf00cf110 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf00cc3d0 con 0x7f6bf0153c30 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39818/0 (socket says 172.21.15.12:39818) 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6bf559c700 1 -- 172.21.15.12:0/1449433746 learned_addr learned my addr 172.21.15.12:0/1449433746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.184+0000 7f6beffff700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf4d9b700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf00cf110 0x7f6bf00c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 msgr2=0x7f6bf00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf00cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf00cf110 msgr2=0x7f6bf00c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf00cf110 0x7f6bf00c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 -- 172.21.15.12:0/1449433746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be8009a20 con 0x7f6bf015de50 2023-10-08T16:24:46.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6bf559c700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b6c0 tx=0x7f6be8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:46.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8012e90 con 0x7f6bf015de50 2023-10-08T16:24:46.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.185+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be8027470 con 0x7f6bf015de50 2023-10-08T16:24:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.186+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf00cc6b0 con 0x7f6bf015de50 2023-10-08T16:24:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.186+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be8027830 con 0x7f6bf015de50 2023-10-08T16:24:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.186+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf00b39d0 con 0x7f6bf015de50 2023-10-08T16:24:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.187+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf00ccbd0 con 0x7f6bf015de50 2023-10-08T16:24:46.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.188+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6be8024070 con 0x7f6bf015de50 2023-10-08T16:24:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.189+0000 7f6becff9700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 0x7f6bd4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.189+0000 7f6bf4d9b700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 msgr2=0x7f6bd4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.189+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6be8087110 con 0x7f6bf015de50 2023-10-08T16:24:46.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.189+0000 7f6bf4d9b700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 0x7f6bd4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:46.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.194+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bf00ccbd0 con 0x7f6bf015de50 2023-10-08T16:24:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.390+0000 7f6bf4d9b700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 msgr2=0x7f6bd4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:46.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.390+0000 7f6bf4d9b700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 0x7f6bd4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:46.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.407+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bf00ccbd0 con 0x7f6bf015de50 2023-10-08T16:24:46.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.408+0000 7f6becff9700 1 -- 172.21.15.12:0/1449433746 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16360 (secure 0 0 0) 0x7f6bf00ccbd0 con 0x7f6bf015de50 2023-10-08T16:24:46.409 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:46.409 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:43.123170+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/717128295":"2023-10-09T16:24:43.123143+0000","172.21.15.12:6836/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/4018489120":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/330434581":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/3992418056":"2023-10-09T16:24:43.123143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 msgr2=0x7f6bd4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 0x7f6bd4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 msgr2=0x7f6bf00b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6be800b6c0 tx=0x7f6be8019000 comp rx=0 tx=0).stop 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 shutdown_connections 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6bd40670e0 0x7f6bd4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bf015de50 0x7f6bf00b3490 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bf00cf110 0x7f6bf00c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 --2- 172.21.15.12:0/1449433746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bf0153c30 0x7f6bf00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 >> 172.21.15.12:0/1449433746 conn(0x7f6bf00703a0 msgr2=0x7f6bf0159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 shutdown_connections 2023-10-08T16:24:46.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.410+0000 7f6bf5d9d700 1 -- 172.21.15.12:0/1449433746 wait complete. 2023-10-08T16:24:46.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:24:19.937534+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:24:20.723520+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:24:46.430 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:24:46.483 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:46.483+0000 7f17f3878180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:46.521 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:46.521+0000 7f43dbe7d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:24:46.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.629+0000 7fefe559d700 1 Processor -- start 2023-10-08T16:24:46.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.629+0000 7fefe559d700 1 -- start start 2023-10-08T16:24:46.891 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:46.655+0000 7f17f3878180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:46.891 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:46.744+0000 7f17f3878180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.630+0000 7fefe559d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 0x7fefe0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.630+0000 7fefe559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 0x7fefe00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.630+0000 7fefe559d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe015ac50 con 0x7fefe015de50 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.630+0000 7fefe559d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe015d010 con 0x7fefe0153a00 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.630+0000 7fefe559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00cf3c0 con 0x7fefe00cea00 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fefe015de50 0x7fefe015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55150/0 (socket says 172.21.15.12:55150) 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdf7fe700 1 -- 172.21.15.12:0/3636034124 learned_addr learned my addr 172.21.15.12:0/3636034124 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdffff700 1 --2- 172.21.15.12:0/3636034124 >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 0x7fefe0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/3636034124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 0x7fefe00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdeffd700 1 -- 172.21.15.12:0/3636034124 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1945173086 0 0) 0x7fefe015ac50 con 0x7fefe015de50 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdeffd700 1 -- 172.21.15.12:0/3636034124 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefcc003570 con 0x7fefe015de50 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 -- 172.21.15.12:0/3636034124 >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 msgr2=0x7fefe0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/3636034124 >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 0x7fefe0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 -- 172.21.15.12:0/3636034124 >> v1:172.21.15.12:6789/0 conn(0x7fefe015de50 legacy=0x7fefe015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 -- 172.21.15.12:0/3636034124 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe015af60 con 0x7fefe00cea00 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefdffff700 1 --2- 172.21.15.12:0/3636034124 >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 0x7fefe0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:46.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.631+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/3636034124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 0x7fefe00cee80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098e0 tx=0x7fefd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f9feac1f96fc67 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefdeffd700 1 -- 172.21.15.12:0/3636034124 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8011630 con 0x7fefe00cea00 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefdeffd700 1 -- 172.21.15.12:0/3636034124 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8011790 con 0x7fefe00cea00 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefdeffd700 1 -- 172.21.15.12:0/3636034124 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8011b30 con 0x7fefe00cea00 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 -- 172.21.15.12:0/3636034124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 msgr2=0x7fefe00cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 --2- 172.21.15.12:0/3636034124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 0x7fefe00cee80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098e0 tx=0x7fefd80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 -- 172.21.15.12:0/3636034124 shutdown_connections 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 --2- 172.21.15.12:0/3636034124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe00cea00 0x7fefe00cee80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 --2- 172.21.15.12:0/3636034124 >> v2:172.21.15.29:3300/0 conn(0x7fefe0153a00 0x7fefe0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.632+0000 7fefe559d700 1 -- 172.21.15.12:0/3636034124 >> 172.21.15.12:0/3636034124 conn(0x7fefe00703a0 msgr2=0x7fefe00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:46.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.633+0000 7fefe559d700 1 -- 172.21.15.12:0/3636034124 shutdown_connections 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.633+0000 7fefe559d700 1 -- 172.21.15.12:0/3636034124 wait complete. 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.634+0000 7fefe559d700 1 Processor -- start 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.634+0000 7fefe559d700 1 -- start start 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe00cea00 0x7fefe0150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 0x7fefe00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe01506a0 con 0x7fefe0153a00 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00cc4f0 con 0x7fefe00cea00 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe00cdbf0 con 0x7fefe015de50 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefdf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefdf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39830/0 (socket says 172.21.15.12:39830) 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefdffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe00cea00 0x7fefe0150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefdf7fe700 1 -- 172.21.15.12:0/951497543 learned_addr learned my addr 172.21.15.12:0/951497543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.635+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 0x7fefe00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe00cea00 msgr2=0x7fefe0150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe00cea00 0x7fefe0150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 msgr2=0x7fefe00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 -- 172.21.15.12:0/951497543 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0009a20 con 0x7fefe015de50 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefdf7fe700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe4d9c700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 0x7fefe00c75e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefd8016000 tx=0x7fefd8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:46.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8011b10 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd801a430 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd801a7d0 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.636+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd8009420 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.637+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe00cbbc0 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.638+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe00cc680 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.639+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fefd801abc0 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.639+0000 7fefd7fff700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 0x7fefc0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.640+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fefd8086790 con 0x7fefe015de50 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.640+0000 7fefdffff700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 msgr2=0x7fefc0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.640+0000 7fefdffff700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 0x7fefc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:46.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.644+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd8053450 con 0x7fefe015de50 2023-10-08T16:24:46.904 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:46.697+0000 7f43dbe7d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:46.904 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:46.786+0000 7f43dbe7d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:24:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.841+0000 7fefdffff700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 msgr2=0x7fefc0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.841+0000 7fefdffff700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 0x7fefc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.847+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fefe004c3c0 con 0x7fefe015de50 2023-10-08T16:24:46.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.848+0000 7fefd7fff700 1 -- 172.21.15.12:0/951497543 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fefd8056a70 con 0x7fefe015de50 2023-10-08T16:24:46.905 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 msgr2=0x7fefc0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 0x7fefc0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 msgr2=0x7fefe00c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 0x7fefe00c75e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fefd8016000 tx=0x7fefd8017000 comp rx=0 tx=0).stop 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 shutdown_connections 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefc00670e0 0x7fefc0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe015de50 0x7fefe00c75e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe00cea00 0x7fefe0150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 --2- 172.21.15.12:0/951497543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe0153a00 0x7fefe00cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 >> 172.21.15.12:0/951497543 conn(0x7fefe00703a0 msgr2=0x7fefe00b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 shutdown_connections 2023-10-08T16:24:46.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:46.850+0000 7fefe559d700 1 -- 172.21.15.12:0/951497543 wait complete. 2023-10-08T16:24:46.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:24:46.974 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:46.974+0000 7f17f3878180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:47.023 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:47.022+0000 7f43dbe7d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.100+0000 7fe14d19d700 1 Processor -- start 2023-10-08T16:24:47.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.101+0000 7fe14d19d700 1 -- start start 2023-10-08T16:24:47.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe14d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 0x7fe14815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe14d19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14815ac50 con 0x7fe148153a00 2023-10-08T16:24:47.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe14d19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14815d010 con 0x7fe1480cea00 2023-10-08T16:24:47.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe14d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815af60 con 0x7fe148153dd0 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe147fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe148153a00 0x7fe14815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55160/0 (socket says 172.21.15.12:55160) 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe147fff700 1 -- 172.21.15.12:0/3748210298 learned_addr learned my addr 172.21.15.12:0/3748210298 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.102+0000 7fe1477fe700 1 --2- 172.21.15.12:0/3748210298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 0x7fe14815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202589894 0 0) 0x7fe14815ac50 con 0x7fe148153a00 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe130003570 con 0x7fe148153a00 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431363197 0 0) 0x7fe14815d010 con 0x7fe1480cea00 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14815ac50 con 0x7fe1480cea00 2023-10-08T16:24:47.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe1477fe700 1 -- 172.21.15.12:0/3748210298 >> v1:172.21.15.29:6789/0 conn(0x7fe1480cea00 legacy=0x7fe1480cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe1477fe700 1 -- 172.21.15.12:0/3748210298 >> v1:172.21.15.12:6789/0 conn(0x7fe148153a00 legacy=0x7fe14815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe1477fe700 1 -- 172.21.15.12:0/3748210298 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14815b240 con 0x7fe148153dd0 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe1477fe700 1 --2- 172.21.15.12:0/3748210298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 0x7fe14815de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009910 tx=0x7fe13c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e047e521a0b960 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.103+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011630 con 0x7fe148153dd0 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c011790 con 0x7fe148153dd0 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe146ffd700 1 -- 172.21.15.12:0/3748210298 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011b30 con 0x7fe148153dd0 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 -- 172.21.15.12:0/3748210298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 msgr2=0x7fe14815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 --2- 172.21.15.12:0/3748210298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 0x7fe14815de50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009910 tx=0x7fe13c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 -- 172.21.15.12:0/3748210298 shutdown_connections 2023-10-08T16:24:47.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 --2- 172.21.15.12:0/3748210298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe148153dd0 0x7fe14815de50 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 -- 172.21.15.12:0/3748210298 >> 172.21.15.12:0/3748210298 conn(0x7fe1480703a0 msgr2=0x7fe1480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:47.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 -- 172.21.15.12:0/3748210298 shutdown_connections 2023-10-08T16:24:47.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.104+0000 7fe14d19d700 1 -- 172.21.15.12:0/3748210298 wait complete. 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.106+0000 7fe14d19d700 1 Processor -- start 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.106+0000 7fe14d19d700 1 -- start start 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 0x7fe148154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe148153dd0 0x7fe1480cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480cd140 con 0x7fe148153a00 2023-10-08T16:24:47.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148152650 con 0x7fe148153dd0 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480ccb80 con 0x7fe1480cea00 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 0x7fe148154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe147fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe147fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38776/0 (socket says 172.21.15.12:38776) 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe147fff700 1 -- 172.21.15.12:0/781299362 learned_addr learned my addr 172.21.15.12:0/781299362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe14c99c700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe148153dd0 0x7fe1480cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 msgr2=0x7fe148152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe148153dd0 msgr2=0x7fe1480cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe148153dd0 0x7fe1480cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe1477fe700 1 -- 172.21.15.12:0/781299362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c009420 con 0x7fe148153a00 2023-10-08T16:24:47.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.107+0000 7fe147fff700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:47.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe1477fe700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 0x7fe148154cb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe13c016000 tx=0x7fe13c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c01f070 con 0x7fe148153a00 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13c002f70 con 0x7fe148153a00 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13c011900 con 0x7fe148153a00 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1480cce60 con 0x7fe148153a00 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.108+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148154790 con 0x7fe148153a00 2023-10-08T16:24:47.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.109+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe148154310 con 0x7fe148153a00 2023-10-08T16:24:47.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.110+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe13c023070 con 0x7fe148153a00 2023-10-08T16:24:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.111+0000 7fe12ffff700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 0x7fe134069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.111+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fe13c0859b0 con 0x7fe148153a00 2023-10-08T16:24:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.111+0000 7fe147fff700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 msgr2=0x7fe134069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:47.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.111+0000 7fe147fff700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 0x7fe134069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:47.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.115+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe148154310 con 0x7fe148153a00 2023-10-08T16:24:47.162 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:47.162+0000 7f17f3878180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:47.215 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:47.214+0000 7f43dbe7d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:24:47.257 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:47.257+0000 7f17f3878180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:47.288 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:24:47.293 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:24:47.311 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:47.311+0000 7f43dbe7d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:24:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.312+0000 7fe147fff700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 msgr2=0x7fe134069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:47.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.312+0000 7fe147fff700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 0x7fe134069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:47.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.317+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe148154310 con 0x7fe148153a00 2023-10-08T16:24:47.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.318+0000 7fe12ffff700 1 -- 172.21.15.12:0/781299362 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe148154310 con 0x7fe148153a00 2023-10-08T16:24:47.319 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:24:47.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 msgr2=0x7fe134069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:47.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 0x7fe134069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 msgr2=0x7fe148154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 0x7fe148154cb0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe13c016000 tx=0x7fe13c017000 comp rx=0 tx=0).stop 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 shutdown_connections 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe1340670e0 0x7fe134069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe148153dd0 0x7fe1480cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe1480cea00 0x7fe148152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 --2- 172.21.15.12:0/781299362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe148153a00 0x7fe148154cb0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 >> 172.21.15.12:0/781299362 conn(0x7fe1480703a0 msgr2=0x7fe1480b1bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 shutdown_connections 2023-10-08T16:24:47.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.320+0000 7fe14d19d700 1 -- 172.21.15.12:0/781299362 wait complete. 2023-10-08T16:24:47.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:24:47.426 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:47.427+0000 7f17f3878180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:47.485 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:47.484+0000 7f43dbe7d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:24:47.531 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:47.531+0000 7f17f3878180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.577+0000 7f136599d700 1 Processor -- start 2023-10-08T16:24:47.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.577+0000 7f136599d700 1 -- start start 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136599d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1360153dd0 0x7f136015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136599d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136015ac50 con 0x7f1360153a00 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136599d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136015d010 con 0x7f13600cea00 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136599d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136015af60 con 0x7f1360153dd0 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136499b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1360153a00 0x7f136015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55168/0 (socket says 172.21.15.12:55168) 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f136499b700 1 -- 172.21.15.12:0/4009157719 learned_addr learned my addr 172.21.15.12:0/4009157719 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:47.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.579+0000 7f135ffff700 1 --2- 172.21.15.12:0/4009157719 >> v2:172.21.15.29:3300/0 conn(0x7f1360153dd0 0x7f136015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135f7fe700 1 -- 172.21.15.12:0/4009157719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796530769 0 0) 0x7f136015ac50 con 0x7f1360153a00 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135f7fe700 1 -- 172.21.15.12:0/4009157719 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1350003570 con 0x7f1360153a00 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135ffff700 1 -- 172.21.15.12:0/4009157719 >> v1:172.21.15.29:6789/0 conn(0x7f13600cea00 legacy=0x7f13600ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135ffff700 1 -- 172.21.15.12:0/4009157719 >> v1:172.21.15.12:6789/0 conn(0x7f1360153a00 legacy=0x7f136015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135ffff700 1 -- 172.21.15.12:0/4009157719 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136015b240 con 0x7f1360153dd0 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135ffff700 1 --2- 172.21.15.12:0/4009157719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153dd0 0x7f136015de50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f134c0098e0 tx=0x7f134c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b60f14fc5bd6c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135f7fe700 1 -- 172.21.15.12:0/4009157719 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00b640 con 0x7f1360153dd0 2023-10-08T16:24:47.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135f7fe700 1 -- 172.21.15.12:0/4009157719 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c00b7a0 con 0x7f1360153dd0 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.580+0000 7f135f7fe700 1 -- 172.21.15.12:0/4009157719 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00bb40 con 0x7f1360153dd0 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 -- 172.21.15.12:0/4009157719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153dd0 msgr2=0x7f136015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 --2- 172.21.15.12:0/4009157719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153dd0 0x7f136015de50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f134c0098e0 tx=0x7f134c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 -- 172.21.15.12:0/4009157719 shutdown_connections 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 --2- 172.21.15.12:0/4009157719 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153dd0 0x7f136015de50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 -- 172.21.15.12:0/4009157719 >> 172.21.15.12:0/4009157719 conn(0x7f13600703a0 msgr2=0x7f13600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 -- 172.21.15.12:0/4009157719 shutdown_connections 2023-10-08T16:24:47.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.581+0000 7f136599d700 1 -- 172.21.15.12:0/4009157719 wait complete. 2023-10-08T16:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.583+0000 7f136599d700 1 Processor -- start 2023-10-08T16:24:47.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.583+0000 7f136599d700 1 -- start start 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 0x7f13600cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 0x7f1360152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1360153dd0 0x7f1360158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1360153300 con 0x7f13600cea00 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1360154440 con 0x7f1360153a00 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136599d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600cb7c0 con 0x7f1360153dd0 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 0x7f13600cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 0x7f1360152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136499b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 0x7f13600cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39852/0 (socket says 172.21.15.12:39852) 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136499b700 1 -- 172.21.15.12:0/4093134623 learned_addr learned my addr 172.21.15.12:0/4093134623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f136519c700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1360153dd0 0x7f1360158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1360153dd0 msgr2=0x7f1360158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1360153dd0 0x7f1360158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 msgr2=0x7f13600cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 0x7f13600cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.584+0000 7f135ffff700 1 -- 172.21.15.12:0/4093134623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f134c009420 con 0x7f1360153a00 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f135ffff700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 0x7f1360152870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13600cac20 tx=0x7f134c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c00bb20 con 0x7f1360153a00 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c000c90 con 0x7f1360153a00 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c011650 con 0x7f1360153a00 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13600cb1b0 con 0x7f1360153a00 2023-10-08T16:24:47.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.585+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136016a540 con 0x7f1360153a00 2023-10-08T16:24:47.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.586+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136004c3c0 con 0x7f1360153a00 2023-10-08T16:24:47.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.587+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f134c011a40 con 0x7f1360153a00 2023-10-08T16:24:47.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.588+0000 7f135cff9700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 0x7f1344069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:47.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.588+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f134c0862f0 con 0x7f1360153a00 2023-10-08T16:24:47.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.588+0000 7f136499b700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 msgr2=0x7f1344069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:47.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.588+0000 7f136499b700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 0x7f1344069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:47.593 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:47.592+0000 7f43dbe7d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:24:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.593+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f134c052fb0 con 0x7f1360153a00 2023-10-08T16:24:47.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.789+0000 7f136499b700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 msgr2=0x7f1344069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:47.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.789+0000 7f136499b700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 0x7f1344069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:47.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.796+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13600cb930 con 0x7f1360153a00 2023-10-08T16:24:47.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.797+0000 7f135cff9700 1 -- 172.21.15.12:0/4093134623 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f134c0565d0 con 0x7f1360153a00 2023-10-08T16:24:47.798 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 msgr2=0x7f1344069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 0x7f1344069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 msgr2=0x7f1360152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 0x7f1360152870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f13600cac20 tx=0x7f134c017000 comp rx=0 tx=0).stop 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 shutdown_connections 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f13440670e0 0x7f1344069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f13600cea00 0x7f13600cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1360153dd0 0x7f1360158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 --2- 172.21.15.12:0/4093134623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1360153a00 0x7f1360152870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:47.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 >> 172.21.15.12:0/4093134623 conn(0x7f13600703a0 msgr2=0x7f1360070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:47.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 shutdown_connections 2023-10-08T16:24:47.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:47.800+0000 7f136599d700 1 -- 172.21.15.12:0/4093134623 wait complete. 2023-10-08T16:24:47.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:48.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.009+0000 7fa3a759e700 1 Processor -- start 2023-10-08T16:24:48.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.010+0000 7fa3a759e700 1 -- start start 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a8153c30 0x7fa3a815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a815de50 0x7fa3a80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 0x7fa3a806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a815afd0 con 0x7fa3a815de50 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a815b2b0 con 0x7fa3a80cef40 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a815b590 con 0x7fa3a8153c30 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a815de50 0x7fa3a80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa3a815de50 0x7fa3a80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39864/0 (socket says 172.21.15.12:39864) 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a5d9b700 1 -- 172.21.15.12:0/2334188205 learned_addr learned my addr 172.21.15.12:0/2334188205 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:48.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a659c700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a8153c30 0x7fa3a815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.011+0000 7fa3a6d9d700 1 --2- 172.21.15.12:0/2334188205 >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 0x7fa3a806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 -- 172.21.15.12:0/2334188205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a8153c30 msgr2=0x7fa3a815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a8153c30 0x7fa3a815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 -- 172.21.15.12:0/2334188205 >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 msgr2=0x7fa3a806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 --2- 172.21.15.12:0/2334188205 >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 0x7fa3a806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 -- 172.21.15.12:0/2334188205 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a815b870 con 0x7fa3a815de50 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a6d9d700 1 --2- 172.21.15.12:0/2334188205 >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 0x7fa3a806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:48.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a5d9b700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80cea00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8071370 tx=0x7fa39c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f0f7dafe801e24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a559a700 1 -- 172.21.15.12:0/2334188205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c009e70 con 0x7fa3a815de50 2023-10-08T16:24:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a559a700 1 -- 172.21.15.12:0/2334188205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c00b860 con 0x7fa3a815de50 2023-10-08T16:24:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.012+0000 7fa3a559a700 1 -- 172.21.15.12:0/2334188205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c00bc00 con 0x7fa3a815de50 2023-10-08T16:24:48.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 -- 172.21.15.12:0/2334188205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 msgr2=0x7fa3a80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80cea00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fa3a8071370 tx=0x7fa39c009250 comp rx=0 tx=0).stop 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 -- 172.21.15.12:0/2334188205 shutdown_connections 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 --2- 172.21.15.12:0/2334188205 >> v2:172.21.15.29:3300/0 conn(0x7fa3a80cef40 0x7fa3a806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a8153c30 0x7fa3a815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 --2- 172.21.15.12:0/2334188205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80cea00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 -- 172.21.15.12:0/2334188205 >> 172.21.15.12:0/2334188205 conn(0x7fa3a80703a0 msgr2=0x7fa3a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 -- 172.21.15.12:0/2334188205 shutdown_connections 2023-10-08T16:24:48.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.013+0000 7fa3a759e700 1 -- 172.21.15.12:0/2334188205 wait complete. 2023-10-08T16:24:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.015+0000 7fa3a759e700 1 Processor -- start 2023-10-08T16:24:48.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.016+0000 7fa3a759e700 1 -- start start 2023-10-08T16:24:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a80cef40 0x7fa3a8152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8153c30 0x7fa3a80c8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80c9720 con 0x7fa3a815de50 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a81525c0 con 0x7fa3a8153c30 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a80b6170 con 0x7fa3a80cef40 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.017+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a80cef40 0x7fa3a8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a5d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8153c30 0x7fa3a80c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39880/0 (socket says 172.21.15.12:39880) 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 -- 172.21.15.12:0/3035755937 learned_addr learned my addr 172.21.15.12:0/3035755937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a80cef40 msgr2=0x7fa3a8152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a80cef40 0x7fa3a8152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8153c30 msgr2=0x7fa3a80c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8153c30 0x7fa3a80c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 -- 172.21.15.12:0/3035755937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c0094f0 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3a6d9d700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000d180 tx=0x7fa3a0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.018+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a000dcc0 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.019+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a000f040 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.019+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0015690 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.019+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a80c8970 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.019+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a80c8e80 con 0x7fa3a815de50 2023-10-08T16:24:48.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.020+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a80cb1a0 con 0x7fa3a815de50 2023-10-08T16:24:48.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.021+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa3a001e3b0 con 0x7fa3a815de50 2023-10-08T16:24:48.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.022+0000 7fa3967fc700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 0x7fa388069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.022+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa3a0085130 con 0x7fa3a815de50 2023-10-08T16:24:48.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.022+0000 7fa3a659c700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 msgr2=0x7fa388069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:48.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.022+0000 7fa3a659c700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 0x7fa388069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:48.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.025+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3a0051ce0 con 0x7fa3a815de50 2023-10-08T16:24:48.034 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:48.034+0000 7f17f3878180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:48.122 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:48.122+0000 7f43dbe7d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:24:48.131 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:48.132+0000 7f17f3878180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:48.223 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:48.222+0000 7f43dbe7d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:24:48.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.223+0000 7fa3a659c700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 msgr2=0x7fa388069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:48.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.223+0000 7fa3a659c700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 0x7fa388069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:48.225 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:48.226+0000 7f17f3878180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:48.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.292+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3a804c3c0 con 0x7fa3a815de50 2023-10-08T16:24:48.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.293+0000 7fa3967fc700 1 -- 172.21.15.12:0/3035755937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa3a0055300 con 0x7fa3a815de50 2023-10-08T16:24:48.294 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:48.294 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 msgr2=0x7fa388069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 0x7fa388069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 msgr2=0x7fa3a80b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000d180 tx=0x7fa3a0009a50 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 shutdown_connections 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa3880670e0 0x7fa388069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a815de50 0x7fa3a80b32d0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a80cef40 0x7fa3a8152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 --2- 172.21.15.12:0/3035755937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a8153c30 0x7fa3a80c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 >> 172.21.15.12:0/3035755937 conn(0x7fa3a80703a0 msgr2=0x7fa3a80c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 shutdown_connections 2023-10-08T16:24:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.296+0000 7fa3a759e700 1 -- 172.21.15.12:0/3035755937 wait complete. 2023-10-08T16:24:48.298 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:48.315 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:48.319 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:48.318+0000 7f43dbe7d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:24:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.505+0000 7f274c7ff700 1 Processor -- start 2023-10-08T16:24:48.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.506+0000 7f274c7ff700 1 -- start start 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274c7ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cb5a0 0x7f27440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274c7ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27440cd9e0 0x7f2744159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274c7ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274415ae40 con 0x7f27440cde50 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274c7ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440d13f0 con 0x7f27440cd9e0 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274c7ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274415ab60 con 0x7f27440cb5a0 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f2749d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27440cd9e0 0x7f2744159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f2749d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f27440cd9e0 0x7f2744159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39888/0 (socket says 172.21.15.12:39888) 2023-10-08T16:24:48.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f2749d9a700 1 -- 172.21.15.12:0/3012650133 learned_addr learned my addr 172.21.15.12:0/3012650133 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274ad9c700 1 --1- 172.21.15.12:0/3012650133 >> v1:172.21.15.12:6789/0 conn(0x7f27440cde50 0x7f2744156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55170/0 (socket says 172.21.15.12:55170) 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.507+0000 7f274a59b700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cb5a0 0x7f27440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749d9a700 1 -- 172.21.15.12:0/3012650133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cb5a0 msgr2=0x7f27440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749d9a700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cb5a0 0x7f27440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749d9a700 1 -- 172.21.15.12:0/3012650133 >> v1:172.21.15.12:6789/0 conn(0x7f27440cde50 legacy=0x7f2744156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749d9a700 1 -- 172.21.15.12:0/3012650133 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440ccf00 con 0x7f27440cd9e0 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749599700 1 -- 172.21.15.12:0/3012650133 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846537974 0 0) 0x7f274415ae40 con 0x7f27440cde50 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749d9a700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cd9e0 0x7f2744159ec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc550de536e0baa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749599700 1 -- 172.21.15.12:0/3012650133 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734009ea0 con 0x7f27440cd9e0 2023-10-08T16:24:48.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749599700 1 -- 172.21.15.12:0/3012650133 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273400b860 con 0x7f27440cd9e0 2023-10-08T16:24:48.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.508+0000 7f2749599700 1 -- 172.21.15.12:0/3012650133 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400bc00 con 0x7f27440cd9e0 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 -- 172.21.15.12:0/3012650133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cd9e0 msgr2=0x7f2744159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cd9e0 0x7f2744159ec0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f27340099b0 tx=0x7f2734009250 comp rx=0 tx=0).stop 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 -- 172.21.15.12:0/3012650133 shutdown_connections 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cb5a0 0x7f27440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3012650133 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cd9e0 0x7f2744159ec0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 -- 172.21.15.12:0/3012650133 >> 172.21.15.12:0/3012650133 conn(0x7f2744070e30 msgr2=0x7f27440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 -- 172.21.15.12:0/3012650133 shutdown_connections 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.509+0000 7f274c7ff700 1 -- 172.21.15.12:0/3012650133 wait complete. 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.511+0000 7f274c7ff700 1 Processor -- start 2023-10-08T16:24:48.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.511+0000 7f274c7ff700 1 -- start start 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cd9e0 0x7f2744155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f274415c470 0x7f274415ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274415ce00 con 0x7f27440cb5a0 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27441560c0 con 0x7f274415c470 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274c7ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274415c950 con 0x7f27440cd9e0 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39894/0 (socket says 172.21.15.12:39894) 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274a59b700 1 -- 172.21.15.12:0/3429805380 learned_addr learned my addr 172.21.15.12:0/3429805380 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:48.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f2749d9a700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cd9e0 0x7f2744155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.512+0000 7f274ad9c700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f274415c470 0x7f274415ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cd9e0 msgr2=0x7f2744155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cd9e0 0x7f2744155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f274415c470 msgr2=0x7f274415ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f274415c470 0x7f274415ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 -- 172.21.15.12:0/3429805380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27340094f0 con 0x7f27440cb5a0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274a59b700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f274000ec80 tx=0x7f27400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000c850 con 0x7f27440cb5a0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274000c9b0 con 0x7f27440cb5a0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274415d050 con 0x7f27440cb5a0 2023-10-08T16:24:48.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274000cd50 con 0x7f27440cb5a0 2023-10-08T16:24:48.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.513+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274415d610 con 0x7f27440cb5a0 2023-10-08T16:24:48.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.515+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274415d980 con 0x7f27440cb5a0 2023-10-08T16:24:48.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.515+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2740013680 con 0x7f27440cb5a0 2023-10-08T16:24:48.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.516+0000 7f273a7fc700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 0x7f2728069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.516+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2740084de0 con 0x7f27440cb5a0 2023-10-08T16:24:48.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.516+0000 7f2749d9a700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 msgr2=0x7f2728069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:48.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.516+0000 7f2749d9a700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 0x7f2728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:48.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.520+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2740051aa0 con 0x7f27440cb5a0 2023-10-08T16:24:48.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.717+0000 7f2749d9a700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 msgr2=0x7f2728069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:48.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.717+0000 7f2749d9a700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 0x7f2728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:48.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.724+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f274404c3c0 con 0x7f27440cb5a0 2023-10-08T16:24:48.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.725+0000 7f273a7fc700 1 -- 172.21.15.12:0/3429805380 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16360 (secure 0 0 0) 0x7f27400550c0 con 0x7f27440cb5a0 2023-10-08T16:24:48.726 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:48.726 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:43.123170+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/717128295":"2023-10-09T16:24:43.123143+0000","172.21.15.12:6836/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/4018489120":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/330434581":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/3992418056":"2023-10-09T16:24:43.123143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 msgr2=0x7f2728069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 0x7f2728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 msgr2=0x7f274415db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f274000ec80 tx=0x7f27400091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 shutdown_connections 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27280670e0 0x7f2728069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27440cb5a0 0x7f274415db30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f274415c470 0x7f274415ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 --2- 172.21.15.12:0/3429805380 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f27440cd9e0 0x7f2744155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 >> 172.21.15.12:0/3429805380 conn(0x7f2744070e30 msgr2=0x7f27440b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:48.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 shutdown_connections 2023-10-08T16:24:48.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.728+0000 7f274c7ff700 1 -- 172.21.15.12:0/3429805380 wait complete. 2023-10-08T16:24:48.748 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:24:48.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:48.873 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:48.873+0000 7f17f3878180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:48.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.965+0000 7f5c19b9d700 1 Processor -- start 2023-10-08T16:24:48.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.965+0000 7f5c19b9d700 1 -- start start 2023-10-08T16:24:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c19b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c14159640 0x7f5c1406d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c19b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c140c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c19b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c140c7420 con 0x7f5c14159a10 2023-10-08T16:24:48.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c19b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1406d5a0 con 0x7f5c14159640 2023-10-08T16:24:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c19b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1406d820 con 0x7f5c140caec0 2023-10-08T16:24:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c18b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c14159640 0x7f5c1406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c0bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5c14159a10 0x7f5c140ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55180/0 (socket says 172.21.15.12:55180) 2023-10-08T16:24:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.967+0000 7f5c0bfff700 1 -- 172.21.15.12:0/1374594101 learned_addr learned my addr 172.21.15.12:0/1374594101 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:48.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c1939c700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c140c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c18b9b700 1 -- 172.21.15.12:0/1374594101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 msgr2=0x7f5c140c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c18b9b700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c140c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c18b9b700 1 -- 172.21.15.12:0/1374594101 >> v1:172.21.15.12:6789/0 conn(0x7f5c14159a10 legacy=0x7f5c140ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c18b9b700 1 -- 172.21.15.12:0/1374594101 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1406db00 con 0x7f5c14159640 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c0b7fe700 1 -- 172.21.15.12:0/1374594101 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081954545 0 0) 0x7f5c140c7420 con 0x7f5c14159a10 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c18b9b700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1406d060 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098e0 tx=0x7f5c100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=544fdc1ebcbadb0b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.968+0000 7f5c0b7fe700 1 -- 172.21.15.12:0/1374594101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000b640 con 0x7f5c14159640 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c0b7fe700 1 -- 172.21.15.12:0/1374594101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1000b7a0 con 0x7f5c14159640 2023-10-08T16:24:48.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c0b7fe700 1 -- 172.21.15.12:0/1374594101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1000bb40 con 0x7f5c14159640 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 -- 172.21.15.12:0/1374594101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 msgr2=0x7f5c1406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1406d060 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f5c100098e0 tx=0x7f5c100091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 -- 172.21.15.12:0/1374594101 shutdown_connections 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c140c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/1374594101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1406d060 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.969+0000 7f5c19b9d700 1 -- 172.21.15.12:0/1374594101 >> 172.21.15.12:0/1374594101 conn(0x7f5c1406e720 msgr2=0x7f5c1406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.970+0000 7f5c19b9d700 1 -- 172.21.15.12:0/1374594101 shutdown_connections 2023-10-08T16:24:48.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.970+0000 7f5c19b9d700 1 -- 172.21.15.12:0/1374594101 wait complete. 2023-10-08T16:24:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.972+0000 7f5c19b9d700 1 Processor -- start 2023-10-08T16:24:48.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.972+0000 7f5c19b9d700 1 -- start start 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c1415c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c14159a10 0x7f5c1416d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415b560 con 0x7f5c14159640 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415b840 con 0x7f5c14159a10 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c19b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415bb20 con 0x7f5c140caec0 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c18b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c1415c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39912/0 (socket says 172.21.15.12:39912) 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 -- 172.21.15.12:0/610443256 learned_addr learned my addr 172.21.15.12:0/610443256 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c1939c700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c14159a10 0x7f5c1416d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 msgr2=0x7f5c1415c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c1415c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c14159a10 msgr2=0x7f5c1416d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c14159a10 0x7f5c1416d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.974+0000 7f5c0bfff700 1 -- 172.21.15.12:0/610443256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c10009420 con 0x7f5c14159640 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c0bfff700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c5e0 tx=0x7f5c04000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04005b30 con 0x7f5c14159640 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c04005c90 con 0x7f5c14159640 2023-10-08T16:24:48.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04007300 con 0x7f5c14159640 2023-10-08T16:24:48.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1415be00 con 0x7f5c14159640 2023-10-08T16:24:48.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.975+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c140b2130 con 0x7f5c14159640 2023-10-08T16:24:48.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.976+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1404c3c0 con 0x7f5c14159640 2023-10-08T16:24:48.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.977+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5c0401b3b0 con 0x7f5c14159640 2023-10-08T16:24:48.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.978+0000 7f5c08ff9700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 0x7f5c00069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:48.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.978+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5c04083f80 con 0x7f5c14159640 2023-10-08T16:24:48.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.978+0000 7f5c18b9b700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 msgr2=0x7f5c00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:48.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.978+0000 7f5c18b9b700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 0x7f5c00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:48.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:48.982+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c04050c40 con 0x7f5c14159640 2023-10-08T16:24:48.988 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:48.987+0000 7f43dbe7d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:24:49.052 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:49.052+0000 7f17f3878180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:49.151 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:49.151+0000 7f17f3878180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:49.169 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:49.169+0000 7f43dbe7d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:24:49.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.179+0000 7f5c18b9b700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 msgr2=0x7f5c00069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:49.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.179+0000 7f5c18b9b700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 0x7f5c00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:49.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.231+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c1415fc40 con 0x7f5c14159640 2023-10-08T16:24:49.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.232+0000 7f5c08ff9700 1 -- 172.21.15.12:0/610443256 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5c04017090 con 0x7f5c14159640 2023-10-08T16:24:49.234 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:49.234 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:49.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.234+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 msgr2=0x7f5c00069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:49.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.234+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 0x7f5c00069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.234+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 msgr2=0x7f5c1415ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.234+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400c5e0 tx=0x7f5c04000fe0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 shutdown_connections 2023-10-08T16:24:49.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c000670e0 0x7f5c00069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c14159a10 0x7f5c1416d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c140caec0 0x7f5c1415c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 --2- 172.21.15.12:0/610443256 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c14159640 0x7f5c1415ab80 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 >> 172.21.15.12:0/610443256 conn(0x7f5c1406e720 msgr2=0x7f5c1406a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:49.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 shutdown_connections 2023-10-08T16:24:49.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.235+0000 7f5c19b9d700 1 -- 172.21.15.12:0/610443256 wait complete. 2023-10-08T16:24:49.238 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:49.254 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:49.272 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:49.272+0000 7f43dbe7d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:24:49.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.446+0000 7fde0bbff700 1 Processor -- start 2023-10-08T16:24:49.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.447+0000 7fde0bbff700 1 -- start start 2023-10-08T16:24:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0bbff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 0x7fde040b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0bbff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde041579d0 0x7fde040b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0bbff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde04158210 con 0x7fde040ccba0 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0bbff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040cb850 con 0x7fde041579d0 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0bbff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cb290 con 0x7fde04157600 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0919a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde041579d0 0x7fde040b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0919a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde041579d0 0x7fde040b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39924/0 (socket says 172.21.15.12:39924) 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0919a700 1 -- 172.21.15.12:0/773025704 learned_addr learned my addr 172.21.15.12:0/773025704 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0a19c700 1 --1- 172.21.15.12:0/773025704 >> v1:172.21.15.12:6789/0 conn(0x7fde040ccba0 0x7fde041586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55192/0 (socket says 172.21.15.12:55192) 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.448+0000 7fde0999b700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 0x7fde040b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0919a700 1 -- 172.21.15.12:0/773025704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 msgr2=0x7fde040b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:49.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0919a700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 0x7fde040b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0919a700 1 -- 172.21.15.12:0/773025704 >> v1:172.21.15.12:6789/0 conn(0x7fde040ccba0 legacy=0x7fde041586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0919a700 1 -- 172.21.15.12:0/773025704 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040cb570 con 0x7fde041579d0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0999b700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 0x7fde040b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde08999700 1 -- 172.21.15.12:0/773025704 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714045819 0 0) 0x7fde04158210 con 0x7fde040ccba0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde0919a700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040b1950 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fddf40099b0 tx=0x7fddf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50efdc16a2f67b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.449+0000 7fde08999700 1 -- 172.21.15.12:0/773025704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4009ea0 con 0x7fde041579d0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde08999700 1 -- 172.21.15.12:0/773025704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf400b860 con 0x7fde041579d0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde08999700 1 -- 172.21.15.12:0/773025704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf400bc00 con 0x7fde041579d0 2023-10-08T16:24:49.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 -- 172.21.15.12:0/773025704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 msgr2=0x7fde040b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040b1950 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fddf40099b0 tx=0x7fddf4009250 comp rx=0 tx=0).stop 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 -- 172.21.15.12:0/773025704 shutdown_connections 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde04157600 0x7fde040b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 --2- 172.21.15.12:0/773025704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040b1950 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 -- 172.21.15.12:0/773025704 >> 172.21.15.12:0/773025704 conn(0x7fde0406d170 msgr2=0x7fde040cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 -- 172.21.15.12:0/773025704 shutdown_connections 2023-10-08T16:24:49.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.450+0000 7fde0bbff700 1 -- 172.21.15.12:0/773025704 wait complete. 2023-10-08T16:24:49.455 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:49.452+0000 7f17f3878180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.452+0000 7fde0bbff700 1 Processor -- start 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.452+0000 7fde0bbff700 1 -- start start 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 0x7fde04156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde04157600 0x7fde0416a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040b1040 con 0x7fde041579d0 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0416aa80 con 0x7fde04157600 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0bbff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040a5ea0 con 0x7fde040ccba0 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0a19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0999b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 0x7fde04156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0a19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39930/0 (socket says 172.21.15.12:39930) 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0a19c700 1 -- 172.21.15.12:0/225144469 learned_addr learned my addr 172.21.15.12:0/225144469 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.453+0000 7fde0919a700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde04157600 0x7fde0416a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde04157600 msgr2=0x7fde0416a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde04157600 0x7fde0416a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 msgr2=0x7fde040a6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 -- 172.21.15.12:0/225144469 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde00009420 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0a19c700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0999b700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 0x7fde04156c10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde0000ec80 tx=0x7fde000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000c850 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0000c9b0 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf40094f0 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.454+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0000cd70 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.455+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040a5850 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.456+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0404c3c0 con 0x7fde040ccba0 2023-10-08T16:24:49.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.457+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fde00013680 con 0x7fde040ccba0 2023-10-08T16:24:49.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.457+0000 7fddf9ffb700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 0x7fdde8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.458+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fde00084da0 con 0x7fde040ccba0 2023-10-08T16:24:49.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.458+0000 7fde0919a700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 msgr2=0x7fdde8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:49.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.458+0000 7fde0919a700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 0x7fdde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:49.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.462+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde00051a60 con 0x7fde040ccba0 2023-10-08T16:24:49.552 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:49.552+0000 7f17f3878180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:49.578 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:49.578+0000 7f43dbe7d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:24:49.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.659+0000 7fde0919a700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 msgr2=0x7fdde8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:49.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.659+0000 7fde0919a700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 0x7fdde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:49.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:49.678+0000 7f43dbe7d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:24:49.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.711+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde041573e0 con 0x7fde040ccba0 2023-10-08T16:24:49.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.712+0000 7fddf9ffb700 1 -- 172.21.15.12:0/225144469 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fde00055080 con 0x7fde040ccba0 2023-10-08T16:24:49.713 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:49.714 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:24:21.751141+0000","modified":"2023-10-08T16:24:25.271821+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6282":{"gid":6282,"name":"c","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/2971316211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2971316211},{"type":"v1","addr":"172.21.15.12:6834","nonce":2971316211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-08T16:24:49.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 msgr2=0x7fdde8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:49.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 0x7fdde8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 msgr2=0x7fde04156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 0x7fde04156c10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fde0000ec80 tx=0x7fde000091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 shutdown_connections 2023-10-08T16:24:49.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdde80670e0 0x7fdde8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde041579d0 0x7fde040a6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde040ccba0 0x7fde04156c10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 --2- 172.21.15.12:0/225144469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde04157600 0x7fde0416a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 >> 172.21.15.12:0/225144469 conn(0x7fde0406d170 msgr2=0x7fde041586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:49.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 shutdown_connections 2023-10-08T16:24:49.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.715+0000 7fde0bbff700 1 -- 172.21.15.12:0/225144469 wait complete. 2023-10-08T16:24:49.718 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 34 2023-10-08T16:24:49.734 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.968+0000 7f28c7fff700 1 Processor -- start 2023-10-08T16:24:49.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.968+0000 7f28c7fff700 1 -- start start 2023-10-08T16:24:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28c8142eb0 0x7f28c80b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b0810 con 0x7f28c8143280 2023-10-08T16:24:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b6100 con 0x7f28c80d09f0 2023-10-08T16:24:49.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80b5b40 con 0x7f28c8142eb0 2023-10-08T16:24:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c67fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28c8143280 0x7f28c80d02e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55198/0 (socket says 172.21.15.12:55198) 2023-10-08T16:24:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.969+0000 7f28c67fc700 1 -- 172.21.15.12:0/4248761468 learned_addr learned my addr 172.21.15.12:0/4248761468 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:49.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c6ffd700 1 --2- 172.21.15.12:0/4248761468 >> v2:172.21.15.29:3300/0 conn(0x7f28c8142eb0 0x7f28c80b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312659521 0 0) 0x7f28c80b0810 con 0x7f28c8143280 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b0003570 con 0x7f28c8143280 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4248761468 >> v1:172.21.15.29:6789/0 conn(0x7f28c80d09f0 legacy=0x7f28c80b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4248761468 >> v1:172.21.15.12:6789/0 conn(0x7f28c8143280 legacy=0x7f28c80d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2408655561 0 0) 0x7f28b0003570 con 0x7f28c8143280 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.970+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4248761468 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80b5e20 con 0x7f28c8142eb0 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c6ffd700 1 --2- 172.21.15.12:0/4248761468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8142eb0 0x7f28c80b2820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b80098e0 tx=0x7f28b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a25829f20b0719d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc001470 con 0x7f28c8142eb0 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8011420 con 0x7f28c8142eb0 2023-10-08T16:24:49.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c5ffb700 1 -- 172.21.15.12:0/4248761468 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b80117c0 con 0x7f28c8142eb0 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 -- 172.21.15.12:0/4248761468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8142eb0 msgr2=0x7f28c80b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4248761468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8142eb0 0x7f28c80b2820 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b80098e0 tx=0x7f28b80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 -- 172.21.15.12:0/4248761468 shutdown_connections 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4248761468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8142eb0 0x7f28c80b2820 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 -- 172.21.15.12:0/4248761468 >> 172.21.15.12:0/4248761468 conn(0x7f28c80703a0 msgr2=0x7f28c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.971+0000 7f28c7fff700 1 -- 172.21.15.12:0/4248761468 shutdown_connections 2023-10-08T16:24:49.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.972+0000 7f28c7fff700 1 -- 172.21.15.12:0/4248761468 wait complete. 2023-10-08T16:24:49.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.973+0000 7f28c7fff700 1 Processor -- start 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.973+0000 7f28c7fff700 1 -- start start 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 0x7f28c80ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8143280 0x7f28c816c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80cf730 con 0x7f28c80d09f0 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80ceb20 con 0x7f28c8143280 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80cee00 con 0x7f28c8142eb0 2023-10-08T16:24:49.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39934/0 (socket says 172.21.15.12:39934) 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4156585757 learned_addr learned my addr 172.21.15.12:0/4156585757 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c67fc700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 0x7f28c80ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.974+0000 7f28c77fe700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8143280 0x7f28c816c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 msgr2=0x7f28c80ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 0x7f28c80ce060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8143280 msgr2=0x7f28c816c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:49.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8143280 0x7f28c816c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 -- 172.21.15.12:0/4156585757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8009420 con 0x7f28c80d09f0 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c67fc700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 0x7f28c80ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28c6ffd700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f28b80091e0 tx=0x7f28b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b801cb30 con 0x7f28c80d09f0 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b801cc90 con 0x7f28c80d09f0 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.975+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b801a6a0 con 0x7f28c80d09f0 2023-10-08T16:24:49.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.976+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c80cf0e0 con 0x7f28c80d09f0 2023-10-08T16:24:49.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.976+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c8169fe0 con 0x7f28c80d09f0 2023-10-08T16:24:49.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.977+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c80cfa10 con 0x7f28c80d09f0 2023-10-08T16:24:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.978+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f28b801aa50 con 0x7f28c80d09f0 2023-10-08T16:24:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.979+0000 7f28aeffd700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 0x7f28b4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.979+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f28b80864f0 con 0x7f28c80d09f0 2023-10-08T16:24:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.979+0000 7f28c67fc700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 msgr2=0x7f28b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:49.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.979+0000 7f28c67fc700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 0x7f28b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:49.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:49.983+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28b80531b0 con 0x7f28c80d09f0 2023-10-08T16:24:50.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.180+0000 7f28c67fc700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 msgr2=0x7f28b4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:50.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.180+0000 7f28c67fc700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 0x7f28b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:50.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.188+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28c804c3c0 con 0x7f28c80d09f0 2023-10-08T16:24:50.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.189+0000 7f28aeffd700 1 -- 172.21.15.12:0/4156585757 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16360 (secure 0 0 0) 0x7f28b80567d0 con 0x7f28c80d09f0 2023-10-08T16:24:50.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:50.190 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":86,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:43.123170+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:24:19.937534+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-08T16:24:20.723520+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/717128295":"2023-10-09T16:24:43.123143+0000","172.21.15.12:6836/115415":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/4018489120":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/330434581":"2023-10-09T16:24:43.123143+0000","172.21.15.12:0/3992418056":"2023-10-09T16:24:43.123143+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:24:50.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 msgr2=0x7f28b4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 0x7f28b4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 msgr2=0x7f28c80aa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f28b80091e0 tx=0x7f28b8016000 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 shutdown_connections 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b40670e0 0x7f28b4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80d09f0 0x7f28c80aa9d0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c8143280 0x7f28c816c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 --2- 172.21.15.12:0/4156585757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c8142eb0 0x7f28c80ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.191+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 >> 172.21.15.12:0/4156585757 conn(0x7f28c80703a0 msgr2=0x7f28c8141f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.192+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 shutdown_connections 2023-10-08T16:24:50.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.192+0000 7f28c7fff700 1 -- 172.21.15.12:0/4156585757 wait complete. 2023-10-08T16:24:50.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:24:50.287 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:50.287+0000 7f17f3878180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.402+0000 7f0a1b5ff700 1 Processor -- start 2023-10-08T16:24:50.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.402+0000 7f0a1b5ff700 1 -- start start 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a1b5ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b07d0 0x7f0a140ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a1b5ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a140b0ba0 0x7f0a140c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a1b5ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1415a280 con 0x7f0a140cf200 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a1b5ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1406e180 con 0x7f0a140b0ba0 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a1b5ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1406d850 con 0x7f0a140b07d0 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a19b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a140b0ba0 0x7f0a140c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.403+0000 7f0a19b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0a140b0ba0 0x7f0a140c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39950/0 (socket says 172.21.15.12:39950) 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 -- 172.21.15.12:0/1536121045 learned_addr learned my addr 172.21.15.12:0/1536121045 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a18b9a700 1 --1- 172.21.15.12:0/1536121045 >> v1:172.21.15.29:6789/0 conn(0x7f0a140cf200 0x7f0a1406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47136/0 (socket says 172.21.15.12:47136) 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a1939b700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b07d0 0x7f0a140ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 -- 172.21.15.12:0/1536121045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b07d0 msgr2=0x7f0a140ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b07d0 0x7f0a140ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 -- 172.21.15.12:0/1536121045 >> v1:172.21.15.29:6789/0 conn(0x7f0a140cf200 legacy=0x7f0a1406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 -- 172.21.15.12:0/1536121045 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1406db30 con 0x7f0a140b0ba0 2023-10-08T16:24:50.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.404+0000 7f0a19b9c700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b0ba0 0x7f0a140c42c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f20 tx=0x7f0a0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763f2b68817ac73e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a0bfff700 1 -- 172.21.15.12:0/1536121045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00e070 con 0x7f0a140b0ba0 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a0bfff700 1 -- 172.21.15.12:0/1536121045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00b9d0 con 0x7f0a140b0ba0 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a0bfff700 1 -- 172.21.15.12:0/1536121045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c0092e0 con 0x7f0a140b0ba0 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/1536121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b0ba0 msgr2=0x7f0a140c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b0ba0 0x7f0a140c42c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c009f20 tx=0x7f0a0c009840 comp rx=0 tx=0).stop 2023-10-08T16:24:50.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/1536121045 shutdown_connections 2023-10-08T16:24:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b0ba0 0x7f0a140c42c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/1536121045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b07d0 0x7f0a140ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/1536121045 >> 172.21.15.12:0/1536121045 conn(0x7f0a1406ce80 msgr2=0x7f0a140ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/1536121045 shutdown_connections 2023-10-08T16:24:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.405+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/1536121045 wait complete. 2023-10-08T16:24:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.407+0000 7f0a1b5ff700 1 Processor -- start 2023-10-08T16:24:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.407+0000 7f0a1b5ff700 1 -- start start 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b0ba0 0x7f0a141690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a140cf200 0x7f0a140b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140b1b10 con 0x7f0a140b07d0 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140b2200 con 0x7f0a140cf200 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1b5ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140b1830 con 0x7f0a140b0ba0 2023-10-08T16:24:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39952/0 (socket says 172.21.15.12:39952) 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a1939b700 1 -- 172.21.15.12:0/3396767050 learned_addr learned my addr 172.21.15.12:0/3396767050 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a19b9c700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a140cf200 0x7f0a140b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.408+0000 7f0a18b9a700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b0ba0 0x7f0a141690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b0ba0 msgr2=0x7f0a141690a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b0ba0 0x7f0a141690a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a140cf200 msgr2=0x7f0a140b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a140cf200 0x7f0a140b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 -- 172.21.15.12:0/3396767050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c009ae0 con 0x7f0a140b07d0 2023-10-08T16:24:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1939b700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ea00 tx=0x7f0a10009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000c850 con 0x7f0a140b07d0 2023-10-08T16:24:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1000c9b0 con 0x7f0a140b07d0 2023-10-08T16:24:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1415b0f0 con 0x7f0a140b07d0 2023-10-08T16:24:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1000cd30 con 0x7f0a140b07d0 2023-10-08T16:24:50.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.409+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a141695e0 con 0x7f0a140b07d0 2023-10-08T16:24:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.411+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1415baf0 con 0x7f0a140b07d0 2023-10-08T16:24:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.411+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0a10013680 con 0x7f0a140b07d0 2023-10-08T16:24:50.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.413+0000 7f0a097fa700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 0x7f09f8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.413+0000 7f0a18b9a700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 msgr2=0x7f09f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.413+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f0a10085280 con 0x7f0a140b07d0 2023-10-08T16:24:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.413+0000 7f0a18b9a700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 0x7f09f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:50.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.416+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a10051f40 con 0x7f0a140b07d0 2023-10-08T16:24:50.441 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:50.441+0000 7f43dbe7d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:24:50.577 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:50.577+0000 7f17f3878180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:50.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.614+0000 7f0a18b9a700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 msgr2=0x7f09f8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:50.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.614+0000 7f0a18b9a700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 0x7f09f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:50.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.663+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0a1415af50 con 0x7f0a140b07d0 2023-10-08T16:24:50.665 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:24:50.664+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:24:50.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.669+0000 7f0a097fa700 1 -- 172.21.15.12:0/3396767050 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0a1415af50 con 0x7f0a140b07d0 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 msgr2=0x7f09f8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 0x7f09f8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 msgr2=0x7f0a140b1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0a1000ea00 tx=0x7f0a10009120 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 shutdown_connections 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09f80670e0 0x7f09f8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0a140b07d0 0x7f0a140b1cc0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0a140cf200 0x7f0a140b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 --2- 172.21.15.12:0/3396767050 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0a140b0ba0 0x7f0a141690a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 >> 172.21.15.12:0/3396767050 conn(0x7f0a1406ce80 msgr2=0x7f0a14158080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 shutdown_connections 2023-10-08T16:24:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.672+0000 7f0a1b5ff700 1 -- 172.21.15.12:0/3396767050 wait complete. 2023-10-08T16:24:50.674 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:24:50.674 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:50.674+0000 7f17f3878180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:50.675 INFO:tasks.ceph.mds.c.smithi012.stderr: -2267> 2023-10-08T16:24:27.236+0000 7f09af1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:24:50.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:24:50.717 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:24:50.741 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:50.740+0000 7f43dbe7d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:24:50.834 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:50.834+0000 7f17f3878180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:50.840 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:50.840+0000 7f43dbe7d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:24:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.886+0000 7f2b6559d700 1 Processor -- start 2023-10-08T16:24:50.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.886+0000 7f2b6559d700 1 -- start start 2023-10-08T16:24:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b6559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b6559d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2b600caec0 0x7f2b6015afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b6559d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6015ada0 con 0x7f2b6006db20 2023-10-08T16:24:50.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b6559d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6006ca80 con 0x7f2b600caec0 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b6559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6006cd60 con 0x7f2b60153c90 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38928/0 (socket says 172.21.15.12:38928) 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b5ffff700 1 -- 172.21.15.12:0/2800385913 learned_addr learned my addr 172.21.15.12:0/2800385913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b64d9c700 1 --2- 172.21.15.12:0/2800385913 >> v2:172.21.15.29:3300/0 conn(0x7f2b600caec0 0x7f2b6015afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b5f7fe700 1 --1- 172.21.15.12:0/2800385913 >> v1:172.21.15.29:6789/0 conn(0x7f2b6006db20 0x7f2b600ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47142/0 (socket says 172.21.15.12:47142) 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.888+0000 7f2b5ffff700 1 -- 172.21.15.12:0/2800385913 >> v2:172.21.15.29:3300/0 conn(0x7f2b600caec0 msgr2=0x7f2b6015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5ffff700 1 --2- 172.21.15.12:0/2800385913 >> v2:172.21.15.29:3300/0 conn(0x7f2b600caec0 0x7f2b6015afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5ffff700 1 -- 172.21.15.12:0/2800385913 >> v1:172.21.15.29:6789/0 conn(0x7f2b6006db20 legacy=0x7f2b600ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5ffff700 1 -- 172.21.15.12:0/2800385913 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6006d040 con 0x7f2b60153c90 2023-10-08T16:24:50.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5ffff700 1 --2- 172.21.15.12:0/2800385913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b500099b0 tx=0x7f2b50009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f24bb652c8431f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5effd700 1 -- 172.21.15.12:0/2800385913 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50009ea0 con 0x7f2b60153c90 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5effd700 1 -- 172.21.15.12:0/2800385913 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000b860 con 0x7f2b60153c90 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.889+0000 7f2b5effd700 1 -- 172.21.15.12:0/2800385913 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000bc00 con 0x7f2b60153c90 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 -- 172.21.15.12:0/2800385913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 msgr2=0x7f2b6015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 --2- 172.21.15.12:0/2800385913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2b500099b0 tx=0x7f2b50009250 comp rx=0 tx=0).stop 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 -- 172.21.15.12:0/2800385913 shutdown_connections 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 --2- 172.21.15.12:0/2800385913 >> v2:172.21.15.29:3300/0 conn(0x7f2b600caec0 0x7f2b6015afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 --2- 172.21.15.12:0/2800385913 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b60153c90 0x7f2b6015a860 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 -- 172.21.15.12:0/2800385913 >> 172.21.15.12:0/2800385913 conn(0x7f2b6006e720 msgr2=0x7f2b6006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 -- 172.21.15.12:0/2800385913 shutdown_connections 2023-10-08T16:24:50.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.890+0000 7f2b6559d700 1 -- 172.21.15.12:0/2800385913 wait complete. 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.891+0000 7f2b6559d700 1 Processor -- start 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.892+0000 7f2b6559d700 1 -- start start 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.892+0000 7f2b6559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.892+0000 7f2b6559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b600caec0 0x7f2b600aa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b6559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 0x7f2b600ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b6559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600c6360 con 0x7f2b60153c90 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b6559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600aa0b0 con 0x7f2b600caec0 2023-10-08T16:24:50.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b6559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600c6080 con 0x7f2b6006db20 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b64d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 0x7f2b600ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38936/0 (socket says 172.21.15.12:38936) 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 -- 172.21.15.12:0/3760541832 learned_addr learned my addr 172.21.15.12:0/3760541832 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5f7fe700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b600caec0 0x7f2b600aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b600caec0 msgr2=0x7f2b600aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b600caec0 0x7f2b600aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 msgr2=0x7f2b600ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:50.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 0x7f2b600ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b5ffff700 1 -- 172.21.15.12:0/3760541832 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500094f0 con 0x7f2b6006db20 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.893+0000 7f2b64d9c700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 0x7f2b600ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b5ffff700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2b600cc090 tx=0x7f2b50017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50000d10 con 0x7f2b6006db20 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5000bbe0 con 0x7f2b6006db20 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50011670 con 0x7f2b6006db20 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b600a9a60 con 0x7f2b6006db20 2023-10-08T16:24:50.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.894+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b601528e0 con 0x7f2b6006db20 2023-10-08T16:24:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.895+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6004c3c0 con 0x7f2b6006db20 2023-10-08T16:24:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.896+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 33) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2b50011aa0 con 0x7f2b6006db20 2023-10-08T16:24:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.897+0000 7f2b47fff700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.897+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f2b50086430 con 0x7f2b6006db20 2023-10-08T16:24:50.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.897+0000 7f2b5f7fe700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 msgr2=0x7f2b4c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:50.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.897+0000 7f2b5f7fe700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:24:50.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:50.901+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b500530a0 con 0x7f2b6006db20 2023-10-08T16:24:50.944 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:50.944+0000 7f17f3878180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:51.008 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.007+0000 7f43dbe7d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:24:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.098+0000 7f2b5f7fe700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 msgr2=0x7f2b4c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.098+0000 7f2b5f7fe700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:24:51.117 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.117+0000 7f43dbe7d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:24:51.140 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:51.140+0000 7f17f3878180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:51.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.153+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2b60159bc0 con 0x7f2b6006db20 2023-10-08T16:24:51.236 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:51.236+0000 7f17f3878180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:51.318 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.318+0000 7f43dbe7d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:24:51.331 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:51.331+0000 7f17f3878180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:51.417 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.416+0000 7f43dbe7d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:24:51.429 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:24:51.429+0000 7f17f3878180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.499+0000 7f2b5f7fe700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 msgr2=0x7f2b4c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:24:51.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.499+0000 7f2b5f7fe700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:24:51.512 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.512+0000 7f43dbe7d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:24:51.610 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:24:51.609+0000 7f43dbe7d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:24:51.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.619+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mgrmap(e 34) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f2b50011d50 con 0x7f2b6006db20 2023-10-08T16:24:51.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.620+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 msgr2=0x7f2b4c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:24:51.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.620+0000 7f2b47fff700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.673+0000 7f2b47fff700 1 -- 172.21.15.12:0/3760541832 <== mon.2 v2:172.21.15.29:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v36) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2b50027e40 con 0x7f2b6006db20 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 msgr2=0x7f2b601523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2b600cc090 tx=0x7f2b50017000 comp rx=0 tx=0).stop 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 shutdown_connections 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2b4c0670e0 0x7f2b4c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2b60153c90 0x7f2b600ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2b6006db20 0x7f2b601523a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 --2- 172.21.15.12:0/3760541832 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2b600caec0 0x7f2b600aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 >> 172.21.15.12:0/3760541832 conn(0x7f2b6006e720 msgr2=0x7f2b6015b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 shutdown_connections 2023-10-08T16:24:51.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.675+0000 7f2b6559d700 1 -- 172.21.15.12:0/3760541832 wait complete. 2023-10-08T16:24:51.695 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:24:51.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.927+0000 7fc671f9d700 1 Processor -- start 2023-10-08T16:24:51.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.927+0000 7fc671f9d700 1 -- start start 2023-10-08T16:24:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.928+0000 7fc671f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc66c0b24f0 0x7fc66c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.928+0000 7fc671f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.928+0000 7fc671f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66c0b0c80 con 0x7fc66c0b28c0 2023-10-08T16:24:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.928+0000 7fc671f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c0d10d0 con 0x7fc66c0b24f0 2023-10-08T16:24:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.928+0000 7fc671f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c0b0f60 con 0x7fc66c0b1d40 2023-10-08T16:24:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:38998/0 (socket says 172.21.15.12:38998) 2023-10-08T16:24:51.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc670f9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc66c0b24f0 0x7fc66c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 -- 172.21.15.12:0/79360937 learned_addr learned my addr 172.21.15.12:0/79360937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc67179c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc66c0b28c0 0x7fc66c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47154/0 (socket says 172.21.15.12:47154) 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 -- 172.21.15.12:0/79360937 >> v2:172.21.15.29:3300/0 conn(0x7fc66c0b24f0 msgr2=0x7fc66c0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 --2- 172.21.15.12:0/79360937 >> v2:172.21.15.29:3300/0 conn(0x7fc66c0b24f0 0x7fc66c0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 -- 172.21.15.12:0/79360937 >> v1:172.21.15.29:6789/0 conn(0x7fc66c0b28c0 legacy=0x7fc66c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 -- 172.21.15.12:0/79360937 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c0b1240 con 0x7fc66c0b1d40 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.929+0000 7fc66bfff700 1 --2- 172.21.15.12:0/79360937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6580099b0 tx=0x7fc658009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48558654ac9f224 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc66b7fe700 1 -- 172.21.15.12:0/79360937 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc658009ea0 con 0x7fc66c0b1d40 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc66b7fe700 1 -- 172.21.15.12:0/79360937 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65800b860 con 0x7fc66c0b1d40 2023-10-08T16:24:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc66b7fe700 1 -- 172.21.15.12:0/79360937 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800bc00 con 0x7fc66c0b1d40 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc671f9d700 1 -- 172.21.15.12:0/79360937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 msgr2=0x7fc66c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc671f9d700 1 --2- 172.21.15.12:0/79360937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc6580099b0 tx=0x7fc658009250 comp rx=0 tx=0).stop 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc671f9d700 1 -- 172.21.15.12:0/79360937 shutdown_connections 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc671f9d700 1 --2- 172.21.15.12:0/79360937 >> v2:172.21.15.29:3300/0 conn(0x7fc66c0b24f0 0x7fc66c0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.930+0000 7fc671f9d700 1 --2- 172.21.15.12:0/79360937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b1d40 0x7fc66c1590f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.931+0000 7fc671f9d700 1 -- 172.21.15.12:0/79360937 >> 172.21.15.12:0/79360937 conn(0x7fc66c0703a0 msgr2=0x7fc66c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.931+0000 7fc671f9d700 1 -- 172.21.15.12:0/79360937 shutdown_connections 2023-10-08T16:24:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.931+0000 7fc671f9d700 1 -- 172.21.15.12:0/79360937 wait complete. 2023-10-08T16:24:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.932+0000 7fc671f9d700 1 Processor -- start 2023-10-08T16:24:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.932+0000 7fc671f9d700 1 -- start start 2023-10-08T16:24:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b24f0 0x7fc66c14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:51.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 0x7fc66c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c153220 con 0x7fc66c0b1d40 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c1523b0 con 0x7fc66c0b28c0 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc671f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c153bf0 con 0x7fc66c0b24f0 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc670f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc670f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40058/0 (socket says 172.21.15.12:40058) 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc670f9b700 1 -- 172.21.15.12:0/3850674884 learned_addr learned my addr 172.21.15.12:0/3850674884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.933+0000 7fc66bfff700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b24f0 0x7fc66c14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc67179c700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 0x7fc66c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 -- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b24f0 msgr2=0x7fc66c14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b24f0 0x7fc66c14d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 -- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 msgr2=0x7fc66c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:51.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 0x7fc66c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 -- 172.21.15.12:0/3850674884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6580094f0 con 0x7fc66c0b1d40 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc67179c700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 0x7fc66c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc670f9b700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc66000ec80 tx=0x7fc6600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000c850 con 0x7fc66c0b1d40 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000c9b0 con 0x7fc66c0b1d40 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c152610 con 0x7fc66c0b1d40 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000cd50 con 0x7fc66c0b1d40 2023-10-08T16:24:51.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.934+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c152c50 con 0x7fc66c0b1d40 2023-10-08T16:24:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.935+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c152fd0 con 0x7fc66c0b1d40 2023-10-08T16:24:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.936+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 34) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fc660013680 con 0x7fc66c0b1d40 2023-10-08T16:24:51.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.937+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6742+0+0 (secure 0 0 0) 0x7fc660084800 con 0x7fc66c0b1d40 2023-10-08T16:24:51.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:51.941+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc660051930 con 0x7fc66c0b1d40 2023-10-08T16:24:52.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.149+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc66c04c3c0 con 0x7fc66c0b1d40 2023-10-08T16:24:52.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.625+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fc6600513e0 con 0x7fc66c0b1d40 2023-10-08T16:24:52.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.625+0000 7fc668ff9700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 0x7fc65006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.627+0000 7fc66bfff700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 0x7fc65006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.631+0000 7fc66bfff700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 0x7fc65006edc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6580099b0 tx=0x7fc658017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:52.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.674+0000 7fc668ff9700 1 -- 172.21.15.12:0/3850674884 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc66006fe80 con 0x7fc66c0b1d40 2023-10-08T16:24:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 msgr2=0x7fc65006edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 0x7fc65006edc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc6580099b0 tx=0x7fc658017000 comp rx=0 tx=0).stop 2023-10-08T16:24:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 msgr2=0x7fc66c1536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc66000ec80 tx=0x7fc6600091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 shutdown_connections 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc65006c9e0 0x7fc65006edc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc66c0b1d40 0x7fc66c1536b0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc66c0b28c0 0x7fc66c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 --2- 172.21.15.12:0/3850674884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc66c0b24f0 0x7fc66c14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 >> 172.21.15.12:0/3850674884 conn(0x7fc66c0703a0 msgr2=0x7fc66c0cf4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 shutdown_connections 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.677+0000 7fc671f9d700 1 -- 172.21.15.12:0/3850674884 wait complete. 2023-10-08T16:24:52.679 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:24:52.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:24:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.889+0000 7fd31139d700 1 Processor -- start 2023-10-08T16:24:52.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.889+0000 7fd31139d700 1 -- start start 2023-10-08T16:24:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.890+0000 7fd31139d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd30c157750 0x7fd30c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.890+0000 7fd31139d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c0c8680 con 0x7fd30c157380 2023-10-08T16:24:52.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.890+0000 7fd31139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd30c15b6a0 con 0x7fd30c15b1a0 2023-10-08T16:24:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.890+0000 7fd31139d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd30c06a7f0 con 0x7fd30c157750 2023-10-08T16:24:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd30c157380 0x7fd30c1585f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44882/0 (socket says 172.21.15.12:44882) 2023-10-08T16:24:52.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30bfff700 1 -- 172.21.15.12:0/2714788791 learned_addr learned my addr 172.21.15.12:0/2714788791 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd310b9c700 1 --2- 172.21.15.12:0/2714788791 >> v2:172.21.15.29:3300/0 conn(0x7fd30c157750 0x7fd30c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039700130 0 0) 0x7fd30c0c8680 con 0x7fd30c157380 2023-10-08T16:24:52.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f4003570 con 0x7fd30c157380 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718491587 0 0) 0x7fd2f4003570 con 0x7fd30c157380 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 >> v2:172.21.15.29:3300/0 conn(0x7fd30c157750 msgr2=0x7fd30c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 --2- 172.21.15.12:0/2714788791 >> v2:172.21.15.29:3300/0 conn(0x7fd30c157750 0x7fd30c0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.891+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 >> v1:172.21.15.29:6789/0 conn(0x7fd30c15b1a0 legacy=0x7fd30c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c15b980 con 0x7fd30c157380 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fd2fc001470 con 0x7fd30c157380 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 >> v1:172.21.15.12:6789/0 conn(0x7fd30c157380 legacy=0x7fd30c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2f4003a60 0x7fd2f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2f4004810 0x7fd2f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd2f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c06a7f0 con 0x7fd2f40051c0 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f400c0e0 con 0x7fd2f4004810 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f400c2a0 con 0x7fd2f4003a60 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd2f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30b7fe700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2f4004810 0x7fd2f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd30bfff700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2f4003a60 0x7fd2f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 -- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2f4003a60 msgr2=0x7fd2f4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd2f4003a60 0x7fd2f4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 -- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2f4004810 msgr2=0x7fd2f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd2f4004810 0x7fd2f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.892+0000 7fd310b9c700 1 -- 172.21.15.12:0/2714788791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f4003570 con 0x7fd2f40051c0 2023-10-08T16:24:52.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd310b9c700 1 -- 172.21.15.12:0/2714788791 reap_dead start 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd310b9c700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd2f400ba60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e210 tx=0x7fd30400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c312938ae728c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400eac0 con 0x7fd2f40051c0 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400f040 con 0x7fd2f40051c0 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd30affd700 1 -- 172.21.15.12:0/2714788791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400ee70 con 0x7fd2f40051c0 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd31139d700 1 -- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 msgr2=0x7fd2f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.893+0000 7fd31139d700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd2f400ba60 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd30400e210 tx=0x7fd30400b040 comp rx=0 tx=0).stop 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.894+0000 7fd31139d700 1 -- 172.21.15.12:0/2714788791 shutdown_connections 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.894+0000 7fd31139d700 1 --2- 172.21.15.12:0/2714788791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd2f400ba60 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.894+0000 7fd31139d700 1 -- 172.21.15.12:0/2714788791 >> 172.21.15.12:0/2714788791 conn(0x7fd30c06c6a0 msgr2=0x7fd30c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.894+0000 7fd31139d700 1 -- 172.21.15.12:0/2714788791 shutdown_connections 2023-10-08T16:24:52.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.894+0000 7fd31139d700 1 -- 172.21.15.12:0/2714788791 wait complete. 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.895+0000 7fd31139d700 1 Processor -- start 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.895+0000 7fd31139d700 1 -- start start 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 0x7fd30c0ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30c14ab30 0x7fd30c151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0c4e90 con 0x7fd2f40051c0 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0ac0d0 con 0x7fd30c14ab30 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd31139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30c0ac3b0 con 0x7fd30c0c3550 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd30bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd30bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34296/0 (socket says 172.21.15.12:34296) 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd30bfff700 1 -- 172.21.15.12:0/3824539293 learned_addr learned my addr 172.21.15.12:0/3824539293 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd30b7fe700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 0x7fd30c0ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.896+0000 7fd310b9c700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30c14ab30 0x7fd30c151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 -- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 msgr2=0x7fd30c0ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 0x7fd30c0ab7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 -- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30c14ab30 msgr2=0x7fd30c151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30c14ab30 0x7fd30c151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 -- 172.21.15.12:0/3824539293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0ac690 con 0x7fd2f40051c0 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30b7fe700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 0x7fd30c0ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd30bfff700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00e7b0 tx=0x7fd2fc000c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:52.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc012500 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc010040 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0128d0 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd30c0ac970 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.897+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd30c14afb0 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.898+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd30c0c4cf0 con 0x7fd2f40051c0 2023-10-08T16:24:52.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.899+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 35) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fd2fc012c40 con 0x7fd2f40051c0 2023-10-08T16:24:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.900+0000 7fd2f3fff700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 0x7fd2f8069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.900+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6304+0+0 (secure 0 0 0) 0x7fd2fc083970 con 0x7fd2f40051c0 2023-10-08T16:24:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.900+0000 7fd30b7fe700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 0x7fd2f8069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:52.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.901+0000 7fd30b7fe700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 0x7fd2f8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd300007e20 tx=0x7fd300009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:52.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:52.904+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd30c0c4cf0 con 0x7fd2f40051c0 2023-10-08T16:24:53.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.104+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd30c0c4cf0 con 0x7fd2f40051c0 2023-10-08T16:24:53.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.679+0000 7fd2f3fff700 1 -- 172.21.15.12:0/3824539293 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd30c0c4cf0 con 0x7fd2f40051c0 2023-10-08T16:24:53.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 msgr2=0x7fd2f8069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 0x7fd2f8069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd300007e20 tx=0x7fd300009040 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 msgr2=0x7fd30c0ca050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00e7b0 tx=0x7fd2fc000c80 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 shutdown_connections 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd2f8066d80 0x7fd2f8069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd2f40051c0 0x7fd30c0ca050 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd30c14ab30 0x7fd30c151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 --2- 172.21.15.12:0/3824539293 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd30c0c3550 0x7fd30c0ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.683+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 >> 172.21.15.12:0/3824539293 conn(0x7fd30c06c6a0 msgr2=0x7fd30c0c7650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.684+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 shutdown_connections 2023-10-08T16:24:53.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.684+0000 7fd31139d700 1 -- 172.21.15.12:0/3824539293 wait complete. 2023-10-08T16:24:53.688 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:24:53.713 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:24:53.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.904+0000 7f68ca99d700 1 Processor -- start 2023-10-08T16:24:53.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.904+0000 7f68ca99d700 1 -- start start 2023-10-08T16:24:53.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68ca99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68c4159550 0x7f68c40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68ca99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f68c4159920 0x7f68c40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68ca99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40acc00 con 0x7f68c415dfd0 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68ca99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40abff0 con 0x7f68c4159550 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68ca99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40ac2d0 con 0x7f68c4159920 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68c999b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68c4159550 0x7f68c40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68c999b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68c4159550 0x7f68c40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34312/0 (socket says 172.21.15.12:34312) 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.905+0000 7f68c999b700 1 -- 172.21.15.12:0/3038124581 learned_addr learned my addr 172.21.15.12:0/3038124581 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68ca19c700 1 --2- 172.21.15.12:0/3038124581 >> v2:172.21.15.29:3300/0 conn(0x7f68c4159920 0x7f68c40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c999b700 1 -- 172.21.15.12:0/3038124581 >> v2:172.21.15.29:3300/0 conn(0x7f68c4159920 msgr2=0x7f68c40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c999b700 1 --2- 172.21.15.12:0/3038124581 >> v2:172.21.15.29:3300/0 conn(0x7f68c4159920 0x7f68c40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c999b700 1 -- 172.21.15.12:0/3038124581 >> v1:172.21.15.29:6789/0 conn(0x7f68c415dfd0 legacy=0x7f68c40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:53.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c999b700 1 -- 172.21.15.12:0/3038124581 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40ac5b0 con 0x7f68c4159550 2023-10-08T16:24:53.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c999b700 1 --2- 172.21.15.12:0/3038124581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c4159550 0x7f68c40ceac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f68c406b0f0 tx=0x7f68c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e5f56b2b100140 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:53.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c8999700 1 -- 172.21.15.12:0/3038124581 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000b820 con 0x7f68c4159550 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c8999700 1 -- 172.21.15.12:0/3038124581 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c000b980 con 0x7f68c4159550 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.906+0000 7f68c8999700 1 -- 172.21.15.12:0/3038124581 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c000bd20 con 0x7f68c4159550 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 -- 172.21.15.12:0/3038124581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c4159550 msgr2=0x7f68c40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 --2- 172.21.15.12:0/3038124581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c4159550 0x7f68c40ceac0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f68c406b0f0 tx=0x7f68c0009250 comp rx=0 tx=0).stop 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 -- 172.21.15.12:0/3038124581 shutdown_connections 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 --2- 172.21.15.12:0/3038124581 >> v2:172.21.15.29:3300/0 conn(0x7f68c4159920 0x7f68c40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 --2- 172.21.15.12:0/3038124581 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c4159550 0x7f68c40ceac0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 -- 172.21.15.12:0/3038124581 >> 172.21.15.12:0/3038124581 conn(0x7f68c406ce80 msgr2=0x7f68c40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 -- 172.21.15.12:0/3038124581 shutdown_connections 2023-10-08T16:24:53.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.907+0000 7f68ca99d700 1 -- 172.21.15.12:0/3038124581 wait complete. 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.908+0000 7f68ca99d700 1 Processor -- start 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.909+0000 7f68ca99d700 1 -- start start 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.909+0000 7f68ca99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68c4159550 0x7f68c40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.909+0000 7f68ca99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68c4159920 0x7f68c40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.909+0000 7f68ca99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c4169c70 con 0x7f68c415dfd0 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40c84c0 con 0x7f68c4159550 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c40c87a0 con 0x7f68c4159920 2023-10-08T16:24:53.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34324/0 (socket says 172.21.15.12:34324) 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 -- 172.21.15.12:0/2875699872 learned_addr learned my addr 172.21.15.12:0/2875699872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68c999b700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68c4159550 0x7f68c40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68c919a700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68c4159920 0x7f68c40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 -- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68c4159920 msgr2=0x7f68c40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68c4159920 0x7f68c40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 -- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68c4159550 msgr2=0x7f68c40cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68c4159550 0x7f68c40cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:53.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.910+0000 7f68ca19c700 1 -- 172.21.15.12:0/2875699872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c00094f0 con 0x7f68c415dfd0 2023-10-08T16:24:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68ca19c700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009fa0 tx=0x7f68bc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00ebc0 con 0x7f68c415dfd0 2023-10-08T16:24:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00ed20 con 0x7f68c415dfd0 2023-10-08T16:24:53.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40c8a80 con 0x7f68c415dfd0 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc014670 con 0x7f68c415dfd0 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.911+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c40ca210 con 0x7f68c415dfd0 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.912+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c404c3c0 con 0x7f68c415dfd0 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.913+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68bc0149e0 con 0x7f68c415dfd0 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.914+0000 7f68b9ffb700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:53.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.914+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f68bc084d00 con 0x7f68c415dfd0 2023-10-08T16:24:53.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.914+0000 7f68c999b700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:53.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.915+0000 7f68c999b700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 0x7f68a80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c406b0f0 tx=0x7f68c0016000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:53.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:53.918+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68bc051e10 con 0x7f68c415dfd0 2023-10-08T16:24:54.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.117+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f68c40b40f0 con 0x7f68c415dfd0 2023-10-08T16:24:54.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.122+0000 7f68b9ffb700 1 -- 172.21.15.12:0/2875699872 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v25) v1 ==== 120+0+0 (secure 0 0 0) 0x7f68bc055430 con 0x7f68c415dfd0 2023-10-08T16:24:54.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 msgr2=0x7f68a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 0x7f68a80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f68c406b0f0 tx=0x7f68c0016000 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 msgr2=0x7f68c40cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009fa0 tx=0x7f68bc009900 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 shutdown_connections 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f68a8066f30 0x7f68a80693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68c415dfd0 0x7f68c40cadb0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68c4159550 0x7f68c40cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 --2- 172.21.15.12:0/2875699872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68c4159920 0x7f68c40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.124+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 >> 172.21.15.12:0/2875699872 conn(0x7f68c406ce80 msgr2=0x7f68c40b31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:54.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.125+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 shutdown_connections 2023-10-08T16:24:54.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.125+0000 7f68ca99d700 1 -- 172.21.15.12:0/2875699872 wait complete. 2023-10-08T16:24:54.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:24:54.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.344+0000 7fe147fff700 1 Processor -- start 2023-10-08T16:24:54.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.344+0000 7fe147fff700 1 -- start start 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.345+0000 7fe147fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe14806ded0 0x7fe148164590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.345+0000 7fe147fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14815bc40 con 0x7fe148159580 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.345+0000 7fe147fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14815b070 con 0x7fe1480b2b00 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.345+0000 7fe147fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14815b310 con 0x7fe14806ded0 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe146ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe148159580 0x7fe1480b23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44894/0 (socket says 172.21.15.12:44894) 2023-10-08T16:24:54.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe146ffd700 1 -- 172.21.15.12:0/346319313 learned_addr learned my addr 172.21.15.12:0/346319313 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe1477fe700 1 --2- 172.21.15.12:0/346319313 >> v2:172.21.15.29:3300/0 conn(0x7fe14806ded0 0x7fe148164590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855419493 0 0) 0x7fe14815bc40 con 0x7fe148159580 2023-10-08T16:24:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe130003570 con 0x7fe148159580 2023-10-08T16:24:54.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241310448 0 0) 0x7fe130003570 con 0x7fe148159580 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 >> v2:172.21.15.29:3300/0 conn(0x7fe14806ded0 msgr2=0x7fe148164590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 --2- 172.21.15.12:0/346319313 >> v2:172.21.15.29:3300/0 conn(0x7fe14806ded0 0x7fe148164590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 >> v1:172.21.15.29:6789/0 conn(0x7fe1480b2b00 legacy=0x7fe14806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14815b5f0 con 0x7fe148159580 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe138001470 con 0x7fe148159580 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 >> v1:172.21.15.12:6789/0 conn(0x7fe148159580 legacy=0x7fe1480b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.346+0000 7fe145ffb700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 0x7fe130003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe145ffb700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe130004810 0x7fe130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe145ffb700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130005210 0x7fe13000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815b310 con 0x7fe130003ab0 2023-10-08T16:24:54.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13000c130 con 0x7fe130004810 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13000c2f0 con 0x7fe130005210 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 0x7fe130003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe1467fc700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe130004810 0x7fe130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe1477fe700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130005210 0x7fe13000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 -- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130005210 msgr2=0x7fe13000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130005210 0x7fe13000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 -- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe130004810 msgr2=0x7fe130004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe130004810 0x7fe130004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe146ffd700 1 -- 172.21.15.12:0/346319313 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe130003570 con 0x7fe130003ab0 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe1477fe700 1 -- 172.21.15.12:0/346319313 reap_dead start 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.347+0000 7fe1467fc700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe130004810 0x7fe130004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:54.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe146ffd700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 0x7fe130003ec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c2d0 tx=0x7fe138001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9e360f2768ffb8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13800cb20 con 0x7fe130003ab0 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13800cca0 con 0x7fe130003ab0 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe145ffb700 1 -- 172.21.15.12:0/346319313 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138005b70 con 0x7fe130003ab0 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe147fff700 1 -- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 msgr2=0x7fe130003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe147fff700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 0x7fe130003ec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe13800c2d0 tx=0x7fe138001d80 comp rx=0 tx=0).stop 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe147fff700 1 -- 172.21.15.12:0/346319313 shutdown_connections 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe147fff700 1 --2- 172.21.15.12:0/346319313 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe130003ab0 0x7fe130003ec0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.348+0000 7fe147fff700 1 -- 172.21.15.12:0/346319313 >> 172.21.15.12:0/346319313 conn(0x7fe1480703a0 msgr2=0x7fe1480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.349+0000 7fe147fff700 1 -- 172.21.15.12:0/346319313 shutdown_connections 2023-10-08T16:24:54.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.349+0000 7fe147fff700 1 -- 172.21.15.12:0/346319313 wait complete. 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.350+0000 7fe147fff700 1 Processor -- start 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.350+0000 7fe147fff700 1 -- start start 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130003ab0 0x7fe14816d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 0x7fe148159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14816e3c0 con 0x7fe1480c59d0 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480c8050 con 0x7fe1480c76f0 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe147fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14816db20 con 0x7fe130003ab0 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe1477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe1477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34340/0 (socket says 172.21.15.12:34340) 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.351+0000 7fe1477fe700 1 -- 172.21.15.12:0/3228211342 learned_addr learned my addr 172.21.15.12:0/3228211342 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe146ffd700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130003ab0 0x7fe14816d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1467fc700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 0x7fe148159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 -- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130003ab0 msgr2=0x7fe14816d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130003ab0 0x7fe14816d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 -- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 msgr2=0x7fe148159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 0x7fe148159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 -- 172.21.15.12:0/3228211342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14816de00 con 0x7fe1480c59d0 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1467fc700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 0x7fe148159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe1477fe700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe14806e2d0 tx=0x7fe14000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000e040 con 0x7fe1480c59d0 2023-10-08T16:24:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14000f040 con 0x7fe1480c59d0 2023-10-08T16:24:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14816e0e0 con 0x7fe1480c59d0 2023-10-08T16:24:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.352+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000fe70 con 0x7fe1480c59d0 2023-10-08T16:24:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.353+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe14815a0e0 con 0x7fe1480c59d0 2023-10-08T16:24:54.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.354+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe14815a360 con 0x7fe1480c59d0 2023-10-08T16:24:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.355+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe140015640 con 0x7fe1480c59d0 2023-10-08T16:24:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.355+0000 7fe12effd700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 0x7fe1340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.355+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fe140084fe0 con 0x7fe1480c59d0 2023-10-08T16:24:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.356+0000 7fe146ffd700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 0x7fe1340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.356+0000 7fe146ffd700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 0x7fe1340693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe138007c00 tx=0x7fe138015000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.360+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe140052130 con 0x7fe1480c59d0 2023-10-08T16:24:54.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.561+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe1480c81e0 con 0x7fe1480c59d0 2023-10-08T16:24:54.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.565+0000 7fe12effd700 1 -- 172.21.15.12:0/3228211342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe140055750 con 0x7fe1480c59d0 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 msgr2=0x7fe1340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 0x7fe1340693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe138007c00 tx=0x7fe138015000 comp rx=0 tx=0).stop 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 msgr2=0x7fe1480c5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe14806e2d0 tx=0x7fe14000b040 comp rx=0 tx=0).stop 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 shutdown_connections 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe134066f30 0x7fe1340693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe1480c59d0 0x7fe1480c5e50 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe130003ab0 0x7fe14816d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 --2- 172.21.15.12:0/3228211342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe1480c76f0 0x7fe148159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 >> 172.21.15.12:0/3228211342 conn(0x7fe1480703a0 msgr2=0x7fe1480cf690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:54.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 shutdown_connections 2023-10-08T16:24:54.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.568+0000 7fe147fff700 1 -- 172.21.15.12:0/3228211342 wait complete. 2023-10-08T16:24:54.586 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:24:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.778+0000 7f95beb9d700 1 Processor -- start 2023-10-08T16:24:54.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.778+0000 7f95beb9d700 1 -- start start 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95beb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95b8153dd0 0x7f95b815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95beb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b80ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95beb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b815ac50 con 0x7f95b8153a00 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95beb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b815d010 con 0x7f95b8153dd0 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95beb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80cf3e0 con 0x7f95b80cea00 2023-10-08T16:24:54.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95bd39a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f95b8153dd0 0x7f95b815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95bdb9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f95b8153a00 0x7f95b815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44900/0 (socket says 172.21.15.12:44900) 2023-10-08T16:24:54.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.779+0000 7f95bdb9b700 1 -- 172.21.15.12:0/3513741958 learned_addr learned my addr 172.21.15.12:0/3513741958 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95be39c700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b80ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bd39a700 1 -- 172.21.15.12:0/3513741958 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 msgr2=0x7f95b80ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bd39a700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b80ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bd39a700 1 -- 172.21.15.12:0/3513741958 >> v1:172.21.15.12:6789/0 conn(0x7f95b8153a00 legacy=0x7f95b815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bd39a700 1 -- 172.21.15.12:0/3513741958 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b815af60 con 0x7f95b8153dd0 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bcb99700 1 -- 172.21.15.12:0/3513741958 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274573339 0 0) 0x7f95b815ac50 con 0x7f95b8153a00 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95be39c700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b80ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bd39a700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b815de50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95a80098e0 tx=0x7f95a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0be955cdd892a7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.780+0000 7f95bcb99700 1 -- 172.21.15.12:0/3513741958 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8009e80 con 0x7f95b8153dd0 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95bcb99700 1 -- 172.21.15.12:0/3513741958 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a800b860 con 0x7f95b8153dd0 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95bcb99700 1 -- 172.21.15.12:0/3513741958 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a800bbe0 con 0x7f95b8153dd0 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 -- 172.21.15.12:0/3513741958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 msgr2=0x7f95b815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b815de50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95a80098e0 tx=0x7f95a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 -- 172.21.15.12:0/3513741958 shutdown_connections 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b80ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 --2- 172.21.15.12:0/3513741958 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b815de50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 -- 172.21.15.12:0/3513741958 >> 172.21.15.12:0/3513741958 conn(0x7f95b80703a0 msgr2=0x7f95b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 -- 172.21.15.12:0/3513741958 shutdown_connections 2023-10-08T16:24:54.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.781+0000 7f95beb9d700 1 -- 172.21.15.12:0/3513741958 wait complete. 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.783+0000 7f95beb9d700 1 Processor -- start 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.783+0000 7f95beb9d700 1 -- start start 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b8144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b8153a00 0x7f95b815fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b8144540 con 0x7f95b8153dd0 2023-10-08T16:24:54.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b816a000 con 0x7f95b8153a00 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95beb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b81693f0 con 0x7f95b80cea00 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34362/0 (socket says 172.21.15.12:34362) 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 -- 172.21.15.12:0/1602630339 learned_addr learned my addr 172.21.15.12:0/1602630339 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95bdb9b700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b8144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95bd39a700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b8153a00 0x7f95b815fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 -- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 msgr2=0x7f95b8144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b8144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 -- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b8153a00 msgr2=0x7f95b815fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b8153a00 0x7f95b815fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:54.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.784+0000 7f95be39c700 1 -- 172.21.15.12:0/1602630339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009420 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95be39c700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f95b000a380 tx=0x7f95b0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0015440 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b00155a0 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b81696d0 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0015960 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.785+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b8169c90 con 0x7f95b8153dd0 2023-10-08T16:24:54.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.786+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b804c3c0 con 0x7f95b8153dd0 2023-10-08T16:24:54.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.787+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95b000d440 con 0x7f95b8153dd0 2023-10-08T16:24:54.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.789+0000 7f95adffb700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:54.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.789+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f95b0085190 con 0x7f95b8153dd0 2023-10-08T16:24:54.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.789+0000 7f95bdb9b700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:54.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.789+0000 7f95bdb9b700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 0x7f959c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fd0 tx=0x7f95b4007d30 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:54.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.793+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95b00522a0 con 0x7f95b8153dd0 2023-10-08T16:24:54.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:54.996+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f95b815b240 con 0x7f95b8153dd0 2023-10-08T16:24:55.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.000+0000 7f95adffb700 1 -- 172.21.15.12:0/1602630339 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v27) v1 ==== 115+0+0 (secure 0 0 0) 0x7f95b00558c0 con 0x7f95b8153dd0 2023-10-08T16:24:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 msgr2=0x7f959c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 0x7f959c0693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f95b4007fd0 tx=0x7f95b4007d30 comp rx=0 tx=0).stop 2023-10-08T16:24:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 msgr2=0x7f95b8160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f95b000a380 tx=0x7f95b0007900 comp rx=0 tx=0).stop 2023-10-08T16:24:55.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 shutdown_connections 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f959c066f30 0x7f959c0693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f95b8153dd0 0x7f95b8160130 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95b80cea00 0x7f95b8144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 --2- 172.21.15.12:0/1602630339 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95b8153a00 0x7f95b815fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 >> 172.21.15.12:0/1602630339 conn(0x7f95b80703a0 msgr2=0x7f95b80b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 shutdown_connections 2023-10-08T16:24:55.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.003+0000 7f95beb9d700 1 -- 172.21.15.12:0/1602630339 wait complete. 2023-10-08T16:24:55.021 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-10-08T16:24:55.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.209+0000 7f5a0db9d700 1 Processor -- start 2023-10-08T16:24:55.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.209+0000 7f5a0db9d700 1 -- start start 2023-10-08T16:24:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0db9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a08159550 0x7f5a080ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0db9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a08159920 0x7f5a080ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0db9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a080acc00 con 0x7f5a0815dfd0 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0db9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080abff0 con 0x7f5a08159550 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0db9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a080ac2d0 con 0x7f5a08159920 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.210+0000 7f5a0cb9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a08159550 0x7f5a080ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a08159550 0x7f5a080ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34370/0 (socket says 172.21.15.12:34370) 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 -- 172.21.15.12:0/1021627376 learned_addr learned my addr 172.21.15.12:0/1021627376 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 -- 172.21.15.12:0/1021627376 >> v2:172.21.15.29:3300/0 conn(0x7f5a08159920 msgr2=0x7f5a080ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 --2- 172.21.15.12:0/1021627376 >> v2:172.21.15.29:3300/0 conn(0x7f5a08159920 0x7f5a080ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 -- 172.21.15.12:0/1021627376 >> v1:172.21.15.29:6789/0 conn(0x7f5a0815dfd0 legacy=0x7f5a080aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:55.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 -- 172.21.15.12:0/1021627376 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a080ac5b0 con 0x7f5a08159550 2023-10-08T16:24:55.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a0cb9b700 1 --2- 172.21.15.12:0/1021627376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a08159550 0x7f5a080ceac0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a0806b0f0 tx=0x7f59fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51393bca442541f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a077fe700 1 -- 172.21.15.12:0/1021627376 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00b820 con 0x7f5a08159550 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a077fe700 1 -- 172.21.15.12:0/1021627376 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59fc00b980 con 0x7f5a08159550 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.211+0000 7f5a077fe700 1 -- 172.21.15.12:0/1021627376 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59fc00bd20 con 0x7f5a08159550 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 -- 172.21.15.12:0/1021627376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a08159550 msgr2=0x7f5a080ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/1021627376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a08159550 0x7f5a080ceac0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f5a0806b0f0 tx=0x7f59fc009250 comp rx=0 tx=0).stop 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 -- 172.21.15.12:0/1021627376 shutdown_connections 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/1021627376 >> v2:172.21.15.29:3300/0 conn(0x7f5a08159920 0x7f5a080ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/1021627376 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a08159550 0x7f5a080ceac0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 -- 172.21.15.12:0/1021627376 >> 172.21.15.12:0/1021627376 conn(0x7f5a0806ce80 msgr2=0x7f5a080ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 -- 172.21.15.12:0/1021627376 shutdown_connections 2023-10-08T16:24:55.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.212+0000 7f5a0db9d700 1 -- 172.21.15.12:0/1021627376 wait complete. 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.214+0000 7f5a0db9d700 1 Processor -- start 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.214+0000 7f5a0db9d700 1 -- start start 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a08159550 0x7f5a08151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 0x7f5a080af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080cb780 con 0x7f5a0815dfd0 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a081524b0 con 0x7f5a08159920 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a080cae50 con 0x7f5a08159550 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34372/0 (socket says 172.21.15.12:34372) 2023-10-08T16:24:55.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 -- 172.21.15.12:0/106715206 learned_addr learned my addr 172.21.15.12:0/106715206 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a07fff700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 0x7f5a080af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0cb9b700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a08159550 0x7f5a08151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 -- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a08159550 msgr2=0x7f5a08151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a08159550 0x7f5a08151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 -- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 msgr2=0x7f5a080af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 0x7f5a080af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a0d39c700 1 -- 172.21.15.12:0/106715206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59fc0094f0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.215+0000 7f5a07fff700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 0x7f5a080af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a0d39c700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000bc30 tx=0x7f5a00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a000092e0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000c6f0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0000cad0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a080cb130 con 0x7f5a0815dfd0 2023-10-08T16:24:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.216+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0816e6a0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.217+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080cb8f0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.218+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a00012070 con 0x7f5a0815dfd0 2023-10-08T16:24:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.219+0000 7f5a04ff9700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 0x7f59ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.219+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5a00084230 con 0x7f5a0815dfd0 2023-10-08T16:24:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.219+0000 7f5a0cb9b700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 0x7f59ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.220+0000 7f5a0cb9b700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 0x7f59ec0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a0806b0f0 tx=0x7f59fc016000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.223+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a00051340 con 0x7f5a0815dfd0 2023-10-08T16:24:55.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.506+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f5a0804c3c0 con 0x7f5a0815dfd0 2023-10-08T16:24:55.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.679+0000 7f5a04ff9700 1 -- 172.21.15.12:0/106715206 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v583) v1 ==== 156+0+0 (secure 0 0 0) 0x7f5a00054960 con 0x7f5a0815dfd0 2023-10-08T16:24:55.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 msgr2=0x7f59ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 0x7f59ec0693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5a0806b0f0 tx=0x7f59fc016000 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 msgr2=0x7f5a080aff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000bc30 tx=0x7f5a00009840 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 shutdown_connections 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59ec066f30 0x7f59ec0693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a0815dfd0 0x7f5a080aff30 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a08159550 0x7f5a08151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 --2- 172.21.15.12:0/106715206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a08159920 0x7f5a080af9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.681+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 >> 172.21.15.12:0/106715206 conn(0x7f5a0806ce80 msgr2=0x7f5a08152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.682+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 shutdown_connections 2023-10-08T16:24:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.682+0000 7f5a0db9d700 1 -- 172.21.15.12:0/106715206 wait complete. 2023-10-08T16:24:55.702 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-10-08T16:24:55.702 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-10-08T16:24:55.702 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:24:55.703 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-08T16:24:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.890+0000 7fda1d99d700 1 Processor -- start 2023-10-08T16:24:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.890+0000 7fda1d99d700 1 -- start start 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fda18153c30 0x7fda1815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda180cf110 0x7fda1815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1815afd0 con 0x7fda1815de50 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1815b2b0 con 0x7fda180cf110 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1815b590 con 0x7fda18153c30 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda180cf110 0x7fda1815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fda180cf110 0x7fda1815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34384/0 (socket says 172.21.15.12:34384) 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda1d19c700 1 -- 172.21.15.12:0/1129565539 learned_addr learned my addr 172.21.15.12:0/1129565539 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.891+0000 7fda17fff700 1 --1- 172.21.15.12:0/1129565539 >> v1:172.21.15.12:6789/0 conn(0x7fda1815de50 0x7fda180cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44910/0 (socket says 172.21.15.12:44910) 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1c99b700 1 --2- 172.21.15.12:0/1129565539 >> v2:172.21.15.29:3300/0 conn(0x7fda18153c30 0x7fda1815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1d19c700 1 -- 172.21.15.12:0/1129565539 >> v2:172.21.15.29:3300/0 conn(0x7fda18153c30 msgr2=0x7fda1815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1d19c700 1 --2- 172.21.15.12:0/1129565539 >> v2:172.21.15.29:3300/0 conn(0x7fda18153c30 0x7fda1815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1d19c700 1 -- 172.21.15.12:0/1129565539 >> v1:172.21.15.12:6789/0 conn(0x7fda1815de50 legacy=0x7fda180cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1d19c700 1 -- 172.21.15.12:0/1129565539 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1815b870 con 0x7fda180cf110 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda177fe700 1 -- 172.21.15.12:0/1129565539 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431343352 0 0) 0x7fda1815afd0 con 0x7fda1815de50 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda1d19c700 1 --2- 172.21.15.12:0/1129565539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda1815c070 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fda1806ead0 tx=0x7fda10009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb449b5e1d73ad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda177fe700 1 -- 172.21.15.12:0/1129565539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000e070 con 0x7fda180cf110 2023-10-08T16:24:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda177fe700 1 -- 172.21.15.12:0/1129565539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1000ba50 con 0x7fda180cf110 2023-10-08T16:24:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.892+0000 7fda177fe700 1 -- 172.21.15.12:0/1129565539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda100092e0 con 0x7fda180cf110 2023-10-08T16:24:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 -- 172.21.15.12:0/1129565539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 msgr2=0x7fda1815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1129565539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda1815c070 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fda1806ead0 tx=0x7fda10009840 comp rx=0 tx=0).stop 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 -- 172.21.15.12:0/1129565539 shutdown_connections 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1129565539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda1815c070 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1129565539 >> v2:172.21.15.29:3300/0 conn(0x7fda18153c30 0x7fda1815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 -- 172.21.15.12:0/1129565539 >> 172.21.15.12:0/1129565539 conn(0x7fda180703a0 msgr2=0x7fda180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 -- 172.21.15.12:0/1129565539 shutdown_connections 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.893+0000 7fda1d99d700 1 -- 172.21.15.12:0/1129565539 wait complete. 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.894+0000 7fda1d99d700 1 Processor -- start 2023-10-08T16:24:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.895+0000 7fda1d99d700 1 -- start start 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.895+0000 7fda1d99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.895+0000 7fda1d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 0x7fda180cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 0x7fda18152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda180c9b50 con 0x7fda180cf110 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda180c8f40 con 0x7fda1815de50 2023-10-08T16:24:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda180c9220 con 0x7fda18153c30 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34396/0 (socket says 172.21.15.12:34396) 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 -- 172.21.15.12:0/1604737477 learned_addr learned my addr 172.21.15.12:0/1604737477 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d19c700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 0x7fda18152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda17fff700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 0x7fda180cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 -- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 msgr2=0x7fda180cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 0x7fda180cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 -- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 msgr2=0x7fda18152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 0x7fda18152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1c99b700 1 -- 172.21.15.12:0/1604737477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10009ae0 con 0x7fda180cf110 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda1d19c700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 0x7fda18152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.896+0000 7fda17fff700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 0x7fda180cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda1c99b700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00d890 tx=0x7fda0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00b690 con 0x7fda180cf110 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00b7f0 con 0x7fda180cf110 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda180c9500 con 0x7fda180cf110 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00bb70 con 0x7fda180cf110 2023-10-08T16:24:55.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.897+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda180cc870 con 0x7fda180cf110 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.898+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda180cca90 con 0x7fda180cf110 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.899+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda0c01e460 con 0x7fda180cf110 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.900+0000 7fda14ff9700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 0x7fd9fc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.900+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fda0c084de0 con 0x7fda180cf110 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.900+0000 7fda17fff700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 0x7fd9fc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.900+0000 7fda17fff700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 0x7fd9fc069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda180c66b0 tx=0x7fda04009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:55.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:55.904+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda0c051ef0 con 0x7fda180cf110 2023-10-08T16:24:56.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.185+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fda1804c3c0 con 0x7fda180cf110 2023-10-08T16:24:56.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.681+0000 7fda14ff9700 1 -- 172.21.15.12:0/1604737477 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v584) v1 ==== 169+0+0 (secure 0 0 0) 0x7fda0c055510 con 0x7fda180cf110 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 msgr2=0x7fd9fc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 0x7fd9fc069410 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fda180c66b0 tx=0x7fda04009040 comp rx=0 tx=0).stop 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 msgr2=0x7fda180c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00d890 tx=0x7fda0c008040 comp rx=0 tx=0).stop 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 shutdown_connections 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9fc066f60 0x7fd9fc069410 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fda180cf110 0x7fda180c9fe0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fda1815de50 0x7fda18152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 --2- 172.21.15.12:0/1604737477 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fda18153c30 0x7fda180cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 >> 172.21.15.12:0/1604737477 conn(0x7fda180703a0 msgr2=0x7fda180b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 shutdown_connections 2023-10-08T16:24:56.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.684+0000 7fda1d99d700 1 -- 172.21.15.12:0/1604737477 wait complete. 2023-10-08T16:24:56.704 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:24:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.896+0000 7fba113ff700 1 Processor -- start 2023-10-08T16:24:56.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.897+0000 7fba113ff700 1 -- start start 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba0c155b60 0x7fba0c0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fba0c155f30 0x7fba0c156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c1599d0 0x7fba0c159e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c15a3b0 con 0x7fba0c155b60 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c1575a0 con 0x7fba0c155f30 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba113ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c156990 con 0x7fba0c1599d0 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba0affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba0c155b60 0x7fba0c0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba0affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fba0c155b60 0x7fba0c0b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34400/0 (socket says 172.21.15.12:34400) 2023-10-08T16:24:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba0affd700 1 -- 172.21.15.12:0/3961025503 learned_addr learned my addr 172.21.15.12:0/3961025503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba0b7fe700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c1599d0 0x7fba0c159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.898+0000 7fba0a7fc700 1 --2- 172.21.15.12:0/3961025503 >> v2:172.21.15.29:3300/0 conn(0x7fba0c155f30 0x7fba0c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 -- 172.21.15.12:0/3961025503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c1599d0 msgr2=0x7fba0c159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c1599d0 0x7fba0c159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 -- 172.21.15.12:0/3961025503 >> v2:172.21.15.29:3300/0 conn(0x7fba0c155f30 msgr2=0x7fba0c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 --2- 172.21.15.12:0/3961025503 >> v2:172.21.15.29:3300/0 conn(0x7fba0c155f30 0x7fba0c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 -- 172.21.15.12:0/3961025503 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c156c70 con 0x7fba0c155b60 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba0affd700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c155b60 0x7fba0c0b0730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0b2450 tx=0x7fb9fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213c112b5828aa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba09ffb700 1 -- 172.21.15.12:0/3961025503 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00b640 con 0x7fba0c155b60 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba09ffb700 1 -- 172.21.15.12:0/3961025503 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00b7a0 con 0x7fba0c155b60 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.899+0000 7fba09ffb700 1 -- 172.21.15.12:0/3961025503 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00bb60 con 0x7fba0c155b60 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 -- 172.21.15.12:0/3961025503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c155b60 msgr2=0x7fba0c0b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c155b60 0x7fba0c0b0730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0b2450 tx=0x7fb9fc009250 comp rx=0 tx=0).stop 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 -- 172.21.15.12:0/3961025503 shutdown_connections 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c1599d0 0x7fba0c159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 --2- 172.21.15.12:0/3961025503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c155b60 0x7fba0c0b0730 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 --2- 172.21.15.12:0/3961025503 >> v2:172.21.15.29:3300/0 conn(0x7fba0c155f30 0x7fba0c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 -- 172.21.15.12:0/3961025503 >> 172.21.15.12:0/3961025503 conn(0x7fba0c06d170 msgr2=0x7fba0c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 -- 172.21.15.12:0/3961025503 shutdown_connections 2023-10-08T16:24:56.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.900+0000 7fba113ff700 1 -- 172.21.15.12:0/3961025503 wait complete. 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.901+0000 7fba113ff700 1 Processor -- start 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.902+0000 7fba113ff700 1 -- start start 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c155b60 0x7fba0c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 0x7fba0c15c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c16a460 con 0x7fba0c1599d0 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c15dea0 con 0x7fba0c155f30 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba113ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c169830 con 0x7fba0c155b60 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34406/0 (socket says 172.21.15.12:34406) 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 -- 172.21.15.12:0/226344808 learned_addr learned my addr 172.21.15.12:0/226344808 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0affd700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c155b60 0x7fba0c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0a7fc700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 0x7fba0c15c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 -- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c155b60 msgr2=0x7fba0c06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c155b60 0x7fba0c06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 -- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 msgr2=0x7fba0c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 0x7fba0c15c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0b7fe700 1 -- 172.21.15.12:0/226344808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0094f0 con 0x7fba0c1599d0 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.903+0000 7fba0a7fc700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 0x7fba0c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fba0b7fe700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fba04009df0 tx=0x7fba0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:56.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0400cb50 con 0x7fba0c1599d0 2023-10-08T16:24:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400f040 con 0x7fba0c1599d0 2023-10-08T16:24:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04014480 con 0x7fba0c1599d0 2023-10-08T16:24:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c15d220 con 0x7fba0c1599d0 2023-10-08T16:24:56.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.904+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c15dac0 con 0x7fba0c1599d0 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.905+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c04c3c0 con 0x7fba0c1599d0 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.906+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fba04014830 con 0x7fba0c1599d0 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.907+0000 7fb9f2ffd700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.907+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fba04084fe0 con 0x7fba0c1599d0 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.907+0000 7fba0affd700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:56.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.908+0000 7fba0affd700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0b2450 tx=0x7fb9fc017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:56.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:56.911+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba040520f0 con 0x7fba0c1599d0 2023-10-08T16:24:57.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.115+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fba0c156f50 con 0x7fba0c1599d0 2023-10-08T16:24:57.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.119+0000 7fb9f2ffd700 1 -- 172.21.15.12:0/226344808 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fba04055710 con 0x7fba0c1599d0 2023-10-08T16:24:57.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 msgr2=0x7fb9f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 0x7fb9f80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fba0c0b2450 tx=0x7fb9fc017000 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 msgr2=0x7fba0c15cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fba04009df0 tx=0x7fba0400b040 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 shutdown_connections 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb9f8066f30 0x7fb9f80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fba0c1599d0 0x7fba0c15cb80 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fba0c155b60 0x7fba0c06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 --2- 172.21.15.12:0/226344808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fba0c155f30 0x7fba0c15c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.121+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 >> 172.21.15.12:0/226344808 conn(0x7fba0c06d170 msgr2=0x7fba0c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:57.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.122+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 shutdown_connections 2023-10-08T16:24:57.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.122+0000 7fba113ff700 1 -- 172.21.15.12:0/226344808 wait complete. 2023-10-08T16:24:57.139 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:24:57.140 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:57.224 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:24:57.316 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:24:57.316 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:24:57.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:24:57.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.503+0000 7f525ffff700 1 Processor -- start 2023-10-08T16:24:57.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.503+0000 7f525ffff700 1 -- start start 2023-10-08T16:24:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.504+0000 7f525ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 0x7f526015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.504+0000 7f525ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52600cf110 0x7f526015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.504+0000 7f525ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526015afd0 con 0x7f526015de50 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.504+0000 7f525ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f526015b2b0 con 0x7f52600cf110 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.504+0000 7f525ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526015b590 con 0x7f5260153c30 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525e7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f526015de50 0x7f52600cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44912/0 (socket says 172.21.15.12:44912) 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525e7fc700 1 -- 172.21.15.12:0/3247327813 learned_addr learned my addr 172.21.15.12:0/3247327813 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525effd700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 0x7f526015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525f7fe700 1 --2- 172.21.15.12:0/3247327813 >> v2:172.21.15.29:3300/0 conn(0x7f52600cf110 0x7f526015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525dffb700 1 -- 172.21.15.12:0/3247327813 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952242682 0 0) 0x7f526015afd0 con 0x7f526015de50 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525dffb700 1 -- 172.21.15.12:0/3247327813 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5248003570 con 0x7f526015de50 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525f7fe700 1 -- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 msgr2=0x7f526015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525f7fe700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 0x7f526015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525f7fe700 1 -- 172.21.15.12:0/3247327813 >> v1:172.21.15.12:6789/0 conn(0x7f526015de50 legacy=0x7f52600cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525f7fe700 1 -- 172.21.15.12:0/3247327813 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f526015b870 con 0x7f52600cf110 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.505+0000 7f525effd700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 0x7f526015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525f7fe700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f526015c070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5258009e60 tx=0x7f5258009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=551682449d2c132d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525dffb700 1 -- 172.21.15.12:0/3247327813 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800e070 con 0x7f52600cf110 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525dffb700 1 -- 172.21.15.12:0/3247327813 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525800bab0 con 0x7f52600cf110 2023-10-08T16:24:57.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525dffb700 1 -- 172.21.15.12:0/3247327813 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525800be30 con 0x7f52600cf110 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 -- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 msgr2=0x7f526015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f526015c070 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5258009e60 tx=0x7f5258009780 comp rx=0 tx=0).stop 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 -- 172.21.15.12:0/3247327813 shutdown_connections 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f526015c070 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 --2- 172.21.15.12:0/3247327813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5260153c30 0x7f526015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 -- 172.21.15.12:0/3247327813 >> 172.21.15.12:0/3247327813 conn(0x7f52600703a0 msgr2=0x7f52600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 -- 172.21.15.12:0/3247327813 shutdown_connections 2023-10-08T16:24:57.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.506+0000 7f525ffff700 1 -- 172.21.15.12:0/3247327813 wait complete. 2023-10-08T16:24:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.508+0000 7f525ffff700 1 Processor -- start 2023-10-08T16:24:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.508+0000 7f525ffff700 1 -- start start 2023-10-08T16:24:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f52600b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f526015de50 0x7f5260152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c8890 con 0x7f5260153c30 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52600c8c50 con 0x7f52600cf110 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52600b6110 con 0x7f526015de50 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34414/0 (socket says 172.21.15.12:34414) 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525e7fc700 1 -- 172.21.15.12:0/374393577 learned_addr learned my addr 172.21.15.12:0/374393577 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f52600b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.509+0000 7f525f7fe700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f526015de50 0x7f5260152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 -- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f526015de50 msgr2=0x7f5260152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f526015de50 0x7f5260152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 -- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 msgr2=0x7f52600b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f52600b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 -- 172.21.15.12:0/374393577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5250009420 con 0x7f5260153c30 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525e7fc700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f52540011e0 tx=0x7f5254007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254005b30 con 0x7f5260153c30 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5254005cb0 con 0x7f5260153c30 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5258009a20 con 0x7f5260153c30 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254007320 con 0x7f5260153c30 2023-10-08T16:24:57.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.510+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52600b5b50 con 0x7f5260153c30 2023-10-08T16:24:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.511+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52600c8dc0 con 0x7f5260153c30 2023-10-08T16:24:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.512+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f525401b3b0 con 0x7f5260153c30 2023-10-08T16:24:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.513+0000 7f5246ffd700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:57.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.514+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5254083990 con 0x7f5260153c30 2023-10-08T16:24:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.514+0000 7f525effd700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:57.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.514+0000 7f525effd700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 0x7f524c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5250009f40 tx=0x7f52500091a0 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:57.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.518+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52600c8dc0 con 0x7f5260153c30 2023-10-08T16:24:57.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.768+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52600c8dc0 con 0x7f5260153c30 2023-10-08T16:24:57.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.769+0000 7f5246ffd700 1 -- 172.21.15.12:0/374393577 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f52600c8dc0 con 0x7f5260153c30 2023-10-08T16:24:57.770 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:57.770 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":36,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5636,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3230489164","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":3230489164},{"type":"v1","addr":"172.21.15.29:6834","nonce":3230489164}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6112,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2032284069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2032284069},{"type":"v1","addr":"172.21.15.12:6835","nonce":2032284069}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6118,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3235879563","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3235879563},{"type":"v1","addr":"172.21.15.29:6835","nonce":3235879563}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6445,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1434412339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1434412339},{"type":"v1","addr":"172.21.15.12:6834","nonce":1434412339}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":36}],"filesystems":[]} 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 msgr2=0x7f524c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 0x7f524c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5250009f40 tx=0x7f52500091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 msgr2=0x7f52600cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f52540011e0 tx=0x7f5254007df0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 shutdown_connections 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f524c066f30 0x7f524c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f526015de50 0x7f5260152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52600cf110 0x7f52600b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 --2- 172.21.15.12:0/374393577 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5260153c30 0x7f52600cc2a0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:57.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 >> 172.21.15.12:0/374393577 conn(0x7f52600703a0 msgr2=0x7f52600c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:57.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 shutdown_connections 2023-10-08T16:24:57.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:57.771+0000 7f525ffff700 1 -- 172.21.15.12:0/374393577 wait complete. 2023-10-08T16:24:57.773 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 36 2023-10-08T16:24:57.789 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:24:57.789 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:24:57.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:24:57.790 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:57.790 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:24:57.790 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:24:57.790 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:24:57.790 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:57.790 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:24:57.790 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:24:57.791 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:24:57.791 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:57.791 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:24:57.791 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:24:57.791 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:24:57.791 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:24:57.804 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:24:57.804 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:24:57.805 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:24:57.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:24:57.808 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:24:57.808 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:24:57.809 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:24:57.809 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:24:57.850 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:24:57.850 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:57.852 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:24:57.853 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:57.853 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:24:57.853 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:57.857 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:24:57.857 DEBUG:teuthology.parallel:result is None 2023-10-08T16:24:57.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:24:57.986 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:24:57.988 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:24:57.998 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:24:57.998 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:24:58.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.055+0000 7f5bf159d700 1 Processor -- start 2023-10-08T16:24:58.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.055+0000 7f5bf159d700 1 -- start start 2023-10-08T16:24:58.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.056+0000 7f5bf159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf159d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bec06aaa0 0x7f5bec0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf159d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec15ae70 con 0x7f5bec13fef0 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf159d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec06af60 con 0x7f5bec06aaa0 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec06b240 con 0x7f5bec13fb20 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bec06aaa0 0x7f5bec0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5beb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5bec13fef0 0x7f5bec0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44936/0 (socket says 172.21.15.12:44936) 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5bec06aaa0 0x7f5bec0c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34470/0 (socket says 172.21.15.12:34470) 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5beb7fe700 1 -- 172.21.15.12:0/1668623662 learned_addr learned my addr 172.21.15.12:0/1668623662 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:58.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bebfff700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 -- 172.21.15.12:0/1668623662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 msgr2=0x7f5bec15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 -- 172.21.15.12:0/1668623662 >> v1:172.21.15.12:6789/0 conn(0x7f5bec13fef0 legacy=0x7f5bec0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5bf0d9c700 1 -- 172.21.15.12:0/1668623662 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec06b520 con 0x7f5bec06aaa0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.057+0000 7f5beaffd700 1 -- 172.21.15.12:0/1668623662 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002984973 0 0) 0x7f5be0001290 con 0x7f5bec13fef0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5bf0d9c700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec0c9d00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009e60 tx=0x7f5be4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fc2aac96bab2f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5beaffd700 1 -- 172.21.15.12:0/1668623662 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400e070 con 0x7f5bec06aaa0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5beaffd700 1 -- 172.21.15.12:0/1668623662 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400bb60 con 0x7f5bec06aaa0 2023-10-08T16:24:58.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5beaffd700 1 -- 172.21.15.12:0/1668623662 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4012430 con 0x7f5bec06aaa0 2023-10-08T16:24:58.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5bf159d700 1 -- 172.21.15.12:0/1668623662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 msgr2=0x7f5bec0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:58.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.058+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec0c9d00 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f5be4009e60 tx=0x7f5be4009780 comp rx=0 tx=0).stop 2023-10-08T16:24:58.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 -- 172.21.15.12:0/1668623662 shutdown_connections 2023-10-08T16:24:58.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec0c9d00 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:58.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1668623662 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 -- 172.21.15.12:0/1668623662 >> 172.21.15.12:0/1668623662 conn(0x7f5bec06d170 msgr2=0x7f5bec0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 -- 172.21.15.12:0/1668623662 shutdown_connections 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.059+0000 7f5bf159d700 1 -- 172.21.15.12:0/1668623662 wait complete. 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.060+0000 7f5bf159d700 1 Processor -- start 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.060+0000 7f5bf159d700 1 -- start start 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec169380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bec13fef0 0x7f5bec15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec13d870 con 0x7f5bec06aaa0 2023-10-08T16:24:58.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec13e4b0 con 0x7f5bec13fef0 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bf159d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec15b480 con 0x7f5bec13fb20 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34486/0 (socket says 172.21.15.12:34486) 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.061+0000 7f5bebfff700 1 -- 172.21.15.12:0/1769263679 learned_addr learned my addr 172.21.15.12:0/1769263679 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5beb7fe700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec169380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bf0d9c700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bec13fef0 0x7f5bec15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 -- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 msgr2=0x7f5bec169380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec169380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 -- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bec13fef0 msgr2=0x7f5bec15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:58.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bec13fef0 0x7f5bec15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 -- 172.21.15.12:0/1769263679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009a20 con 0x7f5bec06aaa0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5beb7fe700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bebfff700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ec80 tx=0x7f5bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00c850 con 0x7f5bec06aaa0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00c9b0 con 0x7f5bec06aaa0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00cd50 con 0x7f5bec06aaa0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec15b760 con 0x7f5bec06aaa0 2023-10-08T16:24:58.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.062+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec15bd20 con 0x7f5bec06aaa0 2023-10-08T16:24:58.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.063+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec16cb90 con 0x7f5bec06aaa0 2023-10-08T16:24:58.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.064+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bdc013680 con 0x7f5bec06aaa0 2023-10-08T16:24:58.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.065+0000 7f5bd3fff700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 0x7f5bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:58.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.065+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5bdc084950 con 0x7f5bec06aaa0 2023-10-08T16:24:58.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.066+0000 7f5beb7fe700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 0x7f5bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:58.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.066+0000 7f5beb7fe700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 0x7f5bd80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5bec15adf0 tx=0x7f5be0009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:58.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.069+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bdc051a60 con 0x7f5bec06aaa0 2023-10-08T16:24:58.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:58.292+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5bec15bf40 con 0x7f5bec06aaa0 2023-10-08T16:24:59.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.134+0000 7f5bd3fff700 1 -- 172.21.15.12:0/1769263679 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5bdc055080 con 0x7f5bec06aaa0 2023-10-08T16:24:59.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 msgr2=0x7f5bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 0x7f5bd80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5bec15adf0 tx=0x7f5be0009040 comp rx=0 tx=0).stop 2023-10-08T16:24:59.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 msgr2=0x7f5bec13df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ec80 tx=0x7f5bdc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 shutdown_connections 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5bd8066f30 0x7f5bd80693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5bec06aaa0 0x7f5bec13df70 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5bec13fef0 0x7f5bec15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 --2- 172.21.15.12:0/1769263679 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5bec13fb20 0x7f5bec169380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 >> 172.21.15.12:0/1769263679 conn(0x7f5bec06d170 msgr2=0x7f5bec0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 shutdown_connections 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.137+0000 7f5bf159d700 1 -- 172.21.15.12:0/1769263679 wait complete. 2023-10-08T16:24:59.139 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:24:59.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:24:59.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.353+0000 7ff0dd59d700 1 Processor -- start 2023-10-08T16:24:59.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.354+0000 7ff0dd59d700 1 -- start start 2023-10-08T16:24:59.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.355+0000 7ff0dd59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e0a0 0x7ff0d80c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.355+0000 7ff0dd59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0d806f3a0 0x7ff0d814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.355+0000 7ff0dd59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d806a490 con 0x7ff0d806e470 2023-10-08T16:24:59.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.355+0000 7ff0dd59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d806b930 con 0x7ff0d806f3a0 2023-10-08T16:24:59.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.355+0000 7ff0dd59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d80c7490 con 0x7ff0d806e0a0 2023-10-08T16:24:59.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e0a0 0x7ff0d80c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d77fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff0d806f3a0 0x7ff0d814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0dcd9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff0d806e470 0x7ff0d8159740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:37952/0 (socket says 172.21.15.12:37952) 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0dcd9c700 1 -- 172.21.15.12:0/2978978086 learned_addr learned my addr 172.21.15.12:0/2978978086 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d77fe700 1 -- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e0a0 msgr2=0x7ff0d80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d77fe700 1 --2- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e0a0 0x7ff0d80c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d77fe700 1 -- 172.21.15.12:0/2978978086 >> v1:172.21.15.29:6789/0 conn(0x7ff0d806e470 legacy=0x7ff0d8159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d77fe700 1 -- 172.21.15.12:0/2978978086 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80c7770 con 0x7ff0d806f3a0 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.356+0000 7ff0d6ffd700 1 -- 172.21.15.12:0/2978978086 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493639482 0 0) 0x7ff0d806a490 con 0x7ff0d806e470 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0d77fe700 1 --2- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806f3a0 0x7ff0d814fc70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a970 tx=0x7ff0cc00a220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9c71a81162243a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0d6ffd700 1 -- 172.21.15.12:0/2978978086 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00ae60 con 0x7ff0d806f3a0 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0d6ffd700 1 -- 172.21.15.12:0/2978978086 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc005a00 con 0x7ff0d806f3a0 2023-10-08T16:24:59.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0d6ffd700 1 -- 172.21.15.12:0/2978978086 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc005da0 con 0x7ff0d806f3a0 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 -- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806f3a0 msgr2=0x7ff0d814fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806f3a0 0x7ff0d814fc70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00a970 tx=0x7ff0cc00a220 comp rx=0 tx=0).stop 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 -- 172.21.15.12:0/2978978086 shutdown_connections 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e0a0 0x7ff0d80c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/2978978086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806f3a0 0x7ff0d814fc70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.357+0000 7ff0dd59d700 1 -- 172.21.15.12:0/2978978086 >> 172.21.15.12:0/2978978086 conn(0x7ff0d806d170 msgr2=0x7ff0d80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.358+0000 7ff0dd59d700 1 -- 172.21.15.12:0/2978978086 shutdown_connections 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.358+0000 7ff0dd59d700 1 -- 172.21.15.12:0/2978978086 wait complete. 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.359+0000 7ff0dd59d700 1 Processor -- start 2023-10-08T16:24:59.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.359+0000 7ff0dd59d700 1 -- start start 2023-10-08T16:24:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806e0a0 0x7ff0d81496c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e470 0x7ff0d80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8168fc0 con 0x7ff0d806f3a0 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d81692a0 con 0x7ff0d806e0a0 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dd59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d8169580 con 0x7ff0d806e470 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dcd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dcd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34494/0 (socket says 172.21.15.12:34494) 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0dcd9c700 1 -- 172.21.15.12:0/370043352 learned_addr learned my addr 172.21.15.12:0/370043352 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0d77fe700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e470 0x7ff0d80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.360+0000 7ff0d7fff700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806e0a0 0x7ff0d81496c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 -- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e470 msgr2=0x7ff0d80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e470 0x7ff0d80af5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 -- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806e0a0 msgr2=0x7ff0d81496c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806e0a0 0x7ff0d81496c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 -- 172.21.15.12:0/370043352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0cc00a460 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dcd9c700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000cc90 tx=0x7ff0d0001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000a8b0 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000aa10 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d8169860 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.361+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000add0 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.362+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d80afb10 con 0x7ff0d806f3a0 2023-10-08T16:24:59.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.362+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d804c3c0 con 0x7ff0d806f3a0 2023-10-08T16:24:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.363+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0d0007300 con 0x7ff0d806f3a0 2023-10-08T16:24:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.364+0000 7ff0bffff700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 0x7ff0c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.364+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5245+0+0 (secure 0 0 0) 0x7ff0d0084720 con 0x7ff0d806f3a0 2023-10-08T16:24:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.365+0000 7ff0d7fff700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 0x7ff0c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.365+0000 7ff0d7fff700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 0x7ff0c40693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8011570 tx=0x7ff0c800b430 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.368+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0d0051b40 con 0x7ff0d806f3a0 2023-10-08T16:24:59.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.651+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff0d80c7a50 con 0x7ff0d806f3a0 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.652+0000 7ff0bffff700 1 -- 172.21.15.12:0/370043352 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff0d0055160 con 0x7ff0d806f3a0 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.653 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:59.654 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.655 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.656 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.657 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.658 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.659 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.660 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:24:59.661 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:24:59.662 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.663 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.664 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:24:59.665 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:59.666 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.667 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:24:59.668 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:24:59.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 msgr2=0x7ff0c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 0x7ff0c40693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8011570 tx=0x7ff0c800b430 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 msgr2=0x7ff0d80c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7ff0d000cc90 tx=0x7ff0d0001a80 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 shutdown_connections 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff0c4066f30 0x7ff0c40693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0d806f3a0 0x7ff0d80c9bf0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0d806e0a0 0x7ff0d81496c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 --2- 172.21.15.12:0/370043352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0d806e470 0x7ff0d80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 >> 172.21.15.12:0/370043352 conn(0x7ff0d806d170 msgr2=0x7ff0d814cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 shutdown_connections 2023-10-08T16:24:59.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.654+0000 7ff0dd59d700 1 -- 172.21.15.12:0/370043352 wait complete. 2023-10-08T16:24:59.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:24:59.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.858+0000 7f18e359e700 1 Processor -- start 2023-10-08T16:24:59.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.859+0000 7f18e359e700 1 -- start start 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18e413fb20 0x7f18e415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18e413fef0 0x7f18e40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e415ae70 con 0x7f18e406aaa0 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e406af60 con 0x7f18e413fef0 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18e406b240 con 0x7f18e413fb20 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18e413fef0 0x7f18e40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e2d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f18e406aaa0 0x7f18e40c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44952/0 (socket says 172.21.15.12:44952) 2023-10-08T16:24:59.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e2d9d700 1 -- 172.21.15.12:0/1874541564 learned_addr learned my addr 172.21.15.12:0/1874541564 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:24:59.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e1d9b700 1 --2- 172.21.15.12:0/1874541564 >> v2:172.21.15.12:3300/0 conn(0x7f18e413fef0 0x7f18e40c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34496/0 (socket says 172.21.15.12:34496) 2023-10-08T16:24:59.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.860+0000 7f18e259c700 1 --2- 172.21.15.12:0/1874541564 >> v2:172.21.15.29:3300/0 conn(0x7f18e413fb20 0x7f18e415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e159a700 1 -- 172.21.15.12:0/1874541564 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441388228 0 0) 0x7f18dc001490 con 0x7f18e406aaa0 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e1d9b700 1 -- 172.21.15.12:0/1874541564 >> v2:172.21.15.29:3300/0 conn(0x7f18e413fb20 msgr2=0x7f18e415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e1d9b700 1 --2- 172.21.15.12:0/1874541564 >> v2:172.21.15.29:3300/0 conn(0x7f18e413fb20 0x7f18e415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e1d9b700 1 -- 172.21.15.12:0/1874541564 >> v1:172.21.15.12:6789/0 conn(0x7f18e406aaa0 legacy=0x7f18e40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e1d9b700 1 -- 172.21.15.12:0/1874541564 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e406b520 con 0x7f18e413fef0 2023-10-08T16:24:59.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e1d9b700 1 --2- 172.21.15.12:0/1874541564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e40c7990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f18e40695b0 tx=0x7f18d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446b65313bd49ff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e159a700 1 -- 172.21.15.12:0/1874541564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8005c10 con 0x7f18e413fef0 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e159a700 1 -- 172.21.15.12:0/1874541564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d8005d70 con 0x7f18e413fef0 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.861+0000 7f18e159a700 1 -- 172.21.15.12:0/1874541564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d8006260 con 0x7f18e413fef0 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 -- 172.21.15.12:0/1874541564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 msgr2=0x7f18e40c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 --2- 172.21.15.12:0/1874541564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e40c7990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f18e40695b0 tx=0x7f18d8009120 comp rx=0 tx=0).stop 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 -- 172.21.15.12:0/1874541564 shutdown_connections 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 --2- 172.21.15.12:0/1874541564 >> v2:172.21.15.29:3300/0 conn(0x7f18e413fb20 0x7f18e415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 --2- 172.21.15.12:0/1874541564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e40c7990 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 -- 172.21.15.12:0/1874541564 >> 172.21.15.12:0/1874541564 conn(0x7f18e406d170 msgr2=0x7f18e40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 -- 172.21.15.12:0/1874541564 shutdown_connections 2023-10-08T16:24:59.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.862+0000 7f18e359e700 1 -- 172.21.15.12:0/1874541564 wait complete. 2023-10-08T16:24:59.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.863+0000 7f18e359e700 1 Processor -- start 2023-10-08T16:24:59.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 -- start start 2023-10-08T16:24:59.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e406aaa0 0x7f18e4157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 0x7f18e4137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4138150 con 0x7f18e413fef0 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4158b80 con 0x7f18e406aaa0 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.864+0000 7f18e359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e4150340 con 0x7f18e413fb20 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34508/0 (socket says 172.21.15.12:34508) 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 -- 172.21.15.12:0/2458792003 learned_addr learned my addr 172.21.15.12:0/2458792003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e259c700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e406aaa0 0x7f18e4157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e1d9b700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 0x7f18e4137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 -- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 msgr2=0x7f18e4137c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 0x7f18e4137c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 -- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e406aaa0 msgr2=0x7f18e4157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e406aaa0 0x7f18e4157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 -- 172.21.15.12:0/2458792003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d80093c0 con 0x7f18e413fef0 2023-10-08T16:24:59.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e1d9b700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 0x7f18e4137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.865+0000 7f18e2d9d700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00cc70 tx=0x7f18dc001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.866+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00ce80 con 0x7f18e413fef0 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.866+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18dc004bb0 con 0x7f18e413fef0 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.866+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00ab70 con 0x7f18e413fef0 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.866+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e4157f70 con 0x7f18e413fef0 2023-10-08T16:24:59.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.866+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e4158530 con 0x7f18e413fef0 2023-10-08T16:24:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.867+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e4158cf0 con 0x7f18e413fef0 2023-10-08T16:24:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.868+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18dc0070f0 con 0x7f18e413fef0 2023-10-08T16:24:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.869+0000 7f18d27fc700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 0x7f18c4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:24:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.869+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f18dc084020 con 0x7f18e413fef0 2023-10-08T16:24:59.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.869+0000 7f18e259c700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 0x7f18c4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:24:59.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.870+0000 7f18e259c700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 0x7f18c4069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d40 tx=0x7f18d4008040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:24:59.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:24:59.873+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18dc054f70 con 0x7f18e413fef0 2023-10-08T16:25:00.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.074+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18e415ae70 con 0x7f18e413fef0 2023-10-08T16:25:00.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.075+0000 7f18d27fc700 1 -- 172.21.15.12:0/2458792003 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+12777 (secure 0 0 0) 0x7f18e415ae70 con 0x7f18e413fef0 2023-10-08T16:25:00.076 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:00.076 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":95,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:24:59.130503+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:00.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 msgr2=0x7f18c4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 0x7f18c4069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009d40 tx=0x7f18d4008040 comp rx=0 tx=0).stop 2023-10-08T16:25:00.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 msgr2=0x7f18e414fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00cc70 tx=0x7f18dc001a30 comp rx=0 tx=0).stop 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 shutdown_connections 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f18c4066f60 0x7f18c4069410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18e413fef0 0x7f18e414fe00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18e406aaa0 0x7f18e4157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 --2- 172.21.15.12:0/2458792003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18e413fb20 0x7f18e4137c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.077+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 >> 172.21.15.12:0/2458792003 conn(0x7f18e406d170 msgr2=0x7f18e40cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.078+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 shutdown_connections 2023-10-08T16:25:00.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.078+0000 7f18e359e700 1 -- 172.21.15.12:0/2458792003 wait complete. 2023-10-08T16:25:00.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:25:00.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:25:00.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.287+0000 7f3bf219d700 1 Processor -- start 2023-10-08T16:25:00.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.287+0000 7f3bf219d700 1 -- start start 2023-10-08T16:25:00.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 0x7f3bec15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3bec13f780 0x7f3bec13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec06bf10 con 0x7f3bec13f780 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec140100 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.288+0000 7f3bf219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec15aed0 con 0x7f3bec0c7be0 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3bec13f780 0x7f3bec13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3bec13f780 0x7f3bec13fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34520/0 (socket says 172.21.15.12:34520) 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 -- 172.21.15.12:0/4086623538 learned_addr learned my addr 172.21.15.12:0/4086623538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf119b700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf099a700 1 --2- 172.21.15.12:0/4086623538 >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 0x7f3bec15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 -- 172.21.15.12:0/4086623538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 msgr2=0x7f3bec06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 -- 172.21.15.12:0/4086623538 >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 msgr2=0x7f3bec15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:00.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 --2- 172.21.15.12:0/4086623538 >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 0x7f3bec15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 -- 172.21.15.12:0/4086623538 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec06b290 con 0x7f3bec13f780 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf119b700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf099a700 1 --2- 172.21.15.12:0/4086623538 >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 0x7f3bec15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3bf199c700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec13f780 0x7f3bec13fbc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0697f0 tx=0x7f3be4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9703586a5d6ab7e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.289+0000 7f3be3fff700 1 -- 172.21.15.12:0/4086623538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400e070 con 0x7f3bec13f780 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3be3fff700 1 -- 172.21.15.12:0/4086623538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400ba50 con 0x7f3bec13f780 2023-10-08T16:25:00.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3be3fff700 1 -- 172.21.15.12:0/4086623538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40092e0 con 0x7f3bec13f780 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 -- 172.21.15.12:0/4086623538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec13f780 msgr2=0x7f3bec13fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec13f780 0x7f3bec13fbc0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0697f0 tx=0x7f3be4009840 comp rx=0 tx=0).stop 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 -- 172.21.15.12:0/4086623538 shutdown_connections 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec13f780 0x7f3bec13fbc0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 --2- 172.21.15.12:0/4086623538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 --2- 172.21.15.12:0/4086623538 >> v2:172.21.15.29:3300/0 conn(0x7f3bec0c7fb0 0x7f3bec15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 -- 172.21.15.12:0/4086623538 >> 172.21.15.12:0/4086623538 conn(0x7f3bec06d110 msgr2=0x7f3bec0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:00.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 -- 172.21.15.12:0/4086623538 shutdown_connections 2023-10-08T16:25:00.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.290+0000 7f3bf219d700 1 -- 172.21.15.12:0/4086623538 wait complete. 2023-10-08T16:25:00.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.292+0000 7f3bf219d700 1 Processor -- start 2023-10-08T16:25:00.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.292+0000 7f3bf219d700 1 -- start start 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 0x7f3bec0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0af8a0 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1594c0 con 0x7f3bec13f780 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec0aef70 con 0x7f3bec0c7be0 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34522/0 (socket says 172.21.15.12:34522) 2023-10-08T16:25:00.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf099a700 1 -- 172.21.15.12:0/3835871340 learned_addr learned my addr 172.21.15.12:0/3835871340 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf119b700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.293+0000 7f3bf199c700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 0x7f3bec0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 -- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 msgr2=0x7f3bec0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec0b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 -- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 msgr2=0x7f3bec0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 0x7f3bec0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 -- 172.21.15.12:0/3835871340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009ae0 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf199c700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 0x7f3bec0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf099a700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e850 tx=0x7f3bdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc013410 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc013570 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc013910 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec0af250 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.294+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec0b1d80 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.295+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec04c3c0 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.296+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bdc013d00 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.297+0000 7f3be17fa700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.297+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f3bdc084150 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.297+0000 7f3bf119b700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.298+0000 7f3bf119b700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006f00 tx=0x7f3be8008040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.301+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bdc0514f0 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.501+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bec06b570 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.501+0000 7f3be17fa700 1 -- 172.21.15.12:0/3835871340 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bdc054b10 con 0x7f3bec0c7fb0 2023-10-08T16:25:00.503 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 msgr2=0x7f3bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 0x7f3bd00693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3be8006f00 tx=0x7f3be8008040 comp rx=0 tx=0).stop 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 msgr2=0x7f3bec0c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e850 tx=0x7f3bdc008040 comp rx=0 tx=0).stop 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 shutdown_connections 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3bd0066f30 0x7f3bd00693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3bec13f780 0x7f3bec0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3bec0c7be0 0x7f3bec0b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 --2- 172.21.15.12:0/3835871340 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3bec0c7fb0 0x7f3bec0c8b70 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 >> 172.21.15.12:0/3835871340 conn(0x7f3bec06d110 msgr2=0x7f3bec155800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 shutdown_connections 2023-10-08T16:25:00.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.504+0000 7f3bf219d700 1 -- 172.21.15.12:0/3835871340 wait complete. 2023-10-08T16:25:00.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:25:00.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.709+0000 7f9e3f59d700 1 Processor -- start 2023-10-08T16:25:00.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.709+0000 7f9e3f59d700 1 -- start start 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e38142c00 0x7f9e3806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3f59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3f59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380ca480 con 0x7f9e3806bd20 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3f59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3815e240 con 0x7f9e380c7f90 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3806b350 con 0x7f9e38142c00 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3dd9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e3806bd20 0x7f9e380c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44968/0 (socket says 172.21.15.12:44968) 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3dd9a700 1 -- 172.21.15.12:0/1691774267 learned_addr learned my addr 172.21.15.12:0/1691774267 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/1691774267 >> v2:172.21.15.12:3300/0 conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3e59b700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e38142c00 0x7f9e3806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/1691774267 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e38142c00 msgr2=0x7f9e3806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e38142c00 0x7f9e3806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/1691774267 >> v1:172.21.15.12:6789/0 conn(0x7f9e3806bd20 legacy=0x7f9e380c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.711+0000 7f9e3d599700 1 -- 172.21.15.12:0/1691774267 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481534584 0 0) 0x7f9e380ca480 con 0x7f9e3806bd20 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/1691774267 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3815df60 con 0x7f9e380c7f90 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009e90 tx=0x7f9e30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d904c95e2e95286 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3d599700 1 -- 172.21.15.12:0/1691774267 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000e070 con 0x7f9e380c7f90 2023-10-08T16:25:00.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3d599700 1 -- 172.21.15.12:0/1691774267 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000bbf0 con 0x7f9e380c7f90 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.712+0000 7f9e3d599700 1 -- 172.21.15.12:0/1691774267 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e30012430 con 0x7f9e380c7f90 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 -- 172.21.15.12:0/1691774267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e380c7f90 msgr2=0x7f9e3806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009e90 tx=0x7f9e30009780 comp rx=0 tx=0).stop 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 -- 172.21.15.12:0/1691774267 shutdown_connections 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/1691774267 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e38142c00 0x7f9e3806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 -- 172.21.15.12:0/1691774267 >> 172.21.15.12:0/1691774267 conn(0x7f9e380675a0 msgr2=0x7f9e380679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 -- 172.21.15.12:0/1691774267 shutdown_connections 2023-10-08T16:25:00.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.713+0000 7f9e3f59d700 1 -- 172.21.15.12:0/1691774267 wait complete. 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.714+0000 7f9e3f59d700 1 Processor -- start 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.714+0000 7f9e3f59d700 1 -- start start 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e3806bd20 0x7f9e3813bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b19d0 con 0x7f9e38142c00 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b0dc0 con 0x7f9e380c7f90 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b10a0 con 0x7f9e3806bd20 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3ed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3ed9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34538/0 (socket says 172.21.15.12:34538) 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.715+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/686710643 learned_addr learned my addr 172.21.15.12:0/686710643 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3e59b700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e3806bd20 0x7f9e3813bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3dd9a700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e3806bd20 msgr2=0x7f9e3813bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e3806bd20 0x7f9e3813bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e380c7f90 msgr2=0x7f9e3806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 -- 172.21.15.12:0/686710643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e30009a20 con 0x7f9e38142c00 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3ed9c700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9e30013000 tx=0x7f9e30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3001b630 con 0x7f9e38142c00 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3001b7b0 con 0x7f9e38142c00 2023-10-08T16:25:00.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3001bb70 con 0x7f9e38142c00 2023-10-08T16:25:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.716+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380b1380 con 0x7f9e38142c00 2023-10-08T16:25:00.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.717+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3813c120 con 0x7f9e38142c00 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.718+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380b1b80 con 0x7f9e38142c00 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.718+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e3001c400 con 0x7f9e38142c00 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.719+0000 7f9e2e7fc700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.719+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f9e30085f60 con 0x7f9e38142c00 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.720+0000 7f9e3e59b700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:00.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.720+0000 7f9e3e59b700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ca0 tx=0x7f9e34008040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:00.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.723+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e380b1b80 con 0x7f9e38142c00 2023-10-08T16:25:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.927+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9e3804c3c0 con 0x7f9e38142c00 2023-10-08T16:25:00.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.927+0000 7f9e2e7fc700 1 -- 172.21.15.12:0/686710643 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) v1 ==== 84+0+65 (secure 0 0 0) 0x7f9e3002a060 con 0x7f9e38142c00 2023-10-08T16:25:00.928 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:00.929 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 msgr2=0x7f9e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ca0 tx=0x7f9e34008040 comp rx=0 tx=0).stop 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 msgr2=0x7f9e3806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f9e30013000 tx=0x7f9e30019000 comp rx=0 tx=0).stop 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 shutdown_connections 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e38142c00 0x7f9e3806cbe0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e3806bd20 0x7f9e3813bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 --2- 172.21.15.12:0/686710643 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e380c7f90 0x7f9e3806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 >> 172.21.15.12:0/686710643 conn(0x7f9e380675a0 msgr2=0x7f9e380c7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 shutdown_connections 2023-10-08T16:25:00.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:00.930+0000 7f9e3f59d700 1 -- 172.21.15.12:0/686710643 wait complete. 2023-10-08T16:25:00.948 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:25:00.948 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:25:01.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.140+0000 7f1c1239d700 1 Processor -- start 2023-10-08T16:25:01.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.140+0000 7f1c1239d700 1 -- start start 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1c0c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1239d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c06d040 con 0x7f1c0c15cb90 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1239d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0c0c2fa0 con 0x7f1c0c06cbe0 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0ccdf0 con 0x7f1c0c0c7870 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1139b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1c0c15cb90 0x7f1c0c15dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44974/0 (socket says 172.21.15.12:44974) 2023-10-08T16:25:01.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c1139b700 1 -- 172.21.15.12:0/1922303632 learned_addr learned my addr 172.21.15.12:0/1922303632 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1c0c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2125269534 0 0) 0x7f1c08001110 con 0x7f1c0c15cb90 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.142+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bf8003570 con 0x7f1c0c15cb90 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3783673914 0 0) 0x7f1bf8003570 con 0x7f1c0c15cb90 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 msgr2=0x7f1c0c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1c0c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 >> v1:172.21.15.29:6789/0 conn(0x7f1c0c06cbe0 legacy=0x7f1c0c0c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c0c7ce0 con 0x7f1c0c15cb90 2023-10-08T16:25:01.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f1c08001600 con 0x7f1c0c15cb90 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 >> v1:172.21.15.12:6789/0 conn(0x7f1c0c15cb90 legacy=0x7f1c0c15dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1bf8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8004060 0x7f1bf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004d50 0x7f1bf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0ccdf0 con 0x7f1bf8004060 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800bc20 con 0x7f1bf8004d50 2023-10-08T16:25:01.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf800bde0 con 0x7f1c0c0c7870 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8004060 0x7f1bf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c1139b700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1bf8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.143+0000 7f1c11b9c700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004d50 0x7f1bf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 -- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 msgr2=0x7f1bf8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c0c7870 0x7f1bf8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 -- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004d50 msgr2=0x7f1bf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:01.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004d50 0x7f1bf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 -- 172.21.15.12:0/1922303632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf8003570 con 0x7f1bf8004060 2023-10-08T16:25:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c11b9c700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004d50 0x7f1bf80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8004060 0x7f1bf8004810 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009c00 tx=0x7f1bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1205e8dc3c0c1ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:01.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00e710 con 0x7f1bf8004060 2023-10-08T16:25:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bfc00e870 con 0x7f1bf8004060 2023-10-08T16:25:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.144+0000 7f1c03fff700 1 -- 172.21.15.12:0/1922303632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc00ec30 con 0x7f1bf8004060 2023-10-08T16:25:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 -- 172.21.15.12:0/1922303632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8004060 msgr2=0x7f1bf8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:01.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 --2- 172.21.15.12:0/1922303632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1bf8004060 0x7f1bf8004810 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009c00 tx=0x7f1bfc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c11b9c700 1 -- 172.21.15.12:0/1922303632 reap_dead start 2023-10-08T16:25:01.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 -- 172.21.15.12:0/1922303632 shutdown_connections 2023-10-08T16:25:01.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 -- 172.21.15.12:0/1922303632 >> 172.21.15.12:0/1922303632 conn(0x7f1c0c0cd230 msgr2=0x7f1c0c0cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:01.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 -- 172.21.15.12:0/1922303632 shutdown_connections 2023-10-08T16:25:01.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.145+0000 7f1c1239d700 1 -- 172.21.15.12:0/1922303632 wait complete. 2023-10-08T16:25:01.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.146+0000 7f1c1239d700 1 Processor -- start 2023-10-08T16:25:01.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 -- start start 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004060 0x7f1c0c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c156ac0 0x7f1c0c13bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0b13a0 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c169ad0 con 0x7f1bf8004060 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.147+0000 7f1c1239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0c0b0820 con 0x7f1c0c156ac0 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34564/0 (socket says 172.21.15.12:34564) 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 -- 172.21.15.12:0/840038486 learned_addr learned my addr 172.21.15.12:0/840038486 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c1139b700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004060 0x7f1c0c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c10b9a700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c156ac0 0x7f1c0c13bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 -- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c156ac0 msgr2=0x7f1c0c13bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c156ac0 0x7f1c0c13bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 -- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004060 msgr2=0x7f1c0c0affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004060 0x7f1c0c0affd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 -- 172.21.15.12:0/840038486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c0c16aa60 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.148+0000 7f1c11b9c700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0b3230 tx=0x7f1c04009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.149+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04018070 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.149+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c04006ba0 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.149+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0c169ce0 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.149+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04012590 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.149+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c0c16a260 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.150+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c0c04c3c0 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.151+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c04003030 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.152+0000 7f1c017fa700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:01.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.152+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f1c04083b50 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.152+0000 7f1c1139b700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:01.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.152+0000 7f1c1139b700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1c08001370 tx=0x7f1c0c0c2f10 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:01.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.156+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c04050ef0 con 0x7f1c0c0b09c0 2023-10-08T16:25:01.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:01.358+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1c0c16aa60 con 0x7f1c0c0b09c0 2023-10-08T16:25:02.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.138+0000 7f1c017fa700 1 -- 172.21.15.12:0/840038486 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1c0c16aa60 con 0x7f1c0c0b09c0 2023-10-08T16:25:02.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.143+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 msgr2=0x7f1bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.143+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1c08001370 tx=0x7f1c0c0c2f10 comp rx=0 tx=0).stop 2023-10-08T16:25:02.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.143+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 msgr2=0x7f1c0c0b0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.143+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0b3230 tx=0x7f1c04009040 comp rx=0 tx=0).stop 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 shutdown_connections 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c0c0b09c0 0x7f1c0c0b0e60 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1bf8004060 0x7f1c0c0affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 --2- 172.21.15.12:0/840038486 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c0c156ac0 0x7f1c0c13bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.144+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 >> 172.21.15.12:0/840038486 conn(0x7f1c0c0cd230 msgr2=0x7f1c0c15daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:02.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.146+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 shutdown_connections 2023-10-08T16:25:02.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.146+0000 7f1c1239d700 1 -- 172.21.15.12:0/840038486 wait complete. 2023-10-08T16:25:02.149 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:25:02.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:25:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.366+0000 7f7b2f59d700 1 Processor -- start 2023-10-08T16:25:02.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.366+0000 7f7b2f59d700 1 -- start start 2023-10-08T16:25:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.367+0000 7f7b2f59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7b2813fb20 0x7f7b2815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.367+0000 7f7b2f59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2815ae70 con 0x7f7b2813fef0 2023-10-08T16:25:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.367+0000 7f7b2f59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b2806af60 con 0x7f7b2806aaa0 2023-10-08T16:25:02.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.367+0000 7f7b2f59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b2806b240 con 0x7f7b2813fb20 2023-10-08T16:25:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2dd9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7b2813fef0 0x7f7b280c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56204/0 (socket says 172.21.15.12:56204) 2023-10-08T16:25:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2dd9a700 1 -- 172.21.15.12:0/2416606642 learned_addr learned my addr 172.21.15.12:0/2416606642 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2e59b700 1 --2- 172.21.15.12:0/2416606642 >> v2:172.21.15.29:3300/0 conn(0x7f7b2813fb20 0x7f7b2815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:02.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937493921 0 0) 0x7f7b18001290 con 0x7f7b2813fef0 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b14003570 con 0x7f7b2813fef0 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081734390 0 0) 0x7f7b2806af60 con 0x7f7b2806aaa0 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b18001290 con 0x7f7b2806aaa0 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.368+0000 7f7b2e59b700 1 -- 172.21.15.12:0/2416606642 >> v1:172.21.15.29:6789/0 conn(0x7f7b2806aaa0 legacy=0x7f7b280c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2e59b700 1 -- 172.21.15.12:0/2416606642 >> v1:172.21.15.12:6789/0 conn(0x7f7b2813fef0 legacy=0x7f7b280c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2e59b700 1 -- 172.21.15.12:0/2416606642 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2806b520 con 0x7f7b2813fb20 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2e59b700 1 --2- 172.21.15.12:0/2416606642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fb20 0x7f7b2815a930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b240098e0 tx=0x7f7b240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d9ad32d68d7ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:02.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24011630 con 0x7f7b2813fb20 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24011790 con 0x7f7b2813fb20 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.369+0000 7f7b2d599700 1 -- 172.21.15.12:0/2416606642 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24011b30 con 0x7f7b2813fb20 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 -- 172.21.15.12:0/2416606642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fb20 msgr2=0x7f7b2815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/2416606642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fb20 0x7f7b2815a930 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b240098e0 tx=0x7f7b240091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 -- 172.21.15.12:0/2416606642 shutdown_connections 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/2416606642 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fb20 0x7f7b2815a930 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 -- 172.21.15.12:0/2416606642 >> 172.21.15.12:0/2416606642 conn(0x7f7b2806d170 msgr2=0x7f7b280cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 -- 172.21.15.12:0/2416606642 shutdown_connections 2023-10-08T16:25:02.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.370+0000 7f7b2f59d700 1 -- 172.21.15.12:0/2416606642 wait complete. 2023-10-08T16:25:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.371+0000 7f7b2f59d700 1 Processor -- start 2023-10-08T16:25:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.371+0000 7f7b2f59d700 1 -- start start 2023-10-08T16:25:02.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7b2813fb20 0x7f7b28155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fef0 0x7f7b280c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280b0e30 con 0x7f7b2806aaa0 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28136350 con 0x7f7b2813fef0 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2816a840 con 0x7f7b2813fb20 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.372+0000 7f7b2e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36336/0 (socket says 172.21.15.12:36336) 2023-10-08T16:25:02.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 -- 172.21.15.12:0/3231328437 learned_addr learned my addr 172.21.15.12:0/3231328437 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 -- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7b2813fb20 msgr2=0x7f7b28155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7b2813fb20 0x7f7b28155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 -- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fef0 msgr2=0x7f7b280c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fef0 0x7f7b280c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 -- 172.21.15.12:0/3231328437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b24009420 con 0x7f7b2806aaa0 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2e59b700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7b28071320 tx=0x7f7b24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2401f070 con 0x7f7b2806aaa0 2023-10-08T16:25:02.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280afc70 con 0x7f7b2806aaa0 2023-10-08T16:25:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b24011b10 con 0x7f7b2806aaa0 2023-10-08T16:25:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.373+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b24023660 con 0x7f7b2806aaa0 2023-10-08T16:25:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.374+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b280b0230 con 0x7f7b2806aaa0 2023-10-08T16:25:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.375+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2804c3c0 con 0x7f7b2806aaa0 2023-10-08T16:25:02.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.376+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b2402c3b0 con 0x7f7b2806aaa0 2023-10-08T16:25:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.376+0000 7f7b1e7fc700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.376+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f7b24085a30 con 0x7f7b2806aaa0 2023-10-08T16:25:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.377+0000 7f7b2dd9a700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:02.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.377+0000 7f7b2dd9a700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 0x7f7b0c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b180014f0 tx=0x7f7b180078a0 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:02.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.381+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b24052c60 con 0x7f7b2806aaa0 2023-10-08T16:25:02.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:02.584+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7b2806b800 con 0x7f7b2806aaa0 2023-10-08T16:25:03.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.148+0000 7f7b1e7fc700 1 -- 172.21.15.12:0/3231328437 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7b24056280 con 0x7f7b2806aaa0 2023-10-08T16:25:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.157+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 msgr2=0x7f7b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.157+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 0x7f7b0c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7b180014f0 tx=0x7f7b180078a0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.157+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 msgr2=0x7f7b2816a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.157+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f7b28071320 tx=0x7f7b24017000 comp rx=0 tx=0).stop 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.158+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 shutdown_connections 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.158+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b0c066f30 0x7f7b0c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.159+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7b2806aaa0 0x7f7b2816a300 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.159+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7b2813fef0 0x7f7b280c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.159+0000 7f7b2f59d700 1 --2- 172.21.15.12:0/3231328437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7b2813fb20 0x7f7b28155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.159+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 >> 172.21.15.12:0/3231328437 conn(0x7f7b2806d170 msgr2=0x7f7b2806ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:03.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.161+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 shutdown_connections 2023-10-08T16:25:03.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.161+0000 7f7b2f59d700 1 -- 172.21.15.12:0/3231328437 wait complete. 2023-10-08T16:25:03.166 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:25:03.186 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:25:03.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.378+0000 7fb747fff700 1 Processor -- start 2023-10-08T16:25:03.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.378+0000 7fb747fff700 1 -- start start 2023-10-08T16:25:03.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb747fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb74806b150 0x7fb7480ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:03.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb747fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480c8060 con 0x7fb74806ad00 2023-10-08T16:25:03.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb747fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480abaa0 con 0x7fb748156670 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb747fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb748156a40 con 0x7fb74806b150 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb7477fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb74806b150 0x7fb7480ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb7477fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb74806b150 0x7fb7480ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36344/0 (socket says 172.21.15.12:36344) 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb7477fe700 1 -- 172.21.15.12:0/3135601684 learned_addr learned my addr 172.21.15.12:0/3135601684 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.379+0000 7fb7467fc700 1 --1- 172.21.15.12:0/3135601684 >> v1:172.21.15.12:6789/0 conn(0x7fb74806ad00 0x7fb7480acbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56218/0 (socket says 172.21.15.12:56218) 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb7477fe700 1 -- 172.21.15.12:0/3135601684 >> v1:172.21.15.29:6789/0 conn(0x7fb748156670 legacy=0x7fb748067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb7477fe700 1 -- 172.21.15.12:0/3135601684 >> v1:172.21.15.12:6789/0 conn(0x7fb74806ad00 legacy=0x7fb7480acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb7477fe700 1 -- 172.21.15.12:0/3135601684 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480c7450 con 0x7fb74806b150 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb745ffb700 1 -- 172.21.15.12:0/3135601684 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239664749 0 0) 0x7fb7480c8060 con 0x7fb74806ad00 2023-10-08T16:25:03.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb7477fe700 1 --2- 172.21.15.12:0/3135601684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb74806b150 0x7fb7480ad2c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f20 tx=0x7fb740009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bacf08f4717080fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb745ffb700 1 -- 172.21.15.12:0/3135601684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74000e070 con 0x7fb74806b150 2023-10-08T16:25:03.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb745ffb700 1 -- 172.21.15.12:0/3135601684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74000bad0 con 0x7fb74806b150 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.380+0000 7fb745ffb700 1 -- 172.21.15.12:0/3135601684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7400092e0 con 0x7fb74806b150 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 -- 172.21.15.12:0/3135601684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb74806b150 msgr2=0x7fb7480ad2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 --2- 172.21.15.12:0/3135601684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb74806b150 0x7fb7480ad2c0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fb740009f20 tx=0x7fb740009840 comp rx=0 tx=0).stop 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 -- 172.21.15.12:0/3135601684 shutdown_connections 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 --2- 172.21.15.12:0/3135601684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb74806b150 0x7fb7480ad2c0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 -- 172.21.15.12:0/3135601684 >> 172.21.15.12:0/3135601684 conn(0x7fb7480c9600 msgr2=0x7fb7480cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 -- 172.21.15.12:0/3135601684 shutdown_connections 2023-10-08T16:25:03.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.381+0000 7fb747fff700 1 -- 172.21.15.12:0/3135601684 wait complete. 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.382+0000 7fb747fff700 1 Processor -- start 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.382+0000 7fb747fff700 1 -- start start 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb74806ad00 0x7fb74814f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb74806b150 0x7fb748153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb748154a80 con 0x7fb748156670 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7481547a0 con 0x7fb74806ad00 2023-10-08T16:25:03.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.383+0000 7fb747fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480bfa80 con 0x7fb74806b150 2023-10-08T16:25:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36346/0 (socket says 172.21.15.12:36346) 2023-10-08T16:25:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 -- 172.21.15.12:0/453814620 learned_addr learned my addr 172.21.15.12:0/453814620 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:03.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb746ffd700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb74806ad00 0x7fb74814f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7467fc700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb74806b150 0x7fb748153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 -- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb74806b150 msgr2=0x7fb748153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb74806b150 0x7fb748153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 -- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb74806ad00 msgr2=0x7fb74814f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb74806ad00 0x7fb74814f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 -- 172.21.15.12:0/453814620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009ae0 con 0x7fb748156670 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.384+0000 7fb7477fe700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb74806dd40 tx=0x7fb740017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.385+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb740012d00 con 0x7fb748156670 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.385+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb740012e80 con 0x7fb748156670 2023-10-08T16:25:03.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.385+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74001e680 con 0x7fb748156670 2023-10-08T16:25:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.385+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480bfd60 con 0x7fb748156670 2023-10-08T16:25:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.385+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7481550d0 con 0x7fb748156670 2023-10-08T16:25:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.386+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb748068d40 con 0x7fb748156670 2023-10-08T16:25:03.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.388+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb74001ea30 con 0x7fb748156670 2023-10-08T16:25:03.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.389+0000 7fb72effd700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 0x7fb7340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:03.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.389+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5997+0+0 (secure 0 0 0) 0x7fb740086dc0 con 0x7fb748156670 2023-10-08T16:25:03.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.389+0000 7fb746ffd700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 0x7fb7340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:03.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.390+0000 7fb746ffd700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 0x7fb7340693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb738009af0 tx=0x7fb738009060 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:03.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.393+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb740053ef0 con 0x7fb748156670 2023-10-08T16:25:03.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:03.640+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb7480c7730 con 0x7fb748156670 2023-10-08T16:25:04.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.179+0000 7fb72effd700 1 -- 172.21.15.12:0/453814620 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v38) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb740057510 con 0x7fb748156670 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 msgr2=0x7fb7340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 0x7fb7340693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb738009af0 tx=0x7fb738009060 comp rx=0 tx=0).stop 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 msgr2=0x7fb7480b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fb74806dd40 tx=0x7fb740017000 comp rx=0 tx=0).stop 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 shutdown_connections 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb734066f30 0x7fb7340693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb748156670 0x7fb7480b0050 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb74806ad00 0x7fb74814f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 --2- 172.21.15.12:0/453814620 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb74806b150 0x7fb748153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.187+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 >> 172.21.15.12:0/453814620 conn(0x7fb7480c9600 msgr2=0x7fb7480aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:04.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.189+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 shutdown_connections 2023-10-08T16:25:04.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.189+0000 7fb747fff700 1 -- 172.21.15.12:0/453814620 wait complete. 2023-10-08T16:25:04.192 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 10 and data pool 11 2023-10-08T16:25:04.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:04.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.401+0000 7ff897fff700 1 Processor -- start 2023-10-08T16:25:04.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.401+0000 7ff897fff700 1 -- start start 2023-10-08T16:25:04.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff897fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff898159aa0 0x7ff8980703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff897fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff897fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89806d3e0 con 0x7ff8981596d0 2023-10-08T16:25:04.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff897fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980cb170 con 0x7ff898159aa0 2023-10-08T16:25:04.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff897fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff89806c7d0 con 0x7ff8980ca7b0 2023-10-08T16:25:04.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.402+0000 7ff8967fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff898159aa0 0x7ff8980703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff898159aa0 0x7ff8980703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36358/0 (socket says 172.21.15.12:36358) 2023-10-08T16:25:04.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 -- 172.21.15.12:0/104284554 learned_addr learned my addr 172.21.15.12:0/104284554 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:04.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 -- 172.21.15.12:0/104284554 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 msgr2=0x7ff8980cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8977fe700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 -- 172.21.15.12:0/104284554 >> v1:172.21.15.29:6789/0 conn(0x7ff8981596d0 legacy=0x7ff89806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 -- 172.21.15.12:0/104284554 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89806cab0 con 0x7ff898159aa0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8977fe700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.403+0000 7ff8967fc700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff898159aa0 0x7ff8980703a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0099b0 tx=0x7ff88c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2260c2f573bc6061 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff895ffb700 1 -- 172.21.15.12:0/104284554 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00b860 con 0x7ff898159aa0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff895ffb700 1 -- 172.21.15.12:0/104284554 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00b9c0 con 0x7ff898159aa0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff895ffb700 1 -- 172.21.15.12:0/104284554 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00bd80 con 0x7ff898159aa0 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 -- 172.21.15.12:0/104284554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff898159aa0 msgr2=0x7ff8980703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff898159aa0 0x7ff8980703a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff88c0099b0 tx=0x7ff88c009250 comp rx=0 tx=0).stop 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 -- 172.21.15.12:0/104284554 shutdown_connections 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 --2- 172.21.15.12:0/104284554 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff898159aa0 0x7ff8980703a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 -- 172.21.15.12:0/104284554 >> 172.21.15.12:0/104284554 conn(0x7ff89806e720 msgr2=0x7ff89806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 -- 172.21.15.12:0/104284554 shutdown_connections 2023-10-08T16:25:04.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.404+0000 7ff897fff700 1 -- 172.21.15.12:0/104284554 wait complete. 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.406+0000 7ff897fff700 1 Processor -- start 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.406+0000 7ff897fff700 1 -- start start 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff898159aa0 0x7ff8980b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980b0690 con 0x7ff8981596d0 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980c4b30 con 0x7ff898159aa0 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff897fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980c4e10 con 0x7ff8980ca7b0 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36364/0 (socket says 172.21.15.12:36364) 2023-10-08T16:25:04.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 -- 172.21.15.12:0/3106680488 learned_addr learned my addr 172.21.15.12:0/3106680488 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff896ffd700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8977fe700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff898159aa0 0x7ff8980b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 -- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 msgr2=0x7ff8980c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 -- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff898159aa0 msgr2=0x7ff8980b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff898159aa0 0x7ff8980b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.407+0000 7ff8967fc700 1 -- 172.21.15.12:0/3106680488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0094f0 con 0x7ff8981596d0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff8967fc700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c01f070 con 0x7ff8981596d0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c011e90 con 0x7ff8981596d0 2023-10-08T16:25:04.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c01a670 con 0x7ff8981596d0 2023-10-08T16:25:04.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8980c50f0 con 0x7ff8981596d0 2023-10-08T16:25:04.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.408+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8980c56b0 con 0x7ff8981596d0 2023-10-08T16:25:04.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.409+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8980c58d0 con 0x7ff8981596d0 2023-10-08T16:25:04.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.410+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff88c01aa20 con 0x7ff8981596d0 2023-10-08T16:25:04.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.411+0000 7ff87effd700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.411+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff88c085d10 con 0x7ff8981596d0 2023-10-08T16:25:04.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.412+0000 7ff896ffd700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.412+0000 7ff896ffd700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff888003860 tx=0x7ff888009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.415+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff88c08b020 con 0x7ff8981596d0 2023-10-08T16:25:04.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.619+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff89804c3c0 con 0x7ff8981596d0 2023-10-08T16:25:04.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.620+0000 7ff87effd700 1 -- 172.21.15.12:0/3106680488 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16009 (secure 0 0 0) 0x7ff88c015090 con 0x7ff8981596d0 2023-10-08T16:25:04.621 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:04.621 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:03.641990+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.622+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 msgr2=0x7ff8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.622+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff888003860 tx=0x7ff888009040 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 msgr2=0x7ff8980b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006fd0 tx=0x7ff88c017000 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 shutdown_connections 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff898159aa0 0x7ff8980b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8980ca7b0 0x7ff8980c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 --2- 172.21.15.12:0/3106680488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8981596d0 0x7ff8980b0150 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 >> 172.21.15.12:0/3106680488 conn(0x7ff89806e720 msgr2=0x7ff89815b620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:04.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 shutdown_connections 2023-10-08T16:25:04.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.623+0000 7ff897fff700 1 -- 172.21.15.12:0/3106680488 wait complete. 2023-10-08T16:25:04.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:04.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.854+0000 7fa5c5f9d700 1 Processor -- start 2023-10-08T16:25:04.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.854+0000 7fa5c5f9d700 1 -- start start 2023-10-08T16:25:04.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c5f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa5c0142fd0 0x7fa5c00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c5f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c00ca480 con 0x7fa5c00c7dc0 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c5f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5c015e240 con 0x7fa5c0142c00 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c5f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5c006b350 con 0x7fa5c0142fd0 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c579c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa5c00c7dc0 0x7fa5c006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56228/0 (socket says 172.21.15.12:56228) 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5c579c700 1 -- 172.21.15.12:0/2351455214 learned_addr learned my addr 172.21.15.12:0/2351455214 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:04.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5bffff700 1 --2- 172.21.15.12:0/2351455214 >> v2:172.21.15.29:3300/0 conn(0x7fa5c0142fd0 0x7fa5c00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5bf7fe700 1 -- 172.21.15.12:0/2351455214 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2613692003 0 0) 0x7fa5c00ca480 con 0x7fa5c00c7dc0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.856+0000 7fa5bf7fe700 1 -- 172.21.15.12:0/2351455214 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b0003570 con 0x7fa5c00c7dc0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bffff700 1 -- 172.21.15.12:0/2351455214 >> v1:172.21.15.29:6789/0 conn(0x7fa5c0142c00 legacy=0x7fa5c006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bffff700 1 -- 172.21.15.12:0/2351455214 >> v1:172.21.15.12:6789/0 conn(0x7fa5c00c7dc0 legacy=0x7fa5c006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bffff700 1 -- 172.21.15.12:0/2351455214 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5c00c81d0 con 0x7fa5c0142fd0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bffff700 1 --2- 172.21.15.12:0/2351455214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c0142fd0 0x7fa5c00c7880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098e0 tx=0x7fa5ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b94f3ae01c0ab1ab server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bf7fe700 1 -- 172.21.15.12:0/2351455214 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00b640 con 0x7fa5c0142fd0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bf7fe700 1 -- 172.21.15.12:0/2351455214 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00b7a0 con 0x7fa5c0142fd0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.857+0000 7fa5bf7fe700 1 -- 172.21.15.12:0/2351455214 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00bb20 con 0x7fa5c0142fd0 2023-10-08T16:25:04.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/2351455214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c0142fd0 msgr2=0x7fa5c00c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/2351455214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c0142fd0 0x7fa5c00c7880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098e0 tx=0x7fa5ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/2351455214 shutdown_connections 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/2351455214 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c0142fd0 0x7fa5c00c7880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/2351455214 >> 172.21.15.12:0/2351455214 conn(0x7fa5c00675a0 msgr2=0x7fa5c00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/2351455214 shutdown_connections 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.858+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/2351455214 wait complete. 2023-10-08T16:25:04.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.859+0000 7fa5c5f9d700 1 Processor -- start 2023-10-08T16:25:04.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 -- start start 2023-10-08T16:25:04.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c00c7dc0 0x7fa5c00b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5c0142c00 0x7fa5c00c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00b26d0 con 0x7fa5c0142fd0 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c6080 con 0x7fa5c00c7dc0 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.860+0000 7fa5c5f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5c00c51f0 con 0x7fa5c0142c00 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36372/0 (socket says 172.21.15.12:36372) 2023-10-08T16:25:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 -- 172.21.15.12:0/49792205 learned_addr learned my addr 172.21.15.12:0/49792205 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c4f9b700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c00c7dc0 0x7fa5c00b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5bffff700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5c0142c00 0x7fa5c00c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 -- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5c0142c00 msgr2=0x7fa5c00c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5c0142c00 0x7fa5c00c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 -- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c00c7dc0 msgr2=0x7fa5c00b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c00c7dc0 0x7fa5c00b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 -- 172.21.15.12:0/49792205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009420 con 0x7fa5c0142fd0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.861+0000 7fa5c579c700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8001460 tx=0x7fa5b8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.862+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800ce80 con 0x7fa5c0142fd0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.862+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b800ab70 con 0x7fa5c0142fd0 2023-10-08T16:25:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.862+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b80070f0 con 0x7fa5c0142fd0 2023-10-08T16:25:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.862+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5c00c5470 con 0x7fa5c0142fd0 2023-10-08T16:25:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.862+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c00c5a30 con 0x7fa5c0142fd0 2023-10-08T16:25:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.863+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5c004c3c0 con 0x7fa5c0142fd0 2023-10-08T16:25:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.864+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5b8007520 con 0x7fa5c0142fd0 2023-10-08T16:25:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.865+0000 7fa5bcff9700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.865+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa5b8084c80 con 0x7fa5c0142fd0 2023-10-08T16:25:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.865+0000 7fa5c4f9b700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.866+0000 7fa5c4f9b700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4003880 tx=0x7fa5b4009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:04.869+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5b8051cb0 con 0x7fa5c0142fd0 2023-10-08T16:25:05.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.070+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5c015dff0 con 0x7fa5c0142fd0 2023-10-08T16:25:05.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.071+0000 7fa5bcff9700 1 -- 172.21.15.12:0/49792205 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16009 (secure 0 0 0) 0x7fa5b80552d0 con 0x7fa5c0142fd0 2023-10-08T16:25:05.072 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:05.072 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:03.641990+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:05.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 msgr2=0x7fa5a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4003880 tx=0x7fa5b4009040 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 msgr2=0x7fa5c0131a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8001460 tx=0x7fa5b8001ae0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 shutdown_connections 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa5a4066f30 0x7fa5a40693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5c0142fd0 0x7fa5c0131a80 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa5c00c7dc0 0x7fa5c00b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 --2- 172.21.15.12:0/49792205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5c0142c00 0x7fa5c00c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.073+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 >> 172.21.15.12:0/49792205 conn(0x7fa5c00675a0 msgr2=0x7fa5c013f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.074+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 shutdown_connections 2023-10-08T16:25:05.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.074+0000 7fa5c5f9d700 1 -- 172.21.15.12:0/49792205 wait complete. 2023-10-08T16:25:05.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:25:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.284+0000 7f187139d700 1 Processor -- start 2023-10-08T16:25:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.284+0000 7f187139d700 1 -- start start 2023-10-08T16:25:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.285+0000 7f187139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 0x7f186c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.285+0000 7f187139d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f186c0cea00 0x7f186c0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.285+0000 7f187139d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c15ac50 con 0x7f186c153a00 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.285+0000 7f187139d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c15d010 con 0x7f186c0cea00 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.285+0000 7f187139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c15af60 con 0x7f186c153dd0 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f186c0cea00 0x7f186c0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f186c0cea00 0x7f186c0cee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36380/0 (socket says 172.21.15.12:36380) 2023-10-08T16:25:05.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 -- 172.21.15.12:0/1022758874 learned_addr learned my addr 172.21.15.12:0/1022758874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f186b7fe700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 0x7f186c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 -- 172.21.15.12:0/1022758874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 msgr2=0x7f186c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 0x7f186c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 -- 172.21.15.12:0/1022758874 >> v1:172.21.15.29:6789/0 conn(0x7f186c153a00 legacy=0x7f186c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f1870b9c700 1 -- 172.21.15.12:0/1022758874 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c15b240 con 0x7f186c0cea00 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.286+0000 7f186b7fe700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 0x7f186c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f1870b9c700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c0cea00 0x7f186c0cee60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1864009f50 tx=0x7f1864009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef92ec79ef7e9125 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f186affd700 1 -- 172.21.15.12:0/1022758874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186400e070 con 0x7f186c0cea00 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f186affd700 1 -- 172.21.15.12:0/1022758874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186400ba70 con 0x7f186c0cea00 2023-10-08T16:25:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f186affd700 1 -- 172.21.15.12:0/1022758874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640092e0 con 0x7f186c0cea00 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 -- 172.21.15.12:0/1022758874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c0cea00 msgr2=0x7f186c0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c0cea00 0x7f186c0cee60 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f1864009f50 tx=0x7f1864009840 comp rx=0 tx=0).stop 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 -- 172.21.15.12:0/1022758874 shutdown_connections 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c0cea00 0x7f186c0cee60 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 --2- 172.21.15.12:0/1022758874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153dd0 0x7f186c15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.287+0000 7f187139d700 1 -- 172.21.15.12:0/1022758874 >> 172.21.15.12:0/1022758874 conn(0x7f186c0703a0 msgr2=0x7f186c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.288+0000 7f187139d700 1 -- 172.21.15.12:0/1022758874 shutdown_connections 2023-10-08T16:25:05.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.288+0000 7f187139d700 1 -- 172.21.15.12:0/1022758874 wait complete. 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.289+0000 7f187139d700 1 Processor -- start 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.289+0000 7f187139d700 1 -- start start 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 0x7f186c13f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153a00 0x7f186c159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c157f30 con 0x7f186c153dd0 2023-10-08T16:25:05.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c158d80 con 0x7f186c0cea00 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f187139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c158170 con 0x7f186c153a00 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f1870b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f1870b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36394/0 (socket says 172.21.15.12:36394) 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f1870b9c700 1 -- 172.21.15.12:0/2159055897 learned_addr learned my addr 172.21.15.12:0/2159055897 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f186b7fe700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153a00 0x7f186c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.290+0000 7f186bfff700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 0x7f186c13f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 -- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153a00 msgr2=0x7f186c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153a00 0x7f186c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 -- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 msgr2=0x7f186c13f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 0x7f186c13f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 -- 172.21.15.12:0/2159055897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864009ae0 con 0x7f186c153dd0 2023-10-08T16:25:05.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f186bfff700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 0x7f186c13f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1870b9c700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f186c06eb00 tx=0x7f1864018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640094e0 con 0x7f186c153dd0 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864008d90 con 0x7f186c153dd0 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864026690 con 0x7f186c153dd0 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c158450 con 0x7f186c153dd0 2023-10-08T16:25:05.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.291+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c158a10 con 0x7f186c153dd0 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.292+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c159750 con 0x7f186c153dd0 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.293+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1864003040 con 0x7f186c153dd0 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.294+0000 7f1853fff700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.294+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f18640867f0 con 0x7f186c153dd0 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.294+0000 7f186bfff700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:05.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.295+0000 7f186bfff700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:05.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.298+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1864053830 con 0x7f186c153dd0 2023-10-08T16:25:05.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:05.547+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f186c04c3c0 con 0x7f186c153dd0 2023-10-08T16:25:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.190+0000 7f1853fff700 1 -- 172.21.15.12:0/2159055897 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1864056e50 con 0x7f186c153dd0 2023-10-08T16:25:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 msgr2=0x7f18580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 0x7f18580693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c009040 comp rx=0 tx=0).stop 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 msgr2=0x7f186c0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f186c06eb00 tx=0x7f1864018000 comp rx=0 tx=0).stop 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 shutdown_connections 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1858066f30 0x7f18580693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f186c153dd0 0x7f186c0d0510 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f186c0cea00 0x7f186c13f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 --2- 172.21.15.12:0/2159055897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f186c153a00 0x7f186c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 >> 172.21.15.12:0/2159055897 conn(0x7f186c0703a0 msgr2=0x7f186c0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 shutdown_connections 2023-10-08T16:25:06.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.193+0000 7f187139d700 1 -- 172.21.15.12:0/2159055897 wait complete. 2023-10-08T16:25:06.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:25:06.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.407+0000 7f6da3fff700 1 Processor -- start 2023-10-08T16:25:06.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.408+0000 7f6da3fff700 1 -- start start 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6da40c7fb0 0x7f6da406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da406b290 con 0x7f6da413f780 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da406b570 con 0x7f6da40c7be0 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da406bf10 con 0x7f6da40c7fb0 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da27fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6da40c7fb0 0x7f6da406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da27fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6da40c7fb0 0x7f6da406abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36404/0 (socket says 172.21.15.12:36404) 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.409+0000 7f6da27fc700 1 -- 172.21.15.12:0/2366738722 learned_addr learned my addr 172.21.15.12:0/2366738722 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da27fc700 1 -- 172.21.15.12:0/2366738722 >> v1:172.21.15.29:6789/0 conn(0x7f6da40c7be0 legacy=0x7f6da415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da27fc700 1 -- 172.21.15.12:0/2366738722 >> v1:172.21.15.12:6789/0 conn(0x7f6da413f780 legacy=0x7f6da413fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da27fc700 1 -- 172.21.15.12:0/2366738722 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da406b850 con 0x7f6da40c7fb0 2023-10-08T16:25:06.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da27fc700 1 --2- 172.21.15.12:0/2366738722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da406abd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800bc50 tx=0x7f6d9800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f2459c47a7ee59 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:06.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da1ffb700 1 -- 172.21.15.12:0/2366738722 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800be60 con 0x7f6da40c7fb0 2023-10-08T16:25:06.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da1ffb700 1 -- 172.21.15.12:0/2366738722 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9800de00 con 0x7f6da40c7fb0 2023-10-08T16:25:06.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.410+0000 7f6da1ffb700 1 -- 172.21.15.12:0/2366738722 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980196b0 con 0x7f6da40c7fb0 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 -- 172.21.15.12:0/2366738722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 msgr2=0x7f6da406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 --2- 172.21.15.12:0/2366738722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da406abd0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800bc50 tx=0x7f6d9800b4f0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 -- 172.21.15.12:0/2366738722 shutdown_connections 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 --2- 172.21.15.12:0/2366738722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da406abd0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 -- 172.21.15.12:0/2366738722 >> 172.21.15.12:0/2366738722 conn(0x7f6da406d110 msgr2=0x7f6da40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 -- 172.21.15.12:0/2366738722 shutdown_connections 2023-10-08T16:25:06.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.411+0000 7f6da3fff700 1 -- 172.21.15.12:0/2366738722 wait complete. 2023-10-08T16:25:06.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.412+0000 7f6da3fff700 1 Processor -- start 2023-10-08T16:25:06.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.412+0000 7f6da3fff700 1 -- start start 2023-10-08T16:25:06.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6da40c7be0 0x7f6da413e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 0x7f6da40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40acf30 con 0x7f6da40c7fb0 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40ac320 con 0x7f6da413f780 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.413+0000 7f6da3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40ac600 con 0x7f6da40c7be0 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36414/0 (socket says 172.21.15.12:36414) 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 -- 172.21.15.12:0/4009303250 learned_addr learned my addr 172.21.15.12:0/4009303250 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da37fe700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 0x7f6da40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da2ffd700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6da40c7be0 0x7f6da413e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 -- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6da40c7be0 msgr2=0x7f6da413e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6da40c7be0 0x7f6da413e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 -- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 msgr2=0x7f6da40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 0x7f6da40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 -- 172.21.15.12:0/4009303250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9800b790 con 0x7f6da40c7fb0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da37fe700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 0x7f6da40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.414+0000 7f6da27fc700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6da40693f0 tx=0x7f6d9801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.415+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d980108d0 con 0x7f6da40c7fb0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.415+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98010a30 con 0x7f6da40c7fb0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.415+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da40ac8e0 con 0x7f6da40c7fb0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.415+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98010df0 con 0x7f6da40c7fb0 2023-10-08T16:25:06.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.415+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da413e7e0 con 0x7f6da40c7fb0 2023-10-08T16:25:06.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.416+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40c3d70 con 0x7f6da40c7fb0 2023-10-08T16:25:06.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.417+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d9802c430 con 0x7f6da40c7fb0 2023-10-08T16:25:06.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.418+0000 7f6d8affd700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 0x7f6d900693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:06.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.418+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6d98014070 con 0x7f6da40c7fb0 2023-10-08T16:25:06.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.418+0000 7f6da2ffd700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 0x7f6d900693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:06.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.418+0000 7f6da2ffd700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 0x7f6d900693b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d94003860 tx=0x7f6d94009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:06.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.422+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6da40c3d70 con 0x7f6da40c7fb0 2023-10-08T16:25:06.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:06.669+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6da40c3d70 con 0x7f6da40c7fb0 2023-10-08T16:25:07.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.191+0000 7f6d8affd700 1 -- 172.21.15.12:0/4009303250 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6da40c3d70 con 0x7f6da40c7fb0 2023-10-08T16:25:07.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 msgr2=0x7f6d900693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 0x7f6d900693b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6d94003860 tx=0x7f6d94009040 comp rx=0 tx=0).stop 2023-10-08T16:25:07.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 msgr2=0x7f6da40ab940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6da40693f0 tx=0x7f6d9801b000 comp rx=0 tx=0).stop 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 shutdown_connections 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d90066f00 0x7f6d900693b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6da413f780 0x7f6da40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6da40c7be0 0x7f6da413e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 --2- 172.21.15.12:0/4009303250 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6da40c7fb0 0x7f6da40ab940 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.193+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 >> 172.21.15.12:0/4009303250 conn(0x7f6da406d110 msgr2=0x7f6da40c1520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.194+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 shutdown_connections 2023-10-08T16:25:07.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.194+0000 7f6da3fff700 1 -- 172.21.15.12:0/4009303250 wait complete. 2023-10-08T16:25:07.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:07.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.399+0000 7f8b00d9d700 1 Processor -- start 2023-10-08T16:25:07.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.399+0000 7f8b00d9d700 1 -- start start 2023-10-08T16:25:07.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.400+0000 7f8b00d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8afc13fb20 0x7f8afc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.400+0000 7f8b00d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 0x7f8afc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.400+0000 7f8b00d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc15ae70 con 0x7f8afc13fef0 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.400+0000 7f8b00d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc06af60 con 0x7f8afc13fb20 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.400+0000 7f8b00d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc06b240 con 0x7f8afc06aaa0 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8afc13fb20 0x7f8afc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 0x7f8afc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8afc13fb20 0x7f8afc15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36622/0 (socket says 172.21.15.12:36622) 2023-10-08T16:25:07.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 -- 172.21.15.12:0/2784919283 learned_addr learned my addr 172.21.15.12:0/2784919283 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 -- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 msgr2=0x7f8afc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 0x7f8afc0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 -- 172.21.15.12:0/2784919283 >> v1:172.21.15.29:6789/0 conn(0x7f8afc13fef0 legacy=0x7f8afc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afb7fe700 1 -- 172.21.15.12:0/2784919283 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc06b520 con 0x7f8afc13fb20 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.401+0000 7f8afbfff700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 0x7f8afc0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8afb7fe700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc13fb20 0x7f8afc15a930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00bc50 tx=0x7f8aec00b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ce9e7c9cd5ecbf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8afa7fc700 1 -- 172.21.15.12:0/2784919283 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00dbf0 con 0x7f8afc13fb20 2023-10-08T16:25:07.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8afa7fc700 1 -- 172.21.15.12:0/2784919283 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec00dd50 con 0x7f8afc13fb20 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8afa7fc700 1 -- 172.21.15.12:0/2784919283 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0196b0 con 0x7f8afc13fb20 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 -- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc13fb20 msgr2=0x7f8afc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc13fb20 0x7f8afc15a930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00bc50 tx=0x7f8aec00b4f0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 -- 172.21.15.12:0/2784919283 shutdown_connections 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc06aaa0 0x7f8afc0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/2784919283 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc13fb20 0x7f8afc15a930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.402+0000 7f8b00d9d700 1 -- 172.21.15.12:0/2784919283 >> 172.21.15.12:0/2784919283 conn(0x7f8afc06d170 msgr2=0x7f8afc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.403+0000 7f8b00d9d700 1 -- 172.21.15.12:0/2784919283 shutdown_connections 2023-10-08T16:25:07.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.403+0000 7f8b00d9d700 1 -- 172.21.15.12:0/2784919283 wait complete. 2023-10-08T16:25:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.404+0000 7f8b00d9d700 1 Processor -- start 2023-10-08T16:25:07.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.404+0000 7f8b00d9d700 1 -- start start 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc06aaa0 0x7f8afc0ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 0x7f8afc13c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0ad1f0 con 0x7f8afc13fb20 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0ac5e0 con 0x7f8afc06aaa0 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8b00d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0ac8c0 con 0x7f8afc13fef0 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8afaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8afaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36424/0 (socket says 172.21.15.12:36424) 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.405+0000 7f8afaffd700 1 -- 172.21.15.12:0/1828711079 learned_addr learned my addr 172.21.15.12:0/1828711079 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:07.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afb7fe700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc06aaa0 0x7f8afc0ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afbfff700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 0x7f8afc13c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 -- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 msgr2=0x7f8afc13c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 0x7f8afc13c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 -- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc06aaa0 msgr2=0x7f8afc0ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc06aaa0 0x7f8afc0ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 -- 172.21.15.12:0/1828711079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af4009a20 con 0x7f8afc13fb20 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afbfff700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 0x7f8afc13c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8afaffd700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c590 tx=0x7f8af0007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0011590 con 0x7f8afc13fb20 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af0011730 con 0x7f8afc13fb20 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0011af0 con 0x7f8afc13fb20 2023-10-08T16:25:07.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.406+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec00b790 con 0x7f8afc13fb20 2023-10-08T16:25:07.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.407+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc0ace80 con 0x7f8afc13fb20 2023-10-08T16:25:07.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.407+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc04c3c0 con 0x7f8afc13fb20 2023-10-08T16:25:07.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.408+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8af0012420 con 0x7f8afc13fb20 2023-10-08T16:25:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.409+0000 7f8ae37fe700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.409+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8af0083920 con 0x7f8afc13fb20 2023-10-08T16:25:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.410+0000 7f8afb7fe700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:07.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.410+0000 7f8afb7fe700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 0x7f8ae80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00bc50 tx=0x7f8aec01b000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:07.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.414+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8af004b5a0 con 0x7f8afc13fb20 2023-10-08T16:25:07.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.661+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8afc15ae70 con 0x7f8afc13fb20 2023-10-08T16:25:07.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.661+0000 7f8ae37fe700 1 -- 172.21.15.12:0/1828711079 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f8afc15ae70 con 0x7f8afc13fb20 2023-10-08T16:25:07.807 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:07.807 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:07.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 msgr2=0x7f8ae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 0x7f8ae80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00bc50 tx=0x7f8aec01b000 comp rx=0 tx=0).stop 2023-10-08T16:25:07.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 msgr2=0x7f8afc158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:07.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f8af000c590 tx=0x7f8af0007f10 comp rx=0 tx=0).stop 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 shutdown_connections 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ae8066f30 0x7f8ae80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8afc13fef0 0x7f8afc13c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8afc06aaa0 0x7f8afc0ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 --2- 172.21.15.12:0/1828711079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8afc13fb20 0x7f8afc158e90 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.663+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 >> 172.21.15.12:0/1828711079 conn(0x7f8afc06d170 msgr2=0x7f8afc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.664+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 shutdown_connections 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.664+0000 7f8b00d9d700 1 -- 172.21.15.12:0/1828711079 wait complete. 2023-10-08T16:25:07.809 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:07.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.996+0000 7f925ffff700 1 Processor -- start 2023-10-08T16:25:07.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.996+0000 7f925ffff700 1 -- start start 2023-10-08T16:25:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.997+0000 7f925ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.997+0000 7f925ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f926015de50 0x7f92600cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:07.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.997+0000 7f925ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926015afd0 con 0x7f92600cef40 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.997+0000 7f925ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926015b2b0 con 0x7f926015de50 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.997+0000 7f925ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926015b590 con 0x7f9260153c30 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f926015de50 0x7f92600cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36352/0 (socket says 172.21.15.12:36352) 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f92600cef40 0x7f926006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:60412/0 (socket says 172.21.15.12:60412) 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925effd700 1 -- 172.21.15.12:0/4234415247 learned_addr learned my addr 172.21.15.12:0/4234415247 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f926015de50 0x7f92600cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36642/0 (socket says 172.21.15.12:36642) 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 -- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 msgr2=0x7f926015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 -- 172.21.15.12:0/4234415247 >> v1:172.21.15.29:6789/0 conn(0x7f92600cef40 legacy=0x7f926006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925e7fc700 1 -- 172.21.15.12:0/4234415247 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926015b870 con 0x7f926015de50 2023-10-08T16:25:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.998+0000 7f925effd700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925e7fc700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926015de50 0x7f92600cea00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f92540098e0 tx=0x7f92540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34ea6e8dc25758a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925dffb700 1 -- 172.21.15.12:0/4234415247 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400b640 con 0x7f926015de50 2023-10-08T16:25:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925dffb700 1 -- 172.21.15.12:0/4234415247 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925400b7a0 con 0x7f926015de50 2023-10-08T16:25:08.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925dffb700 1 -- 172.21.15.12:0/4234415247 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400bb40 con 0x7f926015de50 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 -- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926015de50 msgr2=0x7f92600cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926015de50 0x7f92600cea00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f92540098e0 tx=0x7f92540091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 -- 172.21.15.12:0/4234415247 shutdown_connections 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9260153c30 0x7f926015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 --2- 172.21.15.12:0/4234415247 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f926015de50 0x7f92600cea00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 -- 172.21.15.12:0/4234415247 >> 172.21.15.12:0/4234415247 conn(0x7f92600703a0 msgr2=0x7f92600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:07.999+0000 7f925ffff700 1 -- 172.21.15.12:0/4234415247 shutdown_connections 2023-10-08T16:25:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.000+0000 7f925ffff700 1 -- 172.21.15.12:0/4234415247 wait complete. 2023-10-08T16:25:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.001+0000 7f925ffff700 1 Processor -- start 2023-10-08T16:25:08.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.001+0000 7f925ffff700 1 -- start start 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9260153c30 0x7f92600b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926015de50 0x7f92600b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b41f0 con 0x7f92600cef40 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b35e0 con 0x7f9260153c30 2023-10-08T16:25:08.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b38c0 con 0x7f926015de50 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36434/0 (socket says 172.21.15.12:36434) 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925effd700 1 -- 172.21.15.12:0/1466551754 learned_addr learned my addr 172.21.15.12:0/1466551754 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925e7fc700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9260153c30 0x7f92600b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.002+0000 7f925f7fe700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926015de50 0x7f92600b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 -- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926015de50 msgr2=0x7f92600b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926015de50 0x7f92600b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 -- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9260153c30 msgr2=0x7f92600b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9260153c30 0x7f92600b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 -- 172.21.15.12:0/1466551754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500094f0 con 0x7f92600cef40 2023-10-08T16:25:08.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925effd700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f925000ec50 tx=0x7f9250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000c850 con 0x7f92600cef40 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000c9b0 con 0x7f92600cef40 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000cd50 con 0x7f92600cef40 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9254009420 con 0x7f92600cef40 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.003+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92600b3e80 con 0x7f92600cef40 2023-10-08T16:25:08.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.004+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92600b3330 con 0x7f92600cef40 2023-10-08T16:25:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.005+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9250013680 con 0x7f92600cef40 2023-10-08T16:25:08.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.006+0000 7f9246ffd700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 0x7f924c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.006+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f92500847e0 con 0x7f92600cef40 2023-10-08T16:25:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.007+0000 7f925e7fc700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 0x7f924c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.007+0000 7f925e7fc700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 0x7f924c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92540093f0 tx=0x7f9254017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.010+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9250051820 con 0x7f92600cef40 2023-10-08T16:25:08.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.214+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926004c3c0 con 0x7f92600cef40 2023-10-08T16:25:08.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.215+0000 7f9246ffd700 1 -- 172.21.15.12:0/1466551754 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+15996 (secure 0 0 0) 0x7f9250054e40 con 0x7f92600cef40 2023-10-08T16:25:08.217 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:08.218 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":99,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:05.160048+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:08.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 msgr2=0x7f924c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 0x7f924c0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f92540093f0 tx=0x7f9254017000 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 msgr2=0x7f9260143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f925000ec50 tx=0x7f9250009250 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 shutdown_connections 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f924c066f30 0x7f924c0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92600cef40 0x7f9260143d60 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926015de50 0x7f92600b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 --2- 172.21.15.12:0/1466551754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9260153c30 0x7f92600b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 >> 172.21.15.12:0/1466551754 conn(0x7f92600703a0 msgr2=0x7f92600c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 shutdown_connections 2023-10-08T16:25:08.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.217+0000 7f925ffff700 1 -- 172.21.15.12:0/1466551754 wait complete. 2023-10-08T16:25:08.236 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:25:08.236 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:08.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.421+0000 7f355b39d700 1 Processor -- start 2023-10-08T16:25:08.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.421+0000 7f355b39d700 1 -- start start 2023-10-08T16:25:08.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.422+0000 7f355b39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3554140a70 0x7f35540c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.422+0000 7f355b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f35540aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355b39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35540c6d50 con 0x7f3554140e40 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355b39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35540c7030 con 0x7f3554140a70 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35540c7310 con 0x7f355406de50 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355a39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3554140a70 0x7f35540c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f3559b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3554140e40 0x7f35540c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56250/0 (socket says 172.21.15.12:56250) 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f3559b9a700 1 -- 172.21.15.12:0/3041375998 learned_addr learned my addr 172.21.15.12:0/3041375998 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355ab9c700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f35540aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f3559399700 1 -- 172.21.15.12:0/3041375998 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545222790 0 0) 0x7f35540c6d50 con 0x7f3554140e40 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f3559399700 1 -- 172.21.15.12:0/3041375998 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003570 con 0x7f3554140e40 2023-10-08T16:25:08.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355a39b700 1 -- 172.21.15.12:0/3041375998 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 msgr2=0x7f35540aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355a39b700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f35540aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355a39b700 1 -- 172.21.15.12:0/3041375998 >> v1:172.21.15.12:6789/0 conn(0x7f3554140e40 legacy=0x7f35540c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355a39b700 1 -- 172.21.15.12:0/3041375998 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540c75f0 con 0x7f3554140a70 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.423+0000 7f355ab9c700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f35540aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f355a39b700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140a70 0x7f35540c6770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df83c9098bfbb0a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f3559399700 1 -- 172.21.15.12:0/3041375998 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000b640 con 0x7f3554140a70 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f3559399700 1 -- 172.21.15.12:0/3041375998 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355000b7a0 con 0x7f3554140a70 2023-10-08T16:25:08.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f3559399700 1 -- 172.21.15.12:0/3041375998 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000bb40 con 0x7f3554140a70 2023-10-08T16:25:08.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f355b39d700 1 -- 172.21.15.12:0/3041375998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140a70 msgr2=0x7f35540c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f355b39d700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140a70 0x7f35540c6770 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f35500098e0 tx=0x7f35500091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.424+0000 7f355b39d700 1 -- 172.21.15.12:0/3041375998 shutdown_connections 2023-10-08T16:25:08.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.425+0000 7f355b39d700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f35540aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.425+0000 7f355b39d700 1 --2- 172.21.15.12:0/3041375998 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140a70 0x7f35540c6770 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.425+0000 7f355b39d700 1 -- 172.21.15.12:0/3041375998 >> 172.21.15.12:0/3041375998 conn(0x7f355406d170 msgr2=0x7f35540cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.425+0000 7f355b39d700 1 -- 172.21.15.12:0/3041375998 shutdown_connections 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.425+0000 7f355b39d700 1 -- 172.21.15.12:0/3041375998 wait complete. 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.426+0000 7f355b39d700 1 Processor -- start 2023-10-08T16:25:08.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.426+0000 7f355b39d700 1 -- start start 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f355416d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 0x7f355416dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355415a320 con 0x7f3554140e40 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355415a7b0 con 0x7f3554140a70 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.427+0000 7f355b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3554159710 con 0x7f355406de50 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36448/0 (socket says 172.21.15.12:36448) 2023-10-08T16:25:08.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 -- 172.21.15.12:0/706473829 learned_addr learned my addr 172.21.15.12:0/706473829 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355a39b700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f355416d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f3559b9a700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 0x7f355416dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 -- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 msgr2=0x7f355416d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f355416d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 -- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 msgr2=0x7f355416dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 0x7f355416dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 -- 172.21.15.12:0/706473829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550009420 con 0x7f3554140e40 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355a39b700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f355416d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f3559b9a700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 0x7f355416dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f355ab9c700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d180 tx=0x7f354c009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.428+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c00de20 con 0x7f3554140e40 2023-10-08T16:25:08.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.429+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354c00f040 con 0x7f3554140e40 2023-10-08T16:25:08.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.429+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354c015690 con 0x7f3554140e40 2023-10-08T16:25:08.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.429+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35541599f0 con 0x7f3554140e40 2023-10-08T16:25:08.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.429+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3554159fb0 con 0x7f3554140e40 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.430+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35540648e0 con 0x7f3554140e40 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.431+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f354c01e3b0 con 0x7f3554140e40 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.431+0000 7f354a7fc700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.431+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f354c084cd0 con 0x7f3554140e40 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.432+0000 7f355a39b700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.432+0000 7f355a39b700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35500093f0 tx=0x7f3550017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.435+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35540648e0 con 0x7f3554140e40 2023-10-08T16:25:08.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.631+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f35540648e0 con 0x7f3538066f30 2023-10-08T16:25:08.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.642+0000 7f354a7fc700 1 -- 172.21.15.12:0/706473829 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286540 (secure 0 0 0) 0x7f35540648e0 con 0x7f3538066f30 2023-10-08T16:25:08.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:08.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 msgr2=0x7f35380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35500093f0 tx=0x7f3550017000 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 msgr2=0x7f355416a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f354c00d180 tx=0x7f354c009a50 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 shutdown_connections 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3554140e40 0x7f355416a3a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f355406de50 0x7f355416d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 --2- 172.21.15.12:0/706473829 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3554140a70 0x7f355416dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 >> 172.21.15.12:0/706473829 conn(0x7f355406d170 msgr2=0x7f3554069ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:08.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 shutdown_connections 2023-10-08T16:25:08.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.646+0000 7f355b39d700 1 -- 172.21.15.12:0/706473829 wait complete. 2023-10-08T16:25:08.650 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:08.665 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:25:07.633348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":305,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438028,"kb_used_data":10572,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752536692,"statfs":{"total":773094113280,"available":770597572608,"internally_reserved":0,"allocated":10825728,"data_stored":5819627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.495220"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187439+0000","last_change":"2023-10-08T16:25:04.184423+0000","last_active":"2023-10-08T16:25:04.187439+0000","last_peered":"2023-10-08T16:25:04.187439+0000","last_clean":"2023-10-08T16:25:04.187439+0000","last_became_active":"2023-10-08T16:25:04.184164+0000","last_became_peered":"2023-10-08T16:25:04.184164+0000","last_unstale":"2023-10-08T16:25:04.187439+0000","last_undegraded":"2023-10-08T16:25:04.187439+0000","last_fullsized":"2023-10-08T16:25:04.187439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:41.179128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197698+0000","last_change":"2023-10-08T16:25:04.195798+0000","last_active":"2023-10-08T16:25:04.197698+0000","last_peered":"2023-10-08T16:25:04.197698+0000","last_clean":"2023-10-08T16:25:04.197698+0000","last_became_active":"2023-10-08T16:25:04.195557+0000","last_became_peered":"2023-10-08T16:25:04.195557+0000","last_unstale":"2023-10-08T16:25:04.197698+0000","last_undegraded":"2023-10-08T16:25:04.197698+0000","last_fullsized":"2023-10-08T16:25:04.197698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:52.084740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185291+0000","last_change":"2023-10-08T16:25:04.177365+0000","last_active":"2023-10-08T16:25:04.185291+0000","last_peered":"2023-10-08T16:25:04.185291+0000","last_clean":"2023-10-08T16:25:04.185291+0000","last_became_active":"2023-10-08T16:25:04.177078+0000","last_became_peered":"2023-10-08T16:25:04.177078+0000","last_unstale":"2023-10-08T16:25:04.185291+0000","last_undegraded":"2023-10-08T16:25:04.185291+0000","last_fullsized":"2023-10-08T16:25:04.185291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:32.063542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191108+0000","last_change":"2023-10-08T16:25:04.189784+0000","last_active":"2023-10-08T16:25:04.191108+0000","last_peered":"2023-10-08T16:25:04.191108+0000","last_clean":"2023-10-08T16:25:04.191108+0000","last_became_active":"2023-10-08T16:25:04.189487+0000","last_became_peered":"2023-10-08T16:25:04.189487+0000","last_unstale":"2023-10-08T16:25:04.191108+0000","last_undegraded":"2023-10-08T16:25:04.191108+0000","last_fullsized":"2023-10-08T16:25:04.191108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:32.166576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185816+0000","last_change":"2023-10-08T16:25:04.183703+0000","last_active":"2023-10-08T16:25:04.185816+0000","last_peered":"2023-10-08T16:25:04.185816+0000","last_clean":"2023-10-08T16:25:04.185816+0000","last_became_active":"2023-10-08T16:25:04.183400+0000","last_became_peered":"2023-10-08T16:25:04.183400+0000","last_unstale":"2023-10-08T16:25:04.185816+0000","last_undegraded":"2023-10-08T16:25:04.185816+0000","last_fullsized":"2023-10-08T16:25:04.185816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:34.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.190552+0000","last_change":"2023-10-08T16:25:04.189167+0000","last_active":"2023-10-08T16:25:04.190552+0000","last_peered":"2023-10-08T16:25:04.190552+0000","last_clean":"2023-10-08T16:25:04.190552+0000","last_became_active":"2023-10-08T16:25:04.188893+0000","last_became_peered":"2023-10-08T16:25:04.188893+0000","last_unstale":"2023-10-08T16:25:04.190552+0000","last_undegraded":"2023-10-08T16:25:04.190552+0000","last_fullsized":"2023-10-08T16:25:04.190552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189887+0000","last_change":"2023-10-08T16:25:04.187710+0000","last_active":"2023-10-08T16:25:04.189887+0000","last_peered":"2023-10-08T16:25:04.189887+0000","last_clean":"2023-10-08T16:25:04.189887+0000","last_became_active":"2023-10-08T16:25:04.187434+0000","last_became_peered":"2023-10-08T16:25:04.187434+0000","last_unstale":"2023-10-08T16:25:04.189887+0000","last_undegraded":"2023-10-08T16:25:04.189887+0000","last_fullsized":"2023-10-08T16:25:04.189887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:34.020887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191642+0000","last_change":"2023-10-08T16:25:04.188642+0000","last_active":"2023-10-08T16:25:04.191642+0000","last_peered":"2023-10-08T16:25:04.191642+0000","last_clean":"2023-10-08T16:25:04.191642+0000","last_became_active":"2023-10-08T16:25:04.188360+0000","last_became_peered":"2023-10-08T16:25:04.188360+0000","last_unstale":"2023-10-08T16:25:04.191642+0000","last_undegraded":"2023-10-08T16:25:04.191642+0000","last_fullsized":"2023-10-08T16:25:04.191642+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:18.725697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187648+0000","last_change":"2023-10-08T16:25:04.186151+0000","last_active":"2023-10-08T16:25:04.187648+0000","last_peered":"2023-10-08T16:25:04.187648+0000","last_clean":"2023-10-08T16:25:04.187648+0000","last_became_active":"2023-10-08T16:25:04.185901+0000","last_became_peered":"2023-10-08T16:25:04.185901+0000","last_unstale":"2023-10-08T16:25:04.187648+0000","last_undegraded":"2023-10-08T16:25:04.187648+0000","last_fullsized":"2023-10-08T16:25:04.187648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:54.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180136+0000","last_change":"2023-10-08T16:25:04.179317+0000","last_active":"2023-10-08T16:25:04.180136+0000","last_peered":"2023-10-08T16:25:04.180136+0000","last_clean":"2023-10-08T16:25:04.180136+0000","last_became_active":"2023-10-08T16:25:04.179073+0000","last_became_peered":"2023-10-08T16:25:04.179073+0000","last_unstale":"2023-10-08T16:25:04.180136+0000","last_undegraded":"2023-10-08T16:25:04.180136+0000","last_fullsized":"2023-10-08T16:25:04.180136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:31.655970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180881+0000","last_change":"2023-10-08T16:25:04.179129+0000","last_active":"2023-10-08T16:25:04.180881+0000","last_peered":"2023-10-08T16:25:04.180881+0000","last_clean":"2023-10-08T16:25:04.180881+0000","last_became_active":"2023-10-08T16:25:04.178872+0000","last_became_peered":"2023-10-08T16:25:04.178872+0000","last_unstale":"2023-10-08T16:25:04.180881+0000","last_undegraded":"2023-10-08T16:25:04.180881+0000","last_fullsized":"2023-10-08T16:25:04.180881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:13.196602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185882+0000","last_change":"2023-10-08T16:25:04.184043+0000","last_active":"2023-10-08T16:25:04.185882+0000","last_peered":"2023-10-08T16:25:04.185882+0000","last_clean":"2023-10-08T16:25:04.185882+0000","last_became_active":"2023-10-08T16:25:04.183715+0000","last_became_peered":"2023-10-08T16:25:04.183715+0000","last_unstale":"2023-10-08T16:25:04.185882+0000","last_undegraded":"2023-10-08T16:25:04.185882+0000","last_fullsized":"2023-10-08T16:25:04.185882+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:42.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186771+0000","last_change":"2023-10-08T16:25:04.180663+0000","last_active":"2023-10-08T16:25:04.186771+0000","last_peered":"2023-10-08T16:25:04.186771+0000","last_clean":"2023-10-08T16:25:04.186771+0000","last_became_active":"2023-10-08T16:25:04.180367+0000","last_became_peered":"2023-10-08T16:25:04.180367+0000","last_unstale":"2023-10-08T16:25:04.186771+0000","last_undegraded":"2023-10-08T16:25:04.186771+0000","last_fullsized":"2023-10-08T16:25:04.186771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:23.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191623+0000","last_change":"2023-10-08T16:25:04.188079+0000","last_active":"2023-10-08T16:25:04.191623+0000","last_peered":"2023-10-08T16:25:04.191623+0000","last_clean":"2023-10-08T16:25:04.191623+0000","last_became_active":"2023-10-08T16:25:04.187727+0000","last_became_peered":"2023-10-08T16:25:04.187727+0000","last_unstale":"2023-10-08T16:25:04.191623+0000","last_undegraded":"2023-10-08T16:25:04.191623+0000","last_fullsized":"2023-10-08T16:25:04.191623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:13.467148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195074+0000","last_change":"2023-10-08T16:25:04.191268+0000","last_active":"2023-10-08T16:25:04.195074+0000","last_peered":"2023-10-08T16:25:04.195074+0000","last_clean":"2023-10-08T16:25:04.195074+0000","last_became_active":"2023-10-08T16:25:04.191011+0000","last_became_peered":"2023-10-08T16:25:04.191011+0000","last_unstale":"2023-10-08T16:25:04.195074+0000","last_undegraded":"2023-10-08T16:25:04.195074+0000","last_fullsized":"2023-10-08T16:25:04.195074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:59.573275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189821+0000","last_change":"2023-10-08T16:25:04.186950+0000","last_active":"2023-10-08T16:25:04.189821+0000","last_peered":"2023-10-08T16:25:04.189821+0000","last_clean":"2023-10-08T16:25:04.189821+0000","last_became_active":"2023-10-08T16:25:04.186176+0000","last_became_peered":"2023-10-08T16:25:04.186176+0000","last_unstale":"2023-10-08T16:25:04.189821+0000","last_undegraded":"2023-10-08T16:25:04.189821+0000","last_fullsized":"2023-10-08T16:25:04.189821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186737+0000","last_change":"2023-10-08T16:25:04.184950+0000","last_active":"2023-10-08T16:25:04.186737+0000","last_peered":"2023-10-08T16:25:04.186737+0000","last_clean":"2023-10-08T16:25:04.186737+0000","last_became_active":"2023-10-08T16:25:04.184706+0000","last_became_peered":"2023-10-08T16:25:04.184706+0000","last_unstale":"2023-10-08T16:25:04.186737+0000","last_undegraded":"2023-10-08T16:25:04.186737+0000","last_fullsized":"2023-10-08T16:25:04.186737+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:01.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181007+0000","last_change":"2023-10-08T16:25:04.174122+0000","last_active":"2023-10-08T16:25:04.181007+0000","last_peered":"2023-10-08T16:25:04.181007+0000","last_clean":"2023-10-08T16:25:04.181007+0000","last_became_active":"2023-10-08T16:25:04.173291+0000","last_became_peered":"2023-10-08T16:25:04.173291+0000","last_unstale":"2023-10-08T16:25:04.181007+0000","last_undegraded":"2023-10-08T16:25:04.181007+0000","last_fullsized":"2023-10-08T16:25:04.181007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:10.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198378+0000","last_change":"2023-10-08T16:25:04.192678+0000","last_active":"2023-10-08T16:25:04.198378+0000","last_peered":"2023-10-08T16:25:04.198378+0000","last_clean":"2023-10-08T16:25:04.198378+0000","last_became_active":"2023-10-08T16:25:04.192313+0000","last_became_peered":"2023-10-08T16:25:04.192313+0000","last_unstale":"2023-10-08T16:25:04.198378+0000","last_undegraded":"2023-10-08T16:25:04.198378+0000","last_fullsized":"2023-10-08T16:25:04.198378+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:09.011682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187351+0000","last_change":"2023-10-08T16:25:04.179325+0000","last_active":"2023-10-08T16:25:04.187351+0000","last_peered":"2023-10-08T16:25:04.187351+0000","last_clean":"2023-10-08T16:25:04.187351+0000","last_became_active":"2023-10-08T16:25:04.179060+0000","last_became_peered":"2023-10-08T16:25:04.179060+0000","last_unstale":"2023-10-08T16:25:04.187351+0000","last_undegraded":"2023-10-08T16:25:04.187351+0000","last_fullsized":"2023-10-08T16:25:04.187351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.524280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.173119+0000","last_change":"2023-10-08T16:25:04.169007+0000","last_active":"2023-10-08T16:25:04.173119+0000","last_peered":"2023-10-08T16:25:04.173119+0000","last_clean":"2023-10-08T16:25:04.173119+0000","last_became_active":"2023-10-08T16:25:04.168737+0000","last_became_peered":"2023-10-08T16:25:04.168737+0000","last_unstale":"2023-10-08T16:25:04.173119+0000","last_undegraded":"2023-10-08T16:25:04.173119+0000","last_fullsized":"2023-10-08T16:25:04.173119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:35.049597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189867+0000","last_change":"2023-10-08T16:25:04.185447+0000","last_active":"2023-10-08T16:25:04.189867+0000","last_peered":"2023-10-08T16:25:04.189867+0000","last_clean":"2023-10-08T16:25:04.189867+0000","last_became_active":"2023-10-08T16:25:04.184933+0000","last_became_peered":"2023-10-08T16:25:04.184933+0000","last_unstale":"2023-10-08T16:25:04.189867+0000","last_undegraded":"2023-10-08T16:25:04.189867+0000","last_fullsized":"2023-10-08T16:25:04.189867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198445+0000","last_change":"2023-10-08T16:25:04.191293+0000","last_active":"2023-10-08T16:25:04.198445+0000","last_peered":"2023-10-08T16:25:04.198445+0000","last_clean":"2023-10-08T16:25:04.198445+0000","last_became_active":"2023-10-08T16:25:04.190977+0000","last_became_peered":"2023-10-08T16:25:04.190977+0000","last_unstale":"2023-10-08T16:25:04.198445+0000","last_undegraded":"2023-10-08T16:25:04.198445+0000","last_fullsized":"2023-10-08T16:25:04.198445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:51.509709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203048+0000","last_change":"2023-10-08T16:25:03.164351+0000","last_active":"2023-10-08T16:25:04.203048+0000","last_peered":"2023-10-08T16:25:04.203048+0000","last_clean":"2023-10-08T16:25:04.203048+0000","last_became_active":"2023-10-08T16:25:03.164093+0000","last_became_peered":"2023-10-08T16:25:03.164093+0000","last_unstale":"2023-10-08T16:25:04.203048+0000","last_undegraded":"2023-10-08T16:25:04.203048+0000","last_fullsized":"2023-10-08T16:25:04.203048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:31.593169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187950+0000","last_change":"2023-10-08T16:25:04.186164+0000","last_active":"2023-10-08T16:25:04.187950+0000","last_peered":"2023-10-08T16:25:04.187950+0000","last_clean":"2023-10-08T16:25:04.187950+0000","last_became_active":"2023-10-08T16:25:04.185913+0000","last_became_peered":"2023-10-08T16:25:04.185913+0000","last_unstale":"2023-10-08T16:25:04.187950+0000","last_undegraded":"2023-10-08T16:25:04.187950+0000","last_fullsized":"2023-10-08T16:25:04.187950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:46.826902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195545+0000","last_change":"2023-10-08T16:25:03.158268+0000","last_active":"2023-10-08T16:25:04.195545+0000","last_peered":"2023-10-08T16:25:04.195545+0000","last_clean":"2023-10-08T16:25:04.195545+0000","last_became_active":"2023-10-08T16:25:03.157949+0000","last_became_peered":"2023-10-08T16:25:03.157949+0000","last_unstale":"2023-10-08T16:25:04.195545+0000","last_undegraded":"2023-10-08T16:25:04.195545+0000","last_fullsized":"2023-10-08T16:25:04.195545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:06.052973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.192079+0000","last_change":"2023-10-08T16:25:04.189419+0000","last_active":"2023-10-08T16:25:04.192079+0000","last_peered":"2023-10-08T16:25:04.192079+0000","last_clean":"2023-10-08T16:25:04.192079+0000","last_became_active":"2023-10-08T16:25:04.189092+0000","last_became_peered":"2023-10-08T16:25:04.189092+0000","last_unstale":"2023-10-08T16:25:04.192079+0000","last_undegraded":"2023-10-08T16:25:04.192079+0000","last_fullsized":"2023-10-08T16:25:04.192079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142650+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184564+0000","last_change":"2023-10-08T16:25:04.181450+0000","last_active":"2023-10-08T16:25:04.184564+0000","last_peered":"2023-10-08T16:25:04.184564+0000","last_clean":"2023-10-08T16:25:04.184564+0000","last_became_active":"2023-10-08T16:25:04.181162+0000","last_became_peered":"2023-10-08T16:25:04.181162+0000","last_unstale":"2023-10-08T16:25:04.184564+0000","last_undegraded":"2023-10-08T16:25:04.184564+0000","last_fullsized":"2023-10-08T16:25:04.184564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:05.833282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205224+0000","last_change":"2023-10-08T16:25:03.167869+0000","last_active":"2023-10-08T16:25:04.205224+0000","last_peered":"2023-10-08T16:25:04.205224+0000","last_clean":"2023-10-08T16:25:04.205224+0000","last_became_active":"2023-10-08T16:25:03.167391+0000","last_became_peered":"2023-10-08T16:25:03.167391+0000","last_unstale":"2023-10-08T16:25:04.205224+0000","last_undegraded":"2023-10-08T16:25:04.205224+0000","last_fullsized":"2023-10-08T16:25:04.205224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196986+0000","last_change":"2023-10-08T16:25:03.157433+0000","last_active":"2023-10-08T16:25:04.196986+0000","last_peered":"2023-10-08T16:25:04.196986+0000","last_clean":"2023-10-08T16:25:04.196986+0000","last_became_active":"2023-10-08T16:25:03.156742+0000","last_became_peered":"2023-10-08T16:25:03.156742+0000","last_unstale":"2023-10-08T16:25:04.196986+0000","last_undegraded":"2023-10-08T16:25:04.196986+0000","last_fullsized":"2023-10-08T16:25:04.196986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:09.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.200954+0000","last_change":"2023-10-08T16:25:03.167402+0000","last_active":"2023-10-08T16:25:04.200954+0000","last_peered":"2023-10-08T16:25:04.200954+0000","last_clean":"2023-10-08T16:25:04.200954+0000","last_became_active":"2023-10-08T16:25:03.166793+0000","last_became_peered":"2023-10-08T16:25:03.166793+0000","last_unstale":"2023-10-08T16:25:04.200954+0000","last_undegraded":"2023-10-08T16:25:04.200954+0000","last_fullsized":"2023-10-08T16:25:04.200954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:17.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185722+0000","last_change":"2023-10-08T16:25:04.182471+0000","last_active":"2023-10-08T16:25:04.185722+0000","last_peered":"2023-10-08T16:25:04.185722+0000","last_clean":"2023-10-08T16:25:04.185722+0000","last_became_active":"2023-10-08T16:25:04.182191+0000","last_became_peered":"2023-10-08T16:25:04.182191+0000","last_unstale":"2023-10-08T16:25:04.185722+0000","last_undegraded":"2023-10-08T16:25:04.185722+0000","last_fullsized":"2023-10-08T16:25:04.185722+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:43.756265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169520+0000","last_change":"2023-10-08T16:25:03.161798+0000","last_active":"2023-10-08T16:25:04.169520+0000","last_peered":"2023-10-08T16:25:04.169520+0000","last_clean":"2023-10-08T16:25:04.169520+0000","last_became_active":"2023-10-08T16:25:03.161354+0000","last_became_peered":"2023-10-08T16:25:03.161354+0000","last_unstale":"2023-10-08T16:25:04.169520+0000","last_undegraded":"2023-10-08T16:25:04.169520+0000","last_fullsized":"2023-10-08T16:25:04.169520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:10.765932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186790+0000","last_change":"2023-10-08T16:25:04.184609+0000","last_active":"2023-10-08T16:25:04.186790+0000","last_peered":"2023-10-08T16:25:04.186790+0000","last_clean":"2023-10-08T16:25:04.186790+0000","last_became_active":"2023-10-08T16:25:04.184287+0000","last_became_peered":"2023-10-08T16:25:04.184287+0000","last_unstale":"2023-10-08T16:25:04.186790+0000","last_undegraded":"2023-10-08T16:25:04.186790+0000","last_fullsized":"2023-10-08T16:25:04.186790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:17.070085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.171820+0000","last_change":"2023-10-08T16:25:03.161010+0000","last_active":"2023-10-08T16:25:04.171820+0000","last_peered":"2023-10-08T16:25:04.171820+0000","last_clean":"2023-10-08T16:25:04.171820+0000","last_became_active":"2023-10-08T16:25:03.160730+0000","last_became_peered":"2023-10-08T16:25:03.160730+0000","last_unstale":"2023-10-08T16:25:04.171820+0000","last_undegraded":"2023-10-08T16:25:04.171820+0000","last_fullsized":"2023-10-08T16:25:04.171820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:40.198475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142702+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:42.750989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198374+0000","last_change":"2023-10-08T16:25:04.191823+0000","last_active":"2023-10-08T16:25:04.198374+0000","last_peered":"2023-10-08T16:25:04.198374+0000","last_clean":"2023-10-08T16:25:04.198374+0000","last_became_active":"2023-10-08T16:25:04.191483+0000","last_became_peered":"2023-10-08T16:25:04.191483+0000","last_unstale":"2023-10-08T16:25:04.198374+0000","last_undegraded":"2023-10-08T16:25:04.198374+0000","last_fullsized":"2023-10-08T16:25:04.198374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:37.197720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186603+0000","last_change":"2023-10-08T16:25:03.167559+0000","last_active":"2023-10-08T16:25:04.186603+0000","last_peered":"2023-10-08T16:25:04.186603+0000","last_clean":"2023-10-08T16:25:04.186603+0000","last_became_active":"2023-10-08T16:25:03.167203+0000","last_became_peered":"2023-10-08T16:25:03.167203+0000","last_unstale":"2023-10-08T16:25:04.186603+0000","last_undegraded":"2023-10-08T16:25:04.186603+0000","last_fullsized":"2023-10-08T16:25:04.186603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189905+0000","last_change":"2023-10-08T16:25:04.187189+0000","last_active":"2023-10-08T16:25:04.189905+0000","last_peered":"2023-10-08T16:25:04.189905+0000","last_clean":"2023-10-08T16:25:04.189905+0000","last_became_active":"2023-10-08T16:25:04.186869+0000","last_became_peered":"2023-10-08T16:25:04.186869+0000","last_unstale":"2023-10-08T16:25:04.189905+0000","last_undegraded":"2023-10-08T16:25:04.189905+0000","last_fullsized":"2023-10-08T16:25:04.189905+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197991+0000","last_change":"2023-10-08T16:25:03.152315+0000","last_active":"2023-10-08T16:25:04.197991+0000","last_peered":"2023-10-08T16:25:04.197991+0000","last_clean":"2023-10-08T16:25:04.197991+0000","last_became_active":"2023-10-08T16:25:03.152015+0000","last_became_peered":"2023-10-08T16:25:03.152015+0000","last_unstale":"2023-10-08T16:25:04.197991+0000","last_undegraded":"2023-10-08T16:25:04.197991+0000","last_fullsized":"2023-10-08T16:25:04.197991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:04.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180615+0000","last_change":"2023-10-08T16:25:04.177909+0000","last_active":"2023-10-08T16:25:04.180615+0000","last_peered":"2023-10-08T16:25:04.180615+0000","last_clean":"2023-10-08T16:25:04.180615+0000","last_became_active":"2023-10-08T16:25:04.177426+0000","last_became_peered":"2023-10-08T16:25:04.177426+0000","last_unstale":"2023-10-08T16:25:04.180615+0000","last_undegraded":"2023-10-08T16:25:04.180615+0000","last_fullsized":"2023-10-08T16:25:04.180615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:14.184227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205010+0000","last_change":"2023-10-08T16:25:03.165618+0000","last_active":"2023-10-08T16:25:04.205010+0000","last_peered":"2023-10-08T16:25:04.205010+0000","last_clean":"2023-10-08T16:25:04.205010+0000","last_became_active":"2023-10-08T16:25:03.165328+0000","last_became_peered":"2023-10-08T16:25:03.165328+0000","last_unstale":"2023-10-08T16:25:04.205010+0000","last_undegraded":"2023-10-08T16:25:04.205010+0000","last_fullsized":"2023-10-08T16:25:04.205010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:51.440409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186810+0000","last_change":"2023-10-08T16:25:04.183796+0000","last_active":"2023-10-08T16:25:04.186810+0000","last_peered":"2023-10-08T16:25:04.186810+0000","last_clean":"2023-10-08T16:25:04.186810+0000","last_became_active":"2023-10-08T16:25:04.183546+0000","last_became_peered":"2023-10-08T16:25:04.183546+0000","last_unstale":"2023-10-08T16:25:04.186810+0000","last_undegraded":"2023-10-08T16:25:04.186810+0000","last_fullsized":"2023-10-08T16:25:04.186810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:41.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198977+0000","last_change":"2023-10-08T16:25:03.161230+0000","last_active":"2023-10-08T16:25:04.198977+0000","last_peered":"2023-10-08T16:25:04.198977+0000","last_clean":"2023-10-08T16:25:04.198977+0000","last_became_active":"2023-10-08T16:25:03.160899+0000","last_became_peered":"2023-10-08T16:25:03.160899+0000","last_unstale":"2023-10-08T16:25:04.198977+0000","last_undegraded":"2023-10-08T16:25:04.198977+0000","last_fullsized":"2023-10-08T16:25:04.198977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:39.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186131+0000","last_change":"2023-10-08T16:25:03.169314+0000","last_active":"2023-10-08T16:25:04.186131+0000","last_peered":"2023-10-08T16:25:04.186131+0000","last_clean":"2023-10-08T16:25:04.186131+0000","last_became_active":"2023-10-08T16:25:03.169026+0000","last_became_peered":"2023-10-08T16:25:03.169026+0000","last_unstale":"2023-10-08T16:25:04.186131+0000","last_undegraded":"2023-10-08T16:25:04.186131+0000","last_fullsized":"2023-10-08T16:25:04.186131+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.194997+0000","last_change":"2023-10-08T16:25:04.191999+0000","last_active":"2023-10-08T16:25:04.194997+0000","last_peered":"2023-10-08T16:25:04.194997+0000","last_clean":"2023-10-08T16:25:04.194997+0000","last_became_active":"2023-10-08T16:25:04.191652+0000","last_became_peered":"2023-10-08T16:25:04.191652+0000","last_unstale":"2023-10-08T16:25:04.194997+0000","last_undegraded":"2023-10-08T16:25:04.194997+0000","last_fullsized":"2023-10-08T16:25:04.194997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:33.496567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141832+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:19.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186812+0000","last_change":"2023-10-08T16:25:04.184948+0000","last_active":"2023-10-08T16:25:04.186812+0000","last_peered":"2023-10-08T16:25:04.186812+0000","last_clean":"2023-10-08T16:25:04.186812+0000","last_became_active":"2023-10-08T16:25:04.184601+0000","last_became_peered":"2023-10-08T16:25:04.184601+0000","last_unstale":"2023-10-08T16:25:04.186812+0000","last_undegraded":"2023-10-08T16:25:04.186812+0000","last_fullsized":"2023-10-08T16:25:04.186812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:18.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142758+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.202483+0000","last_change":"2023-10-08T16:25:03.171328+0000","last_active":"2023-10-08T16:25:04.202483+0000","last_peered":"2023-10-08T16:25:04.202483+0000","last_clean":"2023-10-08T16:25:04.202483+0000","last_became_active":"2023-10-08T16:25:03.171110+0000","last_became_peered":"2023-10-08T16:25:03.171110+0000","last_unstale":"2023-10-08T16:25:04.202483+0000","last_undegraded":"2023-10-08T16:25:04.202483+0000","last_fullsized":"2023-10-08T16:25:04.202483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184559+0000","last_change":"2023-10-08T16:25:04.181795+0000","last_active":"2023-10-08T16:25:04.184559+0000","last_peered":"2023-10-08T16:25:04.184559+0000","last_clean":"2023-10-08T16:25:04.184559+0000","last_became_active":"2023-10-08T16:25:04.181403+0000","last_became_peered":"2023-10-08T16:25:04.181403+0000","last_unstale":"2023-10-08T16:25:04.184559+0000","last_undegraded":"2023-10-08T16:25:04.184559+0000","last_fullsized":"2023-10-08T16:25:04.184559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:45.404512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142570+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180117+0000","last_change":"2023-10-08T16:25:04.178756+0000","last_active":"2023-10-08T16:25:04.180117+0000","last_peered":"2023-10-08T16:25:04.180117+0000","last_clean":"2023-10-08T16:25:04.180117+0000","last_became_active":"2023-10-08T16:25:04.178493+0000","last_became_peered":"2023-10-08T16:25:04.178493+0000","last_unstale":"2023-10-08T16:25:04.180117+0000","last_undegraded":"2023-10-08T16:25:04.180117+0000","last_fullsized":"2023-10-08T16:25:04.180117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:09.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203675+0000","last_change":"2023-10-08T16:25:03.162613+0000","last_active":"2023-10-08T16:25:04.203675+0000","last_peered":"2023-10-08T16:25:04.203675+0000","last_clean":"2023-10-08T16:25:04.203675+0000","last_became_active":"2023-10-08T16:25:03.162298+0000","last_became_peered":"2023-10-08T16:25:03.162298+0000","last_unstale":"2023-10-08T16:25:04.203675+0000","last_undegraded":"2023-10-08T16:25:04.203675+0000","last_fullsized":"2023-10-08T16:25:04.203675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180635+0000","last_change":"2023-10-08T16:25:04.178425+0000","last_active":"2023-10-08T16:25:04.180635+0000","last_peered":"2023-10-08T16:25:04.180635+0000","last_clean":"2023-10-08T16:25:04.180635+0000","last_became_active":"2023-10-08T16:25:04.178158+0000","last_became_peered":"2023-10-08T16:25:04.178158+0000","last_unstale":"2023-10-08T16:25:04.180635+0000","last_undegraded":"2023-10-08T16:25:04.180635+0000","last_fullsized":"2023-10-08T16:25:04.180635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:52.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169658+0000","last_change":"2023-10-08T16:25:03.162457+0000","last_active":"2023-10-08T16:25:04.169658+0000","last_peered":"2023-10-08T16:25:04.169658+0000","last_clean":"2023-10-08T16:25:04.169658+0000","last_became_active":"2023-10-08T16:25:03.162174+0000","last_became_peered":"2023-10-08T16:25:03.162174+0000","last_unstale":"2023-10-08T16:25:04.169658+0000","last_undegraded":"2023-10-08T16:25:04.169658+0000","last_fullsized":"2023-10-08T16:25:04.169658+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:14.112628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178384+0000","last_change":"2023-10-08T16:25:04.176022+0000","last_active":"2023-10-08T16:25:04.178384+0000","last_peered":"2023-10-08T16:25:04.178384+0000","last_clean":"2023-10-08T16:25:04.178384+0000","last_became_active":"2023-10-08T16:25:04.175768+0000","last_became_peered":"2023-10-08T16:25:04.175768+0000","last_unstale":"2023-10-08T16:25:04.178384+0000","last_undegraded":"2023-10-08T16:25:04.178384+0000","last_fullsized":"2023-10-08T16:25:04.178384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:12.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186200+0000","last_change":"2023-10-08T16:25:03.167677+0000","last_active":"2023-10-08T16:25:04.186200+0000","last_peered":"2023-10-08T16:25:04.186200+0000","last_clean":"2023-10-08T16:25:04.186200+0000","last_became_active":"2023-10-08T16:25:03.167109+0000","last_became_peered":"2023-10-08T16:25:03.167109+0000","last_unstale":"2023-10-08T16:25:04.186200+0000","last_undegraded":"2023-10-08T16:25:04.186200+0000","last_fullsized":"2023-10-08T16:25:04.186200+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187315+0000","last_change":"2023-10-08T16:25:04.180103+0000","last_active":"2023-10-08T16:25:04.187315+0000","last_peered":"2023-10-08T16:25:04.187315+0000","last_clean":"2023-10-08T16:25:04.187315+0000","last_became_active":"2023-10-08T16:25:04.179854+0000","last_became_peered":"2023-10-08T16:25:04.179854+0000","last_unstale":"2023-10-08T16:25:04.187315+0000","last_undegraded":"2023-10-08T16:25:04.187315+0000","last_fullsized":"2023-10-08T16:25:04.187315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:15.320837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141234+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:30.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187138+0000","last_change":"2023-10-08T16:25:04.180924+0000","last_active":"2023-10-08T16:25:04.187138+0000","last_peered":"2023-10-08T16:25:04.187138+0000","last_clean":"2023-10-08T16:25:04.187138+0000","last_became_active":"2023-10-08T16:25:04.180659+0000","last_became_peered":"2023-10-08T16:25:04.180659+0000","last_unstale":"2023-10-08T16:25:04.187138+0000","last_undegraded":"2023-10-08T16:25:04.187138+0000","last_fullsized":"2023-10-08T16:25:04.187138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:03.340620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.172362+0000","last_change":"2023-10-08T16:25:03.152697+0000","last_active":"2023-10-08T16:25:04.172362+0000","last_peered":"2023-10-08T16:25:04.172362+0000","last_clean":"2023-10-08T16:25:04.172362+0000","last_became_active":"2023-10-08T16:25:03.152373+0000","last_became_peered":"2023-10-08T16:25:03.152373+0000","last_unstale":"2023-10-08T16:25:04.172362+0000","last_undegraded":"2023-10-08T16:25:04.172362+0000","last_fullsized":"2023-10-08T16:25:04.172362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:19.376954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186336+0000","last_change":"2023-10-08T16:25:04.179784+0000","last_active":"2023-10-08T16:25:04.186336+0000","last_peered":"2023-10-08T16:25:04.186336+0000","last_clean":"2023-10-08T16:25:04.186336+0000","last_became_active":"2023-10-08T16:25:04.179540+0000","last_became_peered":"2023-10-08T16:25:04.179540+0000","last_unstale":"2023-10-08T16:25:04.186336+0000","last_undegraded":"2023-10-08T16:25:04.186336+0000","last_fullsized":"2023-10-08T16:25:04.186336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205005+0000","last_change":"2023-10-08T16:25:03.167710+0000","last_active":"2023-10-08T16:25:04.205005+0000","last_peered":"2023-10-08T16:25:04.205005+0000","last_clean":"2023-10-08T16:25:04.205005+0000","last_became_active":"2023-10-08T16:25:03.167346+0000","last_became_peered":"2023-10-08T16:25:03.167346+0000","last_unstale":"2023-10-08T16:25:04.205005+0000","last_undegraded":"2023-10-08T16:25:04.205005+0000","last_fullsized":"2023-10-08T16:25:04.205005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141192+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:06:52.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196073+0000","last_change":"2023-10-08T16:25:04.189875+0000","last_active":"2023-10-08T16:25:04.196073+0000","last_peered":"2023-10-08T16:25:04.196073+0000","last_clean":"2023-10-08T16:25:04.196073+0000","last_became_active":"2023-10-08T16:25:04.189608+0000","last_became_peered":"2023-10-08T16:25:04.189608+0000","last_unstale":"2023-10-08T16:25:04.196073+0000","last_undegraded":"2023-10-08T16:25:04.196073+0000","last_fullsized":"2023-10-08T16:25:04.196073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:17.805094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174488+0000","last_change":"2023-10-08T16:25:03.159563+0000","last_active":"2023-10-08T16:25:04.174488+0000","last_peered":"2023-10-08T16:25:04.174488+0000","last_clean":"2023-10-08T16:25:04.174488+0000","last_became_active":"2023-10-08T16:25:03.159252+0000","last_became_peered":"2023-10-08T16:25:03.159252+0000","last_unstale":"2023-10-08T16:25:04.174488+0000","last_undegraded":"2023-10-08T16:25:04.174488+0000","last_fullsized":"2023-10-08T16:25:04.174488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:09.955599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186235+0000","last_change":"2023-10-08T16:25:04.182673+0000","last_active":"2023-10-08T16:25:04.186235+0000","last_peered":"2023-10-08T16:25:04.186235+0000","last_clean":"2023-10-08T16:25:04.186235+0000","last_became_active":"2023-10-08T16:25:04.182368+0000","last_became_peered":"2023-10-08T16:25:04.182368+0000","last_unstale":"2023-10-08T16:25:04.186235+0000","last_undegraded":"2023-10-08T16:25:04.186235+0000","last_fullsized":"2023-10-08T16:25:04.186235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:41.602049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170934+0000","last_change":"2023-10-08T16:25:03.153859+0000","last_active":"2023-10-08T16:25:04.170934+0000","last_peered":"2023-10-08T16:25:04.170934+0000","last_clean":"2023-10-08T16:25:04.170934+0000","last_became_active":"2023-10-08T16:25:03.153583+0000","last_became_peered":"2023-10-08T16:25:03.153583+0000","last_unstale":"2023-10-08T16:25:04.170934+0000","last_undegraded":"2023-10-08T16:25:04.170934+0000","last_fullsized":"2023-10-08T16:25:04.170934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:55.498306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191111+0000","last_change":"2023-10-08T16:25:04.188418+0000","last_active":"2023-10-08T16:25:04.191111+0000","last_peered":"2023-10-08T16:25:04.191111+0000","last_clean":"2023-10-08T16:25:04.191111+0000","last_became_active":"2023-10-08T16:25:04.188160+0000","last_became_peered":"2023-10-08T16:25:04.188160+0000","last_unstale":"2023-10-08T16:25:04.191111+0000","last_undegraded":"2023-10-08T16:25:04.191111+0000","last_fullsized":"2023-10-08T16:25:04.191111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:42.749730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174357+0000","last_change":"2023-10-08T16:25:03.154067+0000","last_active":"2023-10-08T16:25:04.174357+0000","last_peered":"2023-10-08T16:25:04.174357+0000","last_clean":"2023-10-08T16:25:04.174357+0000","last_became_active":"2023-10-08T16:25:03.153792+0000","last_became_peered":"2023-10-08T16:25:03.153792+0000","last_unstale":"2023-10-08T16:25:04.174357+0000","last_undegraded":"2023-10-08T16:25:04.174357+0000","last_fullsized":"2023-10-08T16:25:04.174357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:05.481126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.193106+0000","last_change":"2023-10-08T16:25:04.188647+0000","last_active":"2023-10-08T16:25:04.193106+0000","last_peered":"2023-10-08T16:25:04.193106+0000","last_clean":"2023-10-08T16:25:04.193106+0000","last_became_active":"2023-10-08T16:25:04.187982+0000","last_became_peered":"2023-10-08T16:25:04.187982+0000","last_unstale":"2023-10-08T16:25:04.193106+0000","last_undegraded":"2023-10-08T16:25:04.193106+0000","last_fullsized":"2023-10-08T16:25:04.193106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168357+0000","last_change":"2023-10-08T16:25:03.161066+0000","last_active":"2023-10-08T16:25:04.168357+0000","last_peered":"2023-10-08T16:25:04.168357+0000","last_clean":"2023-10-08T16:25:04.168357+0000","last_became_active":"2023-10-08T16:25:03.160765+0000","last_became_peered":"2023-10-08T16:25:03.160765+0000","last_unstale":"2023-10-08T16:25:04.168357+0000","last_undegraded":"2023-10-08T16:25:04.168357+0000","last_fullsized":"2023-10-08T16:25:04.168357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:23.727949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187451+0000","last_change":"2023-10-08T16:25:04.181787+0000","last_active":"2023-10-08T16:25:04.187451+0000","last_peered":"2023-10-08T16:25:04.187451+0000","last_clean":"2023-10-08T16:25:04.187451+0000","last_became_active":"2023-10-08T16:25:04.181507+0000","last_became_peered":"2023-10-08T16:25:04.181507+0000","last_unstale":"2023-10-08T16:25:04.187451+0000","last_undegraded":"2023-10-08T16:25:04.187451+0000","last_fullsized":"2023-10-08T16:25:04.187451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:10.414471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142897+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189861+0000","last_change":"2023-10-08T16:25:04.186865+0000","last_active":"2023-10-08T16:25:04.189861+0000","last_peered":"2023-10-08T16:25:04.189861+0000","last_clean":"2023-10-08T16:25:04.189861+0000","last_became_active":"2023-10-08T16:25:04.185912+0000","last_became_peered":"2023-10-08T16:25:04.185912+0000","last_unstale":"2023-10-08T16:25:04.189861+0000","last_undegraded":"2023-10-08T16:25:04.189861+0000","last_fullsized":"2023-10-08T16:25:04.189861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.177861+0000","last_change":"2023-10-08T16:25:03.166929+0000","last_active":"2023-10-08T16:25:04.177861+0000","last_peered":"2023-10-08T16:25:04.177861+0000","last_clean":"2023-10-08T16:25:04.177861+0000","last_became_active":"2023-10-08T16:25:03.166366+0000","last_became_peered":"2023-10-08T16:25:03.166366+0000","last_unstale":"2023-10-08T16:25:04.177861+0000","last_undegraded":"2023-10-08T16:25:04.177861+0000","last_fullsized":"2023-10-08T16:25:04.177861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196970+0000","last_change":"2023-10-08T16:25:04.193416+0000","last_active":"2023-10-08T16:25:04.196970+0000","last_peered":"2023-10-08T16:25:04.196970+0000","last_clean":"2023-10-08T16:25:04.196970+0000","last_became_active":"2023-10-08T16:25:04.193106+0000","last_became_peered":"2023-10-08T16:25:04.193106+0000","last_unstale":"2023-10-08T16:25:04.196970+0000","last_undegraded":"2023-10-08T16:25:04.196970+0000","last_fullsized":"2023-10-08T16:25:04.196970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:09.405286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205316+0000","last_change":"2023-10-08T16:25:03.168169+0000","last_active":"2023-10-08T16:25:04.205316+0000","last_peered":"2023-10-08T16:25:04.205316+0000","last_clean":"2023-10-08T16:25:04.205316+0000","last_became_active":"2023-10-08T16:25:03.167889+0000","last_became_peered":"2023-10-08T16:25:03.167889+0000","last_unstale":"2023-10-08T16:25:04.205316+0000","last_undegraded":"2023-10-08T16:25:04.205316+0000","last_fullsized":"2023-10-08T16:25:04.205316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"88'183","reported_seq":469,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168988+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:04.168988+0000","last_peered":"2023-10-08T16:25:04.168988+0000","last_clean":"2023-10-08T16:25:04.168988+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:04.168988+0000","last_undegraded":"2023-10-08T16:25:04.168988+0000","last_fullsized":"2023-10-08T16:25:04.168988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307248,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064592,"statfs":{"total":96636764160,"available":96322142208,"internally_reserved":0,"allocated":1810432,"data_stored":1176158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.48499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97199999999999998,"5min":0.98299999999999998,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.089},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.032,"15min":1.1000000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.234},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.53000000000000003,"5min":0.439,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3919999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.351,"5min":1.351,"15min":1.3680000000000001},"last":1.073},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.323},"last":1.085},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.448},"last":1.0589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":0.96399999999999997,"15min":1.125},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.65700000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.99199999999999999,"15min":1.365},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.997,"15min":1.0549999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":1.071,"15min":1.552},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.4570000000000001},"last":0.752}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72999999999999998,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.0149999999999999,"15min":1.069},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.619},"last":0.77800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.272,"15min":1.272},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.74099999999999999},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85699999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.85599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":587326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44400000000000001,"15min":0.45000000000000001},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.873},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.82199999999999995,"15min":1.0680000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.65400000000000003,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.629},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":1.472},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.026,"15min":1.373},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.2230000000000001,"15min":1.375},"last":0.84899999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":1.157,"15min":1.276},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.085,"15min":1.224},"last":0.72399999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.63400000000000001,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0069999999999999,"5min":1.0800000000000001,"15min":1.429},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0209999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0109999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0960000000000001,"15min":1.514},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1802240,"data_stored":1175570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":1220608,"data_stored":586738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.30499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.32500000000000001,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.504}]},{"osd":2,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.79200000000000004,"5min":1,"15min":1},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":1.0589999999999999,"5min":1.093,"15min":1.3200000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.996,"5min":1.1799999999999999,"15min":1.397},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82399999999999995,"15min":0.84899999999999998},"min":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.0429999999999999,"5min":1.153,"15min":1.306},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.321},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1171456,"data_stored":564712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.54100000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.56999999999999995,"5min":0.504,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.60399999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.004,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.754,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.085,"15min":1.216},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1479999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.505,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0309999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.47,"15min":1.47},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.022,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65100000000000002},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":0.97099999999999997,"5min":2.661,"15min":2.661},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.117,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0760000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":558515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.47999999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:08.674 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:08.693 INFO:tasks.ceph.mds.d.smithi029.stderr:2023-10-08T16:25:08.693+0000 7fa203df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:25:08.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.892+0000 7f70a299d700 1 Processor -- start 2023-10-08T16:25:08.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.892+0000 7f70a299d700 1 -- start start 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 0x7f709c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f709c06f3a0 0x7f709c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06e470 0x7f709c1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c06a490 con 0x7f709c06f3a0 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0c7490 con 0x7f709c06e0a0 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0c7770 con 0x7f709c06e470 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f709c06f3a0 0x7f709c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f709c06f3a0 0x7f709c14fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36456/0 (socket says 172.21.15.12:36456) 2023-10-08T16:25:08.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a119a700 1 -- 172.21.15.12:0/1723794158 learned_addr learned my addr 172.21.15.12:0/1723794158 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:08.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a199b700 1 --2- 172.21.15.12:0/1723794158 >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 0x7f709c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.894+0000 7f70a219c700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06e470 0x7f709c1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 -- 172.21.15.12:0/1723794158 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06e470 msgr2=0x7f709c1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06e470 0x7f709c1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 -- 172.21.15.12:0/1723794158 >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 msgr2=0x7f709c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 --2- 172.21.15.12:0/1723794158 >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 0x7f709c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 -- 172.21.15.12:0/1723794158 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0c7a50 con 0x7f709c06f3a0 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a199b700 1 --2- 172.21.15.12:0/1723794158 >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 0x7f709c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a119a700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06f3a0 0x7f709c14fc70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f709c069230 tx=0x7f708c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7100e6b12050fe52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a0999700 1 -- 172.21.15.12:0/1723794158 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00b860 con 0x7f709c06f3a0 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a0999700 1 -- 172.21.15.12:0/1723794158 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c00b9c0 con 0x7f709c06f3a0 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.895+0000 7f70a0999700 1 -- 172.21.15.12:0/1723794158 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00bd60 con 0x7f709c06f3a0 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 -- 172.21.15.12:0/1723794158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06f3a0 msgr2=0x7f709c14fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06f3a0 0x7f709c14fc70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f709c069230 tx=0x7f708c009250 comp rx=0 tx=0).stop 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 -- 172.21.15.12:0/1723794158 shutdown_connections 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06e470 0x7f709c1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 --2- 172.21.15.12:0/1723794158 >> v2:172.21.15.29:3300/0 conn(0x7f709c06e0a0 0x7f709c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 --2- 172.21.15.12:0/1723794158 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06f3a0 0x7f709c14fc70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 -- 172.21.15.12:0/1723794158 >> 172.21.15.12:0/1723794158 conn(0x7f709c06d170 msgr2=0x7f709c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 -- 172.21.15.12:0/1723794158 shutdown_connections 2023-10-08T16:25:08.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.896+0000 7f70a299d700 1 -- 172.21.15.12:0/1723794158 wait complete. 2023-10-08T16:25:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.897+0000 7f70a299d700 1 Processor -- start 2023-10-08T16:25:08.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.898+0000 7f70a299d700 1 -- start start 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 0x7f709c16a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 0x7f709c1688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c169320 con 0x7f709c06e470 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c169600 con 0x7f709c06e0a0 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1698e0 con 0x7f709c06f3a0 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36460/0 (socket says 172.21.15.12:36460) 2023-10-08T16:25:08.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 -- 172.21.15.12:0/3359645249 learned_addr learned my addr 172.21.15.12:0/3359645249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a199b700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 0x7f709c16a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 -- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 msgr2=0x7f709c1688d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a219c700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 0x7f709c1688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 0x7f709c1688d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 -- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 msgr2=0x7f709c16a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 0x7f709c16a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a119a700 1 -- 172.21.15.12:0/3359645249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c009490 con 0x7f709c06e470 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a199b700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 0x7f709c16a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.899+0000 7f70a219c700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 0x7f709c1688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f70a119a700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f708c003080 tx=0x7f708c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c00b860 con 0x7f709c06e470 2023-10-08T16:25:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c01f070 con 0x7f709c06e470 2023-10-08T16:25:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c169bc0 con 0x7f709c06e470 2023-10-08T16:25:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0266b0 con 0x7f709c06e470 2023-10-08T16:25:08.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.900+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c16a900 con 0x7f709c06e470 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.901+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c04c3c0 con 0x7f709c06e470 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.902+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f708c026ae0 con 0x7f709c06e470 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.903+0000 7f7091ffb700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 0x7f7080069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.903+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f708c021070 con 0x7f709c06e470 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.903+0000 7f70a199b700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 0x7f7080069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:08.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.904+0000 7f70a199b700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 0x7f7080069410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7098006f00 tx=0x7f7098008040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:08.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:08.907+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f708c0534f0 con 0x7f709c06e470 2023-10-08T16:25:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.105+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f709c0c7d30 con 0x7f7080066f60 2023-10-08T16:25:09.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.114+0000 7f7091ffb700 1 -- 172.21.15.12:0/3359645249 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286540 (secure 0 0 0) 0x7f709c0c7d30 con 0x7f7080066f60 2023-10-08T16:25:09.118 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:09.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 msgr2=0x7f7080069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 0x7f7080069410 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7098006f00 tx=0x7f7098008040 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 msgr2=0x7f709c0b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f708c003080 tx=0x7f708c017000 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 shutdown_connections 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7080066f60 0x7f7080069410 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f709c06f3a0 0x7f709c1688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f709c06e0a0 0x7f709c16a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 --2- 172.21.15.12:0/3359645249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f709c06e470 0x7f709c0b1640 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 >> 172.21.15.12:0/3359645249 conn(0x7f709c06d170 msgr2=0x7f709c0ca210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 shutdown_connections 2023-10-08T16:25:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.118+0000 7f70a299d700 1 -- 172.21.15.12:0/3359645249 wait complete. 2023-10-08T16:25:09.122 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:09.136 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:25:07.633348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":305,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438028,"kb_used_data":10572,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752536692,"statfs":{"total":773094113280,"available":770597572608,"internally_reserved":0,"allocated":10825728,"data_stored":5819627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.495220"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187439+0000","last_change":"2023-10-08T16:25:04.184423+0000","last_active":"2023-10-08T16:25:04.187439+0000","last_peered":"2023-10-08T16:25:04.187439+0000","last_clean":"2023-10-08T16:25:04.187439+0000","last_became_active":"2023-10-08T16:25:04.184164+0000","last_became_peered":"2023-10-08T16:25:04.184164+0000","last_unstale":"2023-10-08T16:25:04.187439+0000","last_undegraded":"2023-10-08T16:25:04.187439+0000","last_fullsized":"2023-10-08T16:25:04.187439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:41.179128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197698+0000","last_change":"2023-10-08T16:25:04.195798+0000","last_active":"2023-10-08T16:25:04.197698+0000","last_peered":"2023-10-08T16:25:04.197698+0000","last_clean":"2023-10-08T16:25:04.197698+0000","last_became_active":"2023-10-08T16:25:04.195557+0000","last_became_peered":"2023-10-08T16:25:04.195557+0000","last_unstale":"2023-10-08T16:25:04.197698+0000","last_undegraded":"2023-10-08T16:25:04.197698+0000","last_fullsized":"2023-10-08T16:25:04.197698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:52.084740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185291+0000","last_change":"2023-10-08T16:25:04.177365+0000","last_active":"2023-10-08T16:25:04.185291+0000","last_peered":"2023-10-08T16:25:04.185291+0000","last_clean":"2023-10-08T16:25:04.185291+0000","last_became_active":"2023-10-08T16:25:04.177078+0000","last_became_peered":"2023-10-08T16:25:04.177078+0000","last_unstale":"2023-10-08T16:25:04.185291+0000","last_undegraded":"2023-10-08T16:25:04.185291+0000","last_fullsized":"2023-10-08T16:25:04.185291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:32.063542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191108+0000","last_change":"2023-10-08T16:25:04.189784+0000","last_active":"2023-10-08T16:25:04.191108+0000","last_peered":"2023-10-08T16:25:04.191108+0000","last_clean":"2023-10-08T16:25:04.191108+0000","last_became_active":"2023-10-08T16:25:04.189487+0000","last_became_peered":"2023-10-08T16:25:04.189487+0000","last_unstale":"2023-10-08T16:25:04.191108+0000","last_undegraded":"2023-10-08T16:25:04.191108+0000","last_fullsized":"2023-10-08T16:25:04.191108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:32.166576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185816+0000","last_change":"2023-10-08T16:25:04.183703+0000","last_active":"2023-10-08T16:25:04.185816+0000","last_peered":"2023-10-08T16:25:04.185816+0000","last_clean":"2023-10-08T16:25:04.185816+0000","last_became_active":"2023-10-08T16:25:04.183400+0000","last_became_peered":"2023-10-08T16:25:04.183400+0000","last_unstale":"2023-10-08T16:25:04.185816+0000","last_undegraded":"2023-10-08T16:25:04.185816+0000","last_fullsized":"2023-10-08T16:25:04.185816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:34.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.190552+0000","last_change":"2023-10-08T16:25:04.189167+0000","last_active":"2023-10-08T16:25:04.190552+0000","last_peered":"2023-10-08T16:25:04.190552+0000","last_clean":"2023-10-08T16:25:04.190552+0000","last_became_active":"2023-10-08T16:25:04.188893+0000","last_became_peered":"2023-10-08T16:25:04.188893+0000","last_unstale":"2023-10-08T16:25:04.190552+0000","last_undegraded":"2023-10-08T16:25:04.190552+0000","last_fullsized":"2023-10-08T16:25:04.190552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189887+0000","last_change":"2023-10-08T16:25:04.187710+0000","last_active":"2023-10-08T16:25:04.189887+0000","last_peered":"2023-10-08T16:25:04.189887+0000","last_clean":"2023-10-08T16:25:04.189887+0000","last_became_active":"2023-10-08T16:25:04.187434+0000","last_became_peered":"2023-10-08T16:25:04.187434+0000","last_unstale":"2023-10-08T16:25:04.189887+0000","last_undegraded":"2023-10-08T16:25:04.189887+0000","last_fullsized":"2023-10-08T16:25:04.189887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:34.020887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191642+0000","last_change":"2023-10-08T16:25:04.188642+0000","last_active":"2023-10-08T16:25:04.191642+0000","last_peered":"2023-10-08T16:25:04.191642+0000","last_clean":"2023-10-08T16:25:04.191642+0000","last_became_active":"2023-10-08T16:25:04.188360+0000","last_became_peered":"2023-10-08T16:25:04.188360+0000","last_unstale":"2023-10-08T16:25:04.191642+0000","last_undegraded":"2023-10-08T16:25:04.191642+0000","last_fullsized":"2023-10-08T16:25:04.191642+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:18.725697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187648+0000","last_change":"2023-10-08T16:25:04.186151+0000","last_active":"2023-10-08T16:25:04.187648+0000","last_peered":"2023-10-08T16:25:04.187648+0000","last_clean":"2023-10-08T16:25:04.187648+0000","last_became_active":"2023-10-08T16:25:04.185901+0000","last_became_peered":"2023-10-08T16:25:04.185901+0000","last_unstale":"2023-10-08T16:25:04.187648+0000","last_undegraded":"2023-10-08T16:25:04.187648+0000","last_fullsized":"2023-10-08T16:25:04.187648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:54.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180136+0000","last_change":"2023-10-08T16:25:04.179317+0000","last_active":"2023-10-08T16:25:04.180136+0000","last_peered":"2023-10-08T16:25:04.180136+0000","last_clean":"2023-10-08T16:25:04.180136+0000","last_became_active":"2023-10-08T16:25:04.179073+0000","last_became_peered":"2023-10-08T16:25:04.179073+0000","last_unstale":"2023-10-08T16:25:04.180136+0000","last_undegraded":"2023-10-08T16:25:04.180136+0000","last_fullsized":"2023-10-08T16:25:04.180136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:31.655970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180881+0000","last_change":"2023-10-08T16:25:04.179129+0000","last_active":"2023-10-08T16:25:04.180881+0000","last_peered":"2023-10-08T16:25:04.180881+0000","last_clean":"2023-10-08T16:25:04.180881+0000","last_became_active":"2023-10-08T16:25:04.178872+0000","last_became_peered":"2023-10-08T16:25:04.178872+0000","last_unstale":"2023-10-08T16:25:04.180881+0000","last_undegraded":"2023-10-08T16:25:04.180881+0000","last_fullsized":"2023-10-08T16:25:04.180881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:13.196602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185882+0000","last_change":"2023-10-08T16:25:04.184043+0000","last_active":"2023-10-08T16:25:04.185882+0000","last_peered":"2023-10-08T16:25:04.185882+0000","last_clean":"2023-10-08T16:25:04.185882+0000","last_became_active":"2023-10-08T16:25:04.183715+0000","last_became_peered":"2023-10-08T16:25:04.183715+0000","last_unstale":"2023-10-08T16:25:04.185882+0000","last_undegraded":"2023-10-08T16:25:04.185882+0000","last_fullsized":"2023-10-08T16:25:04.185882+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:42.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186771+0000","last_change":"2023-10-08T16:25:04.180663+0000","last_active":"2023-10-08T16:25:04.186771+0000","last_peered":"2023-10-08T16:25:04.186771+0000","last_clean":"2023-10-08T16:25:04.186771+0000","last_became_active":"2023-10-08T16:25:04.180367+0000","last_became_peered":"2023-10-08T16:25:04.180367+0000","last_unstale":"2023-10-08T16:25:04.186771+0000","last_undegraded":"2023-10-08T16:25:04.186771+0000","last_fullsized":"2023-10-08T16:25:04.186771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:23.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191623+0000","last_change":"2023-10-08T16:25:04.188079+0000","last_active":"2023-10-08T16:25:04.191623+0000","last_peered":"2023-10-08T16:25:04.191623+0000","last_clean":"2023-10-08T16:25:04.191623+0000","last_became_active":"2023-10-08T16:25:04.187727+0000","last_became_peered":"2023-10-08T16:25:04.187727+0000","last_unstale":"2023-10-08T16:25:04.191623+0000","last_undegraded":"2023-10-08T16:25:04.191623+0000","last_fullsized":"2023-10-08T16:25:04.191623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:13.467148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195074+0000","last_change":"2023-10-08T16:25:04.191268+0000","last_active":"2023-10-08T16:25:04.195074+0000","last_peered":"2023-10-08T16:25:04.195074+0000","last_clean":"2023-10-08T16:25:04.195074+0000","last_became_active":"2023-10-08T16:25:04.191011+0000","last_became_peered":"2023-10-08T16:25:04.191011+0000","last_unstale":"2023-10-08T16:25:04.195074+0000","last_undegraded":"2023-10-08T16:25:04.195074+0000","last_fullsized":"2023-10-08T16:25:04.195074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:59.573275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189821+0000","last_change":"2023-10-08T16:25:04.186950+0000","last_active":"2023-10-08T16:25:04.189821+0000","last_peered":"2023-10-08T16:25:04.189821+0000","last_clean":"2023-10-08T16:25:04.189821+0000","last_became_active":"2023-10-08T16:25:04.186176+0000","last_became_peered":"2023-10-08T16:25:04.186176+0000","last_unstale":"2023-10-08T16:25:04.189821+0000","last_undegraded":"2023-10-08T16:25:04.189821+0000","last_fullsized":"2023-10-08T16:25:04.189821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186737+0000","last_change":"2023-10-08T16:25:04.184950+0000","last_active":"2023-10-08T16:25:04.186737+0000","last_peered":"2023-10-08T16:25:04.186737+0000","last_clean":"2023-10-08T16:25:04.186737+0000","last_became_active":"2023-10-08T16:25:04.184706+0000","last_became_peered":"2023-10-08T16:25:04.184706+0000","last_unstale":"2023-10-08T16:25:04.186737+0000","last_undegraded":"2023-10-08T16:25:04.186737+0000","last_fullsized":"2023-10-08T16:25:04.186737+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:01.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181007+0000","last_change":"2023-10-08T16:25:04.174122+0000","last_active":"2023-10-08T16:25:04.181007+0000","last_peered":"2023-10-08T16:25:04.181007+0000","last_clean":"2023-10-08T16:25:04.181007+0000","last_became_active":"2023-10-08T16:25:04.173291+0000","last_became_peered":"2023-10-08T16:25:04.173291+0000","last_unstale":"2023-10-08T16:25:04.181007+0000","last_undegraded":"2023-10-08T16:25:04.181007+0000","last_fullsized":"2023-10-08T16:25:04.181007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:10.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198378+0000","last_change":"2023-10-08T16:25:04.192678+0000","last_active":"2023-10-08T16:25:04.198378+0000","last_peered":"2023-10-08T16:25:04.198378+0000","last_clean":"2023-10-08T16:25:04.198378+0000","last_became_active":"2023-10-08T16:25:04.192313+0000","last_became_peered":"2023-10-08T16:25:04.192313+0000","last_unstale":"2023-10-08T16:25:04.198378+0000","last_undegraded":"2023-10-08T16:25:04.198378+0000","last_fullsized":"2023-10-08T16:25:04.198378+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:09.011682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187351+0000","last_change":"2023-10-08T16:25:04.179325+0000","last_active":"2023-10-08T16:25:04.187351+0000","last_peered":"2023-10-08T16:25:04.187351+0000","last_clean":"2023-10-08T16:25:04.187351+0000","last_became_active":"2023-10-08T16:25:04.179060+0000","last_became_peered":"2023-10-08T16:25:04.179060+0000","last_unstale":"2023-10-08T16:25:04.187351+0000","last_undegraded":"2023-10-08T16:25:04.187351+0000","last_fullsized":"2023-10-08T16:25:04.187351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.524280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.173119+0000","last_change":"2023-10-08T16:25:04.169007+0000","last_active":"2023-10-08T16:25:04.173119+0000","last_peered":"2023-10-08T16:25:04.173119+0000","last_clean":"2023-10-08T16:25:04.173119+0000","last_became_active":"2023-10-08T16:25:04.168737+0000","last_became_peered":"2023-10-08T16:25:04.168737+0000","last_unstale":"2023-10-08T16:25:04.173119+0000","last_undegraded":"2023-10-08T16:25:04.173119+0000","last_fullsized":"2023-10-08T16:25:04.173119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:35.049597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189867+0000","last_change":"2023-10-08T16:25:04.185447+0000","last_active":"2023-10-08T16:25:04.189867+0000","last_peered":"2023-10-08T16:25:04.189867+0000","last_clean":"2023-10-08T16:25:04.189867+0000","last_became_active":"2023-10-08T16:25:04.184933+0000","last_became_peered":"2023-10-08T16:25:04.184933+0000","last_unstale":"2023-10-08T16:25:04.189867+0000","last_undegraded":"2023-10-08T16:25:04.189867+0000","last_fullsized":"2023-10-08T16:25:04.189867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198445+0000","last_change":"2023-10-08T16:25:04.191293+0000","last_active":"2023-10-08T16:25:04.198445+0000","last_peered":"2023-10-08T16:25:04.198445+0000","last_clean":"2023-10-08T16:25:04.198445+0000","last_became_active":"2023-10-08T16:25:04.190977+0000","last_became_peered":"2023-10-08T16:25:04.190977+0000","last_unstale":"2023-10-08T16:25:04.198445+0000","last_undegraded":"2023-10-08T16:25:04.198445+0000","last_fullsized":"2023-10-08T16:25:04.198445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:51.509709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203048+0000","last_change":"2023-10-08T16:25:03.164351+0000","last_active":"2023-10-08T16:25:04.203048+0000","last_peered":"2023-10-08T16:25:04.203048+0000","last_clean":"2023-10-08T16:25:04.203048+0000","last_became_active":"2023-10-08T16:25:03.164093+0000","last_became_peered":"2023-10-08T16:25:03.164093+0000","last_unstale":"2023-10-08T16:25:04.203048+0000","last_undegraded":"2023-10-08T16:25:04.203048+0000","last_fullsized":"2023-10-08T16:25:04.203048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:31.593169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187950+0000","last_change":"2023-10-08T16:25:04.186164+0000","last_active":"2023-10-08T16:25:04.187950+0000","last_peered":"2023-10-08T16:25:04.187950+0000","last_clean":"2023-10-08T16:25:04.187950+0000","last_became_active":"2023-10-08T16:25:04.185913+0000","last_became_peered":"2023-10-08T16:25:04.185913+0000","last_unstale":"2023-10-08T16:25:04.187950+0000","last_undegraded":"2023-10-08T16:25:04.187950+0000","last_fullsized":"2023-10-08T16:25:04.187950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:46.826902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195545+0000","last_change":"2023-10-08T16:25:03.158268+0000","last_active":"2023-10-08T16:25:04.195545+0000","last_peered":"2023-10-08T16:25:04.195545+0000","last_clean":"2023-10-08T16:25:04.195545+0000","last_became_active":"2023-10-08T16:25:03.157949+0000","last_became_peered":"2023-10-08T16:25:03.157949+0000","last_unstale":"2023-10-08T16:25:04.195545+0000","last_undegraded":"2023-10-08T16:25:04.195545+0000","last_fullsized":"2023-10-08T16:25:04.195545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:06.052973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.192079+0000","last_change":"2023-10-08T16:25:04.189419+0000","last_active":"2023-10-08T16:25:04.192079+0000","last_peered":"2023-10-08T16:25:04.192079+0000","last_clean":"2023-10-08T16:25:04.192079+0000","last_became_active":"2023-10-08T16:25:04.189092+0000","last_became_peered":"2023-10-08T16:25:04.189092+0000","last_unstale":"2023-10-08T16:25:04.192079+0000","last_undegraded":"2023-10-08T16:25:04.192079+0000","last_fullsized":"2023-10-08T16:25:04.192079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142650+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184564+0000","last_change":"2023-10-08T16:25:04.181450+0000","last_active":"2023-10-08T16:25:04.184564+0000","last_peered":"2023-10-08T16:25:04.184564+0000","last_clean":"2023-10-08T16:25:04.184564+0000","last_became_active":"2023-10-08T16:25:04.181162+0000","last_became_peered":"2023-10-08T16:25:04.181162+0000","last_unstale":"2023-10-08T16:25:04.184564+0000","last_undegraded":"2023-10-08T16:25:04.184564+0000","last_fullsized":"2023-10-08T16:25:04.184564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:05.833282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205224+0000","last_change":"2023-10-08T16:25:03.167869+0000","last_active":"2023-10-08T16:25:04.205224+0000","last_peered":"2023-10-08T16:25:04.205224+0000","last_clean":"2023-10-08T16:25:04.205224+0000","last_became_active":"2023-10-08T16:25:03.167391+0000","last_became_peered":"2023-10-08T16:25:03.167391+0000","last_unstale":"2023-10-08T16:25:04.205224+0000","last_undegraded":"2023-10-08T16:25:04.205224+0000","last_fullsized":"2023-10-08T16:25:04.205224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196986+0000","last_change":"2023-10-08T16:25:03.157433+0000","last_active":"2023-10-08T16:25:04.196986+0000","last_peered":"2023-10-08T16:25:04.196986+0000","last_clean":"2023-10-08T16:25:04.196986+0000","last_became_active":"2023-10-08T16:25:03.156742+0000","last_became_peered":"2023-10-08T16:25:03.156742+0000","last_unstale":"2023-10-08T16:25:04.196986+0000","last_undegraded":"2023-10-08T16:25:04.196986+0000","last_fullsized":"2023-10-08T16:25:04.196986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:09.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.200954+0000","last_change":"2023-10-08T16:25:03.167402+0000","last_active":"2023-10-08T16:25:04.200954+0000","last_peered":"2023-10-08T16:25:04.200954+0000","last_clean":"2023-10-08T16:25:04.200954+0000","last_became_active":"2023-10-08T16:25:03.166793+0000","last_became_peered":"2023-10-08T16:25:03.166793+0000","last_unstale":"2023-10-08T16:25:04.200954+0000","last_undegraded":"2023-10-08T16:25:04.200954+0000","last_fullsized":"2023-10-08T16:25:04.200954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:17.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185722+0000","last_change":"2023-10-08T16:25:04.182471+0000","last_active":"2023-10-08T16:25:04.185722+0000","last_peered":"2023-10-08T16:25:04.185722+0000","last_clean":"2023-10-08T16:25:04.185722+0000","last_became_active":"2023-10-08T16:25:04.182191+0000","last_became_peered":"2023-10-08T16:25:04.182191+0000","last_unstale":"2023-10-08T16:25:04.185722+0000","last_undegraded":"2023-10-08T16:25:04.185722+0000","last_fullsized":"2023-10-08T16:25:04.185722+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:43.756265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169520+0000","last_change":"2023-10-08T16:25:03.161798+0000","last_active":"2023-10-08T16:25:04.169520+0000","last_peered":"2023-10-08T16:25:04.169520+0000","last_clean":"2023-10-08T16:25:04.169520+0000","last_became_active":"2023-10-08T16:25:03.161354+0000","last_became_peered":"2023-10-08T16:25:03.161354+0000","last_unstale":"2023-10-08T16:25:04.169520+0000","last_undegraded":"2023-10-08T16:25:04.169520+0000","last_fullsized":"2023-10-08T16:25:04.169520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:10.765932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186790+0000","last_change":"2023-10-08T16:25:04.184609+0000","last_active":"2023-10-08T16:25:04.186790+0000","last_peered":"2023-10-08T16:25:04.186790+0000","last_clean":"2023-10-08T16:25:04.186790+0000","last_became_active":"2023-10-08T16:25:04.184287+0000","last_became_peered":"2023-10-08T16:25:04.184287+0000","last_unstale":"2023-10-08T16:25:04.186790+0000","last_undegraded":"2023-10-08T16:25:04.186790+0000","last_fullsized":"2023-10-08T16:25:04.186790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:17.070085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.171820+0000","last_change":"2023-10-08T16:25:03.161010+0000","last_active":"2023-10-08T16:25:04.171820+0000","last_peered":"2023-10-08T16:25:04.171820+0000","last_clean":"2023-10-08T16:25:04.171820+0000","last_became_active":"2023-10-08T16:25:03.160730+0000","last_became_peered":"2023-10-08T16:25:03.160730+0000","last_unstale":"2023-10-08T16:25:04.171820+0000","last_undegraded":"2023-10-08T16:25:04.171820+0000","last_fullsized":"2023-10-08T16:25:04.171820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:40.198475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142702+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:42.750989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198374+0000","last_change":"2023-10-08T16:25:04.191823+0000","last_active":"2023-10-08T16:25:04.198374+0000","last_peered":"2023-10-08T16:25:04.198374+0000","last_clean":"2023-10-08T16:25:04.198374+0000","last_became_active":"2023-10-08T16:25:04.191483+0000","last_became_peered":"2023-10-08T16:25:04.191483+0000","last_unstale":"2023-10-08T16:25:04.198374+0000","last_undegraded":"2023-10-08T16:25:04.198374+0000","last_fullsized":"2023-10-08T16:25:04.198374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:37.197720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186603+0000","last_change":"2023-10-08T16:25:03.167559+0000","last_active":"2023-10-08T16:25:04.186603+0000","last_peered":"2023-10-08T16:25:04.186603+0000","last_clean":"2023-10-08T16:25:04.186603+0000","last_became_active":"2023-10-08T16:25:03.167203+0000","last_became_peered":"2023-10-08T16:25:03.167203+0000","last_unstale":"2023-10-08T16:25:04.186603+0000","last_undegraded":"2023-10-08T16:25:04.186603+0000","last_fullsized":"2023-10-08T16:25:04.186603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189905+0000","last_change":"2023-10-08T16:25:04.187189+0000","last_active":"2023-10-08T16:25:04.189905+0000","last_peered":"2023-10-08T16:25:04.189905+0000","last_clean":"2023-10-08T16:25:04.189905+0000","last_became_active":"2023-10-08T16:25:04.186869+0000","last_became_peered":"2023-10-08T16:25:04.186869+0000","last_unstale":"2023-10-08T16:25:04.189905+0000","last_undegraded":"2023-10-08T16:25:04.189905+0000","last_fullsized":"2023-10-08T16:25:04.189905+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197991+0000","last_change":"2023-10-08T16:25:03.152315+0000","last_active":"2023-10-08T16:25:04.197991+0000","last_peered":"2023-10-08T16:25:04.197991+0000","last_clean":"2023-10-08T16:25:04.197991+0000","last_became_active":"2023-10-08T16:25:03.152015+0000","last_became_peered":"2023-10-08T16:25:03.152015+0000","last_unstale":"2023-10-08T16:25:04.197991+0000","last_undegraded":"2023-10-08T16:25:04.197991+0000","last_fullsized":"2023-10-08T16:25:04.197991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:04.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180615+0000","last_change":"2023-10-08T16:25:04.177909+0000","last_active":"2023-10-08T16:25:04.180615+0000","last_peered":"2023-10-08T16:25:04.180615+0000","last_clean":"2023-10-08T16:25:04.180615+0000","last_became_active":"2023-10-08T16:25:04.177426+0000","last_became_peered":"2023-10-08T16:25:04.177426+0000","last_unstale":"2023-10-08T16:25:04.180615+0000","last_undegraded":"2023-10-08T16:25:04.180615+0000","last_fullsized":"2023-10-08T16:25:04.180615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:14.184227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205010+0000","last_change":"2023-10-08T16:25:03.165618+0000","last_active":"2023-10-08T16:25:04.205010+0000","last_peered":"2023-10-08T16:25:04.205010+0000","last_clean":"2023-10-08T16:25:04.205010+0000","last_became_active":"2023-10-08T16:25:03.165328+0000","last_became_peered":"2023-10-08T16:25:03.165328+0000","last_unstale":"2023-10-08T16:25:04.205010+0000","last_undegraded":"2023-10-08T16:25:04.205010+0000","last_fullsized":"2023-10-08T16:25:04.205010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:51.440409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186810+0000","last_change":"2023-10-08T16:25:04.183796+0000","last_active":"2023-10-08T16:25:04.186810+0000","last_peered":"2023-10-08T16:25:04.186810+0000","last_clean":"2023-10-08T16:25:04.186810+0000","last_became_active":"2023-10-08T16:25:04.183546+0000","last_became_peered":"2023-10-08T16:25:04.183546+0000","last_unstale":"2023-10-08T16:25:04.186810+0000","last_undegraded":"2023-10-08T16:25:04.186810+0000","last_fullsized":"2023-10-08T16:25:04.186810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:41.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198977+0000","last_change":"2023-10-08T16:25:03.161230+0000","last_active":"2023-10-08T16:25:04.198977+0000","last_peered":"2023-10-08T16:25:04.198977+0000","last_clean":"2023-10-08T16:25:04.198977+0000","last_became_active":"2023-10-08T16:25:03.160899+0000","last_became_peered":"2023-10-08T16:25:03.160899+0000","last_unstale":"2023-10-08T16:25:04.198977+0000","last_undegraded":"2023-10-08T16:25:04.198977+0000","last_fullsized":"2023-10-08T16:25:04.198977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:39.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186131+0000","last_change":"2023-10-08T16:25:03.169314+0000","last_active":"2023-10-08T16:25:04.186131+0000","last_peered":"2023-10-08T16:25:04.186131+0000","last_clean":"2023-10-08T16:25:04.186131+0000","last_became_active":"2023-10-08T16:25:03.169026+0000","last_became_peered":"2023-10-08T16:25:03.169026+0000","last_unstale":"2023-10-08T16:25:04.186131+0000","last_undegraded":"2023-10-08T16:25:04.186131+0000","last_fullsized":"2023-10-08T16:25:04.186131+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.194997+0000","last_change":"2023-10-08T16:25:04.191999+0000","last_active":"2023-10-08T16:25:04.194997+0000","last_peered":"2023-10-08T16:25:04.194997+0000","last_clean":"2023-10-08T16:25:04.194997+0000","last_became_active":"2023-10-08T16:25:04.191652+0000","last_became_peered":"2023-10-08T16:25:04.191652+0000","last_unstale":"2023-10-08T16:25:04.194997+0000","last_undegraded":"2023-10-08T16:25:04.194997+0000","last_fullsized":"2023-10-08T16:25:04.194997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:33.496567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141832+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:19.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186812+0000","last_change":"2023-10-08T16:25:04.184948+0000","last_active":"2023-10-08T16:25:04.186812+0000","last_peered":"2023-10-08T16:25:04.186812+0000","last_clean":"2023-10-08T16:25:04.186812+0000","last_became_active":"2023-10-08T16:25:04.184601+0000","last_became_peered":"2023-10-08T16:25:04.184601+0000","last_unstale":"2023-10-08T16:25:04.186812+0000","last_undegraded":"2023-10-08T16:25:04.186812+0000","last_fullsized":"2023-10-08T16:25:04.186812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:18.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142758+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.202483+0000","last_change":"2023-10-08T16:25:03.171328+0000","last_active":"2023-10-08T16:25:04.202483+0000","last_peered":"2023-10-08T16:25:04.202483+0000","last_clean":"2023-10-08T16:25:04.202483+0000","last_became_active":"2023-10-08T16:25:03.171110+0000","last_became_peered":"2023-10-08T16:25:03.171110+0000","last_unstale":"2023-10-08T16:25:04.202483+0000","last_undegraded":"2023-10-08T16:25:04.202483+0000","last_fullsized":"2023-10-08T16:25:04.202483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184559+0000","last_change":"2023-10-08T16:25:04.181795+0000","last_active":"2023-10-08T16:25:04.184559+0000","last_peered":"2023-10-08T16:25:04.184559+0000","last_clean":"2023-10-08T16:25:04.184559+0000","last_became_active":"2023-10-08T16:25:04.181403+0000","last_became_peered":"2023-10-08T16:25:04.181403+0000","last_unstale":"2023-10-08T16:25:04.184559+0000","last_undegraded":"2023-10-08T16:25:04.184559+0000","last_fullsized":"2023-10-08T16:25:04.184559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:45.404512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142570+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180117+0000","last_change":"2023-10-08T16:25:04.178756+0000","last_active":"2023-10-08T16:25:04.180117+0000","last_peered":"2023-10-08T16:25:04.180117+0000","last_clean":"2023-10-08T16:25:04.180117+0000","last_became_active":"2023-10-08T16:25:04.178493+0000","last_became_peered":"2023-10-08T16:25:04.178493+0000","last_unstale":"2023-10-08T16:25:04.180117+0000","last_undegraded":"2023-10-08T16:25:04.180117+0000","last_fullsized":"2023-10-08T16:25:04.180117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:09.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203675+0000","last_change":"2023-10-08T16:25:03.162613+0000","last_active":"2023-10-08T16:25:04.203675+0000","last_peered":"2023-10-08T16:25:04.203675+0000","last_clean":"2023-10-08T16:25:04.203675+0000","last_became_active":"2023-10-08T16:25:03.162298+0000","last_became_peered":"2023-10-08T16:25:03.162298+0000","last_unstale":"2023-10-08T16:25:04.203675+0000","last_undegraded":"2023-10-08T16:25:04.203675+0000","last_fullsized":"2023-10-08T16:25:04.203675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180635+0000","last_change":"2023-10-08T16:25:04.178425+0000","last_active":"2023-10-08T16:25:04.180635+0000","last_peered":"2023-10-08T16:25:04.180635+0000","last_clean":"2023-10-08T16:25:04.180635+0000","last_became_active":"2023-10-08T16:25:04.178158+0000","last_became_peered":"2023-10-08T16:25:04.178158+0000","last_unstale":"2023-10-08T16:25:04.180635+0000","last_undegraded":"2023-10-08T16:25:04.180635+0000","last_fullsized":"2023-10-08T16:25:04.180635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:52.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169658+0000","last_change":"2023-10-08T16:25:03.162457+0000","last_active":"2023-10-08T16:25:04.169658+0000","last_peered":"2023-10-08T16:25:04.169658+0000","last_clean":"2023-10-08T16:25:04.169658+0000","last_became_active":"2023-10-08T16:25:03.162174+0000","last_became_peered":"2023-10-08T16:25:03.162174+0000","last_unstale":"2023-10-08T16:25:04.169658+0000","last_undegraded":"2023-10-08T16:25:04.169658+0000","last_fullsized":"2023-10-08T16:25:04.169658+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:14.112628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178384+0000","last_change":"2023-10-08T16:25:04.176022+0000","last_active":"2023-10-08T16:25:04.178384+0000","last_peered":"2023-10-08T16:25:04.178384+0000","last_clean":"2023-10-08T16:25:04.178384+0000","last_became_active":"2023-10-08T16:25:04.175768+0000","last_became_peered":"2023-10-08T16:25:04.175768+0000","last_unstale":"2023-10-08T16:25:04.178384+0000","last_undegraded":"2023-10-08T16:25:04.178384+0000","last_fullsized":"2023-10-08T16:25:04.178384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:12.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186200+0000","last_change":"2023-10-08T16:25:03.167677+0000","last_active":"2023-10-08T16:25:04.186200+0000","last_peered":"2023-10-08T16:25:04.186200+0000","last_clean":"2023-10-08T16:25:04.186200+0000","last_became_active":"2023-10-08T16:25:03.167109+0000","last_became_peered":"2023-10-08T16:25:03.167109+0000","last_unstale":"2023-10-08T16:25:04.186200+0000","last_undegraded":"2023-10-08T16:25:04.186200+0000","last_fullsized":"2023-10-08T16:25:04.186200+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187315+0000","last_change":"2023-10-08T16:25:04.180103+0000","last_active":"2023-10-08T16:25:04.187315+0000","last_peered":"2023-10-08T16:25:04.187315+0000","last_clean":"2023-10-08T16:25:04.187315+0000","last_became_active":"2023-10-08T16:25:04.179854+0000","last_became_peered":"2023-10-08T16:25:04.179854+0000","last_unstale":"2023-10-08T16:25:04.187315+0000","last_undegraded":"2023-10-08T16:25:04.187315+0000","last_fullsized":"2023-10-08T16:25:04.187315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:15.320837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141234+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:30.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187138+0000","last_change":"2023-10-08T16:25:04.180924+0000","last_active":"2023-10-08T16:25:04.187138+0000","last_peered":"2023-10-08T16:25:04.187138+0000","last_clean":"2023-10-08T16:25:04.187138+0000","last_became_active":"2023-10-08T16:25:04.180659+0000","last_became_peered":"2023-10-08T16:25:04.180659+0000","last_unstale":"2023-10-08T16:25:04.187138+0000","last_undegraded":"2023-10-08T16:25:04.187138+0000","last_fullsized":"2023-10-08T16:25:04.187138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:03.340620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.172362+0000","last_change":"2023-10-08T16:25:03.152697+0000","last_active":"2023-10-08T16:25:04.172362+0000","last_peered":"2023-10-08T16:25:04.172362+0000","last_clean":"2023-10-08T16:25:04.172362+0000","last_became_active":"2023-10-08T16:25:03.152373+0000","last_became_peered":"2023-10-08T16:25:03.152373+0000","last_unstale":"2023-10-08T16:25:04.172362+0000","last_undegraded":"2023-10-08T16:25:04.172362+0000","last_fullsized":"2023-10-08T16:25:04.172362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:19.376954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186336+0000","last_change":"2023-10-08T16:25:04.179784+0000","last_active":"2023-10-08T16:25:04.186336+0000","last_peered":"2023-10-08T16:25:04.186336+0000","last_clean":"2023-10-08T16:25:04.186336+0000","last_became_active":"2023-10-08T16:25:04.179540+0000","last_became_peered":"2023-10-08T16:25:04.179540+0000","last_unstale":"2023-10-08T16:25:04.186336+0000","last_undegraded":"2023-10-08T16:25:04.186336+0000","last_fullsized":"2023-10-08T16:25:04.186336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205005+0000","last_change":"2023-10-08T16:25:03.167710+0000","last_active":"2023-10-08T16:25:04.205005+0000","last_peered":"2023-10-08T16:25:04.205005+0000","last_clean":"2023-10-08T16:25:04.205005+0000","last_became_active":"2023-10-08T16:25:03.167346+0000","last_became_peered":"2023-10-08T16:25:03.167346+0000","last_unstale":"2023-10-08T16:25:04.205005+0000","last_undegraded":"2023-10-08T16:25:04.205005+0000","last_fullsized":"2023-10-08T16:25:04.205005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141192+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:06:52.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196073+0000","last_change":"2023-10-08T16:25:04.189875+0000","last_active":"2023-10-08T16:25:04.196073+0000","last_peered":"2023-10-08T16:25:04.196073+0000","last_clean":"2023-10-08T16:25:04.196073+0000","last_became_active":"2023-10-08T16:25:04.189608+0000","last_became_peered":"2023-10-08T16:25:04.189608+0000","last_unstale":"2023-10-08T16:25:04.196073+0000","last_undegraded":"2023-10-08T16:25:04.196073+0000","last_fullsized":"2023-10-08T16:25:04.196073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:17.805094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174488+0000","last_change":"2023-10-08T16:25:03.159563+0000","last_active":"2023-10-08T16:25:04.174488+0000","last_peered":"2023-10-08T16:25:04.174488+0000","last_clean":"2023-10-08T16:25:04.174488+0000","last_became_active":"2023-10-08T16:25:03.159252+0000","last_became_peered":"2023-10-08T16:25:03.159252+0000","last_unstale":"2023-10-08T16:25:04.174488+0000","last_undegraded":"2023-10-08T16:25:04.174488+0000","last_fullsized":"2023-10-08T16:25:04.174488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:09.955599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186235+0000","last_change":"2023-10-08T16:25:04.182673+0000","last_active":"2023-10-08T16:25:04.186235+0000","last_peered":"2023-10-08T16:25:04.186235+0000","last_clean":"2023-10-08T16:25:04.186235+0000","last_became_active":"2023-10-08T16:25:04.182368+0000","last_became_peered":"2023-10-08T16:25:04.182368+0000","last_unstale":"2023-10-08T16:25:04.186235+0000","last_undegraded":"2023-10-08T16:25:04.186235+0000","last_fullsized":"2023-10-08T16:25:04.186235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:41.602049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170934+0000","last_change":"2023-10-08T16:25:03.153859+0000","last_active":"2023-10-08T16:25:04.170934+0000","last_peered":"2023-10-08T16:25:04.170934+0000","last_clean":"2023-10-08T16:25:04.170934+0000","last_became_active":"2023-10-08T16:25:03.153583+0000","last_became_peered":"2023-10-08T16:25:03.153583+0000","last_unstale":"2023-10-08T16:25:04.170934+0000","last_undegraded":"2023-10-08T16:25:04.170934+0000","last_fullsized":"2023-10-08T16:25:04.170934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:55.498306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191111+0000","last_change":"2023-10-08T16:25:04.188418+0000","last_active":"2023-10-08T16:25:04.191111+0000","last_peered":"2023-10-08T16:25:04.191111+0000","last_clean":"2023-10-08T16:25:04.191111+0000","last_became_active":"2023-10-08T16:25:04.188160+0000","last_became_peered":"2023-10-08T16:25:04.188160+0000","last_unstale":"2023-10-08T16:25:04.191111+0000","last_undegraded":"2023-10-08T16:25:04.191111+0000","last_fullsized":"2023-10-08T16:25:04.191111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:42.749730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174357+0000","last_change":"2023-10-08T16:25:03.154067+0000","last_active":"2023-10-08T16:25:04.174357+0000","last_peered":"2023-10-08T16:25:04.174357+0000","last_clean":"2023-10-08T16:25:04.174357+0000","last_became_active":"2023-10-08T16:25:03.153792+0000","last_became_peered":"2023-10-08T16:25:03.153792+0000","last_unstale":"2023-10-08T16:25:04.174357+0000","last_undegraded":"2023-10-08T16:25:04.174357+0000","last_fullsized":"2023-10-08T16:25:04.174357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:05.481126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.193106+0000","last_change":"2023-10-08T16:25:04.188647+0000","last_active":"2023-10-08T16:25:04.193106+0000","last_peered":"2023-10-08T16:25:04.193106+0000","last_clean":"2023-10-08T16:25:04.193106+0000","last_became_active":"2023-10-08T16:25:04.187982+0000","last_became_peered":"2023-10-08T16:25:04.187982+0000","last_unstale":"2023-10-08T16:25:04.193106+0000","last_undegraded":"2023-10-08T16:25:04.193106+0000","last_fullsized":"2023-10-08T16:25:04.193106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168357+0000","last_change":"2023-10-08T16:25:03.161066+0000","last_active":"2023-10-08T16:25:04.168357+0000","last_peered":"2023-10-08T16:25:04.168357+0000","last_clean":"2023-10-08T16:25:04.168357+0000","last_became_active":"2023-10-08T16:25:03.160765+0000","last_became_peered":"2023-10-08T16:25:03.160765+0000","last_unstale":"2023-10-08T16:25:04.168357+0000","last_undegraded":"2023-10-08T16:25:04.168357+0000","last_fullsized":"2023-10-08T16:25:04.168357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:23.727949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187451+0000","last_change":"2023-10-08T16:25:04.181787+0000","last_active":"2023-10-08T16:25:04.187451+0000","last_peered":"2023-10-08T16:25:04.187451+0000","last_clean":"2023-10-08T16:25:04.187451+0000","last_became_active":"2023-10-08T16:25:04.181507+0000","last_became_peered":"2023-10-08T16:25:04.181507+0000","last_unstale":"2023-10-08T16:25:04.187451+0000","last_undegraded":"2023-10-08T16:25:04.187451+0000","last_fullsized":"2023-10-08T16:25:04.187451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:10.414471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142897+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189861+0000","last_change":"2023-10-08T16:25:04.186865+0000","last_active":"2023-10-08T16:25:04.189861+0000","last_peered":"2023-10-08T16:25:04.189861+0000","last_clean":"2023-10-08T16:25:04.189861+0000","last_became_active":"2023-10-08T16:25:04.185912+0000","last_became_peered":"2023-10-08T16:25:04.185912+0000","last_unstale":"2023-10-08T16:25:04.189861+0000","last_undegraded":"2023-10-08T16:25:04.189861+0000","last_fullsized":"2023-10-08T16:25:04.189861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.177861+0000","last_change":"2023-10-08T16:25:03.166929+0000","last_active":"2023-10-08T16:25:04.177861+0000","last_peered":"2023-10-08T16:25:04.177861+0000","last_clean":"2023-10-08T16:25:04.177861+0000","last_became_active":"2023-10-08T16:25:03.166366+0000","last_became_peered":"2023-10-08T16:25:03.166366+0000","last_unstale":"2023-10-08T16:25:04.177861+0000","last_undegraded":"2023-10-08T16:25:04.177861+0000","last_fullsized":"2023-10-08T16:25:04.177861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196970+0000","last_change":"2023-10-08T16:25:04.193416+0000","last_active":"2023-10-08T16:25:04.196970+0000","last_peered":"2023-10-08T16:25:04.196970+0000","last_clean":"2023-10-08T16:25:04.196970+0000","last_became_active":"2023-10-08T16:25:04.193106+0000","last_became_peered":"2023-10-08T16:25:04.193106+0000","last_unstale":"2023-10-08T16:25:04.196970+0000","last_undegraded":"2023-10-08T16:25:04.196970+0000","last_fullsized":"2023-10-08T16:25:04.196970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:09.405286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205316+0000","last_change":"2023-10-08T16:25:03.168169+0000","last_active":"2023-10-08T16:25:04.205316+0000","last_peered":"2023-10-08T16:25:04.205316+0000","last_clean":"2023-10-08T16:25:04.205316+0000","last_became_active":"2023-10-08T16:25:03.167889+0000","last_became_peered":"2023-10-08T16:25:03.167889+0000","last_unstale":"2023-10-08T16:25:04.205316+0000","last_undegraded":"2023-10-08T16:25:04.205316+0000","last_fullsized":"2023-10-08T16:25:04.205316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"88'183","reported_seq":469,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168988+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:04.168988+0000","last_peered":"2023-10-08T16:25:04.168988+0000","last_clean":"2023-10-08T16:25:04.168988+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:04.168988+0000","last_undegraded":"2023-10-08T16:25:04.168988+0000","last_fullsized":"2023-10-08T16:25:04.168988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307248,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064592,"statfs":{"total":96636764160,"available":96322142208,"internally_reserved":0,"allocated":1810432,"data_stored":1176158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.48499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97199999999999998,"5min":0.98299999999999998,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.089},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.032,"15min":1.1000000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.234},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.53000000000000003,"5min":0.439,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3919999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.351,"5min":1.351,"15min":1.3680000000000001},"last":1.073},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.323},"last":1.085},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.448},"last":1.0589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":0.96399999999999997,"15min":1.125},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.65700000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.99199999999999999,"15min":1.365},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.997,"15min":1.0549999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":1.071,"15min":1.552},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.4570000000000001},"last":0.752}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72999999999999998,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.0149999999999999,"15min":1.069},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.619},"last":0.77800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.272,"15min":1.272},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.74099999999999999},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85699999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.85599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":587326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44400000000000001,"15min":0.45000000000000001},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.873},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.82199999999999995,"15min":1.0680000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.65400000000000003,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.629},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":1.472},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.026,"15min":1.373},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.2230000000000001,"15min":1.375},"last":0.84899999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":1.157,"15min":1.276},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.085,"15min":1.224},"last":0.72399999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.63400000000000001,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0069999999999999,"5min":1.0800000000000001,"15min":1.429},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0209999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0109999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0960000000000001,"15min":1.514},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1802240,"data_stored":1175570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":1220608,"data_stored":586738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.30499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.32500000000000001,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.504}]},{"osd":2,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.79200000000000004,"5min":1,"15min":1},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":1.0589999999999999,"5min":1.093,"15min":1.3200000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.996,"5min":1.1799999999999999,"15min":1.397},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82399999999999995,"15min":0.84899999999999998},"min":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.0429999999999999,"5min":1.153,"15min":1.306},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.321},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1171456,"data_stored":564712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.54100000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.56999999999999995,"5min":0.504,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.60399999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.004,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.754,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.085,"15min":1.216},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1479999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.505,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0309999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.47,"15min":1.47},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.022,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65100000000000002},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":0.97099999999999997,"5min":2.661,"15min":2.661},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.117,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0760000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":558515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.47999999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:09.144 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.363+0000 7f21d4f9d700 1 Processor -- start 2023-10-08T16:25:09.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.363+0000 7f21d4f9d700 1 -- start start 2023-10-08T16:25:09.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.364+0000 7f21d4f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d015dfd0 0x7f21d00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.364+0000 7f21d4f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21d0159920 0x7f21d00ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.364+0000 7f21d4f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21d00acc00 con 0x7f21d0159550 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.364+0000 7f21d4f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00abff0 con 0x7f21d0159920 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.364+0000 7f21d4f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00ac2d0 con 0x7f21d015dfd0 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21d0159920 0x7f21d00ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f21d0159920 0x7f21d00ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36472/0 (socket says 172.21.15.12:36472) 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cf7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f21d0159550 0x7f21d00ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56266/0 (socket says 172.21.15.12:56266) 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 -- 172.21.15.12:0/2849004138 learned_addr learned my addr 172.21.15.12:0/2849004138 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:09.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21ceffd700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d015dfd0 0x7f21d00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 -- 172.21.15.12:0/2849004138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d015dfd0 msgr2=0x7f21d00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d015dfd0 0x7f21d00aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 -- 172.21.15.12:0/2849004138 >> v1:172.21.15.12:6789/0 conn(0x7f21d0159550 legacy=0x7f21d00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21cffff700 1 -- 172.21.15.12:0/2849004138 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00ac5b0 con 0x7f21d0159920 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.365+0000 7f21ce7fc700 1 -- 172.21.15.12:0/2849004138 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434262031 0 0) 0x7f21d00acc00 con 0x7f21d0159550 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21cffff700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00ad090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009f20 tx=0x7f21c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79e2a88437f929e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21ce7fc700 1 -- 172.21.15.12:0/2849004138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c800e070 con 0x7f21d0159920 2023-10-08T16:25:09.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21ce7fc700 1 -- 172.21.15.12:0/2849004138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c800b9d0 con 0x7f21d0159920 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21ce7fc700 1 -- 172.21.15.12:0/2849004138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c80092e0 con 0x7f21d0159920 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 -- 172.21.15.12:0/2849004138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 msgr2=0x7f21d00ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00ad090 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f21c8009f20 tx=0x7f21c8009840 comp rx=0 tx=0).stop 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 -- 172.21.15.12:0/2849004138 shutdown_connections 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00ad090 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/2849004138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d015dfd0 0x7f21d00aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 -- 172.21.15.12:0/2849004138 >> 172.21.15.12:0/2849004138 conn(0x7f21d006ce80 msgr2=0x7f21d00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 -- 172.21.15.12:0/2849004138 shutdown_connections 2023-10-08T16:25:09.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.366+0000 7f21d4f9d700 1 -- 172.21.15.12:0/2849004138 wait complete. 2023-10-08T16:25:09.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.368+0000 7f21d4f9d700 1 Processor -- start 2023-10-08T16:25:09.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.368+0000 7f21d4f9d700 1 -- start start 2023-10-08T16:25:09.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d0159550 0x7f21d01697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21d015dfd0 0x7f21d01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0150700 con 0x7f21d0159920 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d014e380 con 0x7f21d015dfd0 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21d4f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c7560 con 0x7f21d0159550 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21ceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21ceffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36488/0 (socket says 172.21.15.12:36488) 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21ceffd700 1 -- 172.21.15.12:0/4266169459 learned_addr learned my addr 172.21.15.12:0/4266169459 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21cf7fe700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d0159550 0x7f21d01697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.369+0000 7f21cffff700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21d015dfd0 0x7f21d01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 -- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d0159550 msgr2=0x7f21d01697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d0159550 0x7f21d01697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 -- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21d015dfd0 msgr2=0x7f21d01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21d015dfd0 0x7f21d01501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 -- 172.21.15.12:0/4266169459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c8009ae0 con 0x7f21d0159920 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21ceffd700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e930 tx=0x7f21c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013680 con 0x7f21d0159920 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40137e0 con 0x7f21d0159920 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4013b80 con 0x7f21d0159920 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d00c7820 con 0x7f21d0159920 2023-10-08T16:25:09.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.370+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d014dfe0 con 0x7f21d0159920 2023-10-08T16:25:09.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.371+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d014e530 con 0x7f21d0159920 2023-10-08T16:25:09.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.372+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21c400c3e0 con 0x7f21d0159920 2023-10-08T16:25:09.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.373+0000 7f21b77fe700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.373+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f21c40847e0 con 0x7f21d0159920 2023-10-08T16:25:09.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.373+0000 7f21cf7fe700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.374+0000 7f21cf7fe700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 0x7f21bc0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007fd0 tx=0x7f21c0007d50 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.377+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21d014e530 con 0x7f21d0159920 2023-10-08T16:25:09.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.580+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f21d014e4f0 con 0x7f21bc066f30 2023-10-08T16:25:09.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.589+0000 7f21b77fe700 1 -- 172.21.15.12:0/4266169459 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286540 (secure 0 0 0) 0x7f21d014e4f0 con 0x7f21bc066f30 2023-10-08T16:25:09.593 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 msgr2=0x7f21bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 0x7f21bc0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f21c0007fd0 tx=0x7f21c0007d50 comp rx=0 tx=0).stop 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 msgr2=0x7f21d00686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f21c400e930 tx=0x7f21c40091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 shutdown_connections 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f21bc066f30 0x7f21bc0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f21d015dfd0 0x7f21d01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f21d0159550 0x7f21d01697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 --2- 172.21.15.12:0/4266169459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f21d0159920 0x7f21d00686a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 >> 172.21.15.12:0/4266169459 conn(0x7f21d006ce80 msgr2=0x7f21d0154ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 shutdown_connections 2023-10-08T16:25:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.593+0000 7f21d4f9d700 1 -- 172.21.15.12:0/4266169459 wait complete. 2023-10-08T16:25:09.597 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:09.611 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:25:07.633348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":305,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":162,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438028,"kb_used_data":10572,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752536692,"statfs":{"total":773094113280,"available":770597572608,"internally_reserved":0,"allocated":10825728,"data_stored":5819627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.495220"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187439+0000","last_change":"2023-10-08T16:25:04.184423+0000","last_active":"2023-10-08T16:25:04.187439+0000","last_peered":"2023-10-08T16:25:04.187439+0000","last_clean":"2023-10-08T16:25:04.187439+0000","last_became_active":"2023-10-08T16:25:04.184164+0000","last_became_peered":"2023-10-08T16:25:04.184164+0000","last_unstale":"2023-10-08T16:25:04.187439+0000","last_undegraded":"2023-10-08T16:25:04.187439+0000","last_fullsized":"2023-10-08T16:25:04.187439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:41.179128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197698+0000","last_change":"2023-10-08T16:25:04.195798+0000","last_active":"2023-10-08T16:25:04.197698+0000","last_peered":"2023-10-08T16:25:04.197698+0000","last_clean":"2023-10-08T16:25:04.197698+0000","last_became_active":"2023-10-08T16:25:04.195557+0000","last_became_peered":"2023-10-08T16:25:04.195557+0000","last_unstale":"2023-10-08T16:25:04.197698+0000","last_undegraded":"2023-10-08T16:25:04.197698+0000","last_fullsized":"2023-10-08T16:25:04.197698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:52.084740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185291+0000","last_change":"2023-10-08T16:25:04.177365+0000","last_active":"2023-10-08T16:25:04.185291+0000","last_peered":"2023-10-08T16:25:04.185291+0000","last_clean":"2023-10-08T16:25:04.185291+0000","last_became_active":"2023-10-08T16:25:04.177078+0000","last_became_peered":"2023-10-08T16:25:04.177078+0000","last_unstale":"2023-10-08T16:25:04.185291+0000","last_undegraded":"2023-10-08T16:25:04.185291+0000","last_fullsized":"2023-10-08T16:25:04.185291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:32.063542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191108+0000","last_change":"2023-10-08T16:25:04.189784+0000","last_active":"2023-10-08T16:25:04.191108+0000","last_peered":"2023-10-08T16:25:04.191108+0000","last_clean":"2023-10-08T16:25:04.191108+0000","last_became_active":"2023-10-08T16:25:04.189487+0000","last_became_peered":"2023-10-08T16:25:04.189487+0000","last_unstale":"2023-10-08T16:25:04.191108+0000","last_undegraded":"2023-10-08T16:25:04.191108+0000","last_fullsized":"2023-10-08T16:25:04.191108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:32.166576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185816+0000","last_change":"2023-10-08T16:25:04.183703+0000","last_active":"2023-10-08T16:25:04.185816+0000","last_peered":"2023-10-08T16:25:04.185816+0000","last_clean":"2023-10-08T16:25:04.185816+0000","last_became_active":"2023-10-08T16:25:04.183400+0000","last_became_peered":"2023-10-08T16:25:04.183400+0000","last_unstale":"2023-10-08T16:25:04.185816+0000","last_undegraded":"2023-10-08T16:25:04.185816+0000","last_fullsized":"2023-10-08T16:25:04.185816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:34.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.190552+0000","last_change":"2023-10-08T16:25:04.189167+0000","last_active":"2023-10-08T16:25:04.190552+0000","last_peered":"2023-10-08T16:25:04.190552+0000","last_clean":"2023-10-08T16:25:04.190552+0000","last_became_active":"2023-10-08T16:25:04.188893+0000","last_became_peered":"2023-10-08T16:25:04.188893+0000","last_unstale":"2023-10-08T16:25:04.190552+0000","last_undegraded":"2023-10-08T16:25:04.190552+0000","last_fullsized":"2023-10-08T16:25:04.190552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189887+0000","last_change":"2023-10-08T16:25:04.187710+0000","last_active":"2023-10-08T16:25:04.189887+0000","last_peered":"2023-10-08T16:25:04.189887+0000","last_clean":"2023-10-08T16:25:04.189887+0000","last_became_active":"2023-10-08T16:25:04.187434+0000","last_became_peered":"2023-10-08T16:25:04.187434+0000","last_unstale":"2023-10-08T16:25:04.189887+0000","last_undegraded":"2023-10-08T16:25:04.189887+0000","last_fullsized":"2023-10-08T16:25:04.189887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:34.020887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191642+0000","last_change":"2023-10-08T16:25:04.188642+0000","last_active":"2023-10-08T16:25:04.191642+0000","last_peered":"2023-10-08T16:25:04.191642+0000","last_clean":"2023-10-08T16:25:04.191642+0000","last_became_active":"2023-10-08T16:25:04.188360+0000","last_became_peered":"2023-10-08T16:25:04.188360+0000","last_unstale":"2023-10-08T16:25:04.191642+0000","last_undegraded":"2023-10-08T16:25:04.191642+0000","last_fullsized":"2023-10-08T16:25:04.191642+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:18.725697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187648+0000","last_change":"2023-10-08T16:25:04.186151+0000","last_active":"2023-10-08T16:25:04.187648+0000","last_peered":"2023-10-08T16:25:04.187648+0000","last_clean":"2023-10-08T16:25:04.187648+0000","last_became_active":"2023-10-08T16:25:04.185901+0000","last_became_peered":"2023-10-08T16:25:04.185901+0000","last_unstale":"2023-10-08T16:25:04.187648+0000","last_undegraded":"2023-10-08T16:25:04.187648+0000","last_fullsized":"2023-10-08T16:25:04.187648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:54.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180136+0000","last_change":"2023-10-08T16:25:04.179317+0000","last_active":"2023-10-08T16:25:04.180136+0000","last_peered":"2023-10-08T16:25:04.180136+0000","last_clean":"2023-10-08T16:25:04.180136+0000","last_became_active":"2023-10-08T16:25:04.179073+0000","last_became_peered":"2023-10-08T16:25:04.179073+0000","last_unstale":"2023-10-08T16:25:04.180136+0000","last_undegraded":"2023-10-08T16:25:04.180136+0000","last_fullsized":"2023-10-08T16:25:04.180136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:31.655970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180881+0000","last_change":"2023-10-08T16:25:04.179129+0000","last_active":"2023-10-08T16:25:04.180881+0000","last_peered":"2023-10-08T16:25:04.180881+0000","last_clean":"2023-10-08T16:25:04.180881+0000","last_became_active":"2023-10-08T16:25:04.178872+0000","last_became_peered":"2023-10-08T16:25:04.178872+0000","last_unstale":"2023-10-08T16:25:04.180881+0000","last_undegraded":"2023-10-08T16:25:04.180881+0000","last_fullsized":"2023-10-08T16:25:04.180881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:13.196602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185882+0000","last_change":"2023-10-08T16:25:04.184043+0000","last_active":"2023-10-08T16:25:04.185882+0000","last_peered":"2023-10-08T16:25:04.185882+0000","last_clean":"2023-10-08T16:25:04.185882+0000","last_became_active":"2023-10-08T16:25:04.183715+0000","last_became_peered":"2023-10-08T16:25:04.183715+0000","last_unstale":"2023-10-08T16:25:04.185882+0000","last_undegraded":"2023-10-08T16:25:04.185882+0000","last_fullsized":"2023-10-08T16:25:04.185882+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:42.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186771+0000","last_change":"2023-10-08T16:25:04.180663+0000","last_active":"2023-10-08T16:25:04.186771+0000","last_peered":"2023-10-08T16:25:04.186771+0000","last_clean":"2023-10-08T16:25:04.186771+0000","last_became_active":"2023-10-08T16:25:04.180367+0000","last_became_peered":"2023-10-08T16:25:04.180367+0000","last_unstale":"2023-10-08T16:25:04.186771+0000","last_undegraded":"2023-10-08T16:25:04.186771+0000","last_fullsized":"2023-10-08T16:25:04.186771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:23.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191623+0000","last_change":"2023-10-08T16:25:04.188079+0000","last_active":"2023-10-08T16:25:04.191623+0000","last_peered":"2023-10-08T16:25:04.191623+0000","last_clean":"2023-10-08T16:25:04.191623+0000","last_became_active":"2023-10-08T16:25:04.187727+0000","last_became_peered":"2023-10-08T16:25:04.187727+0000","last_unstale":"2023-10-08T16:25:04.191623+0000","last_undegraded":"2023-10-08T16:25:04.191623+0000","last_fullsized":"2023-10-08T16:25:04.191623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:13.467148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195074+0000","last_change":"2023-10-08T16:25:04.191268+0000","last_active":"2023-10-08T16:25:04.195074+0000","last_peered":"2023-10-08T16:25:04.195074+0000","last_clean":"2023-10-08T16:25:04.195074+0000","last_became_active":"2023-10-08T16:25:04.191011+0000","last_became_peered":"2023-10-08T16:25:04.191011+0000","last_unstale":"2023-10-08T16:25:04.195074+0000","last_undegraded":"2023-10-08T16:25:04.195074+0000","last_fullsized":"2023-10-08T16:25:04.195074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:59.573275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189821+0000","last_change":"2023-10-08T16:25:04.186950+0000","last_active":"2023-10-08T16:25:04.189821+0000","last_peered":"2023-10-08T16:25:04.189821+0000","last_clean":"2023-10-08T16:25:04.189821+0000","last_became_active":"2023-10-08T16:25:04.186176+0000","last_became_peered":"2023-10-08T16:25:04.186176+0000","last_unstale":"2023-10-08T16:25:04.189821+0000","last_undegraded":"2023-10-08T16:25:04.189821+0000","last_fullsized":"2023-10-08T16:25:04.189821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186737+0000","last_change":"2023-10-08T16:25:04.184950+0000","last_active":"2023-10-08T16:25:04.186737+0000","last_peered":"2023-10-08T16:25:04.186737+0000","last_clean":"2023-10-08T16:25:04.186737+0000","last_became_active":"2023-10-08T16:25:04.184706+0000","last_became_peered":"2023-10-08T16:25:04.184706+0000","last_unstale":"2023-10-08T16:25:04.186737+0000","last_undegraded":"2023-10-08T16:25:04.186737+0000","last_fullsized":"2023-10-08T16:25:04.186737+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:01.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181007+0000","last_change":"2023-10-08T16:25:04.174122+0000","last_active":"2023-10-08T16:25:04.181007+0000","last_peered":"2023-10-08T16:25:04.181007+0000","last_clean":"2023-10-08T16:25:04.181007+0000","last_became_active":"2023-10-08T16:25:04.173291+0000","last_became_peered":"2023-10-08T16:25:04.173291+0000","last_unstale":"2023-10-08T16:25:04.181007+0000","last_undegraded":"2023-10-08T16:25:04.181007+0000","last_fullsized":"2023-10-08T16:25:04.181007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:10.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198378+0000","last_change":"2023-10-08T16:25:04.192678+0000","last_active":"2023-10-08T16:25:04.198378+0000","last_peered":"2023-10-08T16:25:04.198378+0000","last_clean":"2023-10-08T16:25:04.198378+0000","last_became_active":"2023-10-08T16:25:04.192313+0000","last_became_peered":"2023-10-08T16:25:04.192313+0000","last_unstale":"2023-10-08T16:25:04.198378+0000","last_undegraded":"2023-10-08T16:25:04.198378+0000","last_fullsized":"2023-10-08T16:25:04.198378+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:09.011682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187351+0000","last_change":"2023-10-08T16:25:04.179325+0000","last_active":"2023-10-08T16:25:04.187351+0000","last_peered":"2023-10-08T16:25:04.187351+0000","last_clean":"2023-10-08T16:25:04.187351+0000","last_became_active":"2023-10-08T16:25:04.179060+0000","last_became_peered":"2023-10-08T16:25:04.179060+0000","last_unstale":"2023-10-08T16:25:04.187351+0000","last_undegraded":"2023-10-08T16:25:04.187351+0000","last_fullsized":"2023-10-08T16:25:04.187351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.524280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.173119+0000","last_change":"2023-10-08T16:25:04.169007+0000","last_active":"2023-10-08T16:25:04.173119+0000","last_peered":"2023-10-08T16:25:04.173119+0000","last_clean":"2023-10-08T16:25:04.173119+0000","last_became_active":"2023-10-08T16:25:04.168737+0000","last_became_peered":"2023-10-08T16:25:04.168737+0000","last_unstale":"2023-10-08T16:25:04.173119+0000","last_undegraded":"2023-10-08T16:25:04.173119+0000","last_fullsized":"2023-10-08T16:25:04.173119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:35.049597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189867+0000","last_change":"2023-10-08T16:25:04.185447+0000","last_active":"2023-10-08T16:25:04.189867+0000","last_peered":"2023-10-08T16:25:04.189867+0000","last_clean":"2023-10-08T16:25:04.189867+0000","last_became_active":"2023-10-08T16:25:04.184933+0000","last_became_peered":"2023-10-08T16:25:04.184933+0000","last_unstale":"2023-10-08T16:25:04.189867+0000","last_undegraded":"2023-10-08T16:25:04.189867+0000","last_fullsized":"2023-10-08T16:25:04.189867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198445+0000","last_change":"2023-10-08T16:25:04.191293+0000","last_active":"2023-10-08T16:25:04.198445+0000","last_peered":"2023-10-08T16:25:04.198445+0000","last_clean":"2023-10-08T16:25:04.198445+0000","last_became_active":"2023-10-08T16:25:04.190977+0000","last_became_peered":"2023-10-08T16:25:04.190977+0000","last_unstale":"2023-10-08T16:25:04.198445+0000","last_undegraded":"2023-10-08T16:25:04.198445+0000","last_fullsized":"2023-10-08T16:25:04.198445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:51.509709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203048+0000","last_change":"2023-10-08T16:25:03.164351+0000","last_active":"2023-10-08T16:25:04.203048+0000","last_peered":"2023-10-08T16:25:04.203048+0000","last_clean":"2023-10-08T16:25:04.203048+0000","last_became_active":"2023-10-08T16:25:03.164093+0000","last_became_peered":"2023-10-08T16:25:03.164093+0000","last_unstale":"2023-10-08T16:25:04.203048+0000","last_undegraded":"2023-10-08T16:25:04.203048+0000","last_fullsized":"2023-10-08T16:25:04.203048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:31.593169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187950+0000","last_change":"2023-10-08T16:25:04.186164+0000","last_active":"2023-10-08T16:25:04.187950+0000","last_peered":"2023-10-08T16:25:04.187950+0000","last_clean":"2023-10-08T16:25:04.187950+0000","last_became_active":"2023-10-08T16:25:04.185913+0000","last_became_peered":"2023-10-08T16:25:04.185913+0000","last_unstale":"2023-10-08T16:25:04.187950+0000","last_undegraded":"2023-10-08T16:25:04.187950+0000","last_fullsized":"2023-10-08T16:25:04.187950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:46.826902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195545+0000","last_change":"2023-10-08T16:25:03.158268+0000","last_active":"2023-10-08T16:25:04.195545+0000","last_peered":"2023-10-08T16:25:04.195545+0000","last_clean":"2023-10-08T16:25:04.195545+0000","last_became_active":"2023-10-08T16:25:03.157949+0000","last_became_peered":"2023-10-08T16:25:03.157949+0000","last_unstale":"2023-10-08T16:25:04.195545+0000","last_undegraded":"2023-10-08T16:25:04.195545+0000","last_fullsized":"2023-10-08T16:25:04.195545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:06.052973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.192079+0000","last_change":"2023-10-08T16:25:04.189419+0000","last_active":"2023-10-08T16:25:04.192079+0000","last_peered":"2023-10-08T16:25:04.192079+0000","last_clean":"2023-10-08T16:25:04.192079+0000","last_became_active":"2023-10-08T16:25:04.189092+0000","last_became_peered":"2023-10-08T16:25:04.189092+0000","last_unstale":"2023-10-08T16:25:04.192079+0000","last_undegraded":"2023-10-08T16:25:04.192079+0000","last_fullsized":"2023-10-08T16:25:04.192079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142650+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184564+0000","last_change":"2023-10-08T16:25:04.181450+0000","last_active":"2023-10-08T16:25:04.184564+0000","last_peered":"2023-10-08T16:25:04.184564+0000","last_clean":"2023-10-08T16:25:04.184564+0000","last_became_active":"2023-10-08T16:25:04.181162+0000","last_became_peered":"2023-10-08T16:25:04.181162+0000","last_unstale":"2023-10-08T16:25:04.184564+0000","last_undegraded":"2023-10-08T16:25:04.184564+0000","last_fullsized":"2023-10-08T16:25:04.184564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:05.833282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205224+0000","last_change":"2023-10-08T16:25:03.167869+0000","last_active":"2023-10-08T16:25:04.205224+0000","last_peered":"2023-10-08T16:25:04.205224+0000","last_clean":"2023-10-08T16:25:04.205224+0000","last_became_active":"2023-10-08T16:25:03.167391+0000","last_became_peered":"2023-10-08T16:25:03.167391+0000","last_unstale":"2023-10-08T16:25:04.205224+0000","last_undegraded":"2023-10-08T16:25:04.205224+0000","last_fullsized":"2023-10-08T16:25:04.205224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196986+0000","last_change":"2023-10-08T16:25:03.157433+0000","last_active":"2023-10-08T16:25:04.196986+0000","last_peered":"2023-10-08T16:25:04.196986+0000","last_clean":"2023-10-08T16:25:04.196986+0000","last_became_active":"2023-10-08T16:25:03.156742+0000","last_became_peered":"2023-10-08T16:25:03.156742+0000","last_unstale":"2023-10-08T16:25:04.196986+0000","last_undegraded":"2023-10-08T16:25:04.196986+0000","last_fullsized":"2023-10-08T16:25:04.196986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:09.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.200954+0000","last_change":"2023-10-08T16:25:03.167402+0000","last_active":"2023-10-08T16:25:04.200954+0000","last_peered":"2023-10-08T16:25:04.200954+0000","last_clean":"2023-10-08T16:25:04.200954+0000","last_became_active":"2023-10-08T16:25:03.166793+0000","last_became_peered":"2023-10-08T16:25:03.166793+0000","last_unstale":"2023-10-08T16:25:04.200954+0000","last_undegraded":"2023-10-08T16:25:04.200954+0000","last_fullsized":"2023-10-08T16:25:04.200954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:17.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185722+0000","last_change":"2023-10-08T16:25:04.182471+0000","last_active":"2023-10-08T16:25:04.185722+0000","last_peered":"2023-10-08T16:25:04.185722+0000","last_clean":"2023-10-08T16:25:04.185722+0000","last_became_active":"2023-10-08T16:25:04.182191+0000","last_became_peered":"2023-10-08T16:25:04.182191+0000","last_unstale":"2023-10-08T16:25:04.185722+0000","last_undegraded":"2023-10-08T16:25:04.185722+0000","last_fullsized":"2023-10-08T16:25:04.185722+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:43.756265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169520+0000","last_change":"2023-10-08T16:25:03.161798+0000","last_active":"2023-10-08T16:25:04.169520+0000","last_peered":"2023-10-08T16:25:04.169520+0000","last_clean":"2023-10-08T16:25:04.169520+0000","last_became_active":"2023-10-08T16:25:03.161354+0000","last_became_peered":"2023-10-08T16:25:03.161354+0000","last_unstale":"2023-10-08T16:25:04.169520+0000","last_undegraded":"2023-10-08T16:25:04.169520+0000","last_fullsized":"2023-10-08T16:25:04.169520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:10.765932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186790+0000","last_change":"2023-10-08T16:25:04.184609+0000","last_active":"2023-10-08T16:25:04.186790+0000","last_peered":"2023-10-08T16:25:04.186790+0000","last_clean":"2023-10-08T16:25:04.186790+0000","last_became_active":"2023-10-08T16:25:04.184287+0000","last_became_peered":"2023-10-08T16:25:04.184287+0000","last_unstale":"2023-10-08T16:25:04.186790+0000","last_undegraded":"2023-10-08T16:25:04.186790+0000","last_fullsized":"2023-10-08T16:25:04.186790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:17.070085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.171820+0000","last_change":"2023-10-08T16:25:03.161010+0000","last_active":"2023-10-08T16:25:04.171820+0000","last_peered":"2023-10-08T16:25:04.171820+0000","last_clean":"2023-10-08T16:25:04.171820+0000","last_became_active":"2023-10-08T16:25:03.160730+0000","last_became_peered":"2023-10-08T16:25:03.160730+0000","last_unstale":"2023-10-08T16:25:04.171820+0000","last_undegraded":"2023-10-08T16:25:04.171820+0000","last_fullsized":"2023-10-08T16:25:04.171820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:40.198475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142702+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:42.750989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198374+0000","last_change":"2023-10-08T16:25:04.191823+0000","last_active":"2023-10-08T16:25:04.198374+0000","last_peered":"2023-10-08T16:25:04.198374+0000","last_clean":"2023-10-08T16:25:04.198374+0000","last_became_active":"2023-10-08T16:25:04.191483+0000","last_became_peered":"2023-10-08T16:25:04.191483+0000","last_unstale":"2023-10-08T16:25:04.198374+0000","last_undegraded":"2023-10-08T16:25:04.198374+0000","last_fullsized":"2023-10-08T16:25:04.198374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:37.197720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186603+0000","last_change":"2023-10-08T16:25:03.167559+0000","last_active":"2023-10-08T16:25:04.186603+0000","last_peered":"2023-10-08T16:25:04.186603+0000","last_clean":"2023-10-08T16:25:04.186603+0000","last_became_active":"2023-10-08T16:25:03.167203+0000","last_became_peered":"2023-10-08T16:25:03.167203+0000","last_unstale":"2023-10-08T16:25:04.186603+0000","last_undegraded":"2023-10-08T16:25:04.186603+0000","last_fullsized":"2023-10-08T16:25:04.186603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189905+0000","last_change":"2023-10-08T16:25:04.187189+0000","last_active":"2023-10-08T16:25:04.189905+0000","last_peered":"2023-10-08T16:25:04.189905+0000","last_clean":"2023-10-08T16:25:04.189905+0000","last_became_active":"2023-10-08T16:25:04.186869+0000","last_became_peered":"2023-10-08T16:25:04.186869+0000","last_unstale":"2023-10-08T16:25:04.189905+0000","last_undegraded":"2023-10-08T16:25:04.189905+0000","last_fullsized":"2023-10-08T16:25:04.189905+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197991+0000","last_change":"2023-10-08T16:25:03.152315+0000","last_active":"2023-10-08T16:25:04.197991+0000","last_peered":"2023-10-08T16:25:04.197991+0000","last_clean":"2023-10-08T16:25:04.197991+0000","last_became_active":"2023-10-08T16:25:03.152015+0000","last_became_peered":"2023-10-08T16:25:03.152015+0000","last_unstale":"2023-10-08T16:25:04.197991+0000","last_undegraded":"2023-10-08T16:25:04.197991+0000","last_fullsized":"2023-10-08T16:25:04.197991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:04.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180615+0000","last_change":"2023-10-08T16:25:04.177909+0000","last_active":"2023-10-08T16:25:04.180615+0000","last_peered":"2023-10-08T16:25:04.180615+0000","last_clean":"2023-10-08T16:25:04.180615+0000","last_became_active":"2023-10-08T16:25:04.177426+0000","last_became_peered":"2023-10-08T16:25:04.177426+0000","last_unstale":"2023-10-08T16:25:04.180615+0000","last_undegraded":"2023-10-08T16:25:04.180615+0000","last_fullsized":"2023-10-08T16:25:04.180615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:14.184227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205010+0000","last_change":"2023-10-08T16:25:03.165618+0000","last_active":"2023-10-08T16:25:04.205010+0000","last_peered":"2023-10-08T16:25:04.205010+0000","last_clean":"2023-10-08T16:25:04.205010+0000","last_became_active":"2023-10-08T16:25:03.165328+0000","last_became_peered":"2023-10-08T16:25:03.165328+0000","last_unstale":"2023-10-08T16:25:04.205010+0000","last_undegraded":"2023-10-08T16:25:04.205010+0000","last_fullsized":"2023-10-08T16:25:04.205010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:51.440409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186810+0000","last_change":"2023-10-08T16:25:04.183796+0000","last_active":"2023-10-08T16:25:04.186810+0000","last_peered":"2023-10-08T16:25:04.186810+0000","last_clean":"2023-10-08T16:25:04.186810+0000","last_became_active":"2023-10-08T16:25:04.183546+0000","last_became_peered":"2023-10-08T16:25:04.183546+0000","last_unstale":"2023-10-08T16:25:04.186810+0000","last_undegraded":"2023-10-08T16:25:04.186810+0000","last_fullsized":"2023-10-08T16:25:04.186810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:41.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198977+0000","last_change":"2023-10-08T16:25:03.161230+0000","last_active":"2023-10-08T16:25:04.198977+0000","last_peered":"2023-10-08T16:25:04.198977+0000","last_clean":"2023-10-08T16:25:04.198977+0000","last_became_active":"2023-10-08T16:25:03.160899+0000","last_became_peered":"2023-10-08T16:25:03.160899+0000","last_unstale":"2023-10-08T16:25:04.198977+0000","last_undegraded":"2023-10-08T16:25:04.198977+0000","last_fullsized":"2023-10-08T16:25:04.198977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:39.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186131+0000","last_change":"2023-10-08T16:25:03.169314+0000","last_active":"2023-10-08T16:25:04.186131+0000","last_peered":"2023-10-08T16:25:04.186131+0000","last_clean":"2023-10-08T16:25:04.186131+0000","last_became_active":"2023-10-08T16:25:03.169026+0000","last_became_peered":"2023-10-08T16:25:03.169026+0000","last_unstale":"2023-10-08T16:25:04.186131+0000","last_undegraded":"2023-10-08T16:25:04.186131+0000","last_fullsized":"2023-10-08T16:25:04.186131+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.194997+0000","last_change":"2023-10-08T16:25:04.191999+0000","last_active":"2023-10-08T16:25:04.194997+0000","last_peered":"2023-10-08T16:25:04.194997+0000","last_clean":"2023-10-08T16:25:04.194997+0000","last_became_active":"2023-10-08T16:25:04.191652+0000","last_became_peered":"2023-10-08T16:25:04.191652+0000","last_unstale":"2023-10-08T16:25:04.194997+0000","last_undegraded":"2023-10-08T16:25:04.194997+0000","last_fullsized":"2023-10-08T16:25:04.194997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:33.496567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141832+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:24:19.022229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186812+0000","last_change":"2023-10-08T16:25:04.184948+0000","last_active":"2023-10-08T16:25:04.186812+0000","last_peered":"2023-10-08T16:25:04.186812+0000","last_clean":"2023-10-08T16:25:04.186812+0000","last_became_active":"2023-10-08T16:25:04.184601+0000","last_became_peered":"2023-10-08T16:25:04.184601+0000","last_unstale":"2023-10-08T16:25:04.186812+0000","last_undegraded":"2023-10-08T16:25:04.186812+0000","last_fullsized":"2023-10-08T16:25:04.186812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:18.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142758+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.202483+0000","last_change":"2023-10-08T16:25:03.171328+0000","last_active":"2023-10-08T16:25:04.202483+0000","last_peered":"2023-10-08T16:25:04.202483+0000","last_clean":"2023-10-08T16:25:04.202483+0000","last_became_active":"2023-10-08T16:25:03.171110+0000","last_became_peered":"2023-10-08T16:25:03.171110+0000","last_unstale":"2023-10-08T16:25:04.202483+0000","last_undegraded":"2023-10-08T16:25:04.202483+0000","last_fullsized":"2023-10-08T16:25:04.202483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184559+0000","last_change":"2023-10-08T16:25:04.181795+0000","last_active":"2023-10-08T16:25:04.184559+0000","last_peered":"2023-10-08T16:25:04.184559+0000","last_clean":"2023-10-08T16:25:04.184559+0000","last_became_active":"2023-10-08T16:25:04.181403+0000","last_became_peered":"2023-10-08T16:25:04.181403+0000","last_unstale":"2023-10-08T16:25:04.184559+0000","last_undegraded":"2023-10-08T16:25:04.184559+0000","last_fullsized":"2023-10-08T16:25:04.184559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:45.404512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142570+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180117+0000","last_change":"2023-10-08T16:25:04.178756+0000","last_active":"2023-10-08T16:25:04.180117+0000","last_peered":"2023-10-08T16:25:04.180117+0000","last_clean":"2023-10-08T16:25:04.180117+0000","last_became_active":"2023-10-08T16:25:04.178493+0000","last_became_peered":"2023-10-08T16:25:04.178493+0000","last_unstale":"2023-10-08T16:25:04.180117+0000","last_undegraded":"2023-10-08T16:25:04.180117+0000","last_fullsized":"2023-10-08T16:25:04.180117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:09.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203675+0000","last_change":"2023-10-08T16:25:03.162613+0000","last_active":"2023-10-08T16:25:04.203675+0000","last_peered":"2023-10-08T16:25:04.203675+0000","last_clean":"2023-10-08T16:25:04.203675+0000","last_became_active":"2023-10-08T16:25:03.162298+0000","last_became_peered":"2023-10-08T16:25:03.162298+0000","last_unstale":"2023-10-08T16:25:04.203675+0000","last_undegraded":"2023-10-08T16:25:04.203675+0000","last_fullsized":"2023-10-08T16:25:04.203675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180635+0000","last_change":"2023-10-08T16:25:04.178425+0000","last_active":"2023-10-08T16:25:04.180635+0000","last_peered":"2023-10-08T16:25:04.180635+0000","last_clean":"2023-10-08T16:25:04.180635+0000","last_became_active":"2023-10-08T16:25:04.178158+0000","last_became_peered":"2023-10-08T16:25:04.178158+0000","last_unstale":"2023-10-08T16:25:04.180635+0000","last_undegraded":"2023-10-08T16:25:04.180635+0000","last_fullsized":"2023-10-08T16:25:04.180635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:52.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169658+0000","last_change":"2023-10-08T16:25:03.162457+0000","last_active":"2023-10-08T16:25:04.169658+0000","last_peered":"2023-10-08T16:25:04.169658+0000","last_clean":"2023-10-08T16:25:04.169658+0000","last_became_active":"2023-10-08T16:25:03.162174+0000","last_became_peered":"2023-10-08T16:25:03.162174+0000","last_unstale":"2023-10-08T16:25:04.169658+0000","last_undegraded":"2023-10-08T16:25:04.169658+0000","last_fullsized":"2023-10-08T16:25:04.169658+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:14.112628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178384+0000","last_change":"2023-10-08T16:25:04.176022+0000","last_active":"2023-10-08T16:25:04.178384+0000","last_peered":"2023-10-08T16:25:04.178384+0000","last_clean":"2023-10-08T16:25:04.178384+0000","last_became_active":"2023-10-08T16:25:04.175768+0000","last_became_peered":"2023-10-08T16:25:04.175768+0000","last_unstale":"2023-10-08T16:25:04.178384+0000","last_undegraded":"2023-10-08T16:25:04.178384+0000","last_fullsized":"2023-10-08T16:25:04.178384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:12.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186200+0000","last_change":"2023-10-08T16:25:03.167677+0000","last_active":"2023-10-08T16:25:04.186200+0000","last_peered":"2023-10-08T16:25:04.186200+0000","last_clean":"2023-10-08T16:25:04.186200+0000","last_became_active":"2023-10-08T16:25:03.167109+0000","last_became_peered":"2023-10-08T16:25:03.167109+0000","last_unstale":"2023-10-08T16:25:04.186200+0000","last_undegraded":"2023-10-08T16:25:04.186200+0000","last_fullsized":"2023-10-08T16:25:04.186200+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187315+0000","last_change":"2023-10-08T16:25:04.180103+0000","last_active":"2023-10-08T16:25:04.187315+0000","last_peered":"2023-10-08T16:25:04.187315+0000","last_clean":"2023-10-08T16:25:04.187315+0000","last_became_active":"2023-10-08T16:25:04.179854+0000","last_became_peered":"2023-10-08T16:25:04.179854+0000","last_unstale":"2023-10-08T16:25:04.187315+0000","last_undegraded":"2023-10-08T16:25:04.187315+0000","last_fullsized":"2023-10-08T16:25:04.187315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:15.320837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141234+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:30.568000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187138+0000","last_change":"2023-10-08T16:25:04.180924+0000","last_active":"2023-10-08T16:25:04.187138+0000","last_peered":"2023-10-08T16:25:04.187138+0000","last_clean":"2023-10-08T16:25:04.187138+0000","last_became_active":"2023-10-08T16:25:04.180659+0000","last_became_peered":"2023-10-08T16:25:04.180659+0000","last_unstale":"2023-10-08T16:25:04.187138+0000","last_undegraded":"2023-10-08T16:25:04.187138+0000","last_fullsized":"2023-10-08T16:25:04.187138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:03.340620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.172362+0000","last_change":"2023-10-08T16:25:03.152697+0000","last_active":"2023-10-08T16:25:04.172362+0000","last_peered":"2023-10-08T16:25:04.172362+0000","last_clean":"2023-10-08T16:25:04.172362+0000","last_became_active":"2023-10-08T16:25:03.152373+0000","last_became_peered":"2023-10-08T16:25:03.152373+0000","last_unstale":"2023-10-08T16:25:04.172362+0000","last_undegraded":"2023-10-08T16:25:04.172362+0000","last_fullsized":"2023-10-08T16:25:04.172362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:19.376954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186336+0000","last_change":"2023-10-08T16:25:04.179784+0000","last_active":"2023-10-08T16:25:04.186336+0000","last_peered":"2023-10-08T16:25:04.186336+0000","last_clean":"2023-10-08T16:25:04.186336+0000","last_became_active":"2023-10-08T16:25:04.179540+0000","last_became_peered":"2023-10-08T16:25:04.179540+0000","last_unstale":"2023-10-08T16:25:04.186336+0000","last_undegraded":"2023-10-08T16:25:04.186336+0000","last_fullsized":"2023-10-08T16:25:04.186336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205005+0000","last_change":"2023-10-08T16:25:03.167710+0000","last_active":"2023-10-08T16:25:04.205005+0000","last_peered":"2023-10-08T16:25:04.205005+0000","last_clean":"2023-10-08T16:25:04.205005+0000","last_became_active":"2023-10-08T16:25:03.167346+0000","last_became_peered":"2023-10-08T16:25:03.167346+0000","last_unstale":"2023-10-08T16:25:04.205005+0000","last_undegraded":"2023-10-08T16:25:04.205005+0000","last_fullsized":"2023-10-08T16:25:04.205005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:03.137707+0000","last_change":"2023-10-08T16:25:03.137707+0000","last_active":"2023-10-08T16:25:03.137707+0000","last_peered":"2023-10-08T16:25:03.137707+0000","last_clean":"2023-10-08T16:25:03.137707+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:03.137707+0000","last_undegraded":"2023-10-08T16:25:03.137707+0000","last_fullsized":"2023-10-08T16:25:03.137707+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.141192+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:06:52.373599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196073+0000","last_change":"2023-10-08T16:25:04.189875+0000","last_active":"2023-10-08T16:25:04.196073+0000","last_peered":"2023-10-08T16:25:04.196073+0000","last_clean":"2023-10-08T16:25:04.196073+0000","last_became_active":"2023-10-08T16:25:04.189608+0000","last_became_peered":"2023-10-08T16:25:04.189608+0000","last_unstale":"2023-10-08T16:25:04.196073+0000","last_undegraded":"2023-10-08T16:25:04.196073+0000","last_fullsized":"2023-10-08T16:25:04.196073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:17.805094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174488+0000","last_change":"2023-10-08T16:25:03.159563+0000","last_active":"2023-10-08T16:25:04.174488+0000","last_peered":"2023-10-08T16:25:04.174488+0000","last_clean":"2023-10-08T16:25:04.174488+0000","last_became_active":"2023-10-08T16:25:03.159252+0000","last_became_peered":"2023-10-08T16:25:03.159252+0000","last_unstale":"2023-10-08T16:25:04.174488+0000","last_undegraded":"2023-10-08T16:25:04.174488+0000","last_fullsized":"2023-10-08T16:25:04.174488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:09.955599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186235+0000","last_change":"2023-10-08T16:25:04.182673+0000","last_active":"2023-10-08T16:25:04.186235+0000","last_peered":"2023-10-08T16:25:04.186235+0000","last_clean":"2023-10-08T16:25:04.186235+0000","last_became_active":"2023-10-08T16:25:04.182368+0000","last_became_peered":"2023-10-08T16:25:04.182368+0000","last_unstale":"2023-10-08T16:25:04.186235+0000","last_undegraded":"2023-10-08T16:25:04.186235+0000","last_fullsized":"2023-10-08T16:25:04.186235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:41.602049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170934+0000","last_change":"2023-10-08T16:25:03.153859+0000","last_active":"2023-10-08T16:25:04.170934+0000","last_peered":"2023-10-08T16:25:04.170934+0000","last_clean":"2023-10-08T16:25:04.170934+0000","last_became_active":"2023-10-08T16:25:03.153583+0000","last_became_peered":"2023-10-08T16:25:03.153583+0000","last_unstale":"2023-10-08T16:25:04.170934+0000","last_undegraded":"2023-10-08T16:25:04.170934+0000","last_fullsized":"2023-10-08T16:25:04.170934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:55.498306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191111+0000","last_change":"2023-10-08T16:25:04.188418+0000","last_active":"2023-10-08T16:25:04.191111+0000","last_peered":"2023-10-08T16:25:04.191111+0000","last_clean":"2023-10-08T16:25:04.191111+0000","last_became_active":"2023-10-08T16:25:04.188160+0000","last_became_peered":"2023-10-08T16:25:04.188160+0000","last_unstale":"2023-10-08T16:25:04.191111+0000","last_undegraded":"2023-10-08T16:25:04.191111+0000","last_fullsized":"2023-10-08T16:25:04.191111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:42.749730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174357+0000","last_change":"2023-10-08T16:25:03.154067+0000","last_active":"2023-10-08T16:25:04.174357+0000","last_peered":"2023-10-08T16:25:04.174357+0000","last_clean":"2023-10-08T16:25:04.174357+0000","last_became_active":"2023-10-08T16:25:03.153792+0000","last_became_peered":"2023-10-08T16:25:03.153792+0000","last_unstale":"2023-10-08T16:25:04.174357+0000","last_undegraded":"2023-10-08T16:25:04.174357+0000","last_fullsized":"2023-10-08T16:25:04.174357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:05.481126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.193106+0000","last_change":"2023-10-08T16:25:04.188647+0000","last_active":"2023-10-08T16:25:04.193106+0000","last_peered":"2023-10-08T16:25:04.193106+0000","last_clean":"2023-10-08T16:25:04.193106+0000","last_became_active":"2023-10-08T16:25:04.187982+0000","last_became_peered":"2023-10-08T16:25:04.187982+0000","last_unstale":"2023-10-08T16:25:04.193106+0000","last_undegraded":"2023-10-08T16:25:04.193106+0000","last_fullsized":"2023-10-08T16:25:04.193106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168357+0000","last_change":"2023-10-08T16:25:03.161066+0000","last_active":"2023-10-08T16:25:04.168357+0000","last_peered":"2023-10-08T16:25:04.168357+0000","last_clean":"2023-10-08T16:25:04.168357+0000","last_became_active":"2023-10-08T16:25:03.160765+0000","last_became_peered":"2023-10-08T16:25:03.160765+0000","last_unstale":"2023-10-08T16:25:04.168357+0000","last_undegraded":"2023-10-08T16:25:04.168357+0000","last_fullsized":"2023-10-08T16:25:04.168357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:23.727949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187451+0000","last_change":"2023-10-08T16:25:04.181787+0000","last_active":"2023-10-08T16:25:04.187451+0000","last_peered":"2023-10-08T16:25:04.187451+0000","last_clean":"2023-10-08T16:25:04.187451+0000","last_became_active":"2023-10-08T16:25:04.181507+0000","last_became_peered":"2023-10-08T16:25:04.181507+0000","last_unstale":"2023-10-08T16:25:04.187451+0000","last_undegraded":"2023-10-08T16:25:04.187451+0000","last_fullsized":"2023-10-08T16:25:04.187451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:10.414471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:02.132431+0000","last_change":"2023-10-08T16:25:02.142897+0000","last_active":"2023-10-08T16:25:02.132431+0000","last_peered":"2023-10-08T16:25:02.132431+0000","last_clean":"2023-10-08T16:25:02.132431+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:02.132431+0000","last_undegraded":"2023-10-08T16:25:02.132431+0000","last_fullsized":"2023-10-08T16:25:02.132431+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189861+0000","last_change":"2023-10-08T16:25:04.186865+0000","last_active":"2023-10-08T16:25:04.189861+0000","last_peered":"2023-10-08T16:25:04.189861+0000","last_clean":"2023-10-08T16:25:04.189861+0000","last_became_active":"2023-10-08T16:25:04.185912+0000","last_became_peered":"2023-10-08T16:25:04.185912+0000","last_unstale":"2023-10-08T16:25:04.189861+0000","last_undegraded":"2023-10-08T16:25:04.189861+0000","last_fullsized":"2023-10-08T16:25:04.189861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.177861+0000","last_change":"2023-10-08T16:25:03.166929+0000","last_active":"2023-10-08T16:25:04.177861+0000","last_peered":"2023-10-08T16:25:04.177861+0000","last_clean":"2023-10-08T16:25:04.177861+0000","last_became_active":"2023-10-08T16:25:03.166366+0000","last_became_peered":"2023-10-08T16:25:03.166366+0000","last_unstale":"2023-10-08T16:25:04.177861+0000","last_undegraded":"2023-10-08T16:25:04.177861+0000","last_fullsized":"2023-10-08T16:25:04.177861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196970+0000","last_change":"2023-10-08T16:25:04.193416+0000","last_active":"2023-10-08T16:25:04.196970+0000","last_peered":"2023-10-08T16:25:04.196970+0000","last_clean":"2023-10-08T16:25:04.196970+0000","last_became_active":"2023-10-08T16:25:04.193106+0000","last_became_peered":"2023-10-08T16:25:04.193106+0000","last_unstale":"2023-10-08T16:25:04.196970+0000","last_undegraded":"2023-10-08T16:25:04.196970+0000","last_fullsized":"2023-10-08T16:25:04.196970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:09.405286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205316+0000","last_change":"2023-10-08T16:25:03.168169+0000","last_active":"2023-10-08T16:25:04.205316+0000","last_peered":"2023-10-08T16:25:04.205316+0000","last_clean":"2023-10-08T16:25:04.205316+0000","last_became_active":"2023-10-08T16:25:03.167889+0000","last_became_peered":"2023-10-08T16:25:03.167889+0000","last_unstale":"2023-10-08T16:25:04.205316+0000","last_undegraded":"2023-10-08T16:25:04.205316+0000","last_fullsized":"2023-10-08T16:25:04.205316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"88'183","reported_seq":469,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168988+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:04.168988+0000","last_peered":"2023-10-08T16:25:04.168988+0000","last_clean":"2023-10-08T16:25:04.168988+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:04.168988+0000","last_undegraded":"2023-10-08T16:25:04.168988+0000","last_fullsized":"2023-10-08T16:25:04.168988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":6},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26,"ondisk_log_size":26,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307248,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064592,"statfs":{"total":96636764160,"available":96322142208,"internally_reserved":0,"allocated":1810432,"data_stored":1176158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.48499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97199999999999998,"5min":0.98299999999999998,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.089},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.032,"15min":1.1000000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.234},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.53000000000000003,"5min":0.439,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3919999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.351,"5min":1.351,"15min":1.3680000000000001},"last":1.073},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.323},"last":1.085},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.448},"last":1.0589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":0.96399999999999997,"15min":1.125},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.65700000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.99199999999999999,"15min":1.365},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.997,"15min":1.0549999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":1.071,"15min":1.552},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.4570000000000001},"last":0.752}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72999999999999998,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.0149999999999999,"15min":1.069},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.619},"last":0.77800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.272,"15min":1.272},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.74099999999999999},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85699999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.85599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":587326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44400000000000001,"15min":0.45000000000000001},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.873},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.82199999999999995,"15min":1.0680000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.65400000000000003,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.629},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":1.472},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.026,"15min":1.373},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.2230000000000001,"15min":1.375},"last":0.84899999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":1.157,"15min":1.276},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.085,"15min":1.224},"last":0.72399999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.63400000000000001,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0069999999999999,"5min":1.0800000000000001,"15min":1.429},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0209999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0109999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0960000000000001,"15min":1.514},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1802240,"data_stored":1175570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":1220608,"data_stored":586738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.30499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.32500000000000001,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.504}]},{"osd":2,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.79200000000000004,"5min":1,"15min":1},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":1.0589999999999999,"5min":1.093,"15min":1.3200000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.996,"5min":1.1799999999999999,"15min":1.397},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82399999999999995,"15min":0.84899999999999998},"min":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.0429999999999999,"5min":1.153,"15min":1.306},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.321},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1171456,"data_stored":564712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.54100000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.56999999999999995,"5min":0.504,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.58899999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.60399999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.004,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.754,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.085,"15min":1.216},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1479999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.505,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0309999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.52000000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.47,"15min":1.47},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.022,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65100000000000002},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":0.97099999999999997,"5min":2.661,"15min":2.661},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.117,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0760000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.66900000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575035,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310708,"kb_used_data":1132,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061132,"statfs":{"total":96636764160,"available":96318599168,"internally_reserved":0,"allocated":1159168,"data_stored":558515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.60499999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.47999999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.83899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:09.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-08T16:25:09.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-08T16:25:09.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-08T16:25:09.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.142650+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-08T16:25:09.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.142702+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:47:42.750989+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.141832+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:24:19.022229+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-08T16:25:09.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.142758+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.142570+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.141234+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:05:30.568000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-08T16:25:09.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T16:25:03.137707+0000', 'last_change': '2023-10-08T16:25:03.137707+0000', 'last_active': '2023-10-08T16:25:03.137707+0000', 'last_peered': '2023-10-08T16:25:03.137707+0000', 'last_clean': '2023-10-08T16:25:03.137707+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:03.137707+0000', 'last_undegraded': '2023-10-08T16:25:03.137707+0000', 'last_fullsized': '2023-10-08T16:25:03.137707+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:03.137707+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T16:25:09.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-08T16:25:09.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.141192+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:06:52.373599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T16:25:09.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-08T16:25:09.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T16:25:02.132431+0000', 'last_change': '2023-10-08T16:25:02.142897+0000', 'last_active': '2023-10-08T16:25:02.132431+0000', 'last_peered': '2023-10-08T16:25:02.132431+0000', 'last_clean': '2023-10-08T16:25:02.132431+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T16:25:02.132431+0000', 'last_undegraded': '2023-10-08T16:25:02.132431+0000', 'last_fullsized': '2023-10-08T16:25:02.132431+0000', 'mapping_epoch': 96, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 96, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'last_clean_scrub_stamp': '2023-10-08T16:25:02.132431+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T16:25:09.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:25:09.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.837+0000 7f5d5219d700 1 Processor -- start 2023-10-08T16:25:09.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.837+0000 7f5d5219d700 1 -- start start 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 0x7f5d4c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5219d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c15b640 con 0x7f5d4c06de50 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5219d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d4c15b920 con 0x7f5d4c140a70 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c0c6800 con 0x7f5d4c06a210 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5199c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5d4c06de50 0x7f5d4c0c7190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:56280/0 (socket says 172.21.15.12:56280) 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5199c700 1 -- 172.21.15.12:0/1465274833 learned_addr learned my addr 172.21.15.12:0/1465274833 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:09.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d5099a700 1 --2- 172.21.15.12:0/1465274833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 0x7f5d4c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190764047 0 0) 0x7f5d4c15b640 con 0x7f5d4c06de50 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d38003570 con 0x7f5d4c06de50 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.839+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458275275 0 0) 0x7f5d4c15b920 con 0x7f5d4c140a70 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d4c15b640 con 0x7f5d4c140a70 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d5099a700 1 -- 172.21.15.12:0/1465274833 >> v1:172.21.15.29:6789/0 conn(0x7f5d4c140a70 legacy=0x7f5d4c069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d5099a700 1 -- 172.21.15.12:0/1465274833 >> v1:172.21.15.12:6789/0 conn(0x7f5d4c06de50 legacy=0x7f5d4c0c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d5099a700 1 -- 172.21.15.12:0/1465274833 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d4c15bc00 con 0x7f5d4c06a210 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d5099a700 1 --2- 172.21.15.12:0/1465274833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 0x7f5d4c0c6c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009910 tx=0x7f5d3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83421ee5c6eeb105 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c011630 con 0x7f5d4c06a210 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c011790 con 0x7f5d4c06a210 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.840+0000 7f5d43fff700 1 -- 172.21.15.12:0/1465274833 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c011b30 con 0x7f5d4c06a210 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 -- 172.21.15.12:0/1465274833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 msgr2=0x7f5d4c0c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 --2- 172.21.15.12:0/1465274833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 0x7f5d4c0c6c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009910 tx=0x7f5d3c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 -- 172.21.15.12:0/1465274833 shutdown_connections 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 --2- 172.21.15.12:0/1465274833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c06a210 0x7f5d4c0c6c50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 -- 172.21.15.12:0/1465274833 >> 172.21.15.12:0/1465274833 conn(0x7f5d4c06d110 msgr2=0x7f5d4c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 -- 172.21.15.12:0/1465274833 shutdown_connections 2023-10-08T16:25:09.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.841+0000 7f5d5219d700 1 -- 172.21.15.12:0/1465274833 wait complete. 2023-10-08T16:25:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.842+0000 7f5d5219d700 1 Processor -- start 2023-10-08T16:25:09.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 -- start start 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 0x7f5d4c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c140a70 0x7f5d4c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c15a5e0 con 0x7f5d4c06de50 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c169c70 con 0x7f5d4c06a210 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.843+0000 7f5d5219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d4c157960 con 0x7f5d4c140a70 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36498/0 (socket says 172.21.15.12:36498) 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 -- 172.21.15.12:0/3826875696 learned_addr learned my addr 172.21.15.12:0/3826875696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:09.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5119b700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 0x7f5d4c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5199c700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c140a70 0x7f5d4c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 -- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c140a70 msgr2=0x7f5d4c15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c140a70 0x7f5d4c15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 -- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 msgr2=0x7f5d4c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 0x7f5d4c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 -- 172.21.15.12:0/3826875696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c009420 con 0x7f5d4c06de50 2023-10-08T16:25:09.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5119b700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 0x7f5d4c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.844+0000 7f5d5099a700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009f00 tx=0x7f5d3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.845+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c01f070 con 0x7f5d4c06de50 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.845+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3c011900 con 0x7f5d4c06de50 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.845+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3c023410 con 0x7f5d4c06de50 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.845+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d4c15a300 con 0x7f5d4c06de50 2023-10-08T16:25:09.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.845+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d4c16a190 con 0x7f5d4c06de50 2023-10-08T16:25:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.846+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d4c04c3c0 con 0x7f5d4c06de50 2023-10-08T16:25:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.847+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d3c023800 con 0x7f5d4c06de50 2023-10-08T16:25:09.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.848+0000 7f5d417fa700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 0x7f5d300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.848+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5d3c085940 con 0x7f5d4c06de50 2023-10-08T16:25:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.848+0000 7f5d5119b700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 0x7f5d300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:09.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.849+0000 7f5d5119b700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 0x7f5d300693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d480038f0 tx=0x7f5d48009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:09.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:09.852+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d3c052980 con 0x7f5d4c06de50 2023-10-08T16:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.138+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5d4c0c6580 con 0x7f5d4c06de50 2023-10-08T16:25:10.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.139+0000 7f5d417fa700 1 -- 172.21.15.12:0/3826875696 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1177 (secure 0 0 0) 0x7f5d3c015080 con 0x7f5d4c06de50 2023-10-08T16:25:10.140 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:10.140 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":974,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":73},{"state_name":"unknown","count":16},{"state_name":"creating+peering","count":8}],"num_pgs":97,"num_pools":3,"num_objects":17,"data_bytes":592674,"bytes_used":2496540672,"bytes_avail":770597572608,"bytes_total":773094113280,"unknown_pgs_ratio":0.16494844853878021,"inactive_pgs_ratio":0.082474224269390106,"write_bytes_sec":2422,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":42,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6774}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T16:23:30.467427+0000","services":{}},"progress_events":{}} 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 msgr2=0x7f5d300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 0x7f5d300693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d480038f0 tx=0x7f5d48009040 comp rx=0 tx=0).stop 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 msgr2=0x7f5d4c16db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c009f00 tx=0x7f5d3c017000 comp rx=0 tx=0).stop 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 shutdown_connections 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5d30066f30 0x7f5d300693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5d4c140a70 0x7f5d4c15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5d4c06a210 0x7f5d4c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 --2- 172.21.15.12:0/3826875696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5d4c06de50 0x7f5d4c16db30 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 >> 172.21.15.12:0/3826875696 conn(0x7f5d4c06d110 msgr2=0x7f5d4c0c8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 shutdown_connections 2023-10-08T16:25:10.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.141+0000 7f5d5219d700 1 -- 172.21.15.12:0/3826875696 wait complete. 2023-10-08T16:25:10.159 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:25:10.159 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.346+0000 7f6491f9d700 1 Processor -- start 2023-10-08T16:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.346+0000 7f6491f9d700 1 -- start start 2023-10-08T16:25:10.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.347+0000 7f6491f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 0x7f648c0c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f6491f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f648c150380 0x7f648c06a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f6491f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c06a490 con 0x7f648c06f3a0 2023-10-08T16:25:10.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f6491f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0c7490 con 0x7f648c150380 2023-10-08T16:25:10.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f6491f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c7770 con 0x7f648c06e0a0 2023-10-08T16:25:10.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f649179c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f648c150380 0x7f648c06a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f649179c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f648c150380 0x7f648c06a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:36706/0 (socket says 172.21.15.12:36706) 2023-10-08T16:25:10.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f649179c700 1 -- 172.21.15.12:0/995465872 learned_addr learned my addr 172.21.15.12:0/995465872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:10.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f6490f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 0x7f648c0c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.348+0000 7f648bfff700 1 --1- 172.21.15.12:0/995465872 >> v1:172.21.15.29:6789/0 conn(0x7f648c06f3a0 0x7f648c14fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:60434/0 (socket says 172.21.15.12:60434) 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f648b7fe700 1 -- 172.21.15.12:0/995465872 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107083480 0 0) 0x7f648c06a490 con 0x7f648c06f3a0 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f648b7fe700 1 -- 172.21.15.12:0/995465872 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f647c003570 con 0x7f648c06f3a0 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f649179c700 1 -- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 msgr2=0x7f648c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f649179c700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 0x7f648c0c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f649179c700 1 -- 172.21.15.12:0/995465872 >> v1:172.21.15.29:6789/0 conn(0x7f648c06f3a0 legacy=0x7f648c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f649179c700 1 -- 172.21.15.12:0/995465872 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0c7a50 con 0x7f648c150380 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f6490f9b700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 0x7f648c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:10.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f649179c700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c150380 0x7f648c06a920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6484009f20 tx=0x7f6484009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69d9e22017b37212 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:10.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f648b7fe700 1 -- 172.21.15.12:0/995465872 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648400e070 con 0x7f648c150380 2023-10-08T16:25:10.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f648b7fe700 1 -- 172.21.15.12:0/995465872 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648400b970 con 0x7f648c150380 2023-10-08T16:25:10.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.349+0000 7f648b7fe700 1 -- 172.21.15.12:0/995465872 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840092e0 con 0x7f648c150380 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 -- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c150380 msgr2=0x7f648c06a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c150380 0x7f648c06a920 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6484009f20 tx=0x7f6484009840 comp rx=0 tx=0).stop 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 -- 172.21.15.12:0/995465872 shutdown_connections 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c150380 0x7f648c06a920 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 --2- 172.21.15.12:0/995465872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c06e0a0 0x7f648c0c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 -- 172.21.15.12:0/995465872 >> 172.21.15.12:0/995465872 conn(0x7f648c06d170 msgr2=0x7f648c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:10.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 -- 172.21.15.12:0/995465872 shutdown_connections 2023-10-08T16:25:10.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.350+0000 7f6491f9d700 1 -- 172.21.15.12:0/995465872 wait complete. 2023-10-08T16:25:10.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.352+0000 7f6491f9d700 1 Processor -- start 2023-10-08T16:25:10.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.352+0000 7f6491f9d700 1 -- start start 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c06f3a0 0x7f648c0c5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 0x7f648c0c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c4cc0 con 0x7f648c06e0a0 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c14a310 con 0x7f648c06f3a0 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6491f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c0c5150 con 0x7f648c150380 2023-10-08T16:25:10.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36504/0 (socket says 172.21.15.12:36504) 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 -- 172.21.15.12:0/1315634110 learned_addr learned my addr 172.21.15.12:0/1315634110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f648bfff700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c06f3a0 0x7f648c0c5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f649179c700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 0x7f648c0c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 -- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 msgr2=0x7f648c0c5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 0x7f648c0c5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 -- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c06f3a0 msgr2=0x7f648c0c5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c06f3a0 0x7f648c0c5550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f6490f9b700 1 -- 172.21.15.12:0/1315634110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648000a5d0 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.353+0000 7f649179c700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 0x7f648c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6490f9b700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f648000eaf0 tx=0x7f648000a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000c950 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648000cab0 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6484009ae0 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000ce50 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.354+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c0c3c00 con 0x7f648c06e0a0 2023-10-08T16:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.355+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c06c070 con 0x7f648c06e0a0 2023-10-08T16:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.356+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64800113f0 con 0x7f648c06e0a0 2023-10-08T16:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.357+0000 7f6488ff9700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.357+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6480015030 con 0x7f648c06e0a0 2023-10-08T16:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.357+0000 7f648bfff700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.358+0000 7f648bfff700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 0x7f64700693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f648c0cb360 tx=0x7f6478007d00 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:10.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.361+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6480051990 con 0x7f648c06e0a0 2023-10-08T16:25:10.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.558+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f648c0c4e00 con 0x7f6470066f30 2023-10-08T16:25:10.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.567+0000 7f6488ff9700 1 -- 172.21.15.12:0/1315634110 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289159 (secure 0 0 0) 0x7f6478004c70 con 0x7f6470066f30 2023-10-08T16:25:10.572 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:10.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.571+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 msgr2=0x7f64700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.571+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 0x7f64700693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f648c0cb360 tx=0x7f6478007d00 comp rx=0 tx=0).stop 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 msgr2=0x7f648c149dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f648000eaf0 tx=0x7f648000a330 comp rx=0 tx=0).stop 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 shutdown_connections 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f648c06e0a0 0x7f648c149dd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f648c150380 0x7f648c0c5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 --2- 172.21.15.12:0/1315634110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f648c06f3a0 0x7f648c0c5550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:10.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 >> 172.21.15.12:0/1315634110 conn(0x7f648c06d170 msgr2=0x7f648c1596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:10.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 shutdown_connections 2023-10-08T16:25:10.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:10.572+0000 7f6491f9d700 1 -- 172.21.15.12:0/1315634110 wait complete. 2023-10-08T16:25:10.576 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:10.590 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:25:09.633713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":323,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":186,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438120,"kb_used_data":10664,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752536600,"statfs":{"total":773094113280,"available":770597478400,"internally_reserved":0,"allocated":10919936,"data_stored":5866964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.490003"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187439+0000","last_change":"2023-10-08T16:25:04.184423+0000","last_active":"2023-10-08T16:25:04.187439+0000","last_peered":"2023-10-08T16:25:04.187439+0000","last_clean":"2023-10-08T16:25:04.187439+0000","last_became_active":"2023-10-08T16:25:04.184164+0000","last_became_peered":"2023-10-08T16:25:04.184164+0000","last_unstale":"2023-10-08T16:25:04.187439+0000","last_undegraded":"2023-10-08T16:25:04.187439+0000","last_fullsized":"2023-10-08T16:25:04.187439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:41.179128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197698+0000","last_change":"2023-10-08T16:25:04.195798+0000","last_active":"2023-10-08T16:25:04.197698+0000","last_peered":"2023-10-08T16:25:04.197698+0000","last_clean":"2023-10-08T16:25:04.197698+0000","last_became_active":"2023-10-08T16:25:04.195557+0000","last_became_peered":"2023-10-08T16:25:04.195557+0000","last_unstale":"2023-10-08T16:25:04.197698+0000","last_undegraded":"2023-10-08T16:25:04.197698+0000","last_fullsized":"2023-10-08T16:25:04.197698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:52.084740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185291+0000","last_change":"2023-10-08T16:25:04.177365+0000","last_active":"2023-10-08T16:25:04.185291+0000","last_peered":"2023-10-08T16:25:04.185291+0000","last_clean":"2023-10-08T16:25:04.185291+0000","last_became_active":"2023-10-08T16:25:04.177078+0000","last_became_peered":"2023-10-08T16:25:04.177078+0000","last_unstale":"2023-10-08T16:25:04.185291+0000","last_undegraded":"2023-10-08T16:25:04.185291+0000","last_fullsized":"2023-10-08T16:25:04.185291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:32.063542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191108+0000","last_change":"2023-10-08T16:25:04.189784+0000","last_active":"2023-10-08T16:25:04.191108+0000","last_peered":"2023-10-08T16:25:04.191108+0000","last_clean":"2023-10-08T16:25:04.191108+0000","last_became_active":"2023-10-08T16:25:04.189487+0000","last_became_peered":"2023-10-08T16:25:04.189487+0000","last_unstale":"2023-10-08T16:25:04.191108+0000","last_undegraded":"2023-10-08T16:25:04.191108+0000","last_fullsized":"2023-10-08T16:25:04.191108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:32.166576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185816+0000","last_change":"2023-10-08T16:25:04.183703+0000","last_active":"2023-10-08T16:25:04.185816+0000","last_peered":"2023-10-08T16:25:04.185816+0000","last_clean":"2023-10-08T16:25:04.185816+0000","last_became_active":"2023-10-08T16:25:04.183400+0000","last_became_peered":"2023-10-08T16:25:04.183400+0000","last_unstale":"2023-10-08T16:25:04.185816+0000","last_undegraded":"2023-10-08T16:25:04.185816+0000","last_fullsized":"2023-10-08T16:25:04.185816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:34.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.190552+0000","last_change":"2023-10-08T16:25:04.189167+0000","last_active":"2023-10-08T16:25:04.190552+0000","last_peered":"2023-10-08T16:25:04.190552+0000","last_clean":"2023-10-08T16:25:04.190552+0000","last_became_active":"2023-10-08T16:25:04.188893+0000","last_became_peered":"2023-10-08T16:25:04.188893+0000","last_unstale":"2023-10-08T16:25:04.190552+0000","last_undegraded":"2023-10-08T16:25:04.190552+0000","last_fullsized":"2023-10-08T16:25:04.190552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181870+0000","last_change":"2023-10-08T16:25:04.173844+0000","last_active":"2023-10-08T16:25:04.181870+0000","last_peered":"2023-10-08T16:25:04.181870+0000","last_clean":"2023-10-08T16:25:04.181870+0000","last_became_active":"2023-10-08T16:25:04.173547+0000","last_became_peered":"2023-10-08T16:25:04.173547+0000","last_unstale":"2023-10-08T16:25:04.181870+0000","last_undegraded":"2023-10-08T16:25:04.181870+0000","last_fullsized":"2023-10-08T16:25:04.181870+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:17.369095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189887+0000","last_change":"2023-10-08T16:25:04.187710+0000","last_active":"2023-10-08T16:25:04.189887+0000","last_peered":"2023-10-08T16:25:04.189887+0000","last_clean":"2023-10-08T16:25:04.189887+0000","last_became_active":"2023-10-08T16:25:04.187434+0000","last_became_peered":"2023-10-08T16:25:04.187434+0000","last_unstale":"2023-10-08T16:25:04.189887+0000","last_undegraded":"2023-10-08T16:25:04.189887+0000","last_fullsized":"2023-10-08T16:25:04.189887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:34.020887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191642+0000","last_change":"2023-10-08T16:25:04.188642+0000","last_active":"2023-10-08T16:25:04.191642+0000","last_peered":"2023-10-08T16:25:04.191642+0000","last_clean":"2023-10-08T16:25:04.191642+0000","last_became_active":"2023-10-08T16:25:04.188360+0000","last_became_peered":"2023-10-08T16:25:04.188360+0000","last_unstale":"2023-10-08T16:25:04.191642+0000","last_undegraded":"2023-10-08T16:25:04.191642+0000","last_fullsized":"2023-10-08T16:25:04.191642+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:18.725697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180825+0000","last_change":"2023-10-08T16:25:04.178519+0000","last_active":"2023-10-08T16:25:04.180825+0000","last_peered":"2023-10-08T16:25:04.180825+0000","last_clean":"2023-10-08T16:25:04.180825+0000","last_became_active":"2023-10-08T16:25:04.178189+0000","last_became_peered":"2023-10-08T16:25:04.178189+0000","last_unstale":"2023-10-08T16:25:04.180825+0000","last_undegraded":"2023-10-08T16:25:04.180825+0000","last_fullsized":"2023-10-08T16:25:04.180825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187648+0000","last_change":"2023-10-08T16:25:04.186151+0000","last_active":"2023-10-08T16:25:04.187648+0000","last_peered":"2023-10-08T16:25:04.187648+0000","last_clean":"2023-10-08T16:25:04.187648+0000","last_became_active":"2023-10-08T16:25:04.185901+0000","last_became_peered":"2023-10-08T16:25:04.185901+0000","last_unstale":"2023-10-08T16:25:04.187648+0000","last_undegraded":"2023-10-08T16:25:04.187648+0000","last_fullsized":"2023-10-08T16:25:04.187648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:54.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180136+0000","last_change":"2023-10-08T16:25:04.179317+0000","last_active":"2023-10-08T16:25:04.180136+0000","last_peered":"2023-10-08T16:25:04.180136+0000","last_clean":"2023-10-08T16:25:04.180136+0000","last_became_active":"2023-10-08T16:25:04.179073+0000","last_became_peered":"2023-10-08T16:25:04.179073+0000","last_unstale":"2023-10-08T16:25:04.180136+0000","last_undegraded":"2023-10-08T16:25:04.180136+0000","last_fullsized":"2023-10-08T16:25:04.180136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:31.655970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180881+0000","last_change":"2023-10-08T16:25:04.179129+0000","last_active":"2023-10-08T16:25:04.180881+0000","last_peered":"2023-10-08T16:25:04.180881+0000","last_clean":"2023-10-08T16:25:04.180881+0000","last_became_active":"2023-10-08T16:25:04.178872+0000","last_became_peered":"2023-10-08T16:25:04.178872+0000","last_unstale":"2023-10-08T16:25:04.180881+0000","last_undegraded":"2023-10-08T16:25:04.180881+0000","last_fullsized":"2023-10-08T16:25:04.180881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:13.196602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185882+0000","last_change":"2023-10-08T16:25:04.184043+0000","last_active":"2023-10-08T16:25:04.185882+0000","last_peered":"2023-10-08T16:25:04.185882+0000","last_clean":"2023-10-08T16:25:04.185882+0000","last_became_active":"2023-10-08T16:25:04.183715+0000","last_became_peered":"2023-10-08T16:25:04.183715+0000","last_unstale":"2023-10-08T16:25:04.185882+0000","last_undegraded":"2023-10-08T16:25:04.185882+0000","last_fullsized":"2023-10-08T16:25:04.185882+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:42.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186771+0000","last_change":"2023-10-08T16:25:04.180663+0000","last_active":"2023-10-08T16:25:04.186771+0000","last_peered":"2023-10-08T16:25:04.186771+0000","last_clean":"2023-10-08T16:25:04.186771+0000","last_became_active":"2023-10-08T16:25:04.180367+0000","last_became_peered":"2023-10-08T16:25:04.180367+0000","last_unstale":"2023-10-08T16:25:04.186771+0000","last_undegraded":"2023-10-08T16:25:04.186771+0000","last_fullsized":"2023-10-08T16:25:04.186771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:23.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181957+0000","last_change":"2023-10-08T16:25:04.180159+0000","last_active":"2023-10-08T16:25:04.181957+0000","last_peered":"2023-10-08T16:25:04.181957+0000","last_clean":"2023-10-08T16:25:04.181957+0000","last_became_active":"2023-10-08T16:25:04.179878+0000","last_became_peered":"2023-10-08T16:25:04.179878+0000","last_unstale":"2023-10-08T16:25:04.181957+0000","last_undegraded":"2023-10-08T16:25:04.181957+0000","last_fullsized":"2023-10-08T16:25:04.181957+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191623+0000","last_change":"2023-10-08T16:25:04.188079+0000","last_active":"2023-10-08T16:25:04.191623+0000","last_peered":"2023-10-08T16:25:04.191623+0000","last_clean":"2023-10-08T16:25:04.191623+0000","last_became_active":"2023-10-08T16:25:04.187727+0000","last_became_peered":"2023-10-08T16:25:04.187727+0000","last_unstale":"2023-10-08T16:25:04.191623+0000","last_undegraded":"2023-10-08T16:25:04.191623+0000","last_fullsized":"2023-10-08T16:25:04.191623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:13.467148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195074+0000","last_change":"2023-10-08T16:25:04.191268+0000","last_active":"2023-10-08T16:25:04.195074+0000","last_peered":"2023-10-08T16:25:04.195074+0000","last_clean":"2023-10-08T16:25:04.195074+0000","last_became_active":"2023-10-08T16:25:04.191011+0000","last_became_peered":"2023-10-08T16:25:04.191011+0000","last_unstale":"2023-10-08T16:25:04.195074+0000","last_undegraded":"2023-10-08T16:25:04.195074+0000","last_fullsized":"2023-10-08T16:25:04.195074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:59.573275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189821+0000","last_change":"2023-10-08T16:25:04.186950+0000","last_active":"2023-10-08T16:25:04.189821+0000","last_peered":"2023-10-08T16:25:04.189821+0000","last_clean":"2023-10-08T16:25:04.189821+0000","last_became_active":"2023-10-08T16:25:04.186176+0000","last_became_peered":"2023-10-08T16:25:04.186176+0000","last_unstale":"2023-10-08T16:25:04.189821+0000","last_undegraded":"2023-10-08T16:25:04.189821+0000","last_fullsized":"2023-10-08T16:25:04.189821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186737+0000","last_change":"2023-10-08T16:25:04.184950+0000","last_active":"2023-10-08T16:25:04.186737+0000","last_peered":"2023-10-08T16:25:04.186737+0000","last_clean":"2023-10-08T16:25:04.186737+0000","last_became_active":"2023-10-08T16:25:04.184706+0000","last_became_peered":"2023-10-08T16:25:04.184706+0000","last_unstale":"2023-10-08T16:25:04.186737+0000","last_undegraded":"2023-10-08T16:25:04.186737+0000","last_fullsized":"2023-10-08T16:25:04.186737+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:01.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178828+0000","last_change":"2023-10-08T16:25:04.175350+0000","last_active":"2023-10-08T16:25:04.178828+0000","last_peered":"2023-10-08T16:25:04.178828+0000","last_clean":"2023-10-08T16:25:04.178828+0000","last_became_active":"2023-10-08T16:25:04.175086+0000","last_became_peered":"2023-10-08T16:25:04.175086+0000","last_unstale":"2023-10-08T16:25:04.178828+0000","last_undegraded":"2023-10-08T16:25:04.178828+0000","last_fullsized":"2023-10-08T16:25:04.178828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:00.991982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189818+0000","last_change":"2023-10-08T16:25:04.184210+0000","last_active":"2023-10-08T16:25:04.189818+0000","last_peered":"2023-10-08T16:25:04.189818+0000","last_clean":"2023-10-08T16:25:04.189818+0000","last_became_active":"2023-10-08T16:25:04.183952+0000","last_became_peered":"2023-10-08T16:25:04.183952+0000","last_unstale":"2023-10-08T16:25:04.189818+0000","last_undegraded":"2023-10-08T16:25:04.189818+0000","last_fullsized":"2023-10-08T16:25:04.189818+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:34.190034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181007+0000","last_change":"2023-10-08T16:25:04.174122+0000","last_active":"2023-10-08T16:25:04.181007+0000","last_peered":"2023-10-08T16:25:04.181007+0000","last_clean":"2023-10-08T16:25:04.181007+0000","last_became_active":"2023-10-08T16:25:04.173291+0000","last_became_peered":"2023-10-08T16:25:04.173291+0000","last_unstale":"2023-10-08T16:25:04.181007+0000","last_undegraded":"2023-10-08T16:25:04.181007+0000","last_fullsized":"2023-10-08T16:25:04.181007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:10.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198378+0000","last_change":"2023-10-08T16:25:04.192678+0000","last_active":"2023-10-08T16:25:04.198378+0000","last_peered":"2023-10-08T16:25:04.198378+0000","last_clean":"2023-10-08T16:25:04.198378+0000","last_became_active":"2023-10-08T16:25:04.192313+0000","last_became_peered":"2023-10-08T16:25:04.192313+0000","last_unstale":"2023-10-08T16:25:04.198378+0000","last_undegraded":"2023-10-08T16:25:04.198378+0000","last_fullsized":"2023-10-08T16:25:04.198378+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:09.011682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.188369+0000","last_change":"2023-10-08T16:25:04.183133+0000","last_active":"2023-10-08T16:25:04.188369+0000","last_peered":"2023-10-08T16:25:04.188369+0000","last_clean":"2023-10-08T16:25:04.188369+0000","last_became_active":"2023-10-08T16:25:04.182855+0000","last_became_peered":"2023-10-08T16:25:04.182855+0000","last_unstale":"2023-10-08T16:25:04.188369+0000","last_undegraded":"2023-10-08T16:25:04.188369+0000","last_fullsized":"2023-10-08T16:25:04.188369+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195299+0000","last_change":"2023-10-08T16:25:04.191760+0000","last_active":"2023-10-08T16:25:04.195299+0000","last_peered":"2023-10-08T16:25:04.195299+0000","last_clean":"2023-10-08T16:25:04.195299+0000","last_became_active":"2023-10-08T16:25:04.191440+0000","last_became_peered":"2023-10-08T16:25:04.191440+0000","last_unstale":"2023-10-08T16:25:04.195299+0000","last_undegraded":"2023-10-08T16:25:04.195299+0000","last_fullsized":"2023-10-08T16:25:04.195299+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:31.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187351+0000","last_change":"2023-10-08T16:25:04.179325+0000","last_active":"2023-10-08T16:25:04.187351+0000","last_peered":"2023-10-08T16:25:04.187351+0000","last_clean":"2023-10-08T16:25:04.187351+0000","last_became_active":"2023-10-08T16:25:04.179060+0000","last_became_peered":"2023-10-08T16:25:04.179060+0000","last_unstale":"2023-10-08T16:25:04.187351+0000","last_undegraded":"2023-10-08T16:25:04.187351+0000","last_fullsized":"2023-10-08T16:25:04.187351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.524280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180279+0000","last_change":"2023-10-08T16:25:04.178259+0000","last_active":"2023-10-08T16:25:04.180279+0000","last_peered":"2023-10-08T16:25:04.180279+0000","last_clean":"2023-10-08T16:25:04.180279+0000","last_became_active":"2023-10-08T16:25:04.177990+0000","last_became_peered":"2023-10-08T16:25:04.177990+0000","last_unstale":"2023-10-08T16:25:04.180279+0000","last_undegraded":"2023-10-08T16:25:04.180279+0000","last_fullsized":"2023-10-08T16:25:04.180279+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.173119+0000","last_change":"2023-10-08T16:25:04.169007+0000","last_active":"2023-10-08T16:25:04.173119+0000","last_peered":"2023-10-08T16:25:04.173119+0000","last_clean":"2023-10-08T16:25:04.173119+0000","last_became_active":"2023-10-08T16:25:04.168737+0000","last_became_peered":"2023-10-08T16:25:04.168737+0000","last_unstale":"2023-10-08T16:25:04.173119+0000","last_undegraded":"2023-10-08T16:25:04.173119+0000","last_fullsized":"2023-10-08T16:25:04.173119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:35.049597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195921+0000","last_change":"2023-10-08T16:25:04.191597+0000","last_active":"2023-10-08T16:25:04.195921+0000","last_peered":"2023-10-08T16:25:04.195921+0000","last_clean":"2023-10-08T16:25:04.195921+0000","last_became_active":"2023-10-08T16:25:04.191287+0000","last_became_peered":"2023-10-08T16:25:04.191287+0000","last_unstale":"2023-10-08T16:25:04.195921+0000","last_undegraded":"2023-10-08T16:25:04.195921+0000","last_fullsized":"2023-10-08T16:25:04.195921+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:56.503583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181893+0000","last_change":"2023-10-08T16:25:04.178249+0000","last_active":"2023-10-08T16:25:04.181893+0000","last_peered":"2023-10-08T16:25:04.181893+0000","last_clean":"2023-10-08T16:25:04.181893+0000","last_became_active":"2023-10-08T16:25:04.177989+0000","last_became_peered":"2023-10-08T16:25:04.177989+0000","last_unstale":"2023-10-08T16:25:04.181893+0000","last_undegraded":"2023-10-08T16:25:04.181893+0000","last_fullsized":"2023-10-08T16:25:04.181893+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:39.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189867+0000","last_change":"2023-10-08T16:25:04.185447+0000","last_active":"2023-10-08T16:25:04.189867+0000","last_peered":"2023-10-08T16:25:04.189867+0000","last_clean":"2023-10-08T16:25:04.189867+0000","last_became_active":"2023-10-08T16:25:04.184933+0000","last_became_peered":"2023-10-08T16:25:04.184933+0000","last_unstale":"2023-10-08T16:25:04.189867+0000","last_undegraded":"2023-10-08T16:25:04.189867+0000","last_fullsized":"2023-10-08T16:25:04.189867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198445+0000","last_change":"2023-10-08T16:25:04.191293+0000","last_active":"2023-10-08T16:25:04.198445+0000","last_peered":"2023-10-08T16:25:04.198445+0000","last_clean":"2023-10-08T16:25:04.198445+0000","last_became_active":"2023-10-08T16:25:04.190977+0000","last_became_peered":"2023-10-08T16:25:04.190977+0000","last_unstale":"2023-10-08T16:25:04.198445+0000","last_undegraded":"2023-10-08T16:25:04.198445+0000","last_fullsized":"2023-10-08T16:25:04.198445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:51.509709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203048+0000","last_change":"2023-10-08T16:25:03.164351+0000","last_active":"2023-10-08T16:25:04.203048+0000","last_peered":"2023-10-08T16:25:04.203048+0000","last_clean":"2023-10-08T16:25:04.203048+0000","last_became_active":"2023-10-08T16:25:03.164093+0000","last_became_peered":"2023-10-08T16:25:03.164093+0000","last_unstale":"2023-10-08T16:25:04.203048+0000","last_undegraded":"2023-10-08T16:25:04.203048+0000","last_fullsized":"2023-10-08T16:25:04.203048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:31.593169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187950+0000","last_change":"2023-10-08T16:25:04.186164+0000","last_active":"2023-10-08T16:25:04.187950+0000","last_peered":"2023-10-08T16:25:04.187950+0000","last_clean":"2023-10-08T16:25:04.187950+0000","last_became_active":"2023-10-08T16:25:04.185913+0000","last_became_peered":"2023-10-08T16:25:04.185913+0000","last_unstale":"2023-10-08T16:25:04.187950+0000","last_undegraded":"2023-10-08T16:25:04.187950+0000","last_fullsized":"2023-10-08T16:25:04.187950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:46.826902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195545+0000","last_change":"2023-10-08T16:25:03.158268+0000","last_active":"2023-10-08T16:25:04.195545+0000","last_peered":"2023-10-08T16:25:04.195545+0000","last_clean":"2023-10-08T16:25:04.195545+0000","last_became_active":"2023-10-08T16:25:03.157949+0000","last_became_peered":"2023-10-08T16:25:03.157949+0000","last_unstale":"2023-10-08T16:25:04.195545+0000","last_undegraded":"2023-10-08T16:25:04.195545+0000","last_fullsized":"2023-10-08T16:25:04.195545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:06.052973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.192079+0000","last_change":"2023-10-08T16:25:04.189419+0000","last_active":"2023-10-08T16:25:04.192079+0000","last_peered":"2023-10-08T16:25:04.192079+0000","last_clean":"2023-10-08T16:25:04.192079+0000","last_became_active":"2023-10-08T16:25:04.189092+0000","last_became_peered":"2023-10-08T16:25:04.189092+0000","last_unstale":"2023-10-08T16:25:04.192079+0000","last_undegraded":"2023-10-08T16:25:04.192079+0000","last_fullsized":"2023-10-08T16:25:04.192079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.204118+0000","last_change":"2023-10-08T16:25:03.163834+0000","last_active":"2023-10-08T16:25:04.204118+0000","last_peered":"2023-10-08T16:25:04.204118+0000","last_clean":"2023-10-08T16:25:04.204118+0000","last_became_active":"2023-10-08T16:25:03.163134+0000","last_became_peered":"2023-10-08T16:25:03.163134+0000","last_unstale":"2023-10-08T16:25:04.204118+0000","last_undegraded":"2023-10-08T16:25:04.204118+0000","last_fullsized":"2023-10-08T16:25:04.204118+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184564+0000","last_change":"2023-10-08T16:25:04.181450+0000","last_active":"2023-10-08T16:25:04.184564+0000","last_peered":"2023-10-08T16:25:04.184564+0000","last_clean":"2023-10-08T16:25:04.184564+0000","last_became_active":"2023-10-08T16:25:04.181162+0000","last_became_peered":"2023-10-08T16:25:04.181162+0000","last_unstale":"2023-10-08T16:25:04.184564+0000","last_undegraded":"2023-10-08T16:25:04.184564+0000","last_fullsized":"2023-10-08T16:25:04.184564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:05.833282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205224+0000","last_change":"2023-10-08T16:25:03.167869+0000","last_active":"2023-10-08T16:25:04.205224+0000","last_peered":"2023-10-08T16:25:04.205224+0000","last_clean":"2023-10-08T16:25:04.205224+0000","last_became_active":"2023-10-08T16:25:03.167391+0000","last_became_peered":"2023-10-08T16:25:03.167391+0000","last_unstale":"2023-10-08T16:25:04.205224+0000","last_undegraded":"2023-10-08T16:25:04.205224+0000","last_fullsized":"2023-10-08T16:25:04.205224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170931+0000","last_change":"2023-10-08T16:25:04.168980+0000","last_active":"2023-10-08T16:25:04.170931+0000","last_peered":"2023-10-08T16:25:04.170931+0000","last_clean":"2023-10-08T16:25:04.170931+0000","last_became_active":"2023-10-08T16:25:04.168606+0000","last_became_peered":"2023-10-08T16:25:04.168606+0000","last_unstale":"2023-10-08T16:25:04.170931+0000","last_undegraded":"2023-10-08T16:25:04.170931+0000","last_fullsized":"2023-10-08T16:25:04.170931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196986+0000","last_change":"2023-10-08T16:25:03.157433+0000","last_active":"2023-10-08T16:25:04.196986+0000","last_peered":"2023-10-08T16:25:04.196986+0000","last_clean":"2023-10-08T16:25:04.196986+0000","last_became_active":"2023-10-08T16:25:03.156742+0000","last_became_peered":"2023-10-08T16:25:03.156742+0000","last_unstale":"2023-10-08T16:25:04.196986+0000","last_undegraded":"2023-10-08T16:25:04.196986+0000","last_fullsized":"2023-10-08T16:25:04.196986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:09.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.183303+0000","last_change":"2023-10-08T16:25:04.182653+0000","last_active":"2023-10-08T16:25:04.183303+0000","last_peered":"2023-10-08T16:25:04.183303+0000","last_clean":"2023-10-08T16:25:04.183303+0000","last_became_active":"2023-10-08T16:25:04.182284+0000","last_became_peered":"2023-10-08T16:25:04.182284+0000","last_unstale":"2023-10-08T16:25:04.183303+0000","last_undegraded":"2023-10-08T16:25:04.183303+0000","last_fullsized":"2023-10-08T16:25:04.183303+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.200954+0000","last_change":"2023-10-08T16:25:03.167402+0000","last_active":"2023-10-08T16:25:04.200954+0000","last_peered":"2023-10-08T16:25:04.200954+0000","last_clean":"2023-10-08T16:25:04.200954+0000","last_became_active":"2023-10-08T16:25:03.166793+0000","last_became_peered":"2023-10-08T16:25:03.166793+0000","last_unstale":"2023-10-08T16:25:04.200954+0000","last_undegraded":"2023-10-08T16:25:04.200954+0000","last_fullsized":"2023-10-08T16:25:04.200954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:17.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185722+0000","last_change":"2023-10-08T16:25:04.182471+0000","last_active":"2023-10-08T16:25:04.185722+0000","last_peered":"2023-10-08T16:25:04.185722+0000","last_clean":"2023-10-08T16:25:04.185722+0000","last_became_active":"2023-10-08T16:25:04.182191+0000","last_became_peered":"2023-10-08T16:25:04.182191+0000","last_unstale":"2023-10-08T16:25:04.185722+0000","last_undegraded":"2023-10-08T16:25:04.185722+0000","last_fullsized":"2023-10-08T16:25:04.185722+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:43.756265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169520+0000","last_change":"2023-10-08T16:25:03.161798+0000","last_active":"2023-10-08T16:25:04.169520+0000","last_peered":"2023-10-08T16:25:04.169520+0000","last_clean":"2023-10-08T16:25:04.169520+0000","last_became_active":"2023-10-08T16:25:03.161354+0000","last_became_peered":"2023-10-08T16:25:03.161354+0000","last_unstale":"2023-10-08T16:25:04.169520+0000","last_undegraded":"2023-10-08T16:25:04.169520+0000","last_fullsized":"2023-10-08T16:25:04.169520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:10.765932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186790+0000","last_change":"2023-10-08T16:25:04.184609+0000","last_active":"2023-10-08T16:25:04.186790+0000","last_peered":"2023-10-08T16:25:04.186790+0000","last_clean":"2023-10-08T16:25:04.186790+0000","last_became_active":"2023-10-08T16:25:04.184287+0000","last_became_peered":"2023-10-08T16:25:04.184287+0000","last_unstale":"2023-10-08T16:25:04.186790+0000","last_undegraded":"2023-10-08T16:25:04.186790+0000","last_fullsized":"2023-10-08T16:25:04.186790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:17.070085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.171820+0000","last_change":"2023-10-08T16:25:03.161010+0000","last_active":"2023-10-08T16:25:04.171820+0000","last_peered":"2023-10-08T16:25:04.171820+0000","last_clean":"2023-10-08T16:25:04.171820+0000","last_became_active":"2023-10-08T16:25:03.160730+0000","last_became_peered":"2023-10-08T16:25:03.160730+0000","last_unstale":"2023-10-08T16:25:04.171820+0000","last_undegraded":"2023-10-08T16:25:04.171820+0000","last_fullsized":"2023-10-08T16:25:04.171820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:40.198475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181367+0000","last_change":"2023-10-08T16:25:04.175551+0000","last_active":"2023-10-08T16:25:04.181367+0000","last_peered":"2023-10-08T16:25:04.181367+0000","last_clean":"2023-10-08T16:25:04.181367+0000","last_became_active":"2023-10-08T16:25:04.175276+0000","last_became_peered":"2023-10-08T16:25:04.175276+0000","last_unstale":"2023-10-08T16:25:04.181367+0000","last_undegraded":"2023-10-08T16:25:04.181367+0000","last_fullsized":"2023-10-08T16:25:04.181367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:07.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.166746+0000","last_change":"2023-10-08T16:25:03.162812+0000","last_active":"2023-10-08T16:25:04.166746+0000","last_peered":"2023-10-08T16:25:04.166746+0000","last_clean":"2023-10-08T16:25:04.166746+0000","last_became_active":"2023-10-08T16:25:03.162264+0000","last_became_peered":"2023-10-08T16:25:03.162264+0000","last_unstale":"2023-10-08T16:25:04.166746+0000","last_undegraded":"2023-10-08T16:25:04.166746+0000","last_fullsized":"2023-10-08T16:25:04.166746+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198374+0000","last_change":"2023-10-08T16:25:04.191823+0000","last_active":"2023-10-08T16:25:04.198374+0000","last_peered":"2023-10-08T16:25:04.198374+0000","last_clean":"2023-10-08T16:25:04.198374+0000","last_became_active":"2023-10-08T16:25:04.191483+0000","last_became_peered":"2023-10-08T16:25:04.191483+0000","last_unstale":"2023-10-08T16:25:04.198374+0000","last_undegraded":"2023-10-08T16:25:04.198374+0000","last_fullsized":"2023-10-08T16:25:04.198374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:37.197720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186603+0000","last_change":"2023-10-08T16:25:03.167559+0000","last_active":"2023-10-08T16:25:04.186603+0000","last_peered":"2023-10-08T16:25:04.186603+0000","last_clean":"2023-10-08T16:25:04.186603+0000","last_became_active":"2023-10-08T16:25:03.167203+0000","last_became_peered":"2023-10-08T16:25:03.167203+0000","last_unstale":"2023-10-08T16:25:04.186603+0000","last_undegraded":"2023-10-08T16:25:04.186603+0000","last_fullsized":"2023-10-08T16:25:04.186603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189905+0000","last_change":"2023-10-08T16:25:04.187189+0000","last_active":"2023-10-08T16:25:04.189905+0000","last_peered":"2023-10-08T16:25:04.189905+0000","last_clean":"2023-10-08T16:25:04.189905+0000","last_became_active":"2023-10-08T16:25:04.186869+0000","last_became_peered":"2023-10-08T16:25:04.186869+0000","last_unstale":"2023-10-08T16:25:04.189905+0000","last_undegraded":"2023-10-08T16:25:04.189905+0000","last_fullsized":"2023-10-08T16:25:04.189905+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197991+0000","last_change":"2023-10-08T16:25:03.152315+0000","last_active":"2023-10-08T16:25:04.197991+0000","last_peered":"2023-10-08T16:25:04.197991+0000","last_clean":"2023-10-08T16:25:04.197991+0000","last_became_active":"2023-10-08T16:25:03.152015+0000","last_became_peered":"2023-10-08T16:25:03.152015+0000","last_unstale":"2023-10-08T16:25:04.197991+0000","last_undegraded":"2023-10-08T16:25:04.197991+0000","last_fullsized":"2023-10-08T16:25:04.197991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:04.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180615+0000","last_change":"2023-10-08T16:25:04.177909+0000","last_active":"2023-10-08T16:25:04.180615+0000","last_peered":"2023-10-08T16:25:04.180615+0000","last_clean":"2023-10-08T16:25:04.180615+0000","last_became_active":"2023-10-08T16:25:04.177426+0000","last_became_peered":"2023-10-08T16:25:04.177426+0000","last_unstale":"2023-10-08T16:25:04.180615+0000","last_undegraded":"2023-10-08T16:25:04.180615+0000","last_fullsized":"2023-10-08T16:25:04.180615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:14.184227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205010+0000","last_change":"2023-10-08T16:25:03.165618+0000","last_active":"2023-10-08T16:25:04.205010+0000","last_peered":"2023-10-08T16:25:04.205010+0000","last_clean":"2023-10-08T16:25:04.205010+0000","last_became_active":"2023-10-08T16:25:03.165328+0000","last_became_peered":"2023-10-08T16:25:03.165328+0000","last_unstale":"2023-10-08T16:25:04.205010+0000","last_undegraded":"2023-10-08T16:25:04.205010+0000","last_fullsized":"2023-10-08T16:25:04.205010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:51.440409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186810+0000","last_change":"2023-10-08T16:25:04.183796+0000","last_active":"2023-10-08T16:25:04.186810+0000","last_peered":"2023-10-08T16:25:04.186810+0000","last_clean":"2023-10-08T16:25:04.186810+0000","last_became_active":"2023-10-08T16:25:04.183546+0000","last_became_peered":"2023-10-08T16:25:04.183546+0000","last_unstale":"2023-10-08T16:25:04.186810+0000","last_undegraded":"2023-10-08T16:25:04.186810+0000","last_fullsized":"2023-10-08T16:25:04.186810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:41.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198977+0000","last_change":"2023-10-08T16:25:03.161230+0000","last_active":"2023-10-08T16:25:04.198977+0000","last_peered":"2023-10-08T16:25:04.198977+0000","last_clean":"2023-10-08T16:25:04.198977+0000","last_became_active":"2023-10-08T16:25:03.160899+0000","last_became_peered":"2023-10-08T16:25:03.160899+0000","last_unstale":"2023-10-08T16:25:04.198977+0000","last_undegraded":"2023-10-08T16:25:04.198977+0000","last_fullsized":"2023-10-08T16:25:04.198977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:39.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170828+0000","last_change":"2023-10-08T16:25:04.169503+0000","last_active":"2023-10-08T16:25:04.170828+0000","last_peered":"2023-10-08T16:25:04.170828+0000","last_clean":"2023-10-08T16:25:04.170828+0000","last_became_active":"2023-10-08T16:25:04.169199+0000","last_became_peered":"2023-10-08T16:25:04.169199+0000","last_unstale":"2023-10-08T16:25:04.170828+0000","last_undegraded":"2023-10-08T16:25:04.170828+0000","last_fullsized":"2023-10-08T16:25:04.170828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:20.382230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186131+0000","last_change":"2023-10-08T16:25:03.169314+0000","last_active":"2023-10-08T16:25:04.186131+0000","last_peered":"2023-10-08T16:25:04.186131+0000","last_clean":"2023-10-08T16:25:04.186131+0000","last_became_active":"2023-10-08T16:25:03.169026+0000","last_became_peered":"2023-10-08T16:25:03.169026+0000","last_unstale":"2023-10-08T16:25:04.186131+0000","last_undegraded":"2023-10-08T16:25:04.186131+0000","last_fullsized":"2023-10-08T16:25:04.186131+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.194997+0000","last_change":"2023-10-08T16:25:04.191999+0000","last_active":"2023-10-08T16:25:04.194997+0000","last_peered":"2023-10-08T16:25:04.194997+0000","last_clean":"2023-10-08T16:25:04.194997+0000","last_became_active":"2023-10-08T16:25:04.191652+0000","last_became_peered":"2023-10-08T16:25:04.191652+0000","last_unstale":"2023-10-08T16:25:04.194997+0000","last_undegraded":"2023-10-08T16:25:04.194997+0000","last_fullsized":"2023-10-08T16:25:04.194997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:33.496567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.164795+0000","last_change":"2023-10-08T16:25:03.153668+0000","last_active":"2023-10-08T16:25:04.164795+0000","last_peered":"2023-10-08T16:25:04.164795+0000","last_clean":"2023-10-08T16:25:04.164795+0000","last_became_active":"2023-10-08T16:25:03.153360+0000","last_became_peered":"2023-10-08T16:25:03.153360+0000","last_unstale":"2023-10-08T16:25:04.164795+0000","last_undegraded":"2023-10-08T16:25:04.164795+0000","last_fullsized":"2023-10-08T16:25:04.164795+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:11:52.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186812+0000","last_change":"2023-10-08T16:25:04.184948+0000","last_active":"2023-10-08T16:25:04.186812+0000","last_peered":"2023-10-08T16:25:04.186812+0000","last_clean":"2023-10-08T16:25:04.186812+0000","last_became_active":"2023-10-08T16:25:04.184601+0000","last_became_peered":"2023-10-08T16:25:04.184601+0000","last_unstale":"2023-10-08T16:25:04.186812+0000","last_undegraded":"2023-10-08T16:25:04.186812+0000","last_fullsized":"2023-10-08T16:25:04.186812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:18.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"98'8","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203876+0000","last_change":"2023-10-08T16:25:03.160242+0000","last_active":"2023-10-08T16:25:04.203876+0000","last_peered":"2023-10-08T16:25:04.203876+0000","last_clean":"2023-10-08T16:25:04.203876+0000","last_became_active":"2023-10-08T16:25:03.159968+0000","last_became_peered":"2023-10-08T16:25:03.159968+0000","last_unstale":"2023-10-08T16:25:04.203876+0000","last_undegraded":"2023-10-08T16:25:04.203876+0000","last_fullsized":"2023-10-08T16:25:04.203876+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178775+0000","last_change":"2023-10-08T16:25:04.174103+0000","last_active":"2023-10-08T16:25:04.178775+0000","last_peered":"2023-10-08T16:25:04.178775+0000","last_clean":"2023-10-08T16:25:04.178775+0000","last_became_active":"2023-10-08T16:25:04.173838+0000","last_became_peered":"2023-10-08T16:25:04.173838+0000","last_unstale":"2023-10-08T16:25:04.178775+0000","last_undegraded":"2023-10-08T16:25:04.178775+0000","last_fullsized":"2023-10-08T16:25:04.178775+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.202483+0000","last_change":"2023-10-08T16:25:03.171328+0000","last_active":"2023-10-08T16:25:04.202483+0000","last_peered":"2023-10-08T16:25:04.202483+0000","last_clean":"2023-10-08T16:25:04.202483+0000","last_became_active":"2023-10-08T16:25:03.171110+0000","last_became_peered":"2023-10-08T16:25:03.171110+0000","last_unstale":"2023-10-08T16:25:04.202483+0000","last_undegraded":"2023-10-08T16:25:04.202483+0000","last_fullsized":"2023-10-08T16:25:04.202483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184559+0000","last_change":"2023-10-08T16:25:04.181795+0000","last_active":"2023-10-08T16:25:04.184559+0000","last_peered":"2023-10-08T16:25:04.184559+0000","last_clean":"2023-10-08T16:25:04.184559+0000","last_became_active":"2023-10-08T16:25:04.181403+0000","last_became_peered":"2023-10-08T16:25:04.181403+0000","last_unstale":"2023-10-08T16:25:04.184559+0000","last_undegraded":"2023-10-08T16:25:04.184559+0000","last_fullsized":"2023-10-08T16:25:04.184559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:45.404512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.204126+0000","last_change":"2023-10-08T16:25:03.166077+0000","last_active":"2023-10-08T16:25:04.204126+0000","last_peered":"2023-10-08T16:25:04.204126+0000","last_clean":"2023-10-08T16:25:04.204126+0000","last_became_active":"2023-10-08T16:25:03.165790+0000","last_became_peered":"2023-10-08T16:25:03.165790+0000","last_unstale":"2023-10-08T16:25:04.204126+0000","last_undegraded":"2023-10-08T16:25:04.204126+0000","last_fullsized":"2023-10-08T16:25:04.204126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180117+0000","last_change":"2023-10-08T16:25:04.178756+0000","last_active":"2023-10-08T16:25:04.180117+0000","last_peered":"2023-10-08T16:25:04.180117+0000","last_clean":"2023-10-08T16:25:04.180117+0000","last_became_active":"2023-10-08T16:25:04.178493+0000","last_became_peered":"2023-10-08T16:25:04.178493+0000","last_unstale":"2023-10-08T16:25:04.180117+0000","last_undegraded":"2023-10-08T16:25:04.180117+0000","last_fullsized":"2023-10-08T16:25:04.180117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:09.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203675+0000","last_change":"2023-10-08T16:25:03.162613+0000","last_active":"2023-10-08T16:25:04.203675+0000","last_peered":"2023-10-08T16:25:04.203675+0000","last_clean":"2023-10-08T16:25:04.203675+0000","last_became_active":"2023-10-08T16:25:03.162298+0000","last_became_peered":"2023-10-08T16:25:03.162298+0000","last_unstale":"2023-10-08T16:25:04.203675+0000","last_undegraded":"2023-10-08T16:25:04.203675+0000","last_fullsized":"2023-10-08T16:25:04.203675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180635+0000","last_change":"2023-10-08T16:25:04.178425+0000","last_active":"2023-10-08T16:25:04.180635+0000","last_peered":"2023-10-08T16:25:04.180635+0000","last_clean":"2023-10-08T16:25:04.180635+0000","last_became_active":"2023-10-08T16:25:04.178158+0000","last_became_peered":"2023-10-08T16:25:04.178158+0000","last_unstale":"2023-10-08T16:25:04.180635+0000","last_undegraded":"2023-10-08T16:25:04.180635+0000","last_fullsized":"2023-10-08T16:25:04.180635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:52.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169658+0000","last_change":"2023-10-08T16:25:03.162457+0000","last_active":"2023-10-08T16:25:04.169658+0000","last_peered":"2023-10-08T16:25:04.169658+0000","last_clean":"2023-10-08T16:25:04.169658+0000","last_became_active":"2023-10-08T16:25:03.162174+0000","last_became_peered":"2023-10-08T16:25:03.162174+0000","last_unstale":"2023-10-08T16:25:04.169658+0000","last_undegraded":"2023-10-08T16:25:04.169658+0000","last_fullsized":"2023-10-08T16:25:04.169658+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:14.112628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178384+0000","last_change":"2023-10-08T16:25:04.176022+0000","last_active":"2023-10-08T16:25:04.178384+0000","last_peered":"2023-10-08T16:25:04.178384+0000","last_clean":"2023-10-08T16:25:04.178384+0000","last_became_active":"2023-10-08T16:25:04.175768+0000","last_became_peered":"2023-10-08T16:25:04.175768+0000","last_unstale":"2023-10-08T16:25:04.178384+0000","last_undegraded":"2023-10-08T16:25:04.178384+0000","last_fullsized":"2023-10-08T16:25:04.178384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:12.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186200+0000","last_change":"2023-10-08T16:25:03.167677+0000","last_active":"2023-10-08T16:25:04.186200+0000","last_peered":"2023-10-08T16:25:04.186200+0000","last_clean":"2023-10-08T16:25:04.186200+0000","last_became_active":"2023-10-08T16:25:03.167109+0000","last_became_peered":"2023-10-08T16:25:03.167109+0000","last_unstale":"2023-10-08T16:25:04.186200+0000","last_undegraded":"2023-10-08T16:25:04.186200+0000","last_fullsized":"2023-10-08T16:25:04.186200+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187315+0000","last_change":"2023-10-08T16:25:04.180103+0000","last_active":"2023-10-08T16:25:04.187315+0000","last_peered":"2023-10-08T16:25:04.187315+0000","last_clean":"2023-10-08T16:25:04.187315+0000","last_became_active":"2023-10-08T16:25:04.179854+0000","last_became_peered":"2023-10-08T16:25:04.179854+0000","last_unstale":"2023-10-08T16:25:04.187315+0000","last_undegraded":"2023-10-08T16:25:04.187315+0000","last_fullsized":"2023-10-08T16:25:04.187315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:15.320837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.164784+0000","last_change":"2023-10-08T16:25:03.153094+0000","last_active":"2023-10-08T16:25:04.164784+0000","last_peered":"2023-10-08T16:25:04.164784+0000","last_clean":"2023-10-08T16:25:04.164784+0000","last_became_active":"2023-10-08T16:25:03.152761+0000","last_became_peered":"2023-10-08T16:25:03.152761+0000","last_unstale":"2023-10-08T16:25:04.164784+0000","last_undegraded":"2023-10-08T16:25:04.164784+0000","last_fullsized":"2023-10-08T16:25:04.164784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:29.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187138+0000","last_change":"2023-10-08T16:25:04.180924+0000","last_active":"2023-10-08T16:25:04.187138+0000","last_peered":"2023-10-08T16:25:04.187138+0000","last_clean":"2023-10-08T16:25:04.187138+0000","last_became_active":"2023-10-08T16:25:04.180659+0000","last_became_peered":"2023-10-08T16:25:04.180659+0000","last_unstale":"2023-10-08T16:25:04.187138+0000","last_undegraded":"2023-10-08T16:25:04.187138+0000","last_fullsized":"2023-10-08T16:25:04.187138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:03.340620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.172362+0000","last_change":"2023-10-08T16:25:03.152697+0000","last_active":"2023-10-08T16:25:04.172362+0000","last_peered":"2023-10-08T16:25:04.172362+0000","last_clean":"2023-10-08T16:25:04.172362+0000","last_became_active":"2023-10-08T16:25:03.152373+0000","last_became_peered":"2023-10-08T16:25:03.152373+0000","last_unstale":"2023-10-08T16:25:04.172362+0000","last_undegraded":"2023-10-08T16:25:04.172362+0000","last_fullsized":"2023-10-08T16:25:04.172362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:19.376954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186336+0000","last_change":"2023-10-08T16:25:04.179784+0000","last_active":"2023-10-08T16:25:04.186336+0000","last_peered":"2023-10-08T16:25:04.186336+0000","last_clean":"2023-10-08T16:25:04.186336+0000","last_became_active":"2023-10-08T16:25:04.179540+0000","last_became_peered":"2023-10-08T16:25:04.179540+0000","last_unstale":"2023-10-08T16:25:04.186336+0000","last_undegraded":"2023-10-08T16:25:04.186336+0000","last_fullsized":"2023-10-08T16:25:04.186336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205005+0000","last_change":"2023-10-08T16:25:03.167710+0000","last_active":"2023-10-08T16:25:04.205005+0000","last_peered":"2023-10-08T16:25:04.205005+0000","last_clean":"2023-10-08T16:25:04.205005+0000","last_became_active":"2023-10-08T16:25:03.167346+0000","last_became_peered":"2023-10-08T16:25:03.167346+0000","last_unstale":"2023-10-08T16:25:04.205005+0000","last_undegraded":"2023-10-08T16:25:04.205005+0000","last_fullsized":"2023-10-08T16:25:04.205005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181147+0000","last_change":"2023-10-08T16:25:04.174009+0000","last_active":"2023-10-08T16:25:04.181147+0000","last_peered":"2023-10-08T16:25:04.181147+0000","last_clean":"2023-10-08T16:25:04.181147+0000","last_became_active":"2023-10-08T16:25:04.173631+0000","last_became_peered":"2023-10-08T16:25:04.173631+0000","last_unstale":"2023-10-08T16:25:04.181147+0000","last_undegraded":"2023-10-08T16:25:04.181147+0000","last_fullsized":"2023-10-08T16:25:04.181147+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:17.449696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.165144+0000","last_change":"2023-10-08T16:25:03.154403+0000","last_active":"2023-10-08T16:25:04.165144+0000","last_peered":"2023-10-08T16:25:04.165144+0000","last_clean":"2023-10-08T16:25:04.165144+0000","last_became_active":"2023-10-08T16:25:03.153289+0000","last_became_peered":"2023-10-08T16:25:03.153289+0000","last_unstale":"2023-10-08T16:25:04.165144+0000","last_undegraded":"2023-10-08T16:25:04.165144+0000","last_fullsized":"2023-10-08T16:25:04.165144+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:27.655730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196073+0000","last_change":"2023-10-08T16:25:04.189875+0000","last_active":"2023-10-08T16:25:04.196073+0000","last_peered":"2023-10-08T16:25:04.196073+0000","last_clean":"2023-10-08T16:25:04.196073+0000","last_became_active":"2023-10-08T16:25:04.189608+0000","last_became_peered":"2023-10-08T16:25:04.189608+0000","last_unstale":"2023-10-08T16:25:04.196073+0000","last_undegraded":"2023-10-08T16:25:04.196073+0000","last_fullsized":"2023-10-08T16:25:04.196073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:17.805094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174488+0000","last_change":"2023-10-08T16:25:03.159563+0000","last_active":"2023-10-08T16:25:04.174488+0000","last_peered":"2023-10-08T16:25:04.174488+0000","last_clean":"2023-10-08T16:25:04.174488+0000","last_became_active":"2023-10-08T16:25:03.159252+0000","last_became_peered":"2023-10-08T16:25:03.159252+0000","last_unstale":"2023-10-08T16:25:04.174488+0000","last_undegraded":"2023-10-08T16:25:04.174488+0000","last_fullsized":"2023-10-08T16:25:04.174488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:09.955599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186235+0000","last_change":"2023-10-08T16:25:04.182673+0000","last_active":"2023-10-08T16:25:04.186235+0000","last_peered":"2023-10-08T16:25:04.186235+0000","last_clean":"2023-10-08T16:25:04.186235+0000","last_became_active":"2023-10-08T16:25:04.182368+0000","last_became_peered":"2023-10-08T16:25:04.182368+0000","last_unstale":"2023-10-08T16:25:04.186235+0000","last_undegraded":"2023-10-08T16:25:04.186235+0000","last_fullsized":"2023-10-08T16:25:04.186235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:41.602049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170934+0000","last_change":"2023-10-08T16:25:03.153859+0000","last_active":"2023-10-08T16:25:04.170934+0000","last_peered":"2023-10-08T16:25:04.170934+0000","last_clean":"2023-10-08T16:25:04.170934+0000","last_became_active":"2023-10-08T16:25:03.153583+0000","last_became_peered":"2023-10-08T16:25:03.153583+0000","last_unstale":"2023-10-08T16:25:04.170934+0000","last_undegraded":"2023-10-08T16:25:04.170934+0000","last_fullsized":"2023-10-08T16:25:04.170934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:55.498306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191111+0000","last_change":"2023-10-08T16:25:04.188418+0000","last_active":"2023-10-08T16:25:04.191111+0000","last_peered":"2023-10-08T16:25:04.191111+0000","last_clean":"2023-10-08T16:25:04.191111+0000","last_became_active":"2023-10-08T16:25:04.188160+0000","last_became_peered":"2023-10-08T16:25:04.188160+0000","last_unstale":"2023-10-08T16:25:04.191111+0000","last_undegraded":"2023-10-08T16:25:04.191111+0000","last_fullsized":"2023-10-08T16:25:04.191111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:42.749730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174357+0000","last_change":"2023-10-08T16:25:03.154067+0000","last_active":"2023-10-08T16:25:04.174357+0000","last_peered":"2023-10-08T16:25:04.174357+0000","last_clean":"2023-10-08T16:25:04.174357+0000","last_became_active":"2023-10-08T16:25:03.153792+0000","last_became_peered":"2023-10-08T16:25:03.153792+0000","last_unstale":"2023-10-08T16:25:04.174357+0000","last_undegraded":"2023-10-08T16:25:04.174357+0000","last_fullsized":"2023-10-08T16:25:04.174357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:05.481126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.193106+0000","last_change":"2023-10-08T16:25:04.188647+0000","last_active":"2023-10-08T16:25:04.193106+0000","last_peered":"2023-10-08T16:25:04.193106+0000","last_clean":"2023-10-08T16:25:04.193106+0000","last_became_active":"2023-10-08T16:25:04.187982+0000","last_became_peered":"2023-10-08T16:25:04.187982+0000","last_unstale":"2023-10-08T16:25:04.193106+0000","last_undegraded":"2023-10-08T16:25:04.193106+0000","last_fullsized":"2023-10-08T16:25:04.193106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168357+0000","last_change":"2023-10-08T16:25:03.161066+0000","last_active":"2023-10-08T16:25:04.168357+0000","last_peered":"2023-10-08T16:25:04.168357+0000","last_clean":"2023-10-08T16:25:04.168357+0000","last_became_active":"2023-10-08T16:25:03.160765+0000","last_became_peered":"2023-10-08T16:25:03.160765+0000","last_unstale":"2023-10-08T16:25:04.168357+0000","last_undegraded":"2023-10-08T16:25:04.168357+0000","last_fullsized":"2023-10-08T16:25:04.168357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:23.727949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187451+0000","last_change":"2023-10-08T16:25:04.181787+0000","last_active":"2023-10-08T16:25:04.187451+0000","last_peered":"2023-10-08T16:25:04.187451+0000","last_clean":"2023-10-08T16:25:04.187451+0000","last_became_active":"2023-10-08T16:25:04.181507+0000","last_became_peered":"2023-10-08T16:25:04.181507+0000","last_unstale":"2023-10-08T16:25:04.187451+0000","last_undegraded":"2023-10-08T16:25:04.187451+0000","last_fullsized":"2023-10-08T16:25:04.187451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:10.414471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.167514+0000","last_change":"2023-10-08T16:25:03.160589+0000","last_active":"2023-10-08T16:25:04.167514+0000","last_peered":"2023-10-08T16:25:04.167514+0000","last_clean":"2023-10-08T16:25:04.167514+0000","last_became_active":"2023-10-08T16:25:03.160320+0000","last_became_peered":"2023-10-08T16:25:03.160320+0000","last_unstale":"2023-10-08T16:25:04.167514+0000","last_undegraded":"2023-10-08T16:25:04.167514+0000","last_fullsized":"2023-10-08T16:25:04.167514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189861+0000","last_change":"2023-10-08T16:25:04.186865+0000","last_active":"2023-10-08T16:25:04.189861+0000","last_peered":"2023-10-08T16:25:04.189861+0000","last_clean":"2023-10-08T16:25:04.189861+0000","last_became_active":"2023-10-08T16:25:04.185912+0000","last_became_peered":"2023-10-08T16:25:04.185912+0000","last_unstale":"2023-10-08T16:25:04.189861+0000","last_undegraded":"2023-10-08T16:25:04.189861+0000","last_fullsized":"2023-10-08T16:25:04.189861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.177861+0000","last_change":"2023-10-08T16:25:03.166929+0000","last_active":"2023-10-08T16:25:04.177861+0000","last_peered":"2023-10-08T16:25:04.177861+0000","last_clean":"2023-10-08T16:25:04.177861+0000","last_became_active":"2023-10-08T16:25:03.166366+0000","last_became_peered":"2023-10-08T16:25:03.166366+0000","last_unstale":"2023-10-08T16:25:04.177861+0000","last_undegraded":"2023-10-08T16:25:04.177861+0000","last_fullsized":"2023-10-08T16:25:04.177861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196970+0000","last_change":"2023-10-08T16:25:04.193416+0000","last_active":"2023-10-08T16:25:04.196970+0000","last_peered":"2023-10-08T16:25:04.196970+0000","last_clean":"2023-10-08T16:25:04.196970+0000","last_became_active":"2023-10-08T16:25:04.193106+0000","last_became_peered":"2023-10-08T16:25:04.193106+0000","last_unstale":"2023-10-08T16:25:04.196970+0000","last_undegraded":"2023-10-08T16:25:04.196970+0000","last_fullsized":"2023-10-08T16:25:04.196970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:09.405286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205316+0000","last_change":"2023-10-08T16:25:03.168169+0000","last_active":"2023-10-08T16:25:04.205316+0000","last_peered":"2023-10-08T16:25:04.205316+0000","last_clean":"2023-10-08T16:25:04.205316+0000","last_became_active":"2023-10-08T16:25:03.167889+0000","last_became_peered":"2023-10-08T16:25:03.167889+0000","last_unstale":"2023-10-08T16:25:04.205316+0000","last_undegraded":"2023-10-08T16:25:04.205316+0000","last_fullsized":"2023-10-08T16:25:04.205316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"88'183","reported_seq":469,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168988+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:04.168988+0000","last_peered":"2023-10-08T16:25:04.168988+0000","last_clean":"2023-10-08T16:25:04.168988+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:04.168988+0000","last_undegraded":"2023-10-08T16:25:04.168988+0000","last_fullsized":"2023-10-08T16:25:04.168988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307248,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064592,"statfs":{"total":96636764160,"available":96322142208,"internally_reserved":0,"allocated":1810432,"data_stored":1176158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.48499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97199999999999998,"5min":0.98299999999999998,"15min":1.103},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.089},"last":0.63300000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.86099999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.032,"15min":1.1000000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":1.006},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.98299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.234},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.53000000000000003,"5min":0.439,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3919999999999999},"last":0.89200000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.351,"5min":1.351,"15min":1.3680000000000001},"last":1.073},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":1.022}]},{"osd":6,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.323},"last":1.085},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.448},"last":1.0589999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":0.96399999999999997,"15min":1.125},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.65700000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.99199999999999999,"15min":1.365},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.997,"15min":1.0549999999999999},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":1.071,"15min":1.552},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.4570000000000001},"last":0.752}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72999999999999998,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.0149999999999999,"15min":1.069},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.619},"last":0.77800000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.272,"15min":1.272},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.621}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.74099999999999999},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85699999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.85599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575036,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":587326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44400000000000001,"15min":0.45000000000000001},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.873},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.82199999999999995,"15min":1.0680000000000001},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.65400000000000003,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.51000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.629},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":1.472},"last":0.54600000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.026,"15min":1.373},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.2230000000000001,"15min":1.375},"last":0.84899999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":1.157,"15min":1.276},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.085,"15min":1.224},"last":0.72399999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.63400000000000001,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0069999999999999,"5min":1.0800000000000001,"15min":1.429},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0209999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0109999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0960000000000001,"15min":1.514},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575036,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1802240,"data_stored":1175570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.442},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.56799999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.46600000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.89500000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":0.98999999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0209999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":0.93799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":1220608,"data_stored":586738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.53600000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.80800000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.91200000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.30499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.32500000000000001,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.504}]},{"osd":2,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.79200000000000004,"5min":1,"15min":1},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2789999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.748}]},{"osd":5,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":1.0589999999999999,"5min":1.093,"15min":1.3200000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.996,"5min":1.1799999999999999,"15min":1.397},"last":0.89500000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82399999999999995,"15min":0.84899999999999998},"min":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.0429999999999999,"5min":1.153,"15min":1.306},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.321},"last":0.92200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575037,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":585272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.80700000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.56999999999999995,"5min":0.504,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.60399999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.004,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.754,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.085,"15min":1.216},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1479999999999999},"last":0.627},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.505,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0309999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.47,"15min":1.47},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.022,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65100000000000002},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":0.97099999999999997,"5min":2.661,"15min":2.661},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.754}]},{"osd":7,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.117,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0760000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310760,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061080,"statfs":{"total":96636764160,"available":96318545920,"internally_reserved":0,"allocated":1212416,"data_stored":585292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.745}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.47799999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.622},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":0.57899999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.52400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.71299999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.72699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:13.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:13.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.795+0000 7f10ab19d700 1 Processor -- start 2023-10-08T16:25:13.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.795+0000 7f10ab19d700 1 -- start start 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10ab19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10a4142fd0 0x7f10a40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10ab19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 0x7f10a406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10ab19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40ca480 con 0x7f10a4142c00 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10ab19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a40c8220 con 0x7f10a4142fd0 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10ab19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a415e240 con 0x7f10a40c7dc0 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10a999a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10a4142fd0 0x7f10a40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10a999a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f10a4142fd0 0x7f10a40c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55266/0 (socket says 172.21.15.12:55266) 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10a999a700 1 -- 172.21.15.12:0/2375113249 learned_addr learned my addr 172.21.15.12:0/2375113249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:13.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10aa99c700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 0x7f10a406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10a999a700 1 -- 172.21.15.12:0/2375113249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 msgr2=0x7f10a406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.797+0000 7f10a999a700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 0x7f10a406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a999a700 1 -- 172.21.15.12:0/2375113249 >> v1:172.21.15.29:6789/0 conn(0x7f10a4142c00 legacy=0x7f10a406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a999a700 1 -- 172.21.15.12:0/2375113249 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a406b350 con 0x7f10a4142fd0 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10aa99c700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 0x7f10a406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:13.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a999a700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a4142fd0 0x7f10a40c7880 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f10940099b0 tx=0x7f1094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd7c1e55c984838 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a9199700 1 -- 172.21.15.12:0/2375113249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400b860 con 0x7f10a4142fd0 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a9199700 1 -- 172.21.15.12:0/2375113249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109400b9c0 con 0x7f10a4142fd0 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.798+0000 7f10a9199700 1 -- 172.21.15.12:0/2375113249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400bd60 con 0x7f10a4142fd0 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 -- 172.21.15.12:0/2375113249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a4142fd0 msgr2=0x7f10a40c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a4142fd0 0x7f10a40c7880 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f10940099b0 tx=0x7f1094009250 comp rx=0 tx=0).stop 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 -- 172.21.15.12:0/2375113249 shutdown_connections 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a40c7dc0 0x7f10a406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 --2- 172.21.15.12:0/2375113249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a4142fd0 0x7f10a40c7880 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 -- 172.21.15.12:0/2375113249 >> 172.21.15.12:0/2375113249 conn(0x7f10a40675a0 msgr2=0x7f10a40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 -- 172.21.15.12:0/2375113249 shutdown_connections 2023-10-08T16:25:13.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.799+0000 7f10ab19d700 1 -- 172.21.15.12:0/2375113249 wait complete. 2023-10-08T16:25:13.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.800+0000 7f10ab19d700 1 Processor -- start 2023-10-08T16:25:13.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.800+0000 7f10ab19d700 1 -- start start 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 0x7f10a40b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 0x7f10a4159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40b2960 con 0x7f10a40c7dc0 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40b20c0 con 0x7f10a4142fd0 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10ab19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a40b23a0 con 0x7f10a4142c00 2023-10-08T16:25:13.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.801+0000 7f10aa19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55276/0 (socket says 172.21.15.12:55276) 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 -- 172.21.15.12:0/963530035 learned_addr learned my addr 172.21.15.12:0/963530035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10a999a700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 0x7f10a40b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa99c700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 0x7f10a4159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 -- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 msgr2=0x7f10a40b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 0x7f10a40b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 -- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 msgr2=0x7f10a4159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 0x7f10a4159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:13.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 -- 172.21.15.12:0/963530035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10940094f0 con 0x7f10a40c7dc0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa99c700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 0x7f10a4159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10a999a700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 0x7f10a40b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f10aa19b700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c590 tx=0x7f10a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.802+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0011590 con 0x7f10a40c7dc0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.803+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00116f0 con 0x7f10a40c7dc0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.803+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a40b2680 con 0x7f10a40c7dc0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.803+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a0011ab0 con 0x7f10a40c7dc0 2023-10-08T16:25:13.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.803+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a4159680 con 0x7f10a40c7dc0 2023-10-08T16:25:13.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.804+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a41598a0 con 0x7f10a40c7dc0 2023-10-08T16:25:13.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.805+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10a001b3b0 con 0x7f10a40c7dc0 2023-10-08T16:25:13.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.805+0000 7f109a7fc700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 0x7f10880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:13.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.806+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f10a0083c70 con 0x7f10a40c7dc0 2023-10-08T16:25:13.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.806+0000 7f10a999a700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 0x7f10880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:13.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.806+0000 7f10a999a700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 0x7f10880693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10940099b0 tx=0x7f1094017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:13.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:13.810+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10a0050d50 con 0x7f10a40c7dc0 2023-10-08T16:25:14.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.006+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10a40c57d0 con 0x7f1088066f30 2023-10-08T16:25:14.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.015+0000 7f109a7fc700 1 -- 172.21.15.12:0/963530035 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289048 (secure 0 0 0) 0x7f10a40c57d0 con 0x7f1088066f30 2023-10-08T16:25:14.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 msgr2=0x7f10880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 0x7f10880693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10940099b0 tx=0x7f1094017000 comp rx=0 tx=0).stop 2023-10-08T16:25:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 msgr2=0x7f10a413e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f10a000c590 tx=0x7f10a000c950 comp rx=0 tx=0).stop 2023-10-08T16:25:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 shutdown_connections 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1088066f30 0x7f10880693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f10a40c7dc0 0x7f10a413e960 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f10a4142fd0 0x7f10a4159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 --2- 172.21.15.12:0/963530035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f10a4142c00 0x7f10a40b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 >> 172.21.15.12:0/963530035 conn(0x7f10a40675a0 msgr2=0x7f10a40c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 shutdown_connections 2023-10-08T16:25:14.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.019+0000 7f10ab19d700 1 -- 172.21.15.12:0/963530035 wait complete. 2023-10-08T16:25:14.024 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:14.037 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:25:13.634579+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438120,"kb_used_data":10664,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752536600,"statfs":{"total":773094113280,"available":770597478400,"internally_reserved":0,"allocated":10919936,"data_stored":5866964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.471368"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187439+0000","last_change":"2023-10-08T16:25:04.184423+0000","last_active":"2023-10-08T16:25:04.187439+0000","last_peered":"2023-10-08T16:25:04.187439+0000","last_clean":"2023-10-08T16:25:04.187439+0000","last_became_active":"2023-10-08T16:25:04.184164+0000","last_became_peered":"2023-10-08T16:25:04.184164+0000","last_unstale":"2023-10-08T16:25:04.187439+0000","last_undegraded":"2023-10-08T16:25:04.187439+0000","last_fullsized":"2023-10-08T16:25:04.187439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:41.179128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197698+0000","last_change":"2023-10-08T16:25:04.195798+0000","last_active":"2023-10-08T16:25:04.197698+0000","last_peered":"2023-10-08T16:25:04.197698+0000","last_clean":"2023-10-08T16:25:04.197698+0000","last_became_active":"2023-10-08T16:25:04.195557+0000","last_became_peered":"2023-10-08T16:25:04.195557+0000","last_unstale":"2023-10-08T16:25:04.197698+0000","last_undegraded":"2023-10-08T16:25:04.197698+0000","last_fullsized":"2023-10-08T16:25:04.197698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:52.084740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185291+0000","last_change":"2023-10-08T16:25:04.177365+0000","last_active":"2023-10-08T16:25:04.185291+0000","last_peered":"2023-10-08T16:25:04.185291+0000","last_clean":"2023-10-08T16:25:04.185291+0000","last_became_active":"2023-10-08T16:25:04.177078+0000","last_became_peered":"2023-10-08T16:25:04.177078+0000","last_unstale":"2023-10-08T16:25:04.185291+0000","last_undegraded":"2023-10-08T16:25:04.185291+0000","last_fullsized":"2023-10-08T16:25:04.185291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:32.063542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191108+0000","last_change":"2023-10-08T16:25:04.189784+0000","last_active":"2023-10-08T16:25:04.191108+0000","last_peered":"2023-10-08T16:25:04.191108+0000","last_clean":"2023-10-08T16:25:04.191108+0000","last_became_active":"2023-10-08T16:25:04.189487+0000","last_became_peered":"2023-10-08T16:25:04.189487+0000","last_unstale":"2023-10-08T16:25:04.191108+0000","last_undegraded":"2023-10-08T16:25:04.191108+0000","last_fullsized":"2023-10-08T16:25:04.191108+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:32.166576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185816+0000","last_change":"2023-10-08T16:25:04.183703+0000","last_active":"2023-10-08T16:25:04.185816+0000","last_peered":"2023-10-08T16:25:04.185816+0000","last_clean":"2023-10-08T16:25:04.185816+0000","last_became_active":"2023-10-08T16:25:04.183400+0000","last_became_peered":"2023-10-08T16:25:04.183400+0000","last_unstale":"2023-10-08T16:25:04.185816+0000","last_undegraded":"2023-10-08T16:25:04.185816+0000","last_fullsized":"2023-10-08T16:25:04.185816+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:34.301554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.190552+0000","last_change":"2023-10-08T16:25:04.189167+0000","last_active":"2023-10-08T16:25:04.190552+0000","last_peered":"2023-10-08T16:25:04.190552+0000","last_clean":"2023-10-08T16:25:04.190552+0000","last_became_active":"2023-10-08T16:25:04.188893+0000","last_became_peered":"2023-10-08T16:25:04.188893+0000","last_unstale":"2023-10-08T16:25:04.190552+0000","last_undegraded":"2023-10-08T16:25:04.190552+0000","last_fullsized":"2023-10-08T16:25:04.190552+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181870+0000","last_change":"2023-10-08T16:25:04.173844+0000","last_active":"2023-10-08T16:25:04.181870+0000","last_peered":"2023-10-08T16:25:04.181870+0000","last_clean":"2023-10-08T16:25:04.181870+0000","last_became_active":"2023-10-08T16:25:04.173547+0000","last_became_peered":"2023-10-08T16:25:04.173547+0000","last_unstale":"2023-10-08T16:25:04.181870+0000","last_undegraded":"2023-10-08T16:25:04.181870+0000","last_fullsized":"2023-10-08T16:25:04.181870+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:17.369095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189887+0000","last_change":"2023-10-08T16:25:04.187710+0000","last_active":"2023-10-08T16:25:04.189887+0000","last_peered":"2023-10-08T16:25:04.189887+0000","last_clean":"2023-10-08T16:25:04.189887+0000","last_became_active":"2023-10-08T16:25:04.187434+0000","last_became_peered":"2023-10-08T16:25:04.187434+0000","last_unstale":"2023-10-08T16:25:04.189887+0000","last_undegraded":"2023-10-08T16:25:04.189887+0000","last_fullsized":"2023-10-08T16:25:04.189887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:13:34.020887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191642+0000","last_change":"2023-10-08T16:25:04.188642+0000","last_active":"2023-10-08T16:25:04.191642+0000","last_peered":"2023-10-08T16:25:04.191642+0000","last_clean":"2023-10-08T16:25:04.191642+0000","last_became_active":"2023-10-08T16:25:04.188360+0000","last_became_peered":"2023-10-08T16:25:04.188360+0000","last_unstale":"2023-10-08T16:25:04.191642+0000","last_undegraded":"2023-10-08T16:25:04.191642+0000","last_fullsized":"2023-10-08T16:25:04.191642+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:18.725697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180825+0000","last_change":"2023-10-08T16:25:04.178519+0000","last_active":"2023-10-08T16:25:04.180825+0000","last_peered":"2023-10-08T16:25:04.180825+0000","last_clean":"2023-10-08T16:25:04.180825+0000","last_became_active":"2023-10-08T16:25:04.178189+0000","last_became_peered":"2023-10-08T16:25:04.178189+0000","last_unstale":"2023-10-08T16:25:04.180825+0000","last_undegraded":"2023-10-08T16:25:04.180825+0000","last_fullsized":"2023-10-08T16:25:04.180825+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187648+0000","last_change":"2023-10-08T16:25:04.186151+0000","last_active":"2023-10-08T16:25:04.187648+0000","last_peered":"2023-10-08T16:25:04.187648+0000","last_clean":"2023-10-08T16:25:04.187648+0000","last_became_active":"2023-10-08T16:25:04.185901+0000","last_became_peered":"2023-10-08T16:25:04.185901+0000","last_unstale":"2023-10-08T16:25:04.187648+0000","last_undegraded":"2023-10-08T16:25:04.187648+0000","last_fullsized":"2023-10-08T16:25:04.187648+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:54.780314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180136+0000","last_change":"2023-10-08T16:25:04.179317+0000","last_active":"2023-10-08T16:25:04.180136+0000","last_peered":"2023-10-08T16:25:04.180136+0000","last_clean":"2023-10-08T16:25:04.180136+0000","last_became_active":"2023-10-08T16:25:04.179073+0000","last_became_peered":"2023-10-08T16:25:04.179073+0000","last_unstale":"2023-10-08T16:25:04.180136+0000","last_undegraded":"2023-10-08T16:25:04.180136+0000","last_fullsized":"2023-10-08T16:25:04.180136+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:58:31.655970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180881+0000","last_change":"2023-10-08T16:25:04.179129+0000","last_active":"2023-10-08T16:25:04.180881+0000","last_peered":"2023-10-08T16:25:04.180881+0000","last_clean":"2023-10-08T16:25:04.180881+0000","last_became_active":"2023-10-08T16:25:04.178872+0000","last_became_peered":"2023-10-08T16:25:04.178872+0000","last_unstale":"2023-10-08T16:25:04.180881+0000","last_undegraded":"2023-10-08T16:25:04.180881+0000","last_fullsized":"2023-10-08T16:25:04.180881+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:13.196602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185882+0000","last_change":"2023-10-08T16:25:04.184043+0000","last_active":"2023-10-08T16:25:04.185882+0000","last_peered":"2023-10-08T16:25:04.185882+0000","last_clean":"2023-10-08T16:25:04.185882+0000","last_became_active":"2023-10-08T16:25:04.183715+0000","last_became_peered":"2023-10-08T16:25:04.183715+0000","last_unstale":"2023-10-08T16:25:04.185882+0000","last_undegraded":"2023-10-08T16:25:04.185882+0000","last_fullsized":"2023-10-08T16:25:04.185882+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:42.191593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186771+0000","last_change":"2023-10-08T16:25:04.180663+0000","last_active":"2023-10-08T16:25:04.186771+0000","last_peered":"2023-10-08T16:25:04.186771+0000","last_clean":"2023-10-08T16:25:04.186771+0000","last_became_active":"2023-10-08T16:25:04.180367+0000","last_became_peered":"2023-10-08T16:25:04.180367+0000","last_unstale":"2023-10-08T16:25:04.186771+0000","last_undegraded":"2023-10-08T16:25:04.186771+0000","last_fullsized":"2023-10-08T16:25:04.186771+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:23.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181957+0000","last_change":"2023-10-08T16:25:04.180159+0000","last_active":"2023-10-08T16:25:04.181957+0000","last_peered":"2023-10-08T16:25:04.181957+0000","last_clean":"2023-10-08T16:25:04.181957+0000","last_became_active":"2023-10-08T16:25:04.179878+0000","last_became_peered":"2023-10-08T16:25:04.179878+0000","last_unstale":"2023-10-08T16:25:04.181957+0000","last_undegraded":"2023-10-08T16:25:04.181957+0000","last_fullsized":"2023-10-08T16:25:04.181957+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191623+0000","last_change":"2023-10-08T16:25:04.188079+0000","last_active":"2023-10-08T16:25:04.191623+0000","last_peered":"2023-10-08T16:25:04.191623+0000","last_clean":"2023-10-08T16:25:04.191623+0000","last_became_active":"2023-10-08T16:25:04.187727+0000","last_became_peered":"2023-10-08T16:25:04.187727+0000","last_unstale":"2023-10-08T16:25:04.191623+0000","last_undegraded":"2023-10-08T16:25:04.191623+0000","last_fullsized":"2023-10-08T16:25:04.191623+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:13.467148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195074+0000","last_change":"2023-10-08T16:25:04.191268+0000","last_active":"2023-10-08T16:25:04.195074+0000","last_peered":"2023-10-08T16:25:04.195074+0000","last_clean":"2023-10-08T16:25:04.195074+0000","last_became_active":"2023-10-08T16:25:04.191011+0000","last_became_peered":"2023-10-08T16:25:04.191011+0000","last_unstale":"2023-10-08T16:25:04.195074+0000","last_undegraded":"2023-10-08T16:25:04.195074+0000","last_fullsized":"2023-10-08T16:25:04.195074+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:14:59.573275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189821+0000","last_change":"2023-10-08T16:25:04.186950+0000","last_active":"2023-10-08T16:25:04.189821+0000","last_peered":"2023-10-08T16:25:04.189821+0000","last_clean":"2023-10-08T16:25:04.189821+0000","last_became_active":"2023-10-08T16:25:04.186176+0000","last_became_peered":"2023-10-08T16:25:04.186176+0000","last_unstale":"2023-10-08T16:25:04.189821+0000","last_undegraded":"2023-10-08T16:25:04.189821+0000","last_fullsized":"2023-10-08T16:25:04.189821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:08:02.717769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186737+0000","last_change":"2023-10-08T16:25:04.184950+0000","last_active":"2023-10-08T16:25:04.186737+0000","last_peered":"2023-10-08T16:25:04.186737+0000","last_clean":"2023-10-08T16:25:04.186737+0000","last_became_active":"2023-10-08T16:25:04.184706+0000","last_became_peered":"2023-10-08T16:25:04.184706+0000","last_unstale":"2023-10-08T16:25:04.186737+0000","last_undegraded":"2023-10-08T16:25:04.186737+0000","last_fullsized":"2023-10-08T16:25:04.186737+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:23:01.200179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178828+0000","last_change":"2023-10-08T16:25:04.175350+0000","last_active":"2023-10-08T16:25:04.178828+0000","last_peered":"2023-10-08T16:25:04.178828+0000","last_clean":"2023-10-08T16:25:04.178828+0000","last_became_active":"2023-10-08T16:25:04.175086+0000","last_became_peered":"2023-10-08T16:25:04.175086+0000","last_unstale":"2023-10-08T16:25:04.178828+0000","last_undegraded":"2023-10-08T16:25:04.178828+0000","last_fullsized":"2023-10-08T16:25:04.178828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:00.991982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189818+0000","last_change":"2023-10-08T16:25:04.184210+0000","last_active":"2023-10-08T16:25:04.189818+0000","last_peered":"2023-10-08T16:25:04.189818+0000","last_clean":"2023-10-08T16:25:04.189818+0000","last_became_active":"2023-10-08T16:25:04.183952+0000","last_became_peered":"2023-10-08T16:25:04.183952+0000","last_unstale":"2023-10-08T16:25:04.189818+0000","last_undegraded":"2023-10-08T16:25:04.189818+0000","last_fullsized":"2023-10-08T16:25:04.189818+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:34.190034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181007+0000","last_change":"2023-10-08T16:25:04.174122+0000","last_active":"2023-10-08T16:25:04.181007+0000","last_peered":"2023-10-08T16:25:04.181007+0000","last_clean":"2023-10-08T16:25:04.181007+0000","last_became_active":"2023-10-08T16:25:04.173291+0000","last_became_peered":"2023-10-08T16:25:04.173291+0000","last_unstale":"2023-10-08T16:25:04.181007+0000","last_undegraded":"2023-10-08T16:25:04.181007+0000","last_fullsized":"2023-10-08T16:25:04.181007+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:10.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198378+0000","last_change":"2023-10-08T16:25:04.192678+0000","last_active":"2023-10-08T16:25:04.198378+0000","last_peered":"2023-10-08T16:25:04.198378+0000","last_clean":"2023-10-08T16:25:04.198378+0000","last_became_active":"2023-10-08T16:25:04.192313+0000","last_became_peered":"2023-10-08T16:25:04.192313+0000","last_unstale":"2023-10-08T16:25:04.198378+0000","last_undegraded":"2023-10-08T16:25:04.198378+0000","last_fullsized":"2023-10-08T16:25:04.198378+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:14:09.011682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.188369+0000","last_change":"2023-10-08T16:25:04.183133+0000","last_active":"2023-10-08T16:25:04.188369+0000","last_peered":"2023-10-08T16:25:04.188369+0000","last_clean":"2023-10-08T16:25:04.188369+0000","last_became_active":"2023-10-08T16:25:04.182855+0000","last_became_peered":"2023-10-08T16:25:04.182855+0000","last_unstale":"2023-10-08T16:25:04.188369+0000","last_undegraded":"2023-10-08T16:25:04.188369+0000","last_fullsized":"2023-10-08T16:25:04.188369+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195299+0000","last_change":"2023-10-08T16:25:04.191760+0000","last_active":"2023-10-08T16:25:04.195299+0000","last_peered":"2023-10-08T16:25:04.195299+0000","last_clean":"2023-10-08T16:25:04.195299+0000","last_became_active":"2023-10-08T16:25:04.191440+0000","last_became_peered":"2023-10-08T16:25:04.191440+0000","last_unstale":"2023-10-08T16:25:04.195299+0000","last_undegraded":"2023-10-08T16:25:04.195299+0000","last_fullsized":"2023-10-08T16:25:04.195299+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:22:31.428730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187351+0000","last_change":"2023-10-08T16:25:04.179325+0000","last_active":"2023-10-08T16:25:04.187351+0000","last_peered":"2023-10-08T16:25:04.187351+0000","last_clean":"2023-10-08T16:25:04.187351+0000","last_became_active":"2023-10-08T16:25:04.179060+0000","last_became_peered":"2023-10-08T16:25:04.179060+0000","last_unstale":"2023-10-08T16:25:04.187351+0000","last_undegraded":"2023-10-08T16:25:04.187351+0000","last_fullsized":"2023-10-08T16:25:04.187351+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.524280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180279+0000","last_change":"2023-10-08T16:25:04.178259+0000","last_active":"2023-10-08T16:25:04.180279+0000","last_peered":"2023-10-08T16:25:04.180279+0000","last_clean":"2023-10-08T16:25:04.180279+0000","last_became_active":"2023-10-08T16:25:04.177990+0000","last_became_peered":"2023-10-08T16:25:04.177990+0000","last_unstale":"2023-10-08T16:25:04.180279+0000","last_undegraded":"2023-10-08T16:25:04.180279+0000","last_fullsized":"2023-10-08T16:25:04.180279+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.173119+0000","last_change":"2023-10-08T16:25:04.169007+0000","last_active":"2023-10-08T16:25:04.173119+0000","last_peered":"2023-10-08T16:25:04.173119+0000","last_clean":"2023-10-08T16:25:04.173119+0000","last_became_active":"2023-10-08T16:25:04.168737+0000","last_became_peered":"2023-10-08T16:25:04.168737+0000","last_unstale":"2023-10-08T16:25:04.173119+0000","last_undegraded":"2023-10-08T16:25:04.173119+0000","last_fullsized":"2023-10-08T16:25:04.173119+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:01:35.049597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195921+0000","last_change":"2023-10-08T16:25:04.191597+0000","last_active":"2023-10-08T16:25:04.195921+0000","last_peered":"2023-10-08T16:25:04.195921+0000","last_clean":"2023-10-08T16:25:04.195921+0000","last_became_active":"2023-10-08T16:25:04.191287+0000","last_became_peered":"2023-10-08T16:25:04.191287+0000","last_unstale":"2023-10-08T16:25:04.195921+0000","last_undegraded":"2023-10-08T16:25:04.195921+0000","last_fullsized":"2023-10-08T16:25:04.195921+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:56.503583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181893+0000","last_change":"2023-10-08T16:25:04.178249+0000","last_active":"2023-10-08T16:25:04.181893+0000","last_peered":"2023-10-08T16:25:04.181893+0000","last_clean":"2023-10-08T16:25:04.181893+0000","last_became_active":"2023-10-08T16:25:04.177989+0000","last_became_peered":"2023-10-08T16:25:04.177989+0000","last_unstale":"2023-10-08T16:25:04.181893+0000","last_undegraded":"2023-10-08T16:25:04.181893+0000","last_fullsized":"2023-10-08T16:25:04.181893+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:39.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189867+0000","last_change":"2023-10-08T16:25:04.185447+0000","last_active":"2023-10-08T16:25:04.189867+0000","last_peered":"2023-10-08T16:25:04.189867+0000","last_clean":"2023-10-08T16:25:04.189867+0000","last_became_active":"2023-10-08T16:25:04.184933+0000","last_became_peered":"2023-10-08T16:25:04.184933+0000","last_unstale":"2023-10-08T16:25:04.189867+0000","last_undegraded":"2023-10-08T16:25:04.189867+0000","last_fullsized":"2023-10-08T16:25:04.189867+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:39:06.727030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198445+0000","last_change":"2023-10-08T16:25:04.191293+0000","last_active":"2023-10-08T16:25:04.198445+0000","last_peered":"2023-10-08T16:25:04.198445+0000","last_clean":"2023-10-08T16:25:04.198445+0000","last_became_active":"2023-10-08T16:25:04.190977+0000","last_became_peered":"2023-10-08T16:25:04.190977+0000","last_unstale":"2023-10-08T16:25:04.198445+0000","last_undegraded":"2023-10-08T16:25:04.198445+0000","last_fullsized":"2023-10-08T16:25:04.198445+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:51.509709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"98'4","reported_seq":14,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203048+0000","last_change":"2023-10-08T16:25:03.164351+0000","last_active":"2023-10-08T16:25:04.203048+0000","last_peered":"2023-10-08T16:25:04.203048+0000","last_clean":"2023-10-08T16:25:04.203048+0000","last_became_active":"2023-10-08T16:25:03.164093+0000","last_became_peered":"2023-10-08T16:25:03.164093+0000","last_unstale":"2023-10-08T16:25:04.203048+0000","last_undegraded":"2023-10-08T16:25:04.203048+0000","last_fullsized":"2023-10-08T16:25:04.203048+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:31.593169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187950+0000","last_change":"2023-10-08T16:25:04.186164+0000","last_active":"2023-10-08T16:25:04.187950+0000","last_peered":"2023-10-08T16:25:04.187950+0000","last_clean":"2023-10-08T16:25:04.187950+0000","last_became_active":"2023-10-08T16:25:04.185913+0000","last_became_peered":"2023-10-08T16:25:04.185913+0000","last_unstale":"2023-10-08T16:25:04.187950+0000","last_undegraded":"2023-10-08T16:25:04.187950+0000","last_fullsized":"2023-10-08T16:25:04.187950+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:46.826902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.195545+0000","last_change":"2023-10-08T16:25:03.158268+0000","last_active":"2023-10-08T16:25:04.195545+0000","last_peered":"2023-10-08T16:25:04.195545+0000","last_clean":"2023-10-08T16:25:04.195545+0000","last_became_active":"2023-10-08T16:25:03.157949+0000","last_became_peered":"2023-10-08T16:25:03.157949+0000","last_unstale":"2023-10-08T16:25:04.195545+0000","last_undegraded":"2023-10-08T16:25:04.195545+0000","last_fullsized":"2023-10-08T16:25:04.195545+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:06.052973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.192079+0000","last_change":"2023-10-08T16:25:04.189419+0000","last_active":"2023-10-08T16:25:04.192079+0000","last_peered":"2023-10-08T16:25:04.192079+0000","last_clean":"2023-10-08T16:25:04.192079+0000","last_became_active":"2023-10-08T16:25:04.189092+0000","last_became_peered":"2023-10-08T16:25:04.189092+0000","last_unstale":"2023-10-08T16:25:04.192079+0000","last_undegraded":"2023-10-08T16:25:04.192079+0000","last_fullsized":"2023-10-08T16:25:04.192079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:41:27.250989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.204118+0000","last_change":"2023-10-08T16:25:03.163834+0000","last_active":"2023-10-08T16:25:04.204118+0000","last_peered":"2023-10-08T16:25:04.204118+0000","last_clean":"2023-10-08T16:25:04.204118+0000","last_became_active":"2023-10-08T16:25:03.163134+0000","last_became_peered":"2023-10-08T16:25:03.163134+0000","last_unstale":"2023-10-08T16:25:04.204118+0000","last_undegraded":"2023-10-08T16:25:04.204118+0000","last_fullsized":"2023-10-08T16:25:04.204118+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184564+0000","last_change":"2023-10-08T16:25:04.181450+0000","last_active":"2023-10-08T16:25:04.184564+0000","last_peered":"2023-10-08T16:25:04.184564+0000","last_clean":"2023-10-08T16:25:04.184564+0000","last_became_active":"2023-10-08T16:25:04.181162+0000","last_became_peered":"2023-10-08T16:25:04.181162+0000","last_unstale":"2023-10-08T16:25:04.184564+0000","last_undegraded":"2023-10-08T16:25:04.184564+0000","last_fullsized":"2023-10-08T16:25:04.184564+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:05.833282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205224+0000","last_change":"2023-10-08T16:25:03.167869+0000","last_active":"2023-10-08T16:25:04.205224+0000","last_peered":"2023-10-08T16:25:04.205224+0000","last_clean":"2023-10-08T16:25:04.205224+0000","last_became_active":"2023-10-08T16:25:03.167391+0000","last_became_peered":"2023-10-08T16:25:03.167391+0000","last_unstale":"2023-10-08T16:25:04.205224+0000","last_undegraded":"2023-10-08T16:25:04.205224+0000","last_fullsized":"2023-10-08T16:25:04.205224+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170931+0000","last_change":"2023-10-08T16:25:04.168980+0000","last_active":"2023-10-08T16:25:04.170931+0000","last_peered":"2023-10-08T16:25:04.170931+0000","last_clean":"2023-10-08T16:25:04.170931+0000","last_became_active":"2023-10-08T16:25:04.168606+0000","last_became_peered":"2023-10-08T16:25:04.168606+0000","last_unstale":"2023-10-08T16:25:04.170931+0000","last_undegraded":"2023-10-08T16:25:04.170931+0000","last_fullsized":"2023-10-08T16:25:04.170931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:57:59.153336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196986+0000","last_change":"2023-10-08T16:25:03.157433+0000","last_active":"2023-10-08T16:25:04.196986+0000","last_peered":"2023-10-08T16:25:04.196986+0000","last_clean":"2023-10-08T16:25:04.196986+0000","last_became_active":"2023-10-08T16:25:03.156742+0000","last_became_peered":"2023-10-08T16:25:03.156742+0000","last_unstale":"2023-10-08T16:25:04.196986+0000","last_undegraded":"2023-10-08T16:25:04.196986+0000","last_fullsized":"2023-10-08T16:25:04.196986+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:09.290672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.183303+0000","last_change":"2023-10-08T16:25:04.182653+0000","last_active":"2023-10-08T16:25:04.183303+0000","last_peered":"2023-10-08T16:25:04.183303+0000","last_clean":"2023-10-08T16:25:04.183303+0000","last_became_active":"2023-10-08T16:25:04.182284+0000","last_became_peered":"2023-10-08T16:25:04.182284+0000","last_unstale":"2023-10-08T16:25:04.183303+0000","last_undegraded":"2023-10-08T16:25:04.183303+0000","last_fullsized":"2023-10-08T16:25:04.183303+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.200954+0000","last_change":"2023-10-08T16:25:03.167402+0000","last_active":"2023-10-08T16:25:04.200954+0000","last_peered":"2023-10-08T16:25:04.200954+0000","last_clean":"2023-10-08T16:25:04.200954+0000","last_became_active":"2023-10-08T16:25:03.166793+0000","last_became_peered":"2023-10-08T16:25:03.166793+0000","last_unstale":"2023-10-08T16:25:04.200954+0000","last_undegraded":"2023-10-08T16:25:04.200954+0000","last_fullsized":"2023-10-08T16:25:04.200954+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:17.720421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.185722+0000","last_change":"2023-10-08T16:25:04.182471+0000","last_active":"2023-10-08T16:25:04.185722+0000","last_peered":"2023-10-08T16:25:04.185722+0000","last_clean":"2023-10-08T16:25:04.185722+0000","last_became_active":"2023-10-08T16:25:04.182191+0000","last_became_peered":"2023-10-08T16:25:04.182191+0000","last_unstale":"2023-10-08T16:25:04.185722+0000","last_undegraded":"2023-10-08T16:25:04.185722+0000","last_fullsized":"2023-10-08T16:25:04.185722+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:43.756265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169520+0000","last_change":"2023-10-08T16:25:03.161798+0000","last_active":"2023-10-08T16:25:04.169520+0000","last_peered":"2023-10-08T16:25:04.169520+0000","last_clean":"2023-10-08T16:25:04.169520+0000","last_became_active":"2023-10-08T16:25:03.161354+0000","last_became_peered":"2023-10-08T16:25:03.161354+0000","last_unstale":"2023-10-08T16:25:04.169520+0000","last_undegraded":"2023-10-08T16:25:04.169520+0000","last_fullsized":"2023-10-08T16:25:04.169520+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:10.765932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186790+0000","last_change":"2023-10-08T16:25:04.184609+0000","last_active":"2023-10-08T16:25:04.186790+0000","last_peered":"2023-10-08T16:25:04.186790+0000","last_clean":"2023-10-08T16:25:04.186790+0000","last_became_active":"2023-10-08T16:25:04.184287+0000","last_became_peered":"2023-10-08T16:25:04.184287+0000","last_unstale":"2023-10-08T16:25:04.186790+0000","last_undegraded":"2023-10-08T16:25:04.186790+0000","last_fullsized":"2023-10-08T16:25:04.186790+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:44:17.070085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.171820+0000","last_change":"2023-10-08T16:25:03.161010+0000","last_active":"2023-10-08T16:25:04.171820+0000","last_peered":"2023-10-08T16:25:04.171820+0000","last_clean":"2023-10-08T16:25:04.171820+0000","last_became_active":"2023-10-08T16:25:03.160730+0000","last_became_peered":"2023-10-08T16:25:03.160730+0000","last_unstale":"2023-10-08T16:25:04.171820+0000","last_undegraded":"2023-10-08T16:25:04.171820+0000","last_fullsized":"2023-10-08T16:25:04.171820+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:56:40.198475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181367+0000","last_change":"2023-10-08T16:25:04.175551+0000","last_active":"2023-10-08T16:25:04.181367+0000","last_peered":"2023-10-08T16:25:04.181367+0000","last_clean":"2023-10-08T16:25:04.181367+0000","last_became_active":"2023-10-08T16:25:04.175276+0000","last_became_peered":"2023-10-08T16:25:04.175276+0000","last_unstale":"2023-10-08T16:25:04.181367+0000","last_undegraded":"2023-10-08T16:25:04.181367+0000","last_fullsized":"2023-10-08T16:25:04.181367+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:07.058249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.166746+0000","last_change":"2023-10-08T16:25:03.162812+0000","last_active":"2023-10-08T16:25:04.166746+0000","last_peered":"2023-10-08T16:25:04.166746+0000","last_clean":"2023-10-08T16:25:04.166746+0000","last_became_active":"2023-10-08T16:25:03.162264+0000","last_became_peered":"2023-10-08T16:25:03.162264+0000","last_unstale":"2023-10-08T16:25:04.166746+0000","last_undegraded":"2023-10-08T16:25:04.166746+0000","last_fullsized":"2023-10-08T16:25:04.166746+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198374+0000","last_change":"2023-10-08T16:25:04.191823+0000","last_active":"2023-10-08T16:25:04.198374+0000","last_peered":"2023-10-08T16:25:04.198374+0000","last_clean":"2023-10-08T16:25:04.198374+0000","last_became_active":"2023-10-08T16:25:04.191483+0000","last_became_peered":"2023-10-08T16:25:04.191483+0000","last_unstale":"2023-10-08T16:25:04.198374+0000","last_undegraded":"2023-10-08T16:25:04.198374+0000","last_fullsized":"2023-10-08T16:25:04.198374+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:34:37.197720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186603+0000","last_change":"2023-10-08T16:25:03.167559+0000","last_active":"2023-10-08T16:25:04.186603+0000","last_peered":"2023-10-08T16:25:04.186603+0000","last_clean":"2023-10-08T16:25:04.186603+0000","last_became_active":"2023-10-08T16:25:03.167203+0000","last_became_peered":"2023-10-08T16:25:03.167203+0000","last_unstale":"2023-10-08T16:25:04.186603+0000","last_undegraded":"2023-10-08T16:25:04.186603+0000","last_fullsized":"2023-10-08T16:25:04.186603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:27.416786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189905+0000","last_change":"2023-10-08T16:25:04.187189+0000","last_active":"2023-10-08T16:25:04.189905+0000","last_peered":"2023-10-08T16:25:04.189905+0000","last_clean":"2023-10-08T16:25:04.189905+0000","last_became_active":"2023-10-08T16:25:04.186869+0000","last_became_peered":"2023-10-08T16:25:04.186869+0000","last_unstale":"2023-10-08T16:25:04.189905+0000","last_undegraded":"2023-10-08T16:25:04.189905+0000","last_fullsized":"2023-10-08T16:25:04.189905+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:48:33.688900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"98'3","reported_seq":13,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.197991+0000","last_change":"2023-10-08T16:25:03.152315+0000","last_active":"2023-10-08T16:25:04.197991+0000","last_peered":"2023-10-08T16:25:04.197991+0000","last_clean":"2023-10-08T16:25:04.197991+0000","last_became_active":"2023-10-08T16:25:03.152015+0000","last_became_peered":"2023-10-08T16:25:03.152015+0000","last_unstale":"2023-10-08T16:25:04.197991+0000","last_undegraded":"2023-10-08T16:25:04.197991+0000","last_fullsized":"2023-10-08T16:25:04.197991+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:04.828006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180615+0000","last_change":"2023-10-08T16:25:04.177909+0000","last_active":"2023-10-08T16:25:04.180615+0000","last_peered":"2023-10-08T16:25:04.180615+0000","last_clean":"2023-10-08T16:25:04.180615+0000","last_became_active":"2023-10-08T16:25:04.177426+0000","last_became_peered":"2023-10-08T16:25:04.177426+0000","last_unstale":"2023-10-08T16:25:04.180615+0000","last_undegraded":"2023-10-08T16:25:04.180615+0000","last_fullsized":"2023-10-08T16:25:04.180615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:14.184227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"98'6","reported_seq":16,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205010+0000","last_change":"2023-10-08T16:25:03.165618+0000","last_active":"2023-10-08T16:25:04.205010+0000","last_peered":"2023-10-08T16:25:04.205010+0000","last_clean":"2023-10-08T16:25:04.205010+0000","last_became_active":"2023-10-08T16:25:03.165328+0000","last_became_peered":"2023-10-08T16:25:03.165328+0000","last_unstale":"2023-10-08T16:25:04.205010+0000","last_undegraded":"2023-10-08T16:25:04.205010+0000","last_fullsized":"2023-10-08T16:25:04.205010+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:04:51.440409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186810+0000","last_change":"2023-10-08T16:25:04.183796+0000","last_active":"2023-10-08T16:25:04.186810+0000","last_peered":"2023-10-08T16:25:04.186810+0000","last_clean":"2023-10-08T16:25:04.186810+0000","last_became_active":"2023-10-08T16:25:04.183546+0000","last_became_peered":"2023-10-08T16:25:04.183546+0000","last_unstale":"2023-10-08T16:25:04.186810+0000","last_undegraded":"2023-10-08T16:25:04.186810+0000","last_fullsized":"2023-10-08T16:25:04.186810+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:41.182111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.198977+0000","last_change":"2023-10-08T16:25:03.161230+0000","last_active":"2023-10-08T16:25:04.198977+0000","last_peered":"2023-10-08T16:25:04.198977+0000","last_clean":"2023-10-08T16:25:04.198977+0000","last_became_active":"2023-10-08T16:25:03.160899+0000","last_became_peered":"2023-10-08T16:25:03.160899+0000","last_unstale":"2023-10-08T16:25:04.198977+0000","last_undegraded":"2023-10-08T16:25:04.198977+0000","last_fullsized":"2023-10-08T16:25:04.198977+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:08:39.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170828+0000","last_change":"2023-10-08T16:25:04.169503+0000","last_active":"2023-10-08T16:25:04.170828+0000","last_peered":"2023-10-08T16:25:04.170828+0000","last_clean":"2023-10-08T16:25:04.170828+0000","last_became_active":"2023-10-08T16:25:04.169199+0000","last_became_peered":"2023-10-08T16:25:04.169199+0000","last_unstale":"2023-10-08T16:25:04.170828+0000","last_undegraded":"2023-10-08T16:25:04.170828+0000","last_fullsized":"2023-10-08T16:25:04.170828+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:20.382230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186131+0000","last_change":"2023-10-08T16:25:03.169314+0000","last_active":"2023-10-08T16:25:04.186131+0000","last_peered":"2023-10-08T16:25:04.186131+0000","last_clean":"2023-10-08T16:25:04.186131+0000","last_became_active":"2023-10-08T16:25:03.169026+0000","last_became_peered":"2023-10-08T16:25:03.169026+0000","last_unstale":"2023-10-08T16:25:04.186131+0000","last_undegraded":"2023-10-08T16:25:04.186131+0000","last_fullsized":"2023-10-08T16:25:04.186131+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:12.461872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.194997+0000","last_change":"2023-10-08T16:25:04.191999+0000","last_active":"2023-10-08T16:25:04.194997+0000","last_peered":"2023-10-08T16:25:04.194997+0000","last_clean":"2023-10-08T16:25:04.194997+0000","last_became_active":"2023-10-08T16:25:04.191652+0000","last_became_peered":"2023-10-08T16:25:04.191652+0000","last_unstale":"2023-10-08T16:25:04.194997+0000","last_undegraded":"2023-10-08T16:25:04.194997+0000","last_fullsized":"2023-10-08T16:25:04.194997+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:33.496567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.164795+0000","last_change":"2023-10-08T16:25:03.153668+0000","last_active":"2023-10-08T16:25:04.164795+0000","last_peered":"2023-10-08T16:25:04.164795+0000","last_clean":"2023-10-08T16:25:04.164795+0000","last_became_active":"2023-10-08T16:25:03.153360+0000","last_became_peered":"2023-10-08T16:25:03.153360+0000","last_unstale":"2023-10-08T16:25:04.164795+0000","last_undegraded":"2023-10-08T16:25:04.164795+0000","last_fullsized":"2023-10-08T16:25:04.164795+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:11:52.163538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186812+0000","last_change":"2023-10-08T16:25:04.184948+0000","last_active":"2023-10-08T16:25:04.186812+0000","last_peered":"2023-10-08T16:25:04.186812+0000","last_clean":"2023-10-08T16:25:04.186812+0000","last_became_active":"2023-10-08T16:25:04.184601+0000","last_became_peered":"2023-10-08T16:25:04.184601+0000","last_unstale":"2023-10-08T16:25:04.186812+0000","last_undegraded":"2023-10-08T16:25:04.186812+0000","last_fullsized":"2023-10-08T16:25:04.186812+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:18.348463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"98'8","reported_seq":18,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203876+0000","last_change":"2023-10-08T16:25:03.160242+0000","last_active":"2023-10-08T16:25:04.203876+0000","last_peered":"2023-10-08T16:25:04.203876+0000","last_clean":"2023-10-08T16:25:04.203876+0000","last_became_active":"2023-10-08T16:25:03.159968+0000","last_became_peered":"2023-10-08T16:25:03.159968+0000","last_unstale":"2023-10-08T16:25:04.203876+0000","last_undegraded":"2023-10-08T16:25:04.203876+0000","last_fullsized":"2023-10-08T16:25:04.203876+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178775+0000","last_change":"2023-10-08T16:25:04.174103+0000","last_active":"2023-10-08T16:25:04.178775+0000","last_peered":"2023-10-08T16:25:04.178775+0000","last_clean":"2023-10-08T16:25:04.178775+0000","last_became_active":"2023-10-08T16:25:04.173838+0000","last_became_peered":"2023-10-08T16:25:04.173838+0000","last_unstale":"2023-10-08T16:25:04.178775+0000","last_undegraded":"2023-10-08T16:25:04.178775+0000","last_fullsized":"2023-10-08T16:25:04.178775+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.202483+0000","last_change":"2023-10-08T16:25:03.171328+0000","last_active":"2023-10-08T16:25:04.202483+0000","last_peered":"2023-10-08T16:25:04.202483+0000","last_clean":"2023-10-08T16:25:04.202483+0000","last_became_active":"2023-10-08T16:25:03.171110+0000","last_became_peered":"2023-10-08T16:25:03.171110+0000","last_unstale":"2023-10-08T16:25:04.202483+0000","last_undegraded":"2023-10-08T16:25:04.202483+0000","last_fullsized":"2023-10-08T16:25:04.202483+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.184559+0000","last_change":"2023-10-08T16:25:04.181795+0000","last_active":"2023-10-08T16:25:04.184559+0000","last_peered":"2023-10-08T16:25:04.184559+0000","last_clean":"2023-10-08T16:25:04.184559+0000","last_became_active":"2023-10-08T16:25:04.181403+0000","last_became_peered":"2023-10-08T16:25:04.181403+0000","last_unstale":"2023-10-08T16:25:04.184559+0000","last_undegraded":"2023-10-08T16:25:04.184559+0000","last_fullsized":"2023-10-08T16:25:04.184559+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:45.404512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.204126+0000","last_change":"2023-10-08T16:25:03.166077+0000","last_active":"2023-10-08T16:25:04.204126+0000","last_peered":"2023-10-08T16:25:04.204126+0000","last_clean":"2023-10-08T16:25:04.204126+0000","last_became_active":"2023-10-08T16:25:03.165790+0000","last_became_peered":"2023-10-08T16:25:03.165790+0000","last_unstale":"2023-10-08T16:25:04.204126+0000","last_undegraded":"2023-10-08T16:25:04.204126+0000","last_fullsized":"2023-10-08T16:25:04.204126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:45.821626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180117+0000","last_change":"2023-10-08T16:25:04.178756+0000","last_active":"2023-10-08T16:25:04.180117+0000","last_peered":"2023-10-08T16:25:04.180117+0000","last_clean":"2023-10-08T16:25:04.180117+0000","last_became_active":"2023-10-08T16:25:04.178493+0000","last_became_peered":"2023-10-08T16:25:04.178493+0000","last_unstale":"2023-10-08T16:25:04.180117+0000","last_undegraded":"2023-10-08T16:25:04.180117+0000","last_fullsized":"2023-10-08T16:25:04.180117+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:57:09.907625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"98'1","reported_seq":11,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.203675+0000","last_change":"2023-10-08T16:25:03.162613+0000","last_active":"2023-10-08T16:25:04.203675+0000","last_peered":"2023-10-08T16:25:04.203675+0000","last_clean":"2023-10-08T16:25:04.203675+0000","last_became_active":"2023-10-08T16:25:03.162298+0000","last_became_peered":"2023-10-08T16:25:03.162298+0000","last_unstale":"2023-10-08T16:25:04.203675+0000","last_undegraded":"2023-10-08T16:25:04.203675+0000","last_fullsized":"2023-10-08T16:25:04.203675+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:51.821606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.180635+0000","last_change":"2023-10-08T16:25:04.178425+0000","last_active":"2023-10-08T16:25:04.180635+0000","last_peered":"2023-10-08T16:25:04.180635+0000","last_clean":"2023-10-08T16:25:04.180635+0000","last_became_active":"2023-10-08T16:25:04.178158+0000","last_became_peered":"2023-10-08T16:25:04.178158+0000","last_unstale":"2023-10-08T16:25:04.180635+0000","last_undegraded":"2023-10-08T16:25:04.180635+0000","last_fullsized":"2023-10-08T16:25:04.180635+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:15:52.826882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.169658+0000","last_change":"2023-10-08T16:25:03.162457+0000","last_active":"2023-10-08T16:25:04.169658+0000","last_peered":"2023-10-08T16:25:04.169658+0000","last_clean":"2023-10-08T16:25:04.169658+0000","last_became_active":"2023-10-08T16:25:03.162174+0000","last_became_peered":"2023-10-08T16:25:03.162174+0000","last_unstale":"2023-10-08T16:25:04.169658+0000","last_undegraded":"2023-10-08T16:25:04.169658+0000","last_fullsized":"2023-10-08T16:25:04.169658+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:14.112628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.178384+0000","last_change":"2023-10-08T16:25:04.176022+0000","last_active":"2023-10-08T16:25:04.178384+0000","last_peered":"2023-10-08T16:25:04.178384+0000","last_clean":"2023-10-08T16:25:04.178384+0000","last_became_active":"2023-10-08T16:25:04.175768+0000","last_became_peered":"2023-10-08T16:25:04.175768+0000","last_unstale":"2023-10-08T16:25:04.178384+0000","last_undegraded":"2023-10-08T16:25:04.178384+0000","last_fullsized":"2023-10-08T16:25:04.178384+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:12.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186200+0000","last_change":"2023-10-08T16:25:03.167677+0000","last_active":"2023-10-08T16:25:04.186200+0000","last_peered":"2023-10-08T16:25:04.186200+0000","last_clean":"2023-10-08T16:25:04.186200+0000","last_became_active":"2023-10-08T16:25:03.167109+0000","last_became_peered":"2023-10-08T16:25:03.167109+0000","last_unstale":"2023-10-08T16:25:04.186200+0000","last_undegraded":"2023-10-08T16:25:04.186200+0000","last_fullsized":"2023-10-08T16:25:04.186200+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:03:13.178951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187315+0000","last_change":"2023-10-08T16:25:04.180103+0000","last_active":"2023-10-08T16:25:04.187315+0000","last_peered":"2023-10-08T16:25:04.187315+0000","last_clean":"2023-10-08T16:25:04.187315+0000","last_became_active":"2023-10-08T16:25:04.179854+0000","last_became_peered":"2023-10-08T16:25:04.179854+0000","last_unstale":"2023-10-08T16:25:04.187315+0000","last_undegraded":"2023-10-08T16:25:04.187315+0000","last_fullsized":"2023-10-08T16:25:04.187315+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:15.320837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.164784+0000","last_change":"2023-10-08T16:25:03.153094+0000","last_active":"2023-10-08T16:25:04.164784+0000","last_peered":"2023-10-08T16:25:04.164784+0000","last_clean":"2023-10-08T16:25:04.164784+0000","last_became_active":"2023-10-08T16:25:03.152761+0000","last_became_peered":"2023-10-08T16:25:03.152761+0000","last_unstale":"2023-10-08T16:25:04.164784+0000","last_undegraded":"2023-10-08T16:25:04.164784+0000","last_fullsized":"2023-10-08T16:25:04.164784+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:29.836043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187138+0000","last_change":"2023-10-08T16:25:04.180924+0000","last_active":"2023-10-08T16:25:04.187138+0000","last_peered":"2023-10-08T16:25:04.187138+0000","last_clean":"2023-10-08T16:25:04.187138+0000","last_became_active":"2023-10-08T16:25:04.180659+0000","last_became_peered":"2023-10-08T16:25:04.180659+0000","last_unstale":"2023-10-08T16:25:04.187138+0000","last_undegraded":"2023-10-08T16:25:04.187138+0000","last_fullsized":"2023-10-08T16:25:04.187138+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:03.340620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.172362+0000","last_change":"2023-10-08T16:25:03.152697+0000","last_active":"2023-10-08T16:25:04.172362+0000","last_peered":"2023-10-08T16:25:04.172362+0000","last_clean":"2023-10-08T16:25:04.172362+0000","last_became_active":"2023-10-08T16:25:03.152373+0000","last_became_peered":"2023-10-08T16:25:03.152373+0000","last_unstale":"2023-10-08T16:25:04.172362+0000","last_undegraded":"2023-10-08T16:25:04.172362+0000","last_fullsized":"2023-10-08T16:25:04.172362+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:19.376954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186336+0000","last_change":"2023-10-08T16:25:04.179784+0000","last_active":"2023-10-08T16:25:04.186336+0000","last_peered":"2023-10-08T16:25:04.186336+0000","last_clean":"2023-10-08T16:25:04.186336+0000","last_became_active":"2023-10-08T16:25:04.179540+0000","last_became_peered":"2023-10-08T16:25:04.179540+0000","last_unstale":"2023-10-08T16:25:04.186336+0000","last_undegraded":"2023-10-08T16:25:04.186336+0000","last_fullsized":"2023-10-08T16:25:04.186336+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:34:15.117904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205005+0000","last_change":"2023-10-08T16:25:03.167710+0000","last_active":"2023-10-08T16:25:04.205005+0000","last_peered":"2023-10-08T16:25:04.205005+0000","last_clean":"2023-10-08T16:25:04.205005+0000","last_became_active":"2023-10-08T16:25:03.167346+0000","last_became_peered":"2023-10-08T16:25:03.167346+0000","last_unstale":"2023-10-08T16:25:04.205005+0000","last_undegraded":"2023-10-08T16:25:04.205005+0000","last_fullsized":"2023-10-08T16:25:04.205005+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:46:41.186317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.181147+0000","last_change":"2023-10-08T16:25:04.174009+0000","last_active":"2023-10-08T16:25:04.181147+0000","last_peered":"2023-10-08T16:25:04.181147+0000","last_clean":"2023-10-08T16:25:04.181147+0000","last_became_active":"2023-10-08T16:25:04.173631+0000","last_became_peered":"2023-10-08T16:25:04.173631+0000","last_unstale":"2023-10-08T16:25:04.181147+0000","last_undegraded":"2023-10-08T16:25:04.181147+0000","last_fullsized":"2023-10-08T16:25:04.181147+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:16:17.449696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"99'1","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-08T16:25:05.166251+0000","last_change":"2023-10-08T16:25:03.154403+0000","last_active":"2023-10-08T16:25:05.166251+0000","last_peered":"2023-10-08T16:25:05.166251+0000","last_clean":"2023-10-08T16:25:05.166251+0000","last_became_active":"2023-10-08T16:25:03.153289+0000","last_became_peered":"2023-10-08T16:25:03.153289+0000","last_unstale":"2023-10-08T16:25:05.166251+0000","last_undegraded":"2023-10-08T16:25:05.166251+0000","last_fullsized":"2023-10-08T16:25:05.166251+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:27.655730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196073+0000","last_change":"2023-10-08T16:25:04.189875+0000","last_active":"2023-10-08T16:25:04.196073+0000","last_peered":"2023-10-08T16:25:04.196073+0000","last_clean":"2023-10-08T16:25:04.196073+0000","last_became_active":"2023-10-08T16:25:04.189608+0000","last_became_peered":"2023-10-08T16:25:04.189608+0000","last_unstale":"2023-10-08T16:25:04.196073+0000","last_undegraded":"2023-10-08T16:25:04.196073+0000","last_fullsized":"2023-10-08T16:25:04.196073+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:17.805094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174488+0000","last_change":"2023-10-08T16:25:03.159563+0000","last_active":"2023-10-08T16:25:04.174488+0000","last_peered":"2023-10-08T16:25:04.174488+0000","last_clean":"2023-10-08T16:25:04.174488+0000","last_became_active":"2023-10-08T16:25:03.159252+0000","last_became_peered":"2023-10-08T16:25:03.159252+0000","last_unstale":"2023-10-08T16:25:04.174488+0000","last_undegraded":"2023-10-08T16:25:04.174488+0000","last_fullsized":"2023-10-08T16:25:04.174488+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:09.955599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.186235+0000","last_change":"2023-10-08T16:25:04.182673+0000","last_active":"2023-10-08T16:25:04.186235+0000","last_peered":"2023-10-08T16:25:04.186235+0000","last_clean":"2023-10-08T16:25:04.186235+0000","last_became_active":"2023-10-08T16:25:04.182368+0000","last_became_peered":"2023-10-08T16:25:04.182368+0000","last_unstale":"2023-10-08T16:25:04.186235+0000","last_undegraded":"2023-10-08T16:25:04.186235+0000","last_fullsized":"2023-10-08T16:25:04.186235+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:18:41.602049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.170934+0000","last_change":"2023-10-08T16:25:03.153859+0000","last_active":"2023-10-08T16:25:04.170934+0000","last_peered":"2023-10-08T16:25:04.170934+0000","last_clean":"2023-10-08T16:25:04.170934+0000","last_became_active":"2023-10-08T16:25:03.153583+0000","last_became_peered":"2023-10-08T16:25:03.153583+0000","last_unstale":"2023-10-08T16:25:04.170934+0000","last_undegraded":"2023-10-08T16:25:04.170934+0000","last_fullsized":"2023-10-08T16:25:04.170934+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:55.498306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.191111+0000","last_change":"2023-10-08T16:25:04.188418+0000","last_active":"2023-10-08T16:25:04.191111+0000","last_peered":"2023-10-08T16:25:04.191111+0000","last_clean":"2023-10-08T16:25:04.191111+0000","last_became_active":"2023-10-08T16:25:04.188160+0000","last_became_peered":"2023-10-08T16:25:04.188160+0000","last_unstale":"2023-10-08T16:25:04.191111+0000","last_undegraded":"2023-10-08T16:25:04.191111+0000","last_fullsized":"2023-10-08T16:25:04.191111+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:00:42.749730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.174357+0000","last_change":"2023-10-08T16:25:03.154067+0000","last_active":"2023-10-08T16:25:04.174357+0000","last_peered":"2023-10-08T16:25:04.174357+0000","last_clean":"2023-10-08T16:25:04.174357+0000","last_became_active":"2023-10-08T16:25:03.153792+0000","last_became_peered":"2023-10-08T16:25:03.153792+0000","last_unstale":"2023-10-08T16:25:04.174357+0000","last_undegraded":"2023-10-08T16:25:04.174357+0000","last_fullsized":"2023-10-08T16:25:04.174357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:05.481126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.193106+0000","last_change":"2023-10-08T16:25:04.188647+0000","last_active":"2023-10-08T16:25:04.193106+0000","last_peered":"2023-10-08T16:25:04.193106+0000","last_clean":"2023-10-08T16:25:04.193106+0000","last_became_active":"2023-10-08T16:25:04.187982+0000","last_became_peered":"2023-10-08T16:25:04.187982+0000","last_unstale":"2023-10-08T16:25:04.193106+0000","last_undegraded":"2023-10-08T16:25:04.193106+0000","last_fullsized":"2023-10-08T16:25:04.193106+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:07:23.566477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168357+0000","last_change":"2023-10-08T16:25:03.161066+0000","last_active":"2023-10-08T16:25:04.168357+0000","last_peered":"2023-10-08T16:25:04.168357+0000","last_clean":"2023-10-08T16:25:04.168357+0000","last_became_active":"2023-10-08T16:25:03.160765+0000","last_became_peered":"2023-10-08T16:25:03.160765+0000","last_unstale":"2023-10-08T16:25:04.168357+0000","last_undegraded":"2023-10-08T16:25:04.168357+0000","last_fullsized":"2023-10-08T16:25:04.168357+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:31:23.727949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.187451+0000","last_change":"2023-10-08T16:25:04.181787+0000","last_active":"2023-10-08T16:25:04.187451+0000","last_peered":"2023-10-08T16:25:04.187451+0000","last_clean":"2023-10-08T16:25:04.187451+0000","last_became_active":"2023-10-08T16:25:04.181507+0000","last_became_peered":"2023-10-08T16:25:04.181507+0000","last_unstale":"2023-10-08T16:25:04.187451+0000","last_undegraded":"2023-10-08T16:25:04.187451+0000","last_fullsized":"2023-10-08T16:25:04.187451+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:10.414471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.167514+0000","last_change":"2023-10-08T16:25:03.160589+0000","last_active":"2023-10-08T16:25:04.167514+0000","last_peered":"2023-10-08T16:25:04.167514+0000","last_clean":"2023-10-08T16:25:04.167514+0000","last_became_active":"2023-10-08T16:25:03.160320+0000","last_became_peered":"2023-10-08T16:25:03.160320+0000","last_unstale":"2023-10-08T16:25:04.167514+0000","last_undegraded":"2023-10-08T16:25:04.167514+0000","last_fullsized":"2023-10-08T16:25:04.167514+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:17.343187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.189861+0000","last_change":"2023-10-08T16:25:04.186865+0000","last_active":"2023-10-08T16:25:04.189861+0000","last_peered":"2023-10-08T16:25:04.189861+0000","last_clean":"2023-10-08T16:25:04.189861+0000","last_became_active":"2023-10-08T16:25:04.185912+0000","last_became_peered":"2023-10-08T16:25:04.185912+0000","last_unstale":"2023-10-08T16:25:04.189861+0000","last_undegraded":"2023-10-08T16:25:04.189861+0000","last_fullsized":"2023-10-08T16:25:04.189861+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:16.289733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.177861+0000","last_change":"2023-10-08T16:25:03.166929+0000","last_active":"2023-10-08T16:25:04.177861+0000","last_peered":"2023-10-08T16:25:04.177861+0000","last_clean":"2023-10-08T16:25:04.177861+0000","last_became_active":"2023-10-08T16:25:03.166366+0000","last_became_peered":"2023-10-08T16:25:03.166366+0000","last_unstale":"2023-10-08T16:25:04.177861+0000","last_undegraded":"2023-10-08T16:25:04.177861+0000","last_fullsized":"2023-10-08T16:25:04.177861+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:43:20.428811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.196970+0000","last_change":"2023-10-08T16:25:04.193416+0000","last_active":"2023-10-08T16:25:04.196970+0000","last_peered":"2023-10-08T16:25:04.196970+0000","last_clean":"2023-10-08T16:25:04.196970+0000","last_became_active":"2023-10-08T16:25:04.193106+0000","last_became_peered":"2023-10-08T16:25:04.193106+0000","last_unstale":"2023-10-08T16:25:04.196970+0000","last_undegraded":"2023-10-08T16:25:04.196970+0000","last_fullsized":"2023-10-08T16:25:04.196970+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:03.137707+0000","last_clean_scrub_stamp":"2023-10-08T16:25:03.137707+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:09.405286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"98'2","reported_seq":12,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.205316+0000","last_change":"2023-10-08T16:25:03.168169+0000","last_active":"2023-10-08T16:25:04.205316+0000","last_peered":"2023-10-08T16:25:04.205316+0000","last_clean":"2023-10-08T16:25:04.205316+0000","last_became_active":"2023-10-08T16:25:03.167889+0000","last_became_peered":"2023-10-08T16:25:03.167889+0000","last_unstale":"2023-10-08T16:25:04.205316+0000","last_undegraded":"2023-10-08T16:25:04.205316+0000","last_fullsized":"2023-10-08T16:25:04.205316+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:02.132431+0000","last_clean_scrub_stamp":"2023-10-08T16:25:02.132431+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:33.296278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"88'183","reported_seq":469,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-08T16:25:04.168988+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:04.168988+0000","last_peered":"2023-10-08T16:25:04.168988+0000","last_clean":"2023-10-08T16:25:04.168988+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:04.168988+0000","last_undegraded":"2023-10-08T16:25:04.168988+0000","last_fullsized":"2023-10-08T16:25:04.168988+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307248,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064592,"statfs":{"total":96636764160,"available":96322142208,"internally_reserved":0,"allocated":1810432,"data_stored":1176158,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69799999999999995,"15min":0.72399999999999998},"min":{"1min":0.48499999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97199999999999998,"5min":0.98299999999999998,"15min":1.103},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70699999999999996,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.089},"last":0.61199999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.98999999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.77000000000000002,"15min":0.78800000000000003},"min":{"1min":0.57099999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.1160000000000001},"last":0.69699999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71799999999999997,"15min":0.73099999999999998},"min":{"1min":0.55500000000000005,"5min":0.48299999999999998,"15min":0.45700000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.73899999999999999,"15min":0.745},"min":{"1min":0.57399999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0189999999999999,"5min":1.032,"15min":1.1000000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72399999999999998,"15min":0.73799999999999999},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.48499999999999999},"max":{"1min":0.94399999999999995,"5min":0.95199999999999996,"15min":1.006},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76200000000000001,"15min":0.78600000000000003},"min":{"1min":0.61099999999999999,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":1.0389999999999999,"5min":1.0660000000000001,"15min":5.5590000000000002},"last":0.84799999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.234},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68300000000000005,"15min":0.67000000000000004},"min":{"1min":0.53000000000000003,"5min":0.439,"15min":0.437},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.3919999999999999},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.71999999999999997,"15min":0.70299999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.351,"5min":1.351,"15min":1.3680000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.73999999999999999,"15min":0.72599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 16:24:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.59799999999999998,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":1.173,"5min":1.173,"15min":1.323},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.76500000000000001,"15min":0.751},"min":{"1min":0.60399999999999998,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.448},"last":0.82699999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575038,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.49299999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82599999999999996,"5min":0.96399999999999997,"15min":1.125},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69999999999999996,"15min":0.71899999999999997},"min":{"1min":0.45100000000000001,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.93799999999999994,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67600000000000005,"15min":0.70099999999999996},"min":{"1min":0.499,"5min":0.38,"15min":0.38},"max":{"1min":0.81200000000000006,"5min":0.99199999999999999,"15min":1.365},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71499999999999997,"15min":0.73199999999999998},"min":{"1min":0.439,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.86899999999999999,"5min":0.997,"15min":1.0549999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.49099999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.88600000000000001,"5min":1.071,"15min":1.552},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.54900000000000004,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.85599999999999998,"5min":1.034,"15min":1.4570000000000001},"last":0.625}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72999999999999998,"15min":0.76100000000000001},"min":{"1min":0.51300000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.0149999999999999,"15min":1.069},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.76700000000000002,"15min":0.77900000000000003},"min":{"1min":0.53300000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97799999999999998,"5min":0.99099999999999999,"15min":1.619},"last":0.67300000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84199999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.746,"15min":0.754},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.90500000000000003,"5min":1.1879999999999999,"15min":1.5900000000000001},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.65600000000000003,"15min":0.66400000000000003},"min":{"1min":0.45600000000000002,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.85499999999999998,"5min":1.272,"15min":1.272},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71799999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.89100000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.83099999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.51600000000000001,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.873},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.71799999999999997,"15min":0.74099999999999999},"min":{"1min":0.48799999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85699999999999998,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.79300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302584,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069256,"statfs":{"total":96636764160,"available":96326918144,"internally_reserved":0,"allocated":1228800,"data_stored":587326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.44400000000000001,"15min":0.45000000000000001},"min":{"1min":0.29999999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54700000000000004,"5min":0.75600000000000001,"15min":0.873},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.48499999999999999,"15min":0.49299999999999999},"min":{"1min":0.35299999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68100000000000005,"5min":0.82199999999999995,"15min":1.0680000000000001},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48999999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.502},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56799999999999995,"15min":0.57799999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.65400000000000003,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.55100000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.62,"15min":0.629},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.71299999999999997,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55600000000000005,"15min":0.57599999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.33700000000000002},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":1.472},"last":0.53200000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.57299999999999995,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":0.94799999999999995,"5min":1.026,"15min":1.373},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80200000000000005,"15min":0.79500000000000004},"min":{"1min":0.53500000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.94999999999999996,"5min":1.2230000000000001,"15min":1.375},"last":0.70999999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79500000000000004,"15min":0.78700000000000003},"min":{"1min":0.54600000000000004,"5min":0.50600000000000001,"15min":0.48999999999999999},"max":{"1min":0.95599999999999996,"5min":1.157,"15min":1.276},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.80600000000000005,"15min":0.80100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.45800000000000002},"max":{"1min":1.0660000000000001,"5min":1.085,"15min":1.224},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.80700000000000005,"15min":0.81100000000000005},"min":{"1min":0.63400000000000001,"5min":0.56899999999999995,"15min":0.52300000000000002},"max":{"1min":1.0069999999999999,"5min":1.0800000000000001,"15min":1.429},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81699999999999995,"15min":0.80800000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0209999999999999,"5min":1.2909999999999999,"15min":1.391},"last":0.746}]},{"osd":7,"last update":"Sun Oct 8 16:24:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.56100000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0109999999999999,"5min":1.0840000000000001,"15min":1.1839999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.83799999999999997,"15min":0.83399999999999996},"min":{"1min":0.68100000000000005,"5min":0.59799999999999998,"15min":0.56999999999999995},"max":{"1min":1.0449999999999999,"5min":1.0960000000000001,"15min":1.514},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575037,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299048,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072792,"statfs":{"total":96636764160,"available":96330539008,"internally_reserved":0,"allocated":1802240,"data_stored":1175570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.46600000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.433}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":0.73599999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":0.74199999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":0.59299999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":0.627},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306672,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065168,"statfs":{"total":96636764160,"available":96322732032,"internally_reserved":0,"allocated":1220608,"data_stored":586738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.439},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.85899999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.95699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.94199999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":1.0049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306668,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065172,"statfs":{"total":96636764160,"available":96322736128,"internally_reserved":0,"allocated":1216512,"data_stored":585314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.45100000000000001,"15min":0.45800000000000002},"min":{"1min":0.30499999999999999,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.27100000000000002},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48299999999999998,"15min":0.47699999999999998},"min":{"1min":0.32500000000000001,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.66100000000000003,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54900000000000004},"min":{"1min":0.39000000000000001,"5min":0.33100000000000002,"15min":0.31900000000000001},"max":{"1min":0.748,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.45700000000000002,"5min":0.39700000000000002,"15min":0.38500000000000001},"max":{"1min":0.72999999999999998,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65700000000000003,"15min":0.65300000000000002},"min":{"1min":0.45000000000000001,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.79200000000000004,"5min":1,"15min":1},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.96399999999999997,"5min":1.04,"15min":1.2789999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.99299999999999999,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.65100000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":0.93700000000000006,"5min":1.1319999999999999,"15min":1.2869999999999999},"last":0.88},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78500000000000003},"min":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.51100000000000001},"max":{"1min":1.0589999999999999,"5min":1.093,"15min":1.3200000000000001},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.79500000000000004,"15min":0.81200000000000006},"min":{"1min":0.50700000000000001,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.3799999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.83099999999999996},"min":{"1min":0.57199999999999995,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.996,"5min":1.1799999999999999,"15min":1.397},"last":0.83599999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:24:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.82399999999999995,"15min":0.84899999999999998},"min":{"1min":0.58299999999999996,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.0429999999999999,"5min":1.153,"15min":1.306},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82399999999999995,"15min":0.83899999999999997},"min":{"1min":0.63400000000000001,"5min":0.58199999999999996,"15min":0.54000000000000004},"max":{"1min":1.111,"5min":1.111,"15min":1.321},"last":0.78600000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298472,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073368,"statfs":{"total":96636764160,"available":96331128832,"internally_reserved":0,"allocated":1212416,"data_stored":585272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.72899999999999998,"15min":0.71299999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.998,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73799999999999999,"15min":0.72399999999999998},"min":{"1min":0.56299999999999994,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.80700000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.56299999999999994,"5min":0.439,"15min":0.436},"max":{"1min":0.99299999999999999,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.747,"15min":0.73899999999999999},"min":{"1min":0.56999999999999995,"5min":0.504,"15min":0.379},"max":{"1min":0.96199999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.54000000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77300000000000002,"15min":0.747},"min":{"1min":0.60399999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":1.004,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.754,"15min":0.753},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91600000000000004,"5min":1.085,"15min":1.216},"last":0.72199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.81399999999999995,"15min":0.80600000000000005},"min":{"1min":0.58899999999999997,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1479999999999999},"last":0.627},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.745},"min":{"1min":0.505,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0309999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.68300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.63600000000000001},"min":{"1min":0.47799999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.022,"5min":1.47,"15min":1.47},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69699999999999995,"15min":0.68799999999999994},"min":{"1min":0.54100000000000004,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.022,"5min":1.0289999999999999,"15min":1.2769999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.65100000000000002},"min":{"1min":0.47999999999999998,"5min":0.42599999999999999,"15min":0.42399999999999999},"max":{"1min":0.97099999999999997,"5min":2.661,"15min":2.661},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.76200000000000001,"15min":0.73699999999999999},"min":{"1min":0.53400000000000003,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.611,"15min":1.6839999999999999},"last":0.754}]},{"osd":7,"last update":"Sun Oct 8 16:24:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.79000000000000004,"15min":0.77200000000000002},"min":{"1min":0.505,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.117,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75800000000000001,"15min":0.73999999999999999},"min":{"1min":0.59099999999999997,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0760000000000001,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.84199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310760,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061080,"statfs":{"total":96636764160,"available":96318545920,"internally_reserved":0,"allocated":1212416,"data_stored":585292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.74299999999999999,"15min":0.72399999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86599999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.746},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40999999999999998,"5min":0.308,"15min":0.308},"max":{"1min":1.087,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.98499999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.751},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.008,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73499999999999999,"15min":0.73799999999999999},"min":{"1min":0.44600000000000001,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.05},"last":0.91600000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.745},"min":{"1min":0.46600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":0.97599999999999998,"15min":1.121},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.98699999999999999,"5min":4.931,"15min":4.931},"last":0.874}]},{"osd":3,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.503,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.123,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.77300000000000002,"15min":0.78000000000000003},"min":{"1min":0.57099999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.101,"5min":1.96,"15min":1.96},"last":1.0129999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68600000000000005,"15min":0.63700000000000001},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0529999999999999,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69599999999999995,"15min":0.68600000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.66500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71499999999999997,"15min":0.69899999999999995},"min":{"1min":0.48099999999999998,"5min":0.443,"15min":0.40899999999999997},"max":{"1min":1,"5min":2.024,"15min":2.024},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.441,"5min":0.441,"15min":0.379},"max":{"1min":1.0029999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.82999999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:24:29 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.76100000000000001},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.436},"max":{"1min":1.052,"5min":2.157,"15min":2.157},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.78700000000000003,"15min":0.78300000000000003},"min":{"1min":0.59599999999999997,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.071,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:14.044 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:25:14.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:25:14.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.270+0000 7f8a4979d700 1 Processor -- start 2023-10-08T16:25:14.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.271+0000 7f8a4979d700 1 -- start start 2023-10-08T16:25:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a4979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a440caec0 0x7f8a44164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a4979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a440c7420 con 0x7f8a44159640 2023-10-08T16:25:14.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a4979d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4406d820 con 0x7f8a44159a10 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a4979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4406db00 con 0x7f8a440caec0 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a43fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8a44159640 0x7f8a4406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55194/0 (socket says 172.21.15.12:55194) 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a43fff700 1 -- 172.21.15.12:0/404222572 learned_addr learned my addr 172.21.15.12:0/404222572 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.272+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a440caec0 0x7f8a44164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577955051 0 0) 0x7f8a440c7420 con 0x7f8a44159640 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a2c003570 con 0x7f8a44159640 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865880992 0 0) 0x7f8a4406d820 con 0x7f8a44159a10 2023-10-08T16:25:14.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a440c7420 con 0x7f8a44159a10 2023-10-08T16:25:14.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734029197 0 0) 0x7f8a2c003570 con 0x7f8a44159640 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a440caec0 msgr2=0x7f8a44164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a440caec0 0x7f8a44164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 >> v1:172.21.15.29:6789/0 conn(0x7f8a44159a10 legacy=0x7f8a440ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4406dde0 con 0x7f8a44159640 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f8a34001470 con 0x7f8a44159640 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 >> v1:172.21.15.12:6789/0 conn(0x7f8a44159640 legacy=0x7f8a4406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a2c003c20 0x7f8a2c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c004810 0x7f8a2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a2c0051c0 0x7f8a2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4406db00 con 0x7f8a2c0051c0 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c00c020 con 0x7f8a2c003c20 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c00c1e0 con 0x7f8a2c004810 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.273+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a440caec0 0x7f8a44164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a2c0051c0 0x7f8a2c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a43fff700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a2c003c20 0x7f8a2c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a437fe700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c004810 0x7f8a2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 -- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c004810 msgr2=0x7f8a2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c004810 0x7f8a2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 -- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a2c003c20 msgr2=0x7f8a2c004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a2c003c20 0x7f8a2c004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 -- 172.21.15.12:0/404222572 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c003570 con 0x7f8a2c0051c0 2023-10-08T16:25:14.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a2c0051c0 0x7f8a2c00ba60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8a440cb290 tx=0x7f8a3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0bdd7a97c77a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00ead0 con 0x7f8a2c0051c0 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c00f040 con 0x7f8a2c0051c0 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.274+0000 7f8a42ffd700 1 -- 172.21.15.12:0/404222572 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00ee80 con 0x7f8a2c0051c0 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 -- 172.21.15.12:0/404222572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a2c0051c0 msgr2=0x7f8a2c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 --2- 172.21.15.12:0/404222572 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a2c0051c0 0x7f8a2c00ba60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8a440cb290 tx=0x7f8a3c00b040 comp rx=0 tx=0).stop 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a48f9c700 1 -- 172.21.15.12:0/404222572 reap_dead start 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 -- 172.21.15.12:0/404222572 shutdown_connections 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 -- 172.21.15.12:0/404222572 >> 172.21.15.12:0/404222572 conn(0x7f8a4406e720 msgr2=0x7f8a4406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 -- 172.21.15.12:0/404222572 shutdown_connections 2023-10-08T16:25:14.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.275+0000 7f8a4979d700 1 -- 172.21.15.12:0/404222572 wait complete. 2023-10-08T16:25:14.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.277+0000 7f8a4979d700 1 Processor -- start 2023-10-08T16:25:14.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.277+0000 7f8a4979d700 1 -- start start 2023-10-08T16:25:14.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c0051c0 0x7f8a440c4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a440c99a0 0x7f8a44153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440c4e50 con 0x7f8a44155d00 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4416d050 con 0x7f8a440c99a0 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a4979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440c51b0 con 0x7f8a2c0051c0 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55300/0 (socket says 172.21.15.12:55300) 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 -- 172.21.15.12:0/426300836 learned_addr learned my addr 172.21.15.12:0/426300836 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:14.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a43fff700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c0051c0 0x7f8a440c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a437fe700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a440c99a0 0x7f8a44153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 -- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c0051c0 msgr2=0x7f8a440c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c0051c0 0x7f8a440c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 -- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a440c99a0 msgr2=0x7f8a44153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a440c99a0 0x7f8a44153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.278+0000 7f8a48f9c700 1 -- 172.21.15.12:0/426300836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a441566b0 con 0x7f8a44155d00 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a48f9c700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00bff0 tx=0x7f8a3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c014e00 con 0x7f8a44155d00 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c027420 con 0x7f8a44155d00 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a4416de70 con 0x7f8a44155d00 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c0277e0 con 0x7f8a44155d00 2023-10-08T16:25:14.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.279+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4416d540 con 0x7f8a44155d00 2023-10-08T16:25:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.280+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a440b0930 con 0x7f8a44155d00 2023-10-08T16:25:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.281+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a3c025070 con 0x7f8a44155d00 2023-10-08T16:25:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.282+0000 7f8a2bfff700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 0x7f8a300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.282+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8a3c086830 con 0x7f8a44155d00 2023-10-08T16:25:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.282+0000 7f8a43fff700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 0x7f8a300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.283+0000 7f8a43fff700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 0x7f8a300693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000c00 tx=0x7f8a4406d9f0 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.286+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a3c0539d0 con 0x7f8a44155d00 2023-10-08T16:25:14.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.568+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8a440cc760 con 0x7f8a44155d00 2023-10-08T16:25:14.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.574+0000 7f8a2bfff700 1 -- 172.21.15.12:0/426300836 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8a3c056ff0 con 0x7f8a44155d00 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 msgr2=0x7f8a300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 0x7f8a300693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8a34000c00 tx=0x7f8a4406d9f0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 msgr2=0x7f8a44156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00bff0 tx=0x7f8a3c019000 comp rx=0 tx=0).stop 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 shutdown_connections 2023-10-08T16:25:14.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8a30066f30 0x7f8a300693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a44155d00 0x7f8a44156170 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a2c0051c0 0x7f8a440c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 --2- 172.21.15.12:0/426300836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a440c99a0 0x7f8a44153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 >> 172.21.15.12:0/426300836 conn(0x7f8a4406e720 msgr2=0x7f8a440c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 shutdown_connections 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.577+0000 7f8a4979d700 1 -- 172.21.15.12:0/426300836 wait complete. 2023-10-08T16:25:14.579 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:25:14.595 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.783+0000 7f530d59d700 1 Processor -- start 2023-10-08T16:25:14.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.783+0000 7f530d59d700 1 -- start start 2023-10-08T16:25:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.784+0000 7f530d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 0x7f530814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.784+0000 7f530d59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530806a490 con 0x7f530806e0a0 2023-10-08T16:25:14.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.784+0000 7f530d59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080c7230 con 0x7f530806e470 2023-10-08T16:25:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.784+0000 7f530d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080c7490 con 0x7f530806f3a0 2023-10-08T16:25:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5307fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f530806e0a0 0x7f53080c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55204/0 (socket says 172.21.15.12:55204) 2023-10-08T16:25:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5307fff700 1 -- 172.21.15.12:0/2847177336 learned_addr learned my addr 172.21.15.12:0/2847177336 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:14.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f53077fe700 1 --2- 172.21.15.12:0/2847177336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 0x7f530814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289649880 0 0) 0x7f530806a490 con 0x7f530806e0a0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52f0003570 con 0x7f530806e0a0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 629556791 0 0) 0x7f53080c7230 con 0x7f530806e470 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f530806a490 con 0x7f530806e470 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f53077fe700 1 -- 172.21.15.12:0/2847177336 >> v1:172.21.15.29:6789/0 conn(0x7f530806e470 legacy=0x7f530806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f53077fe700 1 -- 172.21.15.12:0/2847177336 >> v1:172.21.15.12:6789/0 conn(0x7f530806e0a0 legacy=0x7f53080c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1685191461 0 0) 0x7f52f0003570 con 0x7f530806e0a0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.785+0000 7f53077fe700 1 -- 172.21.15.12:0/2847177336 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080c7770 con 0x7f530806f3a0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.786+0000 7f53077fe700 1 --2- 172.21.15.12:0/2847177336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 0x7f530814fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009900 tx=0x7f52fc009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12369dfbb6a1b188 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.786+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8001470 con 0x7f530806f3a0 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.786+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc011420 con 0x7f530806f3a0 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.786+0000 7f5306ffd700 1 -- 172.21.15.12:0/2847177336 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc0117c0 con 0x7f530806f3a0 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 -- 172.21.15.12:0/2847177336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 msgr2=0x7f530814fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 --2- 172.21.15.12:0/2847177336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 0x7f530814fc70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009900 tx=0x7f52fc009120 comp rx=0 tx=0).stop 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 -- 172.21.15.12:0/2847177336 shutdown_connections 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 --2- 172.21.15.12:0/2847177336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806f3a0 0x7f530814fc70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 -- 172.21.15.12:0/2847177336 >> 172.21.15.12:0/2847177336 conn(0x7f530806d170 msgr2=0x7f53080cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 -- 172.21.15.12:0/2847177336 shutdown_connections 2023-10-08T16:25:14.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.787+0000 7f530d59d700 1 -- 172.21.15.12:0/2847177336 wait complete. 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.788+0000 7f530d59d700 1 Processor -- start 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.788+0000 7f530d59d700 1 -- start start 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 0x7f530816a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 0x7f530814bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530816e260 con 0x7f530806e0a0 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530816b0c0 con 0x7f530806f3a0 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.789+0000 7f530d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530816d9c0 con 0x7f530806e470 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55316/0 (socket says 172.21.15.12:55316) 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 -- 172.21.15.12:0/531314332 learned_addr learned my addr 172.21.15.12:0/531314332 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f53077fe700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 0x7f530816a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 -- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 msgr2=0x7f530816a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f530cd9c700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 0x7f530814bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 0x7f530816a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 -- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 msgr2=0x7f530814bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 0x7f530814bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 -- 172.21.15.12:0/531314332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0093c0 con 0x7f530806e0a0 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f53077fe700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 0x7f530816a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f530cd9c700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 0x7f530814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.790+0000 7f5307fff700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f52f800cb90 tx=0x7f52f8001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.791+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8007360 con 0x7f530806e0a0 2023-10-08T16:25:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.791+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f80074e0 con 0x7f530806e0a0 2023-10-08T16:25:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.791+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530816dca0 con 0x7f530806e0a0 2023-10-08T16:25:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.791+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8004830 con 0x7f530806e0a0 2023-10-08T16:25:14.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.791+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530814c120 con 0x7f530806e0a0 2023-10-08T16:25:14.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.792+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530816ae90 con 0x7f530806e0a0 2023-10-08T16:25:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.793+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52f8004ba0 con 0x7f530806e0a0 2023-10-08T16:25:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.793+0000 7f52effff700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.794+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f52f8083eb0 con 0x7f530806e0a0 2023-10-08T16:25:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.794+0000 7f53077fe700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:14.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.794+0000 7f53077fe700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f530806f770 tx=0x7f52fc016000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:14.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:14.798+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f530816ae90 con 0x7f530806e0a0 2023-10-08T16:25:15.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.044+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f530816ae90 con 0x7f530806e0a0 2023-10-08T16:25:15.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.044+0000 7f52effff700 1 -- 172.21.15.12:0/531314332 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f530816ae90 con 0x7f530806e0a0 2023-10-08T16:25:15.045 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:15.046 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.046+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 msgr2=0x7f52f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.046+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f530806f770 tx=0x7f52fc016000 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.046+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 msgr2=0x7f530816d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.046+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f52f800cb90 tx=0x7f52f8001b50 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 shutdown_connections 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f530806e0a0 0x7f530816d2c0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f530806f3a0 0x7f530814bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 --2- 172.21.15.12:0/531314332 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f530806e470 0x7f530816a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 >> 172.21.15.12:0/531314332 conn(0x7f530806d170 msgr2=0x7f530806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 shutdown_connections 2023-10-08T16:25:15.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.047+0000 7f530d59d700 1 -- 172.21.15.12:0/531314332 wait complete. 2023-10-08T16:25:15.049 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:15.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:25:03.642311+0000', 'modified': '2023-10-08T16:25:07.189472+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6774}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6774': {'gid': 6774, 'name': 'd', 'rank': 0, 'incarnation': 38, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/2452899157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 2452899157}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 2452899157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:25:15.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:25:15.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T16:25:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.660+0000 7f26a359e700 1 Processor -- start 2023-10-08T16:25:15.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.660+0000 7f26a359e700 1 -- start start 2023-10-08T16:25:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.661+0000 7f26a359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26a4153c30 0x7f26a415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.661+0000 7f26a359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a40cf110 0x7f26a415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.661+0000 7f26a359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a415afd0 con 0x7f26a415de50 2023-10-08T16:25:15.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.661+0000 7f26a359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a415b2b0 con 0x7f26a4153c30 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.661+0000 7f26a359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a415b590 con 0x7f26a40cf110 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26a4153c30 0x7f26a415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26a4153c30 0x7f26a415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55320/0 (socket says 172.21.15.12:55320) 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 -- 172.21.15.12:0/581011821 learned_addr learned my addr 172.21.15.12:0/581011821 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a1d9b700 1 --1- 172.21.15.12:0/581011821 >> v1:172.21.15.12:6789/0 conn(0x7f26a415de50 0x7f26a40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55212/0 (socket says 172.21.15.12:55212) 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a40cf110 0x7f26a415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 -- 172.21.15.12:0/581011821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a40cf110 msgr2=0x7f26a415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a40cf110 0x7f26a415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 -- 172.21.15.12:0/581011821 >> v1:172.21.15.12:6789/0 conn(0x7f26a415de50 legacy=0x7f26a40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 -- 172.21.15.12:0/581011821 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a415b870 con 0x7f26a4153c30 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a159a700 1 -- 172.21.15.12:0/581011821 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269117397 0 0) 0x7f26a415afd0 con 0x7f26a415de50 2023-10-08T16:25:15.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.662+0000 7f26a259c700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a415a5e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f26940099b0 tx=0x7f2694009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef2fc5be961c0a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a159a700 1 -- 172.21.15.12:0/581011821 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400b860 con 0x7f26a4153c30 2023-10-08T16:25:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a159a700 1 -- 172.21.15.12:0/581011821 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269400b9c0 con 0x7f26a4153c30 2023-10-08T16:25:15.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a159a700 1 -- 172.21.15.12:0/581011821 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269400bd60 con 0x7f26a4153c30 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 -- 172.21.15.12:0/581011821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 msgr2=0x7f26a415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a415a5e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f26940099b0 tx=0x7f2694009250 comp rx=0 tx=0).stop 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 -- 172.21.15.12:0/581011821 shutdown_connections 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a40cf110 0x7f26a415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 --2- 172.21.15.12:0/581011821 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a415a5e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 -- 172.21.15.12:0/581011821 >> 172.21.15.12:0/581011821 conn(0x7f26a40703a0 msgr2=0x7f26a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 -- 172.21.15.12:0/581011821 shutdown_connections 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.663+0000 7f26a359e700 1 -- 172.21.15.12:0/581011821 wait complete. 2023-10-08T16:25:15.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.665+0000 7f26a359e700 1 Processor -- start 2023-10-08T16:25:15.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.665+0000 7f26a359e700 1 -- start start 2023-10-08T16:25:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a40cf110 0x7f26a40b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a415de50 0x7f26a40b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40b49b0 con 0x7f26a4153c30 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40b3da0 con 0x7f26a40cf110 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a40b4080 con 0x7f26a415de50 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55328/0 (socket says 172.21.15.12:55328) 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a259c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a40cf110 0x7f26a40b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a1d9b700 1 -- 172.21.15.12:0/2969881385 learned_addr learned my addr 172.21.15.12:0/2969881385 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.666+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a415de50 0x7f26a40b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 -- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a415de50 msgr2=0x7f26a40b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a415de50 0x7f26a40b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 -- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a40cf110 msgr2=0x7f26a40b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a40cf110 0x7f26a40b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 -- 172.21.15.12:0/2969881385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26940094f0 con 0x7f26a4153c30 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f269800c5b0 tx=0x7f2698001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26927fc700 1 -- 172.21.15.12:0/2969881385 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698005a70 con 0x7f26a4153c30 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26927fc700 1 -- 172.21.15.12:0/2969881385 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2698005bd0 con 0x7f26a4153c30 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26927fc700 1 -- 172.21.15.12:0/2969881385 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26980070d0 con 0x7f26a4153c30 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a40b4360 con 0x7f26a4153c30 2023-10-08T16:25:15.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.667+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a40b34f0 con 0x7f26a4153c30 2023-10-08T16:25:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.669+0000 7f26927fc700 1 -- 172.21.15.12:0/2969881385 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2698007480 con 0x7f26a4153c30 2023-10-08T16:25:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.670+0000 7f26927fc700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 0x7f26840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.670+0000 7f26927fc700 1 -- 172.21.15.12:0/2969881385 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2698083b70 con 0x7f26a4153c30 2023-10-08T16:25:15.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.671+0000 7f26a259c700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 0x7f26840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.671+0000 7f26a259c700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 0x7f26840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26940099b0 tx=0x7f2694017000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.672+0000 7f26b71cdb80 1 Processor -- start 2023-10-08T16:25:15.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.672+0000 7f26b71cdb80 1 -- start start 2023-10-08T16:25:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf4b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf21ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dce78a70 con 0x5599dcf1f5f0 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dce76270 con 0x5599dcf6c480 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599dce72060 con 0x5599dcf21b80 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55338/0 (socket says 172.21.15.12:55338) 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26a1d9b700 1 -- 172.21.15.12:0/726038992 learned_addr learned my addr 172.21.15.12:0/726038992 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26a259c700 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf4b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.673+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf21ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 -- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 msgr2=0x5599dcf21ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf21ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 -- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 msgr2=0x5599dcf4b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf4b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 -- 172.21.15.12:0/726038992 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599dcd0c270 con 0x5599dcf1f5f0 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f269800cba0 tx=0x7f2698081dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af86386c6bcf278 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26837fe700 1 -- 172.21.15.12:0/726038992 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698054870 con 0x5599dcf1f5f0 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26837fe700 1 -- 172.21.15.12:0/726038992 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269806ae90 con 0x5599dcf1f5f0 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.674+0000 7f26837fe700 1 -- 172.21.15.12:0/726038992 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698057ac0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 -- 172.21.15.12:0/726038992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 msgr2=0x5599dcf6c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f269800cba0 tx=0x7f2698081dc0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 -- 172.21.15.12:0/726038992 shutdown_connections 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf21ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf4b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/726038992 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf6c850 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 -- 172.21.15.12:0/726038992 >> 172.21.15.12:0/726038992 conn(0x5599dcf230c0 msgr2=0x5599dcf238f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 -- 172.21.15.12:0/726038992 shutdown_connections 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.675+0000 7f26b71cdb80 1 -- 172.21.15.12:0/726038992 wait complete. 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.676+0000 7f26b71cdb80 1 -- start start 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.676+0000 7f26b71cdb80 1 Processor -- start 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf4cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf787a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dce1d890 con 0x5599dcf1f5f0 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dce38ea0 con 0x5599dcf6c480 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599dccf4e30 con 0x5599dcf21b80 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26b71cdb80 10 client.0 _ll_register_callbacks cb 0x5599dcee52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26a259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55350/0 (socket says 172.21.15.12:55350) 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26a259c700 1 -- 172.21.15.12:0/1451418180 learned_addr learned my addr 172.21.15.12:0/1451418180 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf787a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.677+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 -- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 msgr2=0x5599dcf4cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf4cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 -- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 msgr2=0x5599dcf787a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf787a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 -- 172.21.15.12:0/1451418180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a40b34f0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf4cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26a259c700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f26a40cf5c0 tx=0x7f2694021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3aeb2ee3626fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f2680ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694037070 con 0x5599dcf1f5f0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f269401a630 con 0x5599dcf1f5f0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599dcf16cd0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f269402d050 con 0x5599dcf1f5f0 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26b71cdb80 10 client.6930 fetch_fsmap learned FSMap version 42 2023-10-08T16:25:15.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.678+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5599dccaefe0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5599dcf16cd0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f269403a030 con 0x5599dcf1f5f0 2023-10-08T16:25:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 10 client.6930 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T16:25:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 10 client.6930 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:25:15.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 20 client.6930 populate_metadata read hostname 'smithi012' 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcf515e0 0x5599dcf519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 4 client.6930 mds_command: new command op to 6774 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 --> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599dcef3aa0 con 0x5599dcf515e0 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.679+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcf515e0 0x5599dcf519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.680+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcf515e0 0x5599dcf519b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14cd69ab209ebb server_cookie=580c7587d3bff23a in_seq=0 out_seq=0 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.680+0000 7f2680ff9700 10 client.6930 ms_handle_connect on v2:172.21.15.29:6833/2452899157 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f2680ff9700 1 -- 172.21.15.12:0/1451418180 <== mds.0 v2:172.21.15.29:6833/2452899157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5599dcef3aa0 con 0x5599dcf515e0 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f2680ff9700 10 client.6930 handle_command_reply: tid=0 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 client.6930 shutdown 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 msgr2=0x5599dcf4d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f26a40cf5c0 tx=0x7f2694021000 comp rx=0 tx=0).stop 2023-10-08T16:25:15.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 shutdown_connections 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcf515e0 0x5599dcf519b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf1f5f0 0x5599dcf4d370 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf6c480 0x5599dcf787a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1451418180 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf4cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f2680ff9700 0 client.6930 ms_handle_reset on v2:172.21.15.29:6833/2452899157 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 >> 172.21.15.12:0/1451418180 conn(0x5599dcf230c0 msgr2=0x5599dcf238d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 shutdown_connections 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1451418180 wait complete. 2023-10-08T16:25:15.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.681+0000 7f26b71cdb80 20 client.6930 trim_cache size 0 max 16384 2023-10-08T16:25:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.699+0000 7f26b71cdb80 1 Processor -- start 2023-10-08T16:25:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.699+0000 7f26b71cdb80 1 -- start start 2023-10-08T16:25:15.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcf699c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf69210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dcf180c0 con 0x5599dcf6c480 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dcefa410 con 0x5599dcf1f5f0 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599dcf01510 con 0x5599dcf21b80 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55358/0 (socket says 172.21.15.12:55358) 2023-10-08T16:25:15.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 -- 172.21.15.12:0/4209399138 learned_addr learned my addr 172.21.15.12:0/4209399138 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf69210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a259c700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcf699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 -- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 msgr2=0x5599dcf69210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf69210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 -- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 msgr2=0x5599dcf699c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcf699c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a2d9d700 1 -- 172.21.15.12:0/4209399138 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599dcf52350 con 0x5599dcf6c480 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a259c700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcf699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.700+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf69210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f269c0075a0 tx=0x7f269c009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df2981a4bf5e788 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f2683fff700 1 -- 172.21.15.12:0/4209399138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c018660 con 0x5599dcf6c480 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f2683fff700 1 -- 172.21.15.12:0/4209399138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269c0187c0 con 0x5599dcf6c480 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f2683fff700 1 -- 172.21.15.12:0/4209399138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c018b80 con 0x5599dcf6c480 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 -- 172.21.15.12:0/4209399138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 msgr2=0x5599dcf4e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f269c0075a0 tx=0x7f269c009850 comp rx=0 tx=0).stop 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 -- 172.21.15.12:0/4209399138 shutdown_connections 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf6c480 0x5599dcf4e900 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcf699c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/4209399138 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf21b80 0x5599dcf69210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.701+0000 7f26b71cdb80 1 -- 172.21.15.12:0/4209399138 >> 172.21.15.12:0/4209399138 conn(0x5599dcf230c0 msgr2=0x5599dcf6c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.702+0000 7f26b71cdb80 1 -- 172.21.15.12:0/4209399138 shutdown_connections 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.702+0000 7f26b71cdb80 1 -- 172.21.15.12:0/4209399138 wait complete. 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.702+0000 7f26b71cdb80 1 -- start start 2023-10-08T16:25:15.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.702+0000 7f26b71cdb80 1 Processor -- start 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcfc8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 0x5599dcf77570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dcfcf240 con 0x5599dcf21b80 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599dcf4a7d0 con 0x5599dcf1f5f0 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5599dcfcef20 con 0x5599dcf6c480 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26b71cdb80 10 client.0 _ll_register_callbacks cb 0x5599dcee52c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:25:15.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.703+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55372/0 (socket says 172.21.15.12:55372) 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 -- 172.21.15.12:0/1394080187 learned_addr learned my addr 172.21.15.12:0/1394080187 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 0x5599dcf77570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a259c700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcfc8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 -- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 msgr2=0x5599dcf77570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 0x5599dcf77570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 -- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 msgr2=0x5599dcfc8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcfc8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 -- 172.21.15.12:0/1394080187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269c011040 con 0x5599dcf21b80 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a2d9d700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 0x5599dcf77570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:15.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a259c700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcfc8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26a1d9b700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2698050d70 tx=0x7f269807e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afad4cd6f66cfc8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f2680ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698057ac0 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f269805b810 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.704+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26a40c8ff0 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2698070280 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 10 client.6936 fetch_fsmap learned FSMap version 42 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) v3 -- 0x5599dce40780 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a40c8ff0 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 42) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2698053d60 con 0x5599dcf21b80 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 10 client.6936 fetch_fsmap finished waiting for FSMap version 42 2023-10-08T16:25:15.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 10 client.6936 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 20 client.6936 populate_metadata read hostname 'smithi012' 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcfce2e0 0x5599dcfce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 4 client.6936 mds_command: new command op to 6774 tid=0[{"prefix": "status"}] 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 --> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f269806ae90 con 0x5599dcfce2e0 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.705+0000 7f26a259c700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcfce2e0 0x5599dcfce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26a259c700 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcfce2e0 0x5599dcfce6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d30b0679a58f821 server_cookie=89b60ad3762bb470 in_seq=0 out_seq=0 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f2680ff9700 10 client.6936 ms_handle_connect on v2:172.21.15.29:6833/2452899157 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f2680ff9700 1 -- 172.21.15.12:0/1394080187 <== mds.0 v2:172.21.15.29:6833/2452899157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f269806ae90 con 0x5599dcfce2e0 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f2680ff9700 10 client.6936 handle_command_reply: tid=0 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 client.6936 shutdown 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 msgr2=0x5599dcf49da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f2698050d70 tx=0x7f269807e040 comp rx=0 tx=0).stop 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 shutdown_connections 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x5599dcf6c480 0x5599dcf77570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5599dcf1f5f0 0x5599dcfc8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.29:6833/2452899157,v1:172.21.15.29:6835/2452899157] conn(0x5599dcfce2e0 0x5599dcfce6b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 --2- 172.21.15.12:0/1394080187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x5599dcf21b80 0x5599dcf49da0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f2680ff9700 0 client.6936 ms_handle_reset on v2:172.21.15.29:6833/2452899157 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 >> 172.21.15.12:0/1394080187 conn(0x5599dcf230c0 msgr2=0x5599dcf1de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 shutdown_connections 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.706+0000 7f26b71cdb80 1 -- 172.21.15.12:0/1394080187 wait complete. 2023-10-08T16:25:15.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26b71cdb80 20 client.6936 trim_cache size 0 max 16384 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 6774, 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.531144582, 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 42, 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 99, 2023-10-08T16:25:15.714 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 99, 2023-10-08T16:25:15.715 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.704302651999999 2023-10-08T16:25:15.715 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:25:15.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 msgr2=0x7f26840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 0x7f26840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f26940099b0 tx=0x7f2694017000 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 msgr2=0x7f26a40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f269800c5b0 tx=0x7f2698001040 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 shutdown_connections 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2684066f30 0x7f26840693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26a415de50 0x7f26a40b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26a40cf110 0x7f26a40b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 --2- 172.21.15.12:0/2969881385 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26a4153c30 0x7f26a40b1750 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 >> 172.21.15.12:0/2969881385 conn(0x7f26a40703a0 msgr2=0x7f26a40c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 shutdown_connections 2023-10-08T16:25:15.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.707+0000 7f26a359e700 1 -- 172.21.15.12:0/2969881385 wait complete. 2023-10-08T16:25:15.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:25:15.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.914+0000 7f11e119d700 1 Processor -- start 2023-10-08T16:25:15.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.914+0000 7f11e119d700 1 -- start start 2023-10-08T16:25:15.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.915+0000 7f11e119d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f11dc15b5d0 0x7f11dc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.915+0000 7f11e119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11dc0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11e119d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc0cb4f0 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11e119d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc0ca6e0 con 0x7f11dc15b5d0 2023-10-08T16:25:15.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11e119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1601e0 con 0x7f11dc0ca240 2023-10-08T16:25:15.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11e099c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f11dc0c6ec0 0x7f11dc06de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55218/0 (socket says 172.21.15.12:55218) 2023-10-08T16:25:15.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11e099c700 1 -- 172.21.15.12:0/845033605 learned_addr learned my addr 172.21.15.12:0/845033605 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:15.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.916+0000 7f11dbfff700 1 --2- 172.21.15.12:0/845033605 >> v2:172.21.15.29:3300/0 conn(0x7f11dc15b5d0 0x7f11dc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11db7fe700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11dc0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2067411837 0 0) 0x7f11dc0cb4f0 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c4003570 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907809446 0 0) 0x7f11c4003570 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 msgr2=0x7f11dc0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11dc0c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 >> v2:172.21.15.29:3300/0 conn(0x7f11dc15b5d0 msgr2=0x7f11dc0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 --2- 172.21.15.12:0/845033605 >> v2:172.21.15.29:3300/0 conn(0x7f11dc15b5d0 0x7f11dc0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc15e390 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f11d40017f0 con 0x7f11dc0c6ec0 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 >> v1:172.21.15.12:6789/0 conn(0x7f11dc0c6ec0 legacy=0x7f11dc06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11c4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c4004810 0x7f11c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0ca6e0 con 0x7f11c4004810 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc1601e0 con 0x7f11c4003ae0 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c400bb40 con 0x7f11dc0ca240 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11db7fe700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c4004810 0x7f11c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11dbfff700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11c4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.917+0000 7f11e099c700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 -- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 msgr2=0x7f11c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc0ca240 0x7f11c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 -- 172.21.15.12:0/845033605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c4004810 msgr2=0x7f11c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c4004810 0x7f11c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 -- 172.21.15.12:0/845033605 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c4003570 con 0x7f11c4003ae0 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11db7fe700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11c4004810 0x7f11c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11dbfff700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11c4003ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009c00 tx=0x7f11cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47cfbfc3112f87a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00e710 con 0x7f11c4003ae0 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc00e870 con 0x7f11c4003ae0 2023-10-08T16:25:15.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.918+0000 7f11daffd700 1 -- 172.21.15.12:0/845033605 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc00ec30 con 0x7f11c4003ae0 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 -- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 msgr2=0x7f11c4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 --2- 172.21.15.12:0/845033605 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11c4003ef0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009c00 tx=0x7f11cc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e099c700 1 -- 172.21.15.12:0/845033605 reap_dead start 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 -- 172.21.15.12:0/845033605 shutdown_connections 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 -- 172.21.15.12:0/845033605 >> 172.21.15.12:0/845033605 conn(0x7f11dc06d170 msgr2=0x7f11dc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 -- 172.21.15.12:0/845033605 shutdown_connections 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.919+0000 7f11e119d700 1 -- 172.21.15.12:0/845033605 wait complete. 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.921+0000 7f11e119d700 1 Processor -- start 2023-10-08T16:25:15.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.921+0000 7f11e119d700 1 -- start start 2023-10-08T16:25:15.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.921+0000 7f11e119d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11dc144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e119d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc15be10 0x7f11dc0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e119d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15cfe0 con 0x7f11dc15b9a0 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e119d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0b1bb0 con 0x7f11c4003ae0 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15c3d0 con 0x7f11dc15be10 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55384/0 (socket says 172.21.15.12:55384) 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 -- 172.21.15.12:0/1751492442 learned_addr learned my addr 172.21.15.12:0/1751492442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11dbfff700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11dc144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11e099c700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc15be10 0x7f11dc0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 -- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc15be10 msgr2=0x7f11dc0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc15be10 0x7f11dc0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 -- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 msgr2=0x7f11dc144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:15.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11dc144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.922+0000 7f11db7fe700 1 -- 172.21.15.12:0/1751492442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc15c6b0 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11db7fe700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f11d0006c20 tx=0x7f11d0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0011e70 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000fc20 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc15c990 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0014440 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.923+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc157980 con 0x7f11dc15b9a0 2023-10-08T16:25:15.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.924+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc15d190 con 0x7f11dc15b9a0 2023-10-08T16:25:15.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.925+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11d00147b0 con 0x7f11dc15b9a0 2023-10-08T16:25:15.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.926+0000 7f11c3fff700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 0x7f11c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:15.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.926+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f11d0018070 con 0x7f11dc15b9a0 2023-10-08T16:25:15.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.926+0000 7f11dbfff700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 0x7f11c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:15.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.927+0000 7f11dbfff700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 0x7f11c80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0091e0 tx=0x7f11cc01a000 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:15.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:15.930+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11dc15d190 con 0x7f11dc15b9a0 2023-10-08T16:25:16.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.177+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11dc15d190 con 0x7f11dc15b9a0 2023-10-08T16:25:16.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.177+0000 7f11c3fff700 1 -- 172.21.15.12:0/1751492442 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) v1 ==== 53+0+73 (secure 0 0 0) 0x7f11d0055e10 con 0x7f11dc15b9a0 2023-10-08T16:25:16.178 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 msgr2=0x7f11c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 0x7f11c80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0091e0 tx=0x7f11cc01a000 comp rx=0 tx=0).stop 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 msgr2=0x7f11dc0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f11d0006c20 tx=0x7f11d0009120 comp rx=0 tx=0).stop 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 shutdown_connections 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f11c8066f30 0x7f11c80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f11dc15be10 0x7f11dc0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:16.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f11c4003ae0 0x7f11dc144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 --2- 172.21.15.12:0/1751492442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f11dc15b9a0 0x7f11dc0b1130 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 >> 172.21.15.12:0/1751492442 conn(0x7f11dc06d170 msgr2=0x7f11dc159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 shutdown_connections 2023-10-08T16:25:16.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:16.180+0000 7f11e119d700 1 -- 172.21.15.12:0/1751492442 wait complete. 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:25:16.198 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:25:16.199 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:16.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.199 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:25:16.236 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:25:16.236 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:25:16.236 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:25:16.237 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41225sec preferred_lft 41225sec 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:25:16.239 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:16.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.240 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:25:16.336 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:25:16.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.339 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:25:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:25:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:25:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:25:16.378 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:25:16.379 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:25:16.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:25:16.380 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:25:16.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.578 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:25:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:25:16.614 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:25:16.615 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:16.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:25:16.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:25:16.718 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:16.755 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:16.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:25:16.755 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:16.831 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:25:16.831 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:25:16.831 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:16.963 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:16.964 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:25:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:25:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:25:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:25:16.993 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:25:16.997 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:25:16.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:16.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:17.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:25:17.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.250+0000 7feb1759e700 1 Processor -- start 2023-10-08T16:25:17.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.250+0000 7feb1759e700 1 -- start start 2023-10-08T16:25:17.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.251+0000 7feb1759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7feb18140a70 0x7feb180c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.251+0000 7feb1759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.251+0000 7feb1759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb180c6d50 con 0x7feb180c8330 2023-10-08T16:25:17.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.251+0000 7feb1759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb180c7030 con 0x7feb18140a70 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.251+0000 7feb1759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c7310 con 0x7feb18140e40 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb16d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feb180c8330 0x7feb180aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55226/0 (socket says 172.21.15.12:55226) 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb16d9d700 1 -- 172.21.15.12:0/3954265567 learned_addr learned my addr 172.21.15.12:0/3954265567 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 --2- 172.21.15.12:0/3954265567 >> v2:172.21.15.12:3300/0 conn(0x7feb18140a70 0x7feb180c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb15d9b700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1559a700 1 -- 172.21.15.12:0/3954265567 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515170774 0 0) 0x7feb180c6d50 con 0x7feb180c8330 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1559a700 1 -- 172.21.15.12:0/3954265567 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb00003570 con 0x7feb180c8330 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 -- 172.21.15.12:0/3954265567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 msgr2=0x7feb180c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 -- 172.21.15.12:0/3954265567 >> v1:172.21.15.12:6789/0 conn(0x7feb180c8330 legacy=0x7feb180aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 -- 172.21.15.12:0/3954265567 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180c75f0 con 0x7feb18140a70 2023-10-08T16:25:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.252+0000 7feb1659c700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb18140a70 0x7feb180c6770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7feb080098e0 tx=0x7feb080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68d02c8cd321f7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.253+0000 7feb1559a700 1 -- 172.21.15.12:0/3954265567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011630 con 0x7feb18140a70 2023-10-08T16:25:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.253+0000 7feb1559a700 1 -- 172.21.15.12:0/3954265567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08011790 con 0x7feb18140a70 2023-10-08T16:25:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.253+0000 7feb1559a700 1 -- 172.21.15.12:0/3954265567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011b30 con 0x7feb18140a70 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.253+0000 7feb1759e700 1 -- 172.21.15.12:0/3954265567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb18140a70 msgr2=0x7feb180c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.253+0000 7feb1759e700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb18140a70 0x7feb180c6770 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7feb080098e0 tx=0x7feb080091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 -- 172.21.15.12:0/3954265567 shutdown_connections 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb18140a70 0x7feb180c6770 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 --2- 172.21.15.12:0/3954265567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 -- 172.21.15.12:0/3954265567 >> 172.21.15.12:0/3954265567 conn(0x7feb1806d170 msgr2=0x7feb180cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 -- 172.21.15.12:0/3954265567 shutdown_connections 2023-10-08T16:25:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.254+0000 7feb1759e700 1 -- 172.21.15.12:0/3954265567 wait complete. 2023-10-08T16:25:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.255+0000 7feb1759e700 1 Processor -- start 2023-10-08T16:25:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.255+0000 7feb1759e700 1 -- start start 2023-10-08T16:25:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb18140a70 0x7feb180c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180b07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb18158b40 con 0x7feb180c8330 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c5c20 con 0x7feb18140a70 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c5f00 con 0x7feb18140e40 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55410/0 (socket says 172.21.15.12:55410) 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.256+0000 7feb1659c700 1 -- 172.21.15.12:0/3287678899 learned_addr learned my addr 172.21.15.12:0/3287678899 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb15d9b700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb18140a70 0x7feb180c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb16d9d700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180b07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 -- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 msgr2=0x7feb180b07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180b07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 -- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb18140a70 msgr2=0x7feb180c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb18140a70 0x7feb180c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 -- 172.21.15.12:0/3287678899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb08009420 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1659c700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7feb18071320 tx=0x7feb08017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0801f070 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb08000bc0 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08011b30 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.257+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb180c61e0 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.258+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb180c5780 con 0x7feb180c8330 2023-10-08T16:25:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.258+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1804c3c0 con 0x7feb180c8330 2023-10-08T16:25:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.259+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb08023070 con 0x7feb180c8330 2023-10-08T16:25:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.261+0000 7feb067fc700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.261+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7feb08085a20 con 0x7feb180c8330 2023-10-08T16:25:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.261+0000 7feb15d9b700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.261+0000 7feb15d9b700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 0x7feaf80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb180ccd10 tx=0x7feb0c009120 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.265+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb08052a60 con 0x7feb180c8330 2023-10-08T16:25:17.422 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:25:17.427 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:25:17.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.499+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7feb180c78d0 con 0x7feaf8066f30 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.501+0000 7feb067fc700 1 -- 172.21.15.12:0/3287678899 <== mgr.6570 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7feb180c78d0 con 0x7feaf8066f30 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:17.502 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:25:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 msgr2=0x7feaf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 0x7feaf80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7feb180ccd10 tx=0x7feb0c009120 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 msgr2=0x7feb18156bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7feb18071320 tx=0x7feb08017000 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 shutdown_connections 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feaf8066f30 0x7feaf80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feb180c8330 0x7feb18156bb0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feb18140e40 0x7feb180b07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 --2- 172.21.15.12:0/3287678899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feb18140a70 0x7feb180c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 >> 172.21.15.12:0/3287678899 conn(0x7feb1806d170 msgr2=0x7feb1813ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 shutdown_connections 2023-10-08T16:25:17.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.503+0000 7feb1759e700 1 -- 172.21.15.12:0/3287678899 wait complete. 2023-10-08T16:25:17.522 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:25:17.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.752+0000 7febc759e700 1 Processor -- start 2023-10-08T16:25:17.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.752+0000 7febc759e700 1 -- start start 2023-10-08T16:25:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.753+0000 7febc759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7febc813fe90 0x7febc806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.753+0000 7febc759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc806b290 con 0x7febc80c7fb0 2023-10-08T16:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.753+0000 7febc759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc806b570 con 0x7febc80c7be0 2023-10-08T16:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.753+0000 7febc759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc806bf10 con 0x7febc813fe90 2023-10-08T16:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7febc80c7fb0 0x7febc813f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55240/0 (socket says 172.21.15.12:55240) 2023-10-08T16:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7febc813fe90 0x7febc806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc5d9b700 1 -- 172.21.15.12:0/2901089780 learned_addr learned my addr 172.21.15.12:0/2901089780 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc559a700 1 -- 172.21.15.12:0/2901089780 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272284743 0 0) 0x7febc806b290 con 0x7febc80c7fb0 2023-10-08T16:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc559a700 1 -- 172.21.15.12:0/2901089780 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb0003570 con 0x7febc80c7fb0 2023-10-08T16:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc6d9d700 1 -- 172.21.15.12:0/2901089780 >> v1:172.21.15.29:6789/0 conn(0x7febc80c7be0 legacy=0x7febc815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc6d9d700 1 -- 172.21.15.12:0/2901089780 >> v1:172.21.15.12:6789/0 conn(0x7febc80c7fb0 legacy=0x7febc813f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.754+0000 7febc6d9d700 1 -- 172.21.15.12:0/2901089780 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc806b850 con 0x7febc813fe90 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc6d9d700 1 --2- 172.21.15.12:0/2901089780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc813fe90 0x7febc806abd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7febc0009e60 tx=0x7febc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf740075b3e2012 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc559a700 1 -- 172.21.15.12:0/2901089780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000e070 con 0x7febc813fe90 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc559a700 1 -- 172.21.15.12:0/2901089780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000bb60 con 0x7febc813fe90 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc559a700 1 -- 172.21.15.12:0/2901089780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc0012430 con 0x7febc813fe90 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc759e700 1 -- 172.21.15.12:0/2901089780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc813fe90 msgr2=0x7febc806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc759e700 1 --2- 172.21.15.12:0/2901089780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc813fe90 0x7febc806abd0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7febc0009e60 tx=0x7febc0009780 comp rx=0 tx=0).stop 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc759e700 1 -- 172.21.15.12:0/2901089780 shutdown_connections 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc759e700 1 --2- 172.21.15.12:0/2901089780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc813fe90 0x7febc806abd0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.755+0000 7febc759e700 1 -- 172.21.15.12:0/2901089780 >> 172.21.15.12:0/2901089780 conn(0x7febc806d110 msgr2=0x7febc80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.756+0000 7febc759e700 1 -- 172.21.15.12:0/2901089780 shutdown_connections 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.756+0000 7febc759e700 1 -- 172.21.15.12:0/2901089780 wait complete. 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.757+0000 7febc759e700 1 Processor -- start 2023-10-08T16:25:17.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.757+0000 7febc759e700 1 -- start start 2023-10-08T16:25:17.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 0x7febc80b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7febc813fe90 0x7febc81557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80c6760 con 0x7febc80c7be0 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc80c5b50 con 0x7febc80c7fb0 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc80c5e30 con 0x7febc813fe90 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55440/0 (socket says 172.21.15.12:55440) 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc659c700 1 -- 172.21.15.12:0/3533133224 learned_addr learned my addr 172.21.15.12:0/3533133224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc6d9d700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7febc813fe90 0x7febc81557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.758+0000 7febc5d9b700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 0x7febc80b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 -- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7febc813fe90 msgr2=0x7febc81557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7febc813fe90 0x7febc81557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 -- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 msgr2=0x7febc80b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 0x7febc80b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 -- 172.21.15.12:0/3533133224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0009a20 con 0x7febc80c7be0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc5d9b700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 0x7febc80b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc659c700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7febb800c590 tx=0x7febb800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011590 con 0x7febc80c7be0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb8011710 con 0x7febc80c7be0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb8011ad0 con 0x7febc80c7be0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc80c6110 con 0x7febc80c7be0 2023-10-08T16:25:17.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.759+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc80c4290 con 0x7febc80c7be0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.760+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc804c3c0 con 0x7febc80c7be0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.761+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 36) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febb801b3b0 con 0x7febc80c7be0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.763+0000 7febb67fc700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.763+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7febb8083c90 con 0x7febc80c7be0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.763+0000 7febc5d9b700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.763+0000 7febc5d9b700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 0x7feba80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febc806e320 tx=0x7febbc009040 comp rx=0 tx=0).ready entity=mgr.6570 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:17.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:17.767+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb8050cd0 con 0x7febc80c7be0 2023-10-08T16:25:18.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.025+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7febc80c7560 con 0x7febc80c7be0 2023-10-08T16:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.144+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7febb80510a0 con 0x7febc80c7be0 2023-10-08T16:25:18.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.145+0000 7febb67fc700 1 -- 172.21.15.12:0/3533133224 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v37) v1 ==== 92+0+0 (secure 0 0 0) 0x7febb8054760 con 0x7febc80c7be0 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 msgr2=0x7feba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 0x7feba80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7febc806e320 tx=0x7febbc009040 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 msgr2=0x7febc80c3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7febb800c590 tx=0x7febb800c8a0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 shutdown_connections 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7febc80c7be0 0x7febc80c3d50 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7febc813fe90 0x7febc81557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 --2- 172.21.15.12:0/3533133224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7febc80c7fb0 0x7febc80b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 >> 172.21.15.12:0/3533133224 conn(0x7febc806d110 msgr2=0x7febc80aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 shutdown_connections 2023-10-08T16:25:18.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.148+0000 7febc759e700 1 -- 172.21.15.12:0/3533133224 wait complete. 2023-10-08T16:25:18.166 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:25:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.361+0000 7f788759e700 1 Processor -- start 2023-10-08T16:25:18.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.361+0000 7f788759e700 1 -- start start 2023-10-08T16:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f788815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 0x7f78880cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f788815ac50 con 0x7f7888153a00 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f788815d010 con 0x7f78880cea00 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788815af60 con 0x7f7888153dd0 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.362+0000 7f788659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7888153a00 0x7f788815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55246/0 (socket says 172.21.15.12:55246) 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f788659c700 1 -- 172.21.15.12:0/2219859720 learned_addr learned my addr 172.21.15.12:0/2219859720 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7885d9b700 1 --2- 172.21.15.12:0/2219859720 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f788815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7886d9d700 1 --2- 172.21.15.12:0/2219859720 >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 0x7f78880cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f788559a700 1 -- 172.21.15.12:0/2219859720 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921295033 0 0) 0x7f788815ac50 con 0x7f7888153a00 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f788559a700 1 -- 172.21.15.12:0/2219859720 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7870003570 con 0x7f7888153a00 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7885d9b700 1 -- 172.21.15.12:0/2219859720 >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 msgr2=0x7f78880cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7885d9b700 1 --2- 172.21.15.12:0/2219859720 >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 0x7f78880cee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7885d9b700 1 -- 172.21.15.12:0/2219859720 >> v1:172.21.15.12:6789/0 conn(0x7f7888153a00 legacy=0x7f788815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7885d9b700 1 -- 172.21.15.12:0/2219859720 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788815b240 con 0x7f7888153dd0 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.363+0000 7f7886d9d700 1 --2- 172.21.15.12:0/2219859720 >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 0x7f78880cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f7885d9b700 1 --2- 172.21.15.12:0/2219859720 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f788815de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f787c009910 tx=0x7f787c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c472c37b83380e32 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:18.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788559a700 1 -- 172.21.15.12:0/2219859720 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011630 con 0x7f7888153dd0 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788559a700 1 -- 172.21.15.12:0/2219859720 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c011790 con 0x7f7888153dd0 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788559a700 1 -- 172.21.15.12:0/2219859720 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011b30 con 0x7f7888153dd0 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 -- 172.21.15.12:0/2219859720 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 msgr2=0x7f788815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 --2- 172.21.15.12:0/2219859720 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f788815de50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f787c009910 tx=0x7f787c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 -- 172.21.15.12:0/2219859720 shutdown_connections 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 --2- 172.21.15.12:0/2219859720 >> v2:172.21.15.12:3300/0 conn(0x7f78880cea00 0x7f78880cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 --2- 172.21.15.12:0/2219859720 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f788815de50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.364+0000 7f788759e700 1 -- 172.21.15.12:0/2219859720 >> 172.21.15.12:0/2219859720 conn(0x7f78880703a0 msgr2=0x7f78880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.365+0000 7f788759e700 1 -- 172.21.15.12:0/2219859720 shutdown_connections 2023-10-08T16:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.365+0000 7f788759e700 1 -- 172.21.15.12:0/2219859720 wait complete. 2023-10-08T16:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.367+0000 7f788759e700 1 Processor -- start 2023-10-08T16:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.367+0000 7f788759e700 1 -- start start 2023-10-08T16:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880cea00 0x7f788815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f7888151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7888158270 con 0x7f7888153a00 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78881575f0 con 0x7f78880cea00 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78881578d0 con 0x7f7888153dd0 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55468/0 (socket says 172.21.15.12:55468) 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 -- 172.21.15.12:0/960280822 learned_addr learned my addr 172.21.15.12:0/960280822 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f788659c700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880cea00 0x7f788815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7886d9d700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f7888151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 msgr2=0x7f7888151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f7888151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880cea00 msgr2=0x7f788815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880cea00 0x7f788815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.369+0000 7f7885d9b700 1 -- 172.21.15.12:0/960280822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7880009a20 con 0x7f7888153a00 2023-10-08T16:25:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f7885d9b700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f788815b0a0 tx=0x7f787c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011b10 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c0253f0 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0257b0 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c009420 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.370+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7888157e90 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.371+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78881583b0 con 0x7f7888153a00 2023-10-08T16:25:18.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.372+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f787c025be0 con 0x7f7888153a00 2023-10-08T16:25:18.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.373+0000 7f78767fc700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 0x7f7868069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.373+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f787c085e10 con 0x7f7888153a00 2023-10-08T16:25:18.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.373+0000 7f788659c700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 msgr2=0x7f7868069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:18.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.373+0000 7f788659c700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 0x7f7868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:18.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.377+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78881583b0 con 0x7f7888153a00 2023-10-08T16:25:18.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.574+0000 7f788659c700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 msgr2=0x7f7868069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:18.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.574+0000 7f788659c700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 0x7f7868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.581+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f78881583b0 con 0x7f7888153a00 2023-10-08T16:25:18.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.587+0000 7f78767fc700 1 -- 172.21.15.12:0/960280822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f78881583b0 con 0x7f7888153a00 2023-10-08T16:25:18.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 msgr2=0x7f7868069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:18.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 0x7f7868069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 msgr2=0x7f78881519c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f788815b0a0 tx=0x7f787c017000 comp rx=0 tx=0).stop 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 shutdown_connections 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7868066f80 0x7f7868069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7888153dd0 0x7f7888151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78880cea00 0x7f788815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.589+0000 7f788759e700 1 --2- 172.21.15.12:0/960280822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7888153a00 0x7f78881519c0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.590+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 >> 172.21.15.12:0/960280822 conn(0x7f78880703a0 msgr2=0x7f78880b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.590+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 shutdown_connections 2023-10-08T16:25:18.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.590+0000 7f788759e700 1 -- 172.21.15.12:0/960280822 wait complete. 2023-10-08T16:25:18.609 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.803+0000 7f52d0f9d700 1 Processor -- start 2023-10-08T16:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.803+0000 7f52d0f9d700 1 -- start start 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52d0f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc06db20 0x7f52cc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52d0f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52cc0caec0 0x7f52cc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52d0f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc15ada0 con 0x7f52cc153c90 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52d0f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc06ca80 con 0x7f52cc0caec0 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52d0f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc06cd60 con 0x7f52cc06db20 2023-10-08T16:25:18.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52cbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52cc0caec0 0x7f52cc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52cb7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f52cc153c90 0x7f52cc0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:41816/0 (socket says 172.21.15.12:41816) 2023-10-08T16:25:18.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52cb7fe700 1 -- 172.21.15.12:0/512893973 learned_addr learned my addr 172.21.15.12:0/512893973 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:18.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.805+0000 7f52caffd700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc06db20 0x7f52cc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52ca7fc700 1 -- 172.21.15.12:0/512893973 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709117374 0 0) 0x7f52bc001110 con 0x7f52cc153c90 2023-10-08T16:25:18.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52ca7fc700 1 -- 172.21.15.12:0/512893973 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52b4003570 con 0x7f52cc153c90 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52cbfff700 1 -- 172.21.15.12:0/512893973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc06db20 msgr2=0x7f52cc15a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52cbfff700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc06db20 0x7f52cc15a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52cbfff700 1 -- 172.21.15.12:0/512893973 >> v1:172.21.15.29:6789/0 conn(0x7f52cc153c90 legacy=0x7f52cc0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52cbfff700 1 -- 172.21.15.12:0/512893973 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc06d040 con 0x7f52cc0caec0 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52cbfff700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc0caec0 0x7f52cc15afb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009e60 tx=0x7f52c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca564eab27379e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52ca7fc700 1 -- 172.21.15.12:0/512893973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400e070 con 0x7f52cc0caec0 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.806+0000 7f52ca7fc700 1 -- 172.21.15.12:0/512893973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c400bab0 con 0x7f52cc0caec0 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52ca7fc700 1 -- 172.21.15.12:0/512893973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400be70 con 0x7f52cc0caec0 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 -- 172.21.15.12:0/512893973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc0caec0 msgr2=0x7f52cc15afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc0caec0 0x7f52cc15afb0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009e60 tx=0x7f52c4009780 comp rx=0 tx=0).stop 2023-10-08T16:25:18.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 -- 172.21.15.12:0/512893973 shutdown_connections 2023-10-08T16:25:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc0caec0 0x7f52cc15afb0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/512893973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc06db20 0x7f52cc15a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 -- 172.21.15.12:0/512893973 >> 172.21.15.12:0/512893973 conn(0x7f52cc06e720 msgr2=0x7f52cc06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 -- 172.21.15.12:0/512893973 shutdown_connections 2023-10-08T16:25:18.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.807+0000 7f52d0f9d700 1 -- 172.21.15.12:0/512893973 wait complete. 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.809+0000 7f52d0f9d700 1 Processor -- start 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.809+0000 7f52d0f9d700 1 -- start start 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc0caec0 0x7f52cc15ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 0x7f52cc14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0b0430 con 0x7f52cc153c90 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0af890 con 0x7f52cc06db20 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52d0f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0afb00 con 0x7f52cc0caec0 2023-10-08T16:25:18.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 0x7f52cc14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38090/0 (socket says 172.21.15.12:38090) 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 -- 172.21.15.12:0/3025583547 learned_addr learned my addr 172.21.15.12:0/3025583547 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52caffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc0caec0 0x7f52cc15ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc0caec0 msgr2=0x7f52cc15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc0caec0 0x7f52cc15ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 msgr2=0x7f52cc14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 0x7f52cc14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cb7fe700 1 -- 172.21.15.12:0/3025583547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009a20 con 0x7f52cc06db20 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.810+0000 7f52cbfff700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 0x7f52cc14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52cb7fe700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c7c0 tx=0x7f52bc007c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:18.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc005c00 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc005d60 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc007320 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc0afde0 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.811+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc15e230 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.812+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc04c3c0 con 0x7f52cc06db20 2023-10-08T16:25:18.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.813+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f52bc01b3b0 con 0x7f52cc06db20 2023-10-08T16:25:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.814+0000 7f52b37fe700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 0x7f52b8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.814+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f52bc083bc0 con 0x7f52cc06db20 2023-10-08T16:25:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.814+0000 7f52caffd700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 msgr2=0x7f52b8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:18.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.814+0000 7f52caffd700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 0x7f52b8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:18.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:18.819+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52bc050c00 con 0x7f52cc06db20 2023-10-08T16:25:19.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.015+0000 7f52caffd700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 msgr2=0x7f52b8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:19.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.015+0000 7f52caffd700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 0x7f52b8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:19.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.025+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f52cc15ada0 con 0x7f52cc06db20 2023-10-08T16:25:19.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.032+0000 7f52b37fe700 1 -- 172.21.15.12:0/3025583547 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f52cc15ada0 con 0x7f52cc06db20 2023-10-08T16:25:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 msgr2=0x7f52b8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 0x7f52b8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 msgr2=0x7f52cc0c3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c7c0 tx=0x7f52bc007c70 comp rx=0 tx=0).stop 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 shutdown_connections 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52b8066f80 0x7f52b8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52cc153c90 0x7f52cc14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52cc06db20 0x7f52cc0c3f40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 --2- 172.21.15.12:0/3025583547 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52cc0caec0 0x7f52cc15ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 >> 172.21.15.12:0/3025583547 conn(0x7f52cc06e720 msgr2=0x7f52cc06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 shutdown_connections 2023-10-08T16:25:19.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.034+0000 7f52d0f9d700 1 -- 172.21.15.12:0/3025583547 wait complete. 2023-10-08T16:25:19.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-08T16:25:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.250+0000 7f28cdf9d700 1 Processor -- start 2023-10-08T16:25:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.250+0000 7f28cdf9d700 1 -- start start 2023-10-08T16:25:19.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.251+0000 7f28cdf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b24f0 0x7f28c80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.251+0000 7f28cdf9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f28c80b1d40 0x7f28c81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.251+0000 7f28cdf9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c80b0c80 con 0x7f28c80b28c0 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.251+0000 7f28cdf9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c80d10d0 con 0x7f28c80b1d40 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.251+0000 7f28cdf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80b0f60 con 0x7f28c80b24f0 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28cd79c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28c80b28c0 0x7f28c815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:55258/0 (socket says 172.21.15.12:55258) 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28cd79c700 1 -- 172.21.15.12:0/3961429536 learned_addr learned my addr 172.21.15.12:0/3961429536 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b24f0 0x7f28c80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:19.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c7fff700 1 --2- 172.21.15.12:0/3961429536 >> v2:172.21.15.29:3300/0 conn(0x7f28c80b1d40 0x7f28c81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c77fe700 1 -- 172.21.15.12:0/3961429536 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3031012906 0 0) 0x7f28c80b0c80 con 0x7f28c80b28c0 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c77fe700 1 -- 172.21.15.12:0/3961429536 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28b8003570 con 0x7f28c80b28c0 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c7fff700 1 -- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b24f0 msgr2=0x7f28c80b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c7fff700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b24f0 0x7f28c80b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c7fff700 1 -- 172.21.15.12:0/3961429536 >> v1:172.21.15.12:6789/0 conn(0x7f28c80b28c0 legacy=0x7f28c815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.252+0000 7f28c7fff700 1 -- 172.21.15.12:0/3961429536 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c80b1240 con 0x7f28c80b1d40 2023-10-08T16:25:19.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28c7fff700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b1d40 0x7f28c81590f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f28b40098e0 tx=0x7f28b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74ffd6edbcf1ab0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28c77fe700 1 -- 172.21.15.12:0/3961429536 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4011630 con 0x7f28c80b1d40 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28c77fe700 1 -- 172.21.15.12:0/3961429536 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4011790 con 0x7f28c80b1d40 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28c77fe700 1 -- 172.21.15.12:0/3961429536 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4011b30 con 0x7f28c80b1d40 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28cdf9d700 1 -- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b1d40 msgr2=0x7f28c81590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.253+0000 7f28cdf9d700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b1d40 0x7f28c81590f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f28b40098e0 tx=0x7f28b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 -- 172.21.15.12:0/3961429536 shutdown_connections 2023-10-08T16:25:19.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b24f0 0x7f28c80b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 --2- 172.21.15.12:0/3961429536 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b1d40 0x7f28c81590f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 -- 172.21.15.12:0/3961429536 >> 172.21.15.12:0/3961429536 conn(0x7f28c80703a0 msgr2=0x7f28c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 -- 172.21.15.12:0/3961429536 shutdown_connections 2023-10-08T16:25:19.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.254+0000 7f28cdf9d700 1 -- 172.21.15.12:0/3961429536 wait complete. 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.255+0000 7f28cdf9d700 1 Processor -- start 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.255+0000 7f28cdf9d700 1 -- start start 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b1d40 0x7f28c81541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80b24f0 0x7f28c8169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b28c0 0x7f28c80c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c80c6340 con 0x7f28c80b24f0 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815bfd0 con 0x7f28c80b28c0 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28cdf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c815c2b0 con 0x7f28c80b1d40 2023-10-08T16:25:19.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.256+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80b24f0 0x7f28c8169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80b24f0 0x7f28c8169cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55496/0 (socket says 172.21.15.12:55496) 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 -- 172.21.15.12:0/1268180236 learned_addr learned my addr 172.21.15.12:0/1268180236 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b1d40 0x7f28c81541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28cd79c700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b28c0 0x7f28c80c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b1d40 msgr2=0x7f28c81541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28c80b1d40 0x7f28c81541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b28c0 msgr2=0x7f28c80c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28c80b28c0 0x7f28c80c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4009420 con 0x7f28c80b24f0 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c7fff700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28c80b24f0 0x7f28c8169cc0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f28c8089370 tx=0x7f28b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:19.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.257+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4011900 con 0x7f28c80b24f0 2023-10-08T16:25:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.258+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4011a60 con 0x7f28c80b24f0 2023-10-08T16:25:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.258+0000 7f28cdf9d700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c815c590 con 0x7f28c80b24f0 2023-10-08T16:25:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.258+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b4025640 con 0x7f28c80b24f0 2023-10-08T16:25:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.258+0000 7f28cdf9d700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c816a200 con 0x7f28c80b24f0 2023-10-08T16:25:19.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.259+0000 7f28cdf9d700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c815cab0 con 0x7f28c80b24f0 2023-10-08T16:25:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.260+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 37) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f28b4025a30 con 0x7f28c80b24f0 2023-10-08T16:25:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.261+0000 7f28c4ff9700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.261+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f28b4085eb0 con 0x7f28c80b24f0 2023-10-08T16:25:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.261+0000 7f28ccf9b700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:19.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.261+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:19.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.265+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28c815cab0 con 0x7f28c80b24f0 2023-10-08T16:25:19.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.462+0000 7f28ccf9b700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:19.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.462+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:19.477 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:19.476+0000 7f9ffa320180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:25:19.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.494+0000 7f28cdf9d700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c816a4b0 con 0x7f28ac066f80 2023-10-08T16:25:19.500 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:19.499+0000 7ffa2c355180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:25:19.647 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:19.646+0000 7f9ffa320180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:19.670 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:19.669+0000 7ffa2c355180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:19.735 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:19.733+0000 7f9ffa320180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:25:19.759 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:19.758+0000 7ffa2c355180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:25:19.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.863+0000 7f28ccf9b700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:19.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:19.863+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:25:19.965 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:19.964+0000 7f9ffa320180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:19.990 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:19.989+0000 7ffa2c355180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:20.149 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:20.148+0000 7f9ffa320180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:25:20.174 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:20.174+0000 7ffa2c355180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:25:20.248 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:20.247+0000 7f9ffa320180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:25:20.272 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:20.272+0000 7ffa2c355180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:25:20.414 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:20.413+0000 7f9ffa320180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:25:20.438 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:20.438+0000 7ffa2c355180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:25:20.518 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:20.517+0000 7f9ffa320180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:20.543 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:20.542+0000 7ffa2c355180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:20.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:20.664+0000 7f28ccf9b700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:20.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:20.664+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:25:21.017 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:21.016+0000 7f9ffa320180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:25:21.045 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:21.044+0000 7ffa2c355180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:25:21.114 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:21.113+0000 7f9ffa320180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:25:21.144 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:21.143+0000 7ffa2c355180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:25:21.210 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:21.209+0000 7f9ffa320180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:25:21.238 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:21.237+0000 7ffa2c355180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:25:21.854 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:21.853+0000 7f9ffa320180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:25:21.885 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:21.884+0000 7ffa2c355180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:25:22.032 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:22.031+0000 7f9ffa320180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:22.064 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:22.063+0000 7ffa2c355180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:22.131 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:22.130+0000 7f9ffa320180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:25:22.164 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:22.163+0000 7ffa2c355180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:25:22.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:22.265+0000 7f28ccf9b700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:22.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:22.265+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:25:22.431 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:22.430+0000 7f9ffa320180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:25:22.465 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:22.464+0000 7ffa2c355180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:25:22.531 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:22.530+0000 7f9ffa320180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:25:22.563 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:22.563+0000 7ffa2c355180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:25:23.264 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:23.263+0000 7f9ffa320180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:25:23.299 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:23.298+0000 7ffa2c355180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:25:23.554 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:23.553+0000 7f9ffa320180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:25:23.590 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:23.590+0000 7ffa2c355180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:25:23.650 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:23.649+0000 7f9ffa320180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:25:23.687 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:23.686+0000 7ffa2c355180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:25:23.810 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:23.809+0000 7f9ffa320180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:25:23.847 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:23.847+0000 7ffa2c355180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:25:23.918 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:23.917+0000 7f9ffa320180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:25:23.957 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:23.956+0000 7ffa2c355180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:25:24.113 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:24.112+0000 7f9ffa320180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:25:24.153 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.152+0000 7ffa2c355180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:25:24.208 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:24.207+0000 7f9ffa320180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:25:24.249 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.248+0000 7ffa2c355180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:25:24.302 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:24.301+0000 7f9ffa320180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:25:24.343 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.343+0000 7ffa2c355180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:25:24.398 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:24.397+0000 7f9ffa320180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:25:24.441 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.440+0000 7ffa2c355180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:25:24.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:24.453+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 38) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f28b40532c0 con 0x7f28c80b24f0 2023-10-08T16:25:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:24.453+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 msgr2=0x7f28ac069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:24.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:24.453+0000 7f28c4ff9700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:24.572 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff9a0e76700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff9a0e76700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff9a0e76700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff9a0e76700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff9a0e76700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff99e671700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff99e671700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff99e671700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff99e671700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:24.573 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:24.571+0000 7ff99e671700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.473+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 39) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f28b402e3f0 con 0x7f28c80b24f0 2023-10-08T16:25:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.473+0000 7f28c4ff9700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.473+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f28c816a4b0 con 0x7f28ac066f80 2023-10-08T16:25:25.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.474+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.477+0000 7f28ccf9b700 1 --2- 172.21.15.12:0/1268180236 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28ac066f80 0x7f28ac0693b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f28bc009810 tx=0x7f28bc0091a0 comp rx=0 tx=0).ready entity=mgr.6978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:25.488 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:25.487+0000 7ff9a8685700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-08T16:25:25.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.487+0000 7f28c4ff9700 1 -- 172.21.15.12:0/1268180236 <== mgr.6978 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f28c816a4b0 con 0x7f28ac066f80 2023-10-08T16:25:25.490 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-08T16:25:25.498 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-08T16:25:25.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:25:25.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.691+0000 7f04a0d9d700 1 Processor -- start 2023-10-08T16:25:25.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.692+0000 7f04a0d9d700 1 -- start start 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f04a0d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f049c0c7fb0 0x7f049c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f04a0d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c06b290 con 0x7f049c0c7be0 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f04a0d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f049c06b570 con 0x7f049c13f780 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f04a0d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f049c06bf10 con 0x7f049c0c7fb0 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f049affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f049c0c7fb0 0x7f049c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f049b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f049c0c7be0 0x7f049c15a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60004/0 (socket says 172.21.15.12:60004) 2023-10-08T16:25:25.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.693+0000 7f049b7fe700 1 -- 172.21.15.12:0/4221308377 learned_addr learned my addr 172.21.15.12:0/4221308377 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049affd700 1 -- 172.21.15.12:0/4221308377 >> v1:172.21.15.29:6789/0 conn(0x7f049c13f780 legacy=0x7f049c13fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049affd700 1 -- 172.21.15.12:0/4221308377 >> v1:172.21.15.12:6789/0 conn(0x7f049c0c7be0 legacy=0x7f049c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049affd700 1 -- 172.21.15.12:0/4221308377 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c06b850 con 0x7f049c0c7fb0 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049affd700 1 --2- 172.21.15.12:0/4221308377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c06abd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f04900098e0 tx=0x7f04900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f2150d70c3142f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049a7fc700 1 -- 172.21.15.12:0/4221308377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490009e80 con 0x7f049c0c7fb0 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049a7fc700 1 -- 172.21.15.12:0/4221308377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049000b820 con 0x7f049c0c7fb0 2023-10-08T16:25:25.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.694+0000 7f049a7fc700 1 -- 172.21.15.12:0/4221308377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000bba0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 -- 172.21.15.12:0/4221308377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 msgr2=0x7f049c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/4221308377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c06abd0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f04900098e0 tx=0x7f04900091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 -- 172.21.15.12:0/4221308377 shutdown_connections 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/4221308377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c06abd0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 -- 172.21.15.12:0/4221308377 >> 172.21.15.12:0/4221308377 conn(0x7f049c06d110 msgr2=0x7f049c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 -- 172.21.15.12:0/4221308377 shutdown_connections 2023-10-08T16:25:25.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.695+0000 7f04a0d9d700 1 -- 172.21.15.12:0/4221308377 wait complete. 2023-10-08T16:25:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.696+0000 7f04a0d9d700 1 Processor -- start 2023-10-08T16:25:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.696+0000 7f04a0d9d700 1 -- start start 2023-10-08T16:25:25.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 0x7f049c0c22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 0x7f049c169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0aa0a0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f049c0b1ae0 con 0x7f049c0c7be0 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.697+0000 7f04a0d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f049c16b300 con 0x7f049c13f780 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54954/0 (socket says 172.21.15.12:54954) 2023-10-08T16:25:25.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 -- 172.21.15.12:0/473335298 learned_addr learned my addr 172.21.15.12:0/473335298 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049b7fe700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 0x7f049c0c22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 -- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 msgr2=0x7f049c169e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049bfff700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 0x7f049c169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 0x7f049c169e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 -- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 msgr2=0x7f049c0c22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 0x7f049c0c22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 -- 172.21.15.12:0/473335298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009420 con 0x7f049c0c7fb0 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049b7fe700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 0x7f049c0c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:25.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049bfff700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 0x7f049c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.698+0000 7f049affd700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f04900030c0 tx=0x7f0490016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.699+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049000bae0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.699+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490020070 con 0x7f049c0c7fb0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.699+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049001b6a0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.699+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f049c0a9dc0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.699+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f049c16af90 con 0x7f049c0c7fb0 2023-10-08T16:25:25.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.700+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049c16ab10 con 0x7f049c0c7fb0 2023-10-08T16:25:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.701+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 39) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f0490022030 con 0x7f049c0c7fb0 2023-10-08T16:25:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.702+0000 7f04837fe700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.702+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f04900864f0 con 0x7f049c0c7fb0 2023-10-08T16:25:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.702+0000 7f049b7fe700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:25.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.702+0000 7f049b7fe700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f048c001820 tx=0x7f048c009040 comp rx=0 tx=0).ready entity=mgr.6978 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:25.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.706+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f049c16ab10 con 0x7f049c0c7fb0 2023-10-08T16:25:25.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:25.966+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f049c16ab10 con 0x7f049c0c7fb0 2023-10-08T16:25:26.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.480+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0490053b50 con 0x7f049c0c7fb0 2023-10-08T16:25:26.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.483+0000 7f04837fe700 1 -- 172.21.15.12:0/473335298 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v40) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0490056da0 con 0x7f049c0c7fb0 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 msgr2=0x7f0488069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f048c001820 tx=0x7f048c009040 comp rx=0 tx=0).stop 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 msgr2=0x7f049c0c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f04900030c0 tx=0x7f0490016000 comp rx=0 tx=0).stop 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 shutdown_connections 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f049c13f780 0x7f049c169e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:26.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f049c0c7be0 0x7f049c0c22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 --2- 172.21.15.12:0/473335298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f049c0c7fb0 0x7f049c0c2830 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 >> 172.21.15.12:0/473335298 conn(0x7f049c06d110 msgr2=0x7f049c0c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 shutdown_connections 2023-10-08T16:25:26.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:26.486+0000 7f04a0d9d700 1 -- 172.21.15.12:0/473335298 wait complete. 2023-10-08T16:25:26.507 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:25:26.507 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:25:26.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:25:26.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:25:26.676 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:25:26.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:25:26.676 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:26.765 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:25:26.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:26.765 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:25:26.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:27.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.034+0000 7fe36f59e700 1 Processor -- start 2023-10-08T16:25:27.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.034+0000 7fe36f59e700 1 -- start start 2023-10-08T16:25:27.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe37013fb20 0x7fe37015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe37006aaa0 0x7fe3700c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37015ae70 con 0x7fe37013fef0 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37006af60 con 0x7fe37013fb20 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37006b240 con 0x7fe37006aaa0 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.035+0000 7fe36e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe37013fb20 0x7fe37015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe37013fb20 0x7fe37015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54970/0 (socket says 172.21.15.12:54970) 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 -- 172.21.15.12:0/607414377 learned_addr learned my addr 172.21.15.12:0/607414377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:27.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36ed9d700 1 --2- 172.21.15.12:0/607414377 >> v2:172.21.15.29:3300/0 conn(0x7fe37006aaa0 0x7fe3700c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 -- 172.21.15.12:0/607414377 >> v2:172.21.15.29:3300/0 conn(0x7fe37006aaa0 msgr2=0x7fe3700c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 --2- 172.21.15.12:0/607414377 >> v2:172.21.15.29:3300/0 conn(0x7fe37006aaa0 0x7fe3700c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 -- 172.21.15.12:0/607414377 >> v1:172.21.15.12:6789/0 conn(0x7fe37013fef0 legacy=0x7fe3700c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 -- 172.21.15.12:0/607414377 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37006b520 con 0x7fe37013fb20 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36d59a700 1 -- 172.21.15.12:0/607414377 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3933974157 0 0) 0x7fe364001180 con 0x7fe37013fef0 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.036+0000 7fe36e59c700 1 --2- 172.21.15.12:0/607414377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fb20 0x7fe37015a930 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe370069d40 tx=0x7fe360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2336409170b98454 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.037+0000 7fe36d59a700 1 -- 172.21.15.12:0/607414377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe360009e70 con 0x7fe37013fb20 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.037+0000 7fe36d59a700 1 -- 172.21.15.12:0/607414377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36000b860 con 0x7fe37013fb20 2023-10-08T16:25:27.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.037+0000 7fe36d59a700 1 -- 172.21.15.12:0/607414377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36000bc00 con 0x7fe37013fb20 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.037+0000 7fe36f59e700 1 -- 172.21.15.12:0/607414377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fb20 msgr2=0x7fe37015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.037+0000 7fe36f59e700 1 --2- 172.21.15.12:0/607414377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fb20 0x7fe37015a930 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fe370069d40 tx=0x7fe360009250 comp rx=0 tx=0).stop 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 -- 172.21.15.12:0/607414377 shutdown_connections 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 --2- 172.21.15.12:0/607414377 >> v2:172.21.15.29:3300/0 conn(0x7fe37006aaa0 0x7fe3700c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 --2- 172.21.15.12:0/607414377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fb20 0x7fe37015a930 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 -- 172.21.15.12:0/607414377 >> 172.21.15.12:0/607414377 conn(0x7fe37006d170 msgr2=0x7fe3700cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 -- 172.21.15.12:0/607414377 shutdown_connections 2023-10-08T16:25:27.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.038+0000 7fe36f59e700 1 -- 172.21.15.12:0/607414377 wait complete. 2023-10-08T16:25:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.039+0000 7fe36f59e700 1 Processor -- start 2023-10-08T16:25:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.039+0000 7fe36f59e700 1 -- start start 2023-10-08T16:25:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe37006aaa0 0x7fe37015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013fb20 0x7fe3700c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37015d9c0 con 0x7fe37013fef0 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37015de50 con 0x7fe37013fb20 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37015cad0 con 0x7fe37006aaa0 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.040+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54972/0 (socket says 172.21.15.12:54972) 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 -- 172.21.15.12:0/2707877613 learned_addr learned my addr 172.21.15.12:0/2707877613 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36e59c700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe37006aaa0 0x7fe37015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36dd9b700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013fb20 0x7fe3700c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe37006aaa0 msgr2=0x7fe37015ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe37006aaa0 0x7fe37015ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013fb20 msgr2=0x7fe3700c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013fb20 0x7fe3700c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 -- 172.21.15.12:0/2707877613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600094f0 con 0x7fe37013fef0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe36ed9d700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe368009ef0 tx=0x7fe36800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.041+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800cb70 con 0x7fe37013fef0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.042+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800f040 con 0x7fe37013fef0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.042+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368014480 con 0x7fe37013fef0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.042+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37015cdb0 con 0x7fe37013fef0 2023-10-08T16:25:27.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.042+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37015d370 con 0x7fe37013fef0 2023-10-08T16:25:27.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.043+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37015db70 con 0x7fe37013fef0 2023-10-08T16:25:27.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.045+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fe368014830 con 0x7fe37013fef0 2023-10-08T16:25:27.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.045+0000 7fe35e7fc700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 0x7fe350069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.045+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fe368085810 con 0x7fe37013fef0 2023-10-08T16:25:27.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.046+0000 7fe36e59c700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 msgr2=0x7fe350069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:27.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.046+0000 7fe36e59c700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 0x7fe350069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:27.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.050+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe37015db70 con 0x7fe37013fef0 2023-10-08T16:25:27.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.247+0000 7fe36e59c700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 msgr2=0x7fe350069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:27.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.247+0000 7fe36e59c700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 0x7fe350069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:27.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.302+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe37004c3c0 con 0x7fe37013fef0 2023-10-08T16:25:27.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.302+0000 7fe35e7fc700 1 -- 172.21.15.12:0/2707877613 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fe368052460 con 0x7fe37013fef0 2023-10-08T16:25:27.303 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:27.303 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:27.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 msgr2=0x7fe350069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:27.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 0x7fe350069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 msgr2=0x7fe370155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fe368009ef0 tx=0x7fe36800b040 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 shutdown_connections 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe3500670e0 0x7fe350069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.304+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013fef0 0x7fe370155a30 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.305+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe37006aaa0 0x7fe37015ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.305+0000 7fe36f59e700 1 --2- 172.21.15.12:0/2707877613 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013fb20 0x7fe3700c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.305+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 >> 172.21.15.12:0/2707877613 conn(0x7fe37006d170 msgr2=0x7fe37013dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.305+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 shutdown_connections 2023-10-08T16:25:27.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.305+0000 7fe36f59e700 1 -- 172.21.15.12:0/2707877613 wait complete. 2023-10-08T16:25:27.307 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:27.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.518+0000 7fbc2ffff700 1 Processor -- start 2023-10-08T16:25:27.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.518+0000 7fbc2ffff700 1 -- start start 2023-10-08T16:25:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.519+0000 7fbc2ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 0x7fbc3015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.519+0000 7fbc2ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc300cf110 0x7fbc3015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.519+0000 7fbc2ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3015afd0 con 0x7fbc3015de50 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.519+0000 7fbc2ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3015b2b0 con 0x7fbc300cf110 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.519+0000 7fbc2ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3015b590 con 0x7fbc30153c30 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc300cf110 0x7fbc3015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc300cf110 0x7fbc3015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54980/0 (socket says 172.21.15.12:54980) 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 -- 172.21.15.12:0/3841156908 learned_addr learned my addr 172.21.15.12:0/3841156908 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:27.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2effd700 1 --2- 172.21.15.12:0/3841156908 >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 0x7fbc3015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 -- 172.21.15.12:0/3841156908 >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 msgr2=0x7fbc3015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 --2- 172.21.15.12:0/3841156908 >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 0x7fbc3015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 -- 172.21.15.12:0/3841156908 >> v1:172.21.15.29:6789/0 conn(0x7fbc3015de50 legacy=0x7fbc300cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 -- 172.21.15.12:0/3841156908 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3015b870 con 0x7fbc300cf110 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2effd700 1 --2- 172.21.15.12:0/3841156908 >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 0x7fbc3015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.520+0000 7fbc2f7fe700 1 --2- 172.21.15.12:0/3841156908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc300cf110 0x7fbc3015c070 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006ead0 tx=0x7fbc28009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f19e79c3f3bdb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2dffb700 1 -- 172.21.15.12:0/3841156908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2800e070 con 0x7fbc300cf110 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2dffb700 1 -- 172.21.15.12:0/3841156908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2800ba50 con 0x7fbc300cf110 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2dffb700 1 -- 172.21.15.12:0/3841156908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc280092e0 con 0x7fbc300cf110 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 -- 172.21.15.12:0/3841156908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc300cf110 msgr2=0x7fbc3015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/3841156908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc300cf110 0x7fbc3015c070 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fbc3006ead0 tx=0x7fbc28009840 comp rx=0 tx=0).stop 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 -- 172.21.15.12:0/3841156908 shutdown_connections 2023-10-08T16:25:27.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/3841156908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc300cf110 0x7fbc3015c070 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/3841156908 >> v2:172.21.15.29:3300/0 conn(0x7fbc30153c30 0x7fbc3015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 -- 172.21.15.12:0/3841156908 >> 172.21.15.12:0/3841156908 conn(0x7fbc300703a0 msgr2=0x7fbc300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 -- 172.21.15.12:0/3841156908 shutdown_connections 2023-10-08T16:25:27.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.521+0000 7fbc2ffff700 1 -- 172.21.15.12:0/3841156908 wait complete. 2023-10-08T16:25:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.523+0000 7fbc2ffff700 1 Processor -- start 2023-10-08T16:25:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.523+0000 7fbc2ffff700 1 -- start start 2023-10-08T16:25:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc300cf110 0x7fbc30151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc3015de50 0x7fbc300b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300b4e40 con 0x7fbc30153c30 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300b3f50 con 0x7fbc300cf110 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300b4230 con 0x7fbc3015de50 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc3015de50 0x7fbc300b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54988/0 (socket says 172.21.15.12:54988) 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2e7fc700 1 -- 172.21.15.12:0/2203694103 learned_addr learned my addr 172.21.15.12:0/2203694103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.524+0000 7fbc2effd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc300cf110 0x7fbc30151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc3015de50 msgr2=0x7fbc300b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc3015de50 0x7fbc300b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc300cf110 msgr2=0x7fbc30151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc300cf110 0x7fbc30151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 -- 172.21.15.12:0/2203694103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28009ae0 con 0x7fbc30153c30 2023-10-08T16:25:27.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2e7fc700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c590 tx=0x7fbc24007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24011590 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc24011730 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc300b4510 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24011af0 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.525+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300b4ad0 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.526+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300b4fb0 con 0x7fbc30153c30 2023-10-08T16:25:27.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.527+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fbc24012420 con 0x7fbc30153c30 2023-10-08T16:25:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.528+0000 7fbc16ffd700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 0x7fbc1c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.528+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fbc24083cb0 con 0x7fbc30153c30 2023-10-08T16:25:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.528+0000 7fbc2effd700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 msgr2=0x7fbc1c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:27.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.528+0000 7fbc2effd700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 0x7fbc1c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:27.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.532+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc2404b5a0 con 0x7fbc30153c30 2023-10-08T16:25:27.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.729+0000 7fbc2effd700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 msgr2=0x7fbc1c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:27.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.729+0000 7fbc2effd700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 0x7fbc1c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:27.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.738+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc3004c3c0 con 0x7fbc30153c30 2023-10-08T16:25:27.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.739+0000 7fbc16ffd700 1 -- 172.21.15.12:0/2203694103 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16366 (secure 0 0 0) 0x7fbc24017070 con 0x7fbc30153c30 2023-10-08T16:25:27.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:27.740 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:24.443211+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:6836/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/1978126982":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3725668702":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3786028739":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3804927267":"2023-10-09T16:25:24.443180+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.741+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 msgr2=0x7fbc1c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 0x7fbc1c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 msgr2=0x7fbc300b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fbc2400c590 tx=0x7fbc24007f30 comp rx=0 tx=0).stop 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 shutdown_connections 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc1c0670e0 0x7fbc1c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc3015de50 0x7fbc300b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc300cf110 0x7fbc30151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 --2- 172.21.15.12:0/2203694103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc30153c30 0x7fbc300b12e0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 >> 172.21.15.12:0/2203694103 conn(0x7fbc300703a0 msgr2=0x7fbc300c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 shutdown_connections 2023-10-08T16:25:27.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.742+0000 7fbc2ffff700 1 -- 172.21.15.12:0/2203694103 wait complete. 2023-10-08T16:25:27.761 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:25:01.400029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:25:02.625461+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:25:27.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:25:27.820 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:27.819+0000 7f31cc56d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:25:27.858 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:27.857+0000 7fcc56b16180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:25:27.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.957+0000 7f1c1c99d700 1 Processor -- start 2023-10-08T16:25:27.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.957+0000 7f1c1c99d700 1 -- start start 2023-10-08T16:25:27.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c1c99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c18153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c1c99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1c180cea00 0x7f1c180cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c1c99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1815ac50 con 0x7f1c1815de50 2023-10-08T16:25:27.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c1c99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1815d010 con 0x7f1c180cea00 2023-10-08T16:25:27.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c1c99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1815af60 con 0x7f1c18153a00 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c177fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c18153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c16ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1c1815de50 0x7f1c1815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60034/0 (socket says 172.21.15.12:60034) 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c16ffd700 1 -- 172.21.15.12:0/4145334101 learned_addr learned my addr 172.21.15.12:0/4145334101 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c17fff700 1 --2- 172.21.15.12:0/4145334101 >> v2:172.21.15.29:3300/0 conn(0x7f1c180cea00 0x7f1c180cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c167fc700 1 -- 172.21.15.12:0/4145334101 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861195547 0 0) 0x7f1c1815ac50 con 0x7f1c1815de50 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c177fe700 1 -- 172.21.15.12:0/4145334101 >> v2:172.21.15.29:3300/0 conn(0x7f1c180cea00 msgr2=0x7f1c180cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c177fe700 1 --2- 172.21.15.12:0/4145334101 >> v2:172.21.15.29:3300/0 conn(0x7f1c180cea00 0x7f1c180cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c177fe700 1 -- 172.21.15.12:0/4145334101 >> v1:172.21.15.12:6789/0 conn(0x7f1c1815de50 legacy=0x7f1c1815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.959+0000 7f1c177fe700 1 -- 172.21.15.12:0/4145334101 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1815b240 con 0x7f1c18153a00 2023-10-08T16:25:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.960+0000 7f1c177fe700 1 --2- 172.21.15.12:0/4145334101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c18153dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c080098e0 tx=0x7f1c080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23d9f242e3fb05b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.960+0000 7f1c167fc700 1 -- 172.21.15.12:0/4145334101 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800b640 con 0x7f1c18153a00 2023-10-08T16:25:27.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.960+0000 7f1c167fc700 1 -- 172.21.15.12:0/4145334101 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c0800b7a0 con 0x7f1c18153a00 2023-10-08T16:25:27.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.960+0000 7f1c167fc700 1 -- 172.21.15.12:0/4145334101 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0800bb40 con 0x7f1c18153a00 2023-10-08T16:25:27.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 -- 172.21.15.12:0/4145334101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 msgr2=0x7f1c18153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/4145334101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c18153dd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c080098e0 tx=0x7f1c080091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 -- 172.21.15.12:0/4145334101 shutdown_connections 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/4145334101 >> v2:172.21.15.29:3300/0 conn(0x7f1c180cea00 0x7f1c180cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/4145334101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c18153dd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 -- 172.21.15.12:0/4145334101 >> 172.21.15.12:0/4145334101 conn(0x7f1c180703a0 msgr2=0x7f1c180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 -- 172.21.15.12:0/4145334101 shutdown_connections 2023-10-08T16:25:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.961+0000 7f1c1c99d700 1 -- 172.21.15.12:0/4145334101 wait complete. 2023-10-08T16:25:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.962+0000 7f1c1c99d700 1 Processor -- start 2023-10-08T16:25:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.962+0000 7f1c1c99d700 1 -- start start 2023-10-08T16:25:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c180cea00 0x7f1c18157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c1816d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1816e0e0 con 0x7f1c1815de50 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1816db20 con 0x7f1c180cea00 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c1c99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1816de00 con 0x7f1c18153a00 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.963+0000 7f1c17fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54994/0 (socket says 172.21.15.12:54994) 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 -- 172.21.15.12:0/740615770 learned_addr learned my addr 172.21.15.12:0/740615770 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c177fe700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c180cea00 0x7f1c18157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c16ffd700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c1816d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:27.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 msgr2=0x7f1c1816d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c1816d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c180cea00 msgr2=0x7f1c18157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c180cea00 0x7f1c18157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 -- 172.21.15.12:0/740615770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c08009420 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1c17fff700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009e90 tx=0x7f1c1000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1000cb70 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1000f040 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.964+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10014480 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.965+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c180c8440 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.965+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c18157a90 con 0x7f1c1815de50 2023-10-08T16:25:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.966+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c180c82a0 con 0x7f1c1815de50 2023-10-08T16:25:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.967+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1c10014830 con 0x7f1c1815de50 2023-10-08T16:25:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.967+0000 7f1bff7fe700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 0x7f1c04069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.968+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1c10085940 con 0x7f1c1815de50 2023-10-08T16:25:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.968+0000 7f1c177fe700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 msgr2=0x7f1c04069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.968+0000 7f1c177fe700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 0x7f1c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:27.971+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c180c82a0 con 0x7f1c1815de50 2023-10-08T16:25:27.992 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:27.991+0000 7f31cc56d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:28.033 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.032+0000 7fcc56b16180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:28.081 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.080+0000 7f31cc56d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:25:28.123 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.122+0000 7fcc56b16180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:25:28.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.169+0000 7f1c177fe700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 msgr2=0x7f1c04069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:28.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.169+0000 7f1c177fe700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 0x7f1c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:28.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.174+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c180c82a0 con 0x7f1c1815de50 2023-10-08T16:25:28.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.174+0000 7f1bff7fe700 1 -- 172.21.15.12:0/740615770 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c180c82a0 con 0x7f1c1815de50 2023-10-08T16:25:28.175 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:25:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 msgr2=0x7f1c04069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 0x7f1c04069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 msgr2=0x7f1c1815c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f1c10009e90 tx=0x7f1c1000b040 comp rx=0 tx=0).stop 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 shutdown_connections 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1c040670e0 0x7f1c04069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c1815de50 0x7f1c1815c150 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c180cea00 0x7f1c18157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 --2- 172.21.15.12:0/740615770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c18153a00 0x7f1c1816d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.177+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 >> 172.21.15.12:0/740615770 conn(0x7f1c180703a0 msgr2=0x7f1c180c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.178+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 shutdown_connections 2023-10-08T16:25:28.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.178+0000 7f1c1c99d700 1 -- 172.21.15.12:0/740615770 wait complete. 2023-10-08T16:25:28.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:25:28.317 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.316+0000 7f31cc56d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:28.362 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.361+0000 7fcc56b16180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.392+0000 7f459539d700 1 Processor -- start 2023-10-08T16:25:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.392+0000 7f459539d700 1 -- start start 2023-10-08T16:25:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.393+0000 7f459539d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4590153dd0 0x7f459015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.393+0000 7f459539d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45900cea00 0x7f45900ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.393+0000 7f459539d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459015ac50 con 0x7f4590153a00 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.393+0000 7f459539d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459015d010 con 0x7f45900cea00 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.393+0000 7f459539d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45900cf3e0 con 0x7f4590153dd0 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45900cea00 0x7f45900ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f45900cea00 0x7f45900ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55006/0 (socket says 172.21.15.12:55006) 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 -- 172.21.15.12:0/3043179721 learned_addr learned my addr 172.21.15.12:0/3043179721 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f458ffff700 1 --1- 172.21.15.12:0/3043179721 >> v1:172.21.15.29:6789/0 conn(0x7f4590153a00 0x7f459015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:34194/0 (socket says 172.21.15.12:34194) 2023-10-08T16:25:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f458f7fe700 1 --2- 172.21.15.12:0/3043179721 >> v2:172.21.15.29:3300/0 conn(0x7f4590153dd0 0x7f459015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 -- 172.21.15.12:0/3043179721 >> v2:172.21.15.29:3300/0 conn(0x7f4590153dd0 msgr2=0x7f459015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 --2- 172.21.15.12:0/3043179721 >> v2:172.21.15.29:3300/0 conn(0x7f4590153dd0 0x7f459015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 -- 172.21.15.12:0/3043179721 >> v1:172.21.15.29:6789/0 conn(0x7f4590153a00 legacy=0x7f459015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.394+0000 7f4594b9c700 1 -- 172.21.15.12:0/3043179721 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459015af60 con 0x7f45900cea00 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f4594b9c700 1 --2- 172.21.15.12:0/3043179721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f45900ceea0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f45900b3070 tx=0x7f4588009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d23b54412158761 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f458effd700 1 -- 172.21.15.12:0/3043179721 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458800e070 con 0x7f45900cea00 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f458effd700 1 -- 172.21.15.12:0/3043179721 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800ba20 con 0x7f45900cea00 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f458effd700 1 -- 172.21.15.12:0/3043179721 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880092e0 con 0x7f45900cea00 2023-10-08T16:25:28.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f459539d700 1 -- 172.21.15.12:0/3043179721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 msgr2=0x7f45900ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.395+0000 7f459539d700 1 --2- 172.21.15.12:0/3043179721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f45900ceea0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f45900b3070 tx=0x7f4588009840 comp rx=0 tx=0).stop 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 -- 172.21.15.12:0/3043179721 shutdown_connections 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 --2- 172.21.15.12:0/3043179721 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f45900ceea0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 --2- 172.21.15.12:0/3043179721 >> v2:172.21.15.29:3300/0 conn(0x7f4590153dd0 0x7f459015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 -- 172.21.15.12:0/3043179721 >> 172.21.15.12:0/3043179721 conn(0x7f45900703a0 msgr2=0x7f45900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 -- 172.21.15.12:0/3043179721 shutdown_connections 2023-10-08T16:25:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.396+0000 7f459539d700 1 -- 172.21.15.12:0/3043179721 wait complete. 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.397+0000 7f459539d700 1 Processor -- start 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.397+0000 7f459539d700 1 -- start start 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4590153a00 0x7f45900c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4590153dd0 0x7f45900c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cbbe0 con 0x7f45900cea00 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cb2b0 con 0x7f4590153a00 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f459539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45900cb590 con 0x7f4590153dd0 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.398+0000 7f458ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55018/0 (socket says 172.21.15.12:55018) 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 -- 172.21.15.12:0/632131301 learned_addr learned my addr 172.21.15.12:0/632131301 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458f7fe700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4590153a00 0x7f45900c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f4594b9c700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4590153dd0 0x7f45900c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4590153dd0 msgr2=0x7f45900c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4590153dd0 0x7f45900c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4590153a00 msgr2=0x7f45900c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4590153a00 0x7f45900c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 -- 172.21.15.12:0/632131301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4588009ae0 con 0x7f45900cea00 2023-10-08T16:25:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f458ffff700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f458000c7c0 tx=0x7f4580007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4580005a70 con 0x7f45900cea00 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.399+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4580005bd0 con 0x7f45900cea00 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.400+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45900cb870 con 0x7f45900cea00 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.400+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45800070d0 con 0x7f45900cea00 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.400+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45900c9740 con 0x7f45900cea00 2023-10-08T16:25:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.401+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459004c3c0 con 0x7f45900cea00 2023-10-08T16:25:28.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.402+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4580007480 con 0x7f45900cea00 2023-10-08T16:25:28.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.403+0000 7f4577fff700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 0x7f457c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:28.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.403+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f4580083f90 con 0x7f45900cea00 2023-10-08T16:25:28.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.403+0000 7f458f7fe700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 msgr2=0x7f457c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:28.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.403+0000 7f458f7fe700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 0x7f457c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:28.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.407+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4580050c50 con 0x7f45900cea00 2023-10-08T16:25:28.503 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.502+0000 7f31cc56d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:25:28.843 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.550+0000 7fcc56b16180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:25:28.844 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.598+0000 7f31cc56d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:25:28.844 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.764+0000 7f31cc56d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:25:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.604+0000 7f458f7fe700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 msgr2=0x7f457c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.604+0000 7f458f7fe700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 0x7f457c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.607+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f459015b240 con 0x7f45900cea00 2023-10-08T16:25:28.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.608+0000 7f4577fff700 1 -- 172.21.15.12:0/632131301 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7f45800170a0 con 0x7f45900cea00 2023-10-08T16:25:28.845 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:25:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 msgr2=0x7f457c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 0x7f457c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 msgr2=0x7f459013e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f458000c7c0 tx=0x7f4580007f70 comp rx=0 tx=0).stop 2023-10-08T16:25:28.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 shutdown_connections 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f457c0670e0 0x7f457c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f45900cea00 0x7f459013e050 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4590153dd0 0x7f45900c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 --2- 172.21.15.12:0/632131301 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4590153a00 0x7f45900c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.610+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 >> 172.21.15.12:0/632131301 conn(0x7f45900703a0 msgr2=0x7f45900d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.611+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 shutdown_connections 2023-10-08T16:25:28.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:28.611+0000 7f459539d700 1 -- 172.21.15.12:0/632131301 wait complete. 2023-10-08T16:25:28.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:25:28.848 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.648+0000 7fcc56b16180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:25:28.848 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.816+0000 7fcc56b16180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:25:28.870 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:28.869+0000 7f31cc56d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:28.934 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:28.934+0000 7fcc56b16180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:25:29.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.050+0000 7ff18739d700 1 Processor -- start 2023-10-08T16:25:29.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.051+0000 7ff18739d700 1 -- start start 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff180159550 0x7ff1800ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff18015dfd0 0x7ff1800aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff180159920 0x7ff1800ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1800acc00 con 0x7ff180159550 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1800abff0 con 0x7ff180159920 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800ac2d0 con 0x7ff18015dfd0 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18639b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff180159550 0x7ff1800ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18639b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff180159550 0x7ff1800ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55030/0 (socket says 172.21.15.12:55030) 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.052+0000 7ff18639b700 1 -- 172.21.15.12:0/3912817362 learned_addr learned my addr 172.21.15.12:0/3912817362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff186b9c700 1 --2- 172.21.15.12:0/3912817362 >> v2:172.21.15.29:3300/0 conn(0x7ff180159920 0x7ff1800ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff185b9a700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff18015dfd0 0x7ff1800aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 -- 172.21.15.12:0/3912817362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff18015dfd0 msgr2=0x7ff1800aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff18015dfd0 0x7ff1800aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 -- 172.21.15.12:0/3912817362 >> v2:172.21.15.29:3300/0 conn(0x7ff180159920 msgr2=0x7ff1800ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 --2- 172.21.15.12:0/3912817362 >> v2:172.21.15.29:3300/0 conn(0x7ff180159920 0x7ff1800ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 -- 172.21.15.12:0/3912817362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1800ac5b0 con 0x7ff180159550 2023-10-08T16:25:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.053+0000 7ff18639b700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff180159550 0x7ff1800ceac0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff18006c180 tx=0x7ff17c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca17e480a511dac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff185399700 1 -- 172.21.15.12:0/3912817362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00b640 con 0x7ff180159550 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff185399700 1 -- 172.21.15.12:0/3912817362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00b7a0 con 0x7ff180159550 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff185399700 1 -- 172.21.15.12:0/3912817362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00bb60 con 0x7ff180159550 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 -- 172.21.15.12:0/3912817362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff180159550 msgr2=0x7ff1800ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff180159550 0x7ff1800ceac0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7ff18006c180 tx=0x7ff17c009250 comp rx=0 tx=0).stop 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 -- 172.21.15.12:0/3912817362 shutdown_connections 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 --2- 172.21.15.12:0/3912817362 >> v2:172.21.15.29:3300/0 conn(0x7ff180159920 0x7ff1800ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff180159550 0x7ff1800ceac0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 --2- 172.21.15.12:0/3912817362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff18015dfd0 0x7ff1800aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.054+0000 7ff18739d700 1 -- 172.21.15.12:0/3912817362 >> 172.21.15.12:0/3912817362 conn(0x7ff18006ce80 msgr2=0x7ff1800ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:29.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.055+0000 7ff18739d700 1 -- 172.21.15.12:0/3912817362 shutdown_connections 2023-10-08T16:25:29.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.055+0000 7ff18739d700 1 -- 172.21.15.12:0/3912817362 wait complete. 2023-10-08T16:25:29.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.056+0000 7ff18739d700 1 Processor -- start 2023-10-08T16:25:29.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.056+0000 7ff18739d700 1 -- start start 2023-10-08T16:25:29.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 0x7ff18009a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 0x7ff1800cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800cbce0 con 0x7ff18015dfd0 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1800ccab0 con 0x7ff180159550 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff180153b50 con 0x7ff180159920 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18639b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff186b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 0x7ff1800cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.057+0000 7ff18639b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:58732/0 (socket says 172.21.15.12:58732) 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 -- 172.21.15.12:0/365609369 learned_addr learned my addr 172.21.15.12:0/365609369 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff185b9a700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 0x7ff18009a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 msgr2=0x7ff18009a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 0x7ff18009a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 msgr2=0x7ff1800cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 0x7ff1800cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 -- 172.21.15.12:0/365609369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0094f0 con 0x7ff180159550 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff185b9a700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 0x7ff18009a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff186b9c700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 0x7ff1800cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.058+0000 7ff18639b700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff18006ad70 tx=0x7ff17c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.059+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c00b910 con 0x7ff180159550 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.059+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c00ba70 con 0x7ff180159550 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.059+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18009a650 con 0x7ff180159550 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.059+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c011630 con 0x7ff180159550 2023-10-08T16:25:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.059+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1800cba00 con 0x7ff180159550 2023-10-08T16:25:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.060+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18004c3c0 con 0x7ff180159550 2023-10-08T16:25:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.061+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ff17c0119a0 con 0x7ff180159550 2023-10-08T16:25:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.062+0000 7ff1767fc700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 0x7ff164069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.062+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7ff17c086630 con 0x7ff180159550 2023-10-08T16:25:29.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.062+0000 7ff185b9a700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 msgr2=0x7ff164069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:29.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.062+0000 7ff185b9a700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 0x7ff164069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:29.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.065+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff17c053370 con 0x7ff180159550 2023-10-08T16:25:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.263+0000 7ff185b9a700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 msgr2=0x7ff164069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:29.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.263+0000 7ff185b9a700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 0x7ff164069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:29.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.269+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff18006e7c0 con 0x7ff180159550 2023-10-08T16:25:29.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.270+0000 7ff1767fc700 1 -- 172.21.15.12:0/365609369 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff17c056990 con 0x7ff180159550 2023-10-08T16:25:29.271 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:25:29.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 msgr2=0x7ff164069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 0x7ff164069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 msgr2=0x7ff180153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff18006ad70 tx=0x7ff17c017000 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 shutdown_connections 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff1640670e0 0x7ff164069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff18015dfd0 0x7ff1800cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff180159550 0x7ff180153610 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 --2- 172.21.15.12:0/365609369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff180159920 0x7ff18009a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.272+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 >> 172.21.15.12:0/365609369 conn(0x7ff18006ce80 msgr2=0x7ff1801543a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.273+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 shutdown_connections 2023-10-08T16:25:29.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.273+0000 7ff18739d700 1 -- 172.21.15.12:0/365609369 wait complete. 2023-10-08T16:25:29.292 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:29.374 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:29.373+0000 7f31cc56d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:25:29.453 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:29.452+0000 7fcc56b16180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:25:29.473 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:29.472+0000 7f31cc56d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:25:29.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.482+0000 7f204e19d700 1 Processor -- start 2023-10-08T16:25:29.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.482+0000 7f204e19d700 1 -- start start 2023-10-08T16:25:29.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.483+0000 7f204e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.483+0000 7f204e19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 0x7f20480cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.483+0000 7f204e19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204815afd0 con 0x7f20480cef40 2023-10-08T16:25:29.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.483+0000 7f204e19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204815b2b0 con 0x7f204815de50 2023-10-08T16:25:29.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.483+0000 7f204e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204815b590 con 0x7f2048153c30 2023-10-08T16:25:29.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36046/0 (socket says 172.21.15.12:36046) 2023-10-08T16:25:29.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 -- 172.21.15.12:0/1698740731 learned_addr learned my addr 172.21.15.12:0/1698740731 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204c99a700 1 --2- 172.21.15.12:0/1698740731 >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 0x7f20480cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 -- 172.21.15.12:0/1698740731 >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 msgr2=0x7f20480cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 --2- 172.21.15.12:0/1698740731 >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 0x7f20480cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 -- 172.21.15.12:0/1698740731 >> v1:172.21.15.29:6789/0 conn(0x7f20480cef40 legacy=0x7f204806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 -- 172.21.15.12:0/1698740731 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204815b870 con 0x7f2048153c30 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204c99a700 1 --2- 172.21.15.12:0/1698740731 >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 0x7f20480cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f203ffff700 1 -- 172.21.15.12:0/1698740731 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2455445243 0 0) 0x7f204815afd0 con 0x7f20480cef40 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.484+0000 7f204d19b700 1 --2- 172.21.15.12:0/1698740731 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20440099b0 tx=0x7f2044009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b6da09e4719ef5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f203ffff700 1 -- 172.21.15.12:0/1698740731 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400b860 con 0x7f2048153c30 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f203ffff700 1 -- 172.21.15.12:0/1698740731 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400b9c0 con 0x7f2048153c30 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f203ffff700 1 -- 172.21.15.12:0/1698740731 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400bd60 con 0x7f2048153c30 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 -- 172.21.15.12:0/1698740731 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 msgr2=0x7f204815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 --2- 172.21.15.12:0/1698740731 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f20440099b0 tx=0x7f2044009250 comp rx=0 tx=0).stop 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 -- 172.21.15.12:0/1698740731 shutdown_connections 2023-10-08T16:25:29.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 --2- 172.21.15.12:0/1698740731 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2048153c30 0x7f204815a5e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 --2- 172.21.15.12:0/1698740731 >> v2:172.21.15.29:3300/0 conn(0x7f204815de50 0x7f20480cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 -- 172.21.15.12:0/1698740731 >> 172.21.15.12:0/1698740731 conn(0x7f20480703a0 msgr2=0x7f20480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:29.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 -- 172.21.15.12:0/1698740731 shutdown_connections 2023-10-08T16:25:29.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.485+0000 7f204e19d700 1 -- 172.21.15.12:0/1698740731 wait complete. 2023-10-08T16:25:29.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.487+0000 7f204e19d700 1 Processor -- start 2023-10-08T16:25:29.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.487+0000 7f204e19d700 1 -- start start 2023-10-08T16:25:29.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2048153c30 0x7f20480cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204815de50 0x7f2048151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b5120 con 0x7f20480cef40 2023-10-08T16:25:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b4510 con 0x7f2048153c30 2023-10-08T16:25:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480b47f0 con 0x7f204815de50 2023-10-08T16:25:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55052/0 (socket says 172.21.15.12:55052) 2023-10-08T16:25:29.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204d19b700 1 -- 172.21.15.12:0/1850853086 learned_addr learned my addr 172.21.15.12:0/1850853086 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204d99c700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204815de50 0x7f2048151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.488+0000 7f204c99a700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2048153c30 0x7f20480cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204815de50 msgr2=0x7f2048151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204815de50 0x7f2048151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2048153c30 msgr2=0x7f20480cca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2048153c30 0x7f20480cca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 -- 172.21.15.12:0/1850853086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20440094f0 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204d19b700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f20440090b0 tx=0x7f2044017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044011d70 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204401f070 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480b4ad0 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440266d0 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.489+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480b4220 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.490+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204804c3c0 con 0x7f20480cef40 2023-10-08T16:25:29.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.491+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f2044026a80 con 0x7f20480cef40 2023-10-08T16:25:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.492+0000 7f203d7fa700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 0x7f202c0695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.492+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2044021070 con 0x7f20480cef40 2023-10-08T16:25:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.492+0000 7f204c99a700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 msgr2=0x7f202c0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.492+0000 7f204c99a700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 0x7f202c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:29.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.496+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2044052fe0 con 0x7f20480cef40 2023-10-08T16:25:29.555 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:29.554+0000 7fcc56b16180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:25:29.568 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:29.568+0000 7f31cc56d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:25:29.650 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:29.649+0000 7fcc56b16180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:25:29.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.693+0000 7f204c99a700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 msgr2=0x7f202c0695c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:29.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.693+0000 7f204c99a700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 0x7f202c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:29.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.744+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20480cc070 con 0x7f20480cef40 2023-10-08T16:25:29.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.745+0000 7f203d7fa700 1 -- 172.21.15.12:0/1850853086 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f2044056600 con 0x7f20480cef40 2023-10-08T16:25:29.746 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:29.746 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:29.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 msgr2=0x7f202c0695c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:29.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 0x7f202c0695c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 msgr2=0x7f20480b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f20440090b0 tx=0x7f2044017000 comp rx=0 tx=0).stop 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 shutdown_connections 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f202c067110 0x7f202c0695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f20480cef40 0x7f20480b3ce0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204815de50 0x7f2048151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 --2- 172.21.15.12:0/1850853086 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2048153c30 0x7f20480cca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 >> 172.21.15.12:0/1850853086 conn(0x7f20480703a0 msgr2=0x7f2048152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 shutdown_connections 2023-10-08T16:25:29.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.747+0000 7f204e19d700 1 -- 172.21.15.12:0/1850853086 wait complete. 2023-10-08T16:25:29.750 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:29.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:29.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.960+0000 7f1749d9d700 1 Processor -- start 2023-10-08T16:25:29.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.960+0000 7f1749d9d700 1 -- start start 2023-10-08T16:25:29.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.961+0000 7f1749d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744153c30 0x7f174415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.961+0000 7f1749d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f174415de50 0x7f17440cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.961+0000 7f1749d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f174415afd0 con 0x7f17440cef40 2023-10-08T16:25:29.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.961+0000 7f1749d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174415b2b0 con 0x7f174415de50 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.961+0000 7f1749d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174415b590 con 0x7f1744153c30 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f174415de50 0x7f17440cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1748d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744153c30 0x7f174415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f174415de50 0x7f17440cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55066/0 (socket says 172.21.15.12:55066) 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 -- 172.21.15.12:0/2988781432 learned_addr learned my addr 172.21.15.12:0/2988781432 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f174959c700 1 --1- 172.21.15.12:0/2988781432 >> v1:172.21.15.29:6789/0 conn(0x7f17440cef40 0x7f174406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:34206/0 (socket says 172.21.15.12:34206) 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f17437fe700 1 -- 172.21.15.12:0/2988781432 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438138734 0 0) 0x7f174415afd0 con 0x7f17440cef40 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 -- 172.21.15.12:0/2988781432 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744153c30 msgr2=0x7f174415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 --2- 172.21.15.12:0/2988781432 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744153c30 0x7f174415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 -- 172.21.15.12:0/2988781432 >> v1:172.21.15.29:6789/0 conn(0x7f17440cef40 legacy=0x7f174406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.962+0000 7f1743fff700 1 -- 172.21.15.12:0/2988781432 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174415b870 con 0x7f174415de50 2023-10-08T16:25:29.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f1743fff700 1 --2- 172.21.15.12:0/2988781432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f17440cea00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f17300099b0 tx=0x7f1730009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492a6405d7710bbc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f17437fe700 1 -- 172.21.15.12:0/2988781432 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730009ea0 con 0x7f174415de50 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f17437fe700 1 -- 172.21.15.12:0/2988781432 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000b860 con 0x7f174415de50 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f17437fe700 1 -- 172.21.15.12:0/2988781432 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000bc00 con 0x7f174415de50 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f1749d9d700 1 -- 172.21.15.12:0/2988781432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 msgr2=0x7f17440cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.963+0000 7f1749d9d700 1 --2- 172.21.15.12:0/2988781432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f17440cea00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f17300099b0 tx=0x7f1730009250 comp rx=0 tx=0).stop 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 -- 172.21.15.12:0/2988781432 shutdown_connections 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 --2- 172.21.15.12:0/2988781432 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1744153c30 0x7f174415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 --2- 172.21.15.12:0/2988781432 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f17440cea00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 -- 172.21.15.12:0/2988781432 >> 172.21.15.12:0/2988781432 conn(0x7f17440703a0 msgr2=0x7f17440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:29.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 -- 172.21.15.12:0/2988781432 shutdown_connections 2023-10-08T16:25:29.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.964+0000 7f1749d9d700 1 -- 172.21.15.12:0/2988781432 wait complete. 2023-10-08T16:25:29.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.965+0000 7f1749d9d700 1 Processor -- start 2023-10-08T16:25:29.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.965+0000 7f1749d9d700 1 -- start start 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 0x7f17441528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744153c30 0x7f1744159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1744152750 con 0x7f174415de50 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b42e0 con 0x7f1744153c30 2023-10-08T16:25:29.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1749d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17440b3370 con 0x7f17440cef40 2023-10-08T16:25:29.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f174959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1743fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744153c30 0x7f1744159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f174959c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55076/0 (socket says 172.21.15.12:55076) 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f174959c700 1 -- 172.21.15.12:0/1256780979 learned_addr learned my addr 172.21.15.12:0/1256780979 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.966+0000 7f1748d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 0x7f17441528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 msgr2=0x7f17441528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 0x7f17441528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744153c30 msgr2=0x7f1744159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744153c30 0x7f1744159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 -- 172.21.15.12:0/1256780979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300094f0 con 0x7f174415de50 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f1748d9b700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 0x7f17441528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.967+0000 7f174959c700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f173c00cd20 tx=0x7f173c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.968+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00ce80 con 0x7f174415de50 2023-10-08T16:25:29.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.968+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173c005df0 con 0x7f174415de50 2023-10-08T16:25:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.968+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173c00aa20 con 0x7f174415de50 2023-10-08T16:25:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.968+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17440b35e0 con 0x7f174415de50 2023-10-08T16:25:29.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.968+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440b3f70 con 0x7f174415de50 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.969+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17440b4470 con 0x7f174415de50 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.970+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f173c0070f0 con 0x7f174415de50 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.971+0000 7f1740ff9700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 0x7f1728069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.971+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f173c084b10 con 0x7f174415de50 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.971+0000 7f1748d9b700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 msgr2=0x7f1728069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:29.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.971+0000 7f1748d9b700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 0x7f1728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:29.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:29.975+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f173c051850 con 0x7f174415de50 2023-10-08T16:25:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.172+0000 7f1748d9b700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 msgr2=0x7f1728069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:30.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.172+0000 7f1748d9b700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 0x7f1728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:30.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.195+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f174404c3c0 con 0x7f174415de50 2023-10-08T16:25:30.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.197+0000 7f1740ff9700 1 -- 172.21.15.12:0/1256780979 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16366 (secure 0 0 0) 0x7f173c054e70 con 0x7f174415de50 2023-10-08T16:25:30.198 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:30.198 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:24.443211+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:6836/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/1978126982":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3725668702":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3786028739":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3804927267":"2023-10-09T16:25:24.443180+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.200+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 msgr2=0x7f1728069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.200+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 0x7f1728069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.200+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 msgr2=0x7f1744152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.200+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f173c00cd20 tx=0x7f173c001a20 comp rx=0 tx=0).stop 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 shutdown_connections 2023-10-08T16:25:30.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f17280670e0 0x7f1728069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f174415de50 0x7f1744152210 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f17440cef40 0x7f17441528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 --2- 172.21.15.12:0/1256780979 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1744153c30 0x7f1744159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 >> 172.21.15.12:0/1256780979 conn(0x7f17440703a0 msgr2=0x7f1744070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 shutdown_connections 2023-10-08T16:25:30.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.201+0000 7f1749d9d700 1 -- 172.21.15.12:0/1256780979 wait complete. 2023-10-08T16:25:30.219 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:30.218+0000 7f31cc56d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:25:30.230 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:25:30.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:30.312 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:30.311+0000 7fcc56b16180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:25:30.399 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:30.398+0000 7f31cc56d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:30.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.424+0000 7f9f4bfff700 1 Processor -- start 2023-10-08T16:25:30.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.425+0000 7f9f4bfff700 1 -- start start 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 0x7f9f4c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9f4c0cef40 0x7f9f4c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c15afd0 con 0x7f9f4c15de50 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4c15b2b0 con 0x7f9f4c0cef40 2023-10-08T16:25:30.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c15b590 con 0x7f9f4c153c30 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 0x7f9f4c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4b7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9f4c0cef40 0x7f9f4c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4affd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36082/0 (socket says 172.21.15.12:36082) 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.426+0000 7f9f4affd700 1 -- 172.21.15.12:0/4087543140 learned_addr learned my addr 172.21.15.12:0/4087543140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 -- 172.21.15.12:0/4087543140 >> v2:172.21.15.29:3300/0 conn(0x7f9f4c0cef40 msgr2=0x7f9f4c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 --2- 172.21.15.12:0/4087543140 >> v2:172.21.15.29:3300/0 conn(0x7f9f4c0cef40 0x7f9f4c06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 -- 172.21.15.12:0/4087543140 >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 msgr2=0x7f9f4c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 --2- 172.21.15.12:0/4087543140 >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 0x7f9f4c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 -- 172.21.15.12:0/4087543140 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c15b870 con 0x7f9f4c153c30 2023-10-08T16:25:30.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4a7fc700 1 --2- 172.21.15.12:0/4087543140 >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 0x7f9f4c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f4affd700 1 --2- 172.21.15.12:0/4087543140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c071370 tx=0x7f9f3c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a48df411b4f0378a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f49ffb700 1 -- 172.21.15.12:0/4087543140 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00b640 con 0x7f9f4c153c30 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f49ffb700 1 -- 172.21.15.12:0/4087543140 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00b7a0 con 0x7f9f4c153c30 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.427+0000 7f9f49ffb700 1 -- 172.21.15.12:0/4087543140 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00bb60 con 0x7f9f4c153c30 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 -- 172.21.15.12:0/4087543140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 msgr2=0x7f9f4c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/4087543140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c071370 tx=0x7f9f3c009250 comp rx=0 tx=0).stop 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 -- 172.21.15.12:0/4087543140 shutdown_connections 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/4087543140 >> v2:172.21.15.29:3300/0 conn(0x7f9f4c0cef40 0x7f9f4c06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/4087543140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c153c30 0x7f9f4c15a5e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/4087543140 >> v2:172.21.15.12:3300/0 conn(0x7f9f4c15de50 0x7f9f4c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 -- 172.21.15.12:0/4087543140 >> 172.21.15.12:0/4087543140 conn(0x7f9f4c0703a0 msgr2=0x7f9f4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:30.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 -- 172.21.15.12:0/4087543140 shutdown_connections 2023-10-08T16:25:30.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.428+0000 7f9f4bfff700 1 -- 172.21.15.12:0/4087543140 wait complete. 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.430+0000 7f9f4bfff700 1 Processor -- start 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.430+0000 7f9f4bfff700 1 -- start start 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f4c0cef40 0x7f9f4c0cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 0x7f9f4c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0ca410 con 0x7f9f4c153c30 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0cc550 con 0x7f9f4c0cef40 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f4c0cd390 con 0x7f9f4c15de50 2023-10-08T16:25:30.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55082/0 (socket says 172.21.15.12:55082) 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4a7fc700 1 -- 172.21.15.12:0/2941611723 learned_addr learned my addr 172.21.15.12:0/2941611723 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 0x7f9f4c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4affd700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f4c0cef40 0x7f9f4c0cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f4c0cef40 msgr2=0x7f9f4c0cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f4c0cef40 0x7f9f4c0cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 msgr2=0x7f9f4c13ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4b7fe700 1 -- 172.21.15.12:0/2941611723 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f40009420 con 0x7f9f4c15de50 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.431+0000 7f9f4a7fc700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:30.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f4b7fe700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 0x7f9f4c1525f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009e80 tx=0x7f9f4400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400caa0 con 0x7f9f4c15de50 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4400f040 con 0x7f9f4c15de50 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400ce70 con 0x7f9f4c15de50 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3c0094f0 con 0x7f9f4c15de50 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.432+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4c0cca60 con 0x7f9f4c15de50 2023-10-08T16:25:30.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.433+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f4c04c3c0 con 0x7f9f4c15de50 2023-10-08T16:25:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.434+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f9f44014690 con 0x7f9f4c15de50 2023-10-08T16:25:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.435+0000 7f9f32ffd700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 0x7f9f38069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.435+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f9f44085800 con 0x7f9f4c15de50 2023-10-08T16:25:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.435+0000 7f9f4affd700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 msgr2=0x7f9f38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:30.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.435+0000 7f9f4affd700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 0x7f9f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.439+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f44055e40 con 0x7f9f4c15de50 2023-10-08T16:25:30.497 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:30.496+0000 7fcc56b16180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:25:30.500 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:30.499+0000 7f31cc56d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:25:30.597 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:30.596+0000 7fcc56b16180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:25:30.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.636+0000 7f9f4affd700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 msgr2=0x7f9f38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:30.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.636+0000 7f9f4affd700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 0x7f9f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:30.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.686+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f4c0caef0 con 0x7f9f4c15de50 2023-10-08T16:25:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.687+0000 7f9f32ffd700 1 -- 172.21.15.12:0/2941611723 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f9f440559d0 con 0x7f9f4c15de50 2023-10-08T16:25:30.688 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:30.688 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 msgr2=0x7f9f38069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 0x7f9f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 msgr2=0x7f9f4c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 0x7f9f4c1525f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f9f44009e80 tx=0x7f9f4400b040 comp rx=0 tx=0).stop 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 shutdown_connections 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9f380670e0 0x7f9f38069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9f4c15de50 0x7f9f4c1525f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9f4c0cef40 0x7f9f4c0cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 --2- 172.21.15.12:0/2941611723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9f4c153c30 0x7f9f4c13ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 >> 172.21.15.12:0/2941611723 conn(0x7f9f4c0703a0 msgr2=0x7f9f4c0b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 shutdown_connections 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.690+0000 7f9f4bfff700 1 -- 172.21.15.12:0/2941611723 wait complete. 2023-10-08T16:25:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:30.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:30.801 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:30.800+0000 7f31cc56d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:25:30.901 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:30.900+0000 7f31cc56d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:25:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.907+0000 7f36011ff700 1 Processor -- start 2023-10-08T16:25:30.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.908+0000 7f36011ff700 1 -- start start 2023-10-08T16:25:30.909 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:30.908+0000 7fcc56b16180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f36011ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f36011ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f35fc0cf200 0x7f35fc0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f36011ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc15a280 con 0x7f35fc0b0ba0 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f36011ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc06e180 con 0x7f35fc0cf200 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f36011ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0cd540 con 0x7f35fc0b07d0 2023-10-08T16:25:30.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f35fb59e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35fc0b0ba0 0x7f35fc06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60046/0 (socket says 172.21.15.12:60046) 2023-10-08T16:25:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f35fb59e700 1 -- 172.21.15.12:0/112326446 learned_addr learned my addr 172.21.15.12:0/112326446 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f35fad9d700 1 --2- 172.21.15.12:0/112326446 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.909+0000 7f35fa59c700 1 --2- 172.21.15.12:0/112326446 >> v2:172.21.15.29:3300/0 conn(0x7f35fc0cf200 0x7f35fc0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35fad9d700 1 -- 172.21.15.12:0/112326446 >> v2:172.21.15.29:3300/0 conn(0x7f35fc0cf200 msgr2=0x7f35fc0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35f9d9b700 1 -- 172.21.15.12:0/112326446 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813441156 0 0) 0x7f35fc15a280 con 0x7f35fc0b0ba0 2023-10-08T16:25:30.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35fad9d700 1 --2- 172.21.15.12:0/112326446 >> v2:172.21.15.29:3300/0 conn(0x7f35fc0cf200 0x7f35fc0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35fad9d700 1 -- 172.21.15.12:0/112326446 >> v1:172.21.15.12:6789/0 conn(0x7f35fc0b0ba0 legacy=0x7f35fc06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35fad9d700 1 -- 172.21.15.12:0/112326446 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc06d850 con 0x7f35fc0b07d0 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35fad9d700 1 --2- 172.21.15.12:0/112326446 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0ccac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0098d0 tx=0x7f35ec009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1519e32b58bb445f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35f9d9b700 1 -- 172.21.15.12:0/112326446 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec005c10 con 0x7f35fc0b07d0 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.910+0000 7f35f9d9b700 1 -- 172.21.15.12:0/112326446 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec005d70 con 0x7f35fc0b07d0 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f35f9d9b700 1 -- 172.21.15.12:0/112326446 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec006280 con 0x7f35fc0b07d0 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 -- 172.21.15.12:0/112326446 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 msgr2=0x7f35fc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 --2- 172.21.15.12:0/112326446 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0ccac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0098d0 tx=0x7f35ec009120 comp rx=0 tx=0).stop 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 -- 172.21.15.12:0/112326446 shutdown_connections 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 --2- 172.21.15.12:0/112326446 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0ccac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 --2- 172.21.15.12:0/112326446 >> v2:172.21.15.29:3300/0 conn(0x7f35fc0cf200 0x7f35fc0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 -- 172.21.15.12:0/112326446 >> 172.21.15.12:0/112326446 conn(0x7f35fc06ce80 msgr2=0x7f35fc0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 -- 172.21.15.12:0/112326446 shutdown_connections 2023-10-08T16:25:30.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.911+0000 7f36011ff700 1 -- 172.21.15.12:0/112326446 wait complete. 2023-10-08T16:25:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.913+0000 7f36011ff700 1 Processor -- start 2023-10-08T16:25:30.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.913+0000 7f36011ff700 1 -- start start 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0b0ba0 0x7f35fc14b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 0x7f35fc068410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc099630 con 0x7f35fc0cf200 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc098a20 con 0x7f35fc0b0ba0 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f36011ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc098d00 con 0x7f35fc0b07d0 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f35fb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 0x7f35fc068410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f35fad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f35fb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 0x7f35fc068410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55088/0 (socket says 172.21.15.12:55088) 2023-10-08T16:25:30.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f35fb59e700 1 -- 172.21.15.12:0/3431644112 learned_addr learned my addr 172.21.15.12:0/3431644112 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.914+0000 7f35fa59c700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0b0ba0 0x7f35fc14b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0b0ba0 msgr2=0x7f35fc14b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0b0ba0 0x7f35fc14b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 msgr2=0x7f35fc068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 0x7f35fc068410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 -- 172.21.15.12:0/3431644112 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ec0093c0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35fad9d700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0981d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35ec015000 tx=0x7f35ec016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec01b760 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec01b8e0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec01bca0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc098fe0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.915+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc098710 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.916+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc04c3c0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.917+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f35ec00b6d0 con 0x7f35fc0b07d0 2023-10-08T16:25:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.918+0000 7f35e2ffd700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 0x7f35e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.919+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f35ec086850 con 0x7f35fc0b07d0 2023-10-08T16:25:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.919+0000 7f35fa59c700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 msgr2=0x7f35e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:30.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.919+0000 7f35fa59c700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 0x7f35e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:30.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:30.923+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35ec053510 con 0x7f35fc0b07d0 2023-10-08T16:25:31.011 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:31.011+0000 7fcc56b16180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:25:31.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.120+0000 7f35fa59c700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 msgr2=0x7f35e8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:31.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.120+0000 7f35fa59c700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 0x7f35e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.172+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35fc06db30 con 0x7f35fc0b07d0 2023-10-08T16:25:31.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.172+0000 7f35e2ffd700 1 -- 172.21.15.12:0/3431644112 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f35ec084e60 con 0x7f35fc0b07d0 2023-10-08T16:25:31.173 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:31.174 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":42,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:03.642311+0000","modified":"2023-10-08T16:25:07.189472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6774},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6774":{"gid":6774,"name":"d","rank":0,"incarnation":38,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/2452899157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2452899157},{"type":"v1","addr":"172.21.15.29:6835","nonce":2452899157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 msgr2=0x7f35e8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 0x7f35e8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 msgr2=0x7f35fc0981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0981d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f35ec015000 tx=0x7f35ec016000 comp rx=0 tx=0).stop 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 shutdown_connections 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f35e80670e0 0x7f35e8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35fc0cf200 0x7f35fc068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35fc0b07d0 0x7f35fc0981d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 --2- 172.21.15.12:0/3431644112 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35fc0b0ba0 0x7f35fc14b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 >> 172.21.15.12:0/3431644112 conn(0x7f35fc06ce80 msgr2=0x7f35fc0cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 shutdown_connections 2023-10-08T16:25:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.175+0000 7f36011ff700 1 -- 172.21.15.12:0/3431644112 wait complete. 2023-10-08T16:25:31.179 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 42 2023-10-08T16:25:31.195 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.382+0000 7f6f5759e700 1 Processor -- start 2023-10-08T16:25:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.383+0000 7f6f5759e700 1 -- start start 2023-10-08T16:25:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f580caec0 0x7f6f58164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f580c7420 con 0x7f6f58159640 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5806d820 con 0x7f6f58159a10 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5806db00 con 0x7f6f580caec0 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f56d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6f580caec0 0x7f6f58164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6f58159640 0x7f6f5806d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60048/0 (socket says 172.21.15.12:60048) 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5659c700 1 -- 172.21.15.12:0/373937755 learned_addr learned my addr 172.21.15.12:0/373937755 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.384+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519703023 0 0) 0x7f6f580c7420 con 0x7f6f58159640 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f40003570 con 0x7f6f58159640 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273995086 0 0) 0x7f6f5806d820 con 0x7f6f58159a10 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f56d9d700 1 -- 172.21.15.12:0/373937755 >> v1:172.21.15.29:6789/0 conn(0x7f6f58159a10 legacy=0x7f6f580ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f56d9d700 1 -- 172.21.15.12:0/373937755 >> v1:172.21.15.12:6789/0 conn(0x7f6f58159640 legacy=0x7f6f5806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f56d9d700 1 -- 172.21.15.12:0/373937755 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5806dde0 con 0x7f6f580caec0 2023-10-08T16:25:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f56d9d700 1 --2- 172.21.15.12:0/373937755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f580caec0 0x7f6f58164450 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e90 tx=0x7f6f50009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62dfecce2ae98b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5000e070 con 0x7f6f580caec0 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5000bc40 con 0x7f6f580caec0 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.385+0000 7f6f5559a700 1 -- 172.21.15.12:0/373937755 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50012430 con 0x7f6f580caec0 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 -- 172.21.15.12:0/373937755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f580caec0 msgr2=0x7f6f58164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 --2- 172.21.15.12:0/373937755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f580caec0 0x7f6f58164450 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009e90 tx=0x7f6f50009780 comp rx=0 tx=0).stop 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 -- 172.21.15.12:0/373937755 shutdown_connections 2023-10-08T16:25:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 --2- 172.21.15.12:0/373937755 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f580caec0 0x7f6f58164450 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 -- 172.21.15.12:0/373937755 >> 172.21.15.12:0/373937755 conn(0x7f6f5806e720 msgr2=0x7f6f5806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 -- 172.21.15.12:0/373937755 shutdown_connections 2023-10-08T16:25:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.386+0000 7f6f5759e700 1 -- 172.21.15.12:0/373937755 wait complete. 2023-10-08T16:25:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.387+0000 7f6f5759e700 1 Processor -- start 2023-10-08T16:25:31.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.387+0000 7f6f5759e700 1 -- start start 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f580caec0 0x7f6f58159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f58159640 0x7f6f5814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580c62a0 con 0x7f6f58159a10 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580c6580 con 0x7f6f58159640 2023-10-08T16:25:31.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.388+0000 7f6f5759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f580c6860 con 0x7f6f580caec0 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f5659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f580caec0 0x7f6f58159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55094/0 (socket says 172.21.15.12:55094) 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 -- 172.21.15.12:0/789814850 learned_addr learned my addr 172.21.15.12:0/789814850 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f55d9b700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f58159640 0x7f6f5814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f580caec0 msgr2=0x7f6f58159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f580caec0 0x7f6f58159e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f58159640 msgr2=0x7f6f5814a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f58159640 0x7f6f5814a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 -- 172.21.15.12:0/789814850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f50009a20 con 0x7f6f58159a10 2023-10-08T16:25:31.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.389+0000 7f6f56d9d700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6f50013000 tx=0x7f6f50019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.390+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f50026480 con 0x7f6f58159a10 2023-10-08T16:25:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.390+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f50026620 con 0x7f6f58159a10 2023-10-08T16:25:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.390+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f500269e0 con 0x7f6f58159a10 2023-10-08T16:25:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.390+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f580c6b40 con 0x7f6f58159a10 2023-10-08T16:25:31.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.390+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f58154700 con 0x7f6f58159a10 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.391+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5804c3c0 con 0x7f6f58159a10 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.392+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6f5001c400 con 0x7f6f58159a10 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.393+0000 7f6f467fc700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 0x7f6f38069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.393+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6f50086bb0 con 0x7f6f58159a10 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.393+0000 7f6f5659c700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 msgr2=0x7f6f38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:31.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.393+0000 7f6f5659c700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 0x7f6f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:31.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.397+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f50053760 con 0x7f6f58159a10 2023-10-08T16:25:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.594+0000 7f6f5659c700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 msgr2=0x7f6f38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.594+0000 7f6f5659c700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 0x7f6f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.603+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f580cb2f0 con 0x7f6f58159a10 2023-10-08T16:25:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.604+0000 7f6f467fc700 1 -- 172.21.15.12:0/789814850 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16366 (secure 0 0 0) 0x7f6f5002b090 con 0x7f6f58159a10 2023-10-08T16:25:31.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:31.605 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:24.443211+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:01.400029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:02.625461+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:6836/115415":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/1978126982":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3725668702":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3786028739":"2023-10-09T16:25:24.443180+0000","172.21.15.12:0/3804927267":"2023-10-09T16:25:24.443180+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 msgr2=0x7f6f38069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 0x7f6f38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 msgr2=0x7f6f58156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6f50013000 tx=0x7f6f50019000 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 shutdown_connections 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6f380670e0 0x7f6f38069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6f58159a10 0x7f6f58156aa0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6f580caec0 0x7f6f58159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 --2- 172.21.15.12:0/789814850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6f58159640 0x7f6f5814a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.606+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 >> 172.21.15.12:0/789814850 conn(0x7f6f5806e720 msgr2=0x7f6f580c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.607+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 shutdown_connections 2023-10-08T16:25:31.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.607+0000 7f6f5759e700 1 -- 172.21.15.12:0/789814850 wait complete. 2023-10-08T16:25:31.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:25:31.641 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:31.641+0000 7f31cc56d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:25:31.771 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:31.771+0000 7fcc56b16180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:25:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.816+0000 7f005bfff700 1 Processor -- start 2023-10-08T16:25:31.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.816+0000 7f005bfff700 1 -- start start 2023-10-08T16:25:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.817+0000 7f005bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f005c0caec0 0x7f005c164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.817+0000 7f005bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c0c7420 con 0x7f005c159a10 2023-10-08T16:25:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.817+0000 7f005bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c06d820 con 0x7f005c159640 2023-10-08T16:25:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.817+0000 7f005bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c06db00 con 0x7f005c0caec0 2023-10-08T16:25:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f005a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f005c159a10 0x7f005c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60058/0 (socket says 172.21.15.12:60058) 2023-10-08T16:25:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f005a7fc700 1 -- 172.21.15.12:0/1404529970 learned_addr learned my addr 172.21.15.12:0/1404529970 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> v2:172.21.15.29:3300/0 conn(0x7f005c0caec0 0x7f005c164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342769017 0 0) 0x7f005c0c7420 con 0x7f005c159a10 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0044003570 con 0x7f005c159a10 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900688512 0 0) 0x7f005c06d820 con 0x7f005c159640 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f005c0c7420 con 0x7f005c159640 2023-10-08T16:25:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2207558866 0 0) 0x7f0044003570 con 0x7f005c159a10 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 >> v2:172.21.15.29:3300/0 conn(0x7f005c0caec0 msgr2=0x7f005c164450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 --2- 172.21.15.12:0/1404529970 >> v2:172.21.15.29:3300/0 conn(0x7f005c0caec0 0x7f005c164450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 >> v1:172.21.15.29:6789/0 conn(0x7f005c159640 legacy=0x7f005c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c06dde0 con 0x7f005c159a10 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f0050001470 con 0x7f005c159a10 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.818+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> v2:172.21.15.29:3300/0 conn(0x7f005c0caec0 0x7f005c164450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 >> v1:172.21.15.12:6789/0 conn(0x7f005c159a10 legacy=0x7f005c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0044003c20 0x7f0044004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0044004810 0x7f0044004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f004400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c06db00 con 0x7f00440051c0 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004400c1e0 con 0x7f0044003c20 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004400c3a0 con 0x7f0044004810 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f004400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005a7fc700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0044004810 0x7f0044004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005affd700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0044003c20 0x7f0044004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 -- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0044004810 msgr2=0x7f0044004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0044004810 0x7f0044004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 -- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0044003c20 msgr2=0x7f0044004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0044003c20 0x7f0044004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 -- 172.21.15.12:0/1404529970 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0044003570 con 0x7f00440051c0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.819+0000 7f005b7fe700 1 -- 172.21.15.12:0/1404529970 reap_dead start 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f005b7fe700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f004400ba60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f00540094d0 tx=0x7f005400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75f294d33aaf95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054009cf0 con 0x7f00440051c0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005400f040 con 0x7f00440051c0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f0059ffb700 1 -- 172.21.15.12:0/1404529970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400ee40 con 0x7f00440051c0 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f005bfff700 1 -- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 msgr2=0x7f004400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.820+0000 7f005bfff700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f004400ba60 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f00540094d0 tx=0x7f005400b040 comp rx=0 tx=0).stop 2023-10-08T16:25:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.821+0000 7f005bfff700 1 -- 172.21.15.12:0/1404529970 shutdown_connections 2023-10-08T16:25:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.821+0000 7f005bfff700 1 --2- 172.21.15.12:0/1404529970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f004400ba60 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.821+0000 7f005bfff700 1 -- 172.21.15.12:0/1404529970 >> 172.21.15.12:0/1404529970 conn(0x7f005c06e720 msgr2=0x7f005c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.821+0000 7f005bfff700 1 -- 172.21.15.12:0/1404529970 shutdown_connections 2023-10-08T16:25:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.821+0000 7f005bfff700 1 -- 172.21.15.12:0/1404529970 wait complete. 2023-10-08T16:25:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.822+0000 7f005bfff700 1 Processor -- start 2023-10-08T16:25:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.822+0000 7f005bfff700 1 -- start start 2023-10-08T16:25:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005c0c8e80 0x7f005c150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005c16e7a0 0x7f005c150a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c16b270 con 0x7f00440051c0 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c16dcc0 con 0x7f005c16e7a0 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c16dfa0 con 0x7f005c0c8e80 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.823+0000 7f005affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55108/0 (socket says 172.21.15.12:55108) 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 -- 172.21.15.12:0/3632599941 learned_addr learned my addr 172.21.15.12:0/3632599941 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005a7fc700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005c0c8e80 0x7f005c150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005b7fe700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005c16e7a0 0x7f005c150a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005c0c8e80 msgr2=0x7f005c150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005c0c8e80 0x7f005c150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005c16e7a0 msgr2=0x7f005c150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005c16e7a0 0x7f005c150a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 -- 172.21.15.12:0/3632599941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c16e280 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005affd700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f004c00e580 tx=0x7f004c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c001570 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004c010040 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.824+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c16a540 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.825+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004c001940 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.825+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c16aa60 con 0x7f00440051c0 2023-10-08T16:25:31.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.826+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c04c3c0 con 0x7f00440051c0 2023-10-08T16:25:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.827+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f004c001d30 con 0x7f00440051c0 2023-10-08T16:25:31.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.828+0000 7f0042ffd700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 0x7f0048069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.828+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f004c084870 con 0x7f00440051c0 2023-10-08T16:25:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.828+0000 7f005a7fc700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 msgr2=0x7f0048069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:31.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.828+0000 7f005a7fc700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 0x7f0048069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:31.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:31.832+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f004c051420 con 0x7f00440051c0 2023-10-08T16:25:31.934 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:31.933+0000 7f31cc56d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:25:32.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.029+0000 7f005a7fc700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 msgr2=0x7f0048069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:32.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.029+0000 7f005a7fc700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 0x7f0048069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:32.030 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.029+0000 7f31cc56d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:25:32.068 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.067+0000 7fcc56b16180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:25:32.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.082+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f005c0b2820 con 0x7f00440051c0 2023-10-08T16:25:32.083 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:25:32.083+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:25:32.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.087+0000 7f0042ffd700 1 -- 172.21.15.12:0/3632599941 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) v1 ==== 161+0+0 (secure 0 0 0) 0x7f004c054a40 con 0x7f00440051c0 2023-10-08T16:25:32.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 msgr2=0x7f0048069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 0x7f0048069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 msgr2=0x7f005c0c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f004c00e580 tx=0x7f004c009040 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 shutdown_connections 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00480670e0 0x7f0048069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00440051c0 0x7f005c0c8940 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f005c16e7a0 0x7f005c150a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 --2- 172.21.15.12:0/3632599941 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f005c0c8e80 0x7f005c150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.089+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 >> 172.21.15.12:0/3632599941 conn(0x7f005c06e720 msgr2=0x7f005c0aecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.090+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 shutdown_connections 2023-10-08T16:25:32.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.090+0000 7f005bfff700 1 -- 172.21.15.12:0/3632599941 wait complete. 2023-10-08T16:25:32.092 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:25:32.094 INFO:tasks.ceph.mds.d.smithi029.stderr: -1267> 2023-10-08T16:25:08.693+0000 7fa203df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:25:32.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:25:32.132 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:25:32.169 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.168+0000 7fcc56b16180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:25:32.196 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.195+0000 7f31cc56d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:25:32.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.301+0000 7fd570f9d700 1 Processor -- start 2023-10-08T16:25:32.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.301+0000 7fd570f9d700 1 -- start start 2023-10-08T16:25:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.302+0000 7fd570f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd56c13fe90 0x7fd56c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.302+0000 7fd570f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c06b290 con 0x7fd56c0c7be0 2023-10-08T16:25:32.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.302+0000 7fd570f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c06b570 con 0x7fd56c0c7fb0 2023-10-08T16:25:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.302+0000 7fd570f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c06bf10 con 0x7fd56c13fe90 2023-10-08T16:25:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd56c13fe90 0x7fd56c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd56c13fe90 0x7fd56c06abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41040/0 (socket says 172.21.15.12:41040) 2023-10-08T16:25:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 -- 172.21.15.12:0/2718674648 learned_addr learned my addr 172.21.15.12:0/2718674648 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:32.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56b7fe700 1 --1- 172.21.15.12:0/2718674648 >> v1:172.21.15.12:6789/0 conn(0x7fd56c0c7be0 0x7fd56c15a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48592/0 (socket says 172.21.15.12:48592) 2023-10-08T16:25:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 -- 172.21.15.12:0/2718674648 >> v1:172.21.15.29:6789/0 conn(0x7fd56c0c7fb0 legacy=0x7fd56c13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 -- 172.21.15.12:0/2718674648 >> v1:172.21.15.12:6789/0 conn(0x7fd56c0c7be0 legacy=0x7fd56c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 -- 172.21.15.12:0/2718674648 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c06b850 con 0x7fd56c13fe90 2023-10-08T16:25:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56a7fc700 1 -- 172.21.15.12:0/2718674648 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138247164 0 0) 0x7fd56c06b570 con 0x7fd56c0c7fb0 2023-10-08T16:25:32.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.303+0000 7fd56bfff700 1 --2- 172.21.15.12:0/2718674648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c13fe90 0x7fd56c06abd0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd564009f20 tx=0x7fd564009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ac9b89637e6335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd56a7fc700 1 -- 172.21.15.12:0/2718674648 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56400e070 con 0x7fd56c13fe90 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd56a7fc700 1 -- 172.21.15.12:0/2718674648 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56400b980 con 0x7fd56c13fe90 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd56a7fc700 1 -- 172.21.15.12:0/2718674648 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640092e0 con 0x7fd56c13fe90 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 -- 172.21.15.12:0/2718674648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c13fe90 msgr2=0x7fd56c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2718674648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c13fe90 0x7fd56c06abd0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd564009f20 tx=0x7fd564009840 comp rx=0 tx=0).stop 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 -- 172.21.15.12:0/2718674648 shutdown_connections 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2718674648 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c13fe90 0x7fd56c06abd0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 -- 172.21.15.12:0/2718674648 >> 172.21.15.12:0/2718674648 conn(0x7fd56c06d110 msgr2=0x7fd56c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.304+0000 7fd570f9d700 1 -- 172.21.15.12:0/2718674648 shutdown_connections 2023-10-08T16:25:32.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.305+0000 7fd570f9d700 1 -- 172.21.15.12:0/2718674648 wait complete. 2023-10-08T16:25:32.307 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.305+0000 7f31cc56d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:25:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.306+0000 7fd570f9d700 1 Processor -- start 2023-10-08T16:25:32.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.306+0000 7fd570f9d700 1 -- start start 2023-10-08T16:25:32.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 0x7fd56c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 0x7fd56c0c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c13d380 con 0x7fd56c0c7fb0 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c1561f0 con 0x7fd56c13fe90 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd570f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c169cd0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd56affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd56b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 0x7fd56c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd56affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41050/0 (socket says 172.21.15.12:41050) 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd56affd700 1 -- 172.21.15.12:0/2220175980 learned_addr learned my addr 172.21.15.12:0/2220175980 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:32.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.307+0000 7fd56bfff700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 0x7fd56c0c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 msgr2=0x7fd56c0c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 0x7fd56c0c22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 msgr2=0x7fd56c16a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 -- 172.21.15.12:0/2220175980 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564009ae0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56bfff700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 0x7fd56c0c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56affd700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:32.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd56b7fe700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 0x7fd56c13e750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c840 tx=0x7fd55c007ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c005a70 con 0x7fd56c0c7be0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55c005bf0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55c0070d0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.308+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c1699c0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.309+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c13d0a0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.310+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c04c3c0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.311+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 40) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fd55c007480 con 0x7fd56c0c7be0 2023-10-08T16:25:32.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.312+0000 7fd5537fe700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.312+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6441+0+0 (secure 0 0 0) 0x7fd55c083ff0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.312+0000 7fd56affd700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 msgr2=0x7fd558069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:32.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.312+0000 7fd56affd700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:25:32.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.316+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd55c050cc0 con 0x7fd56c0c7be0 2023-10-08T16:25:32.335 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.334+0000 7fcc56b16180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:25:32.445 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.444+0000 7fcc56b16180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:25:32.505 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.504+0000 7f31cc56d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:25:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.513+0000 7fd56affd700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 msgr2=0x7fd558069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:32.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.513+0000 7fd56affd700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:25:32.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.565+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd56c06bb30 con 0x7fd56c0c7be0 2023-10-08T16:25:32.602 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.601+0000 7f31cc56d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:25:32.644 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.643+0000 7fcc56b16180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:25:32.698 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.697+0000 7f31cc56d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:25:32.741 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.740+0000 7fcc56b16180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:25:32.796 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:25:32.795+0000 7f31cc56d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:25:32.842 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.841+0000 7fcc56b16180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:25:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.914+0000 7fd56affd700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 msgr2=0x7fd558069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:25:32.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.914+0000 7fd56affd700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:25:32.939 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:32.938+0000 7fcc56b16180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:25:32.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.950+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mgrmap(e 41) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fd55c051090 con 0x7fd56c0c7be0 2023-10-08T16:25:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.950+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 msgr2=0x7fd558069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:25:32.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:32.950+0000 7fd5537fe700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.014 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd1ec3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.014 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd1ec3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.014 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd1ec3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd1ec3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd1ec3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd4ec9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd4ec9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd4ec9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd4ec9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.015 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:25:33.013+0000 7fcbd4ec9700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:25:33.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.088+0000 7fd5537fe700 1 -- 172.21.15.12:0/2220175980 <== mon.2 v2:172.21.15.29:3301/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd55c06eab0 con 0x7fd56c0c7be0 2023-10-08T16:25:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 msgr2=0x7fd56c13e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 0x7fd56c13e750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd55c00c840 tx=0x7fd55c007ef0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 shutdown_connections 2023-10-08T16:25:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5580670e0 0x7fd558069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd56c13fe90 0x7fd56c0c22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd56c0c7be0 0x7fd56c13e750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 --2- 172.21.15.12:0/2220175980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd56c0c7fb0 0x7fd56c16a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 >> 172.21.15.12:0/2220175980 conn(0x7fd56c06d110 msgr2=0x7fd56c0caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 shutdown_connections 2023-10-08T16:25:33.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.091+0000 7fd570f9d700 1 -- 172.21.15.12:0/2220175980 wait complete. 2023-10-08T16:25:33.109 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.301+0000 7fa695f9d700 1 Processor -- start 2023-10-08T16:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.301+0000 7fa695f9d700 1 -- start start 2023-10-08T16:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.302+0000 7fa695f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.302+0000 7fa695f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.302+0000 7fa695f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6901571b0 con 0x7fa6900c2a90 2023-10-08T16:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.302+0000 7fa695f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6901579b0 con 0x7fa6900c85d0 2023-10-08T16:25:33.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.302+0000 7fa695f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900c1390 con 0x7fa6900c8200 2023-10-08T16:25:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa69579c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa694f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa69579c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:33426/0 (socket says 172.21.15.12:33426) 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa694f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:59932/0 (socket says 172.21.15.12:59932) 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa69579c700 1 -- 172.21.15.12:0/2370351584 learned_addr learned my addr 172.21.15.12:0/2370351584 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa68ffff700 1 --1- 172.21.15.12:0/2370351584 >> v1:172.21.15.29:6789/0 conn(0x7fa6900c2a90 0x7fa690156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:49690/0 (socket says 172.21.15.12:49690) 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa68f7fe700 1 -- 172.21.15.12:0/2370351584 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914582313 0 0) 0x7fa67c001110 con 0x7fa6900c2a90 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa68f7fe700 1 -- 172.21.15.12:0/2370351584 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa680003570 con 0x7fa6900c2a90 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa694f9b700 1 -- 172.21.15.12:0/2370351584 >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 msgr2=0x7fa6900cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa694f9b700 1 --2- 172.21.15.12:0/2370351584 >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.303+0000 7fa694f9b700 1 -- 172.21.15.12:0/2370351584 >> v1:172.21.15.29:6789/0 conn(0x7fa6900c2a90 legacy=0x7fa690156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa694f9b700 1 -- 172.21.15.12:0/2370351584 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6901573f0 con 0x7fa6900c8200 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa69579c700 1 --2- 172.21.15.12:0/2370351584 >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa694f9b700 1 --2- 172.21.15.12:0/2370351584 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa68400dd10 tx=0x7fa68400d630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd26bb8dbf2f5462 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa68f7fe700 1 -- 172.21.15.12:0/2370351584 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684012070 con 0x7fa6900c8200 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa68f7fe700 1 -- 172.21.15.12:0/2370351584 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400de70 con 0x7fa6900c8200 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.304+0000 7fa68f7fe700 1 -- 172.21.15.12:0/2370351584 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400fab0 con 0x7fa6900c8200 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 -- 172.21.15.12:0/2370351584 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 msgr2=0x7fa6900c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2370351584 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa68400dd10 tx=0x7fa68400d630 comp rx=0 tx=0).stop 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 -- 172.21.15.12:0/2370351584 shutdown_connections 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2370351584 >> v2:172.21.15.29:3300/0 conn(0x7fa6900c85d0 0x7fa6900cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2370351584 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c8200 0x7fa6900c1820 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 -- 172.21.15.12:0/2370351584 >> 172.21.15.12:0/2370351584 conn(0x7fa69006c6a0 msgr2=0x7fa69006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 -- 172.21.15.12:0/2370351584 shutdown_connections 2023-10-08T16:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.305+0000 7fa695f9d700 1 -- 172.21.15.12:0/2370351584 wait complete. 2023-10-08T16:25:33.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.306+0000 7fa695f9d700 1 Processor -- start 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.306+0000 7fa695f9d700 1 -- start start 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6900c8200 0x7fa6901596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c85d0 0x7fa69013ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900acfe0 con 0x7fa6900c2a90 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6900ae7e0 con 0x7fa6900c8200 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.307+0000 7fa695f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa690158600 con 0x7fa6900c85d0 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41174/0 (socket says 172.21.15.12:41174) 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 -- 172.21.15.12:0/2312864377 learned_addr learned my addr 172.21.15.12:0/2312864377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa68ffff700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6900c8200 0x7fa6901596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa69579c700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c85d0 0x7fa69013ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 -- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c85d0 msgr2=0x7fa69013ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c85d0 0x7fa69013ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 -- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6900c8200 msgr2=0x7fa6901596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6900c8200 0x7fa6901596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 -- 172.21.15.12:0/2312864377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68800bb00 con 0x7fa6900c2a90 2023-10-08T16:25:33.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.308+0000 7fa694f9b700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa6900c14d0 tx=0x7fa68401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.309+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68400c970 con 0x7fa6900c2a90 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.309+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68400caf0 con 0x7fa6900c2a90 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.309+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684020410 con 0x7fa6900c2a90 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.309+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68400d8d0 con 0x7fa6900c2a90 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.309+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa690158c40 con 0x7fa6900c2a90 2023-10-08T16:25:33.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.310+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69004c3c0 con 0x7fa6900c2a90 2023-10-08T16:25:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.311+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 41) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fa6840207c0 con 0x7fa6900c2a90 2023-10-08T16:25:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.312+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6742+0+0 (secure 0 0 0) 0x7fa684089ac0 con 0x7fa6900c2a90 2023-10-08T16:25:33.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.316+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa684056bf0 con 0x7fa6900c2a90 2023-10-08T16:25:33.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.518+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa6900aeac0 con 0x7fa6900c2a90 2023-10-08T16:25:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.955+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 42) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fa6840566a0 con 0x7fa6900c2a90 2023-10-08T16:25:33.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.955+0000 7fa68cff9700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 0x7fa67406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:33.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.957+0000 7fa68ffff700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 0x7fa67406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:33.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:33.960+0000 7fa68ffff700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 0x7fa67406edc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa690168ff0 tx=0x7fa67c007a10 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:34.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.494+0000 7fa68cff9700 1 -- 172.21.15.12:0/2312864377 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa68406ef20 con 0x7fa6900c2a90 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 msgr2=0x7fa67406edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 0x7fa67406edc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa690168ff0 tx=0x7fa67c007a10 comp rx=0 tx=0).stop 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 msgr2=0x7fa6900ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fa6900c14d0 tx=0x7fa68401c000 comp rx=0 tx=0).stop 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 shutdown_connections 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa67406c9e0 0x7fa67406edc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa6900c2a90 0x7fa6900ab740 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa6900c85d0 0x7fa69013ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 --2- 172.21.15.12:0/2312864377 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa6900c8200 0x7fa6901596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 >> 172.21.15.12:0/2312864377 conn(0x7fa69006c6a0 msgr2=0x7fa69014dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 shutdown_connections 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.497+0000 7fa695f9d700 1 -- 172.21.15.12:0/2312864377 wait complete. 2023-10-08T16:25:34.499 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:25:34.519 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:25:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.716+0000 7f6ead79d700 1 Processor -- start 2023-10-08T16:25:34.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.716+0000 7f6ead79d700 1 -- start start 2023-10-08T16:25:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.717+0000 7f6ead79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6ea8142ca0 0x7f6ea815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.717+0000 7f6ead79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea815d8d0 con 0x7f6ea8143070 2023-10-08T16:25:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.717+0000 7f6ead79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea815d2f0 con 0x7f6ea80cb450 2023-10-08T16:25:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.717+0000 7f6ead79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea80cc630 con 0x7f6ea8142ca0 2023-10-08T16:25:34.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6ea8143070 0x7f6ea80cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48606/0 (socket says 172.21.15.12:48606) 2023-10-08T16:25:34.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea77fe700 1 -- 172.21.15.12:0/1307049949 learned_addr learned my addr 172.21.15.12:0/1307049949 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/1307049949 >> v2:172.21.15.29:3300/0 conn(0x7f6ea8142ca0 0x7f6ea815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2995570349 0 0) 0x7f6ea815d8d0 con 0x7f6ea8143070 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e90003570 con 0x7f6ea8143070 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651100558 0 0) 0x7f6ea815d2f0 con 0x7f6ea80cb450 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea815d8d0 con 0x7f6ea80cb450 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 711098943 0 0) 0x7f6e90003570 con 0x7f6ea8143070 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 >> v2:172.21.15.29:3300/0 conn(0x7f6ea8142ca0 msgr2=0x7f6ea815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:34.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 --2- 172.21.15.12:0/1307049949 >> v2:172.21.15.29:3300/0 conn(0x7f6ea8142ca0 0x7f6ea815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 >> v1:172.21.15.29:6789/0 conn(0x7f6ea80cb450 legacy=0x7f6ea806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea815d560 con 0x7f6ea8143070 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f6e9c001470 con 0x7f6ea8143070 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 >> v1:172.21.15.12:6789/0 conn(0x7f6ea8143070 legacy=0x7f6ea80cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6e90003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.718+0000 7f6ea6ffd700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e90004810 0x7f6e90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea6ffd700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e900051c0 0x7f6e9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80cc630 con 0x7f6e900051c0 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9000c0b0 con 0x7f6e90003bf0 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9000c270 con 0x7f6e90004810 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6e90003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6eacf9c700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e900051c0 0x7f6e9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea77fe700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e90004810 0x7f6e90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 -- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e90004810 msgr2=0x7f6e90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e90004810 0x7f6e90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 -- 172.21.15.12:0/1307049949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e900051c0 msgr2=0x7f6e9000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e900051c0 0x7f6e9000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6ea7fff700 1 -- 172.21.15.12:0/1307049949 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90003570 con 0x7f6e90003bf0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.719+0000 7f6eacf9c700 1 -- 172.21.15.12:0/1307049949 reap_dead start 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6e90003fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009c00 tx=0x7f6e980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839a5da5888d14e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800e710 con 0x7f6e90003bf0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9800e870 con 0x7f6e90003bf0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ea6ffd700 1 -- 172.21.15.12:0/1307049949 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800ec30 con 0x7f6e90003bf0 2023-10-08T16:25:34.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ead79d700 1 -- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 msgr2=0x7f6e90003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.720+0000 7f6ead79d700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6e90003fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6e98009c00 tx=0x7f6e980091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.721+0000 7f6ead79d700 1 -- 172.21.15.12:0/1307049949 shutdown_connections 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.721+0000 7f6ead79d700 1 --2- 172.21.15.12:0/1307049949 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6e90003fe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.721+0000 7f6ead79d700 1 -- 172.21.15.12:0/1307049949 >> 172.21.15.12:0/1307049949 conn(0x7f6ea8067c80 msgr2=0x7f6ea8068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.721+0000 7f6ead79d700 1 -- 172.21.15.12:0/1307049949 shutdown_connections 2023-10-08T16:25:34.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.721+0000 7f6ead79d700 1 -- 172.21.15.12:0/1307049949 wait complete. 2023-10-08T16:25:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.722+0000 7f6ead79d700 1 Processor -- start 2023-10-08T16:25:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.722+0000 7f6ead79d700 1 -- start start 2023-10-08T16:25:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6ea80b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6ea80b3570 0x7f6ea80b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea815af30 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80af390 con 0x7f6e90003bf0 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ead79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea80af060 con 0x7f6ea80b3570 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ea77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ea77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41200/0 (socket says 172.21.15.12:41200) 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ea77fe700 1 -- 172.21.15.12:0/3280255940 learned_addr learned my addr 172.21.15.12:0/3280255940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6eacf9c700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6ea80b3570 0x7f6ea80b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.723+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6ea80b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 -- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6ea80b3570 msgr2=0x7f6ea80b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6ea80b3570 0x7f6ea80b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 -- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 msgr2=0x7f6ea80b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6ea80b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 -- 172.21.15.12:0/3280255940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea816a470 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ea77fe700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001ed0 tx=0x7f6e9c001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c018030 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c00f690 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea816a750 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00fa70 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.724+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea816aa30 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.725+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea80af500 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.726+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 42) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f6e9c01b070 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.727+0000 7f6e8ffff700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 0x7f6e94069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.727+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6304+0+0 (secure 0 0 0) 0x7f6e9c019070 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.727+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 0x7f6e94069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:34.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.728+0000 7f6ea7fff700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 0x7f6e94069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e980091e0 tx=0x7f6e9801a000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:34.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.731+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e9c051370 con 0x7f6ea80aeaf0 2023-10-08T16:25:34.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:34.936+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ea804c3c0 con 0x7f6ea80aeaf0 2023-10-08T16:25:35.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.502+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e9c051740 con 0x7f6ea80aeaf0 2023-10-08T16:25:35.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.508+0000 7f6e8ffff700 1 -- 172.21.15.12:0/3280255940 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6e9c06fe10 con 0x7f6ea80aeaf0 2023-10-08T16:25:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 msgr2=0x7f6e94069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 0x7f6e94069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6e980091e0 tx=0x7f6e9801a000 comp rx=0 tx=0).stop 2023-10-08T16:25:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 msgr2=0x7f6ea8169b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c001ed0 tx=0x7f6e9c001e10 comp rx=0 tx=0).stop 2023-10-08T16:25:35.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 shutdown_connections 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e94066d80 0x7f6e94069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6ea80b3570 0x7f6ea80b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e90003bf0 0x7f6ea80b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 --2- 172.21.15.12:0/3280255940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6ea80aeaf0 0x7f6ea8169b00 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 >> 172.21.15.12:0/3280255940 conn(0x7f6ea8067c80 msgr2=0x7f6ea80cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 shutdown_connections 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.511+0000 7f6ead79d700 1 -- 172.21.15.12:0/3280255940 wait complete. 2023-10-08T16:25:35.513 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:25:35.533 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:25:35.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.724+0000 7f444359e700 1 Processor -- start 2023-10-08T16:25:35.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.724+0000 7f444359e700 1 -- start start 2023-10-08T16:25:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f444359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4444153dd0 0x7f444415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f444359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 0x7f44440ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f444359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444415ac50 con 0x7f4444153a00 2023-10-08T16:25:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f444359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444415d010 con 0x7f4444153dd0 2023-10-08T16:25:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f444359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44440cf3e0 con 0x7f44440cea00 2023-10-08T16:25:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.725+0000 7f4441d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4444153dd0 0x7f444415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4444153dd0 0x7f444415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41204/0 (socket says 172.21.15.12:41204) 2023-10-08T16:25:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f444259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4444153a00 0x7f444415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48614/0 (socket says 172.21.15.12:48614) 2023-10-08T16:25:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 -- 172.21.15.12:0/2271829408 learned_addr learned my addr 172.21.15.12:0/2271829408 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4442d9d700 1 --2- 172.21.15.12:0/2271829408 >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 0x7f44440ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 -- 172.21.15.12:0/2271829408 >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 msgr2=0x7f44440ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 --2- 172.21.15.12:0/2271829408 >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 0x7f44440ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 -- 172.21.15.12:0/2271829408 >> v1:172.21.15.12:6789/0 conn(0x7f4444153a00 legacy=0x7f444415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 -- 172.21.15.12:0/2271829408 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444415af60 con 0x7f4444153dd0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4442d9d700 1 --2- 172.21.15.12:0/2271829408 >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 0x7f44440ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f444159a700 1 -- 172.21.15.12:0/2271829408 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479796871 0 0) 0x7f444415ac50 con 0x7f4444153a00 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.726+0000 7f4441d9b700 1 --2- 172.21.15.12:0/2271829408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f444415de50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f44440d03b0 tx=0x7f4438009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23fdbef84012c3e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444159a700 1 -- 172.21.15.12:0/2271829408 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800b860 con 0x7f4444153dd0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444159a700 1 -- 172.21.15.12:0/2271829408 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800b9c0 con 0x7f4444153dd0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444159a700 1 -- 172.21.15.12:0/2271829408 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800bd60 con 0x7f4444153dd0 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 -- 172.21.15.12:0/2271829408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 msgr2=0x7f444415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 --2- 172.21.15.12:0/2271829408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f444415de50 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f44440d03b0 tx=0x7f4438009250 comp rx=0 tx=0).stop 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 -- 172.21.15.12:0/2271829408 shutdown_connections 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 --2- 172.21.15.12:0/2271829408 >> v2:172.21.15.29:3300/0 conn(0x7f44440cea00 0x7f44440ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 --2- 172.21.15.12:0/2271829408 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f444415de50 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 -- 172.21.15.12:0/2271829408 >> 172.21.15.12:0/2271829408 conn(0x7f44440703a0 msgr2=0x7f44440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 -- 172.21.15.12:0/2271829408 shutdown_connections 2023-10-08T16:25:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.727+0000 7f444359e700 1 -- 172.21.15.12:0/2271829408 wait complete. 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.729+0000 7f444359e700 1 Processor -- start 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.729+0000 7f444359e700 1 -- start start 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44440cea00 0x7f444415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4444153a00 0x7f44440c9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444415ecb0 con 0x7f4444153dd0 2023-10-08T16:25:35.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f444415e3c0 con 0x7f4444153a00 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44440ca2f0 con 0x7f44440cea00 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41210/0 (socket says 172.21.15.12:41210) 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 -- 172.21.15.12:0/628742309 learned_addr learned my addr 172.21.15.12:0/628742309 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4441d9b700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4444153a00 0x7f44440c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f444259c700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44440cea00 0x7f444415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 -- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44440cea00 msgr2=0x7f444415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44440cea00 0x7f444415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 -- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4444153a00 msgr2=0x7f44440c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4444153a00 0x7f44440c9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.730+0000 7f4442d9d700 1 -- 172.21.15.12:0/628742309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44380094f0 con 0x7f4444153dd0 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f4442d9d700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f443c00a380 tx=0x7f443c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c015440 con 0x7f4444153dd0 2023-10-08T16:25:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443c0155a0 con 0x7f4444153dd0 2023-10-08T16:25:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f444415e660 con 0x7f4444153dd0 2023-10-08T16:25:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443c015960 con 0x7f4444153dd0 2023-10-08T16:25:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.731+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44440ca000 con 0x7f4444153dd0 2023-10-08T16:25:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.732+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f444415ee20 con 0x7f4444153dd0 2023-10-08T16:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.733+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f443c00d440 con 0x7f4444153dd0 2023-10-08T16:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.734+0000 7f44327fc700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 0x7f44240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.734+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f443c085180 con 0x7f4444153dd0 2023-10-08T16:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.734+0000 7f444259c700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 0x7f44240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.735+0000 7f444259c700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 0x7f44240693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f44440d14b0 tx=0x7f4434007bf0 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.738+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f443c052330 con 0x7f4444153dd0 2023-10-08T16:25:35.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.952+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f444404c3c0 con 0x7f4444153dd0 2023-10-08T16:25:35.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.957+0000 7f44327fc700 1 -- 172.21.15.12:0/628742309 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v31) v1 ==== 120+0+0 (secure 0 0 0) 0x7f443c055950 con 0x7f4444153dd0 2023-10-08T16:25:35.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 msgr2=0x7f44240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 0x7f44240693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f44440d14b0 tx=0x7f4434007bf0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 msgr2=0x7f44440c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f443c00a380 tx=0x7f443c007900 comp rx=0 tx=0).stop 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 shutdown_connections 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.959+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4424066f30 0x7f44240693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4444153dd0 0x7f44440c9ac0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f44440cea00 0x7f444415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 --2- 172.21.15.12:0/628742309 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4444153a00 0x7f44440c9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 >> 172.21.15.12:0/628742309 conn(0x7f44440703a0 msgr2=0x7f44440b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 shutdown_connections 2023-10-08T16:25:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:35.960+0000 7f444359e700 1 -- 172.21.15.12:0/628742309 wait complete. 2023-10-08T16:25:35.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:25:36.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.169+0000 7f33d2b9d700 1 Processor -- start 2023-10-08T16:25:36.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.169+0000 7f33d2b9d700 1 -- start start 2023-10-08T16:25:36.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.170+0000 7f33d2b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f33cc0cf110 0x7f33cc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.170+0000 7f33d2b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc15ac50 con 0x7f33cc153dd0 2023-10-08T16:25:36.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.170+0000 7f33d2b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc15d010 con 0x7f33cc153a00 2023-10-08T16:25:36.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.170+0000 7f33d2b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc15af60 con 0x7f33cc0cf110 2023-10-08T16:25:36.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d139a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f33cc153dd0 0x7f33cc0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48626/0 (socket says 172.21.15.12:48626) 2023-10-08T16:25:36.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d139a700 1 -- 172.21.15.12:0/1095582838 learned_addr learned my addr 172.21.15.12:0/1095582838 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:36.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d239c700 1 --2- 172.21.15.12:0/1095582838 >> v2:172.21.15.12:3300/0 conn(0x7f33cc0cf110 0x7f33cc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d239c700 1 -- 172.21.15.12:0/1095582838 >> v1:172.21.15.29:6789/0 conn(0x7f33cc153a00 legacy=0x7f33cc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d239c700 1 -- 172.21.15.12:0/1095582838 >> v1:172.21.15.12:6789/0 conn(0x7f33cc153dd0 legacy=0x7f33cc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d239c700 1 -- 172.21.15.12:0/1095582838 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc15b240 con 0x7f33cc0cf110 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d0b99700 1 -- 172.21.15.12:0/1095582838 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939058830 0 0) 0x7f33cc15ac50 con 0x7f33cc153dd0 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.171+0000 7f33d239c700 1 --2- 172.21.15.12:0/1095582838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc0cf110 0x7f33cc15de50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e60 tx=0x7f33c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf09f41ab0f9c06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d0b99700 1 -- 172.21.15.12:0/1095582838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400e070 con 0x7f33cc0cf110 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d0b99700 1 -- 172.21.15.12:0/1095582838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400bc30 con 0x7f33cc0cf110 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d0b99700 1 -- 172.21.15.12:0/1095582838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4012430 con 0x7f33cc0cf110 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 -- 172.21.15.12:0/1095582838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc0cf110 msgr2=0x7f33cc15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/1095582838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc0cf110 0x7f33cc15de50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f33c4009e60 tx=0x7f33c4009780 comp rx=0 tx=0).stop 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 -- 172.21.15.12:0/1095582838 shutdown_connections 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/1095582838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc0cf110 0x7f33cc15de50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 -- 172.21.15.12:0/1095582838 >> 172.21.15.12:0/1095582838 conn(0x7f33cc0703a0 msgr2=0x7f33cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 -- 172.21.15.12:0/1095582838 shutdown_connections 2023-10-08T16:25:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.172+0000 7f33d2b9d700 1 -- 172.21.15.12:0/1095582838 wait complete. 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.174+0000 7f33d2b9d700 1 Processor -- start 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.174+0000 7f33d2b9d700 1 -- start start 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33cc0cf110 0x7f33cc14c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f33cc153a00 0x7f33cc0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c8b60 con 0x7f33cc153dd0 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c7f50 con 0x7f33cc0cf110 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c8230 con 0x7f33cc153a00 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41234/0 (socket says 172.21.15.12:41234) 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 -- 172.21.15.12:0/3837828695 learned_addr learned my addr 172.21.15.12:0/3837828695 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d1b9b700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33cc0cf110 0x7f33cc14c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d139a700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f33cc153a00 0x7f33cc0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 -- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f33cc153a00 msgr2=0x7f33cc0c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f33cc153a00 0x7f33cc0c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 -- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33cc0cf110 msgr2=0x7f33cc14c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33cc0cf110 0x7f33cc14c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.175+0000 7f33d239c700 1 -- 172.21.15.12:0/3837828695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c4009a20 con 0x7f33cc153dd0 2023-10-08T16:25:36.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33d239c700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f33c4013000 tx=0x7f33c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4012e40 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c401b630 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c401b9f0 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc0c8510 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.176+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc14c7f0 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.177+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc0c8d10 con 0x7f33cc153dd0 2023-10-08T16:25:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.178+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33c401c400 con 0x7f33cc153dd0 2023-10-08T16:25:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.179+0000 7f33c1ffb700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.179+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f33c40861a0 con 0x7f33cc153dd0 2023-10-08T16:25:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.179+0000 7f33d1b9b700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.180+0000 7f33d1b9b700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 0x7f33b00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33c8003a80 tx=0x7f33c8007ec0 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.184+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33c40532b0 con 0x7f33cc153dd0 2023-10-08T16:25:36.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.393+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f33cc04c3c0 con 0x7f33cc153dd0 2023-10-08T16:25:36.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.397+0000 7f33c1ffb700 1 -- 172.21.15.12:0/3837828695 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v32) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33c4009880 con 0x7f33cc153dd0 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.399+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 msgr2=0x7f33b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.399+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 0x7f33b00693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33c8003a80 tx=0x7f33c8007ec0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.399+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 msgr2=0x7f33cc0c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.399+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f33c4013000 tx=0x7f33c4019000 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 shutdown_connections 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f33b0066f30 0x7f33b00693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f33cc153dd0 0x7f33cc0c75e0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f33cc0cf110 0x7f33cc14c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 --2- 172.21.15.12:0/3837828695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f33cc153a00 0x7f33cc0c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 >> 172.21.15.12:0/3837828695 conn(0x7f33cc0703a0 msgr2=0x7f33cc0d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:36.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 shutdown_connections 2023-10-08T16:25:36.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.400+0000 7f33d2b9d700 1 -- 172.21.15.12:0/3837828695 wait complete. 2023-10-08T16:25:36.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:25:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.608+0000 7ff5af59e700 1 Processor -- start 2023-10-08T16:25:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.608+0000 7ff5af59e700 1 -- start start 2023-10-08T16:25:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.609+0000 7ff5af59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff5b0153a00 0x7ff5b0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.609+0000 7ff5af59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 0x7ff5b00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.609+0000 7ff5af59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b015ac50 con 0x7ff5b015de50 2023-10-08T16:25:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.609+0000 7ff5af59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b015d010 con 0x7ff5b0153a00 2023-10-08T16:25:36.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.609+0000 7ff5af59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00cf3c0 con 0x7ff5b00cea00 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5aed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 0x7ff5b00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5ae59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff5b0153a00 0x7ff5b0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5a7fff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff5b015de50 0x7ff5b015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:49700/0 (socket says 172.21.15.12:49700) 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5a7fff700 1 -- 172.21.15.12:0/3276847594 learned_addr learned my addr 172.21.15.12:0/3276847594 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5add9b700 1 -- 172.21.15.12:0/3276847594 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169646049 0 0) 0x7ff5b015ac50 con 0x7ff5b015de50 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5add9b700 1 -- 172.21.15.12:0/3276847594 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c003570 con 0x7ff5b015de50 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5ae59c700 1 -- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 msgr2=0x7ff5b00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5ae59c700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 0x7ff5b00cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5ae59c700 1 -- 172.21.15.12:0/3276847594 >> v1:172.21.15.29:6789/0 conn(0x7ff5b015de50 legacy=0x7ff5b015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5ae59c700 1 -- 172.21.15.12:0/3276847594 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b015af60 con 0x7ff5b0153a00 2023-10-08T16:25:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.610+0000 7ff5aed9d700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 0x7ff5b00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5ae59c700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b0153dd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098e0 tx=0x7ff5a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372ee90074cb578c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5add9b700 1 -- 172.21.15.12:0/3276847594 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011630 con 0x7ff5b0153a00 2023-10-08T16:25:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5add9b700 1 -- 172.21.15.12:0/3276847594 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0011790 con 0x7ff5b0153a00 2023-10-08T16:25:36.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5add9b700 1 -- 172.21.15.12:0/3276847594 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011b30 con 0x7ff5b0153a00 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 -- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 msgr2=0x7ff5b0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b0153dd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff5a00098e0 tx=0x7ff5a00091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 -- 172.21.15.12:0/3276847594 shutdown_connections 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b00cea00 0x7ff5b00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 --2- 172.21.15.12:0/3276847594 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b0153dd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.611+0000 7ff5af59e700 1 -- 172.21.15.12:0/3276847594 >> 172.21.15.12:0/3276847594 conn(0x7ff5b00703a0 msgr2=0x7ff5b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.612+0000 7ff5af59e700 1 -- 172.21.15.12:0/3276847594 shutdown_connections 2023-10-08T16:25:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.612+0000 7ff5af59e700 1 -- 172.21.15.12:0/3276847594 wait complete. 2023-10-08T16:25:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.613+0000 7ff5af59e700 1 Processor -- start 2023-10-08T16:25:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.613+0000 7ff5af59e700 1 -- start start 2023-10-08T16:25:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b00c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b015de50 0x7ff5b00c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00c8530 con 0x7ff5b00cea00 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00c9370 con 0x7ff5b0153a00 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5af59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00c8760 con 0x7ff5b015de50 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5ae59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41240/0 (socket says 172.21.15.12:41240) 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.614+0000 7ff5ae59c700 1 -- 172.21.15.12:0/4206285406 learned_addr learned my addr 172.21.15.12:0/4206285406 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5aed9d700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b015de50 0x7ff5b00c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5a7fff700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b00c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 -- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b015de50 msgr2=0x7ff5b00c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b015de50 0x7ff5b00c5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 -- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 msgr2=0x7ff5b00c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b00c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 -- 172.21.15.12:0/4206285406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a8009a20 con 0x7ff5b00cea00 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5ae59c700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006eb00 tx=0x7ff5a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0011b10 con 0x7ff5b00cea00 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0000cc0 con 0x7ff5b00cea00 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.615+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0023600 con 0x7ff5b00cea00 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.616+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a0009420 con 0x7ff5b00cea00 2023-10-08T16:25:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.616+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b00c8d20 con 0x7ff5b00cea00 2023-10-08T16:25:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.617+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b00c96e0 con 0x7ff5b00cea00 2023-10-08T16:25:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.617+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5a002c3b0 con 0x7ff5b00cea00 2023-10-08T16:25:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.618+0000 7ff5a67fc700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 0x7ff5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:36.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.618+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7ff5a00859f0 con 0x7ff5b00cea00 2023-10-08T16:25:36.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.618+0000 7ff5a7fff700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 0x7ff5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:36.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.619+0000 7ff5a7fff700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 0x7ff5900693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00b29c0 tx=0x7ff598009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:36.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.622+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5a0052c40 con 0x7ff5b00cea00 2023-10-08T16:25:36.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.833+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7ff5b004c3c0 con 0x7ff5b00cea00 2023-10-08T16:25:36.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.837+0000 7ff5a67fc700 1 -- 172.21.15.12:0/4206285406 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v33) v1 ==== 115+0+0 (secure 0 0 0) 0x7ff5a00150b0 con 0x7ff5b00cea00 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.839+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 msgr2=0x7ff5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.839+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 0x7ff5900693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00b29c0 tx=0x7ff598009040 comp rx=0 tx=0).stop 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.839+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 msgr2=0x7ff5b0158ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.839+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7ff5b006eb00 tx=0x7ff5a0017000 comp rx=0 tx=0).stop 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 shutdown_connections 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff590066f30 0x7ff5900693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff5b00cea00 0x7ff5b0158ba0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff5b015de50 0x7ff5b00c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 --2- 172.21.15.12:0/4206285406 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff5b0153a00 0x7ff5b00c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 >> 172.21.15.12:0/4206285406 conn(0x7ff5b00703a0 msgr2=0x7ff5b0152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 shutdown_connections 2023-10-08T16:25:36.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:36.840+0000 7ff5af59e700 1 -- 172.21.15.12:0/4206285406 wait complete. 2023-10-08T16:25:36.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-10-08T16:25:37.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.045+0000 7f5b1299d700 1 Processor -- start 2023-10-08T16:25:37.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.045+0000 7f5b1299d700 1 -- start start 2023-10-08T16:25:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.046+0000 7f5b1299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5b0c06f3a0 0x7f5b0c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.046+0000 7f5b1299d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c06a490 con 0x7f5b0c06e470 2023-10-08T16:25:37.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.046+0000 7f5b1299d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0c7230 con 0x7f5b0c06e0a0 2023-10-08T16:25:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.046+0000 7f5b1299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c7490 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5b0c06f3a0 0x7f5b0c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1219c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5b0c06e470 0x7f5b0c06a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48638/0 (socket says 172.21.15.12:48638) 2023-10-08T16:25:37.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1219c700 1 -- 172.21.15.12:0/3227890873 learned_addr learned my addr 172.21.15.12:0/3227890873 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1119a700 1 -- 172.21.15.12:0/3227890873 >> v1:172.21.15.29:6789/0 conn(0x7f5b0c06e0a0 legacy=0x7f5b0c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1119a700 1 -- 172.21.15.12:0/3227890873 >> v1:172.21.15.12:6789/0 conn(0x7f5b0c06e470 legacy=0x7f5b0c06a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1119a700 1 -- 172.21.15.12:0/3227890873 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0c7770 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b10999700 1 -- 172.21.15.12:0/3227890873 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387329265 0 0) 0x7f5b0c06a490 con 0x7f5b0c06e470 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.047+0000 7f5b1119a700 1 --2- 172.21.15.12:0/3227890873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c14fc70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00aa70 tx=0x7f5afc00a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e5e48e366b1303 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b10999700 1 -- 172.21.15.12:0/3227890873 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc005c10 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b10999700 1 -- 172.21.15.12:0/3227890873 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc005d70 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b10999700 1 -- 172.21.15.12:0/3227890873 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc00ca60 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 -- 172.21.15.12:0/3227890873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06f3a0 msgr2=0x7f5b0c14fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 --2- 172.21.15.12:0/3227890873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c14fc70 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00aa70 tx=0x7f5afc00a2e0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 -- 172.21.15.12:0/3227890873 shutdown_connections 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 --2- 172.21.15.12:0/3227890873 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c14fc70 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 -- 172.21.15.12:0/3227890873 >> 172.21.15.12:0/3227890873 conn(0x7f5b0c06d170 msgr2=0x7f5b0c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 -- 172.21.15.12:0/3227890873 shutdown_connections 2023-10-08T16:25:37.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.048+0000 7f5b1299d700 1 -- 172.21.15.12:0/3227890873 wait complete. 2023-10-08T16:25:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.050+0000 7f5b1299d700 1 Processor -- start 2023-10-08T16:25:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.050+0000 7f5b1299d700 1 -- start start 2023-10-08T16:25:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 0x7f5b0c14c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c0cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c5cf0 con 0x7f5b0c06e470 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c50e0 con 0x7f5b0c06f3a0 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0c53c0 con 0x7f5b0c06e0a0 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41258/0 (socket says 172.21.15.12:41258) 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 -- 172.21.15.12:0/1652472023 learned_addr learned my addr 172.21.15.12:0/1652472023 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1219c700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c0cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1199b700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 0x7f5b0c14c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 -- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 msgr2=0x7f5b0c14c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 0x7f5b0c14c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 -- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0c06f3a0 msgr2=0x7f5b0c0cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c0cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.051+0000 7f5b1119a700 1 -- 172.21.15.12:0/1652472023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5afc00a560 con 0x7f5b0c06e470 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b1199b700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 0x7f5b0c14c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b1119a700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00a530 tx=0x7f5afc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc01f070 con 0x7f5b0c06e470 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc00ca40 con 0x7f5b0c06e470 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc023660 con 0x7f5b0c06e470 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c0c56a0 con 0x7f5b0c06e470 2023-10-08T16:25:37.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.052+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c16ae80 con 0x7f5b0c06e470 2023-10-08T16:25:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.053+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0c5e60 con 0x7f5b0c06e470 2023-10-08T16:25:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.054+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5afc005ee0 con 0x7f5b0c06e470 2023-10-08T16:25:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.055+0000 7f5b01ffb700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 0x7f5af00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.055+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f5afc085c50 con 0x7f5b0c06e470 2023-10-08T16:25:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.055+0000 7f5b1199b700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 0x7f5af00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.056+0000 7f5b1199b700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 0x7f5af00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b08007fd0 tx=0x7f5b08009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.059+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5afc052d60 con 0x7f5b0c06e470 2023-10-08T16:25:37.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.341+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7f5b0c04c3c0 con 0x7f5b0c06e470 2023-10-08T16:25:37.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.513+0000 7f5b01ffb700 1 -- 172.21.15.12:0/1652472023 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v618) v1 ==== 166+0+0 (secure 0 0 0) 0x7f5afc0140e0 con 0x7f5b0c06e470 2023-10-08T16:25:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 msgr2=0x7f5af00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 0x7f5af00693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5b08007fd0 tx=0x7f5b08009040 comp rx=0 tx=0).stop 2023-10-08T16:25:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 msgr2=0x7f5b0c16a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00a530 tx=0x7f5afc019000 comp rx=0 tx=0).stop 2023-10-08T16:25:37.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 shutdown_connections 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5af0066f30 0x7f5af00693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5b0c06f3a0 0x7f5b0c0cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5b0c06e0a0 0x7f5b0c14c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 --2- 172.21.15.12:0/1652472023 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5b0c06e470 0x7f5b0c16a940 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 >> 172.21.15.12:0/1652472023 conn(0x7f5b0c06d170 msgr2=0x7f5b0c06a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 shutdown_connections 2023-10-08T16:25:37.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.515+0000 7f5b1299d700 1 -- 172.21.15.12:0/1652472023 wait complete. 2023-10-08T16:25:37.534 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-10-08T16:25:37.534 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that a non-existent path leads to schedule deactivation after a few retries. 2023-10-08T16:25:37.534 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:25:37.534 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-08T16:25:37.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.720+0000 7f41ce99d700 1 Processor -- start 2023-10-08T16:25:37.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.720+0000 7f41ce99d700 1 -- start start 2023-10-08T16:25:37.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41c813fb20 0x7f41c815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 0x7f41c80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c815ae70 con 0x7f41c813fef0 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c806af60 con 0x7f41c813fb20 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c806b240 con 0x7f41c806aaa0 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41c813fb20 0x7f41c815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41c813fb20 0x7f41c815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41264/0 (socket says 172.21.15.12:41264) 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 -- 172.21.15.12:0/782444124 learned_addr learned my addr 172.21.15.12:0/782444124 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41ce19c700 1 --2- 172.21.15.12:0/782444124 >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 0x7f41c80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 -- 172.21.15.12:0/782444124 >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 msgr2=0x7f41c80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 --2- 172.21.15.12:0/782444124 >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 0x7f41c80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 -- 172.21.15.12:0/782444124 >> v1:172.21.15.29:6789/0 conn(0x7f41c813fef0 legacy=0x7f41c80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.722+0000 7f41cd99b700 1 -- 172.21.15.12:0/782444124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c806b520 con 0x7f41c813fb20 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.723+0000 7f41ce19c700 1 --2- 172.21.15.12:0/782444124 >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 0x7f41c80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.723+0000 7f41cd99b700 1 --2- 172.21.15.12:0/782444124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c813fb20 0x7f41c815a930 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f41c8069d40 tx=0x7f41c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7e47e4d94cb1ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.723+0000 7f41cc999700 1 -- 172.21.15.12:0/782444124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400b860 con 0x7f41c813fb20 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.723+0000 7f41cc999700 1 -- 172.21.15.12:0/782444124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400b9c0 con 0x7f41c813fb20 2023-10-08T16:25:37.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.723+0000 7f41cc999700 1 -- 172.21.15.12:0/782444124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400bd60 con 0x7f41c813fb20 2023-10-08T16:25:37.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 -- 172.21.15.12:0/782444124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c813fb20 msgr2=0x7f41c815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 --2- 172.21.15.12:0/782444124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c813fb20 0x7f41c815a930 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f41c8069d40 tx=0x7f41c4009250 comp rx=0 tx=0).stop 2023-10-08T16:25:37.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 -- 172.21.15.12:0/782444124 shutdown_connections 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 --2- 172.21.15.12:0/782444124 >> v2:172.21.15.29:3300/0 conn(0x7f41c806aaa0 0x7f41c80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 --2- 172.21.15.12:0/782444124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c813fb20 0x7f41c815a930 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 -- 172.21.15.12:0/782444124 >> 172.21.15.12:0/782444124 conn(0x7f41c806d170 msgr2=0x7f41c80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 -- 172.21.15.12:0/782444124 shutdown_connections 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.724+0000 7f41ce99d700 1 -- 172.21.15.12:0/782444124 wait complete. 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.725+0000 7f41ce99d700 1 Processor -- start 2023-10-08T16:25:37.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.725+0000 7f41ce99d700 1 -- start start 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41c813fb20 0x7f41c8156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41c813fef0 0x7f41c8168c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c80ad2a0 con 0x7f41c806aaa0 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8169690 con 0x7f41c813fef0 2023-10-08T16:25:37.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41ce99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8169970 con 0x7f41c813fb20 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41cd99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41cd99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41278/0 (socket says 172.21.15.12:41278) 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.726+0000 7f41cd99b700 1 -- 172.21.15.12:0/3943115038 learned_addr learned my addr 172.21.15.12:0/3943115038 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 -- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41c813fb20 msgr2=0x7f41c8156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41c813fb20 0x7f41c8156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 -- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41c813fef0 msgr2=0x7f41c8168c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41c813fef0 0x7f41c8168c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 -- 172.21.15.12:0/3943115038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40094f0 con 0x7f41c806aaa0 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41cd99b700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009290 tx=0x7f41c4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c401ae00 con 0x7f41c806aaa0 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c4010470 con 0x7f41c806aaa0 2023-10-08T16:25:37.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4010830 con 0x7f41c806aaa0 2023-10-08T16:25:37.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.727+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c80acf30 con 0x7f41c806aaa0 2023-10-08T16:25:37.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.728+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c8156020 con 0x7f41c806aaa0 2023-10-08T16:25:37.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.728+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c804c3c0 con 0x7f41c806aaa0 2023-10-08T16:25:37.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.729+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41c4022070 con 0x7f41c806aaa0 2023-10-08T16:25:37.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.730+0000 7f41bdffb700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 0x7f41ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:37.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.730+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f41c4014070 con 0x7f41c806aaa0 2023-10-08T16:25:37.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.730+0000 7f41cd19a700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 0x7f41ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:37.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.731+0000 7f41cd19a700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 0x7f41ac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41c8158fe0 tx=0x7f41b8007b90 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:37.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:37.735+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41c4054970 con 0x7f41c806aaa0 2023-10-08T16:25:38.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.016+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f41c806b800 con 0x7f41c806aaa0 2023-10-08T16:25:38.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.513+0000 7f41bdffb700 1 -- 172.21.15.12:0/3943115038 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v619) v1 ==== 186+0+0 (secure 0 0 0) 0x7f41c4029100 con 0x7f41c806aaa0 2023-10-08T16:25:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 msgr2=0x7f41ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 0x7f41ac0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f41c8158fe0 tx=0x7f41b8007b90 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 msgr2=0x7f41c8135bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009290 tx=0x7f41c4019000 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 shutdown_connections 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f41ac066f30 0x7f41ac0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41c806aaa0 0x7f41c8135bf0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41c813fef0 0x7f41c8168c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.515+0000 7f41ce99d700 1 --2- 172.21.15.12:0/3943115038 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41c813fb20 0x7f41c8156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.516+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 >> 172.21.15.12:0/3943115038 conn(0x7f41c806d170 msgr2=0x7f41c80caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.516+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 shutdown_connections 2023-10-08T16:25:38.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.516+0000 7f41ce99d700 1 -- 172.21.15.12:0/3943115038 wait complete. 2023-10-08T16:25:38.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.725+0000 7f72bcf9d700 1 Processor -- start 2023-10-08T16:25:38.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.725+0000 7f72bcf9d700 1 -- start start 2023-10-08T16:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.726+0000 7f72bcf9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72b80c7be0 0x7f72b806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.726+0000 7f72bcf9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b806b290 con 0x7f72b813f780 2023-10-08T16:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.726+0000 7f72bcf9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b806b570 con 0x7f72b80c7fb0 2023-10-08T16:25:38.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.726+0000 7f72bcf9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b806bf10 con 0x7f72b80c7be0 2023-10-08T16:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.727+0000 7f72b7fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f72b813f780 0x7f72b813fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48650/0 (socket says 172.21.15.12:48650) 2023-10-08T16:25:38.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.727+0000 7f72b7fff700 1 -- 172.21.15.12:0/3140999293 learned_addr learned my addr 172.21.15.12:0/3140999293 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.727+0000 7f72b77fe700 1 --2- 172.21.15.12:0/3140999293 >> v2:172.21.15.29:3300/0 conn(0x7f72b80c7be0 0x7f72b806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.727+0000 7f72b67fc700 1 -- 172.21.15.12:0/3140999293 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 849999024 0 0) 0x7f72b806b290 con 0x7f72b813f780 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.727+0000 7f72b67fc700 1 -- 172.21.15.12:0/3140999293 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003570 con 0x7f72b813f780 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b77fe700 1 -- 172.21.15.12:0/3140999293 >> v1:172.21.15.29:6789/0 conn(0x7f72b80c7fb0 legacy=0x7f72b815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b77fe700 1 -- 172.21.15.12:0/3140999293 >> v1:172.21.15.12:6789/0 conn(0x7f72b813f780 legacy=0x7f72b813fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b77fe700 1 -- 172.21.15.12:0/3140999293 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b806b850 con 0x7f72b80c7be0 2023-10-08T16:25:38.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b77fe700 1 --2- 172.21.15.12:0/3140999293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b80c7be0 0x7f72b806abd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72a80098e0 tx=0x7f72a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b30c0ec2ed1dbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b67fc700 1 -- 172.21.15.12:0/3140999293 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800b640 con 0x7f72b80c7be0 2023-10-08T16:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b67fc700 1 -- 172.21.15.12:0/3140999293 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a800b7a0 con 0x7f72b80c7be0 2023-10-08T16:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.728+0000 7f72b67fc700 1 -- 172.21.15.12:0/3140999293 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800bb40 con 0x7f72b80c7be0 2023-10-08T16:25:38.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 -- 172.21.15.12:0/3140999293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b80c7be0 msgr2=0x7f72b806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/3140999293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b80c7be0 0x7f72b806abd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f72a80098e0 tx=0x7f72a80091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 -- 172.21.15.12:0/3140999293 shutdown_connections 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/3140999293 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b80c7be0 0x7f72b806abd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 -- 172.21.15.12:0/3140999293 >> 172.21.15.12:0/3140999293 conn(0x7f72b806d110 msgr2=0x7f72b80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 -- 172.21.15.12:0/3140999293 shutdown_connections 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.729+0000 7f72bcf9d700 1 -- 172.21.15.12:0/3140999293 wait complete. 2023-10-08T16:25:38.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.730+0000 7f72bcf9d700 1 Processor -- start 2023-10-08T16:25:38.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.730+0000 7f72bcf9d700 1 -- start start 2023-10-08T16:25:38.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72b80c7fb0 0x7f72b80c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 0x7f72b8156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8159990 con 0x7f72b80c7be0 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b80c3720 con 0x7f72b813f780 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.731+0000 7f72bcf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b813b8e0 con 0x7f72b80c7fb0 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41288/0 (socket says 172.21.15.12:41288) 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 -- 172.21.15.12:0/527386248 learned_addr learned my addr 172.21.15.12:0/527386248 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b7fff700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 0x7f72b8156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b6ffd700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72b80c7fb0 0x7f72b80c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 -- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72b80c7fb0 msgr2=0x7f72b80c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72b80c7fb0 0x7f72b80c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 -- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 msgr2=0x7f72b8156ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 0x7f72b8156ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 -- 172.21.15.12:0/527386248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8009420 con 0x7f72b80c7be0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b7fff700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 0x7f72b8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.732+0000 7f72b77fe700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009f80 tx=0x7f72a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.733+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a800bb20 con 0x7f72b80c7be0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.733+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a8011420 con 0x7f72b80c7be0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.733+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a80117a0 con 0x7f72b80c7be0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.733+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8157000 con 0x7f72b80c7be0 2023-10-08T16:25:38.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.733+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b81575e0 con 0x7f72b80c7be0 2023-10-08T16:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.734+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b804c3c0 con 0x7f72b80c7be0 2023-10-08T16:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.735+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72a8011b10 con 0x7f72b80c7be0 2023-10-08T16:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.735+0000 7f729f7fe700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:38.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.736+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f72a8085dd0 con 0x7f72b80c7be0 2023-10-08T16:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.736+0000 7f72b6ffd700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:38.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.736+0000 7f72b6ffd700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 0x7f72a40693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72b813d460 tx=0x7f72ac009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:38.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.740+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72a8052ee0 con 0x7f72b80c7be0 2023-10-08T16:25:38.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.940+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f72b806f0a0 con 0x7f72b80c7be0 2023-10-08T16:25:38.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.947+0000 7f729f7fe700 1 -- 172.21.15.12:0/527386248 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f72a8056500 con 0x7f72b80c7be0 2023-10-08T16:25:38.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 msgr2=0x7f72a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 0x7f72a40693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f72b813d460 tx=0x7f72ac009040 comp rx=0 tx=0).stop 2023-10-08T16:25:38.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 msgr2=0x7f72b8158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009f80 tx=0x7f72a8017000 comp rx=0 tx=0).stop 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 shutdown_connections 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72a4066f30 0x7f72a40693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f72b80c7be0 0x7f72b8158760 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f72b813f780 0x7f72b8156ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 --2- 172.21.15.12:0/527386248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72b80c7fb0 0x7f72b80c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 >> 172.21.15.12:0/527386248 conn(0x7f72b806d110 msgr2=0x7f72b813d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 shutdown_connections 2023-10-08T16:25:38.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:38.949+0000 7f72bcf9d700 1 -- 172.21.15.12:0/527386248 wait complete. 2023-10-08T16:25:38.968 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:25:38.968 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:25:39.049 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:25:39.138 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:25:39.138 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:25:39.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:39.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.325+0000 7fe027fff700 1 Processor -- start 2023-10-08T16:25:39.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.325+0000 7fe027fff700 1 -- start start 2023-10-08T16:25:39.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.326+0000 7fe027fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe028150380 0x7fe028160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe027fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02806a490 con 0x7fe02806f3a0 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe027fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0280c7230 con 0x7fe02806e0a0 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe027fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02806b930 con 0x7fe028150380 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe0267fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe02806f3a0 0x7fe02814fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48658/0 (socket says 172.21.15.12:48658) 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe0267fc700 1 -- 172.21.15.12:0/902791201 learned_addr learned my addr 172.21.15.12:0/902791201 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:39.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe0277fe700 1 --2- 172.21.15.12:0/902791201 >> v2:172.21.15.29:3300/0 conn(0x7fe028150380 0x7fe028160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286686677 0 0) 0x7fe02806a490 con 0x7fe02806f3a0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe010004680 con 0x7fe02806f3a0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982054730 0 0) 0x7fe0280c7230 con 0x7fe02806e0a0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.327+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe02806a490 con 0x7fe02806e0a0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe0277fe700 1 -- 172.21.15.12:0/902791201 >> v1:172.21.15.29:6789/0 conn(0x7fe02806e0a0 legacy=0x7fe0280c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe0277fe700 1 -- 172.21.15.12:0/902791201 >> v1:172.21.15.12:6789/0 conn(0x7fe02806f3a0 legacy=0x7fe02814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe0277fe700 1 -- 172.21.15.12:0/902791201 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0280c7490 con 0x7fe028150380 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe0277fe700 1 --2- 172.21.15.12:0/902791201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028150380 0x7fe028160ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe020009e60 tx=0x7fe020009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc8784e3d830eb13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02000bab0 con 0x7fe028150380 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02000bc10 con 0x7fe028150380 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.328+0000 7fe025ffb700 1 -- 172.21.15.12:0/902791201 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe020011460 con 0x7fe028150380 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 -- 172.21.15.12:0/902791201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028150380 msgr2=0x7fe028160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 --2- 172.21.15.12:0/902791201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028150380 0x7fe028160ae0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe020009e60 tx=0x7fe020009780 comp rx=0 tx=0).stop 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 -- 172.21.15.12:0/902791201 shutdown_connections 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 --2- 172.21.15.12:0/902791201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe028150380 0x7fe028160ae0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 -- 172.21.15.12:0/902791201 >> 172.21.15.12:0/902791201 conn(0x7fe02806d170 msgr2=0x7fe0280cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 -- 172.21.15.12:0/902791201 shutdown_connections 2023-10-08T16:25:39.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.329+0000 7fe027fff700 1 -- 172.21.15.12:0/902791201 wait complete. 2023-10-08T16:25:39.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.330+0000 7fe027fff700 1 Processor -- start 2023-10-08T16:25:39.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.330+0000 7fe027fff700 1 -- start start 2023-10-08T16:25:39.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 0x7fe028158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe028150380 0x7fe02814a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0281571b0 con 0x7fe02806f3a0 2023-10-08T16:25:39.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02814b980 con 0x7fe02806e0a0 2023-10-08T16:25:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe027fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe028157470 con 0x7fe028150380 2023-10-08T16:25:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.331+0000 7fe0267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41304/0 (socket says 172.21.15.12:41304) 2023-10-08T16:25:39.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 -- 172.21.15.12:0/1086622655 learned_addr learned my addr 172.21.15.12:0/1086622655 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:39.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe026ffd700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 0x7fe028158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0277fe700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe028150380 0x7fe02814a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 -- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe028150380 msgr2=0x7fe02814a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe028150380 0x7fe02814a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 -- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 msgr2=0x7fe028158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 0x7fe028158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 -- 172.21.15.12:0/1086622655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe020009a20 con 0x7fe02806f3a0 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe026ffd700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 0x7fe028158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:39.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe0267fc700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c790 tx=0x7fe01c007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c007300 con 0x7fe02806f3a0 2023-10-08T16:25:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c007460 con 0x7fe02806f3a0 2023-10-08T16:25:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.332+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02814ae80 con 0x7fe02806f3a0 2023-10-08T16:25:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.333+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0057f0 con 0x7fe02806f3a0 2023-10-08T16:25:39.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.333+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02814b3c0 con 0x7fe02806f3a0 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.333+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0281575e0 con 0x7fe02806f3a0 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.334+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe01c005be0 con 0x7fe02806f3a0 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.335+0000 7fe00effd700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.335+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7fe01c0841b0 con 0x7fe02806f3a0 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.336+0000 7fe026ffd700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.336+0000 7fe026ffd700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe018007fd0 tx=0x7fe018009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.339+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe01c051340 con 0x7fe02806f3a0 2023-10-08T16:25:39.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.589+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02804c3c0 con 0x7fe02806f3a0 2023-10-08T16:25:39.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.590+0000 7fe00effd700 1 -- 172.21.15.12:0/1086622655 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fe01c054960 con 0x7fe02806f3a0 2023-10-08T16:25:39.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:39.591 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":44,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3639099219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3639099219},{"type":"v1","addr":"172.21.15.29:6835","nonce":3639099219}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6553,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/649476630","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":649476630},{"type":"v1","addr":"172.21.15.29:6834","nonce":649476630}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6756,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2490517821","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2490517821},{"type":"v1","addr":"172.21.15.12:6833","nonce":2490517821}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37},{"gid":6759,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/486303614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":486303614},{"type":"v1","addr":"172.21.15.12:6835","nonce":486303614}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 msgr2=0x7fe0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 0x7fe0140693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe018007fd0 tx=0x7fe018009040 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 msgr2=0x7fe0280aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00c790 tx=0x7fe01c007ce0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 shutdown_connections 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe014066f30 0x7fe0140693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe028150380 0x7fe02814a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe02806e0a0 0x7fe028158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 --2- 172.21.15.12:0/1086622655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe02806f3a0 0x7fe0280aeed0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.592+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 >> 172.21.15.12:0/1086622655 conn(0x7fe02806d170 msgr2=0x7fe02814d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:39.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.593+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 shutdown_connections 2023-10-08T16:25:39.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.593+0000 7fe027fff700 1 -- 172.21.15.12:0/1086622655 wait complete. 2023-10-08T16:25:39.595 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 44 2023-10-08T16:25:39.611 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:25:39.611 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:25:39.612 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:25:39.612 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:25:39.612 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:25:39.612 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:25:39.612 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:25:39.612 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:25:39.613 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:25:39.613 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:25:39.613 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:25:39.613 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:25:39.613 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:25:39.614 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:25:39.614 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:25:39.614 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:25:39.626 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:25:39.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:25:39.627 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:25:39.627 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:25:39.630 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:25:39.630 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:25:39.631 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:25:39.631 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:25:39.670 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:25:39.671 DEBUG:teuthology.parallel:result is None 2023-10-08T16:25:39.673 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:25:39.673 DEBUG:teuthology.parallel:result is None 2023-10-08T16:25:39.675 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:25:39.675 DEBUG:teuthology.parallel:result is None 2023-10-08T16:25:39.678 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:25:39.678 DEBUG:teuthology.parallel:result is None 2023-10-08T16:25:39.678 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:25:39.808 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:25:39.808 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:25:39.819 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:25:39.819 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:25:39.821 INFO:tasks.ceph.mds.d.smithi029.stderr:2023-10-08T16:25:39.820+0000 7f4e869fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T16:25:39.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-10-08T16:25:39.833 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-08T16:25:39.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.876+0000 7f9ee359e700 1 Processor -- start 2023-10-08T16:25:39.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.876+0000 7f9ee359e700 1 -- start start 2023-10-08T16:25:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9ee4159a10 0x7f9ee40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ee40c7420 con 0x7f9ee4159640 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee406d820 con 0x7f9ee4159a10 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee406db00 con 0x7f9ee4070410 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9ee4159640 0x7f9ee406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48680/0 (socket says 172.21.15.12:48680) 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee259c700 1 -- 172.21.15.12:0/3399274120 learned_addr learned my addr 172.21.15.12:0/3399274120 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/3399274120 >> v2:172.21.15.12:3300/0 conn(0x7f9ee4159a10 0x7f9ee40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee2d9d700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.878+0000 7f9ee159a700 1 -- 172.21.15.12:0/3399274120 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721894198 0 0) 0x7f9ee40c7420 con 0x7f9ee4159640 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee159a700 1 -- 172.21.15.12:0/3399274120 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ecc003570 con 0x7f9ee4159640 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/3399274120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 msgr2=0x7f9ee40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:39.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/3399274120 >> v1:172.21.15.12:6789/0 conn(0x7f9ee4159640 legacy=0x7f9ee406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/3399274120 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee406dde0 con 0x7f9ee4159a10 2023-10-08T16:25:39.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159a10 0x7f9ee40ca7b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80098e0 tx=0x7f9ed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9240b4d0e33d98fa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee159a700 1 -- 172.21.15.12:0/3399274120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011630 con 0x7f9ee4159a10 2023-10-08T16:25:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee159a700 1 -- 172.21.15.12:0/3399274120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8011790 con 0x7f9ee4159a10 2023-10-08T16:25:39.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.879+0000 7f9ee159a700 1 -- 172.21.15.12:0/3399274120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011b30 con 0x7f9ee4159a10 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 -- 172.21.15.12:0/3399274120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159a10 msgr2=0x7f9ee40ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159a10 0x7f9ee40ca7b0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80098e0 tx=0x7f9ed80091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 -- 172.21.15.12:0/3399274120 shutdown_connections 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 --2- 172.21.15.12:0/3399274120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159a10 0x7f9ee40ca7b0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 -- 172.21.15.12:0/3399274120 >> 172.21.15.12:0/3399274120 conn(0x7f9ee406e720 msgr2=0x7f9ee406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 -- 172.21.15.12:0/3399274120 shutdown_connections 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.880+0000 7f9ee359e700 1 -- 172.21.15.12:0/3399274120 wait complete. 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.881+0000 7f9ee359e700 1 Processor -- start 2023-10-08T16:25:39.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.881+0000 7f9ee359e700 1 -- start start 2023-10-08T16:25:39.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee416a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee4159a10 0x7f9ee416a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee416bbb0 con 0x7f9ee4159640 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee416afa0 con 0x7f9ee4159a10 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.882+0000 7f9ee359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee416b280 con 0x7f9ee4070410 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41358/0 (socket says 172.21.15.12:41358) 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/2162254316 learned_addr learned my addr 172.21.15.12:0/2162254316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee259c700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee416a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee2d9d700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee4159a10 0x7f9ee416a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 msgr2=0x7f9ee416a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee416a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee4159a10 msgr2=0x7f9ee416a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee4159a10 0x7f9ee416a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 -- 172.21.15.12:0/2162254316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed8009420 con 0x7f9ee4159640 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.883+0000 7f9ee1d9b700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8013000 tx=0x7f9ed8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.884+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8011b10 con 0x7f9ee4159640 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.884+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed80253f0 con 0x7f9ee4159640 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.884+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee416b560 con 0x7f9ee4159640 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.884+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8025790 con 0x7f9ee4159640 2023-10-08T16:25:39.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.884+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee416a740 con 0x7f9ee4159640 2023-10-08T16:25:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.885+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee416bd60 con 0x7f9ee4159640 2023-10-08T16:25:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.886+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ed8025b80 con 0x7f9ee4159640 2023-10-08T16:25:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.887+0000 7f9ed27fc700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.887+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5890+0+0 (secure 0 0 0) 0x7f9ed8085db0 con 0x7f9ee4159640 2023-10-08T16:25:39.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.887+0000 7f9ee259c700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:39.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.888+0000 7f9ee259c700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 0x7f9ec40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40058d0 tx=0x7f9ed4009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:39.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:39.891+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ee416bd60 con 0x7f9ee4159640 2023-10-08T16:25:40.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.113+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9ee416bcf0 con 0x7f9ee4159640 2023-10-08T16:25:40.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.963+0000 7f9ed27fc700 1 -- 172.21.15.12:0/2162254316 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9ed8015080 con 0x7f9ee4159640 2023-10-08T16:25:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 msgr2=0x7f9ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 0x7f9ec40693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9ed40058d0 tx=0x7f9ed4009040 comp rx=0 tx=0).stop 2023-10-08T16:25:40.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 msgr2=0x7f9ee40ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8013000 tx=0x7f9ed8017000 comp rx=0 tx=0).stop 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 shutdown_connections 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9ec4066f30 0x7f9ec40693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ee4159a10 0x7f9ee416a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ee4070410 0x7f9ee416a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 --2- 172.21.15.12:0/2162254316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ee4159640 0x7f9ee40ae2e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 >> 172.21.15.12:0/2162254316 conn(0x7f9ee406e720 msgr2=0x7f9ee4158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.966+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 shutdown_connections 2023-10-08T16:25:40.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:40.967+0000 7f9ee359e700 1 -- 172.21.15.12:0/2162254316 wait complete. 2023-10-08T16:25:40.969 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:25:40.987 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:25:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.178+0000 7fe33ef9d700 1 Processor -- start 2023-10-08T16:25:41.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.178+0000 7fe33ef9d700 1 -- start start 2023-10-08T16:25:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.179+0000 7fe33ef9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe33813fef0 0x7fe33815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.179+0000 7fe33ef9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33815ae70 con 0x7fe33806aaa0 2023-10-08T16:25:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.179+0000 7fe33ef9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33806af60 con 0x7fe33813fb20 2023-10-08T16:25:41.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.179+0000 7fe33ef9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33806b240 con 0x7fe33813fef0 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33e79c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe33806aaa0 0x7fe3380c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48682/0 (socket says 172.21.15.12:48682) 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33e79c700 1 -- 172.21.15.12:0/3050320233 learned_addr learned my addr 172.21.15.12:0/3050320233 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33d79a700 1 --2- 172.21.15.12:0/3050320233 >> v2:172.21.15.29:3300/0 conn(0x7fe33813fef0 0x7fe33815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577537621 0 0) 0x7fe330001490 con 0x7fe33806aaa0 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe324003570 con 0x7fe33806aaa0 2023-10-08T16:25:41.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341103678 0 0) 0x7fe33806af60 con 0x7fe33813fb20 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe330001490 con 0x7fe33813fb20 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33d79a700 1 -- 172.21.15.12:0/3050320233 >> v1:172.21.15.29:6789/0 conn(0x7fe33813fb20 legacy=0x7fe3380c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33d79a700 1 -- 172.21.15.12:0/3050320233 >> v1:172.21.15.12:6789/0 conn(0x7fe33806aaa0 legacy=0x7fe3380c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.180+0000 7fe33d79a700 1 -- 172.21.15.12:0/3050320233 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33806b520 con 0x7fe33813fef0 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.181+0000 7fe33d79a700 1 --2- 172.21.15.12:0/3050320233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fef0 0x7fe33815a930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098d0 tx=0x7fe328009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb1dd213b9227771 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.181+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328005c10 con 0x7fe33813fef0 2023-10-08T16:25:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.181+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe328005d70 con 0x7fe33813fef0 2023-10-08T16:25:41.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.181+0000 7fe33cf99700 1 -- 172.21.15.12:0/3050320233 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328006260 con 0x7fe33813fef0 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 -- 172.21.15.12:0/3050320233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fef0 msgr2=0x7fe33815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/3050320233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fef0 0x7fe33815a930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098d0 tx=0x7fe328009120 comp rx=0 tx=0).stop 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 -- 172.21.15.12:0/3050320233 shutdown_connections 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/3050320233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fef0 0x7fe33815a930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 -- 172.21.15.12:0/3050320233 >> 172.21.15.12:0/3050320233 conn(0x7fe33806d170 msgr2=0x7fe3380cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 -- 172.21.15.12:0/3050320233 shutdown_connections 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.182+0000 7fe33ef9d700 1 -- 172.21.15.12:0/3050320233 wait complete. 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.183+0000 7fe33ef9d700 1 Processor -- start 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.183+0000 7fe33ef9d700 1 -- start start 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 0x7fe33813e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe33813fef0 0x7fe33813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33813f190 con 0x7fe33806aaa0 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe338158930 con 0x7fe33813fb20 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33ef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe338158c10 con 0x7fe33813fef0 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.184+0000 7fe33df9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41364/0 (socket says 172.21.15.12:41364) 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 -- 172.21.15.12:0/2977979911 learned_addr learned my addr 172.21.15.12:0/2977979911 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33d79a700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 0x7fe33813e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33e79c700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe33813fef0 0x7fe33813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 -- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe33813fef0 msgr2=0x7fe33813ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe33813fef0 0x7fe33813ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 -- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 msgr2=0x7fe33813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 0x7fe33813e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 -- 172.21.15.12:0/2977979911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3280093c0 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33d79a700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 0x7fe33813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe33df9b700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c790 tx=0x7fe334007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334010510 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.185+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe334010670 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.186+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334010a10 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.186+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe338158ef0 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.186+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3381594b0 con 0x7fe33806aaa0 2023-10-08T16:25:41.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.187+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3381596a0 con 0x7fe33806aaa0 2023-10-08T16:25:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.187+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe33401b400 con 0x7fe33806aaa0 2023-10-08T16:25:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.188+0000 7fe32dffb700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 0x7fe31c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.188+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fe3340841d0 con 0x7fe33806aaa0 2023-10-08T16:25:41.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.189+0000 7fe33d79a700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 0x7fe31c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.189+0000 7fe33d79a700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 0x7fe31c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098d0 tx=0x7fe328016000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.193+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe334051570 con 0x7fe33806aaa0 2023-10-08T16:25:41.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.476+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe33804c3c0 con 0x7fe33806aaa0 2023-10-08T16:25:41.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.477+0000 7fe32dffb700 1 -- 172.21.15.12:0/2977979911 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe334054b90 con 0x7fe33806aaa0 2023-10-08T16:25:41.478 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:41.478 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:25:41.478 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:25:41.478 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:25:41.479 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.480 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:25:41.481 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.482 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:25:41.483 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.484 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.485 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:25:41.486 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:25:41.487 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.488 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.489 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:25:41.490 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.491 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:25:41.492 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:25:41.493 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:25:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 msgr2=0x7fe31c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 0x7fe31c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3280098d0 tx=0x7fe328016000 comp rx=0 tx=0).stop 2023-10-08T16:25:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 msgr2=0x7fe3380af300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c790 tx=0x7fe334007e10 comp rx=0 tx=0).stop 2023-10-08T16:25:41.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 shutdown_connections 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.479+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe31c066f30 0x7fe31c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe33806aaa0 0x7fe3380af300 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe33813fef0 0x7fe33813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 --2- 172.21.15.12:0/2977979911 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe33813fb20 0x7fe33813e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 >> 172.21.15.12:0/2977979911 conn(0x7fe33806d170 msgr2=0x7fe3380c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 shutdown_connections 2023-10-08T16:25:41.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.480+0000 7fe33ef9d700 1 -- 172.21.15.12:0/2977979911 wait complete. 2023-10-08T16:25:41.498 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.685+0000 7f2052b9d700 1 Processor -- start 2023-10-08T16:25:41.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.685+0000 7f2052b9d700 1 -- start start 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f2052b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f204c1596d0 0x7f204c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f2052b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c06d3e0 con 0x7f204c159aa0 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f2052b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c06c7d0 con 0x7f204c0ca7b0 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f2052b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c06cab0 con 0x7f204c1596d0 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f205139a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f204c159aa0 0x7f204c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48690/0 (socket says 172.21.15.12:48690) 2023-10-08T16:25:41.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f205139a700 1 -- 172.21.15.12:0/2941271538 learned_addr learned my addr 172.21.15.12:0/2941271538 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.687+0000 7f2051b9b700 1 --2- 172.21.15.12:0/2941271538 >> v2:172.21.15.29:3300/0 conn(0x7f204c1596d0 0x7f204c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217115213 0 0) 0x7f204c06d3e0 con 0x7f204c159aa0 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2038003570 con 0x7f204c159aa0 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1990377779 0 0) 0x7f2038003570 con 0x7f204c159aa0 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 >> v2:172.21.15.29:3300/0 conn(0x7f204c1596d0 msgr2=0x7f204c06d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 --2- 172.21.15.12:0/2941271538 >> v2:172.21.15.29:3300/0 conn(0x7f204c1596d0 0x7f204c06d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 >> v1:172.21.15.29:6789/0 conn(0x7f204c0ca7b0 legacy=0x7f204c15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c06cd90 con 0x7f204c159aa0 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f203c001470 con 0x7f204c159aa0 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 >> v1:172.21.15.12:6789/0 conn(0x7f204c159aa0 legacy=0x7f204c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2038003ab0 0x7f2038003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2038004810 0x7f2038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f203800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c06cab0 con 0x7f2038005290 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203800c250 con 0x7f2038004810 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203800c410 con 0x7f2038003ab0 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f205239c700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f203800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.688+0000 7f2051b9b700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2038003ab0 0x7f2038003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205139a700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2038004810 0x7f2038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 -- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2038003ab0 msgr2=0x7f2038003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2038003ab0 0x7f2038003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 -- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2038004810 msgr2=0x7f2038004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2038004810 0x7f2038004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 -- 172.21.15.12:0/2941271538 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038003570 con 0x7f2038005290 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 -- 172.21.15.12:0/2941271538 reap_dead start 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f205239c700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f203800ba60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2044001fc0 tx=0x7f2044001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138dc69db39e9962 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044001950 con 0x7f2038005290 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204400c8b0 con 0x7f2038005290 2023-10-08T16:25:41.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.689+0000 7f2050b99700 1 -- 172.21.15.12:0/2941271538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204400cc90 con 0x7f2038005290 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 -- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 msgr2=0x7f203800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f203800ba60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f2044001fc0 tx=0x7f2044001640 comp rx=0 tx=0).stop 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 -- 172.21.15.12:0/2941271538 shutdown_connections 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 --2- 172.21.15.12:0/2941271538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f203800ba60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 -- 172.21.15.12:0/2941271538 >> 172.21.15.12:0/2941271538 conn(0x7f204c06e720 msgr2=0x7f204c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 -- 172.21.15.12:0/2941271538 shutdown_connections 2023-10-08T16:25:41.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.690+0000 7f2052b9d700 1 -- 172.21.15.12:0/2941271538 wait complete. 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.691+0000 7f2052b9d700 1 Processor -- start 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 -- start start 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204c0c8120 0x7f204c0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f204c15afe0 0x7f204c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c15b990 con 0x7f2038005290 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c9820 con 0x7f204c15afe0 2023-10-08T16:25:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.692+0000 7f2052b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0c8c10 con 0x7f204c0c8120 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:41378/0 (socket says 172.21.15.12:41378) 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 -- 172.21.15.12:0/3912527040 learned_addr learned my addr 172.21.15.12:0/3912527040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 -- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204c0c8120 msgr2=0x7f204c0c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204c0c8120 0x7f204c0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 -- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f204c15afe0 msgr2=0x7f204c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f204c15afe0 0x7f204c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 -- 172.21.15.12:0/3912527040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0c8ef0 con 0x7f2038005290 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2051b9b700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2048006ac0 tx=0x7f20480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800fa10 con 0x7f2038005290 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.693+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204800fb70 con 0x7f2038005290 2023-10-08T16:25:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.694+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c0c91d0 con 0x7f2038005290 2023-10-08T16:25:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.694+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048014440 con 0x7f2038005290 2023-10-08T16:25:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.694+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c143d40 con 0x7f2038005290 2023-10-08T16:25:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.695+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c070730 con 0x7f2038005290 2023-10-08T16:25:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.696+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2048014830 con 0x7f2038005290 2023-10-08T16:25:41.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.697+0000 7f2041ffb700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:41.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.697+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f2048018030 con 0x7f2038005290 2023-10-08T16:25:41.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.697+0000 7f205139a700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:41.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.698+0000 7f205139a700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 0x7f20300693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f203c0015a0 tx=0x7f203c001460 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.701+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2048052230 con 0x7f2038005290 2023-10-08T16:25:41.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.906+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f204c06d070 con 0x7f2038005290 2023-10-08T16:25:41.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.907+0000 7f2041ffb700 1 -- 172.21.15.12:0/3912527040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+12779 (secure 0 0 0) 0x7f2048022090 con 0x7f2038005290 2023-10-08T16:25:41.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:41.909 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":109,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:40.959731+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:41.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 msgr2=0x7f20300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 0x7f20300693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f203c0015a0 tx=0x7f203c001460 comp rx=0 tx=0).stop 2023-10-08T16:25:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 msgr2=0x7f204c143800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2048006ac0 tx=0x7f20480091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 shutdown_connections 2023-10-08T16:25:41.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.909+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2030066f30 0x7f20300693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2038005290 0x7f204c143800 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f204c15afe0 0x7f204c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 --2- 172.21.15.12:0/3912527040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f204c0c8120 0x7f204c0c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 >> 172.21.15.12:0/3912527040 conn(0x7f204c06e720 msgr2=0x7f204c154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:41.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 shutdown_connections 2023-10-08T16:25:41.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:41.910+0000 7f2052b9d700 1 -- 172.21.15.12:0/3912527040 wait complete. 2023-10-08T16:25:41.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:25:41.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:25:42.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.119+0000 7f7edef9d700 1 Processor -- start 2023-10-08T16:25:42.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.119+0000 7f7edef9d700 1 -- start start 2023-10-08T16:25:42.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.120+0000 7f7edef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed8142c00 0x7f7ed806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.120+0000 7f7edef9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ed806bd20 0x7f7ed80c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.120+0000 7f7edef9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80ca480 con 0x7f7ed8142fd0 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.120+0000 7f7edef9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed815e240 con 0x7f7ed806bd20 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.120+0000 7f7edef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed806b350 con 0x7f7ed8142c00 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ed806bd20 0x7f7ed80c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ed806bd20 0x7f7ed80c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53572/0 (socket says 172.21.15.12:53572) 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 -- 172.21.15.12:0/675112159 learned_addr learned my addr 172.21.15.12:0/675112159 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7eddf9b700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed8142c00 0x7f7ed806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 -- 172.21.15.12:0/675112159 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed8142c00 msgr2=0x7f7ed806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:42.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed8142c00 0x7f7ed806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 -- 172.21.15.12:0/675112159 >> v1:172.21.15.29:6789/0 conn(0x7f7ed8142fd0 legacy=0x7f7ed806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.121+0000 7f7edd79a700 1 -- 172.21.15.12:0/675112159 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed815df60 con 0x7f7ed806bd20 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.122+0000 7f7edd79a700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed806bd20 0x7f7ed80c7880 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80099b0 tx=0x7f7ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d19159c974f97833 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.122+0000 7f7edcf99700 1 -- 172.21.15.12:0/675112159 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800b860 con 0x7f7ed806bd20 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.122+0000 7f7edcf99700 1 -- 172.21.15.12:0/675112159 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec800b9c0 con 0x7f7ed806bd20 2023-10-08T16:25:42.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.122+0000 7f7edcf99700 1 -- 172.21.15.12:0/675112159 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800bd80 con 0x7f7ed806bd20 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 -- 172.21.15.12:0/675112159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed806bd20 msgr2=0x7f7ed80c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed806bd20 0x7f7ed80c7880 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80099b0 tx=0x7f7ec8009250 comp rx=0 tx=0).stop 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 -- 172.21.15.12:0/675112159 shutdown_connections 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed8142c00 0x7f7ed806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 --2- 172.21.15.12:0/675112159 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed806bd20 0x7f7ed80c7880 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 -- 172.21.15.12:0/675112159 >> 172.21.15.12:0/675112159 conn(0x7f7ed80675a0 msgr2=0x7f7ed80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 -- 172.21.15.12:0/675112159 shutdown_connections 2023-10-08T16:25:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.123+0000 7f7edef9d700 1 -- 172.21.15.12:0/675112159 wait complete. 2023-10-08T16:25:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.124+0000 7f7edef9d700 1 Processor -- start 2023-10-08T16:25:42.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.124+0000 7f7edef9d700 1 -- start start 2023-10-08T16:25:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed806bd20 0x7f7ed813d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ed8142c00 0x7f7ed80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80b0590 con 0x7f7ed8142fd0 2023-10-08T16:25:42.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed813e580 con 0x7f7ed8142c00 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.125+0000 7f7edef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8159520 con 0x7f7ed806bd20 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53576/0 (socket says 172.21.15.12:53576) 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 -- 172.21.15.12:0/3475770156 learned_addr learned my addr 172.21.15.12:0/3475770156 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7eddf9b700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed806bd20 0x7f7ed813d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7edd79a700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ed8142c00 0x7f7ed80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 -- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed806bd20 msgr2=0x7f7ed813d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed806bd20 0x7f7ed813d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 -- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ed8142c00 msgr2=0x7f7ed80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ed8142c00 0x7f7ed80b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 -- 172.21.15.12:0/3475770156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80094f0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.126+0000 7f7ede79c700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c840 tx=0x7f7ed0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.127+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0012630 con 0x7f7ed8142fd0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.127+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed00127b0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.127+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0012b70 con 0x7f7ed8142fd0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.127+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed813d970 con 0x7f7ed8142fd0 2023-10-08T16:25:42.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.127+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed813df30 con 0x7f7ed8142fd0 2023-10-08T16:25:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.128+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed813e6f0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.129+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ed001a3a0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.130+0000 7f7ecdffb700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 0x7f7ebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.130+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f7ed0084530 con 0x7f7ed8142fd0 2023-10-08T16:25:42.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.130+0000 7f7eddf9b700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 0x7f7ebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.131+0000 7f7eddf9b700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 0x7f7ebc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4006fd0 tx=0x7f7ed4008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.134+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ed00518d0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.334+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ed804c3c0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.335+0000 7f7ecdffb700 1 -- 172.21.15.12:0/3475770156 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ed0054ef0 con 0x7f7ed8142fd0 2023-10-08T16:25:42.336 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:25:42.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 msgr2=0x7f7ebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 0x7f7ebc0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4006fd0 tx=0x7f7ed4008040 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 msgr2=0x7f7ed8158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c840 tx=0x7f7ed0001670 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 shutdown_connections 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7ebc066f30 0x7f7ebc0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ed8142fd0 0x7f7ed8158fe0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ed806bd20 0x7f7ed813d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 --2- 172.21.15.12:0/3475770156 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ed8142c00 0x7f7ed80b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.337+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 >> 172.21.15.12:0/3475770156 conn(0x7f7ed80675a0 msgr2=0x7f7ed806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.338+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 shutdown_connections 2023-10-08T16:25:42.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.338+0000 7f7edef9d700 1 -- 172.21.15.12:0/3475770156 wait complete. 2023-10-08T16:25:42.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:25:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.543+0000 7f5163fff700 1 Processor -- start 2023-10-08T16:25:42.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.543+0000 7f5163fff700 1 -- start start 2023-10-08T16:25:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.544+0000 7f5163fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f516413fb20 0x7f516415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.544+0000 7f5163fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 0x7f51640c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.544+0000 7f5163fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f516415ae70 con 0x7f516406aaa0 2023-10-08T16:25:42.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.544+0000 7f5163fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f516406af60 con 0x7f516413fb20 2023-10-08T16:25:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.544+0000 7f5163fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516406b240 con 0x7f516413fef0 2023-10-08T16:25:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f516413fb20 0x7f516415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f51637fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f516406aaa0 0x7f51640c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40814/0 (socket says 172.21.15.12:40814) 2023-10-08T16:25:42.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f51637fe700 1 -- 172.21.15.12:0/3793393333 learned_addr learned my addr 172.21.15.12:0/3793393333 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f51627fc700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 0x7f51640c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5161ffb700 1 -- 172.21.15.12:0/3793393333 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654031357 0 0) 0x7f515c001490 con 0x7f516406aaa0 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5161ffb700 1 -- 172.21.15.12:0/3793393333 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f514c003570 con 0x7f516406aaa0 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 -- 172.21.15.12:0/3793393333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 msgr2=0x7f51640c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 0x7f51640c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 -- 172.21.15.12:0/3793393333 >> v1:172.21.15.12:6789/0 conn(0x7f516406aaa0 legacy=0x7f51640c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 -- 172.21.15.12:0/3793393333 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516406b520 con 0x7f516413fb20 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f51627fc700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 0x7f51640c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.545+0000 7f5162ffd700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fb20 0x7f516415a930 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94236b0af205f5ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5161ffb700 1 -- 172.21.15.12:0/3793393333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400f6b0 con 0x7f516413fb20 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5161ffb700 1 -- 172.21.15.12:0/3793393333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515400f810 con 0x7f516413fb20 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5161ffb700 1 -- 172.21.15.12:0/3793393333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515400fbb0 con 0x7f516413fb20 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 -- 172.21.15.12:0/3793393333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fb20 msgr2=0x7f516415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fb20 0x7f516415a930 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f51540098e0 tx=0x7f51540091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 -- 172.21.15.12:0/3793393333 shutdown_connections 2023-10-08T16:25:42.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fb20 0x7f516415a930 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 --2- 172.21.15.12:0/3793393333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516413fef0 0x7f51640c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 -- 172.21.15.12:0/3793393333 >> 172.21.15.12:0/3793393333 conn(0x7f516406d170 msgr2=0x7f51640cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 -- 172.21.15.12:0/3793393333 shutdown_connections 2023-10-08T16:25:42.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.546+0000 7f5163fff700 1 -- 172.21.15.12:0/3793393333 wait complete. 2023-10-08T16:25:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.548+0000 7f5163fff700 1 Processor -- start 2023-10-08T16:25:42.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.548+0000 7f5163fff700 1 -- start start 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516406aaa0 0x7f51640c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f516413fb20 0x7f51640c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164169cf0 con 0x7f516413fef0 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5164169fd0 con 0x7f516413fb20 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5163fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f516416a2b0 con 0x7f516406aaa0 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f51637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f51637fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53584/0 (socket says 172.21.15.12:53584) 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f51637fe700 1 -- 172.21.15.12:0/1179212045 learned_addr learned my addr 172.21.15.12:0/1179212045 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f5162ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516406aaa0 0x7f51640c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.549+0000 7f51627fc700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f516413fb20 0x7f51640c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 -- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516406aaa0 msgr2=0x7f51640c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516406aaa0 0x7f51640c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 -- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f516413fb20 msgr2=0x7f51640c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f516413fb20 0x7f51640c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 -- 172.21.15.12:0/1179212045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5154009420 con 0x7f516413fef0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f51637fe700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f515c0015f0 tx=0x7f515c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00a8b0 con 0x7f516413fef0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f515c00aa10 con 0x7f516413fef0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516416a590 con 0x7f516413fef0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f515c00ad90 con 0x7f516413fef0 2023-10-08T16:25:42.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.550+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5164155e90 con 0x7f516413fef0 2023-10-08T16:25:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.551+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516416aab0 con 0x7f516413fef0 2023-10-08T16:25:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.552+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f515c007300 con 0x7f516413fef0 2023-10-08T16:25:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.553+0000 7f514affd700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 0x7f51500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.553+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f515c0845c0 con 0x7f516413fef0 2023-10-08T16:25:42.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.553+0000 7f5162ffd700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 0x7f51500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.554+0000 7f5162ffd700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 0x7f51500693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51540093f0 tx=0x7f5154019000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.557+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f516416aab0 con 0x7f516413fef0 2023-10-08T16:25:42.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.760+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f516415ae70 con 0x7f516413fef0 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.761+0000 7f514affd700 1 -- 172.21.15.12:0/1179212045 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+65 (secure 0 0 0) 0x7f516415ae70 con 0x7f516413fef0 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:42.762 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:25:42.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 msgr2=0x7f51500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 0x7f51500693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f51540093f0 tx=0x7f5154019000 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 msgr2=0x7f51640ac150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f515c0015f0 tx=0x7f515c001a10 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 shutdown_connections 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5150066f30 0x7f51500693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f516413fef0 0x7f51640ac150 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f516406aaa0 0x7f51640c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 --2- 172.21.15.12:0/1179212045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f516413fb20 0x7f51640c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.763+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 >> 172.21.15.12:0/1179212045 conn(0x7f516406d170 msgr2=0x7f516415faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.764+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 shutdown_connections 2023-10-08T16:25:42.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.764+0000 7f5163fff700 1 -- 172.21.15.12:0/1179212045 wait complete. 2023-10-08T16:25:42.782 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:25:42.782 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:25:42.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.972+0000 7f426af9d700 1 Processor -- start 2023-10-08T16:25:42.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.973+0000 7f426af9d700 1 -- start start 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f42640b24f0 0x7f42640b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b1d40 0x7f42641590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426af9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42640b0c80 con 0x7f42640b28c0 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640d10d0 con 0x7f42640b24f0 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b0f60 con 0x7f42640b1d40 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426a79c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f42640b28c0 0x7f426415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40822/0 (socket says 172.21.15.12:40822) 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426a79c700 1 -- 172.21.15.12:0/2463150671 learned_addr learned my addr 172.21.15.12:0/2463150671 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f4269f9b700 1 --2- 172.21.15.12:0/2463150671 >> v2:172.21.15.12:3300/0 conn(0x7f42640b24f0 0x7f42640b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.974+0000 7f426979a700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b1d40 0x7f42641590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4268f99700 1 -- 172.21.15.12:0/2463150671 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213206544 0 0) 0x7f42640b0c80 con 0x7f42640b28c0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4268f99700 1 -- 172.21.15.12:0/2463150671 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4250003570 con 0x7f42640b28c0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4269f9b700 1 -- 172.21.15.12:0/2463150671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b1d40 msgr2=0x7f42641590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4269f9b700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b1d40 0x7f42641590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4269f9b700 1 -- 172.21.15.12:0/2463150671 >> v1:172.21.15.12:6789/0 conn(0x7f42640b28c0 legacy=0x7f426415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4269f9b700 1 -- 172.21.15.12:0/2463150671 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640b1240 con 0x7f42640b24f0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4269f9b700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b24f0 0x7f42640b0580 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f42600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817a4bfc023e3b33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4268f99700 1 -- 172.21.15.12:0/2463150671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000b640 con 0x7f42640b24f0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4268f99700 1 -- 172.21.15.12:0/2463150671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426000b7a0 con 0x7f42640b24f0 2023-10-08T16:25:42.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.975+0000 7f4268f99700 1 -- 172.21.15.12:0/2463150671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000bb40 con 0x7f42640b24f0 2023-10-08T16:25:42.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 -- 172.21.15.12:0/2463150671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b24f0 msgr2=0x7f42640b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b24f0 0x7f42640b0580 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f42600098e0 tx=0x7f42600091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 -- 172.21.15.12:0/2463150671 shutdown_connections 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b24f0 0x7f42640b0580 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 --2- 172.21.15.12:0/2463150671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b1d40 0x7f42641590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 -- 172.21.15.12:0/2463150671 >> 172.21.15.12:0/2463150671 conn(0x7f42640703a0 msgr2=0x7f42640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 -- 172.21.15.12:0/2463150671 shutdown_connections 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.976+0000 7f426af9d700 1 -- 172.21.15.12:0/2463150671 wait complete. 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.977+0000 7f426af9d700 1 Processor -- start 2023-10-08T16:25:42.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.977+0000 7f426af9d700 1 -- start start 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 0x7f42640c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640b28c0 0x7f4264154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c6a30 con 0x7f42640b1d40 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c6d10 con 0x7f42640b28c0 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.978+0000 7f426af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640c6ff0 con 0x7f42640b24f0 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53598/0 (socket says 172.21.15.12:53598) 2023-10-08T16:25:42.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 -- 172.21.15.12:0/137887234 learned_addr learned my addr 172.21.15.12:0/137887234 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f426979a700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 0x7f42640c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f426a79c700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640b28c0 0x7f4264154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 -- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 msgr2=0x7f42640c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 0x7f42640c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 -- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640b28c0 msgr2=0x7f4264154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640b28c0 0x7f4264154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 -- 172.21.15.12:0/137887234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4260009420 con 0x7f42640b1d40 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f426979a700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 0x7f42640c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.979+0000 7f4269f9b700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f4264089370 tx=0x7f4260017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.980+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426001bda0 con 0x7f42640b1d40 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.980+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4260011420 con 0x7f42640b1d40 2023-10-08T16:25:42.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.980+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42640c72d0 con 0x7f42640b1d40 2023-10-08T16:25:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.980+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600117e0 con 0x7f42640b1d40 2023-10-08T16:25:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.980+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4264169740 con 0x7f42640b1d40 2023-10-08T16:25:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.981+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640c7460 con 0x7f42640b1d40 2023-10-08T16:25:42.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.981+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4260011b90 con 0x7f42640b1d40 2023-10-08T16:25:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.982+0000 7f4259ffb700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 0x7f42480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.982+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f4260085b10 con 0x7f42640b1d40 2023-10-08T16:25:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.983+0000 7f426979a700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 0x7f42480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:42.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.983+0000 7f426979a700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 0x7f42480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4264158cd0 tx=0x7f4254008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:42.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:42.987+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4260052f60 con 0x7f42640b1d40 2023-10-08T16:25:43.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.189+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f426404c3c0 con 0x7f42640b1d40 2023-10-08T16:25:43.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.540+0000 7f4259ffb700 1 -- 172.21.15.12:0/137887234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4260056580 con 0x7f42640b1d40 2023-10-08T16:25:43.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.545+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 msgr2=0x7f42480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.545+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 0x7f42480693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4264158cd0 tx=0x7f4254008040 comp rx=0 tx=0).stop 2023-10-08T16:25:43.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.545+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 msgr2=0x7f4264155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.545+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f4264089370 tx=0x7f4260017000 comp rx=0 tx=0).stop 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 shutdown_connections 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4248066f30 0x7f42480693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42640b1d40 0x7f4264155ad0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42640b28c0 0x7f4264154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 --2- 172.21.15.12:0/137887234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f42640b24f0 0x7f42640c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 >> 172.21.15.12:0/137887234 conn(0x7f42640703a0 msgr2=0x7f42640b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 shutdown_connections 2023-10-08T16:25:43.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.546+0000 7f426af9d700 1 -- 172.21.15.12:0/137887234 wait complete. 2023-10-08T16:25:43.549 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:25:43.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:25:43.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.760+0000 7fd0b239d700 1 Processor -- start 2023-10-08T16:25:43.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.760+0000 7fd0b239d700 1 -- start start 2023-10-08T16:25:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0ac140a70 0x7fd0ac0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b239d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd0ac140e40 0x7fd0ac0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b239d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0c6d50 con 0x7fd0ac0c8330 2023-10-08T16:25:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b239d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0c7030 con 0x7fd0ac140a70 2023-10-08T16:25:43.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b239d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac0c7310 con 0x7fd0ac140e40 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0ac140a70 0x7fd0ac0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd0ac140a70 0x7fd0ac0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53606/0 (socket says 172.21.15.12:53606) 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b139b700 1 -- 172.21.15.12:0/1754962924 learned_addr learned my addr 172.21.15.12:0/1754962924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.762+0000 7fd0b0b9a700 1 --2- 172.21.15.12:0/1754962924 >> v2:172.21.15.29:3300/0 conn(0x7fd0ac140e40 0x7fd0ac0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0b139b700 1 -- 172.21.15.12:0/1754962924 >> v2:172.21.15.29:3300/0 conn(0x7fd0ac140e40 msgr2=0x7fd0ac0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0b139b700 1 --2- 172.21.15.12:0/1754962924 >> v2:172.21.15.29:3300/0 conn(0x7fd0ac140e40 0x7fd0ac0c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0b139b700 1 -- 172.21.15.12:0/1754962924 >> v1:172.21.15.29:6789/0 conn(0x7fd0ac0c8330 legacy=0x7fd0ac0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0b139b700 1 -- 172.21.15.12:0/1754962924 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0c75f0 con 0x7fd0ac140a70 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0b139b700 1 --2- 172.21.15.12:0/1754962924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac140a70 0x7fd0ac0c6770 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0cc0e0 tx=0x7fd0a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d7c8cd7a238bd0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0a3fff700 1 -- 172.21.15.12:0/1754962924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800b860 con 0x7fd0ac140a70 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0a3fff700 1 -- 172.21.15.12:0/1754962924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a800b9c0 con 0x7fd0ac140a70 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.763+0000 7fd0a3fff700 1 -- 172.21.15.12:0/1754962924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800bd60 con 0x7fd0ac140a70 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 -- 172.21.15.12:0/1754962924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac140a70 msgr2=0x7fd0ac0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 --2- 172.21.15.12:0/1754962924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac140a70 0x7fd0ac0c6770 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0cc0e0 tx=0x7fd0a8009250 comp rx=0 tx=0).stop 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 -- 172.21.15.12:0/1754962924 shutdown_connections 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 --2- 172.21.15.12:0/1754962924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac140a70 0x7fd0ac0c6770 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 --2- 172.21.15.12:0/1754962924 >> v2:172.21.15.29:3300/0 conn(0x7fd0ac140e40 0x7fd0ac0c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 -- 172.21.15.12:0/1754962924 >> 172.21.15.12:0/1754962924 conn(0x7fd0ac06d170 msgr2=0x7fd0ac0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 -- 172.21.15.12:0/1754962924 shutdown_connections 2023-10-08T16:25:43.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.764+0000 7fd0b239d700 1 -- 172.21.15.12:0/1754962924 wait complete. 2023-10-08T16:25:43.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.765+0000 7fd0b239d700 1 Processor -- start 2023-10-08T16:25:43.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.766+0000 7fd0b239d700 1 -- start start 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.766+0000 7fd0b239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.766+0000 7fd0b239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 0x7fd0ac15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0ac140e40 0x7fd0ac15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac1587d0 con 0x7fd0ac0c8330 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac16aba0 con 0x7fd0ac140a70 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0ae580 con 0x7fd0ac140e40 2023-10-08T16:25:43.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53616/0 (socket says 172.21.15.12:53616) 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 -- 172.21.15.12:0/778552258 learned_addr learned my addr 172.21.15.12:0/778552258 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b0b9a700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 0x7fd0ac15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b1b9c700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0ac140e40 0x7fd0ac15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 -- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0ac140e40 msgr2=0x7fd0ac15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0ac140e40 0x7fd0ac15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 -- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 msgr2=0x7fd0ac15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 0x7fd0ac15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 -- 172.21.15.12:0/778552258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80094f0 con 0x7fd0ac0c8330 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b0b9a700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 0x7fd0ac15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.767+0000 7fd0b139b700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac071320 tx=0x7fd0a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.768+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8011e60 con 0x7fd0ac0c8330 2023-10-08T16:25:43.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.768+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a801a630 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.768+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801a9f0 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.768+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac157a10 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.768+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac157fd0 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.769+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac04c3c0 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.771+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd0a802d430 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.772+0000 7fd0a17fa700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 0x7fd090069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.772+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5615+0+0 (secure 0 0 0) 0x7fd0a8086150 con 0x7fd0ac0c8330 2023-10-08T16:25:43.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.772+0000 7fd0b0b9a700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 0x7fd090069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:43.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.772+0000 7fd0b0b9a700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 0x7fd090069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd09c005fd0 tx=0x7fd09c008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:43.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.775+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0a8053580 con 0x7fd0ac0c8330 2023-10-08T16:25:43.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:43.978+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd0ac0c78d0 con 0x7fd0ac0c8330 2023-10-08T16:25:44.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.546+0000 7fd0a17fa700 1 -- 172.21.15.12:0/778552258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd0a8056ba0 con 0x7fd0ac0c8330 2023-10-08T16:25:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.560+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 msgr2=0x7fd090069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.560+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 0x7fd090069410 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd09c005fd0 tx=0x7fd09c008040 comp rx=0 tx=0).stop 2023-10-08T16:25:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.560+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 msgr2=0x7fd0ac0ae040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.560+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac071320 tx=0x7fd0a8017000 comp rx=0 tx=0).stop 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 shutdown_connections 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd090066f60 0x7fd090069410 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0ac0c8330 0x7fd0ac0ae040 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0ac140e40 0x7fd0ac15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 --2- 172.21.15.12:0/778552258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0ac140a70 0x7fd0ac15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.563+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 >> 172.21.15.12:0/778552258 conn(0x7fd0ac06d170 msgr2=0x7fd0ac0c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.564+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 shutdown_connections 2023-10-08T16:25:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.564+0000 7fd0b239d700 1 -- 172.21.15.12:0/778552258 wait complete. 2023-10-08T16:25:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:25:44.585 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:25:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.775+0000 7f6dc3fff700 1 Processor -- start 2023-10-08T16:25:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.775+0000 7f6dc3fff700 1 -- start start 2023-10-08T16:25:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.776+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.776+0000 7f6dc3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc415b640 con 0x7f6dc406de50 2023-10-08T16:25:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.776+0000 7f6dc3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dc415b920 con 0x7f6dc40c7c60 2023-10-08T16:25:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.776+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40c6800 con 0x7f6dc4140a70 2023-10-08T16:25:44.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc27fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6dc406de50 0x7f6dc4157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40830/0 (socket says 172.21.15.12:40830) 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc27fc700 1 -- 172.21.15.12:0/2068504635 learned_addr learned my addr 172.21.15.12:0/2068504635 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc2ffd700 1 --2- 172.21.15.12:0/2068504635 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967613655 0 0) 0x7f6dc415b640 con 0x7f6dc406de50 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dac003570 con 0x7f6dc406de50 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675319404 0 0) 0x7f6dc415b920 con 0x7f6dc40c7c60 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc415b640 con 0x7f6dc40c7c60 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc2ffd700 1 -- 172.21.15.12:0/2068504635 >> v1:172.21.15.29:6789/0 conn(0x7f6dc40c7c60 legacy=0x7f6dc4158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc2ffd700 1 -- 172.21.15.12:0/2068504635 >> v1:172.21.15.12:6789/0 conn(0x7f6dc406de50 legacy=0x7f6dc4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.777+0000 7f6dc2ffd700 1 -- 172.21.15.12:0/2068504635 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc415bc00 con 0x7f6dc4140a70 2023-10-08T16:25:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc2ffd700 1 --2- 172.21.15.12:0/2068504635 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc4069b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40c6940 tx=0x7f6db40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb064756c655f7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4011630 con 0x7f6dc4140a70 2023-10-08T16:25:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4011790 con 0x7f6dc4140a70 2023-10-08T16:25:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc1ffb700 1 -- 172.21.15.12:0/2068504635 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4011b50 con 0x7f6dc4140a70 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc3fff700 1 -- 172.21.15.12:0/2068504635 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 msgr2=0x7f6dc4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.778+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/2068504635 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc4069b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6dc40c6940 tx=0x7f6db40091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.779+0000 7f6dc3fff700 1 -- 172.21.15.12:0/2068504635 shutdown_connections 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.779+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/2068504635 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc4069b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.779+0000 7f6dc3fff700 1 -- 172.21.15.12:0/2068504635 >> 172.21.15.12:0/2068504635 conn(0x7f6dc406d110 msgr2=0x7f6dc40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.779+0000 7f6dc3fff700 1 -- 172.21.15.12:0/2068504635 shutdown_connections 2023-10-08T16:25:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.779+0000 7f6dc3fff700 1 -- 172.21.15.12:0/2068504635 wait complete. 2023-10-08T16:25:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.780+0000 7f6dc3fff700 1 Processor -- start 2023-10-08T16:25:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.780+0000 7f6dc3fff700 1 -- start start 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 0x7f6dc41589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc416d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40b1150 con 0x7f6dc40c7c60 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc4158ef0 con 0x7f6dc406de50 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc40b0860 con 0x7f6dc4140a70 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 0x7f6dc41589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc2ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 0x7f6dc41589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:49780/0 (socket says 172.21.15.12:49780) 2023-10-08T16:25:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc2ffd700 1 -- 172.21.15.12:0/3607523349 learned_addr learned my addr 172.21.15.12:0/3607523349 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53622/0 (socket says 172.21.15.12:53622) 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.781+0000 7f6dc37fe700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc416d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 -- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 msgr2=0x7f6dc416d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc416d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 -- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 msgr2=0x7f6dc41589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 0x7f6dc41589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 -- 172.21.15.12:0/3607523349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db4009420 con 0x7f6dc40c7c60 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc27fc700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6db800c580 tx=0x7f6db8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8005b30 con 0x7f6dc40c7c60 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8005c90 con 0x7f6dc40c7c60 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc40c36c0 con 0x7f6dc40c7c60 2023-10-08T16:25:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.782+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8007320 con 0x7f6dc40c7c60 2023-10-08T16:25:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.783+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc40b0de0 con 0x7f6dc40c7c60 2023-10-08T16:25:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.784+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc404c3c0 con 0x7f6dc40c7c60 2023-10-08T16:25:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.785+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6db801b3b0 con 0x7f6dc40c7c60 2023-10-08T16:25:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.786+0000 7f6daaffd700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 0x7f6db00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.786+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f6db8083f60 con 0x7f6dc40c7c60 2023-10-08T16:25:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.786+0000 7f6dc2ffd700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 0x7f6db00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.786+0000 7f6dc2ffd700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 0x7f6db00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6db4003080 tx=0x7f6db4016000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:44.789+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6db8051090 con 0x7f6dc40c7c60 2023-10-08T16:25:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.039+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6dc415bee0 con 0x7f6dc40c7c60 2023-10-08T16:25:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.580+0000 7f6daaffd700 1 -- 172.21.15.12:0/3607523349 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v46) v1 ==== 174+0+0 (secure 0 0 0) 0x7f6db80170c0 con 0x7f6dc40c7c60 2023-10-08T16:25:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.592+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 msgr2=0x7f6db00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.592+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 0x7f6db00693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6db4003080 tx=0x7f6db4016000 comp rx=0 tx=0).stop 2023-10-08T16:25:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.592+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 msgr2=0x7f6dc416cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.592+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6db800c580 tx=0x7f6db8007d70 comp rx=0 tx=0).stop 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 shutdown_connections 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6db0066f30 0x7f6db00693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6dc4140a70 0x7f6dc416d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6dc406de50 0x7f6dc41589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 --2- 172.21.15.12:0/3607523349 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6dc40c7c60 0x7f6dc416cf80 secure :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f6db800c580 tx=0x7f6db8007d70 comp rx=0 tx=0).stop 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.593+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 >> 172.21.15.12:0/3607523349 conn(0x7f6dc406d110 msgr2=0x7f6dc415a770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.596+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 shutdown_connections 2023-10-08T16:25:45.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.597+0000 7f6dc3fff700 1 -- 172.21.15.12:0/3607523349 wait complete. 2023-10-08T16:25:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 12 and data pool 13 2023-10-08T16:25:45.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.806+0000 7f60a8f9d700 1 Processor -- start 2023-10-08T16:25:45.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.806+0000 7f60a8f9d700 1 -- start start 2023-10-08T16:25:45.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a8f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 0x7f60a40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a8f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a40ca480 con 0x7f60a4142c00 2023-10-08T16:25:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a8f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a40c8220 con 0x7f60a4142fd0 2023-10-08T16:25:45.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a415e240 con 0x7f60a40c7dc0 2023-10-08T16:25:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:60756/0 (socket says 172.21.15.12:60756) 2023-10-08T16:25:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a3fff700 1 -- 172.21.15.12:0/65638177 learned_addr learned my addr 172.21.15.12:0/65638177 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:45.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a2ffd700 1 --2- 172.21.15.12:0/65638177 >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 0x7f60a40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.808+0000 7f60a37fe700 1 --1- 172.21.15.12:0/65638177 >> v1:172.21.15.29:6789/0 conn(0x7f60a4142c00 0x7f60a406b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:36954/0 (socket says 172.21.15.12:36954) 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a27fc700 1 -- 172.21.15.12:0/65638177 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411644009 0 0) 0x7f60a40ca480 con 0x7f60a4142c00 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a27fc700 1 -- 172.21.15.12:0/65638177 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f608c003570 con 0x7f60a4142c00 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a3fff700 1 -- 172.21.15.12:0/65638177 >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 msgr2=0x7f60a40c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a3fff700 1 --2- 172.21.15.12:0/65638177 >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 0x7f60a40c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a3fff700 1 -- 172.21.15.12:0/65638177 >> v1:172.21.15.29:6789/0 conn(0x7f60a4142c00 legacy=0x7f60a406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a3fff700 1 -- 172.21.15.12:0/65638177 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a406b350 con 0x7f60a40c7dc0 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a2ffd700 1 --2- 172.21.15.12:0/65638177 >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 0x7f60a40c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.809+0000 7f60a3fff700 1 --2- 172.21.15.12:0/65638177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f609c009f20 tx=0x7f609c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320ede9994359b84 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a27fc700 1 -- 172.21.15.12:0/65638177 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c00e070 con 0x7f60a40c7dc0 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a27fc700 1 -- 172.21.15.12:0/65638177 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00b970 con 0x7f60a40c7dc0 2023-10-08T16:25:45.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a27fc700 1 -- 172.21.15.12:0/65638177 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0092e0 con 0x7f60a40c7dc0 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 -- 172.21.15.12:0/65638177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 msgr2=0x7f60a406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/65638177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f609c009f20 tx=0x7f609c009840 comp rx=0 tx=0).stop 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 -- 172.21.15.12:0/65638177 shutdown_connections 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/65638177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a40c7dc0 0x7f60a406c6a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/65638177 >> v2:172.21.15.29:3300/0 conn(0x7f60a4142fd0 0x7f60a40c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 -- 172.21.15.12:0/65638177 >> 172.21.15.12:0/65638177 conn(0x7f60a40675a0 msgr2=0x7f60a40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 -- 172.21.15.12:0/65638177 shutdown_connections 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.810+0000 7f60a8f9d700 1 -- 172.21.15.12:0/65638177 wait complete. 2023-10-08T16:25:45.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.812+0000 7f60a8f9d700 1 Processor -- start 2023-10-08T16:25:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.812+0000 7f60a8f9d700 1 -- start start 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60a40c7dc0 0x7f60a4168a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a41354b0 con 0x7f60a4142c00 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c6fc0 con 0x7f60a40c7dc0 2023-10-08T16:25:45.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a40c72a0 con 0x7f60a4142fd0 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60a40c7dc0 0x7f60a4168a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53634/0 (socket says 172.21.15.12:53634) 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:60760/0 (socket says 172.21.15.12:60760) 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.813+0000 7f60a2ffd700 1 -- 172.21.15.12:0/171652071 learned_addr learned my addr 172.21.15.12:0/171652071 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 -- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 msgr2=0x7f60a40cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 -- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60a40c7dc0 msgr2=0x7f60a4168a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60a40c7dc0 0x7f60a4168a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 -- 172.21.15.12:0/171652071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009420 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a3fff700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a2ffd700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f609800ec80 tx=0x7f60980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800c850 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609800c9b0 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f609c009ae0 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609800cd30 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.814+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40b1370 con 0x7f60a4142c00 2023-10-08T16:25:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.815+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a404c3c0 con 0x7f60a4142c00 2023-10-08T16:25:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.816+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6098013680 con 0x7f60a4142c00 2023-10-08T16:25:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.818+0000 7f608b7fe700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.818+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f60980849a0 con 0x7f60a4142c00 2023-10-08T16:25:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.818+0000 7f60a37fe700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:45.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.818+0000 7f60a37fe700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 0x7f60900693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6094004f70 tx=0x7f6094007d40 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:45.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:45.822+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60980519e0 con 0x7f60a4142c00 2023-10-08T16:25:46.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.026+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a415df60 con 0x7f60a4142c00 2023-10-08T16:25:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.027+0000 7f608b7fe700 1 -- 172.21.15.12:0/171652071 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f6098055000 con 0x7f60a4142c00 2023-10-08T16:25:46.028 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:46.028 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":112,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:45.040710+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:46.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 msgr2=0x7f60900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 0x7f60900693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6094004f70 tx=0x7f6094007d40 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 msgr2=0x7f60a40cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f609800ec80 tx=0x7f60980091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 shutdown_connections 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6090066f30 0x7f60900693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60a4142fd0 0x7f60a40cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60a40c7dc0 0x7f60a4168a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 --2- 172.21.15.12:0/171652071 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60a4142c00 0x7f60a40cd520 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.029+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 >> 172.21.15.12:0/171652071 conn(0x7f60a40675a0 msgr2=0x7f60a40c9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.030+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 shutdown_connections 2023-10-08T16:25:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.030+0000 7f60a8f9d700 1 -- 172.21.15.12:0/171652071 wait complete. 2023-10-08T16:25:46.048 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.235+0000 7f788719d700 1 Processor -- start 2023-10-08T16:25:46.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.235+0000 7f788719d700 1 -- start start 2023-10-08T16:25:46.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.236+0000 7f788719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142fd0 0x7f78800c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.236+0000 7f788719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78800c7dc0 0x7f788006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.236+0000 7f788719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800ca480 con 0x7f7880142c00 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.236+0000 7f788719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78800c8240 con 0x7f78800c7dc0 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.236+0000 7f788719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f788015e240 con 0x7f7880142fd0 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78800c7dc0 0x7f788006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788619b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7880142c00 0x7f788006b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40834/0 (socket says 172.21.15.12:40834) 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788619b700 1 -- 172.21.15.12:0/2279101377 learned_addr learned my addr 172.21.15.12:0/2279101377 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:46.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788599a700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142fd0 0x7f78800c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f7885199700 1 -- 172.21.15.12:0/2279101377 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618409860 0 0) 0x7f78800ca480 con 0x7f7880142c00 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 -- 172.21.15.12:0/2279101377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142fd0 msgr2=0x7f78800c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142fd0 0x7f78800c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 -- 172.21.15.12:0/2279101377 >> v1:172.21.15.12:6789/0 conn(0x7f7880142c00 legacy=0x7f788006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 -- 172.21.15.12:0/2279101377 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f788006b350 con 0x7f78800c7dc0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.237+0000 7f788699c700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f788006c6a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7878009e60 tx=0x7f7878009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f425ebfffabe0492 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f7885199700 1 -- 172.21.15.12:0/2279101377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787800e070 con 0x7f78800c7dc0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f7885199700 1 -- 172.21.15.12:0/2279101377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787800bb60 con 0x7f78800c7dc0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f7885199700 1 -- 172.21.15.12:0/2279101377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878012430 con 0x7f78800c7dc0 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 -- 172.21.15.12:0/2279101377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 msgr2=0x7f788006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f788006c6a0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f7878009e60 tx=0x7f7878009780 comp rx=0 tx=0).stop 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 -- 172.21.15.12:0/2279101377 shutdown_connections 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f788006c6a0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 --2- 172.21.15.12:0/2279101377 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142fd0 0x7f78800c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 -- 172.21.15.12:0/2279101377 >> 172.21.15.12:0/2279101377 conn(0x7f78800675a0 msgr2=0x7f78800679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 -- 172.21.15.12:0/2279101377 shutdown_connections 2023-10-08T16:25:46.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.238+0000 7f788719d700 1 -- 172.21.15.12:0/2279101377 wait complete. 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.240+0000 7f788719d700 1 Processor -- start 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.240+0000 7f788719d700 1 -- start start 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142c00 0x7f7880139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 0x7f7880140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880138ea0 con 0x7f78800c7dc0 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880138290 con 0x7f7880142fd0 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880138570 con 0x7f7880142c00 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53662/0 (socket says 172.21.15.12:53662) 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 -- 172.21.15.12:0/4233915082 learned_addr learned my addr 172.21.15.12:0/4233915082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788599a700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142c00 0x7f7880139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788699c700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 0x7f7880140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 -- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142c00 msgr2=0x7f7880139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142c00 0x7f7880139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 -- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 msgr2=0x7f7880140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 0x7f7880140180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788619b700 1 -- 172.21.15.12:0/4233915082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009a20 con 0x7f78800c7dc0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.241+0000 7f788699c700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 0x7f7880140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f788619b700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c7e0 tx=0x7f787c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c005b30 con 0x7f78800c7dc0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c005c90 con 0x7f78800c7dc0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c007300 con 0x7f78800c7dc0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7880138850 con 0x7f78800c7dc0 2023-10-08T16:25:46.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.242+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7880159360 con 0x7f78800c7dc0 2023-10-08T16:25:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.243+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f788004c3c0 con 0x7f78800c7dc0 2023-10-08T16:25:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.244+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f787c01b400 con 0x7f78800c7dc0 2023-10-08T16:25:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.245+0000 7f78767fc700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 0x7f78640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.246+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f787c0842e0 con 0x7f78800c7dc0 2023-10-08T16:25:46.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.246+0000 7f788599a700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 0x7f78640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.246+0000 7f788599a700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 0x7f78640693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78800afa20 tx=0x7f7870008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.250+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f787c0513a0 con 0x7f78800c7dc0 2023-10-08T16:25:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.453+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7880139180 con 0x7f78800c7dc0 2023-10-08T16:25:46.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.454+0000 7f78767fc700 1 -- 172.21.15.12:0/4233915082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f787c0549c0 con 0x7f78800c7dc0 2023-10-08T16:25:46.455 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:46.455 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":112,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:45.040710+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:46.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 msgr2=0x7f78640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 0x7f78640693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78800afa20 tx=0x7f7870008040 comp rx=0 tx=0).stop 2023-10-08T16:25:46.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 msgr2=0x7f7880158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f787c00c7e0 tx=0x7f787c007df0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 shutdown_connections 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7864066f30 0x7f78640693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78800c7dc0 0x7f7880158e20 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7880142fd0 0x7f7880140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 --2- 172.21.15.12:0/4233915082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7880142c00 0x7f7880139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 >> 172.21.15.12:0/4233915082 conn(0x7f78800675a0 msgr2=0x7f78800cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 shutdown_connections 2023-10-08T16:25:46.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.456+0000 7f788719d700 1 -- 172.21.15.12:0/4233915082 wait complete. 2023-10-08T16:25:46.475 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:25:46.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-10-08T16:25:46.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-08T16:25:46.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.668+0000 7fcbf9b9d700 1 Processor -- start 2023-10-08T16:25:46.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.669+0000 7fcbf9b9d700 1 -- start start 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf9b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf9b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf406b290 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf9b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf406b570 con 0x7fcbf413f780 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf9b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf406bf10 con 0x7fcbf40c7be0 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcbf40c7fb0 0x7fcbf415a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40836/0 (socket says 172.21.15.12:40836) 2023-10-08T16:25:46.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.670+0000 7fcbf3fff700 1 -- 172.21.15.12:0/2192372719 learned_addr learned my addr 172.21.15.12:0/2192372719 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf8b9b700 1 --2- 172.21.15.12:0/2192372719 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3987206190 0 0) 0x7fcbf406b290 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbe4003570 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063216073 0 0) 0x7fcbf406b570 con 0x7fcbf413f780 2023-10-08T16:25:46.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbf406b290 con 0x7fcbf413f780 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf8b9b700 1 -- 172.21.15.12:0/2192372719 >> v1:172.21.15.29:6789/0 conn(0x7fcbf413f780 legacy=0x7fcbf40c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf8b9b700 1 -- 172.21.15.12:0/2192372719 >> v1:172.21.15.12:6789/0 conn(0x7fcbf40c7fb0 legacy=0x7fcbf415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf8b9b700 1 -- 172.21.15.12:0/2192372719 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf406b850 con 0x7fcbf40c7be0 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.671+0000 7fcbf8b9b700 1 --2- 172.21.15.12:0/2192372719 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf406abd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009910 tx=0x7fcbe80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8521120a67f4ebd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011630 con 0x7fcbf40c7be0 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011790 con 0x7fcbf40c7be0 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf37fe700 1 -- 172.21.15.12:0/2192372719 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8011b30 con 0x7fcbf40c7be0 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/2192372719 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 msgr2=0x7fcbf406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/2192372719 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf406abd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009910 tx=0x7fcbe80091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/2192372719 shutdown_connections 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/2192372719 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf406abd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/2192372719 >> 172.21.15.12:0/2192372719 conn(0x7fcbf406d110 msgr2=0x7fcbf40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:46.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/2192372719 shutdown_connections 2023-10-08T16:25:46.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.672+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/2192372719 wait complete. 2023-10-08T16:25:46.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.674+0000 7fcbf9b9d700 1 Processor -- start 2023-10-08T16:25:46.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.674+0000 7fcbf9b9d700 1 -- start start 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf40c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf413f780 0x7fcbf413d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf413f250 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40c1fc0 con 0x7fcbf413f780 2023-10-08T16:25:46.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf9b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40c22a0 con 0x7fcbf40c7be0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53674/0 (socket says 172.21.15.12:53674) 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf3fff700 1 -- 172.21.15.12:0/430324375 learned_addr learned my addr 172.21.15.12:0/430324375 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf939c700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf413f780 0x7fcbf413d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.675+0000 7fcbf8b9b700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf40c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 -- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 msgr2=0x7fcbf40c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf40c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 -- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf413f780 msgr2=0x7fcbf413d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf413f780 0x7fcbf413d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 -- 172.21.15.12:0/430324375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8009420 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf3fff700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c790 tx=0x7fcbe0007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0005b30 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe0005cb0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf40c2580 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.676+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0007320 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.677+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf413dac0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.678+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf40c41b0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.678+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbe001b3b0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.679+0000 7fcbf0ff9700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:46.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.679+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fcbe0083bc0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.679+0000 7fcbf8b9b700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:46.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.680+0000 7fcbf8b9b700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 0x7fcbd80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009860 tx=0x7fcbe8017000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:46.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.683+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbf40c41b0 con 0x7fcbf40c7fb0 2023-10-08T16:25:46.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:46.933+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcbf40c41b0 con 0x7fcbf40c7fb0 2023-10-08T16:25:47.540 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:25:47.545 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:25:47.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.587+0000 7fcbf0ff9700 1 -- 172.21.15.12:0/430324375 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcbf40c41b0 con 0x7fcbf40c7fb0 2023-10-08T16:25:47.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 msgr2=0x7fcbd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 0x7fcbd80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009860 tx=0x7fcbe8017000 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 msgr2=0x7fcbf413ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fcbe000c790 tx=0x7fcbe0007e40 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 shutdown_connections 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcbf413f780 0x7fcbf413d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcbf40c7be0 0x7fcbf40c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.591+0000 7fcbf9b9d700 1 --2- 172.21.15.12:0/430324375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcbf40c7fb0 0x7fcbf413ed10 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.592+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 >> 172.21.15.12:0/430324375 conn(0x7fcbf406d110 msgr2=0x7fcbf40b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.592+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 shutdown_connections 2023-10-08T16:25:47.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.592+0000 7fcbf9b9d700 1 -- 172.21.15.12:0/430324375 wait complete. 2023-10-08T16:25:47.614 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:25:47.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.804+0000 7f28b1b9d700 1 Processor -- start 2023-10-08T16:25:47.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.804+0000 7f28b1b9d700 1 -- start start 2023-10-08T16:25:47.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b1b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28ac153dd0 0x7f28ac15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 0x7f28ac0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b1b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ac15ac50 con 0x7f28ac153a00 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b1b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ac15d010 con 0x7f28ac153dd0 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0cf3e0 con 0x7f28ac0cea00 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28abfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28ac153dd0 0x7f28ac15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b0b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28ac153a00 0x7f28ac15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40840/0 (socket says 172.21.15.12:40840) 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.805+0000 7f28b0b9b700 1 -- 172.21.15.12:0/3788928695 learned_addr learned my addr 172.21.15.12:0/3788928695 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28b139c700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 0x7f28ac0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28abfff700 1 -- 172.21.15.12:0/3788928695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 msgr2=0x7f28ac0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28abfff700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 0x7f28ac0ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28abfff700 1 -- 172.21.15.12:0/3788928695 >> v1:172.21.15.12:6789/0 conn(0x7f28ac153a00 legacy=0x7f28ac15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28abfff700 1 -- 172.21.15.12:0/3788928695 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac15af60 con 0x7f28ac153dd0 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28b139c700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 0x7f28ac0ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:47.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28ab7fe700 1 -- 172.21.15.12:0/3788928695 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265764863 0 0) 0x7f28ac15ac50 con 0x7f28ac153a00 2023-10-08T16:25:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28abfff700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac15de50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f28980098e0 tx=0x7f28980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc3e77a6617564a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.806+0000 7f28ab7fe700 1 -- 172.21.15.12:0/3788928695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898009e80 con 0x7f28ac153dd0 2023-10-08T16:25:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28ab7fe700 1 -- 172.21.15.12:0/3788928695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289800b860 con 0x7f28ac153dd0 2023-10-08T16:25:47.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28ab7fe700 1 -- 172.21.15.12:0/3788928695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289800bbe0 con 0x7f28ac153dd0 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 -- 172.21.15.12:0/3788928695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 msgr2=0x7f28ac15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac15de50 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f28980098e0 tx=0x7f28980091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 -- 172.21.15.12:0/3788928695 shutdown_connections 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac0cea00 0x7f28ac0ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/3788928695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac15de50 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 -- 172.21.15.12:0/3788928695 >> 172.21.15.12:0/3788928695 conn(0x7f28ac0703a0 msgr2=0x7f28ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 -- 172.21.15.12:0/3788928695 shutdown_connections 2023-10-08T16:25:47.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.807+0000 7f28b1b9d700 1 -- 172.21.15.12:0/3788928695 wait complete. 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.809+0000 7f28b1b9d700 1 Processor -- start 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.809+0000 7f28b1b9d700 1 -- start start 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28ac0cea00 0x7f28ac158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac153a00 0x7f28ac0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0c9690 con 0x7f28ac153dd0 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0cd070 con 0x7f28ac0cea00 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ac0cd350 con 0x7f28ac153a00 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53692/0 (socket says 172.21.15.12:53692) 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 -- 172.21.15.12:0/1322770177 learned_addr learned my addr 172.21.15.12:0/1322770177 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:47.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28abfff700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac153a00 0x7f28ac0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b0b9b700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28ac0cea00 0x7f28ac158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 -- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac153a00 msgr2=0x7f28ac0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac153a00 0x7f28ac0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 -- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28ac0cea00 msgr2=0x7f28ac158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28ac0cea00 0x7f28ac158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.810+0000 7f28b139c700 1 -- 172.21.15.12:0/1322770177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898009420 con 0x7f28ac153dd0 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28b139c700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d180 tx=0x7f28a4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a400de20 con 0x7f28ac153dd0 2023-10-08T16:25:47.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a400f040 con 0x7f28ac153dd0 2023-10-08T16:25:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a4015690 con 0x7f28ac153dd0 2023-10-08T16:25:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ac0c9320 con 0x7f28ac153dd0 2023-10-08T16:25:47.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.811+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ac0c8f40 con 0x7f28ac153dd0 2023-10-08T16:25:47.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.812+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ac04c3c0 con 0x7f28ac153dd0 2023-10-08T16:25:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.813+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28a401e3b0 con 0x7f28ac153dd0 2023-10-08T16:25:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.814+0000 7f28a8ff9700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 0x7f28900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.814+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f28a4084d70 con 0x7f28ac153dd0 2023-10-08T16:25:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.814+0000 7f28b0b9b700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 0x7f28900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:47.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.815+0000 7f28b0b9b700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 0x7f28900693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28a00011e0 tx=0x7f28a0009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:47.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:47.818+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28a4051db0 con 0x7f28ac153dd0 2023-10-08T16:25:48.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.067+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f28ac15b240 con 0x7f28ac153dd0 2023-10-08T16:25:48.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.592+0000 7f28a8ff9700 1 -- 172.21.15.12:0/1322770177 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f28a401a0c0 con 0x7f28ac153dd0 2023-10-08T16:25:48.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 msgr2=0x7f28900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 0x7f28900693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f28a00011e0 tx=0x7f28a0009040 comp rx=0 tx=0).stop 2023-10-08T16:25:48.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 msgr2=0x7f28ac157550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f28a400d180 tx=0x7f28a4009a50 comp rx=0 tx=0).stop 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 shutdown_connections 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2890066f30 0x7f28900693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28ac153dd0 0x7f28ac157550 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28ac0cea00 0x7f28ac158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 --2- 172.21.15.12:0/1322770177 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28ac153a00 0x7f28ac0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 >> 172.21.15.12:0/1322770177 conn(0x7f28ac0703a0 msgr2=0x7f28ac070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.595+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 shutdown_connections 2023-10-08T16:25:48.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.596+0000 7f28b1b9d700 1 -- 172.21.15.12:0/1322770177 wait complete. 2023-10-08T16:25:48.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:48.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.803+0000 7f075b19d700 1 Processor -- start 2023-10-08T16:25:48.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.803+0000 7f075b19d700 1 -- start start 2023-10-08T16:25:48.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.804+0000 7f075b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f075415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.804+0000 7f075b19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075415ae70 con 0x7f075413fb20 2023-10-08T16:25:48.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f075b19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075406af60 con 0x7f075413fef0 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f075b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075406b240 con 0x7f075406aaa0 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f075a19b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f075413fb20 0x7f07540c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40852/0 (socket says 172.21.15.12:40852) 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f075a19b700 1 -- 172.21.15.12:0/1444245006 learned_addr learned my addr 172.21.15.12:0/1444245006 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f075a99c700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f075415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218866120 0 0) 0x7f0750001110 con 0x7f075413fb20 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0740003570 con 0x7f075413fb20 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356787668 0 0) 0x7f075406af60 con 0x7f075413fef0 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0750001110 con 0x7f075413fef0 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2273327032 0 0) 0x7f0740003570 con 0x7f075413fb20 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 msgr2=0x7f075415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:48.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f075415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 >> v1:172.21.15.29:6789/0 conn(0x7f075413fef0 legacy=0x7f07540c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075406b520 con 0x7f075413fb20 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.805+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f0750001600 con 0x7f075413fb20 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 >> v1:172.21.15.12:6789/0 conn(0x7f075413fb20 legacy=0x7f07540c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0740003c20 0x7f0740004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f0740004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740004d50 0x7f07400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075406b240 con 0x7f0740003c20 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bbf0 con 0x7f0740004d50 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074000bdb0 con 0x7f075406aaa0 2023-10-08T16:25:48.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0740003c20 0x7f0740004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075999a700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f0740004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a99c700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740004d50 0x7f07400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 -- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 msgr2=0x7f0740004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f0740004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 -- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740004d50 msgr2=0x7f07400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740004d50 0x7f07400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075a19b700 1 -- 172.21.15.12:0/1444245006 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0740003570 con 0x7f0740003c20 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.806+0000 7f075999a700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075406aaa0 0x7f0740004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075a19b700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0740003c20 0x7f0740004010 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0750007fc0 tx=0x7f0750007940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77773ecb0d9bca77 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000cc90 con 0x7f0740003c20 2023-10-08T16:25:48.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000ce10 con 0x7f0740003c20 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f0759199700 1 -- 172.21.15.12:0/1444245006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0750005b70 con 0x7f0740003c20 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075b19d700 1 -- 172.21.15.12:0/1444245006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0740003c20 msgr2=0x7f0740004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075b19d700 1 --2- 172.21.15.12:0/1444245006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0740003c20 0x7f0740004010 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f0750007fc0 tx=0x7f0750007940 comp rx=0 tx=0).stop 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075a99c700 1 -- 172.21.15.12:0/1444245006 reap_dead start 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075b19d700 1 -- 172.21.15.12:0/1444245006 shutdown_connections 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075b19d700 1 -- 172.21.15.12:0/1444245006 >> 172.21.15.12:0/1444245006 conn(0x7f075406d170 msgr2=0x7f07540cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.807+0000 7f075b19d700 1 -- 172.21.15.12:0/1444245006 shutdown_connections 2023-10-08T16:25:48.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.808+0000 7f075b19d700 1 -- 172.21.15.12:0/1444245006 wait complete. 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.809+0000 7f075b19d700 1 Processor -- start 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.809+0000 7f075b19d700 1 -- start start 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740003c20 0x7f0754155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07540abbc0 0x7f075413e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0754156c60 con 0x7f075413ea50 2023-10-08T16:25:48.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07541562c0 con 0x7f0740003c20 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075413efd0 con 0x7f07540abbc0 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075999a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07540abbc0 0x7f075413e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075a19b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740003c20 0x7f0754155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075a99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53698/0 (socket says 172.21.15.12:53698) 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.810+0000 7f075a99c700 1 -- 172.21.15.12:0/3336257078 learned_addr learned my addr 172.21.15.12:0/3336257078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 -- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07540abbc0 msgr2=0x7f075413e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07540abbc0 0x7f075413e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 -- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740003c20 msgr2=0x7f0754155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740003c20 0x7f0754155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 -- 172.21.15.12:0/3336257078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754156eb0 con 0x7f075413ea50 2023-10-08T16:25:48.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075a99c700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f07540712c0 tx=0x7f074c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00e070 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c011b80 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c016470 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.811+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754157190 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.812+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075413c0d0 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.812+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075404c3c0 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.813+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f074c016860 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.814+0000 7f074a7fc700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.814+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f074c0851c0 con 0x7f075413ea50 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.814+0000 7f075a19b700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:48.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.815+0000 7f075a19b700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 0x7f07380693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07500010e0 tx=0x7f0750017000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:48.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:48.818+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f074c052200 con 0x7f075413ea50 2023-10-08T16:25:49.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.067+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07540aea20 con 0x7f075413ea50 2023-10-08T16:25:49.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.067+0000 7f074a7fc700 1 -- 172.21.15.12:0/3336257078 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f074c055820 con 0x7f075413ea50 2023-10-08T16:25:49.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:49.069 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:25:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 msgr2=0x7f07380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 0x7f07380693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f07500010e0 tx=0x7f0750017000 comp rx=0 tx=0).stop 2023-10-08T16:25:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 msgr2=0x7f0754158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f07540712c0 tx=0x7f074c00b040 comp rx=0 tx=0).stop 2023-10-08T16:25:49.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 shutdown_connections 2023-10-08T16:25:49.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0738066f30 0x7f07380693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f075413ea50 0x7f0754158af0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0740003c20 0x7f0754155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 --2- 172.21.15.12:0/3336257078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07540abbc0 0x7f075413e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 >> 172.21.15.12:0/3336257078 conn(0x7f075406d170 msgr2=0x7f075406edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 shutdown_connections 2023-10-08T16:25:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.070+0000 7f075b19d700 1 -- 172.21.15.12:0/3336257078 wait complete. 2023-10-08T16:25:49.075 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:25:49.089 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:25:49.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.276+0000 7f5a389fe700 1 Processor -- start 2023-10-08T16:25:49.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.276+0000 7f5a389fe700 1 -- start start 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a389fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a340caec0 0x7f5a34164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a389fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a340c7420 con 0x7f5a34159640 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a389fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3406d820 con 0x7f5a34159a10 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a389fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3406db00 con 0x7f5a340caec0 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a3359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a340caec0 0x7f5a34164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a32d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5a34159640 0x7f5a3406d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40856/0 (socket says 172.21.15.12:40856) 2023-10-08T16:25:49.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a32d9d700 1 -- 172.21.15.12:0/3597420034 learned_addr learned my addr 172.21.15.12:0/3597420034 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a31d9b700 1 -- 172.21.15.12:0/3597420034 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225527471 0 0) 0x7f5a340c7420 con 0x7f5a34159640 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a3359e700 1 -- 172.21.15.12:0/3597420034 >> v1:172.21.15.29:6789/0 conn(0x7f5a34159a10 legacy=0x7f5a340ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a3359e700 1 -- 172.21.15.12:0/3597420034 >> v1:172.21.15.12:6789/0 conn(0x7f5a34159640 legacy=0x7f5a3406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.278+0000 7f5a3359e700 1 -- 172.21.15.12:0/3597420034 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3406dde0 con 0x7f5a340caec0 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a3359e700 1 --2- 172.21.15.12:0/3597420034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a340caec0 0x7f5a34164450 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009e90 tx=0x7f5a2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd20b2e8a70465aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a31d9b700 1 -- 172.21.15.12:0/3597420034 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c00e070 con 0x7f5a340caec0 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a31d9b700 1 -- 172.21.15.12:0/3597420034 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c00bbf0 con 0x7f5a340caec0 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a31d9b700 1 -- 172.21.15.12:0/3597420034 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c012430 con 0x7f5a340caec0 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a389fe700 1 -- 172.21.15.12:0/3597420034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a340caec0 msgr2=0x7f5a34164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.279+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3597420034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a340caec0 0x7f5a34164450 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c009e90 tx=0x7f5a2c009780 comp rx=0 tx=0).stop 2023-10-08T16:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.280+0000 7f5a389fe700 1 -- 172.21.15.12:0/3597420034 shutdown_connections 2023-10-08T16:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.280+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3597420034 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a340caec0 0x7f5a34164450 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.280+0000 7f5a389fe700 1 -- 172.21.15.12:0/3597420034 >> 172.21.15.12:0/3597420034 conn(0x7f5a3406e720 msgr2=0x7f5a3406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.280+0000 7f5a389fe700 1 -- 172.21.15.12:0/3597420034 shutdown_connections 2023-10-08T16:25:49.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.280+0000 7f5a389fe700 1 -- 172.21.15.12:0/3597420034 wait complete. 2023-10-08T16:25:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.281+0000 7f5a389fe700 1 Processor -- start 2023-10-08T16:25:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.281+0000 7f5a389fe700 1 -- start start 2023-10-08T16:25:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 0x7f5a340b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a34159640 0x7f5a3416a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a340b1cd0 con 0x7f5a34159a10 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3416a920 con 0x7f5a340caec0 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a389fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3416b550 con 0x7f5a34159640 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a3359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a3359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53714/0 (socket says 172.21.15.12:53714) 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.282+0000 7f5a3359e700 1 -- 172.21.15.12:0/3867824374 learned_addr learned my addr 172.21.15.12:0/3867824374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a32d9d700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 0x7f5a340b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3259c700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a34159640 0x7f5a3416a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 -- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a34159640 msgr2=0x7f5a3416a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a34159640 0x7f5a3416a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 -- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 msgr2=0x7f5a340b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 0x7f5a340b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 -- 172.21.15.12:0/3867824374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a2c009a20 con 0x7f5a34159a10 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a32d9d700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 0x7f5a340b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:49.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a3359e700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c013000 tx=0x7f5a2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c01b630 con 0x7f5a34159a10 2023-10-08T16:25:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2c01b790 con 0x7f5a34159a10 2023-10-08T16:25:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a3416ac20 con 0x7f5a34159a10 2023-10-08T16:25:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c01bb50 con 0x7f5a34159a10 2023-10-08T16:25:49.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.283+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3416b1e0 con 0x7f5a34159a10 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.284+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3404c3c0 con 0x7f5a34159a10 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.285+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a2c01c400 con 0x7f5a34159a10 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.286+0000 7f5a1affd700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 0x7f5a200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.286+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5a2c086660 con 0x7f5a34159a10 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.287+0000 7f5a32d9d700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 0x7f5a200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.287+0000 7f5a32d9d700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 0x7f5a200693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000c00 tx=0x7f5a24009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.291+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a2c0536a0 con 0x7f5a34159a10 2023-10-08T16:25:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.493+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a340b2820 con 0x7f5a34159a10 2023-10-08T16:25:49.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.493+0000 7f5a1affd700 1 -- 172.21.15.12:0/3867824374 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16007 (secure 0 0 0) 0x7f5a2c056cc0 con 0x7f5a34159a10 2023-10-08T16:25:49.739 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:49.739 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":113,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:25:46.574074+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 msgr2=0x7f5a200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 0x7f5a200693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5a24000c00 tx=0x7f5a24009040 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 msgr2=0x7f5a34155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c013000 tx=0x7f5a2c019000 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 shutdown_connections 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a20066f30 0x7f5a200693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a34159a10 0x7f5a34155530 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a340caec0 0x7f5a340b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 --2- 172.21.15.12:0/3867824374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a34159640 0x7f5a3416a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 >> 172.21.15.12:0/3867824374 conn(0x7f5a3406e720 msgr2=0x7f5a340c1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:49.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 shutdown_connections 2023-10-08T16:25:49.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.496+0000 7f5a389fe700 1 -- 172.21.15.12:0/3867824374 wait complete. 2023-10-08T16:25:49.742 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:25:49.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.929+0000 7ff39719d700 1 Processor -- start 2023-10-08T16:25:49.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.929+0000 7ff39719d700 1 -- start start 2023-10-08T16:25:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39719d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff39013fef0 0x7ff39015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39015ae70 con 0x7ff39013fb20 2023-10-08T16:25:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39719d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff39006af60 con 0x7ff39006aaa0 2023-10-08T16:25:49.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39719d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff39006b240 con 0x7ff39013fef0 2023-10-08T16:25:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39619b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff39013fb20 0x7ff3900c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40860/0 (socket says 172.21.15.12:40860) 2023-10-08T16:25:49.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.930+0000 7ff39619b700 1 -- 172.21.15.12:0/3843787120 learned_addr learned my addr 172.21.15.12:0/3843787120 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff39599a700 1 --2- 172.21.15.12:0/3843787120 >> v2:172.21.15.29:3300/0 conn(0x7ff39013fef0 0x7ff39015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 447740256 0 0) 0x7ff38c001110 con 0x7ff39013fb20 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff37c003570 con 0x7ff39013fb20 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2633730087 0 0) 0x7ff37c003570 con 0x7ff39013fb20 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 >> v2:172.21.15.29:3300/0 conn(0x7ff39013fef0 msgr2=0x7ff39015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 --2- 172.21.15.12:0/3843787120 >> v2:172.21.15.29:3300/0 conn(0x7ff39013fef0 0x7ff39015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 >> v1:172.21.15.29:6789/0 conn(0x7ff39006aaa0 legacy=0x7ff3900c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff39006b520 con 0x7ff39013fb20 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7ff38c001600 con 0x7ff39013fb20 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 >> v1:172.21.15.12:6789/0 conn(0x7ff39013fb20 legacy=0x7ff3900c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff37c003ab0 0x7ff37c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff37c004810 0x7ff37c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff37c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff39006b240 con 0x7ff37c005210 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c00c130 con 0x7ff37c003ab0 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff37c00c2f0 con 0x7ff37c004810 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.931+0000 7ff39699c700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff37c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39599a700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff37c004810 0x7ff37c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39619b700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff37c003ab0 0x7ff37c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 -- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff37c004810 msgr2=0x7ff37c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff37c004810 0x7ff37c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 -- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff37c003ab0 msgr2=0x7ff37c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff37c003ab0 0x7ff37c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 -- 172.21.15.12:0/3843787120 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff37c003570 con 0x7ff37c005210 2023-10-08T16:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 -- 172.21.15.12:0/3843787120 reap_dead start 2023-10-08T16:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff39699c700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff37c00ba60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff388001f90 tx=0x7ff388001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c61af3a30ea025d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff388001950 con 0x7ff37c005210 2023-10-08T16:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38800c8b0 con 0x7ff37c005210 2023-10-08T16:25:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.932+0000 7ff395199700 1 -- 172.21.15.12:0/3843787120 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38800cc50 con 0x7ff37c005210 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 -- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 msgr2=0x7ff37c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff37c00ba60 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ff388001f90 tx=0x7ff388001640 comp rx=0 tx=0).stop 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 -- 172.21.15.12:0/3843787120 shutdown_connections 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 --2- 172.21.15.12:0/3843787120 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff37c00ba60 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 -- 172.21.15.12:0/3843787120 >> 172.21.15.12:0/3843787120 conn(0x7ff39006d170 msgr2=0x7ff3900cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 -- 172.21.15.12:0/3843787120 shutdown_connections 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.933+0000 7ff39719d700 1 -- 172.21.15.12:0/3843787120 wait complete. 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.934+0000 7ff39719d700 1 Processor -- start 2023-10-08T16:25:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.935+0000 7ff39719d700 1 -- start start 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.935+0000 7ff39719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.935+0000 7ff39719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 0x7ff3901558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff390133a20 0x7ff390155e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900ac310 con 0x7ff37c005210 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900ab740 con 0x7ff3900c15d0 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3900ab9e0 con 0x7ff390133a20 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53736/0 (socket says 172.21.15.12:53736) 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 -- 172.21.15.12:0/1552817336 learned_addr learned my addr 172.21.15.12:0/1552817336 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39699c700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff390133a20 0x7ff390155e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39599a700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 0x7ff3901558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 -- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff390133a20 msgr2=0x7ff390155e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff390133a20 0x7ff390155e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 -- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 msgr2=0x7ff3901558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 0x7ff3901558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 -- 172.21.15.12:0/1552817336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3900abcc0 con 0x7ff37c005210 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39599a700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 0x7ff3901558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.936+0000 7ff39619b700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0070e0 tx=0x7ff38c0079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.937+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c018030 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.937+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c00f610 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.937+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c00f9b0 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.937+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3900abfa0 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.937+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff390132720 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.938+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff39004c3c0 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.939+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff38c01b070 con 0x7ff37c005210 2023-10-08T16:25:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.940+0000 7ff3867fc700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.940+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff38c019070 con 0x7ff37c005210 2023-10-08T16:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.940+0000 7ff39599a700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.940+0000 7ff39599a700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 0x7ff3740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3900c19e0 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:49.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:49.944+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff38c054eb0 con 0x7ff37c005210 2023-10-08T16:25:50.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.139+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3900b1ea0 con 0x7ff374066f30 2023-10-08T16:25:50.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.149+0000 7ff3867fc700 1 -- 172.21.15.12:0/1552817336 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280011 (secure 0 0 0) 0x7ff380009e40 con 0x7ff374066f30 2023-10-08T16:25:50.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.153+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 msgr2=0x7ff3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.153+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 0x7ff3740693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff3900c19e0 tx=0x7ff380008040 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 msgr2=0x7ff3900c1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0070e0 tx=0x7ff38c0079d0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 shutdown_connections 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff374066f30 0x7ff3740693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff37c005210 0x7ff3900c1090 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff390133a20 0x7ff390155e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 --2- 172.21.15.12:0/1552817336 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff3900c15d0 0x7ff3901558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 >> 172.21.15.12:0/1552817336 conn(0x7ff39006d170 msgr2=0x7ff3900caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 shutdown_connections 2023-10-08T16:25:50.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.154+0000 7ff39719d700 1 -- 172.21.15.12:0/1552817336 wait complete. 2023-10-08T16:25:50.158 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:50.172 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:25:48.961458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":325,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439176,"kb_used_data":11720,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535544,"statfs":{"total":773094113280,"available":770596397056,"internally_reserved":0,"allocated":12001280,"data_stored":6424472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.423954"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592653+0000","last_change":"2023-10-08T16:25:45.586001+0000","last_active":"2023-10-08T16:25:45.592653+0000","last_peered":"2023-10-08T16:25:45.592653+0000","last_clean":"2023-10-08T16:25:45.592653+0000","last_became_active":"2023-10-08T16:25:45.585724+0000","last_became_peered":"2023-10-08T16:25:45.585724+0000","last_unstale":"2023-10-08T16:25:45.592653+0000","last_undegraded":"2023-10-08T16:25:45.592653+0000","last_fullsized":"2023-10-08T16:25:45.592653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586090+0000","last_change":"2023-10-08T16:25:45.576696+0000","last_active":"2023-10-08T16:25:45.586090+0000","last_peered":"2023-10-08T16:25:45.586090+0000","last_clean":"2023-10-08T16:25:45.586090+0000","last_became_active":"2023-10-08T16:25:45.576430+0000","last_became_peered":"2023-10-08T16:25:45.576430+0000","last_unstale":"2023-10-08T16:25:45.586090+0000","last_undegraded":"2023-10-08T16:25:45.586090+0000","last_fullsized":"2023-10-08T16:25:45.586090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:42.921358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600258+0000","last_change":"2023-10-08T16:25:45.591542+0000","last_active":"2023-10-08T16:25:45.600258+0000","last_peered":"2023-10-08T16:25:45.600258+0000","last_clean":"2023-10-08T16:25:45.600258+0000","last_became_active":"2023-10-08T16:25:45.591281+0000","last_became_peered":"2023-10-08T16:25:45.591281+0000","last_unstale":"2023-10-08T16:25:45.600258+0000","last_undegraded":"2023-10-08T16:25:45.600258+0000","last_fullsized":"2023-10-08T16:25:45.600258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:08.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600201+0000","last_change":"2023-10-08T16:25:45.595131+0000","last_active":"2023-10-08T16:25:45.600201+0000","last_peered":"2023-10-08T16:25:45.600201+0000","last_clean":"2023-10-08T16:25:45.600201+0000","last_became_active":"2023-10-08T16:25:45.594345+0000","last_became_peered":"2023-10-08T16:25:45.594345+0000","last_unstale":"2023-10-08T16:25:45.600201+0000","last_undegraded":"2023-10-08T16:25:45.600201+0000","last_fullsized":"2023-10-08T16:25:45.600201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:30.920035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585512+0000","last_change":"2023-10-08T16:25:45.576917+0000","last_active":"2023-10-08T16:25:45.585512+0000","last_peered":"2023-10-08T16:25:45.585512+0000","last_clean":"2023-10-08T16:25:45.585512+0000","last_became_active":"2023-10-08T16:25:45.576667+0000","last_became_peered":"2023-10-08T16:25:45.576667+0000","last_unstale":"2023-10-08T16:25:45.585512+0000","last_undegraded":"2023-10-08T16:25:45.585512+0000","last_fullsized":"2023-10-08T16:25:45.585512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:01.278875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591660+0000","last_change":"2023-10-08T16:25:45.583307+0000","last_active":"2023-10-08T16:25:45.591660+0000","last_peered":"2023-10-08T16:25:45.591660+0000","last_clean":"2023-10-08T16:25:45.591660+0000","last_became_active":"2023-10-08T16:25:45.583039+0000","last_became_peered":"2023-10-08T16:25:45.583039+0000","last_unstale":"2023-10-08T16:25:45.591660+0000","last_undegraded":"2023-10-08T16:25:45.591660+0000","last_fullsized":"2023-10-08T16:25:45.591660+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542564+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538641+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:09.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548265+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:55.377049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548052+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:03.328786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591640+0000","last_change":"2023-10-08T16:25:45.582599+0000","last_active":"2023-10-08T16:25:45.591640+0000","last_peered":"2023-10-08T16:25:45.591640+0000","last_clean":"2023-10-08T16:25:45.591640+0000","last_became_active":"2023-10-08T16:25:45.582327+0000","last_became_peered":"2023-10-08T16:25:45.582327+0000","last_unstale":"2023-10-08T16:25:45.591640+0000","last_undegraded":"2023-10-08T16:25:45.591640+0000","last_fullsized":"2023-10-08T16:25:45.591640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:53.896274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538621+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:15.388455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.539531+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:12.410069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548083+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:42.462686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571192+0000","last_change":"2023-10-08T16:25:44.563896+0000","last_active":"2023-10-08T16:25:45.571192+0000","last_peered":"2023-10-08T16:25:45.571192+0000","last_clean":"2023-10-08T16:25:45.571192+0000","last_became_active":"2023-10-08T16:25:44.563641+0000","last_became_peered":"2023-10-08T16:25:44.563641+0000","last_unstale":"2023-10-08T16:25:45.571192+0000","last_undegraded":"2023-10-08T16:25:45.571192+0000","last_fullsized":"2023-10-08T16:25:45.571192+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:50.684591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541966+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:03.765895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541722+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:09.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542940+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538614+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604552+0000","last_change":"2023-10-08T16:25:44.565264+0000","last_active":"2023-10-08T16:25:45.604552+0000","last_peered":"2023-10-08T16:25:45.604552+0000","last_clean":"2023-10-08T16:25:45.604552+0000","last_became_active":"2023-10-08T16:25:44.564967+0000","last_became_peered":"2023-10-08T16:25:44.564967+0000","last_unstale":"2023-10-08T16:25:45.604552+0000","last_undegraded":"2023-10-08T16:25:45.604552+0000","last_fullsized":"2023-10-08T16:25:45.604552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:46.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.544563+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:47.799650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592361+0000","last_change":"2023-10-08T16:25:45.587967+0000","last_active":"2023-10-08T16:25:45.592361+0000","last_peered":"2023-10-08T16:25:45.592361+0000","last_clean":"2023-10-08T16:25:45.592361+0000","last_became_active":"2023-10-08T16:25:45.587092+0000","last_became_peered":"2023-10-08T16:25:45.587092+0000","last_unstale":"2023-10-08T16:25:45.592361+0000","last_undegraded":"2023-10-08T16:25:45.592361+0000","last_fullsized":"2023-10-08T16:25:45.592361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:56.717915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.539486+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592213+0000","last_change":"2023-10-08T16:25:45.585139+0000","last_active":"2023-10-08T16:25:45.592213+0000","last_peered":"2023-10-08T16:25:45.592213+0000","last_clean":"2023-10-08T16:25:45.592213+0000","last_became_active":"2023-10-08T16:25:45.584865+0000","last_became_peered":"2023-10-08T16:25:45.584865+0000","last_unstale":"2023-10-08T16:25:45.592213+0000","last_undegraded":"2023-10-08T16:25:45.592213+0000","last_fullsized":"2023-10-08T16:25:45.592213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:39.963917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546769+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:47.033554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543118+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548631+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:10.183611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546701+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:59.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543886+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546213+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:25.264207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.545880+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:53.320887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543240+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:12.298198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603898+0000","last_change":"2023-10-08T16:25:44.551814+0000","last_active":"2023-10-08T16:25:45.603898+0000","last_peered":"2023-10-08T16:25:45.603898+0000","last_clean":"2023-10-08T16:25:45.603898+0000","last_became_active":"2023-10-08T16:25:44.551552+0000","last_became_peered":"2023-10-08T16:25:44.551552+0000","last_unstale":"2023-10-08T16:25:45.603898+0000","last_undegraded":"2023-10-08T16:25:45.603898+0000","last_fullsized":"2023-10-08T16:25:45.603898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:21.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571579+0000","last_change":"2023-10-08T16:25:44.566555+0000","last_active":"2023-10-08T16:25:45.571579+0000","last_peered":"2023-10-08T16:25:45.571579+0000","last_clean":"2023-10-08T16:25:45.571579+0000","last_became_active":"2023-10-08T16:25:44.564889+0000","last_became_peered":"2023-10-08T16:25:44.564889+0000","last_unstale":"2023-10-08T16:25:45.571579+0000","last_undegraded":"2023-10-08T16:25:45.571579+0000","last_fullsized":"2023-10-08T16:25:45.571579+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:21.570754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542389+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:22.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541699+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:15.388455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548321+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:20:27.131944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538870+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:22.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541693+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:25.301553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538755+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:03.765895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586322+0000","last_change":"2023-10-08T16:25:45.583813+0000","last_active":"2023-10-08T16:25:45.586322+0000","last_peered":"2023-10-08T16:25:45.586322+0000","last_clean":"2023-10-08T16:25:45.586322+0000","last_became_active":"2023-10-08T16:25:45.583329+0000","last_became_peered":"2023-10-08T16:25:45.583329+0000","last_unstale":"2023-10-08T16:25:45.586322+0000","last_undegraded":"2023-10-08T16:25:45.586322+0000","last_fullsized":"2023-10-08T16:25:45.586322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:44.737697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543424+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:01.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"102'205","reported_seq":556,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-08T16:25:41.497996+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:41.497996+0000","last_peered":"2023-10-08T16:25:41.497996+0000","last_clean":"2023-10-08T16:25:41.497996+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:41.497996+0000","last_undegraded":"2023-10-08T16:25:41.497996+0000","last_fullsized":"2023-10-08T16:25:41.497996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307368,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1933312,"data_stored":1240151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.94599999999999995,"15min":0.99199999999999999},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.042},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.05},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89500000000000002,"5min":0.95199999999999996,"15min":1.002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.98299999999999998,"5min":1.0389999999999999,"15min":5.5590000000000002},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.57499999999999996,"5min":0.439,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.351,"15min":1.351},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.022,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.173,"15min":1.173},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.627,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.76800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.071,"15min":1.081},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.87,"5min":1.034,"15min":1.0800000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"min":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96799999999999997,"5min":1.0149999999999999,"15min":1.069},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.125},"last":0.749}]},{"osd":4,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":1.073},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.871}]},{"osd":5,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":1.272,"15min":1.272},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0680000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":676664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42199999999999999,"15min":0.44600000000000001},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.873},"last":0.318},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61099999999999999,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78000000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.95199999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96899999999999997,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.0660000000000001,"15min":1.224},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78500000000000003,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0780000000000001,"15min":1.206},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.89900000000000002,"5min":1.101,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.81999999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.1839999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56999999999999995},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072652,"statfs":{"total":96636764160,"available":96330395648,"internally_reserved":0,"allocated":1945600,"data_stored":1246348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":1.0349999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":1.0509999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":1.135}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.503}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":1,"15min":1},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.76400000000000001},"min":{"1min":0.54100000000000004,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.95399999999999996,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.753}]},{"osd":5,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":1.1319999999999999,"15min":1.2110000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96199999999999997,"5min":1.093,"15min":1.3200000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.87}]},{"osd":7,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.23},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82099999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":655980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":1.02,"15min":1.02},"last":0.84999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84499999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.016},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.379},"max":{"1min":0.878,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.085,"15min":1.1060000000000001},"last":0.93999999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1339999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.99199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.47,"15min":1.47},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0589999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79200000000000004,"5min":2.661,"15min":2.661},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.611,"15min":1.611},"last":1.04}]},{"osd":7,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.161},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310896,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060944,"statfs":{"total":96636764160,"available":96318406656,"internally_reserved":0,"allocated":1351680,"data_stored":655980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0129999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72599999999999998,"15min":0.749},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93300000000000005,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.745},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.05},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92000000000000004,"5min":0.97599999999999998,"15min":1.0389999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98099999999999998,"5min":4.931,"15min":4.931},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.081,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.0129999999999999,"5min":1.96,"15min":1.96},"last":0.63}]},{"osd":4,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69499999999999995,"15min":0.63300000000000001},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":1.0489999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96499999999999997,"5min":2.024,"15min":2.024},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.105,"5min":2.157,"15min":2.157},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:50.180 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.399+0000 7fb71bfff700 1 Processor -- start 2023-10-08T16:25:50.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.399+0000 7fb71bfff700 1 -- start start 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb71c153c30 0x7fb71c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71c0cf110 0x7fb71c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c15afd0 con 0x7fb71c15de50 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c15b2b0 con 0x7fb71c0cf110 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c15b590 con 0x7fb71c153c30 2023-10-08T16:25:50.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71c0cf110 0x7fb71c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb71c0cf110 0x7fb71c15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53752/0 (socket says 172.21.15.12:53752) 2023-10-08T16:25:50.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71b7fe700 1 -- 172.21.15.12:0/3409002174 learned_addr learned my addr 172.21.15.12:0/3409002174 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:50.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.401+0000 7fb71affd700 1 --2- 172.21.15.12:0/3409002174 >> v2:172.21.15.29:3300/0 conn(0x7fb71c153c30 0x7fb71c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb71b7fe700 1 -- 172.21.15.12:0/3409002174 >> v2:172.21.15.29:3300/0 conn(0x7fb71c153c30 msgr2=0x7fb71c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:50.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/3409002174 >> v2:172.21.15.29:3300/0 conn(0x7fb71c153c30 0x7fb71c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb71b7fe700 1 -- 172.21.15.12:0/3409002174 >> v1:172.21.15.29:6789/0 conn(0x7fb71c15de50 legacy=0x7fb71c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb71b7fe700 1 -- 172.21.15.12:0/3409002174 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c15b870 con 0x7fb71c0cf110 2023-10-08T16:25:50.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/3409002174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c0cf110 0x7fb71c15c070 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb71c06ead0 tx=0x7fb714009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ede0579892ff69 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb719ffb700 1 -- 172.21.15.12:0/3409002174 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71400e070 con 0x7fb71c0cf110 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb719ffb700 1 -- 172.21.15.12:0/3409002174 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400ba20 con 0x7fb71c0cf110 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.402+0000 7fb719ffb700 1 -- 172.21.15.12:0/3409002174 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7140092e0 con 0x7fb71c0cf110 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 -- 172.21.15.12:0/3409002174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c0cf110 msgr2=0x7fb71c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 --2- 172.21.15.12:0/3409002174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c0cf110 0x7fb71c15c070 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb71c06ead0 tx=0x7fb714009840 comp rx=0 tx=0).stop 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 -- 172.21.15.12:0/3409002174 shutdown_connections 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 --2- 172.21.15.12:0/3409002174 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c0cf110 0x7fb71c15c070 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 --2- 172.21.15.12:0/3409002174 >> v2:172.21.15.29:3300/0 conn(0x7fb71c153c30 0x7fb71c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 -- 172.21.15.12:0/3409002174 >> 172.21.15.12:0/3409002174 conn(0x7fb71c0703a0 msgr2=0x7fb71c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 -- 172.21.15.12:0/3409002174 shutdown_connections 2023-10-08T16:25:50.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.403+0000 7fb71bfff700 1 -- 172.21.15.12:0/3409002174 wait complete. 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.404+0000 7fb71bfff700 1 Processor -- start 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 -- start start 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb71c0cf110 0x7fb71c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c15de50 0x7fb71c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c9530 con 0x7fb71c153c30 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0b5e30 con 0x7fb71c15de50 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.405+0000 7fb71bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0c8920 con 0x7fb71c0cf110 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53762/0 (socket says 172.21.15.12:53762) 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 -- 172.21.15.12:0/1106398171 learned_addr learned my addr 172.21.15.12:0/1106398171 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71affd700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb71c0cf110 0x7fb71c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71b7fe700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c15de50 0x7fb71c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 -- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb71c0cf110 msgr2=0x7fb71c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb71c0cf110 0x7fb71c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 -- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c15de50 msgr2=0x7fb71c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c15de50 0x7fb71c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 -- 172.21.15.12:0/1106398171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb714009ae0 con 0x7fb71c153c30 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.406+0000 7fb71a7fc700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c510 tx=0x7fb71000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.407+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710011590 con 0x7fb71c153c30 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.407+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb710011710 con 0x7fb71c153c30 2023-10-08T16:25:50.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.407+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb710011ad0 con 0x7fb71c153c30 2023-10-08T16:25:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.407+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c0c8c00 con 0x7fb71c153c30 2023-10-08T16:25:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.407+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c0c91c0 con 0x7fb71c153c30 2023-10-08T16:25:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.408+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c0c9350 con 0x7fb71c153c30 2023-10-08T16:25:50.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.409+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb71001b3b0 con 0x7fb71c153c30 2023-10-08T16:25:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.410+0000 7fb702ffd700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.410+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fb710083c90 con 0x7fb71c153c30 2023-10-08T16:25:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.410+0000 7fb71affd700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.411+0000 7fb71affd700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 0x7fb7080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d40 tx=0x7fb70c008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.414+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb710050cd0 con 0x7fb71c153c30 2023-10-08T16:25:50.523 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-08T16:25:50.522+0000 7faba73f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:25:50.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.611+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb71c04c3c0 con 0x7fb708066f30 2023-10-08T16:25:50.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.619+0000 7fb702ffd700 1 -- 172.21.15.12:0/1106398171 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280011 (secure 0 0 0) 0x7fb71c04c3c0 con 0x7fb708066f30 2023-10-08T16:25:50.623 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.623+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 msgr2=0x7fb7080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.623+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 0x7fb7080693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d40 tx=0x7fb70c008040 comp rx=0 tx=0).stop 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.623+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 msgr2=0x7fb71c152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.623+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7fb71000c510 tx=0x7fb71000c8d0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 shutdown_connections 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb708066f30 0x7fb7080693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb71c15de50 0x7fb71c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb71c0cf110 0x7fb71c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 --2- 172.21.15.12:0/1106398171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb71c153c30 0x7fb71c152f50 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 >> 172.21.15.12:0/1106398171 conn(0x7fb71c0703a0 msgr2=0x7fb71c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:50.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 shutdown_connections 2023-10-08T16:25:50.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.624+0000 7fb71bfff700 1 -- 172.21.15.12:0/1106398171 wait complete. 2023-10-08T16:25:50.627 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:50.642 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:25:48.961458+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590402,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":325,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":209,"ondisk_log_size":209,"up":86,"acting":86,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439176,"kb_used_data":11720,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535544,"statfs":{"total":773094113280,"available":770596397056,"internally_reserved":0,"allocated":12001280,"data_stored":6424472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.423954"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592653+0000","last_change":"2023-10-08T16:25:45.586001+0000","last_active":"2023-10-08T16:25:45.592653+0000","last_peered":"2023-10-08T16:25:45.592653+0000","last_clean":"2023-10-08T16:25:45.592653+0000","last_became_active":"2023-10-08T16:25:45.585724+0000","last_became_peered":"2023-10-08T16:25:45.585724+0000","last_unstale":"2023-10-08T16:25:45.592653+0000","last_undegraded":"2023-10-08T16:25:45.592653+0000","last_fullsized":"2023-10-08T16:25:45.592653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586090+0000","last_change":"2023-10-08T16:25:45.576696+0000","last_active":"2023-10-08T16:25:45.586090+0000","last_peered":"2023-10-08T16:25:45.586090+0000","last_clean":"2023-10-08T16:25:45.586090+0000","last_became_active":"2023-10-08T16:25:45.576430+0000","last_became_peered":"2023-10-08T16:25:45.576430+0000","last_unstale":"2023-10-08T16:25:45.586090+0000","last_undegraded":"2023-10-08T16:25:45.586090+0000","last_fullsized":"2023-10-08T16:25:45.586090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:42.921358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600258+0000","last_change":"2023-10-08T16:25:45.591542+0000","last_active":"2023-10-08T16:25:45.600258+0000","last_peered":"2023-10-08T16:25:45.600258+0000","last_clean":"2023-10-08T16:25:45.600258+0000","last_became_active":"2023-10-08T16:25:45.591281+0000","last_became_peered":"2023-10-08T16:25:45.591281+0000","last_unstale":"2023-10-08T16:25:45.600258+0000","last_undegraded":"2023-10-08T16:25:45.600258+0000","last_fullsized":"2023-10-08T16:25:45.600258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:08.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600201+0000","last_change":"2023-10-08T16:25:45.595131+0000","last_active":"2023-10-08T16:25:45.600201+0000","last_peered":"2023-10-08T16:25:45.600201+0000","last_clean":"2023-10-08T16:25:45.600201+0000","last_became_active":"2023-10-08T16:25:45.594345+0000","last_became_peered":"2023-10-08T16:25:45.594345+0000","last_unstale":"2023-10-08T16:25:45.600201+0000","last_undegraded":"2023-10-08T16:25:45.600201+0000","last_fullsized":"2023-10-08T16:25:45.600201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:30.920035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585512+0000","last_change":"2023-10-08T16:25:45.576917+0000","last_active":"2023-10-08T16:25:45.585512+0000","last_peered":"2023-10-08T16:25:45.585512+0000","last_clean":"2023-10-08T16:25:45.585512+0000","last_became_active":"2023-10-08T16:25:45.576667+0000","last_became_peered":"2023-10-08T16:25:45.576667+0000","last_unstale":"2023-10-08T16:25:45.585512+0000","last_undegraded":"2023-10-08T16:25:45.585512+0000","last_fullsized":"2023-10-08T16:25:45.585512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:01.278875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591660+0000","last_change":"2023-10-08T16:25:45.583307+0000","last_active":"2023-10-08T16:25:45.591660+0000","last_peered":"2023-10-08T16:25:45.591660+0000","last_clean":"2023-10-08T16:25:45.591660+0000","last_became_active":"2023-10-08T16:25:45.583039+0000","last_became_peered":"2023-10-08T16:25:45.583039+0000","last_unstale":"2023-10-08T16:25:45.591660+0000","last_undegraded":"2023-10-08T16:25:45.591660+0000","last_fullsized":"2023-10-08T16:25:45.591660+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542564+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538641+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:09.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548265+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:55.377049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548052+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:03.328786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591640+0000","last_change":"2023-10-08T16:25:45.582599+0000","last_active":"2023-10-08T16:25:45.591640+0000","last_peered":"2023-10-08T16:25:45.591640+0000","last_clean":"2023-10-08T16:25:45.591640+0000","last_became_active":"2023-10-08T16:25:45.582327+0000","last_became_peered":"2023-10-08T16:25:45.582327+0000","last_unstale":"2023-10-08T16:25:45.591640+0000","last_undegraded":"2023-10-08T16:25:45.591640+0000","last_fullsized":"2023-10-08T16:25:45.591640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:53.896274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538621+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:15.388455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.539531+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:12.410069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548083+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:42.462686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571192+0000","last_change":"2023-10-08T16:25:44.563896+0000","last_active":"2023-10-08T16:25:45.571192+0000","last_peered":"2023-10-08T16:25:45.571192+0000","last_clean":"2023-10-08T16:25:45.571192+0000","last_became_active":"2023-10-08T16:25:44.563641+0000","last_became_peered":"2023-10-08T16:25:44.563641+0000","last_unstale":"2023-10-08T16:25:45.571192+0000","last_undegraded":"2023-10-08T16:25:45.571192+0000","last_fullsized":"2023-10-08T16:25:45.571192+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:50.684591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541966+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:03.765895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541722+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:09.714495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542940+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538614+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604552+0000","last_change":"2023-10-08T16:25:44.565264+0000","last_active":"2023-10-08T16:25:45.604552+0000","last_peered":"2023-10-08T16:25:45.604552+0000","last_clean":"2023-10-08T16:25:45.604552+0000","last_became_active":"2023-10-08T16:25:44.564967+0000","last_became_peered":"2023-10-08T16:25:44.564967+0000","last_unstale":"2023-10-08T16:25:45.604552+0000","last_undegraded":"2023-10-08T16:25:45.604552+0000","last_fullsized":"2023-10-08T16:25:45.604552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:46.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.544563+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:34:47.799650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592361+0000","last_change":"2023-10-08T16:25:45.587967+0000","last_active":"2023-10-08T16:25:45.592361+0000","last_peered":"2023-10-08T16:25:45.592361+0000","last_clean":"2023-10-08T16:25:45.592361+0000","last_became_active":"2023-10-08T16:25:45.587092+0000","last_became_peered":"2023-10-08T16:25:45.587092+0000","last_unstale":"2023-10-08T16:25:45.592361+0000","last_undegraded":"2023-10-08T16:25:45.592361+0000","last_fullsized":"2023-10-08T16:25:45.592361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:56.717915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.539486+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592213+0000","last_change":"2023-10-08T16:25:45.585139+0000","last_active":"2023-10-08T16:25:45.592213+0000","last_peered":"2023-10-08T16:25:45.592213+0000","last_clean":"2023-10-08T16:25:45.592213+0000","last_became_active":"2023-10-08T16:25:45.584865+0000","last_became_peered":"2023-10-08T16:25:45.584865+0000","last_unstale":"2023-10-08T16:25:45.592213+0000","last_undegraded":"2023-10-08T16:25:45.592213+0000","last_fullsized":"2023-10-08T16:25:45.592213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:39.963917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546769+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:47.033554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543118+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548631+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:10.183611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546701+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:58:59.553436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543886+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:38:56.806295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.546213+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:39:25.264207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.545880+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:53.320887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543240+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:12.298198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603898+0000","last_change":"2023-10-08T16:25:44.551814+0000","last_active":"2023-10-08T16:25:45.603898+0000","last_peered":"2023-10-08T16:25:45.603898+0000","last_clean":"2023-10-08T16:25:45.603898+0000","last_became_active":"2023-10-08T16:25:44.551552+0000","last_became_peered":"2023-10-08T16:25:44.551552+0000","last_unstale":"2023-10-08T16:25:45.603898+0000","last_undegraded":"2023-10-08T16:25:45.603898+0000","last_fullsized":"2023-10-08T16:25:45.603898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:21.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571579+0000","last_change":"2023-10-08T16:25:44.566555+0000","last_active":"2023-10-08T16:25:45.571579+0000","last_peered":"2023-10-08T16:25:45.571579+0000","last_clean":"2023-10-08T16:25:45.571579+0000","last_became_active":"2023-10-08T16:25:44.564889+0000","last_became_peered":"2023-10-08T16:25:44.564889+0000","last_unstale":"2023-10-08T16:25:45.571579+0000","last_undegraded":"2023-10-08T16:25:45.571579+0000","last_fullsized":"2023-10-08T16:25:45.571579+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:21.570754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.542389+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:22.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541699+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:15.388455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.548321+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:20:27.131944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538870+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:22.546696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.541693+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:25.301553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:25:44.534785+0000","last_change":"2023-10-08T16:25:44.534785+0000","last_active":"2023-10-08T16:25:44.534785+0000","last_peered":"2023-10-08T16:25:44.534785+0000","last_clean":"2023-10-08T16:25:44.534785+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:44.534785+0000","last_undegraded":"2023-10-08T16:25:44.534785+0000","last_fullsized":"2023-10-08T16:25:44.534785+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.538755+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:03.765895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586322+0000","last_change":"2023-10-08T16:25:45.583813+0000","last_active":"2023-10-08T16:25:45.586322+0000","last_peered":"2023-10-08T16:25:45.586322+0000","last_clean":"2023-10-08T16:25:45.586322+0000","last_became_active":"2023-10-08T16:25:45.583329+0000","last_became_peered":"2023-10-08T16:25:45.583329+0000","last_unstale":"2023-10-08T16:25:45.586322+0000","last_undegraded":"2023-10-08T16:25:45.586322+0000","last_fullsized":"2023-10-08T16:25:45.586322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:44.737697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T16:25:43.526350+0000","last_change":"2023-10-08T16:25:43.543424+0000","last_active":"2023-10-08T16:25:43.526350+0000","last_peered":"2023-10-08T16:25:43.526350+0000","last_clean":"2023-10-08T16:25:43.526350+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:25:43.526350+0000","last_undegraded":"2023-10-08T16:25:43.526350+0000","last_fullsized":"2023-10-08T16:25:43.526350+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:01.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"102'205","reported_seq":556,"reported_epoch":109,"state":"active+clean","last_fresh":"2023-10-08T16:25:41.497996+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:41.497996+0000","last_peered":"2023-10-08T16:25:41.497996+0000","last_clean":"2023-10-08T16:25:41.497996+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:41.497996+0000","last_undegraded":"2023-10-08T16:25:41.497996+0000","last_fullsized":"2023-10-08T16:25:41.497996+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":20,"acting":20,"num_store_stats":1},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307368,"kb_used_data":1888,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064472,"statfs":{"total":96636764160,"available":96322019328,"internally_reserved":0,"allocated":1933312,"data_stored":1240151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.94599999999999995,"15min":0.99199999999999999},"last":0.753}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.042},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.05},"last":0.622}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89500000000000002,"5min":0.95199999999999996,"15min":1.002},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.98299999999999998,"5min":1.0389999999999999,"15min":5.5590000000000002},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.57499999999999996,"5min":0.439,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.351,"15min":1.351},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.022,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.173,"15min":1.173},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.627,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0149999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.76800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.071,"15min":1.081},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.87,"5min":1.034,"15min":1.0800000000000001},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"min":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96799999999999997,"5min":1.0149999999999999,"15min":1.069},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.125},"last":0.749}]},{"osd":4,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":1.073},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.871}]},{"osd":5,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":1.272,"15min":1.272},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":1.0449999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0680000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.99099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":676664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42199999999999999,"15min":0.44600000000000001},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.873},"last":0.318},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61099999999999999,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78000000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.95199999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96899999999999997,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.0660000000000001,"15min":1.224},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78500000000000003,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0780000000000001,"15min":1.206},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.89900000000000002,"5min":1.101,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.81999999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.1839999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56999999999999995},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072652,"statfs":{"total":96636764160,"available":96330395648,"internally_reserved":0,"allocated":1945600,"data_stored":1246348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.496},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.25800000000000001},"max":{"1min":0.72299999999999998,"5min":1.1339999999999999,"15min":1.524},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54700000000000004,"15min":0.56399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67200000000000004,"5min":0.81100000000000005,"15min":1.679},"last":0.55300000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.52500000000000002,"15min":0.51700000000000002},"min":{"1min":0.38600000000000001,"5min":0.37,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.093,"15min":1.5569999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.51100000000000001,"15min":0.52500000000000002},"min":{"1min":0.35499999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71499999999999997,"5min":0.94399999999999995,"15min":1.7270000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71099999999999997,"5min":0.878,"15min":1.371},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.627,"15min":0.63300000000000001},"min":{"1min":0.48999999999999999,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.69599999999999995,"5min":1.21,"15min":1.2470000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.751,"15min":0.76600000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":0.88500000000000001,"5min":1.1579999999999999,"15min":1.4790000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78200000000000003,"15min":0.79200000000000004},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.46400000000000002},"max":{"1min":0.90600000000000003,"5min":1.1899999999999999,"15min":1.325},"last":1.0349999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.78600000000000003,"15min":0.79300000000000004},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.47899999999999998},"max":{"1min":1.026,"5min":1.1439999999999999,"15min":1.153},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97499999999999998,"5min":1.2330000000000001,"15min":1.4410000000000001},"last":1.0509999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.81000000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":0.88500000000000001,"5min":1.1950000000000001,"15min":1.288},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.04,"5min":1.212,"15min":1.262},"last":1.135}]},{"osd":7,"last update":"Sun Oct 8 16:24:40 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.82499999999999996},"min":{"1min":0.61299999999999999,"5min":0.58299999999999996,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.1579999999999999,"15min":1.2749999999999999},"last":1.0680000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.80500000000000005,"15min":0.81599999999999995},"min":{"1min":0.55700000000000005,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":0.96399999999999997,"5min":1.202,"15min":1.4079999999999999},"last":1.157}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.47299999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.52300000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.503}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306788,"kb_used_data":1308,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065052,"statfs":{"total":96636764160,"available":96322613248,"internally_reserved":0,"allocated":1339392,"data_stored":649783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.48599999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":1,"15min":1},"last":0.57799999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.76400000000000001},"min":{"1min":0.54100000000000004,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.95399999999999996,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.753}]},{"osd":5,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":1.1319999999999999,"15min":1.2110000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96199999999999997,"5min":1.093,"15min":1.3200000000000001},"last":0.85599999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.87}]},{"osd":7,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.23},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82099999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298608,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073232,"statfs":{"total":96636764160,"available":96330989568,"internally_reserved":0,"allocated":1351680,"data_stored":655980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":1.02,"15min":1.02},"last":0.84999999999999998}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84499999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":1.016},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.379},"max":{"1min":0.878,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.085,"15min":1.1060000000000001},"last":0.93999999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1339999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.99199999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.47,"15min":1.47},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0589999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79200000000000004,"5min":2.661,"15min":2.661},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.611,"15min":1.611},"last":1.04}]},{"osd":7,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":1.161},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310896,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060944,"statfs":{"total":96636764160,"available":96318406656,"internally_reserved":0,"allocated":1351680,"data_stored":655980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0129999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.89600000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72599999999999998,"15min":0.749},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93300000000000005,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.745},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.05},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92000000000000004,"5min":0.97599999999999998,"15min":1.0389999999999999},"last":0.497},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98099999999999998,"5min":4.931,"15min":4.931},"last":0.69499999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.081,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.0129999999999999,"5min":1.96,"15min":1.96},"last":0.63}]},{"osd":4,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69499999999999995,"15min":0.63300000000000001},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":1.0489999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.58299999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96499999999999997,"5min":2.024,"15min":2.024},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.105,"5min":2.157,"15min":2.157},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:50.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.868+0000 7f5c489fe700 1 Processor -- start 2023-10-08T16:25:50.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.868+0000 7f5c489fe700 1 -- start start 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c44153c30 0x7f5c4415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c4415de50 0x7f5c440cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5c440cef40 0x7f5c4406d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4415afd0 con 0x7f5c4415de50 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4415b2b0 con 0x7f5c440cef40 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c489fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4415b590 con 0x7f5c44153c30 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.869+0000 7f5c4259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c4415de50 0x7f5c440cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5c4415de50 0x7f5c440cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53778/0 (socket says 172.21.15.12:53778) 2023-10-08T16:25:50.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 -- 172.21.15.12:0/3481742317 learned_addr learned my addr 172.21.15.12:0/3481742317 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4359e700 1 --2- 172.21.15.12:0/3481742317 >> v2:172.21.15.29:3300/0 conn(0x7f5c440cef40 0x7f5c4406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c42d9d700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c44153c30 0x7f5c4415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 -- 172.21.15.12:0/3481742317 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c44153c30 msgr2=0x7f5c4415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c44153c30 0x7f5c4415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 -- 172.21.15.12:0/3481742317 >> v2:172.21.15.29:3300/0 conn(0x7f5c440cef40 msgr2=0x7f5c4406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 --2- 172.21.15.12:0/3481742317 >> v2:172.21.15.29:3300/0 conn(0x7f5c440cef40 0x7f5c4406d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 -- 172.21.15.12:0/3481742317 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c4415b870 con 0x7f5c4415de50 2023-10-08T16:25:50.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.870+0000 7f5c4259c700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440cea00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f5c44071370 tx=0x7f5c38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7ad90f6e965ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c41d9b700 1 -- 172.21.15.12:0/3481742317 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800b640 con 0x7f5c4415de50 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c41d9b700 1 -- 172.21.15.12:0/3481742317 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800b7a0 con 0x7f5c4415de50 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c41d9b700 1 -- 172.21.15.12:0/3481742317 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800bb60 con 0x7f5c4415de50 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 -- 172.21.15.12:0/3481742317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 msgr2=0x7f5c440cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440cea00 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f5c44071370 tx=0x7f5c38009250 comp rx=0 tx=0).stop 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 -- 172.21.15.12:0/3481742317 shutdown_connections 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 --2- 172.21.15.12:0/3481742317 >> v2:172.21.15.29:3300/0 conn(0x7f5c440cef40 0x7f5c4406d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c44153c30 0x7f5c4415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 --2- 172.21.15.12:0/3481742317 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440cea00 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 -- 172.21.15.12:0/3481742317 >> 172.21.15.12:0/3481742317 conn(0x7f5c440703a0 msgr2=0x7f5c440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 -- 172.21.15.12:0/3481742317 shutdown_connections 2023-10-08T16:25:50.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.871+0000 7f5c489fe700 1 -- 172.21.15.12:0/3481742317 wait complete. 2023-10-08T16:25:50.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.873+0000 7f5c489fe700 1 Processor -- start 2023-10-08T16:25:50.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.873+0000 7f5c489fe700 1 -- start start 2023-10-08T16:25:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c440cef40 0x7f5c4413e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c44153c30 0x7f5c440cbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440ccb90 con 0x7f5c4415de50 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440c8800 con 0x7f5c44153c30 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c489fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c440cc5d0 con 0x7f5c440cef40 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c4359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c4359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53782/0 (socket says 172.21.15.12:53782) 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c4359e700 1 -- 172.21.15.12:0/460517625 learned_addr learned my addr 172.21.15.12:0/460517625 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c42d9d700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c440cef40 0x7f5c4413e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.874+0000 7f5c4259c700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c44153c30 0x7f5c440cbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 -- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c440cef40 msgr2=0x7f5c4413e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c440cef40 0x7f5c4413e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 -- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c44153c30 msgr2=0x7f5c440cbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c44153c30 0x7f5c440cbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 -- 172.21.15.12:0/460517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380094f0 con 0x7f5c4415de50 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c4359e700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009e90 tx=0x7f5c3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c00cb70 con 0x7f5c4415de50 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c00f040 con 0x7f5c4415de50 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c014480 con 0x7f5c4415de50 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c440cc8b0 con 0x7f5c4415de50 2023-10-08T16:25:50.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.875+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c44151f50 con 0x7f5c4415de50 2023-10-08T16:25:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.876+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c440c8970 con 0x7f5c4415de50 2023-10-08T16:25:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.877+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3c014830 con 0x7f5c4415de50 2023-10-08T16:25:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.878+0000 7f5c2affd700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 0x7f5c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.878+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5c3c085130 con 0x7f5c4415de50 2023-10-08T16:25:50.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.879+0000 7f5c42d9d700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 0x7f5c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:50.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.879+0000 7f5c42d9d700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 0x7f5c300693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009d20 tx=0x7f5c340091a0 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:50.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:50.883+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c3c052170 con 0x7f5c4415de50 2023-10-08T16:25:51.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.082+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c4404c3c0 con 0x7f5c30066f30 2023-10-08T16:25:51.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.091+0000 7f5c2affd700 1 -- 172.21.15.12:0/460517625 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289355 (secure 0 0 0) 0x7f5c4404c3c0 con 0x7f5c30066f30 2023-10-08T16:25:51.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 msgr2=0x7f5c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 0x7f5c300693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5c34009d20 tx=0x7f5c340091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 msgr2=0x7f5c440b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c009e90 tx=0x7f5c3c00b040 comp rx=0 tx=0).stop 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 shutdown_connections 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5c30066f30 0x7f5c300693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5c4415de50 0x7f5c440b32d0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5c440cef40 0x7f5c4413e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 --2- 172.21.15.12:0/460517625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5c44153c30 0x7f5c440cbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 >> 172.21.15.12:0/460517625 conn(0x7f5c440703a0 msgr2=0x7f5c440c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 shutdown_connections 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.095+0000 7f5c489fe700 1 -- 172.21.15.12:0/460517625 wait complete. 2023-10-08T16:25:51.099 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:51.113 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:25:50.961808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439528,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535192,"statfs":{"total":773094113280,"available":770596036608,"internally_reserved":0,"allocated":12361728,"data_stored":6597108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.421015"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595665+0000","last_change":"2023-10-08T16:25:45.589950+0000","last_active":"2023-10-08T16:25:45.595665+0000","last_peered":"2023-10-08T16:25:45.595665+0000","last_clean":"2023-10-08T16:25:45.595665+0000","last_became_active":"2023-10-08T16:25:45.589614+0000","last_became_peered":"2023-10-08T16:25:45.589614+0000","last_unstale":"2023-10-08T16:25:45.595665+0000","last_undegraded":"2023-10-08T16:25:45.595665+0000","last_fullsized":"2023-10-08T16:25:45.595665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592653+0000","last_change":"2023-10-08T16:25:45.586001+0000","last_active":"2023-10-08T16:25:45.592653+0000","last_peered":"2023-10-08T16:25:45.592653+0000","last_clean":"2023-10-08T16:25:45.592653+0000","last_became_active":"2023-10-08T16:25:45.585724+0000","last_became_peered":"2023-10-08T16:25:45.585724+0000","last_unstale":"2023-10-08T16:25:45.592653+0000","last_undegraded":"2023-10-08T16:25:45.592653+0000","last_fullsized":"2023-10-08T16:25:45.592653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595899+0000","last_change":"2023-10-08T16:25:45.593576+0000","last_active":"2023-10-08T16:25:45.595899+0000","last_peered":"2023-10-08T16:25:45.595899+0000","last_clean":"2023-10-08T16:25:45.595899+0000","last_became_active":"2023-10-08T16:25:45.593238+0000","last_became_peered":"2023-10-08T16:25:45.593238+0000","last_unstale":"2023-10-08T16:25:45.595899+0000","last_undegraded":"2023-10-08T16:25:45.595899+0000","last_fullsized":"2023-10-08T16:25:45.595899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:01.642697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594827+0000","last_change":"2023-10-08T16:25:45.592344+0000","last_active":"2023-10-08T16:25:45.594827+0000","last_peered":"2023-10-08T16:25:45.594827+0000","last_clean":"2023-10-08T16:25:45.594827+0000","last_became_active":"2023-10-08T16:25:45.592064+0000","last_became_peered":"2023-10-08T16:25:45.592064+0000","last_unstale":"2023-10-08T16:25:45.594827+0000","last_undegraded":"2023-10-08T16:25:45.594827+0000","last_fullsized":"2023-10-08T16:25:45.594827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:13.418504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585550+0000","last_change":"2023-10-08T16:25:45.578187+0000","last_active":"2023-10-08T16:25:45.585550+0000","last_peered":"2023-10-08T16:25:45.585550+0000","last_clean":"2023-10-08T16:25:45.585550+0000","last_became_active":"2023-10-08T16:25:45.577823+0000","last_became_peered":"2023-10-08T16:25:45.577823+0000","last_unstale":"2023-10-08T16:25:45.585550+0000","last_undegraded":"2023-10-08T16:25:45.585550+0000","last_fullsized":"2023-10-08T16:25:45.585550+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585168+0000","last_change":"2023-10-08T16:25:45.583726+0000","last_active":"2023-10-08T16:25:45.585168+0000","last_peered":"2023-10-08T16:25:45.585168+0000","last_clean":"2023-10-08T16:25:45.585168+0000","last_became_active":"2023-10-08T16:25:45.583413+0000","last_became_peered":"2023-10-08T16:25:45.583413+0000","last_unstale":"2023-10-08T16:25:45.585168+0000","last_undegraded":"2023-10-08T16:25:45.585168+0000","last_fullsized":"2023-10-08T16:25:45.585168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:39.641394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595848+0000","last_change":"2023-10-08T16:25:45.594729+0000","last_active":"2023-10-08T16:25:45.595848+0000","last_peered":"2023-10-08T16:25:45.595848+0000","last_clean":"2023-10-08T16:25:45.595848+0000","last_became_active":"2023-10-08T16:25:45.594337+0000","last_became_peered":"2023-10-08T16:25:45.594337+0000","last_unstale":"2023-10-08T16:25:45.595848+0000","last_undegraded":"2023-10-08T16:25:45.595848+0000","last_fullsized":"2023-10-08T16:25:45.595848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:10.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590653+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.590653+0000","last_peered":"2023-10-08T16:25:45.590653+0000","last_clean":"2023-10-08T16:25:45.590653+0000","last_became_active":"2023-10-08T16:25:45.588642+0000","last_became_peered":"2023-10-08T16:25:45.588642+0000","last_unstale":"2023-10-08T16:25:45.590653+0000","last_undegraded":"2023-10-08T16:25:45.590653+0000","last_fullsized":"2023-10-08T16:25:45.590653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:48.041989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583837+0000","last_change":"2023-10-08T16:25:45.580504+0000","last_active":"2023-10-08T16:25:45.583837+0000","last_peered":"2023-10-08T16:25:45.583837+0000","last_clean":"2023-10-08T16:25:45.583837+0000","last_became_active":"2023-10-08T16:25:45.580203+0000","last_became_peered":"2023-10-08T16:25:45.580203+0000","last_unstale":"2023-10-08T16:25:45.583837+0000","last_undegraded":"2023-10-08T16:25:45.583837+0000","last_fullsized":"2023-10-08T16:25:45.583837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598173+0000","last_change":"2023-10-08T16:25:45.597142+0000","last_active":"2023-10-08T16:25:45.598173+0000","last_peered":"2023-10-08T16:25:45.598173+0000","last_clean":"2023-10-08T16:25:45.598173+0000","last_became_active":"2023-10-08T16:25:45.596713+0000","last_became_peered":"2023-10-08T16:25:45.596713+0000","last_unstale":"2023-10-08T16:25:45.598173+0000","last_undegraded":"2023-10-08T16:25:45.598173+0000","last_fullsized":"2023-10-08T16:25:45.598173+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586090+0000","last_change":"2023-10-08T16:25:45.576696+0000","last_active":"2023-10-08T16:25:45.586090+0000","last_peered":"2023-10-08T16:25:45.586090+0000","last_clean":"2023-10-08T16:25:45.586090+0000","last_became_active":"2023-10-08T16:25:45.576430+0000","last_became_peered":"2023-10-08T16:25:45.576430+0000","last_unstale":"2023-10-08T16:25:45.586090+0000","last_undegraded":"2023-10-08T16:25:45.586090+0000","last_fullsized":"2023-10-08T16:25:45.586090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:42.921358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597728+0000","last_change":"2023-10-08T16:25:45.596083+0000","last_active":"2023-10-08T16:25:45.597728+0000","last_peered":"2023-10-08T16:25:45.597728+0000","last_clean":"2023-10-08T16:25:45.597728+0000","last_became_active":"2023-10-08T16:25:45.595822+0000","last_became_peered":"2023-10-08T16:25:45.595822+0000","last_unstale":"2023-10-08T16:25:45.597728+0000","last_undegraded":"2023-10-08T16:25:45.597728+0000","last_fullsized":"2023-10-08T16:25:45.597728+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586244+0000","last_change":"2023-10-08T16:25:45.584050+0000","last_active":"2023-10-08T16:25:45.586244+0000","last_peered":"2023-10-08T16:25:45.586244+0000","last_clean":"2023-10-08T16:25:45.586244+0000","last_became_active":"2023-10-08T16:25:45.583718+0000","last_became_peered":"2023-10-08T16:25:45.583718+0000","last_unstale":"2023-10-08T16:25:45.586244+0000","last_undegraded":"2023-10-08T16:25:45.586244+0000","last_fullsized":"2023-10-08T16:25:45.586244+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594763+0000","last_change":"2023-10-08T16:25:45.592638+0000","last_active":"2023-10-08T16:25:45.594763+0000","last_peered":"2023-10-08T16:25:45.594763+0000","last_clean":"2023-10-08T16:25:45.594763+0000","last_became_active":"2023-10-08T16:25:45.592348+0000","last_became_peered":"2023-10-08T16:25:45.592348+0000","last_unstale":"2023-10-08T16:25:45.594763+0000","last_undegraded":"2023-10-08T16:25:45.594763+0000","last_fullsized":"2023-10-08T16:25:45.594763+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:23.555131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582866+0000","last_change":"2023-10-08T16:25:45.575307+0000","last_active":"2023-10-08T16:25:45.582866+0000","last_peered":"2023-10-08T16:25:45.582866+0000","last_clean":"2023-10-08T16:25:45.582866+0000","last_became_active":"2023-10-08T16:25:45.575019+0000","last_became_peered":"2023-10-08T16:25:45.575019+0000","last_unstale":"2023-10-08T16:25:45.582866+0000","last_undegraded":"2023-10-08T16:25:45.582866+0000","last_fullsized":"2023-10-08T16:25:45.582866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590887+0000","last_change":"2023-10-08T16:25:45.589882+0000","last_active":"2023-10-08T16:25:45.590887+0000","last_peered":"2023-10-08T16:25:45.590887+0000","last_clean":"2023-10-08T16:25:45.590887+0000","last_became_active":"2023-10-08T16:25:45.589606+0000","last_became_peered":"2023-10-08T16:25:45.589606+0000","last_unstale":"2023-10-08T16:25:45.590887+0000","last_undegraded":"2023-10-08T16:25:45.590887+0000","last_fullsized":"2023-10-08T16:25:45.590887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:21.301510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587365+0000","last_change":"2023-10-08T16:25:45.583907+0000","last_active":"2023-10-08T16:25:45.587365+0000","last_peered":"2023-10-08T16:25:45.587365+0000","last_clean":"2023-10-08T16:25:45.587365+0000","last_became_active":"2023-10-08T16:25:45.583647+0000","last_became_peered":"2023-10-08T16:25:45.583647+0000","last_unstale":"2023-10-08T16:25:45.587365+0000","last_undegraded":"2023-10-08T16:25:45.587365+0000","last_fullsized":"2023-10-08T16:25:45.587365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595167+0000","last_change":"2023-10-08T16:25:45.593464+0000","last_active":"2023-10-08T16:25:45.595167+0000","last_peered":"2023-10-08T16:25:45.595167+0000","last_clean":"2023-10-08T16:25:45.595167+0000","last_became_active":"2023-10-08T16:25:45.593263+0000","last_became_peered":"2023-10-08T16:25:45.593263+0000","last_unstale":"2023-10-08T16:25:45.595167+0000","last_undegraded":"2023-10-08T16:25:45.595167+0000","last_fullsized":"2023-10-08T16:25:45.595167+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:16.396889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591914+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.591914+0000","last_peered":"2023-10-08T16:25:45.591914+0000","last_clean":"2023-10-08T16:25:45.591914+0000","last_became_active":"2023-10-08T16:25:45.588818+0000","last_became_peered":"2023-10-08T16:25:45.588818+0000","last_unstale":"2023-10-08T16:25:45.591914+0000","last_undegraded":"2023-10-08T16:25:45.591914+0000","last_fullsized":"2023-10-08T16:25:45.591914+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:10.711535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584058+0000","last_change":"2023-10-08T16:25:45.580427+0000","last_active":"2023-10-08T16:25:45.584058+0000","last_peered":"2023-10-08T16:25:45.584058+0000","last_clean":"2023-10-08T16:25:45.584058+0000","last_became_active":"2023-10-08T16:25:45.579809+0000","last_became_peered":"2023-10-08T16:25:45.579809+0000","last_unstale":"2023-10-08T16:25:45.584058+0000","last_undegraded":"2023-10-08T16:25:45.584058+0000","last_fullsized":"2023-10-08T16:25:45.584058+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:26.309987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594714+0000","last_change":"2023-10-08T16:25:45.591447+0000","last_active":"2023-10-08T16:25:45.594714+0000","last_peered":"2023-10-08T16:25:45.594714+0000","last_clean":"2023-10-08T16:25:45.594714+0000","last_became_active":"2023-10-08T16:25:45.590913+0000","last_became_peered":"2023-10-08T16:25:45.590913+0000","last_unstale":"2023-10-08T16:25:45.594714+0000","last_undegraded":"2023-10-08T16:25:45.594714+0000","last_fullsized":"2023-10-08T16:25:45.594714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:28.456125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600258+0000","last_change":"2023-10-08T16:25:45.591542+0000","last_active":"2023-10-08T16:25:45.600258+0000","last_peered":"2023-10-08T16:25:45.600258+0000","last_clean":"2023-10-08T16:25:45.600258+0000","last_became_active":"2023-10-08T16:25:45.591281+0000","last_became_peered":"2023-10-08T16:25:45.591281+0000","last_unstale":"2023-10-08T16:25:45.600258+0000","last_undegraded":"2023-10-08T16:25:45.600258+0000","last_fullsized":"2023-10-08T16:25:45.600258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:08.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595849+0000","last_change":"2023-10-08T16:25:45.589521+0000","last_active":"2023-10-08T16:25:45.595849+0000","last_peered":"2023-10-08T16:25:45.595849+0000","last_clean":"2023-10-08T16:25:45.595849+0000","last_became_active":"2023-10-08T16:25:45.589068+0000","last_became_peered":"2023-10-08T16:25:45.589068+0000","last_unstale":"2023-10-08T16:25:45.595849+0000","last_undegraded":"2023-10-08T16:25:45.595849+0000","last_fullsized":"2023-10-08T16:25:45.595849+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583057+0000","last_change":"2023-10-08T16:25:45.580064+0000","last_active":"2023-10-08T16:25:45.583057+0000","last_peered":"2023-10-08T16:25:45.583057+0000","last_clean":"2023-10-08T16:25:45.583057+0000","last_became_active":"2023-10-08T16:25:45.579798+0000","last_became_peered":"2023-10-08T16:25:45.579798+0000","last_unstale":"2023-10-08T16:25:45.583057+0000","last_undegraded":"2023-10-08T16:25:45.583057+0000","last_fullsized":"2023-10-08T16:25:45.583057+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600201+0000","last_change":"2023-10-08T16:25:45.595131+0000","last_active":"2023-10-08T16:25:45.600201+0000","last_peered":"2023-10-08T16:25:45.600201+0000","last_clean":"2023-10-08T16:25:45.600201+0000","last_became_active":"2023-10-08T16:25:45.594345+0000","last_became_peered":"2023-10-08T16:25:45.594345+0000","last_unstale":"2023-10-08T16:25:45.600201+0000","last_undegraded":"2023-10-08T16:25:45.600201+0000","last_fullsized":"2023-10-08T16:25:45.600201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:30.920035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594976+0000","last_change":"2023-10-08T16:25:45.592565+0000","last_active":"2023-10-08T16:25:45.594976+0000","last_peered":"2023-10-08T16:25:45.594976+0000","last_clean":"2023-10-08T16:25:45.594976+0000","last_became_active":"2023-10-08T16:25:45.592242+0000","last_became_peered":"2023-10-08T16:25:45.592242+0000","last_unstale":"2023-10-08T16:25:45.594976+0000","last_undegraded":"2023-10-08T16:25:45.594976+0000","last_fullsized":"2023-10-08T16:25:45.594976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588610+0000","last_change":"2023-10-08T16:25:45.586741+0000","last_active":"2023-10-08T16:25:45.588610+0000","last_peered":"2023-10-08T16:25:45.588610+0000","last_clean":"2023-10-08T16:25:45.588610+0000","last_became_active":"2023-10-08T16:25:45.585990+0000","last_became_peered":"2023-10-08T16:25:45.585990+0000","last_unstale":"2023-10-08T16:25:45.588610+0000","last_undegraded":"2023-10-08T16:25:45.588610+0000","last_fullsized":"2023-10-08T16:25:45.588610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596393+0000","last_change":"2023-10-08T16:25:45.589945+0000","last_active":"2023-10-08T16:25:45.596393+0000","last_peered":"2023-10-08T16:25:45.596393+0000","last_clean":"2023-10-08T16:25:45.596393+0000","last_became_active":"2023-10-08T16:25:45.589161+0000","last_became_peered":"2023-10-08T16:25:45.589161+0000","last_unstale":"2023-10-08T16:25:45.596393+0000","last_undegraded":"2023-10-08T16:25:45.596393+0000","last_fullsized":"2023-10-08T16:25:45.596393+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:50.185229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585512+0000","last_change":"2023-10-08T16:25:45.576917+0000","last_active":"2023-10-08T16:25:45.585512+0000","last_peered":"2023-10-08T16:25:45.585512+0000","last_clean":"2023-10-08T16:25:45.585512+0000","last_became_active":"2023-10-08T16:25:45.576667+0000","last_became_peered":"2023-10-08T16:25:45.576667+0000","last_unstale":"2023-10-08T16:25:45.585512+0000","last_undegraded":"2023-10-08T16:25:45.585512+0000","last_fullsized":"2023-10-08T16:25:45.585512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:01.278875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591660+0000","last_change":"2023-10-08T16:25:45.583307+0000","last_active":"2023-10-08T16:25:45.591660+0000","last_peered":"2023-10-08T16:25:45.591660+0000","last_clean":"2023-10-08T16:25:45.591660+0000","last_became_active":"2023-10-08T16:25:45.583039+0000","last_became_peered":"2023-10-08T16:25:45.583039+0000","last_unstale":"2023-10-08T16:25:45.591660+0000","last_undegraded":"2023-10-08T16:25:45.591660+0000","last_fullsized":"2023-10-08T16:25:45.591660+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585526+0000","last_change":"2023-10-08T16:25:45.582116+0000","last_active":"2023-10-08T16:25:45.585526+0000","last_peered":"2023-10-08T16:25:45.585526+0000","last_clean":"2023-10-08T16:25:45.585526+0000","last_became_active":"2023-10-08T16:25:45.581794+0000","last_became_peered":"2023-10-08T16:25:45.581794+0000","last_unstale":"2023-10-08T16:25:45.585526+0000","last_undegraded":"2023-10-08T16:25:45.585526+0000","last_fullsized":"2023-10-08T16:25:45.585526+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:11.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597544+0000","last_change":"2023-10-08T16:25:45.593632+0000","last_active":"2023-10-08T16:25:45.597544+0000","last_peered":"2023-10-08T16:25:45.597544+0000","last_clean":"2023-10-08T16:25:45.597544+0000","last_became_active":"2023-10-08T16:25:45.593322+0000","last_became_peered":"2023-10-08T16:25:45.593322+0000","last_unstale":"2023-10-08T16:25:45.597544+0000","last_undegraded":"2023-10-08T16:25:45.597544+0000","last_fullsized":"2023-10-08T16:25:45.597544+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591412+0000","last_change":"2023-10-08T16:25:45.590723+0000","last_active":"2023-10-08T16:25:45.591412+0000","last_peered":"2023-10-08T16:25:45.591412+0000","last_clean":"2023-10-08T16:25:45.591412+0000","last_became_active":"2023-10-08T16:25:45.590395+0000","last_became_peered":"2023-10-08T16:25:45.590395+0000","last_unstale":"2023-10-08T16:25:45.591412+0000","last_undegraded":"2023-10-08T16:25:45.591412+0000","last_fullsized":"2023-10-08T16:25:45.591412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612680+0000","last_change":"2023-10-08T16:25:44.563060+0000","last_active":"2023-10-08T16:25:45.612680+0000","last_peered":"2023-10-08T16:25:45.612680+0000","last_clean":"2023-10-08T16:25:45.612680+0000","last_became_active":"2023-10-08T16:25:44.562784+0000","last_became_peered":"2023-10-08T16:25:44.562784+0000","last_unstale":"2023-10-08T16:25:45.612680+0000","last_undegraded":"2023-10-08T16:25:45.612680+0000","last_fullsized":"2023-10-08T16:25:45.612680+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:45.980150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595644+0000","last_change":"2023-10-08T16:25:45.589637+0000","last_active":"2023-10-08T16:25:45.595644+0000","last_peered":"2023-10-08T16:25:45.595644+0000","last_clean":"2023-10-08T16:25:45.595644+0000","last_became_active":"2023-10-08T16:25:45.589100+0000","last_became_peered":"2023-10-08T16:25:45.589100+0000","last_unstale":"2023-10-08T16:25:45.595644+0000","last_undegraded":"2023-10-08T16:25:45.595644+0000","last_fullsized":"2023-10-08T16:25:45.595644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:02.301066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603596+0000","last_change":"2023-10-08T16:25:44.553709+0000","last_active":"2023-10-08T16:25:45.603596+0000","last_peered":"2023-10-08T16:25:45.603596+0000","last_clean":"2023-10-08T16:25:45.603596+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.603596+0000","last_undegraded":"2023-10-08T16:25:45.603596+0000","last_fullsized":"2023-10-08T16:25:45.603596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597615+0000","last_change":"2023-10-08T16:25:45.593290+0000","last_active":"2023-10-08T16:25:45.597615+0000","last_peered":"2023-10-08T16:25:45.597615+0000","last_clean":"2023-10-08T16:25:45.597615+0000","last_became_active":"2023-10-08T16:25:45.593001+0000","last_became_peered":"2023-10-08T16:25:45.593001+0000","last_unstale":"2023-10-08T16:25:45.597615+0000","last_undegraded":"2023-10-08T16:25:45.597615+0000","last_fullsized":"2023-10-08T16:25:45.597615+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612499+0000","last_change":"2023-10-08T16:25:44.552656+0000","last_active":"2023-10-08T16:25:45.612499+0000","last_peered":"2023-10-08T16:25:45.612499+0000","last_clean":"2023-10-08T16:25:45.612499+0000","last_became_active":"2023-10-08T16:25:44.552389+0000","last_became_peered":"2023-10-08T16:25:44.552389+0000","last_unstale":"2023-10-08T16:25:45.612499+0000","last_undegraded":"2023-10-08T16:25:45.612499+0000","last_fullsized":"2023-10-08T16:25:45.612499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:42.769179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584922+0000","last_change":"2023-10-08T16:25:45.580198+0000","last_active":"2023-10-08T16:25:45.584922+0000","last_peered":"2023-10-08T16:25:45.584922+0000","last_clean":"2023-10-08T16:25:45.584922+0000","last_became_active":"2023-10-08T16:25:45.579926+0000","last_became_peered":"2023-10-08T16:25:45.579926+0000","last_unstale":"2023-10-08T16:25:45.584922+0000","last_undegraded":"2023-10-08T16:25:45.584922+0000","last_fullsized":"2023-10-08T16:25:45.584922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:13.493376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.611804+0000","last_change":"2023-10-08T16:25:44.551156+0000","last_active":"2023-10-08T16:25:45.611804+0000","last_peered":"2023-10-08T16:25:45.611804+0000","last_clean":"2023-10-08T16:25:45.611804+0000","last_became_active":"2023-10-08T16:25:44.550865+0000","last_became_peered":"2023-10-08T16:25:44.550865+0000","last_unstale":"2023-10-08T16:25:45.611804+0000","last_undegraded":"2023-10-08T16:25:45.611804+0000","last_fullsized":"2023-10-08T16:25:45.611804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:54.104951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591640+0000","last_change":"2023-10-08T16:25:45.582599+0000","last_active":"2023-10-08T16:25:45.591640+0000","last_peered":"2023-10-08T16:25:45.591640+0000","last_clean":"2023-10-08T16:25:45.591640+0000","last_became_active":"2023-10-08T16:25:45.582327+0000","last_became_peered":"2023-10-08T16:25:45.582327+0000","last_unstale":"2023-10-08T16:25:45.591640+0000","last_undegraded":"2023-10-08T16:25:45.591640+0000","last_fullsized":"2023-10-08T16:25:45.591640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:53.896274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604343+0000","last_change":"2023-10-08T16:25:44.559604+0000","last_active":"2023-10-08T16:25:45.604343+0000","last_peered":"2023-10-08T16:25:45.604343+0000","last_clean":"2023-10-08T16:25:45.604343+0000","last_became_active":"2023-10-08T16:25:44.559311+0000","last_became_peered":"2023-10-08T16:25:44.559311+0000","last_unstale":"2023-10-08T16:25:45.604343+0000","last_undegraded":"2023-10-08T16:25:45.604343+0000","last_fullsized":"2023-10-08T16:25:45.604343+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585683+0000","last_change":"2023-10-08T16:25:45.582286+0000","last_active":"2023-10-08T16:25:45.585683+0000","last_peered":"2023-10-08T16:25:45.585683+0000","last_clean":"2023-10-08T16:25:45.585683+0000","last_became_active":"2023-10-08T16:25:45.581936+0000","last_became_peered":"2023-10-08T16:25:45.581936+0000","last_unstale":"2023-10-08T16:25:45.585683+0000","last_undegraded":"2023-10-08T16:25:45.585683+0000","last_fullsized":"2023-10-08T16:25:45.585683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603788+0000","last_change":"2023-10-08T16:25:44.551223+0000","last_active":"2023-10-08T16:25:45.603788+0000","last_peered":"2023-10-08T16:25:45.603788+0000","last_clean":"2023-10-08T16:25:45.603788+0000","last_became_active":"2023-10-08T16:25:44.550256+0000","last_became_peered":"2023-10-08T16:25:44.550256+0000","last_unstale":"2023-10-08T16:25:45.603788+0000","last_undegraded":"2023-10-08T16:25:45.603788+0000","last_fullsized":"2023-10-08T16:25:45.603788+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586389+0000","last_change":"2023-10-08T16:25:45.584883+0000","last_active":"2023-10-08T16:25:45.586389+0000","last_peered":"2023-10-08T16:25:45.586389+0000","last_clean":"2023-10-08T16:25:45.586389+0000","last_became_active":"2023-10-08T16:25:45.584561+0000","last_became_peered":"2023-10-08T16:25:45.584561+0000","last_unstale":"2023-10-08T16:25:45.586389+0000","last_undegraded":"2023-10-08T16:25:45.586389+0000","last_fullsized":"2023-10-08T16:25:45.586389+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:20.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.569466+0000","last_change":"2023-10-08T16:25:44.559468+0000","last_active":"2023-10-08T16:25:45.569466+0000","last_peered":"2023-10-08T16:25:45.569466+0000","last_clean":"2023-10-08T16:25:45.569466+0000","last_became_active":"2023-10-08T16:25:44.559209+0000","last_became_peered":"2023-10-08T16:25:44.559209+0000","last_unstale":"2023-10-08T16:25:45.569466+0000","last_undegraded":"2023-10-08T16:25:45.569466+0000","last_fullsized":"2023-10-08T16:25:45.569466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.993977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577542+0000","last_change":"2023-10-08T16:25:45.574917+0000","last_active":"2023-10-08T16:25:45.577542+0000","last_peered":"2023-10-08T16:25:45.577542+0000","last_clean":"2023-10-08T16:25:45.577542+0000","last_became_active":"2023-10-08T16:25:45.574470+0000","last_became_peered":"2023-10-08T16:25:45.574470+0000","last_unstale":"2023-10-08T16:25:45.577542+0000","last_undegraded":"2023-10-08T16:25:45.577542+0000","last_fullsized":"2023-10-08T16:25:45.577542+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571192+0000","last_change":"2023-10-08T16:25:44.563896+0000","last_active":"2023-10-08T16:25:45.571192+0000","last_peered":"2023-10-08T16:25:45.571192+0000","last_clean":"2023-10-08T16:25:45.571192+0000","last_became_active":"2023-10-08T16:25:44.563641+0000","last_became_peered":"2023-10-08T16:25:44.563641+0000","last_unstale":"2023-10-08T16:25:45.571192+0000","last_undegraded":"2023-10-08T16:25:45.571192+0000","last_fullsized":"2023-10-08T16:25:45.571192+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:50.684591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582821+0000","last_change":"2023-10-08T16:25:45.577068+0000","last_active":"2023-10-08T16:25:45.582821+0000","last_peered":"2023-10-08T16:25:45.582821+0000","last_clean":"2023-10-08T16:25:45.582821+0000","last_became_active":"2023-10-08T16:25:45.576772+0000","last_became_peered":"2023-10-08T16:25:45.576772+0000","last_unstale":"2023-10-08T16:25:45.582821+0000","last_undegraded":"2023-10-08T16:25:45.582821+0000","last_fullsized":"2023-10-08T16:25:45.582821+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:40.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.581357+0000","last_change":"2023-10-08T16:25:44.563195+0000","last_active":"2023-10-08T16:25:45.581357+0000","last_peered":"2023-10-08T16:25:45.581357+0000","last_clean":"2023-10-08T16:25:45.581357+0000","last_became_active":"2023-10-08T16:25:44.562921+0000","last_became_peered":"2023-10-08T16:25:44.562921+0000","last_unstale":"2023-10-08T16:25:45.581357+0000","last_undegraded":"2023-10-08T16:25:45.581357+0000","last_fullsized":"2023-10-08T16:25:45.581357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585199+0000","last_change":"2023-10-08T16:25:45.582188+0000","last_active":"2023-10-08T16:25:45.585199+0000","last_peered":"2023-10-08T16:25:45.585199+0000","last_clean":"2023-10-08T16:25:45.585199+0000","last_became_active":"2023-10-08T16:25:45.581893+0000","last_became_peered":"2023-10-08T16:25:45.581893+0000","last_unstale":"2023-10-08T16:25:45.585199+0000","last_undegraded":"2023-10-08T16:25:45.585199+0000","last_fullsized":"2023-10-08T16:25:45.585199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:04.337220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577393+0000","last_change":"2023-10-08T16:25:44.560229+0000","last_active":"2023-10-08T16:25:45.577393+0000","last_peered":"2023-10-08T16:25:45.577393+0000","last_clean":"2023-10-08T16:25:45.577393+0000","last_became_active":"2023-10-08T16:25:44.559921+0000","last_became_peered":"2023-10-08T16:25:44.559921+0000","last_unstale":"2023-10-08T16:25:45.577393+0000","last_undegraded":"2023-10-08T16:25:45.577393+0000","last_fullsized":"2023-10-08T16:25:45.577393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:12.410069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594494+0000","last_change":"2023-10-08T16:25:45.589991+0000","last_active":"2023-10-08T16:25:45.594494+0000","last_peered":"2023-10-08T16:25:45.594494+0000","last_clean":"2023-10-08T16:25:45.594494+0000","last_became_active":"2023-10-08T16:25:45.589565+0000","last_became_peered":"2023-10-08T16:25:45.589565+0000","last_unstale":"2023-10-08T16:25:45.594494+0000","last_undegraded":"2023-10-08T16:25:45.594494+0000","last_fullsized":"2023-10-08T16:25:45.594494+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606205+0000","last_change":"2023-10-08T16:25:44.563895+0000","last_active":"2023-10-08T16:25:45.606205+0000","last_peered":"2023-10-08T16:25:45.606205+0000","last_clean":"2023-10-08T16:25:45.606205+0000","last_became_active":"2023-10-08T16:25:44.563652+0000","last_became_peered":"2023-10-08T16:25:44.563652+0000","last_unstale":"2023-10-08T16:25:45.606205+0000","last_undegraded":"2023-10-08T16:25:45.606205+0000","last_fullsized":"2023-10-08T16:25:45.606205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:04.242293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588572+0000","last_change":"2023-10-08T16:25:45.586201+0000","last_active":"2023-10-08T16:25:45.588572+0000","last_peered":"2023-10-08T16:25:45.588572+0000","last_clean":"2023-10-08T16:25:45.588572+0000","last_became_active":"2023-10-08T16:25:45.585617+0000","last_became_peered":"2023-10-08T16:25:45.585617+0000","last_unstale":"2023-10-08T16:25:45.588572+0000","last_undegraded":"2023-10-08T16:25:45.588572+0000","last_fullsized":"2023-10-08T16:25:45.588572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:52.832630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606194+0000","last_change":"2023-10-08T16:25:44.545277+0000","last_active":"2023-10-08T16:25:45.606194+0000","last_peered":"2023-10-08T16:25:45.606194+0000","last_clean":"2023-10-08T16:25:45.606194+0000","last_became_active":"2023-10-08T16:25:44.544876+0000","last_became_peered":"2023-10-08T16:25:44.544876+0000","last_unstale":"2023-10-08T16:25:45.606194+0000","last_undegraded":"2023-10-08T16:25:45.606194+0000","last_fullsized":"2023-10-08T16:25:45.606194+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587263+0000","last_change":"2023-10-08T16:25:45.578741+0000","last_active":"2023-10-08T16:25:45.587263+0000","last_peered":"2023-10-08T16:25:45.587263+0000","last_clean":"2023-10-08T16:25:45.587263+0000","last_became_active":"2023-10-08T16:25:45.578478+0000","last_became_peered":"2023-10-08T16:25:45.578478+0000","last_unstale":"2023-10-08T16:25:45.587263+0000","last_undegraded":"2023-10-08T16:25:45.587263+0000","last_fullsized":"2023-10-08T16:25:45.587263+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:34.644987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604552+0000","last_change":"2023-10-08T16:25:44.565264+0000","last_active":"2023-10-08T16:25:45.604552+0000","last_peered":"2023-10-08T16:25:45.604552+0000","last_clean":"2023-10-08T16:25:45.604552+0000","last_became_active":"2023-10-08T16:25:44.564967+0000","last_became_peered":"2023-10-08T16:25:44.564967+0000","last_unstale":"2023-10-08T16:25:45.604552+0000","last_undegraded":"2023-10-08T16:25:45.604552+0000","last_fullsized":"2023-10-08T16:25:45.604552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:46.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586357+0000","last_change":"2023-10-08T16:25:45.585553+0000","last_active":"2023-10-08T16:25:45.586357+0000","last_peered":"2023-10-08T16:25:45.586357+0000","last_clean":"2023-10-08T16:25:45.586357+0000","last_became_active":"2023-10-08T16:25:45.585259+0000","last_became_peered":"2023-10-08T16:25:45.585259+0000","last_unstale":"2023-10-08T16:25:45.586357+0000","last_undegraded":"2023-10-08T16:25:45.586357+0000","last_fullsized":"2023-10-08T16:25:45.586357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:24.637587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566733+0000","last_change":"2023-10-08T16:25:44.547629+0000","last_active":"2023-10-08T16:25:45.566733+0000","last_peered":"2023-10-08T16:25:45.566733+0000","last_clean":"2023-10-08T16:25:45.566733+0000","last_became_active":"2023-10-08T16:25:44.546718+0000","last_became_peered":"2023-10-08T16:25:44.546718+0000","last_unstale":"2023-10-08T16:25:45.566733+0000","last_undegraded":"2023-10-08T16:25:45.566733+0000","last_fullsized":"2023-10-08T16:25:45.566733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:17.418830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592361+0000","last_change":"2023-10-08T16:25:45.587967+0000","last_active":"2023-10-08T16:25:45.592361+0000","last_peered":"2023-10-08T16:25:45.592361+0000","last_clean":"2023-10-08T16:25:45.592361+0000","last_became_active":"2023-10-08T16:25:45.587092+0000","last_became_peered":"2023-10-08T16:25:45.587092+0000","last_unstale":"2023-10-08T16:25:45.592361+0000","last_undegraded":"2023-10-08T16:25:45.592361+0000","last_fullsized":"2023-10-08T16:25:45.592361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:56.717915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571878+0000","last_change":"2023-10-08T16:25:44.551921+0000","last_active":"2023-10-08T16:25:45.571878+0000","last_peered":"2023-10-08T16:25:45.571878+0000","last_clean":"2023-10-08T16:25:45.571878+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.571878+0000","last_undegraded":"2023-10-08T16:25:45.571878+0000","last_fullsized":"2023-10-08T16:25:45.571878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592213+0000","last_change":"2023-10-08T16:25:45.585139+0000","last_active":"2023-10-08T16:25:45.592213+0000","last_peered":"2023-10-08T16:25:45.592213+0000","last_clean":"2023-10-08T16:25:45.592213+0000","last_became_active":"2023-10-08T16:25:45.584865+0000","last_became_peered":"2023-10-08T16:25:45.584865+0000","last_unstale":"2023-10-08T16:25:45.592213+0000","last_undegraded":"2023-10-08T16:25:45.592213+0000","last_fullsized":"2023-10-08T16:25:45.592213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:39.963917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600692+0000","last_change":"2023-10-08T16:25:44.552061+0000","last_active":"2023-10-08T16:25:45.600692+0000","last_peered":"2023-10-08T16:25:45.600692+0000","last_clean":"2023-10-08T16:25:45.600692+0000","last_became_active":"2023-10-08T16:25:44.551299+0000","last_became_peered":"2023-10-08T16:25:44.551299+0000","last_unstale":"2023-10-08T16:25:45.600692+0000","last_undegraded":"2023-10-08T16:25:45.600692+0000","last_fullsized":"2023-10-08T16:25:45.600692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:38.632959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585852+0000","last_change":"2023-10-08T16:25:45.582615+0000","last_active":"2023-10-08T16:25:45.585852+0000","last_peered":"2023-10-08T16:25:45.585852+0000","last_clean":"2023-10-08T16:25:45.585852+0000","last_became_active":"2023-10-08T16:25:45.582274+0000","last_became_peered":"2023-10-08T16:25:45.582274+0000","last_unstale":"2023-10-08T16:25:45.585852+0000","last_undegraded":"2023-10-08T16:25:45.585852+0000","last_fullsized":"2023-10-08T16:25:45.585852+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:44.964129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603931+0000","last_change":"2023-10-08T16:25:44.560913+0000","last_active":"2023-10-08T16:25:45.603931+0000","last_peered":"2023-10-08T16:25:45.603931+0000","last_clean":"2023-10-08T16:25:45.603931+0000","last_became_active":"2023-10-08T16:25:44.560638+0000","last_became_peered":"2023-10-08T16:25:44.560638+0000","last_unstale":"2023-10-08T16:25:45.603931+0000","last_undegraded":"2023-10-08T16:25:45.603931+0000","last_fullsized":"2023-10-08T16:25:45.603931+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:41:47.167394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597572+0000","last_change":"2023-10-08T16:25:45.594278+0000","last_active":"2023-10-08T16:25:45.597572+0000","last_peered":"2023-10-08T16:25:45.597572+0000","last_clean":"2023-10-08T16:25:45.597572+0000","last_became_active":"2023-10-08T16:25:45.593991+0000","last_became_peered":"2023-10-08T16:25:45.593991+0000","last_unstale":"2023-10-08T16:25:45.597572+0000","last_undegraded":"2023-10-08T16:25:45.597572+0000","last_fullsized":"2023-10-08T16:25:45.597572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:26:52.532205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.599335+0000","last_change":"2023-10-08T16:25:44.557054+0000","last_active":"2023-10-08T16:25:45.599335+0000","last_peered":"2023-10-08T16:25:45.599335+0000","last_clean":"2023-10-08T16:25:45.599335+0000","last_became_active":"2023-10-08T16:25:44.556775+0000","last_became_peered":"2023-10-08T16:25:44.556775+0000","last_unstale":"2023-10-08T16:25:45.599335+0000","last_undegraded":"2023-10-08T16:25:45.599335+0000","last_fullsized":"2023-10-08T16:25:45.599335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:12.503445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586297+0000","last_change":"2023-10-08T16:25:45.578887+0000","last_active":"2023-10-08T16:25:45.586297+0000","last_peered":"2023-10-08T16:25:45.586297+0000","last_clean":"2023-10-08T16:25:45.586297+0000","last_became_active":"2023-10-08T16:25:45.578598+0000","last_became_peered":"2023-10-08T16:25:45.578598+0000","last_unstale":"2023-10-08T16:25:45.586297+0000","last_undegraded":"2023-10-08T16:25:45.586297+0000","last_fullsized":"2023-10-08T16:25:45.586297+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574205+0000","last_change":"2023-10-08T16:25:44.556557+0000","last_active":"2023-10-08T16:25:45.574205+0000","last_peered":"2023-10-08T16:25:45.574205+0000","last_clean":"2023-10-08T16:25:45.574205+0000","last_became_active":"2023-10-08T16:25:44.556239+0000","last_became_peered":"2023-10-08T16:25:44.556239+0000","last_unstale":"2023-10-08T16:25:45.574205+0000","last_undegraded":"2023-10-08T16:25:45.574205+0000","last_fullsized":"2023-10-08T16:25:45.574205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:51.824195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594745+0000","last_change":"2023-10-08T16:25:45.592514+0000","last_active":"2023-10-08T16:25:45.594745+0000","last_peered":"2023-10-08T16:25:45.594745+0000","last_clean":"2023-10-08T16:25:45.594745+0000","last_became_active":"2023-10-08T16:25:45.592232+0000","last_became_peered":"2023-10-08T16:25:45.592232+0000","last_unstale":"2023-10-08T16:25:45.594745+0000","last_undegraded":"2023-10-08T16:25:45.594745+0000","last_fullsized":"2023-10-08T16:25:45.594745+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:04.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612375+0000","last_change":"2023-10-08T16:25:44.550134+0000","last_active":"2023-10-08T16:25:45.612375+0000","last_peered":"2023-10-08T16:25:45.612375+0000","last_clean":"2023-10-08T16:25:45.612375+0000","last_became_active":"2023-10-08T16:25:44.549837+0000","last_became_peered":"2023-10-08T16:25:44.549837+0000","last_unstale":"2023-10-08T16:25:45.612375+0000","last_undegraded":"2023-10-08T16:25:45.612375+0000","last_fullsized":"2023-10-08T16:25:45.612375+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:03.826716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583645+0000","last_change":"2023-10-08T16:25:45.581026+0000","last_active":"2023-10-08T16:25:45.583645+0000","last_peered":"2023-10-08T16:25:45.583645+0000","last_clean":"2023-10-08T16:25:45.583645+0000","last_became_active":"2023-10-08T16:25:45.580746+0000","last_became_peered":"2023-10-08T16:25:45.580746+0000","last_unstale":"2023-10-08T16:25:45.583645+0000","last_undegraded":"2023-10-08T16:25:45.583645+0000","last_fullsized":"2023-10-08T16:25:45.583645+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:48.378741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.570156+0000","last_change":"2023-10-08T16:25:44.557614+0000","last_active":"2023-10-08T16:25:45.570156+0000","last_peered":"2023-10-08T16:25:45.570156+0000","last_clean":"2023-10-08T16:25:45.570156+0000","last_became_active":"2023-10-08T16:25:44.557338+0000","last_became_peered":"2023-10-08T16:25:44.557338+0000","last_unstale":"2023-10-08T16:25:45.570156+0000","last_undegraded":"2023-10-08T16:25:45.570156+0000","last_fullsized":"2023-10-08T16:25:45.570156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:12.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584093+0000","last_change":"2023-10-08T16:25:45.581008+0000","last_active":"2023-10-08T16:25:45.584093+0000","last_peered":"2023-10-08T16:25:45.584093+0000","last_clean":"2023-10-08T16:25:45.584093+0000","last_became_active":"2023-10-08T16:25:45.580751+0000","last_became_peered":"2023-10-08T16:25:45.580751+0000","last_unstale":"2023-10-08T16:25:45.584093+0000","last_undegraded":"2023-10-08T16:25:45.584093+0000","last_fullsized":"2023-10-08T16:25:45.584093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575487+0000","last_change":"2023-10-08T16:25:44.560692+0000","last_active":"2023-10-08T16:25:45.575487+0000","last_peered":"2023-10-08T16:25:45.575487+0000","last_clean":"2023-10-08T16:25:45.575487+0000","last_became_active":"2023-10-08T16:25:44.560446+0000","last_became_peered":"2023-10-08T16:25:44.560446+0000","last_unstale":"2023-10-08T16:25:45.575487+0000","last_undegraded":"2023-10-08T16:25:45.575487+0000","last_fullsized":"2023-10-08T16:25:45.575487+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:43.729263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584981+0000","last_change":"2023-10-08T16:25:45.581050+0000","last_active":"2023-10-08T16:25:45.584981+0000","last_peered":"2023-10-08T16:25:45.584981+0000","last_clean":"2023-10-08T16:25:45.584981+0000","last_became_active":"2023-10-08T16:25:45.580673+0000","last_became_peered":"2023-10-08T16:25:45.580673+0000","last_unstale":"2023-10-08T16:25:45.584981+0000","last_undegraded":"2023-10-08T16:25:45.584981+0000","last_fullsized":"2023-10-08T16:25:45.584981+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566601+0000","last_change":"2023-10-08T16:25:44.550131+0000","last_active":"2023-10-08T16:25:45.566601+0000","last_peered":"2023-10-08T16:25:45.566601+0000","last_clean":"2023-10-08T16:25:45.566601+0000","last_became_active":"2023-10-08T16:25:44.549815+0000","last_became_peered":"2023-10-08T16:25:44.549815+0000","last_unstale":"2023-10-08T16:25:45.566601+0000","last_undegraded":"2023-10-08T16:25:45.566601+0000","last_fullsized":"2023-10-08T16:25:45.566601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:05.527633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588928+0000","last_change":"2023-10-08T16:25:45.587793+0000","last_active":"2023-10-08T16:25:45.588928+0000","last_peered":"2023-10-08T16:25:45.588928+0000","last_clean":"2023-10-08T16:25:45.588928+0000","last_became_active":"2023-10-08T16:25:45.587349+0000","last_became_peered":"2023-10-08T16:25:45.587349+0000","last_unstale":"2023-10-08T16:25:45.588928+0000","last_undegraded":"2023-10-08T16:25:45.588928+0000","last_fullsized":"2023-10-08T16:25:45.588928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603898+0000","last_change":"2023-10-08T16:25:44.551814+0000","last_active":"2023-10-08T16:25:45.603898+0000","last_peered":"2023-10-08T16:25:45.603898+0000","last_clean":"2023-10-08T16:25:45.603898+0000","last_became_active":"2023-10-08T16:25:44.551552+0000","last_became_peered":"2023-10-08T16:25:44.551552+0000","last_unstale":"2023-10-08T16:25:45.603898+0000","last_undegraded":"2023-10-08T16:25:45.603898+0000","last_fullsized":"2023-10-08T16:25:45.603898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:21.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596231+0000","last_change":"2023-10-08T16:25:45.593817+0000","last_active":"2023-10-08T16:25:45.596231+0000","last_peered":"2023-10-08T16:25:45.596231+0000","last_clean":"2023-10-08T16:25:45.596231+0000","last_became_active":"2023-10-08T16:25:45.593456+0000","last_became_peered":"2023-10-08T16:25:45.593456+0000","last_unstale":"2023-10-08T16:25:45.596231+0000","last_undegraded":"2023-10-08T16:25:45.596231+0000","last_fullsized":"2023-10-08T16:25:45.596231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:21.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571579+0000","last_change":"2023-10-08T16:25:44.566555+0000","last_active":"2023-10-08T16:25:45.571579+0000","last_peered":"2023-10-08T16:25:45.571579+0000","last_clean":"2023-10-08T16:25:45.571579+0000","last_became_active":"2023-10-08T16:25:44.564889+0000","last_became_peered":"2023-10-08T16:25:44.564889+0000","last_unstale":"2023-10-08T16:25:45.571579+0000","last_undegraded":"2023-10-08T16:25:45.571579+0000","last_fullsized":"2023-10-08T16:25:45.571579+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:21.570754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597683+0000","last_change":"2023-10-08T16:25:45.594888+0000","last_active":"2023-10-08T16:25:45.597683+0000","last_peered":"2023-10-08T16:25:45.597683+0000","last_clean":"2023-10-08T16:25:45.597683+0000","last_became_active":"2023-10-08T16:25:45.594595+0000","last_became_peered":"2023-10-08T16:25:45.594595+0000","last_unstale":"2023-10-08T16:25:45.597683+0000","last_undegraded":"2023-10-08T16:25:45.597683+0000","last_fullsized":"2023-10-08T16:25:45.597683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574484+0000","last_change":"2023-10-08T16:25:44.555840+0000","last_active":"2023-10-08T16:25:45.574484+0000","last_peered":"2023-10-08T16:25:45.574484+0000","last_clean":"2023-10-08T16:25:45.574484+0000","last_became_active":"2023-10-08T16:25:44.555556+0000","last_became_peered":"2023-10-08T16:25:44.555556+0000","last_unstale":"2023-10-08T16:25:45.574484+0000","last_undegraded":"2023-10-08T16:25:45.574484+0000","last_fullsized":"2023-10-08T16:25:45.574484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:19.721147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588591+0000","last_change":"2023-10-08T16:25:45.586274+0000","last_active":"2023-10-08T16:25:45.588591+0000","last_peered":"2023-10-08T16:25:45.588591+0000","last_clean":"2023-10-08T16:25:45.588591+0000","last_became_active":"2023-10-08T16:25:45.585917+0000","last_became_peered":"2023-10-08T16:25:45.585917+0000","last_unstale":"2023-10-08T16:25:45.588591+0000","last_undegraded":"2023-10-08T16:25:45.588591+0000","last_fullsized":"2023-10-08T16:25:45.588591+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:20:28.140378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.578717+0000","last_change":"2023-10-08T16:25:44.562104+0000","last_active":"2023-10-08T16:25:45.578717+0000","last_peered":"2023-10-08T16:25:45.578717+0000","last_clean":"2023-10-08T16:25:45.578717+0000","last_became_active":"2023-10-08T16:25:44.561808+0000","last_became_peered":"2023-10-08T16:25:44.561808+0000","last_unstale":"2023-10-08T16:25:45.578717+0000","last_undegraded":"2023-10-08T16:25:45.578717+0000","last_fullsized":"2023-10-08T16:25:45.578717+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:09.926631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583878+0000","last_change":"2023-10-08T16:25:45.580482+0000","last_active":"2023-10-08T16:25:45.583878+0000","last_peered":"2023-10-08T16:25:45.583878+0000","last_clean":"2023-10-08T16:25:45.583878+0000","last_became_active":"2023-10-08T16:25:45.580140+0000","last_became_peered":"2023-10-08T16:25:45.580140+0000","last_unstale":"2023-10-08T16:25:45.583878+0000","last_undegraded":"2023-10-08T16:25:45.583878+0000","last_fullsized":"2023-10-08T16:25:45.583878+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572348+0000","last_change":"2023-10-08T16:25:44.551669+0000","last_active":"2023-10-08T16:25:45.572348+0000","last_peered":"2023-10-08T16:25:45.572348+0000","last_clean":"2023-10-08T16:25:45.572348+0000","last_became_active":"2023-10-08T16:25:44.551423+0000","last_became_peered":"2023-10-08T16:25:44.551423+0000","last_unstale":"2023-10-08T16:25:45.572348+0000","last_undegraded":"2023-10-08T16:25:45.572348+0000","last_fullsized":"2023-10-08T16:25:45.572348+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585854+0000","last_change":"2023-10-08T16:25:45.582864+0000","last_active":"2023-10-08T16:25:45.585854+0000","last_peered":"2023-10-08T16:25:45.585854+0000","last_clean":"2023-10-08T16:25:45.585854+0000","last_became_active":"2023-10-08T16:25:45.582578+0000","last_became_peered":"2023-10-08T16:25:45.582578+0000","last_unstale":"2023-10-08T16:25:45.585854+0000","last_undegraded":"2023-10-08T16:25:45.585854+0000","last_fullsized":"2023-10-08T16:25:45.585854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:41.323085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572632+0000","last_change":"2023-10-08T16:25:44.550959+0000","last_active":"2023-10-08T16:25:45.572632+0000","last_peered":"2023-10-08T16:25:45.572632+0000","last_clean":"2023-10-08T16:25:45.572632+0000","last_became_active":"2023-10-08T16:25:44.550527+0000","last_became_peered":"2023-10-08T16:25:44.550527+0000","last_unstale":"2023-10-08T16:25:45.572632+0000","last_undegraded":"2023-10-08T16:25:45.572632+0000","last_fullsized":"2023-10-08T16:25:45.572632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594986+0000","last_change":"2023-10-08T16:25:45.592717+0000","last_active":"2023-10-08T16:25:45.594986+0000","last_peered":"2023-10-08T16:25:45.594986+0000","last_clean":"2023-10-08T16:25:45.594986+0000","last_became_active":"2023-10-08T16:25:45.592338+0000","last_became_peered":"2023-10-08T16:25:45.592338+0000","last_unstale":"2023-10-08T16:25:45.594986+0000","last_undegraded":"2023-10-08T16:25:45.594986+0000","last_fullsized":"2023-10-08T16:25:45.594986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:04.835151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575648+0000","last_change":"2023-10-08T16:25:44.562414+0000","last_active":"2023-10-08T16:25:45.575648+0000","last_peered":"2023-10-08T16:25:45.575648+0000","last_clean":"2023-10-08T16:25:45.575648+0000","last_became_active":"2023-10-08T16:25:44.562080+0000","last_became_peered":"2023-10-08T16:25:44.562080+0000","last_unstale":"2023-10-08T16:25:45.575648+0000","last_undegraded":"2023-10-08T16:25:45.575648+0000","last_fullsized":"2023-10-08T16:25:45.575648+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598116+0000","last_change":"2023-10-08T16:25:45.595024+0000","last_active":"2023-10-08T16:25:45.598116+0000","last_peered":"2023-10-08T16:25:45.598116+0000","last_clean":"2023-10-08T16:25:45.598116+0000","last_became_active":"2023-10-08T16:25:45.594664+0000","last_became_peered":"2023-10-08T16:25:45.594664+0000","last_unstale":"2023-10-08T16:25:45.598116+0000","last_undegraded":"2023-10-08T16:25:45.598116+0000","last_fullsized":"2023-10-08T16:25:45.598116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:04.017138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572038+0000","last_change":"2023-10-08T16:25:44.557142+0000","last_active":"2023-10-08T16:25:45.572038+0000","last_peered":"2023-10-08T16:25:45.572038+0000","last_clean":"2023-10-08T16:25:45.572038+0000","last_became_active":"2023-10-08T16:25:44.556876+0000","last_became_peered":"2023-10-08T16:25:44.556876+0000","last_unstale":"2023-10-08T16:25:45.572038+0000","last_undegraded":"2023-10-08T16:25:45.572038+0000","last_fullsized":"2023-10-08T16:25:45.572038+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586322+0000","last_change":"2023-10-08T16:25:45.583813+0000","last_active":"2023-10-08T16:25:45.586322+0000","last_peered":"2023-10-08T16:25:45.586322+0000","last_clean":"2023-10-08T16:25:45.586322+0000","last_became_active":"2023-10-08T16:25:45.583329+0000","last_became_peered":"2023-10-08T16:25:45.583329+0000","last_unstale":"2023-10-08T16:25:45.586322+0000","last_undegraded":"2023-10-08T16:25:45.586322+0000","last_fullsized":"2023-10-08T16:25:45.586322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:44.737697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604424+0000","last_change":"2023-10-08T16:25:44.556287+0000","last_active":"2023-10-08T16:25:45.604424+0000","last_peered":"2023-10-08T16:25:45.604424+0000","last_clean":"2023-10-08T16:25:45.604424+0000","last_became_active":"2023-10-08T16:25:44.555458+0000","last_became_peered":"2023-10-08T16:25:44.555458+0000","last_unstale":"2023-10-08T16:25:45.604424+0000","last_undegraded":"2023-10-08T16:25:45.604424+0000","last_fullsized":"2023-10-08T16:25:45.604424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:08.585517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"102'205","reported_seq":559,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574866+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:45.574866+0000","last_peered":"2023-10-08T16:25:45.574866+0000","last_clean":"2023-10-08T16:25:45.574866+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:45.574866+0000","last_undegraded":"2023-10-08T16:25:45.574866+0000","last_fullsized":"2023-10-08T16:25:45.574866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1266908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.746},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.94599999999999995,"15min":0.99199999999999999},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.873},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.042},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.05},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89500000000000002,"5min":0.95199999999999996,"15min":1.002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.98299999999999998,"5min":1.0389999999999999,"15min":5.5590000000000002},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.57499999999999996,"5min":0.439,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.351,"15min":1.351},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.022,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.173,"15min":1.173},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.627,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":677136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.76800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.071,"15min":1.081},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.87,"5min":1.034,"15min":1.0800000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"min":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96799999999999997,"5min":1.0149999999999999,"15min":1.069},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.125},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":1.272,"15min":1.272},"last":0.752},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0680000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":676664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42199999999999999,"15min":0.44600000000000001},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.873},"last":0.318},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61099999999999999,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78000000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.95199999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96899999999999997,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.0660000000000001,"15min":1.224},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78500000000000003,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0780000000000001,"15min":1.206},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.89900000000000002,"5min":1.101,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.81999999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.1839999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56999999999999995},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299228,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072612,"statfs":{"total":96636764160,"available":96330354688,"internally_reserved":0,"allocated":1986560,"data_stored":1266872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.89400000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.32000000000000001},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.093},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.878,"15min":0.878},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":1.21,"15min":1.21},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.76400000000000001},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.46400000000000002},"max":{"1min":1.0589999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1439999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.2330000000000001},"last":0.995}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":1.0600000000000001,"5min":1.157,"15min":1.1950000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.212},"last":0.93899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.82299999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":1.0680000000000001,"5min":1.1140000000000001,"15min":1.1579999999999999},"last":0.872},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.157,"5min":1.163,"15min":1.202},"last":1.0269999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306840,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065000,"statfs":{"total":96636764160,"available":96322560000,"internally_reserved":0,"allocated":1392640,"data_stored":677024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.41699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.752}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.88900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":678006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.377}]},{"osd":2,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":1,"15min":1},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.76400000000000001},"min":{"1min":0.54100000000000004,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.95399999999999996,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":1.1319999999999999,"15min":1.2110000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96199999999999997,"5min":1.093,"15min":1.3200000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.23},"last":0.627},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82099999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073196,"statfs":{"total":96636764160,"available":96330952704,"internally_reserved":0,"allocated":1388544,"data_stored":676470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.495},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":1.02,"15min":1.02},"last":0.86399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84499999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.379},"max":{"1min":0.878,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.085,"15min":1.1060000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1339999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.47,"15min":1.47},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0589999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79200000000000004,"5min":2.661,"15min":2.661},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.611,"15min":1.611},"last":0.90600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310948,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060892,"statfs":{"total":96636764160,"available":96318353408,"internally_reserved":0,"allocated":1404928,"data_stored":678028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0129999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72599999999999998,"15min":0.749},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93300000000000005,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.05},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92000000000000004,"5min":0.97599999999999998,"15min":1.0389999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98099999999999998,"5min":4.931,"15min":4.931},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.081,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.0129999999999999,"5min":1.96,"15min":1.96},"last":0.76900000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69499999999999995,"15min":0.63300000000000001},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.753},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":1.0489999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.86099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96499999999999997,"5min":2.024,"15min":2.024},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.105,"5min":2.157,"15min":2.157},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:51.122 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T16:25:51.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.339+0000 7f684919d700 1 Processor -- start 2023-10-08T16:25:51.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.339+0000 7f684919d700 1 -- start start 2023-10-08T16:25:51.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.340+0000 7f684919d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68440cc840 0x7f6844155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.340+0000 7f684919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.340+0000 7f684919d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684406b790 con 0x7f68440c7930 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.340+0000 7f684919d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684406ab80 con 0x7f68440cc840 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.340+0000 7f684919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684406ae60 con 0x7f68440ccce0 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f68437fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f68440cc840 0x7f6844155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f6843fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f68440c7930 0x7f684406a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40870/0 (socket says 172.21.15.12:40870) 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f6843fff700 1 -- 172.21.15.12:0/1808474768 learned_addr learned my addr 172.21.15.12:0/1808474768 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:51.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f684899c700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f6842ffd700 1 -- 172.21.15.12:0/1808474768 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514452890 0 0) 0x7f684406b790 con 0x7f68440c7930 2023-10-08T16:25:51.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f68437fe700 1 -- 172.21.15.12:0/1808474768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 msgr2=0x7f684406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f68437fe700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684406de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f68437fe700 1 -- 172.21.15.12:0/1808474768 >> v1:172.21.15.12:6789/0 conn(0x7f68440c7930 legacy=0x7f684406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.341+0000 7f68437fe700 1 -- 172.21.15.12:0/1808474768 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684406b140 con 0x7f68440cc840 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f68437fe700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f6844155890 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f68380098e0 tx=0x7f68380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b9c870fb492c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f6842ffd700 1 -- 172.21.15.12:0/1808474768 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800b640 con 0x7f68440cc840 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f6842ffd700 1 -- 172.21.15.12:0/1808474768 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683800b7a0 con 0x7f68440cc840 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f6842ffd700 1 -- 172.21.15.12:0/1808474768 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800bb40 con 0x7f68440cc840 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 -- 172.21.15.12:0/1808474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 msgr2=0x7f6844155890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f6844155890 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f68380098e0 tx=0x7f68380091a0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 -- 172.21.15.12:0/1808474768 shutdown_connections 2023-10-08T16:25:51.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684406de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 --2- 172.21.15.12:0/1808474768 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f6844155890 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 -- 172.21.15.12:0/1808474768 >> 172.21.15.12:0/1808474768 conn(0x7f684406d110 msgr2=0x7f68440cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:51.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.342+0000 7f684919d700 1 -- 172.21.15.12:0/1808474768 shutdown_connections 2023-10-08T16:25:51.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.343+0000 7f684919d700 1 -- 172.21.15.12:0/1808474768 wait complete. 2023-10-08T16:25:51.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.344+0000 7f684919d700 1 Processor -- start 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.344+0000 7f684919d700 1 -- start start 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 0x7f684416b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684415ca50 con 0x7f68440cc840 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f684415cd30 con 0x7f68440c7930 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f684919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684415d010 con 0x7f68440ccce0 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f68437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f68437fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53802/0 (socket says 172.21.15.12:53802) 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.345+0000 7f68437fe700 1 -- 172.21.15.12:0/3150338565 learned_addr learned my addr 172.21.15.12:0/3150338565 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:51.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f684899c700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f6843fff700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 0x7f684416b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 -- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 msgr2=0x7f684415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 -- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 msgr2=0x7f684416b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 0x7f684416b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 -- 172.21.15.12:0/3150338565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6838009420 con 0x7f68440cc840 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f684899c700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f6843fff700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 0x7f684416b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:51.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f68437fe700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f68440cd1c0 tx=0x7f6838017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683800bb20 con 0x7f68440cc840 2023-10-08T16:25:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6838011420 con 0x7f68440cc840 2023-10-08T16:25:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68380117a0 con 0x7f68440cc840 2023-10-08T16:25:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.346+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684415d2f0 con 0x7f68440cc840 2023-10-08T16:25:51.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.347+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68440c6470 con 0x7f68440cc840 2023-10-08T16:25:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.348+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f684404c3c0 con 0x7f68440cc840 2023-10-08T16:25:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.348+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6838011b50 con 0x7f68440cc840 2023-10-08T16:25:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.349+0000 7f682bfff700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 0x7f68300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.349+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f6838085e40 con 0x7f68440cc840 2023-10-08T16:25:51.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.349+0000 7f6843fff700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 0x7f68300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.350+0000 7f6843fff700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 0x7f68300693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68340011e0 tx=0x7f6834009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.354+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6838052e80 con 0x7f68440cc840 2023-10-08T16:25:51.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.635+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f684406f170 con 0x7f68440cc840 2023-10-08T16:25:51.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.635+0000 7f682bfff700 1 -- 172.21.15.12:0/3150338565 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1017 (secure 0 0 0) 0x7f68380564a0 con 0x7f68440cc840 2023-10-08T16:25:51.636 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:51.637 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1015,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2498076672,"bytes_avail":770596036608,"bytes_total":773094113280,"write_bytes_sec":2073,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":49,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7251}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-10-08T16:23:30.467427+0000","services":{}},"progress_events":{}} 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 msgr2=0x7f68300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 0x7f68300693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f68340011e0 tx=0x7f6834009040 comp rx=0 tx=0).stop 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 msgr2=0x7f68440c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f68440cd1c0 tx=0x7f6838017000 comp rx=0 tx=0).stop 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 shutdown_connections 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6830066f30 0x7f68300693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f68440ccce0 0x7f684415daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f68440c7930 0x7f684416b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 --2- 172.21.15.12:0/3150338565 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f68440cc840 0x7f68440c5f30 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 >> 172.21.15.12:0/3150338565 conn(0x7f684406d110 msgr2=0x7f68440af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 shutdown_connections 2023-10-08T16:25:51.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.638+0000 7f684919d700 1 -- 172.21.15.12:0/3150338565 wait complete. 2023-10-08T16:25:51.656 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T16:25:51.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.842+0000 7fa9d3fff700 1 Processor -- start 2023-10-08T16:25:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.842+0000 7fa9d3fff700 1 -- start start 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9d4159820 0x7fa9d40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d406f420 con 0x7fa9d40a9e20 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d40aa260 con 0x7fa9d4159450 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d406e560 con 0x7fa9d4159820 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d27fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa9d4159820 0x7fa9d40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa9d40a9e20 0x7fa9d4163260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:40886/0 (socket says 172.21.15.12:40886) 2023-10-08T16:25:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d37fe700 1 -- 172.21.15.12:0/232054718 learned_addr learned my addr 172.21.15.12:0/232054718 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d27fc700 1 -- 172.21.15.12:0/232054718 >> v1:172.21.15.29:6789/0 conn(0x7fa9d4159450 legacy=0x7fa9d406de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.844+0000 7fa9d27fc700 1 -- 172.21.15.12:0/232054718 >> v1:172.21.15.12:6789/0 conn(0x7fa9d40a9e20 legacy=0x7fa9d4163260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d27fc700 1 -- 172.21.15.12:0/232054718 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d406e810 con 0x7fa9d4159820 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d1ffb700 1 -- 172.21.15.12:0/232054718 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417850609 0 0) 0x7fa9d406f420 con 0x7fa9d40a9e20 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d27fc700 1 --2- 172.21.15.12:0/232054718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d40a98e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098d0 tx=0x7fa9c8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931b9e4827fcfb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d1ffb700 1 -- 172.21.15.12:0/232054718 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8009e70 con 0x7fa9d4159820 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d1ffb700 1 -- 172.21.15.12:0/232054718 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c8005c10 con 0x7fa9d4159820 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.845+0000 7fa9d1ffb700 1 -- 172.21.15.12:0/232054718 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800b650 con 0x7fa9d4159820 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 -- 172.21.15.12:0/232054718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 msgr2=0x7fa9d40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/232054718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d40a98e0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80098d0 tx=0x7fa9c8009120 comp rx=0 tx=0).stop 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 -- 172.21.15.12:0/232054718 shutdown_connections 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/232054718 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d40a98e0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 -- 172.21.15.12:0/232054718 >> 172.21.15.12:0/232054718 conn(0x7fa9d406d170 msgr2=0x7fa9d40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 -- 172.21.15.12:0/232054718 shutdown_connections 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.846+0000 7fa9d3fff700 1 -- 172.21.15.12:0/232054718 wait complete. 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.847+0000 7fa9d3fff700 1 Processor -- start 2023-10-08T16:25:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.847+0000 7fa9d3fff700 1 -- start start 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa9d40a9e20 0x7fa9d406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 0x7fa9d4159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415aca0 con 0x7fa9d4159820 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d40af090 con 0x7fa9d4159450 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.848+0000 7fa9d3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d415a400 con 0x7fa9d40a9e20 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53820/0 (socket says 172.21.15.12:53820) 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 -- 172.21.15.12:0/2444691928 learned_addr learned my addr 172.21.15.12:0/2444691928 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d27fc700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 0x7fa9d4159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d2ffd700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa9d40a9e20 0x7fa9d406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 -- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa9d40a9e20 msgr2=0x7fa9d406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa9d40a9e20 0x7fa9d406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 -- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 msgr2=0x7fa9d4159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 0x7fa9d4159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 -- 172.21.15.12:0/2444691928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c80093c0 con 0x7fa9d4159820 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d27fc700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 0x7fa9d4159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.849+0000 7fa9d37fe700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00cbf0 tx=0x7fa9cc0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.850+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc00a9c0 con 0x7fa9d4159820 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.850+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9cc00ab40 con 0x7fa9d4159820 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.850+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9cc0070f0 con 0x7fa9d4159820 2023-10-08T16:25:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.850+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d415a6e0 con 0x7fa9d4159820 2023-10-08T16:25:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.850+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d4155de0 con 0x7fa9d4159820 2023-10-08T16:25:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.851+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d404c3c0 con 0x7fa9d4159820 2023-10-08T16:25:51.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.852+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9cc007520 con 0x7fa9d4159820 2023-10-08T16:25:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.853+0000 7fa9baffd700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.853+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa9cc084a90 con 0x7fa9d4159820 2023-10-08T16:25:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.853+0000 7fa9d2ffd700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:51.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.854+0000 7fa9d2ffd700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 0x7fa9c00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4003860 tx=0x7fa9c4009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:51.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:51.857+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9cc051b50 con 0x7fa9d4159820 2023-10-08T16:25:52.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.056+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9d406eaf0 con 0x7fa9c0066f30 2023-10-08T16:25:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.064+0000 7fa9baffd700 1 -- 172.21.15.12:0/2444691928 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289355 (secure 0 0 0) 0x7fa9d406eaf0 con 0x7fa9c0066f30 2023-10-08T16:25:52.069 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 msgr2=0x7fa9c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:52.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 0x7fa9c00693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa9c4003860 tx=0x7fa9c4009040 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 msgr2=0x7fa9d41558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa9cc00cbf0 tx=0x7fa9cc0019b0 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 shutdown_connections 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa9c0066f30 0x7fa9c00693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9d4159820 0x7fa9d41558a0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa9d40a9e20 0x7fa9d406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 --2- 172.21.15.12:0/2444691928 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa9d4159450 0x7fa9d4159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:52.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 >> 172.21.15.12:0/2444691928 conn(0x7fa9d406d170 msgr2=0x7fa9d40c28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:52.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 shutdown_connections 2023-10-08T16:25:52.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:52.069+0000 7fa9d3fff700 1 -- 172.21.15.12:0/2444691928 wait complete. 2023-10-08T16:25:52.073 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:52.087 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:25:50.961808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":363,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":243,"ondisk_log_size":243,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439528,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535192,"statfs":{"total":773094113280,"available":770596036608,"internally_reserved":0,"allocated":12361728,"data_stored":6597108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.421015"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595665+0000","last_change":"2023-10-08T16:25:45.589950+0000","last_active":"2023-10-08T16:25:45.595665+0000","last_peered":"2023-10-08T16:25:45.595665+0000","last_clean":"2023-10-08T16:25:45.595665+0000","last_became_active":"2023-10-08T16:25:45.589614+0000","last_became_peered":"2023-10-08T16:25:45.589614+0000","last_unstale":"2023-10-08T16:25:45.595665+0000","last_undegraded":"2023-10-08T16:25:45.595665+0000","last_fullsized":"2023-10-08T16:25:45.595665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592653+0000","last_change":"2023-10-08T16:25:45.586001+0000","last_active":"2023-10-08T16:25:45.592653+0000","last_peered":"2023-10-08T16:25:45.592653+0000","last_clean":"2023-10-08T16:25:45.592653+0000","last_became_active":"2023-10-08T16:25:45.585724+0000","last_became_peered":"2023-10-08T16:25:45.585724+0000","last_unstale":"2023-10-08T16:25:45.592653+0000","last_undegraded":"2023-10-08T16:25:45.592653+0000","last_fullsized":"2023-10-08T16:25:45.592653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595899+0000","last_change":"2023-10-08T16:25:45.593576+0000","last_active":"2023-10-08T16:25:45.595899+0000","last_peered":"2023-10-08T16:25:45.595899+0000","last_clean":"2023-10-08T16:25:45.595899+0000","last_became_active":"2023-10-08T16:25:45.593238+0000","last_became_peered":"2023-10-08T16:25:45.593238+0000","last_unstale":"2023-10-08T16:25:45.595899+0000","last_undegraded":"2023-10-08T16:25:45.595899+0000","last_fullsized":"2023-10-08T16:25:45.595899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:01.642697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594827+0000","last_change":"2023-10-08T16:25:45.592344+0000","last_active":"2023-10-08T16:25:45.594827+0000","last_peered":"2023-10-08T16:25:45.594827+0000","last_clean":"2023-10-08T16:25:45.594827+0000","last_became_active":"2023-10-08T16:25:45.592064+0000","last_became_peered":"2023-10-08T16:25:45.592064+0000","last_unstale":"2023-10-08T16:25:45.594827+0000","last_undegraded":"2023-10-08T16:25:45.594827+0000","last_fullsized":"2023-10-08T16:25:45.594827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:13.418504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585550+0000","last_change":"2023-10-08T16:25:45.578187+0000","last_active":"2023-10-08T16:25:45.585550+0000","last_peered":"2023-10-08T16:25:45.585550+0000","last_clean":"2023-10-08T16:25:45.585550+0000","last_became_active":"2023-10-08T16:25:45.577823+0000","last_became_peered":"2023-10-08T16:25:45.577823+0000","last_unstale":"2023-10-08T16:25:45.585550+0000","last_undegraded":"2023-10-08T16:25:45.585550+0000","last_fullsized":"2023-10-08T16:25:45.585550+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585168+0000","last_change":"2023-10-08T16:25:45.583726+0000","last_active":"2023-10-08T16:25:45.585168+0000","last_peered":"2023-10-08T16:25:45.585168+0000","last_clean":"2023-10-08T16:25:45.585168+0000","last_became_active":"2023-10-08T16:25:45.583413+0000","last_became_peered":"2023-10-08T16:25:45.583413+0000","last_unstale":"2023-10-08T16:25:45.585168+0000","last_undegraded":"2023-10-08T16:25:45.585168+0000","last_fullsized":"2023-10-08T16:25:45.585168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:39.641394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595848+0000","last_change":"2023-10-08T16:25:45.594729+0000","last_active":"2023-10-08T16:25:45.595848+0000","last_peered":"2023-10-08T16:25:45.595848+0000","last_clean":"2023-10-08T16:25:45.595848+0000","last_became_active":"2023-10-08T16:25:45.594337+0000","last_became_peered":"2023-10-08T16:25:45.594337+0000","last_unstale":"2023-10-08T16:25:45.595848+0000","last_undegraded":"2023-10-08T16:25:45.595848+0000","last_fullsized":"2023-10-08T16:25:45.595848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:10.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590653+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.590653+0000","last_peered":"2023-10-08T16:25:45.590653+0000","last_clean":"2023-10-08T16:25:45.590653+0000","last_became_active":"2023-10-08T16:25:45.588642+0000","last_became_peered":"2023-10-08T16:25:45.588642+0000","last_unstale":"2023-10-08T16:25:45.590653+0000","last_undegraded":"2023-10-08T16:25:45.590653+0000","last_fullsized":"2023-10-08T16:25:45.590653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:48.041989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583837+0000","last_change":"2023-10-08T16:25:45.580504+0000","last_active":"2023-10-08T16:25:45.583837+0000","last_peered":"2023-10-08T16:25:45.583837+0000","last_clean":"2023-10-08T16:25:45.583837+0000","last_became_active":"2023-10-08T16:25:45.580203+0000","last_became_peered":"2023-10-08T16:25:45.580203+0000","last_unstale":"2023-10-08T16:25:45.583837+0000","last_undegraded":"2023-10-08T16:25:45.583837+0000","last_fullsized":"2023-10-08T16:25:45.583837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598173+0000","last_change":"2023-10-08T16:25:45.597142+0000","last_active":"2023-10-08T16:25:45.598173+0000","last_peered":"2023-10-08T16:25:45.598173+0000","last_clean":"2023-10-08T16:25:45.598173+0000","last_became_active":"2023-10-08T16:25:45.596713+0000","last_became_peered":"2023-10-08T16:25:45.596713+0000","last_unstale":"2023-10-08T16:25:45.598173+0000","last_undegraded":"2023-10-08T16:25:45.598173+0000","last_fullsized":"2023-10-08T16:25:45.598173+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586090+0000","last_change":"2023-10-08T16:25:45.576696+0000","last_active":"2023-10-08T16:25:45.586090+0000","last_peered":"2023-10-08T16:25:45.586090+0000","last_clean":"2023-10-08T16:25:45.586090+0000","last_became_active":"2023-10-08T16:25:45.576430+0000","last_became_peered":"2023-10-08T16:25:45.576430+0000","last_unstale":"2023-10-08T16:25:45.586090+0000","last_undegraded":"2023-10-08T16:25:45.586090+0000","last_fullsized":"2023-10-08T16:25:45.586090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:42.921358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597728+0000","last_change":"2023-10-08T16:25:45.596083+0000","last_active":"2023-10-08T16:25:45.597728+0000","last_peered":"2023-10-08T16:25:45.597728+0000","last_clean":"2023-10-08T16:25:45.597728+0000","last_became_active":"2023-10-08T16:25:45.595822+0000","last_became_peered":"2023-10-08T16:25:45.595822+0000","last_unstale":"2023-10-08T16:25:45.597728+0000","last_undegraded":"2023-10-08T16:25:45.597728+0000","last_fullsized":"2023-10-08T16:25:45.597728+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586244+0000","last_change":"2023-10-08T16:25:45.584050+0000","last_active":"2023-10-08T16:25:45.586244+0000","last_peered":"2023-10-08T16:25:45.586244+0000","last_clean":"2023-10-08T16:25:45.586244+0000","last_became_active":"2023-10-08T16:25:45.583718+0000","last_became_peered":"2023-10-08T16:25:45.583718+0000","last_unstale":"2023-10-08T16:25:45.586244+0000","last_undegraded":"2023-10-08T16:25:45.586244+0000","last_fullsized":"2023-10-08T16:25:45.586244+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594763+0000","last_change":"2023-10-08T16:25:45.592638+0000","last_active":"2023-10-08T16:25:45.594763+0000","last_peered":"2023-10-08T16:25:45.594763+0000","last_clean":"2023-10-08T16:25:45.594763+0000","last_became_active":"2023-10-08T16:25:45.592348+0000","last_became_peered":"2023-10-08T16:25:45.592348+0000","last_unstale":"2023-10-08T16:25:45.594763+0000","last_undegraded":"2023-10-08T16:25:45.594763+0000","last_fullsized":"2023-10-08T16:25:45.594763+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:23.555131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582866+0000","last_change":"2023-10-08T16:25:45.575307+0000","last_active":"2023-10-08T16:25:45.582866+0000","last_peered":"2023-10-08T16:25:45.582866+0000","last_clean":"2023-10-08T16:25:45.582866+0000","last_became_active":"2023-10-08T16:25:45.575019+0000","last_became_peered":"2023-10-08T16:25:45.575019+0000","last_unstale":"2023-10-08T16:25:45.582866+0000","last_undegraded":"2023-10-08T16:25:45.582866+0000","last_fullsized":"2023-10-08T16:25:45.582866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590887+0000","last_change":"2023-10-08T16:25:45.589882+0000","last_active":"2023-10-08T16:25:45.590887+0000","last_peered":"2023-10-08T16:25:45.590887+0000","last_clean":"2023-10-08T16:25:45.590887+0000","last_became_active":"2023-10-08T16:25:45.589606+0000","last_became_peered":"2023-10-08T16:25:45.589606+0000","last_unstale":"2023-10-08T16:25:45.590887+0000","last_undegraded":"2023-10-08T16:25:45.590887+0000","last_fullsized":"2023-10-08T16:25:45.590887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:21.301510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587365+0000","last_change":"2023-10-08T16:25:45.583907+0000","last_active":"2023-10-08T16:25:45.587365+0000","last_peered":"2023-10-08T16:25:45.587365+0000","last_clean":"2023-10-08T16:25:45.587365+0000","last_became_active":"2023-10-08T16:25:45.583647+0000","last_became_peered":"2023-10-08T16:25:45.583647+0000","last_unstale":"2023-10-08T16:25:45.587365+0000","last_undegraded":"2023-10-08T16:25:45.587365+0000","last_fullsized":"2023-10-08T16:25:45.587365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595167+0000","last_change":"2023-10-08T16:25:45.593464+0000","last_active":"2023-10-08T16:25:45.595167+0000","last_peered":"2023-10-08T16:25:45.595167+0000","last_clean":"2023-10-08T16:25:45.595167+0000","last_became_active":"2023-10-08T16:25:45.593263+0000","last_became_peered":"2023-10-08T16:25:45.593263+0000","last_unstale":"2023-10-08T16:25:45.595167+0000","last_undegraded":"2023-10-08T16:25:45.595167+0000","last_fullsized":"2023-10-08T16:25:45.595167+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:16.396889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591914+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.591914+0000","last_peered":"2023-10-08T16:25:45.591914+0000","last_clean":"2023-10-08T16:25:45.591914+0000","last_became_active":"2023-10-08T16:25:45.588818+0000","last_became_peered":"2023-10-08T16:25:45.588818+0000","last_unstale":"2023-10-08T16:25:45.591914+0000","last_undegraded":"2023-10-08T16:25:45.591914+0000","last_fullsized":"2023-10-08T16:25:45.591914+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:10.711535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584058+0000","last_change":"2023-10-08T16:25:45.580427+0000","last_active":"2023-10-08T16:25:45.584058+0000","last_peered":"2023-10-08T16:25:45.584058+0000","last_clean":"2023-10-08T16:25:45.584058+0000","last_became_active":"2023-10-08T16:25:45.579809+0000","last_became_peered":"2023-10-08T16:25:45.579809+0000","last_unstale":"2023-10-08T16:25:45.584058+0000","last_undegraded":"2023-10-08T16:25:45.584058+0000","last_fullsized":"2023-10-08T16:25:45.584058+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:26.309987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594714+0000","last_change":"2023-10-08T16:25:45.591447+0000","last_active":"2023-10-08T16:25:45.594714+0000","last_peered":"2023-10-08T16:25:45.594714+0000","last_clean":"2023-10-08T16:25:45.594714+0000","last_became_active":"2023-10-08T16:25:45.590913+0000","last_became_peered":"2023-10-08T16:25:45.590913+0000","last_unstale":"2023-10-08T16:25:45.594714+0000","last_undegraded":"2023-10-08T16:25:45.594714+0000","last_fullsized":"2023-10-08T16:25:45.594714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:28.456125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600258+0000","last_change":"2023-10-08T16:25:45.591542+0000","last_active":"2023-10-08T16:25:45.600258+0000","last_peered":"2023-10-08T16:25:45.600258+0000","last_clean":"2023-10-08T16:25:45.600258+0000","last_became_active":"2023-10-08T16:25:45.591281+0000","last_became_peered":"2023-10-08T16:25:45.591281+0000","last_unstale":"2023-10-08T16:25:45.600258+0000","last_undegraded":"2023-10-08T16:25:45.600258+0000","last_fullsized":"2023-10-08T16:25:45.600258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:08.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595849+0000","last_change":"2023-10-08T16:25:45.589521+0000","last_active":"2023-10-08T16:25:45.595849+0000","last_peered":"2023-10-08T16:25:45.595849+0000","last_clean":"2023-10-08T16:25:45.595849+0000","last_became_active":"2023-10-08T16:25:45.589068+0000","last_became_peered":"2023-10-08T16:25:45.589068+0000","last_unstale":"2023-10-08T16:25:45.595849+0000","last_undegraded":"2023-10-08T16:25:45.595849+0000","last_fullsized":"2023-10-08T16:25:45.595849+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583057+0000","last_change":"2023-10-08T16:25:45.580064+0000","last_active":"2023-10-08T16:25:45.583057+0000","last_peered":"2023-10-08T16:25:45.583057+0000","last_clean":"2023-10-08T16:25:45.583057+0000","last_became_active":"2023-10-08T16:25:45.579798+0000","last_became_peered":"2023-10-08T16:25:45.579798+0000","last_unstale":"2023-10-08T16:25:45.583057+0000","last_undegraded":"2023-10-08T16:25:45.583057+0000","last_fullsized":"2023-10-08T16:25:45.583057+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600201+0000","last_change":"2023-10-08T16:25:45.595131+0000","last_active":"2023-10-08T16:25:45.600201+0000","last_peered":"2023-10-08T16:25:45.600201+0000","last_clean":"2023-10-08T16:25:45.600201+0000","last_became_active":"2023-10-08T16:25:45.594345+0000","last_became_peered":"2023-10-08T16:25:45.594345+0000","last_unstale":"2023-10-08T16:25:45.600201+0000","last_undegraded":"2023-10-08T16:25:45.600201+0000","last_fullsized":"2023-10-08T16:25:45.600201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:30.920035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594976+0000","last_change":"2023-10-08T16:25:45.592565+0000","last_active":"2023-10-08T16:25:45.594976+0000","last_peered":"2023-10-08T16:25:45.594976+0000","last_clean":"2023-10-08T16:25:45.594976+0000","last_became_active":"2023-10-08T16:25:45.592242+0000","last_became_peered":"2023-10-08T16:25:45.592242+0000","last_unstale":"2023-10-08T16:25:45.594976+0000","last_undegraded":"2023-10-08T16:25:45.594976+0000","last_fullsized":"2023-10-08T16:25:45.594976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588610+0000","last_change":"2023-10-08T16:25:45.586741+0000","last_active":"2023-10-08T16:25:45.588610+0000","last_peered":"2023-10-08T16:25:45.588610+0000","last_clean":"2023-10-08T16:25:45.588610+0000","last_became_active":"2023-10-08T16:25:45.585990+0000","last_became_peered":"2023-10-08T16:25:45.585990+0000","last_unstale":"2023-10-08T16:25:45.588610+0000","last_undegraded":"2023-10-08T16:25:45.588610+0000","last_fullsized":"2023-10-08T16:25:45.588610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596393+0000","last_change":"2023-10-08T16:25:45.589945+0000","last_active":"2023-10-08T16:25:45.596393+0000","last_peered":"2023-10-08T16:25:45.596393+0000","last_clean":"2023-10-08T16:25:45.596393+0000","last_became_active":"2023-10-08T16:25:45.589161+0000","last_became_peered":"2023-10-08T16:25:45.589161+0000","last_unstale":"2023-10-08T16:25:45.596393+0000","last_undegraded":"2023-10-08T16:25:45.596393+0000","last_fullsized":"2023-10-08T16:25:45.596393+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:50.185229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585512+0000","last_change":"2023-10-08T16:25:45.576917+0000","last_active":"2023-10-08T16:25:45.585512+0000","last_peered":"2023-10-08T16:25:45.585512+0000","last_clean":"2023-10-08T16:25:45.585512+0000","last_became_active":"2023-10-08T16:25:45.576667+0000","last_became_peered":"2023-10-08T16:25:45.576667+0000","last_unstale":"2023-10-08T16:25:45.585512+0000","last_undegraded":"2023-10-08T16:25:45.585512+0000","last_fullsized":"2023-10-08T16:25:45.585512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:01.278875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591660+0000","last_change":"2023-10-08T16:25:45.583307+0000","last_active":"2023-10-08T16:25:45.591660+0000","last_peered":"2023-10-08T16:25:45.591660+0000","last_clean":"2023-10-08T16:25:45.591660+0000","last_became_active":"2023-10-08T16:25:45.583039+0000","last_became_peered":"2023-10-08T16:25:45.583039+0000","last_unstale":"2023-10-08T16:25:45.591660+0000","last_undegraded":"2023-10-08T16:25:45.591660+0000","last_fullsized":"2023-10-08T16:25:45.591660+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585526+0000","last_change":"2023-10-08T16:25:45.582116+0000","last_active":"2023-10-08T16:25:45.585526+0000","last_peered":"2023-10-08T16:25:45.585526+0000","last_clean":"2023-10-08T16:25:45.585526+0000","last_became_active":"2023-10-08T16:25:45.581794+0000","last_became_peered":"2023-10-08T16:25:45.581794+0000","last_unstale":"2023-10-08T16:25:45.585526+0000","last_undegraded":"2023-10-08T16:25:45.585526+0000","last_fullsized":"2023-10-08T16:25:45.585526+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:11.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597544+0000","last_change":"2023-10-08T16:25:45.593632+0000","last_active":"2023-10-08T16:25:45.597544+0000","last_peered":"2023-10-08T16:25:45.597544+0000","last_clean":"2023-10-08T16:25:45.597544+0000","last_became_active":"2023-10-08T16:25:45.593322+0000","last_became_peered":"2023-10-08T16:25:45.593322+0000","last_unstale":"2023-10-08T16:25:45.597544+0000","last_undegraded":"2023-10-08T16:25:45.597544+0000","last_fullsized":"2023-10-08T16:25:45.597544+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591412+0000","last_change":"2023-10-08T16:25:45.590723+0000","last_active":"2023-10-08T16:25:45.591412+0000","last_peered":"2023-10-08T16:25:45.591412+0000","last_clean":"2023-10-08T16:25:45.591412+0000","last_became_active":"2023-10-08T16:25:45.590395+0000","last_became_peered":"2023-10-08T16:25:45.590395+0000","last_unstale":"2023-10-08T16:25:45.591412+0000","last_undegraded":"2023-10-08T16:25:45.591412+0000","last_fullsized":"2023-10-08T16:25:45.591412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612680+0000","last_change":"2023-10-08T16:25:44.563060+0000","last_active":"2023-10-08T16:25:45.612680+0000","last_peered":"2023-10-08T16:25:45.612680+0000","last_clean":"2023-10-08T16:25:45.612680+0000","last_became_active":"2023-10-08T16:25:44.562784+0000","last_became_peered":"2023-10-08T16:25:44.562784+0000","last_unstale":"2023-10-08T16:25:45.612680+0000","last_undegraded":"2023-10-08T16:25:45.612680+0000","last_fullsized":"2023-10-08T16:25:45.612680+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:45.980150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595644+0000","last_change":"2023-10-08T16:25:45.589637+0000","last_active":"2023-10-08T16:25:45.595644+0000","last_peered":"2023-10-08T16:25:45.595644+0000","last_clean":"2023-10-08T16:25:45.595644+0000","last_became_active":"2023-10-08T16:25:45.589100+0000","last_became_peered":"2023-10-08T16:25:45.589100+0000","last_unstale":"2023-10-08T16:25:45.595644+0000","last_undegraded":"2023-10-08T16:25:45.595644+0000","last_fullsized":"2023-10-08T16:25:45.595644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:02.301066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603596+0000","last_change":"2023-10-08T16:25:44.553709+0000","last_active":"2023-10-08T16:25:45.603596+0000","last_peered":"2023-10-08T16:25:45.603596+0000","last_clean":"2023-10-08T16:25:45.603596+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.603596+0000","last_undegraded":"2023-10-08T16:25:45.603596+0000","last_fullsized":"2023-10-08T16:25:45.603596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597615+0000","last_change":"2023-10-08T16:25:45.593290+0000","last_active":"2023-10-08T16:25:45.597615+0000","last_peered":"2023-10-08T16:25:45.597615+0000","last_clean":"2023-10-08T16:25:45.597615+0000","last_became_active":"2023-10-08T16:25:45.593001+0000","last_became_peered":"2023-10-08T16:25:45.593001+0000","last_unstale":"2023-10-08T16:25:45.597615+0000","last_undegraded":"2023-10-08T16:25:45.597615+0000","last_fullsized":"2023-10-08T16:25:45.597615+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612499+0000","last_change":"2023-10-08T16:25:44.552656+0000","last_active":"2023-10-08T16:25:45.612499+0000","last_peered":"2023-10-08T16:25:45.612499+0000","last_clean":"2023-10-08T16:25:45.612499+0000","last_became_active":"2023-10-08T16:25:44.552389+0000","last_became_peered":"2023-10-08T16:25:44.552389+0000","last_unstale":"2023-10-08T16:25:45.612499+0000","last_undegraded":"2023-10-08T16:25:45.612499+0000","last_fullsized":"2023-10-08T16:25:45.612499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:42.769179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584922+0000","last_change":"2023-10-08T16:25:45.580198+0000","last_active":"2023-10-08T16:25:45.584922+0000","last_peered":"2023-10-08T16:25:45.584922+0000","last_clean":"2023-10-08T16:25:45.584922+0000","last_became_active":"2023-10-08T16:25:45.579926+0000","last_became_peered":"2023-10-08T16:25:45.579926+0000","last_unstale":"2023-10-08T16:25:45.584922+0000","last_undegraded":"2023-10-08T16:25:45.584922+0000","last_fullsized":"2023-10-08T16:25:45.584922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:13.493376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.611804+0000","last_change":"2023-10-08T16:25:44.551156+0000","last_active":"2023-10-08T16:25:45.611804+0000","last_peered":"2023-10-08T16:25:45.611804+0000","last_clean":"2023-10-08T16:25:45.611804+0000","last_became_active":"2023-10-08T16:25:44.550865+0000","last_became_peered":"2023-10-08T16:25:44.550865+0000","last_unstale":"2023-10-08T16:25:45.611804+0000","last_undegraded":"2023-10-08T16:25:45.611804+0000","last_fullsized":"2023-10-08T16:25:45.611804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:54.104951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591640+0000","last_change":"2023-10-08T16:25:45.582599+0000","last_active":"2023-10-08T16:25:45.591640+0000","last_peered":"2023-10-08T16:25:45.591640+0000","last_clean":"2023-10-08T16:25:45.591640+0000","last_became_active":"2023-10-08T16:25:45.582327+0000","last_became_peered":"2023-10-08T16:25:45.582327+0000","last_unstale":"2023-10-08T16:25:45.591640+0000","last_undegraded":"2023-10-08T16:25:45.591640+0000","last_fullsized":"2023-10-08T16:25:45.591640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:53.896274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604343+0000","last_change":"2023-10-08T16:25:44.559604+0000","last_active":"2023-10-08T16:25:45.604343+0000","last_peered":"2023-10-08T16:25:45.604343+0000","last_clean":"2023-10-08T16:25:45.604343+0000","last_became_active":"2023-10-08T16:25:44.559311+0000","last_became_peered":"2023-10-08T16:25:44.559311+0000","last_unstale":"2023-10-08T16:25:45.604343+0000","last_undegraded":"2023-10-08T16:25:45.604343+0000","last_fullsized":"2023-10-08T16:25:45.604343+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585683+0000","last_change":"2023-10-08T16:25:45.582286+0000","last_active":"2023-10-08T16:25:45.585683+0000","last_peered":"2023-10-08T16:25:45.585683+0000","last_clean":"2023-10-08T16:25:45.585683+0000","last_became_active":"2023-10-08T16:25:45.581936+0000","last_became_peered":"2023-10-08T16:25:45.581936+0000","last_unstale":"2023-10-08T16:25:45.585683+0000","last_undegraded":"2023-10-08T16:25:45.585683+0000","last_fullsized":"2023-10-08T16:25:45.585683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603788+0000","last_change":"2023-10-08T16:25:44.551223+0000","last_active":"2023-10-08T16:25:45.603788+0000","last_peered":"2023-10-08T16:25:45.603788+0000","last_clean":"2023-10-08T16:25:45.603788+0000","last_became_active":"2023-10-08T16:25:44.550256+0000","last_became_peered":"2023-10-08T16:25:44.550256+0000","last_unstale":"2023-10-08T16:25:45.603788+0000","last_undegraded":"2023-10-08T16:25:45.603788+0000","last_fullsized":"2023-10-08T16:25:45.603788+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586389+0000","last_change":"2023-10-08T16:25:45.584883+0000","last_active":"2023-10-08T16:25:45.586389+0000","last_peered":"2023-10-08T16:25:45.586389+0000","last_clean":"2023-10-08T16:25:45.586389+0000","last_became_active":"2023-10-08T16:25:45.584561+0000","last_became_peered":"2023-10-08T16:25:45.584561+0000","last_unstale":"2023-10-08T16:25:45.586389+0000","last_undegraded":"2023-10-08T16:25:45.586389+0000","last_fullsized":"2023-10-08T16:25:45.586389+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:20.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.569466+0000","last_change":"2023-10-08T16:25:44.559468+0000","last_active":"2023-10-08T16:25:45.569466+0000","last_peered":"2023-10-08T16:25:45.569466+0000","last_clean":"2023-10-08T16:25:45.569466+0000","last_became_active":"2023-10-08T16:25:44.559209+0000","last_became_peered":"2023-10-08T16:25:44.559209+0000","last_unstale":"2023-10-08T16:25:45.569466+0000","last_undegraded":"2023-10-08T16:25:45.569466+0000","last_fullsized":"2023-10-08T16:25:45.569466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.993977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577542+0000","last_change":"2023-10-08T16:25:45.574917+0000","last_active":"2023-10-08T16:25:45.577542+0000","last_peered":"2023-10-08T16:25:45.577542+0000","last_clean":"2023-10-08T16:25:45.577542+0000","last_became_active":"2023-10-08T16:25:45.574470+0000","last_became_peered":"2023-10-08T16:25:45.574470+0000","last_unstale":"2023-10-08T16:25:45.577542+0000","last_undegraded":"2023-10-08T16:25:45.577542+0000","last_fullsized":"2023-10-08T16:25:45.577542+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571192+0000","last_change":"2023-10-08T16:25:44.563896+0000","last_active":"2023-10-08T16:25:45.571192+0000","last_peered":"2023-10-08T16:25:45.571192+0000","last_clean":"2023-10-08T16:25:45.571192+0000","last_became_active":"2023-10-08T16:25:44.563641+0000","last_became_peered":"2023-10-08T16:25:44.563641+0000","last_unstale":"2023-10-08T16:25:45.571192+0000","last_undegraded":"2023-10-08T16:25:45.571192+0000","last_fullsized":"2023-10-08T16:25:45.571192+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:50.684591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582821+0000","last_change":"2023-10-08T16:25:45.577068+0000","last_active":"2023-10-08T16:25:45.582821+0000","last_peered":"2023-10-08T16:25:45.582821+0000","last_clean":"2023-10-08T16:25:45.582821+0000","last_became_active":"2023-10-08T16:25:45.576772+0000","last_became_peered":"2023-10-08T16:25:45.576772+0000","last_unstale":"2023-10-08T16:25:45.582821+0000","last_undegraded":"2023-10-08T16:25:45.582821+0000","last_fullsized":"2023-10-08T16:25:45.582821+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:40.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.581357+0000","last_change":"2023-10-08T16:25:44.563195+0000","last_active":"2023-10-08T16:25:45.581357+0000","last_peered":"2023-10-08T16:25:45.581357+0000","last_clean":"2023-10-08T16:25:45.581357+0000","last_became_active":"2023-10-08T16:25:44.562921+0000","last_became_peered":"2023-10-08T16:25:44.562921+0000","last_unstale":"2023-10-08T16:25:45.581357+0000","last_undegraded":"2023-10-08T16:25:45.581357+0000","last_fullsized":"2023-10-08T16:25:45.581357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585199+0000","last_change":"2023-10-08T16:25:45.582188+0000","last_active":"2023-10-08T16:25:45.585199+0000","last_peered":"2023-10-08T16:25:45.585199+0000","last_clean":"2023-10-08T16:25:45.585199+0000","last_became_active":"2023-10-08T16:25:45.581893+0000","last_became_peered":"2023-10-08T16:25:45.581893+0000","last_unstale":"2023-10-08T16:25:45.585199+0000","last_undegraded":"2023-10-08T16:25:45.585199+0000","last_fullsized":"2023-10-08T16:25:45.585199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:04.337220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577393+0000","last_change":"2023-10-08T16:25:44.560229+0000","last_active":"2023-10-08T16:25:45.577393+0000","last_peered":"2023-10-08T16:25:45.577393+0000","last_clean":"2023-10-08T16:25:45.577393+0000","last_became_active":"2023-10-08T16:25:44.559921+0000","last_became_peered":"2023-10-08T16:25:44.559921+0000","last_unstale":"2023-10-08T16:25:45.577393+0000","last_undegraded":"2023-10-08T16:25:45.577393+0000","last_fullsized":"2023-10-08T16:25:45.577393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:12.410069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594494+0000","last_change":"2023-10-08T16:25:45.589991+0000","last_active":"2023-10-08T16:25:45.594494+0000","last_peered":"2023-10-08T16:25:45.594494+0000","last_clean":"2023-10-08T16:25:45.594494+0000","last_became_active":"2023-10-08T16:25:45.589565+0000","last_became_peered":"2023-10-08T16:25:45.589565+0000","last_unstale":"2023-10-08T16:25:45.594494+0000","last_undegraded":"2023-10-08T16:25:45.594494+0000","last_fullsized":"2023-10-08T16:25:45.594494+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606205+0000","last_change":"2023-10-08T16:25:44.563895+0000","last_active":"2023-10-08T16:25:45.606205+0000","last_peered":"2023-10-08T16:25:45.606205+0000","last_clean":"2023-10-08T16:25:45.606205+0000","last_became_active":"2023-10-08T16:25:44.563652+0000","last_became_peered":"2023-10-08T16:25:44.563652+0000","last_unstale":"2023-10-08T16:25:45.606205+0000","last_undegraded":"2023-10-08T16:25:45.606205+0000","last_fullsized":"2023-10-08T16:25:45.606205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:04.242293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588572+0000","last_change":"2023-10-08T16:25:45.586201+0000","last_active":"2023-10-08T16:25:45.588572+0000","last_peered":"2023-10-08T16:25:45.588572+0000","last_clean":"2023-10-08T16:25:45.588572+0000","last_became_active":"2023-10-08T16:25:45.585617+0000","last_became_peered":"2023-10-08T16:25:45.585617+0000","last_unstale":"2023-10-08T16:25:45.588572+0000","last_undegraded":"2023-10-08T16:25:45.588572+0000","last_fullsized":"2023-10-08T16:25:45.588572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:52.832630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606194+0000","last_change":"2023-10-08T16:25:44.545277+0000","last_active":"2023-10-08T16:25:45.606194+0000","last_peered":"2023-10-08T16:25:45.606194+0000","last_clean":"2023-10-08T16:25:45.606194+0000","last_became_active":"2023-10-08T16:25:44.544876+0000","last_became_peered":"2023-10-08T16:25:44.544876+0000","last_unstale":"2023-10-08T16:25:45.606194+0000","last_undegraded":"2023-10-08T16:25:45.606194+0000","last_fullsized":"2023-10-08T16:25:45.606194+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587263+0000","last_change":"2023-10-08T16:25:45.578741+0000","last_active":"2023-10-08T16:25:45.587263+0000","last_peered":"2023-10-08T16:25:45.587263+0000","last_clean":"2023-10-08T16:25:45.587263+0000","last_became_active":"2023-10-08T16:25:45.578478+0000","last_became_peered":"2023-10-08T16:25:45.578478+0000","last_unstale":"2023-10-08T16:25:45.587263+0000","last_undegraded":"2023-10-08T16:25:45.587263+0000","last_fullsized":"2023-10-08T16:25:45.587263+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:34.644987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604552+0000","last_change":"2023-10-08T16:25:44.565264+0000","last_active":"2023-10-08T16:25:45.604552+0000","last_peered":"2023-10-08T16:25:45.604552+0000","last_clean":"2023-10-08T16:25:45.604552+0000","last_became_active":"2023-10-08T16:25:44.564967+0000","last_became_peered":"2023-10-08T16:25:44.564967+0000","last_unstale":"2023-10-08T16:25:45.604552+0000","last_undegraded":"2023-10-08T16:25:45.604552+0000","last_fullsized":"2023-10-08T16:25:45.604552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:46.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586357+0000","last_change":"2023-10-08T16:25:45.585553+0000","last_active":"2023-10-08T16:25:45.586357+0000","last_peered":"2023-10-08T16:25:45.586357+0000","last_clean":"2023-10-08T16:25:45.586357+0000","last_became_active":"2023-10-08T16:25:45.585259+0000","last_became_peered":"2023-10-08T16:25:45.585259+0000","last_unstale":"2023-10-08T16:25:45.586357+0000","last_undegraded":"2023-10-08T16:25:45.586357+0000","last_fullsized":"2023-10-08T16:25:45.586357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:24.637587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566733+0000","last_change":"2023-10-08T16:25:44.547629+0000","last_active":"2023-10-08T16:25:45.566733+0000","last_peered":"2023-10-08T16:25:45.566733+0000","last_clean":"2023-10-08T16:25:45.566733+0000","last_became_active":"2023-10-08T16:25:44.546718+0000","last_became_peered":"2023-10-08T16:25:44.546718+0000","last_unstale":"2023-10-08T16:25:45.566733+0000","last_undegraded":"2023-10-08T16:25:45.566733+0000","last_fullsized":"2023-10-08T16:25:45.566733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:17.418830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592361+0000","last_change":"2023-10-08T16:25:45.587967+0000","last_active":"2023-10-08T16:25:45.592361+0000","last_peered":"2023-10-08T16:25:45.592361+0000","last_clean":"2023-10-08T16:25:45.592361+0000","last_became_active":"2023-10-08T16:25:45.587092+0000","last_became_peered":"2023-10-08T16:25:45.587092+0000","last_unstale":"2023-10-08T16:25:45.592361+0000","last_undegraded":"2023-10-08T16:25:45.592361+0000","last_fullsized":"2023-10-08T16:25:45.592361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:56.717915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571878+0000","last_change":"2023-10-08T16:25:44.551921+0000","last_active":"2023-10-08T16:25:45.571878+0000","last_peered":"2023-10-08T16:25:45.571878+0000","last_clean":"2023-10-08T16:25:45.571878+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.571878+0000","last_undegraded":"2023-10-08T16:25:45.571878+0000","last_fullsized":"2023-10-08T16:25:45.571878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592213+0000","last_change":"2023-10-08T16:25:45.585139+0000","last_active":"2023-10-08T16:25:45.592213+0000","last_peered":"2023-10-08T16:25:45.592213+0000","last_clean":"2023-10-08T16:25:45.592213+0000","last_became_active":"2023-10-08T16:25:45.584865+0000","last_became_peered":"2023-10-08T16:25:45.584865+0000","last_unstale":"2023-10-08T16:25:45.592213+0000","last_undegraded":"2023-10-08T16:25:45.592213+0000","last_fullsized":"2023-10-08T16:25:45.592213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:39.963917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600692+0000","last_change":"2023-10-08T16:25:44.552061+0000","last_active":"2023-10-08T16:25:45.600692+0000","last_peered":"2023-10-08T16:25:45.600692+0000","last_clean":"2023-10-08T16:25:45.600692+0000","last_became_active":"2023-10-08T16:25:44.551299+0000","last_became_peered":"2023-10-08T16:25:44.551299+0000","last_unstale":"2023-10-08T16:25:45.600692+0000","last_undegraded":"2023-10-08T16:25:45.600692+0000","last_fullsized":"2023-10-08T16:25:45.600692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:38.632959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585852+0000","last_change":"2023-10-08T16:25:45.582615+0000","last_active":"2023-10-08T16:25:45.585852+0000","last_peered":"2023-10-08T16:25:45.585852+0000","last_clean":"2023-10-08T16:25:45.585852+0000","last_became_active":"2023-10-08T16:25:45.582274+0000","last_became_peered":"2023-10-08T16:25:45.582274+0000","last_unstale":"2023-10-08T16:25:45.585852+0000","last_undegraded":"2023-10-08T16:25:45.585852+0000","last_fullsized":"2023-10-08T16:25:45.585852+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:44.964129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603931+0000","last_change":"2023-10-08T16:25:44.560913+0000","last_active":"2023-10-08T16:25:45.603931+0000","last_peered":"2023-10-08T16:25:45.603931+0000","last_clean":"2023-10-08T16:25:45.603931+0000","last_became_active":"2023-10-08T16:25:44.560638+0000","last_became_peered":"2023-10-08T16:25:44.560638+0000","last_unstale":"2023-10-08T16:25:45.603931+0000","last_undegraded":"2023-10-08T16:25:45.603931+0000","last_fullsized":"2023-10-08T16:25:45.603931+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:41:47.167394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597572+0000","last_change":"2023-10-08T16:25:45.594278+0000","last_active":"2023-10-08T16:25:45.597572+0000","last_peered":"2023-10-08T16:25:45.597572+0000","last_clean":"2023-10-08T16:25:45.597572+0000","last_became_active":"2023-10-08T16:25:45.593991+0000","last_became_peered":"2023-10-08T16:25:45.593991+0000","last_unstale":"2023-10-08T16:25:45.597572+0000","last_undegraded":"2023-10-08T16:25:45.597572+0000","last_fullsized":"2023-10-08T16:25:45.597572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:26:52.532205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.599335+0000","last_change":"2023-10-08T16:25:44.557054+0000","last_active":"2023-10-08T16:25:45.599335+0000","last_peered":"2023-10-08T16:25:45.599335+0000","last_clean":"2023-10-08T16:25:45.599335+0000","last_became_active":"2023-10-08T16:25:44.556775+0000","last_became_peered":"2023-10-08T16:25:44.556775+0000","last_unstale":"2023-10-08T16:25:45.599335+0000","last_undegraded":"2023-10-08T16:25:45.599335+0000","last_fullsized":"2023-10-08T16:25:45.599335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:12.503445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586297+0000","last_change":"2023-10-08T16:25:45.578887+0000","last_active":"2023-10-08T16:25:45.586297+0000","last_peered":"2023-10-08T16:25:45.586297+0000","last_clean":"2023-10-08T16:25:45.586297+0000","last_became_active":"2023-10-08T16:25:45.578598+0000","last_became_peered":"2023-10-08T16:25:45.578598+0000","last_unstale":"2023-10-08T16:25:45.586297+0000","last_undegraded":"2023-10-08T16:25:45.586297+0000","last_fullsized":"2023-10-08T16:25:45.586297+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574205+0000","last_change":"2023-10-08T16:25:44.556557+0000","last_active":"2023-10-08T16:25:45.574205+0000","last_peered":"2023-10-08T16:25:45.574205+0000","last_clean":"2023-10-08T16:25:45.574205+0000","last_became_active":"2023-10-08T16:25:44.556239+0000","last_became_peered":"2023-10-08T16:25:44.556239+0000","last_unstale":"2023-10-08T16:25:45.574205+0000","last_undegraded":"2023-10-08T16:25:45.574205+0000","last_fullsized":"2023-10-08T16:25:45.574205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:51.824195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594745+0000","last_change":"2023-10-08T16:25:45.592514+0000","last_active":"2023-10-08T16:25:45.594745+0000","last_peered":"2023-10-08T16:25:45.594745+0000","last_clean":"2023-10-08T16:25:45.594745+0000","last_became_active":"2023-10-08T16:25:45.592232+0000","last_became_peered":"2023-10-08T16:25:45.592232+0000","last_unstale":"2023-10-08T16:25:45.594745+0000","last_undegraded":"2023-10-08T16:25:45.594745+0000","last_fullsized":"2023-10-08T16:25:45.594745+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:04.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612375+0000","last_change":"2023-10-08T16:25:44.550134+0000","last_active":"2023-10-08T16:25:45.612375+0000","last_peered":"2023-10-08T16:25:45.612375+0000","last_clean":"2023-10-08T16:25:45.612375+0000","last_became_active":"2023-10-08T16:25:44.549837+0000","last_became_peered":"2023-10-08T16:25:44.549837+0000","last_unstale":"2023-10-08T16:25:45.612375+0000","last_undegraded":"2023-10-08T16:25:45.612375+0000","last_fullsized":"2023-10-08T16:25:45.612375+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:03.826716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583645+0000","last_change":"2023-10-08T16:25:45.581026+0000","last_active":"2023-10-08T16:25:45.583645+0000","last_peered":"2023-10-08T16:25:45.583645+0000","last_clean":"2023-10-08T16:25:45.583645+0000","last_became_active":"2023-10-08T16:25:45.580746+0000","last_became_peered":"2023-10-08T16:25:45.580746+0000","last_unstale":"2023-10-08T16:25:45.583645+0000","last_undegraded":"2023-10-08T16:25:45.583645+0000","last_fullsized":"2023-10-08T16:25:45.583645+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:48.378741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.570156+0000","last_change":"2023-10-08T16:25:44.557614+0000","last_active":"2023-10-08T16:25:45.570156+0000","last_peered":"2023-10-08T16:25:45.570156+0000","last_clean":"2023-10-08T16:25:45.570156+0000","last_became_active":"2023-10-08T16:25:44.557338+0000","last_became_peered":"2023-10-08T16:25:44.557338+0000","last_unstale":"2023-10-08T16:25:45.570156+0000","last_undegraded":"2023-10-08T16:25:45.570156+0000","last_fullsized":"2023-10-08T16:25:45.570156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:12.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584093+0000","last_change":"2023-10-08T16:25:45.581008+0000","last_active":"2023-10-08T16:25:45.584093+0000","last_peered":"2023-10-08T16:25:45.584093+0000","last_clean":"2023-10-08T16:25:45.584093+0000","last_became_active":"2023-10-08T16:25:45.580751+0000","last_became_peered":"2023-10-08T16:25:45.580751+0000","last_unstale":"2023-10-08T16:25:45.584093+0000","last_undegraded":"2023-10-08T16:25:45.584093+0000","last_fullsized":"2023-10-08T16:25:45.584093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575487+0000","last_change":"2023-10-08T16:25:44.560692+0000","last_active":"2023-10-08T16:25:45.575487+0000","last_peered":"2023-10-08T16:25:45.575487+0000","last_clean":"2023-10-08T16:25:45.575487+0000","last_became_active":"2023-10-08T16:25:44.560446+0000","last_became_peered":"2023-10-08T16:25:44.560446+0000","last_unstale":"2023-10-08T16:25:45.575487+0000","last_undegraded":"2023-10-08T16:25:45.575487+0000","last_fullsized":"2023-10-08T16:25:45.575487+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:43.729263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584981+0000","last_change":"2023-10-08T16:25:45.581050+0000","last_active":"2023-10-08T16:25:45.584981+0000","last_peered":"2023-10-08T16:25:45.584981+0000","last_clean":"2023-10-08T16:25:45.584981+0000","last_became_active":"2023-10-08T16:25:45.580673+0000","last_became_peered":"2023-10-08T16:25:45.580673+0000","last_unstale":"2023-10-08T16:25:45.584981+0000","last_undegraded":"2023-10-08T16:25:45.584981+0000","last_fullsized":"2023-10-08T16:25:45.584981+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566601+0000","last_change":"2023-10-08T16:25:44.550131+0000","last_active":"2023-10-08T16:25:45.566601+0000","last_peered":"2023-10-08T16:25:45.566601+0000","last_clean":"2023-10-08T16:25:45.566601+0000","last_became_active":"2023-10-08T16:25:44.549815+0000","last_became_peered":"2023-10-08T16:25:44.549815+0000","last_unstale":"2023-10-08T16:25:45.566601+0000","last_undegraded":"2023-10-08T16:25:45.566601+0000","last_fullsized":"2023-10-08T16:25:45.566601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:05.527633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588928+0000","last_change":"2023-10-08T16:25:45.587793+0000","last_active":"2023-10-08T16:25:45.588928+0000","last_peered":"2023-10-08T16:25:45.588928+0000","last_clean":"2023-10-08T16:25:45.588928+0000","last_became_active":"2023-10-08T16:25:45.587349+0000","last_became_peered":"2023-10-08T16:25:45.587349+0000","last_unstale":"2023-10-08T16:25:45.588928+0000","last_undegraded":"2023-10-08T16:25:45.588928+0000","last_fullsized":"2023-10-08T16:25:45.588928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603898+0000","last_change":"2023-10-08T16:25:44.551814+0000","last_active":"2023-10-08T16:25:45.603898+0000","last_peered":"2023-10-08T16:25:45.603898+0000","last_clean":"2023-10-08T16:25:45.603898+0000","last_became_active":"2023-10-08T16:25:44.551552+0000","last_became_peered":"2023-10-08T16:25:44.551552+0000","last_unstale":"2023-10-08T16:25:45.603898+0000","last_undegraded":"2023-10-08T16:25:45.603898+0000","last_fullsized":"2023-10-08T16:25:45.603898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:21.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596231+0000","last_change":"2023-10-08T16:25:45.593817+0000","last_active":"2023-10-08T16:25:45.596231+0000","last_peered":"2023-10-08T16:25:45.596231+0000","last_clean":"2023-10-08T16:25:45.596231+0000","last_became_active":"2023-10-08T16:25:45.593456+0000","last_became_peered":"2023-10-08T16:25:45.593456+0000","last_unstale":"2023-10-08T16:25:45.596231+0000","last_undegraded":"2023-10-08T16:25:45.596231+0000","last_fullsized":"2023-10-08T16:25:45.596231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:21.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571579+0000","last_change":"2023-10-08T16:25:44.566555+0000","last_active":"2023-10-08T16:25:45.571579+0000","last_peered":"2023-10-08T16:25:45.571579+0000","last_clean":"2023-10-08T16:25:45.571579+0000","last_became_active":"2023-10-08T16:25:44.564889+0000","last_became_peered":"2023-10-08T16:25:44.564889+0000","last_unstale":"2023-10-08T16:25:45.571579+0000","last_undegraded":"2023-10-08T16:25:45.571579+0000","last_fullsized":"2023-10-08T16:25:45.571579+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:21.570754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597683+0000","last_change":"2023-10-08T16:25:45.594888+0000","last_active":"2023-10-08T16:25:45.597683+0000","last_peered":"2023-10-08T16:25:45.597683+0000","last_clean":"2023-10-08T16:25:45.597683+0000","last_became_active":"2023-10-08T16:25:45.594595+0000","last_became_peered":"2023-10-08T16:25:45.594595+0000","last_unstale":"2023-10-08T16:25:45.597683+0000","last_undegraded":"2023-10-08T16:25:45.597683+0000","last_fullsized":"2023-10-08T16:25:45.597683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574484+0000","last_change":"2023-10-08T16:25:44.555840+0000","last_active":"2023-10-08T16:25:45.574484+0000","last_peered":"2023-10-08T16:25:45.574484+0000","last_clean":"2023-10-08T16:25:45.574484+0000","last_became_active":"2023-10-08T16:25:44.555556+0000","last_became_peered":"2023-10-08T16:25:44.555556+0000","last_unstale":"2023-10-08T16:25:45.574484+0000","last_undegraded":"2023-10-08T16:25:45.574484+0000","last_fullsized":"2023-10-08T16:25:45.574484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:19.721147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588591+0000","last_change":"2023-10-08T16:25:45.586274+0000","last_active":"2023-10-08T16:25:45.588591+0000","last_peered":"2023-10-08T16:25:45.588591+0000","last_clean":"2023-10-08T16:25:45.588591+0000","last_became_active":"2023-10-08T16:25:45.585917+0000","last_became_peered":"2023-10-08T16:25:45.585917+0000","last_unstale":"2023-10-08T16:25:45.588591+0000","last_undegraded":"2023-10-08T16:25:45.588591+0000","last_fullsized":"2023-10-08T16:25:45.588591+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:20:28.140378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.578717+0000","last_change":"2023-10-08T16:25:44.562104+0000","last_active":"2023-10-08T16:25:45.578717+0000","last_peered":"2023-10-08T16:25:45.578717+0000","last_clean":"2023-10-08T16:25:45.578717+0000","last_became_active":"2023-10-08T16:25:44.561808+0000","last_became_peered":"2023-10-08T16:25:44.561808+0000","last_unstale":"2023-10-08T16:25:45.578717+0000","last_undegraded":"2023-10-08T16:25:45.578717+0000","last_fullsized":"2023-10-08T16:25:45.578717+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:09.926631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583878+0000","last_change":"2023-10-08T16:25:45.580482+0000","last_active":"2023-10-08T16:25:45.583878+0000","last_peered":"2023-10-08T16:25:45.583878+0000","last_clean":"2023-10-08T16:25:45.583878+0000","last_became_active":"2023-10-08T16:25:45.580140+0000","last_became_peered":"2023-10-08T16:25:45.580140+0000","last_unstale":"2023-10-08T16:25:45.583878+0000","last_undegraded":"2023-10-08T16:25:45.583878+0000","last_fullsized":"2023-10-08T16:25:45.583878+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572348+0000","last_change":"2023-10-08T16:25:44.551669+0000","last_active":"2023-10-08T16:25:45.572348+0000","last_peered":"2023-10-08T16:25:45.572348+0000","last_clean":"2023-10-08T16:25:45.572348+0000","last_became_active":"2023-10-08T16:25:44.551423+0000","last_became_peered":"2023-10-08T16:25:44.551423+0000","last_unstale":"2023-10-08T16:25:45.572348+0000","last_undegraded":"2023-10-08T16:25:45.572348+0000","last_fullsized":"2023-10-08T16:25:45.572348+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585854+0000","last_change":"2023-10-08T16:25:45.582864+0000","last_active":"2023-10-08T16:25:45.585854+0000","last_peered":"2023-10-08T16:25:45.585854+0000","last_clean":"2023-10-08T16:25:45.585854+0000","last_became_active":"2023-10-08T16:25:45.582578+0000","last_became_peered":"2023-10-08T16:25:45.582578+0000","last_unstale":"2023-10-08T16:25:45.585854+0000","last_undegraded":"2023-10-08T16:25:45.585854+0000","last_fullsized":"2023-10-08T16:25:45.585854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:41.323085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572632+0000","last_change":"2023-10-08T16:25:44.550959+0000","last_active":"2023-10-08T16:25:45.572632+0000","last_peered":"2023-10-08T16:25:45.572632+0000","last_clean":"2023-10-08T16:25:45.572632+0000","last_became_active":"2023-10-08T16:25:44.550527+0000","last_became_peered":"2023-10-08T16:25:44.550527+0000","last_unstale":"2023-10-08T16:25:45.572632+0000","last_undegraded":"2023-10-08T16:25:45.572632+0000","last_fullsized":"2023-10-08T16:25:45.572632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594986+0000","last_change":"2023-10-08T16:25:45.592717+0000","last_active":"2023-10-08T16:25:45.594986+0000","last_peered":"2023-10-08T16:25:45.594986+0000","last_clean":"2023-10-08T16:25:45.594986+0000","last_became_active":"2023-10-08T16:25:45.592338+0000","last_became_peered":"2023-10-08T16:25:45.592338+0000","last_unstale":"2023-10-08T16:25:45.594986+0000","last_undegraded":"2023-10-08T16:25:45.594986+0000","last_fullsized":"2023-10-08T16:25:45.594986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:04.835151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575648+0000","last_change":"2023-10-08T16:25:44.562414+0000","last_active":"2023-10-08T16:25:45.575648+0000","last_peered":"2023-10-08T16:25:45.575648+0000","last_clean":"2023-10-08T16:25:45.575648+0000","last_became_active":"2023-10-08T16:25:44.562080+0000","last_became_peered":"2023-10-08T16:25:44.562080+0000","last_unstale":"2023-10-08T16:25:45.575648+0000","last_undegraded":"2023-10-08T16:25:45.575648+0000","last_fullsized":"2023-10-08T16:25:45.575648+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598116+0000","last_change":"2023-10-08T16:25:45.595024+0000","last_active":"2023-10-08T16:25:45.598116+0000","last_peered":"2023-10-08T16:25:45.598116+0000","last_clean":"2023-10-08T16:25:45.598116+0000","last_became_active":"2023-10-08T16:25:45.594664+0000","last_became_peered":"2023-10-08T16:25:45.594664+0000","last_unstale":"2023-10-08T16:25:45.598116+0000","last_undegraded":"2023-10-08T16:25:45.598116+0000","last_fullsized":"2023-10-08T16:25:45.598116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:04.017138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572038+0000","last_change":"2023-10-08T16:25:44.557142+0000","last_active":"2023-10-08T16:25:45.572038+0000","last_peered":"2023-10-08T16:25:45.572038+0000","last_clean":"2023-10-08T16:25:45.572038+0000","last_became_active":"2023-10-08T16:25:44.556876+0000","last_became_peered":"2023-10-08T16:25:44.556876+0000","last_unstale":"2023-10-08T16:25:45.572038+0000","last_undegraded":"2023-10-08T16:25:45.572038+0000","last_fullsized":"2023-10-08T16:25:45.572038+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586322+0000","last_change":"2023-10-08T16:25:45.583813+0000","last_active":"2023-10-08T16:25:45.586322+0000","last_peered":"2023-10-08T16:25:45.586322+0000","last_clean":"2023-10-08T16:25:45.586322+0000","last_became_active":"2023-10-08T16:25:45.583329+0000","last_became_peered":"2023-10-08T16:25:45.583329+0000","last_unstale":"2023-10-08T16:25:45.586322+0000","last_undegraded":"2023-10-08T16:25:45.586322+0000","last_fullsized":"2023-10-08T16:25:45.586322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:44.737697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604424+0000","last_change":"2023-10-08T16:25:44.556287+0000","last_active":"2023-10-08T16:25:45.604424+0000","last_peered":"2023-10-08T16:25:45.604424+0000","last_clean":"2023-10-08T16:25:45.604424+0000","last_became_active":"2023-10-08T16:25:44.555458+0000","last_became_peered":"2023-10-08T16:25:44.555458+0000","last_unstale":"2023-10-08T16:25:45.604424+0000","last_undegraded":"2023-10-08T16:25:45.604424+0000","last_fullsized":"2023-10-08T16:25:45.604424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:08.585517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"102'205","reported_seq":559,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574866+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:45.574866+0000","last_peered":"2023-10-08T16:25:45.574866+0000","last_clean":"2023-10-08T16:25:45.574866+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:45.574866+0000","last_undegraded":"2023-10-08T16:25:45.574866+0000","last_fullsized":"2023-10-08T16:25:45.574866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1266908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.746},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.94599999999999995,"15min":0.99199999999999999},"last":0.76400000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.873},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.042},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.05},"last":0.91200000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89500000000000002,"5min":0.95199999999999996,"15min":1.002},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.98299999999999998,"5min":1.0389999999999999,"15min":5.5590000000000002},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.57499999999999996,"5min":0.439,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.351,"15min":1.351},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.022,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.173,"15min":1.173},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.627,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.622}]}]},{"osd":6,"up_from":13,"seq":55834575044,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":677136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.74399999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.76800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.071,"15min":1.081},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.87,"5min":1.034,"15min":1.0800000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"min":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96799999999999997,"5min":1.0149999999999999,"15min":1.069},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.125},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.78500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":1.272,"15min":1.272},"last":0.752},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77000000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0680000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.84799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":676664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42199999999999999,"15min":0.44600000000000001},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.873},"last":0.318},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61099999999999999,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.38},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.45000000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78000000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.501},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.95199999999999996},"last":0.41499999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96899999999999997,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.0660000000000001,"15min":1.224},"last":0.75700000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78500000000000003,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0780000000000001,"15min":1.206},"last":0.621},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.89900000000000002,"5min":1.101,"15min":1.2909999999999999},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.81999999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.1839999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.875,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56999999999999995},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299228,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072612,"statfs":{"total":96636764160,"available":96330354688,"internally_reserved":0,"allocated":1986560,"data_stored":1266872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.89400000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.48199999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.32000000000000001},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.093},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.372}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.878,"15min":0.878},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":1.21,"15min":1.21},"last":0.56599999999999995}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.76400000000000001},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.46400000000000002},"max":{"1min":1.0589999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88900000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1439999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.2330000000000001},"last":0.995}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":1.0600000000000001,"5min":1.157,"15min":1.1950000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.212},"last":0.93899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.82299999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":1.0680000000000001,"5min":1.1140000000000001,"15min":1.1579999999999999},"last":0.872},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.157,"5min":1.163,"15min":1.202},"last":1.0269999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306840,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065000,"statfs":{"total":96636764160,"available":96322560000,"internally_reserved":0,"allocated":1392640,"data_stored":677024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.29199999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.96599999999999997,"5min":1.046,"15min":1.046},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.54800000000000004,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.01,"5min":1.01,"15min":1.1279999999999999},"last":0.45500000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.505,"15min":0.52700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73099999999999998,"5min":1.1519999999999999,"15min":1.4690000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.502,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.746,"5min":0.94399999999999995,"15min":1.2809999999999999},"last":0.41699999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51800000000000002,"15min":0.53400000000000003},"min":{"1min":0.34499999999999997,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.82099999999999995,"5min":0.99299999999999999,"15min":1.4119999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77000000000000002,"5min":1.1160000000000001,"15min":1.448},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75600000000000001,"15min":0.78600000000000003},"min":{"1min":0.52500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.90100000000000002,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.753,"15min":0.77800000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.84999999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.752}]},{"osd":5,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81100000000000005,"15min":0.83699999999999997},"min":{"1min":0.63200000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.878},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.79100000000000004,"15min":0.82199999999999995},"min":{"1min":0.56399999999999995,"5min":0.55600000000000005,"15min":0.53300000000000003},"max":{"1min":1.052,"5min":1.3,"15min":1.3720000000000001},"last":0.88900000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.76300000000000001,"15min":0.79200000000000004},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.92200000000000004,"5min":1.321,"15min":1.3959999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77800000000000002,"15min":0.82099999999999995},"min":{"1min":0.55300000000000005,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93899999999999995,"5min":1.5149999999999999,"15min":1.5229999999999999},"last":0.86299999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:24:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.81200000000000006,"15min":0.85399999999999998},"min":{"1min":0.61699999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.028,"5min":1.4410000000000001,"15min":1.734},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82099999999999995,"15min":0.86499999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96599999999999997,"5min":1.272,"15min":1.655},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575044,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":678006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.308},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.377}]},{"osd":2,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":1,"15min":1},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.76400000000000001},"min":{"1min":0.54100000000000004,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.95399999999999996,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.67600000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":1.1319999999999999,"15min":1.2110000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96199999999999997,"5min":1.093,"15min":1.3200000000000001},"last":0.58899999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.23},"last":0.627},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82099999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.60099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073196,"statfs":{"total":96636764160,"available":96330952704,"internally_reserved":0,"allocated":1388544,"data_stored":676470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.495},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":1.02,"15min":1.02},"last":0.86399999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84499999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.379},"max":{"1min":0.878,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.71099999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.085,"15min":1.1060000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1339999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.82199999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.47,"15min":1.47},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0589999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79200000000000004,"5min":2.661,"15min":2.661},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.611,"15min":1.611},"last":0.90600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.88500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575043,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310948,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060892,"statfs":{"total":96636764160,"available":96318353408,"internally_reserved":0,"allocated":1404928,"data_stored":678028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0129999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.73499999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72599999999999998,"15min":0.749},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93300000000000005,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.05},"last":0.60299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92000000000000004,"5min":0.97599999999999998,"15min":1.0389999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98099999999999998,"5min":4.931,"15min":4.931},"last":0.442}]},{"osd":3,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.081,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.0129999999999999,"5min":1.96,"15min":1.96},"last":0.76900000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69499999999999995,"15min":0.63300000000000001},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.753},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":1.0489999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.86099999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96499999999999997,"5min":2.024,"15min":2.024},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.105,"5min":2.157,"15min":2.157},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.81599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:55.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:25:55.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.295+0000 7fddfffff700 1 Processor -- start 2023-10-08T16:25:55.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.295+0000 7fddfffff700 1 -- start start 2023-10-08T16:25:55.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.296+0000 7fddfffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142fd0 0x7fde000c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.296+0000 7fddfffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde000c7dc0 0x7fde0006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.296+0000 7fddfffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde000ca480 con 0x7fde00142c00 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.296+0000 7fddfffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde000c8240 con 0x7fde000c7dc0 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.296+0000 7fddfffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0015e240 con 0x7fde00142fd0 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddfeffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fde00142c00 0x7fde0006b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52308/0 (socket says 172.21.15.12:52308) 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddfeffd700 1 -- 172.21.15.12:0/919653462 learned_addr learned my addr 172.21.15.12:0/919653462 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddff7fe700 1 --2- 172.21.15.12:0/919653462 >> v2:172.21.15.12:3300/0 conn(0x7fde000c7dc0 0x7fde0006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddfe7fc700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142fd0 0x7fde000c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddfdffb700 1 -- 172.21.15.12:0/919653462 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2042570391 0 0) 0x7fde000ca480 con 0x7fde00142c00 2023-10-08T16:25:55.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddfdffb700 1 -- 172.21.15.12:0/919653462 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdde8003570 con 0x7fde00142c00 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddff7fe700 1 -- 172.21.15.12:0/919653462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142fd0 msgr2=0x7fde000c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddff7fe700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142fd0 0x7fde000c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddff7fe700 1 -- 172.21.15.12:0/919653462 >> v1:172.21.15.12:6789/0 conn(0x7fde00142c00 legacy=0x7fde0006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.297+0000 7fddff7fe700 1 -- 172.21.15.12:0/919653462 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0006b350 con 0x7fde000c7dc0 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddff7fe700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde0006c6a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e60 tx=0x7fddf8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207a8ce01987948 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfdffb700 1 -- 172.21.15.12:0/919653462 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800e070 con 0x7fde000c7dc0 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfdffb700 1 -- 172.21.15.12:0/919653462 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf800bab0 con 0x7fde000c7dc0 2023-10-08T16:25:55.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfdffb700 1 -- 172.21.15.12:0/919653462 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf800be30 con 0x7fde000c7dc0 2023-10-08T16:25:55.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 -- 172.21.15.12:0/919653462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 msgr2=0x7fde0006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde0006c6a0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fddf8009e60 tx=0x7fddf8009780 comp rx=0 tx=0).stop 2023-10-08T16:25:55.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 -- 172.21.15.12:0/919653462 shutdown_connections 2023-10-08T16:25:55.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde0006c6a0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 --2- 172.21.15.12:0/919653462 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142fd0 0x7fde000c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.298+0000 7fddfffff700 1 -- 172.21.15.12:0/919653462 >> 172.21.15.12:0/919653462 conn(0x7fde000675a0 msgr2=0x7fde000679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.299+0000 7fddfffff700 1 -- 172.21.15.12:0/919653462 shutdown_connections 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.299+0000 7fddfffff700 1 -- 172.21.15.12:0/919653462 wait complete. 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.300+0000 7fddfffff700 1 Processor -- start 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.300+0000 7fddfffff700 1 -- start start 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 0x7fde000b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 0x7fde000c5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000b0310 con 0x7fde000c7dc0 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde000c5390 con 0x7fde00142fd0 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde001591f0 con 0x7fde00142c00 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37368/0 (socket says 172.21.15.12:37368) 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfeffd700 1 -- 172.21.15.12:0/1517588961 learned_addr learned my addr 172.21.15.12:0/1517588961 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddfe7fc700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 0x7fde000b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.301+0000 7fddff7fe700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 0x7fde000c5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 -- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 msgr2=0x7fde000b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 0x7fde000b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 -- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 msgr2=0x7fde000c5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 0x7fde000c5820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 -- 172.21.15.12:0/1517588961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf8009a20 con 0x7fde000c7dc0 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfe7fc700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 0x7fde000b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddff7fe700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 0x7fde000c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfeffd700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fddf00011e0 tx=0x7fddf0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0005b30 con 0x7fde000c7dc0 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf0005c90 con 0x7fde000c7dc0 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf00072e0 con 0x7fde000c7dc0 2023-10-08T16:25:55.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde000c4780 con 0x7fde000c7dc0 2023-10-08T16:25:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.302+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde000c4d40 con 0x7fde000c7dc0 2023-10-08T16:25:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.303+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde000c5670 con 0x7fde000c7dc0 2023-10-08T16:25:55.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.304+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddf0007650 con 0x7fde000c7dc0 2023-10-08T16:25:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.305+0000 7fdde6ffd700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 0x7fddec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.305+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fddf0083b70 con 0x7fde000c7dc0 2023-10-08T16:25:55.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.306+0000 7fddfe7fc700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 0x7fddec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.306+0000 7fddfe7fc700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 0x7fddec0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde0016cf60 tx=0x7fddf4008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.309+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddf004b5a0 con 0x7fde000c7dc0 2023-10-08T16:25:55.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.506+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde0004c410 con 0x7fddec066f30 2023-10-08T16:25:55.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.515+0000 7fdde6ffd700 1 -- 172.21.15.12:0/1517588961 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289349 (secure 0 0 0) 0x7fde0004c410 con 0x7fddec066f30 2023-10-08T16:25:55.520 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:55.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 msgr2=0x7fddec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 0x7fddec0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde0016cf60 tx=0x7fddf4008040 comp rx=0 tx=0).stop 2023-10-08T16:25:55.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 msgr2=0x7fde00158cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fddf00011e0 tx=0x7fddf0007df0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 shutdown_connections 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fddec066f30 0x7fddec0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde000c7dc0 0x7fde00158cb0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde00142fd0 0x7fde000c5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 --2- 172.21.15.12:0/1517588961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde00142c00 0x7fde000b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 >> 172.21.15.12:0/1517588961 conn(0x7fde000675a0 msgr2=0x7fde0006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 shutdown_connections 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.519+0000 7fddfffff700 1 -- 172.21.15.12:0/1517588961 wait complete. 2023-10-08T16:25:55.523 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:25:55.537 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T16:25:54.962677+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2439528,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752535192,"statfs":{"total":773094113280,"available":770596036608,"internally_reserved":0,"allocated":12361728,"data_stored":6597108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.397662"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595665+0000","last_change":"2023-10-08T16:25:45.589950+0000","last_active":"2023-10-08T16:25:45.595665+0000","last_peered":"2023-10-08T16:25:45.595665+0000","last_clean":"2023-10-08T16:25:45.595665+0000","last_became_active":"2023-10-08T16:25:45.589614+0000","last_became_peered":"2023-10-08T16:25:45.589614+0000","last_unstale":"2023-10-08T16:25:45.595665+0000","last_undegraded":"2023-10-08T16:25:45.595665+0000","last_fullsized":"2023-10-08T16:25:45.595665+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592653+0000","last_change":"2023-10-08T16:25:45.586001+0000","last_active":"2023-10-08T16:25:45.592653+0000","last_peered":"2023-10-08T16:25:45.592653+0000","last_clean":"2023-10-08T16:25:45.592653+0000","last_became_active":"2023-10-08T16:25:45.585724+0000","last_became_peered":"2023-10-08T16:25:45.585724+0000","last_unstale":"2023-10-08T16:25:45.592653+0000","last_undegraded":"2023-10-08T16:25:45.592653+0000","last_fullsized":"2023-10-08T16:25:45.592653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595899+0000","last_change":"2023-10-08T16:25:45.593576+0000","last_active":"2023-10-08T16:25:45.595899+0000","last_peered":"2023-10-08T16:25:45.595899+0000","last_clean":"2023-10-08T16:25:45.595899+0000","last_became_active":"2023-10-08T16:25:45.593238+0000","last_became_peered":"2023-10-08T16:25:45.593238+0000","last_unstale":"2023-10-08T16:25:45.595899+0000","last_undegraded":"2023-10-08T16:25:45.595899+0000","last_fullsized":"2023-10-08T16:25:45.595899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:33:01.642697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594827+0000","last_change":"2023-10-08T16:25:45.592344+0000","last_active":"2023-10-08T16:25:45.594827+0000","last_peered":"2023-10-08T16:25:45.594827+0000","last_clean":"2023-10-08T16:25:45.594827+0000","last_became_active":"2023-10-08T16:25:45.592064+0000","last_became_peered":"2023-10-08T16:25:45.592064+0000","last_unstale":"2023-10-08T16:25:45.594827+0000","last_undegraded":"2023-10-08T16:25:45.594827+0000","last_fullsized":"2023-10-08T16:25:45.594827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:13.418504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585550+0000","last_change":"2023-10-08T16:25:45.578187+0000","last_active":"2023-10-08T16:25:45.585550+0000","last_peered":"2023-10-08T16:25:45.585550+0000","last_clean":"2023-10-08T16:25:45.585550+0000","last_became_active":"2023-10-08T16:25:45.577823+0000","last_became_peered":"2023-10-08T16:25:45.577823+0000","last_unstale":"2023-10-08T16:25:45.585550+0000","last_undegraded":"2023-10-08T16:25:45.585550+0000","last_fullsized":"2023-10-08T16:25:45.585550+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:43.777614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585168+0000","last_change":"2023-10-08T16:25:45.583726+0000","last_active":"2023-10-08T16:25:45.585168+0000","last_peered":"2023-10-08T16:25:45.585168+0000","last_clean":"2023-10-08T16:25:45.585168+0000","last_became_active":"2023-10-08T16:25:45.583413+0000","last_became_peered":"2023-10-08T16:25:45.583413+0000","last_unstale":"2023-10-08T16:25:45.585168+0000","last_undegraded":"2023-10-08T16:25:45.585168+0000","last_fullsized":"2023-10-08T16:25:45.585168+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:39.641394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595848+0000","last_change":"2023-10-08T16:25:45.594729+0000","last_active":"2023-10-08T16:25:45.595848+0000","last_peered":"2023-10-08T16:25:45.595848+0000","last_clean":"2023-10-08T16:25:45.595848+0000","last_became_active":"2023-10-08T16:25:45.594337+0000","last_became_peered":"2023-10-08T16:25:45.594337+0000","last_unstale":"2023-10-08T16:25:45.595848+0000","last_undegraded":"2023-10-08T16:25:45.595848+0000","last_fullsized":"2023-10-08T16:25:45.595848+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:12:10.722929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590653+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.590653+0000","last_peered":"2023-10-08T16:25:45.590653+0000","last_clean":"2023-10-08T16:25:45.590653+0000","last_became_active":"2023-10-08T16:25:45.588642+0000","last_became_peered":"2023-10-08T16:25:45.588642+0000","last_unstale":"2023-10-08T16:25:45.590653+0000","last_undegraded":"2023-10-08T16:25:45.590653+0000","last_fullsized":"2023-10-08T16:25:45.590653+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:36:48.041989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583837+0000","last_change":"2023-10-08T16:25:45.580504+0000","last_active":"2023-10-08T16:25:45.583837+0000","last_peered":"2023-10-08T16:25:45.583837+0000","last_clean":"2023-10-08T16:25:45.583837+0000","last_became_active":"2023-10-08T16:25:45.580203+0000","last_became_peered":"2023-10-08T16:25:45.580203+0000","last_unstale":"2023-10-08T16:25:45.583837+0000","last_undegraded":"2023-10-08T16:25:45.583837+0000","last_fullsized":"2023-10-08T16:25:45.583837+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598173+0000","last_change":"2023-10-08T16:25:45.597142+0000","last_active":"2023-10-08T16:25:45.598173+0000","last_peered":"2023-10-08T16:25:45.598173+0000","last_clean":"2023-10-08T16:25:45.598173+0000","last_became_active":"2023-10-08T16:25:45.596713+0000","last_became_peered":"2023-10-08T16:25:45.596713+0000","last_unstale":"2023-10-08T16:25:45.598173+0000","last_undegraded":"2023-10-08T16:25:45.598173+0000","last_fullsized":"2023-10-08T16:25:45.598173+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586090+0000","last_change":"2023-10-08T16:25:45.576696+0000","last_active":"2023-10-08T16:25:45.586090+0000","last_peered":"2023-10-08T16:25:45.586090+0000","last_clean":"2023-10-08T16:25:45.586090+0000","last_became_active":"2023-10-08T16:25:45.576430+0000","last_became_peered":"2023-10-08T16:25:45.576430+0000","last_unstale":"2023-10-08T16:25:45.586090+0000","last_undegraded":"2023-10-08T16:25:45.586090+0000","last_fullsized":"2023-10-08T16:25:45.586090+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:42.921358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597728+0000","last_change":"2023-10-08T16:25:45.596083+0000","last_active":"2023-10-08T16:25:45.597728+0000","last_peered":"2023-10-08T16:25:45.597728+0000","last_clean":"2023-10-08T16:25:45.597728+0000","last_became_active":"2023-10-08T16:25:45.595822+0000","last_became_peered":"2023-10-08T16:25:45.595822+0000","last_unstale":"2023-10-08T16:25:45.597728+0000","last_undegraded":"2023-10-08T16:25:45.597728+0000","last_fullsized":"2023-10-08T16:25:45.597728+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586244+0000","last_change":"2023-10-08T16:25:45.584050+0000","last_active":"2023-10-08T16:25:45.586244+0000","last_peered":"2023-10-08T16:25:45.586244+0000","last_clean":"2023-10-08T16:25:45.586244+0000","last_became_active":"2023-10-08T16:25:45.583718+0000","last_became_peered":"2023-10-08T16:25:45.583718+0000","last_unstale":"2023-10-08T16:25:45.586244+0000","last_undegraded":"2023-10-08T16:25:45.586244+0000","last_fullsized":"2023-10-08T16:25:45.586244+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594763+0000","last_change":"2023-10-08T16:25:45.592638+0000","last_active":"2023-10-08T16:25:45.594763+0000","last_peered":"2023-10-08T16:25:45.594763+0000","last_clean":"2023-10-08T16:25:45.594763+0000","last_became_active":"2023-10-08T16:25:45.592348+0000","last_became_peered":"2023-10-08T16:25:45.592348+0000","last_unstale":"2023-10-08T16:25:45.594763+0000","last_undegraded":"2023-10-08T16:25:45.594763+0000","last_fullsized":"2023-10-08T16:25:45.594763+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:27:23.555131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582866+0000","last_change":"2023-10-08T16:25:45.575307+0000","last_active":"2023-10-08T16:25:45.582866+0000","last_peered":"2023-10-08T16:25:45.582866+0000","last_clean":"2023-10-08T16:25:45.582866+0000","last_became_active":"2023-10-08T16:25:45.575019+0000","last_became_peered":"2023-10-08T16:25:45.575019+0000","last_unstale":"2023-10-08T16:25:45.582866+0000","last_undegraded":"2023-10-08T16:25:45.582866+0000","last_fullsized":"2023-10-08T16:25:45.582866+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.590887+0000","last_change":"2023-10-08T16:25:45.589882+0000","last_active":"2023-10-08T16:25:45.590887+0000","last_peered":"2023-10-08T16:25:45.590887+0000","last_clean":"2023-10-08T16:25:45.590887+0000","last_became_active":"2023-10-08T16:25:45.589606+0000","last_became_peered":"2023-10-08T16:25:45.589606+0000","last_unstale":"2023-10-08T16:25:45.590887+0000","last_undegraded":"2023-10-08T16:25:45.590887+0000","last_fullsized":"2023-10-08T16:25:45.590887+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:21.301510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587365+0000","last_change":"2023-10-08T16:25:45.583907+0000","last_active":"2023-10-08T16:25:45.587365+0000","last_peered":"2023-10-08T16:25:45.587365+0000","last_clean":"2023-10-08T16:25:45.587365+0000","last_became_active":"2023-10-08T16:25:45.583647+0000","last_became_peered":"2023-10-08T16:25:45.583647+0000","last_unstale":"2023-10-08T16:25:45.587365+0000","last_undegraded":"2023-10-08T16:25:45.587365+0000","last_fullsized":"2023-10-08T16:25:45.587365+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:56.385484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595167+0000","last_change":"2023-10-08T16:25:45.593464+0000","last_active":"2023-10-08T16:25:45.595167+0000","last_peered":"2023-10-08T16:25:45.595167+0000","last_clean":"2023-10-08T16:25:45.595167+0000","last_became_active":"2023-10-08T16:25:45.593263+0000","last_became_peered":"2023-10-08T16:25:45.593263+0000","last_unstale":"2023-10-08T16:25:45.595167+0000","last_undegraded":"2023-10-08T16:25:45.595167+0000","last_fullsized":"2023-10-08T16:25:45.595167+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:55:16.396889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591914+0000","last_change":"2023-10-08T16:25:45.589152+0000","last_active":"2023-10-08T16:25:45.591914+0000","last_peered":"2023-10-08T16:25:45.591914+0000","last_clean":"2023-10-08T16:25:45.591914+0000","last_became_active":"2023-10-08T16:25:45.588818+0000","last_became_peered":"2023-10-08T16:25:45.588818+0000","last_unstale":"2023-10-08T16:25:45.591914+0000","last_undegraded":"2023-10-08T16:25:45.591914+0000","last_fullsized":"2023-10-08T16:25:45.591914+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:10.711535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584058+0000","last_change":"2023-10-08T16:25:45.580427+0000","last_active":"2023-10-08T16:25:45.584058+0000","last_peered":"2023-10-08T16:25:45.584058+0000","last_clean":"2023-10-08T16:25:45.584058+0000","last_became_active":"2023-10-08T16:25:45.579809+0000","last_became_peered":"2023-10-08T16:25:45.579809+0000","last_unstale":"2023-10-08T16:25:45.584058+0000","last_undegraded":"2023-10-08T16:25:45.584058+0000","last_fullsized":"2023-10-08T16:25:45.584058+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:26.309987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594714+0000","last_change":"2023-10-08T16:25:45.591447+0000","last_active":"2023-10-08T16:25:45.594714+0000","last_peered":"2023-10-08T16:25:45.594714+0000","last_clean":"2023-10-08T16:25:45.594714+0000","last_became_active":"2023-10-08T16:25:45.590913+0000","last_became_peered":"2023-10-08T16:25:45.590913+0000","last_unstale":"2023-10-08T16:25:45.594714+0000","last_undegraded":"2023-10-08T16:25:45.594714+0000","last_fullsized":"2023-10-08T16:25:45.594714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:28.456125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600258+0000","last_change":"2023-10-08T16:25:45.591542+0000","last_active":"2023-10-08T16:25:45.600258+0000","last_peered":"2023-10-08T16:25:45.600258+0000","last_clean":"2023-10-08T16:25:45.600258+0000","last_became_active":"2023-10-08T16:25:45.591281+0000","last_became_peered":"2023-10-08T16:25:45.591281+0000","last_unstale":"2023-10-08T16:25:45.600258+0000","last_undegraded":"2023-10-08T16:25:45.600258+0000","last_fullsized":"2023-10-08T16:25:45.600258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:19:08.337943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595849+0000","last_change":"2023-10-08T16:25:45.589521+0000","last_active":"2023-10-08T16:25:45.595849+0000","last_peered":"2023-10-08T16:25:45.595849+0000","last_clean":"2023-10-08T16:25:45.595849+0000","last_became_active":"2023-10-08T16:25:45.589068+0000","last_became_peered":"2023-10-08T16:25:45.589068+0000","last_unstale":"2023-10-08T16:25:45.595849+0000","last_undegraded":"2023-10-08T16:25:45.595849+0000","last_fullsized":"2023-10-08T16:25:45.595849+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583057+0000","last_change":"2023-10-08T16:25:45.580064+0000","last_active":"2023-10-08T16:25:45.583057+0000","last_peered":"2023-10-08T16:25:45.583057+0000","last_clean":"2023-10-08T16:25:45.583057+0000","last_became_active":"2023-10-08T16:25:45.579798+0000","last_became_peered":"2023-10-08T16:25:45.579798+0000","last_unstale":"2023-10-08T16:25:45.583057+0000","last_undegraded":"2023-10-08T16:25:45.583057+0000","last_fullsized":"2023-10-08T16:25:45.583057+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600201+0000","last_change":"2023-10-08T16:25:45.595131+0000","last_active":"2023-10-08T16:25:45.600201+0000","last_peered":"2023-10-08T16:25:45.600201+0000","last_clean":"2023-10-08T16:25:45.600201+0000","last_became_active":"2023-10-08T16:25:45.594345+0000","last_became_peered":"2023-10-08T16:25:45.594345+0000","last_unstale":"2023-10-08T16:25:45.600201+0000","last_undegraded":"2023-10-08T16:25:45.600201+0000","last_fullsized":"2023-10-08T16:25:45.600201+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:30.920035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594976+0000","last_change":"2023-10-08T16:25:45.592565+0000","last_active":"2023-10-08T16:25:45.594976+0000","last_peered":"2023-10-08T16:25:45.594976+0000","last_clean":"2023-10-08T16:25:45.594976+0000","last_became_active":"2023-10-08T16:25:45.592242+0000","last_became_peered":"2023-10-08T16:25:45.592242+0000","last_unstale":"2023-10-08T16:25:45.594976+0000","last_undegraded":"2023-10-08T16:25:45.594976+0000","last_fullsized":"2023-10-08T16:25:45.594976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:09:29.168629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588610+0000","last_change":"2023-10-08T16:25:45.586741+0000","last_active":"2023-10-08T16:25:45.588610+0000","last_peered":"2023-10-08T16:25:45.588610+0000","last_clean":"2023-10-08T16:25:45.588610+0000","last_became_active":"2023-10-08T16:25:45.585990+0000","last_became_peered":"2023-10-08T16:25:45.585990+0000","last_unstale":"2023-10-08T16:25:45.588610+0000","last_undegraded":"2023-10-08T16:25:45.588610+0000","last_fullsized":"2023-10-08T16:25:45.588610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596393+0000","last_change":"2023-10-08T16:25:45.589945+0000","last_active":"2023-10-08T16:25:45.596393+0000","last_peered":"2023-10-08T16:25:45.596393+0000","last_clean":"2023-10-08T16:25:45.596393+0000","last_became_active":"2023-10-08T16:25:45.589161+0000","last_became_peered":"2023-10-08T16:25:45.589161+0000","last_unstale":"2023-10-08T16:25:45.596393+0000","last_undegraded":"2023-10-08T16:25:45.596393+0000","last_fullsized":"2023-10-08T16:25:45.596393+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:56:50.185229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585512+0000","last_change":"2023-10-08T16:25:45.576917+0000","last_active":"2023-10-08T16:25:45.585512+0000","last_peered":"2023-10-08T16:25:45.585512+0000","last_clean":"2023-10-08T16:25:45.585512+0000","last_became_active":"2023-10-08T16:25:45.576667+0000","last_became_peered":"2023-10-08T16:25:45.576667+0000","last_unstale":"2023-10-08T16:25:45.585512+0000","last_undegraded":"2023-10-08T16:25:45.585512+0000","last_fullsized":"2023-10-08T16:25:45.585512+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:10:01.278875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591660+0000","last_change":"2023-10-08T16:25:45.583307+0000","last_active":"2023-10-08T16:25:45.591660+0000","last_peered":"2023-10-08T16:25:45.591660+0000","last_clean":"2023-10-08T16:25:45.591660+0000","last_became_active":"2023-10-08T16:25:45.583039+0000","last_became_peered":"2023-10-08T16:25:45.583039+0000","last_unstale":"2023-10-08T16:25:45.591660+0000","last_undegraded":"2023-10-08T16:25:45.591660+0000","last_fullsized":"2023-10-08T16:25:45.591660+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:59.341347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585526+0000","last_change":"2023-10-08T16:25:45.582116+0000","last_active":"2023-10-08T16:25:45.585526+0000","last_peered":"2023-10-08T16:25:45.585526+0000","last_clean":"2023-10-08T16:25:45.585526+0000","last_became_active":"2023-10-08T16:25:45.581794+0000","last_became_peered":"2023-10-08T16:25:45.581794+0000","last_unstale":"2023-10-08T16:25:45.585526+0000","last_undegraded":"2023-10-08T16:25:45.585526+0000","last_fullsized":"2023-10-08T16:25:45.585526+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:11.192046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597544+0000","last_change":"2023-10-08T16:25:45.593632+0000","last_active":"2023-10-08T16:25:45.597544+0000","last_peered":"2023-10-08T16:25:45.597544+0000","last_clean":"2023-10-08T16:25:45.597544+0000","last_became_active":"2023-10-08T16:25:45.593322+0000","last_became_peered":"2023-10-08T16:25:45.593322+0000","last_unstale":"2023-10-08T16:25:45.597544+0000","last_undegraded":"2023-10-08T16:25:45.597544+0000","last_fullsized":"2023-10-08T16:25:45.597544+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591412+0000","last_change":"2023-10-08T16:25:45.590723+0000","last_active":"2023-10-08T16:25:45.591412+0000","last_peered":"2023-10-08T16:25:45.591412+0000","last_clean":"2023-10-08T16:25:45.591412+0000","last_became_active":"2023-10-08T16:25:45.590395+0000","last_became_peered":"2023-10-08T16:25:45.590395+0000","last_unstale":"2023-10-08T16:25:45.591412+0000","last_undegraded":"2023-10-08T16:25:45.591412+0000","last_fullsized":"2023-10-08T16:25:45.591412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:13.511879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612680+0000","last_change":"2023-10-08T16:25:44.563060+0000","last_active":"2023-10-08T16:25:45.612680+0000","last_peered":"2023-10-08T16:25:45.612680+0000","last_clean":"2023-10-08T16:25:45.612680+0000","last_became_active":"2023-10-08T16:25:44.562784+0000","last_became_peered":"2023-10-08T16:25:44.562784+0000","last_unstale":"2023-10-08T16:25:45.612680+0000","last_undegraded":"2023-10-08T16:25:45.612680+0000","last_fullsized":"2023-10-08T16:25:45.612680+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:45.980150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.595644+0000","last_change":"2023-10-08T16:25:45.589637+0000","last_active":"2023-10-08T16:25:45.595644+0000","last_peered":"2023-10-08T16:25:45.595644+0000","last_clean":"2023-10-08T16:25:45.595644+0000","last_became_active":"2023-10-08T16:25:45.589100+0000","last_became_peered":"2023-10-08T16:25:45.589100+0000","last_unstale":"2023-10-08T16:25:45.595644+0000","last_undegraded":"2023-10-08T16:25:45.595644+0000","last_fullsized":"2023-10-08T16:25:45.595644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:02.301066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603596+0000","last_change":"2023-10-08T16:25:44.553709+0000","last_active":"2023-10-08T16:25:45.603596+0000","last_peered":"2023-10-08T16:25:45.603596+0000","last_clean":"2023-10-08T16:25:45.603596+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.603596+0000","last_undegraded":"2023-10-08T16:25:45.603596+0000","last_fullsized":"2023-10-08T16:25:45.603596+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:41.810278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597615+0000","last_change":"2023-10-08T16:25:45.593290+0000","last_active":"2023-10-08T16:25:45.597615+0000","last_peered":"2023-10-08T16:25:45.597615+0000","last_clean":"2023-10-08T16:25:45.597615+0000","last_became_active":"2023-10-08T16:25:45.593001+0000","last_became_peered":"2023-10-08T16:25:45.593001+0000","last_unstale":"2023-10-08T16:25:45.597615+0000","last_undegraded":"2023-10-08T16:25:45.597615+0000","last_fullsized":"2023-10-08T16:25:45.597615+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:02.002411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612499+0000","last_change":"2023-10-08T16:25:44.552656+0000","last_active":"2023-10-08T16:25:45.612499+0000","last_peered":"2023-10-08T16:25:45.612499+0000","last_clean":"2023-10-08T16:25:45.612499+0000","last_became_active":"2023-10-08T16:25:44.552389+0000","last_became_peered":"2023-10-08T16:25:44.552389+0000","last_unstale":"2023-10-08T16:25:45.612499+0000","last_undegraded":"2023-10-08T16:25:45.612499+0000","last_fullsized":"2023-10-08T16:25:45.612499+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:01:42.769179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584922+0000","last_change":"2023-10-08T16:25:45.580198+0000","last_active":"2023-10-08T16:25:45.584922+0000","last_peered":"2023-10-08T16:25:45.584922+0000","last_clean":"2023-10-08T16:25:45.584922+0000","last_became_active":"2023-10-08T16:25:45.579926+0000","last_became_peered":"2023-10-08T16:25:45.579926+0000","last_unstale":"2023-10-08T16:25:45.584922+0000","last_undegraded":"2023-10-08T16:25:45.584922+0000","last_fullsized":"2023-10-08T16:25:45.584922+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:13.493376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.611804+0000","last_change":"2023-10-08T16:25:44.551156+0000","last_active":"2023-10-08T16:25:45.611804+0000","last_peered":"2023-10-08T16:25:45.611804+0000","last_clean":"2023-10-08T16:25:45.611804+0000","last_became_active":"2023-10-08T16:25:44.550865+0000","last_became_peered":"2023-10-08T16:25:44.550865+0000","last_unstale":"2023-10-08T16:25:45.611804+0000","last_undegraded":"2023-10-08T16:25:45.611804+0000","last_fullsized":"2023-10-08T16:25:45.611804+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:54.104951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.591640+0000","last_change":"2023-10-08T16:25:45.582599+0000","last_active":"2023-10-08T16:25:45.591640+0000","last_peered":"2023-10-08T16:25:45.591640+0000","last_clean":"2023-10-08T16:25:45.591640+0000","last_became_active":"2023-10-08T16:25:45.582327+0000","last_became_peered":"2023-10-08T16:25:45.582327+0000","last_unstale":"2023-10-08T16:25:45.591640+0000","last_undegraded":"2023-10-08T16:25:45.591640+0000","last_fullsized":"2023-10-08T16:25:45.591640+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:37:53.896274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604343+0000","last_change":"2023-10-08T16:25:44.559604+0000","last_active":"2023-10-08T16:25:45.604343+0000","last_peered":"2023-10-08T16:25:45.604343+0000","last_clean":"2023-10-08T16:25:45.604343+0000","last_became_active":"2023-10-08T16:25:44.559311+0000","last_became_peered":"2023-10-08T16:25:44.559311+0000","last_unstale":"2023-10-08T16:25:45.604343+0000","last_undegraded":"2023-10-08T16:25:45.604343+0000","last_fullsized":"2023-10-08T16:25:45.604343+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:00.588117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585683+0000","last_change":"2023-10-08T16:25:45.582286+0000","last_active":"2023-10-08T16:25:45.585683+0000","last_peered":"2023-10-08T16:25:45.585683+0000","last_clean":"2023-10-08T16:25:45.585683+0000","last_became_active":"2023-10-08T16:25:45.581936+0000","last_became_peered":"2023-10-08T16:25:45.581936+0000","last_unstale":"2023-10-08T16:25:45.585683+0000","last_undegraded":"2023-10-08T16:25:45.585683+0000","last_fullsized":"2023-10-08T16:25:45.585683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603788+0000","last_change":"2023-10-08T16:25:44.551223+0000","last_active":"2023-10-08T16:25:45.603788+0000","last_peered":"2023-10-08T16:25:45.603788+0000","last_clean":"2023-10-08T16:25:45.603788+0000","last_became_active":"2023-10-08T16:25:44.550256+0000","last_became_peered":"2023-10-08T16:25:44.550256+0000","last_unstale":"2023-10-08T16:25:45.603788+0000","last_undegraded":"2023-10-08T16:25:45.603788+0000","last_fullsized":"2023-10-08T16:25:45.603788+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586389+0000","last_change":"2023-10-08T16:25:45.584883+0000","last_active":"2023-10-08T16:25:45.586389+0000","last_peered":"2023-10-08T16:25:45.586389+0000","last_clean":"2023-10-08T16:25:45.586389+0000","last_became_active":"2023-10-08T16:25:45.584561+0000","last_became_peered":"2023-10-08T16:25:45.584561+0000","last_unstale":"2023-10-08T16:25:45.586389+0000","last_undegraded":"2023-10-08T16:25:45.586389+0000","last_fullsized":"2023-10-08T16:25:45.586389+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:53:20.870804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.569466+0000","last_change":"2023-10-08T16:25:44.559468+0000","last_active":"2023-10-08T16:25:45.569466+0000","last_peered":"2023-10-08T16:25:45.569466+0000","last_clean":"2023-10-08T16:25:45.569466+0000","last_became_active":"2023-10-08T16:25:44.559209+0000","last_became_peered":"2023-10-08T16:25:44.559209+0000","last_unstale":"2023-10-08T16:25:45.569466+0000","last_undegraded":"2023-10-08T16:25:45.569466+0000","last_fullsized":"2023-10-08T16:25:45.569466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:00.993977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577542+0000","last_change":"2023-10-08T16:25:45.574917+0000","last_active":"2023-10-08T16:25:45.577542+0000","last_peered":"2023-10-08T16:25:45.577542+0000","last_clean":"2023-10-08T16:25:45.577542+0000","last_became_active":"2023-10-08T16:25:45.574470+0000","last_became_peered":"2023-10-08T16:25:45.574470+0000","last_unstale":"2023-10-08T16:25:45.577542+0000","last_undegraded":"2023-10-08T16:25:45.577542+0000","last_fullsized":"2023-10-08T16:25:45.577542+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:08.243160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571192+0000","last_change":"2023-10-08T16:25:44.563896+0000","last_active":"2023-10-08T16:25:45.571192+0000","last_peered":"2023-10-08T16:25:45.571192+0000","last_clean":"2023-10-08T16:25:45.571192+0000","last_became_active":"2023-10-08T16:25:44.563641+0000","last_became_peered":"2023-10-08T16:25:44.563641+0000","last_unstale":"2023-10-08T16:25:45.571192+0000","last_undegraded":"2023-10-08T16:25:45.571192+0000","last_fullsized":"2023-10-08T16:25:45.571192+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:50.684591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.582821+0000","last_change":"2023-10-08T16:25:45.577068+0000","last_active":"2023-10-08T16:25:45.582821+0000","last_peered":"2023-10-08T16:25:45.582821+0000","last_clean":"2023-10-08T16:25:45.582821+0000","last_became_active":"2023-10-08T16:25:45.576772+0000","last_became_peered":"2023-10-08T16:25:45.576772+0000","last_unstale":"2023-10-08T16:25:45.582821+0000","last_undegraded":"2023-10-08T16:25:45.582821+0000","last_fullsized":"2023-10-08T16:25:45.582821+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:40.150617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.581357+0000","last_change":"2023-10-08T16:25:44.563195+0000","last_active":"2023-10-08T16:25:45.581357+0000","last_peered":"2023-10-08T16:25:45.581357+0000","last_clean":"2023-10-08T16:25:45.581357+0000","last_became_active":"2023-10-08T16:25:44.562921+0000","last_became_peered":"2023-10-08T16:25:44.562921+0000","last_unstale":"2023-10-08T16:25:45.581357+0000","last_undegraded":"2023-10-08T16:25:45.581357+0000","last_fullsized":"2023-10-08T16:25:45.581357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585199+0000","last_change":"2023-10-08T16:25:45.582188+0000","last_active":"2023-10-08T16:25:45.585199+0000","last_peered":"2023-10-08T16:25:45.585199+0000","last_clean":"2023-10-08T16:25:45.585199+0000","last_became_active":"2023-10-08T16:25:45.581893+0000","last_became_peered":"2023-10-08T16:25:45.581893+0000","last_unstale":"2023-10-08T16:25:45.585199+0000","last_undegraded":"2023-10-08T16:25:45.585199+0000","last_fullsized":"2023-10-08T16:25:45.585199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:04.337220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.577393+0000","last_change":"2023-10-08T16:25:44.560229+0000","last_active":"2023-10-08T16:25:45.577393+0000","last_peered":"2023-10-08T16:25:45.577393+0000","last_clean":"2023-10-08T16:25:45.577393+0000","last_became_active":"2023-10-08T16:25:44.559921+0000","last_became_peered":"2023-10-08T16:25:44.559921+0000","last_unstale":"2023-10-08T16:25:45.577393+0000","last_undegraded":"2023-10-08T16:25:45.577393+0000","last_fullsized":"2023-10-08T16:25:45.577393+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:13:12.410069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594494+0000","last_change":"2023-10-08T16:25:45.589991+0000","last_active":"2023-10-08T16:25:45.594494+0000","last_peered":"2023-10-08T16:25:45.594494+0000","last_clean":"2023-10-08T16:25:45.594494+0000","last_became_active":"2023-10-08T16:25:45.589565+0000","last_became_peered":"2023-10-08T16:25:45.589565+0000","last_unstale":"2023-10-08T16:25:45.594494+0000","last_undegraded":"2023-10-08T16:25:45.594494+0000","last_fullsized":"2023-10-08T16:25:45.594494+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:09.593952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606205+0000","last_change":"2023-10-08T16:25:44.563895+0000","last_active":"2023-10-08T16:25:45.606205+0000","last_peered":"2023-10-08T16:25:45.606205+0000","last_clean":"2023-10-08T16:25:45.606205+0000","last_became_active":"2023-10-08T16:25:44.563652+0000","last_became_peered":"2023-10-08T16:25:44.563652+0000","last_unstale":"2023-10-08T16:25:45.606205+0000","last_undegraded":"2023-10-08T16:25:45.606205+0000","last_fullsized":"2023-10-08T16:25:45.606205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:42:04.242293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588572+0000","last_change":"2023-10-08T16:25:45.586201+0000","last_active":"2023-10-08T16:25:45.588572+0000","last_peered":"2023-10-08T16:25:45.588572+0000","last_clean":"2023-10-08T16:25:45.588572+0000","last_became_active":"2023-10-08T16:25:45.585617+0000","last_became_peered":"2023-10-08T16:25:45.585617+0000","last_unstale":"2023-10-08T16:25:45.588572+0000","last_undegraded":"2023-10-08T16:25:45.588572+0000","last_fullsized":"2023-10-08T16:25:45.588572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:52.832630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.606194+0000","last_change":"2023-10-08T16:25:44.545277+0000","last_active":"2023-10-08T16:25:45.606194+0000","last_peered":"2023-10-08T16:25:45.606194+0000","last_clean":"2023-10-08T16:25:45.606194+0000","last_became_active":"2023-10-08T16:25:44.544876+0000","last_became_peered":"2023-10-08T16:25:44.544876+0000","last_unstale":"2023-10-08T16:25:45.606194+0000","last_undegraded":"2023-10-08T16:25:45.606194+0000","last_fullsized":"2023-10-08T16:25:45.606194+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:15.870291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.587263+0000","last_change":"2023-10-08T16:25:45.578741+0000","last_active":"2023-10-08T16:25:45.587263+0000","last_peered":"2023-10-08T16:25:45.587263+0000","last_clean":"2023-10-08T16:25:45.587263+0000","last_became_active":"2023-10-08T16:25:45.578478+0000","last_became_peered":"2023-10-08T16:25:45.578478+0000","last_unstale":"2023-10-08T16:25:45.587263+0000","last_undegraded":"2023-10-08T16:25:45.587263+0000","last_fullsized":"2023-10-08T16:25:45.587263+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:34.644987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604552+0000","last_change":"2023-10-08T16:25:44.565264+0000","last_active":"2023-10-08T16:25:45.604552+0000","last_peered":"2023-10-08T16:25:45.604552+0000","last_clean":"2023-10-08T16:25:45.604552+0000","last_became_active":"2023-10-08T16:25:44.564967+0000","last_became_peered":"2023-10-08T16:25:44.564967+0000","last_unstale":"2023-10-08T16:25:45.604552+0000","last_undegraded":"2023-10-08T16:25:45.604552+0000","last_fullsized":"2023-10-08T16:25:45.604552+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:46.221925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586357+0000","last_change":"2023-10-08T16:25:45.585553+0000","last_active":"2023-10-08T16:25:45.586357+0000","last_peered":"2023-10-08T16:25:45.586357+0000","last_clean":"2023-10-08T16:25:45.586357+0000","last_became_active":"2023-10-08T16:25:45.585259+0000","last_became_peered":"2023-10-08T16:25:45.585259+0000","last_unstale":"2023-10-08T16:25:45.586357+0000","last_undegraded":"2023-10-08T16:25:45.586357+0000","last_fullsized":"2023-10-08T16:25:45.586357+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:09:24.637587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566733+0000","last_change":"2023-10-08T16:25:44.547629+0000","last_active":"2023-10-08T16:25:45.566733+0000","last_peered":"2023-10-08T16:25:45.566733+0000","last_clean":"2023-10-08T16:25:45.566733+0000","last_became_active":"2023-10-08T16:25:44.546718+0000","last_became_peered":"2023-10-08T16:25:44.546718+0000","last_unstale":"2023-10-08T16:25:45.566733+0000","last_undegraded":"2023-10-08T16:25:45.566733+0000","last_fullsized":"2023-10-08T16:25:45.566733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:38:17.418830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592361+0000","last_change":"2023-10-08T16:25:45.587967+0000","last_active":"2023-10-08T16:25:45.592361+0000","last_peered":"2023-10-08T16:25:45.592361+0000","last_clean":"2023-10-08T16:25:45.592361+0000","last_became_active":"2023-10-08T16:25:45.587092+0000","last_became_peered":"2023-10-08T16:25:45.587092+0000","last_unstale":"2023-10-08T16:25:45.592361+0000","last_undegraded":"2023-10-08T16:25:45.592361+0000","last_fullsized":"2023-10-08T16:25:45.592361+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:56.717915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.571878+0000","last_change":"2023-10-08T16:25:44.551921+0000","last_active":"2023-10-08T16:25:45.571878+0000","last_peered":"2023-10-08T16:25:45.571878+0000","last_clean":"2023-10-08T16:25:45.571878+0000","last_became_active":"2023-10-08T16:25:44.551651+0000","last_became_peered":"2023-10-08T16:25:44.551651+0000","last_unstale":"2023-10-08T16:25:45.571878+0000","last_undegraded":"2023-10-08T16:25:45.571878+0000","last_fullsized":"2023-10-08T16:25:45.571878+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.592213+0000","last_change":"2023-10-08T16:25:45.585139+0000","last_active":"2023-10-08T16:25:45.592213+0000","last_peered":"2023-10-08T16:25:45.592213+0000","last_clean":"2023-10-08T16:25:45.592213+0000","last_became_active":"2023-10-08T16:25:45.584865+0000","last_became_peered":"2023-10-08T16:25:45.584865+0000","last_unstale":"2023-10-08T16:25:45.592213+0000","last_undegraded":"2023-10-08T16:25:45.592213+0000","last_fullsized":"2023-10-08T16:25:45.592213+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:18:39.963917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.600692+0000","last_change":"2023-10-08T16:25:44.552061+0000","last_active":"2023-10-08T16:25:45.600692+0000","last_peered":"2023-10-08T16:25:45.600692+0000","last_clean":"2023-10-08T16:25:45.600692+0000","last_became_active":"2023-10-08T16:25:44.551299+0000","last_became_peered":"2023-10-08T16:25:44.551299+0000","last_unstale":"2023-10-08T16:25:45.600692+0000","last_undegraded":"2023-10-08T16:25:45.600692+0000","last_fullsized":"2023-10-08T16:25:45.600692+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:38.632959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585852+0000","last_change":"2023-10-08T16:25:45.582615+0000","last_active":"2023-10-08T16:25:45.585852+0000","last_peered":"2023-10-08T16:25:45.585852+0000","last_clean":"2023-10-08T16:25:45.585852+0000","last_became_active":"2023-10-08T16:25:45.582274+0000","last_became_peered":"2023-10-08T16:25:45.582274+0000","last_unstale":"2023-10-08T16:25:45.585852+0000","last_undegraded":"2023-10-08T16:25:45.585852+0000","last_fullsized":"2023-10-08T16:25:45.585852+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:44.964129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603931+0000","last_change":"2023-10-08T16:25:44.560913+0000","last_active":"2023-10-08T16:25:45.603931+0000","last_peered":"2023-10-08T16:25:45.603931+0000","last_clean":"2023-10-08T16:25:45.603931+0000","last_became_active":"2023-10-08T16:25:44.560638+0000","last_became_peered":"2023-10-08T16:25:44.560638+0000","last_unstale":"2023-10-08T16:25:45.603931+0000","last_undegraded":"2023-10-08T16:25:45.603931+0000","last_fullsized":"2023-10-08T16:25:45.603931+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:41:47.167394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597572+0000","last_change":"2023-10-08T16:25:45.594278+0000","last_active":"2023-10-08T16:25:45.597572+0000","last_peered":"2023-10-08T16:25:45.597572+0000","last_clean":"2023-10-08T16:25:45.597572+0000","last_became_active":"2023-10-08T16:25:45.593991+0000","last_became_peered":"2023-10-08T16:25:45.593991+0000","last_unstale":"2023-10-08T16:25:45.597572+0000","last_undegraded":"2023-10-08T16:25:45.597572+0000","last_fullsized":"2023-10-08T16:25:45.597572+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:26:52.532205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.599335+0000","last_change":"2023-10-08T16:25:44.557054+0000","last_active":"2023-10-08T16:25:45.599335+0000","last_peered":"2023-10-08T16:25:45.599335+0000","last_clean":"2023-10-08T16:25:45.599335+0000","last_became_active":"2023-10-08T16:25:44.556775+0000","last_became_peered":"2023-10-08T16:25:44.556775+0000","last_unstale":"2023-10-08T16:25:45.599335+0000","last_undegraded":"2023-10-08T16:25:45.599335+0000","last_fullsized":"2023-10-08T16:25:45.599335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:12.503445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586297+0000","last_change":"2023-10-08T16:25:45.578887+0000","last_active":"2023-10-08T16:25:45.586297+0000","last_peered":"2023-10-08T16:25:45.586297+0000","last_clean":"2023-10-08T16:25:45.586297+0000","last_became_active":"2023-10-08T16:25:45.578598+0000","last_became_peered":"2023-10-08T16:25:45.578598+0000","last_unstale":"2023-10-08T16:25:45.586297+0000","last_undegraded":"2023-10-08T16:25:45.586297+0000","last_fullsized":"2023-10-08T16:25:45.586297+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:55.113386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574205+0000","last_change":"2023-10-08T16:25:44.556557+0000","last_active":"2023-10-08T16:25:45.574205+0000","last_peered":"2023-10-08T16:25:45.574205+0000","last_clean":"2023-10-08T16:25:45.574205+0000","last_became_active":"2023-10-08T16:25:44.556239+0000","last_became_peered":"2023-10-08T16:25:44.556239+0000","last_unstale":"2023-10-08T16:25:45.574205+0000","last_undegraded":"2023-10-08T16:25:45.574205+0000","last_fullsized":"2023-10-08T16:25:45.574205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:51.824195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594745+0000","last_change":"2023-10-08T16:25:45.592514+0000","last_active":"2023-10-08T16:25:45.594745+0000","last_peered":"2023-10-08T16:25:45.594745+0000","last_clean":"2023-10-08T16:25:45.594745+0000","last_became_active":"2023-10-08T16:25:45.592232+0000","last_became_peered":"2023-10-08T16:25:45.592232+0000","last_unstale":"2023-10-08T16:25:45.594745+0000","last_undegraded":"2023-10-08T16:25:45.594745+0000","last_fullsized":"2023-10-08T16:25:45.594745+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:04.774330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.612375+0000","last_change":"2023-10-08T16:25:44.550134+0000","last_active":"2023-10-08T16:25:45.612375+0000","last_peered":"2023-10-08T16:25:45.612375+0000","last_clean":"2023-10-08T16:25:45.612375+0000","last_became_active":"2023-10-08T16:25:44.549837+0000","last_became_peered":"2023-10-08T16:25:44.549837+0000","last_unstale":"2023-10-08T16:25:45.612375+0000","last_undegraded":"2023-10-08T16:25:45.612375+0000","last_fullsized":"2023-10-08T16:25:45.612375+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:03.826716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583645+0000","last_change":"2023-10-08T16:25:45.581026+0000","last_active":"2023-10-08T16:25:45.583645+0000","last_peered":"2023-10-08T16:25:45.583645+0000","last_clean":"2023-10-08T16:25:45.583645+0000","last_became_active":"2023-10-08T16:25:45.580746+0000","last_became_peered":"2023-10-08T16:25:45.580746+0000","last_unstale":"2023-10-08T16:25:45.583645+0000","last_undegraded":"2023-10-08T16:25:45.583645+0000","last_fullsized":"2023-10-08T16:25:45.583645+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:15:48.378741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.570156+0000","last_change":"2023-10-08T16:25:44.557614+0000","last_active":"2023-10-08T16:25:45.570156+0000","last_peered":"2023-10-08T16:25:45.570156+0000","last_clean":"2023-10-08T16:25:45.570156+0000","last_became_active":"2023-10-08T16:25:44.557338+0000","last_became_peered":"2023-10-08T16:25:44.557338+0000","last_unstale":"2023-10-08T16:25:45.570156+0000","last_undegraded":"2023-10-08T16:25:45.570156+0000","last_fullsized":"2023-10-08T16:25:45.570156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:12.452184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584093+0000","last_change":"2023-10-08T16:25:45.581008+0000","last_active":"2023-10-08T16:25:45.584093+0000","last_peered":"2023-10-08T16:25:45.584093+0000","last_clean":"2023-10-08T16:25:45.584093+0000","last_became_active":"2023-10-08T16:25:45.580751+0000","last_became_peered":"2023-10-08T16:25:45.580751+0000","last_unstale":"2023-10-08T16:25:45.584093+0000","last_undegraded":"2023-10-08T16:25:45.584093+0000","last_fullsized":"2023-10-08T16:25:45.584093+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:53:48.310155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575487+0000","last_change":"2023-10-08T16:25:44.560692+0000","last_active":"2023-10-08T16:25:45.575487+0000","last_peered":"2023-10-08T16:25:45.575487+0000","last_clean":"2023-10-08T16:25:45.575487+0000","last_became_active":"2023-10-08T16:25:44.560446+0000","last_became_peered":"2023-10-08T16:25:44.560446+0000","last_unstale":"2023-10-08T16:25:45.575487+0000","last_undegraded":"2023-10-08T16:25:45.575487+0000","last_fullsized":"2023-10-08T16:25:45.575487+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:43.729263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.584981+0000","last_change":"2023-10-08T16:25:45.581050+0000","last_active":"2023-10-08T16:25:45.584981+0000","last_peered":"2023-10-08T16:25:45.584981+0000","last_clean":"2023-10-08T16:25:45.584981+0000","last_became_active":"2023-10-08T16:25:45.580673+0000","last_became_peered":"2023-10-08T16:25:45.580673+0000","last_unstale":"2023-10-08T16:25:45.584981+0000","last_undegraded":"2023-10-08T16:25:45.584981+0000","last_fullsized":"2023-10-08T16:25:45.584981+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:43.471121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.566601+0000","last_change":"2023-10-08T16:25:44.550131+0000","last_active":"2023-10-08T16:25:45.566601+0000","last_peered":"2023-10-08T16:25:45.566601+0000","last_clean":"2023-10-08T16:25:45.566601+0000","last_became_active":"2023-10-08T16:25:44.549815+0000","last_became_peered":"2023-10-08T16:25:44.549815+0000","last_unstale":"2023-10-08T16:25:45.566601+0000","last_undegraded":"2023-10-08T16:25:45.566601+0000","last_fullsized":"2023-10-08T16:25:45.566601+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:05.527633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588928+0000","last_change":"2023-10-08T16:25:45.587793+0000","last_active":"2023-10-08T16:25:45.588928+0000","last_peered":"2023-10-08T16:25:45.588928+0000","last_clean":"2023-10-08T16:25:45.588928+0000","last_became_active":"2023-10-08T16:25:45.587349+0000","last_became_peered":"2023-10-08T16:25:45.587349+0000","last_unstale":"2023-10-08T16:25:45.588928+0000","last_undegraded":"2023-10-08T16:25:45.588928+0000","last_fullsized":"2023-10-08T16:25:45.588928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.603898+0000","last_change":"2023-10-08T16:25:44.551814+0000","last_active":"2023-10-08T16:25:45.603898+0000","last_peered":"2023-10-08T16:25:45.603898+0000","last_clean":"2023-10-08T16:25:45.603898+0000","last_became_active":"2023-10-08T16:25:44.551552+0000","last_became_peered":"2023-10-08T16:25:44.551552+0000","last_unstale":"2023-10-08T16:25:45.603898+0000","last_undegraded":"2023-10-08T16:25:45.603898+0000","last_fullsized":"2023-10-08T16:25:45.603898+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:19:21.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.596231+0000","last_change":"2023-10-08T16:25:45.593817+0000","last_active":"2023-10-08T16:25:45.596231+0000","last_peered":"2023-10-08T16:25:45.596231+0000","last_clean":"2023-10-08T16:25:45.596231+0000","last_became_active":"2023-10-08T16:25:45.593456+0000","last_became_peered":"2023-10-08T16:25:45.593456+0000","last_unstale":"2023-10-08T16:25:45.596231+0000","last_undegraded":"2023-10-08T16:25:45.596231+0000","last_fullsized":"2023-10-08T16:25:45.596231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:21.934469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"113'1","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-10-08T16:25:46.664487+0000","last_change":"2023-10-08T16:25:44.566555+0000","last_active":"2023-10-08T16:25:46.664487+0000","last_peered":"2023-10-08T16:25:46.664487+0000","last_clean":"2023-10-08T16:25:46.664487+0000","last_became_active":"2023-10-08T16:25:44.564889+0000","last_became_peered":"2023-10-08T16:25:44.564889+0000","last_unstale":"2023-10-08T16:25:46.664487+0000","last_undegraded":"2023-10-08T16:25:46.664487+0000","last_fullsized":"2023-10-08T16:25:46.664487+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:02:21.570754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.597683+0000","last_change":"2023-10-08T16:25:45.594888+0000","last_active":"2023-10-08T16:25:45.597683+0000","last_peered":"2023-10-08T16:25:45.597683+0000","last_clean":"2023-10-08T16:25:45.597683+0000","last_became_active":"2023-10-08T16:25:45.594595+0000","last_became_peered":"2023-10-08T16:25:45.594595+0000","last_unstale":"2023-10-08T16:25:45.597683+0000","last_undegraded":"2023-10-08T16:25:45.597683+0000","last_fullsized":"2023-10-08T16:25:45.597683+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:41.649755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574484+0000","last_change":"2023-10-08T16:25:44.555840+0000","last_active":"2023-10-08T16:25:45.574484+0000","last_peered":"2023-10-08T16:25:45.574484+0000","last_clean":"2023-10-08T16:25:45.574484+0000","last_became_active":"2023-10-08T16:25:44.555556+0000","last_became_peered":"2023-10-08T16:25:44.555556+0000","last_unstale":"2023-10-08T16:25:45.574484+0000","last_undegraded":"2023-10-08T16:25:45.574484+0000","last_fullsized":"2023-10-08T16:25:45.574484+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:31:19.721147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.588591+0000","last_change":"2023-10-08T16:25:45.586274+0000","last_active":"2023-10-08T16:25:45.588591+0000","last_peered":"2023-10-08T16:25:45.588591+0000","last_clean":"2023-10-08T16:25:45.588591+0000","last_became_active":"2023-10-08T16:25:45.585917+0000","last_became_peered":"2023-10-08T16:25:45.585917+0000","last_unstale":"2023-10-08T16:25:45.588591+0000","last_undegraded":"2023-10-08T16:25:45.588591+0000","last_fullsized":"2023-10-08T16:25:45.588591+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:20:28.140378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.578717+0000","last_change":"2023-10-08T16:25:44.562104+0000","last_active":"2023-10-08T16:25:45.578717+0000","last_peered":"2023-10-08T16:25:45.578717+0000","last_clean":"2023-10-08T16:25:45.578717+0000","last_became_active":"2023-10-08T16:25:44.561808+0000","last_became_peered":"2023-10-08T16:25:44.561808+0000","last_unstale":"2023-10-08T16:25:45.578717+0000","last_undegraded":"2023-10-08T16:25:45.578717+0000","last_fullsized":"2023-10-08T16:25:45.578717+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:19:09.926631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.583878+0000","last_change":"2023-10-08T16:25:45.580482+0000","last_active":"2023-10-08T16:25:45.583878+0000","last_peered":"2023-10-08T16:25:45.583878+0000","last_clean":"2023-10-08T16:25:45.583878+0000","last_became_active":"2023-10-08T16:25:45.580140+0000","last_became_peered":"2023-10-08T16:25:45.580140+0000","last_unstale":"2023-10-08T16:25:45.583878+0000","last_undegraded":"2023-10-08T16:25:45.583878+0000","last_fullsized":"2023-10-08T16:25:45.583878+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:59:00.561871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572348+0000","last_change":"2023-10-08T16:25:44.551669+0000","last_active":"2023-10-08T16:25:45.572348+0000","last_peered":"2023-10-08T16:25:45.572348+0000","last_clean":"2023-10-08T16:25:45.572348+0000","last_became_active":"2023-10-08T16:25:44.551423+0000","last_became_peered":"2023-10-08T16:25:44.551423+0000","last_unstale":"2023-10-08T16:25:45.572348+0000","last_undegraded":"2023-10-08T16:25:45.572348+0000","last_fullsized":"2023-10-08T16:25:45.572348+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:40.641320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.585854+0000","last_change":"2023-10-08T16:25:45.582864+0000","last_active":"2023-10-08T16:25:45.585854+0000","last_peered":"2023-10-08T16:25:45.585854+0000","last_clean":"2023-10-08T16:25:45.585854+0000","last_became_active":"2023-10-08T16:25:45.582578+0000","last_became_peered":"2023-10-08T16:25:45.582578+0000","last_unstale":"2023-10-08T16:25:45.585854+0000","last_undegraded":"2023-10-08T16:25:45.585854+0000","last_fullsized":"2023-10-08T16:25:45.585854+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:41.323085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572632+0000","last_change":"2023-10-08T16:25:44.550959+0000","last_active":"2023-10-08T16:25:45.572632+0000","last_peered":"2023-10-08T16:25:45.572632+0000","last_clean":"2023-10-08T16:25:45.572632+0000","last_became_active":"2023-10-08T16:25:44.550527+0000","last_became_peered":"2023-10-08T16:25:44.550527+0000","last_unstale":"2023-10-08T16:25:45.572632+0000","last_undegraded":"2023-10-08T16:25:45.572632+0000","last_fullsized":"2023-10-08T16:25:45.572632+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:30:04.052676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.594986+0000","last_change":"2023-10-08T16:25:45.592717+0000","last_active":"2023-10-08T16:25:45.594986+0000","last_peered":"2023-10-08T16:25:45.594986+0000","last_clean":"2023-10-08T16:25:45.594986+0000","last_became_active":"2023-10-08T16:25:45.592338+0000","last_became_peered":"2023-10-08T16:25:45.592338+0000","last_unstale":"2023-10-08T16:25:45.594986+0000","last_undegraded":"2023-10-08T16:25:45.594986+0000","last_fullsized":"2023-10-08T16:25:45.594986+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:08:04.835151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.575648+0000","last_change":"2023-10-08T16:25:44.562414+0000","last_active":"2023-10-08T16:25:45.575648+0000","last_peered":"2023-10-08T16:25:45.575648+0000","last_clean":"2023-10-08T16:25:45.575648+0000","last_became_active":"2023-10-08T16:25:44.562080+0000","last_became_peered":"2023-10-08T16:25:44.562080+0000","last_unstale":"2023-10-08T16:25:45.575648+0000","last_undegraded":"2023-10-08T16:25:45.575648+0000","last_fullsized":"2023-10-08T16:25:45.575648+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.598116+0000","last_change":"2023-10-08T16:25:45.595024+0000","last_active":"2023-10-08T16:25:45.598116+0000","last_peered":"2023-10-08T16:25:45.598116+0000","last_clean":"2023-10-08T16:25:45.598116+0000","last_became_active":"2023-10-08T16:25:45.594664+0000","last_became_peered":"2023-10-08T16:25:45.594664+0000","last_unstale":"2023-10-08T16:25:45.598116+0000","last_undegraded":"2023-10-08T16:25:45.598116+0000","last_fullsized":"2023-10-08T16:25:45.598116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:31:04.017138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.572038+0000","last_change":"2023-10-08T16:25:44.557142+0000","last_active":"2023-10-08T16:25:45.572038+0000","last_peered":"2023-10-08T16:25:45.572038+0000","last_clean":"2023-10-08T16:25:45.572038+0000","last_became_active":"2023-10-08T16:25:44.556876+0000","last_became_peered":"2023-10-08T16:25:44.556876+0000","last_unstale":"2023-10-08T16:25:45.572038+0000","last_undegraded":"2023-10-08T16:25:45.572038+0000","last_fullsized":"2023-10-08T16:25:45.572038+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:05:15.255484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.586322+0000","last_change":"2023-10-08T16:25:45.583813+0000","last_active":"2023-10-08T16:25:45.586322+0000","last_peered":"2023-10-08T16:25:45.586322+0000","last_clean":"2023-10-08T16:25:45.586322+0000","last_became_active":"2023-10-08T16:25:45.583329+0000","last_became_peered":"2023-10-08T16:25:45.583329+0000","last_unstale":"2023-10-08T16:25:45.586322+0000","last_undegraded":"2023-10-08T16:25:45.586322+0000","last_fullsized":"2023-10-08T16:25:45.586322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:44.534785+0000","last_clean_scrub_stamp":"2023-10-08T16:25:44.534785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:59:44.737697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.604424+0000","last_change":"2023-10-08T16:25:44.556287+0000","last_active":"2023-10-08T16:25:45.604424+0000","last_peered":"2023-10-08T16:25:45.604424+0000","last_clean":"2023-10-08T16:25:45.604424+0000","last_became_active":"2023-10-08T16:25:44.555458+0000","last_became_peered":"2023-10-08T16:25:44.555458+0000","last_unstale":"2023-10-08T16:25:45.604424+0000","last_undegraded":"2023-10-08T16:25:45.604424+0000","last_fullsized":"2023-10-08T16:25:45.604424+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:25:43.526350+0000","last_clean_scrub_stamp":"2023-10-08T16:25:43.526350+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:49:08.585517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"102'205","reported_seq":559,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-08T16:25:45.574866+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:25:45.574866+0000","last_peered":"2023-10-08T16:25:45.574866+0000","last_clean":"2023-10-08T16:25:45.574866+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:25:45.574866+0000","last_undegraded":"2023-10-08T16:25:45.574866+0000","last_fullsized":"2023-10-08T16:25:45.574866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307420,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064420,"statfs":{"total":96636764160,"available":96321966080,"internally_reserved":0,"allocated":1986560,"data_stored":1266908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.68000000000000005,"15min":0.71999999999999997},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.81499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.68000000000000005,"15min":0.71199999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.875,"5min":0.94599999999999995,"15min":0.99199999999999999},"last":0.77200000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91000000000000003,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.755,"15min":0.78100000000000003},"min":{"1min":0.54300000000000004,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.042},"last":0.71099999999999997}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.69399999999999995,"15min":0.72599999999999998},"min":{"1min":0.499,"5min":0.48799999999999999,"15min":0.46100000000000002},"max":{"1min":0.81499999999999995,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72899999999999998,"15min":0.73899999999999999},"min":{"1min":0.53600000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.89700000000000002,"5min":1.0189999999999999,"15min":1.05},"last":0.65800000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.70799999999999996,"15min":0.73399999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.89500000000000002,"5min":0.95199999999999996,"15min":1.002},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.755,"15min":0.78300000000000003},"min":{"1min":0.51700000000000002,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.98299999999999998,"5min":1.0389999999999999,"15min":5.5590000000000002},"last":0.74099999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65600000000000003,"15min":0.64000000000000001},"min":{"1min":0.443,"5min":0.40699999999999997,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.57499999999999996,"5min":0.439,"15min":0.437},"max":{"1min":0.93700000000000006,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.95899999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.72999999999999998,"15min":0.70099999999999996},"min":{"1min":0.54900000000000004,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.073,"5min":1.351,"15min":1.351},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.54800000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.022,"5min":1.0940000000000001,"15min":1.4319999999999999},"last":0.90800000000000003}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79100000000000004,"15min":0.77500000000000002},"min":{"1min":0.59399999999999997,"5min":0.55800000000000005,"15min":0.46100000000000002},"max":{"1min":1.085,"5min":1.173,"15min":1.173},"last":0.871},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77300000000000002,"15min":0.749},"min":{"1min":0.627,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":1.0589999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.98399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575045,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":677136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.66200000000000003,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.96399999999999997,"15min":1.0860000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.68300000000000005,"15min":0.71499999999999997},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.375},"max":{"1min":0.84299999999999997,"5min":1.0569999999999999,"15min":1.0600000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66000000000000003,"15min":0.69799999999999995},"min":{"1min":0.45500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.82799999999999996,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.70599999999999996,"15min":0.73099999999999998},"min":{"1min":0.44900000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.78400000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.72899999999999998,"15min":0.76800000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.88900000000000001,"5min":1.071,"15min":1.081},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.745,"15min":0.77600000000000002},"min":{"1min":0.57799999999999996,"5min":0.53800000000000003,"15min":0.499},"max":{"1min":0.87,"5min":1.034,"15min":1.0800000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72099999999999997,"15min":0.75700000000000001},"min":{"1min":0.48999999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.96799999999999997,"5min":1.0149999999999999,"15min":1.069},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.75700000000000001,"15min":0.77100000000000002},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.125},"last":0.85299999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.437,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.749,"15min":0.749},"min":{"1min":0.61199999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.96799999999999997,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.438,"15min":0.41499999999999998},"max":{"1min":0.83999999999999997,"5min":1.272,"15min":1.272},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":1.0449999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Sun Oct 8 16:25:42 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72999999999999998,"15min":0.72899999999999998},"min":{"1min":0.497,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":1.012,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72699999999999998,"15min":0.73799999999999999},"min":{"1min":0.51500000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0680000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.753}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302752,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069088,"statfs":{"total":96636764160,"available":96326746112,"internally_reserved":0,"allocated":1400832,"data_stored":676664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.42199999999999999,"15min":0.44600000000000001},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72199999999999998,"5min":0.75600000000000001,"15min":0.873},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.46899999999999997,"15min":0.48999999999999999},"min":{"1min":0.33900000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.61099999999999999,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.33400000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48499999999999999,"15min":0.48599999999999999},"min":{"1min":0.29499999999999998,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.71999999999999997,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.375},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55100000000000005,"15min":0.57599999999999996},"min":{"1min":0.41399999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"max":{"1min":0.751,"5min":0.89100000000000001,"15min":0.91200000000000003},"last":0.47199999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78000000000000003,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.38200000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77100000000000002,"5min":0.82099999999999995,"15min":0.95199999999999996},"last":0.44500000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.60499999999999998,"5min":0.51300000000000001,"15min":0.45500000000000002},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.77700000000000002,"15min":0.79000000000000004},"min":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96899999999999997,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.54900000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":2.379,"5min":2.379,"15min":2.379},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.78200000000000003,"15min":0.79800000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.45800000000000002},"max":{"1min":1.01,"5min":1.0660000000000001,"15min":1.224},"last":0.69999999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78500000000000003,"15min":0.80600000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.92300000000000004,"5min":1.0780000000000001,"15min":1.206},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.89900000000000002,"5min":1.101,"15min":1.2909999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.79900000000000004,"15min":0.81999999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.002,"5min":1.0249999999999999,"15min":1.1839999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.56999999999999995},"max":{"1min":2.5870000000000002,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.71999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299228,"kb_used_data":1940,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072612,"statfs":{"total":96636764160,"available":96330354688,"internally_reserved":0,"allocated":1986560,"data_stored":1266872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.49099999999999999,"15min":0.49299999999999999},"min":{"1min":0.28999999999999998,"5min":0.27700000000000002,"15min":0.26200000000000001},"max":{"1min":0.89400000000000002,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.434}]},{"osd":2,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.32000000000000001},"max":{"1min":0.94799999999999995,"5min":1.093,"15min":1.093},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.5,"15min":0.52200000000000002},"min":{"1min":0.36399999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.376}]},{"osd":3,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.32900000000000001,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71199999999999997,"5min":0.878,"15min":0.878},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.629},"min":{"1min":0.47699999999999998,"5min":0.45200000000000001,"15min":0.42899999999999999},"max":{"1min":0.98799999999999999,"5min":1.21,"15min":1.21},"last":0.45300000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.74199999999999999,"15min":0.76400000000000001},"min":{"1min":0.48299999999999998,"5min":0.40600000000000003,"15min":0.40300000000000002},"max":{"1min":1.0009999999999999,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.76900000000000002,"15min":0.79100000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.46400000000000002},"max":{"1min":1.0589999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.79300000000000004},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":1.0740000000000001,"5min":1.083,"15min":1.1439999999999999},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76200000000000001,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0509999999999999,"5min":1.0720000000000001,"15min":1.2330000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.77500000000000002,"15min":0.80600000000000005},"min":{"1min":0.58299999999999996,"5min":0.54800000000000004,"15min":0.52900000000000003},"max":{"1min":1.0600000000000001,"5min":1.157,"15min":1.1950000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.79000000000000004,"15min":0.81200000000000006},"min":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.51600000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.212},"last":0.71199999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:25:46 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.78900000000000003,"15min":0.82299999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":1.0680000000000001,"5min":1.1140000000000001,"15min":1.1579999999999999},"last":0.748},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.501},"max":{"1min":1.157,"5min":1.163,"15min":1.202},"last":0.83799999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575045,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306840,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065000,"statfs":{"total":96636764160,"available":96322560000,"internally_reserved":0,"allocated":1392640,"data_stored":677024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.66600000000000004,"5min":0.96599999999999997,"15min":1.046},"last":0.378},{"interface":"front","average":{"1min":0.496,"5min":0.53100000000000003,"15min":0.56399999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.64000000000000001,"5min":1.01,"15min":1.01},"last":0.48899999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48699999999999999,"15min":0.52200000000000002},"min":{"1min":0.35199999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67100000000000004,"5min":0.75800000000000001,"15min":1.1519999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.76600000000000001,"5min":0.88900000000000001,"15min":0.94399999999999995},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51500000000000001,"15min":0.53200000000000003},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.99299999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.60199999999999998,"15min":0.63500000000000001},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.77100000000000002,"5min":0.83199999999999996,"15min":1.1160000000000001},"last":0.505}]},{"osd":4,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.72699999999999998,"15min":0.77900000000000003},"min":{"1min":0.53600000000000003,"5min":0.434,"15min":0.434},"max":{"1min":0.93200000000000005,"5min":1.0069999999999999,"15min":1.4790000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73599999999999999,"15min":0.77300000000000002},"min":{"1min":0.52900000000000003,"5min":0.495,"15min":0.495},"max":{"1min":0.96599999999999997,"5min":1.056,"15min":1.2909999999999999},"last":0.77500000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.78700000000000003,"15min":0.83499999999999996},"min":{"1min":0.60999999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.02,"5min":1.026,"15min":1.4990000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.77200000000000002,"15min":0.81100000000000005},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.997,"5min":1.0669999999999999,"15min":1.3},"last":0.876}]},{"osd":6,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.73099999999999998,"15min":0.77800000000000002},"min":{"1min":0.48399999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98599999999999999,"5min":1.0109999999999999,"15min":1.321},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.754,"15min":0.81299999999999994},"min":{"1min":0.52700000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94199999999999995,"5min":1.036,"15min":1.5149999999999999},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Oct 8 16:25:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.78900000000000003,"15min":0.84499999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.0980000000000001,"15min":1.734},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.85199999999999998},"min":{"1min":0.55600000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0049999999999999,"5min":1.103,"15min":1.655},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575045,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306848,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064992,"statfs":{"total":96636764160,"available":96322551808,"internally_reserved":0,"allocated":1400832,"data_stored":678006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.439,"15min":0.45600000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.59099999999999997,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.51400000000000001,"15min":0.51900000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.54100000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47899999999999998,"15min":0.47699999999999998},"min":{"1min":0.315,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.53500000000000003,"15min":0.54700000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.70699999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.58999999999999997,"15min":0.60599999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38500000000000001},"max":{"1min":0.76000000000000001,"5min":0.89800000000000002,"15min":0.95699999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63900000000000001,"15min":0.65200000000000002},"min":{"1min":0.46800000000000003,"5min":0.42699999999999999,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":1,"15min":1},"last":0.52700000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71299999999999997,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72799999999999998,"15min":0.76400000000000001},"min":{"1min":0.54100000000000004,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.95399999999999996,"5min":1.0760000000000001,"15min":1.3600000000000001},"last":0.77900000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.753,"15min":0.78100000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0329999999999999,"5min":1.1319999999999999,"15min":1.2110000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.755,"15min":0.78000000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.96199999999999997,"5min":1.093,"15min":1.3200000000000001},"last":0.89200000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.80400000000000005,"15min":0.81599999999999995},"min":{"1min":0.48399999999999999,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":1.032},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.83499999999999996},"min":{"1min":0.56299999999999994,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.0249999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:25:40 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.81399999999999995,"15min":0.84499999999999997},"min":{"1min":0.58799999999999997,"5min":0.57899999999999996,"15min":0.55600000000000005},"max":{"1min":1.204,"5min":1.204,"15min":1.23},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82099999999999995,"15min":0.83899999999999997},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.96199999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575045,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298644,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073196,"statfs":{"total":96636764160,"available":96330952704,"internally_reserved":0,"allocated":1388544,"data_stored":676470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.69499999999999995,"15min":0.70799999999999996},"min":{"1min":0.41699999999999998,"5min":0.40799999999999997,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.72799999999999998,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.86799999999999999,"5min":1.02,"15min":1.02},"last":0.749}]},{"osd":1,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.72599999999999998,"15min":0.74099999999999999},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84499999999999997,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":0.73399999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.379},"max":{"1min":0.878,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.747,"15min":0.74199999999999999},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.89400000000000002,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73299999999999998,"15min":0.748},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.96499999999999997,"5min":1.085,"15min":1.1060000000000001},"last":0.84899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":1.0469999999999999,"5min":1.056,"15min":1.1339999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.629,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88400000000000001,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.86599999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.41399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.47,"15min":1.47},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.69799999999999995,"15min":0.68100000000000005},"min":{"1min":0.5,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.93400000000000005,"5min":1.0289999999999999,"15min":1.0589999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.79200000000000004,"5min":2.661,"15min":2.661},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.754,"15min":0.72799999999999998},"min":{"1min":0.51400000000000001,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":0.94299999999999995,"5min":1.611,"15min":1.611},"last":0.78300000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:25:36 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.76500000000000001},"min":{"1min":0.54800000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.99299999999999999,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.75,"15min":0.73299999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.90600000000000003,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.90600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575044,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310948,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060892,"statfs":{"total":96636764160,"available":96318353408,"internally_reserved":0,"allocated":1404928,"data_stored":678028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.40699999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.96099999999999997,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.71099999999999997,"15min":0.73099999999999998},"min":{"1min":0.33500000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0129999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.63100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.72599999999999998,"15min":0.749},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.93300000000000005,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.623,"5min":0.70699999999999996,"15min":0.73399999999999999},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.91600000000000004,"5min":1.0309999999999999,"15min":1.05},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69999999999999996,"15min":0.73499999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92000000000000004,"5min":0.97599999999999998,"15min":1.0389999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.73199999999999998,"15min":0.73899999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.98099999999999998,"5min":4.931,"15min":4.931},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.081,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.753},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.75800000000000001,"15min":0.77300000000000002},"min":{"1min":0.57199999999999995,"5min":0.442,"15min":0.442},"max":{"1min":1.0129999999999999,"5min":1.96,"15min":1.96},"last":0.80900000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69499999999999995,"15min":0.63300000000000001},"min":{"1min":0.42999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70599999999999996,"15min":0.68100000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":1.0489999999999999,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.82699999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.68999999999999995},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.96499999999999997,"5min":2.024,"15min":2.024},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.76600000000000001,"15min":0.71799999999999997},"min":{"1min":0.55100000000000005,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Oct 8 16:25:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.76700000000000002,"15min":0.751},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.105,"5min":2.157,"15min":2.157},"last":0.877},{"interface":"front","average":{"1min":0.751,"5min":0.78000000000000003,"15min":0.77600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.0129999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.72399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:25:55.548 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:25:55.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:25:55.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.772+0000 7f155f19d700 1 Processor -- start 2023-10-08T16:25:55.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.772+0000 7f155f19d700 1 -- start start 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155f19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15580ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155f19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1558159920 0x7f15580ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155f19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580acc00 con 0x7f155815dfd0 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155f19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15580abff0 con 0x7f1558159920 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155f19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15580ac2d0 con 0x7f1558159550 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155d99a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f155815dfd0 0x7f15580aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52312/0 (socket says 172.21.15.12:52312) 2023-10-08T16:25:55.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155d99a700 1 -- 172.21.15.12:0/1359888866 learned_addr learned my addr 172.21.15.12:0/1359888866 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.773+0000 7f155e99c700 1 --2- 172.21.15.12:0/1359888866 >> v2:172.21.15.12:3300/0 conn(0x7f1558159920 0x7f15580ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e19b700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15580ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155d199700 1 -- 172.21.15.12:0/1359888866 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567701030 0 0) 0x7f15580acc00 con 0x7f155815dfd0 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155d199700 1 -- 172.21.15.12:0/1359888866 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003570 con 0x7f155815dfd0 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e99c700 1 -- 172.21.15.12:0/1359888866 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 msgr2=0x7f15580ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e99c700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15580ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e99c700 1 -- 172.21.15.12:0/1359888866 >> v1:172.21.15.12:6789/0 conn(0x7f155815dfd0 legacy=0x7f15580aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e99c700 1 -- 172.21.15.12:0/1359888866 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15580ac5b0 con 0x7f1558159920 2023-10-08T16:25:55.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.774+0000 7f155e99c700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1558159920 0x7f15580ad090 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f1550009e60 tx=0x7f1550009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f140c299e1fbd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155d199700 1 -- 172.21.15.12:0/1359888866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155000e070 con 0x7f1558159920 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155d199700 1 -- 172.21.15.12:0/1359888866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155000bab0 con 0x7f1558159920 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155d199700 1 -- 172.21.15.12:0/1359888866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f155000be70 con 0x7f1558159920 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 -- 172.21.15.12:0/1359888866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1558159920 msgr2=0x7f15580ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1558159920 0x7f15580ad090 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f1550009e60 tx=0x7f1550009780 comp rx=0 tx=0).stop 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 -- 172.21.15.12:0/1359888866 shutdown_connections 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1558159920 0x7f15580ad090 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 --2- 172.21.15.12:0/1359888866 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15580ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 -- 172.21.15.12:0/1359888866 >> 172.21.15.12:0/1359888866 conn(0x7f155806ce80 msgr2=0x7f15580ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 -- 172.21.15.12:0/1359888866 shutdown_connections 2023-10-08T16:25:55.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.775+0000 7f155f19d700 1 -- 172.21.15.12:0/1359888866 wait complete. 2023-10-08T16:25:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.777+0000 7f155f19d700 1 Processor -- start 2023-10-08T16:25:55.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.777+0000 7f155f19d700 1 -- start start 2023-10-08T16:25:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15581551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1558159920 0x7f1558150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558155910 con 0x7f155815dfd0 2023-10-08T16:25:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581513a0 con 0x7f1558159920 2023-10-08T16:25:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155f19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1558169cd0 con 0x7f1558159550 2023-10-08T16:25:55.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37374/0 (socket says 172.21.15.12:37374) 2023-10-08T16:25:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 -- 172.21.15.12:0/3026424090 learned_addr learned my addr 172.21.15.12:0/3026424090 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:55.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155d99a700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1558159920 0x7f1558150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e19b700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15581551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 -- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 msgr2=0x7f15581551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15581551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 -- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1558159920 msgr2=0x7f1558150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1558159920 0x7f1558150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.778+0000 7f155e99c700 1 -- 172.21.15.12:0/3026424090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1550009a20 con 0x7f155815dfd0 2023-10-08T16:25:55.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f155e99c700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f155000b610 tx=0x7f1550019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1550027470 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15500275f0 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15500279b0 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155816aaf0 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.779+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155816e1d0 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.780+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15580cf000 con 0x7f155815dfd0 2023-10-08T16:25:55.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.781+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1550024070 con 0x7f155815dfd0 2023-10-08T16:25:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.782+0000 7f154e7fc700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 0x7f153c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.782+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f1550086f10 con 0x7f155815dfd0 2023-10-08T16:25:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.782+0000 7f155e19b700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 0x7f153c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:55.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.783+0000 7f155e19b700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 0x7f153c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1554009ca0 tx=0x7f1554008040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:55.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:55.786+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1550053f50 con 0x7f155815dfd0 2023-10-08T16:25:56.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.066+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f155816e1d0 con 0x7f155815dfd0 2023-10-08T16:25:56.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.071+0000 7f154e7fc700 1 -- 172.21.15.12:0/3026424090 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f155816e1d0 con 0x7f155815dfd0 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 msgr2=0x7f153c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 0x7f153c0693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1554009ca0 tx=0x7f1554008040 comp rx=0 tx=0).stop 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 msgr2=0x7f155816dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f155000b610 tx=0x7f1550019000 comp rx=0 tx=0).stop 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 shutdown_connections 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f153c066f30 0x7f153c0693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f155815dfd0 0x7f155816dc90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1558159550 0x7f15581551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 --2- 172.21.15.12:0/3026424090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1558159920 0x7f1558150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 >> 172.21.15.12:0/3026424090 conn(0x7f155806ce80 msgr2=0x7f15580681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 shutdown_connections 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.073+0000 7f155f19d700 1 -- 172.21.15.12:0/3026424090 wait complete. 2023-10-08T16:25:56.075 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:25:56.092 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:25:56.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.279+0000 7f96fef9d700 1 Processor -- start 2023-10-08T16:25:56.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.279+0000 7f96fef9d700 1 -- start start 2023-10-08T16:25:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fef9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96f813fb20 0x7f96f815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fef9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f96f806aaa0 0x7f96f80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fef9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96f815ae70 con 0x7f96f813fef0 2023-10-08T16:25:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fef9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f806af60 con 0x7f96f813fb20 2023-10-08T16:25:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fef9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96f806b240 con 0x7f96f806aaa0 2023-10-08T16:25:56.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fdf9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96f813fb20 0x7f96f815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fdf9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f96f813fb20 0x7f96f815a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37390/0 (socket says 172.21.15.12:37390) 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.280+0000 7f96fdf9b700 1 -- 172.21.15.12:0/2708663042 learned_addr learned my addr 172.21.15.12:0/2708663042 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fe79c700 1 --2- 172.21.15.12:0/2708663042 >> v2:172.21.15.29:3300/0 conn(0x7f96f806aaa0 0x7f96f80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fdf9b700 1 -- 172.21.15.12:0/2708663042 >> v2:172.21.15.29:3300/0 conn(0x7f96f806aaa0 msgr2=0x7f96f80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fdf9b700 1 --2- 172.21.15.12:0/2708663042 >> v2:172.21.15.29:3300/0 conn(0x7f96f806aaa0 0x7f96f80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fdf9b700 1 -- 172.21.15.12:0/2708663042 >> v1:172.21.15.29:6789/0 conn(0x7f96f813fef0 legacy=0x7f96f80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fdf9b700 1 -- 172.21.15.12:0/2708663042 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f806b520 con 0x7f96f813fb20 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fdf9b700 1 --2- 172.21.15.12:0/2708663042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f813fb20 0x7f96f815a930 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f96f8069d40 tx=0x7f96f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6bc57e5d3a44a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fcf99700 1 -- 172.21.15.12:0/2708663042 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400b860 con 0x7f96f813fb20 2023-10-08T16:25:56.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fcf99700 1 -- 172.21.15.12:0/2708663042 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f400b9c0 con 0x7f96f813fb20 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.281+0000 7f96fcf99700 1 -- 172.21.15.12:0/2708663042 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f400bd60 con 0x7f96f813fb20 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 -- 172.21.15.12:0/2708663042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f813fb20 msgr2=0x7f96f815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 --2- 172.21.15.12:0/2708663042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f813fb20 0x7f96f815a930 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f96f8069d40 tx=0x7f96f4009250 comp rx=0 tx=0).stop 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 -- 172.21.15.12:0/2708663042 shutdown_connections 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 --2- 172.21.15.12:0/2708663042 >> v2:172.21.15.29:3300/0 conn(0x7f96f806aaa0 0x7f96f80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 --2- 172.21.15.12:0/2708663042 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f813fb20 0x7f96f815a930 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 -- 172.21.15.12:0/2708663042 >> 172.21.15.12:0/2708663042 conn(0x7f96f806d170 msgr2=0x7f96f80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:56.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 -- 172.21.15.12:0/2708663042 shutdown_connections 2023-10-08T16:25:56.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.282+0000 7f96fef9d700 1 -- 172.21.15.12:0/2708663042 wait complete. 2023-10-08T16:25:56.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.284+0000 7f96fef9d700 1 Processor -- start 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.284+0000 7f96fef9d700 1 -- start start 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 0x7f96f8157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96f813fef0 0x7f96f8153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f816aaa0 con 0x7f96f806aaa0 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8169ff0 con 0x7f96f813fef0 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96f8157bb0 con 0x7f96f813fb20 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37406/0 (socket says 172.21.15.12:37406) 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 -- 172.21.15.12:0/4258427471 learned_addr learned my addr 172.21.15.12:0/4258427471 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fe79c700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96f813fef0 0x7f96f8153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fd79a700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 0x7f96f8157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 -- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 msgr2=0x7f96f8157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 0x7f96f8157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 -- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96f813fef0 msgr2=0x7f96f8153a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96f813fef0 0x7f96f8153a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fdf9b700 1 -- 172.21.15.12:0/4258427471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96f40094f0 con 0x7f96f806aaa0 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.285+0000 7f96fd79a700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 0x7f96f8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96fdf9b700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f96f8071320 tx=0x7f96f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:56.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f401a420 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f401a5c0 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f401a980 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96f816a4e0 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.286+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96f816adb0 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.287+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96f804c3c0 con 0x7f96f806aaa0 2023-10-08T16:25:56.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.288+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96f401ad30 con 0x7f96f806aaa0 2023-10-08T16:25:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.289+0000 7f96edffb700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:56.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.289+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f96f4086300 con 0x7f96f806aaa0 2023-10-08T16:25:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.289+0000 7f96fd79a700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:56.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.290+0000 7f96fd79a700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96f80cd200 tx=0x7f96e8009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:56.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.294+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96f4053340 con 0x7f96f806aaa0 2023-10-08T16:25:56.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.541+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96f806b800 con 0x7f96f806aaa0 2023-10-08T16:25:56.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.542+0000 7f96edffb700 1 -- 172.21.15.12:0/4258427471 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f96f4056960 con 0x7f96f806aaa0 2023-10-08T16:25:56.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:25:56.543 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 msgr2=0x7f96dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 0x7f96dc0693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96f80cd200 tx=0x7f96e8009040 comp rx=0 tx=0).stop 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 msgr2=0x7f96f8169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f96f8071320 tx=0x7f96f4017000 comp rx=0 tx=0).stop 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 shutdown_connections 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f96dc066f30 0x7f96dc0693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f96f806aaa0 0x7f96f8169ab0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f96f813fef0 0x7f96f8153a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 --2- 172.21.15.12:0/4258427471 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f96f813fb20 0x7f96f8157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 >> 172.21.15.12:0/4258427471 conn(0x7f96f806d170 msgr2=0x7f96f8155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 shutdown_connections 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:56.544+0000 7f96fef9d700 1 -- 172.21.15.12:0/4258427471 wait complete. 2023-10-08T16:25:56.546 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:25:56.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:25:45.041023+0000', 'modified': '2023-10-08T16:25:48.586927+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7251': {'gid': 7251, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/1691195997', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6833', 'nonce': 1691195997}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 1691195997}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:25:56.965 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:25:56.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T16:25:57.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.158+0000 7f8599f9d700 1 Processor -- start 2023-10-08T16:25:57.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.159+0000 7f8599f9d700 1 -- start start 2023-10-08T16:25:57.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8599f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85940cf110 0x7f8594164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8599f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859415afd0 con 0x7f859415de50 2023-10-08T16:25:57.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8599f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859415b2b0 con 0x7f8594153c30 2023-10-08T16:25:57.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8599f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859415b590 con 0x7f85940cf110 2023-10-08T16:25:57.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8593fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f859415de50 0x7f85940cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52324/0 (socket says 172.21.15.12:52324) 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f8593fff700 1 -- 172.21.15.12:0/3817128500 learned_addr learned my addr 172.21.15.12:0/3817128500 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.160+0000 7f859979c700 1 --2- 172.21.15.12:0/3817128500 >> v2:172.21.15.29:3300/0 conn(0x7f85940cf110 0x7f8594164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515969759 0 0) 0x7f859415afd0 con 0x7f859415de50 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8584003570 con 0x7f859415de50 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145798611 0 0) 0x7f859415b2b0 con 0x7f8594153c30 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859415afd0 con 0x7f8594153c30 2023-10-08T16:25:57.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f859979c700 1 -- 172.21.15.12:0/3817128500 >> v1:172.21.15.29:6789/0 conn(0x7f8594153c30 legacy=0x7f859415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f859979c700 1 -- 172.21.15.12:0/3817128500 >> v1:172.21.15.12:6789/0 conn(0x7f859415de50 legacy=0x7f85940cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f859979c700 1 -- 172.21.15.12:0/3817128500 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859415b870 con 0x7f85940cf110 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f859979c700 1 --2- 172.21.15.12:0/3817128500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85940cf110 0x7f8594164600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f858c009e60 tx=0x7f858c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97747e106431492b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.161+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00e070 con 0x7f85940cf110 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00bab0 con 0x7f85940cf110 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f85937fe700 1 -- 172.21.15.12:0/3817128500 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00be70 con 0x7f85940cf110 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 -- 172.21.15.12:0/3817128500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85940cf110 msgr2=0x7f8594164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3817128500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85940cf110 0x7f8594164600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f858c009e60 tx=0x7f858c009780 comp rx=0 tx=0).stop 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 -- 172.21.15.12:0/3817128500 shutdown_connections 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3817128500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85940cf110 0x7f8594164600 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 -- 172.21.15.12:0/3817128500 >> 172.21.15.12:0/3817128500 conn(0x7f85940703a0 msgr2=0x7f85940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 -- 172.21.15.12:0/3817128500 shutdown_connections 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.162+0000 7f8599f9d700 1 -- 172.21.15.12:0/3817128500 wait complete. 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.164+0000 7f8599f9d700 1 Processor -- start 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.164+0000 7f8599f9d700 1 -- start start 2023-10-08T16:25:57.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85940cf110 0x7f8594169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f859415de50 0x7f85940c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940c8940 con 0x7f8594153c30 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85940b4900 con 0x7f859415de50 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8599f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85940b4be0 con 0x7f85940cf110 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37410/0 (socket says 172.21.15.12:37410) 2023-10-08T16:25:57.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8593fff700 1 -- 172.21.15.12:0/3893616860 learned_addr learned my addr 172.21.15.12:0/3893616860 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f8598f9b700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85940cf110 0x7f8594169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.165+0000 7f859979c700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f859415de50 0x7f85940c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 -- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85940cf110 msgr2=0x7f8594169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85940cf110 0x7f8594169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 -- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f859415de50 msgr2=0x7f85940c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f859415de50 0x7f85940c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 -- 172.21.15.12:0/3893616860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c009a20 con 0x7f8594153c30 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8593fff700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f858000c790 tx=0x7f8580007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8590ff9700 1 -- 172.21.15.12:0/3893616860 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580005b30 con 0x7f8594153c30 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8590ff9700 1 -- 172.21.15.12:0/3893616860 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580005c90 con 0x7f8594153c30 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8590ff9700 1 -- 172.21.15.12:0/3893616860 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580007300 con 0x7f8594153c30 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85940b4ec0 con 0x7f8594153c30 2023-10-08T16:25:57.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.166+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940c8c20 con 0x7f8594153c30 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.169+0000 7f8590ff9700 1 -- 172.21.15.12:0/3893616860 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f858001b3b0 con 0x7f8594153c30 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.169+0000 7f8590ff9700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 0x7f85780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.169+0000 7f8590ff9700 1 -- 172.21.15.12:0/3893616860 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8580083b90 con 0x7f8594153c30 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.170+0000 7f8598f9b700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 0x7f85780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.170+0000 7f8598f9b700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 0x7f85780693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8588007fd0 tx=0x7f8588007d50 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.171+0000 7f85a99b9b80 1 Processor -- start 2023-10-08T16:25:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.171+0000 7f85a99b9b80 1 -- start start 2023-10-08T16:25:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649528f4a70 con 0x56495299db80 2023-10-08T16:25:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649528f2270 con 0x5649529e8480 2023-10-08T16:25:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.172+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649528ee060 con 0x56495299b5f0 2023-10-08T16:25:57.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37416/0 (socket says 172.21.15.12:37416) 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 -- 172.21.15.12:0/3287701114 learned_addr learned my addr 172.21.15.12:0/3287701114 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 -- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 msgr2=0x5649529e8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f8598f9b700 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 -- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 msgr2=0x5649529c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 -- 172.21.15.12:0/3287701114 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564952788270 con 0x56495299db80 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f8598f9b700 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.173+0000 7f859979c700 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f858c00b610 tx=0x7f858c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1280af0532c27b13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f857dffb700 1 -- 172.21.15.12:0/3287701114 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00be80 con 0x56495299db80 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f857dffb700 1 -- 172.21.15.12:0/3287701114 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c012640 con 0x56495299db80 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f857dffb700 1 -- 172.21.15.12:0/3287701114 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c0129c0 con 0x56495299db80 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 -- 172.21.15.12:0/3287701114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 msgr2=0x56495299dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f858c00b610 tx=0x7f858c019000 comp rx=0 tx=0).stop 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 -- 172.21.15.12:0/3287701114 shutdown_connections 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299dff0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/3287701114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 -- 172.21.15.12:0/3287701114 >> 172.21.15.12:0/3287701114 conn(0x56495299f0c0 msgr2=0x56495299f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.174+0000 7f85a99b9b80 1 -- 172.21.15.12:0/3287701114 shutdown_connections 2023-10-08T16:25:57.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.175+0000 7f85a99b9b80 1 -- 172.21.15.12:0/3287701114 wait complete. 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.175+0000 7f85a99b9b80 1 -- start start 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.175+0000 7f85a99b9b80 1 Processor -- start 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299db80 0x5649529cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x564952899890 con 0x56495299b5f0 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649528b4ea0 con 0x5649529e8480 2023-10-08T16:25:57.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x564952770e30 con 0x56495299db80 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.176+0000 7f85a99b9b80 10 client.0 _ll_register_callbacks cb 0x5649529612c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37426/0 (socket says 172.21.15.12:37426) 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 -- 172.21.15.12:0/934701947 learned_addr learned my addr 172.21.15.12:0/934701947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 -- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299db80 msgr2=0x5649529cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299db80 0x5649529cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 -- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 msgr2=0x5649529cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 -- 172.21.15.12:0/934701947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859415b870 con 0x56495299b5f0 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8598f9b700 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f85880147d0 tx=0x7f8588015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7794a1ffa00863a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8572ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:25:57.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858800f620 con 0x56495299b5f0 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8588020420 con 0x56495299b5f0 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.177+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564952992cd0 con 0x56495299b5f0 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85880207f0 con 0x56495299b5f0 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 10 client.7437 fetch_fsmap learned FSMap version 49 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x56495272afe0 con 0x56495299b5f0 2023-10-08T16:25:57.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564952992cd0 con 0x56495299b5f0 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8588020950 con 0x56495299b5f0 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 10 client.7437 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 10 client.7437 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 20 client.7437 populate_metadata read hostname 'smithi012' 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x5649529c7ca0 0x5649529c8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 4 client.7437 mds_command: new command op to 7251 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:25:57.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 --> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56495296faa0 con 0x5649529c7ca0 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.178+0000 7f8593fff700 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x5649529c7ca0 0x5649529c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.179+0000 7f8572ffd700 10 client.7437 ms_handle_connect on v2:172.21.15.12:6833/1691195997 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.179+0000 7f8593fff700 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x5649529c7ca0 0x5649529c8070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b44de6f2fbb5e161 server_cookie=1cf65f627209e9e in_seq=0 out_seq=0 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f8572ffd700 1 -- 172.21.15.12:0/934701947 <== mds.0 v2:172.21.15.12:6833/1691195997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56495296faa0 con 0x5649529c7ca0 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f8572ffd700 10 client.7437 handle_command_reply: tid=0 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 client.7437 shutdown 2023-10-08T16:25:57.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 msgr2=0x5649529c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f85880147d0 tx=0x7f8588015000 comp rx=0 tx=0).stop 2023-10-08T16:25:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 shutdown_connections 2023-10-08T16:25:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x5649529c7ca0 0x5649529c8070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299b5f0 0x5649529c2030 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x5649529cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/934701947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299db80 0x5649529cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f8572ffd700 0 client.7437 ms_handle_reset on v2:172.21.15.12:6833/1691195997 2023-10-08T16:25:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 >> 172.21.15.12:0/934701947 conn(0x56495299f0c0 msgr2=0x56495299f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 shutdown_connections 2023-10-08T16:25:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 1 -- 172.21.15.12:0/934701947 wait complete. 2023-10-08T16:25:57.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.180+0000 7f85a99b9b80 20 client.7437 trim_cache size 0 max 16384 2023-10-08T16:25:57.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.198+0000 7f85a99b9b80 1 Processor -- start 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.198+0000 7f85a99b9b80 1 -- start start 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.198+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.198+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952994df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649529cafb0 con 0x56495299db80 2023-10-08T16:25:57.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56495299aba0 con 0x5649529e8480 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649529954b0 con 0x56495299b5f0 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37442/0 (socket says 172.21.15.12:37442) 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 -- 172.21.15.12:0/661530684 learned_addr learned my addr 172.21.15.12:0/661530684 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 -- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 msgr2=0x5649529e2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 -- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 msgr2=0x564952994df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952994df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 -- 172.21.15.12:0/661530684 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649528bc780 con 0x56495299db80 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.199+0000 7f8593fff700 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8580054590 tx=0x7f858000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c3d0ac16661fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f857e7fc700 1 -- 172.21.15.12:0/661530684 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580054890 con 0x56495299db80 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f857e7fc700 1 -- 172.21.15.12:0/661530684 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580005e00 con 0x56495299db80 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f857e7fc700 1 -- 172.21.15.12:0/661530684 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85800076f0 con 0x56495299db80 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 -- 172.21.15.12:0/661530684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 msgr2=0x56495299ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f8580054590 tx=0x7f858000c710 comp rx=0 tx=0).stop 2023-10-08T16:25:57.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 -- 172.21.15.12:0/661530684 shutdown_connections 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952994df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x5649529e2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/661530684 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x56495299ada0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 -- 172.21.15.12:0/661530684 >> 172.21.15.12:0/661530684 conn(0x56495299f0c0 msgr2=0x5649529c8610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 -- 172.21.15.12:0/661530684 shutdown_connections 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.200+0000 7f85a99b9b80 1 -- 172.21.15.12:0/661530684 wait complete. 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.201+0000 7f85a99b9b80 1 -- start start 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.201+0000 7f85a99b9b80 1 Processor -- start 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x564952a47710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952a4a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649529c2a00 con 0x56495299db80 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649529e5a00 con 0x5649529e8480 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x564952a4ad90 con 0x56495299b5f0 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f85a99b9b80 10 client.0 _ll_register_callbacks cb 0x5649529612c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f8593fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37452/0 (socket says 172.21.15.12:37452) 2023-10-08T16:25:57.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f8593fff700 1 -- 172.21.15.12:0/2870076382 learned_addr learned my addr 172.21.15.12:0/2870076382 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f8598f9b700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x564952a47710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.202+0000 7f859979c700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952a4a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 -- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 msgr2=0x564952a47710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x564952a47710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 -- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 msgr2=0x564952a4a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952a4a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 -- 172.21.15.12:0/2870076382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85940c8c20 con 0x56495299db80 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8593fff700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f85800547d0 tx=0x7f858006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63caf9b936778915 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8572ffd700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580054d00 con 0x56495299db80 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8580053d80 con 0x56495299db80 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f859415e690 con 0x56495299db80 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f858005b3a0 con 0x56495299db80 2023-10-08T16:25:57.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f85a99b9b80 10 client.7443 fetch_fsmap learned FSMap version 49 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x5649528a3470 con 0x56495299db80 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.203+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859415e690 con 0x56495299db80 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f85800074e0 con 0x56495299db80 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 10 client.7443 fetch_fsmap finished waiting for FSMap version 49 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 10 client.7443 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 20 client.7443 populate_metadata read hostname 'smithi012' 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x564952a4a650 0x5649529e3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 4 client.7443 mds_command: new command op to 7251 tid=0[{"prefix": "status"}] 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 --> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f858c012640 con 0x564952a4a650 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f8598f9b700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x564952a4a650 0x5649529e3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f8598f9b700 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x564952a4a650 0x5649529e3a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19b4de32fbfcafc3 server_cookie=75e2b15d944bdeb1 in_seq=0 out_seq=0 2023-10-08T16:25:57.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.204+0000 7f8572ffd700 10 client.7443 ms_handle_connect on v2:172.21.15.12:6833/1691195997 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f8572ffd700 1 -- 172.21.15.12:0/2870076382 <== mds.0 v2:172.21.15.12:6833/1691195997 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+321 (crc 0 0 0) 0x7f858c012640 con 0x564952a4a650 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f8572ffd700 10 client.7443 handle_command_reply: tid=0 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 client.7443 shutdown 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 msgr2=0x5649529e54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f85800547d0 tx=0x7f858006b000 comp rx=0 tx=0).stop 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 shutdown_connections 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:6833/1691195997,v1:172.21.15.12:6835/1691195997] conn(0x564952a4a650 0x5649529e3a50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x5649529e8480 0x564952a4a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56495299b5f0 0x564952a47710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f8572ffd700 0 client.7443 ms_handle_reset on v2:172.21.15.12:6833/1691195997 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 --2- 172.21.15.12:0/2870076382 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56495299db80 0x5649529e54c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 >> 172.21.15.12:0/2870076382 conn(0x56495299f0c0 msgr2=0x5649529c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 shutdown_connections 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 1 -- 172.21.15.12:0/2870076382 wait complete. 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.205+0000 7f85a99b9b80 20 client.7443 trim_cache size 0 max 16384 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:25:57.225 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 7251, 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.630560069, 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 49, 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 113, 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 113, 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.391853635 2023-10-08T16:25:57.226 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 msgr2=0x7f85780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 0x7f85780693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8588007fd0 tx=0x7f8588007d50 comp rx=0 tx=0).stop 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 msgr2=0x7f8594151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f858000c790 tx=0x7f8580007ea0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 shutdown_connections 2023-10-08T16:25:57.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8578066f30 0x7f85780693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f859415de50 0x7f85940c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f85940cf110 0x7f8594169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 --2- 172.21.15.12:0/3893616860 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8594153c30 0x7f8594151eb0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 >> 172.21.15.12:0/3893616860 conn(0x7f85940703a0 msgr2=0x7f85940ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 shutdown_connections 2023-10-08T16:25:57.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.206+0000 7f8599f9d700 1 -- 172.21.15.12:0/3893616860 wait complete. 2023-10-08T16:25:57.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:25:57.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.416+0000 7f077f39d700 1 Processor -- start 2023-10-08T16:25:57.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.417+0000 7f077f39d700 1 -- start start 2023-10-08T16:25:57.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 0x7f07780cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077f39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07780cef40 0x7f077815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077f39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077815afd0 con 0x7f0778153c30 2023-10-08T16:25:57.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077f39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f077815b2b0 con 0x7f07780cef40 2023-10-08T16:25:57.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f077815b590 con 0x7f077815de50 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077eb9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07780cef40 0x7f077815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077eb9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f07780cef40 0x7f077815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37458/0 (socket says 172.21.15.12:37458) 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077eb9c700 1 -- 172.21.15.12:0/2753313604 learned_addr learned my addr 172.21.15.12:0/2753313604 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.418+0000 7f077db9a700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 0x7f07780cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077eb9c700 1 -- 172.21.15.12:0/2753313604 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 msgr2=0x7f07780cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077eb9c700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 0x7f07780cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077eb9c700 1 -- 172.21.15.12:0/2753313604 >> v1:172.21.15.29:6789/0 conn(0x7f0778153c30 legacy=0x7f077815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077eb9c700 1 -- 172.21.15.12:0/2753313604 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f077815b870 con 0x7f07780cef40 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077db9a700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 0x7f07780cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077eb9c700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07780cef40 0x7f077815c070 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0770009f20 tx=0x7f0770009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7370f58f2c50e6fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077d399700 1 -- 172.21.15.12:0/2753313604 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f077000e070 con 0x7f07780cef40 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077d399700 1 -- 172.21.15.12:0/2753313604 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f077000ba80 con 0x7f07780cef40 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.419+0000 7f077d399700 1 -- 172.21.15.12:0/2753313604 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07700092e0 con 0x7f07780cef40 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 -- 172.21.15.12:0/2753313604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07780cef40 msgr2=0x7f077815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07780cef40 0x7f077815c070 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0770009f20 tx=0x7f0770009840 comp rx=0 tx=0).stop 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 -- 172.21.15.12:0/2753313604 shutdown_connections 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f07780cef40 0x7f077815c070 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 --2- 172.21.15.12:0/2753313604 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f077815de50 0x7f07780cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 -- 172.21.15.12:0/2753313604 >> 172.21.15.12:0/2753313604 conn(0x7f07780703a0 msgr2=0x7f07780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 -- 172.21.15.12:0/2753313604 shutdown_connections 2023-10-08T16:25:57.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.420+0000 7f077f39d700 1 -- 172.21.15.12:0/2753313604 wait complete. 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.421+0000 7f077f39d700 1 Processor -- start 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.421+0000 7f077f39d700 1 -- start start 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 0x7f07780b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 0x7f077816c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c9860 con 0x7f0778153c30 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c9b40 con 0x7f077815de50 2023-10-08T16:25:57.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.422+0000 7f077f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780c9e20 con 0x7f07780cef40 2023-10-08T16:25:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37472/0 (socket says 172.21.15.12:37472) 2023-10-08T16:25:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 -- 172.21.15.12:0/736968043 learned_addr learned my addr 172.21.15.12:0/736968043 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:57.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077e39b700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 0x7f07780b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077eb9c700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 0x7f077816c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 -- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 msgr2=0x7f07780b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 0x7f07780b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 -- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 msgr2=0x7f077816c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 0x7f077816c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 -- 172.21.15.12:0/736968043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0770009ae0 con 0x7f0778153c30 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077eb9c700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 0x7f077816c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077e39b700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 0x7f07780b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.423+0000 7f077db9a700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f076800e8d0 tx=0x7f0768008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.424+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800ee70 con 0x7f0778153c30 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.424+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076800c5e0 con 0x7f0778153c30 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.424+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076800c980 con 0x7f0778153c30 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.424+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780ca100 con 0x7f0778153c30 2023-10-08T16:25:57.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.424+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07781522a0 con 0x7f0778153c30 2023-10-08T16:25:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.425+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07781500a0 con 0x7f0778153c30 2023-10-08T16:25:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.426+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0768013410 con 0x7f0778153c30 2023-10-08T16:25:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.428+0000 7f076e7fc700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:57.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.428+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f07680845c0 con 0x7f0778153c30 2023-10-08T16:25:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.428+0000 7f077e39b700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.428+0000 7f077e39b700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 0x7f075c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0774007fd0 tx=0x7f0774009040 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:57.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.432+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07781500a0 con 0x7f0778153c30 2023-10-08T16:25:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.677+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07781500a0 con 0x7f0778153c30 2023-10-08T16:25:57.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.677+0000 7f076e7fc700 1 -- 172.21.15.12:0/736968043 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f07781500a0 con 0x7f0778153c30 2023-10-08T16:25:57.678 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.679+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 msgr2=0x7f075c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.679+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 0x7f075c0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0774007fd0 tx=0x7f0774009040 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 msgr2=0x7f0778151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f076800e8d0 tx=0x7f0768008040 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 shutdown_connections 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f075c066f30 0x7f075c0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f077815de50 0x7f077816c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f07780cef40 0x7f07780b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 --2- 172.21.15.12:0/736968043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0778153c30 0x7f0778151d60 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 >> 172.21.15.12:0/736968043 conn(0x7f07780703a0 msgr2=0x7f0778070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:57.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 shutdown_connections 2023-10-08T16:25:57.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:57.680+0000 7f077f39d700 1 -- 172.21.15.12:0/736968043 wait complete. 2023-10-08T16:25:57.698 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:25:57.699 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:57.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:57.700 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.737 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41184sec preferred_lft 41184sec 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:57.738 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.739 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:25:57.740 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:25:57.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:57.741 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:25:57.837 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:25:57.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:57.841 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:25:57.880 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:25:57.880 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:25:57.881 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:25:57.881 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:25:57.881 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:25:57.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:57.882 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:25:57.883 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:25:57.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:25:57.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:25:57.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:25:57.883 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:25:58.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:58.081 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:25:58.118 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:25:58.119 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:25:58.119 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:58.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:58.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:25:58.222 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:25:58.222 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:58.259 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:25:58.259 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:25:58.260 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:58.336 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:25:58.336 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:25:58.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:58.469 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:58.470 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:25:58.498 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:25:58.498 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:25:58.499 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:25:58.499 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:25:58.499 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:25:58.503 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:25:58.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:25:58.504 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:25:58.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:25:58.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 Processor -- start 2023-10-08T16:25:58.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 -- start start 2023-10-08T16:25:58.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 0x7f28d415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:58.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d415ae70 con 0x7f28d413fb20 2023-10-08T16:25:58.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d406af60 con 0x7f28d406aaa0 2023-10-08T16:25:58.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.756+0000 7f28da59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d406b240 con 0x7f28d413fef0 2023-10-08T16:25:58.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d959b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f28d413fb20 0x7f28d40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52326/0 (socket says 172.21.15.12:52326) 2023-10-08T16:25:58.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d959b700 1 -- 172.21.15.12:0/2883223784 learned_addr learned my addr 172.21.15.12:0/2883223784 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:58.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d8d9a700 1 --2- 172.21.15.12:0/2883223784 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 0x7f28d415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:58.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751813374 0 0) 0x7f28d0001110 con 0x7f28d413fb20 2023-10-08T16:25:58.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28c0003570 con 0x7f28d413fb20 2023-10-08T16:25:58.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213889422 0 0) 0x7f28d406af60 con 0x7f28d406aaa0 2023-10-08T16:25:58.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d0001110 con 0x7f28d406aaa0 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d8d9a700 1 -- 172.21.15.12:0/2883223784 >> v1:172.21.15.29:6789/0 conn(0x7f28d406aaa0 legacy=0x7f28d40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d8d9a700 1 -- 172.21.15.12:0/2883223784 >> v1:172.21.15.12:6789/0 conn(0x7f28d413fb20 legacy=0x7f28d40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.757+0000 7f28d8d9a700 1 -- 172.21.15.12:0/2883223784 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d406b520 con 0x7f28d413fef0 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.758+0000 7f28d8d9a700 1 --2- 172.21.15.12:0/2883223784 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 0x7f28d415a930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009900 tx=0x7f28c4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7edce2d833f02675 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.758+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4005c10 con 0x7f28d413fef0 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.758+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c4005d70 con 0x7f28d413fef0 2023-10-08T16:25:58.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.758+0000 7f28cbfff700 1 -- 172.21.15.12:0/2883223784 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c4006260 con 0x7f28d413fef0 2023-10-08T16:25:58.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 -- 172.21.15.12:0/2883223784 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 msgr2=0x7f28d415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:58.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 --2- 172.21.15.12:0/2883223784 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 0x7f28d415a930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28c4009900 tx=0x7f28c4009120 comp rx=0 tx=0).stop 2023-10-08T16:25:58.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 -- 172.21.15.12:0/2883223784 shutdown_connections 2023-10-08T16:25:58.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 --2- 172.21.15.12:0/2883223784 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fef0 0x7f28d415a930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:58.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 -- 172.21.15.12:0/2883223784 >> 172.21.15.12:0/2883223784 conn(0x7f28d406d170 msgr2=0x7f28d40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:58.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 -- 172.21.15.12:0/2883223784 shutdown_connections 2023-10-08T16:25:58.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.759+0000 7f28da59d700 1 -- 172.21.15.12:0/2883223784 wait complete. 2023-10-08T16:25:58.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.760+0000 7f28da59d700 1 Processor -- start 2023-10-08T16:25:58.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.760+0000 7f28da59d700 1 -- start start 2023-10-08T16:25:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:58.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fb20 0x7f28d41574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d413fef0 0x7f28d40b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d41674b0 con 0x7f28d406aaa0 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4158bd0 con 0x7f28d413fef0 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28da59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d4158e70 con 0x7f28d413fb20 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28d959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28d959b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37488/0 (socket says 172.21.15.12:37488) 2023-10-08T16:25:58.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.761+0000 7f28d959b700 1 -- 172.21.15.12:0/6199625 learned_addr learned my addr 172.21.15.12:0/6199625 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d9d9c700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d413fef0 0x7f28d40b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d8d9a700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fb20 0x7f28d41574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 -- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fb20 msgr2=0x7f28d41574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fb20 0x7f28d41574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 -- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d413fef0 msgr2=0x7f28d40b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d413fef0 0x7f28d40b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 -- 172.21.15.12:0/6199625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c40093c0 con 0x7f28d406aaa0 2023-10-08T16:25:58.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28d959b700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f28d00058d0 tx=0x7f28d0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0005b30 con 0x7f28d406aaa0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0005c90 con 0x7f28d406aaa0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0007300 con 0x7f28d406aaa0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.762+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4159150 con 0x7f28d406aaa0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.763+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d4159710 con 0x7f28d406aaa0 2023-10-08T16:25:58.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.764+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d404c3c0 con 0x7f28d406aaa0 2023-10-08T16:25:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.766+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28d001b400 con 0x7f28d406aaa0 2023-10-08T16:25:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.766+0000 7f28c97fa700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 0x7f28b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.766+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f28d00842d0 con 0x7f28d406aaa0 2023-10-08T16:25:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.766+0000 7f28d8d9a700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 0x7f28b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:58.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.766+0000 7f28d8d9a700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 0x7f28b80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28d4069580 tx=0x7f28c4016000 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:58.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:58.770+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d0051390 con 0x7f28d406aaa0 2023-10-08T16:25:59.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.002+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f28d41675f0 con 0x7f28b8066f30 2023-10-08T16:25:59.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.003+0000 7f28c97fa700 1 -- 172.21.15.12:0/6199625 <== mgr.7062 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f28c4000bc0 con 0x7f28b8066f30 2023-10-08T16:25:59.004 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:25:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:25:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:25:59.004 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:25:59.005 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:25:59.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 msgr2=0x7f28b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 0x7f28b80693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f28d4069580 tx=0x7f28c4016000 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 msgr2=0x7f28d413ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f28d00058d0 tx=0x7f28d0007ea0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 shutdown_connections 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f28b8066f30 0x7f28b80693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28d406aaa0 0x7f28d413ce00 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28d413fef0 0x7f28d40b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 --2- 172.21.15.12:0/6199625 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28d413fb20 0x7f28d41574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.005+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 >> 172.21.15.12:0/6199625 conn(0x7f28d406d170 msgr2=0x7f28d40ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.006+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 shutdown_connections 2023-10-08T16:25:59.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.006+0000 7f28da59d700 1 -- 172.21.15.12:0/6199625 wait complete. 2023-10-08T16:25:59.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:25:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.214+0000 7f3124f9d700 1 Processor -- start 2023-10-08T16:25:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.214+0000 7f3124f9d700 1 -- start start 2023-10-08T16:25:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f3124f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 0x7f312006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f3124f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312006b290 con 0x7f31200c7fb0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f3124f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312006b570 con 0x7f31200c7be0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f3124f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312006bf10 con 0x7f312013fe90 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f311effd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f31200c7fb0 0x7f312013f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52332/0 (socket says 172.21.15.12:52332) 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.215+0000 7f311effd700 1 -- 172.21.15.12:0/4269129728 learned_addr learned my addr 172.21.15.12:0/4269129728 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311ffff700 1 --2- 172.21.15.12:0/4269129728 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 0x7f312006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509044874 0 0) 0x7f312006b290 con 0x7f31200c7fb0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3108003570 con 0x7f31200c7fb0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885700167 0 0) 0x7f312006b570 con 0x7f31200c7be0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f312006b290 con 0x7f31200c7be0 2023-10-08T16:25:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 631498361 0 0) 0x7f3108003570 con 0x7f31200c7fb0 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311ffff700 1 -- 172.21.15.12:0/4269129728 >> v1:172.21.15.29:6789/0 conn(0x7f31200c7be0 legacy=0x7f312015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311ffff700 1 -- 172.21.15.12:0/4269129728 >> v1:172.21.15.12:6789/0 conn(0x7f31200c7fb0 legacy=0x7f312013f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.216+0000 7f311ffff700 1 -- 172.21.15.12:0/4269129728 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312006b850 con 0x7f312013fe90 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f311ffff700 1 --2- 172.21.15.12:0/4269129728 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 0x7f312006abd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3118009e90 tx=0x7f3118009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b5d6be93765625 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311800e070 con 0x7f312013fe90 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311800b870 con 0x7f312013fe90 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f311e7fc700 1 -- 172.21.15.12:0/4269129728 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3114001470 con 0x7f312013fe90 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f3124f9d700 1 -- 172.21.15.12:0/4269129728 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 msgr2=0x7f312006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.217+0000 7f3124f9d700 1 --2- 172.21.15.12:0/4269129728 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 0x7f312006abd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3118009e90 tx=0x7f3118009780 comp rx=0 tx=0).stop 2023-10-08T16:25:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.218+0000 7f3124f9d700 1 -- 172.21.15.12:0/4269129728 shutdown_connections 2023-10-08T16:25:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.218+0000 7f3124f9d700 1 --2- 172.21.15.12:0/4269129728 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f312013fe90 0x7f312006abd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.218+0000 7f3124f9d700 1 -- 172.21.15.12:0/4269129728 >> 172.21.15.12:0/4269129728 conn(0x7f312006d110 msgr2=0x7f31200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:25:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.218+0000 7f3124f9d700 1 -- 172.21.15.12:0/4269129728 shutdown_connections 2023-10-08T16:25:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.218+0000 7f3124f9d700 1 -- 172.21.15.12:0/4269129728 wait complete. 2023-10-08T16:25:59.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.219+0000 7f3124f9d700 1 Processor -- start 2023-10-08T16:25:59.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.219+0000 7f3124f9d700 1 -- start start 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31200c7be0 0x7f3120166f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31200c7fb0 0x7f3120168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31200a5880 con 0x7f312013fe90 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3120169210 con 0x7f31200c7fb0 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.220+0000 7f3124f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312016b5e0 con 0x7f31200c7be0 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37490/0 (socket says 172.21.15.12:37490) 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 -- 172.21.15.12:0/1182341579 learned_addr learned my addr 172.21.15.12:0/1182341579 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311f7fe700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31200c7be0 0x7f3120166f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:59.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311effd700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31200c7fb0 0x7f3120168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 -- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31200c7be0 msgr2=0x7f3120166f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31200c7be0 0x7f3120166f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 -- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31200c7fb0 msgr2=0x7f3120168cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31200c7fb0 0x7f3120168cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 -- 172.21.15.12:0/1182341579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3118009a20 con 0x7f312013fe90 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.221+0000 7f311ffff700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3118003000 tx=0x7f3118017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.222+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3118012be0 con 0x7f312013fe90 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.222+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3118012d40 con 0x7f312013fe90 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.222+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311801e6a0 con 0x7f312013fe90 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.222+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312016a9d0 con 0x7f312013fe90 2023-10-08T16:25:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.222+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312016af90 con 0x7f312013fe90 2023-10-08T16:25:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.223+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f312004c3c0 con 0x7f312013fe90 2023-10-08T16:25:59.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.224+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 43) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f311801ead0 con 0x7f312013fe90 2023-10-08T16:25:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.225+0000 7f31077fe700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 0x7f310c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:25:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.225+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f3118086440 con 0x7f312013fe90 2023-10-08T16:25:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.225+0000 7f311f7fe700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 0x7f310c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:25:59.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.226+0000 7f311f7fe700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 0x7f310c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3110007fd0 tx=0x7f3110007d10 comp rx=0 tx=0).ready entity=mgr.7062 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:25:59.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.229+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3118053480 con 0x7f312013fe90 2023-10-08T16:25:59.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:25:59.486+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f312006bb30 con 0x7f312013fe90 2023-10-08T16:26:00.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.176+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 44) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3118053850 con 0x7f312013fe90 2023-10-08T16:26:00.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.178+0000 7f31077fe700 1 -- 172.21.15.12:0/1182341579 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v44) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3118084840 con 0x7f312013fe90 2023-10-08T16:26:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 msgr2=0x7f310c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 0x7f310c0693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3110007fd0 tx=0x7f3110007d10 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 msgr2=0x7f3120169d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3118003000 tx=0x7f3118017000 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 shutdown_connections 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f310c066f30 0x7f310c0693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f312013fe90 0x7f3120169d50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31200c7be0 0x7f3120166f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 --2- 172.21.15.12:0/1182341579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31200c7fb0 0x7f3120168cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 >> 172.21.15.12:0/1182341579 conn(0x7f312006d110 msgr2=0x7f31200caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 shutdown_connections 2023-10-08T16:26:00.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.181+0000 7f3124f9d700 1 -- 172.21.15.12:0/1182341579 wait complete. 2023-10-08T16:26:00.202 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:26:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.400+0000 7fdbfab9d700 1 Processor -- start 2023-10-08T16:26:00.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.400+0000 7fdbfab9d700 1 -- start start 2023-10-08T16:26:00.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 0x7fdbf4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 0x7fdbf415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf40cea00 0x7fdbf40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf415af60 con 0x7fdbf40cea00 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf415b240 con 0x7fdbf415de50 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf415b520 con 0x7fdbf4153a00 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbfa39c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbf40cea00 0x7fdbf40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbf939a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 0x7fdbf415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbf9b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 0x7fdbf4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbf9b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 0x7fdbf4153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49008/0 (socket says 172.21.15.12:49008) 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbf939a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 0x7fdbf415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:40488/0 (socket says 172.21.15.12:40488) 2023-10-08T16:26:00.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.402+0000 7fdbf9b9b700 1 -- 172.21.15.12:0/4067565096 learned_addr learned my addr 172.21.15.12:0/4067565096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 -- 172.21.15.12:0/4067565096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 msgr2=0x7fdbf4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 --2- 172.21.15.12:0/4067565096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 0x7fdbf4153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 -- 172.21.15.12:0/4067565096 >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 msgr2=0x7fdbf415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 --2- 172.21.15.12:0/4067565096 >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 0x7fdbf415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 -- 172.21.15.12:0/4067565096 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf415b800 con 0x7fdbf40cea00 2023-10-08T16:26:00.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbfa39c700 1 --2- 172.21.15.12:0/4067565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf40cea00 0x7fdbf40cee40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdbf406e800 tx=0x7fdbec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2b2b344f99cf0e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbf8b99700 1 -- 172.21.15.12:0/4067565096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00e070 con 0x7fdbf40cea00 2023-10-08T16:26:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbf8b99700 1 -- 172.21.15.12:0/4067565096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbec00bab0 con 0x7fdbf40cea00 2023-10-08T16:26:00.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.403+0000 7fdbf8b99700 1 -- 172.21.15.12:0/4067565096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbec00be70 con 0x7fdbf40cea00 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 -- 172.21.15.12:0/4067565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf40cea00 msgr2=0x7fdbf40cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/4067565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf40cea00 0x7fdbf40cee40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdbf406e800 tx=0x7fdbec009780 comp rx=0 tx=0).stop 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 -- 172.21.15.12:0/4067565096 shutdown_connections 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/4067565096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf40cea00 0x7fdbf40cee40 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/4067565096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf4153a00 0x7fdbf4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/4067565096 >> v2:172.21.15.29:3300/0 conn(0x7fdbf415de50 0x7fdbf415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 -- 172.21.15.12:0/4067565096 >> 172.21.15.12:0/4067565096 conn(0x7fdbf40703a0 msgr2=0x7fdbf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 -- 172.21.15.12:0/4067565096 shutdown_connections 2023-10-08T16:26:00.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.404+0000 7fdbfab9d700 1 -- 172.21.15.12:0/4067565096 wait complete. 2023-10-08T16:26:00.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.406+0000 7fdbfab9d700 1 Processor -- start 2023-10-08T16:26:00.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.407+0000 7fdbfab9d700 1 -- start start 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf40cea00 0x7fdbf40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 0x7fdbf4158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c7b20 con 0x7fdbf4153a00 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf40c9d30 con 0x7fdbf415de50 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbfab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf413dde0 con 0x7fdbf40cea00 2023-10-08T16:26:00.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.408+0000 7fdbf939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37510/0 (socket says 172.21.15.12:37510) 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 -- 172.21.15.12:0/1429814145 learned_addr learned my addr 172.21.15.12:0/1429814145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbfa39c700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 0x7fdbf4158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf9b9b700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf40cea00 0x7fdbf40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf40cea00 msgr2=0x7fdbf40c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf40cea00 0x7fdbf40c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 msgr2=0x7fdbf4158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 0x7fdbf4158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 -- 172.21.15.12:0/1429814145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbec009a20 con 0x7fdbf4153a00 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbfa39c700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 0x7fdbf4158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:26:00.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.409+0000 7fdbf939a700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400e930 tx=0x7fdbe40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.410+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4013680 con 0x7fdbf4153a00 2023-10-08T16:26:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.410+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe40137e0 con 0x7fdbf4153a00 2023-10-08T16:26:00.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.410+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf40c9140 con 0x7fdbf4153a00 2023-10-08T16:26:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.410+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe4013b80 con 0x7fdbf4153a00 2023-10-08T16:26:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.410+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf40c99c0 con 0x7fdbf4153a00 2023-10-08T16:26:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.411+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf40c9520 con 0x7fdbf4153a00 2023-10-08T16:26:00.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.413+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 44) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fdbe400c3e0 con 0x7fdbf4153a00 2023-10-08T16:26:00.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.414+0000 7fdbe9ffb700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 0x7fdbd8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.414+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fdbe4084830 con 0x7fdbf4153a00 2023-10-08T16:26:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.414+0000 7fdbf9b9b700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 msgr2=0x7fdbd8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:00.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.414+0000 7fdbf9b9b700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 0x7fdbd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:26:00.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.418+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbe4051870 con 0x7fdbf4153a00 2023-10-08T16:26:00.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.615+0000 7fdbf9b9b700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 msgr2=0x7fdbd8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:00.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.615+0000 7fdbf9b9b700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 0x7fdbd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:26:00.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.624+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fdbf40c9ea0 con 0x7fdbf4153a00 2023-10-08T16:26:00.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.628+0000 7fdbe9ffb700 1 -- 172.21.15.12:0/1429814145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdbe4054e90 con 0x7fdbf4153a00 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 msgr2=0x7fdbd8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 0x7fdbd8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 msgr2=0x7fdbf413d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fdbe400e930 tx=0x7fdbe40091a0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 shutdown_connections 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdbd8066f80 0x7fdbd8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbf415de50 0x7fdbf4158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbf40cea00 0x7fdbf40c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 --2- 172.21.15.12:0/1429814145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbf4153a00 0x7fdbf413d8a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.630+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 >> 172.21.15.12:0/1429814145 conn(0x7fdbf40703a0 msgr2=0x7fdbf40d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:00.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.631+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 shutdown_connections 2023-10-08T16:26:00.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.631+0000 7fdbfab9d700 1 -- 172.21.15.12:0/1429814145 wait complete. 2023-10-08T16:26:00.649 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:26:00.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.844+0000 7f414319d700 1 Processor -- start 2023-10-08T16:26:00.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.844+0000 7f414319d700 1 -- start start 2023-10-08T16:26:00.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.845+0000 7f414319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c15dfd0 0x7f413c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.845+0000 7f414319d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f413c159920 0x7f413c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.845+0000 7f414319d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413c0acc00 con 0x7f413c159550 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.845+0000 7f414319d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413c0abff0 con 0x7f413c159920 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.845+0000 7f414319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0ac2d0 con 0x7f413c15dfd0 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f413c159920 0x7f413c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414199a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c15dfd0 0x7f413c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f413c159920 0x7f413c0ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37518/0 (socket says 172.21.15.12:37518) 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 -- 172.21.15.12:0/3309458003 learned_addr learned my addr 172.21.15.12:0/3309458003 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:00.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414219b700 1 --1- 172.21.15.12:0/3309458003 >> v1:172.21.15.29:6789/0 conn(0x7f413c159550 0x7f413c0ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52080/0 (socket says 172.21.15.12:52080) 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 -- 172.21.15.12:0/3309458003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c15dfd0 msgr2=0x7f413c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 --2- 172.21.15.12:0/3309458003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c15dfd0 0x7f413c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 -- 172.21.15.12:0/3309458003 >> v1:172.21.15.29:6789/0 conn(0x7f413c159550 legacy=0x7f413c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 -- 172.21.15.12:0/3309458003 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413c0ac5b0 con 0x7f413c159920 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f4141199700 1 -- 172.21.15.12:0/3309458003 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918526449 0 0) 0x7f413c0acc00 con 0x7f413c159550 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.846+0000 7f414299c700 1 --2- 172.21.15.12:0/3309458003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159920 0x7f413c0ad090 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4134009f20 tx=0x7f4134009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5775ef57a192561a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f4141199700 1 -- 172.21.15.12:0/3309458003 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413400e070 con 0x7f413c159920 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f4141199700 1 -- 172.21.15.12:0/3309458003 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413400b9d0 con 0x7f413c159920 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f4141199700 1 -- 172.21.15.12:0/3309458003 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41340092e0 con 0x7f413c159920 2023-10-08T16:26:00.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 -- 172.21.15.12:0/3309458003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159920 msgr2=0x7f413c0ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 --2- 172.21.15.12:0/3309458003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159920 0x7f413c0ad090 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f4134009f20 tx=0x7f4134009840 comp rx=0 tx=0).stop 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 -- 172.21.15.12:0/3309458003 shutdown_connections 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 --2- 172.21.15.12:0/3309458003 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159920 0x7f413c0ad090 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 --2- 172.21.15.12:0/3309458003 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c15dfd0 0x7f413c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.847+0000 7f414319d700 1 -- 172.21.15.12:0/3309458003 >> 172.21.15.12:0/3309458003 conn(0x7f413c06ce80 msgr2=0x7f413c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.848+0000 7f414319d700 1 -- 172.21.15.12:0/3309458003 shutdown_connections 2023-10-08T16:26:00.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.848+0000 7f414319d700 1 -- 172.21.15.12:0/3309458003 wait complete. 2023-10-08T16:26:00.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.849+0000 7f414319d700 1 Processor -- start 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.849+0000 7f414319d700 1 -- start start 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c159920 0x7f413c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f413c15dfd0 0x7f413c141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c14eb60 con 0x7f413c159550 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413c14e880 con 0x7f413c15dfd0 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413c0c7700 con 0x7f413c159920 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37524/0 (socket says 172.21.15.12:37524) 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414219b700 1 -- 172.21.15.12:0/2965525191 learned_addr learned my addr 172.21.15.12:0/2965525191 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414199a700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c159920 0x7f413c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.850+0000 7f414299c700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f413c15dfd0 0x7f413c141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c159920 msgr2=0x7f413c152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c159920 0x7f413c152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f413c15dfd0 msgr2=0x7f413c141a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f413c15dfd0 0x7f413c141a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 -- 172.21.15.12:0/2965525191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134009ae0 con 0x7f413c159550 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414219b700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f41380011e0 tx=0x7f4138007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138005a70 con 0x7f413c159550 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4138005bd0 con 0x7f413c159550 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380070d0 con 0x7f413c159550 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413c0c79e0 con 0x7f413c159550 2023-10-08T16:26:00.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.851+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c150c40 con 0x7f413c159550 2023-10-08T16:26:00.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.852+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413c0c7560 con 0x7f413c159550 2023-10-08T16:26:00.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.853+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 44) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4138007480 con 0x7f413c159550 2023-10-08T16:26:00.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.854+0000 7f41327fc700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 0x7f4120069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:00.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.854+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4138083bd0 con 0x7f413c159550 2023-10-08T16:26:00.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.854+0000 7f414199a700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 msgr2=0x7f4120069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:00.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.855+0000 7f414199a700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 0x7f4120069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:26:00.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:00.859+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f413c0c7560 con 0x7f413c159550 2023-10-08T16:26:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.056+0000 7f414199a700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 msgr2=0x7f4120069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:01.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.056+0000 7f414199a700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 0x7f4120069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:26:01.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.061+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f413c0c7560 con 0x7f413c159550 2023-10-08T16:26:01.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.065+0000 7f41327fc700 1 -- 172.21.15.12:0/2965525191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f413c0c7560 con 0x7f413c159550 2023-10-08T16:26:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 msgr2=0x7f4120069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:26:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 0x7f4120069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 msgr2=0x7f413c14d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:01.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f41380011e0 tx=0x7f4138007e10 comp rx=0 tx=0).stop 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 shutdown_connections 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4120066f80 0x7f4120069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f413c159550 0x7f413c14d090 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f413c15dfd0 0x7f413c141a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 --2- 172.21.15.12:0/2965525191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f413c159920 0x7f413c152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 >> 172.21.15.12:0/2965525191 conn(0x7f413c06ce80 msgr2=0x7f413c153390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 shutdown_connections 2023-10-08T16:26:01.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.068+0000 7f414319d700 1 -- 172.21.15.12:0/2965525191 wait complete. 2023-10-08T16:26:01.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-10-08T16:26:01.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.288+0000 7fa792b9d700 1 Processor -- start 2023-10-08T16:26:01.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.288+0000 7fa792b9d700 1 -- start start 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa792b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78c0cce90 0x7fa78c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa792b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa78c0cb440 0x7fa78c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa792b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa78c15d570 con 0x7fa78c159fb0 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa792b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c15e180 con 0x7fa78c0cce90 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa792b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0cd870 con 0x7fa78c0cb440 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa79139a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78c0cce90 0x7fa78c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa79139a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa78c0cce90 0x7fa78c0cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37538/0 (socket says 172.21.15.12:37538) 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa79139a700 1 -- 172.21.15.12:0/81963883 learned_addr learned my addr 172.21.15.12:0/81963883 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:01.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.290+0000 7fa79239c700 1 --2- 172.21.15.12:0/81963883 >> v2:172.21.15.29:3300/0 conn(0x7fa78c0cb440 0x7fa78c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa79139a700 1 -- 172.21.15.12:0/81963883 >> v2:172.21.15.29:3300/0 conn(0x7fa78c0cb440 msgr2=0x7fa78c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:26:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa79139a700 1 --2- 172.21.15.12:0/81963883 >> v2:172.21.15.29:3300/0 conn(0x7fa78c0cb440 0x7fa78c0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa79139a700 1 -- 172.21.15.12:0/81963883 >> v1:172.21.15.29:6789/0 conn(0x7fa78c159fb0 legacy=0x7fa78c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa79139a700 1 -- 172.21.15.12:0/81963883 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c15d850 con 0x7fa78c0cce90 2023-10-08T16:26:01.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa79139a700 1 --2- 172.21.15.12:0/81963883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c0cd330 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa78c089710 tx=0x7fa77c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222a4b9884e989ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa790b99700 1 -- 172.21.15.12:0/81963883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c009e70 con 0x7fa78c0cce90 2023-10-08T16:26:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa790b99700 1 -- 172.21.15.12:0/81963883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c00b860 con 0x7fa78c0cce90 2023-10-08T16:26:01.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.291+0000 7fa790b99700 1 -- 172.21.15.12:0/81963883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00bc00 con 0x7fa78c0cce90 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 -- 172.21.15.12:0/81963883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 msgr2=0x7fa78c0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 --2- 172.21.15.12:0/81963883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c0cd330 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fa78c089710 tx=0x7fa77c009250 comp rx=0 tx=0).stop 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 -- 172.21.15.12:0/81963883 shutdown_connections 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 --2- 172.21.15.12:0/81963883 >> v2:172.21.15.29:3300/0 conn(0x7fa78c0cb440 0x7fa78c0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 --2- 172.21.15.12:0/81963883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c0cd330 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 -- 172.21.15.12:0/81963883 >> 172.21.15.12:0/81963883 conn(0x7fa78c0703a0 msgr2=0x7fa78c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 -- 172.21.15.12:0/81963883 shutdown_connections 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.292+0000 7fa792b9d700 1 -- 172.21.15.12:0/81963883 wait complete. 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.294+0000 7fa792b9d700 1 Processor -- start 2023-10-08T16:26:01.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.294+0000 7fa792b9d700 1 -- start start 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa78c0cb440 0x7fa78c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa78c159fb0 0x7fa78c16c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c16e1d0 con 0x7fa78c0cce90 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c14d500 con 0x7fa78c0cb440 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa792b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0b11f0 con 0x7fa78c159fb0 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37548/0 (socket says 172.21.15.12:37548) 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 -- 172.21.15.12:0/3150284830 learned_addr learned my addr 172.21.15.12:0/3150284830 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa78c0cb440 0x7fa78c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:01.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79239c700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa78c159fb0 0x7fa78c16c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa78c159fb0 msgr2=0x7fa78c16c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa78c159fb0 0x7fa78c16c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa78c0cb440 msgr2=0x7fa78c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa78c0cb440 0x7fa78c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.295+0000 7fa79139a700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa77c0094f0 con 0x7fa78c0cce90 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa79139a700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa78c06d1f0 tx=0x7fa77c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c00bbe0 con 0x7fa78c0cce90 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c011420 con 0x7fa78c0cce90 2023-10-08T16:26:01.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0117c0 con 0x7fa78c0cce90 2023-10-08T16:26:01.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c0b08c0 con 0x7fa78c0cce90 2023-10-08T16:26:01.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.296+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c0b0e80 con 0x7fa78c0cce90 2023-10-08T16:26:01.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.298+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c04c3c0 con 0x7fa78c0cce90 2023-10-08T16:26:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.298+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 44) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fa77c011bf0 con 0x7fa78c0cce90 2023-10-08T16:26:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.299+0000 7fa781ffb700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.299+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa77c085c70 con 0x7fa78c0cce90 2023-10-08T16:26:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.299+0000 7fa791b9b700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:01.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.299+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:26:01.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.304+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa77c052d50 con 0x7fa78c0cce90 2023-10-08T16:26:01.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.500+0000 7fa791b9b700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:01.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.500+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:26:01.513 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:01.514+0000 7fd3c6186180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:26:01.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.531+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa78c0b1330 con 0x7fa770066f80 2023-10-08T16:26:01.554 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:01.554+0000 7fb84a057180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:26:01.688 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:01.688+0000 7fd3c6186180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:26:01.729 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:01.729+0000 7fb84a057180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:26:01.777 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:01.777+0000 7fd3c6186180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:26:01.818 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:01.818+0000 7fb84a057180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:26:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.901+0000 7fa791b9b700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:01.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:01.901+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:26:02.008 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:02.008+0000 7fd3c6186180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:26:02.051 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:02.051+0000 7fb84a057180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:26:02.193 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:02.193+0000 7fd3c6186180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:26:02.237 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:02.237+0000 7fb84a057180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:26:02.289 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:02.289+0000 7fd3c6186180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:26:02.333 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:02.333+0000 7fb84a057180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:26:02.456 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:02.456+0000 7fd3c6186180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:26:02.500 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:02.500+0000 7fb84a057180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:26:02.562 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:02.562+0000 7fd3c6186180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:26:02.605 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:02.605+0000 7fb84a057180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:26:02.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:02.702+0000 7fa791b9b700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:02.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:02.702+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:26:03.069 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:03.069+0000 7fd3c6186180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:26:03.109 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:03.109+0000 7fb84a057180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:26:03.167 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:03.167+0000 7fd3c6186180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:26:03.207 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:03.207+0000 7fb84a057180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:26:03.262 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:03.262+0000 7fd3c6186180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:26:03.302 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:03.302+0000 7fb84a057180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:26:03.915 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:03.915+0000 7fd3c6186180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:26:03.951 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:03.951+0000 7fb84a057180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:26:04.095 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:04.095+0000 7fd3c6186180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:26:04.130 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:04.130+0000 7fb84a057180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:26:04.196 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:04.196+0000 7fd3c6186180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:26:04.229 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:04.230+0000 7fb84a057180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:26:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:04.303+0000 7fa791b9b700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:26:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:04.303+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:26:04.498 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:04.498+0000 7fd3c6186180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:26:04.533 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:04.533+0000 7fb84a057180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:26:04.598 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:04.598+0000 7fd3c6186180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:26:04.633 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:04.633+0000 7fb84a057180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:26:05.337 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:05.337+0000 7fd3c6186180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:26:05.369 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:05.369+0000 7fb84a057180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:26:05.629 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:05.629+0000 7fd3c6186180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:26:05.662 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:05.662+0000 7fb84a057180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:26:05.726 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:05.726+0000 7fd3c6186180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:26:05.758 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:05.758+0000 7fb84a057180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:26:05.888 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:05.888+0000 7fd3c6186180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:26:05.919 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:05.919+0000 7fb84a057180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:26:05.997 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:05.997+0000 7fd3c6186180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:26:06.028 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.028+0000 7fb84a057180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:26:06.196 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:06.196+0000 7fd3c6186180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:26:06.226 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.226+0000 7fb84a057180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:26:06.293 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:06.293+0000 7fd3c6186180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:26:06.322 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.323+0000 7fb84a057180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:26:06.393 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:06.393+0000 7fd3c6186180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:26:06.418 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.419+0000 7fb84a057180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:26:06.492 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:26:06.492+0000 7fd3c6186180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:26:06.517 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.517+0000 7fb84a057180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:26:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:06.527+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 45) v1 ==== 84468+0+0 (secure 0 0 0) 0x7fa77c053120 con 0x7fa78c0cce90 2023-10-08T16:26:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:06.527+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:26:06.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:06.527+0000 7fa781ffb700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:06.650 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bf3b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bf3b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bf3b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bf3b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bf3b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bc3b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bc3b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bc3b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.690 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bc3b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:06.690 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:26:06.650+0000 7fb7bc3b1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:26:07.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.534+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 46) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa77c0233f0 con 0x7fa78c0cce90 2023-10-08T16:26:07.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.534+0000 7fa781ffb700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.534+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa78c0b1330 con 0x7fa770066f80 2023-10-08T16:26:07.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.538+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.541+0000 7fa791b9b700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa78c142750 tx=0x7fa788007ec0 comp rx=0 tx=0).ready entity=mgr.7476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:07.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.613+0000 7fa781ffb700 1 -- 172.21.15.12:0/3150284830 <== mgr.7476 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fa78c0b1330 con 0x7fa770066f80 2023-10-08T16:26:07.613 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /bad-path 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 msgr2=0x7fa770069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa78c142750 tx=0x7fa788007ec0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 msgr2=0x7fa78c1511c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fa78c06d1f0 tx=0x7fa77c017000 comp rx=0 tx=0).stop 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 shutdown_connections 2023-10-08T16:26:07.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa770066f80 0x7fa770069430 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa78c159fb0 0x7fa78c16c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa78c0cb440 0x7fa78c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 --2- 172.21.15.12:0/3150284830 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa78c0cce90 0x7fa78c1511c0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 >> 172.21.15.12:0/3150284830 conn(0x7fa78c0703a0 msgr2=0x7fa78c14de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 shutdown_connections 2023-10-08T16:26:07.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.616+0000 7fa792b9d700 1 -- 172.21.15.12:0/3150284830 wait complete. 2023-10-08T16:26:07.635 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-10-08T16:26:07.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-08T16:26:07.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.827+0000 7eff85d9d700 1 Processor -- start 2023-10-08T16:26:07.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.828+0000 7eff85d9d700 1 -- start start 2023-10-08T16:26:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff85d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c2a90 0x7eff80156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff85d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff800c85d0 0x7eff800cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff85d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff801579b0 con 0x7eff800c8200 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff85d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff800c1390 con 0x7eff800c85d0 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff85d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff801573f0 con 0x7eff800c2a90 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff8559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff800c85d0 0x7eff800cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff8559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7eff800c85d0 0x7eff800cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56866/0 (socket says 172.21.15.12:56866) 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff8559c700 1 -- 172.21.15.12:0/949657752 learned_addr learned my addr 172.21.15.12:0/949657752 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.829+0000 7eff7ffff700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c2a90 0x7eff80156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff8559c700 1 -- 172.21.15.12:0/949657752 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c2a90 msgr2=0x7eff80156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff8559c700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c2a90 0x7eff80156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff8559c700 1 -- 172.21.15.12:0/949657752 >> v1:172.21.15.29:6789/0 conn(0x7eff800c8200 legacy=0x7eff800c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff8559c700 1 -- 172.21.15.12:0/949657752 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff801576d0 con 0x7eff800c85d0 2023-10-08T16:26:07.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff8559c700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c85d0 0x7eff800cc2f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7eff78009f20 tx=0x7eff78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd75615bd4c40eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff7f7fe700 1 -- 172.21.15.12:0/949657752 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800e070 con 0x7eff800c85d0 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff7f7fe700 1 -- 172.21.15.12:0/949657752 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800ba80 con 0x7eff800c85d0 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.830+0000 7eff7f7fe700 1 -- 172.21.15.12:0/949657752 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff780092e0 con 0x7eff800c85d0 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 -- 172.21.15.12:0/949657752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c85d0 msgr2=0x7eff800cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c85d0 0x7eff800cc2f0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7eff78009f20 tx=0x7eff78009840 comp rx=0 tx=0).stop 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 -- 172.21.15.12:0/949657752 shutdown_connections 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c85d0 0x7eff800cc2f0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 --2- 172.21.15.12:0/949657752 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c2a90 0x7eff80156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 -- 172.21.15.12:0/949657752 >> 172.21.15.12:0/949657752 conn(0x7eff8006c6a0 msgr2=0x7eff8006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 -- 172.21.15.12:0/949657752 shutdown_connections 2023-10-08T16:26:07.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.831+0000 7eff85d9d700 1 -- 172.21.15.12:0/949657752 wait complete. 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.832+0000 7eff85d9d700 1 Processor -- start 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.833+0000 7eff85d9d700 1 -- start start 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 0x7eff80146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c85d0 0x7eff801654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8014bb30 con 0x7eff800c2a90 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8015a7f0 con 0x7eff800c8200 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff85d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff80165f00 con 0x7eff800c85d0 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:56880/0 (socket says 172.21.15.12:56880) 2023-10-08T16:26:07.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 -- 172.21.15.12:0/342848575 learned_addr learned my addr 172.21.15.12:0/342848575 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff7ffff700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 0x7eff80146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff8559c700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c85d0 0x7eff801654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 -- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c85d0 msgr2=0x7eff801654d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c85d0 0x7eff801654d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 -- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 msgr2=0x7eff80146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 0x7eff80146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff84d9b700 1 -- 172.21.15.12:0/342848575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff78009ae0 con 0x7eff800c2a90 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.834+0000 7eff7ffff700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 0x7eff80146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff84d9b700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c590 tx=0x7eff7400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74011590 con 0x7eff800c2a90 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740116f0 con 0x7eff800c2a90 2023-10-08T16:26:07.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff801661e0 con 0x7eff800c2a90 2023-10-08T16:26:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff74011ab0 con 0x7eff800c2a90 2023-10-08T16:26:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.835+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8014bd40 con 0x7eff800c2a90 2023-10-08T16:26:07.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.836+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff800c25d0 con 0x7eff800c2a90 2023-10-08T16:26:07.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.837+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 46) v1 ==== 84595+0+0 (secure 0 0 0) 0x7eff7401b3b0 con 0x7eff800c2a90 2023-10-08T16:26:07.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.838+0000 7eff7cff9700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 0x7eff64069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:26:07.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.838+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6355+0+0 (secure 0 0 0) 0x7eff74083b50 con 0x7eff800c2a90 2023-10-08T16:26:07.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.838+0000 7eff7ffff700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 0x7eff64069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:26:07.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.839+0000 7eff7ffff700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 0x7eff64069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff8015c0f0 tx=0x7eff6c008040 comp rx=0 tx=0).ready entity=mgr.7476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:26:07.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:07.842+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff74050d10 con 0x7eff800c2a90 2023-10-08T16:26:08.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.070+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff8004c3c0 con 0x7eff64066dd0 2023-10-08T16:26:08.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.078+0000 7eff7cff9700 1 -- 172.21.15.12:0/342848575 <== mgr.7476 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7eff8004c3c0 con 0x7eff64066dd0 2023-10-08T16:26:08.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:26:08.078 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:26:07", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-08T16:26:08.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 msgr2=0x7eff64069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:08.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 0x7eff64069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff8015c0f0 tx=0x7eff6c008040 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 msgr2=0x7eff8015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7eff7400c590 tx=0x7eff7400c950 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 shutdown_connections 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff64066dd0 0x7eff64069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff800c2a90 0x7eff8015a2b0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff800c85d0 0x7eff801654d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 --2- 172.21.15.12:0/342848575 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff800c8200 0x7eff80146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 >> 172.21.15.12:0/342848575 conn(0x7eff8006c6a0 msgr2=0x7eff800ca5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 shutdown_connections 2023-10-08T16:26:08.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:26:08.080+0000 7eff85d9d700 1 -- 172.21.15.12:0/342848575 wait complete. 2023-10-08T16:26:08.098 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:26:07", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-10-08T16:26:17.663 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:26:17.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:26:47.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:26:47.779 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:27:00.626 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:00.625+0000 7fb7aeb96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:00.626 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:00.625+0000 7fb7aeb96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:00.626 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:00.625+0000 7fb7aeb96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:00.626 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:00.625+0000 7fb7aeb96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:00.627 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:00.625+0000 7fb7aeb96700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:08.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-10-08T16:27:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.303+0000 7ff6bbfff700 1 Processor -- start 2023-10-08T16:27:08.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.304+0000 7ff6bbfff700 1 -- start start 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c8200 0x7ff6bc0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bbfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff6bc0c2a90 0x7ff6bc156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bbfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6bc1579b0 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bbfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6bc0c1390 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc1573f0 con 0x7ff6bc0c8200 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff6bc0c85d0 0x7ff6bc0cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33312/0 (socket says 172.21.15.12:33312) 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6bb7fe700 1 -- 172.21.15.12:0/3459826951 learned_addr learned my addr 172.21.15.12:0/3459826951 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6baffd700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c8200 0x7ff6bc0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.305+0000 7ff6ba7fc700 1 --2- 172.21.15.12:0/3459826951 >> v2:172.21.15.29:3300/0 conn(0x7ff6bc0c2a90 0x7ff6bc156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6b9ffb700 1 -- 172.21.15.12:0/3459826951 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030698778 0 0) 0x7ff6bc1579b0 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6b9ffb700 1 -- 172.21.15.12:0/3459826951 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a4003570 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6ba7fc700 1 -- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c8200 msgr2=0x7ff6bc0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6ba7fc700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c8200 0x7ff6bc0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6ba7fc700 1 -- 172.21.15.12:0/3459826951 >> v1:172.21.15.12:6789/0 conn(0x7ff6bc0c85d0 legacy=0x7ff6bc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6ba7fc700 1 -- 172.21.15.12:0/3459826951 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6bc1576d0 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6ba7fc700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c2a90 0x7ff6bc156aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e78d4cdebd31d377 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6b9ffb700 1 -- 172.21.15.12:0/3459826951 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011630 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6b9ffb700 1 -- 172.21.15.12:0/3459826951 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b0011790 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.306+0000 7ff6b9ffb700 1 -- 172.21.15.12:0/3459826951 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b0011b30 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 -- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c2a90 msgr2=0x7ff6bc156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c2a90 0x7ff6bc156aa0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff6b00098e0 tx=0x7ff6b00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 -- 172.21.15.12:0/3459826951 shutdown_connections 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c8200 0x7ff6bc0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/3459826951 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c2a90 0x7ff6bc156aa0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 -- 172.21.15.12:0/3459826951 >> 172.21.15.12:0/3459826951 conn(0x7ff6bc06c6a0 msgr2=0x7ff6bc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:08.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 -- 172.21.15.12:0/3459826951 shutdown_connections 2023-10-08T16:27:08.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.307+0000 7ff6bbfff700 1 -- 172.21.15.12:0/3459826951 wait complete. 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.308+0000 7ff6bbfff700 1 Processor -- start 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 -- start start 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c2a90 0x7ff6bc15baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c8200 0x7ff6bc15bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc14e320 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc169700 con 0x7ff6bc0c8200 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.309+0000 7ff6bbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6bc15b000 con 0x7ff6bc0c2a90 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47010/0 (socket says 172.21.15.12:47010) 2023-10-08T16:27:08.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 -- 172.21.15.12:0/4256635953 learned_addr learned my addr 172.21.15.12:0/4256635953 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6baffd700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c2a90 0x7ff6bc15baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6ba7fc700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c8200 0x7ff6bc15bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 -- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c2a90 msgr2=0x7ff6bc15baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c2a90 0x7ff6bc15baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 -- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c8200 msgr2=0x7ff6bc15bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c8200 0x7ff6bc15bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 -- 172.21.15.12:0/4256635953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b0009420 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.310+0000 7ff6bb7fe700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4001460 tx=0x7ff6b4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.311+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400a870 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.311+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b400a9d0 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.311+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6bc159630 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.311+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b400ad50 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.311+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6bc15b580 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.312+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6bc0c2500 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.313+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 48) v1 ==== 84973+0+0 (secure 0 0 0) 0x7ff6b4007300 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.314+0000 7ff6a2ffd700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 0x7ff6a8069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.314+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7ff6b4084fb0 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.314+0000 7ff6baffd700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 0x7ff6a8069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.314+0000 7ff6baffd700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 0x7ff6a8069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0c92e0 tx=0x7ff6ac0091a0 comp rx=0 tx=0).ready entity=mgr.7476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.318+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6b4051c90 con 0x7ff6bc0c85d0 2023-10-08T16:27:08.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.550+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6bc159350 con 0x7ff6a80671c0 2023-10-08T16:27:08.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.557+0000 7ff6a2ffd700 1 -- 172.21.15.12:0/4256635953 <== mgr.7476 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7ff6ac011a50 con 0x7ff6a80671c0 2023-10-08T16:27:08.558 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:08.558 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:26:07", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.559+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 msgr2=0x7ff6a8069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.559+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 0x7ff6a8069670 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc0c92e0 tx=0x7ff6ac0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.559+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 msgr2=0x7ff6bc15c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.559+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4001460 tx=0x7ff6b4001a40 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 shutdown_connections 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff6a80671c0 0x7ff6a8069670 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6bc0c85d0 0x7ff6bc15c520 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6bc0c2a90 0x7ff6bc15baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 --2- 172.21.15.12:0/4256635953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff6bc0c8200 0x7ff6bc15bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 >> 172.21.15.12:0/4256635953 conn(0x7ff6bc06c6a0 msgr2=0x7ff6bc14fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:08.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 shutdown_connections 2023-10-08T16:27:08.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.560+0000 7ff6bbfff700 1 -- 172.21.15.12:0/4256635953 wait complete. 2023-10-08T16:27:08.578 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:26:07", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-10-08T16:27:08.578 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-10-08T16:27:08.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.768+0000 7fb49199d700 1 Processor -- start 2023-10-08T16:27:08.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.768+0000 7fb49199d700 1 -- start start 2023-10-08T16:27:08.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 0x7fb48c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 0x7fb48c156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb48c1579b0 con 0x7fb48c0c85d0 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48c0c1390 con 0x7fb48c0c8200 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c1573f0 con 0x7fb48c0c2a90 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49119c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb48c0c85d0 0x7fb48c0cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33322/0 (socket says 172.21.15.12:33322) 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49119c700 1 -- 172.21.15.12:0/2970084 learned_addr learned my addr 172.21.15.12:0/2970084 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb49099b700 1 --2- 172.21.15.12:0/2970084 >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 0x7fb48c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb48bfff700 1 --2- 172.21.15.12:0/2970084 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 0x7fb48c156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb48b7fe700 1 -- 172.21.15.12:0/2970084 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828973009 0 0) 0x7fb48c1579b0 con 0x7fb48c0c85d0 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.770+0000 7fb48b7fe700 1 -- 172.21.15.12:0/2970084 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c003570 con 0x7fb48c0c85d0 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48bfff700 1 -- 172.21.15.12:0/2970084 >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 msgr2=0x7fb48c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48bfff700 1 --2- 172.21.15.12:0/2970084 >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 0x7fb48c0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48bfff700 1 -- 172.21.15.12:0/2970084 >> v1:172.21.15.12:6789/0 conn(0x7fb48c0c85d0 legacy=0x7fb48c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48bfff700 1 -- 172.21.15.12:0/2970084 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48c1576d0 con 0x7fb48c0c2a90 2023-10-08T16:27:08.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb49099b700 1 --2- 172.21.15.12:0/2970084 >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 0x7fb48c0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48bfff700 1 --2- 172.21.15.12:0/2970084 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 0x7fb48c156aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4780098e0 tx=0x7fb4780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a57c305d62a848d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48b7fe700 1 -- 172.21.15.12:0/2970084 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478011630 con 0x7fb48c0c2a90 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48b7fe700 1 -- 172.21.15.12:0/2970084 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb478011790 con 0x7fb48c0c2a90 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.771+0000 7fb48b7fe700 1 -- 172.21.15.12:0/2970084 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478011b10 con 0x7fb48c0c2a90 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 -- 172.21.15.12:0/2970084 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 msgr2=0x7fb48c156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 --2- 172.21.15.12:0/2970084 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 0x7fb48c156aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4780098e0 tx=0x7fb4780091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 -- 172.21.15.12:0/2970084 shutdown_connections 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 --2- 172.21.15.12:0/2970084 >> v2:172.21.15.29:3300/0 conn(0x7fb48c0c8200 0x7fb48c0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 --2- 172.21.15.12:0/2970084 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c2a90 0x7fb48c156aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 -- 172.21.15.12:0/2970084 >> 172.21.15.12:0/2970084 conn(0x7fb48c06c6a0 msgr2=0x7fb48c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:08.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 -- 172.21.15.12:0/2970084 shutdown_connections 2023-10-08T16:27:08.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.772+0000 7fb49199d700 1 -- 172.21.15.12:0/2970084 wait complete. 2023-10-08T16:27:08.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.773+0000 7fb49199d700 1 Processor -- start 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.774+0000 7fb49199d700 1 -- start start 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.774+0000 7fb49199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb48c0c2a90 0x7fb48c0abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.774+0000 7fb49199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c8200 0x7fb48c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0ad500 con 0x7fb48c0c85d0 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0ac8f0 con 0x7fb48c0c2a90 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb48c0acbd0 con 0x7fb48c0c8200 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49099b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb48c0c2a90 0x7fb48c0abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47018/0 (socket says 172.21.15.12:47018) 2023-10-08T16:27:08.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 -- 172.21.15.12:0/3830522200 learned_addr learned my addr 172.21.15.12:0/3830522200 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb48bfff700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c8200 0x7fb48c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 -- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c8200 msgr2=0x7fb48c0b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c8200 0x7fb48c0b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 -- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb48c0c2a90 msgr2=0x7fb48c0abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb48c0c2a90 0x7fb48c0abff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 -- 172.21.15.12:0/3830522200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb480009420 con 0x7fb48c0c85d0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.775+0000 7fb49119c700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb484001460 tx=0x7fb484001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.776+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400a870 con 0x7fb48c0c85d0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.776+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400a9d0 con 0x7fb48c0c85d0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.776+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb478009420 con 0x7fb48c0c85d0 2023-10-08T16:27:08.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.776+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48400ad50 con 0x7fb48c0c85d0 2023-10-08T16:27:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.776+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48c0c4ee0 con 0x7fb48c0c85d0 2023-10-08T16:27:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.777+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb48c0acfc0 con 0x7fb48c0c85d0 2023-10-08T16:27:08.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.778+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 48) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fb484007300 con 0x7fb48c0c85d0 2023-10-08T16:27:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.779+0000 7fb488ff9700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 0x7fb470069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.779+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fb484084f40 con 0x7fb48c0c85d0 2023-10-08T16:27:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.779+0000 7fb49099b700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 0x7fb470069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:08.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.780+0000 7fb49099b700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 0x7fb470069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb480009f40 tx=0x7fb4800091a0 comp rx=0 tx=0).ready entity=mgr.7476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:08.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:08.784+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb484051bf0 con 0x7fb48c0c85d0 2023-10-08T16:27:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.012+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7fb48c0acd90 con 0x7fb4700671c0 2023-10-08T16:27:09.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.080+0000 7fb488ff9700 1 -- 172.21.15.12:0/3830522200 <== mgr.7476 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7fb48c0acd90 con 0x7fb4700671c0 2023-10-08T16:27:09.081 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /bad-path 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 msgr2=0x7fb470069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 0x7fb470069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb480009f40 tx=0x7fb4800091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 msgr2=0x7fb48c0b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fb484001460 tx=0x7fb484001a40 comp rx=0 tx=0).stop 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 shutdown_connections 2023-10-08T16:27:09.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb4700671c0 0x7fb470069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb48c0c85d0 0x7fb48c0b0770 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb48c0c2a90 0x7fb48c0abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 --2- 172.21.15.12:0/3830522200 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb48c0c8200 0x7fb48c0b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 >> 172.21.15.12:0/3830522200 conn(0x7fb48c06c6a0 msgr2=0x7fb48c0cb4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 shutdown_connections 2023-10-08T16:27:09.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.082+0000 7fb49199d700 1 -- 172.21.15.12:0/3830522200 wait complete. 2023-10-08T16:27:09.101 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-10-08T16:27:09.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:27:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.291+0000 7f47449fe700 1 Processor -- start 2023-10-08T16:27:09.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.291+0000 7f47449fe700 1 -- start start 2023-10-08T16:27:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f47449fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47400c7fb0 0x7f474006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f47449fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f474013f780 0x7f474013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f47449fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4740140120 con 0x7f47400c7be0 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f47449fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f474006bf10 con 0x7f474013f780 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f47449fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474006b290 con 0x7f47400c7fb0 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f474013f780 0x7f474013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f474013f780 0x7f474013fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47032/0 (socket says 172.21.15.12:47032) 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473f59e700 1 -- 172.21.15.12:0/2042063388 learned_addr learned my addr 172.21.15.12:0/2042063388 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473e59c700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47400c7fb0 0x7f474006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473f59e700 1 -- 172.21.15.12:0/2042063388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47400c7fb0 msgr2=0x7f474006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.293+0000 7f473f59e700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47400c7fb0 0x7f474006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473f59e700 1 -- 172.21.15.12:0/2042063388 >> v1:172.21.15.29:6789/0 conn(0x7f47400c7be0 legacy=0x7f474015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473f59e700 1 -- 172.21.15.12:0/2042063388 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474006b570 con 0x7f474013f780 2023-10-08T16:27:09.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473f59e700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474013f780 0x7f474013fbe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f473800d1a0 tx=0x7f473800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eab2f16f696cff2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473dd9b700 1 -- 172.21.15.12:0/2042063388 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738010070 con 0x7f474013f780 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473dd9b700 1 -- 172.21.15.12:0/2042063388 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473800b0d0 con 0x7f474013f780 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.294+0000 7f473dd9b700 1 -- 172.21.15.12:0/2042063388 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473800b490 con 0x7f474013f780 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 -- 172.21.15.12:0/2042063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474013f780 msgr2=0x7f474013fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474013f780 0x7f474013fbe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f473800d1a0 tx=0x7f473800ba50 comp rx=0 tx=0).stop 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 -- 172.21.15.12:0/2042063388 shutdown_connections 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f474013f780 0x7f474013fbe0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 --2- 172.21.15.12:0/2042063388 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f47400c7fb0 0x7f474006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 -- 172.21.15.12:0/2042063388 >> 172.21.15.12:0/2042063388 conn(0x7f474006d110 msgr2=0x7f47400cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 -- 172.21.15.12:0/2042063388 shutdown_connections 2023-10-08T16:27:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.295+0000 7f47449fe700 1 -- 172.21.15.12:0/2042063388 wait complete. 2023-10-08T16:27:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.296+0000 7f47449fe700 1 Processor -- start 2023-10-08T16:27:09.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.296+0000 7f47449fe700 1 -- start start 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 0x7f4740168f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f474013f780 0x7f474013d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400c31e0 con 0x7f47400c7be0 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47400c4490 con 0x7f47400c7fb0 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f47449fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47400c33f0 con 0x7f474013f780 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f473ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f473ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47038/0 (socket says 172.21.15.12:47038) 2023-10-08T16:27:09.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.297+0000 7f473ed9d700 1 -- 172.21.15.12:0/1929173287 learned_addr learned my addr 172.21.15.12:0/1929173287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473f59e700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f474013f780 0x7f474013d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473e59c700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 0x7f4740168f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 -- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f474013f780 msgr2=0x7f474013d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f474013f780 0x7f474013d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 -- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 msgr2=0x7f4740168f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 0x7f4740168f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 -- 172.21.15.12:0/1929173287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473800bcf0 con 0x7f47400c7be0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473e59c700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 0x7f4740168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f473ed9d700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f473000c590 tx=0x7f473000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011590 con 0x7f47400c7be0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4730011710 con 0x7f47400c7be0 2023-10-08T16:27:09.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4730011ad0 con 0x7f47400c7be0 2023-10-08T16:27:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.298+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47400c36d0 con 0x7f47400c7be0 2023-10-08T16:27:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.299+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47400c3f70 con 0x7f47400c7be0 2023-10-08T16:27:09.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.300+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47400c38c0 con 0x7f47400c7be0 2023-10-08T16:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.300+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 48) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f473001b3b0 con 0x7f47400c7be0 2023-10-08T16:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.302+0000 7f4726ffd700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 0x7f472c069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.302+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f4730083f40 con 0x7f47400c7be0 2023-10-08T16:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.302+0000 7f473e59c700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 0x7f472c069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:09.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.302+0000 7f473e59c700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 0x7f472c069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4740159920 tx=0x7f4734008040 comp rx=0 tx=0).ready entity=mgr.7476 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:09.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.305+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4730050c00 con 0x7f47400c7be0 2023-10-08T16:27:09.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:09.562+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f4740140120 con 0x7f47400c7be0 2023-10-08T16:27:10.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.278+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f4730050fd0 con 0x7f47400c7be0 2023-10-08T16:27:10.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.279+0000 7f4726ffd700 1 -- 172.21.15.12:0/1929173287 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v49) v1 ==== 93+0+0 (secure 0 0 0) 0x7f4730054690 con 0x7f47400c7be0 2023-10-08T16:27:10.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 msgr2=0x7f472c069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 0x7f472c069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4740159920 tx=0x7f4734008040 comp rx=0 tx=0).stop 2023-10-08T16:27:10.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 msgr2=0x7f47400c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f473000c590 tx=0x7f473000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 shutdown_connections 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f472c0671c0 0x7f472c069670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f47400c7be0 0x7f47400c5940 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f474013f780 0x7f474013d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 --2- 172.21.15.12:0/1929173287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f47400c7fb0 0x7f4740168f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 >> 172.21.15.12:0/1929173287 conn(0x7f474006d110 msgr2=0x7f474013ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 shutdown_connections 2023-10-08T16:27:10.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.282+0000 7f47449fe700 1 -- 172.21.15.12:0/1929173287 wait complete. 2023-10-08T16:27:10.302 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:27:10.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:27:10.394 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:27:10.474 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:27:10.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:27:10.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:10.474 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:27:10.561 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:27:10.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:10.562 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:27:10.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:10.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.828+0000 7fd7ef59d700 1 Processor -- start 2023-10-08T16:27:10.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.828+0000 7fd7ef59d700 1 -- start start 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.829+0000 7fd7ef59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 0x7fd7e806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.829+0000 7fd7ef59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 0x7fd7e806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ef59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80ca480 con 0x7fd7e806bd20 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ef59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e815e240 con 0x7fd7e8142c00 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ef59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e806b350 con 0x7fd7e80c7f90 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7eed9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 0x7fd7e806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ee59b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 0x7fd7e806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7edd9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fd7e806bd20 0x7fd7e80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:59214/0 (socket says 172.21.15.12:59214) 2023-10-08T16:27:10.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7edd9a700 1 -- 172.21.15.12:0/1356952421 learned_addr learned my addr 172.21.15.12:0/1356952421 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ed599700 1 -- 172.21.15.12:0/1356952421 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114798515 0 0) 0x7fd7e80ca480 con 0x7fd7e806bd20 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7ed599700 1 -- 172.21.15.12:0/1356952421 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d4003570 con 0x7fd7e806bd20 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7eed9c700 1 -- 172.21.15.12:0/1356952421 >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 msgr2=0x7fd7e806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.830+0000 7fd7eed9c700 1 --2- 172.21.15.12:0/1356952421 >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 0x7fd7e806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7eed9c700 1 -- 172.21.15.12:0/1356952421 >> v1:172.21.15.29:6789/0 conn(0x7fd7e806bd20 legacy=0x7fd7e80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7eed9c700 1 -- 172.21.15.12:0/1356952421 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e815df60 con 0x7fd7e80c7f90 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7ee59b700 1 --2- 172.21.15.12:0/1356952421 >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 0x7fd7e806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7eed9c700 1 --2- 172.21.15.12:0/1356952421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 0x7fd7e806c6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009e60 tx=0x7fd7e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5588f981d180753 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7ed599700 1 -- 172.21.15.12:0/1356952421 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000e070 con 0x7fd7e80c7f90 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7ed599700 1 -- 172.21.15.12:0/1356952421 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000bab0 con 0x7fd7e80c7f90 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.831+0000 7fd7ed599700 1 -- 172.21.15.12:0/1356952421 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000be70 con 0x7fd7e80c7f90 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 -- 172.21.15.12:0/1356952421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 msgr2=0x7fd7e806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/1356952421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 0x7fd7e806c6a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009e60 tx=0x7fd7e0009780 comp rx=0 tx=0).stop 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 -- 172.21.15.12:0/1356952421 shutdown_connections 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/1356952421 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e80c7f90 0x7fd7e806c6a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/1356952421 >> v2:172.21.15.29:3300/0 conn(0x7fd7e8142c00 0x7fd7e806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 -- 172.21.15.12:0/1356952421 >> 172.21.15.12:0/1356952421 conn(0x7fd7e80675a0 msgr2=0x7fd7e80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 -- 172.21.15.12:0/1356952421 shutdown_connections 2023-10-08T16:27:10.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.832+0000 7fd7ef59d700 1 -- 172.21.15.12:0/1356952421 wait complete. 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.833+0000 7fd7ef59d700 1 Processor -- start 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.833+0000 7fd7ef59d700 1 -- start start 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e806bd20 0x7fd7e815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e8142c00 0x7fd7e813b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c2c70 con 0x7fd7e80c7f90 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e815ea10 con 0x7fd7e8142c00 2023-10-08T16:27:10.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.834+0000 7fd7ef59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e815ecf0 con 0x7fd7e806bd20 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7ee59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e806bd20 0x7fd7e815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47058/0 (socket says 172.21.15.12:47058) 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 -- 172.21.15.12:0/2016391680 learned_addr learned my addr 172.21.15.12:0/2016391680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7eed9c700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e8142c00 0x7fd7e813b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e806bd20 msgr2=0x7fd7e815e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e806bd20 0x7fd7e815e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e8142c00 msgr2=0x7fd7e813b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e8142c00 0x7fd7e813b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 -- 172.21.15.12:0/2016391680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4009420 con 0x7fd7e80c7f90 2023-10-08T16:27:10.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.835+0000 7fd7edd9a700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c7c0 tx=0x7fd7d8007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.836+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8005c00 con 0x7fd7e80c7f90 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.836+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8005d60 con 0x7fd7e80c7f90 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.836+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8007320 con 0x7fd7e80c7f90 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.836+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e0009a20 con 0x7fd7e80c7f90 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.836+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e80c4de0 con 0x7fd7e80c7f90 2023-10-08T16:27:10.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.837+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e80c4c40 con 0x7fd7e80c7f90 2023-10-08T16:27:10.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.839+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd7d801b3b0 con 0x7fd7e80c7f90 2023-10-08T16:27:10.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.840+0000 7fd7de7fc700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 0x7fd7cc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:10.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.840+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fd7d8084090 con 0x7fd7e80c7f90 2023-10-08T16:27:10.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.840+0000 7fd7ee59b700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 msgr2=0x7fd7cc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:10.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.840+0000 7fd7ee59b700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 0x7fd7cc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:10.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:10.844+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7e80c4c40 con 0x7fd7e80c7f90 2023-10-08T16:27:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.041+0000 7fd7ee59b700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 msgr2=0x7fd7cc069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:11.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.041+0000 7fd7ee59b700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 0x7fd7cc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:11.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.091+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7e80c4c40 con 0x7fd7e80c7f90 2023-10-08T16:27:11.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.091+0000 7fd7de7fc700 1 -- 172.21.15.12:0/2016391680 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fd7e80c4c40 con 0x7fd7e80c7f90 2023-10-08T16:27:11.093 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:11.094 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 msgr2=0x7fd7cc069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 0x7fd7cc069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 msgr2=0x7fd7e815f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c7c0 tx=0x7fd7d8007dd0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 shutdown_connections 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd7cc067170 0x7fd7cc069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd7e8142c00 0x7fd7e813b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7e806bd20 0x7fd7e815e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 --2- 172.21.15.12:0/2016391680 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7e80c7f90 0x7fd7e815f790 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 >> 172.21.15.12:0/2016391680 conn(0x7fd7e80675a0 msgr2=0x7fd7e806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:11.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 shutdown_connections 2023-10-08T16:27:11.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.094+0000 7fd7ef59d700 1 -- 172.21.15.12:0/2016391680 wait complete. 2023-10-08T16:27:11.096 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:27:11.113 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.306+0000 7f2875d9d700 1 Processor -- start 2023-10-08T16:27:11.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.306+0000 7f2875d9d700 1 -- start start 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f2875d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006f3a0 0x7f287014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f2875d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f287006e470 0x7f28701501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f2875d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287006a490 con 0x7f287006e0a0 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f2875d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700c7230 con 0x7f287006e470 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f2875d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287006b930 con 0x7f287006f3a0 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f287559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f287006e470 0x7f28701501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f287559c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f287006e470 0x7f28701501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47060/0 (socket says 172.21.15.12:47060) 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f287559c700 1 -- 172.21.15.12:0/4053189047 learned_addr learned my addr 172.21.15.12:0/4053189047 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:11.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f286ffff700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006f3a0 0x7f287014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.308+0000 7f287559c700 1 -- 172.21.15.12:0/4053189047 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006f3a0 msgr2=0x7f287014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f287559c700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006f3a0 0x7f287014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f287559c700 1 -- 172.21.15.12:0/4053189047 >> v1:172.21.15.29:6789/0 conn(0x7f287006e0a0 legacy=0x7f28700c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f287559c700 1 -- 172.21.15.12:0/4053189047 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700c7490 con 0x7f287006e470 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f286f7fe700 1 -- 172.21.15.12:0/4053189047 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723391928 0 0) 0x7f287006a490 con 0x7f287006e0a0 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f287559c700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006e470 0x7f28701501b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f286800d1a0 tx=0x7f286800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9805435f2301bf96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f286f7fe700 1 -- 172.21.15.12:0/4053189047 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2868010070 con 0x7f287006e470 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f286f7fe700 1 -- 172.21.15.12:0/4053189047 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800de10 con 0x7f287006e470 2023-10-08T16:27:11.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.309+0000 7f286f7fe700 1 -- 172.21.15.12:0/4053189047 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800b320 con 0x7f287006e470 2023-10-08T16:27:11.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 -- 172.21.15.12:0/4053189047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006e470 msgr2=0x7f28701501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006e470 0x7f28701501b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f286800d1a0 tx=0x7f286800ba50 comp rx=0 tx=0).stop 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 -- 172.21.15.12:0/4053189047 shutdown_connections 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006e470 0x7f28701501b0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 --2- 172.21.15.12:0/4053189047 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006f3a0 0x7f287014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 -- 172.21.15.12:0/4053189047 >> 172.21.15.12:0/4053189047 conn(0x7f287006d170 msgr2=0x7f28700cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 -- 172.21.15.12:0/4053189047 shutdown_connections 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.310+0000 7f2875d9d700 1 -- 172.21.15.12:0/4053189047 wait complete. 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.311+0000 7f2875d9d700 1 Processor -- start 2023-10-08T16:27:11.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.311+0000 7f2875d9d700 1 -- start start 2023-10-08T16:27:11.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f287006e0a0 0x7f28701584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006e470 0x7f28700c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870158020 con 0x7f287006f3a0 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870157130 con 0x7f287006e0a0 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.312+0000 7f2875d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870157410 con 0x7f287006e470 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47068/0 (socket says 172.21.15.12:47068) 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 -- 172.21.15.12:0/1473451932 learned_addr learned my addr 172.21.15.12:0/1473451932 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f286ffff700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006e470 0x7f28700c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f2874d9b700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f287006e0a0 0x7f28701584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006e470 msgr2=0x7f28700c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006e470 0x7f28700c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f287006e0a0 msgr2=0x7f28701584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f287006e0a0 0x7f28701584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 -- 172.21.15.12:0/1473451932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286800bcf0 con 0x7f287006f3a0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.313+0000 7f287559c700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2870071320 tx=0x7f286801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.314+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286800ac90 con 0x7f287006f3a0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.314+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286800adf0 con 0x7f287006f3a0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.314+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701576f0 con 0x7f287006f3a0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.314+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28680286b0 con 0x7f287006f3a0 2023-10-08T16:27:11.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.314+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2870157cb0 con 0x7f287006f3a0 2023-10-08T16:27:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.315+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287004c3c0 con 0x7f287006f3a0 2023-10-08T16:27:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.316+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2868003040 con 0x7f287006f3a0 2023-10-08T16:27:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.317+0000 7f286cff9700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 0x7f2854069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.317+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f2868088de0 con 0x7f287006f3a0 2023-10-08T16:27:11.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.321+0000 7f2874d9b700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 msgr2=0x7f2854069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:11.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.321+0000 7f2874d9b700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 0x7f2854069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:11.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.321+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2868055990 con 0x7f287006f3a0 2023-10-08T16:27:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.522+0000 7f2874d9b700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 msgr2=0x7f2854069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.522+0000 7f2874d9b700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 0x7f2854069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:11.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.525+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28700c7770 con 0x7f287006f3a0 2023-10-08T16:27:11.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.526+0000 7f286cff9700 1 -- 172.21.15.12:0/1473451932 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16426 (secure 0 0 0) 0x7f2868058fb0 con 0x7f287006f3a0 2023-10-08T16:27:11.527 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:11.527 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":116,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:08.258493+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:6836/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1999722044":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/3895767093":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/2985334558":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1146732295":"2023-10-09T16:26:06.519092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 msgr2=0x7f2854069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 0x7f2854069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 msgr2=0x7f2870168cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f2870071320 tx=0x7f286801a000 comp rx=0 tx=0).stop 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 shutdown_connections 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2854067170 0x7f2854069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f287006f3a0 0x7f2870168cd0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f287006e0a0 0x7f28701584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 --2- 172.21.15.12:0/1473451932 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f287006e470 0x7f28700c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 >> 172.21.15.12:0/1473451932 conn(0x7f287006d170 msgr2=0x7f28700c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 shutdown_connections 2023-10-08T16:27:11.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.529+0000 7f2875d9d700 1 -- 172.21.15.12:0/1473451932 wait complete. 2023-10-08T16:27:11.548 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:25:43.230140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:25:44.019008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:27:11.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:27:11.610 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:11.610+0000 7f2d3b15d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:27:11.637 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:11.636+0000 7f4df7c32180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:27:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.741+0000 7fd24199d700 1 Processor -- start 2023-10-08T16:27:11.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.741+0000 7fd24199d700 1 -- start start 2023-10-08T16:27:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.742+0000 7fd24199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24199d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd23c0cea00 0x7fd23c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24199d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c15ac50 con 0x7fd23c15de50 2023-10-08T16:27:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24199d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c15d010 con 0x7fd23c0cea00 2023-10-08T16:27:11.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15af60 con 0x7fd23c153a00 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd23c0cea00 0x7fd23c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24099b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24099b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:56590/0 (socket says 172.21.15.12:56590) 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd23c0cea00 0x7fd23c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47076/0 (socket says 172.21.15.12:47076) 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24099b700 1 -- 172.21.15.12:0/1212987924 learned_addr learned my addr 172.21.15.12:0/1212987924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.743+0000 7fd24119c700 1 -- 172.21.15.12:0/1212987924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 msgr2=0x7fd23c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:11.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd24119c700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd24119c700 1 -- 172.21.15.12:0/1212987924 >> v1:172.21.15.29:6789/0 conn(0x7fd23c15de50 legacy=0x7fd23c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd24119c700 1 -- 172.21.15.12:0/1212987924 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c15b240 con 0x7fd23c0cea00 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd23b7fe700 1 -- 172.21.15.12:0/1212987924 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609767060 0 0) 0x7fd23c15ac50 con 0x7fd23c15de50 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd24099b700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd24119c700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c0cea00 0x7fd23c0cee40 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd234009e60 tx=0x7fd234009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4e6a130ef46be4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd23b7fe700 1 -- 172.21.15.12:0/1212987924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400e070 con 0x7fd23c0cea00 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd23b7fe700 1 -- 172.21.15.12:0/1212987924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400bb60 con 0x7fd23c0cea00 2023-10-08T16:27:11.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.744+0000 7fd23b7fe700 1 -- 172.21.15.12:0/1212987924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234012430 con 0x7fd23c0cea00 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 -- 172.21.15.12:0/1212987924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c0cea00 msgr2=0x7fd23c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c0cea00 0x7fd23c0cee40 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fd234009e60 tx=0x7fd234009780 comp rx=0 tx=0).stop 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 -- 172.21.15.12:0/1212987924 shutdown_connections 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c0cea00 0x7fd23c0cee40 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 --2- 172.21.15.12:0/1212987924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c153a00 0x7fd23c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 -- 172.21.15.12:0/1212987924 >> 172.21.15.12:0/1212987924 conn(0x7fd23c0703a0 msgr2=0x7fd23c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 -- 172.21.15.12:0/1212987924 shutdown_connections 2023-10-08T16:27:11.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.745+0000 7fd24199d700 1 -- 172.21.15.12:0/1212987924 wait complete. 2023-10-08T16:27:11.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.747+0000 7fd24199d700 1 Processor -- start 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.747+0000 7fd24199d700 1 -- start start 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c0cea00 0x7fd23c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c15de50 0x7fd23c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c157ff0 con 0x7fd23c15de50 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0cb870 con 0x7fd23c153a00 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0ca2d0 con 0x7fd23c0cea00 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24099b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c0cea00 0x7fd23c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd24119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c15de50 0x7fd23c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:11.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd23bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:60866/0 (socket says 172.21.15.12:60866) 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd23bfff700 1 -- 172.21.15.12:0/665366229 learned_addr learned my addr 172.21.15.12:0/665366229 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.748+0000 7fd23bfff700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c0cea00 msgr2=0x7fd23c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd23bfff700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c0cea00 0x7fd23c0cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd23bfff700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c15de50 msgr2=0x7fd23c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd23bfff700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c15de50 0x7fd23c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd23bfff700 1 -- 172.21.15.12:0/665366229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2300094f0 con 0x7fd23c153a00 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd23bfff700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c530 tx=0x7fd22800c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228011590 con 0x7fd23c153a00 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228011710 con 0x7fd23c153a00 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd228011ad0 con 0x7fd23c153a00 2023-10-08T16:27:11.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd234009a20 con 0x7fd23c153a00 2023-10-08T16:27:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.749+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0cbe10 con 0x7fd23c153a00 2023-10-08T16:27:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.751+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c158160 con 0x7fd23c153a00 2023-10-08T16:27:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.751+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd22801b3b0 con 0x7fd23c153a00 2023-10-08T16:27:11.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.752+0000 7fd238ff9700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 0x7fd220069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.752+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fd228084040 con 0x7fd23c153a00 2023-10-08T16:27:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.752+0000 7fd24099b700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 msgr2=0x7fd220069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:11.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.752+0000 7fd24099b700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 0x7fd220069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:11.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.761+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd228050d00 con 0x7fd23c153a00 2023-10-08T16:27:11.785 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:11.784+0000 7f2d3b15d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:11.835 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:11.835+0000 7f4df7c32180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:11.874 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:11.874+0000 7f2d3b15d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:27:11.924 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:11.924+0000 7f4df7c32180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:27:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.953+0000 7fd24099b700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 msgr2=0x7fd220069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:11.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.953+0000 7fd24099b700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 0x7fd220069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:11.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.991+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd23c04c3f0 con 0x7fd23c153a00 2023-10-08T16:27:11.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.992+0000 7fd238ff9700 1 -- 172.21.15.12:0/665366229 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd228017070 con 0x7fd23c153a00 2023-10-08T16:27:11.993 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:27:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 msgr2=0x7fd220069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:11.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 0x7fd220069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 msgr2=0x7fd23c0c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c530 tx=0x7fd22800c840 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 shutdown_connections 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd220067170 0x7fd220069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd23c15de50 0x7fd23c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd23c0cea00 0x7fd23c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 --2- 172.21.15.12:0/665366229 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd23c153a00 0x7fd23c0c9c60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 >> 172.21.15.12:0/665366229 conn(0x7fd23c0703a0 msgr2=0x7fd23c0c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 shutdown_connections 2023-10-08T16:27:11.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:11.996+0000 7fd24199d700 1 -- 172.21.15.12:0/665366229 wait complete. 2023-10-08T16:27:12.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:27:12.105 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:12.105+0000 7f2d3b15d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:12.177 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:12.176+0000 7f4df7c32180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:12.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.226+0000 7f00c939d700 1 Processor -- start 2023-10-08T16:27:12.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.226+0000 7f00c939d700 1 -- start start 2023-10-08T16:27:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.227+0000 7f00c939d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 0x7f00c415a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.227+0000 7f00c939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.227+0000 7f00c939d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c415ada0 con 0x7f00c4154060 2023-10-08T16:27:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.227+0000 7f00c939d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c406ca80 con 0x7f00c4153c90 2023-10-08T16:27:12.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.227+0000 7f00c939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c406cd60 con 0x7f00c406db20 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:41484/0 (socket says 172.21.15.12:41484) 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 -- 172.21.15.12:0/3071122758 learned_addr learned my addr 172.21.15.12:0/3071122758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c8b9c700 1 --1- 172.21.15.12:0/3071122758 >> v1:172.21.15.29:6789/0 conn(0x7f00c4154060 0x7f00c406a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:34912/0 (socket says 172.21.15.12:34912) 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c3fff700 1 --2- 172.21.15.12:0/3071122758 >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 0x7f00c415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c2ffd700 1 -- 172.21.15.12:0/3071122758 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3033736948 0 0) 0x7f00bc001490 con 0x7f00c4154060 2023-10-08T16:27:12.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c2ffd700 1 -- 172.21.15.12:0/3071122758 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac003570 con 0x7f00c4154060 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 -- 172.21.15.12:0/3071122758 >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 msgr2=0x7f00c415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 --2- 172.21.15.12:0/3071122758 >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 0x7f00c415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 -- 172.21.15.12:0/3071122758 >> v1:172.21.15.29:6789/0 conn(0x7f00c4154060 legacy=0x7f00c406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c37fe700 1 -- 172.21.15.12:0/3071122758 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c406d040 con 0x7f00c406db20 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.228+0000 7f00c3fff700 1 --2- 172.21.15.12:0/3071122758 >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 0x7f00c415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c37fe700 1 --2- 172.21.15.12:0/3071122758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00b80099b0 tx=0x7f00b8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d397b9cbce12d24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c2ffd700 1 -- 172.21.15.12:0/3071122758 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800b680 con 0x7f00c406db20 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c2ffd700 1 -- 172.21.15.12:0/3071122758 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b800b7e0 con 0x7f00c406db20 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c2ffd700 1 -- 172.21.15.12:0/3071122758 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800bb80 con 0x7f00c406db20 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c939d700 1 -- 172.21.15.12:0/3071122758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 msgr2=0x7f00c40ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.229+0000 7f00c939d700 1 --2- 172.21.15.12:0/3071122758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00b80099b0 tx=0x7f00b8009250 comp rx=0 tx=0).stop 2023-10-08T16:27:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 -- 172.21.15.12:0/3071122758 shutdown_connections 2023-10-08T16:27:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 --2- 172.21.15.12:0/3071122758 >> v2:172.21.15.29:3300/0 conn(0x7f00c4153c90 0x7f00c415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 --2- 172.21.15.12:0/3071122758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40ca7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 -- 172.21.15.12:0/3071122758 >> 172.21.15.12:0/3071122758 conn(0x7f00c406e720 msgr2=0x7f00c406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:12.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 -- 172.21.15.12:0/3071122758 shutdown_connections 2023-10-08T16:27:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.230+0000 7f00c939d700 1 -- 172.21.15.12:0/3071122758 wait complete. 2023-10-08T16:27:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.231+0000 7f00c939d700 1 Processor -- start 2023-10-08T16:27:12.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.231+0000 7f00c939d700 1 -- start start 2023-10-08T16:27:12.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c4153c90 0x7f00c40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c4154060 0x7f00c40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b1a10 con 0x7f00c4153c90 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40b02c0 con 0x7f00c4154060 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40c9120 con 0x7f00c406db20 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c4153c90 0x7f00c40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:41488/0 (socket says 172.21.15.12:41488) 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c3fff700 1 -- 172.21.15.12:0/78743442 learned_addr learned my addr 172.21.15.12:0/78743442 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.232+0000 7f00c8b9c700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c4154060 0x7f00c40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c4154060 msgr2=0x7f00c40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c4154060 0x7f00c40c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c4153c90 msgr2=0x7f00c40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c4153c90 0x7f00c40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 -- 172.21.15.12:0/78743442 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009420 con 0x7f00c406db20 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c3fff700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ecb0 tx=0x7f00b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400c920 con 0x7f00c406db20 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400ca80 con 0x7f00c406db20 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b80094f0 con 0x7f00c406db20 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.233+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400ce00 con 0x7f00c406db20 2023-10-08T16:27:12.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.234+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40afc70 con 0x7f00c406db20 2023-10-08T16:27:12.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.234+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c404c3c0 con 0x7f00c406db20 2023-10-08T16:27:12.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.236+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f00b4013680 con 0x7f00c406db20 2023-10-08T16:27:12.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.236+0000 7f00abfff700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 0x7f00b0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.237+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f00b4084e80 con 0x7f00c406db20 2023-10-08T16:27:12.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.237+0000 7f00c37fe700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 msgr2=0x7f00b0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:12.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.237+0000 7f00c37fe700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 0x7f00b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.241+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b4051b40 con 0x7f00c406db20 2023-10-08T16:27:12.293 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:12.292+0000 7f2d3b15d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:27:12.366 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:12.365+0000 7f4df7c32180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:27:12.388 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:12.388+0000 7f2d3b15d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:27:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.438+0000 7f00c37fe700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 msgr2=0x7f00b0069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:12.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.438+0000 7f00c37fe700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 0x7f00b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:12.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.446+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00c415cfe0 con 0x7f00c406db20 2023-10-08T16:27:12.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.446+0000 7f00abfff700 1 -- 172.21.15.12:0/78743442 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f00b4055160 con 0x7f00c406db20 2023-10-08T16:27:12.447 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:27:12.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 msgr2=0x7f00b0069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:12.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 0x7f00b0069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 msgr2=0x7f00c40b0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f00b400ecb0 tx=0x7f00b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 shutdown_connections 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f00b0067170 0x7f00b0069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c4154060 0x7f00c40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c406db20 0x7f00c40b0750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 --2- 172.21.15.12:0/78743442 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c4153c90 0x7f00c40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 >> 172.21.15.12:0/78743442 conn(0x7f00c406e720 msgr2=0x7f00c4153510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 shutdown_connections 2023-10-08T16:27:12.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.449+0000 7f00c939d700 1 -- 172.21.15.12:0/78743442 wait complete. 2023-10-08T16:27:12.464 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:12.463+0000 7f4df7c32180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:27:12.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:27:12.555 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:12.555+0000 7f2d3b15d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:27:12.637 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:12.636+0000 7f4df7c32180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:27:12.660 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:12.660+0000 7f2d3b15d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:12.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.666+0000 7f34bb59d700 1 Processor -- start 2023-10-08T16:27:12.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.666+0000 7f34bb59d700 1 -- start start 2023-10-08T16:27:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.667+0000 7f34bb59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34b415dfd0 0x7f34b40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.667+0000 7f34bb59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40acc00 con 0x7f34b4159550 2023-10-08T16:27:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.667+0000 7f34bb59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b40abff0 con 0x7f34b4159920 2023-10-08T16:27:12.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.667+0000 7f34bb59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b40ac2d0 con 0x7f34b415dfd0 2023-10-08T16:27:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.667+0000 7f34b9d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34b415dfd0 0x7f34b40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f34b415dfd0 0x7f34b40aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32846/0 (socket says 172.21.15.12:32846) 2023-10-08T16:27:12.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 -- 172.21.15.12:0/2112815667 learned_addr learned my addr 172.21.15.12:0/2112815667 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 -- 172.21.15.12:0/2112815667 >> v1:172.21.15.29:6789/0 conn(0x7f34b4159920 legacy=0x7f34b40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 -- 172.21.15.12:0/2112815667 >> v1:172.21.15.12:6789/0 conn(0x7f34b4159550 legacy=0x7f34b40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 -- 172.21.15.12:0/2112815667 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b40ac5b0 con 0x7f34b415dfd0 2023-10-08T16:27:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9599700 1 -- 172.21.15.12:0/2112815667 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2688947855 0 0) 0x7f34b40acc00 con 0x7f34b4159550 2023-10-08T16:27:12.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.668+0000 7f34b9d9a700 1 --2- 172.21.15.12:0/2112815667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b415dfd0 0x7f34b40aedb0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f34a40099b0 tx=0x7f34a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b512a205e04eaea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34b9599700 1 -- 172.21.15.12:0/2112815667 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400b860 con 0x7f34b415dfd0 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34b9599700 1 -- 172.21.15.12:0/2112815667 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a400b9c0 con 0x7f34b415dfd0 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34b9599700 1 -- 172.21.15.12:0/2112815667 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a400bd60 con 0x7f34b415dfd0 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 -- 172.21.15.12:0/2112815667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b415dfd0 msgr2=0x7f34b40aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 --2- 172.21.15.12:0/2112815667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b415dfd0 0x7f34b40aedb0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f34a40099b0 tx=0x7f34a4009250 comp rx=0 tx=0).stop 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 -- 172.21.15.12:0/2112815667 shutdown_connections 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 --2- 172.21.15.12:0/2112815667 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b415dfd0 0x7f34b40aedb0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 -- 172.21.15.12:0/2112815667 >> 172.21.15.12:0/2112815667 conn(0x7f34b406ce80 msgr2=0x7f34b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 -- 172.21.15.12:0/2112815667 shutdown_connections 2023-10-08T16:27:12.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.669+0000 7f34bb59d700 1 -- 172.21.15.12:0/2112815667 wait complete. 2023-10-08T16:27:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.671+0000 7f34bb59d700 1 Processor -- start 2023-10-08T16:27:12.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.671+0000 7f34bb59d700 1 -- start start 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34b4159920 0x7f34b40b2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b415dfd0 0x7f34b40b2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b1500 con 0x7f34b4159550 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b17a0 con 0x7f34b415dfd0 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bb59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b40b1a80 con 0x7f34b4159920 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34ba59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34ba59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32860/0 (socket says 172.21.15.12:32860) 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34ba59b700 1 -- 172.21.15.12:0/3297317402 learned_addr learned my addr 172.21.15.12:0/3297317402 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34b9d9a700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34b4159920 0x7f34b40b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.672+0000 7f34bad9c700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b415dfd0 0x7f34b40b2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34b4159920 msgr2=0x7f34b40b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34b4159920 0x7f34b40b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b415dfd0 msgr2=0x7f34b40b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b415dfd0 0x7f34b40b2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 -- 172.21.15.12:0/3297317402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a40094f0 con 0x7f34b4159550 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34ba59b700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c7e0 tx=0x7f34b0007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0011590 con 0x7f34b4159550 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0011710 con 0x7f34b4159550 2023-10-08T16:27:12.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0011ad0 con 0x7f34b4159550 2023-10-08T16:27:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b40b1d60 con 0x7f34b4159550 2023-10-08T16:27:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.673+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b4154e40 con 0x7f34b4159550 2023-10-08T16:27:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.674+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b40b2280 con 0x7f34b4159550 2023-10-08T16:27:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.675+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f34b001b3b0 con 0x7f34b4159550 2023-10-08T16:27:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.677+0000 7f34aa7fc700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 0x7f3498069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.677+0000 7f34b9d9a700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 msgr2=0x7f3498069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.677+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f34b0084080 con 0x7f34b4159550 2023-10-08T16:27:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.677+0000 7f34b9d9a700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 0x7f3498069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.681+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34b40b2280 con 0x7f34b4159550 2023-10-08T16:27:12.746 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:12.745+0000 7f4df7c32180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.878+0000 7f34b9d9a700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 msgr2=0x7f3498069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:12.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.878+0000 7f34b9d9a700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 0x7f3498069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:12.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.884+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34b40b2280 con 0x7f34b4159550 2023-10-08T16:27:12.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.884+0000 7f34aa7fc700 1 -- 172.21.15.12:0/3297317402 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f34b40b2280 con 0x7f34b4159550 2023-10-08T16:27:12.885 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.886+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 msgr2=0x7f3498069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.886+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 0x7f3498069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.886+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 msgr2=0x7f34b4155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.886+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c7e0 tx=0x7f34b0007da0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 shutdown_connections 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3498067170 0x7f3498069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f34b4159550 0x7f34b4155ef0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f34b415dfd0 0x7f34b40b2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 --2- 172.21.15.12:0/3297317402 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f34b4159920 0x7f34b40b2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 >> 172.21.15.12:0/3297317402 conn(0x7f34b406ce80 msgr2=0x7f34b40aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:12.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 shutdown_connections 2023-10-08T16:27:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:12.887+0000 7f34bb59d700 1 -- 172.21.15.12:0/3297317402 wait complete. 2023-10-08T16:27:12.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:13.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.097+0000 7efd1f59e700 1 Processor -- start 2023-10-08T16:27:13.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.098+0000 7efd1f59e700 1 -- start start 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd20153c30 0x7efd2015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2015afd0 con 0x7efd2015de50 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd2015b2b0 con 0x7efd200cf110 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd2015b590 con 0x7efd20153c30 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd20153c30 0x7efd2015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efd20153c30 0x7efd2015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32876/0 (socket says 172.21.15.12:32876) 2023-10-08T16:27:13.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1e59c700 1 -- 172.21.15.12:0/3111577933 learned_addr learned my addr 172.21.15.12:0/3111577933 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:13.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1dd9b700 1 --1- 172.21.15.12:0/3111577933 >> v1:172.21.15.12:6789/0 conn(0x7efd2015de50 0x7efd200cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36422/0 (socket says 172.21.15.12:36422) 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1e59c700 1 -- 172.21.15.12:0/3111577933 >> v1:172.21.15.29:6789/0 conn(0x7efd200cf110 legacy=0x7efd2015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.099+0000 7efd1e59c700 1 -- 172.21.15.12:0/3111577933 >> v1:172.21.15.12:6789/0 conn(0x7efd2015de50 legacy=0x7efd200cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.100+0000 7efd1e59c700 1 -- 172.21.15.12:0/3111577933 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd2015b870 con 0x7efd20153c30 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.100+0000 7efd1e59c700 1 --2- 172.21.15.12:0/3111577933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd2015a5e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7efd100099b0 tx=0x7efd10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6a1223e9f3d2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.100+0000 7efd1d59a700 1 -- 172.21.15.12:0/3111577933 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000b860 con 0x7efd20153c30 2023-10-08T16:27:13.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.100+0000 7efd1d59a700 1 -- 172.21.15.12:0/3111577933 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1000b9c0 con 0x7efd20153c30 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.100+0000 7efd1d59a700 1 -- 172.21.15.12:0/3111577933 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1000bd60 con 0x7efd20153c30 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 -- 172.21.15.12:0/3111577933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 msgr2=0x7efd2015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 --2- 172.21.15.12:0/3111577933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd2015a5e0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7efd100099b0 tx=0x7efd10009250 comp rx=0 tx=0).stop 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 -- 172.21.15.12:0/3111577933 shutdown_connections 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 --2- 172.21.15.12:0/3111577933 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd2015a5e0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 -- 172.21.15.12:0/3111577933 >> 172.21.15.12:0/3111577933 conn(0x7efd200703a0 msgr2=0x7efd200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 -- 172.21.15.12:0/3111577933 shutdown_connections 2023-10-08T16:27:13.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.101+0000 7efd1f59e700 1 -- 172.21.15.12:0/3111577933 wait complete. 2023-10-08T16:27:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.102+0000 7efd1f59e700 1 Processor -- start 2023-10-08T16:27:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.102+0000 7efd1f59e700 1 -- start start 2023-10-08T16:27:13.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efd200cf110 0x7efd200b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd2015de50 0x7efd200b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20150920 con 0x7efd20153c30 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200b60a0 con 0x7efd2015de50 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd200c7680 con 0x7efd200cf110 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.103+0000 7efd1dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32884/0 (socket says 172.21.15.12:32884) 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 -- 172.21.15.12:0/617964123 learned_addr learned my addr 172.21.15.12:0/617964123 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1e59c700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efd200cf110 0x7efd200b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1ed9d700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd2015de50 0x7efd200b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efd200cf110 msgr2=0x7efd200b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efd200cf110 0x7efd200b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd2015de50 msgr2=0x7efd200b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd2015de50 0x7efd200b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 -- 172.21.15.12:0/617964123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd100094f0 con 0x7efd20153c30 2023-10-08T16:27:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd1dd9b700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c560 tx=0x7efd14007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.104+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14005a70 con 0x7efd20153c30 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.105+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14005bd0 con 0x7efd20153c30 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.105+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140070d0 con 0x7efd20153c30 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.105+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd20159440 con 0x7efd20153c30 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.105+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd200c9c20 con 0x7efd20153c30 2023-10-08T16:27:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.106+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd200c7840 con 0x7efd20153c30 2023-10-08T16:27:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.107+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7efd14007480 con 0x7efd20153c30 2023-10-08T16:27:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.108+0000 7efd0e7fc700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 0x7efd00069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.108+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7efd14083f10 con 0x7efd20153c30 2023-10-08T16:27:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.108+0000 7efd1e59c700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 msgr2=0x7efd00069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.108+0000 7efd1e59c700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 0x7efd00069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:13.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.116+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd14050bd0 con 0x7efd20153c30 2023-10-08T16:27:13.162 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:13.162+0000 7f2d3b15d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:27:13.259 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:13.259+0000 7f2d3b15d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:27:13.261 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:13.261+0000 7f4df7c32180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:27:13.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.309+0000 7efd1e59c700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 msgr2=0x7efd00069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:13.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.309+0000 7efd1e59c700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 0x7efd00069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:13.355 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:13.355+0000 7f2d3b15d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:27:13.361 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:13.360+0000 7f4df7c32180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:27:13.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.366+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd2004c3c0 con 0x7efd20153c30 2023-10-08T16:27:13.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.367+0000 7efd0e7fc700 1 -- 172.21.15.12:0/617964123 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7efd14017020 con 0x7efd20153c30 2023-10-08T16:27:13.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:13.368 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:27:13.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 msgr2=0x7efd00069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:13.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 0x7efd00069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 msgr2=0x7efd200c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c560 tx=0x7efd14007f70 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 shutdown_connections 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efd00067170 0x7efd00069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efd2015de50 0x7efd200b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efd200cf110 0x7efd200b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 --2- 172.21.15.12:0/617964123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efd20153c30 0x7efd200c96e0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 >> 172.21.15.12:0/617964123 conn(0x7efd200703a0 msgr2=0x7efd200cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 shutdown_connections 2023-10-08T16:27:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.369+0000 7efd1f59e700 1 -- 172.21.15.12:0/617964123 wait complete. 2023-10-08T16:27:13.372 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:27:13.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:13.458 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:13.458+0000 7f4df7c32180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:27:13.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.577+0000 7f40dbfff700 1 Processor -- start 2023-10-08T16:27:13.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.577+0000 7f40dbfff700 1 -- start start 2023-10-08T16:27:13.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40dbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40dc15de50 0x7f40dc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc0cef40 0x7f40dc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40dbfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40dc0cf3c0 con 0x7f40dc153c30 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40dbfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40dc15afd0 con 0x7f40dc15de50 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40dbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc15b2b0 con 0x7f40dc0cef40 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.578+0000 7f40da7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40dc15de50 0x7f40dc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40daffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f40dc153c30 0x7f40dc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:34946/0 (socket says 172.21.15.12:34946) 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40daffd700 1 -- 172.21.15.12:0/1537337187 learned_addr learned my addr 172.21.15.12:0/1537337187 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40da7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f40dc15de50 0x7f40dc0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32900/0 (socket says 172.21.15.12:32900) 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40db7fe700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc0cef40 0x7f40dc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40da7fc700 1 -- 172.21.15.12:0/1537337187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc0cef40 msgr2=0x7f40dc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40da7fc700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc0cef40 0x7f40dc15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40da7fc700 1 -- 172.21.15.12:0/1537337187 >> v1:172.21.15.29:6789/0 conn(0x7f40dc153c30 legacy=0x7f40dc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.579+0000 7f40da7fc700 1 -- 172.21.15.12:0/1537337187 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40dc15b590 con 0x7f40dc15de50 2023-10-08T16:27:13.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40da7fc700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc15de50 0x7f40dc0cea00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40d00098e0 tx=0x7f40d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81adf3517fcee49 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40d9ffb700 1 -- 172.21.15.12:0/1537337187 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000b640 con 0x7f40dc15de50 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40d9ffb700 1 -- 172.21.15.12:0/1537337187 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000b7a0 con 0x7f40dc15de50 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40d9ffb700 1 -- 172.21.15.12:0/1537337187 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000bb40 con 0x7f40dc15de50 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40dbfff700 1 -- 172.21.15.12:0/1537337187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc15de50 msgr2=0x7f40dc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.580+0000 7f40dbfff700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc15de50 0x7f40dc0cea00 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f40d00098e0 tx=0x7f40d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 -- 172.21.15.12:0/1537337187 shutdown_connections 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc0cef40 0x7f40dc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 --2- 172.21.15.12:0/1537337187 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc15de50 0x7f40dc0cea00 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 -- 172.21.15.12:0/1537337187 >> 172.21.15.12:0/1537337187 conn(0x7f40dc0703a0 msgr2=0x7f40dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 -- 172.21.15.12:0/1537337187 shutdown_connections 2023-10-08T16:27:13.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.581+0000 7f40dbfff700 1 -- 172.21.15.12:0/1537337187 wait complete. 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.583+0000 7f40dbfff700 1 Processor -- start 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.583+0000 7f40dbfff700 1 -- start start 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 0x7f40dc169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0b46c0 con 0x7f40dc0cef40 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc0c8d30 con 0x7f40dc15de50 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.584+0000 7f40dbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40dc169d50 con 0x7f40dc153c30 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 0x7f40dc169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:41528/0 (socket says 172.21.15.12:41528) 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32914/0 (socket says 172.21.15.12:32914) 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40db7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 0x7f40dc169810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:33586/0 (socket says 172.21.15.12:33586) 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 -- 172.21.15.12:0/2563843157 learned_addr learned my addr 172.21.15.12:0/2563843157 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 msgr2=0x7f40dc169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 0x7f40dc169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 msgr2=0x7f40dc0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40da7fc700 1 -- 172.21.15.12:0/2563843157 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009420 con 0x7f40dc153c30 2023-10-08T16:27:13.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.585+0000 7f40daffd700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40da7fc700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40d000a010 tx=0x7f40d0017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d001bcc0 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d001be60 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d0011670 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40dc0b43e0 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.586+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40dc0c89c0 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.587+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40dc04c3c0 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.589+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f40d0011a20 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.590+0000 7f40c2ffd700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.590+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f40d00862c0 con 0x7f40dc153c30 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.590+0000 7f40daffd700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 msgr2=0x7f40c8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:13.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.590+0000 7f40daffd700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:13.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.595+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40d0052f80 con 0x7f40dc153c30 2023-10-08T16:27:13.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.791+0000 7f40daffd700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 msgr2=0x7f40c8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:13.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.791+0000 7f40daffd700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:13.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.802+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40dc0caef0 con 0x7f40dc153c30 2023-10-08T16:27:13.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.803+0000 7f40c2ffd700 1 -- 172.21.15.12:0/2563843157 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16426 (secure 0 0 0) 0x7f40d00565a0 con 0x7f40dc153c30 2023-10-08T16:27:13.804 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:13.804 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":116,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:08.258493+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:6836/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1999722044":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/3895767093":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/2985334558":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1146732295":"2023-10-09T16:26:06.519092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 msgr2=0x7f40c8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 msgr2=0x7f40dc0b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f40d000a010 tx=0x7f40d0017000 comp rx=0 tx=0).stop 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 shutdown_connections 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f40c8067170 0x7f40c8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f40dc0cef40 0x7f40dc0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f40dc15de50 0x7f40dc169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 --2- 172.21.15.12:0/2563843157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f40dc153c30 0x7f40dc0b3ce0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 >> 172.21.15.12:0/2563843157 conn(0x7f40dc0703a0 msgr2=0x7f40dc0cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:14.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 shutdown_connections 2023-10-08T16:27:14.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:13.807+0000 7f40dbfff700 1 -- 172.21.15.12:0/2563843157 wait complete. 2023-10-08T16:27:14.004 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:27:14.005 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:14.005 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:14.004+0000 7f2d3b15d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:27:14.136 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:14.135+0000 7f4df7c32180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:27:14.184 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:14.184+0000 7f2d3b15d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:14.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.222+0000 7f730b1ff700 1 Processor -- start 2023-10-08T16:27:14.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.223+0000 7f730b1ff700 1 -- start start 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f730b1ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f73040cb970 0x7f7304159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f730b1ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730415ae40 con 0x7f73040cb5a0 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f730b1ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730415ab60 con 0x7f730415a400 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f730b1ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73040ce0f0 con 0x7f73040cb970 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f7308f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f73040cb5a0 0x7f73040cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36426/0 (socket says 172.21.15.12:36426) 2023-10-08T16:27:14.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.224+0000 7f7308f9b700 1 -- 172.21.15.12:0/1163917620 learned_addr learned my addr 172.21.15.12:0/1163917620 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:14.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f7303fff700 1 --2- 172.21.15.12:0/1163917620 >> v2:172.21.15.29:3300/0 conn(0x7f73040cb970 0x7f7304159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821784366 0 0) 0x7f730415ae40 con 0x7f73040cb5a0 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72f4003570 con 0x7f73040cb5a0 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163750348 0 0) 0x7f730415ab60 con 0x7f730415a400 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f730415ae40 con 0x7f730415a400 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f7303fff700 1 -- 172.21.15.12:0/1163917620 >> v1:172.21.15.29:6789/0 conn(0x7f730415a400 legacy=0x7f7304156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f7303fff700 1 -- 172.21.15.12:0/1163917620 >> v1:172.21.15.12:6789/0 conn(0x7f73040cb5a0 legacy=0x7f73040cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f7303fff700 1 -- 172.21.15.12:0/1163917620 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73040ccf00 con 0x7f73040cb970 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.225+0000 7f7303fff700 1 --2- 172.21.15.12:0/1163917620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304159ec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72f00098e0 tx=0x7f72f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f095f3fe473fc0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0011630 con 0x7f73040cb970 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0011790 con 0x7f73040cb970 2023-10-08T16:27:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f73037fe700 1 -- 172.21.15.12:0/1163917620 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0011b30 con 0x7f73040cb970 2023-10-08T16:27:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 -- 172.21.15.12:0/1163917620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 msgr2=0x7f7304159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 --2- 172.21.15.12:0/1163917620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304159ec0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f72f00098e0 tx=0x7f72f00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 -- 172.21.15.12:0/1163917620 shutdown_connections 2023-10-08T16:27:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 --2- 172.21.15.12:0/1163917620 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304159ec0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 -- 172.21.15.12:0/1163917620 >> 172.21.15.12:0/1163917620 conn(0x7f7304070e30 msgr2=0x7f73040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 -- 172.21.15.12:0/1163917620 shutdown_connections 2023-10-08T16:27:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.226+0000 7f730b1ff700 1 -- 172.21.15.12:0/1163917620 wait complete. 2023-10-08T16:27:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.228+0000 7f730b1ff700 1 Processor -- start 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.228+0000 7f730b1ff700 1 -- start start 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f730415a400 0x7f73040b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730416dc40 con 0x7f73040cb5a0 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730416df20 con 0x7f73040cb970 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730b1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730416e200 con 0x7f730415a400 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f7308f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f7303fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f7308f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32926/0 (socket says 172.21.15.12:32926) 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f7308f9b700 1 -- 172.21.15.12:0/4154299428 learned_addr learned my addr 172.21.15.12:0/4154299428 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.229+0000 7f730979c700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f730415a400 0x7f73040b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f730415a400 msgr2=0x7f73040b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f730415a400 0x7f73040b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 msgr2=0x7f7304153130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304153130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 -- 172.21.15.12:0/4154299428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f0009420 con 0x7f73040cb5a0 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7308f9b700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c790 tx=0x7f72f8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8005b30 con 0x7f73040cb5a0 2023-10-08T16:27:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8005cd0 con 0x7f73040cb5a0 2023-10-08T16:27:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007320 con 0x7f73040cb5a0 2023-10-08T16:27:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730415b070 con 0x7f73040cb5a0 2023-10-08T16:27:14.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.230+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730416d930 con 0x7f73040cb5a0 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.232+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730404c3c0 con 0x7f73040cb5a0 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.232+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f72f8012400 con 0x7f73040cb5a0 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.233+0000 7f7300ff9700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 0x7f72e8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.233+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f72f8083f70 con 0x7f73040cb5a0 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.233+0000 7f7303fff700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 msgr2=0x7f72e8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.233+0000 7f7303fff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 0x7f72e8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.237+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f804b5a0 con 0x7f73040cb5a0 2023-10-08T16:27:14.284 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:14.284+0000 7f2d3b15d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:27:14.322 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:14.321+0000 7f4df7c32180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:14.422 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:14.421+0000 7f4df7c32180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:27:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.434+0000 7f7303fff700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 msgr2=0x7f72e8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:14.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.434+0000 7f7303fff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 0x7f72e8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:14.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.490+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73040cb1c0 con 0x7f73040cb5a0 2023-10-08T16:27:14.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.491+0000 7f7300ff9700 1 -- 172.21.15.12:0/4154299428 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7f72f8017090 con 0x7f73040cb5a0 2023-10-08T16:27:14.492 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:14.492 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:27:14.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 msgr2=0x7f72e8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:14.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 0x7f72e8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 msgr2=0x7f730416d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c790 tx=0x7f72f8007e80 comp rx=0 tx=0).stop 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 shutdown_connections 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f72e8067170 0x7f72e8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f73040cb5a0 0x7f730416d3f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f730415a400 0x7f73040b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 --2- 172.21.15.12:0/4154299428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f73040cb970 0x7f7304153130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 >> 172.21.15.12:0/4154299428 conn(0x7f7304070e30 msgr2=0x7f73040ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 shutdown_connections 2023-10-08T16:27:14.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.494+0000 7f730b1ff700 1 -- 172.21.15.12:0/4154299428 wait complete. 2023-10-08T16:27:14.497 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:27:14.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:14.588 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:14.588+0000 7f2d3b15d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:27:14.686 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:14.686+0000 7f2d3b15d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:27:14.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.713+0000 7fd39c99d700 1 Processor -- start 2023-10-08T16:27:14.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.713+0000 7fd39c99d700 1 -- start start 2023-10-08T16:27:14.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.714+0000 7fd39c99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3981596d0 0x7fd39806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd39c99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd3980ca7b0 0x7fd3980cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd39c99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39806d3e0 con 0x7fd398159aa0 2023-10-08T16:27:14.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd39c99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980cb170 con 0x7fd3981596d0 2023-10-08T16:27:14.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd39c99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39806c7d0 con 0x7fd3980ca7b0 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3981596d0 0x7fd39806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd3981596d0 0x7fd39806d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32936/0 (socket says 172.21.15.12:32936) 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 -- 172.21.15.12:0/98123452 learned_addr learned my addr 172.21.15.12:0/98123452 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd396ffd700 1 --1- 172.21.15.12:0/98123452 >> v1:172.21.15.12:6789/0 conn(0x7fd398159aa0 0x7fd3980703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36442/0 (socket says 172.21.15.12:36442) 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd397fff700 1 --2- 172.21.15.12:0/98123452 >> v2:172.21.15.29:3300/0 conn(0x7fd3980ca7b0 0x7fd3980cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 -- 172.21.15.12:0/98123452 >> v2:172.21.15.29:3300/0 conn(0x7fd3980ca7b0 msgr2=0x7fd3980cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 --2- 172.21.15.12:0/98123452 >> v2:172.21.15.29:3300/0 conn(0x7fd3980ca7b0 0x7fd3980cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 -- 172.21.15.12:0/98123452 >> v1:172.21.15.12:6789/0 conn(0x7fd398159aa0 legacy=0x7fd3980703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3977fe700 1 -- 172.21.15.12:0/98123452 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39806cab0 con 0x7fd3981596d0 2023-10-08T16:27:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.715+0000 7fd3967fc700 1 -- 172.21.15.12:0/98123452 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490740318 0 0) 0x7fd39806d3e0 con 0x7fd398159aa0 2023-10-08T16:27:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.716+0000 7fd3977fe700 1 --2- 172.21.15.12:0/98123452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3981596d0 0x7fd39806d870 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd39806e230 tx=0x7fd388009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e8846de4fbf291 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.716+0000 7fd3967fc700 1 -- 172.21.15.12:0/98123452 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd388009e70 con 0x7fd3981596d0 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.716+0000 7fd3967fc700 1 -- 172.21.15.12:0/98123452 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38800b860 con 0x7fd3981596d0 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.716+0000 7fd3967fc700 1 -- 172.21.15.12:0/98123452 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bc20 con 0x7fd3981596d0 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 -- 172.21.15.12:0/98123452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3981596d0 msgr2=0x7fd39806d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 --2- 172.21.15.12:0/98123452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3981596d0 0x7fd39806d870 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd39806e230 tx=0x7fd388009250 comp rx=0 tx=0).stop 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 -- 172.21.15.12:0/98123452 shutdown_connections 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 --2- 172.21.15.12:0/98123452 >> v2:172.21.15.29:3300/0 conn(0x7fd3980ca7b0 0x7fd3980cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 --2- 172.21.15.12:0/98123452 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3981596d0 0x7fd39806d870 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 -- 172.21.15.12:0/98123452 >> 172.21.15.12:0/98123452 conn(0x7fd39806e720 msgr2=0x7fd39806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 -- 172.21.15.12:0/98123452 shutdown_connections 2023-10-08T16:27:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.717+0000 7fd39c99d700 1 -- 172.21.15.12:0/98123452 wait complete. 2023-10-08T16:27:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.718+0000 7fd39c99d700 1 Processor -- start 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.718+0000 7fd39c99d700 1 -- start start 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3981596d0 0x7fd3980afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd398159aa0 0x7fd39813e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980b0f30 con 0x7fd3980ca7b0 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980c4de0 con 0x7fd398159aa0 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd39c99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39816d6e0 con 0x7fd3981596d0 2023-10-08T16:27:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.719+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd396ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3981596d0 0x7fd3980afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32942/0 (socket says 172.21.15.12:32942) 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 -- 172.21.15.12:0/111966013 learned_addr learned my addr 172.21.15.12:0/111966013 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd397fff700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd398159aa0 0x7fd39813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3981596d0 msgr2=0x7fd3980afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3981596d0 0x7fd3980afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd398159aa0 msgr2=0x7fd39813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd398159aa0 0x7fd39813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 -- 172.21.15.12:0/111966013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880094f0 con 0x7fd3980ca7b0 2023-10-08T16:27:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.720+0000 7fd3977fe700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd388006fd0 tx=0x7fd388017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.721+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38801f070 con 0x7fd3980ca7b0 2023-10-08T16:27:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.721+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd388006b30 con 0x7fd3980ca7b0 2023-10-08T16:27:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.721+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38800bc00 con 0x7fd3980ca7b0 2023-10-08T16:27:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.721+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39816d9c0 con 0x7fd3980ca7b0 2023-10-08T16:27:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.721+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39816df80 con 0x7fd3980ca7b0 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.722+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39804c3c0 con 0x7fd3980ca7b0 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.723+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd388011630 con 0x7fd3980ca7b0 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.724+0000 7fd37f7fe700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 0x7fd384069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.724+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fd388085d90 con 0x7fd3980ca7b0 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.724+0000 7fd396ffd700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 msgr2=0x7fd384069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.724+0000 7fd396ffd700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 0x7fd384069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.728+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd388052ad0 con 0x7fd3980ca7b0 2023-10-08T16:27:14.738 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:14.737+0000 7f4df7c32180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:27:14.838 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:14.838+0000 7f4df7c32180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:27:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.925+0000 7fd396ffd700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 msgr2=0x7fd384069650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:14.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.925+0000 7fd396ffd700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 0x7fd384069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:14.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.975+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd39814c390 con 0x7fd3980ca7b0 2023-10-08T16:27:14.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.976+0000 7fd37f7fe700 1 -- 172.21.15.12:0/111966013 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4593 (secure 0 0 0) 0x7fd388028090 con 0x7fd3980ca7b0 2023-10-08T16:27:14.977 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:14.977 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:25:45.041023+0000","modified":"2023-10-08T16:25:48.586927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7251":{"gid":7251,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/1691195997","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":1691195997},{"type":"v1","addr":"172.21.15.12:6835","nonce":1691195997}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 msgr2=0x7fd384069650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 0x7fd384069650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 msgr2=0x7fd3980b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd388006fd0 tx=0x7fd388017000 comp rx=0 tx=0).stop 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 shutdown_connections 2023-10-08T16:27:14.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd3840671a0 0x7fd384069650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3980ca7b0 0x7fd3980b09f0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd398159aa0 0x7fd39813e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 --2- 172.21.15.12:0/111966013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd3981596d0 0x7fd3980afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 >> 172.21.15.12:0/111966013 conn(0x7fd39806e720 msgr2=0x7fd39815b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 shutdown_connections 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:14.978+0000 7fd39c99d700 1 -- 172.21.15.12:0/111966013 wait complete. 2023-10-08T16:27:14.980 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 49 2023-10-08T16:27:14.997 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:15.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.186+0000 7f25beb9d700 1 Processor -- start 2023-10-08T16:27:15.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.186+0000 7f25beb9d700 1 -- start start 2023-10-08T16:27:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.187+0000 7f25beb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 0x7f25b80ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.187+0000 7f25beb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 0x7f25b80aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.187+0000 7f25beb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b80acc00 con 0x7f25b8159920 2023-10-08T16:27:15.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.187+0000 7f25beb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b80abff0 con 0x7f25b815dfd0 2023-10-08T16:27:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.187+0000 7f25beb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80ac2d0 con 0x7f25b8159550 2023-10-08T16:27:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25be39c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f25b8159920 0x7f25b80ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36454/0 (socket says 172.21.15.12:36454) 2023-10-08T16:27:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25be39c700 1 -- 172.21.15.12:0/261390503 learned_addr learned my addr 172.21.15.12:0/261390503 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bd39a700 1 --2- 172.21.15.12:0/261390503 >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 0x7f25b80aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/261390503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 0x7f25b80ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bcb99700 1 -- 172.21.15.12:0/261390503 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3375046834 0 0) 0x7f25b80acc00 con 0x7f25b8159920 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bcb99700 1 -- 172.21.15.12:0/261390503 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a4003570 con 0x7f25b8159920 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 -- 172.21.15.12:0/261390503 >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 msgr2=0x7f25b80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/261390503 >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 0x7f25b80aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 -- 172.21.15.12:0/261390503 >> v1:172.21.15.12:6789/0 conn(0x7f25b8159920 legacy=0x7f25b80ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 -- 172.21.15.12:0/261390503 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b80ac5b0 con 0x7f25b8159550 2023-10-08T16:27:15.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bd39a700 1 --2- 172.21.15.12:0/261390503 >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 0x7f25b80aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.188+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/261390503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 0x7f25b80ceac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f25b40098e0 tx=0x7f25b40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bd0eab9328186c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25bcb99700 1 -- 172.21.15.12:0/261390503 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011630 con 0x7f25b8159550 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25bcb99700 1 -- 172.21.15.12:0/261390503 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4011790 con 0x7f25b8159550 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25bcb99700 1 -- 172.21.15.12:0/261390503 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011b10 con 0x7f25b8159550 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 -- 172.21.15.12:0/261390503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 msgr2=0x7f25b80ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 --2- 172.21.15.12:0/261390503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 0x7f25b80ceac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f25b40098e0 tx=0x7f25b40091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 -- 172.21.15.12:0/261390503 shutdown_connections 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 --2- 172.21.15.12:0/261390503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b8159550 0x7f25b80ceac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 --2- 172.21.15.12:0/261390503 >> v2:172.21.15.29:3300/0 conn(0x7f25b815dfd0 0x7f25b80aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.189+0000 7f25beb9d700 1 -- 172.21.15.12:0/261390503 >> 172.21.15.12:0/261390503 conn(0x7f25b806ce80 msgr2=0x7f25b80ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.190+0000 7f25beb9d700 1 -- 172.21.15.12:0/261390503 shutdown_connections 2023-10-08T16:27:15.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.190+0000 7f25beb9d700 1 -- 172.21.15.12:0/261390503 wait complete. 2023-10-08T16:27:15.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.191+0000 7f25beb9d700 1 Processor -- start 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.191+0000 7f25beb9d700 1 -- start start 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25b8159920 0x7f25b80ad090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b815dfd0 0x7f25b80ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c8c30 con 0x7f25b8159550 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c8020 con 0x7f25b8159920 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25beb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b80c8300 con 0x7f25b815dfd0 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25bdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25bdb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32958/0 (socket says 172.21.15.12:32958) 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25bdb9b700 1 -- 172.21.15.12:0/987864360 learned_addr learned my addr 172.21.15.12:0/987864360 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25bd39a700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25b8159920 0x7f25b80ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.192+0000 7f25be39c700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b815dfd0 0x7f25b80ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b815dfd0 msgr2=0x7f25b80ad5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b815dfd0 0x7f25b80ad5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25b8159920 msgr2=0x7f25b80ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25b8159920 0x7f25b80ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 -- 172.21.15.12:0/987864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8009420 con 0x7f25b8159550 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25bdb9b700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ac410 tx=0x7f25b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011900 con 0x7f25b8159550 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.193+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4011a60 con 0x7f25b8159550 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.194+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4009420 con 0x7f25b8159550 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.194+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b401a680 con 0x7f25b8159550 2023-10-08T16:27:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.194+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b80c88c0 con 0x7f25b8159550 2023-10-08T16:27:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.195+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b80c8a50 con 0x7f25b8159550 2023-10-08T16:27:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.196+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f25b401aa30 con 0x7f25b8159550 2023-10-08T16:27:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.196+0000 7f25adffb700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 0x7f259c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.196+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f25b40868d0 con 0x7f25b8159550 2023-10-08T16:27:15.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.197+0000 7f25bd39a700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 msgr2=0x7f259c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:15.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.197+0000 7f25bd39a700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 0x7f259c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:15.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.201+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25b40534c0 con 0x7f25b8159550 2023-10-08T16:27:15.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.398+0000 7f25bd39a700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 msgr2=0x7f259c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:15.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.398+0000 7f25bd39a700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 0x7f259c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:15.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.404+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b804c3c0 con 0x7f25b8159550 2023-10-08T16:27:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.404+0000 7f25adffb700 1 -- 172.21.15.12:0/987864360 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16426 (secure 0 0 0) 0x7f25b4056ae0 con 0x7f25b8159550 2023-10-08T16:27:15.406 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:15.406 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":116,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:08.258493+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:25:43.230140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-08T16:25:44.019008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.11","mappings":[{"from":1,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:6836/115415":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1999722044":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/3895767093":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/2985334558":"2023-10-09T16:26:06.519092+0000","172.21.15.12:0/1146732295":"2023-10-09T16:26:06.519092+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 msgr2=0x7f259c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 0x7f259c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 msgr2=0x7f25b80c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f25b80ac410 tx=0x7f25b4017000 comp rx=0 tx=0).stop 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 shutdown_connections 2023-10-08T16:27:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f259c067170 0x7f259c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f25b8159550 0x7f25b80c7560 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f25b815dfd0 0x7f25b80ad5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 --2- 172.21.15.12:0/987864360 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f25b8159920 0x7f25b80ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 >> 172.21.15.12:0/987864360 conn(0x7f25b806ce80 msgr2=0x7f25b806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 shutdown_connections 2023-10-08T16:27:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.407+0000 7f25beb9d700 1 -- 172.21.15.12:0/987864360 wait complete. 2023-10-08T16:27:15.423 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:15.423+0000 7f2d3b15d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:27:15.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:27:15.597 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:15.597+0000 7f4df7c32180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:27:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.616+0000 7fdd98dff700 1 Processor -- start 2023-10-08T16:27:15.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.616+0000 7fdd98dff700 1 -- start start 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd98dff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 0x7fdd9415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd98dff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd94161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd98dff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd94158210 con 0x7fdd94157600 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd98dff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd940cb850 con 0x7fdd940b1b20 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd98dff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940cb290 con 0x7fdd941579d0 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd9259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdd94157600 0x7fdd940b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36468/0 (socket says 172.21.15.12:36468) 2023-10-08T16:27:15.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd9259c700 1 -- 172.21.15.12:0/4077249167 learned_addr learned my addr 172.21.15.12:0/4077249167 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd92d9d700 1 --2- 172.21.15.12:0/4077249167 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd94161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd91d9b700 1 --2- 172.21.15.12:0/4077249167 >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 0x7fdd9415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.618+0000 7fdd9159a700 1 -- 172.21.15.12:0/4077249167 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599766774 0 0) 0x7fdd94158210 con 0x7fdd94157600 2023-10-08T16:27:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd9159a700 1 -- 172.21.15.12:0/4077249167 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd7c003570 con 0x7fdd94157600 2023-10-08T16:27:15.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd92d9d700 1 -- 172.21.15.12:0/4077249167 >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 msgr2=0x7fdd9415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd92d9d700 1 --2- 172.21.15.12:0/4077249167 >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 0x7fdd9415f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd92d9d700 1 -- 172.21.15.12:0/4077249167 >> v1:172.21.15.12:6789/0 conn(0x7fdd94157600 legacy=0x7fdd940b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd92d9d700 1 -- 172.21.15.12:0/4077249167 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd940cb570 con 0x7fdd941579d0 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd91d9b700 1 --2- 172.21.15.12:0/4077249167 >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 0x7fdd9415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd92d9d700 1 --2- 172.21.15.12:0/4077249167 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd94161800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009e60 tx=0x7fdd8c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9af9fa0ab73852b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd9159a700 1 -- 172.21.15.12:0/4077249167 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00e070 con 0x7fdd941579d0 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd9159a700 1 -- 172.21.15.12:0/4077249167 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c00bab0 con 0x7fdd941579d0 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.619+0000 7fdd9159a700 1 -- 172.21.15.12:0/4077249167 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c00be70 con 0x7fdd941579d0 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 -- 172.21.15.12:0/4077249167 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 msgr2=0x7fdd94161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 --2- 172.21.15.12:0/4077249167 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd94161800 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009e60 tx=0x7fdd8c009780 comp rx=0 tx=0).stop 2023-10-08T16:27:15.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 -- 172.21.15.12:0/4077249167 shutdown_connections 2023-10-08T16:27:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 --2- 172.21.15.12:0/4077249167 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd94161800 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 --2- 172.21.15.12:0/4077249167 >> v2:172.21.15.29:3300/0 conn(0x7fdd940b1b20 0x7fdd9415f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 -- 172.21.15.12:0/4077249167 >> 172.21.15.12:0/4077249167 conn(0x7fdd9406d170 msgr2=0x7fdd940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 -- 172.21.15.12:0/4077249167 shutdown_connections 2023-10-08T16:27:15.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.620+0000 7fdd98dff700 1 -- 172.21.15.12:0/4077249167 wait complete. 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.623+0000 7fdd98dff700 1 Processor -- start 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.623+0000 7fdd98dff700 1 -- start start 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd940b1b20 0x7fdd941558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd940c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940a71d0 con 0x7fdd94157600 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940a9b40 con 0x7fdd940b1b20 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.624+0000 7fdd98dff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd940a68a0 con 0x7fdd941579d0 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32960/0 (socket says 172.21.15.12:32960) 2023-10-08T16:27:15.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 -- 172.21.15.12:0/501759287 learned_addr learned my addr 172.21.15.12:0/501759287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd9259c700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd940b1b20 0x7fdd941558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd92d9d700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd940c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 msgr2=0x7fdd940c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd940c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd940b1b20 msgr2=0x7fdd941558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd940b1b20 0x7fdd941558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 -- 172.21.15.12:0/501759287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88009420 con 0x7fdd94157600 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.625+0000 7fdd91d9b700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800ec80 tx=0x7fdd880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.626+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800c850 con 0x7fdd94157600 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.626+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8800c9b0 con 0x7fdd94157600 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.626+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800cd30 con 0x7fdd94157600 2023-10-08T16:27:15.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.626+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c009a20 con 0x7fdd94157600 2023-10-08T16:27:15.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.626+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd940a6e60 con 0x7fdd94157600 2023-10-08T16:27:15.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.627+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9404c3c0 con 0x7fdd94157600 2023-10-08T16:27:15.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.628+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fdd88013680 con 0x7fdd94157600 2023-10-08T16:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.629+0000 7fdd827fc700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 0x7fdd74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.629+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fdd88085120 con 0x7fdd94157600 2023-10-08T16:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.629+0000 7fdd9259c700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 msgr2=0x7fdd74069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:15.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.629+0000 7fdd9259c700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 0x7fdd74069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:15.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.633+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd88055870 con 0x7fdd94157600 2023-10-08T16:27:15.714 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:15.714+0000 7f2d3b15d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:27:15.810 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:15.810+0000 7f2d3b15d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:27:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.830+0000 7fdd9259c700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 msgr2=0x7fdd74069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:15.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.830+0000 7fdd9259c700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 0x7fdd74069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:15.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.880+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdd940a7310 con 0x7fdd94157600 2023-10-08T16:27:15.881 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:27:15.881+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:27:15.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.888+0000 7fdd827fc700 1 -- 172.21.15.12:0/501759287 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdd88055400 con 0x7fdd94157600 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 msgr2=0x7fdd74069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 0x7fdd74069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 msgr2=0x7fdd940ab170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800ec80 tx=0x7fdd880091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 shutdown_connections 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd74067170 0x7fdd74069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd941579d0 0x7fdd940c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd940b1b20 0x7fdd941558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 --2- 172.21.15.12:0/501759287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd94157600 0x7fdd940ab170 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.890+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 >> 172.21.15.12:0/501759287 conn(0x7fdd9406d170 msgr2=0x7fdd940ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.891+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 shutdown_connections 2023-10-08T16:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:15.891+0000 7fdd98dff700 1 -- 172.21.15.12:0/501759287 wait complete. 2023-10-08T16:27:15.893 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:27:15.895 INFO:tasks.ceph.mds.a.smithi012.stderr: -5473> 2023-10-08T16:25:50.522+0000 7faba73f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:27:15.897 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:15.897+0000 7f4df7c32180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:27:15.910 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:27:15.943 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:27:15.973 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:15.973+0000 7f2d3b15d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:27:16.002 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.001+0000 7f4df7c32180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:27:16.084 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:16.084+0000 7f2d3b15d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:27:16.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.104+0000 7f8ddbfff700 1 Processor -- start 2023-10-08T16:27:16.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.105+0000 7f8ddbfff700 1 -- start start 2023-10-08T16:27:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc153a00 0x7f8ddc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddbfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ddc15de50 0x7f8ddc15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddbfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc15af60 con 0x7f8ddc0cea00 2023-10-08T16:27:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddbfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc15d010 con 0x7f8ddc15de50 2023-10-08T16:27:16.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc15b240 con 0x7f8ddc153a00 2023-10-08T16:27:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddaffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc153a00 0x7f8ddc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8dda7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8ddc15de50 0x7f8ddc15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8ddc0cea00 0x7f8ddc0cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36484/0 (socket says 172.21.15.12:36484) 2023-10-08T16:27:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.106+0000 7f8ddb7fe700 1 -- 172.21.15.12:0/410022052 learned_addr learned my addr 172.21.15.12:0/410022052 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:16.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dda7fc700 1 -- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc153a00 msgr2=0x7f8ddc153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc153a00 0x7f8ddc153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dda7fc700 1 -- 172.21.15.12:0/410022052 >> v1:172.21.15.12:6789/0 conn(0x7f8ddc0cea00 legacy=0x7f8ddc0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dda7fc700 1 -- 172.21.15.12:0/410022052 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc15b520 con 0x7f8ddc15de50 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dd9ffb700 1 -- 172.21.15.12:0/410022052 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 40154298 0 0) 0x7f8ddc15af60 con 0x7f8ddc0cea00 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc15de50 0x7f8ddc15a540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00098e0 tx=0x7f8dd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1413baaae639ccad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dd9ffb700 1 -- 172.21.15.12:0/410022052 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000b640 con 0x7f8ddc15de50 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dd9ffb700 1 -- 172.21.15.12:0/410022052 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd000b7a0 con 0x7f8ddc15de50 2023-10-08T16:27:16.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.107+0000 7f8dd9ffb700 1 -- 172.21.15.12:0/410022052 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000bb40 con 0x7f8ddc15de50 2023-10-08T16:27:16.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 -- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc15de50 msgr2=0x7f8ddc15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:16.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc15de50 0x7f8ddc15a540 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8dd00098e0 tx=0x7f8dd00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 -- 172.21.15.12:0/410022052 shutdown_connections 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc153a00 0x7f8ddc153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/410022052 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc15de50 0x7f8ddc15a540 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 -- 172.21.15.12:0/410022052 >> 172.21.15.12:0/410022052 conn(0x7f8ddc0703a0 msgr2=0x7f8ddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 -- 172.21.15.12:0/410022052 shutdown_connections 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.108+0000 7f8ddbfff700 1 -- 172.21.15.12:0/410022052 wait complete. 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.110+0000 7f8ddbfff700 1 Processor -- start 2023-10-08T16:27:16.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.110+0000 7f8ddbfff700 1 -- start start 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 0x7f8ddc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 0x7f8ddc0c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc15de50 0x7f8ddc0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc152760 con 0x7f8ddc0cea00 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc153dd0 con 0x7f8ddc153a00 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddbfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc0b4ae0 con 0x7f8ddc15de50 2023-10-08T16:27:16.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 0x7f8ddc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 0x7f8ddc152220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:32978/0 (socket says 172.21.15.12:32978) 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddaffd700 1 -- 172.21.15.12:0/2046387316 learned_addr learned my addr 172.21.15.12:0/2046387316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 0x7f8ddc0c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8ddb7fe700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc15de50 0x7f8ddc0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc15de50 msgr2=0x7f8ddc0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc15de50 0x7f8ddc0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 msgr2=0x7f8ddc152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 0x7f8ddc152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.111+0000 7f8dda7fc700 1 -- 172.21.15.12:0/2046387316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd0009420 con 0x7f8ddc153a00 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8dda7fc700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 0x7f8ddc0c8580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0016000 tx=0x7f8dd0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd000bb20 con 0x7f8ddc153a00 2023-10-08T16:27:16.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0000c90 con 0x7f8ddc153a00 2023-10-08T16:27:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0011630 con 0x7f8ddc153a00 2023-10-08T16:27:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc0c9a80 con 0x7f8ddc153a00 2023-10-08T16:27:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.112+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc0ca040 con 0x7f8ddc153a00 2023-10-08T16:27:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.113+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc0b48b0 con 0x7f8ddc153a00 2023-10-08T16:27:16.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.115+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 49) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f8dd00119a0 con 0x7f8ddc153a00 2023-10-08T16:27:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.116+0000 7f8dc2ffd700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.116+0000 7f8ddaffd700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 msgr2=0x7f8dc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.116+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6470+0+0 (secure 0 0 0) 0x7f8dd0085d30 con 0x7f8ddc153a00 2023-10-08T16:27:16.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.116+0000 7f8ddaffd700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:16.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.121+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dd0052970 con 0x7f8ddc153a00 2023-10-08T16:27:16.171 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.170+0000 7f4df7c32180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:27:16.283 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:16.283+0000 7f2d3b15d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:27:16.283 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.282+0000 7f4df7c32180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:27:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.317+0000 7f8ddaffd700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 msgr2=0x7f8dc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:16.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.317+0000 7f8ddaffd700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:16.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.370+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ddc04c3c0 con 0x7f8ddc153a00 2023-10-08T16:27:16.381 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:16.381+0000 7f2d3b15d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:27:16.477 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:16.477+0000 7f2d3b15d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:27:16.483 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.482+0000 7f4df7c32180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:27:16.575 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:16.575+0000 7f2d3b15d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:27:16.580 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.580+0000 7f4df7c32180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:27:16.676 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.676+0000 7f4df7c32180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:27:16.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.718+0000 7f8ddaffd700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 msgr2=0x7f8dc8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:16.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.718+0000 7f8ddaffd700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:27:16.774 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.773+0000 7f4df7c32180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:27:16.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.786+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 50) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f8dd0052d40 con 0x7f8ddc153a00 2023-10-08T16:27:16.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.787+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 msgr2=0x7f8dc8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:16.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.787+0000 7f8dc2ffd700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.856 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d76249700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d76249700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d76249700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d76249700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d76249700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d73243700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d73243700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d73243700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d73243700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.857 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:16.855+0000 7f4d73243700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:16.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.886+0000 7f8dc2ffd700 1 -- 172.21.15.12:0/2046387316 <== mon.1 v2:172.21.15.29:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8dd006d860 con 0x7f8ddc153a00 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 msgr2=0x7f8ddc0c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 0x7f8ddc0c8580 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0016000 tx=0x7f8dd0017000 comp rx=0 tx=0).stop 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 shutdown_connections 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8dc8067170 0x7f8dc8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ddc0cea00 0x7f8ddc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ddc15de50 0x7f8ddc0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 --2- 172.21.15.12:0/2046387316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ddc153a00 0x7f8ddc0c8580 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 >> 172.21.15.12:0/2046387316 conn(0x7f8ddc0703a0 msgr2=0x7f8ddc152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:16.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 shutdown_connections 2023-10-08T16:27:16.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:16.889+0000 7f8ddbfff700 1 -- 172.21.15.12:0/2046387316 wait complete. 2023-10-08T16:27:16.907 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.140+0000 7fde89b9d700 1 Processor -- start 2023-10-08T16:27:17.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.140+0000 7fde89b9d700 1 -- start start 2023-10-08T16:27:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.141+0000 7fde89b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c2a90 0x7fde84156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.141+0000 7fde89b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde840c85d0 0x7fde840cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.141+0000 7fde89b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde841579b0 con 0x7fde840c8200 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.141+0000 7fde89b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde840c1390 con 0x7fde840c85d0 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.141+0000 7fde89b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde841573f0 con 0x7fde840c2a90 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde840c85d0 0x7fde840cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fde840c85d0 0x7fde840cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33132/0 (socket says 172.21.15.12:33132) 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 -- 172.21.15.12:0/1861668677 learned_addr learned my addr 172.21.15.12:0/1861668677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:17.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde83fff700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c2a90 0x7fde84156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 -- 172.21.15.12:0/1861668677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c2a90 msgr2=0x7fde84156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:17.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c2a90 0x7fde84156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 -- 172.21.15.12:0/1861668677 >> v1:172.21.15.29:6789/0 conn(0x7fde840c8200 legacy=0x7fde840c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 -- 172.21.15.12:0/1861668677 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde841576d0 con 0x7fde840c85d0 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.142+0000 7fde8939c700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde840cc2f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00d1a0 tx=0x7fde7c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf5022caaf31918 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde837fe700 1 -- 172.21.15.12:0/1861668677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c010070 con 0x7fde840c85d0 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde837fe700 1 -- 172.21.15.12:0/1861668677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c00de10 con 0x7fde840c85d0 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde837fe700 1 -- 172.21.15.12:0/1861668677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00b320 con 0x7fde840c85d0 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 -- 172.21.15.12:0/1861668677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 msgr2=0x7fde840cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde840cc2f0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00d1a0 tx=0x7fde7c00ba50 comp rx=0 tx=0).stop 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 -- 172.21.15.12:0/1861668677 shutdown_connections 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde840cc2f0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:17.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 --2- 172.21.15.12:0/1861668677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c2a90 0x7fde84156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 -- 172.21.15.12:0/1861668677 >> 172.21.15.12:0/1861668677 conn(0x7fde8406c6a0 msgr2=0x7fde8406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 -- 172.21.15.12:0/1861668677 shutdown_connections 2023-10-08T16:27:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.143+0000 7fde89b9d700 1 -- 172.21.15.12:0/1861668677 wait complete. 2023-10-08T16:27:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.145+0000 7fde89b9d700 1 Processor -- start 2023-10-08T16:27:17.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.145+0000 7fde89b9d700 1 -- start start 2023-10-08T16:27:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde840c2a90 0x7fde840b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c8200 0x7fde84147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840acc00 con 0x7fde840c85d0 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b1520 con 0x7fde840c2a90 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde89b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde840b17c0 con 0x7fde840c8200 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde8939c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde8939c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33142/0 (socket says 172.21.15.12:33142) 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde8939c700 1 -- 172.21.15.12:0/2134116856 learned_addr learned my addr 172.21.15.12:0/2134116856 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde88b9b700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde840c2a90 0x7fde840b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.146+0000 7fde83fff700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c8200 0x7fde84147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 -- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c8200 msgr2=0x7fde84147b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c8200 0x7fde84147b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 -- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde840c2a90 msgr2=0x7fde840b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde840c2a90 0x7fde840b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:17.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 -- 172.21.15.12:0/2134116856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c00bcf0 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde8939c700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00d840 tx=0x7fde7c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c009ab0 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7c009c10 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c01e440 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.147+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde840b1aa0 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.148+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde84148040 con 0x7fde840c85d0 2023-10-08T16:27:17.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.149+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8404c3c0 con 0x7fde840c85d0 2023-10-08T16:27:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.149+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 50) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fde7c003040 con 0x7fde840c85d0 2023-10-08T16:27:17.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.150+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6814+0+0 (secure 0 0 0) 0x7fde7c086110 con 0x7fde840c85d0 2023-10-08T16:27:17.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.155+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde7c053200 con 0x7fde840c85d0 2023-10-08T16:27:17.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.361+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fde840c2280 con 0x7fde840c85d0 2023-10-08T16:27:17.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.789+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 51) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fde7c05c0d0 con 0x7fde840c85d0 2023-10-08T16:27:17.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.790+0000 7fde80ff9700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 0x7fde6806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:17.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.792+0000 7fde88b9b700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 0x7fde6806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:17.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:17.794+0000 7fde88b9b700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 0x7fde6806ee70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde78003a80 tx=0x7fde78007ec0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:17.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:27:17.896 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:27:18.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.301+0000 7fde80ff9700 1 -- 172.21.15.12:0/2134116856 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) v1 ==== 181+0+0 (secure 0 0 0) 0x7fde7c0285e0 con 0x7fde840c85d0 2023-10-08T16:27:18.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 msgr2=0x7fde6806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 0x7fde6806ee70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fde78003a80 tx=0x7fde78007ec0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 msgr2=0x7fde84158e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fde7c00d840 tx=0x7fde7c01a000 comp rx=0 tx=0).stop 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 shutdown_connections 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fde6806ca90 0x7fde6806ee70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fde840c85d0 0x7fde84158e90 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fde840c2a90 0x7fde840b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 --2- 172.21.15.12:0/2134116856 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fde840c8200 0x7fde84147b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.303+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 >> 172.21.15.12:0/2134116856 conn(0x7fde8406c6a0 msgr2=0x7fde840ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:18.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.304+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 shutdown_connections 2023-10-08T16:27:18.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.304+0000 7fde89b9d700 1 -- 172.21.15.12:0/2134116856 wait complete. 2023-10-08T16:27:18.306 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:27:18.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:27:18.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.513+0000 7f8f9679d700 1 Processor -- start 2023-10-08T16:27:18.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.513+0000 7f8f9679d700 1 -- start start 2023-10-08T16:27:18.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.514+0000 7f8f9679d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f900cacb0 0x7f8f9006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.514+0000 7f8f9679d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9006d740 con 0x7f8f9006c6a0 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.514+0000 7f8f9679d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9006cb30 con 0x7f8f90159770 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.514+0000 7f8f9679d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f90159b40 con 0x7f8f900cacb0 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f94f9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8f9006c6a0 0x7f8f900c7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36494/0 (socket says 172.21.15.12:36494) 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f94f9a700 1 -- 172.21.15.12:0/1413522543 learned_addr learned my addr 172.21.15.12:0/1413522543 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f95f9c700 1 --2- 172.21.15.12:0/1413522543 >> v2:172.21.15.12:3300/0 conn(0x7f8f900cacb0 0x7f8f9006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f87fff700 1 -- 172.21.15.12:0/1413522543 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517573285 0 0) 0x7f8f9006d740 con 0x7f8f9006c6a0 2023-10-08T16:27:18.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f87fff700 1 -- 172.21.15.12:0/1413522543 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003570 con 0x7f8f9006c6a0 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f95f9c700 1 -- 172.21.15.12:0/1413522543 >> v1:172.21.15.29:6789/0 conn(0x7f8f90159770 legacy=0x7f8f900ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f95f9c700 1 -- 172.21.15.12:0/1413522543 >> v1:172.21.15.12:6789/0 conn(0x7f8f9006c6a0 legacy=0x7f8f900c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f95f9c700 1 -- 172.21.15.12:0/1413522543 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9006ce10 con 0x7f8f900cacb0 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.515+0000 7f8f95f9c700 1 --2- 172.21.15.12:0/1413522543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9006dbd0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009e60 tx=0x7f8f88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ddf171e4b57909 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f87fff700 1 -- 172.21.15.12:0/1413522543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8800e070 con 0x7f8f900cacb0 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f87fff700 1 -- 172.21.15.12:0/1413522543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8800bb60 con 0x7f8f900cacb0 2023-10-08T16:27:18.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f87fff700 1 -- 172.21.15.12:0/1413522543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f88012430 con 0x7f8f900cacb0 2023-10-08T16:27:18.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 -- 172.21.15.12:0/1413522543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 msgr2=0x7f8f9006dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 --2- 172.21.15.12:0/1413522543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9006dbd0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8f88009e60 tx=0x7f8f88009780 comp rx=0 tx=0).stop 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 -- 172.21.15.12:0/1413522543 shutdown_connections 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 --2- 172.21.15.12:0/1413522543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9006dbd0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 -- 172.21.15.12:0/1413522543 >> 172.21.15.12:0/1413522543 conn(0x7f8f9006e790 msgr2=0x7f8f9006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 -- 172.21.15.12:0/1413522543 shutdown_connections 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.516+0000 7f8f9679d700 1 -- 172.21.15.12:0/1413522543 wait complete. 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.518+0000 7f8f9679d700 1 Processor -- start 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.518+0000 7f8f9679d700 1 -- start start 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f9006c6a0 0x7f8f9014f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:18.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f90159770 0x7f8f9015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90152f20 con 0x7f8f900cacb0 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90153970 con 0x7f8f9006c6a0 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9679d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f90153c50 con 0x7f8f90159770 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33166/0 (socket says 172.21.15.12:33166) 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 -- 172.21.15.12:0/563554725 learned_addr learned my addr 172.21.15.12:0/563554725 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f95f9c700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f90159770 0x7f8f9015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f9579b700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f9006c6a0 0x7f8f9014f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 -- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f90159770 msgr2=0x7f8f9015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f90159770 0x7f8f9015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 -- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f9006c6a0 msgr2=0x7f8f9014f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f9006c6a0 0x7f8f9014f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.519+0000 7f8f94f9a700 1 -- 172.21.15.12:0/563554725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f88009a20 con 0x7f8f900cacb0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f94f9a700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c7c0 tx=0x7f8f80007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80005b30 con 0x7f8f900cacb0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f80005c90 con 0x7f8f900cacb0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80007340 con 0x7f8f900cacb0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f90153f30 con 0x7f8f900cacb0 2023-10-08T16:27:18.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.520+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9014f9e0 con 0x7f8f900cacb0 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.521+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9004c3c0 con 0x7f8f900cacb0 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.522+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 51) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f8f8001b400 con 0x7f8f900cacb0 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.523+0000 7f8f857fa700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 0x7f8f74069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.523+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6376+0+0 (secure 0 0 0) 0x7f8f800840a0 con 0x7f8f900cacb0 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.523+0000 7f8f9579b700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 0x7f8f74069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:18.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.524+0000 7f8f9579b700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 0x7f8f74069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0037c0 tx=0x7f8f8c009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:18.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.527+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f800512d0 con 0x7f8f900cacb0 2023-10-08T16:27:18.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:18.732+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8f9006d0f0 con 0x7f8f900cacb0 2023-10-08T16:27:19.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.307+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f800516a0 con 0x7f8f900cacb0 2023-10-08T16:27:19.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.313+0000 7f8f857fa700 1 -- 172.21.15.12:0/563554725 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8f800512d0 con 0x7f8f900cacb0 2023-10-08T16:27:19.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.315+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 msgr2=0x7f8f74069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.315+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 0x7f8f74069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c0037c0 tx=0x7f8f8c009040 comp rx=0 tx=0).stop 2023-10-08T16:27:19.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.315+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 msgr2=0x7f8f9015c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.315+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000c7c0 tx=0x7f8f80007e00 comp rx=0 tx=0).stop 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 shutdown_connections 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f74066d80 0x7f8f74069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f90159770 0x7f8f9015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f9006c6a0 0x7f8f9014f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 --2- 172.21.15.12:0/563554725 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f900cacb0 0x7f8f9015c5a0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 >> 172.21.15.12:0/563554725 conn(0x7f8f9006e790 msgr2=0x7f8f90151470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 shutdown_connections 2023-10-08T16:27:19.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.316+0000 7f8f9679d700 1 -- 172.21.15.12:0/563554725 wait complete. 2023-10-08T16:27:19.319 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:27:19.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:27:19.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.524+0000 7f849cb9d700 1 Processor -- start 2023-10-08T16:27:19.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.525+0000 7f849cb9d700 1 -- start start 2023-10-08T16:27:19.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f849cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f84980aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f849cb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980ad780 con 0x7f84980ca270 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f849cb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84980cee60 con 0x7f84980accb0 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f849cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84980cf140 con 0x7f84980cc5b0 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f8497fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f84980ca270 0x7f849806e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36500/0 (socket says 172.21.15.12:36500) 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f8497fff700 1 -- 172.21.15.12:0/3318559974 learned_addr learned my addr 172.21.15.12:0/3318559974 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:19.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f8496ffd700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f84980aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.526+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157827861 0 0) 0x7f84980ad780 con 0x7f84980ca270 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8480003570 con 0x7f84980ca270 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065949553 0 0) 0x7f84980cee60 con 0x7f84980accb0 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84980ad780 con 0x7f84980accb0 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950775380 0 0) 0x7f8480003570 con 0x7f84980ca270 2023-10-08T16:27:19.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 msgr2=0x7f84980aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f84980aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 >> v1:172.21.15.29:6789/0 conn(0x7f84980accb0 legacy=0x7f84980cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849806d850 con 0x7f84980ca270 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f84900017f0 con 0x7f84980ca270 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 >> v1:172.21.15.12:6789/0 conn(0x7f84980ca270 legacy=0x7f849806e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f8480003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8480004180 0x7f8480004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980cf140 con 0x7f8480004d50 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848000bba0 con 0x7f8480004180 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848000bd60 con 0x7f84980cc5b0 2023-10-08T16:27:19.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f8497fff700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.527+0000 7f84977fe700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f8480003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8496ffd700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8480004180 0x7f8480004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 -- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 msgr2=0x7f8480003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980cc5b0 0x7f8480003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 -- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8480004180 msgr2=0x7f8480004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:19.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8480004180 0x7f8480004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 -- 172.21.15.12:0/3318559974 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8480003570 con 0x7f8480004d50 2023-10-08T16:27:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f8497fff700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84800051c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f849000a8d0 tx=0x7f8490002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8643a65f6ded3ff server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900070d0 con 0x7f8480004d50 2023-10-08T16:27:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8490007230 con 0x7f8480004d50 2023-10-08T16:27:19.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.528+0000 7f84967fc700 1 -- 172.21.15.12:0/3318559974 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84900075f0 con 0x7f8480004d50 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 -- 172.21.15.12:0/3318559974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 msgr2=0x7f84800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 --2- 172.21.15.12:0/3318559974 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84800051c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f849000a8d0 tx=0x7f8490002190 comp rx=0 tx=0).stop 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f8497fff700 1 -- 172.21.15.12:0/3318559974 reap_dead start 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 -- 172.21.15.12:0/3318559974 shutdown_connections 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 -- 172.21.15.12:0/3318559974 >> 172.21.15.12:0/3318559974 conn(0x7f849806ce80 msgr2=0x7f84980ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:19.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 -- 172.21.15.12:0/3318559974 shutdown_connections 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.529+0000 7f849cb9d700 1 -- 172.21.15.12:0/3318559974 wait complete. 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.530+0000 7f849cb9d700 1 Processor -- start 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.530+0000 7f849cb9d700 1 -- start start 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980c4510 0x7f84980b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84980c4980 0x7f84980b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84980b2420 con 0x7f8480004d50 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8498068080 con 0x7f84980c4980 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.531+0000 7f849cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8498068600 con 0x7f84980c4510 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33188/0 (socket says 172.21.15.12:33188) 2023-10-08T16:27:19.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 -- 172.21.15.12:0/715044447 learned_addr learned my addr 172.21.15.12:0/715044447 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 -- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980c4510 msgr2=0x7f84980b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980c4510 0x7f84980b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 -- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84980c4980 msgr2=0x7f84980b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84980c4980 0x7f84980b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 -- 172.21.15.12:0/715044447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84980b1470 con 0x7f8480004d50 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f84977fe700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8488002b50 tx=0x7f8488007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800fa00 con 0x7f8480004d50 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800fb80 con 0x7f8480004d50 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880133f0 con 0x7f8480004d50 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.532+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84980b4290 con 0x7f8480004d50 2023-10-08T16:27:19.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.533+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84980b2140 con 0x7f8480004d50 2023-10-08T16:27:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.533+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849804c3c0 con 0x7f8480004d50 2023-10-08T16:27:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.534+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84880137a0 con 0x7f8480004d50 2023-10-08T16:27:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.535+0000 7f847f7fe700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.535+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f8488084800 con 0x7f8480004d50 2023-10-08T16:27:19.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.535+0000 7f8496ffd700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.536+0000 7f8496ffd700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 0x7f84840693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84980b4470 tx=0x7f848c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.539+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84880518f0 con 0x7f8480004d50 2023-10-08T16:27:19.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.745+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f849806db30 con 0x7f8480004d50 2023-10-08T16:27:19.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.749+0000 7f847f7fe700 1 -- 172.21.15.12:0/715044447 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v37) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8488054f10 con 0x7f8480004d50 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 msgr2=0x7f84840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 0x7f84840693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f84980b4470 tx=0x7f848c008040 comp rx=0 tx=0).stop 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 msgr2=0x7f84981573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f8488002b50 tx=0x7f8488007d30 comp rx=0 tx=0).stop 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 shutdown_connections 2023-10-08T16:27:19.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8484066f30 0x7f84840693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8480004d50 0x7f84981573c0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f84980c4980 0x7f84980b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 --2- 172.21.15.12:0/715044447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f84980c4510 0x7f84980b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 >> 172.21.15.12:0/715044447 conn(0x7f849806ce80 msgr2=0x7f8498159290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 shutdown_connections 2023-10-08T16:27:19.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.752+0000 7f849cb9d700 1 -- 172.21.15.12:0/715044447 wait complete. 2023-10-08T16:27:19.771 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:27:19.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.959+0000 7f48ef59d700 1 Processor -- start 2023-10-08T16:27:19.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.960+0000 7f48ef59d700 1 -- start start 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ef59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e80c7be0 0x7f48e806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ef59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 0x7f48e815a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ef59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e815aed0 con 0x7f48e813f780 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ef59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e806bf10 con 0x7f48e80c7be0 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ef59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e806b290 con 0x7f48e80c7fb0 2023-10-08T16:27:19.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ee59b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e80c7be0 0x7f48e806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ee59b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e80c7be0 0x7f48e806abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33204/0 (socket says 172.21.15.12:33204) 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ee59b700 1 -- 172.21.15.12:0/2344087070 learned_addr learned my addr 172.21.15.12:0/2344087070 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48eed9c700 1 --1- 172.21.15.12:0/2344087070 >> v1:172.21.15.12:6789/0 conn(0x7f48e813f780 0x7f48e80c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36512/0 (socket says 172.21.15.12:36512) 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48edd9a700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 0x7f48e815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.961+0000 7f48ee59b700 1 -- 172.21.15.12:0/2344087070 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 msgr2=0x7f48e815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ee59b700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 0x7f48e815a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ee59b700 1 -- 172.21.15.12:0/2344087070 >> v1:172.21.15.12:6789/0 conn(0x7f48e813f780 legacy=0x7f48e80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ed599700 1 -- 172.21.15.12:0/2344087070 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745514142 0 0) 0x7f48e815aed0 con 0x7f48e813f780 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ee59b700 1 -- 172.21.15.12:0/2344087070 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e806b570 con 0x7f48e80c7be0 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48edd9a700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 0x7f48e815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:19.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ee59b700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7be0 0x7f48e806abd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f48e40099b0 tx=0x7f48e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b5dc04fc2839962 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ed599700 1 -- 172.21.15.12:0/2344087070 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400b860 con 0x7f48e80c7be0 2023-10-08T16:27:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ed599700 1 -- 172.21.15.12:0/2344087070 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400b9c0 con 0x7f48e80c7be0 2023-10-08T16:27:19.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.962+0000 7f48ed599700 1 -- 172.21.15.12:0/2344087070 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400bd60 con 0x7f48e80c7be0 2023-10-08T16:27:19.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 -- 172.21.15.12:0/2344087070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7be0 msgr2=0x7f48e806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7be0 0x7f48e806abd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f48e40099b0 tx=0x7f48e4009250 comp rx=0 tx=0).stop 2023-10-08T16:27:19.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 -- 172.21.15.12:0/2344087070 shutdown_connections 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7be0 0x7f48e806abd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 --2- 172.21.15.12:0/2344087070 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e80c7fb0 0x7f48e815a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 -- 172.21.15.12:0/2344087070 >> 172.21.15.12:0/2344087070 conn(0x7f48e806d110 msgr2=0x7f48e80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 -- 172.21.15.12:0/2344087070 shutdown_connections 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.963+0000 7f48ef59d700 1 -- 172.21.15.12:0/2344087070 wait complete. 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.964+0000 7f48ef59d700 1 Processor -- start 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.964+0000 7f48ef59d700 1 -- start start 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c7be0 0x7f48e8161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e813f780 0x7f48e813e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e81587d0 con 0x7f48e80c7fb0 2023-10-08T16:27:19.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8158ab0 con 0x7f48e80c7be0 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48ef59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e8158d90 con 0x7f48e813f780 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48edd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.965+0000 7f48edd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33208/0 (socket says 172.21.15.12:33208) 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 -- 172.21.15.12:0/958811887 learned_addr learned my addr 172.21.15.12:0/958811887 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48ee59b700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c7be0 0x7f48e8161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48eed9c700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e813f780 0x7f48e813e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 -- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e813f780 msgr2=0x7f48e813e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e813f780 0x7f48e813e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 -- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c7be0 msgr2=0x7f48e8161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c7be0 0x7f48e8161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 -- 172.21.15.12:0/958811887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e40094f0 con 0x7f48e80c7fb0 2023-10-08T16:27:19.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48edd9a700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c830 tx=0x7f48d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.966+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8011600 con 0x7f48e80c7fb0 2023-10-08T16:27:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.967+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d8011760 con 0x7f48e80c7fb0 2023-10-08T16:27:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.967+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d8011b20 con 0x7f48e80c7fb0 2023-10-08T16:27:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.967+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e8159070 con 0x7f48e80c7fb0 2023-10-08T16:27:19.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.967+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e8161770 con 0x7f48e80c7fb0 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.968+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e8159590 con 0x7f48e80c7fb0 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.969+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48d8018360 con 0x7f48e80c7fb0 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.969+0000 7f48de7fc700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.969+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f48d80845f0 con 0x7f48e80c7fb0 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.970+0000 7f48ee59b700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:19.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.970+0000 7f48ee59b700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48e40099b0 tx=0x7f48e4017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:19.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:19.974+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48e8159590 con 0x7f48e80c7fb0 2023-10-08T16:27:20.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.188+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f48e8159590 con 0x7f48e80c7fb0 2023-10-08T16:27:20.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.192+0000 7f48de7fc700 1 -- 172.21.15.12:0/958811887 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v38) v1 ==== 104+0+0 (secure 0 0 0) 0x7f48e8159590 con 0x7f48e80c7fb0 2023-10-08T16:27:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 msgr2=0x7f48cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 0x7f48cc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f48e40099b0 tx=0x7f48e4017000 comp rx=0 tx=0).stop 2023-10-08T16:27:20.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 msgr2=0x7f48e8155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f48d800c830 tx=0x7f48d8008040 comp rx=0 tx=0).stop 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 shutdown_connections 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48cc066f30 0x7f48cc0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e813f780 0x7f48e813e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e80c7be0 0x7f48e8161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 --2- 172.21.15.12:0/958811887 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e80c7fb0 0x7f48e8155990 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 >> 172.21.15.12:0/958811887 conn(0x7f48e806d110 msgr2=0x7f48e80c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 shutdown_connections 2023-10-08T16:27:20.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.195+0000 7f48ef59d700 1 -- 172.21.15.12:0/958811887 wait complete. 2023-10-08T16:27:20.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:27:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.402+0000 7fce6359e700 1 Processor -- start 2023-10-08T16:27:20.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.402+0000 7fce6359e700 1 -- start start 2023-10-08T16:27:20.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.403+0000 7fce6359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce64153a00 0x7fce64153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.403+0000 7fce6359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce6415de50 0x7fce6415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.403+0000 7fce6359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6415af60 con 0x7fce640cea00 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.403+0000 7fce6359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6415d010 con 0x7fce6415de50 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.403+0000 7fce6359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6415b240 con 0x7fce64153a00 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce6415de50 0x7fce6415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fce6415de50 0x7fce6415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33220/0 (socket says 172.21.15.12:33220) 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 -- 172.21.15.12:0/3611790093 learned_addr learned my addr 172.21.15.12:0/3611790093 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:20.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce6259c700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce64153a00 0x7fce64153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 -- 172.21.15.12:0/3611790093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce64153a00 msgr2=0x7fce64153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce64153a00 0x7fce64153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 -- 172.21.15.12:0/3611790093 >> v1:172.21.15.29:6789/0 conn(0x7fce640cea00 legacy=0x7fce640cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.404+0000 7fce61d9b700 1 -- 172.21.15.12:0/3611790093 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6415b520 con 0x7fce6415de50 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce61d9b700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce6415de50 0x7fce6415a540 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fce580099b0 tx=0x7fce58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cef04510f17c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce6159a700 1 -- 172.21.15.12:0/3611790093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce58009ea0 con 0x7fce6415de50 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce6159a700 1 -- 172.21.15.12:0/3611790093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce5800b860 con 0x7fce6415de50 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce6159a700 1 -- 172.21.15.12:0/3611790093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800bc00 con 0x7fce6415de50 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce6359e700 1 -- 172.21.15.12:0/3611790093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce6415de50 msgr2=0x7fce6415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.405+0000 7fce6359e700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce6415de50 0x7fce6415a540 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fce580099b0 tx=0x7fce58009250 comp rx=0 tx=0).stop 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 -- 172.21.15.12:0/3611790093 shutdown_connections 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce64153a00 0x7fce64153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 --2- 172.21.15.12:0/3611790093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce6415de50 0x7fce6415a540 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 -- 172.21.15.12:0/3611790093 >> 172.21.15.12:0/3611790093 conn(0x7fce640703a0 msgr2=0x7fce640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 -- 172.21.15.12:0/3611790093 shutdown_connections 2023-10-08T16:27:20.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.406+0000 7fce6359e700 1 -- 172.21.15.12:0/3611790093 wait complete. 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.407+0000 7fce6359e700 1 Processor -- start 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.407+0000 7fce6359e700 1 -- start start 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce640cea00 0x7fce640d0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce6415de50 0x7fce640cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce640c7fb0 con 0x7fce64153a00 2023-10-08T16:27:20.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce64151620 con 0x7fce6415de50 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce640cd6e0 con 0x7fce640cea00 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce61d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce61d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33236/0 (socket says 172.21.15.12:33236) 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce61d9b700 1 -- 172.21.15.12:0/1639922294 learned_addr learned my addr 172.21.15.12:0/1639922294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce6259c700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce640cea00 0x7fce640d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.408+0000 7fce62d9d700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce6415de50 0x7fce640cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 -- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce640cea00 msgr2=0x7fce640d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce640cea00 0x7fce640d0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 -- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce6415de50 msgr2=0x7fce640cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce6415de50 0x7fce640cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 -- 172.21.15.12:0/1639922294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580094f0 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce61d9b700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce6406eb00 tx=0x7fce58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5800bbe0 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce58011420 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce640c7680 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce580117c0 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.409+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce640c7c40 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.410+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce640c8160 con 0x7fce64153a00 2023-10-08T16:27:20.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.411+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce58011bf0 con 0x7fce64153a00 2023-10-08T16:27:20.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.413+0000 7fce527fc700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 0x7fce440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.413+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fce58085e80 con 0x7fce64153a00 2023-10-08T16:27:20.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.413+0000 7fce6259c700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 0x7fce440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.413+0000 7fce6259c700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 0x7fce440693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce54009db0 tx=0x7fce540091a0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.417+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce640c8160 con 0x7fce64153a00 2023-10-08T16:27:20.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.619+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fce640c8160 con 0x7fce64153a00 2023-10-08T16:27:20.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.624+0000 7fce527fc700 1 -- 172.21.15.12:0/1639922294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v39) v1 ==== 115+0+0 (secure 0 0 0) 0x7fce640c8160 con 0x7fce64153a00 2023-10-08T16:27:20.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 msgr2=0x7fce440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 0x7fce440693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce54009db0 tx=0x7fce540091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 msgr2=0x7fce640ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fce6406eb00 tx=0x7fce58017000 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 shutdown_connections 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fce44066f30 0x7fce440693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fce6415de50 0x7fce640cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fce640cea00 0x7fce640d0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 --2- 172.21.15.12:0/1639922294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fce64153a00 0x7fce640ccb40 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.626+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 >> 172.21.15.12:0/1639922294 conn(0x7fce640703a0 msgr2=0x7fce641521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.627+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 shutdown_connections 2023-10-08T16:27:20.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.627+0000 7fce6359e700 1 -- 172.21.15.12:0/1639922294 wait complete. 2023-10-08T16:27:20.645 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-10-08T16:27:20.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.831+0000 7fa8a2d9d700 1 Processor -- start 2023-10-08T16:27:20.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.831+0000 7fa8a2d9d700 1 -- start start 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a2d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 0x7fa89c160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a2d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c06a490 con 0x7fa89c06f3a0 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a2d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89c0c7230 con 0x7fa89c06e0a0 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a2d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c06b930 con 0x7fa89c150380 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a159a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa89c06f3a0 0x7fa89c14fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36524/0 (socket says 172.21.15.12:36524) 2023-10-08T16:27:20.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a159a700 1 -- 172.21.15.12:0/4083240792 learned_addr learned my addr 172.21.15.12:0/4083240792 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.833+0000 7fa8a259c700 1 --2- 172.21.15.12:0/4083240792 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 0x7fa89c160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307864293 0 0) 0x7fa89c06a490 con 0x7fa89c06f3a0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa888003570 con 0x7fa89c06f3a0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488710593 0 0) 0x7fa89c0c7230 con 0x7fa89c06e0a0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa89c06a490 con 0x7fa89c06e0a0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a259c700 1 -- 172.21.15.12:0/4083240792 >> v1:172.21.15.29:6789/0 conn(0x7fa89c06e0a0 legacy=0x7fa89c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a259c700 1 -- 172.21.15.12:0/4083240792 >> v1:172.21.15.12:6789/0 conn(0x7fa89c06f3a0 legacy=0x7fa89c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a259c700 1 -- 172.21.15.12:0/4083240792 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c0c7490 con 0x7fa89c150380 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a259c700 1 --2- 172.21.15.12:0/4083240792 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 0x7fa89c160ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa89400afa0 tx=0x7fa89400a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6bcd884b5661234 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400f070 con 0x7fa89c150380 2023-10-08T16:27:20.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400a2e0 con 0x7fa89c150380 2023-10-08T16:27:20.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.834+0000 7fa8a0d99700 1 -- 172.21.15.12:0/4083240792 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400cbf0 con 0x7fa89c150380 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4083240792 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 msgr2=0x7fa89c160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4083240792 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 0x7fa89c160ae0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa89400afa0 tx=0x7fa89400a890 comp rx=0 tx=0).stop 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4083240792 shutdown_connections 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4083240792 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c150380 0x7fa89c160ae0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4083240792 >> 172.21.15.12:0/4083240792 conn(0x7fa89c06d170 msgr2=0x7fa89c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4083240792 shutdown_connections 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.835+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4083240792 wait complete. 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.836+0000 7fa8a2d9d700 1 Processor -- start 2023-10-08T16:27:20.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.837+0000 7fa8a2d9d700 1 -- start start 2023-10-08T16:27:20.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.837+0000 7fa8a2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.837+0000 7fa8a2d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c06f3a0 0x7fa89c154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a2d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa89c150380 0x7fa89c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a2d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b1f00 con 0x7fa89c06e0a0 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a2d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0c43a0 con 0x7fa89c150380 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a2d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c0b1c20 con 0x7fa89c06f3a0 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33240/0 (socket says 172.21.15.12:33240) 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 -- 172.21.15.12:0/4235367510 learned_addr learned my addr 172.21.15.12:0/4235367510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a159a700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c06f3a0 0x7fa89c154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a259c700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa89c150380 0x7fa89c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 -- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c06f3a0 msgr2=0x7fa89c154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c06f3a0 0x7fa89c154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 -- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa89c150380 msgr2=0x7fa89c14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa89c150380 0x7fa89c14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 -- 172.21.15.12:0/4235367510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89400ab30 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.838+0000 7fa8a1d9b700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c790 tx=0x7fa898007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.839+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898010510 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.839+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898010670 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.839+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898010a10 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.839+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c0c3380 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.839+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c0c3940 con 0x7fa89c06e0a0 2023-10-08T16:27:20.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.840+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c0c31c0 con 0x7fa89c06e0a0 2023-10-08T16:27:20.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.841+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa89801b400 con 0x7fa89c06e0a0 2023-10-08T16:27:20.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.842+0000 7fa891ffb700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 0x7fa8800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:20.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.842+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7fa898084460 con 0x7fa89c06e0a0 2023-10-08T16:27:20.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.843+0000 7fa8a159a700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 0x7fa8800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:20.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.843+0000 7fa8a159a700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 0x7fa8800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa89c14f320 tx=0x7fa88c009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:20.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:20.846+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa898051550 con 0x7fa89c06e0a0 2023-10-08T16:27:21.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.128+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7fa89c04c3c0 con 0x7fa89c06e0a0 2023-10-08T16:27:21.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.315+0000 7fa891ffb700 1 -- 172.21.15.12:0/4235367510 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v685) v1 ==== 183+0+0 (secure 0 0 0) 0x7fa898054b70 con 0x7fa89c06e0a0 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.317+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 msgr2=0x7fa8800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.317+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 0x7fa8800693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa89c14f320 tx=0x7fa88c009040 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.317+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 msgr2=0x7fa89c0c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.317+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa89800c790 tx=0x7fa898007e10 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 shutdown_connections 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa880066f30 0x7fa8800693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa89c06e0a0 0x7fa89c0c3e60 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa89c150380 0x7fa89c14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 --2- 172.21.15.12:0/4235367510 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa89c06f3a0 0x7fa89c154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 >> 172.21.15.12:0/4235367510 conn(0x7fa89c06d170 msgr2=0x7fa89c0ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:21.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 shutdown_connections 2023-10-08T16:27:21.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.318+0000 7fa8a2d9d700 1 -- 172.21.15.12:0/4235367510 wait complete. 2023-10-08T16:27:21.337 INFO:tasks.cephfs_test_runner:Test that a non-existent path leads to schedule deactivation after a few retries. ... ok 2023-10-08T16:27:21.337 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-10-08T16:27:21.337 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:27:21.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-08T16:27:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.523+0000 7f531359e700 1 Processor -- start 2023-10-08T16:27:21.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.523+0000 7f531359e700 1 -- start start 2023-10-08T16:27:21.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f53140c7f90 0x7f531406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53140ca480 con 0x7f5314142fd0 2023-10-08T16:27:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f531415e240 con 0x7f5314142c00 2023-10-08T16:27:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f531406b350 con 0x7f53140c7f90 2023-10-08T16:27:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f5311d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5314142fd0 0x7f53140c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36534/0 (socket says 172.21.15.12:36534) 2023-10-08T16:27:21.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f5311d9b700 1 -- 172.21.15.12:0/2057012803 learned_addr learned my addr 172.21.15.12:0/2057012803 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f5312d9d700 1 --2- 172.21.15.12:0/2057012803 >> v2:172.21.15.29:3300/0 conn(0x7f53140c7f90 0x7f531406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1640257945 0 0) 0x7f53140ca480 con 0x7f5314142fd0 2023-10-08T16:27:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.525+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52fc003570 con 0x7f5314142fd0 2023-10-08T16:27:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366730691 0 0) 0x7f531415e240 con 0x7f5314142c00 2023-10-08T16:27:21.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53140ca480 con 0x7f5314142c00 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4250708877 0 0) 0x7f52fc003570 con 0x7f5314142fd0 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 >> v2:172.21.15.29:3300/0 conn(0x7f53140c7f90 msgr2=0x7f531406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 --2- 172.21.15.12:0/2057012803 >> v2:172.21.15.29:3300/0 conn(0x7f53140c7f90 0x7f531406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 >> v1:172.21.15.29:6789/0 conn(0x7f5314142c00 legacy=0x7f531406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531415df60 con 0x7f5314142fd0 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f5308001470 con 0x7f5314142fd0 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 >> v1:172.21.15.12:6789/0 conn(0x7f5314142fd0 legacy=0x7f53140c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52fc003c40 0x7f52fc004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52fc004810 0x7f52fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f52fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f531406b350 con 0x7f52fc005210 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc00c1b0 con 0x7f52fc004810 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc00c370 con 0x7f52fc003c40 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f5312d9d700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f52fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f5311d9b700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52fc004810 0x7f52fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.526+0000 7f531259c700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52fc003c40 0x7f52fc004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 -- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52fc003c40 msgr2=0x7f52fc004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52fc003c40 0x7f52fc004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 -- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52fc004810 msgr2=0x7f52fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52fc004810 0x7f52fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 -- 172.21.15.12:0/2057012803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc003570 con 0x7f52fc005210 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 -- 172.21.15.12:0/2057012803 reap_dead start 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f5312d9d700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f52fc00ba60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f530c0094d0 tx=0x7f530c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532c378a2b3507cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00ea90 con 0x7f52fc005210 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c00f040 con 0x7f52fc005210 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.527+0000 7f531159a700 1 -- 172.21.15.12:0/2057012803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00ee60 con 0x7f52fc005210 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 -- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 msgr2=0x7f52fc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f52fc00ba60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f530c0094d0 tx=0x7f530c00b040 comp rx=0 tx=0).stop 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 -- 172.21.15.12:0/2057012803 shutdown_connections 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 --2- 172.21.15.12:0/2057012803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f52fc00ba60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 -- 172.21.15.12:0/2057012803 >> 172.21.15.12:0/2057012803 conn(0x7f53140675a0 msgr2=0x7f53140679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 -- 172.21.15.12:0/2057012803 shutdown_connections 2023-10-08T16:27:21.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.528+0000 7f531359e700 1 -- 172.21.15.12:0/2057012803 wait complete. 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.529+0000 7f531359e700 1 Processor -- start 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 -- start start 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53140c4d00 0x7f53140c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53140cd010 0x7f53140cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53140cd9f0 con 0x7f52fc005210 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5314169e20 con 0x7f53140cd010 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.530+0000 7f531359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53140b1a50 con 0x7f53140c4d00 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33258/0 (socket says 172.21.15.12:33258) 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 -- 172.21.15.12:0/1080844517 learned_addr learned my addr 172.21.15.12:0/1080844517 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 -- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53140c4d00 msgr2=0x7f53140c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53140c4d00 0x7f53140c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 -- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53140cd010 msgr2=0x7f53140cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53140cd010 0x7f53140cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 -- 172.21.15.12:0/1080844517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140c5850 con 0x7f52fc005210 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531259c700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f530400f890 tx=0x7f5304007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304006820 con 0x7f52fc005210 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53040069a0 con 0x7f52fc005210 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.531+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53140c5b30 con 0x7f52fc005210 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.532+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5304006d60 con 0x7f52fc005210 2023-10-08T16:27:21.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.532+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53140c60f0 con 0x7f52fc005210 2023-10-08T16:27:21.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.533+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f531404c3c0 con 0x7f52fc005210 2023-10-08T16:27:21.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.533+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5304007240 con 0x7f52fc005210 2023-10-08T16:27:21.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.534+0000 7f53027fc700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:21.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.534+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f5304084750 con 0x7f52fc005210 2023-10-08T16:27:21.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.535+0000 7f5311d9b700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:21.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.535+0000 7f5311d9b700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53080015a0 tx=0x7f531406b490 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:21.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.539+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5304051840 con 0x7f52fc005210 2023-10-08T16:27:21.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:21.818+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f531406ad00 con 0x7f52fc005210 2023-10-08T16:27:22.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.317+0000 7f53027fc700 1 -- 172.21.15.12:0/1080844517 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v686) v1 ==== 151+0+0 (secure 0 0 0) 0x7f5304054e60 con 0x7f52fc005210 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 msgr2=0x7f52f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f53080015a0 tx=0x7f531406b490 comp rx=0 tx=0).stop 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 msgr2=0x7f531413fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f530400f890 tx=0x7f5304007d30 comp rx=0 tx=0).stop 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 shutdown_connections 2023-10-08T16:27:22.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52f4066f30 0x7f52f40693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52fc005210 0x7f531413fd70 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53140cd010 0x7f53140cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 --2- 172.21.15.12:0/1080844517 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53140c4d00 0x7f53140c5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 >> 172.21.15.12:0/1080844517 conn(0x7f53140675a0 msgr2=0x7f53140ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 shutdown_connections 2023-10-08T16:27:22.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.320+0000 7f531359e700 1 -- 172.21.15.12:0/1080844517 wait complete. 2023-10-08T16:27:22.340 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:27:22.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.532+0000 7f2232b9d700 1 Processor -- start 2023-10-08T16:27:22.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.532+0000 7f2232b9d700 1 -- start start 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2232b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f222c15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2232b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c15ac50 con 0x7f222c153a00 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2232b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c15d010 con 0x7f222c0cea00 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2232b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c15af60 con 0x7f222c153dd0 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2231b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f222c153a00 0x7f222c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59092/0 (socket says 172.21.15.12:59092) 2023-10-08T16:27:22.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.533+0000 7f2231b9b700 1 -- 172.21.15.12:0/3535797163 learned_addr learned my addr 172.21.15.12:0/3535797163 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f223139a700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f222c15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919704307 0 0) 0x7f222c15ac50 con 0x7f222c153a00 2023-10-08T16:27:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2218003570 con 0x7f222c153a00 2023-10-08T16:27:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2963045580 0 0) 0x7f2218003570 con 0x7f222c153a00 2023-10-08T16:27:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 msgr2=0x7f222c15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f222c15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 >> v1:172.21.15.29:6789/0 conn(0x7f222c0cea00 legacy=0x7f222c0cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c15b240 con 0x7f222c153a00 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f2228001470 con 0x7f222c153a00 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 >> v1:172.21.15.12:6789/0 conn(0x7f222c153a00 legacy=0x7f222c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f2218003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f2218004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2218004d50 0x7f22180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c15af60 con 0x7f2218003a90 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221800bb70 con 0x7f2218004d50 2023-10-08T16:27:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221800bd30 con 0x7f222c153dd0 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.534+0000 7f2231b9b700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f2218003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f223139a700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f2218004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f223239c700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2218004d50 0x7f22180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 -- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 msgr2=0x7f2218004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c153dd0 0x7f2218004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 -- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2218004d50 msgr2=0x7f22180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2218004d50 0x7f22180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 -- 172.21.15.12:0/3535797163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2218003570 con 0x7f2218003a90 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f223239c700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2218004d50 0x7f22180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2231b9b700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f2218003ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f222800c390 tx=0x7f222c0d03e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fccc57b5a41a73f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222800cc60 con 0x7f2218003a90 2023-10-08T16:27:22.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222800cdc0 con 0x7f2218003a90 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.535+0000 7f2230b99700 1 -- 172.21.15.12:0/3535797163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228005b70 con 0x7f2218003a90 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 -- 172.21.15.12:0/3535797163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 msgr2=0x7f2218003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 --2- 172.21.15.12:0/3535797163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f2218003ea0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f222800c390 tx=0x7f222c0d03e0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f223239c700 1 -- 172.21.15.12:0/3535797163 reap_dead start 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 -- 172.21.15.12:0/3535797163 shutdown_connections 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 -- 172.21.15.12:0/3535797163 >> 172.21.15.12:0/3535797163 conn(0x7f222c0703a0 msgr2=0x7f222c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 -- 172.21.15.12:0/3535797163 shutdown_connections 2023-10-08T16:27:22.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.536+0000 7f2232b9d700 1 -- 172.21.15.12:0/3535797163 wait complete. 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.537+0000 7f2232b9d700 1 Processor -- start 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.538+0000 7f2232b9d700 1 -- start start 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.538+0000 7f2232b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.538+0000 7f2232b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0c75e0 0x7f222c145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2232b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c151890 0x7f222c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2232b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c152270 con 0x7f2218003a90 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2232b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0b3820 con 0x7f222c0c75e0 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2232b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0c7d50 con 0x7f222c151890 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51846/0 (socket says 172.21.15.12:51846) 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 -- 172.21.15.12:0/403917080 learned_addr learned my addr 172.21.15.12:0/403917080 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 -- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c151890 msgr2=0x7f222c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c151890 0x7f222c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 -- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0c75e0 msgr2=0x7f222c145f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f223139a700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0c75e0 0x7f222c145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0c75e0 0x7f222c145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 -- 172.21.15.12:0/403917080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0c8030 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.539+0000 7f2231b9b700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2228007cd0 tx=0x7f2228015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.540+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228001500 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.540+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22280072e0 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.540+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22280076a0 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.540+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c0c8310 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.540+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c0c7a50 con 0x7f2218003a90 2023-10-08T16:27:22.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.541+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c0b3b50 con 0x7f2218003a90 2023-10-08T16:27:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.542+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2228019030 con 0x7f2218003a90 2023-10-08T16:27:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.543+0000 7f2221ffb700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 0x7f22100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.543+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7f2228085ce0 con 0x7f2218003a90 2023-10-08T16:27:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.543+0000 7f223139a700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 0x7f22100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:22.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.543+0000 7f223139a700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 0x7f22100693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f221c0093f0 tx=0x7f221c008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:22.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.547+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2228052dd0 con 0x7f2218003a90 2023-10-08T16:27:22.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.747+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f222c0c8830 con 0x7f2218003a90 2023-10-08T16:27:22.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.751+0000 7f2221ffb700 1 -- 172.21.15.12:0/403917080 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7f222c0c8830 con 0x7f2218003a90 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.753+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 msgr2=0x7f22100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.753+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 0x7f22100693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f221c0093f0 tx=0x7f221c008040 comp rx=0 tx=0).stop 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.753+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 msgr2=0x7f222c0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.753+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f2228007cd0 tx=0x7f2228015000 comp rx=0 tx=0).stop 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 shutdown_connections 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2210066f30 0x7f22100693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2218003a90 0x7f222c0cd020 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f222c151890 0x7f222c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 --2- 172.21.15.12:0/403917080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f222c0c75e0 0x7f222c145f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 >> 172.21.15.12:0/403917080 conn(0x7f222c0703a0 msgr2=0x7f222c1529e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 shutdown_connections 2023-10-08T16:27:22.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:22.754+0000 7f2232b9d700 1 -- 172.21.15.12:0/403917080 wait complete. 2023-10-08T16:27:22.772 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:27:22.772 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:27:22.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:27:22.949 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:27:22.949 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:27:22.949 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.136+0000 7ff479d9d700 1 Processor -- start 2023-10-08T16:27:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.136+0000 7ff479d9d700 1 -- start start 2023-10-08T16:27:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.137+0000 7ff479d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.137+0000 7ff479d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47415ae70 con 0x7ff47413fef0 2023-10-08T16:27:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.137+0000 7ff479d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47406af60 con 0x7ff47406aaa0 2023-10-08T16:27:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.137+0000 7ff479d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47406b240 con 0x7ff47413fb20 2023-10-08T16:27:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff478d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff473fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff47413fef0 0x7ff4740c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59100/0 (socket says 172.21.15.12:59100) 2023-10-08T16:27:23.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff473fff700 1 -- 172.21.15.12:0/2690585743 learned_addr learned my addr 172.21.15.12:0/2690585743 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff478d9b700 1 -- 172.21.15.12:0/2690585743 >> v1:172.21.15.29:6789/0 conn(0x7ff47406aaa0 legacy=0x7ff4740c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:23.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff478d9b700 1 -- 172.21.15.12:0/2690585743 >> v1:172.21.15.12:6789/0 conn(0x7ff47413fef0 legacy=0x7ff4740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff478d9b700 1 -- 172.21.15.12:0/2690585743 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47406b520 con 0x7ff47413fb20 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.138+0000 7ff4737fe700 1 -- 172.21.15.12:0/2690585743 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917932461 0 0) 0x7ff460001290 con 0x7ff47413fef0 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff478d9b700 1 --2- 172.21.15.12:0/2690585743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0302f287612d1a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff4737fe700 1 -- 172.21.15.12:0/2690585743 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468009e80 con 0x7ff47413fb20 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff4737fe700 1 -- 172.21.15.12:0/2690585743 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800b820 con 0x7ff47413fb20 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff4737fe700 1 -- 172.21.15.12:0/2690585743 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bba0 con 0x7ff47413fb20 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 -- 172.21.15.12:0/2690585743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 msgr2=0x7ff47415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2690585743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 -- 172.21.15.12:0/2690585743 shutdown_connections 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2690585743 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 -- 172.21.15.12:0/2690585743 >> 172.21.15.12:0/2690585743 conn(0x7ff47406d170 msgr2=0x7ff4740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.139+0000 7ff479d9d700 1 -- 172.21.15.12:0/2690585743 shutdown_connections 2023-10-08T16:27:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.140+0000 7ff479d9d700 1 -- 172.21.15.12:0/2690585743 wait complete. 2023-10-08T16:27:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.141+0000 7ff479d9d700 1 Processor -- start 2023-10-08T16:27:23.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.141+0000 7ff479d9d700 1 -- start start 2023-10-08T16:27:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47406aaa0 0x7ff4740acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740c2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740ad0a0 con 0x7ff47413fb20 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740b1e00 con 0x7ff47413fef0 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff479d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740af1b0 con 0x7ff47406aaa0 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff473fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff473fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51866/0 (socket says 172.21.15.12:51866) 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.142+0000 7ff473fff700 1 -- 172.21.15.12:0/2074602143 learned_addr learned my addr 172.21.15.12:0/2074602143 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff478d9b700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47406aaa0 0x7ff4740acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff47959c700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 -- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47406aaa0 msgr2=0x7ff4740acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47406aaa0 0x7ff4740acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 -- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 msgr2=0x7ff4740c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 -- 172.21.15.12:0/2074602143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009420 con 0x7ff47413fb20 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff47959c700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff473fff700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c590 tx=0x7ff460007e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600072e0 con 0x7ff47413fb20 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff460007480 con 0x7ff47413fb20 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600057f0 con 0x7ff47413fb20 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4740b1560 con 0x7ff47413fb20 2023-10-08T16:27:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.143+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740b1b20 con 0x7ff47413fb20 2023-10-08T16:27:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.144+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4740b12b0 con 0x7ff47413fb20 2023-10-08T16:27:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.145+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff460005be0 con 0x7ff47413fb20 2023-10-08T16:27:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.146+0000 7ff470ff9700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.146+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7ff460001e40 con 0x7ff47413fb20 2023-10-08T16:27:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.146+0000 7ff478d9b700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.147+0000 7ff478d9b700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4680030c0 tx=0x7ff468016000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.150+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff46004b5a0 con 0x7ff47413fb20 2023-10-08T16:27:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.398+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff47415ae70 con 0x7ff47413fb20 2023-10-08T16:27:23.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.399+0000 7ff470ff9700 1 -- 172.21.15.12:0/2074602143 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3520 (secure 0 0 0) 0x7ff47415ae70 con 0x7ff47413fb20 2023-10-08T16:27:23.449 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:23.449 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/253798488","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":253798488},{"type":"v1","addr":"172.21.15.29:6834","nonce":253798488}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":6985,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3239245765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3239245765},{"type":"v1","addr":"172.21.15.29:6835","nonce":3239245765}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/605027558","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":605027558},{"type":"v1","addr":"172.21.15.12:6834","nonce":605027558}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7650,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/720606394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":720606394},{"type":"v1","addr":"172.21.15.12:6835","nonce":720606394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[]} 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 msgr2=0x7ff4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff4680030c0 tx=0x7ff468016000 comp rx=0 tx=0).stop 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 msgr2=0x7ff4740b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c590 tx=0x7ff460007e20 comp rx=0 tx=0).stop 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 shutdown_connections 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47406aaa0 0x7ff4740acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 --2- 172.21.15.12:0/2074602143 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff4740b0d10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 >> 172.21.15.12:0/2074602143 conn(0x7ff47406d170 msgr2=0x7ff4740c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 shutdown_connections 2023-10-08T16:27:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.401+0000 7ff479d9d700 1 -- 172.21.15.12:0/2074602143 wait complete. 2023-10-08T16:27:23.452 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 51 2023-10-08T16:27:23.452 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:27:23.452 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:27:23.453 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:27:23.453 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:27:23.453 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:27:23.453 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:27:23.453 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:27:23.453 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:27:23.454 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:27:23.454 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:27:23.454 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:27:23.454 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:27:23.454 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:27:23.454 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:27:23.455 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:27:23.455 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:27:23.466 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:27:23.466 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:27:23.468 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:27:23.468 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:27:23.471 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:27:23.471 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:27:23.472 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:27:23.472 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:27:23.512 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:27:23.512 DEBUG:teuthology.parallel:result is None 2023-10-08T16:27:23.515 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:27:23.515 DEBUG:teuthology.parallel:result is None 2023-10-08T16:27:23.516 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:27:23.517 DEBUG:teuthology.parallel:result is None 2023-10-08T16:27:23.519 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:27:23.519 DEBUG:teuthology.parallel:result is None 2023-10-08T16:27:23.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:27:23.647 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:27:23.652 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:27:23.661 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:27:23.662 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:27:23.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.718+0000 7ffb10b9d700 1 Processor -- start 2023-10-08T16:27:23.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.718+0000 7ffb10b9d700 1 -- start start 2023-10-08T16:27:23.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb10b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb0c153c30 0x7ffb0c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb10b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb0c15de50 0x7ffb0c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb10b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c0cf3c0 con 0x7ffb0c0cef40 2023-10-08T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb10b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c15afd0 con 0x7ffb0c15de50 2023-10-08T16:27:23.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb10b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c15b2b0 con 0x7ffb0c153c30 2023-10-08T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb0affd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb0c15de50 0x7ffb0c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb0bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ffb0c0cef40 0x7ffb0c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:57526/0 (socket says 172.21.15.12:57526) 2023-10-08T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb0bfff700 1 -- 172.21.15.12:0/1419564514 learned_addr learned my addr 172.21.15.12:0/1419564514 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.720+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/1419564514 >> v2:172.21.15.29:3300/0 conn(0x7ffb0c153c30 0x7ffb0c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0b7fe700 1 -- 172.21.15.12:0/1419564514 >> v2:172.21.15.12:3300/0 conn(0x7ffb0c15de50 msgr2=0x7ffb0c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/1419564514 >> v2:172.21.15.12:3300/0 conn(0x7ffb0c15de50 0x7ffb0c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0a7fc700 1 -- 172.21.15.12:0/1419564514 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2255221662 0 0) 0x7ffb0c0cf3c0 con 0x7ffb0c0cef40 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0b7fe700 1 -- 172.21.15.12:0/1419564514 >> v1:172.21.15.29:6789/0 conn(0x7ffb0c0cef40 legacy=0x7ffb0c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0b7fe700 1 -- 172.21.15.12:0/1419564514 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c15b590 con 0x7ffb0c153c30 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/1419564514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c153c30 0x7ffb0c15a5e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06ead0 tx=0x7ffafc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff5db0734263f3f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0a7fc700 1 -- 172.21.15.12:0/1419564514 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc011630 con 0x7ffb0c153c30 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0a7fc700 1 -- 172.21.15.12:0/1419564514 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffafc011790 con 0x7ffb0c153c30 2023-10-08T16:27:23.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.721+0000 7ffb0a7fc700 1 -- 172.21.15.12:0/1419564514 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffafc011b30 con 0x7ffb0c153c30 2023-10-08T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 -- 172.21.15.12:0/1419564514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c153c30 msgr2=0x7ffb0c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/1419564514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c153c30 0x7ffb0c15a5e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06ead0 tx=0x7ffafc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 -- 172.21.15.12:0/1419564514 shutdown_connections 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/1419564514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c153c30 0x7ffb0c15a5e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/1419564514 >> v2:172.21.15.12:3300/0 conn(0x7ffb0c15de50 0x7ffb0c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 -- 172.21.15.12:0/1419564514 >> 172.21.15.12:0/1419564514 conn(0x7ffb0c0703a0 msgr2=0x7ffb0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 -- 172.21.15.12:0/1419564514 shutdown_connections 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.722+0000 7ffb10b9d700 1 -- 172.21.15.12:0/1419564514 wait complete. 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.723+0000 7ffb10b9d700 1 Processor -- start 2023-10-08T16:27:23.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.723+0000 7ffb10b9d700 1 -- start start 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 0x7ffb0c0c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c9490 con 0x7ffb0c153c30 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cb1b0 con 0x7ffb0c15de50 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb10b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0cb490 con 0x7ffb0c0cef40 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.724+0000 7ffb0affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51910/0 (socket says 172.21.15.12:51910) 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 -- 172.21.15.12:0/857127828 learned_addr learned my addr 172.21.15.12:0/857127828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0bfff700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 0x7ffb0c0c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 -- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb0c0cef40 msgr2=0x7ffb0c168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 -- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 msgr2=0x7ffb0c0c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 0x7ffb0c0c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 -- 172.21.15.12:0/857127828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc009420 con 0x7ffb0c153c30 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0bfff700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 0x7ffb0c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb0affd700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000ec80 tx=0x7ffb000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000c9d0 con 0x7ffb0c153c30 2023-10-08T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0000cb30 con 0x7ffb0c153c30 2023-10-08T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0cb770 con 0x7ffb0c153c30 2023-10-08T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.725+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00013470 con 0x7ffb0c153c30 2023-10-08T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.726+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0c8be0 con 0x7ffb0c153c30 2023-10-08T16:27:23.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.727+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c04c3c0 con 0x7ffb0c153c30 2023-10-08T16:27:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.727+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb00013820 con 0x7ffb0c153c30 2023-10-08T16:27:23.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.728+0000 7ffaf37fe700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 0x7ffaf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.728+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5933+0+0 (secure 0 0 0) 0x7ffb00084a40 con 0x7ffb0c153c30 2023-10-08T16:27:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.729+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 0x7ffaf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:23.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.729+0000 7ffb0b7fe700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 0x7ffaf80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0093f0 tx=0x7ffafc017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:23.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.732+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb00051b30 con 0x7ffb0c153c30 2023-10-08T16:27:23.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:23.956+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffb0c0caef0 con 0x7ffb0c153c30 2023-10-08T16:27:24.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.771+0000 7ffaf37fe700 1 -- 172.21.15.12:0/857127828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffb00055150 con 0x7ffb0c153c30 2023-10-08T16:27:24.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 msgr2=0x7ffaf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 0x7ffaf80693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ffafc0093f0 tx=0x7ffafc017000 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 msgr2=0x7ffb0c0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000ec80 tx=0x7ffb000091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 shutdown_connections 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffaf8066f30 0x7ffaf80693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb0c15de50 0x7ffb0c0c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb0c0cef40 0x7ffb0c168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 --2- 172.21.15.12:0/857127828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb0c153c30 0x7ffb0c0b3e90 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 >> 172.21.15.12:0/857127828 conn(0x7ffb0c0703a0 msgr2=0x7ffb0c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:24.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 shutdown_connections 2023-10-08T16:27:24.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.774+0000 7ffb10b9d700 1 -- 172.21.15.12:0/857127828 wait complete. 2023-10-08T16:27:24.777 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:27:24.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:27:24.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.988+0000 7fef3f59e700 1 Processor -- start 2023-10-08T16:27:24.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.988+0000 7fef3f59e700 1 -- start start 2023-10-08T16:27:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.989+0000 7fef3f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef400accb0 0x7fef400aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fef400cbea0 0x7fef400cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400ad780 con 0x7fef4006e330 2023-10-08T16:27:24.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400cc880 con 0x7fef400accb0 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400cee60 con 0x7fef400cbea0 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fef4006e330 0x7fef4006e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59132/0 (socket says 172.21.15.12:59132) 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef400accb0 0x7fef400aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3ed9d700 1 -- 172.21.15.12:0/505854737 learned_addr learned my addr 172.21.15.12:0/505854737 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/505854737 >> v2:172.21.15.29:3300/0 conn(0x7fef400cbea0 0x7fef400cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3e59c700 1 -- 172.21.15.12:0/505854737 >> v2:172.21.15.29:3300/0 conn(0x7fef400cbea0 msgr2=0x7fef400cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3e59c700 1 --2- 172.21.15.12:0/505854737 >> v2:172.21.15.29:3300/0 conn(0x7fef400cbea0 0x7fef400cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3e59c700 1 -- 172.21.15.12:0/505854737 >> v1:172.21.15.12:6789/0 conn(0x7fef4006e330 legacy=0x7fef4006e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3e59c700 1 -- 172.21.15.12:0/505854737 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400cf140 con 0x7fef400accb0 2023-10-08T16:27:24.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.990+0000 7fef3d59a700 1 -- 172.21.15.12:0/505854737 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555852750 0 0) 0x7fef400ad780 con 0x7fef4006e330 2023-10-08T16:27:24.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3e59c700 1 --2- 172.21.15.12:0/505854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef400aaed0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fef40088590 tx=0x7fef300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97bb6567c111ef3f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3d59a700 1 -- 172.21.15.12:0/505854737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30011630 con 0x7fef400accb0 2023-10-08T16:27:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3d59a700 1 -- 172.21.15.12:0/505854737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30011790 con 0x7fef400accb0 2023-10-08T16:27:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3d59a700 1 -- 172.21.15.12:0/505854737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30011b30 con 0x7fef400accb0 2023-10-08T16:27:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3f59e700 1 -- 172.21.15.12:0/505854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 msgr2=0x7fef400aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3f59e700 1 --2- 172.21.15.12:0/505854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef400aaed0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fef40088590 tx=0x7fef300091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.991+0000 7fef3f59e700 1 -- 172.21.15.12:0/505854737 shutdown_connections 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.992+0000 7fef3f59e700 1 --2- 172.21.15.12:0/505854737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef400aaed0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.992+0000 7fef3f59e700 1 --2- 172.21.15.12:0/505854737 >> v2:172.21.15.29:3300/0 conn(0x7fef400cbea0 0x7fef400cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.992+0000 7fef3f59e700 1 -- 172.21.15.12:0/505854737 >> 172.21.15.12:0/505854737 conn(0x7fef4006ce80 msgr2=0x7fef400ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.992+0000 7fef3f59e700 1 -- 172.21.15.12:0/505854737 shutdown_connections 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.992+0000 7fef3f59e700 1 -- 172.21.15.12:0/505854737 wait complete. 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.993+0000 7fef3f59e700 1 Processor -- start 2023-10-08T16:27:24.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.993+0000 7fef3f59e700 1 -- start start 2023-10-08T16:27:24.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 0x7fef4014b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 0x7fef4016d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4016de90 con 0x7fef400accb0 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef400c2550 con 0x7fef400cbea0 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400b1440 con 0x7fef4006e330 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51934/0 (socket says 172.21.15.12:51934) 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.994+0000 7fef3dd9b700 1 -- 172.21.15.12:0/2626609266 learned_addr learned my addr 172.21.15.12:0/2626609266 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:24.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3ed9d700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 0x7fef4016d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3e59c700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 0x7fef4014b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 -- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 msgr2=0x7fef4014b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 0x7fef4014b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 -- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 msgr2=0x7fef4016d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 0x7fef4016d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 -- 172.21.15.12:0/2626609266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30009420 con 0x7fef400accb0 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3ed9d700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 0x7fef4016d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3e59c700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 0x7fef4014b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3dd9b700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e930 tx=0x7fef340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:24.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef34009510 con 0x7fef400accb0 2023-10-08T16:27:25.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3400c850 con 0x7fef400accb0 2023-10-08T16:27:25.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3400cc10 con 0x7fef400accb0 2023-10-08T16:27:25.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.995+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4016dbb0 con 0x7fef400accb0 2023-10-08T16:27:25.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.996+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef400c21e0 con 0x7fef400accb0 2023-10-08T16:27:25.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.996+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef400c2700 con 0x7fef400accb0 2023-10-08T16:27:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.998+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef34013470 con 0x7fef400accb0 2023-10-08T16:27:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.999+0000 7fef2e7fc700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 0x7fef200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.999+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fef34084540 con 0x7fef400accb0 2023-10-08T16:27:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:24.999+0000 7fef3e59c700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 0x7fef200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.000+0000 7fef3e59c700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 0x7fef200693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef30003080 tx=0x7fef30017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.002+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef400c2700 con 0x7fef400accb0 2023-10-08T16:27:25.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.280+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fef400c26c0 con 0x7fef400accb0 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.281+0000 7fef2e7fc700 1 -- 172.21.15.12:0/2626609266 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fef34055370 con 0x7fef400accb0 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.282 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:27:25.283 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:27:25.284 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.285 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:27:25.286 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.287 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.288 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.289 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.290 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:27:25.291 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:27:25.292 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.293 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.294 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.295 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.296 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:25.297 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:27:25.297 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 msgr2=0x7fef200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 0x7fef200693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fef30003080 tx=0x7fef30017000 comp rx=0 tx=0).stop 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 msgr2=0x7fef4016cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fef3400e930 tx=0x7fef340091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 shutdown_connections 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fef20066f30 0x7fef200693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef400cbea0 0x7fef4016d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef4006e330 0x7fef4014b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 --2- 172.21.15.12:0/2626609266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef400accb0 0x7fef4016cfd0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.283+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 >> 172.21.15.12:0/2626609266 conn(0x7fef4006ce80 msgr2=0x7fef40159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.284+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 shutdown_connections 2023-10-08T16:27:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.284+0000 7fef3f59e700 1 -- 172.21.15.12:0/2626609266 wait complete. 2023-10-08T16:27:25.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:25.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.489+0000 7f2ffafff700 1 Processor -- start 2023-10-08T16:27:25.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.490+0000 7f2ffafff700 1 -- start start 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ffafff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ff41579d0 0x7f2ff41629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ffafff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff4158210 con 0x7f2ff4157600 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ffafff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff40cb290 con 0x7f2ff40b1b20 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ffafff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff40cb850 con 0x7f2ff41579d0 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ff8d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2ff4157600 0x7f2ff40b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59146/0 (socket says 172.21.15.12:59146) 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ff8d9b700 1 -- 172.21.15.12:0/2559299460 learned_addr learned my addr 172.21.15.12:0/2559299460 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:25.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ff959c700 1 --2- 172.21.15.12:0/2559299460 >> v2:172.21.15.12:3300/0 conn(0x7f2ff41579d0 0x7f2ff41629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.491+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322734857 0 0) 0x7f2ff4158210 con 0x7f2ff4157600 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe4003570 con 0x7f2ff4157600 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff959c700 1 -- 172.21.15.12:0/2559299460 >> v1:172.21.15.29:6789/0 conn(0x7f2ff40b1b20 legacy=0x7f2ff415f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345480378 0 0) 0x7f2ff40cb290 con 0x7f2ff40b1b20 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff959c700 1 -- 172.21.15.12:0/2559299460 >> v1:172.21.15.12:6789/0 conn(0x7f2ff4157600 legacy=0x7f2ff40b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff959c700 1 -- 172.21.15.12:0/2559299460 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff40cb570 con 0x7f2ff41579d0 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff959c700 1 --2- 172.21.15.12:0/2559299460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff41579d0 0x7f2ff41629e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009e60 tx=0x7f2fec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b572a9a41ff6bcb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec00e070 con 0x7f2ff41579d0 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fec00bb60 con 0x7f2ff41579d0 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.492+0000 7f2ff37fe700 1 -- 172.21.15.12:0/2559299460 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fec012430 con 0x7f2ff41579d0 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 -- 172.21.15.12:0/2559299460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff41579d0 msgr2=0x7f2ff41629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2559299460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff41579d0 0x7f2ff41629e0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f2fec009e60 tx=0x7f2fec009780 comp rx=0 tx=0).stop 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 -- 172.21.15.12:0/2559299460 shutdown_connections 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2559299460 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff41579d0 0x7f2ff41629e0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 -- 172.21.15.12:0/2559299460 >> 172.21.15.12:0/2559299460 conn(0x7f2ff406d170 msgr2=0x7f2ff40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 -- 172.21.15.12:0/2559299460 shutdown_connections 2023-10-08T16:27:25.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.493+0000 7f2ffafff700 1 -- 172.21.15.12:0/2559299460 wait complete. 2023-10-08T16:27:25.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.494+0000 7f2ffafff700 1 Processor -- start 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.495+0000 7f2ffafff700 1 -- start start 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.495+0000 7f2ffafff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 0x7f2ff40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.495+0000 7f2ffafff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ffafff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff41579d0 0x7f2ff40aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ffafff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff416a270 con 0x7f2ff4157600 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ffafff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4169400 con 0x7f2ff41579d0 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ffafff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff4169660 con 0x7f2ff40b1b20 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51946/0 (socket says 172.21.15.12:51946) 2023-10-08T16:27:25.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 -- 172.21.15.12:0/2038224008 learned_addr learned my addr 172.21.15.12:0/2038224008 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff959c700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff41579d0 0x7f2ff40aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff8d9b700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 0x7f2ff40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 -- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 msgr2=0x7f2ff40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 0x7f2ff40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 -- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff41579d0 msgr2=0x7f2ff40aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff41579d0 0x7f2ff40aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff3fff700 1 -- 172.21.15.12:0/2038224008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec009a20 con 0x7f2ff4157600 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.496+0000 7f2ff8d9b700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 0x7f2ff40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ff3fff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c7e0 tx=0x7f2fe0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0011590 con 0x7f2ff4157600 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe0011710 con 0x7f2ff4157600 2023-10-08T16:27:25.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0011ad0 con 0x7f2ff4157600 2023-10-08T16:27:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff4169940 con 0x7f2ff4157600 2023-10-08T16:27:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.497+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff4169f00 con 0x7f2ff4157600 2023-10-08T16:27:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.498+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff40c17b0 con 0x7f2ff4157600 2023-10-08T16:27:25.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.499+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fe001b3b0 con 0x7f2ff4157600 2023-10-08T16:27:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.500+0000 7f2ff0ff9700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.500+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f2fe0083950 con 0x7f2ff4157600 2023-10-08T16:27:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.500+0000 7f2ff8d9b700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.501+0000 7f2ff8d9b700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80058d0 tx=0x7f2fe8009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.504+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fe0050cf0 con 0x7f2ff4157600 2023-10-08T16:27:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.710+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff406fb80 con 0x7f2ff4157600 2023-10-08T16:27:25.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.711+0000 7f2ff0ff9700 1 -- 172.21.15.12:0/2038224008 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+12787 (secure 0 0 0) 0x7f2fe0017070 con 0x7f2ff4157600 2023-10-08T16:27:25.712 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:25.712 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":125,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:24.765350+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 msgr2=0x7f2fd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 0x7f2fd80693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80058d0 tx=0x7f2fe8009040 comp rx=0 tx=0).stop 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 msgr2=0x7f2ff414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000c7e0 tx=0x7f2fe0007df0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 shutdown_connections 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2fd8066f30 0x7f2fd80693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ff41579d0 0x7f2ff40aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ff40b1b20 0x7f2ff40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 --2- 172.21.15.12:0/2038224008 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ff4157600 0x7f2ff414c550 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 >> 172.21.15.12:0/2038224008 conn(0x7f2ff406d170 msgr2=0x7f2ff40c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 shutdown_connections 2023-10-08T16:27:25.716 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.714+0000 7f2ffafff700 1 -- 172.21.15.12:0/2038224008 wait complete. 2023-10-08T16:27:25.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:27:25.733 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:27:25.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.922+0000 7f4e00d9d700 1 Processor -- start 2023-10-08T16:27:25.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.922+0000 7f4e00d9d700 1 -- start start 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4e00d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4dfc153a00 0x7f4dfc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4e00d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dfc0cea00 0x7f4dfc0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4e00d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dfc15ac50 con 0x7f4dfc15de50 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4e00d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc15d010 con 0x7f4dfc0cea00 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4e00d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dfc0cf3c0 con 0x7f4dfc153a00 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.923+0000 7f4dfbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dfc0cea00 0x7f4dfc0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dfc0cea00 0x7f4dfc0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51954/0 (socket says 172.21.15.12:51954) 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 -- 172.21.15.12:0/4003593508 learned_addr learned my addr 172.21.15.12:0/4003593508 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfb7fe700 1 --2- 172.21.15.12:0/4003593508 >> v2:172.21.15.29:3300/0 conn(0x7f4dfc153a00 0x7f4dfc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 -- 172.21.15.12:0/4003593508 >> v2:172.21.15.29:3300/0 conn(0x7f4dfc153a00 msgr2=0x7f4dfc153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/4003593508 >> v2:172.21.15.29:3300/0 conn(0x7f4dfc153a00 0x7f4dfc153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 -- 172.21.15.12:0/4003593508 >> v1:172.21.15.29:6789/0 conn(0x7f4dfc15de50 legacy=0x7f4dfc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 -- 172.21.15.12:0/4003593508 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc15af60 con 0x7f4dfc0cea00 2023-10-08T16:27:25.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/4003593508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc0cee80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0cac20 tx=0x7f4df4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3b6f1d9d0c4160 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.924+0000 7f4dfa7fc700 1 -- 172.21.15.12:0/4003593508 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400e070 con 0x7f4dfc0cea00 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4dfa7fc700 1 -- 172.21.15.12:0/4003593508 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400ba20 con 0x7f4dfc0cea00 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4dfa7fc700 1 -- 172.21.15.12:0/4003593508 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df40092e0 con 0x7f4dfc0cea00 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 -- 172.21.15.12:0/4003593508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc0cea00 msgr2=0x7f4dfc0cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/4003593508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc0cee80 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc0cac20 tx=0x7f4df4009840 comp rx=0 tx=0).stop 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 -- 172.21.15.12:0/4003593508 shutdown_connections 2023-10-08T16:27:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/4003593508 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc0cee80 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/4003593508 >> v2:172.21.15.29:3300/0 conn(0x7f4dfc153a00 0x7f4dfc153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 -- 172.21.15.12:0/4003593508 >> 172.21.15.12:0/4003593508 conn(0x7f4dfc0703a0 msgr2=0x7f4dfc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 -- 172.21.15.12:0/4003593508 shutdown_connections 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.925+0000 7f4e00d9d700 1 -- 172.21.15.12:0/4003593508 wait complete. 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.927+0000 7f4e00d9d700 1 Processor -- start 2023-10-08T16:27:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.927+0000 7f4e00d9d700 1 -- start start 2023-10-08T16:27:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc16a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 0x7f4dfc0c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c8bd0 con 0x7f4dfc153a00 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0ca480 con 0x7f4dfc0cea00 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4e00d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dfc0c7b90 con 0x7f4dfc15de50 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51962/0 (socket says 172.21.15.12:51962) 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 -- 172.21.15.12:0/3122826942 learned_addr learned my addr 172.21.15.12:0/3122826942 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfb7fe700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc16a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 0x7f4dfc0c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 -- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 msgr2=0x7f4dfc0c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 0x7f4dfc0c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 -- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cea00 msgr2=0x7f4dfc16a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc16a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfaffd700 1 -- 172.21.15.12:0/3122826942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009ae0 con 0x7f4dfc153a00 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.928+0000 7f4dfbfff700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 0x7f4dfc0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4dfaffd700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c590 tx=0x7f4df000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0011590 con 0x7f4dfc153a00 2023-10-08T16:27:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df0011710 con 0x7f4dfc153a00 2023-10-08T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc151aa0 con 0x7f4dfc153a00 2023-10-08T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0011ad0 con 0x7f4dfc153a00 2023-10-08T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.929+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dfc151450 con 0x7f4dfc153a00 2023-10-08T16:27:25.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.930+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dfc151c30 con 0x7f4dfc153a00 2023-10-08T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.931+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df001b3b0 con 0x7f4dfc153a00 2023-10-08T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.932+0000 7f4de37fe700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.932+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f4df0083840 con 0x7f4dfc153a00 2023-10-08T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.932+0000 7f4dfb7fe700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:25.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.933+0000 7f4dfb7fe700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 0x7f4de80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009db0 tx=0x7f4dec0091a0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:25.936+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4df0050c80 con 0x7f4dfc153a00 2023-10-08T16:27:26.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.135+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4dfc04c3c0 con 0x7f4dfc153a00 2023-10-08T16:27:26.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.136+0000 7f4de37fe700 1 -- 172.21.15.12:0/3122826942 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4df0017070 con 0x7f4dfc153a00 2023-10-08T16:27:26.137 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:27:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 msgr2=0x7f4de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 0x7f4de80693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4dec009db0 tx=0x7f4dec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 msgr2=0x7f4dfc0c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f4df000c590 tx=0x7f4df000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 shutdown_connections 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dfc15de50 0x7f4dfc0c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dfc0cea00 0x7f4dfc16a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 --2- 172.21.15.12:0/3122826942 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dfc153a00 0x7f4dfc0c7650 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 >> 172.21.15.12:0/3122826942 conn(0x7f4dfc0703a0 msgr2=0x7f4dfc0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 shutdown_connections 2023-10-08T16:27:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.138+0000 7f4e00d9d700 1 -- 172.21.15.12:0/3122826942 wait complete. 2023-10-08T16:27:26.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:27:26.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.343+0000 7f3f8d79d700 1 Processor -- start 2023-10-08T16:27:26.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.344+0000 7f3f8d79d700 1 -- start start 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f8d79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f8806aaa0 0x7f3f8815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f8d79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8815ae70 con 0x7f3f8813fb20 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f8d79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8806af60 con 0x7f3f8813fef0 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f8d79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8806b240 con 0x7f3f8806aaa0 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f87fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3f8813fb20 0x7f3f880c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59152/0 (socket says 172.21.15.12:59152) 2023-10-08T16:27:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f87fff700 1 -- 172.21.15.12:0/4016806686 learned_addr learned my addr 172.21.15.12:0/4016806686 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196809657 0 0) 0x7f3f78001110 con 0x7f3f8813fb20 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f70003570 con 0x7f3f8813fb20 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.345+0000 7f3f8cf9c700 1 --2- 172.21.15.12:0/4016806686 >> v2:172.21.15.29:3300/0 conn(0x7f3f8806aaa0 0x7f3f8815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2124506807 0 0) 0x7f3f70003570 con 0x7f3f8813fb20 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 >> v2:172.21.15.29:3300/0 conn(0x7f3f8806aaa0 msgr2=0x7f3f8815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 --2- 172.21.15.12:0/4016806686 >> v2:172.21.15.29:3300/0 conn(0x7f3f8806aaa0 0x7f3f8815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 >> v1:172.21.15.29:6789/0 conn(0x7f3f8813fef0 legacy=0x7f3f880c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8806b520 con 0x7f3f8813fb20 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f3f78001600 con 0x7f3f8813fb20 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 >> v1:172.21.15.12:6789/0 conn(0x7f3f8813fb20 legacy=0x7f3f880c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f70003a60 0x7f3f70003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f700051c0 0x7f3f7000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8806b240 con 0x7f3f70004810 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7000c0d0 con 0x7f3f700051c0 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7000c290 con 0x7f3f70003a60 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f877fe700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f87fff700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f70003a60 0x7f3f70003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.346+0000 7f3f8cf9c700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f700051c0 0x7f3f7000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 -- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f70003a60 msgr2=0x7f3f70003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f70003a60 0x7f3f70003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 -- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f700051c0 msgr2=0x7f3f7000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f700051c0 0x7f3f7000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 -- 172.21.15.12:0/4016806686 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f70003570 con 0x7f3f70004810 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f8cf9c700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f700051c0 0x7f3f7000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f8cf9c700 1 -- 172.21.15.12:0/4016806686 reap_dead start 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f877fe700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f70004c80 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3f880cd200 tx=0x7f3f7c007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21771fa321a033be server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c001290 con 0x7f3f70004810 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c0104a0 con 0x7f3f70004810 2023-10-08T16:27:26.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.347+0000 7f3f86ffd700 1 -- 172.21.15.12:0/4016806686 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c010650 con 0x7f3f70004810 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 -- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 msgr2=0x7f3f70004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f70004c80 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f3f880cd200 tx=0x7f3f7c007d80 comp rx=0 tx=0).stop 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 -- 172.21.15.12:0/4016806686 shutdown_connections 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/4016806686 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f70004c80 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 -- 172.21.15.12:0/4016806686 >> 172.21.15.12:0/4016806686 conn(0x7f3f8806d170 msgr2=0x7f3f880cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:26.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 -- 172.21.15.12:0/4016806686 shutdown_connections 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.348+0000 7f3f8d79d700 1 -- 172.21.15.12:0/4016806686 wait complete. 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.349+0000 7f3f8d79d700 1 Processor -- start 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.349+0000 7f3f8d79d700 1 -- start start 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f881389b0 0x7f3f88138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 0x7f3f880af620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880ab7f0 con 0x7f3f70004810 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880ac610 con 0x7f3f880af1b0 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.350+0000 7f3f8d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880acfe0 con 0x7f3f881389b0 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51976/0 (socket says 172.21.15.12:51976) 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 -- 172.21.15.12:0/1939988833 learned_addr learned my addr 172.21.15.12:0/1939988833 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f877fe700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f881389b0 0x7f3f88138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f8cf9c700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 0x7f3f880af620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 -- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f881389b0 msgr2=0x7f3f88138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f881389b0 0x7f3f88138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 -- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 msgr2=0x7f3f880af620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 0x7f3f880af620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 -- 172.21.15.12:0/1939988833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88139360 con 0x7f3f70004810 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f8cf9c700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 0x7f3f880af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f87fff700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001e70 tx=0x7f3f78007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.351+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78001600 con 0x7f3f70004810 2023-10-08T16:27:26.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.352+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7800f870 con 0x7f3f70004810 2023-10-08T16:27:26.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.352+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f880aba00 con 0x7f3f70004810 2023-10-08T16:27:26.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.352+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800fc10 con 0x7f3f70004810 2023-10-08T16:27:26.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.352+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f880abfc0 con 0x7f3f70004810 2023-10-08T16:27:26.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.353+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8804c3c0 con 0x7f3f70004810 2023-10-08T16:27:26.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.354+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f7801d460 con 0x7f3f70004810 2023-10-08T16:27:26.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.355+0000 7f3f6ffff700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 0x7f3f740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.355+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5245+0+0 (secure 0 0 0) 0x7f3f78084420 con 0x7f3f70004810 2023-10-08T16:27:26.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.355+0000 7f3f877fe700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 0x7f3f740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.356+0000 7f3f877fe700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 0x7f3f740693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f880ad430 tx=0x7f3f7c017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.359+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f78051860 con 0x7f3f70004810 2023-10-08T16:27:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.566+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3f8815ae70 con 0x7f3f70004810 2023-10-08T16:27:26.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.566+0000 7f3f6ffff700 1 -- 172.21.15.12:0/1939988833 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3f8815ae70 con 0x7f3f70004810 2023-10-08T16:27:26.567 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:26.568 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:27:26.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 msgr2=0x7f3f740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 0x7f3f740693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3f880ad430 tx=0x7f3f7c017000 comp rx=0 tx=0).stop 2023-10-08T16:27:26.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 msgr2=0x7f3f880acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f3f78001e70 tx=0x7f3f78007a50 comp rx=0 tx=0).stop 2023-10-08T16:27:26.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 shutdown_connections 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f74066f30 0x7f3f740693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f70004810 0x7f3f880acaa0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f880af1b0 0x7f3f880af620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 --2- 172.21.15.12:0/1939988833 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f881389b0 0x7f3f88138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 >> 172.21.15.12:0/1939988833 conn(0x7f3f8806d170 msgr2=0x7f3f880c2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 shutdown_connections 2023-10-08T16:27:26.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.569+0000 7f3f8d79d700 1 -- 172.21.15.12:0/1939988833 wait complete. 2023-10-08T16:27:26.587 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:27:26.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:27:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.778+0000 7fb13719d700 1 Processor -- start 2023-10-08T16:27:26.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.778+0000 7fb13719d700 1 -- start start 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.779+0000 7fb13719d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb1300b24f0 0x7fb1300b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.779+0000 7fb13719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1300b1d40 0x7fb1301590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.779+0000 7fb13719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1300b0c80 con 0x7fb1300b28c0 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.779+0000 7fb13719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300d10d0 con 0x7fb1300b1d40 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.779+0000 7fb13719d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300b0f60 con 0x7fb1300b24f0 2023-10-08T16:27:26.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1300b1d40 0x7fb1301590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13699c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb1300b28c0 0x7fb13015d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59168/0 (socket says 172.21.15.12:59168) 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13699c700 1 -- 172.21.15.12:0/3942696216 learned_addr learned my addr 172.21.15.12:0/3942696216 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13619b700 1 --2- 172.21.15.12:0/3942696216 >> v2:172.21.15.29:3300/0 conn(0x7fb1300b24f0 0x7fb1300b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 -- 172.21.15.12:0/3942696216 >> v2:172.21.15.29:3300/0 conn(0x7fb1300b24f0 msgr2=0x7fb1300b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 --2- 172.21.15.12:0/3942696216 >> v2:172.21.15.29:3300/0 conn(0x7fb1300b24f0 0x7fb1300b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 -- 172.21.15.12:0/3942696216 >> v1:172.21.15.12:6789/0 conn(0x7fb1300b28c0 legacy=0x7fb13015d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb135199700 1 -- 172.21.15.12:0/3942696216 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820523187 0 0) 0x7fb1300b0c80 con 0x7fb1300b28c0 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 -- 172.21.15.12:0/3942696216 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300b1240 con 0x7fb1300b1d40 2023-10-08T16:27:26.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.780+0000 7fb13599a700 1 --2- 172.21.15.12:0/3942696216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb1301590f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb1300d1230 tx=0x7fb1200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a558f7f4d29c80f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb135199700 1 -- 172.21.15.12:0/3942696216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011630 con 0x7fb1300b1d40 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb135199700 1 -- 172.21.15.12:0/3942696216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120011790 con 0x7fb1300b1d40 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb135199700 1 -- 172.21.15.12:0/3942696216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011b30 con 0x7fb1300b1d40 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 -- 172.21.15.12:0/3942696216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 msgr2=0x7fb1301590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 --2- 172.21.15.12:0/3942696216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb1301590f0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb1300d1230 tx=0x7fb1200091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 -- 172.21.15.12:0/3942696216 shutdown_connections 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 --2- 172.21.15.12:0/3942696216 >> v2:172.21.15.29:3300/0 conn(0x7fb1300b24f0 0x7fb1300b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 --2- 172.21.15.12:0/3942696216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb1301590f0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 -- 172.21.15.12:0/3942696216 >> 172.21.15.12:0/3942696216 conn(0x7fb1300703a0 msgr2=0x7fb1300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 -- 172.21.15.12:0/3942696216 shutdown_connections 2023-10-08T16:27:26.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.781+0000 7fb13719d700 1 -- 172.21.15.12:0/3942696216 wait complete. 2023-10-08T16:27:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.783+0000 7fb13719d700 1 Processor -- start 2023-10-08T16:27:26.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.783+0000 7fb13719d700 1 -- start start 2023-10-08T16:27:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 0x7fb13015c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 0x7fb130153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13014f6d0 con 0x7fb1300b1d40 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1301517d0 con 0x7fb1300b28c0 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb130150ee0 con 0x7fb1300b24f0 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51994/0 (socket says 172.21.15.12:51994) 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.784+0000 7fb13619b700 1 -- 172.21.15.12:0/2831631287 learned_addr learned my addr 172.21.15.12:0/2831631287 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 -- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 msgr2=0x7fb13015c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13599a700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 0x7fb13015c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13699c700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 0x7fb130153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 0x7fb13015c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 -- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 msgr2=0x7fb130153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 0x7fb130153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 -- 172.21.15.12:0/2831631287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb120009420 con 0x7fb1300b1d40 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13599a700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 0x7fb13015c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13699c700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 0x7fb130153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13619b700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00ec80 tx=0x7fb12c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c00c9d0 con 0x7fb1300b1d40 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c00cb30 con 0x7fb1300b1d40 2023-10-08T16:27:26.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c013470 con 0x7fb1300b1d40 2023-10-08T16:27:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.785+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13015ccf0 con 0x7fb1300b1d40 2023-10-08T16:27:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.786+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb130151460 con 0x7fb1300b1d40 2023-10-08T16:27:26.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.787+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb130151ab0 con 0x7fb1300b1d40 2023-10-08T16:27:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.788+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb12c013820 con 0x7fb1300b1d40 2023-10-08T16:27:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.788+0000 7fb1267fc700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.789+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5245+0+0 (secure 0 0 0) 0x7fb12c084790 con 0x7fb1300b1d40 2023-10-08T16:27:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.789+0000 7fb13599a700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:26.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.789+0000 7fb13599a700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 0x7fb1140693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb1300afaa0 tx=0x7fb120017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:26.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.792+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb12c051b30 con 0x7fb1300b1d40 2023-10-08T16:27:26.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:26.997+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb13004c3c0 con 0x7fb1300b1d40 2023-10-08T16:27:27.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.338+0000 7fb1267fc700 1 -- 172.21.15.12:0/2831631287 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb12c055150 con 0x7fb1300b1d40 2023-10-08T16:27:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 msgr2=0x7fb1140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 0x7fb1140693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb1300afaa0 tx=0x7fb120017000 comp rx=0 tx=0).stop 2023-10-08T16:27:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 msgr2=0x7fb13014f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:27.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00ec80 tx=0x7fb12c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 shutdown_connections 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb114066f30 0x7fb1140693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1300b1d40 0x7fb13014f190 secure :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fb12c00ec80 tx=0x7fb12c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1300b28c0 0x7fb130153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 --2- 172.21.15.12:0/2831631287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1300b24f0 0x7fb13015c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.342+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 >> 172.21.15.12:0/2831631287 conn(0x7fb1300703a0 msgr2=0x7fb1300cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.346+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 shutdown_connections 2023-10-08T16:27:27.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.346+0000 7fb13719d700 1 -- 172.21.15.12:0/2831631287 wait complete. 2023-10-08T16:27:27.349 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:27:27.366 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:27:27.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.561+0000 7f59c259d700 1 Processor -- start 2023-10-08T16:27:27.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.561+0000 7f59c259d700 1 -- start start 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f59bc13fb20 0x7f59bc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f59bc13fef0 0x7f59bc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 0x7f59bc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0c8410 con 0x7f59bc13fb20 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc15ae70 con 0x7f59bc13fef0 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.562+0000 7f59c259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc06af60 con 0x7f59bc06aaa0 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f59bc13fb20 0x7f59bc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f59bc13fb20 0x7f59bc15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52008/0 (socket says 172.21.15.12:52008) 2023-10-08T16:27:27.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 -- 172.21.15.12:0/3044109436 learned_addr learned my addr 172.21.15.12:0/3044109436 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c1d9c700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 0x7f59bc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c0d9a700 1 --2- 172.21.15.12:0/3044109436 >> v2:172.21.15.29:3300/0 conn(0x7f59bc13fef0 0x7f59bc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 -- 172.21.15.12:0/3044109436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 msgr2=0x7f59bc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 0x7f59bc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 -- 172.21.15.12:0/3044109436 >> v2:172.21.15.29:3300/0 conn(0x7f59bc13fef0 msgr2=0x7f59bc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 --2- 172.21.15.12:0/3044109436 >> v2:172.21.15.29:3300/0 conn(0x7f59bc13fef0 0x7f59bc0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 -- 172.21.15.12:0/3044109436 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc06b240 con 0x7f59bc13fb20 2023-10-08T16:27:27.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c1d9c700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 0x7f59bc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.563+0000 7f59c159b700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fb20 0x7f59bc15a930 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06a5e0 tx=0x7f59b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d219b679e534fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59b3fff700 1 -- 172.21.15.12:0/3044109436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800b860 con 0x7f59bc13fb20 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59b3fff700 1 -- 172.21.15.12:0/3044109436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b800b9c0 con 0x7f59bc13fb20 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59b3fff700 1 -- 172.21.15.12:0/3044109436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b800bd60 con 0x7f59bc13fb20 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 -- 172.21.15.12:0/3044109436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fb20 msgr2=0x7f59bc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fb20 0x7f59bc15a930 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06a5e0 tx=0x7f59b8009250 comp rx=0 tx=0).stop 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 -- 172.21.15.12:0/3044109436 shutdown_connections 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc06aaa0 0x7f59bc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 --2- 172.21.15.12:0/3044109436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fb20 0x7f59bc15a930 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 --2- 172.21.15.12:0/3044109436 >> v2:172.21.15.29:3300/0 conn(0x7f59bc13fef0 0x7f59bc0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 -- 172.21.15.12:0/3044109436 >> 172.21.15.12:0/3044109436 conn(0x7f59bc06d170 msgr2=0x7f59bc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 -- 172.21.15.12:0/3044109436 shutdown_connections 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.564+0000 7f59c259d700 1 -- 172.21.15.12:0/3044109436 wait complete. 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.566+0000 7f59c259d700 1 Processor -- start 2023-10-08T16:27:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.566+0000 7f59c259d700 1 -- start start 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59bc06aaa0 0x7f59bc130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc13fb20 0x7f59bc1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15cdf0 con 0x7f59bc13fef0 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15b620 con 0x7f59bc06aaa0 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15b010 con 0x7f59bc13fb20 2023-10-08T16:27:27.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52014/0 (socket says 172.21.15.12:52014) 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c1d9c700 1 -- 172.21.15.12:0/1828885234 learned_addr learned my addr 172.21.15.12:0/1828885234 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c0d9a700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc13fb20 0x7f59bc1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.567+0000 7f59c159b700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59bc06aaa0 0x7f59bc130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 -- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc13fb20 msgr2=0x7f59bc1574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc13fb20 0x7f59bc1574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 -- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59bc06aaa0 msgr2=0x7f59bc130c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59bc06aaa0 0x7f59bc130c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 -- 172.21.15.12:0/1828885234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80094f0 con 0x7f59bc13fef0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c1d9c700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009f90 tx=0x7f59b40099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400dbe0 con 0x7f59bc13fef0 2023-10-08T16:27:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b400f040 con 0x7f59bc13fef0 2023-10-08T16:27:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b4015440 con 0x7f59bc13fef0 2023-10-08T16:27:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc0b0940 con 0x7f59bc13fef0 2023-10-08T16:27:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.568+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc0b0f00 con 0x7f59bc13fef0 2023-10-08T16:27:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.569+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc15b7d0 con 0x7f59bc13fef0 2023-10-08T16:27:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.571+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59b401f440 con 0x7f59bc13fef0 2023-10-08T16:27:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.571+0000 7f59b17fa700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.572+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5615+0+0 (secure 0 0 0) 0x7f59b4084a80 con 0x7f59bc13fef0 2023-10-08T16:27:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.572+0000 7f59c159b700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.572+0000 7f59c159b700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 0x7f59a00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06a5e0 tx=0x7f59b8017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:27.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.575+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59b4051dd0 con 0x7f59bc13fef0 2023-10-08T16:27:27.777 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:27.776+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f59bc15b7d0 con 0x7f59bc13fef0 2023-10-08T16:27:28.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.344+0000 7f59b17fa700 1 -- 172.21.15.12:0/1828885234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) v1 ==== 170+0+0 (secure 0 0 0) 0x7f59bc15b7d0 con 0x7f59bc13fef0 2023-10-08T16:27:28.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.354+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 msgr2=0x7f59a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.354+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 0x7f59a00693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f59bc06a5e0 tx=0x7f59b8017000 comp rx=0 tx=0).stop 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.354+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 msgr2=0x7f59bc1579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.354+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009f90 tx=0x7f59b40099b0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 shutdown_connections 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f59a0066f30 0x7f59a00693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f59bc13fef0 0x7f59bc1579e0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f59bc06aaa0 0x7f59bc130c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 --2- 172.21.15.12:0/1828885234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f59bc13fb20 0x7f59bc1574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.355+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 >> 172.21.15.12:0/1828885234 conn(0x7f59bc06d170 msgr2=0x7f59bc13ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.360+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 shutdown_connections 2023-10-08T16:27:28.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.360+0000 7f59c259d700 1 -- 172.21.15.12:0/1828885234 wait complete. 2023-10-08T16:27:28.368 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:27:28.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:27:28.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.575+0000 7f30d179d700 1 Processor -- start 2023-10-08T16:27:28.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.576+0000 7f30d179d700 1 -- start start 2023-10-08T16:27:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d179d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f30cc147620 0x7f30cc0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d179d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc069ee0 con 0x7f30cc06e0a0 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d179d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0cb7f0 con 0x7f30cc147620 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0cbad0 con 0x7f30cc06b380 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30cbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f30cc06e0a0 0x7f30cc146f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59182/0 (socket says 172.21.15.12:59182) 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30cbfff700 1 -- 172.21.15.12:0/1967619376 learned_addr learned my addr 172.21.15.12:0/1967619376 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30d0f9c700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.577+0000 7f30cb7fe700 1 --2- 172.21.15.12:0/1967619376 >> v2:172.21.15.29:3300/0 conn(0x7f30cc147620 0x7f30cc0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30caffd700 1 -- 172.21.15.12:0/1967619376 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332097460 0 0) 0x7f30cc069ee0 con 0x7f30cc06e0a0 2023-10-08T16:27:28.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30caffd700 1 -- 172.21.15.12:0/1967619376 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30b4003570 con 0x7f30cc06e0a0 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30cb7fe700 1 -- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 msgr2=0x7f30cc0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30cb7fe700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30cb7fe700 1 -- 172.21.15.12:0/1967619376 >> v1:172.21.15.12:6789/0 conn(0x7f30cc06e0a0 legacy=0x7f30cc146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30cb7fe700 1 -- 172.21.15.12:0/1967619376 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0cbdb0 con 0x7f30cc147620 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30d0f9c700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.578+0000 7f30cb7fe700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc147620 0x7f30cc0c9d00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f30c00098e0 tx=0x7f30c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d7beedaf10d7c33 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30caffd700 1 -- 172.21.15.12:0/1967619376 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0011630 con 0x7f30cc147620 2023-10-08T16:27:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30caffd700 1 -- 172.21.15.12:0/1967619376 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0011790 con 0x7f30cc147620 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30caffd700 1 -- 172.21.15.12:0/1967619376 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0011b30 con 0x7f30cc147620 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 -- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc147620 msgr2=0x7f30cc0c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc147620 0x7f30cc0c9d00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f30c00098e0 tx=0x7f30c00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 -- 172.21.15.12:0/1967619376 shutdown_connections 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 --2- 172.21.15.12:0/1967619376 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc147620 0x7f30cc0c9d00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 -- 172.21.15.12:0/1967619376 >> 172.21.15.12:0/1967619376 conn(0x7f30cc06d110 msgr2=0x7f30cc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 -- 172.21.15.12:0/1967619376 shutdown_connections 2023-10-08T16:27:28.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.579+0000 7f30d179d700 1 -- 172.21.15.12:0/1967619376 wait complete. 2023-10-08T16:27:28.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.581+0000 7f30d179d700 1 Processor -- start 2023-10-08T16:27:28.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.581+0000 7f30d179d700 1 -- start start 2023-10-08T16:27:28.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc06e0a0 0x7f30cc0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c5710 con 0x7f30cc147620 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0c59f0 con 0x7f30cc06e0a0 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0af5a0 con 0x7f30cc06b380 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d0f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d0f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52018/0 (socket says 172.21.15.12:52018) 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30d0f9c700 1 -- 172.21.15.12:0/2501049184 learned_addr learned my addr 172.21.15.12:0/2501049184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30cb7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc06e0a0 0x7f30cc0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.582+0000 7f30cbfff700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 -- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 msgr2=0x7f30cc0b19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0b19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 -- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc06e0a0 msgr2=0x7f30cc0c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc06e0a0 0x7f30cc0c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 -- 172.21.15.12:0/2501049184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c4009a20 con 0x7f30cc147620 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d0f9c700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fc0 tx=0x7f30c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c400cbd0 con 0x7f30cc147620 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c400f040 con 0x7f30cc147620 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.583+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c0009420 con 0x7f30cc147620 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.584+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4014480 con 0x7f30cc147620 2023-10-08T16:27:28.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.584+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc0afb60 con 0x7f30cc147620 2023-10-08T16:27:28.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.585+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0afd50 con 0x7f30cc147620 2023-10-08T16:27:28.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.586+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30c4003020 con 0x7f30cc147620 2023-10-08T16:27:28.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.587+0000 7f30b3fff700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 0x7f30b8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:28.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.588+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5997+0+0 (secure 0 0 0) 0x7f30c4085a70 con 0x7f30cc147620 2023-10-08T16:27:28.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.588+0000 7f30cbfff700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 0x7f30b8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:28.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.588+0000 7f30cbfff700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 0x7f30b8069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30bc007fd0 tx=0x7f30bc009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:28.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.591+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30c4052ba0 con 0x7f30cc147620 2023-10-08T16:27:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:28.837+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f30cc0648e0 con 0x7f30cc147620 2023-10-08T16:27:29.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.363+0000 7f30b3fff700 1 -- 172.21.15.12:0/2501049184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7f30cc0648e0 con 0x7f30cc147620 2023-10-08T16:27:29.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.373+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 msgr2=0x7f30b8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.374+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 0x7f30b8069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f30bc007fd0 tx=0x7f30bc009040 comp rx=0 tx=0).stop 2023-10-08T16:27:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.374+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 msgr2=0x7f30cc0c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.374+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009fc0 tx=0x7f30c400b040 comp rx=0 tx=0).stop 2023-10-08T16:27:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 shutdown_connections 2023-10-08T16:27:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f30b8066f60 0x7f30b8069410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f30cc147620 0x7f30cc0c5040 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f30cc06b380 0x7f30cc0b19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 --2- 172.21.15.12:0/2501049184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f30cc06e0a0 0x7f30cc0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.376+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 >> 172.21.15.12:0/2501049184 conn(0x7f30cc06d110 msgr2=0x7f30cc1461b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:29.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.380+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 shutdown_connections 2023-10-08T16:27:29.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.381+0000 7f30d179d700 1 -- 172.21.15.12:0/2501049184 wait complete. 2023-10-08T16:27:29.394 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 14 and data pool 15 2023-10-08T16:27:29.412 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:29.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.600+0000 7f0dde19d700 1 Processor -- start 2023-10-08T16:27:29.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.600+0000 7f0dde19d700 1 -- start start 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dde19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dd8142fd0 0x7f0dd80c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dde19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0dd80c7dc0 0x7f0dd806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dde19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd80ca480 con 0x7f0dd8142c00 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dde19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd815e240 con 0x7f0dd8142fd0 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dde19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd806b350 con 0x7f0dd80c7dc0 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0ddd19b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0dd8142c00 0x7f0dd806b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59188/0 (socket says 172.21.15.12:59188) 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0ddd19b700 1 -- 172.21.15.12:0/3105898063 learned_addr learned my addr 172.21.15.12:0/3105898063 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3105898063 >> v2:172.21.15.12:3300/0 conn(0x7f0dd8142fd0 0x7f0dd80c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0ddd99c700 1 --2- 172.21.15.12:0/3105898063 >> v2:172.21.15.29:3300/0 conn(0x7f0dd80c7dc0 0x7f0dd806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dcffff700 1 -- 172.21.15.12:0/3105898063 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051752857 0 0) 0x7f0dd80ca480 con 0x7f0dd8142c00 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0dcffff700 1 -- 172.21.15.12:0/3105898063 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dc4003570 con 0x7f0dd8142c00 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.602+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3105898063 >> v2:172.21.15.29:3300/0 conn(0x7f0dd80c7dc0 msgr2=0x7f0dd806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3105898063 >> v2:172.21.15.29:3300/0 conn(0x7f0dd80c7dc0 0x7f0dd806c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3105898063 >> v1:172.21.15.12:6789/0 conn(0x7f0dd8142c00 legacy=0x7f0dd806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3105898063 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd80c81d0 con 0x7f0dd8142fd0 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3105898063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142fd0 0x7f0dd80c7880 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0dd806d750 tx=0x7f0dc80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=746390e097ef129 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0dcffff700 1 -- 172.21.15.12:0/3105898063 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8011630 con 0x7f0dd8142fd0 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0dcffff700 1 -- 172.21.15.12:0/3105898063 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8011790 con 0x7f0dd8142fd0 2023-10-08T16:27:29.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.603+0000 7f0dcffff700 1 -- 172.21.15.12:0/3105898063 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8011b30 con 0x7f0dd8142fd0 2023-10-08T16:27:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 -- 172.21.15.12:0/3105898063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142fd0 msgr2=0x7f0dd80c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3105898063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142fd0 0x7f0dd80c7880 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f0dd806d750 tx=0x7f0dc80091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 -- 172.21.15.12:0/3105898063 shutdown_connections 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3105898063 >> v2:172.21.15.29:3300/0 conn(0x7f0dd80c7dc0 0x7f0dd806c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3105898063 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142fd0 0x7f0dd80c7880 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 -- 172.21.15.12:0/3105898063 >> 172.21.15.12:0/3105898063 conn(0x7f0dd80675a0 msgr2=0x7f0dd80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 -- 172.21.15.12:0/3105898063 shutdown_connections 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.604+0000 7f0dde19d700 1 -- 172.21.15.12:0/3105898063 wait complete. 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.605+0000 7f0dde19d700 1 Processor -- start 2023-10-08T16:27:29.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.605+0000 7f0dde19d700 1 -- start start 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dd80c7dc0 0x7f0dd815abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dd8142fd0 0x7f0dd81693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd816d1f0 con 0x7f0dd8142c00 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd816c930 con 0x7f0dd8142fd0 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.606+0000 7f0dde19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd816cba0 con 0x7f0dd80c7dc0 2023-10-08T16:27:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52028/0 (socket says 172.21.15.12:52028) 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3335475965 learned_addr learned my addr 172.21.15.12:0/3335475965 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddd19b700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dd80c7dc0 0x7f0dd815abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddd99c700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dd8142fd0 0x7f0dd81693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dd80c7dc0 msgr2=0x7f0dd815abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dd80c7dc0 0x7f0dd815abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dd8142fd0 msgr2=0x7f0dd81693f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dd8142fd0 0x7f0dd81693f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 -- 172.21.15.12:0/3335475965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc8009420 con 0x7f0dd8142c00 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.607+0000 7f0ddc99a700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009f50 tx=0x7f0dc8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.608+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8011900 con 0x7f0dd8142c00 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.608+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8011a60 con 0x7f0dd8142c00 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.608+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8025620 con 0x7f0dd8142c00 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.608+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd816ce80 con 0x7f0dd8142c00 2023-10-08T16:27:29.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.608+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd816d680 con 0x7f0dd8142c00 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.609+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd816d3a0 con 0x7f0dd8142c00 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.610+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dc8025a10 con 0x7f0dd8142c00 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.610+0000 7f0dcd7fa700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.611+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f0dc8085e40 con 0x7f0dd8142c00 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.611+0000 7f0ddd19b700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:29.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.611+0000 7f0ddd19b700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4007fd0 tx=0x7f0dd4009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:29.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.615+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dd816d3a0 con 0x7f0dd8142c00 2023-10-08T16:27:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.818+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0dd816d3a0 con 0x7f0dd8142c00 2023-10-08T16:27:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.819+0000 7f0dcd7fa700 1 -- 172.21.15.12:0/3335475965 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f0dd816d3a0 con 0x7f0dd8142c00 2023-10-08T16:27:29.820 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:29.821 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":128,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:28.839175+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.821+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 msgr2=0x7f0dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.821+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 0x7f0dbc0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4007fd0 tx=0x7f0dd4009040 comp rx=0 tx=0).stop 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.821+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 msgr2=0x7f0dd815b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009f50 tx=0x7f0dc8017000 comp rx=0 tx=0).stop 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 shutdown_connections 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0dbc066f30 0x7f0dbc0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dd8142fd0 0x7f0dd81693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dd80c7dc0 0x7f0dd815abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 --2- 172.21.15.12:0/3335475965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dd8142c00 0x7f0dd815b130 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 >> 172.21.15.12:0/3335475965 conn(0x7f0dd80675a0 msgr2=0x7f0dd80c8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 shutdown_connections 2023-10-08T16:27:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:29.822+0000 7f0dde19d700 1 -- 172.21.15.12:0/3335475965 wait complete. 2023-10-08T16:27:29.841 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:30.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.028+0000 7f4d4219d700 1 Processor -- start 2023-10-08T16:27:30.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.028+0000 7f4d4219d700 1 -- start start 2023-10-08T16:27:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.029+0000 7f4d4219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 0x7f4d3c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.029+0000 7f4d4219d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 0x7f4d3c0703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.029+0000 7f4d4219d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3c06d3e0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.029+0000 7f4d4219d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d3c06c7d0 con 0x7f4d3c159aa0 2023-10-08T16:27:30.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.029+0000 7f4d4219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c06cab0 con 0x7f4d3c1596d0 2023-10-08T16:27:30.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4199c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d3c0ca7b0 0x7f4d3c0cabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59198/0 (socket says 172.21.15.12:59198) 2023-10-08T16:27:30.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4199c700 1 -- 172.21.15.12:0/2656656946 learned_addr learned my addr 172.21.15.12:0/2656656946 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:30.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4119b700 1 --2- 172.21.15.12:0/2656656946 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 0x7f4d3c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4099a700 1 --2- 172.21.15.12:0/2656656946 >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 0x7f4d3c0703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d33fff700 1 -- 172.21.15.12:0/2656656946 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51253126 0 0) 0x7f4d3c06d3e0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d33fff700 1 -- 172.21.15.12:0/2656656946 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d28003570 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4119b700 1 -- 172.21.15.12:0/2656656946 >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 msgr2=0x7f4d3c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4119b700 1 --2- 172.21.15.12:0/2656656946 >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 0x7f4d3c0703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4119b700 1 -- 172.21.15.12:0/2656656946 >> v1:172.21.15.12:6789/0 conn(0x7f4d3c0ca7b0 legacy=0x7f4d3c0cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4119b700 1 -- 172.21.15.12:0/2656656946 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c06cd90 con 0x7f4d3c1596d0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.030+0000 7f4d4099a700 1 --2- 172.21.15.12:0/2656656946 >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 0x7f4d3c0703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d4119b700 1 --2- 172.21.15.12:0/2656656946 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 0x7f4d3c06d870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d380098e0 tx=0x7f4d380091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d7199ed64ad39a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d33fff700 1 -- 172.21.15.12:0/2656656946 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011630 con 0x7f4d3c1596d0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d33fff700 1 -- 172.21.15.12:0/2656656946 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38011790 con 0x7f4d3c1596d0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d33fff700 1 -- 172.21.15.12:0/2656656946 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011b30 con 0x7f4d3c1596d0 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d4219d700 1 -- 172.21.15.12:0/2656656946 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 msgr2=0x7f4d3c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.031+0000 7f4d4219d700 1 --2- 172.21.15.12:0/2656656946 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 0x7f4d3c06d870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4d380098e0 tx=0x7f4d380091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 -- 172.21.15.12:0/2656656946 shutdown_connections 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 --2- 172.21.15.12:0/2656656946 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c1596d0 0x7f4d3c06d870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 --2- 172.21.15.12:0/2656656946 >> v2:172.21.15.29:3300/0 conn(0x7f4d3c159aa0 0x7f4d3c0703a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 -- 172.21.15.12:0/2656656946 >> 172.21.15.12:0/2656656946 conn(0x7f4d3c06e720 msgr2=0x7f4d3c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 -- 172.21.15.12:0/2656656946 shutdown_connections 2023-10-08T16:27:30.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.032+0000 7f4d4219d700 1 -- 172.21.15.12:0/2656656946 wait complete. 2023-10-08T16:27:30.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.033+0000 7f4d4219d700 1 Processor -- start 2023-10-08T16:27:30.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.033+0000 7f4d4219d700 1 -- start start 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3c1596d0 0x7f4d3c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c159aa0 0x7f4d3c14f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c149d90 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c14f710 con 0x7f4d3c1596d0 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4219d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3c14dbf0 con 0x7f4d3c159aa0 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4119b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52040/0 (socket says 172.21.15.12:52040) 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.034+0000 7f4d4119b700 1 -- 172.21.15.12:0/1190388487 learned_addr learned my addr 172.21.15.12:0/1190388487 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:30.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 -- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c159aa0 msgr2=0x7f4d3c14f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c159aa0 0x7f4d3c14f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 -- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3c1596d0 msgr2=0x7f4d3c14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3c1596d0 0x7f4d3c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 -- 172.21.15.12:0/1190388487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009420 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4119b700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009ed0 tx=0x7f4d38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38011b10 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d380253f0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380257b0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d38009420 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.035+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3c14e1b0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.036+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3c04c3c0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.037+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d38025ba0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.039+0000 7f4d317fa700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 0x7f4d200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.039+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4d38085fc0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.039+0000 7f4d4099a700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 0x7f4d200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.039+0000 7f4d4099a700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 0x7f4d200693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0ca190 tx=0x7f4d2c0091a0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.043+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d38053000 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.246+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d3c0c35b0 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.247+0000 7f4d317fa700 1 -- 172.21.15.12:0/1190388487 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16020 (secure 0 0 0) 0x7f4d38056620 con 0x7f4d3c0ca7b0 2023-10-08T16:27:30.248 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:30.248 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":128,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:28.839175+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 msgr2=0x7f4d200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 0x7f4d200693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0ca190 tx=0x7f4d2c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 msgr2=0x7f4d3c0c3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f4d38009ed0 tx=0x7f4d38017000 comp rx=0 tx=0).stop 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 shutdown_connections 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d20066f30 0x7f4d200693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d3c0ca7b0 0x7f4d3c0c3f00 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d3c159aa0 0x7f4d3c14f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 --2- 172.21.15.12:0/1190388487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d3c1596d0 0x7f4d3c14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 >> 172.21.15.12:0/1190388487 conn(0x7f4d3c06e720 msgr2=0x7f4d3c159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 shutdown_connections 2023-10-08T16:27:30.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.250+0000 7f4d4219d700 1 -- 172.21.15.12:0/1190388487 wait complete. 2023-10-08T16:27:30.268 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:27:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.460+0000 7f7c9cfff700 1 Processor -- start 2023-10-08T16:27:30.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.460+0000 7f7c9cfff700 1 -- start start 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.461+0000 7f7c9cfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 0x7f7c980abc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.461+0000 7f7c9cfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c980ac1d0 0x7f7c980ad140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.461+0000 7f7c9cfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c980cc270 con 0x7f7c980ad680 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.461+0000 7f7c9cfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980a9cf0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.461+0000 7f7c9cfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c980adaa0 con 0x7f7c98159970 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7c980ac1d0 0x7f7c980ad140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c96d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7c980ad680 0x7f7c980aa180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59208/0 (socket says 172.21.15.12:59208) 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c96d9d700 1 -- 172.21.15.12:0/100826489 learned_addr learned my addr 172.21.15.12:0/100826489 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c9659c700 1 --2- 172.21.15.12:0/100826489 >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 0x7f7c980abc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c9559a700 1 -- 172.21.15.12:0/100826489 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095168613 0 0) 0x7f7c980cc270 con 0x7f7c980ad680 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 -- 172.21.15.12:0/100826489 >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 msgr2=0x7f7c980abc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 --2- 172.21.15.12:0/100826489 >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 0x7f7c980abc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 -- 172.21.15.12:0/100826489 >> v1:172.21.15.12:6789/0 conn(0x7f7c980ad680 legacy=0x7f7c980aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 -- 172.21.15.12:0/100826489 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980ac6e0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c9659c700 1 --2- 172.21.15.12:0/100826489 >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 0x7f7c980abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:30.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.462+0000 7f7c95d9b700 1 --2- 172.21.15.12:0/100826489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c980ad140 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7c98064670 tx=0x7f7c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f243f59dce58a450 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9559a700 1 -- 172.21.15.12:0/100826489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00b6b0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9559a700 1 -- 172.21.15.12:0/100826489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00b810 con 0x7f7c980ac1d0 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9559a700 1 -- 172.21.15.12:0/100826489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c00bbb0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 -- 172.21.15.12:0/100826489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 msgr2=0x7f7c980ad140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/100826489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c980ad140 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7c98064670 tx=0x7f7c8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 -- 172.21.15.12:0/100826489 shutdown_connections 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/100826489 >> v2:172.21.15.29:3300/0 conn(0x7f7c98159970 0x7f7c980abc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/100826489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c980ad140 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 -- 172.21.15.12:0/100826489 >> 172.21.15.12:0/100826489 conn(0x7f7c9806d170 msgr2=0x7f7c980cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 -- 172.21.15.12:0/100826489 shutdown_connections 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.463+0000 7f7c9cfff700 1 -- 172.21.15.12:0/100826489 wait complete. 2023-10-08T16:27:30.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.465+0000 7f7c9cfff700 1 Processor -- start 2023-10-08T16:27:30.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.465+0000 7f7c9cfff700 1 -- start start 2023-10-08T16:27:30.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c980ad680 0x7f7c980c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 0x7f7c980c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980c1b10 con 0x7f7c980ac1d0 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980c1df0 con 0x7f7c98159970 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9cfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c980c20d0 con 0x7f7c980ad680 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52056/0 (socket says 172.21.15.12:52056) 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c9659c700 1 -- 172.21.15.12:0/2470864096 learned_addr learned my addr 172.21.15.12:0/2470864096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c95d9b700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c980ad680 0x7f7c980c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.466+0000 7f7c96d9d700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 0x7f7c980c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 -- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c980ad680 msgr2=0x7f7c980c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c980ad680 0x7f7c980c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 -- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 msgr2=0x7f7c980c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 0x7f7c980c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 -- 172.21.15.12:0/2470864096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c8c009420 con 0x7f7c980ac1d0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c96d9d700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 0x7f7c980c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9659c700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800d860 tx=0x7f7c88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880125f0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88012750 con 0x7f7c980ac1d0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88012af0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c980c23b0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.467+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9814a4b0 con 0x7f7c980ac1d0 2023-10-08T16:27:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.468+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c980c2a00 con 0x7f7c980ac1d0 2023-10-08T16:27:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.469+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c88014430 con 0x7f7c980ac1d0 2023-10-08T16:27:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.470+0000 7f7c867fc700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.470+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7c88084b00 con 0x7f7c980ac1d0 2023-10-08T16:27:30.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.470+0000 7f7c95d9b700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:30.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.471+0000 7f7c95d9b700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 0x7f7c780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0093f0 tx=0x7f7c8c017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:30.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.474+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c88086e60 con 0x7f7c980ac1d0 2023-10-08T16:27:30.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:30.722+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7c9804c3c0 con 0x7f7c980ac1d0 2023-10-08T16:27:31.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.383+0000 7f7c867fc700 1 -- 172.21.15.12:0/2470864096 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7c88051b40 con 0x7f7c980ac1d0 2023-10-08T16:27:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 msgr2=0x7f7c780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 0x7f7c780693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0093f0 tx=0x7f7c8c017000 comp rx=0 tx=0).stop 2023-10-08T16:27:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 msgr2=0x7f7c98149f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800d860 tx=0x7f7c88008040 comp rx=0 tx=0).stop 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 shutdown_connections 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c78066f30 0x7f7c780693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c980ac1d0 0x7f7c98149f70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c98159970 0x7f7c980c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 --2- 172.21.15.12:0/2470864096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c980ad680 0x7f7c980c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 >> 172.21.15.12:0/2470864096 conn(0x7f7c9806d170 msgr2=0x7f7c9806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 shutdown_connections 2023-10-08T16:27:31.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.386+0000 7f7c9cfff700 1 -- 172.21.15.12:0/2470864096 wait complete. 2023-10-08T16:27:31.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:27:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.601+0000 7f5912b9d700 1 Processor -- start 2023-10-08T16:27:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.602+0000 7f5912b9d700 1 -- start start 2023-10-08T16:27:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5912b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f590c142c00 0x7f590c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5912b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f590c06bd20 0x7f590c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5912b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0ca480 con 0x7f590c142fd0 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5912b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c15e240 con 0x7f590c142c00 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5912b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c06b350 con 0x7f590c06bd20 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f5911b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f590c142c00 0x7f590c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f591239c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f590c142fd0 0x7f590c06c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59214/0 (socket says 172.21.15.12:59214) 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f591239c700 1 -- 172.21.15.12:0/4273685695 learned_addr learned my addr 172.21.15.12:0/4273685695 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.603+0000 7f591139a700 1 --2- 172.21.15.12:0/4273685695 >> v2:172.21.15.29:3300/0 conn(0x7f590c06bd20 0x7f590c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5911b9b700 1 -- 172.21.15.12:0/4273685695 >> v2:172.21.15.29:3300/0 conn(0x7f590c06bd20 msgr2=0x7f590c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5911b9b700 1 --2- 172.21.15.12:0/4273685695 >> v2:172.21.15.29:3300/0 conn(0x7f590c06bd20 0x7f590c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5911b9b700 1 -- 172.21.15.12:0/4273685695 >> v1:172.21.15.12:6789/0 conn(0x7f590c142fd0 legacy=0x7f590c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5911b9b700 1 -- 172.21.15.12:0/4273685695 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c15df60 con 0x7f590c142c00 2023-10-08T16:27:31.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5910b99700 1 -- 172.21.15.12:0/4273685695 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529271548 0 0) 0x7f590c0ca480 con 0x7f590c142fd0 2023-10-08T16:27:31.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5911b9b700 1 --2- 172.21.15.12:0/4273685695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142c00 0x7f590c06b7e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f590c06d750 tx=0x7f59080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9533eae5b237fd13 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5910b99700 1 -- 172.21.15.12:0/4273685695 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011630 con 0x7f590c142c00 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5910b99700 1 -- 172.21.15.12:0/4273685695 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5908011790 con 0x7f590c142c00 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.604+0000 7f5910b99700 1 -- 172.21.15.12:0/4273685695 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5908011b30 con 0x7f590c142c00 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 -- 172.21.15.12:0/4273685695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142c00 msgr2=0x7f590c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 --2- 172.21.15.12:0/4273685695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142c00 0x7f590c06b7e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f590c06d750 tx=0x7f59080091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 -- 172.21.15.12:0/4273685695 shutdown_connections 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 --2- 172.21.15.12:0/4273685695 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142c00 0x7f590c06b7e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 --2- 172.21.15.12:0/4273685695 >> v2:172.21.15.29:3300/0 conn(0x7f590c06bd20 0x7f590c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 -- 172.21.15.12:0/4273685695 >> 172.21.15.12:0/4273685695 conn(0x7f590c0675a0 msgr2=0x7f590c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 -- 172.21.15.12:0/4273685695 shutdown_connections 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.605+0000 7f5912b9d700 1 -- 172.21.15.12:0/4273685695 wait complete. 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.606+0000 7f5912b9d700 1 Processor -- start 2023-10-08T16:27:31.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 -- start start 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 0x7f590c0c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f590c142c00 0x7f590c0affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0c5cc0 con 0x7f590c142fd0 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0b20f0 con 0x7f590c06bd20 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.607+0000 7f5912b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0c70a0 con 0x7f590c142c00 2023-10-08T16:27:31.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:52078/0 (socket says 172.21.15.12:52078) 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 -- 172.21.15.12:0/518708032 learned_addr learned my addr 172.21.15.12:0/518708032 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591139a700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f590c142c00 0x7f590c0affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f5911b9b700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 0x7f590c0c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 -- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f590c142c00 msgr2=0x7f590c0affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f590c142c00 0x7f590c0affe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 -- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 msgr2=0x7f590c0c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 0x7f590c0c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 -- 172.21.15.12:0/518708032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5908009420 con 0x7f590c142fd0 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f5911b9b700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 0x7f590c0c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f591239c700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f590400cbf0 tx=0x7f59040019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:31.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.608+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590400a9c0 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.609+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400ab20 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.609+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59040070f0 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.609+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c0b2390 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.609+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c0b2950 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.610+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c0b2b70 con 0x7f590c142fd0 2023-10-08T16:27:31.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.611+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f59040074e0 con 0x7f590c142fd0 2023-10-08T16:27:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.612+0000 7f5901ffb700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.612+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5904084af0 con 0x7f590c142fd0 2023-10-08T16:27:31.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.612+0000 7f5911b9b700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:31.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.613+0000 7f5911b9b700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 0x7f58f00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5908003080 tx=0x7f5908017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:31.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.617+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5904051bb0 con 0x7f590c142fd0 2023-10-08T16:27:31.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:31.867+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f590c04c3c0 con 0x7f590c142fd0 2023-10-08T16:27:32.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.384+0000 7f5901ffb700 1 -- 172.21.15.12:0/518708032 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7f59040551d0 con 0x7f590c142fd0 2023-10-08T16:27:32.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 msgr2=0x7f58f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 0x7f58f00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5908003080 tx=0x7f5908017000 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 msgr2=0x7f590c0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f590400cbf0 tx=0x7f59040019b0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 shutdown_connections 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f58f0066f30 0x7f58f00693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f590c142fd0 0x7f590c0b0520 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f590c06bd20 0x7f590c0c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 --2- 172.21.15.12:0/518708032 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f590c142c00 0x7f590c0affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.387+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 >> 172.21.15.12:0/518708032 conn(0x7f590c0675a0 msgr2=0x7f590c140450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.388+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 shutdown_connections 2023-10-08T16:27:32.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.388+0000 7f5912b9d700 1 -- 172.21.15.12:0/518708032 wait complete. 2023-10-08T16:27:32.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:32.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.598+0000 7f4297fff700 1 Processor -- start 2023-10-08T16:27:32.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.598+0000 7f4297fff700 1 -- start start 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.599+0000 7f4297fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f42980c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.599+0000 7f4297fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980c6d50 con 0x7f4298140a70 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.599+0000 7f4297fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42980c7030 con 0x7f429806de50 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.599+0000 7f4297fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c7310 con 0x7f4298140e40 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4296ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4298140a70 0x7f42980c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60232/0 (socket says 172.21.15.12:60232) 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4296ffd700 1 -- 172.21.15.12:0/1671293969 learned_addr learned my addr 172.21.15.12:0/1671293969 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f42967fc700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f42980c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157496960 0 0) 0x7f42980c6d50 con 0x7f4298140a70 2023-10-08T16:27:32.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4280003570 con 0x7f4298140a70 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661274816 0 0) 0x7f42980c7030 con 0x7f429806de50 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42980c6d50 con 0x7f429806de50 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669492232 0 0) 0x7f4280003570 con 0x7f4298140a70 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 msgr2=0x7f42980c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f42980c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 >> v1:172.21.15.29:6789/0 conn(0x7f429806de50 legacy=0x7f42980aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980c75f0 con 0x7f4298140a70 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f4288001470 con 0x7f4298140a70 2023-10-08T16:27:32.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.600+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 >> v1:172.21.15.12:6789/0 conn(0x7f4298140a70 legacy=0x7f42980c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4280003c20 0x7f4280004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4280004810 0x7f4280004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f4280005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c7310 con 0x7f4280004810 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428000bc20 con 0x7f4280003c20 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428000bde0 con 0x7f4298140e40 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4280004810 0x7f4280004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42977fe700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f4280005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f4296ffd700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4280003c20 0x7f4280004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 -- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 msgr2=0x7f4280005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4298140e40 0x7f4280005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 -- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4280003c20 msgr2=0x7f4280004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4280003c20 0x7f4280004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.601+0000 7f42967fc700 1 -- 172.21.15.12:0/1671293969 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4280003570 con 0x7f4280004810 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f42967fc700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4280004810 0x7f4280004c80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f428c009bf0 tx=0x7f428c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef401747747418b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c005a00 con 0x7f4280004810 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c005b60 con 0x7f4280004810 2023-10-08T16:27:32.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4295ffb700 1 -- 172.21.15.12:0/1671293969 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00e710 con 0x7f4280004810 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4297fff700 1 -- 172.21.15.12:0/1671293969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4280004810 msgr2=0x7f4280004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4297fff700 1 --2- 172.21.15.12:0/1671293969 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4280004810 0x7f4280004c80 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f428c009bf0 tx=0x7f428c009120 comp rx=0 tx=0).stop 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f42977fe700 1 -- 172.21.15.12:0/1671293969 reap_dead start 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4297fff700 1 -- 172.21.15.12:0/1671293969 shutdown_connections 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4297fff700 1 -- 172.21.15.12:0/1671293969 >> 172.21.15.12:0/1671293969 conn(0x7f429806d170 msgr2=0x7f42980cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.602+0000 7f4297fff700 1 -- 172.21.15.12:0/1671293969 shutdown_connections 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.603+0000 7f4297fff700 1 -- 172.21.15.12:0/1671293969 wait complete. 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.604+0000 7f4297fff700 1 Processor -- start 2023-10-08T16:27:32.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.604+0000 7f4297fff700 1 -- start start 2023-10-08T16:27:32.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4280004810 0x7f4298169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42980caed0 0x7f429816d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429816a530 con 0x7f42980cb340 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c5020 con 0x7f42980caed0 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4297fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42980c4410 con 0x7f4280004810 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f42977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f42977fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35456/0 (socket says 172.21.15.12:35456) 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f42977fe700 1 -- 172.21.15.12:0/1277282566 learned_addr learned my addr 172.21.15.12:0/1277282566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f42967fc700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42980caed0 0x7f429816d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.605+0000 7f4296ffd700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4280004810 0x7f4298169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 -- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4280004810 msgr2=0x7f4298169ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4280004810 0x7f4298169ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 -- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42980caed0 msgr2=0x7f429816d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42980caed0 0x7f429816d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 -- 172.21.15.12:0/1277282566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42980c46f0 con 0x7f42980cb340 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f42977fe700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f42980697f0 tx=0x7f4290009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42900032e0 con 0x7f42980cb340 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4290003440 con 0x7f42980cb340 2023-10-08T16:27:32.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4290001910 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42980c49d0 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.606+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429816d280 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.608+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42980c51b0 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.608+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4290001d00 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.610+0000 7f427effd700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.610+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f4290084030 con 0x7f42980cb340 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.610+0000 7f4296ffd700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:32.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.610+0000 7f4296ffd700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 0x7f42840693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4288001ed0 tx=0x7f4288007040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:32.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.613+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4290051110 con 0x7f42980cb340 2023-10-08T16:27:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.860+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f429804c3c0 con 0x7f42980cb340 2023-10-08T16:27:32.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.860+0000 7f427effd700 1 -- 172.21.15.12:0/1277282566 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f4290054730 con 0x7f42980cb340 2023-10-08T16:27:32.862 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:32.862 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 msgr2=0x7f42840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 0x7f42840693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4288001ed0 tx=0x7f4288007040 comp rx=0 tx=0).stop 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 msgr2=0x7f429816db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f42980697f0 tx=0x7f4290009040 comp rx=0 tx=0).stop 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 shutdown_connections 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4284066f30 0x7f42840693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f42980cb340 0x7f429816db30 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4280004810 0x7f4298169ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 --2- 172.21.15.12:0/1277282566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f42980caed0 0x7f429816d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 >> 172.21.15.12:0/1277282566 conn(0x7f429806d170 msgr2=0x7f42980c7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 shutdown_connections 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:32.863+0000 7f4297fff700 1 -- 172.21.15.12:0/1277282566 wait complete. 2023-10-08T16:27:32.865 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:27:32.881 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:27:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.067+0000 7fa8c6d9d700 1 Processor -- start 2023-10-08T16:27:33.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.067+0000 7fa8c6d9d700 1 -- start start 2023-10-08T16:27:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8c006e0a0 0x7fa8c00c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa8c006f3a0 0x7fa8c014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c01501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c006a490 con 0x7fa8c006e0a0 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c00c7490 con 0x7fa8c006f3a0 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c6d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00c7770 con 0x7fa8c006e470 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8c006e0a0 0x7fa8c00c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa8c006e0a0 0x7fa8c00c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35464/0 (socket says 172.21.15.12:35464) 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 -- 172.21.15.12:0/3742534430 learned_addr learned my addr 172.21.15.12:0/3742534430 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c659c700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c01501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c559a700 1 --2- 172.21.15.12:0/3742534430 >> v2:172.21.15.29:3300/0 conn(0x7fa8c006f3a0 0x7fa8c014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 -- 172.21.15.12:0/3742534430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 msgr2=0x7fa8c01501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c01501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 -- 172.21.15.12:0/3742534430 >> v2:172.21.15.29:3300/0 conn(0x7fa8c006f3a0 msgr2=0x7fa8c014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/3742534430 >> v2:172.21.15.29:3300/0 conn(0x7fa8c006f3a0 0x7fa8c014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.069+0000 7fa8c5d9b700 1 -- 172.21.15.12:0/3742534430 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c00c7a50 con 0x7fa8c006e0a0 2023-10-08T16:27:33.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00c6b20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156140 tx=0x7fa8bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21420482659e6d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c4d99700 1 -- 172.21.15.12:0/3742534430 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00b860 con 0x7fa8c006e0a0 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c4d99700 1 -- 172.21.15.12:0/3742534430 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc00b9c0 con 0x7fa8c006e0a0 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c4d99700 1 -- 172.21.15.12:0/3742534430 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc00bd60 con 0x7fa8c006e0a0 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/3742534430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006e0a0 msgr2=0x7fa8c00c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.070+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00c6b20 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156140 tx=0x7fa8bc009250 comp rx=0 tx=0).stop 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/3742534430 shutdown_connections 2023-10-08T16:27:33.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c01501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/3742534430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00c6b20 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/3742534430 >> v2:172.21.15.29:3300/0 conn(0x7fa8c006f3a0 0x7fa8c014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/3742534430 >> 172.21.15.12:0/3742534430 conn(0x7fa8c006d170 msgr2=0x7fa8c00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/3742534430 shutdown_connections 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.071+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/3742534430 wait complete. 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.072+0000 7fa8c6d9d700 1 Processor -- start 2023-10-08T16:27:33.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.072+0000 7fa8c6d9d700 1 -- start start 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c00c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00b01e0 con 0x7fa8c006f3a0 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00b04c0 con 0x7fa8c006e0a0 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c6d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c00b07a0 con 0x7fa8c006e470 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35466/0 (socket says 172.21.15.12:35466) 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.073+0000 7fa8c659c700 1 -- 172.21.15.12:0/1110072470 learned_addr learned my addr 172.21.15.12:0/1110072470 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c559a700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c00c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 -- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 msgr2=0x7fa8c00c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c00c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 -- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8c006e0a0 msgr2=0x7fa8c00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 -- 172.21.15.12:0/1110072470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc0094f0 con 0x7fa8c006f3a0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c659c700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009fa0 tx=0x7fa8b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800ed20 con 0x7fa8c006f3a0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800ee80 con 0x7fa8c006f3a0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b8014670 con 0x7fa8c006f3a0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c00b0a80 con 0x7fa8c006f3a0 2023-10-08T16:27:33.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.074+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c00afe20 con 0x7fa8c006f3a0 2023-10-08T16:27:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.076+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c004c3c0 con 0x7fa8c006f3a0 2023-10-08T16:27:33.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.076+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8b80149e0 con 0x7fa8c006f3a0 2023-10-08T16:27:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.078+0000 7fa8b5ffb700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 0x7fa8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.078+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7fa8b8084f00 con 0x7fa8c006f3a0 2023-10-08T16:27:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.078+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 0x7fa8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.078+0000 7fa8c5d9b700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 0x7fa8a40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156140 tx=0x7fa8bc017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.082+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b8051f40 con 0x7fa8c006f3a0 2023-10-08T16:27:33.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.282+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8c00c7d30 con 0x7fa8c006f3a0 2023-10-08T16:27:33.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.283+0000 7fa8b5ffb700 1 -- 172.21.15.12:0/1110072470 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16007 (secure 0 0 0) 0x7fa8b8055560 con 0x7fa8c006f3a0 2023-10-08T16:27:33.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:33.285 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":129,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:30.371801+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:27:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 msgr2=0x7fa8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 0x7fa8a40693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0156140 tx=0x7fa8bc017000 comp rx=0 tx=0).stop 2023-10-08T16:27:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 msgr2=0x7fa8c01412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009fa0 tx=0x7fa8b8009900 comp rx=0 tx=0).stop 2023-10-08T16:27:33.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 shutdown_connections 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa8a4066f30 0x7fa8a40693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa8c006f3a0 0x7fa8c01412e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa8c006e0a0 0x7fa8c00af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 --2- 172.21.15.12:0/1110072470 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa8c006e470 0x7fa8c00c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 >> 172.21.15.12:0/1110072470 conn(0x7fa8c006d170 msgr2=0x7fa8c0147d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 shutdown_connections 2023-10-08T16:27:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.286+0000 7fa8c6d9d700 1 -- 172.21.15.12:0/1110072470 wait complete. 2023-10-08T16:27:33.304 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:27:33.305 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:27:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.492+0000 7f2d0639d700 1 Processor -- start 2023-10-08T16:27:33.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.492+0000 7f2d0639d700 1 -- start start 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d00142c00 0x7f2d0006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0639d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d000c7f90 0x7f2d0006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0639d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d000ca480 con 0x7f2d0006bd20 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0639d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0015e240 con 0x7f2d000c7f90 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0006b350 con 0x7f2d00142c00 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d000c7f90 0x7f2d0006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2d000c7f90 0x7f2d0006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35480/0 (socket says 172.21.15.12:35480) 2023-10-08T16:27:33.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 -- 172.21.15.12:0/2139940668 learned_addr learned my addr 172.21.15.12:0/2139940668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d0539b700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d00142c00 0x7f2d0006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 -- 172.21.15.12:0/2139940668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d00142c00 msgr2=0x7f2d0006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d00142c00 0x7f2d0006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 -- 172.21.15.12:0/2139940668 >> v1:172.21.15.29:6789/0 conn(0x7f2d0006bd20 legacy=0x7f2d000c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.494+0000 7f2d05b9c700 1 -- 172.21.15.12:0/2139940668 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0015df60 con 0x7f2d000c7f90 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2d05b9c700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000c7f90 0x7f2d0006c6a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009f50 tx=0x7f2cf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a15bf71cb45343 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2cf7fff700 1 -- 172.21.15.12:0/2139940668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800e070 con 0x7f2d000c7f90 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2cf7fff700 1 -- 172.21.15.12:0/2139940668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf800ba70 con 0x7f2d000c7f90 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2cf7fff700 1 -- 172.21.15.12:0/2139940668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80092e0 con 0x7f2d000c7f90 2023-10-08T16:27:33.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2d0639d700 1 -- 172.21.15.12:0/2139940668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000c7f90 msgr2=0x7f2d0006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.495+0000 7f2d0639d700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000c7f90 0x7f2d0006c6a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009f50 tx=0x7f2cf8009840 comp rx=0 tx=0).stop 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 -- 172.21.15.12:0/2139940668 shutdown_connections 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d000c7f90 0x7f2d0006c6a0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 --2- 172.21.15.12:0/2139940668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d00142c00 0x7f2d0006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 -- 172.21.15.12:0/2139940668 >> 172.21.15.12:0/2139940668 conn(0x7f2d000675a0 msgr2=0x7f2d000679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 -- 172.21.15.12:0/2139940668 shutdown_connections 2023-10-08T16:27:33.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.496+0000 7f2d0639d700 1 -- 172.21.15.12:0/2139940668 wait complete. 2023-10-08T16:27:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.497+0000 7f2d0639d700 1 Processor -- start 2023-10-08T16:27:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.497+0000 7f2d0639d700 1 -- start start 2023-10-08T16:27:33.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 0x7f2d00158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d000c7f90 0x7f2d0013eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 0x7f2d0013d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d000c4700 con 0x7f2d00142c00 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d00159520 con 0x7f2d0006bd20 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0013f3c0 con 0x7f2d000c7f90 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.498+0000 7f2d0539b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 0x7f2d00158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 0x7f2d0013d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d0539b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 0x7f2d00158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54216/0 (socket says 172.21.15.12:54216) 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d0539b700 1 -- 172.21.15.12:0/982625544 learned_addr learned my addr 172.21.15.12:0/982625544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d04b9a700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d000c7f90 0x7f2d0013eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 -- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d000c7f90 msgr2=0x7f2d0013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d000c7f90 0x7f2d0013eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 -- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 msgr2=0x7f2d00158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 0x7f2d00158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 -- 172.21.15.12:0/982625544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf8009ae0 con 0x7f2d00142c00 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2d05b9c700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 0x7f2d0013d6b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8015000 tx=0x7f2cf8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.499+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8008ce0 con 0x7f2d00142c00 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.500+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf8008e60 con 0x7f2d00142c00 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.500+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80266b0 con 0x7f2d00142c00 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.500+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0013f6a0 con 0x7f2d00142c00 2023-10-08T16:27:33.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.500+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d000c4390 con 0x7f2d00142c00 2023-10-08T16:27:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.501+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d00141b50 con 0x7f2d00142c00 2023-10-08T16:27:33.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.502+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2cf8003040 con 0x7f2d00142c00 2023-10-08T16:27:33.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.502+0000 7f2cf57fa700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.503+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f2cf80864c0 con 0x7f2d00142c00 2023-10-08T16:27:33.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.503+0000 7f2d0539b700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.503+0000 7f2d0539b700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 0x7f2ce40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.507+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cf80535a0 con 0x7f2d00142c00 2023-10-08T16:27:33.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.704+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2d0004c3c0 con 0x7f2ce4066f30 2023-10-08T16:27:33.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.715+0000 7f2cf57fa700 1 -- 172.21.15.12:0/982625544 <== mgr.7255 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289618 (secure 0 0 0) 0x7f2d0004c3c0 con 0x7f2ce4066f30 2023-10-08T16:27:33.719 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 msgr2=0x7f2ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 0x7f2ce40693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc006fd0 tx=0x7f2cfc008040 comp rx=0 tx=0).stop 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 msgr2=0x7f2d0013d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 0x7f2d0013d6b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8015000 tx=0x7f2cf8018000 comp rx=0 tx=0).stop 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 shutdown_connections 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2ce4066f30 0x7f2ce40693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2d00142c00 0x7f2d0013d6b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2d0006bd20 0x7f2d00158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 --2- 172.21.15.12:0/982625544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2d000c7f90 0x7f2d0013eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 >> 172.21.15.12:0/982625544 conn(0x7f2d000675a0 msgr2=0x7f2d000c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 shutdown_connections 2023-10-08T16:27:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.719+0000 7f2d0639d700 1 -- 172.21.15.12:0/982625544 wait complete. 2023-10-08T16:27:33.723 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:27:33.737 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:27:32.800110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2445224,"kb_used_data":13672,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752529496,"statfs":{"total":773094113280,"available":770590203904,"internally_reserved":0,"allocated":14000128,"data_stored":7436628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.461755"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379278+0000","last_change":"2023-10-08T16:27:29.373858+0000","last_active":"2023-10-08T16:27:29.379278+0000","last_peered":"2023-10-08T16:27:29.379278+0000","last_clean":"2023-10-08T16:27:29.379278+0000","last_became_active":"2023-10-08T16:27:29.373565+0000","last_became_peered":"2023-10-08T16:27:29.373565+0000","last_unstale":"2023-10-08T16:27:29.379278+0000","last_undegraded":"2023-10-08T16:27:29.379278+0000","last_fullsized":"2023-10-08T16:27:29.379278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:14.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392102+0000","last_change":"2023-10-08T16:27:29.389184+0000","last_active":"2023-10-08T16:27:29.392102+0000","last_peered":"2023-10-08T16:27:29.392102+0000","last_clean":"2023-10-08T16:27:29.392102+0000","last_became_active":"2023-10-08T16:27:29.388922+0000","last_became_peered":"2023-10-08T16:27:29.388922+0000","last_unstale":"2023-10-08T16:27:29.392102+0000","last_undegraded":"2023-10-08T16:27:29.392102+0000","last_fullsized":"2023-10-08T16:27:29.392102+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:03.032285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379557+0000","last_change":"2023-10-08T16:27:29.374553+0000","last_active":"2023-10-08T16:27:29.379557+0000","last_peered":"2023-10-08T16:27:29.379557+0000","last_clean":"2023-10-08T16:27:29.379557+0000","last_became_active":"2023-10-08T16:27:29.374272+0000","last_became_peered":"2023-10-08T16:27:29.374272+0000","last_unstale":"2023-10-08T16:27:29.379557+0000","last_undegraded":"2023-10-08T16:27:29.379557+0000","last_fullsized":"2023-10-08T16:27:29.379557+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:59.982427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387685+0000","last_change":"2023-10-08T16:27:29.381088+0000","last_active":"2023-10-08T16:27:29.387685+0000","last_peered":"2023-10-08T16:27:29.387685+0000","last_clean":"2023-10-08T16:27:29.387685+0000","last_became_active":"2023-10-08T16:27:29.380708+0000","last_became_peered":"2023-10-08T16:27:29.380708+0000","last_unstale":"2023-10-08T16:27:29.387685+0000","last_undegraded":"2023-10-08T16:27:29.387685+0000","last_fullsized":"2023-10-08T16:27:29.387685+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:11.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387043+0000","last_change":"2023-10-08T16:27:29.384186+0000","last_active":"2023-10-08T16:27:29.387043+0000","last_peered":"2023-10-08T16:27:29.387043+0000","last_clean":"2023-10-08T16:27:29.387043+0000","last_became_active":"2023-10-08T16:27:29.383892+0000","last_became_peered":"2023-10-08T16:27:29.383892+0000","last_unstale":"2023-10-08T16:27:29.387043+0000","last_undegraded":"2023-10-08T16:27:29.387043+0000","last_fullsized":"2023-10-08T16:27:29.387043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:33.630944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389426+0000","last_change":"2023-10-08T16:27:29.379416+0000","last_active":"2023-10-08T16:27:29.389426+0000","last_peered":"2023-10-08T16:27:29.389426+0000","last_clean":"2023-10-08T16:27:29.389426+0000","last_became_active":"2023-10-08T16:27:29.379148+0000","last_became_peered":"2023-10-08T16:27:29.379148+0000","last_unstale":"2023-10-08T16:27:29.389426+0000","last_undegraded":"2023-10-08T16:27:29.389426+0000","last_fullsized":"2023-10-08T16:27:29.389426+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:42.424082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389461+0000","last_change":"2023-10-08T16:27:29.378709+0000","last_active":"2023-10-08T16:27:29.389461+0000","last_peered":"2023-10-08T16:27:29.389461+0000","last_clean":"2023-10-08T16:27:29.389461+0000","last_became_active":"2023-10-08T16:27:29.378391+0000","last_became_peered":"2023-10-08T16:27:29.378391+0000","last_unstale":"2023-10-08T16:27:29.389461+0000","last_undegraded":"2023-10-08T16:27:29.389461+0000","last_fullsized":"2023-10-08T16:27:29.389461+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.957655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390908+0000","last_change":"2023-10-08T16:27:29.383757+0000","last_active":"2023-10-08T16:27:29.390908+0000","last_peered":"2023-10-08T16:27:29.390908+0000","last_clean":"2023-10-08T16:27:29.390908+0000","last_became_active":"2023-10-08T16:27:29.383460+0000","last_became_peered":"2023-10-08T16:27:29.383460+0000","last_unstale":"2023-10-08T16:27:29.390908+0000","last_undegraded":"2023-10-08T16:27:29.390908+0000","last_fullsized":"2023-10-08T16:27:29.390908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:46.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386732+0000","last_change":"2023-10-08T16:27:29.382427+0000","last_active":"2023-10-08T16:27:29.386732+0000","last_peered":"2023-10-08T16:27:29.386732+0000","last_clean":"2023-10-08T16:27:29.386732+0000","last_became_active":"2023-10-08T16:27:29.382050+0000","last_became_peered":"2023-10-08T16:27:29.382050+0000","last_unstale":"2023-10-08T16:27:29.386732+0000","last_undegraded":"2023-10-08T16:27:29.386732+0000","last_fullsized":"2023-10-08T16:27:29.386732+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:48.123995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375739+0000","last_change":"2023-10-08T16:27:29.373150+0000","last_active":"2023-10-08T16:27:29.375739+0000","last_peered":"2023-10-08T16:27:29.375739+0000","last_clean":"2023-10-08T16:27:29.375739+0000","last_became_active":"2023-10-08T16:27:29.372856+0000","last_became_peered":"2023-10-08T16:27:29.372856+0000","last_unstale":"2023-10-08T16:27:29.375739+0000","last_undegraded":"2023-10-08T16:27:29.375739+0000","last_fullsized":"2023-10-08T16:27:29.375739+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:44.005158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393114+0000","last_change":"2023-10-08T16:27:29.391427+0000","last_active":"2023-10-08T16:27:29.393114+0000","last_peered":"2023-10-08T16:27:29.393114+0000","last_clean":"2023-10-08T16:27:29.393114+0000","last_became_active":"2023-10-08T16:27:29.391137+0000","last_became_peered":"2023-10-08T16:27:29.391137+0000","last_unstale":"2023-10-08T16:27:29.393114+0000","last_undegraded":"2023-10-08T16:27:29.393114+0000","last_fullsized":"2023-10-08T16:27:29.393114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:47.843659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385138+0000","last_change":"2023-10-08T16:27:29.379483+0000","last_active":"2023-10-08T16:27:29.385138+0000","last_peered":"2023-10-08T16:27:29.385138+0000","last_clean":"2023-10-08T16:27:29.385138+0000","last_became_active":"2023-10-08T16:27:29.379212+0000","last_became_peered":"2023-10-08T16:27:29.379212+0000","last_unstale":"2023-10-08T16:27:29.385138+0000","last_undegraded":"2023-10-08T16:27:29.385138+0000","last_fullsized":"2023-10-08T16:27:29.385138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:29.030060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392728+0000","last_change":"2023-10-08T16:27:29.390119+0000","last_active":"2023-10-08T16:27:29.392728+0000","last_peered":"2023-10-08T16:27:29.392728+0000","last_clean":"2023-10-08T16:27:29.392728+0000","last_became_active":"2023-10-08T16:27:29.389829+0000","last_became_peered":"2023-10-08T16:27:29.389829+0000","last_unstale":"2023-10-08T16:27:29.392728+0000","last_undegraded":"2023-10-08T16:27:29.392728+0000","last_fullsized":"2023-10-08T16:27:29.392728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.957655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387204+0000","last_change":"2023-10-08T16:27:29.381607+0000","last_active":"2023-10-08T16:27:29.387204+0000","last_peered":"2023-10-08T16:27:29.387204+0000","last_clean":"2023-10-08T16:27:29.387204+0000","last_became_active":"2023-10-08T16:27:29.381346+0000","last_became_peered":"2023-10-08T16:27:29.381346+0000","last_unstale":"2023-10-08T16:27:29.387204+0000","last_undegraded":"2023-10-08T16:27:29.387204+0000","last_fullsized":"2023-10-08T16:27:29.387204+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:44.662043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381640+0000","last_change":"2023-10-08T16:27:29.379465+0000","last_active":"2023-10-08T16:27:29.381640+0000","last_peered":"2023-10-08T16:27:29.381640+0000","last_clean":"2023-10-08T16:27:29.381640+0000","last_became_active":"2023-10-08T16:27:29.379165+0000","last_became_peered":"2023-10-08T16:27:29.379165+0000","last_unstale":"2023-10-08T16:27:29.381640+0000","last_undegraded":"2023-10-08T16:27:29.381640+0000","last_fullsized":"2023-10-08T16:27:29.381640+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:07.811729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392326+0000","last_change":"2023-10-08T16:27:29.383826+0000","last_active":"2023-10-08T16:27:29.392326+0000","last_peered":"2023-10-08T16:27:29.392326+0000","last_clean":"2023-10-08T16:27:29.392326+0000","last_became_active":"2023-10-08T16:27:29.383572+0000","last_became_peered":"2023-10-08T16:27:29.383572+0000","last_unstale":"2023-10-08T16:27:29.392326+0000","last_undegraded":"2023-10-08T16:27:29.392326+0000","last_fullsized":"2023-10-08T16:27:29.392326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:11.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394932+0000","last_change":"2023-10-08T16:27:29.390612+0000","last_active":"2023-10-08T16:27:29.394932+0000","last_peered":"2023-10-08T16:27:29.394932+0000","last_clean":"2023-10-08T16:27:29.394932+0000","last_became_active":"2023-10-08T16:27:29.388094+0000","last_became_peered":"2023-10-08T16:27:29.388094+0000","last_unstale":"2023-10-08T16:27:29.394932+0000","last_undegraded":"2023-10-08T16:27:29.394932+0000","last_fullsized":"2023-10-08T16:27:29.394932+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:17.963950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392881+0000","last_change":"2023-10-08T16:27:29.390965+0000","last_active":"2023-10-08T16:27:29.392881+0000","last_peered":"2023-10-08T16:27:29.392881+0000","last_clean":"2023-10-08T16:27:29.392881+0000","last_became_active":"2023-10-08T16:27:29.389412+0000","last_became_peered":"2023-10-08T16:27:29.389412+0000","last_unstale":"2023-10-08T16:27:29.392881+0000","last_undegraded":"2023-10-08T16:27:29.392881+0000","last_fullsized":"2023-10-08T16:27:29.392881+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:47.843659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381026+0000","last_change":"2023-10-08T16:27:29.377250+0000","last_active":"2023-10-08T16:27:29.381026+0000","last_peered":"2023-10-08T16:27:29.381026+0000","last_clean":"2023-10-08T16:27:29.381026+0000","last_became_active":"2023-10-08T16:27:29.376977+0000","last_became_peered":"2023-10-08T16:27:29.376977+0000","last_unstale":"2023-10-08T16:27:29.381026+0000","last_undegraded":"2023-10-08T16:27:29.381026+0000","last_fullsized":"2023-10-08T16:27:29.381026+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:27.927620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386762+0000","last_change":"2023-10-08T16:27:29.382224+0000","last_active":"2023-10-08T16:27:29.386762+0000","last_peered":"2023-10-08T16:27:29.386762+0000","last_clean":"2023-10-08T16:27:29.386762+0000","last_became_active":"2023-10-08T16:27:29.381947+0000","last_became_peered":"2023-10-08T16:27:29.381947+0000","last_unstale":"2023-10-08T16:27:29.386762+0000","last_undegraded":"2023-10-08T16:27:29.386762+0000","last_fullsized":"2023-10-08T16:27:29.386762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:02.792968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.384912+0000","last_change":"2023-10-08T16:27:29.379754+0000","last_active":"2023-10-08T16:27:29.384912+0000","last_peered":"2023-10-08T16:27:29.384912+0000","last_clean":"2023-10-08T16:27:29.384912+0000","last_became_active":"2023-10-08T16:27:29.379472+0000","last_became_peered":"2023-10-08T16:27:29.379472+0000","last_unstale":"2023-10-08T16:27:29.384912+0000","last_undegraded":"2023-10-08T16:27:29.384912+0000","last_fullsized":"2023-10-08T16:27:29.384912+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:47.942997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390195+0000","last_change":"2023-10-08T16:27:29.383617+0000","last_active":"2023-10-08T16:27:29.390195+0000","last_peered":"2023-10-08T16:27:29.390195+0000","last_clean":"2023-10-08T16:27:29.390195+0000","last_became_active":"2023-10-08T16:27:29.383352+0000","last_became_peered":"2023-10-08T16:27:29.383352+0000","last_unstale":"2023-10-08T16:27:29.390195+0000","last_undegraded":"2023-10-08T16:27:29.390195+0000","last_fullsized":"2023-10-08T16:27:29.390195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:00.850581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390251+0000","last_change":"2023-10-08T16:27:29.382866+0000","last_active":"2023-10-08T16:27:29.390251+0000","last_peered":"2023-10-08T16:27:29.390251+0000","last_clean":"2023-10-08T16:27:29.390251+0000","last_became_active":"2023-10-08T16:27:29.382433+0000","last_became_peered":"2023-10-08T16:27:29.382433+0000","last_unstale":"2023-10-08T16:27:29.390251+0000","last_undegraded":"2023-10-08T16:27:29.390251+0000","last_fullsized":"2023-10-08T16:27:29.390251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:56.251411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392303+0000","last_change":"2023-10-08T16:27:29.383277+0000","last_active":"2023-10-08T16:27:29.392303+0000","last_peered":"2023-10-08T16:27:29.392303+0000","last_clean":"2023-10-08T16:27:29.392303+0000","last_became_active":"2023-10-08T16:27:29.383021+0000","last_became_peered":"2023-10-08T16:27:29.383021+0000","last_unstale":"2023-10-08T16:27:29.392303+0000","last_undegraded":"2023-10-08T16:27:29.392303+0000","last_fullsized":"2023-10-08T16:27:29.392303+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:49.576056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386241+0000","last_change":"2023-10-08T16:27:29.382396+0000","last_active":"2023-10-08T16:27:29.386241+0000","last_peered":"2023-10-08T16:27:29.386241+0000","last_clean":"2023-10-08T16:27:29.386241+0000","last_became_active":"2023-10-08T16:27:29.382049+0000","last_became_peered":"2023-10-08T16:27:29.382049+0000","last_unstale":"2023-10-08T16:27:29.386241+0000","last_undegraded":"2023-10-08T16:27:29.386241+0000","last_fullsized":"2023-10-08T16:27:29.386241+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:02.792968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390244+0000","last_change":"2023-10-08T16:27:29.382448+0000","last_active":"2023-10-08T16:27:29.390244+0000","last_peered":"2023-10-08T16:27:29.390244+0000","last_clean":"2023-10-08T16:27:29.390244+0000","last_became_active":"2023-10-08T16:27:29.382177+0000","last_became_peered":"2023-10-08T16:27:29.382177+0000","last_unstale":"2023-10-08T16:27:29.390244+0000","last_undegraded":"2023-10-08T16:27:29.390244+0000","last_fullsized":"2023-10-08T16:27:29.390244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:55.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392304+0000","last_change":"2023-10-08T16:27:29.385536+0000","last_active":"2023-10-08T16:27:29.392304+0000","last_peered":"2023-10-08T16:27:29.392304+0000","last_clean":"2023-10-08T16:27:29.392304+0000","last_became_active":"2023-10-08T16:27:29.384915+0000","last_became_peered":"2023-10-08T16:27:29.384915+0000","last_unstale":"2023-10-08T16:27:29.392304+0000","last_undegraded":"2023-10-08T16:27:29.392304+0000","last_fullsized":"2023-10-08T16:27:29.392304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:48.024657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387203+0000","last_change":"2023-10-08T16:27:29.384226+0000","last_active":"2023-10-08T16:27:29.387203+0000","last_peered":"2023-10-08T16:27:29.387203+0000","last_clean":"2023-10-08T16:27:29.387203+0000","last_became_active":"2023-10-08T16:27:29.383948+0000","last_became_peered":"2023-10-08T16:27:29.383948+0000","last_unstale":"2023-10-08T16:27:29.387203+0000","last_undegraded":"2023-10-08T16:27:29.387203+0000","last_fullsized":"2023-10-08T16:27:29.387203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:59.559385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390873+0000","last_change":"2023-10-08T16:27:29.382317+0000","last_active":"2023-10-08T16:27:29.390873+0000","last_peered":"2023-10-08T16:27:29.390873+0000","last_clean":"2023-10-08T16:27:29.390873+0000","last_became_active":"2023-10-08T16:27:29.382017+0000","last_became_peered":"2023-10-08T16:27:29.382017+0000","last_unstale":"2023-10-08T16:27:29.390873+0000","last_undegraded":"2023-10-08T16:27:29.390873+0000","last_fullsized":"2023-10-08T16:27:29.390873+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:04.056985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387234+0000","last_change":"2023-10-08T16:27:29.382685+0000","last_active":"2023-10-08T16:27:29.387234+0000","last_peered":"2023-10-08T16:27:29.387234+0000","last_clean":"2023-10-08T16:27:29.387234+0000","last_became_active":"2023-10-08T16:27:29.377687+0000","last_became_peered":"2023-10-08T16:27:29.377687+0000","last_unstale":"2023-10-08T16:27:29.387234+0000","last_undegraded":"2023-10-08T16:27:29.387234+0000","last_fullsized":"2023-10-08T16:27:29.387234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:24.967293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381623+0000","last_change":"2023-10-08T16:27:29.378920+0000","last_active":"2023-10-08T16:27:29.381623+0000","last_peered":"2023-10-08T16:27:29.381623+0000","last_clean":"2023-10-08T16:27:29.381623+0000","last_became_active":"2023-10-08T16:27:29.378630+0000","last_became_peered":"2023-10-08T16:27:29.378630+0000","last_unstale":"2023-10-08T16:27:29.381623+0000","last_undegraded":"2023-10-08T16:27:29.381623+0000","last_fullsized":"2023-10-08T16:27:29.381623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:53.605021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393771+0000","last_change":"2023-10-08T16:27:29.390691+0000","last_active":"2023-10-08T16:27:29.393771+0000","last_peered":"2023-10-08T16:27:29.393771+0000","last_clean":"2023-10-08T16:27:29.393771+0000","last_became_active":"2023-10-08T16:27:29.390385+0000","last_became_peered":"2023-10-08T16:27:29.390385+0000","last_unstale":"2023-10-08T16:27:29.393771+0000","last_undegraded":"2023-10-08T16:27:29.393771+0000","last_fullsized":"2023-10-08T16:27:29.393771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:12.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387281+0000","last_change":"2023-10-08T16:27:29.383267+0000","last_active":"2023-10-08T16:27:29.387281+0000","last_peered":"2023-10-08T16:27:29.387281+0000","last_clean":"2023-10-08T16:27:29.387281+0000","last_became_active":"2023-10-08T16:27:29.383005+0000","last_became_peered":"2023-10-08T16:27:29.383005+0000","last_unstale":"2023-10-08T16:27:29.387281+0000","last_undegraded":"2023-10-08T16:27:29.387281+0000","last_fullsized":"2023-10-08T16:27:29.387281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:10:25.423783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"128'4","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395572+0000","last_change":"2023-10-08T16:27:28.363387+0000","last_active":"2023-10-08T16:27:29.395572+0000","last_peered":"2023-10-08T16:27:29.395572+0000","last_clean":"2023-10-08T16:27:29.395572+0000","last_became_active":"2023-10-08T16:27:28.363091+0000","last_became_peered":"2023-10-08T16:27:28.363091+0000","last_unstale":"2023-10-08T16:27:29.395572+0000","last_undegraded":"2023-10-08T16:27:29.395572+0000","last_fullsized":"2023-10-08T16:27:29.395572+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:44.757436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387657+0000","last_change":"2023-10-08T16:27:29.380122+0000","last_active":"2023-10-08T16:27:29.387657+0000","last_peered":"2023-10-08T16:27:29.387657+0000","last_clean":"2023-10-08T16:27:29.387657+0000","last_became_active":"2023-10-08T16:27:29.379756+0000","last_became_peered":"2023-10-08T16:27:29.379756+0000","last_unstale":"2023-10-08T16:27:29.387657+0000","last_undegraded":"2023-10-08T16:27:29.387657+0000","last_fullsized":"2023-10-08T16:27:29.387657+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:28.061066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394474+0000","last_change":"2023-10-08T16:27:28.365010+0000","last_active":"2023-10-08T16:27:29.394474+0000","last_peered":"2023-10-08T16:27:29.394474+0000","last_clean":"2023-10-08T16:27:29.394474+0000","last_became_active":"2023-10-08T16:27:28.364683+0000","last_became_peered":"2023-10-08T16:27:28.364683+0000","last_unstale":"2023-10-08T16:27:29.394474+0000","last_undegraded":"2023-10-08T16:27:29.394474+0000","last_fullsized":"2023-10-08T16:27:29.394474+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:44.235757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379067+0000","last_change":"2023-10-08T16:27:29.372939+0000","last_active":"2023-10-08T16:27:29.379067+0000","last_peered":"2023-10-08T16:27:29.379067+0000","last_clean":"2023-10-08T16:27:29.379067+0000","last_became_active":"2023-10-08T16:27:29.372650+0000","last_became_peered":"2023-10-08T16:27:29.372650+0000","last_unstale":"2023-10-08T16:27:29.379067+0000","last_undegraded":"2023-10-08T16:27:29.379067+0000","last_fullsized":"2023-10-08T16:27:29.379067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:29.478719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394642+0000","last_change":"2023-10-08T16:27:28.358992+0000","last_active":"2023-10-08T16:27:29.394642+0000","last_peered":"2023-10-08T16:27:29.394642+0000","last_clean":"2023-10-08T16:27:29.394642+0000","last_became_active":"2023-10-08T16:27:28.358680+0000","last_became_peered":"2023-10-08T16:27:28.358680+0000","last_unstale":"2023-10-08T16:27:29.394642+0000","last_undegraded":"2023-10-08T16:27:29.394642+0000","last_fullsized":"2023-10-08T16:27:29.394642+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:34.612493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385014+0000","last_change":"2023-10-08T16:27:29.377113+0000","last_active":"2023-10-08T16:27:29.385014+0000","last_peered":"2023-10-08T16:27:29.385014+0000","last_clean":"2023-10-08T16:27:29.385014+0000","last_became_active":"2023-10-08T16:27:29.375055+0000","last_became_peered":"2023-10-08T16:27:29.375055+0000","last_unstale":"2023-10-08T16:27:29.385014+0000","last_undegraded":"2023-10-08T16:27:29.385014+0000","last_fullsized":"2023-10-08T16:27:29.385014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:28.517941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395387+0000","last_change":"2023-10-08T16:27:28.369648+0000","last_active":"2023-10-08T16:27:29.395387+0000","last_peered":"2023-10-08T16:27:29.395387+0000","last_clean":"2023-10-08T16:27:29.395387+0000","last_became_active":"2023-10-08T16:27:28.369374+0000","last_became_peered":"2023-10-08T16:27:28.369374+0000","last_unstale":"2023-10-08T16:27:29.395387+0000","last_undegraded":"2023-10-08T16:27:29.395387+0000","last_fullsized":"2023-10-08T16:27:29.395387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:05.384399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390734+0000","last_change":"2023-10-08T16:27:29.387753+0000","last_active":"2023-10-08T16:27:29.390734+0000","last_peered":"2023-10-08T16:27:29.390734+0000","last_clean":"2023-10-08T16:27:29.390734+0000","last_became_active":"2023-10-08T16:27:29.387480+0000","last_became_peered":"2023-10-08T16:27:29.387480+0000","last_unstale":"2023-10-08T16:27:29.390734+0000","last_undegraded":"2023-10-08T16:27:29.390734+0000","last_fullsized":"2023-10-08T16:27:29.390734+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:43.946265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392503+0000","last_change":"2023-10-08T16:27:28.360760+0000","last_active":"2023-10-08T16:27:29.392503+0000","last_peered":"2023-10-08T16:27:29.392503+0000","last_clean":"2023-10-08T16:27:29.392503+0000","last_became_active":"2023-10-08T16:27:28.360279+0000","last_became_peered":"2023-10-08T16:27:28.360279+0000","last_unstale":"2023-10-08T16:27:29.392503+0000","last_undegraded":"2023-10-08T16:27:29.392503+0000","last_fullsized":"2023-10-08T16:27:29.392503+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:29:06.530062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381964+0000","last_change":"2023-10-08T16:27:29.377374+0000","last_active":"2023-10-08T16:27:29.381964+0000","last_peered":"2023-10-08T16:27:29.381964+0000","last_clean":"2023-10-08T16:27:29.381964+0000","last_became_active":"2023-10-08T16:27:29.377106+0000","last_became_peered":"2023-10-08T16:27:29.377106+0000","last_unstale":"2023-10-08T16:27:29.381964+0000","last_undegraded":"2023-10-08T16:27:29.381964+0000","last_fullsized":"2023-10-08T16:27:29.381964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:03.987781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394924+0000","last_change":"2023-10-08T16:27:28.368034+0000","last_active":"2023-10-08T16:27:29.394924+0000","last_peered":"2023-10-08T16:27:29.394924+0000","last_clean":"2023-10-08T16:27:29.394924+0000","last_became_active":"2023-10-08T16:27:28.367754+0000","last_became_peered":"2023-10-08T16:27:28.367754+0000","last_unstale":"2023-10-08T16:27:29.394924+0000","last_undegraded":"2023-10-08T16:27:29.394924+0000","last_fullsized":"2023-10-08T16:27:29.394924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:07.865035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387619+0000","last_change":"2023-10-08T16:27:29.380132+0000","last_active":"2023-10-08T16:27:29.387619+0000","last_peered":"2023-10-08T16:27:29.387619+0000","last_clean":"2023-10-08T16:27:29.387619+0000","last_became_active":"2023-10-08T16:27:29.379712+0000","last_became_peered":"2023-10-08T16:27:29.379712+0000","last_unstale":"2023-10-08T16:27:29.387619+0000","last_undegraded":"2023-10-08T16:27:29.387619+0000","last_fullsized":"2023-10-08T16:27:29.387619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:49.576056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.365818+0000","last_change":"2023-10-08T16:27:28.364305+0000","last_active":"2023-10-08T16:27:29.365818+0000","last_peered":"2023-10-08T16:27:29.365818+0000","last_clean":"2023-10-08T16:27:29.365818+0000","last_became_active":"2023-10-08T16:27:28.364027+0000","last_became_peered":"2023-10-08T16:27:28.364027+0000","last_unstale":"2023-10-08T16:27:29.365818+0000","last_undegraded":"2023-10-08T16:27:29.365818+0000","last_fullsized":"2023-10-08T16:27:29.365818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:12.791712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385206+0000","last_change":"2023-10-08T16:27:29.378769+0000","last_active":"2023-10-08T16:27:29.385206+0000","last_peered":"2023-10-08T16:27:29.385206+0000","last_clean":"2023-10-08T16:27:29.385206+0000","last_became_active":"2023-10-08T16:27:29.378512+0000","last_became_peered":"2023-10-08T16:27:29.378512+0000","last_unstale":"2023-10-08T16:27:29.385206+0000","last_undegraded":"2023-10-08T16:27:29.385206+0000","last_fullsized":"2023-10-08T16:27:29.385206+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:17:37.117093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.362532+0000","last_change":"2023-10-08T16:27:28.362914+0000","last_active":"2023-10-08T16:27:29.362532+0000","last_peered":"2023-10-08T16:27:29.362532+0000","last_clean":"2023-10-08T16:27:29.362532+0000","last_became_active":"2023-10-08T16:27:28.362643+0000","last_became_peered":"2023-10-08T16:27:28.362643+0000","last_unstale":"2023-10-08T16:27:29.362532+0000","last_undegraded":"2023-10-08T16:27:29.362532+0000","last_fullsized":"2023-10-08T16:27:29.362532+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:31.480683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394894+0000","last_change":"2023-10-08T16:27:29.391268+0000","last_active":"2023-10-08T16:27:29.394894+0000","last_peered":"2023-10-08T16:27:29.394894+0000","last_clean":"2023-10-08T16:27:29.394894+0000","last_became_active":"2023-10-08T16:27:29.390978+0000","last_became_peered":"2023-10-08T16:27:29.390978+0000","last_unstale":"2023-10-08T16:27:29.394894+0000","last_undegraded":"2023-10-08T16:27:29.394894+0000","last_fullsized":"2023-10-08T16:27:29.394894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:17.572035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363480+0000","last_change":"2023-10-08T16:27:28.349341+0000","last_active":"2023-10-08T16:27:29.363480+0000","last_peered":"2023-10-08T16:27:29.363480+0000","last_clean":"2023-10-08T16:27:29.363480+0000","last_became_active":"2023-10-08T16:27:28.349059+0000","last_became_peered":"2023-10-08T16:27:28.349059+0000","last_unstale":"2023-10-08T16:27:29.363480+0000","last_undegraded":"2023-10-08T16:27:29.363480+0000","last_fullsized":"2023-10-08T16:27:29.363480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:26:57.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385179+0000","last_change":"2023-10-08T16:27:29.379595+0000","last_active":"2023-10-08T16:27:29.385179+0000","last_peered":"2023-10-08T16:27:29.385179+0000","last_clean":"2023-10-08T16:27:29.385179+0000","last_became_active":"2023-10-08T16:27:29.379306+0000","last_became_peered":"2023-10-08T16:27:29.379306+0000","last_unstale":"2023-10-08T16:27:29.385179+0000","last_undegraded":"2023-10-08T16:27:29.385179+0000","last_fullsized":"2023-10-08T16:27:29.385179+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:58.984309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369963+0000","last_change":"2023-10-08T16:27:28.365568+0000","last_active":"2023-10-08T16:27:29.369963+0000","last_peered":"2023-10-08T16:27:29.369963+0000","last_clean":"2023-10-08T16:27:29.369963+0000","last_became_active":"2023-10-08T16:27:28.365300+0000","last_became_peered":"2023-10-08T16:27:28.365300+0000","last_unstale":"2023-10-08T16:27:29.369963+0000","last_undegraded":"2023-10-08T16:27:29.369963+0000","last_fullsized":"2023-10-08T16:27:29.369963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:59.845119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.383375+0000","last_change":"2023-10-08T16:27:29.379430+0000","last_active":"2023-10-08T16:27:29.383375+0000","last_peered":"2023-10-08T16:27:29.383375+0000","last_clean":"2023-10-08T16:27:29.383375+0000","last_became_active":"2023-10-08T16:27:29.379156+0000","last_became_peered":"2023-10-08T16:27:29.379156+0000","last_unstale":"2023-10-08T16:27:29.383375+0000","last_undegraded":"2023-10-08T16:27:29.383375+0000","last_fullsized":"2023-10-08T16:27:29.383375+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:48.123995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"128'3","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.396018+0000","last_change":"2023-10-08T16:27:28.362761+0000","last_active":"2023-10-08T16:27:29.396018+0000","last_peered":"2023-10-08T16:27:29.396018+0000","last_clean":"2023-10-08T16:27:29.396018+0000","last_became_active":"2023-10-08T16:27:28.362357+0000","last_became_peered":"2023-10-08T16:27:28.362357+0000","last_unstale":"2023-10-08T16:27:29.396018+0000","last_undegraded":"2023-10-08T16:27:29.396018+0000","last_fullsized":"2023-10-08T16:27:29.396018+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:55.245950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392325+0000","last_change":"2023-10-08T16:27:29.385709+0000","last_active":"2023-10-08T16:27:29.392325+0000","last_peered":"2023-10-08T16:27:29.392325+0000","last_clean":"2023-10-08T16:27:29.392325+0000","last_became_active":"2023-10-08T16:27:29.385275+0000","last_became_peered":"2023-10-08T16:27:29.385275+0000","last_unstale":"2023-10-08T16:27:29.392325+0000","last_undegraded":"2023-10-08T16:27:29.392325+0000","last_fullsized":"2023-10-08T16:27:29.392325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:53.605021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"128'6","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.397316+0000","last_change":"2023-10-08T16:27:28.363300+0000","last_active":"2023-10-08T16:27:29.397316+0000","last_peered":"2023-10-08T16:27:29.397316+0000","last_clean":"2023-10-08T16:27:29.397316+0000","last_became_active":"2023-10-08T16:27:28.363011+0000","last_became_peered":"2023-10-08T16:27:28.363011+0000","last_unstale":"2023-10-08T16:27:29.397316+0000","last_undegraded":"2023-10-08T16:27:29.397316+0000","last_fullsized":"2023-10-08T16:27:29.397316+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:10.148037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381466+0000","last_change":"2023-10-08T16:27:29.379392+0000","last_active":"2023-10-08T16:27:29.381466+0000","last_peered":"2023-10-08T16:27:29.381466+0000","last_clean":"2023-10-08T16:27:29.381466+0000","last_became_active":"2023-10-08T16:27:29.379130+0000","last_became_peered":"2023-10-08T16:27:29.379130+0000","last_unstale":"2023-10-08T16:27:29.381466+0000","last_undegraded":"2023-10-08T16:27:29.381466+0000","last_fullsized":"2023-10-08T16:27:29.381466+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:48.024657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394413+0000","last_change":"2023-10-08T16:27:28.359280+0000","last_active":"2023-10-08T16:27:29.394413+0000","last_peered":"2023-10-08T16:27:29.394413+0000","last_clean":"2023-10-08T16:27:29.394413+0000","last_became_active":"2023-10-08T16:27:28.358916+0000","last_became_peered":"2023-10-08T16:27:28.358916+0000","last_unstale":"2023-10-08T16:27:29.394413+0000","last_undegraded":"2023-10-08T16:27:29.394413+0000","last_fullsized":"2023-10-08T16:27:29.394413+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:17.230109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379137+0000","last_change":"2023-10-08T16:27:29.373144+0000","last_active":"2023-10-08T16:27:29.379137+0000","last_peered":"2023-10-08T16:27:29.379137+0000","last_clean":"2023-10-08T16:27:29.379137+0000","last_became_active":"2023-10-08T16:27:29.372894+0000","last_became_peered":"2023-10-08T16:27:29.372894+0000","last_unstale":"2023-10-08T16:27:29.379137+0000","last_undegraded":"2023-10-08T16:27:29.379137+0000","last_fullsized":"2023-10-08T16:27:29.379137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:55.440723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369476+0000","last_change":"2023-10-08T16:27:28.365643+0000","last_active":"2023-10-08T16:27:29.369476+0000","last_peered":"2023-10-08T16:27:29.369476+0000","last_clean":"2023-10-08T16:27:29.369476+0000","last_became_active":"2023-10-08T16:27:28.365383+0000","last_became_peered":"2023-10-08T16:27:28.365383+0000","last_unstale":"2023-10-08T16:27:29.369476+0000","last_undegraded":"2023-10-08T16:27:29.369476+0000","last_fullsized":"2023-10-08T16:27:29.369476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.704744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385355+0000","last_change":"2023-10-08T16:27:29.376814+0000","last_active":"2023-10-08T16:27:29.385355+0000","last_peered":"2023-10-08T16:27:29.385355+0000","last_clean":"2023-10-08T16:27:29.385355+0000","last_became_active":"2023-10-08T16:27:29.376443+0000","last_became_peered":"2023-10-08T16:27:29.376443+0000","last_unstale":"2023-10-08T16:27:29.385355+0000","last_undegraded":"2023-10-08T16:27:29.385355+0000","last_fullsized":"2023-10-08T16:27:29.385355+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:08.870496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363845+0000","last_change":"2023-10-08T16:27:28.358696+0000","last_active":"2023-10-08T16:27:29.363845+0000","last_peered":"2023-10-08T16:27:29.363845+0000","last_clean":"2023-10-08T16:27:29.363845+0000","last_became_active":"2023-10-08T16:27:28.358372+0000","last_became_peered":"2023-10-08T16:27:28.358372+0000","last_unstale":"2023-10-08T16:27:29.363845+0000","last_undegraded":"2023-10-08T16:27:29.363845+0000","last_fullsized":"2023-10-08T16:27:29.363845+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:42.940804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390412+0000","last_change":"2023-10-08T16:27:29.386998+0000","last_active":"2023-10-08T16:27:29.390412+0000","last_peered":"2023-10-08T16:27:29.390412+0000","last_clean":"2023-10-08T16:27:29.390412+0000","last_became_active":"2023-10-08T16:27:29.386112+0000","last_became_peered":"2023-10-08T16:27:29.386112+0000","last_unstale":"2023-10-08T16:27:29.390412+0000","last_undegraded":"2023-10-08T16:27:29.390412+0000","last_fullsized":"2023-10-08T16:27:29.390412+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:54.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"128'8","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394434+0000","last_change":"2023-10-08T16:27:28.363271+0000","last_active":"2023-10-08T16:27:29.394434+0000","last_peered":"2023-10-08T16:27:29.394434+0000","last_clean":"2023-10-08T16:27:29.394434+0000","last_became_active":"2023-10-08T16:27:28.362972+0000","last_became_peered":"2023-10-08T16:27:28.362972+0000","last_unstale":"2023-10-08T16:27:29.394434+0000","last_undegraded":"2023-10-08T16:27:29.394434+0000","last_fullsized":"2023-10-08T16:27:29.394434+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:30.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375537+0000","last_change":"2023-10-08T16:27:29.372458+0000","last_active":"2023-10-08T16:27:29.375537+0000","last_peered":"2023-10-08T16:27:29.375537+0000","last_clean":"2023-10-08T16:27:29.375537+0000","last_became_active":"2023-10-08T16:27:29.372194+0000","last_became_peered":"2023-10-08T16:27:29.372194+0000","last_unstale":"2023-10-08T16:27:29.375537+0000","last_undegraded":"2023-10-08T16:27:29.375537+0000","last_fullsized":"2023-10-08T16:27:29.375537+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:29.030060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395890+0000","last_change":"2023-10-08T16:27:28.361460+0000","last_active":"2023-10-08T16:27:29.395890+0000","last_peered":"2023-10-08T16:27:29.395890+0000","last_clean":"2023-10-08T16:27:29.395890+0000","last_became_active":"2023-10-08T16:27:28.361149+0000","last_became_peered":"2023-10-08T16:27:28.361149+0000","last_unstale":"2023-10-08T16:27:29.395890+0000","last_undegraded":"2023-10-08T16:27:29.395890+0000","last_fullsized":"2023-10-08T16:27:29.395890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:50.503118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.384403+0000","last_change":"2023-10-08T16:27:29.377724+0000","last_active":"2023-10-08T16:27:29.384403+0000","last_peered":"2023-10-08T16:27:29.384403+0000","last_clean":"2023-10-08T16:27:29.384403+0000","last_became_active":"2023-10-08T16:27:29.376197+0000","last_became_peered":"2023-10-08T16:27:29.376197+0000","last_unstale":"2023-10-08T16:27:29.384403+0000","last_undegraded":"2023-10-08T16:27:29.384403+0000","last_fullsized":"2023-10-08T16:27:29.384403+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:11.153498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394711+0000","last_change":"2023-10-08T16:27:28.356539+0000","last_active":"2023-10-08T16:27:29.394711+0000","last_peered":"2023-10-08T16:27:29.394711+0000","last_clean":"2023-10-08T16:27:29.394711+0000","last_became_active":"2023-10-08T16:27:28.356186+0000","last_became_peered":"2023-10-08T16:27:28.356186+0000","last_unstale":"2023-10-08T16:27:29.394711+0000","last_undegraded":"2023-10-08T16:27:29.394711+0000","last_fullsized":"2023-10-08T16:27:29.394711+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:23.153060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393133+0000","last_change":"2023-10-08T16:27:29.391980+0000","last_active":"2023-10-08T16:27:29.393133+0000","last_peered":"2023-10-08T16:27:29.393133+0000","last_clean":"2023-10-08T16:27:29.393133+0000","last_became_active":"2023-10-08T16:27:29.391723+0000","last_became_peered":"2023-10-08T16:27:29.391723+0000","last_unstale":"2023-10-08T16:27:29.393133+0000","last_undegraded":"2023-10-08T16:27:29.393133+0000","last_fullsized":"2023-10-08T16:27:29.393133+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:04.242088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.373042+0000","last_change":"2023-10-08T16:27:28.368857+0000","last_active":"2023-10-08T16:27:29.373042+0000","last_peered":"2023-10-08T16:27:29.373042+0000","last_clean":"2023-10-08T16:27:29.373042+0000","last_became_active":"2023-10-08T16:27:28.368586+0000","last_became_peered":"2023-10-08T16:27:28.368586+0000","last_unstale":"2023-10-08T16:27:29.373042+0000","last_undegraded":"2023-10-08T16:27:29.373042+0000","last_fullsized":"2023-10-08T16:27:29.373042+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:57.978848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387251+0000","last_change":"2023-10-08T16:27:29.383998+0000","last_active":"2023-10-08T16:27:29.387251+0000","last_peered":"2023-10-08T16:27:29.387251+0000","last_clean":"2023-10-08T16:27:29.387251+0000","last_became_active":"2023-10-08T16:27:29.383738+0000","last_became_peered":"2023-10-08T16:27:29.383738+0000","last_unstale":"2023-10-08T16:27:29.387251+0000","last_undegraded":"2023-10-08T16:27:29.387251+0000","last_fullsized":"2023-10-08T16:27:29.387251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:59.108829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395321+0000","last_change":"2023-10-08T16:27:28.358573+0000","last_active":"2023-10-08T16:27:29.395321+0000","last_peered":"2023-10-08T16:27:29.395321+0000","last_clean":"2023-10-08T16:27:29.395321+0000","last_became_active":"2023-10-08T16:27:28.358200+0000","last_became_peered":"2023-10-08T16:27:28.358200+0000","last_unstale":"2023-10-08T16:27:29.395321+0000","last_undegraded":"2023-10-08T16:27:29.395321+0000","last_fullsized":"2023-10-08T16:27:29.395321+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:47.118533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.382574+0000","last_change":"2023-10-08T16:27:29.373874+0000","last_active":"2023-10-08T16:27:29.382574+0000","last_peered":"2023-10-08T16:27:29.382574+0000","last_clean":"2023-10-08T16:27:29.382574+0000","last_became_active":"2023-10-08T16:27:29.373619+0000","last_became_peered":"2023-10-08T16:27:29.373619+0000","last_unstale":"2023-10-08T16:27:29.382574+0000","last_undegraded":"2023-10-08T16:27:29.382574+0000","last_fullsized":"2023-10-08T16:27:29.382574+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:59.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.370348+0000","last_change":"2023-10-08T16:27:28.351207+0000","last_active":"2023-10-08T16:27:29.370348+0000","last_peered":"2023-10-08T16:27:29.370348+0000","last_clean":"2023-10-08T16:27:29.370348+0000","last_became_active":"2023-10-08T16:27:28.350890+0000","last_became_peered":"2023-10-08T16:27:28.350890+0000","last_unstale":"2023-10-08T16:27:29.370348+0000","last_undegraded":"2023-10-08T16:27:29.370348+0000","last_fullsized":"2023-10-08T16:27:29.370348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:30.007307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387131+0000","last_change":"2023-10-08T16:27:29.382395+0000","last_active":"2023-10-08T16:27:29.387131+0000","last_peered":"2023-10-08T16:27:29.387131+0000","last_clean":"2023-10-08T16:27:29.387131+0000","last_became_active":"2023-10-08T16:27:29.382120+0000","last_became_peered":"2023-10-08T16:27:29.382120+0000","last_unstale":"2023-10-08T16:27:29.387131+0000","last_undegraded":"2023-10-08T16:27:29.387131+0000","last_fullsized":"2023-10-08T16:27:29.387131+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:39.772313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369436+0000","last_change":"2023-10-08T16:27:28.363508+0000","last_active":"2023-10-08T16:27:29.369436+0000","last_peered":"2023-10-08T16:27:29.369436+0000","last_clean":"2023-10-08T16:27:29.369436+0000","last_became_active":"2023-10-08T16:27:28.363140+0000","last_became_peered":"2023-10-08T16:27:28.363140+0000","last_unstale":"2023-10-08T16:27:29.369436+0000","last_undegraded":"2023-10-08T16:27:29.369436+0000","last_fullsized":"2023-10-08T16:27:29.369436+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:10:24.418321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375474+0000","last_change":"2023-10-08T16:27:29.372750+0000","last_active":"2023-10-08T16:27:29.375474+0000","last_peered":"2023-10-08T16:27:29.375474+0000","last_clean":"2023-10-08T16:27:29.375474+0000","last_became_active":"2023-10-08T16:27:29.372363+0000","last_became_peered":"2023-10-08T16:27:29.372363+0000","last_unstale":"2023-10-08T16:27:29.375474+0000","last_undegraded":"2023-10-08T16:27:29.375474+0000","last_fullsized":"2023-10-08T16:27:29.375474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:59.150062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.368138+0000","last_change":"2023-10-08T16:27:28.368017+0000","last_active":"2023-10-08T16:27:29.368138+0000","last_peered":"2023-10-08T16:27:29.368138+0000","last_clean":"2023-10-08T16:27:29.368138+0000","last_became_active":"2023-10-08T16:27:28.367708+0000","last_became_peered":"2023-10-08T16:27:28.367708+0000","last_unstale":"2023-10-08T16:27:29.368138+0000","last_undegraded":"2023-10-08T16:27:29.368138+0000","last_fullsized":"2023-10-08T16:27:29.368138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:28.024599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392081+0000","last_change":"2023-10-08T16:27:29.388574+0000","last_active":"2023-10-08T16:27:29.392081+0000","last_peered":"2023-10-08T16:27:29.392081+0000","last_clean":"2023-10-08T16:27:29.392081+0000","last_became_active":"2023-10-08T16:27:29.388326+0000","last_became_peered":"2023-10-08T16:27:29.388326+0000","last_unstale":"2023-10-08T16:27:29.392081+0000","last_undegraded":"2023-10-08T16:27:29.392081+0000","last_fullsized":"2023-10-08T16:27:29.392081+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:13.785549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390323+0000","last_change":"2023-10-08T16:27:28.354375+0000","last_active":"2023-10-08T16:27:29.390323+0000","last_peered":"2023-10-08T16:27:29.390323+0000","last_clean":"2023-10-08T16:27:29.390323+0000","last_became_active":"2023-10-08T16:27:28.354031+0000","last_became_peered":"2023-10-08T16:27:28.354031+0000","last_unstale":"2023-10-08T16:27:29.390323+0000","last_undegraded":"2023-10-08T16:27:29.390323+0000","last_fullsized":"2023-10-08T16:27:29.390323+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:23.961832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389343+0000","last_change":"2023-10-08T16:27:29.384396+0000","last_active":"2023-10-08T16:27:29.389343+0000","last_peered":"2023-10-08T16:27:29.389343+0000","last_clean":"2023-10-08T16:27:29.389343+0000","last_became_active":"2023-10-08T16:27:29.384130+0000","last_became_peered":"2023-10-08T16:27:29.384130+0000","last_unstale":"2023-10-08T16:27:29.389343+0000","last_undegraded":"2023-10-08T16:27:29.389343+0000","last_fullsized":"2023-10-08T16:27:29.389343+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:10.841744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.374113+0000","last_change":"2023-10-08T16:27:28.362100+0000","last_active":"2023-10-08T16:27:29.374113+0000","last_peered":"2023-10-08T16:27:29.374113+0000","last_clean":"2023-10-08T16:27:29.374113+0000","last_became_active":"2023-10-08T16:27:28.361834+0000","last_became_peered":"2023-10-08T16:27:28.361834+0000","last_unstale":"2023-10-08T16:27:29.374113+0000","last_undegraded":"2023-10-08T16:27:29.374113+0000","last_fullsized":"2023-10-08T16:27:29.374113+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:11.187340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379251+0000","last_change":"2023-10-08T16:27:29.374027+0000","last_active":"2023-10-08T16:27:29.379251+0000","last_peered":"2023-10-08T16:27:29.379251+0000","last_clean":"2023-10-08T16:27:29.379251+0000","last_became_active":"2023-10-08T16:27:29.373730+0000","last_became_peered":"2023-10-08T16:27:29.373730+0000","last_unstale":"2023-10-08T16:27:29.379251+0000","last_undegraded":"2023-10-08T16:27:29.379251+0000","last_fullsized":"2023-10-08T16:27:29.379251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.366507+0000","last_change":"2023-10-08T16:27:28.368903+0000","last_active":"2023-10-08T16:27:29.366507+0000","last_peered":"2023-10-08T16:27:29.366507+0000","last_clean":"2023-10-08T16:27:29.366507+0000","last_became_active":"2023-10-08T16:27:28.368628+0000","last_became_peered":"2023-10-08T16:27:28.368628+0000","last_unstale":"2023-10-08T16:27:29.366507+0000","last_undegraded":"2023-10-08T16:27:29.366507+0000","last_fullsized":"2023-10-08T16:27:29.366507+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:27.512480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385678+0000","last_change":"2023-10-08T16:27:29.381547+0000","last_active":"2023-10-08T16:27:29.385678+0000","last_peered":"2023-10-08T16:27:29.385678+0000","last_clean":"2023-10-08T16:27:29.385678+0000","last_became_active":"2023-10-08T16:27:29.381278+0000","last_became_peered":"2023-10-08T16:27:29.381278+0000","last_unstale":"2023-10-08T16:27:29.385678+0000","last_undegraded":"2023-10-08T16:27:29.385678+0000","last_fullsized":"2023-10-08T16:27:29.385678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.364400+0000","last_change":"2023-10-08T16:27:28.354870+0000","last_active":"2023-10-08T16:27:29.364400+0000","last_peered":"2023-10-08T16:27:29.364400+0000","last_clean":"2023-10-08T16:27:29.364400+0000","last_became_active":"2023-10-08T16:27:28.354573+0000","last_became_peered":"2023-10-08T16:27:28.354573+0000","last_unstale":"2023-10-08T16:27:29.364400+0000","last_undegraded":"2023-10-08T16:27:29.364400+0000","last_fullsized":"2023-10-08T16:27:29.364400+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:41:13.111913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.391014+0000","last_change":"2023-10-08T16:27:29.387121+0000","last_active":"2023-10-08T16:27:29.391014+0000","last_peered":"2023-10-08T16:27:29.391014+0000","last_clean":"2023-10-08T16:27:29.391014+0000","last_became_active":"2023-10-08T16:27:29.386826+0000","last_became_peered":"2023-10-08T16:27:29.386826+0000","last_unstale":"2023-10-08T16:27:29.391014+0000","last_undegraded":"2023-10-08T16:27:29.391014+0000","last_fullsized":"2023-10-08T16:27:29.391014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:50.977123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.370904+0000","last_change":"2023-10-08T16:27:28.363737+0000","last_active":"2023-10-08T16:27:29.370904+0000","last_peered":"2023-10-08T16:27:29.370904+0000","last_clean":"2023-10-08T16:27:29.370904+0000","last_became_active":"2023-10-08T16:27:28.363498+0000","last_became_peered":"2023-10-08T16:27:28.363498+0000","last_unstale":"2023-10-08T16:27:29.370904+0000","last_undegraded":"2023-10-08T16:27:29.370904+0000","last_fullsized":"2023-10-08T16:27:29.370904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:01.787507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386227+0000","last_change":"2023-10-08T16:27:29.381456+0000","last_active":"2023-10-08T16:27:29.386227+0000","last_peered":"2023-10-08T16:27:29.386227+0000","last_clean":"2023-10-08T16:27:29.386227+0000","last_became_active":"2023-10-08T16:27:29.381196+0000","last_became_peered":"2023-10-08T16:27:29.381196+0000","last_unstale":"2023-10-08T16:27:29.386227+0000","last_undegraded":"2023-10-08T16:27:29.386227+0000","last_fullsized":"2023-10-08T16:27:29.386227+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:06.389860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363844+0000","last_change":"2023-10-08T16:27:28.360498+0000","last_active":"2023-10-08T16:27:29.363844+0000","last_peered":"2023-10-08T16:27:29.363844+0000","last_clean":"2023-10-08T16:27:29.363844+0000","last_became_active":"2023-10-08T16:27:28.360235+0000","last_became_peered":"2023-10-08T16:27:28.360235+0000","last_unstale":"2023-10-08T16:27:29.363844+0000","last_undegraded":"2023-10-08T16:27:29.363844+0000","last_fullsized":"2023-10-08T16:27:29.363844+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:44.757436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389694+0000","last_change":"2023-10-08T16:27:29.386700+0000","last_active":"2023-10-08T16:27:29.389694+0000","last_peered":"2023-10-08T16:27:29.389694+0000","last_clean":"2023-10-08T16:27:29.389694+0000","last_became_active":"2023-10-08T16:27:29.386447+0000","last_became_peered":"2023-10-08T16:27:29.386447+0000","last_unstale":"2023-10-08T16:27:29.389694+0000","last_undegraded":"2023-10-08T16:27:29.389694+0000","last_fullsized":"2023-10-08T16:27:29.389694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:46.225182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.367077+0000","last_change":"2023-10-08T16:27:28.362520+0000","last_active":"2023-10-08T16:27:29.367077+0000","last_peered":"2023-10-08T16:27:29.367077+0000","last_clean":"2023-10-08T16:27:29.367077+0000","last_became_active":"2023-10-08T16:27:28.362191+0000","last_became_peered":"2023-10-08T16:27:28.362191+0000","last_unstale":"2023-10-08T16:27:29.367077+0000","last_undegraded":"2023-10-08T16:27:29.367077+0000","last_fullsized":"2023-10-08T16:27:29.367077+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:16.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386203+0000","last_change":"2023-10-08T16:27:29.383295+0000","last_active":"2023-10-08T16:27:29.386203+0000","last_peered":"2023-10-08T16:27:29.386203+0000","last_clean":"2023-10-08T16:27:29.386203+0000","last_became_active":"2023-10-08T16:27:29.382954+0000","last_became_peered":"2023-10-08T16:27:29.382954+0000","last_unstale":"2023-10-08T16:27:29.386203+0000","last_undegraded":"2023-10-08T16:27:29.386203+0000","last_fullsized":"2023-10-08T16:27:29.386203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:59.621061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.368069+0000","last_change":"2023-10-08T16:27:28.360770+0000","last_active":"2023-10-08T16:27:29.368069+0000","last_peered":"2023-10-08T16:27:29.368069+0000","last_clean":"2023-10-08T16:27:29.368069+0000","last_became_active":"2023-10-08T16:27:28.358744+0000","last_became_peered":"2023-10-08T16:27:28.358744+0000","last_unstale":"2023-10-08T16:27:29.368069+0000","last_undegraded":"2023-10-08T16:27:29.368069+0000","last_fullsized":"2023-10-08T16:27:29.368069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:31.252093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387298+0000","last_change":"2023-10-08T16:27:29.384627+0000","last_active":"2023-10-08T16:27:29.387298+0000","last_peered":"2023-10-08T16:27:29.387298+0000","last_clean":"2023-10-08T16:27:29.387298+0000","last_became_active":"2023-10-08T16:27:29.384375+0000","last_became_peered":"2023-10-08T16:27:29.384375+0000","last_unstale":"2023-10-08T16:27:29.387298+0000","last_undegraded":"2023-10-08T16:27:29.387298+0000","last_fullsized":"2023-10-08T16:27:29.387298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:32.145602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393801+0000","last_change":"2023-10-08T16:27:28.366050+0000","last_active":"2023-10-08T16:27:29.393801+0000","last_peered":"2023-10-08T16:27:29.393801+0000","last_clean":"2023-10-08T16:27:29.393801+0000","last_became_active":"2023-10-08T16:27:28.365733+0000","last_became_peered":"2023-10-08T16:27:28.365733+0000","last_unstale":"2023-10-08T16:27:29.393801+0000","last_undegraded":"2023-10-08T16:27:29.393801+0000","last_fullsized":"2023-10-08T16:27:29.393801+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:00.820446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"118'227","reported_seq":653,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.374167+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:27:29.374167+0000","last_peered":"2023-10-08T16:27:29.374167+0000","last_clean":"2023-10-08T16:27:29.374167+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:27:29.374167+0000","last_undegraded":"2023-10-08T16:27:29.374167+0000","last_fullsized":"2023-10-08T16:27:29.374167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307624,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064216,"statfs":{"total":96636764160,"available":96321757184,"internally_reserved":0,"allocated":2195456,"data_stored":1371890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66300000000000003,"15min":0.71599999999999997},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.70999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77500000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.42599999999999999},"max":{"1min":0.88,"5min":1.002,"15min":1.0469999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89800000000000002,"5min":1.0229999999999999,"15min":1.042},"last":0.73299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69199999999999995,"15min":0.72599999999999998},"min":{"1min":0.504,"5min":0.499,"15min":0.46800000000000003},"max":{"1min":0.89000000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.55600000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":1.0189999999999999,"15min":1.05},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.76300000000000001},"min":{"1min":0.56299999999999994,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.437},"max":{"1min":0.997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":1.351,"15min":1.351},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.71799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47099999999999997},"max":{"1min":1.016,"5min":1.173,"15min":1.173},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.748},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575063,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307044,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064796,"statfs":{"total":96636764160,"available":96322351104,"internally_reserved":0,"allocated":1601536,"data_stored":782034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.0860000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91500000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70199999999999996,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.998,"5min":1.071,"15min":1.081},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.77300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.499},"max":{"1min":0.85299999999999998,"5min":1.034,"15min":1.0800000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.60699999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95599999999999996,"5min":0.98299999999999998,"15min":1.0149999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.77000000000000002},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.125},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.65000000000000002},"min":{"1min":0.45900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83199999999999996,"5min":1.073,"15min":1.073},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.747},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.77400000000000002,"5min":1.272,"15min":1.272},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.88800000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.89400000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.86099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575062,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302940,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068900,"statfs":{"total":96636764160,"available":96326553600,"internally_reserved":0,"allocated":1593344,"data_stored":781410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.375,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.91200000000000003},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.95899999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.56599999999999995,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.95199999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.879,"15min":1.879},"last":0.749},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":1.379}]},{"osd":5,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":2.379,"15min":2.379},"last":1.4390000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.58399999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.0660000000000001,"15min":1.224},"last":1.042}]},{"osd":6,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.81100000000000005},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0780000000000001,"15min":1.206},"last":0.995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0309999999999999,"5min":1.101,"15min":1.2909999999999999},"last":1.4079999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.67500000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.1839999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2191360,"data_stored":1372332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.624,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.32700000000000001},"max":{"1min":0.54400000000000004,"5min":1.093,"15min":1.093},"last":0.37},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67800000000000005,"5min":1.022,"15min":1.022},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.878},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81699999999999995,"5min":1.21,"15min":1.21},"last":0.58499999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92600000000000005,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.0569999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.94899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":0.92500000000000004,"5min":1.083,"15min":1.1439999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.61599999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.2330000000000001},"last":0.97599999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.995,"5min":1.157,"15min":1.1950000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79300000000000004,"15min":0.81699999999999995},"min":{"1min":0.63700000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.131,"5min":1.196,"15min":1.212},"last":0.84399999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":1.1140000000000001,"15min":1.1579999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80100000000000005,"15min":0.81899999999999995},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.014,"5min":1.163,"15min":1.202},"last":0.93300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307040,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064800,"statfs":{"total":96636764160,"available":96322355200,"internally_reserved":0,"allocated":1597440,"data_stored":781444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.96599999999999997,"15min":1.046},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.01,"15min":1.01},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":1.1519999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.505,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88900000000000001,"15min":0.94399999999999995},"last":0.42099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.53000000000000003},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.879,"15min":0.99299999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":1.1160000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.4790000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.77200000000000002},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0349999999999999,"5min":1.056,"15min":1.2909999999999999},"last":0.88800000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.83699999999999997},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.53800000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.4990000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76500000000000001,"15min":0.81100000000000005},"min":{"1min":0.49299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.3},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.321},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75600000000000001,"15min":0.81399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52700000000000002,"15min":0.48099999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.5149999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79400000000000004,"15min":0.84299999999999997},"min":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.4410000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79200000000000004,"15min":0.85099999999999998},"min":{"1min":0.56599999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.286},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307052,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064788,"statfs":{"total":96636764160,"available":96322342912,"internally_reserved":0,"allocated":1609728,"data_stored":782968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66300000000000003,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51000000000000001,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46800000000000003,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.72099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.95699999999999996},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.091,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.3600000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74299999999999999,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.2110000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75600000000000001,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.3200000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.1919999999999999,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80800000000000005,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.044,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84699999999999998},"min":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.173,"5min":1.204,"15min":1.23},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0369999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298864,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072976,"statfs":{"total":96636764160,"available":96330727424,"internally_reserved":0,"allocated":1613824,"data_stored":783070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.016,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.496},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.503,"5min":0.498,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97499999999999998,"5min":1.085,"15min":1.1060000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1339999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99199999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.45700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.876,"5min":1.47,"15min":1.47},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91700000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":2.661,"15min":2.661},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.04,"5min":1.611,"15min":1.611},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80600000000000005,"15min":0.76200000000000001},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.161,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.137,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575062,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311136,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060704,"statfs":{"total":96636764160,"available":96318160896,"internally_reserved":0,"allocated":1597440,"data_stored":781480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.47999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86299999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.53800000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.95099999999999996,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.97199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70099999999999996,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.0389999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":4.931,"15min":4.931},"last":0.78700000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.77500000000000002},"min":{"1min":0.55300000000000005,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":1.96,"15min":1.96},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69999999999999996,"15min":0.63300000000000001},"min":{"1min":0.46200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":0.88200000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.46200000000000002,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0249999999999999,"5min":2.024,"15min":2.024},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76800000000000002,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.83799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1,"5min":2.157,"15min":2.157},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.046,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:27:33.744 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:27:33.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.965+0000 7f658c9ff700 1 Processor -- start 2023-10-08T16:27:33.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.965+0000 7f658c9ff700 1 -- start start 2023-10-08T16:27:33.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.966+0000 7f658c9ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 0x7f65880ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.966+0000 7f658c9ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65880b0ba0 0x7f65880c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.966+0000 7f658c9ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658815a280 con 0x7f65880cf200 2023-10-08T16:27:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.966+0000 7f658c9ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658806e180 con 0x7f65880b0ba0 2023-10-08T16:27:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.966+0000 7f658c9ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658806d850 con 0x7f65880b07d0 2023-10-08T16:27:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65880b0ba0 0x7f65880c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65880b0ba0 0x7f65880c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35492/0 (socket says 172.21.15.12:35492) 2023-10-08T16:27:33.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 -- 172.21.15.12:0/707083601 learned_addr learned my addr 172.21.15.12:0/707083601 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f658659c700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 0x7f65880ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 -- 172.21.15.12:0/707083601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 msgr2=0x7f65880ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 0x7f65880ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 -- 172.21.15.12:0/707083601 >> v1:172.21.15.29:6789/0 conn(0x7f65880cf200 legacy=0x7f658806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 -- 172.21.15.12:0/707083601 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658806db30 con 0x7f65880b0ba0 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f658659c700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 0x7f65880ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.967+0000 7f6586d9d700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b0ba0 0x7f65880c42c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6580009f20 tx=0x7f6580009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8c3118e9a6591c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658559a700 1 -- 172.21.15.12:0/707083601 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000e070 con 0x7f65880b0ba0 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658559a700 1 -- 172.21.15.12:0/707083601 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000ba40 con 0x7f65880b0ba0 2023-10-08T16:27:33.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658559a700 1 -- 172.21.15.12:0/707083601 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65800092e0 con 0x7f65880b0ba0 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 -- 172.21.15.12:0/707083601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b0ba0 msgr2=0x7f65880c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b0ba0 0x7f65880c42c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6580009f20 tx=0x7f6580009840 comp rx=0 tx=0).stop 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 -- 172.21.15.12:0/707083601 shutdown_connections 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b0ba0 0x7f65880c42c0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 --2- 172.21.15.12:0/707083601 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b07d0 0x7f65880ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 -- 172.21.15.12:0/707083601 >> 172.21.15.12:0/707083601 conn(0x7f658806ce80 msgr2=0x7f65880ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 -- 172.21.15.12:0/707083601 shutdown_connections 2023-10-08T16:27:33.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.968+0000 7f658c9ff700 1 -- 172.21.15.12:0/707083601 wait complete. 2023-10-08T16:27:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.970+0000 7f658c9ff700 1 Processor -- start 2023-10-08T16:27:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.970+0000 7f658c9ff700 1 -- start start 2023-10-08T16:27:33.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b0ba0 0x7f65880c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65880cf200 0x7f6588153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588156210 con 0x7f65880b07d0 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6588151a60 con 0x7f65880cf200 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658c9ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6588152690 con 0x7f65880b0ba0 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35504/0 (socket says 172.21.15.12:35504) 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 -- 172.21.15.12:0/3380042219 learned_addr learned my addr 172.21.15.12:0/3380042219 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f6585d9b700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b0ba0 0x7f65880c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f6586d9d700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65880cf200 0x7f6588153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 -- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b0ba0 msgr2=0x7f65880c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b0ba0 0x7f65880c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 -- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65880cf200 msgr2=0x7f6588153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.971+0000 7f658659c700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65880cf200 0x7f6588153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f658659c700 1 -- 172.21.15.12:0/3380042219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009ae0 con 0x7f65880b07d0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f658659c700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f657800c880 tx=0x7f6578008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578005a00 con 0x7f65880b07d0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578005b60 con 0x7f65880b07d0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65881534f0 con 0x7f65880b07d0 2023-10-08T16:27:33.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578011600 con 0x7f65880b07d0 2023-10-08T16:27:33.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.972+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6588152990 con 0x7f65880b07d0 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.973+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65881537d0 con 0x7f65880b07d0 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.974+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65780119f0 con 0x7f65880b07d0 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.975+0000 7f65767fc700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.975+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f65780844b0 con 0x7f65880b07d0 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.976+0000 7f6585d9b700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:33.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.976+0000 7f6585d9b700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 0x7f65680693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65880c8810 tx=0x7f657c007ea0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:33.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:33.979+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65780514f0 con 0x7f65880b07d0 2023-10-08T16:27:34.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.176+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f658804c3c0 con 0x7f6568066f30 2023-10-08T16:27:34.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.185+0000 7f65767fc700 1 -- 172.21.15.12:0/3380042219 <== mgr.7255 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289618 (secure 0 0 0) 0x7f658804c3c0 con 0x7f6568066f30 2023-10-08T16:27:34.190 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 msgr2=0x7f65680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 0x7f65680693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f65880c8810 tx=0x7f657c007ea0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 msgr2=0x7f6588155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f657800c880 tx=0x7f6578008040 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 shutdown_connections 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6568066f30 0x7f65680693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65880b07d0 0x7f6588155cd0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65880cf200 0x7f6588153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 --2- 172.21.15.12:0/3380042219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65880b0ba0 0x7f65880c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 >> 172.21.15.12:0/3380042219 conn(0x7f658806ce80 msgr2=0x7f6588151bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:34.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 shutdown_connections 2023-10-08T16:27:34.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.189+0000 7f658c9ff700 1 -- 172.21.15.12:0/3380042219 wait complete. 2023-10-08T16:27:34.194 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:27:34.208 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:27:32.800110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":403,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2445224,"kb_used_data":13672,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752529496,"statfs":{"total":773094113280,"available":770590203904,"internally_reserved":0,"allocated":14000128,"data_stored":7436628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.461755"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379278+0000","last_change":"2023-10-08T16:27:29.373858+0000","last_active":"2023-10-08T16:27:29.379278+0000","last_peered":"2023-10-08T16:27:29.379278+0000","last_clean":"2023-10-08T16:27:29.379278+0000","last_became_active":"2023-10-08T16:27:29.373565+0000","last_became_peered":"2023-10-08T16:27:29.373565+0000","last_unstale":"2023-10-08T16:27:29.379278+0000","last_undegraded":"2023-10-08T16:27:29.379278+0000","last_fullsized":"2023-10-08T16:27:29.379278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:14.191715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392102+0000","last_change":"2023-10-08T16:27:29.389184+0000","last_active":"2023-10-08T16:27:29.392102+0000","last_peered":"2023-10-08T16:27:29.392102+0000","last_clean":"2023-10-08T16:27:29.392102+0000","last_became_active":"2023-10-08T16:27:29.388922+0000","last_became_peered":"2023-10-08T16:27:29.388922+0000","last_unstale":"2023-10-08T16:27:29.392102+0000","last_undegraded":"2023-10-08T16:27:29.392102+0000","last_fullsized":"2023-10-08T16:27:29.392102+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:57:03.032285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379557+0000","last_change":"2023-10-08T16:27:29.374553+0000","last_active":"2023-10-08T16:27:29.379557+0000","last_peered":"2023-10-08T16:27:29.379557+0000","last_clean":"2023-10-08T16:27:29.379557+0000","last_became_active":"2023-10-08T16:27:29.374272+0000","last_became_peered":"2023-10-08T16:27:29.374272+0000","last_unstale":"2023-10-08T16:27:29.379557+0000","last_undegraded":"2023-10-08T16:27:29.379557+0000","last_fullsized":"2023-10-08T16:27:29.379557+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:59.982427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387685+0000","last_change":"2023-10-08T16:27:29.381088+0000","last_active":"2023-10-08T16:27:29.387685+0000","last_peered":"2023-10-08T16:27:29.387685+0000","last_clean":"2023-10-08T16:27:29.387685+0000","last_became_active":"2023-10-08T16:27:29.380708+0000","last_became_peered":"2023-10-08T16:27:29.380708+0000","last_unstale":"2023-10-08T16:27:29.387685+0000","last_undegraded":"2023-10-08T16:27:29.387685+0000","last_fullsized":"2023-10-08T16:27:29.387685+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:11.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387043+0000","last_change":"2023-10-08T16:27:29.384186+0000","last_active":"2023-10-08T16:27:29.387043+0000","last_peered":"2023-10-08T16:27:29.387043+0000","last_clean":"2023-10-08T16:27:29.387043+0000","last_became_active":"2023-10-08T16:27:29.383892+0000","last_became_peered":"2023-10-08T16:27:29.383892+0000","last_unstale":"2023-10-08T16:27:29.387043+0000","last_undegraded":"2023-10-08T16:27:29.387043+0000","last_fullsized":"2023-10-08T16:27:29.387043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:25:33.630944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389426+0000","last_change":"2023-10-08T16:27:29.379416+0000","last_active":"2023-10-08T16:27:29.389426+0000","last_peered":"2023-10-08T16:27:29.389426+0000","last_clean":"2023-10-08T16:27:29.389426+0000","last_became_active":"2023-10-08T16:27:29.379148+0000","last_became_peered":"2023-10-08T16:27:29.379148+0000","last_unstale":"2023-10-08T16:27:29.389426+0000","last_undegraded":"2023-10-08T16:27:29.389426+0000","last_fullsized":"2023-10-08T16:27:29.389426+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:42.424082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389461+0000","last_change":"2023-10-08T16:27:29.378709+0000","last_active":"2023-10-08T16:27:29.389461+0000","last_peered":"2023-10-08T16:27:29.389461+0000","last_clean":"2023-10-08T16:27:29.389461+0000","last_became_active":"2023-10-08T16:27:29.378391+0000","last_became_peered":"2023-10-08T16:27:29.378391+0000","last_unstale":"2023-10-08T16:27:29.389461+0000","last_undegraded":"2023-10-08T16:27:29.389461+0000","last_fullsized":"2023-10-08T16:27:29.389461+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.957655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390908+0000","last_change":"2023-10-08T16:27:29.383757+0000","last_active":"2023-10-08T16:27:29.390908+0000","last_peered":"2023-10-08T16:27:29.390908+0000","last_clean":"2023-10-08T16:27:29.390908+0000","last_became_active":"2023-10-08T16:27:29.383460+0000","last_became_peered":"2023-10-08T16:27:29.383460+0000","last_unstale":"2023-10-08T16:27:29.390908+0000","last_undegraded":"2023-10-08T16:27:29.390908+0000","last_fullsized":"2023-10-08T16:27:29.390908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:46.631031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386732+0000","last_change":"2023-10-08T16:27:29.382427+0000","last_active":"2023-10-08T16:27:29.386732+0000","last_peered":"2023-10-08T16:27:29.386732+0000","last_clean":"2023-10-08T16:27:29.386732+0000","last_became_active":"2023-10-08T16:27:29.382050+0000","last_became_peered":"2023-10-08T16:27:29.382050+0000","last_unstale":"2023-10-08T16:27:29.386732+0000","last_undegraded":"2023-10-08T16:27:29.386732+0000","last_fullsized":"2023-10-08T16:27:29.386732+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:48.123995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375739+0000","last_change":"2023-10-08T16:27:29.373150+0000","last_active":"2023-10-08T16:27:29.375739+0000","last_peered":"2023-10-08T16:27:29.375739+0000","last_clean":"2023-10-08T16:27:29.375739+0000","last_became_active":"2023-10-08T16:27:29.372856+0000","last_became_peered":"2023-10-08T16:27:29.372856+0000","last_unstale":"2023-10-08T16:27:29.375739+0000","last_undegraded":"2023-10-08T16:27:29.375739+0000","last_fullsized":"2023-10-08T16:27:29.375739+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:32:44.005158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393114+0000","last_change":"2023-10-08T16:27:29.391427+0000","last_active":"2023-10-08T16:27:29.393114+0000","last_peered":"2023-10-08T16:27:29.393114+0000","last_clean":"2023-10-08T16:27:29.393114+0000","last_became_active":"2023-10-08T16:27:29.391137+0000","last_became_peered":"2023-10-08T16:27:29.391137+0000","last_unstale":"2023-10-08T16:27:29.393114+0000","last_undegraded":"2023-10-08T16:27:29.393114+0000","last_fullsized":"2023-10-08T16:27:29.393114+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:47.843659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385138+0000","last_change":"2023-10-08T16:27:29.379483+0000","last_active":"2023-10-08T16:27:29.385138+0000","last_peered":"2023-10-08T16:27:29.385138+0000","last_clean":"2023-10-08T16:27:29.385138+0000","last_became_active":"2023-10-08T16:27:29.379212+0000","last_became_peered":"2023-10-08T16:27:29.379212+0000","last_unstale":"2023-10-08T16:27:29.385138+0000","last_undegraded":"2023-10-08T16:27:29.385138+0000","last_fullsized":"2023-10-08T16:27:29.385138+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:29.030060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392728+0000","last_change":"2023-10-08T16:27:29.390119+0000","last_active":"2023-10-08T16:27:29.392728+0000","last_peered":"2023-10-08T16:27:29.392728+0000","last_clean":"2023-10-08T16:27:29.392728+0000","last_became_active":"2023-10-08T16:27:29.389829+0000","last_became_peered":"2023-10-08T16:27:29.389829+0000","last_unstale":"2023-10-08T16:27:29.392728+0000","last_undegraded":"2023-10-08T16:27:29.392728+0000","last_fullsized":"2023-10-08T16:27:29.392728+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.957655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387204+0000","last_change":"2023-10-08T16:27:29.381607+0000","last_active":"2023-10-08T16:27:29.387204+0000","last_peered":"2023-10-08T16:27:29.387204+0000","last_clean":"2023-10-08T16:27:29.387204+0000","last_became_active":"2023-10-08T16:27:29.381346+0000","last_became_peered":"2023-10-08T16:27:29.381346+0000","last_unstale":"2023-10-08T16:27:29.387204+0000","last_undegraded":"2023-10-08T16:27:29.387204+0000","last_fullsized":"2023-10-08T16:27:29.387204+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:44.662043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381640+0000","last_change":"2023-10-08T16:27:29.379465+0000","last_active":"2023-10-08T16:27:29.381640+0000","last_peered":"2023-10-08T16:27:29.381640+0000","last_clean":"2023-10-08T16:27:29.381640+0000","last_became_active":"2023-10-08T16:27:29.379165+0000","last_became_peered":"2023-10-08T16:27:29.379165+0000","last_unstale":"2023-10-08T16:27:29.381640+0000","last_undegraded":"2023-10-08T16:27:29.381640+0000","last_fullsized":"2023-10-08T16:27:29.381640+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:07.811729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392326+0000","last_change":"2023-10-08T16:27:29.383826+0000","last_active":"2023-10-08T16:27:29.392326+0000","last_peered":"2023-10-08T16:27:29.392326+0000","last_clean":"2023-10-08T16:27:29.392326+0000","last_became_active":"2023-10-08T16:27:29.383572+0000","last_became_peered":"2023-10-08T16:27:29.383572+0000","last_unstale":"2023-10-08T16:27:29.392326+0000","last_undegraded":"2023-10-08T16:27:29.392326+0000","last_fullsized":"2023-10-08T16:27:29.392326+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:41:11.523119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394932+0000","last_change":"2023-10-08T16:27:29.390612+0000","last_active":"2023-10-08T16:27:29.394932+0000","last_peered":"2023-10-08T16:27:29.394932+0000","last_clean":"2023-10-08T16:27:29.394932+0000","last_became_active":"2023-10-08T16:27:29.388094+0000","last_became_peered":"2023-10-08T16:27:29.388094+0000","last_unstale":"2023-10-08T16:27:29.394932+0000","last_undegraded":"2023-10-08T16:27:29.394932+0000","last_fullsized":"2023-10-08T16:27:29.394932+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:17.963950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392881+0000","last_change":"2023-10-08T16:27:29.390965+0000","last_active":"2023-10-08T16:27:29.392881+0000","last_peered":"2023-10-08T16:27:29.392881+0000","last_clean":"2023-10-08T16:27:29.392881+0000","last_became_active":"2023-10-08T16:27:29.389412+0000","last_became_peered":"2023-10-08T16:27:29.389412+0000","last_unstale":"2023-10-08T16:27:29.392881+0000","last_undegraded":"2023-10-08T16:27:29.392881+0000","last_fullsized":"2023-10-08T16:27:29.392881+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:24:47.843659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381026+0000","last_change":"2023-10-08T16:27:29.377250+0000","last_active":"2023-10-08T16:27:29.381026+0000","last_peered":"2023-10-08T16:27:29.381026+0000","last_clean":"2023-10-08T16:27:29.381026+0000","last_became_active":"2023-10-08T16:27:29.376977+0000","last_became_peered":"2023-10-08T16:27:29.376977+0000","last_unstale":"2023-10-08T16:27:29.381026+0000","last_undegraded":"2023-10-08T16:27:29.381026+0000","last_fullsized":"2023-10-08T16:27:29.381026+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:27.927620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386762+0000","last_change":"2023-10-08T16:27:29.382224+0000","last_active":"2023-10-08T16:27:29.386762+0000","last_peered":"2023-10-08T16:27:29.386762+0000","last_clean":"2023-10-08T16:27:29.386762+0000","last_became_active":"2023-10-08T16:27:29.381947+0000","last_became_peered":"2023-10-08T16:27:29.381947+0000","last_unstale":"2023-10-08T16:27:29.386762+0000","last_undegraded":"2023-10-08T16:27:29.386762+0000","last_fullsized":"2023-10-08T16:27:29.386762+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:02.792968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.384912+0000","last_change":"2023-10-08T16:27:29.379754+0000","last_active":"2023-10-08T16:27:29.384912+0000","last_peered":"2023-10-08T16:27:29.384912+0000","last_clean":"2023-10-08T16:27:29.384912+0000","last_became_active":"2023-10-08T16:27:29.379472+0000","last_became_peered":"2023-10-08T16:27:29.379472+0000","last_unstale":"2023-10-08T16:27:29.384912+0000","last_undegraded":"2023-10-08T16:27:29.384912+0000","last_fullsized":"2023-10-08T16:27:29.384912+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:47.942997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390195+0000","last_change":"2023-10-08T16:27:29.383617+0000","last_active":"2023-10-08T16:27:29.390195+0000","last_peered":"2023-10-08T16:27:29.390195+0000","last_clean":"2023-10-08T16:27:29.390195+0000","last_became_active":"2023-10-08T16:27:29.383352+0000","last_became_peered":"2023-10-08T16:27:29.383352+0000","last_unstale":"2023-10-08T16:27:29.390195+0000","last_undegraded":"2023-10-08T16:27:29.390195+0000","last_fullsized":"2023-10-08T16:27:29.390195+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:18:00.850581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390251+0000","last_change":"2023-10-08T16:27:29.382866+0000","last_active":"2023-10-08T16:27:29.390251+0000","last_peered":"2023-10-08T16:27:29.390251+0000","last_clean":"2023-10-08T16:27:29.390251+0000","last_became_active":"2023-10-08T16:27:29.382433+0000","last_became_peered":"2023-10-08T16:27:29.382433+0000","last_unstale":"2023-10-08T16:27:29.390251+0000","last_undegraded":"2023-10-08T16:27:29.390251+0000","last_fullsized":"2023-10-08T16:27:29.390251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:56.251411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392303+0000","last_change":"2023-10-08T16:27:29.383277+0000","last_active":"2023-10-08T16:27:29.392303+0000","last_peered":"2023-10-08T16:27:29.392303+0000","last_clean":"2023-10-08T16:27:29.392303+0000","last_became_active":"2023-10-08T16:27:29.383021+0000","last_became_peered":"2023-10-08T16:27:29.383021+0000","last_unstale":"2023-10-08T16:27:29.392303+0000","last_undegraded":"2023-10-08T16:27:29.392303+0000","last_fullsized":"2023-10-08T16:27:29.392303+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:49.576056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386241+0000","last_change":"2023-10-08T16:27:29.382396+0000","last_active":"2023-10-08T16:27:29.386241+0000","last_peered":"2023-10-08T16:27:29.386241+0000","last_clean":"2023-10-08T16:27:29.386241+0000","last_became_active":"2023-10-08T16:27:29.382049+0000","last_became_peered":"2023-10-08T16:27:29.382049+0000","last_unstale":"2023-10-08T16:27:29.386241+0000","last_undegraded":"2023-10-08T16:27:29.386241+0000","last_fullsized":"2023-10-08T16:27:29.386241+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:02.792968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390244+0000","last_change":"2023-10-08T16:27:29.382448+0000","last_active":"2023-10-08T16:27:29.390244+0000","last_peered":"2023-10-08T16:27:29.390244+0000","last_clean":"2023-10-08T16:27:29.390244+0000","last_became_active":"2023-10-08T16:27:29.382177+0000","last_became_peered":"2023-10-08T16:27:29.382177+0000","last_unstale":"2023-10-08T16:27:29.390244+0000","last_undegraded":"2023-10-08T16:27:29.390244+0000","last_fullsized":"2023-10-08T16:27:29.390244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:53:55.461918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392304+0000","last_change":"2023-10-08T16:27:29.385536+0000","last_active":"2023-10-08T16:27:29.392304+0000","last_peered":"2023-10-08T16:27:29.392304+0000","last_clean":"2023-10-08T16:27:29.392304+0000","last_became_active":"2023-10-08T16:27:29.384915+0000","last_became_peered":"2023-10-08T16:27:29.384915+0000","last_unstale":"2023-10-08T16:27:29.392304+0000","last_undegraded":"2023-10-08T16:27:29.392304+0000","last_fullsized":"2023-10-08T16:27:29.392304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:48.024657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387203+0000","last_change":"2023-10-08T16:27:29.384226+0000","last_active":"2023-10-08T16:27:29.387203+0000","last_peered":"2023-10-08T16:27:29.387203+0000","last_clean":"2023-10-08T16:27:29.387203+0000","last_became_active":"2023-10-08T16:27:29.383948+0000","last_became_peered":"2023-10-08T16:27:29.383948+0000","last_unstale":"2023-10-08T16:27:29.387203+0000","last_undegraded":"2023-10-08T16:27:29.387203+0000","last_fullsized":"2023-10-08T16:27:29.387203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:36:59.559385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390873+0000","last_change":"2023-10-08T16:27:29.382317+0000","last_active":"2023-10-08T16:27:29.390873+0000","last_peered":"2023-10-08T16:27:29.390873+0000","last_clean":"2023-10-08T16:27:29.390873+0000","last_became_active":"2023-10-08T16:27:29.382017+0000","last_became_peered":"2023-10-08T16:27:29.382017+0000","last_unstale":"2023-10-08T16:27:29.390873+0000","last_undegraded":"2023-10-08T16:27:29.390873+0000","last_fullsized":"2023-10-08T16:27:29.390873+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:04.056985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387234+0000","last_change":"2023-10-08T16:27:29.382685+0000","last_active":"2023-10-08T16:27:29.387234+0000","last_peered":"2023-10-08T16:27:29.387234+0000","last_clean":"2023-10-08T16:27:29.387234+0000","last_became_active":"2023-10-08T16:27:29.377687+0000","last_became_peered":"2023-10-08T16:27:29.377687+0000","last_unstale":"2023-10-08T16:27:29.387234+0000","last_undegraded":"2023-10-08T16:27:29.387234+0000","last_fullsized":"2023-10-08T16:27:29.387234+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:24.967293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381623+0000","last_change":"2023-10-08T16:27:29.378920+0000","last_active":"2023-10-08T16:27:29.381623+0000","last_peered":"2023-10-08T16:27:29.381623+0000","last_clean":"2023-10-08T16:27:29.381623+0000","last_became_active":"2023-10-08T16:27:29.378630+0000","last_became_peered":"2023-10-08T16:27:29.378630+0000","last_unstale":"2023-10-08T16:27:29.381623+0000","last_undegraded":"2023-10-08T16:27:29.381623+0000","last_fullsized":"2023-10-08T16:27:29.381623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:53.605021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393771+0000","last_change":"2023-10-08T16:27:29.390691+0000","last_active":"2023-10-08T16:27:29.393771+0000","last_peered":"2023-10-08T16:27:29.393771+0000","last_clean":"2023-10-08T16:27:29.393771+0000","last_became_active":"2023-10-08T16:27:29.390385+0000","last_became_peered":"2023-10-08T16:27:29.390385+0000","last_unstale":"2023-10-08T16:27:29.393771+0000","last_undegraded":"2023-10-08T16:27:29.393771+0000","last_fullsized":"2023-10-08T16:27:29.393771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:12.262026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387281+0000","last_change":"2023-10-08T16:27:29.383267+0000","last_active":"2023-10-08T16:27:29.387281+0000","last_peered":"2023-10-08T16:27:29.387281+0000","last_clean":"2023-10-08T16:27:29.387281+0000","last_became_active":"2023-10-08T16:27:29.383005+0000","last_became_peered":"2023-10-08T16:27:29.383005+0000","last_unstale":"2023-10-08T16:27:29.387281+0000","last_undegraded":"2023-10-08T16:27:29.387281+0000","last_fullsized":"2023-10-08T16:27:29.387281+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:10:25.423783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"128'4","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395572+0000","last_change":"2023-10-08T16:27:28.363387+0000","last_active":"2023-10-08T16:27:29.395572+0000","last_peered":"2023-10-08T16:27:29.395572+0000","last_clean":"2023-10-08T16:27:29.395572+0000","last_became_active":"2023-10-08T16:27:28.363091+0000","last_became_peered":"2023-10-08T16:27:28.363091+0000","last_unstale":"2023-10-08T16:27:29.395572+0000","last_undegraded":"2023-10-08T16:27:29.395572+0000","last_fullsized":"2023-10-08T16:27:29.395572+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:44.757436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387657+0000","last_change":"2023-10-08T16:27:29.380122+0000","last_active":"2023-10-08T16:27:29.387657+0000","last_peered":"2023-10-08T16:27:29.387657+0000","last_clean":"2023-10-08T16:27:29.387657+0000","last_became_active":"2023-10-08T16:27:29.379756+0000","last_became_peered":"2023-10-08T16:27:29.379756+0000","last_unstale":"2023-10-08T16:27:29.387657+0000","last_undegraded":"2023-10-08T16:27:29.387657+0000","last_fullsized":"2023-10-08T16:27:29.387657+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:13:28.061066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394474+0000","last_change":"2023-10-08T16:27:28.365010+0000","last_active":"2023-10-08T16:27:29.394474+0000","last_peered":"2023-10-08T16:27:29.394474+0000","last_clean":"2023-10-08T16:27:29.394474+0000","last_became_active":"2023-10-08T16:27:28.364683+0000","last_became_peered":"2023-10-08T16:27:28.364683+0000","last_unstale":"2023-10-08T16:27:29.394474+0000","last_undegraded":"2023-10-08T16:27:29.394474+0000","last_fullsized":"2023-10-08T16:27:29.394474+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:44.235757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379067+0000","last_change":"2023-10-08T16:27:29.372939+0000","last_active":"2023-10-08T16:27:29.379067+0000","last_peered":"2023-10-08T16:27:29.379067+0000","last_clean":"2023-10-08T16:27:29.379067+0000","last_became_active":"2023-10-08T16:27:29.372650+0000","last_became_peered":"2023-10-08T16:27:29.372650+0000","last_unstale":"2023-10-08T16:27:29.379067+0000","last_undegraded":"2023-10-08T16:27:29.379067+0000","last_fullsized":"2023-10-08T16:27:29.379067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:29.478719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394642+0000","last_change":"2023-10-08T16:27:28.358992+0000","last_active":"2023-10-08T16:27:29.394642+0000","last_peered":"2023-10-08T16:27:29.394642+0000","last_clean":"2023-10-08T16:27:29.394642+0000","last_became_active":"2023-10-08T16:27:28.358680+0000","last_became_peered":"2023-10-08T16:27:28.358680+0000","last_unstale":"2023-10-08T16:27:29.394642+0000","last_undegraded":"2023-10-08T16:27:29.394642+0000","last_fullsized":"2023-10-08T16:27:29.394642+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:34.612493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385014+0000","last_change":"2023-10-08T16:27:29.377113+0000","last_active":"2023-10-08T16:27:29.385014+0000","last_peered":"2023-10-08T16:27:29.385014+0000","last_clean":"2023-10-08T16:27:29.385014+0000","last_became_active":"2023-10-08T16:27:29.375055+0000","last_became_peered":"2023-10-08T16:27:29.375055+0000","last_unstale":"2023-10-08T16:27:29.385014+0000","last_undegraded":"2023-10-08T16:27:29.385014+0000","last_fullsized":"2023-10-08T16:27:29.385014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:28.517941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395387+0000","last_change":"2023-10-08T16:27:28.369648+0000","last_active":"2023-10-08T16:27:29.395387+0000","last_peered":"2023-10-08T16:27:29.395387+0000","last_clean":"2023-10-08T16:27:29.395387+0000","last_became_active":"2023-10-08T16:27:28.369374+0000","last_became_peered":"2023-10-08T16:27:28.369374+0000","last_unstale":"2023-10-08T16:27:29.395387+0000","last_undegraded":"2023-10-08T16:27:29.395387+0000","last_fullsized":"2023-10-08T16:27:29.395387+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:05.384399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390734+0000","last_change":"2023-10-08T16:27:29.387753+0000","last_active":"2023-10-08T16:27:29.390734+0000","last_peered":"2023-10-08T16:27:29.390734+0000","last_clean":"2023-10-08T16:27:29.390734+0000","last_became_active":"2023-10-08T16:27:29.387480+0000","last_became_peered":"2023-10-08T16:27:29.387480+0000","last_unstale":"2023-10-08T16:27:29.390734+0000","last_undegraded":"2023-10-08T16:27:29.390734+0000","last_fullsized":"2023-10-08T16:27:29.390734+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:43.946265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392503+0000","last_change":"2023-10-08T16:27:28.360760+0000","last_active":"2023-10-08T16:27:29.392503+0000","last_peered":"2023-10-08T16:27:29.392503+0000","last_clean":"2023-10-08T16:27:29.392503+0000","last_became_active":"2023-10-08T16:27:28.360279+0000","last_became_peered":"2023-10-08T16:27:28.360279+0000","last_unstale":"2023-10-08T16:27:29.392503+0000","last_undegraded":"2023-10-08T16:27:29.392503+0000","last_fullsized":"2023-10-08T16:27:29.392503+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:29:06.530062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381964+0000","last_change":"2023-10-08T16:27:29.377374+0000","last_active":"2023-10-08T16:27:29.381964+0000","last_peered":"2023-10-08T16:27:29.381964+0000","last_clean":"2023-10-08T16:27:29.381964+0000","last_became_active":"2023-10-08T16:27:29.377106+0000","last_became_peered":"2023-10-08T16:27:29.377106+0000","last_unstale":"2023-10-08T16:27:29.381964+0000","last_undegraded":"2023-10-08T16:27:29.381964+0000","last_fullsized":"2023-10-08T16:27:29.381964+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:20:03.987781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394924+0000","last_change":"2023-10-08T16:27:28.368034+0000","last_active":"2023-10-08T16:27:29.394924+0000","last_peered":"2023-10-08T16:27:29.394924+0000","last_clean":"2023-10-08T16:27:29.394924+0000","last_became_active":"2023-10-08T16:27:28.367754+0000","last_became_peered":"2023-10-08T16:27:28.367754+0000","last_unstale":"2023-10-08T16:27:29.394924+0000","last_undegraded":"2023-10-08T16:27:29.394924+0000","last_fullsized":"2023-10-08T16:27:29.394924+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:07.865035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387619+0000","last_change":"2023-10-08T16:27:29.380132+0000","last_active":"2023-10-08T16:27:29.387619+0000","last_peered":"2023-10-08T16:27:29.387619+0000","last_clean":"2023-10-08T16:27:29.387619+0000","last_became_active":"2023-10-08T16:27:29.379712+0000","last_became_peered":"2023-10-08T16:27:29.379712+0000","last_unstale":"2023-10-08T16:27:29.387619+0000","last_undegraded":"2023-10-08T16:27:29.387619+0000","last_fullsized":"2023-10-08T16:27:29.387619+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:49.576056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.365818+0000","last_change":"2023-10-08T16:27:28.364305+0000","last_active":"2023-10-08T16:27:29.365818+0000","last_peered":"2023-10-08T16:27:29.365818+0000","last_clean":"2023-10-08T16:27:29.365818+0000","last_became_active":"2023-10-08T16:27:28.364027+0000","last_became_peered":"2023-10-08T16:27:28.364027+0000","last_unstale":"2023-10-08T16:27:29.365818+0000","last_undegraded":"2023-10-08T16:27:29.365818+0000","last_fullsized":"2023-10-08T16:27:29.365818+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:23:12.791712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385206+0000","last_change":"2023-10-08T16:27:29.378769+0000","last_active":"2023-10-08T16:27:29.385206+0000","last_peered":"2023-10-08T16:27:29.385206+0000","last_clean":"2023-10-08T16:27:29.385206+0000","last_became_active":"2023-10-08T16:27:29.378512+0000","last_became_peered":"2023-10-08T16:27:29.378512+0000","last_unstale":"2023-10-08T16:27:29.385206+0000","last_undegraded":"2023-10-08T16:27:29.385206+0000","last_fullsized":"2023-10-08T16:27:29.385206+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:17:37.117093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.362532+0000","last_change":"2023-10-08T16:27:28.362914+0000","last_active":"2023-10-08T16:27:29.362532+0000","last_peered":"2023-10-08T16:27:29.362532+0000","last_clean":"2023-10-08T16:27:29.362532+0000","last_became_active":"2023-10-08T16:27:28.362643+0000","last_became_peered":"2023-10-08T16:27:28.362643+0000","last_unstale":"2023-10-08T16:27:29.362532+0000","last_undegraded":"2023-10-08T16:27:29.362532+0000","last_fullsized":"2023-10-08T16:27:29.362532+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:31.480683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394894+0000","last_change":"2023-10-08T16:27:29.391268+0000","last_active":"2023-10-08T16:27:29.394894+0000","last_peered":"2023-10-08T16:27:29.394894+0000","last_clean":"2023-10-08T16:27:29.394894+0000","last_became_active":"2023-10-08T16:27:29.390978+0000","last_became_peered":"2023-10-08T16:27:29.390978+0000","last_unstale":"2023-10-08T16:27:29.394894+0000","last_undegraded":"2023-10-08T16:27:29.394894+0000","last_fullsized":"2023-10-08T16:27:29.394894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:01:17.572035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363480+0000","last_change":"2023-10-08T16:27:28.349341+0000","last_active":"2023-10-08T16:27:29.363480+0000","last_peered":"2023-10-08T16:27:29.363480+0000","last_clean":"2023-10-08T16:27:29.363480+0000","last_became_active":"2023-10-08T16:27:28.349059+0000","last_became_peered":"2023-10-08T16:27:28.349059+0000","last_unstale":"2023-10-08T16:27:29.363480+0000","last_undegraded":"2023-10-08T16:27:29.363480+0000","last_fullsized":"2023-10-08T16:27:29.363480+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:26:57.971734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385179+0000","last_change":"2023-10-08T16:27:29.379595+0000","last_active":"2023-10-08T16:27:29.385179+0000","last_peered":"2023-10-08T16:27:29.385179+0000","last_clean":"2023-10-08T16:27:29.385179+0000","last_became_active":"2023-10-08T16:27:29.379306+0000","last_became_peered":"2023-10-08T16:27:29.379306+0000","last_unstale":"2023-10-08T16:27:29.385179+0000","last_undegraded":"2023-10-08T16:27:29.385179+0000","last_fullsized":"2023-10-08T16:27:29.385179+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:58.984309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369963+0000","last_change":"2023-10-08T16:27:28.365568+0000","last_active":"2023-10-08T16:27:29.369963+0000","last_peered":"2023-10-08T16:27:29.369963+0000","last_clean":"2023-10-08T16:27:29.369963+0000","last_became_active":"2023-10-08T16:27:28.365300+0000","last_became_peered":"2023-10-08T16:27:28.365300+0000","last_unstale":"2023-10-08T16:27:29.369963+0000","last_undegraded":"2023-10-08T16:27:29.369963+0000","last_fullsized":"2023-10-08T16:27:29.369963+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:59.845119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.383375+0000","last_change":"2023-10-08T16:27:29.379430+0000","last_active":"2023-10-08T16:27:29.383375+0000","last_peered":"2023-10-08T16:27:29.383375+0000","last_clean":"2023-10-08T16:27:29.383375+0000","last_became_active":"2023-10-08T16:27:29.379156+0000","last_became_peered":"2023-10-08T16:27:29.379156+0000","last_unstale":"2023-10-08T16:27:29.383375+0000","last_undegraded":"2023-10-08T16:27:29.383375+0000","last_fullsized":"2023-10-08T16:27:29.383375+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:48.123995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"128'3","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.396018+0000","last_change":"2023-10-08T16:27:28.362761+0000","last_active":"2023-10-08T16:27:29.396018+0000","last_peered":"2023-10-08T16:27:29.396018+0000","last_clean":"2023-10-08T16:27:29.396018+0000","last_became_active":"2023-10-08T16:27:28.362357+0000","last_became_peered":"2023-10-08T16:27:28.362357+0000","last_unstale":"2023-10-08T16:27:29.396018+0000","last_undegraded":"2023-10-08T16:27:29.396018+0000","last_fullsized":"2023-10-08T16:27:29.396018+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:57:55.245950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392325+0000","last_change":"2023-10-08T16:27:29.385709+0000","last_active":"2023-10-08T16:27:29.392325+0000","last_peered":"2023-10-08T16:27:29.392325+0000","last_clean":"2023-10-08T16:27:29.392325+0000","last_became_active":"2023-10-08T16:27:29.385275+0000","last_became_peered":"2023-10-08T16:27:29.385275+0000","last_unstale":"2023-10-08T16:27:29.392325+0000","last_undegraded":"2023-10-08T16:27:29.392325+0000","last_fullsized":"2023-10-08T16:27:29.392325+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:53.605021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"128'6","reported_seq":16,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.397316+0000","last_change":"2023-10-08T16:27:28.363300+0000","last_active":"2023-10-08T16:27:29.397316+0000","last_peered":"2023-10-08T16:27:29.397316+0000","last_clean":"2023-10-08T16:27:29.397316+0000","last_became_active":"2023-10-08T16:27:28.363011+0000","last_became_peered":"2023-10-08T16:27:28.363011+0000","last_unstale":"2023-10-08T16:27:29.397316+0000","last_undegraded":"2023-10-08T16:27:29.397316+0000","last_fullsized":"2023-10-08T16:27:29.397316+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:10.148037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.381466+0000","last_change":"2023-10-08T16:27:29.379392+0000","last_active":"2023-10-08T16:27:29.381466+0000","last_peered":"2023-10-08T16:27:29.381466+0000","last_clean":"2023-10-08T16:27:29.381466+0000","last_became_active":"2023-10-08T16:27:29.379130+0000","last_became_peered":"2023-10-08T16:27:29.379130+0000","last_unstale":"2023-10-08T16:27:29.381466+0000","last_undegraded":"2023-10-08T16:27:29.381466+0000","last_fullsized":"2023-10-08T16:27:29.381466+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:48.024657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394413+0000","last_change":"2023-10-08T16:27:28.359280+0000","last_active":"2023-10-08T16:27:29.394413+0000","last_peered":"2023-10-08T16:27:29.394413+0000","last_clean":"2023-10-08T16:27:29.394413+0000","last_became_active":"2023-10-08T16:27:28.358916+0000","last_became_peered":"2023-10-08T16:27:28.358916+0000","last_unstale":"2023-10-08T16:27:29.394413+0000","last_undegraded":"2023-10-08T16:27:29.394413+0000","last_fullsized":"2023-10-08T16:27:29.394413+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:44:17.230109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379137+0000","last_change":"2023-10-08T16:27:29.373144+0000","last_active":"2023-10-08T16:27:29.379137+0000","last_peered":"2023-10-08T16:27:29.379137+0000","last_clean":"2023-10-08T16:27:29.379137+0000","last_became_active":"2023-10-08T16:27:29.372894+0000","last_became_peered":"2023-10-08T16:27:29.372894+0000","last_unstale":"2023-10-08T16:27:29.379137+0000","last_undegraded":"2023-10-08T16:27:29.379137+0000","last_fullsized":"2023-10-08T16:27:29.379137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:07:55.440723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369476+0000","last_change":"2023-10-08T16:27:28.365643+0000","last_active":"2023-10-08T16:27:29.369476+0000","last_peered":"2023-10-08T16:27:29.369476+0000","last_clean":"2023-10-08T16:27:29.369476+0000","last_became_active":"2023-10-08T16:27:28.365383+0000","last_became_peered":"2023-10-08T16:27:28.365383+0000","last_unstale":"2023-10-08T16:27:29.369476+0000","last_undegraded":"2023-10-08T16:27:29.369476+0000","last_fullsized":"2023-10-08T16:27:29.369476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:40:41.704744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385355+0000","last_change":"2023-10-08T16:27:29.376814+0000","last_active":"2023-10-08T16:27:29.385355+0000","last_peered":"2023-10-08T16:27:29.385355+0000","last_clean":"2023-10-08T16:27:29.385355+0000","last_became_active":"2023-10-08T16:27:29.376443+0000","last_became_peered":"2023-10-08T16:27:29.376443+0000","last_unstale":"2023-10-08T16:27:29.385355+0000","last_undegraded":"2023-10-08T16:27:29.385355+0000","last_fullsized":"2023-10-08T16:27:29.385355+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:29:08.870496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363845+0000","last_change":"2023-10-08T16:27:28.358696+0000","last_active":"2023-10-08T16:27:29.363845+0000","last_peered":"2023-10-08T16:27:29.363845+0000","last_clean":"2023-10-08T16:27:29.363845+0000","last_became_active":"2023-10-08T16:27:28.358372+0000","last_became_peered":"2023-10-08T16:27:28.358372+0000","last_unstale":"2023-10-08T16:27:29.363845+0000","last_undegraded":"2023-10-08T16:27:29.363845+0000","last_fullsized":"2023-10-08T16:27:29.363845+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:26:42.940804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390412+0000","last_change":"2023-10-08T16:27:29.386998+0000","last_active":"2023-10-08T16:27:29.390412+0000","last_peered":"2023-10-08T16:27:29.390412+0000","last_clean":"2023-10-08T16:27:29.390412+0000","last_became_active":"2023-10-08T16:27:29.386112+0000","last_became_peered":"2023-10-08T16:27:29.386112+0000","last_unstale":"2023-10-08T16:27:29.390412+0000","last_undegraded":"2023-10-08T16:27:29.390412+0000","last_fullsized":"2023-10-08T16:27:29.390412+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:54.327041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"128'8","reported_seq":18,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394434+0000","last_change":"2023-10-08T16:27:28.363271+0000","last_active":"2023-10-08T16:27:29.394434+0000","last_peered":"2023-10-08T16:27:29.394434+0000","last_clean":"2023-10-08T16:27:29.394434+0000","last_became_active":"2023-10-08T16:27:28.362972+0000","last_became_peered":"2023-10-08T16:27:28.362972+0000","last_unstale":"2023-10-08T16:27:29.394434+0000","last_undegraded":"2023-10-08T16:27:29.394434+0000","last_fullsized":"2023-10-08T16:27:29.394434+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:12:30.416590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375537+0000","last_change":"2023-10-08T16:27:29.372458+0000","last_active":"2023-10-08T16:27:29.375537+0000","last_peered":"2023-10-08T16:27:29.375537+0000","last_clean":"2023-10-08T16:27:29.375537+0000","last_became_active":"2023-10-08T16:27:29.372194+0000","last_became_peered":"2023-10-08T16:27:29.372194+0000","last_unstale":"2023-10-08T16:27:29.375537+0000","last_undegraded":"2023-10-08T16:27:29.375537+0000","last_fullsized":"2023-10-08T16:27:29.375537+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:29.030060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395890+0000","last_change":"2023-10-08T16:27:28.361460+0000","last_active":"2023-10-08T16:27:29.395890+0000","last_peered":"2023-10-08T16:27:29.395890+0000","last_clean":"2023-10-08T16:27:29.395890+0000","last_became_active":"2023-10-08T16:27:28.361149+0000","last_became_peered":"2023-10-08T16:27:28.361149+0000","last_unstale":"2023-10-08T16:27:29.395890+0000","last_undegraded":"2023-10-08T16:27:29.395890+0000","last_fullsized":"2023-10-08T16:27:29.395890+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:58:50.503118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.384403+0000","last_change":"2023-10-08T16:27:29.377724+0000","last_active":"2023-10-08T16:27:29.384403+0000","last_peered":"2023-10-08T16:27:29.384403+0000","last_clean":"2023-10-08T16:27:29.384403+0000","last_became_active":"2023-10-08T16:27:29.376197+0000","last_became_peered":"2023-10-08T16:27:29.376197+0000","last_unstale":"2023-10-08T16:27:29.384403+0000","last_undegraded":"2023-10-08T16:27:29.384403+0000","last_fullsized":"2023-10-08T16:27:29.384403+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:11.153498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.394711+0000","last_change":"2023-10-08T16:27:28.356539+0000","last_active":"2023-10-08T16:27:29.394711+0000","last_peered":"2023-10-08T16:27:29.394711+0000","last_clean":"2023-10-08T16:27:29.394711+0000","last_became_active":"2023-10-08T16:27:28.356186+0000","last_became_peered":"2023-10-08T16:27:28.356186+0000","last_unstale":"2023-10-08T16:27:29.394711+0000","last_undegraded":"2023-10-08T16:27:29.394711+0000","last_fullsized":"2023-10-08T16:27:29.394711+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:07:23.153060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393133+0000","last_change":"2023-10-08T16:27:29.391980+0000","last_active":"2023-10-08T16:27:29.393133+0000","last_peered":"2023-10-08T16:27:29.393133+0000","last_clean":"2023-10-08T16:27:29.393133+0000","last_became_active":"2023-10-08T16:27:29.391723+0000","last_became_peered":"2023-10-08T16:27:29.391723+0000","last_unstale":"2023-10-08T16:27:29.393133+0000","last_undegraded":"2023-10-08T16:27:29.393133+0000","last_fullsized":"2023-10-08T16:27:29.393133+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:04.242088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.373042+0000","last_change":"2023-10-08T16:27:28.368857+0000","last_active":"2023-10-08T16:27:29.373042+0000","last_peered":"2023-10-08T16:27:29.373042+0000","last_clean":"2023-10-08T16:27:29.373042+0000","last_became_active":"2023-10-08T16:27:28.368586+0000","last_became_peered":"2023-10-08T16:27:28.368586+0000","last_unstale":"2023-10-08T16:27:29.373042+0000","last_undegraded":"2023-10-08T16:27:29.373042+0000","last_fullsized":"2023-10-08T16:27:29.373042+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:20:57.978848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387251+0000","last_change":"2023-10-08T16:27:29.383998+0000","last_active":"2023-10-08T16:27:29.387251+0000","last_peered":"2023-10-08T16:27:29.387251+0000","last_clean":"2023-10-08T16:27:29.387251+0000","last_became_active":"2023-10-08T16:27:29.383738+0000","last_became_peered":"2023-10-08T16:27:29.383738+0000","last_unstale":"2023-10-08T16:27:29.387251+0000","last_undegraded":"2023-10-08T16:27:29.387251+0000","last_fullsized":"2023-10-08T16:27:29.387251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:59.108829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.395321+0000","last_change":"2023-10-08T16:27:28.358573+0000","last_active":"2023-10-08T16:27:29.395321+0000","last_peered":"2023-10-08T16:27:29.395321+0000","last_clean":"2023-10-08T16:27:29.395321+0000","last_became_active":"2023-10-08T16:27:28.358200+0000","last_became_peered":"2023-10-08T16:27:28.358200+0000","last_unstale":"2023-10-08T16:27:29.395321+0000","last_undegraded":"2023-10-08T16:27:29.395321+0000","last_fullsized":"2023-10-08T16:27:29.395321+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:02:47.118533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.382574+0000","last_change":"2023-10-08T16:27:29.373874+0000","last_active":"2023-10-08T16:27:29.382574+0000","last_peered":"2023-10-08T16:27:29.382574+0000","last_clean":"2023-10-08T16:27:29.382574+0000","last_became_active":"2023-10-08T16:27:29.373619+0000","last_became_peered":"2023-10-08T16:27:29.373619+0000","last_unstale":"2023-10-08T16:27:29.382574+0000","last_undegraded":"2023-10-08T16:27:29.382574+0000","last_fullsized":"2023-10-08T16:27:29.382574+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:59.174919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.370348+0000","last_change":"2023-10-08T16:27:28.351207+0000","last_active":"2023-10-08T16:27:29.370348+0000","last_peered":"2023-10-08T16:27:29.370348+0000","last_clean":"2023-10-08T16:27:29.370348+0000","last_became_active":"2023-10-08T16:27:28.350890+0000","last_became_peered":"2023-10-08T16:27:28.350890+0000","last_unstale":"2023-10-08T16:27:29.370348+0000","last_undegraded":"2023-10-08T16:27:29.370348+0000","last_fullsized":"2023-10-08T16:27:29.370348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:30.007307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387131+0000","last_change":"2023-10-08T16:27:29.382395+0000","last_active":"2023-10-08T16:27:29.387131+0000","last_peered":"2023-10-08T16:27:29.387131+0000","last_clean":"2023-10-08T16:27:29.387131+0000","last_became_active":"2023-10-08T16:27:29.382120+0000","last_became_peered":"2023-10-08T16:27:29.382120+0000","last_unstale":"2023-10-08T16:27:29.387131+0000","last_undegraded":"2023-10-08T16:27:29.387131+0000","last_fullsized":"2023-10-08T16:27:29.387131+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:01:39.772313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.369436+0000","last_change":"2023-10-08T16:27:28.363508+0000","last_active":"2023-10-08T16:27:29.369436+0000","last_peered":"2023-10-08T16:27:29.369436+0000","last_clean":"2023-10-08T16:27:29.369436+0000","last_became_active":"2023-10-08T16:27:28.363140+0000","last_became_peered":"2023-10-08T16:27:28.363140+0000","last_unstale":"2023-10-08T16:27:29.369436+0000","last_undegraded":"2023-10-08T16:27:29.369436+0000","last_fullsized":"2023-10-08T16:27:29.369436+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:10:24.418321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.375474+0000","last_change":"2023-10-08T16:27:29.372750+0000","last_active":"2023-10-08T16:27:29.375474+0000","last_peered":"2023-10-08T16:27:29.375474+0000","last_clean":"2023-10-08T16:27:29.375474+0000","last_became_active":"2023-10-08T16:27:29.372363+0000","last_became_peered":"2023-10-08T16:27:29.372363+0000","last_unstale":"2023-10-08T16:27:29.375474+0000","last_undegraded":"2023-10-08T16:27:29.375474+0000","last_fullsized":"2023-10-08T16:27:29.375474+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:18:59.150062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.368138+0000","last_change":"2023-10-08T16:27:28.368017+0000","last_active":"2023-10-08T16:27:29.368138+0000","last_peered":"2023-10-08T16:27:29.368138+0000","last_clean":"2023-10-08T16:27:29.368138+0000","last_became_active":"2023-10-08T16:27:28.367708+0000","last_became_peered":"2023-10-08T16:27:28.367708+0000","last_unstale":"2023-10-08T16:27:29.368138+0000","last_undegraded":"2023-10-08T16:27:29.368138+0000","last_fullsized":"2023-10-08T16:27:29.368138+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:28.024599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.392081+0000","last_change":"2023-10-08T16:27:29.388574+0000","last_active":"2023-10-08T16:27:29.392081+0000","last_peered":"2023-10-08T16:27:29.392081+0000","last_clean":"2023-10-08T16:27:29.392081+0000","last_became_active":"2023-10-08T16:27:29.388326+0000","last_became_peered":"2023-10-08T16:27:29.388326+0000","last_unstale":"2023-10-08T16:27:29.392081+0000","last_undegraded":"2023-10-08T16:27:29.392081+0000","last_fullsized":"2023-10-08T16:27:29.392081+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:13.785549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"128'2","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.390323+0000","last_change":"2023-10-08T16:27:28.354375+0000","last_active":"2023-10-08T16:27:29.390323+0000","last_peered":"2023-10-08T16:27:29.390323+0000","last_clean":"2023-10-08T16:27:29.390323+0000","last_became_active":"2023-10-08T16:27:28.354031+0000","last_became_peered":"2023-10-08T16:27:28.354031+0000","last_unstale":"2023-10-08T16:27:29.390323+0000","last_undegraded":"2023-10-08T16:27:29.390323+0000","last_fullsized":"2023-10-08T16:27:29.390323+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:43:23.961832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389343+0000","last_change":"2023-10-08T16:27:29.384396+0000","last_active":"2023-10-08T16:27:29.389343+0000","last_peered":"2023-10-08T16:27:29.389343+0000","last_clean":"2023-10-08T16:27:29.389343+0000","last_became_active":"2023-10-08T16:27:29.384130+0000","last_became_peered":"2023-10-08T16:27:29.384130+0000","last_unstale":"2023-10-08T16:27:29.389343+0000","last_undegraded":"2023-10-08T16:27:29.389343+0000","last_fullsized":"2023-10-08T16:27:29.389343+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:07:10.841744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.374113+0000","last_change":"2023-10-08T16:27:28.362100+0000","last_active":"2023-10-08T16:27:29.374113+0000","last_peered":"2023-10-08T16:27:29.374113+0000","last_clean":"2023-10-08T16:27:29.374113+0000","last_became_active":"2023-10-08T16:27:28.361834+0000","last_became_peered":"2023-10-08T16:27:28.361834+0000","last_unstale":"2023-10-08T16:27:29.374113+0000","last_undegraded":"2023-10-08T16:27:29.374113+0000","last_fullsized":"2023-10-08T16:27:29.374113+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:11.187340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.379251+0000","last_change":"2023-10-08T16:27:29.374027+0000","last_active":"2023-10-08T16:27:29.379251+0000","last_peered":"2023-10-08T16:27:29.379251+0000","last_clean":"2023-10-08T16:27:29.379251+0000","last_became_active":"2023-10-08T16:27:29.373730+0000","last_became_peered":"2023-10-08T16:27:29.373730+0000","last_unstale":"2023-10-08T16:27:29.379251+0000","last_undegraded":"2023-10-08T16:27:29.379251+0000","last_fullsized":"2023-10-08T16:27:29.379251+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:22.268470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.366507+0000","last_change":"2023-10-08T16:27:28.368903+0000","last_active":"2023-10-08T16:27:29.366507+0000","last_peered":"2023-10-08T16:27:29.366507+0000","last_clean":"2023-10-08T16:27:29.366507+0000","last_became_active":"2023-10-08T16:27:28.368628+0000","last_became_peered":"2023-10-08T16:27:28.368628+0000","last_unstale":"2023-10-08T16:27:29.366507+0000","last_undegraded":"2023-10-08T16:27:29.366507+0000","last_fullsized":"2023-10-08T16:27:29.366507+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:40:27.512480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.385678+0000","last_change":"2023-10-08T16:27:29.381547+0000","last_active":"2023-10-08T16:27:29.385678+0000","last_peered":"2023-10-08T16:27:29.385678+0000","last_clean":"2023-10-08T16:27:29.385678+0000","last_became_active":"2023-10-08T16:27:29.381278+0000","last_became_peered":"2023-10-08T16:27:29.381278+0000","last_unstale":"2023-10-08T16:27:29.385678+0000","last_undegraded":"2023-10-08T16:27:29.385678+0000","last_fullsized":"2023-10-08T16:27:29.385678+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:49:46.918319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.364400+0000","last_change":"2023-10-08T16:27:28.354870+0000","last_active":"2023-10-08T16:27:29.364400+0000","last_peered":"2023-10-08T16:27:29.364400+0000","last_clean":"2023-10-08T16:27:29.364400+0000","last_became_active":"2023-10-08T16:27:28.354573+0000","last_became_peered":"2023-10-08T16:27:28.354573+0000","last_unstale":"2023-10-08T16:27:29.364400+0000","last_undegraded":"2023-10-08T16:27:29.364400+0000","last_fullsized":"2023-10-08T16:27:29.364400+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:41:13.111913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.391014+0000","last_change":"2023-10-08T16:27:29.387121+0000","last_active":"2023-10-08T16:27:29.391014+0000","last_peered":"2023-10-08T16:27:29.391014+0000","last_clean":"2023-10-08T16:27:29.391014+0000","last_became_active":"2023-10-08T16:27:29.386826+0000","last_became_peered":"2023-10-08T16:27:29.386826+0000","last_unstale":"2023-10-08T16:27:29.391014+0000","last_undegraded":"2023-10-08T16:27:29.391014+0000","last_fullsized":"2023-10-08T16:27:29.391014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:08:50.977123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.370904+0000","last_change":"2023-10-08T16:27:28.363737+0000","last_active":"2023-10-08T16:27:29.370904+0000","last_peered":"2023-10-08T16:27:29.370904+0000","last_clean":"2023-10-08T16:27:29.370904+0000","last_became_active":"2023-10-08T16:27:28.363498+0000","last_became_peered":"2023-10-08T16:27:28.363498+0000","last_unstale":"2023-10-08T16:27:29.370904+0000","last_undegraded":"2023-10-08T16:27:29.370904+0000","last_fullsized":"2023-10-08T16:27:29.370904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:01.787507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386227+0000","last_change":"2023-10-08T16:27:29.381456+0000","last_active":"2023-10-08T16:27:29.386227+0000","last_peered":"2023-10-08T16:27:29.386227+0000","last_clean":"2023-10-08T16:27:29.386227+0000","last_became_active":"2023-10-08T16:27:29.381196+0000","last_became_peered":"2023-10-08T16:27:29.381196+0000","last_unstale":"2023-10-08T16:27:29.386227+0000","last_undegraded":"2023-10-08T16:27:29.386227+0000","last_fullsized":"2023-10-08T16:27:29.386227+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:27:06.389860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.363844+0000","last_change":"2023-10-08T16:27:28.360498+0000","last_active":"2023-10-08T16:27:29.363844+0000","last_peered":"2023-10-08T16:27:29.363844+0000","last_clean":"2023-10-08T16:27:29.363844+0000","last_became_active":"2023-10-08T16:27:28.360235+0000","last_became_peered":"2023-10-08T16:27:28.360235+0000","last_unstale":"2023-10-08T16:27:29.363844+0000","last_undegraded":"2023-10-08T16:27:29.363844+0000","last_fullsized":"2023-10-08T16:27:29.363844+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:31:44.757436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.389694+0000","last_change":"2023-10-08T16:27:29.386700+0000","last_active":"2023-10-08T16:27:29.389694+0000","last_peered":"2023-10-08T16:27:29.389694+0000","last_clean":"2023-10-08T16:27:29.389694+0000","last_became_active":"2023-10-08T16:27:29.386447+0000","last_became_peered":"2023-10-08T16:27:29.386447+0000","last_unstale":"2023-10-08T16:27:29.389694+0000","last_undegraded":"2023-10-08T16:27:29.389694+0000","last_fullsized":"2023-10-08T16:27:29.389694+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:08:46.225182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.367077+0000","last_change":"2023-10-08T16:27:28.362520+0000","last_active":"2023-10-08T16:27:29.367077+0000","last_peered":"2023-10-08T16:27:29.367077+0000","last_clean":"2023-10-08T16:27:29.367077+0000","last_became_active":"2023-10-08T16:27:28.362191+0000","last_became_peered":"2023-10-08T16:27:28.362191+0000","last_unstale":"2023-10-08T16:27:29.367077+0000","last_undegraded":"2023-10-08T16:27:29.367077+0000","last_fullsized":"2023-10-08T16:27:29.367077+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:16.958489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.386203+0000","last_change":"2023-10-08T16:27:29.383295+0000","last_active":"2023-10-08T16:27:29.386203+0000","last_peered":"2023-10-08T16:27:29.386203+0000","last_clean":"2023-10-08T16:27:29.386203+0000","last_became_active":"2023-10-08T16:27:29.382954+0000","last_became_peered":"2023-10-08T16:27:29.382954+0000","last_unstale":"2023-10-08T16:27:29.386203+0000","last_undegraded":"2023-10-08T16:27:29.386203+0000","last_fullsized":"2023-10-08T16:27:29.386203+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:59.621061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.368069+0000","last_change":"2023-10-08T16:27:28.360770+0000","last_active":"2023-10-08T16:27:29.368069+0000","last_peered":"2023-10-08T16:27:29.368069+0000","last_clean":"2023-10-08T16:27:29.368069+0000","last_became_active":"2023-10-08T16:27:28.358744+0000","last_became_peered":"2023-10-08T16:27:28.358744+0000","last_unstale":"2023-10-08T16:27:29.368069+0000","last_undegraded":"2023-10-08T16:27:29.368069+0000","last_fullsized":"2023-10-08T16:27:29.368069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:58:31.252093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.387298+0000","last_change":"2023-10-08T16:27:29.384627+0000","last_active":"2023-10-08T16:27:29.387298+0000","last_peered":"2023-10-08T16:27:29.387298+0000","last_clean":"2023-10-08T16:27:29.387298+0000","last_became_active":"2023-10-08T16:27:29.384375+0000","last_became_peered":"2023-10-08T16:27:29.384375+0000","last_unstale":"2023-10-08T16:27:29.387298+0000","last_undegraded":"2023-10-08T16:27:29.387298+0000","last_fullsized":"2023-10-08T16:27:29.387298+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:28.336923+0000","last_clean_scrub_stamp":"2023-10-08T16:27:28.336923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:57:32.145602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"128'1","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.393801+0000","last_change":"2023-10-08T16:27:28.366050+0000","last_active":"2023-10-08T16:27:29.393801+0000","last_peered":"2023-10-08T16:27:29.393801+0000","last_clean":"2023-10-08T16:27:29.393801+0000","last_became_active":"2023-10-08T16:27:28.365733+0000","last_became_peered":"2023-10-08T16:27:28.365733+0000","last_unstale":"2023-10-08T16:27:29.393801+0000","last_undegraded":"2023-10-08T16:27:29.393801+0000","last_fullsized":"2023-10-08T16:27:29.393801+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:27:27.331462+0000","last_clean_scrub_stamp":"2023-10-08T16:27:27.331462+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:46:00.820446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"118'227","reported_seq":653,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-10-08T16:27:29.374167+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:27:29.374167+0000","last_peered":"2023-10-08T16:27:29.374167+0000","last_clean":"2023-10-08T16:27:29.374167+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:27:29.374167+0000","last_undegraded":"2023-10-08T16:27:29.374167+0000","last_fullsized":"2023-10-08T16:27:29.374167+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575062,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307624,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064216,"statfs":{"total":96636764160,"available":96321757184,"internally_reserved":0,"allocated":2195456,"data_stored":1371890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66300000000000003,"15min":0.71599999999999997},"min":{"1min":0.39500000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":1.103},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67700000000000005,"15min":0.70999999999999996},"min":{"1min":0.43099999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.77500000000000002},"min":{"1min":0.52300000000000002,"5min":0.47299999999999998,"15min":0.42599999999999999},"max":{"1min":0.88,"5min":1.002,"15min":1.0469999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.753,"15min":0.77900000000000003},"min":{"1min":0.56999999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89800000000000002,"5min":1.0229999999999999,"15min":1.042},"last":0.73299999999999998}]},{"osd":2,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.69199999999999995,"15min":0.72599999999999998},"min":{"1min":0.504,"5min":0.499,"15min":0.46800000000000003},"max":{"1min":0.89000000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72899999999999998,"15min":0.73799999999999999},"min":{"1min":0.55600000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.95999999999999996,"5min":1.0189999999999999,"15min":1.05},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.71899999999999997,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.76300000000000001},"min":{"1min":0.56299999999999994,"5min":0.49199999999999999,"15min":0.48199999999999998},"max":{"1min":0.91500000000000004,"5min":1.0389999999999999,"15min":1.0780000000000001},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.63700000000000001},"min":{"1min":0.46700000000000003,"5min":0.443,"15min":0.38700000000000001},"max":{"1min":0.93600000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.45300000000000001,"5min":0.439,"15min":0.437},"max":{"1min":0.997,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89700000000000002}]},{"osd":5,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.48199999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":1.351,"15min":1.351},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73699999999999999,"15min":0.71799999999999997},"min":{"1min":0.51400000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.47099999999999997},"max":{"1min":1.016,"5min":1.173,"15min":1.173},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76600000000000001,"15min":0.748},"min":{"1min":0.54900000000000004,"5min":0.51500000000000001,"15min":0.48099999999999998},"max":{"1min":0.98399999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575063,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307044,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064796,"statfs":{"total":96636764160,"available":96322351104,"internally_reserved":0,"allocated":1601536,"data_stored":782034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.70199999999999996},"min":{"1min":0.437,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":1.0860000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67800000000000005,"15min":0.71599999999999997},"min":{"1min":0.45800000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.91500000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.66000000000000003,"15min":0.69899999999999995},"min":{"1min":0.46899999999999997,"5min":0.38,"15min":0.38},"max":{"1min":0.96399999999999997,"5min":0.99199999999999999,"15min":1.0369999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.70199999999999996,"15min":0.73299999999999998},"min":{"1min":0.56200000000000006,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.90900000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72199999999999998,"15min":0.77000000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.998,"5min":1.071,"15min":1.081},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73599999999999999,"15min":0.77300000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.499},"max":{"1min":0.85299999999999998,"5min":1.034,"15min":1.0800000000000001},"last":0.70599999999999996}]},{"osd":3,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.72799999999999998,"15min":0.75800000000000001},"min":{"1min":0.60699999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.95599999999999996,"5min":0.98299999999999998,"15min":1.0149999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.74299999999999999,"15min":0.77000000000000002},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.125},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66300000000000003,"15min":0.65000000000000002},"min":{"1min":0.45900000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.83199999999999996,"5min":1.073,"15min":1.073},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.746,"15min":0.747},"min":{"1min":0.43099999999999999,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.94899999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.80300000000000005}]},{"osd":5,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.46899999999999997,"5min":0.45400000000000001,"15min":0.41499999999999998},"max":{"1min":0.77400000000000002,"5min":1.272,"15min":1.272},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.53900000000000003,"5min":0.48599999999999999,"15min":0.42999999999999999},"max":{"1min":0.88800000000000001,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.872}]},{"osd":7,"last update":"Sun Oct 8 16:26:43 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.49299999999999999,"5min":0.46100000000000002,"15min":0.42399999999999999},"max":{"1min":0.89400000000000002,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.73499999999999999,"15min":0.73399999999999999},"min":{"1min":0.54800000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92000000000000004,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.86099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575062,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302940,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068900,"statfs":{"total":96636764160,"available":96326553600,"internally_reserved":0,"allocated":1593344,"data_stored":781410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.42199999999999999,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.496},"min":{"1min":0.33400000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80800000000000005,"5min":0.82199999999999995,"15min":0.96599999999999997},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48199999999999998,"15min":0.48599999999999999},"min":{"1min":0.375,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.68300000000000005,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.505},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.91200000000000003},"last":0.54500000000000004}]},{"osd":3,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.60899999999999999,"15min":0.63600000000000001},"min":{"1min":0.41899999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.95899999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.56599999999999995,"15min":0.58199999999999996},"min":{"1min":0.44500000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.95199999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.79200000000000004,"15min":0.78800000000000003},"min":{"1min":0.624,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0580000000000001,"5min":1.879,"15min":1.879},"last":0.749},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.58299999999999996,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.0680000000000001,"15min":1.2230000000000001},"last":1.379}]},{"osd":5,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79400000000000004,"15min":0.79200000000000004},"min":{"1min":0.57899999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":2.379,"15min":2.379},"last":1.4390000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.77000000000000002,"15min":0.80200000000000005},"min":{"1min":0.58399999999999996,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.016,"5min":1.0660000000000001,"15min":1.224},"last":1.042}]},{"osd":6,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.78100000000000003,"15min":0.81100000000000005},"min":{"1min":0.61899999999999999,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":1.0129999999999999,"5min":1.0780000000000001,"15min":1.206},"last":0.995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.59999999999999998,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":1.0309999999999999,"5min":1.101,"15min":1.2909999999999999},"last":1.4079999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:26:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79500000000000004,"15min":0.82299999999999995},"min":{"1min":0.67500000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.1839999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.69499999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":0.99299999999999999,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.91100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575062,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2191360,"data_stored":1372332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48599999999999999,"15min":0.497},"min":{"1min":0.32900000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.63,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.624,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.51200000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.50600000000000001,"15min":0.51400000000000001},"min":{"1min":0.38900000000000001,"5min":0.37,"15min":0.32700000000000001},"max":{"1min":0.54400000000000004,"5min":1.093,"15min":1.093},"last":0.37},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67800000000000005,"5min":1.022,"15min":1.022},"last":0.45200000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.503,"15min":0.52500000000000002},"min":{"1min":0.34899999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.78300000000000003,"5min":0.81399999999999995,"15min":0.878},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61099999999999999,"15min":0.63200000000000001},"min":{"1min":0.45300000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81699999999999995,"5min":1.21,"15min":1.21},"last":0.58499999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74099999999999999,"15min":0.76700000000000002},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92600000000000005,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.749,"5min":0.75800000000000001,"15min":0.79200000000000004},"min":{"1min":0.57799999999999996,"5min":0.504,"15min":0.504},"max":{"1min":1.0569999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.94899999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76000000000000001,"15min":0.79500000000000004},"min":{"1min":0.54700000000000004,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":0.92500000000000004,"5min":1.083,"15min":1.1439999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.79900000000000004},"min":{"1min":0.61599999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.2330000000000001},"last":0.97599999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77100000000000002,"15min":0.80800000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.995,"5min":1.157,"15min":1.1950000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.79300000000000004,"15min":0.81699999999999995},"min":{"1min":0.63700000000000001,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.131,"5min":1.196,"15min":1.212},"last":0.84399999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:26:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77900000000000003,"15min":0.82199999999999995},"min":{"1min":0.58699999999999997,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":0.98399999999999999,"5min":1.1140000000000001,"15min":1.1579999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.80100000000000005,"15min":0.81899999999999995},"min":{"1min":0.56699999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.014,"5min":1.163,"15min":1.202},"last":0.93300000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575063,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307040,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064800,"statfs":{"total":96636764160,"available":96322355200,"internally_reserved":0,"allocated":1597440,"data_stored":781444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.48099999999999998},"min":{"1min":0.34499999999999997,"5min":0.27800000000000002,"15min":0.25900000000000001},"max":{"1min":0.69499999999999995,"5min":0.96599999999999997,"15min":1.046},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.38500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73699999999999999,"5min":1.01,"15min":1.01},"last":0.51000000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49199999999999999,"15min":0.52000000000000002},"min":{"1min":0.377,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.75700000000000001,"5min":0.75800000000000001,"15min":1.1519999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.505,"15min":0.52300000000000002},"min":{"1min":0.41099999999999998,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":0.77000000000000002,"5min":0.88900000000000001,"15min":0.94399999999999995},"last":0.42099999999999999}]},{"osd":3,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.505,"15min":0.53000000000000003},"min":{"1min":0.34200000000000003,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.65900000000000003,"5min":0.879,"15min":0.99299999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.63600000000000001},"min":{"1min":0.47399999999999998,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.80100000000000005,"5min":0.83199999999999996,"15min":1.1160000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72799999999999998,"15min":0.77700000000000002},"min":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.434},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.4790000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73299999999999998,"15min":0.77200000000000002},"min":{"1min":0.54900000000000004,"5min":0.495,"15min":0.495},"max":{"1min":1.0349999999999999,"5min":1.056,"15min":1.2909999999999999},"last":0.88800000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.78300000000000003,"15min":0.83699999999999997},"min":{"1min":0.64100000000000001,"5min":0.54000000000000004,"15min":0.53800000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.4990000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76500000000000001,"15min":0.81100000000000005},"min":{"1min":0.49299999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.103,"5min":1.103,"15min":1.3},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.77800000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.046,"15min":1.321},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.75600000000000001,"15min":0.81399999999999995},"min":{"1min":0.60299999999999998,"5min":0.52700000000000002,"15min":0.48099999999999998},"max":{"1min":1.163,"5min":1.163,"15min":1.5149999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:26:52 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.79400000000000004,"15min":0.84299999999999997},"min":{"1min":0.57299999999999995,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.4410000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.79200000000000004,"15min":0.85099999999999998},"min":{"1min":0.56599999999999995,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.286},"last":0.83699999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575063,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307052,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064788,"statfs":{"total":96636764160,"available":96322342912,"internally_reserved":0,"allocated":1609728,"data_stored":782968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44,"15min":0.45900000000000002},"min":{"1min":0.29699999999999999,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.66300000000000003,"5min":0.73199999999999998,"15min":0.83899999999999997},"last":0.443},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.51000000000000001,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":0.71499999999999997,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.67000000000000004}]},{"osd":1,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46800000000000003,"15min":0.47899999999999998},"min":{"1min":0.33400000000000002,"5min":0.30599999999999999,"15min":0.25800000000000001},"max":{"1min":0.69399999999999995,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.377,"5min":0.32400000000000001,"15min":0.31900000000000001},"max":{"1min":0.72099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57199999999999995,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.95699999999999996},"last":0.747},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63,"15min":0.65300000000000002},"min":{"1min":0.435,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90100000000000002,"5min":1,"15min":1},"last":0.65200000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.71099999999999997,"15min":0.73699999999999999},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":1.091,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72199999999999998,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.47799999999999998,"15min":0.42799999999999999},"max":{"1min":0.98699999999999999,"5min":1.0249999999999999,"15min":1.3600000000000001},"last":0.57299999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.74299999999999999,"15min":0.78300000000000003},"min":{"1min":0.55900000000000005,"5min":0.495,"15min":0.495},"max":{"1min":0.99399999999999999,"5min":1.0329999999999999,"15min":1.2110000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.75600000000000001,"15min":0.78300000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.214,"5min":1.214,"15min":1.3200000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.80200000000000005,"15min":0.81799999999999995},"min":{"1min":0.54500000000000004,"5min":0.48299999999999998,"15min":0.45500000000000002},"max":{"1min":1.1919999999999999,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.80800000000000005,"15min":0.83999999999999997},"min":{"1min":0.63400000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.044,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:26:42 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.84699999999999998},"min":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.173,"5min":1.204,"15min":1.23},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.58099999999999996,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0369999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.81200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834575063,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298864,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072976,"statfs":{"total":96636764160,"available":96330727424,"internally_reserved":0,"allocated":1613824,"data_stored":783070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.67900000000000005,"15min":0.70699999999999996},"min":{"1min":0.44,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89900000000000002,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72599999999999998,"15min":0.72399999999999998},"min":{"1min":0.52800000000000002,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.90700000000000003,"5min":1.02,"15min":1.02},"last":0.64100000000000001}]},{"osd":1,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.74099999999999999},"min":{"1min":0.54900000000000004,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.016,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.496},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.503,"5min":0.498,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.73999999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.74399999999999999,"15min":0.74199999999999999},"min":{"1min":0.47699999999999998,"5min":0.433,"15min":0.42099999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73299999999999998,"15min":0.749},"min":{"1min":0.58899999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97499999999999998,"5min":1.085,"15min":1.1060000000000001},"last":0.71199999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80400000000000005,"15min":0.80000000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1339999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.99199999999999999,"5min":3.4169999999999998,"15min":3.4169999999999998},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.629},"min":{"1min":0.45700000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.876,"5min":1.47,"15min":1.47},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.67800000000000005},"min":{"1min":0.50600000000000001,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.91700000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68000000000000005,"15min":0.64800000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88400000000000001,"5min":2.661,"15min":2.661},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76200000000000001,"15min":0.72799999999999998},"min":{"1min":0.55800000000000005,"5min":0.47099999999999997,"15min":0.46999999999999997},"max":{"1min":1.04,"5min":1.611,"15min":1.611},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:26:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.80600000000000005,"15min":0.76200000000000001},"min":{"1min":0.55700000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.161,"5min":2.0720000000000001,"15min":2.0720000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.73399999999999999},"min":{"1min":0.52700000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.137,"5min":2.6120000000000001,"15min":2.6120000000000001},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575062,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311136,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060704,"statfs":{"total":96636764160,"available":96318160896,"internally_reserved":0,"allocated":1597440,"data_stored":781480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71599999999999997,"15min":0.72299999999999998},"min":{"1min":0.47999999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.86299999999999999,"5min":5.3250000000000002,"15min":5.3250000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.53800000000000003,"5min":0.308,"15min":0.308},"max":{"1min":0.95099999999999996,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":0.80100000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.72999999999999998,"15min":0.752},"min":{"1min":0.54300000000000004,"5min":0.38,"15min":0.38},"max":{"1min":0.97199999999999998,"5min":2.1120000000000001,"15min":2.1120000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.70099999999999996,"15min":0.73099999999999998},"min":{"1min":0.43099999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70099999999999996,"15min":0.73699999999999999},"min":{"1min":0.44800000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.02,"5min":1.02,"15min":1.0389999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.72599999999999998,"15min":0.73999999999999999},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94999999999999996,"5min":4.931,"15min":4.931},"last":0.78700000000000003}]},{"osd":3,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72499999999999998,"15min":0.74299999999999999},"min":{"1min":0.44700000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93100000000000005,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.77500000000000002},"min":{"1min":0.55300000000000005,"5min":0.442,"15min":0.442},"max":{"1min":0.98999999999999999,"5min":1.96,"15min":1.96},"last":0.77300000000000002}]},{"osd":4,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69999999999999996,"15min":0.63300000000000001},"min":{"1min":0.46200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.82599999999999996,"5min":8.3770000000000007,"15min":8.3770000000000007},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70999999999999996,"15min":0.67800000000000005},"min":{"1min":0.44500000000000001,"5min":0.432,"15min":0.40400000000000003},"max":{"1min":0.88200000000000001,"5min":2.1989999999999998,"15min":2.1989999999999998},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.71999999999999997,"15min":0.68999999999999995},"min":{"1min":0.46200000000000002,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":1.0249999999999999,"5min":2.024,"15min":2.024},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.76800000000000002,"15min":0.71199999999999997},"min":{"1min":0.50800000000000001,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":0.92900000000000005,"5min":7.1639999999999997,"15min":7.1639999999999997},"last":0.83799999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:26:33 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.747},"min":{"1min":0.48499999999999999,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1,"5min":2.157,"15min":2.157},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.78300000000000003,"15min":0.77100000000000002},"min":{"1min":0.53300000000000003,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":1.046,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.81499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:27:34.215 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:27:34.215 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:27:34.335 INFO:tasks.ceph.mds.b.smithi029.stderr:2023-10-08T16:27:34.335+0000 7f1bc95f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:27:34.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.443+0000 7f5f7cd9d700 1 Processor -- start 2023-10-08T16:27:34.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.443+0000 7f5f7cd9d700 1 -- start start 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f7806e0a0 0x7f5f780c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806f3a0 0x7f5f7814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f7806e470 0x7f5f781501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7806a490 con 0x7f5f7806e0a0 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780c7490 con 0x7f5f7806e470 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c7770 con 0x7f5f7806f3a0 2023-10-08T16:27:34.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f777fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f7806e0a0 0x7f5f780c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f777fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5f7806e0a0 0x7f5f780c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35506/0 (socket says 172.21.15.12:35506) 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f777fe700 1 -- 172.21.15.12:0/2421459871 learned_addr learned my addr 172.21.15.12:0/2421459871 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806f3a0 0x7f5f7814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.444+0000 7f5f77fff700 1 --2- 172.21.15.12:0/2421459871 >> v2:172.21.15.29:3300/0 conn(0x7f5f7806e470 0x7f5f781501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 -- 172.21.15.12:0/2421459871 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806f3a0 msgr2=0x7f5f7814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806f3a0 0x7f5f7814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 -- 172.21.15.12:0/2421459871 >> v2:172.21.15.29:3300/0 conn(0x7f5f7806e470 msgr2=0x7f5f781501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2421459871 >> v2:172.21.15.29:3300/0 conn(0x7f5f7806e470 0x7f5f781501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 -- 172.21.15.12:0/2421459871 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780c7a50 con 0x7f5f7806e0a0 2023-10-08T16:27:34.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f777fe700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806e0a0 0x7f5f780c6b20 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5f780698d0 tx=0x7f5f6800a330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7ca6e1db6e933c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f767fc700 1 -- 172.21.15.12:0/2421459871 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800ae60 con 0x7f5f7806e0a0 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.445+0000 7f5f767fc700 1 -- 172.21.15.12:0/2421459871 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6800b750 con 0x7f5f7806e0a0 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f767fc700 1 -- 172.21.15.12:0/2421459871 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800baf0 con 0x7f5f7806e0a0 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/2421459871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806e0a0 msgr2=0x7f5f780c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806e0a0 0x7f5f780c6b20 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f5f780698d0 tx=0x7f5f6800a330 comp rx=0 tx=0).stop 2023-10-08T16:27:34.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/2421459871 shutdown_connections 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/2421459871 >> v2:172.21.15.29:3300/0 conn(0x7f5f7806e470 0x7f5f781501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806e0a0 0x7f5f780c6b20 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/2421459871 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806f3a0 0x7f5f7814fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/2421459871 >> 172.21.15.12:0/2421459871 conn(0x7f5f7806d170 msgr2=0x7f5f780cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/2421459871 shutdown_connections 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.446+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/2421459871 wait complete. 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.448+0000 7f5f7cd9d700 1 Processor -- start 2023-10-08T16:27:34.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.448+0000 7f5f7cd9d700 1 -- start start 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 0x7f5f7813ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f7806e470 0x7f5f7816d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c2880 con 0x7f5f7806f3a0 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c22c0 con 0x7f5f7806e470 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f7cd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f780c25a0 con 0x7f5f7806e0a0 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35510/0 (socket says 172.21.15.12:35510) 2023-10-08T16:27:34.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 -- 172.21.15.12:0/1113161745 learned_addr learned my addr 172.21.15.12:0/1113161745 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f777fe700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 0x7f5f7813ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f76ffd700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f7806e470 0x7f5f7816d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 -- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 msgr2=0x7f5f7813ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 0x7f5f7813ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 -- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f7806e470 msgr2=0x7f5f7816d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f7806e470 0x7f5f7816d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.449+0000 7f5f77fff700 1 -- 172.21.15.12:0/1113161745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6800a590 con 0x7f5f7806f3a0 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f777fe700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 0x7f5f7813ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f77fff700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009e90 tx=0x7f5f7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000cc20 con 0x7f5f7806f3a0 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000f040 con 0x7f5f7806f3a0 2023-10-08T16:27:34.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70014480 con 0x7f5f7806f3a0 2023-10-08T16:27:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f780aff10 con 0x7f5f7806f3a0 2023-10-08T16:27:34.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.450+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7813ef90 con 0x7f5f7806f3a0 2023-10-08T16:27:34.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.451+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f780b0430 con 0x7f5f7806f3a0 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.452+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f70014830 con 0x7f5f7806f3a0 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.453+0000 7f5f5f7fe700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 0x7f5f640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.453+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5f700854c0 con 0x7f5f7806f3a0 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.453+0000 7f5f777fe700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 0x7f5f640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.454+0000 7f5f777fe700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 0x7f5f640693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f780698d0 tx=0x7f5f68019000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:34.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.457+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f780b0430 con 0x7f5f7806f3a0 2023-10-08T16:27:34.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.740+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f5f780b0430 con 0x7f5f7806f3a0 2023-10-08T16:27:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.744+0000 7f5f5f7fe700 1 -- 172.21.15.12:0/1113161745 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5f780b0430 con 0x7f5f7806f3a0 2023-10-08T16:27:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 msgr2=0x7f5f640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 0x7f5f640693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5f780698d0 tx=0x7f5f68019000 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 msgr2=0x7f5f7816d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009e90 tx=0x7f5f7000b040 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 shutdown_connections 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5f64066f30 0x7f5f640693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f7806f3a0 0x7f5f7816d620 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f7806e0a0 0x7f5f7813ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 --2- 172.21.15.12:0/1113161745 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f7806e470 0x7f5f7816d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 >> 172.21.15.12:0/1113161745 conn(0x7f5f7806d170 msgr2=0x7f5f7814ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.746+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 shutdown_connections 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:34.747+0000 7f5f7cd9d700 1 -- 172.21.15.12:0/1113161745 wait complete. 2023-10-08T16:27:34.956 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:27:34.957 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:27:35.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.142+0000 7f52c6b9d700 1 Processor -- start 2023-10-08T16:27:35.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.143+0000 7f52c6b9d700 1 -- start start 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c6b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52c00ca410 0x7f52c00c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c6b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52c00c6ec0 0x7f52c015f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c6b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00cb4f0 con 0x7f52c015b5d0 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c6b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c00c7340 con 0x7f52c00c6ec0 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c6b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c015e390 con 0x7f52c00ca410 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c639c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52c00c6ec0 0x7f52c015f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c5b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52c015b5d0 0x7f52c00c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60242/0 (socket says 172.21.15.12:60242) 2023-10-08T16:27:35.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c5b9b700 1 -- 172.21.15.12:0/1513863359 learned_addr learned my addr 172.21.15.12:0/1513863359 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:35.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.144+0000 7f52c539a700 1 --2- 172.21.15.12:0/1513863359 >> v2:172.21.15.29:3300/0 conn(0x7f52c00ca410 0x7f52c00c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c639c700 1 -- 172.21.15.12:0/1513863359 >> v2:172.21.15.29:3300/0 conn(0x7f52c00ca410 msgr2=0x7f52c00c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:35.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c639c700 1 --2- 172.21.15.12:0/1513863359 >> v2:172.21.15.29:3300/0 conn(0x7f52c00ca410 0x7f52c00c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c639c700 1 -- 172.21.15.12:0/1513863359 >> v1:172.21.15.12:6789/0 conn(0x7f52c015b5d0 legacy=0x7f52c00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c639c700 1 -- 172.21.15.12:0/1513863359 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00ca8e0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c4b99700 1 -- 172.21.15.12:0/1513863359 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109382409 0 0) 0x7f52c00cb4f0 con 0x7f52c015b5d0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c639c700 1 --2- 172.21.15.12:0/1513863359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c015f1d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e60 tx=0x7f52b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada824193d15f98b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c4b99700 1 -- 172.21.15.12:0/1513863359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b800e070 con 0x7f52c00c6ec0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c4b99700 1 -- 172.21.15.12:0/1513863359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b800bbf0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.145+0000 7f52c4b99700 1 -- 172.21.15.12:0/1513863359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b8012430 con 0x7f52c00c6ec0 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 -- 172.21.15.12:0/1513863359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 msgr2=0x7f52c015f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/1513863359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c015f1d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009e60 tx=0x7f52b8009780 comp rx=0 tx=0).stop 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 -- 172.21.15.12:0/1513863359 shutdown_connections 2023-10-08T16:27:35.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/1513863359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c015f1d0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/1513863359 >> v2:172.21.15.29:3300/0 conn(0x7f52c00ca410 0x7f52c00c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 -- 172.21.15.12:0/1513863359 >> 172.21.15.12:0/1513863359 conn(0x7f52c006d170 msgr2=0x7f52c00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 -- 172.21.15.12:0/1513863359 shutdown_connections 2023-10-08T16:27:35.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.146+0000 7f52c6b9d700 1 -- 172.21.15.12:0/1513863359 wait complete. 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.147+0000 7f52c6b9d700 1 Processor -- start 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.147+0000 7f52c6b9d700 1 -- start start 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52c00ca410 0x7f52c0159210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52c015b5d0 0x7f52c00c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c016dd20 con 0x7f52c00c6ec0 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c006b470 con 0x7f52c00ca410 2023-10-08T16:27:35.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.148+0000 7f52c6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00c3ff0 con 0x7f52c015b5d0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35522/0 (socket says 172.21.15.12:35522) 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 -- 172.21.15.12:0/4015009075 learned_addr learned my addr 172.21.15.12:0/4015009075 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c539a700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52c00ca410 0x7f52c0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c639c700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52c015b5d0 0x7f52c00c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 -- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52c015b5d0 msgr2=0x7f52c00c52c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52c015b5d0 0x7f52c00c52c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 -- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52c00ca410 msgr2=0x7f52c0159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52c00ca410 0x7f52c0159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 -- 172.21.15.12:0/4015009075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b8009a20 con 0x7f52c00c6ec0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.149+0000 7f52c5b9b700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c7e0 tx=0x7f52bc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:35.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.150+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc005b30 con 0x7f52c00c6ec0 2023-10-08T16:27:35.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.150+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc005c90 con 0x7f52c00c6ec0 2023-10-08T16:27:35.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.150+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc007300 con 0x7f52c00c6ec0 2023-10-08T16:27:35.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.150+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c00c3750 con 0x7f52c00c6ec0 2023-10-08T16:27:35.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.150+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c00c3d10 con 0x7f52c00c6ec0 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.151+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c004c3c0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.152+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52bc01b400 con 0x7f52c00c6ec0 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.152+0000 7f52b5ffb700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 0x7f52a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.153+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f52bc0842d0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.153+0000 7f52c539a700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 0x7f52a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:35.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.153+0000 7f52c539a700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 0x7f52a40693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52b0006aa0 tx=0x7f52b0008040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:35.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.157+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52bc051390 con 0x7f52c00c6ec0 2023-10-08T16:27:35.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.405+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52c0159bf0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.406+0000 7f52b5ffb700 1 -- 172.21.15.12:0/4015009075 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f52bc0549b0 con 0x7f52c00c6ec0 2023-10-08T16:27:35.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:35.407 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:27:35.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 msgr2=0x7f52a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 0x7f52a40693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f52b0006aa0 tx=0x7f52b0008040 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 msgr2=0x7f52c00af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00c7e0 tx=0x7f52bc007df0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 shutdown_connections 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52a4066f30 0x7f52a40693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52c00c6ec0 0x7f52c00af890 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52c015b5d0 0x7f52c00c52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.408+0000 7f52c6b9d700 1 --2- 172.21.15.12:0/4015009075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52c00ca410 0x7f52c0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.409+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 >> 172.21.15.12:0/4015009075 conn(0x7f52c006d170 msgr2=0x7f52c00c13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.409+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 shutdown_connections 2023-10-08T16:27:35.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:35.409+0000 7f52c6b9d700 1 -- 172.21.15.12:0/4015009075 wait complete. 2023-10-08T16:27:35.411 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:27:35.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:27:28.839508+0000', 'modified': '2023-10-08T16:27:32.382120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7776}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7776': {'gid': 7776, 'name': 'b', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/4259979226', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6833', 'nonce': 4259979226}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 4259979226}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:27:35.830 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:27:35.830 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T16:27:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.019+0000 7f5ee359e700 1 Processor -- start 2023-10-08T16:27:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.019+0000 7f5ee359e700 1 -- start start 2023-10-08T16:27:36.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.020+0000 7f5ee359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5ee413fb20 0x7f5ee415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.020+0000 7f5ee359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ee413fef0 0x7f5ee40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.020+0000 7f5ee359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee415ae70 con 0x7f5ee406aaa0 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.020+0000 7f5ee359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee406af60 con 0x7f5ee413fef0 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.020+0000 7f5ee359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ee406b240 con 0x7f5ee413fb20 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee1d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ee413fef0 0x7f5ee40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee2d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5ee406aaa0 0x7f5ee40c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60254/0 (socket says 172.21.15.12:60254) 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee2d9d700 1 -- 172.21.15.12:0/1970206138 learned_addr learned my addr 172.21.15.12:0/1970206138 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee259c700 1 --2- 172.21.15.12:0/1970206138 >> v2:172.21.15.29:3300/0 conn(0x7f5ee413fb20 0x7f5ee415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/1970206138 >> v2:172.21.15.29:3300/0 conn(0x7f5ee413fb20 msgr2=0x7f5ee415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/1970206138 >> v2:172.21.15.29:3300/0 conn(0x7f5ee413fb20 0x7f5ee415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/1970206138 >> v1:172.21.15.12:6789/0 conn(0x7f5ee406aaa0 legacy=0x7f5ee40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.021+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/1970206138 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee406b520 con 0x7f5ee413fef0 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/1970206138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fef0 0x7f5ee40c7990 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40695b0 tx=0x7f5ed8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e7a8b20a4db95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee159a700 1 -- 172.21.15.12:0/1970206138 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8005c10 con 0x7f5ee413fef0 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee159a700 1 -- 172.21.15.12:0/1970206138 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed8005d70 con 0x7f5ee413fef0 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee159a700 1 -- 172.21.15.12:0/1970206138 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8006260 con 0x7f5ee413fef0 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 -- 172.21.15.12:0/1970206138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fef0 msgr2=0x7f5ee40c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 --2- 172.21.15.12:0/1970206138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fef0 0x7f5ee40c7990 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5ee40695b0 tx=0x7f5ed8009120 comp rx=0 tx=0).stop 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 -- 172.21.15.12:0/1970206138 shutdown_connections 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 --2- 172.21.15.12:0/1970206138 >> v2:172.21.15.29:3300/0 conn(0x7f5ee413fb20 0x7f5ee415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 --2- 172.21.15.12:0/1970206138 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fef0 0x7f5ee40c7990 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.022+0000 7f5ee359e700 1 -- 172.21.15.12:0/1970206138 >> 172.21.15.12:0/1970206138 conn(0x7f5ee406d170 msgr2=0x7f5ee40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.023+0000 7f5ee359e700 1 -- 172.21.15.12:0/1970206138 shutdown_connections 2023-10-08T16:27:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.023+0000 7f5ee359e700 1 -- 172.21.15.12:0/1970206138 wait complete. 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.024+0000 7f5ee359e700 1 Processor -- start 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.024+0000 7f5ee359e700 1 -- start start 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ee406aaa0 0x7f5ee4137630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ee413fef0 0x7f5ee4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee413ce90 con 0x7f5ee413fb20 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee4156660 con 0x7f5ee413fef0 2023-10-08T16:27:36.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee41397a0 con 0x7f5ee406aaa0 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35536/0 (socket says 172.21.15.12:35536) 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/2540283011 learned_addr learned my addr 172.21.15.12:0/2540283011 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee259c700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ee406aaa0 0x7f5ee4137630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.025+0000 7f5ee2d9d700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ee413fef0 0x7f5ee4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ee406aaa0 msgr2=0x7f5ee4137630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ee406aaa0 0x7f5ee4137630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ee413fef0 msgr2=0x7f5ee4156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ee413fef0 0x7f5ee4156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/2540283011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed80093c0 con 0x7f5ee413fb20 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4071320 tx=0x7f5ed8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.026+0000 7f5ed27fc700 1 -- 172.21.15.12:0/2540283011 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed801b760 con 0x7f5ee413fb20 2023-10-08T16:27:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.027+0000 7f5ed27fc700 1 -- 172.21.15.12:0/2540283011 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed801b8e0 con 0x7f5ee413fb20 2023-10-08T16:27:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.027+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee413d0c0 con 0x7f5ee413fb20 2023-10-08T16:27:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.027+0000 7f5ed27fc700 1 -- 172.21.15.12:0/2540283011 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed801bca0 con 0x7f5ee413fb20 2023-10-08T16:27:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.027+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee4139150 con 0x7f5ee413fb20 2023-10-08T16:27:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.029+0000 7f5ed27fc700 1 -- 172.21.15.12:0/2540283011 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ed802f440 con 0x7f5ee413fb20 2023-10-08T16:27:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.029+0000 7f5ed27fc700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 0x7f5ec40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.030+0000 7f5ed27fc700 1 -- 172.21.15.12:0/2540283011 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5ed8086650 con 0x7f5ee413fb20 2023-10-08T16:27:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.030+0000 7f5ee259c700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 0x7f5ec40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.030+0000 7f5ee259c700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 0x7f5ec40694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009db0 tx=0x7f5ed40091a0 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.031+0000 7f5ef704fb80 1 Processor -- start 2023-10-08T16:27:36.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.032+0000 7f5ef704fb80 1 -- start start 2023-10-08T16:27:36.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.032+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.032+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a711850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a6c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a61da70 con 0x558c3a711480 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a61b270 con 0x558c3a6c45f0 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c3a617060 con 0x558c3a6c6b80 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35542/0 (socket says 172.21.15.12:35542) 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 -- 172.21.15.12:0/264201476 learned_addr learned my addr 172.21.15.12:0/264201476 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 -- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 msgr2=0x558c3a6c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a6c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 -- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 msgr2=0x558c3a711850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a711850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 -- 172.21.15.12:0/264201476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c3a4b1270 con 0x558c3a711480 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.033+0000 7f5ee259c700 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4011f50 tx=0x7f5ed4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d8c7d208ec9efa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ec37fe700 1 -- 172.21.15.12:0/264201476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4014e70 con 0x558c3a711480 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ec37fe700 1 -- 172.21.15.12:0/264201476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4021450 con 0x558c3a711480 2023-10-08T16:27:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ec37fe700 1 -- 172.21.15.12:0/264201476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40217d0 con 0x558c3a711480 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 -- 172.21.15.12:0/264201476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 msgr2=0x558c3a6f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4011f50 tx=0x7f5ed4019000 comp rx=0 tx=0).stop 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 -- 172.21.15.12:0/264201476 shutdown_connections 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a6f07d0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a6c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/264201476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a711850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 -- 172.21.15.12:0/264201476 >> 172.21.15.12:0/264201476 conn(0x558c3a6c80c0 msgr2=0x558c3a6c88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 -- 172.21.15.12:0/264201476 shutdown_connections 2023-10-08T16:27:36.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.034+0000 7f5ef704fb80 1 -- 172.21.15.12:0/264201476 wait complete. 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.035+0000 7f5ef704fb80 1 -- start start 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.035+0000 7f5ef704fb80 1 Processor -- start 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a6eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a710560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a5c2890 con 0x558c3a711480 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a5ddea0 con 0x558c3a6c45f0 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c3a499e30 con 0x558c3a6c6b80 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.036+0000 7f5ef704fb80 10 client.0 _ll_register_callbacks cb 0x558c3a68a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35558/0 (socket says 172.21.15.12:35558) 2023-10-08T16:27:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 -- 172.21.15.12:0/1233759756 learned_addr learned my addr 172.21.15.12:0/1233759756 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee259c700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a6eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a710560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 -- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 msgr2=0x558c3a710560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a710560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 -- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 msgr2=0x558c3a6eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a6eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 -- 172.21.15.12:0/1233759756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed4011b90 con 0x558c3a711480 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ee2d9d700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00fa20 tx=0x7f5edc009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b1545e5b701936 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ec0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5edc001d30 con 0x558c3a711480 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.037+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c3a6bbcd0 con 0x558c3a711480 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5edc00d850 con 0x558c3a711480 2023-10-08T16:27:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5edc00dc20 con 0x558c3a711480 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 10 client.7920 fetch_fsmap learned FSMap version 57 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x558c3a453fe0 con 0x558c3a711480 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558c3a6bbcd0 con 0x558c3a711480 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 57) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5edc012070 con 0x558c3a711480 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 10 client.7920 fetch_fsmap finished waiting for FSMap version 57 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 10 client.7920 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 20 client.7920 populate_metadata read hostname 'smithi012' 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a6f6190 0x558c3a6f6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 4 client.7920 mds_command: new command op to 7776 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.038+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 --> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c3a698aa0 con 0x558c3a6f6190 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.039+0000 7f5ee259c700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a6f6190 0x558c3a6f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.039+0000 7f5ee259c700 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a6f6190 0x558c3a6f6560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f9e61782faa3f03 server_cookie=8d76a60c1b46801e in_seq=0 out_seq=0 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.039+0000 7f5ec0ff9700 10 client.7920 ms_handle_connect on v2:172.21.15.29:6833/4259979226 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.040+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/1233759756 <== mds.0 v2:172.21.15.29:6833/4259979226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558c3a698aa0 con 0x558c3a6f6190 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.040+0000 7f5ec0ff9700 10 client.7920 handle_command_reply: tid=0 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.040+0000 7f5ef704fb80 1 client.7920 shutdown 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 msgr2=0x558c3a710aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00fa20 tx=0x7f5edc009040 comp rx=0 tx=0).stop 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 shutdown_connections 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a711480 0x558c3a710aa0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a6f6190 0x558c3a6f6560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c45f0 0x558c3a6eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/1233759756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c6b80 0x558c3a710560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ec0ff9700 0 client.7920 ms_handle_reset on v2:172.21.15.29:6833/4259979226 2023-10-08T16:27:36.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 >> 172.21.15.12:0/1233759756 conn(0x558c3a6c80c0 msgr2=0x558c3a6c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 shutdown_connections 2023-10-08T16:27:36.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 1 -- 172.21.15.12:0/1233759756 wait complete. 2023-10-08T16:27:36.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.041+0000 7f5ef704fb80 20 client.7920 trim_cache size 0 max 16384 2023-10-08T16:27:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 Processor -- start 2023-10-08T16:27:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 -- start start 2023-10-08T16:27:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c6b80 0x558c3a70e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a711480 0x558c3a70e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.059+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6c6340 con 0x558c3a6c45f0 2023-10-08T16:27:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6c36f0 con 0x558c3a6c6b80 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6f7370 con 0x558c3a711480 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35568/0 (socket says 172.21.15.12:35568) 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 -- 172.21.15.12:0/784198910 learned_addr learned my addr 172.21.15.12:0/784198910 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 -- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a711480 msgr2=0x558c3a70e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a711480 0x558c3a70e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 -- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c6b80 msgr2=0x558c3a70e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c6b80 0x558c3a70e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 -- 172.21.15.12:0/784198910 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c3a5e5780 con 0x558c3a6c45f0 2023-10-08T16:27:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ee259c700 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4011930 tx=0x7f5ed4003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68d3cdbcafb9829 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ec3fff700 1 -- 172.21.15.12:0/784198910 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4030040 con 0x558c3a6c45f0 2023-10-08T16:27:36.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ec3fff700 1 -- 172.21.15.12:0/784198910 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40215c0 con 0x558c3a6c45f0 2023-10-08T16:27:36.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.060+0000 7f5ec3fff700 1 -- 172.21.15.12:0/784198910 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4021730 con 0x558c3a6c45f0 2023-10-08T16:27:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 -- 172.21.15.12:0/784198910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 msgr2=0x558c3a6f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4011930 tx=0x7f5ed4003040 comp rx=0 tx=0).stop 2023-10-08T16:27:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 -- 172.21.15.12:0/784198910 shutdown_connections 2023-10-08T16:27:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c45f0 0x558c3a6f6e30 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a711480 0x558c3a70e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/784198910 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a6c6b80 0x558c3a70e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 -- 172.21.15.12:0/784198910 >> 172.21.15.12:0/784198910 conn(0x558c3a6c80c0 msgr2=0x558c3a6c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 -- 172.21.15.12:0/784198910 shutdown_connections 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.061+0000 7f5ef704fb80 1 -- 172.21.15.12:0/784198910 wait complete. 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.062+0000 7f5ef704fb80 1 -- start start 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.062+0000 7f5ef704fb80 1 Processor -- start 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c45f0 0x558c3a70e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a711480 0x558c3a776520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6c4f40 con 0x558c3a6c6b80 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6ea2b0 con 0x558c3a711480 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x558c3a6ea500 con 0x558c3a6c45f0 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ef704fb80 10 client.0 _ll_register_callbacks cb 0x558c3a68a2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ee1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35582/0 (socket says 172.21.15.12:35582) 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/499665075 learned_addr learned my addr 172.21.15.12:0/499665075 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ee259c700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c45f0 0x558c3a70e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.063+0000 7f5ee2d9d700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a711480 0x558c3a776520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c45f0 msgr2=0x558c3a70e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c45f0 0x558c3a70e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a711480 msgr2=0x558c3a776520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a711480 0x558c3a776520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 -- 172.21.15.12:0/499665075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c3a4b1270 con 0x558c3a6c6b80 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ee1d9b700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80570d0 tx=0x7f5ed8028040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9d1386d26886a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed805a620 con 0x558c3a6c6b80 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5ed805e370 con 0x558c3a6c6b80 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ee4139e00 con 0x558c3a6c6b80 2023-10-08T16:27:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ed8010590 con 0x558c3a6c6b80 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ef704fb80 10 client.7926 fetch_fsmap learned FSMap version 57 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x558c3a5cc470 con 0x558c3a6c6b80 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4139e00 con 0x558c3a6c6b80 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 57) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5ed8057630 con 0x558c3a6c6b80 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.064+0000 7f5ef704fb80 10 client.7926 fetch_fsmap finished waiting for FSMap version 57 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ef704fb80 10 client.7926 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ef704fb80 20 client.7926 populate_metadata read hostname 'smithi012' 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a776fd0 0x558c3a772970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ef704fb80 4 client.7926 mds_command: new command op to 7776 tid=0[{"prefix": "status"}] 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 --> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f5ed4021450 con 0x558c3a776fd0 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ee259c700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a776fd0 0x558c3a772970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ee259c700 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a776fd0 0x558c3a772970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99494094cb3b114 server_cookie=d11da8521fb804b1 in_seq=0 out_seq=0 2023-10-08T16:27:36.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.065+0000 7f5ec0ff9700 10 client.7926 ms_handle_connect on v2:172.21.15.29:6833/4259979226 2023-10-08T16:27:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ec0ff9700 1 -- 172.21.15.12:0/499665075 <== mds.0 v2:172.21.15.29:6833/4259979226 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+320 (crc 0 0 0) 0x7f5ed4021450 con 0x558c3a776fd0 2023-10-08T16:27:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ec0ff9700 10 client.7926 handle_command_reply: tid=0 2023-10-08T16:27:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 client.7926 shutdown 2023-10-08T16:27:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 msgr2=0x558c3a70e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5ed80570d0 tx=0x7f5ed8028040 comp rx=0 tx=0).stop 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 shutdown_connections 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:6833/4259979226,v1:172.21.15.29:6835/4259979226] conn(0x558c3a776fd0 0x558c3a772970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x558c3a711480 0x558c3a776520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x558c3a6c45f0 0x558c3a70e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 --2- 172.21.15.12:0/499665075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x558c3a6c6b80 0x558c3a70e570 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ec0ff9700 0 client.7926 ms_handle_reset on v2:172.21.15.29:6833/4259979226 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 >> 172.21.15.12:0/499665075 conn(0x558c3a6c80c0 msgr2=0x558c3a6f5890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 shutdown_connections 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 1 -- 172.21.15.12:0/499665075 wait complete. 2023-10-08T16:27:36.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.066+0000 7f5ef704fb80 20 client.7926 trim_cache size 0 max 16384 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 7776, 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.708730718, 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 57, 2023-10-08T16:27:36.076 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 129, 2023-10-08T16:27:36.077 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 129, 2023-10-08T16:27:36.077 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.400741402 2023-10-08T16:27:36.077 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 msgr2=0x7f5ec40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 0x7f5ec40694b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ed4009db0 tx=0x7f5ed40091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 msgr2=0x7f5ee413c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4071320 tx=0x7f5ed8016000 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 shutdown_connections 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ec4067000 0x7f5ec40694b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ee413fef0 0x7f5ee4156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ee406aaa0 0x7f5ee4137630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 --2- 172.21.15.12:0/2540283011 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ee413fb20 0x7f5ee413c950 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 >> 172.21.15.12:0/2540283011 conn(0x7f5ee406d170 msgr2=0x7f5ee40cc360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 shutdown_connections 2023-10-08T16:27:36.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.067+0000 7f5ee359e700 1 -- 172.21.15.12:0/2540283011 wait complete. 2023-10-08T16:27:36.085 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:27:36.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.272+0000 7f5a35bff700 1 Processor -- start 2023-10-08T16:27:36.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.272+0000 7f5a35bff700 1 -- start start 2023-10-08T16:27:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a35bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a35bff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 0x7f5a30161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a35bff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a30158210 con 0x7f5a30157600 2023-10-08T16:27:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a35bff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300cb850 con 0x7f5a301579d0 2023-10-08T16:27:36.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a35bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300cb290 con 0x7f5a300b1b20 2023-10-08T16:27:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.273+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:40890/0 (socket says 172.21.15.12:40890) 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 -- 172.21.15.12:0/3464798015 learned_addr learned my addr 172.21.15.12:0/3464798015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/3464798015 >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 0x7f5a30161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 -- 172.21.15.12:0/3464798015 >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 msgr2=0x7f5a30161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 --2- 172.21.15.12:0/3464798015 >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 0x7f5a30161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 -- 172.21.15.12:0/3464798015 >> v1:172.21.15.29:6789/0 conn(0x7f5a30157600 legacy=0x7f5a300b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 -- 172.21.15.12:0/3464798015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300cb570 con 0x7f5a300b1b20 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/3464798015 >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 0x7f5a30161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/3464798015 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480572883 0 0) 0x7f5a30158210 con 0x7f5a30157600 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.274+0000 7f5a2effd700 1 --2- 172.21.15.12:0/3464798015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099b0 tx=0x7f5a24009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=435044e58876a67c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/3464798015 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24009ea0 con 0x7f5a300b1b20 2023-10-08T16:27:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/3464798015 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400b860 con 0x7f5a300b1b20 2023-10-08T16:27:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/3464798015 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400bc00 con 0x7f5a300b1b20 2023-10-08T16:27:36.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 -- 172.21.15.12:0/3464798015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 msgr2=0x7f5a3015f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 --2- 172.21.15.12:0/3464798015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099b0 tx=0x7f5a24009250 comp rx=0 tx=0).stop 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 -- 172.21.15.12:0/3464798015 shutdown_connections 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 --2- 172.21.15.12:0/3464798015 >> v2:172.21.15.29:3300/0 conn(0x7f5a301579d0 0x7f5a30161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 --2- 172.21.15.12:0/3464798015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300b1b20 0x7f5a3015f2b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 -- 172.21.15.12:0/3464798015 >> 172.21.15.12:0/3464798015 conn(0x7f5a3006d170 msgr2=0x7f5a300cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 -- 172.21.15.12:0/3464798015 shutdown_connections 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.275+0000 7f5a35bff700 1 -- 172.21.15.12:0/3464798015 wait complete. 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.277+0000 7f5a35bff700 1 Processor -- start 2023-10-08T16:27:36.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.277+0000 7f5a35bff700 1 -- start start 2023-10-08T16:27:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 0x7f5a300ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a301579d0 0x7f5a3006a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301683d0 con 0x7f5a30157600 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3016af40 con 0x7f5a300b1b20 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a35bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a30167e10 con 0x7f5a301579d0 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a2effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35584/0 (socket says 172.21.15.12:35584) 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a2effd700 1 -- 172.21.15.12:0/2524472937 learned_addr learned my addr 172.21.15.12:0/2524472937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a301579d0 0x7f5a3006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.278+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 0x7f5a300ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 -- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a301579d0 msgr2=0x7f5a3006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a301579d0 0x7f5a3006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 -- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 msgr2=0x7f5a300ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 0x7f5a300ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 -- 172.21.15.12:0/2524472937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a28009a20 con 0x7f5a30157600 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 0x7f5a300ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a2effd700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5a24006fd0 tx=0x7f5a24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400b9d0 con 0x7f5a30157600 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400bb50 con 0x7f5a30157600 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a240094f0 con 0x7f5a30157600 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a24025670 con 0x7f5a30157600 2023-10-08T16:27:36.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.279+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a3016abd0 con 0x7f5a30157600 2023-10-08T16:27:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.280+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3016b0b0 con 0x7f5a30157600 2023-10-08T16:27:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.281+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a24023070 con 0x7f5a30157600 2023-10-08T16:27:36.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.283+0000 7f5a177fe700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.283+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f5a24085c90 con 0x7f5a30157600 2023-10-08T16:27:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.283+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:36.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.283+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 0x7f5a1c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:36.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.287+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a24052cd0 con 0x7f5a30157600 2023-10-08T16:27:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.537+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a3004c3c0 con 0x7f5a30157600 2023-10-08T16:27:36.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.538+0000 7f5a177fe700 1 -- 172.21.15.12:0/2524472937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a240562f0 con 0x7f5a30157600 2023-10-08T16:27:36.539 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:27:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 msgr2=0x7f5a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 0x7f5a1c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5a20007fd0 tx=0x7f5a20009040 comp rx=0 tx=0).stop 2023-10-08T16:27:36.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 msgr2=0x7f5a301674a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f5a24006fd0 tx=0x7f5a24017000 comp rx=0 tx=0).stop 2023-10-08T16:27:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 shutdown_connections 2023-10-08T16:27:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a1c066f30 0x7f5a1c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a301579d0 0x7f5a3006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300b1b20 0x7f5a300ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 --2- 172.21.15.12:0/2524472937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a30157600 0x7f5a301674a0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:36.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 >> 172.21.15.12:0/2524472937 conn(0x7f5a3006d170 msgr2=0x7f5a300cc290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:36.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 shutdown_connections 2023-10-08T16:27:36.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:36.540+0000 7f5a35bff700 1 -- 172.21.15.12:0/2524472937 wait complete. 2023-10-08T16:27:36.558 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:27:36.559 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:27:36.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.560 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:27:36.597 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:27:36.597 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:27:36.597 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:27:36.597 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.597 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41085sec preferred_lft 41085sec 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:27:36.598 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:27:36.599 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:27:36.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.601 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:27:36.697 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:27:36.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.700 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:27:36.739 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:27:36.740 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:27:36.740 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:27:36.740 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:27:36.740 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:27:36.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:27:36.741 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:27:36.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.941 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:27:36.977 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:27:36.978 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:27:36.978 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:27:36.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:36.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:27:37.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:27:37.081 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:27:37.117 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:27:37.118 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:27:37.118 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:27:37.193 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:27:37.194 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:27:37.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:27:37.326 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:27:37.326 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:27:37.356 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:27:37.356 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:27:37.356 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:27:37.356 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:27:37.356 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:27:37.361 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:27:37.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:27:37.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:27:37.427 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:27:37.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.615+0000 7ff47999d700 1 Processor -- start 2023-10-08T16:27:37.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.615+0000 7ff47999d700 1 -- start start 2023-10-08T16:27:37.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.616+0000 7ff47999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47999d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47415ae70 con 0x7ff47406aaa0 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff47406af60 con 0x7ff47413fef0 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47406b240 con 0x7ff47413fb20 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47919c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff47406aaa0 0x7ff4740c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60268/0 (socket says 172.21.15.12:60268) 2023-10-08T16:27:37.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47919c700 1 -- 172.21.15.12:0/999096061 learned_addr learned my addr 172.21.15.12:0/999096061 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47899b700 1 -- 172.21.15.12:0/999096061 >> v1:172.21.15.29:6789/0 conn(0x7ff47413fef0 legacy=0x7ff4740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47899b700 1 -- 172.21.15.12:0/999096061 >> v1:172.21.15.12:6789/0 conn(0x7ff47406aaa0 legacy=0x7ff4740c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff47899b700 1 -- 172.21.15.12:0/999096061 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47406b520 con 0x7ff47413fb20 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.617+0000 7ff4737fe700 1 -- 172.21.15.12:0/999096061 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730442355 0 0) 0x7ff46c001490 con 0x7ff47406aaa0 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.618+0000 7ff47899b700 1 --2- 172.21.15.12:0/999096061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d63a974de8730cd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.618+0000 7ff4737fe700 1 -- 172.21.15.12:0/999096061 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468009e80 con 0x7ff47413fb20 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.618+0000 7ff4737fe700 1 -- 172.21.15.12:0/999096061 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46800b860 con 0x7ff47413fb20 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.618+0000 7ff4737fe700 1 -- 172.21.15.12:0/999096061 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bbe0 con 0x7ff47413fb20 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 -- 172.21.15.12:0/999096061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 msgr2=0x7ff47415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 --2- 172.21.15.12:0/999096061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7ff4680098e0 tx=0x7ff4680091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 -- 172.21.15.12:0/999096061 shutdown_connections 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 --2- 172.21.15.12:0/999096061 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47413fb20 0x7ff47415a930 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 -- 172.21.15.12:0/999096061 >> 172.21.15.12:0/999096061 conn(0x7ff47406d170 msgr2=0x7ff4740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 -- 172.21.15.12:0/999096061 shutdown_connections 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.619+0000 7ff47999d700 1 -- 172.21.15.12:0/999096061 wait complete. 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.620+0000 7ff47999d700 1 Processor -- start 2023-10-08T16:27:37.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.620+0000 7ff47999d700 1 -- start start 2023-10-08T16:27:37.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 0x7ff474159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474159880 con 0x7ff47406aaa0 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740ae4f0 con 0x7ff47413fef0 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.621+0000 7ff47999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740ad450 con 0x7ff47413fb20 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35596/0 (socket says 172.21.15.12:35596) 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 -- 172.21.15.12:0/3884535090 learned_addr learned my addr 172.21.15.12:0/3884535090 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff473fff700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 0x7ff474159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:37.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 -- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 msgr2=0x7ff474159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 0x7ff474159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47919c700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 -- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 msgr2=0x7ff4740b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740b0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 -- 172.21.15.12:0/3884535090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468009420 con 0x7ff47406aaa0 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff473fff700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 0x7ff474159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47919c700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff47899b700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff474071320 tx=0x7ff468017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.622+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46801f070 con 0x7ff47406aaa0 2023-10-08T16:27:37.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.623+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468011420 con 0x7ff47406aaa0 2023-10-08T16:27:37.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.623+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4740ad730 con 0x7ff47406aaa0 2023-10-08T16:27:37.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.623+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46800bbe0 con 0x7ff47406aaa0 2023-10-08T16:27:37.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.623+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740adcf0 con 0x7ff47406aaa0 2023-10-08T16:27:37.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.624+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47404c3c0 con 0x7ff47406aaa0 2023-10-08T16:27:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.625+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff468011a50 con 0x7ff47406aaa0 2023-10-08T16:27:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.625+0000 7ff470ff9700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.626+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7ff468085e60 con 0x7ff47406aaa0 2023-10-08T16:27:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.626+0000 7ff473fff700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:37.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.626+0000 7ff473fff700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff47406f230 tx=0x7ff460009040 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:37.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.630+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff468052ea0 con 0x7ff47406aaa0 2023-10-08T16:27:37.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.862+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ff47406b800 con 0x7ff458066f30 2023-10-08T16:27:37.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.864+0000 7ff470ff9700 1 -- 172.21.15.12:0/3884535090 <== mgr.7255 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff47406b800 con 0x7ff458066f30 2023-10-08T16:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:27:37.865 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:27:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 msgr2=0x7ff4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff47406f230 tx=0x7ff460009040 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 msgr2=0x7ff4740ace00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7ff474071320 tx=0x7ff468017000 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 shutdown_connections 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff458066f30 0x7ff4580693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff47406aaa0 0x7ff4740ace00 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff47413fef0 0x7ff4740b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 --2- 172.21.15.12:0/3884535090 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff47413fb20 0x7ff474159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 >> 172.21.15.12:0/3884535090 conn(0x7ff47406d170 msgr2=0x7ff47413eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 shutdown_connections 2023-10-08T16:27:37.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:37.866+0000 7ff47999d700 1 -- 172.21.15.12:0/3884535090 wait complete. 2023-10-08T16:27:37.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:27:38.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.074+0000 7f111199d700 1 Processor -- start 2023-10-08T16:27:38.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.074+0000 7f111199d700 1 -- start start 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.075+0000 7f111199d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f110c153c90 0x7f110c15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.075+0000 7f111199d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f110c0caec0 0x7f110c15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.075+0000 7f111199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c15ada0 con 0x7f110c06db20 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.075+0000 7f111199d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c06ca80 con 0x7f110c153c90 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.075+0000 7f111199d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c06cd60 con 0x7f110c0caec0 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f110c153c90 0x7f110c15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f110c153c90 0x7f110c15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35604/0 (socket says 172.21.15.12:35604) 2023-10-08T16:27:38.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 -- 172.21.15.12:0/3550321831 learned_addr learned my addr 172.21.15.12:0/3550321831 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f110bfff700 1 --1- 172.21.15.12:0/3550321831 >> v1:172.21.15.12:6789/0 conn(0x7f110c06db20 0x7f110c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60282/0 (socket says 172.21.15.12:60282) 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111119c700 1 --2- 172.21.15.12:0/3550321831 >> v2:172.21.15.29:3300/0 conn(0x7f110c0caec0 0x7f110c15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 -- 172.21.15.12:0/3550321831 >> v2:172.21.15.29:3300/0 conn(0x7f110c0caec0 msgr2=0x7f110c15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 --2- 172.21.15.12:0/3550321831 >> v2:172.21.15.29:3300/0 conn(0x7f110c0caec0 0x7f110c15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 -- 172.21.15.12:0/3550321831 >> v1:172.21.15.12:6789/0 conn(0x7f110c06db20 legacy=0x7f110c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 -- 172.21.15.12:0/3550321831 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c06d040 con 0x7f110c153c90 2023-10-08T16:27:38.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.076+0000 7f111099b700 1 --2- 172.21.15.12:0/3550321831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c15a860 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cba60 tx=0x7f1100009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ae3da8dbee6256 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:38.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f110b7fe700 1 -- 172.21.15.12:0/3550321831 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000b860 con 0x7f110c153c90 2023-10-08T16:27:38.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f110b7fe700 1 -- 172.21.15.12:0/3550321831 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110000b9c0 con 0x7f110c153c90 2023-10-08T16:27:38.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f110b7fe700 1 -- 172.21.15.12:0/3550321831 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110000bd60 con 0x7f110c153c90 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 -- 172.21.15.12:0/3550321831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 msgr2=0x7f110c15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 --2- 172.21.15.12:0/3550321831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c15a860 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cba60 tx=0x7f1100009250 comp rx=0 tx=0).stop 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 -- 172.21.15.12:0/3550321831 shutdown_connections 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 --2- 172.21.15.12:0/3550321831 >> v2:172.21.15.29:3300/0 conn(0x7f110c0caec0 0x7f110c15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 --2- 172.21.15.12:0/3550321831 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c15a860 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.077+0000 7f111199d700 1 -- 172.21.15.12:0/3550321831 >> 172.21.15.12:0/3550321831 conn(0x7f110c06e720 msgr2=0x7f110c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.078+0000 7f111199d700 1 -- 172.21.15.12:0/3550321831 shutdown_connections 2023-10-08T16:27:38.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.078+0000 7f111199d700 1 -- 172.21.15.12:0/3550321831 wait complete. 2023-10-08T16:27:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.079+0000 7f111199d700 1 Processor -- start 2023-10-08T16:27:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.079+0000 7f111199d700 1 -- start start 2023-10-08T16:27:38.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f110c06db20 0x7f110c0b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f110c0caec0 0x7f110c0c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c49d0 con 0x7f110c153c90 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c5c80 con 0x7f110c06db20 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c0c57f0 con 0x7f110c0caec0 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111119c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35610/0 (socket says 172.21.15.12:35610) 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111119c700 1 -- 172.21.15.12:0/1545282103 learned_addr learned my addr 172.21.15.12:0/1545282103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f111099b700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f110c06db20 0x7f110c0b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.080+0000 7f110bfff700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f110c0caec0 0x7f110c0c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 -- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f110c0caec0 msgr2=0x7f110c0c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f110c0caec0 0x7f110c0c4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 -- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f110c06db20 msgr2=0x7f110c0b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f110c06db20 0x7f110c0b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 -- 172.21.15.12:0/1545282103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000094f0 con 0x7f110c153c90 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111119c700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1104007f60 tx=0x7f11040098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400eb90 con 0x7f110c153c90 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400ecf0 con 0x7f110c153c90 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c0c4be0 con 0x7f110c153c90 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.081+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104014670 con 0x7f110c153c90 2023-10-08T16:27:38.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.082+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0c51a0 con 0x7f110c153c90 2023-10-08T16:27:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.082+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c0c5980 con 0x7f110c153c90 2023-10-08T16:27:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.083+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 52) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1104014a60 con 0x7f110c153c90 2023-10-08T16:27:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.084+0000 7f1108ff9700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 0x7f10f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.084+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f1104084db0 con 0x7f110c153c90 2023-10-08T16:27:38.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.084+0000 7f111099b700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 0x7f10f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.085+0000 7f111099b700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 0x7f10f00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cba60 tx=0x7f1100017000 comp rx=0 tx=0).ready entity=mgr.7255 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:38.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.088+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1104089070 con 0x7f110c153c90 2023-10-08T16:27:38.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.348+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f110c04c3c0 con 0x7f110c153c90 2023-10-08T16:27:38.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.411+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 53) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1104012dc0 con 0x7f110c153c90 2023-10-08T16:27:38.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.412+0000 7f1108ff9700 1 -- 172.21.15.12:0/1545282103 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v53) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1104051df0 con 0x7f110c153c90 2023-10-08T16:27:38.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 msgr2=0x7f10f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 0x7f10f00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f110c0cba60 tx=0x7f1100017000 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 msgr2=0x7f110c152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f1104007f60 tx=0x7f11040098e0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 shutdown_connections 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f10f0066f30 0x7f10f00693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f110c153c90 0x7f110c152780 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f110c06db20 0x7f110c0b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 --2- 172.21.15.12:0/1545282103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f110c0caec0 0x7f110c0c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.415+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 >> 172.21.15.12:0/1545282103 conn(0x7f110c06e720 msgr2=0x7f110c0c1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.416+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 shutdown_connections 2023-10-08T16:27:38.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.416+0000 7f111199d700 1 -- 172.21.15.12:0/1545282103 wait complete. 2023-10-08T16:27:38.441 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:27:38.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.635+0000 7f723899d700 1 Processor -- start 2023-10-08T16:27:38.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.635+0000 7f723899d700 1 -- start start 2023-10-08T16:27:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.636+0000 7f723899d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7234153a00 0x7f7234153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.636+0000 7f723899d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f72340cea00 0x7f72340cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f723899d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723415ac50 con 0x7f723415de50 2023-10-08T16:27:38.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f723899d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723415d010 con 0x7f7234153a00 2023-10-08T16:27:38.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f723899d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72340cf3c0 con 0x7f72340cea00 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f7232ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f723415de50 0x7f723415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60310/0 (socket says 172.21.15.12:60310) 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f72337fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7234153a00 0x7f7234153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f7232ffd700 1 -- 172.21.15.12:0/2781393118 learned_addr learned my addr 172.21.15.12:0/2781393118 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f7233fff700 1 --2- 172.21.15.12:0/2781393118 >> v2:172.21.15.29:3300/0 conn(0x7f72340cea00 0x7f72340cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f72337fe700 1 -- 172.21.15.12:0/2781393118 >> v2:172.21.15.29:3300/0 conn(0x7f72340cea00 msgr2=0x7f72340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f72337fe700 1 --2- 172.21.15.12:0/2781393118 >> v2:172.21.15.29:3300/0 conn(0x7f72340cea00 0x7f72340cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f72337fe700 1 -- 172.21.15.12:0/2781393118 >> v1:172.21.15.12:6789/0 conn(0x7f723415de50 legacy=0x7f723415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.637+0000 7f72337fe700 1 -- 172.21.15.12:0/2781393118 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723415af60 con 0x7f7234153a00 2023-10-08T16:27:38.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.638+0000 7f72337fe700 1 --2- 172.21.15.12:0/2781393118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7234153a00 0x7f7234153dd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f72340d03e0 tx=0x7f72240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f34d7a38fa1b042 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.638+0000 7f72327fc700 1 -- 172.21.15.12:0/2781393118 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224011630 con 0x7f7234153a00 2023-10-08T16:27:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.638+0000 7f72327fc700 1 -- 172.21.15.12:0/2781393118 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224011790 con 0x7f7234153a00 2023-10-08T16:27:38.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.638+0000 7f72327fc700 1 -- 172.21.15.12:0/2781393118 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224011b30 con 0x7f7234153a00 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 -- 172.21.15.12:0/2781393118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7234153a00 msgr2=0x7f7234153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 --2- 172.21.15.12:0/2781393118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7234153a00 0x7f7234153dd0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f72340d03e0 tx=0x7f72240091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 -- 172.21.15.12:0/2781393118 shutdown_connections 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 --2- 172.21.15.12:0/2781393118 >> v2:172.21.15.29:3300/0 conn(0x7f72340cea00 0x7f72340cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 --2- 172.21.15.12:0/2781393118 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7234153a00 0x7f7234153dd0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 -- 172.21.15.12:0/2781393118 >> 172.21.15.12:0/2781393118 conn(0x7f72340703a0 msgr2=0x7f72340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 -- 172.21.15.12:0/2781393118 shutdown_connections 2023-10-08T16:27:38.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.639+0000 7f723899d700 1 -- 172.21.15.12:0/2781393118 wait complete. 2023-10-08T16:27:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.640+0000 7f723899d700 1 Processor -- start 2023-10-08T16:27:38.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.640+0000 7f723899d700 1 -- start start 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 0x7f723416a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 0x7f72340cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723416a540 con 0x7f723415de50 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72340ca400 con 0x7f7234153a00 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.641+0000 7f723899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72340c9e40 con 0x7f72340cea00 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f7232ffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 0x7f723416a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:40956/0 (socket says 172.21.15.12:40956) 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 -- 172.21.15.12:0/3840132015 learned_addr learned my addr 172.21.15.12:0/3840132015 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f7233fff700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 0x7f72340cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 msgr2=0x7f723416a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 0x7f723416a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 msgr2=0x7f72340cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 0x7f72340cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f72337fe700 1 -- 172.21.15.12:0/3840132015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7224009420 con 0x7f72340cea00 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f7232ffd700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 0x7f723416a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.642+0000 7f7233fff700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 0x7f72340cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f72337fe700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f723406eb00 tx=0x7f7224017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224000d10 con 0x7f72340cea00 2023-10-08T16:27:38.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7224011b10 con 0x7f72340cea00 2023-10-08T16:27:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72340ca120 con 0x7f72340cea00 2023-10-08T16:27:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7224023660 con 0x7f72340cea00 2023-10-08T16:27:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.643+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72340cc4f0 con 0x7f72340cea00 2023-10-08T16:27:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.644+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723404c3c0 con 0x7f72340cea00 2023-10-08T16:27:38.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.645+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 53) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f72240193b0 con 0x7f72340cea00 2023-10-08T16:27:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.646+0000 7f721b7fe700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 0x7f7220069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.646+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f7224085be0 con 0x7f72340cea00 2023-10-08T16:27:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.646+0000 7f7232ffd700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 msgr2=0x7f7220069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:38.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.646+0000 7f7232ffd700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 0x7f7220069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:38.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.651+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7224052ca0 con 0x7f72340cea00 2023-10-08T16:27:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.847+0000 7f7232ffd700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 msgr2=0x7f7220069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:38.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.847+0000 7f7232ffd700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 0x7f7220069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:38.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.855+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7234152610 con 0x7f72340cea00 2023-10-08T16:27:38.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.861+0000 7f721b7fe700 1 -- 172.21.15.12:0/3840132015 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f72240280d0 con 0x7f72340cea00 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 msgr2=0x7f7220069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 0x7f7220069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 msgr2=0x7f7234151ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f723406eb00 tx=0x7f7224017000 comp rx=0 tx=0).stop 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 shutdown_connections 2023-10-08T16:27:38.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7220066f80 0x7f7220069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f723415de50 0x7f72340cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f72340cea00 0x7f7234151ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 --2- 172.21.15.12:0/3840132015 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7234153a00 0x7f723416a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 >> 172.21.15.12:0/3840132015 conn(0x7f72340703a0 msgr2=0x7f723415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 shutdown_connections 2023-10-08T16:27:38.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:38.864+0000 7f723899d700 1 -- 172.21.15.12:0/3840132015 wait complete. 2023-10-08T16:27:38.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:27:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.074+0000 7f8f3db9d700 1 Processor -- start 2023-10-08T16:27:39.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.074+0000 7f8f3db9d700 1 -- start start 2023-10-08T16:27:39.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.075+0000 7f8f3db9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8f38153dd0 0x7f8f3815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.075+0000 7f8f3db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 0x7f8f380ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3db9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3815ac50 con 0x7f8f38153a00 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3db9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3815d010 con 0x7f8f38153dd0 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cf3e0 con 0x7f8f380cea00 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3cb9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8f38153a00 0x7f8f3815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60312/0 (socket says 172.21.15.12:60312) 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3cb9b700 1 -- 172.21.15.12:0/1419444794 learned_addr learned my addr 172.21.15.12:0/1419444794 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f3d39c700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 0x7f8f380ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f37fff700 1 --2- 172.21.15.12:0/1419444794 >> v2:172.21.15.29:3300/0 conn(0x7f8f38153dd0 0x7f8f3815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f377fe700 1 -- 172.21.15.12:0/1419444794 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208657045 0 0) 0x7f8f3815ac50 con 0x7f8f38153a00 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f377fe700 1 -- 172.21.15.12:0/1419444794 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f28003570 con 0x7f8f38153a00 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f37fff700 1 -- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 msgr2=0x7f8f380ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.076+0000 7f8f37fff700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 0x7f8f380ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f37fff700 1 -- 172.21.15.12:0/1419444794 >> v1:172.21.15.12:6789/0 conn(0x7f8f38153a00 legacy=0x7f8f3815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f37fff700 1 -- 172.21.15.12:0/1419444794 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3815af60 con 0x7f8f38153dd0 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f3d39c700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 0x7f8f380ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f37fff700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38153dd0 0x7f8f3815de50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8f240098e0 tx=0x7f8f240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=900eeebb487d5403 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:39.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f377fe700 1 -- 172.21.15.12:0/1419444794 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011630 con 0x7f8f38153dd0 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f377fe700 1 -- 172.21.15.12:0/1419444794 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24011790 con 0x7f8f38153dd0 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.077+0000 7f8f377fe700 1 -- 172.21.15.12:0/1419444794 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011b30 con 0x7f8f38153dd0 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 -- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38153dd0 msgr2=0x7f8f3815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38153dd0 0x7f8f3815de50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8f240098e0 tx=0x7f8f240091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 -- 172.21.15.12:0/1419444794 shutdown_connections 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f380cea00 0x7f8f380ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/1419444794 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f38153dd0 0x7f8f3815de50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 -- 172.21.15.12:0/1419444794 >> 172.21.15.12:0/1419444794 conn(0x7f8f380703a0 msgr2=0x7f8f380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 -- 172.21.15.12:0/1419444794 shutdown_connections 2023-10-08T16:27:39.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.078+0000 7f8f3db9d700 1 -- 172.21.15.12:0/1419444794 wait complete. 2023-10-08T16:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.079+0000 7f8f3db9d700 1 Processor -- start 2023-10-08T16:27:39.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.079+0000 7f8f3db9d700 1 -- start start 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f380cea00 0x7f8f38156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f38153dd0 0x7f8f380c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f381570a0 con 0x7f8f38153a00 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cb850 con 0x7f8f380cea00 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.080+0000 7f8f3db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380ca3a0 con 0x7f8f38153dd0 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35652/0 (socket says 172.21.15.12:35652) 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 -- 172.21.15.12:0/777093184 learned_addr learned my addr 172.21.15.12:0/777093184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f3cb9b700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f380cea00 0x7f8f38156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f3d39c700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f38153dd0 0x7f8f380c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f38153dd0 msgr2=0x7f8f380c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f38153dd0 0x7f8f380c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f380cea00 msgr2=0x7f8f38156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f380cea00 0x7f8f38156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 -- 172.21.15.12:0/777093184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009a20 con 0x7f8f38153a00 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.081+0000 7f8f37fff700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8f24013000 tx=0x7f8f24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.082+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24011900 con 0x7f8f38153a00 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.082+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f24011a60 con 0x7f8f38153a00 2023-10-08T16:27:39.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.082+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f24009420 con 0x7f8f38153a00 2023-10-08T16:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.082+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2401a680 con 0x7f8f38153a00 2023-10-08T16:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.082+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380cb240 con 0x7f8f38153a00 2023-10-08T16:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.083+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380cb9e0 con 0x7f8f38153a00 2023-10-08T16:27:39.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.084+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 53) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f8f2401aa30 con 0x7f8f38153a00 2023-10-08T16:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.085+0000 7f8f34ff9700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 0x7f8f1c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.085+0000 7f8f3cb9b700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 msgr2=0x7f8f1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.085+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f8f24086230 con 0x7f8f38153a00 2023-10-08T16:27:39.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.085+0000 7f8f3cb9b700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 0x7f8f1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:39.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.093+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f24053330 con 0x7f8f38153a00 2023-10-08T16:27:39.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.286+0000 7f8f3cb9b700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 msgr2=0x7f8f1c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.286+0000 7f8f3cb9b700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 0x7f8f1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:39.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.300+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f8f3804c3c0 con 0x7f8f38153a00 2023-10-08T16:27:39.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.306+0000 7f8f34ff9700 1 -- 172.21.15.12:0/777093184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8f24056950 con 0x7f8f38153a00 2023-10-08T16:27:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 msgr2=0x7f8f1c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 0x7f8f1c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 msgr2=0x7f8f380c9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f8f24013000 tx=0x7f8f24017000 comp rx=0 tx=0).stop 2023-10-08T16:27:39.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 shutdown_connections 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f1c066f80 0x7f8f1c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f38153dd0 0x7f8f380c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f380cea00 0x7f8f38156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 --2- 172.21.15.12:0/777093184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f38153a00 0x7f8f380c9920 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 >> 172.21.15.12:0/777093184 conn(0x7f8f380703a0 msgr2=0x7f8f38152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 shutdown_connections 2023-10-08T16:27:39.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.308+0000 7f8f3db9d700 1 -- 172.21.15.12:0/777093184 wait complete. 2023-10-08T16:27:39.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:39.327 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T16:27:39.369 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-08T16:27:39.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.603+0000 7f55fb59e700 1 Processor -- start 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.603+0000 7f55fb59e700 1 -- start start 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fb59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55fc0b24f0 0x7f55fc0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fb59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55fc0b1d40 0x7f55fc1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fb59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55fc0b0c80 con 0x7f55fc0b28c0 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fb59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0d10d0 con 0x7f55fc0b24f0 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fb59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0b0f60 con 0x7f55fc0b1d40 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f55fc0b28c0 0x7f55fc15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:60328/0 (socket says 172.21.15.12:60328) 2023-10-08T16:27:39.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fad9d700 1 -- 172.21.15.12:0/2666791233 learned_addr learned my addr 172.21.15.12:0/2666791233 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.604+0000 7f55fa59c700 1 --2- 172.21.15.12:0/2666791233 >> v2:172.21.15.12:3300/0 conn(0x7f55fc0b24f0 0x7f55fc0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/2666791233 >> v2:172.21.15.29:3300/0 conn(0x7f55fc0b1d40 0x7f55fc1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f959a700 1 -- 172.21.15.12:0/2666791233 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2325913533 0 0) 0x7f55fc0b0c80 con 0x7f55fc0b28c0 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f959a700 1 -- 172.21.15.12:0/2666791233 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55e4003570 con 0x7f55fc0b28c0 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 -- 172.21.15.12:0/2666791233 >> v2:172.21.15.12:3300/0 conn(0x7f55fc0b24f0 msgr2=0x7f55fc0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/2666791233 >> v2:172.21.15.12:3300/0 conn(0x7f55fc0b24f0 0x7f55fc0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 -- 172.21.15.12:0/2666791233 >> v1:172.21.15.12:6789/0 conn(0x7f55fc0b28c0 legacy=0x7f55fc15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 -- 172.21.15.12:0/2666791233 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0b1240 con 0x7f55fc0b1d40 2023-10-08T16:27:39.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.605+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/2666791233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc1590f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55fc15d1a0 tx=0x7f55f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879cff2309f2ffc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55f959a700 1 -- 172.21.15.12:0/2666791233 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0011630 con 0x7f55fc0b1d40 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55f959a700 1 -- 172.21.15.12:0/2666791233 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f00117b0 con 0x7f55fc0b1d40 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55f959a700 1 -- 172.21.15.12:0/2666791233 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0011b30 con 0x7f55fc0b1d40 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 -- 172.21.15.12:0/2666791233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 msgr2=0x7f55fc1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 --2- 172.21.15.12:0/2666791233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc1590f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f55fc15d1a0 tx=0x7f55f00091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 -- 172.21.15.12:0/2666791233 shutdown_connections 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 --2- 172.21.15.12:0/2666791233 >> v2:172.21.15.12:3300/0 conn(0x7f55fc0b24f0 0x7f55fc0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 --2- 172.21.15.12:0/2666791233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc1590f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 -- 172.21.15.12:0/2666791233 >> 172.21.15.12:0/2666791233 conn(0x7f55fc0703a0 msgr2=0x7f55fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:39.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 -- 172.21.15.12:0/2666791233 shutdown_connections 2023-10-08T16:27:39.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.606+0000 7f55fb59e700 1 -- 172.21.15.12:0/2666791233 wait complete. 2023-10-08T16:27:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.608+0000 7f55fb59e700 1 Processor -- start 2023-10-08T16:27:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.608+0000 7f55fb59e700 1 -- start start 2023-10-08T16:27:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55fc0b28c0 0x7f55fc157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc16b190 con 0x7f55fc0b24f0 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0af860 con 0x7f55fc0b1d40 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fb59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc16a580 con 0x7f55fc0b28c0 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fa59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:35672/0 (socket says 172.21.15.12:35672) 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 learned_addr learned my addr 172.21.15.12:0/3229332430 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.609+0000 7f55fad9d700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55fc0b28c0 0x7f55fc157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55fc0b28c0 msgr2=0x7f55fc157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55fc0b28c0 0x7f55fc157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 msgr2=0x7f55fc1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0009420 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fa59c700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc15bea0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ea50 tx=0x7f55ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00ee90 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec00c7f0 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc16a860 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00cb90 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.610+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc16ae20 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.611+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc04c3c0 con 0x7f55fc0b1d40 2023-10-08T16:27:39.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.612+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 53) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f55ec013470 con 0x7f55fc0b1d40 2023-10-08T16:27:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.613+0000 7f55ea7fc700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.614+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f55ec084980 con 0x7f55fc0b1d40 2023-10-08T16:27:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.614+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:39.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.614+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:27:39.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.618+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55ec0519c0 con 0x7f55fc0b1d40 2023-10-08T16:27:39.756 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:39.755+0000 7f05effaa180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:27:39.780 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:39.779+0000 7fb59bead180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:27:39.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.815+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:39.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.815+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:27:39.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:39.846+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f55fc15cce0 con 0x7f55dc066f80 2023-10-08T16:27:39.929 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:39.928+0000 7f05effaa180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:39.951 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:39.950+0000 7fb59bead180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:40.019 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.018+0000 7f05effaa180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:27:40.040 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.039+0000 7fb59bead180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:27:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:40.216+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:40.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:40.216+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:27:40.252 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.251+0000 7f05effaa180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:40.272 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.271+0000 7fb59bead180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:40.439 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.438+0000 7f05effaa180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:27:40.456 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.455+0000 7fb59bead180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:27:40.536 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.535+0000 7f05effaa180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:27:40.551 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.551+0000 7fb59bead180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:27:40.704 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.702+0000 7f05effaa180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:27:40.718 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.717+0000 7fb59bead180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:27:40.809 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:40.808+0000 7f05effaa180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:40.822 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:40.821+0000 7fb59bead180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:27:41.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:41.017+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:41.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:41.017+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:27:41.318 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:41.317+0000 7f05effaa180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:27:41.325 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:41.325+0000 7fb59bead180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:27:41.417 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:41.416+0000 7f05effaa180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:27:41.423 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:41.422+0000 7fb59bead180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:27:41.512 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:41.511+0000 7f05effaa180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:27:41.518 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:41.517+0000 7fb59bead180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:27:42.166 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:42.165+0000 7fb59bead180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:27:42.166 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:42.166+0000 7f05effaa180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:27:42.345 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:42.344+0000 7fb59bead180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:42.346 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:42.346+0000 7f05effaa180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:27:42.444 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:42.443+0000 7fb59bead180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:27:42.447 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:42.447+0000 7f05effaa180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:27:42.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:42.619+0000 7f55f9d9b700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:27:42.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:42.619+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:27:42.746 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:42.745+0000 7fb59bead180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:27:42.750 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:42.750+0000 7f05effaa180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:27:42.846 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:42.845+0000 7fb59bead180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:27:42.851 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:42.850+0000 7f05effaa180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:27:43.580 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:43.580+0000 7fb59bead180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:27:43.597 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:43.596+0000 7f05effaa180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:27:43.872 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:43.872+0000 7fb59bead180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:27:43.889 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:43.888+0000 7f05effaa180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:27:43.969 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:43.968+0000 7fb59bead180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:27:43.987 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:43.986+0000 7f05effaa180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:27:44.129 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.129+0000 7fb59bead180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:27:44.149 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.148+0000 7f05effaa180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:27:44.238 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.238+0000 7fb59bead180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:27:44.258 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.258+0000 7f05effaa180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:27:44.437 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.436+0000 7fb59bead180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:27:44.458 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.457+0000 7f05effaa180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:27:44.535 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.533+0000 7fb59bead180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:27:44.557 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.556+0000 7f05effaa180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:27:44.630 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.629+0000 7fb59bead180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:27:44.653 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.652+0000 7f05effaa180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:27:44.729 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.726+0000 7fb59bead180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:27:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:44.736+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 54) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f55ec051d90 con 0x7f55fc0b1d40 2023-10-08T16:27:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:44.736+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:27:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:44.736+0000 7f55ea7fc700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:44.756 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:27:44.755+0000 7f05effaa180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:27:44.859 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb5109f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.860 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb5109f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.860 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb5109f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.860 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb5109f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.860 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb5109f6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.860 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb50e1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.861 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb50e1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.861 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb50e1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.861 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb50e1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:44.861 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:27:44.859+0000 7fb50e1f1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:27:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.741+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mon.1 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 55) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f55ec05ff40 con 0x7f55fc0b1d40 2023-10-08T16:27:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.742+0000 7f55ea7fc700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.742+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f55fc15cce0 con 0x7f55dc066f80 2023-10-08T16:27:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.745+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:45.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.748+0000 7f55f9d9b700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc0693b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55fc158620 tx=0x7f55f0017000 comp rx=0 tx=0).ready entity=mgr.7965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:45.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.813+0000 7f55ea7fc700 1 -- 172.21.15.12:0/3229332430 <== mgr.7965 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f55fc15cce0 con 0x7f55dc066f80 2023-10-08T16:27:45.815 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T16:27:45.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.815+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 msgr2=0x7f55dc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.815+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc0693b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f55fc158620 tx=0x7f55f0017000 comp rx=0 tx=0).stop 2023-10-08T16:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 msgr2=0x7f55fc15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc15bea0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00ea50 tx=0x7f55ec0091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 shutdown_connections 2023-10-08T16:27:45.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f55dc066f80 0x7f55dc0693b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55fc0b28c0 0x7f55fc157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55fc0b1d40 0x7f55fc15bea0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 --2- 172.21.15.12:0/3229332430 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55fc0b24f0 0x7f55fc1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 >> 172.21.15.12:0/3229332430 conn(0x7f55fc0703a0 msgr2=0x7f55fc154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 shutdown_connections 2023-10-08T16:27:45.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:45.816+0000 7f55fb59e700 1 -- 172.21.15.12:0/3229332430 wait complete. 2023-10-08T16:27:45.836 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T16:27:45.836 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-08-16_28_00 in ~15s... 2023-10-08T16:27:45.836 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-08T16:27:45.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-08T16:27:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.030+0000 7fa941d9d700 1 Processor -- start 2023-10-08T16:27:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.030+0000 7fa941d9d700 1 -- start start 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa941d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa93c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa941d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa93c0c85d0 0x7fa93c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa941d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c1571b0 con 0x7fa93c0c2a90 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa941d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c1579b0 con 0x7fa93c0c85d0 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa941d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0c1390 con 0x7fa93c0c8200 2023-10-08T16:27:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa93bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa93c0c2a90 0x7fa93c156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35612/0 (socket says 172.21.15.12:35612) 2023-10-08T16:27:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.031+0000 7fa93bfff700 1 -- 172.21.15.12:0/186252816 learned_addr learned my addr 172.21.15.12:0/186252816 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:27:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa940d9b700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa93c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa94159c700 1 --2- 172.21.15.12:0/186252816 >> v2:172.21.15.29:3300/0 conn(0x7fa93c0c85d0 0x7fa93c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56748756 0 0) 0x7fa928001110 con 0x7fa93c0c2a90 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa92c003570 con 0x7fa93c0c2a90 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716197720 0 0) 0x7fa92c003570 con 0x7fa93c0c2a90 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 msgr2=0x7fa93c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa93c0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 >> v2:172.21.15.29:3300/0 conn(0x7fa93c0c85d0 msgr2=0x7fa93c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 --2- 172.21.15.12:0/186252816 >> v2:172.21.15.29:3300/0 conn(0x7fa93c0c85d0 0x7fa93c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c1573f0 con 0x7fa93c0c2a90 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fa928001600 con 0x7fa93c0c2a90 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 >> v1:172.21.15.12:6789/0 conn(0x7fa93c0c2a90 legacy=0x7fa93c156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c003a60 0x7fa92c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa92c004810 0x7fa92c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa92c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1579b0 con 0x7fa92c004810 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0c1390 con 0x7fa92c003a60 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.032+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92c00dc70 con 0x7fa93c0c8200 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa92c004810 0x7fa92c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa940d9b700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c003a60 0x7fa92c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa94159c700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa92c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 -- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 msgr2=0x7fa92c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0c8200 0x7fa92c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 -- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c003a60 msgr2=0x7fa92c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:27:46.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c003a60 0x7fa92c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 -- 172.21.15.12:0/186252816 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92c003570 con 0x7fa92c004810 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.033+0000 7fa93bfff700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa92c004810 0x7fa92c004c80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c620 tx=0x7fa93c157af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=740801b2233052b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92800cde0 con 0x7fa92c004810 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928005920 con 0x7fa92c004810 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa93b7fe700 1 -- 172.21.15.12:0/186252816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928005ce0 con 0x7fa92c004810 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 -- 172.21.15.12:0/186252816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa92c004810 msgr2=0x7fa92c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 --2- 172.21.15.12:0/186252816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa92c004810 0x7fa92c004c80 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fa92800c620 tx=0x7fa93c157af0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa94159c700 1 -- 172.21.15.12:0/186252816 reap_dead start 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 -- 172.21.15.12:0/186252816 shutdown_connections 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 -- 172.21.15.12:0/186252816 >> 172.21.15.12:0/186252816 conn(0x7fa93c06c6a0 msgr2=0x7fa93c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 -- 172.21.15.12:0/186252816 shutdown_connections 2023-10-08T16:27:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.034+0000 7fa941d9d700 1 -- 172.21.15.12:0/186252816 wait complete. 2023-10-08T16:27:46.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.036+0000 7fa941d9d700 1 Processor -- start 2023-10-08T16:27:46.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.036+0000 7fa941d9d700 1 -- start start 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c004810 0x7fa93c13cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0cb6c0 0x7fa93c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c13d160 con 0x7fa93c0ad150 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0accc0 con 0x7fa92c004810 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa941d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0ac0b0 con 0x7fa93c0cb6c0 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46902/0 (socket says 172.21.15.12:46902) 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 -- 172.21.15.12:0/3145929823 learned_addr learned my addr 172.21.15.12:0/3145929823 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa940d9b700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c004810 0x7fa93c13cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa94159c700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0cb6c0 0x7fa93c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 -- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0cb6c0 msgr2=0x7fa93c14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0cb6c0 0x7fa93c14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 -- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c004810 msgr2=0x7fa93c13cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c004810 0x7fa93c13cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.037+0000 7fa93bfff700 1 -- 172.21.15.12:0/3145929823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0ac390 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa93bfff700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0046d0 tx=0x7fa928015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928005ca0 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa928005e00 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa928007530 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c0ac670 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.038+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c0abc80 con 0x7fa93c0ad150 2023-10-08T16:27:46.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.039+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93c0abe70 con 0x7fa93c0ad150 2023-10-08T16:27:46.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.040+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 55) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fa928019030 con 0x7fa93c0ad150 2023-10-08T16:27:46.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.041+0000 7fa938ff9700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 0x7fa920069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:27:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.041+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fa928085380 con 0x7fa93c0ad150 2023-10-08T16:27:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.041+0000 7fa940d9b700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 0x7fa920069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:27:46.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.042+0000 7fa940d9b700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 0x7fa920069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa930006f00 tx=0x7fa9300091a0 comp rx=0 tx=0).ready entity=mgr.7965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:27:46.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.046+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa93c0abe70 con 0x7fa93c0ad150 2023-10-08T16:27:46.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.278+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa93c1571b0 con 0x7fa920066dd0 2023-10-08T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.286+0000 7fa938ff9700 1 -- 172.21.15.12:0/3145929823 <== mgr.7965 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7fa93c1571b0 con 0x7fa920066dd0 2023-10-08T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:27:46.287 INFO:teuthology.orchestra.run.smithi012.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 msgr2=0x7fa920069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 0x7fa920069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa930006f00 tx=0x7fa9300091a0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 msgr2=0x7fa93c0ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0046d0 tx=0x7fa928015000 comp rx=0 tx=0).stop 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 shutdown_connections 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa920066dd0 0x7fa920069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa93c0cb6c0 0x7fa93c14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa92c004810 0x7fa93c13cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 --2- 172.21.15.12:0/3145929823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa93c0ad150 0x7fa93c0ab740 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 >> 172.21.15.12:0/3145929823 conn(0x7fa93c06c6a0 msgr2=0x7fa93c14dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.288+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 shutdown_connections 2023-10-08T16:27:46.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:27:46.289+0000 7fa941d9d700 1 -- 172.21.15.12:0/3145929823 wait complete. 2023-10-08T16:27:46.307 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-10-08T16:27:46.307 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-10-08T16:27:46.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:46.307 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:46.350 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:46.351 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:46.351 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:47.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:47.352 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:47.396 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:47.396 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:47.396 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:48.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:27:48.013 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:27:48.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:48.397 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:48.440 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:48.441 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:48.441 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:49.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:49.442 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:49.486 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:49.487 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:49.487 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:50.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:50.488 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:50.532 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:50.532 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:50.532 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:51.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:51.533 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:51.578 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:51.578 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:51.578 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:52.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:52.579 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:52.624 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:52.624 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:52.624 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:53.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:53.625 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:53.669 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:53.669 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:53.669 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:54.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:54.670 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:54.714 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:54.714 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:54.714 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:55.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:55.834 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:55.878 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:55.878 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:55.878 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:56.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:56.880 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:56.923 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:56.923 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:56.924 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:57.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:57.924 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:57.969 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:57.969 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:57.969 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:27:58.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:27:58.970 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:27:59.014 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:27:59.014 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:27:59.014 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:28:00.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:00.015 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:28:00.059 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T16:28:00.059 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T16:28:00.059 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:28:00.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:00.825+0000 7fb5009d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:00.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:00.825+0000 7fb5009d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:00.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:00.825+0000 7fb5009d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:00.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:00.825+0000 7fb5009d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:00.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:00.825+0000 7fb5009d6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:01.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:01.061 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:28:01.103 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_28_00_UTC 2023-10-08T16:28:01.105 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-16_28_00_UTC'} 2023-10-08T16:28:01.105 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-08-16_28_00_UTC'} 2023-10-08T16:28:01.105 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T16:28:01.105 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-08-16_28_00_UTC'] 2023-10-08T16:28:01.105 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696782465.8367395, now = 1696782481.1056702, timo = 15 2023-10-08T16:28:02.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-08T16:28:02.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.307+0000 7fcf6139d700 1 Processor -- start 2023-10-08T16:28:02.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.308+0000 7fcf6139d700 1 -- start start 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf6139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c153660 0x7fcf5c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf6139d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5c0c9090 0x7fcf5c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf6139d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0c2200 con 0x7fcf5c153a30 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf6139d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c157250 con 0x7fcf5c0c9090 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf6139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c15f0 con 0x7fcf5c153660 2023-10-08T16:28:02.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf60b9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcf5c0c9090 0x7fcf5c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf5b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fcf5c153a30 0x7fcf5c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32774/0 (socket says 172.21.15.12:32774) 2023-10-08T16:28:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf5b7fe700 1 -- 172.21.15.12:0/4234790298 learned_addr learned my addr 172.21.15.12:0/4234790298 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:02.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.309+0000 7fcf5bfff700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c153660 0x7fcf5c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf5affd700 1 -- 172.21.15.12:0/4234790298 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076859958 0 0) 0x7fcf5c0c2200 con 0x7fcf5c153a30 2023-10-08T16:28:02.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf5affd700 1 -- 172.21.15.12:0/4234790298 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf44004680 con 0x7fcf5c153a30 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf60b9c700 1 -- 172.21.15.12:0/4234790298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c153660 msgr2=0x7fcf5c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf60b9c700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c153660 0x7fcf5c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf60b9c700 1 -- 172.21.15.12:0/4234790298 >> v1:172.21.15.12:6789/0 conn(0x7fcf5c153a30 legacy=0x7fcf5c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf60b9c700 1 -- 172.21.15.12:0/4234790298 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0c18d0 con 0x7fcf5c0c9090 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf60b9c700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c0c9090 0x7fcf5c156d10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e60 tx=0x7fcf54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0c03981f507515 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf5affd700 1 -- 172.21.15.12:0/4234790298 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400e070 con 0x7fcf5c0c9090 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf5affd700 1 -- 172.21.15.12:0/4234790298 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5400bab0 con 0x7fcf5c0c9090 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.310+0000 7fcf5affd700 1 -- 172.21.15.12:0/4234790298 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5400be30 con 0x7fcf5c0c9090 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 -- 172.21.15.12:0/4234790298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c0c9090 msgr2=0x7fcf5c156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c0c9090 0x7fcf5c156d10 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e60 tx=0x7fcf54009780 comp rx=0 tx=0).stop 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 -- 172.21.15.12:0/4234790298 shutdown_connections 2023-10-08T16:28:02.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c0c9090 0x7fcf5c156d10 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 --2- 172.21.15.12:0/4234790298 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c153660 0x7fcf5c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 -- 172.21.15.12:0/4234790298 >> 172.21.15.12:0/4234790298 conn(0x7fcf5c06c6a0 msgr2=0x7fcf5c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 -- 172.21.15.12:0/4234790298 shutdown_connections 2023-10-08T16:28:02.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.311+0000 7fcf6139d700 1 -- 172.21.15.12:0/4234790298 wait complete. 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.312+0000 7fcf6139d700 1 Processor -- start 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.313+0000 7fcf6139d700 1 -- start start 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.313+0000 7fcf6139d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c0c9090 0x7fcf5c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf6139d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf6139d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf5c153a30 0x7fcf5c06ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf6139d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c1589a0 con 0x7fcf5c153660 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf6139d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0af430 con 0x7fcf5c153a30 2023-10-08T16:28:02.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf6139d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c157cc0 con 0x7fcf5c0c9090 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53878/0 (socket says 172.21.15.12:53878) 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 -- 172.21.15.12:0/1486294907 learned_addr learned my addr 172.21.15.12:0/1486294907 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5bfff700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c0c9090 0x7fcf5c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf60b9c700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf5c153a30 0x7fcf5c06ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 -- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c0c9090 msgr2=0x7fcf5c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c0c9090 0x7fcf5c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 -- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf5c153a30 msgr2=0x7fcf5c06ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf5c153a30 0x7fcf5c06ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.314+0000 7fcf5b7fe700 1 -- 172.21.15.12:0/1486294907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009a20 con 0x7fcf5c153660 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf5b7fe700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c590 tx=0x7fcf50007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:02.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf50005b30 con 0x7fcf5c153660 2023-10-08T16:28:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50005c90 con 0x7fcf5c153660 2023-10-08T16:28:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c157fa0 con 0x7fcf5c153660 2023-10-08T16:28:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf500072e0 con 0x7fcf5c153660 2023-10-08T16:28:02.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.315+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c158560 con 0x7fcf5c153660 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.316+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c158b50 con 0x7fcf5c153660 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.317+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 56) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fcf50007690 con 0x7fcf5c153660 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.318+0000 7fcf43fff700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 0x7fcf480695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.318+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fcf50083f10 con 0x7fcf5c153660 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.318+0000 7fcf5bfff700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 0x7fcf480695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:02.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.319+0000 7fcf5bfff700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 0x7fcf480695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009db0 tx=0x7fcf4c0091a0 comp rx=0 tx=0).ready entity=mgr.7965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:02.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.323+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf5c158b50 con 0x7fcf5c153660 2023-10-08T16:28:02.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.551+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf5c158720 con 0x7fcf48067130 2023-10-08T16:28:02.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.615+0000 7fcf43fff700 1 -- 172.21.15.12:0/1486294907 <== mgr.7965 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcf5c158720 con 0x7fcf48067130 2023-10-08T16:28:02.617 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path snap_test_dir1 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 msgr2=0x7fcf480695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 0x7fcf480695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c009db0 tx=0x7fcf4c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 msgr2=0x7fcf5c0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000c590 tx=0x7fcf50007d90 comp rx=0 tx=0).stop 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 shutdown_connections 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcf48067130 0x7fcf480695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcf5c153a30 0x7fcf5c06ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcf5c0c9090 0x7fcf5c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 --2- 172.21.15.12:0/1486294907 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcf5c153660 0x7fcf5c0add00 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:02.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 >> 172.21.15.12:0/1486294907 conn(0x7fcf5c06c6a0 msgr2=0x7fcf5c1547b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:02.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 shutdown_connections 2023-10-08T16:28:02.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:02.618+0000 7fcf6139d700 1 -- 172.21.15.12:0/1486294907 wait complete. 2023-10-08T16:28:02.636 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-08T16:28:02.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:02.636 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T16:28:02.674 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_28_00_UTC 2023-10-08T16:28:02.675 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_28_00_UTC 2023-10-08T16:28:02.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:02.675 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_28_00_UTC) 2023-10-08T16:28:02.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:02.760 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T16:28:02.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T16:28:03.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.069+0000 7fd5e0d9d700 1 Processor -- start 2023-10-08T16:28:03.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.069+0000 7fd5e0d9d700 1 -- start start 2023-10-08T16:28:03.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5e0d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5dc153dd0 0x7fd5dc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5e0d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc15ac50 con 0x7fd5dc0cea00 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5e0d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5dc15d010 con 0x7fd5dc153a00 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5e0d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5dc15af60 con 0x7fd5dc153dd0 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5dbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd5dc0cea00 0x7fd5dc0ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32784/0 (socket says 172.21.15.12:32784) 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5daffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd5dc153dd0 0x7fd5dc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:03.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5dbfff700 1 -- 172.21.15.12:0/908907201 learned_addr learned my addr 172.21.15.12:0/908907201 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:03.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5daffd700 1 -- 172.21.15.12:0/908907201 >> v1:172.21.15.29:6789/0 conn(0x7fd5dc153a00 legacy=0x7fd5dc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5daffd700 1 -- 172.21.15.12:0/908907201 >> v1:172.21.15.12:6789/0 conn(0x7fd5dc0cea00 legacy=0x7fd5dc0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5daffd700 1 -- 172.21.15.12:0/908907201 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5dc15b240 con 0x7fd5dc153dd0 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.070+0000 7fd5da7fc700 1 -- 172.21.15.12:0/908907201 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572830230 0 0) 0x7fd5dc15ac50 con 0x7fd5dc0cea00 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5daffd700 1 --2- 172.21.15.12:0/908907201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153dd0 0x7fd5dc15de50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00098e0 tx=0x7fd5d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e2fe594fc81c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5da7fc700 1 -- 172.21.15.12:0/908907201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d0009e80 con 0x7fd5dc153dd0 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5da7fc700 1 -- 172.21.15.12:0/908907201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000b860 con 0x7fd5dc153dd0 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5da7fc700 1 -- 172.21.15.12:0/908907201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000bbe0 con 0x7fd5dc153dd0 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/908907201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153dd0 msgr2=0x7fd5dc15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/908907201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153dd0 0x7fd5dc15de50 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fd5d00098e0 tx=0x7fd5d00091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/908907201 shutdown_connections 2023-10-08T16:28:03.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/908907201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153dd0 0x7fd5dc15de50 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:03.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/908907201 >> 172.21.15.12:0/908907201 conn(0x7fd5dc0703a0 msgr2=0x7fd5dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:03.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/908907201 shutdown_connections 2023-10-08T16:28:03.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.071+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/908907201 wait complete. 2023-10-08T16:28:03.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.073+0000 7fd5e0d9d700 1 Processor -- start 2023-10-08T16:28:03.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.073+0000 7fd5e0d9d700 1 -- start start 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5dc0cea00 0x7fd5dc146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5dc153dd0 0x7fd5dc0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c8c70 con 0x7fd5dc153a00 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c8060 con 0x7fd5dc0cea00 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5e0d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5dc0c8340 con 0x7fd5dc153dd0 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53906/0 (socket says 172.21.15.12:53906) 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5daffd700 1 -- 172.21.15.12:0/2886634186 learned_addr learned my addr 172.21.15.12:0/2886634186 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5db7fe700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5dc0cea00 0x7fd5dc146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:03.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.074+0000 7fd5dbfff700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5dc153dd0 0x7fd5dc0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 -- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5dc153dd0 msgr2=0x7fd5dc0c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5dc153dd0 0x7fd5dc0c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 -- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5dc0cea00 msgr2=0x7fd5dc146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5dc0cea00 0x7fd5dc146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 -- 172.21.15.12:0/2886634186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0009420 con 0x7fd5dc153a00 2023-10-08T16:28:03.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5daffd700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0013000 tx=0x7fd5d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d001f070 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d0000c90 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000bbe0 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5dc0c8620 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.075+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5dc147490 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.076+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5dc04c3c0 con 0x7fd5dc153a00 2023-10-08T16:28:03.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.077+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 56) v1 ==== 84916+0+0 (secure 0 0 0) 0x7fd5d0011840 con 0x7fd5dc153a00 2023-10-08T16:28:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.078+0000 7fd5c37fe700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 0x7fd5c80695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.078+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fd5d0085de0 con 0x7fd5dc153a00 2023-10-08T16:28:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.078+0000 7fd5db7fe700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 0x7fd5c80695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:03.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.079+0000 7fd5db7fe700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 0x7fd5c80695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc003a80 tx=0x7fd5cc007ec0 comp rx=0 tx=0).ready entity=mgr.7965 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:03.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.083+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5d0052b50 con 0x7fd5dc153a00 2023-10-08T16:28:03.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.224+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 57) v1 ==== 84973+0+0 (secure 0 0 0) 0x7fd5d0052f20 con 0x7fd5dc153a00 2023-10-08T16:28:03.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:03.344+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fd5dc15b520 con 0x7fd5dc153a00 2023-10-08T16:28:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.232+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fd5d0068fb0 con 0x7fd5dc153a00 2023-10-08T16:28:04.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.233+0000 7fd5c37fe700 1 -- 172.21.15.12:0/2886634186 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v58) v1 ==== 93+0+0 (secure 0 0 0) 0x7fd5d0053b60 con 0x7fd5dc153a00 2023-10-08T16:28:04.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 msgr2=0x7fd5c80695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 0x7fd5c80695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc003a80 tx=0x7fd5cc007ec0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 msgr2=0x7fd5dc0c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0013000 tx=0x7fd5d0017000 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 shutdown_connections 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd5c8067130 0x7fd5c80695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd5dc153dd0 0x7fd5dc0c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd5dc0cea00 0x7fd5dc146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 --2- 172.21.15.12:0/2886634186 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd5dc153a00 0x7fd5dc0c75e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 >> 172.21.15.12:0/2886634186 conn(0x7fd5dc0703a0 msgr2=0x7fd5dc152f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:04.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 shutdown_connections 2023-10-08T16:28:04.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.237+0000 7fd5e0d9d700 1 -- 172.21.15.12:0/2886634186 wait complete. 2023-10-08T16:28:04.257 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:28:04.258 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:28:04.347 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:28:04.428 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:28:04.429 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T16:28:04.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:04.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T16:28:04.521 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T16:28:04.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:04.521 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T16:28:04.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:04.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.791+0000 7f2e9359d700 1 Processor -- start 2023-10-08T16:28:04.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.791+0000 7f2e9359d700 1 -- start start 2023-10-08T16:28:04.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c153c30 0x7f2e8c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9359d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2e8c0cf110 0x7f2e8c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9359d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c15afd0 con 0x7f2e8c15de50 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9359d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c15b2b0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c15b590 con 0x7f2e8c153c30 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e92d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2e8c0cf110 0x7f2e8c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e9259b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c153c30 0x7f2e8c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e91d9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f2e8c15de50 0x7f2e8c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:43446/0 (socket says 172.21.15.12:43446) 2023-10-08T16:28:04.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e91d9a700 1 -- 172.21.15.12:0/4104977328 learned_addr learned my addr 172.21.15.12:0/4104977328 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e92d9c700 1 -- 172.21.15.12:0/4104977328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c153c30 msgr2=0x7f2e8c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e92d9c700 1 --2- 172.21.15.12:0/4104977328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c153c30 0x7f2e8c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e92d9c700 1 -- 172.21.15.12:0/4104977328 >> v1:172.21.15.29:6789/0 conn(0x7f2e8c15de50 legacy=0x7f2e8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e92d9c700 1 -- 172.21.15.12:0/4104977328 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c15b870 con 0x7f2e8c0cf110 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.792+0000 7f2e91599700 1 -- 172.21.15.12:0/4104977328 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1324201851 0 0) 0x7f2e8c15afd0 con 0x7f2e8c15de50 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e92d9c700 1 --2- 172.21.15.12:0/4104977328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c15c070 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e60 tx=0x7f2e84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d0a5e43b354447 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:04.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e91599700 1 -- 172.21.15.12:0/4104977328 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e8c0cf110 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e91599700 1 -- 172.21.15.12:0/4104977328 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400bb60 con 0x7f2e8c0cf110 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e91599700 1 -- 172.21.15.12:0/4104977328 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84012430 con 0x7f2e8c0cf110 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 -- 172.21.15.12:0/4104977328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 msgr2=0x7f2e8c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 --2- 172.21.15.12:0/4104977328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c15c070 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009e60 tx=0x7f2e84009780 comp rx=0 tx=0).stop 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 -- 172.21.15.12:0/4104977328 shutdown_connections 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 --2- 172.21.15.12:0/4104977328 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c15c070 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 --2- 172.21.15.12:0/4104977328 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c153c30 0x7f2e8c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 -- 172.21.15.12:0/4104977328 >> 172.21.15.12:0/4104977328 conn(0x7f2e8c0703a0 msgr2=0x7f2e8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.794+0000 7f2e9359d700 1 -- 172.21.15.12:0/4104977328 shutdown_connections 2023-10-08T16:28:04.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.795+0000 7f2e9359d700 1 -- 172.21.15.12:0/4104977328 wait complete. 2023-10-08T16:28:04.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.796+0000 7f2e9359d700 1 Processor -- start 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.796+0000 7f2e9359d700 1 -- start start 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 0x7f2e8c0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c15de50 0x7f2e8c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c86a0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0cc150 con 0x7f2e8c153c30 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0cc3d0 con 0x7f2e8c15de50 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e91d9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 0x7f2e8c0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:04.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9259b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53948/0 (socket says 172.21.15.12:53948) 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e91d9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 0x7f2e8c0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46184/0 (socket says 172.21.15.12:46184) 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e9259b700 1 -- 172.21.15.12:0/3230514004 learned_addr learned my addr 172.21.15.12:0/3230514004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.797+0000 7f2e92d9c700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c15de50 0x7f2e8c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c15de50 msgr2=0x7f2e8c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c15de50 0x7f2e8c0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 msgr2=0x7f2e8c0cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 0x7f2e8c0cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 -- 172.21.15.12:0/3230514004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009a20 con 0x7f2e8c0cf110 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9259b700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ecb0 tx=0x7f2e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800c850 con 0x7f2e8c0cf110 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8800c9b0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8800cd70 con 0x7f2e8c0cf110 2023-10-08T16:28:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.798+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0cc6b0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.799+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0b39d0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.800+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c0ccbd0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.800+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2e88013680 con 0x7f2e8c0cf110 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.801+0000 7f2e827fc700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 0x7f2e70069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.801+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2e88084ce0 con 0x7f2e8c0cf110 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.801+0000 7f2e91d9a700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 msgr2=0x7f2e70069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:04.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.801+0000 7f2e91d9a700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 0x7f2e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:04.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:04.804+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e8c0ccbd0 con 0x7f2e8c0cf110 2023-10-08T16:28:05.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.002+0000 7f2e91d9a700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 msgr2=0x7f2e70069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:05.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.002+0000 7f2e91d9a700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 0x7f2e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:05.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.055+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e8c0ccbd0 con 0x7f2e8c0cf110 2023-10-08T16:28:05.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.055+0000 7f2e827fc700 1 -- 172.21.15.12:0/3230514004 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2e8c0ccbd0 con 0x7f2e8c0cf110 2023-10-08T16:28:05.055 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:05.055 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 msgr2=0x7f2e70069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 0x7f2e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 msgr2=0x7f2e8c0c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800ecb0 tx=0x7f2e880091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 shutdown_connections 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2e70067170 0x7f2e70069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2e8c0cf110 0x7f2e8c0c7ee0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2e8c15de50 0x7f2e8c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 --2- 172.21.15.12:0/3230514004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2e8c153c30 0x7f2e8c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 >> 172.21.15.12:0/3230514004 conn(0x7f2e8c0703a0 msgr2=0x7f2e8c159480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:05.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 shutdown_connections 2023-10-08T16:28:05.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.058+0000 7f2e9359d700 1 -- 172.21.15.12:0/3230514004 wait complete. 2023-10-08T16:28:05.059 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:28:05.084 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:05.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.274+0000 7f6bb4f9d700 1 Processor -- start 2023-10-08T16:28:05.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.275+0000 7f6bb4f9d700 1 -- start start 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6bb4f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb0153c30 0x7f6bb015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6bb4f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6bb4f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bb015afd0 con 0x7f6bb00cef40 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6bb4f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bb015b2b0 con 0x7f6bb0153c30 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6bb4f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb015b590 con 0x7f6bb015de50 2023-10-08T16:28:05.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb0153c30 0x7f6bb015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baf7fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6bb0153c30 0x7f6bb015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46198/0 (socket says 172.21.15.12:46198) 2023-10-08T16:28:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:58624/0 (socket says 172.21.15.12:58624) 2023-10-08T16:28:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baf7fe700 1 -- 172.21.15.12:0/3115075789 learned_addr learned my addr 172.21.15.12:0/3115075789 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:05.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.276+0000 7f6baffff700 1 --1- 172.21.15.12:0/3115075789 >> v1:172.21.15.29:6789/0 conn(0x7f6bb00cef40 0x7f6bb006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:43460/0 (socket says 172.21.15.12:43460) 2023-10-08T16:28:05.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6bae7fc700 1 -- 172.21.15.12:0/3115075789 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962750680 0 0) 0x7f6bb015afd0 con 0x7f6bb00cef40 2023-10-08T16:28:05.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6bae7fc700 1 -- 172.21.15.12:0/3115075789 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98003570 con 0x7f6bb00cef40 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baf7fe700 1 -- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 msgr2=0x7f6bb00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baf7fe700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baf7fe700 1 -- 172.21.15.12:0/3115075789 >> v1:172.21.15.29:6789/0 conn(0x7f6bb00cef40 legacy=0x7f6bb006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baf7fe700 1 -- 172.21.15.12:0/3115075789 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb015b870 con 0x7f6bb0153c30 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baeffd700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6baf7fe700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb0153c30 0x7f6bb015a5e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f8ed21314d69d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6bae7fc700 1 -- 172.21.15.12:0/3115075789 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000b680 con 0x7f6bb0153c30 2023-10-08T16:28:05.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6bae7fc700 1 -- 172.21.15.12:0/3115075789 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba000b7e0 con 0x7f6bb0153c30 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.277+0000 7f6bae7fc700 1 -- 172.21.15.12:0/3115075789 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000bb80 con 0x7f6bb0153c30 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb0153c30 msgr2=0x7f6bb015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb0153c30 0x7f6bb015a5e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ba00099b0 tx=0x7f6ba0009250 comp rx=0 tx=0).stop 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/3115075789 shutdown_connections 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb0153c30 0x7f6bb015a5e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/3115075789 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/3115075789 >> 172.21.15.12:0/3115075789 conn(0x7f6bb00703a0 msgr2=0x7f6bb00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/3115075789 shutdown_connections 2023-10-08T16:28:05.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.278+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/3115075789 wait complete. 2023-10-08T16:28:05.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.279+0000 7f6bb4f9d700 1 Processor -- start 2023-10-08T16:28:05.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.280+0000 7f6bb4f9d700 1 -- start start 2023-10-08T16:28:05.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.280+0000 7f6bb4f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 0x7f6bb00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.280+0000 7f6bb4f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.280+0000 7f6bb4f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb0152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.280+0000 7f6bb4f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b11a0 con 0x7f6bb0153c30 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6bb4f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b0870 con 0x7f6bb00cef40 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6bb4f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bb00b0b50 con 0x7f6bb015de50 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baf7fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 0x7f6bb00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53958/0 (socket says 172.21.15.12:53958) 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 -- 172.21.15.12:0/2023952618 learned_addr learned my addr 172.21.15.12:0/2023952618 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baffff700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb0152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 msgr2=0x7f6bb0152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb0152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 msgr2=0x7f6bb00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 0x7f6bb00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baeffd700 1 -- 172.21.15.12:0/2023952618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba4009420 con 0x7f6bb0153c30 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.281+0000 7f6baf7fe700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 0x7f6bb00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6baeffd700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400ec80 tx=0x7f6ba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400c920 con 0x7f6bb0153c30 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba400ca80 con 0x7f6bb0153c30 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400ce00 con 0x7f6bb0153c30 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba00094f0 con 0x7f6bb0153c30 2023-10-08T16:28:05.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.282+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bb00c7fc0 con 0x7f6bb0153c30 2023-10-08T16:28:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.283+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bb00b1310 con 0x7f6bb0153c30 2023-10-08T16:28:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.284+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f6ba4013680 con 0x7f6bb0153c30 2023-10-08T16:28:05.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.285+0000 7f6b977fe700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 0x7f6b9c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.285+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6ba4084fa0 con 0x7f6bb0153c30 2023-10-08T16:28:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.285+0000 7f6baf7fe700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 msgr2=0x7f6b9c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:05.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.285+0000 7f6baf7fe700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 0x7f6b9c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:05.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.289+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ba4051c50 con 0x7f6bb0153c30 2023-10-08T16:28:05.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.486+0000 7f6baf7fe700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 msgr2=0x7f6b9c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:05.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.486+0000 7f6baf7fe700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 0x7f6b9c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:05.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.505+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bb004c3c0 con 0x7f6bb0153c30 2023-10-08T16:28:05.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.506+0000 7f6b977fe700 1 -- 172.21.15.12:0/2023952618 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16376 (secure 0 0 0) 0x7f6ba4055270 con 0x7f6bb0153c30 2023-10-08T16:28:05.507 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:05.507 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":130,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:44.729280+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/4094836460":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6837/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6836/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/2792310995":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/1657489760":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/3455412283":"2023-10-09T16:27:44.729247+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:05.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 msgr2=0x7f6b9c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:05.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 0x7f6b9c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 msgr2=0x7f6bb013ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400ec80 tx=0x7f6ba40091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 shutdown_connections 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6b9c067170 0x7f6b9c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6bb015de50 0x7f6bb0152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6bb00cef40 0x7f6bb00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 --2- 172.21.15.12:0/2023952618 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6bb0153c30 0x7f6bb013ed10 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 >> 172.21.15.12:0/2023952618 conn(0x7f6bb00703a0 msgr2=0x7f6bb00c6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 shutdown_connections 2023-10-08T16:28:05.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.509+0000 7f6bb4f9d700 1 -- 172.21.15.12:0/2023952618 wait complete. 2023-10-08T16:28:05.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:27:27.038847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:27:27.818753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T16:28:05.535 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:28:05.582 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:05.582+0000 7f0403e51180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:28:05.638 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:05.638+0000 7fdb206d9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:28:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.728+0000 7ff77cb9d700 1 Processor -- start 2023-10-08T16:28:05.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.728+0000 7ff77cb9d700 1 -- start start 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.729+0000 7ff77cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff778153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff77cb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77815ac50 con 0x7ff7780cea00 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff77cb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77815d010 con 0x7ff77815de50 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff77cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77815af60 con 0x7ff778153a00 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff776ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff77815de50 0x7ff77815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:43474/0 (socket says 172.21.15.12:43474) 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff776ffd700 1 -- 172.21.15.12:0/4241791092 learned_addr learned my addr 172.21.15.12:0/4241791092 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7777fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff778153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff777fff700 1 --1- 172.21.15.12:0/4241791092 >> v1:172.21.15.12:6789/0 conn(0x7ff7780cea00 0x7ff7780cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32798/0 (socket says 172.21.15.12:32798) 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936199503 0 0) 0x7ff77815d010 con 0x7ff77815de50 2023-10-08T16:28:05.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff760003570 con 0x7ff77815de50 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966115874 0 0) 0x7ff77815ac50 con 0x7ff7780cea00 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77815d010 con 0x7ff7780cea00 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.730+0000 7ff7777fe700 1 -- 172.21.15.12:0/4241791092 >> v1:172.21.15.29:6789/0 conn(0x7ff77815de50 legacy=0x7ff77815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7777fe700 1 -- 172.21.15.12:0/4241791092 >> v1:172.21.15.12:6789/0 conn(0x7ff7780cea00 legacy=0x7ff7780cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7777fe700 1 -- 172.21.15.12:0/4241791092 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77815b240 con 0x7ff778153a00 2023-10-08T16:28:05.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7777fe700 1 --2- 172.21.15.12:0/4241791092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff778153dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff768009910 tx=0x7ff7680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32ea3609115af120 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768011630 con 0x7ff778153a00 2023-10-08T16:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff768011790 con 0x7ff778153a00 2023-10-08T16:28:05.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.731+0000 7ff7767fc700 1 -- 172.21.15.12:0/4241791092 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff768011b30 con 0x7ff778153a00 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 -- 172.21.15.12:0/4241791092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 msgr2=0x7ff778153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/4241791092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff778153dd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff768009910 tx=0x7ff7680091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 -- 172.21.15.12:0/4241791092 shutdown_connections 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/4241791092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff778153dd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 -- 172.21.15.12:0/4241791092 >> 172.21.15.12:0/4241791092 conn(0x7ff7780703a0 msgr2=0x7ff7780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 -- 172.21.15.12:0/4241791092 shutdown_connections 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.732+0000 7ff77cb9d700 1 -- 172.21.15.12:0/4241791092 wait complete. 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.733+0000 7ff77cb9d700 1 Processor -- start 2023-10-08T16:28:05.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.734+0000 7ff77cb9d700 1 -- start start 2023-10-08T16:28:05.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.734+0000 7ff77cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7780cea00 0x7ff7780b23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.734+0000 7ff77cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff7781519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff77cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff77cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c8760 con 0x7ff77815de50 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff77cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff778151f30 con 0x7ff7780cea00 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff77cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7781523d0 con 0x7ff778153a00 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53970/0 (socket says 172.21.15.12:53970) 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 -- 172.21.15.12:0/3147018271 learned_addr learned my addr 172.21.15.12:0/3147018271 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff776ffd700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff7781519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff7777fe700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7780cea00 0x7ff7780b23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:05.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 msgr2=0x7ff7781519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff7781519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7780cea00 msgr2=0x7ff7780b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7780cea00 0x7ff7780b23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.735+0000 7ff777fff700 1 -- 172.21.15.12:0/3147018271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768009420 con 0x7ff77815de50 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff777fff700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff77000cd30 tx=0x7ff770001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000ce90 con 0x7ff77815de50 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff770005df0 con 0x7ff77815de50 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7780c7b50 con 0x7ff77815de50 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000aac0 con 0x7ff77815de50 2023-10-08T16:28:05.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.736+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7780c8110 con 0x7ff77815de50 2023-10-08T16:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.737+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7780c8910 con 0x7ff77815de50 2023-10-08T16:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.738+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7ff7700070f0 con 0x7ff77815de50 2023-10-08T16:28:05.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.739+0000 7ff75f7fe700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 0x7ff764069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.739+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7ff770084c30 con 0x7ff77815de50 2023-10-08T16:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.739+0000 7ff7777fe700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 msgr2=0x7ff764069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:05.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.739+0000 7ff7777fe700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 0x7ff764069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:05.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.743+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7780c8910 con 0x7ff77815de50 2023-10-08T16:28:05.754 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:05.754+0000 7f0403e51180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:05.816 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:05.816+0000 7fdb206d9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:05.844 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:05.844+0000 7f0403e51180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:28:05.906 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:05.907+0000 7fdb206d9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:28:05.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.940+0000 7ff7777fe700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 msgr2=0x7ff764069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:05.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.940+0000 7ff7777fe700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 0x7ff764069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:05.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.946+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff77804c3c0 con 0x7ff77815de50 2023-10-08T16:28:05.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.947+0000 7ff75f7fe700 1 -- 172.21.15.12:0/3147018271 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff770051970 con 0x7ff77815de50 2023-10-08T16:28:05.947 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:28:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 msgr2=0x7ff764069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 0x7ff764069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 msgr2=0x7ff7780c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:05.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff77000cd30 tx=0x7ff770001b60 comp rx=0 tx=0).stop 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 shutdown_connections 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff764067170 0x7ff764069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff77815de50 0x7ff7780c52d0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7780cea00 0x7ff7780b23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 --2- 172.21.15.12:0/3147018271 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff778153a00 0x7ff7781519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 >> 172.21.15.12:0/3147018271 conn(0x7ff7780703a0 msgr2=0x7ff778152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 shutdown_connections 2023-10-08T16:28:05.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:05.949+0000 7ff77cb9d700 1 -- 172.21.15.12:0/3147018271 wait complete. 2023-10-08T16:28:05.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T16:28:06.077 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:06.077+0000 7f0403e51180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:06.144 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:06.144+0000 7fdb206d9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:06.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.162+0000 7f6e88f9d700 1 Processor -- start 2023-10-08T16:28:06.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.162+0000 7f6e88f9d700 1 -- start start 2023-10-08T16:28:06.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.163+0000 7f6e88f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e84153dd0 0x7f6e8415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.163+0000 7f6e88f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e840cea00 0x7f6e840ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.163+0000 7f6e88f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8415ac50 con 0x7f6e84153a00 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.163+0000 7f6e88f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8415d010 con 0x7f6e84153dd0 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.163+0000 7f6e88f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840cf3e0 con 0x7f6e840cea00 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e84153dd0 0x7f6e8415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6e84153dd0 0x7f6e8415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53978/0 (socket says 172.21.15.12:53978) 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 -- 172.21.15.12:0/136381108 learned_addr learned my addr 172.21.15.12:0/136381108 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:06.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e83fff700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e840cea00 0x7f6e840ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 -- 172.21.15.12:0/136381108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e840cea00 msgr2=0x7f6e840ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e840cea00 0x7f6e840ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 -- 172.21.15.12:0/136381108 >> v1:172.21.15.29:6789/0 conn(0x7f6e84153a00 legacy=0x7f6e8415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e827fc700 1 -- 172.21.15.12:0/136381108 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645585982 0 0) 0x7f6e8415ac50 con 0x7f6e84153a00 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 -- 172.21.15.12:0/136381108 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8415af60 con 0x7f6e84153dd0 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.164+0000 7f6e82ffd700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e8415de50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6e780099b0 tx=0x7f6e78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882ab9bab96676a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e827fc700 1 -- 172.21.15.12:0/136381108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e78009ea0 con 0x7f6e84153dd0 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e827fc700 1 -- 172.21.15.12:0/136381108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800b860 con 0x7f6e84153dd0 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e827fc700 1 -- 172.21.15.12:0/136381108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800bc00 con 0x7f6e84153dd0 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 -- 172.21.15.12:0/136381108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 msgr2=0x7f6e8415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e8415de50 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f6e780099b0 tx=0x7f6e78009250 comp rx=0 tx=0).stop 2023-10-08T16:28:06.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 -- 172.21.15.12:0/136381108 shutdown_connections 2023-10-08T16:28:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e840cea00 0x7f6e840ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/136381108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e8415de50 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 -- 172.21.15.12:0/136381108 >> 172.21.15.12:0/136381108 conn(0x7f6e840703a0 msgr2=0x7f6e840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.165+0000 7f6e88f9d700 1 -- 172.21.15.12:0/136381108 shutdown_connections 2023-10-08T16:28:06.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.166+0000 7f6e88f9d700 1 -- 172.21.15.12:0/136381108 wait complete. 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.167+0000 7f6e88f9d700 1 Processor -- start 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.167+0000 7f6e88f9d700 1 -- start start 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e840cea00 0x7f6e84146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 0x7f6e840c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84146580 con 0x7f6e84153dd0 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e84158d20 con 0x7f6e840cea00 2023-10-08T16:28:06.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e88f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840c8c00 con 0x7f6e84153a00 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e83fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e83fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:53986/0 (socket says 172.21.15.12:53986) 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e83fff700 1 -- 172.21.15.12:0/1697966258 learned_addr learned my addr 172.21.15.12:0/1697966258 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e837fe700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e840cea00 0x7f6e84146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.168+0000 7f6e82ffd700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 0x7f6e840c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 msgr2=0x7f6e840c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 0x7f6e840c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e840cea00 msgr2=0x7f6e84146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e840cea00 0x7f6e84146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 -- 172.21.15.12:0/1697966258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e780094f0 con 0x7f6e84153dd0 2023-10-08T16:28:06.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e82ffd700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 0x7f6e840c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e83fff700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e90 tx=0x7f6e7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00cc20 con 0x7f6e84153dd0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c00f040 con 0x7f6e84153dd0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c014480 con 0x7f6e84153dd0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e840c8ee0 con 0x7f6e84153dd0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.169+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840c94a0 con 0x7f6e84153dd0 2023-10-08T16:28:06.171 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.171+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8404c3c0 con 0x7f6e84153dd0 2023-10-08T16:28:06.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.171+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f6e7c0147f0 con 0x7f6e84153dd0 2023-10-08T16:28:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.173+0000 7f6e6b7fe700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 0x7f6e70069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.173+0000 7f6e837fe700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 msgr2=0x7f6e70069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.173+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f6e7c085720 con 0x7f6e84153dd0 2023-10-08T16:28:06.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.173+0000 7f6e837fe700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 0x7f6e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:06.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.177+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e7c055d50 con 0x7f6e84153dd0 2023-10-08T16:28:06.266 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:06.266+0000 7f0403e51180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:28:06.336 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:06.336+0000 7fdb206d9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:28:06.363 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:06.363+0000 7f0403e51180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:28:06.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.374+0000 7f6e837fe700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 msgr2=0x7f6e70069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:06.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.374+0000 7f6e837fe700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 0x7f6e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:06.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.383+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e8415b240 con 0x7f6e84153dd0 2023-10-08T16:28:06.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.383+0000 7f6e6b7fe700 1 -- 172.21.15.12:0/1697966258 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e7c0558e0 con 0x7f6e84153dd0 2023-10-08T16:28:06.383 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 msgr2=0x7f6e70069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 0x7f6e70069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 msgr2=0x7f6e840c5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009e90 tx=0x7f6e7c00b040 comp rx=0 tx=0).stop 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 shutdown_connections 2023-10-08T16:28:06.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6e70067170 0x7f6e70069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e84153dd0 0x7f6e840c5810 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e840cea00 0x7f6e84146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 --2- 172.21.15.12:0/1697966258 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e84153a00 0x7f6e840c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 >> 172.21.15.12:0/1697966258 conn(0x7f6e840703a0 msgr2=0x7f6e840d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 shutdown_connections 2023-10-08T16:28:06.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.386+0000 7f6e88f9d700 1 -- 172.21.15.12:0/1697966258 wait complete. 2023-10-08T16:28:06.404 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T16:28:06.435 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:06.436+0000 7fdb206d9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:28:06.531 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:06.531+0000 7f0403e51180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:28:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.598+0000 7fe863fff700 1 Processor -- start 2023-10-08T16:28:06.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.598+0000 7fe863fff700 1 -- start start 2023-10-08T16:28:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.599+0000 7fe863fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.599+0000 7fe863fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 0x7fe8640cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.599+0000 7fe863fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86415ac50 con 0x7fe86415de50 2023-10-08T16:28:06.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.599+0000 7fe863fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86415d010 con 0x7fe864153a00 2023-10-08T16:28:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.599+0000 7fe863fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640cf3c0 con 0x7fe8640cea00 2023-10-08T16:28:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe8627fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe86415de50 0x7fe86415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32800/0 (socket says 172.21.15.12:32800) 2023-10-08T16:28:06.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe8627fc700 1 -- 172.21.15.12:0/1872190940 learned_addr learned my addr 172.21.15.12:0/1872190940 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1872190940 >> v2:172.21.15.29:3300/0 conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe8637fe700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 0x7fe8640cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe861ffb700 1 -- 172.21.15.12:0/1872190940 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890222429 0 0) 0x7fe86415ac50 con 0x7fe86415de50 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe861ffb700 1 -- 172.21.15.12:0/1872190940 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe84c003570 con 0x7fe86415de50 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe862ffd700 1 -- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 msgr2=0x7fe8640cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 0x7fe8640cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe862ffd700 1 -- 172.21.15.12:0/1872190940 >> v1:172.21.15.12:6789/0 conn(0x7fe86415de50 legacy=0x7fe86415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe862ffd700 1 -- 172.21.15.12:0/1872190940 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86415af60 con 0x7fe864153a00 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.600+0000 7fe8637fe700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 0x7fe8640cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.601+0000 7fe862ffd700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe8540098e0 tx=0x7fe8540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c2e53c33a435ab3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.601+0000 7fe861ffb700 1 -- 172.21.15.12:0/1872190940 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011630 con 0x7fe864153a00 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.601+0000 7fe861ffb700 1 -- 172.21.15.12:0/1872190940 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854011790 con 0x7fe864153a00 2023-10-08T16:28:06.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.601+0000 7fe861ffb700 1 -- 172.21.15.12:0/1872190940 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011b30 con 0x7fe864153a00 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 -- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 msgr2=0x7fe864153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe8540098e0 tx=0x7fe8540091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 -- 172.21.15.12:0/1872190940 shutdown_connections 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8640cea00 0x7fe8640cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 --2- 172.21.15.12:0/1872190940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe864153dd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 -- 172.21.15.12:0/1872190940 >> 172.21.15.12:0/1872190940 conn(0x7fe8640703a0 msgr2=0x7fe8640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 -- 172.21.15.12:0/1872190940 shutdown_connections 2023-10-08T16:28:06.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.602+0000 7fe863fff700 1 -- 172.21.15.12:0/1872190940 wait complete. 2023-10-08T16:28:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.603+0000 7fe863fff700 1 Processor -- start 2023-10-08T16:28:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.603+0000 7fe863fff700 1 -- start start 2023-10-08T16:28:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe8640b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640b1390 con 0x7fe8640cea00 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8641526a0 con 0x7fe864153a00 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe863fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8640c8770 con 0x7fe86415de50 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.604+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54002/0 (socket says 172.21.15.12:54002) 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 -- 172.21.15.12:0/204531265 learned_addr learned my addr 172.21.15.12:0/204531265 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe8627fc700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe8640b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe8637fe700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 msgr2=0x7fe864158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 msgr2=0x7fe8640b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe8640b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 -- 172.21.15.12:0/204531265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85c009a20 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe862ffd700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fe86406eb00 tx=0x7fe854017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011b10 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8540253f0 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.605+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540257b0 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.606+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe854009420 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.606+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8640b0850 con 0x7fe8640cea00 2023-10-08T16:28:06.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.607+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86404c3c0 con 0x7fe8640cea00 2023-10-08T16:28:06.608 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:06.608+0000 7fdb206d9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:28:06.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.608+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fe854025ba0 con 0x7fe8640cea00 2023-10-08T16:28:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.609+0000 7fe84affd700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 0x7fe850069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.610+0000 7fe8627fc700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 msgr2=0x7fe850069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:06.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.610+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7fe854086410 con 0x7fe8640cea00 2023-10-08T16:28:06.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.610+0000 7fe8627fc700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 0x7fe850069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:06.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.614+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe854053160 con 0x7fe8640cea00 2023-10-08T16:28:06.637 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:06.637+0000 7f0403e51180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:06.714 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:06.715+0000 7fdb206d9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.811+0000 7fe8627fc700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 msgr2=0x7fe850069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:06.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.811+0000 7fe8627fc700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 0x7fe850069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.818+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8640ca3f0 con 0x7fe8640cea00 2023-10-08T16:28:06.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.818+0000 7fe84affd700 1 -- 172.21.15.12:0/204531265 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe854056780 con 0x7fe8640cea00 2023-10-08T16:28:06.819 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T16:28:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 msgr2=0x7fe850069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:06.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 0x7fe850069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 msgr2=0x7fe864152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fe86406eb00 tx=0x7fe854017000 comp rx=0 tx=0).stop 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 shutdown_connections 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe850067170 0x7fe850069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8640cea00 0x7fe864152160 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe86415de50 0x7fe864158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 --2- 172.21.15.12:0/204531265 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe864153a00 0x7fe8640b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 >> 172.21.15.12:0/204531265 conn(0x7fe8640703a0 msgr2=0x7fe864152ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 shutdown_connections 2023-10-08T16:28:06.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:06.821+0000 7fe863fff700 1 -- 172.21.15.12:0/204531265 wait complete. 2023-10-08T16:28:06.839 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:07.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.071+0000 7f5e79f9d700 1 Processor -- start 2023-10-08T16:28:07.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.071+0000 7f5e79f9d700 1 -- start start 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e79f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 0x7f5e740cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e79f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5e740cef40 0x7f5e7415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e79f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740cf3c0 con 0x7f5e74153c30 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e79f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7415afd0 con 0x7f5e7415de50 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e79f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e7415b2b0 con 0x7f5e740cef40 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e73fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 0x7f5e740cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e73fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 0x7f5e740cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54012/0 (socket says 172.21.15.12:54012) 2023-10-08T16:28:07.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e73fff700 1 -- 172.21.15.12:0/2621085654 learned_addr learned my addr 172.21.15.12:0/2621085654 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:07.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.073+0000 7f5e7979c700 1 --2- 172.21.15.12:0/2621085654 >> v2:172.21.15.29:3300/0 conn(0x7f5e740cef40 0x7f5e7415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e7979c700 1 -- 172.21.15.12:0/2621085654 >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 msgr2=0x7f5e740cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:07.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e7979c700 1 --2- 172.21.15.12:0/2621085654 >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 0x7f5e740cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e7979c700 1 -- 172.21.15.12:0/2621085654 >> v1:172.21.15.29:6789/0 conn(0x7f5e74153c30 legacy=0x7f5e7415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e7979c700 1 -- 172.21.15.12:0/2621085654 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7415b590 con 0x7f5e740cef40 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e7979c700 1 --2- 172.21.15.12:0/2621085654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e740cef40 0x7f5e7415c070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e740cdab0 tx=0x7f5e6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c69994417f45bba3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e737fe700 1 -- 172.21.15.12:0/2621085654 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c00e070 con 0x7f5e740cef40 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e737fe700 1 -- 172.21.15.12:0/2621085654 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6c00bb60 con 0x7f5e740cef40 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.074+0000 7f5e737fe700 1 -- 172.21.15.12:0/2621085654 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6c012430 con 0x7f5e740cef40 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 -- 172.21.15.12:0/2621085654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e740cef40 msgr2=0x7f5e7415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/2621085654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e740cef40 0x7f5e7415c070 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5e740cdab0 tx=0x7f5e6c009780 comp rx=0 tx=0).stop 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 -- 172.21.15.12:0/2621085654 shutdown_connections 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/2621085654 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e740cef40 0x7f5e7415c070 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/2621085654 >> v2:172.21.15.12:3300/0 conn(0x7f5e7415de50 0x7f5e740cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 -- 172.21.15.12:0/2621085654 >> 172.21.15.12:0/2621085654 conn(0x7f5e740703a0 msgr2=0x7f5e740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:07.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 -- 172.21.15.12:0/2621085654 shutdown_connections 2023-10-08T16:28:07.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.075+0000 7f5e79f9d700 1 -- 172.21.15.12:0/2621085654 wait complete. 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.076+0000 7f5e79f9d700 1 Processor -- start 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.077+0000 7f5e79f9d700 1 -- start start 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.077+0000 7f5e79f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e740cef40 0x7f5e74169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.077+0000 7f5e79f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e79f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e79f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740b4b10 con 0x7f5e7415de50 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e79f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740ca260 con 0x7f5e74153c30 2023-10-08T16:28:07.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e79f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cc5c0 con 0x7f5e740cef40 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e7979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e7979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54026/0 (socket says 172.21.15.12:54026) 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e78f9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e740cef40 0x7f5e74169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e7979c700 1 -- 172.21.15.12:0/3345387503 learned_addr learned my addr 172.21.15.12:0/3345387503 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46254/0 (socket says 172.21.15.12:46254) 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e740cef40 msgr2=0x7f5e74169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e740cef40 0x7f5e74169a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 msgr2=0x7f5e740c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e73fff700 1 -- 172.21.15.12:0/3345387503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009a20 con 0x7f5e74153c30 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.078+0000 7f5e7979c700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e73fff700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e60006fd0 tx=0x7f5e60009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60013680 con 0x7f5e74153c30 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e600137e0 con 0x7f5e74153c30 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e740c9f80 con 0x7f5e74153c30 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60013b60 con 0x7f5e74153c30 2023-10-08T16:28:07.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.079+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e740cc2d0 con 0x7f5e74153c30 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.080+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74146520 con 0x7f5e74153c30 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.081+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f5e600123d0 con 0x7f5e74153c30 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.082+0000 7f5e70ff9700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 0x7f5e58069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.082+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f5e60084c40 con 0x7f5e74153c30 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.082+0000 7f5e78f9b700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 msgr2=0x7f5e58069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:07.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.082+0000 7f5e78f9b700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 0x7f5e58069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.091+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e74146520 con 0x7f5e74153c30 2023-10-08T16:28:07.150 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:07.150+0000 7f0403e51180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:28:07.232 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:07.232+0000 7fdb206d9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:28:07.251 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:07.251+0000 7f0403e51180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:28:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.283+0000 7f5e78f9b700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 msgr2=0x7f5e58069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.283+0000 7f5e78f9b700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 0x7f5e58069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:07.334 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:07.334+0000 7fdb206d9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:28:07.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.345+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e74146520 con 0x7f5e74153c30 2023-10-08T16:28:07.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.346+0000 7f5e70ff9700 1 -- 172.21.15.12:0/3345387503 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5e74146520 con 0x7f5e74153c30 2023-10-08T16:28:07.346 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:07.347 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:28:07.347 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:07.347+0000 7f0403e51180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:28:07.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 msgr2=0x7f5e58069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:07.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 0x7f5e58069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 msgr2=0x7f5e74145f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e60006fd0 tx=0x7f5e60009250 comp rx=0 tx=0).stop 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 shutdown_connections 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5e58067170 0x7f5e58069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5e7415de50 0x7f5e740c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5e740cef40 0x7f5e74169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 --2- 172.21.15.12:0/3345387503 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5e74153c30 0x7f5e74145f20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 >> 172.21.15.12:0/3345387503 conn(0x7f5e740703a0 msgr2=0x7f5e740c5540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 shutdown_connections 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.349+0000 7f5e79f9d700 1 -- 172.21.15.12:0/3345387503 wait complete. 2023-10-08T16:28:07.351 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:28:07.367 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:07.432 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:07.432+0000 7fdb206d9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:28:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.557+0000 7f3ad099d700 1 Processor -- start 2023-10-08T16:28:07.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.557+0000 7f3ad099d700 1 -- start start 2023-10-08T16:28:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 0x7f3acc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 0x7f3acc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 0x7f3acc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc15afd0 con 0x7f3acc0cef40 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3acc15b2b0 con 0x7f3acc15de50 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3ad099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc15b590 con 0x7f3acc153c30 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3acbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 0x7f3acc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.558+0000 7f3acb7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 0x7f3acc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acaffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 0x7f3acc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acaffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 0x7f3acc0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46270/0 (socket says 172.21.15.12:46270) 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acaffd700 1 -- 172.21.15.12:0/1587480725 learned_addr learned my addr 172.21.15.12:0/1587480725 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:07.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acbfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 0x7f3acc06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54042/0 (socket says 172.21.15.12:54042) 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 -- 172.21.15.12:0/1587480725 >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 msgr2=0x7f3acc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/1587480725 >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 0x7f3acc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 -- 172.21.15.12:0/1587480725 >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 msgr2=0x7f3acc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/1587480725 >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 0x7f3acc06d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 -- 172.21.15.12:0/1587480725 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc15b870 con 0x7f3acc153c30 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/1587480725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 0x7f3acc15a5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3acc06e800 tx=0x7f3abc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7019e017252846e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.559+0000 7f3aca7fc700 1 -- 172.21.15.12:0/1587480725 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc011630 con 0x7f3acc153c30 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3aca7fc700 1 -- 172.21.15.12:0/1587480725 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3abc0117b0 con 0x7f3acc153c30 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3aca7fc700 1 -- 172.21.15.12:0/1587480725 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3abc011b70 con 0x7f3acc153c30 2023-10-08T16:28:07.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 -- 172.21.15.12:0/1587480725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 msgr2=0x7f3acc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 --2- 172.21.15.12:0/1587480725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 0x7f3acc15a5e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3acc06e800 tx=0x7f3abc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 -- 172.21.15.12:0/1587480725 shutdown_connections 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 --2- 172.21.15.12:0/1587480725 >> v2:172.21.15.12:3300/0 conn(0x7f3acc0cef40 0x7f3acc06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 --2- 172.21.15.12:0/1587480725 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc153c30 0x7f3acc15a5e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 --2- 172.21.15.12:0/1587480725 >> v2:172.21.15.29:3300/0 conn(0x7f3acc15de50 0x7f3acc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 -- 172.21.15.12:0/1587480725 >> 172.21.15.12:0/1587480725 conn(0x7f3acc0703a0 msgr2=0x7f3acc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 -- 172.21.15.12:0/1587480725 shutdown_connections 2023-10-08T16:28:07.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.560+0000 7f3ad099d700 1 -- 172.21.15.12:0/1587480725 wait complete. 2023-10-08T16:28:07.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.562+0000 7f3ad099d700 1 Processor -- start 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.562+0000 7f3ad099d700 1 -- start start 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 0x7f3acc140c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3acc153c30 0x7f3acc16d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc141320 con 0x7f3acc15de50 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0b3f20 con 0x7f3acc153c30 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3ad099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3acc0b4200 con 0x7f3acc0cef40 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3acbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3acaffd700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3acc153c30 0x7f3acc16d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.565 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3acbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54058/0 (socket says 172.21.15.12:54058) 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3acbfff700 1 -- 172.21.15.12:0/388306484 learned_addr learned my addr 172.21.15.12:0/388306484 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.563+0000 7f3acb7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 0x7f3acc140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 msgr2=0x7f3acc140c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 0x7f3acc140c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3acc153c30 msgr2=0x7f3acc16d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3acc153c30 0x7f3acc16d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 -- 172.21.15.12:0/388306484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc009420 con 0x7f3acc15de50 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 0x7f3acc140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3acbfff700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009e90 tx=0x7f3ac400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac400cb70 con 0x7f3acc15de50 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ac400f040 con 0x7f3acc15de50 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3acc0b44e0 con 0x7f3acc15de50 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac4014480 con 0x7f3acc15de50 2023-10-08T16:28:07.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.564+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3acc0b4aa0 con 0x7f3acc15de50 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.565+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3acc0b4cc0 con 0x7f3acc15de50 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.566+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f3ac40147f0 con 0x7f3acc15de50 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.567+0000 7f3ab37fe700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 0x7f3ab8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.567+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f3ac4085670 con 0x7f3acc15de50 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.567+0000 7f3acb7fe700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 msgr2=0x7f3ab8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:07.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.567+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 0x7f3ab8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:07.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.571+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ac4052210 con 0x7f3acc15de50 2023-10-08T16:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.768+0000 7f3acb7fe700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 msgr2=0x7f3ab8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.768+0000 7f3acb7fe700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 0x7f3ab8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:07.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.780+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3acc04c3c0 con 0x7f3acc15de50 2023-10-08T16:28:07.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.781+0000 7f3ab37fe700 1 -- 172.21.15.12:0/388306484 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16376 (secure 0 0 0) 0x7f3ac4059e60 con 0x7f3acc15de50 2023-10-08T16:28:07.781 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:07.782 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":130,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:44.729280+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/4094836460":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6837/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6836/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/2792310995":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/1657489760":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/3455412283":"2023-10-09T16:27:44.729247+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:07.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 msgr2=0x7f3ab8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 0x7f3ab8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 msgr2=0x7f3acc16d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4009e90 tx=0x7f3ac400b040 comp rx=0 tx=0).stop 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 shutdown_connections 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3ab8067170 0x7f3ab8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3acc15de50 0x7f3acc16d810 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3acc0cef40 0x7f3acc140c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 --2- 172.21.15.12:0/388306484 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3acc153c30 0x7f3acc16d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:07.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 >> 172.21.15.12:0/388306484 conn(0x7f3acc0703a0 msgr2=0x7f3acc153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:07.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 shutdown_connections 2023-10-08T16:28:07.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:07.784+0000 7f3ad099d700 1 -- 172.21.15.12:0/388306484 wait complete. 2023-10-08T16:28:07.801 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T16:28:07.802 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:08.003 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:08.003+0000 7f0403e51180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.011+0000 7f1a93fff700 1 Processor -- start 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.011+0000 7f1a93fff700 1 -- start start 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.013+0000 7f1a93fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a94166260 0x7f1a9406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a93fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940c9d00 con 0x7f1a94087a10 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a93fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a940ca5a0 con 0x7f1a940c7000 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a93fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a9406eef0 con 0x7f1a94166260 2023-10-08T16:28:08.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a937fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1a94087a10 0x7f1a940caa30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32810/0 (socket says 172.21.15.12:32810) 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a937fe700 1 -- 172.21.15.12:0/1408498697 learned_addr learned my addr 172.21.15.12:0/1408498697 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.014+0000 7f1a92ffd700 1 --2- 172.21.15.12:0/1408498697 >> v2:172.21.15.29:3300/0 conn(0x7f1a94166260 0x7f1a9406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1408498697 >> v1:172.21.15.29:6789/0 conn(0x7f1a940c7000 legacy=0x7f1a94087300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a91ffb700 1 -- 172.21.15.12:0/1408498697 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375533145 0 0) 0x7f1a940c9d00 con 0x7f1a94087a10 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1408498697 >> v1:172.21.15.12:6789/0 conn(0x7f1a94087a10 legacy=0x7f1a940caa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1408498697 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a940c9f50 con 0x7f1a94166260 2023-10-08T16:28:08.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a92ffd700 1 --2- 172.21.15.12:0/1408498697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94166260 0x7f1a9406e860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1a84010cd0 tx=0x7f1a8400a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381bab0d60881741 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:08.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.015+0000 7f1a91ffb700 1 -- 172.21.15.12:0/1408498697 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8400be70 con 0x7f1a94166260 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a91ffb700 1 -- 172.21.15.12:0/1408498697 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a84006b10 con 0x7f1a94166260 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a91ffb700 1 -- 172.21.15.12:0/1408498697 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a84007030 con 0x7f1a94166260 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a93fff700 1 -- 172.21.15.12:0/1408498697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94166260 msgr2=0x7f1a9406e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1408498697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94166260 0x7f1a9406e860 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1a84010cd0 tx=0x7f1a8400a0f0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a93fff700 1 -- 172.21.15.12:0/1408498697 shutdown_connections 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1408498697 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a94166260 0x7f1a9406e860 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.016+0000 7f1a93fff700 1 -- 172.21.15.12:0/1408498697 >> 172.21.15.12:0/1408498697 conn(0x7f1a9406d130 msgr2=0x7f1a940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.017+0000 7f1a93fff700 1 -- 172.21.15.12:0/1408498697 shutdown_connections 2023-10-08T16:28:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.017+0000 7f1a93fff700 1 -- 172.21.15.12:0/1408498697 wait complete. 2023-10-08T16:28:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.020+0000 7f1a93fff700 1 Processor -- start 2023-10-08T16:28:08.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.020+0000 7f1a93fff700 1 -- start start 2023-10-08T16:28:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.022+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.022+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a940c7000 0x7f1a94179110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.022+0000 7f1a93fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 0x7f1a940c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a93fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a941770a0 con 0x7f1a94087a10 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a93fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a94069d90 con 0x7f1a940c7000 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a93fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a9406a070 con 0x7f1a94166260 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a92ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54066/0 (socket says 172.21.15.12:54066) 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1054744150 learned_addr learned my addr 172.21.15.12:0/1054744150 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a937fe700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 0x7f1a940c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.023+0000 7f1a937fe700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a940c7000 msgr2=0x7f1a94179110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-08T16:28:08.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a937fe700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a940c7000 0x7f1a94179110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a937fe700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 msgr2=0x7f1a941774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a937fe700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a937fe700 1 -- 172.21.15.12:0/1054744150 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a840107c0 con 0x7f1a94166260 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a937fe700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 0x7f1a940c33f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a940c9c20 tx=0x7f1a8c0074a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a92ffd700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00d040 con 0x7f1a94166260 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8c00a610 con 0x7f1a94166260 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8c00a9b0 con 0x7f1a94166260 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.024+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a9406a350 con 0x7f1a94166260 2023-10-08T16:28:08.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.025+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a940c3930 con 0x7f1a94166260 2023-10-08T16:28:08.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.026+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a9404c3c0 con 0x7f1a94166260 2023-10-08T16:28:08.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.031+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f1a8c01b460 con 0x7f1a94166260 2023-10-08T16:28:08.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.033+0000 7f1a7affd700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 0x7f1a80069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.033+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f1a8c084ca0 con 0x7f1a94166260 2023-10-08T16:28:08.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.034+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 msgr2=0x7f1a80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:08.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.034+0000 7f1a92ffd700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 0x7f1a80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:08.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.035+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a8c051a00 con 0x7f1a94166260 2023-10-08T16:28:08.102 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:08.102+0000 7fdb206d9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:28:08.186 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:08.186+0000 7f0403e51180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:08.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.235+0000 7f1a92ffd700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 msgr2=0x7f1a80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.235+0000 7f1a92ffd700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 0x7f1a80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:08.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.285+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a940ca230 con 0x7f1a94166260 2023-10-08T16:28:08.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.286+0000 7f1a7affd700 1 -- 172.21.15.12:0/1054744150 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f1a8c055020 con 0x7f1a94166260 2023-10-08T16:28:08.285 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:08.286 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:28:08.286 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:08.286+0000 7fdb206d9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:08.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 msgr2=0x7f1a80069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:08.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 0x7f1a80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 msgr2=0x7f1a940c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 0x7f1a940c33f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1a940c9c20 tx=0x7f1a8c0074a0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 shutdown_connections 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a80067170 0x7f1a80069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a94087a10 0x7f1a941774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a94166260 0x7f1a940c33f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 --2- 172.21.15.12:0/1054744150 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a940c7000 0x7f1a94179110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 >> 172.21.15.12:0/1054744150 conn(0x7f1a9406d130 msgr2=0x7f1a94164a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 shutdown_connections 2023-10-08T16:28:08.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.288+0000 7f1a93fff700 1 -- 172.21.15.12:0/1054744150 wait complete. 2023-10-08T16:28:08.290 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:08.288+0000 7f0403e51180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:28:08.290 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:28:08.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:08.393 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:08.393+0000 7fdb206d9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:28:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.499+0000 7efca259d700 1 Processor -- start 2023-10-08T16:28:08.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.499+0000 7efca259d700 1 -- start start 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc9c15de50 0x7efc9c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c0cef40 0x7efc9c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca259d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0cf3c0 con 0x7efc9c153c30 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c15afd0 con 0x7efc9c15de50 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c15b2b0 con 0x7efc9c0cef40 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca159b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc9c153c30 0x7efc9c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32814/0 (socket says 172.21.15.12:32814) 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca159b700 1 -- 172.21.15.12:0/3216435891 learned_addr learned my addr 172.21.15.12:0/3216435891 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:08.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca0d9a700 1 --2- 172.21.15.12:0/3216435891 >> v2:172.21.15.29:3300/0 conn(0x7efc9c15de50 0x7efc9c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca1d9c700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c0cef40 0x7efc9c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efc93fff700 1 -- 172.21.15.12:0/3216435891 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 502333017 0 0) 0x7efc9c0cf3c0 con 0x7efc9c153c30 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efc93fff700 1 -- 172.21.15.12:0/3216435891 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc88003570 con 0x7efc9c153c30 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca0d9a700 1 -- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c0cef40 msgr2=0x7efc9c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.501+0000 7efca0d9a700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c0cef40 0x7efc9c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efca0d9a700 1 -- 172.21.15.12:0/3216435891 >> v1:172.21.15.12:6789/0 conn(0x7efc9c153c30 legacy=0x7efc9c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efca0d9a700 1 -- 172.21.15.12:0/3216435891 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c15b590 con 0x7efc9c15de50 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efca0d9a700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c15de50 0x7efc9c0cea00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098e0 tx=0x7efc8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4913e7b252fbec server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efc93fff700 1 -- 172.21.15.12:0/3216435891 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c011630 con 0x7efc9c15de50 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efc93fff700 1 -- 172.21.15.12:0/3216435891 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c011790 con 0x7efc9c15de50 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.502+0000 7efc93fff700 1 -- 172.21.15.12:0/3216435891 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c011b30 con 0x7efc9c15de50 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 -- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c15de50 msgr2=0x7efc9c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c15de50 0x7efc9c0cea00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0098e0 tx=0x7efc8c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 -- 172.21.15.12:0/3216435891 shutdown_connections 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c0cef40 0x7efc9c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 --2- 172.21.15.12:0/3216435891 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c15de50 0x7efc9c0cea00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 -- 172.21.15.12:0/3216435891 >> 172.21.15.12:0/3216435891 conn(0x7efc9c0703a0 msgr2=0x7efc9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 -- 172.21.15.12:0/3216435891 shutdown_connections 2023-10-08T16:28:08.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.503+0000 7efca259d700 1 -- 172.21.15.12:0/3216435891 wait complete. 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.505+0000 7efca259d700 1 Processor -- start 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.505+0000 7efca259d700 1 -- start start 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 0x7efc9c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c153c30 0x7efc9c0b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0b35d0 con 0x7efc9c15de50 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0b6300 con 0x7efc9c0cef40 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0cb1b0 con 0x7efc9c153c30 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 0x7efc9c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca1d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54080/0 (socket says 172.21.15.12:54080) 2023-10-08T16:28:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca1d9c700 1 -- 172.21.15.12:0/965264961 learned_addr learned my addr 172.21.15.12:0/965264961 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:08.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca0d9a700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c153c30 0x7efc9c0b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c153c30 msgr2=0x7efc9c0b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c153c30 0x7efc9c0b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 msgr2=0x7efc9c0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca159b700 1 -- 172.21.15.12:0/965264961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c009420 con 0x7efc9c0cef40 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.506+0000 7efca1d9c700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efca159b700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 0x7efc9c0c7620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c580 tx=0x7efc98007d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98005b30 con 0x7efc9c0cef40 2023-10-08T16:28:08.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98005cb0 con 0x7efc9c0cef40 2023-10-08T16:28:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98007320 con 0x7efc9c0cef40 2023-10-08T16:28:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c0cb490 con 0x7efc9c0cef40 2023-10-08T16:28:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.507+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c0cba50 con 0x7efc9c0cef40 2023-10-08T16:28:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.509+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c04c3c0 con 0x7efc9c0cef40 2023-10-08T16:28:08.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.509+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7efc9801b3b0 con 0x7efc9c0cef40 2023-10-08T16:28:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.510+0000 7efc917fa700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 0x7efc80069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.510+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7efc98083ff0 con 0x7efc9c0cef40 2023-10-08T16:28:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.510+0000 7efca0d9a700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 msgr2=0x7efc80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:08.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.510+0000 7efca0d9a700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 0x7efc80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:08.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.518+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc98050ca0 con 0x7efc9c0cef40 2023-10-08T16:28:08.598 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:08.598+0000 7f0403e51180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:28:08.699 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:08.700+0000 7f0403e51180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:28:08.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.711+0000 7efca0d9a700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 msgr2=0x7efc80069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:08.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.711+0000 7efca0d9a700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 0x7efc80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:08.722 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:08.723+0000 7fdb206d9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:28:08.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.797+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc9c0caef0 con 0x7efc9c0cef40 2023-10-08T16:28:08.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.798+0000 7efc917fa700 1 -- 172.21.15.12:0/965264961 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4599 (secure 0 0 0) 0x7efc98017020 con 0x7efc9c0cef40 2023-10-08T16:28:08.798 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:08.798 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":57,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:27:28.839508+0000","modified":"2023-10-08T16:27:32.382120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7776},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7776":{"gid":7776,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4259979226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":4259979226},{"type":"v1","addr":"172.21.15.29:6835","nonce":4259979226}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-08T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 msgr2=0x7efc80069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 0x7efc80069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 msgr2=0x7efc9c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 0x7efc9c0c7620 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7efc9800c580 tx=0x7efc98007d50 comp rx=0 tx=0).stop 2023-10-08T16:28:08.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 shutdown_connections 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80067170 0x7efc80069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c15de50 0x7efc9c0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0cef40 0x7efc9c0c7620 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 --2- 172.21.15.12:0/965264961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c153c30 0x7efc9c0b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 >> 172.21.15.12:0/965264961 conn(0x7efc9c0703a0 msgr2=0x7efc9c0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 shutdown_connections 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:08.801+0000 7efca259d700 1 -- 172.21.15.12:0/965264961 wait complete. 2023-10-08T16:28:08.802 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 57 2023-10-08T16:28:08.819 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:08.824 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:08.825+0000 7fdb206d9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:28:09.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.008+0000 7f2acedff700 1 Processor -- start 2023-10-08T16:28:09.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.009+0000 7f2acedff700 1 -- start start 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ac815d440 0x7f2ac80aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ac806c6a0 0x7f2ac806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac815d810 0x7f2ac815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac806d080 con 0x7f2ac815d440 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac815a750 con 0x7f2ac806c6a0 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acedff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8159e40 con 0x7f2ac815d810 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2accb9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ac815d440 0x7f2ac80aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2accb9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2ac815d440 0x7f2ac80aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54094/0 (socket says 172.21.15.12:54094) 2023-10-08T16:28:09.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2accb9b700 1 -- 172.21.15.12:0/2602977105 learned_addr learned my addr 172.21.15.12:0/2602977105 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2ac7fff700 1 --2- 172.21.15.12:0/2602977105 >> v2:172.21.15.29:3300/0 conn(0x7f2ac806c6a0 0x7f2ac806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.010+0000 7f2acd39c700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac815d810 0x7f2ac815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 -- 172.21.15.12:0/2602977105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac815d810 msgr2=0x7f2ac815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac815d810 0x7f2ac815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 -- 172.21.15.12:0/2602977105 >> v2:172.21.15.29:3300/0 conn(0x7f2ac806c6a0 msgr2=0x7f2ac806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 --2- 172.21.15.12:0/2602977105 >> v2:172.21.15.29:3300/0 conn(0x7f2ac806c6a0 0x7f2ac806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 -- 172.21.15.12:0/2602977105 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80af300 con 0x7f2ac815d440 2023-10-08T16:28:09.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2accb9b700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac80aec90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2ac815a6c0 tx=0x7f2abc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90839dda1fd48ecb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2ac77fe700 1 -- 172.21.15.12:0/2602977105 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc009e70 con 0x7f2ac815d440 2023-10-08T16:28:09.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2ac77fe700 1 -- 172.21.15.12:0/2602977105 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00b860 con 0x7f2ac815d440 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.011+0000 7f2ac77fe700 1 -- 172.21.15.12:0/2602977105 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00bc00 con 0x7f2ac815d440 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 -- 172.21.15.12:0/2602977105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 msgr2=0x7f2ac80aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac80aec90 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f2ac815a6c0 tx=0x7f2abc009250 comp rx=0 tx=0).stop 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 -- 172.21.15.12:0/2602977105 shutdown_connections 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac815d810 0x7f2ac815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 --2- 172.21.15.12:0/2602977105 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac80aec90 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 --2- 172.21.15.12:0/2602977105 >> v2:172.21.15.29:3300/0 conn(0x7f2ac806c6a0 0x7f2ac806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 -- 172.21.15.12:0/2602977105 >> 172.21.15.12:0/2602977105 conn(0x7f2ac806f190 msgr2=0x7f2ac80ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 -- 172.21.15.12:0/2602977105 shutdown_connections 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.012+0000 7f2acedff700 1 -- 172.21.15.12:0/2602977105 wait complete. 2023-10-08T16:28:09.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.014+0000 7f2acedff700 1 Processor -- start 2023-10-08T16:28:09.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.014+0000 7f2acedff700 1 -- start start 2023-10-08T16:28:09.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac806c6a0 0x7f2ac816a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 0x7f2ac81489d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac8147290 con 0x7f2ac815d440 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac81483d0 con 0x7f2ac815d810 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acedff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac816a8e0 con 0x7f2ac806c6a0 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2accb9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac806c6a0 0x7f2ac816a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54100/0 (socket says 172.21.15.12:54100) 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 -- 172.21.15.12:0/3293738727 learned_addr learned my addr 172.21.15.12:0/3293738727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2acd39c700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 0x7f2ac81489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac806c6a0 msgr2=0x7f2ac816a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac806c6a0 0x7f2ac816a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.015+0000 7f2ac7fff700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 msgr2=0x7f2ac81489d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac7fff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 0x7f2ac81489d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac7fff700 1 -- 172.21.15.12:0/3293738727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc0094f0 con 0x7f2ac815d440 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2acd39c700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 0x7f2ac81489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac7fff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400e930 tx=0x7f2ab40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4013680 con 0x7f2ac815d440 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab40137e0 con 0x7f2ac815d440 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab4013b80 con 0x7f2ac815d440 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac8146680 con 0x7f2ac815d440 2023-10-08T16:28:09.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.016+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac8146c40 con 0x7f2ac815d440 2023-10-08T16:28:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.017+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac8147400 con 0x7f2ac815d440 2023-10-08T16:28:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.018+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f2ab400c3e0 con 0x7f2ac815d440 2023-10-08T16:28:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.019+0000 7f2ac4ff9700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 0x7f2aac069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.019+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6355+0+0 (secure 0 0 0) 0x7f2ab4084cb0 con 0x7f2ac815d440 2023-10-08T16:28:09.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.019+0000 7f2accb9b700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 msgr2=0x7f2aac069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:09.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.019+0000 7f2accb9b700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 0x7f2aac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:09.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.023+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ab4051960 con 0x7f2ac815d440 2023-10-08T16:28:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.220+0000 7f2accb9b700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 msgr2=0x7f2aac069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:09.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.220+0000 7f2accb9b700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 0x7f2aac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:09.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.227+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ac804c3c0 con 0x7f2ac815d440 2023-10-08T16:28:09.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.228+0000 7f2ac4ff9700 1 -- 172.21.15.12:0/3293738727 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16376 (secure 0 0 0) 0x7f2ab4054f80 con 0x7f2ac815d440 2023-10-08T16:28:09.228 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:09.228 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":130,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:27:44.729280+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:27:27.038847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-08T16:27:27.818753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/4094836460":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6837/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:6836/115415":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/2792310995":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/1657489760":"2023-10-09T16:27:44.729247+0000","172.21.15.12:0/3455412283":"2023-10-09T16:27:44.729247+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:09.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 msgr2=0x7f2aac069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:09.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 0x7f2aac069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 msgr2=0x7f2ac814c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400e930 tx=0x7f2ab40091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 shutdown_connections 2023-10-08T16:28:09.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2aac067170 0x7f2aac069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ac815d810 0x7f2ac81489d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ac806c6a0 0x7f2ac816a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 --2- 172.21.15.12:0/3293738727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ac815d440 0x7f2ac814c230 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.230+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 >> 172.21.15.12:0/3293738727 conn(0x7f2ac806f190 msgr2=0x7f2ac815c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.231+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 shutdown_connections 2023-10-08T16:28:09.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.231+0000 7f2acedff700 1 -- 172.21.15.12:0/3293738727 wait complete. 2023-10-08T16:28:09.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T16:28:09.452 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:09.452+0000 7f0403e51180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:28:09.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.488+0000 7fa30539d700 1 Processor -- start 2023-10-08T16:28:09.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.488+0000 7fa30539d700 1 -- start start 2023-10-08T16:28:09.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.489+0000 7fa30539d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3000cf110 0x7fa300164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.489+0000 7fa30539d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30015afd0 con 0x7fa300153c30 2023-10-08T16:28:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.489+0000 7fa30539d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30015b2b0 con 0x7fa30015de50 2023-10-08T16:28:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.489+0000 7fa30539d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30015b590 con 0x7fa3000cf110 2023-10-08T16:28:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa2fffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa300153c30 0x7fa30015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32828/0 (socket says 172.21.15.12:32828) 2023-10-08T16:28:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa2fffff700 1 -- 172.21.15.12:0/1869214592 learned_addr learned my addr 172.21.15.12:0/1869214592 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:09.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa304b9c700 1 --2- 172.21.15.12:0/1869214592 >> v2:172.21.15.29:3300/0 conn(0x7fa3000cf110 0x7fa300164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa2feffd700 1 -- 172.21.15.12:0/1869214592 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224086437 0 0) 0x7fa30015afd0 con 0x7fa300153c30 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa2feffd700 1 -- 172.21.15.12:0/1869214592 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e8003570 con 0x7fa300153c30 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa304b9c700 1 -- 172.21.15.12:0/1869214592 >> v1:172.21.15.29:6789/0 conn(0x7fa30015de50 legacy=0x7fa3000cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa304b9c700 1 -- 172.21.15.12:0/1869214592 >> v1:172.21.15.12:6789/0 conn(0x7fa300153c30 legacy=0x7fa30015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.490+0000 7fa304b9c700 1 -- 172.21.15.12:0/1869214592 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30015b870 con 0x7fa3000cf110 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.491+0000 7fa304b9c700 1 --2- 172.21.15.12:0/1869214592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300164600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e60 tx=0x7fa2f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3552c734c5de6e51 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.491+0000 7fa2feffd700 1 -- 172.21.15.12:0/1869214592 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800e070 con 0x7fa3000cf110 2023-10-08T16:28:09.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.491+0000 7fa2feffd700 1 -- 172.21.15.12:0/1869214592 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800bb60 con 0x7fa3000cf110 2023-10-08T16:28:09.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.491+0000 7fa2feffd700 1 -- 172.21.15.12:0/1869214592 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8012430 con 0x7fa3000cf110 2023-10-08T16:28:09.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 -- 172.21.15.12:0/1869214592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 msgr2=0x7fa300164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 --2- 172.21.15.12:0/1869214592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300164600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8009e60 tx=0x7fa2f8009780 comp rx=0 tx=0).stop 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 -- 172.21.15.12:0/1869214592 shutdown_connections 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 --2- 172.21.15.12:0/1869214592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300164600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 -- 172.21.15.12:0/1869214592 >> 172.21.15.12:0/1869214592 conn(0x7fa3000703a0 msgr2=0x7fa3000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 -- 172.21.15.12:0/1869214592 shutdown_connections 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.492+0000 7fa30539d700 1 -- 172.21.15.12:0/1869214592 wait complete. 2023-10-08T16:28:09.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.493+0000 7fa30539d700 1 Processor -- start 2023-10-08T16:28:09.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.493+0000 7fa30539d700 1 -- start start 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa30015de50 0x7fa3000cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c9310 con 0x7fa300153c30 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c8740 con 0x7fa3000cf110 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.494+0000 7fa30539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c89e0 con 0x7fa30015de50 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2fffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54102/0 (socket says 172.21.15.12:54102) 2023-10-08T16:28:09.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 -- 172.21.15.12:0/684717573 learned_addr learned my addr 172.21.15.12:0/684717573 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa304b9c700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa30015de50 0x7fa3000cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa30015de50 msgr2=0x7fa3000cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa30015de50 0x7fa3000cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 msgr2=0x7fa300152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 -- 172.21.15.12:0/684717573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f8009a20 con 0x7fa300153c30 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2ff7fe700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c590 tx=0x7fa2f4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.495+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011590 con 0x7fa300153c30 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.496+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4011730 con 0x7fa300153c30 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.496+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011af0 con 0x7fa300153c30 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.496+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000c8cc0 con 0x7fa300153c30 2023-10-08T16:28:09.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.496+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa300153100 con 0x7fa300153c30 2023-10-08T16:28:09.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.497+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30004c3c0 con 0x7fa300153c30 2023-10-08T16:28:09.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.498+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fa2f4012420 con 0x7fa300153c30 2023-10-08T16:28:09.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.499+0000 7fa2e7fff700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 0x7fa2ec069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.499+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6411+0+0 (secure 0 0 0) 0x7fa2f4083d20 con 0x7fa300153c30 2023-10-08T16:28:09.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.499+0000 7fa2fffff700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 msgr2=0x7fa2ec069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:09.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.499+0000 7fa2fffff700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 0x7fa2ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:09.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.503+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2f404b5a0 con 0x7fa300153c30 2023-10-08T16:28:09.592 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:09.592+0000 7fdb206d9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:28:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.700+0000 7fa2fffff700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 msgr2=0x7fa2ec069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:09.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.700+0000 7fa2fffff700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 0x7fa2ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:09.747 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:09.747+0000 7f0403e51180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:28:09.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.751+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa3000b2d50 con 0x7fa300153c30 2023-10-08T16:28:09.751 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T16:28:09.751+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T16:28:09.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.759+0000 7fa2e7fff700 1 -- 172.21.15.12:0/684717573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa2f4017070 con 0x7fa300153c30 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 msgr2=0x7fa2ec069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 0x7fa2ec069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 msgr2=0x7fa3000b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c590 tx=0x7fa2f4007f30 comp rx=0 tx=0).stop 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 shutdown_connections 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa2ec067170 0x7fa2ec069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa30015de50 0x7fa3000cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3000cf110 0x7fa300152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 --2- 172.21.15.12:0/684717573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa300153c30 0x7fa3000b32d0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 >> 172.21.15.12:0/684717573 conn(0x7fa3000703a0 msgr2=0x7fa300070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 shutdown_connections 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.763+0000 7fa30539d700 1 -- 172.21.15.12:0/684717573 wait complete. 2023-10-08T16:28:09.764 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T16:28:09.765 INFO:tasks.ceph.mds.b.smithi029.stderr: -5012> 2023-10-08T16:27:34.335+0000 7f1bc95f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:28:09.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T16:28:09.811 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:28:09.850 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:09.850+0000 7f0403e51180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:28:09.891 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:09.891+0000 7fdb206d9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.977+0000 7fae043ff700 1 Processor -- start 2023-10-08T16:28:09.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.977+0000 7fae043ff700 1 -- start start 2023-10-08T16:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.978+0000 7fae043ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.978+0000 7fae043ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.978+0000 7fae043ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0ccfd0 con 0x7fadfc06dc70 2023-10-08T16:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.978+0000 7fae043ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc0cf0e0 con 0x7fadfc06e0e0 2023-10-08T16:28:09.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.978+0000 7fae043ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc15a3d0 con 0x7fadfc159530 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0299c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0299c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46338/0 (socket says 172.21.15.12:46338) 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0199a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fadfc06dc70 0x7fadfc159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:43512/0 (socket says 172.21.15.12:43512) 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:58766/0 (socket says 172.21.15.12:58766) 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0299c700 1 -- 172.21.15.12:0/2955278989 learned_addr learned my addr 172.21.15.12:0/2955278989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae01199700 1 -- 172.21.15.12:0/2955278989 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340233817 0 0) 0x7fadfc0ccfd0 con 0x7fadfc06dc70 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 -- 172.21.15.12:0/2955278989 >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 msgr2=0x7fadfc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 --2- 172.21.15.12:0/2955278989 >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 -- 172.21.15.12:0/2955278989 >> v1:172.21.15.29:6789/0 conn(0x7fadfc06dc70 legacy=0x7fadfc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0219b700 1 -- 172.21.15.12:0/2955278989 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc15a6b0 con 0x7fadfc159530 2023-10-08T16:28:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.979+0000 7fae0299c700 1 --2- 172.21.15.12:0/2955278989 >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae0219b700 1 --2- 172.21.15.12:0/2955278989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c93c027ee0a3149e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae01199700 1 -- 172.21.15.12:0/2955278989 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800b640 con 0x7fadfc159530 2023-10-08T16:28:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae01199700 1 -- 172.21.15.12:0/2955278989 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf800b7a0 con 0x7fadfc159530 2023-10-08T16:28:09.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae01199700 1 -- 172.21.15.12:0/2955278989 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800bb40 con 0x7fadfc159530 2023-10-08T16:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae043ff700 1 -- 172.21.15.12:0/2955278989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 msgr2=0x7fadfc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.980+0000 7fae043ff700 1 --2- 172.21.15.12:0/2955278989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098e0 tx=0x7fadf80091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 -- 172.21.15.12:0/2955278989 shutdown_connections 2023-10-08T16:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 --2- 172.21.15.12:0/2955278989 >> v2:172.21.15.29:3300/0 conn(0x7fadfc06e0e0 0x7fadfc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 --2- 172.21.15.12:0/2955278989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc159530 0x7fadfc0ceba0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 -- 172.21.15.12:0/2955278989 >> 172.21.15.12:0/2955278989 conn(0x7fadfc0703a0 msgr2=0x7fadfc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 -- 172.21.15.12:0/2955278989 shutdown_connections 2023-10-08T16:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.981+0000 7fae043ff700 1 -- 172.21.15.12:0/2955278989 wait complete. 2023-10-08T16:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.982+0000 7fae043ff700 1 Processor -- start 2023-10-08T16:28:09.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.982+0000 7fae043ff700 1 -- start start 2023-10-08T16:28:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc06e0e0 0x7fadfc0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 0x7fadfc0c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc15bf00 con 0x7fadfc159530 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc15c1e0 con 0x7fadfc06dc70 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae043ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc14e640 con 0x7fadfc06e0e0 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae0299c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 0x7fadfc0c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae0219b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae0219b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46346/0 (socket says 172.21.15.12:46346) 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae0219b700 1 -- 172.21.15.12:0/795255722 learned_addr learned my addr 172.21.15.12:0/795255722 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.983+0000 7fae0199a700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc06e0e0 0x7fadfc0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc06e0e0 msgr2=0x7fadfc0c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc06e0e0 0x7fadfc0c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 msgr2=0x7fadfc0c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 0x7fadfc0c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 -- 172.21.15.12:0/795255722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf4009ae0 con 0x7fadfc06dc70 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0299c700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 0x7fadfc0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fae0219b700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fadf80093f0 tx=0x7fadf8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.984+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf800bb20 con 0x7fadfc06dc70 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.985+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8000c90 con 0x7fadfc06dc70 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.985+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8011650 con 0x7fadfc06dc70 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.985+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf8009420 con 0x7fadfc06dc70 2023-10-08T16:28:09.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.985+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc0c9df0 con 0x7fadfc06dc70 2023-10-08T16:28:09.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.986+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc04c3c0 con 0x7fadfc06dc70 2023-10-08T16:28:09.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.988+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 58) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fadf8011a00 con 0x7fadfc06dc70 2023-10-08T16:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.990+0000 7fadf27fc700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:09.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.990+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6469+0+0 (secure 0 0 0) 0x7fadf80863d0 con 0x7fadfc06dc70 2023-10-08T16:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.991+0000 7fae0199a700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 msgr2=0x7fade00696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:09.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.991+0000 7fae0199a700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:09.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:09.996+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf8053010 con 0x7fadfc06dc70 2023-10-08T16:28:09.999 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:09.999+0000 7fdb206d9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:28:10.018 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.018+0000 7f0403e51180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:28:10.128 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.128+0000 7f0403e51180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:28:10.165 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.165+0000 7fdb206d9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:28:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.192+0000 7fae0199a700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 msgr2=0x7fade00696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.192+0000 7fae0199a700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:10.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.246+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fadfc15a990 con 0x7fadfc06dc70 2023-10-08T16:28:10.278 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.278+0000 7fdb206d9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:28:10.328 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.328+0000 7f0403e51180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:28:10.425 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.425+0000 7f0403e51180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:28:10.481 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.482+0000 7fdb206d9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:28:10.522 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.522+0000 7f0403e51180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:28:10.580 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.580+0000 7fdb206d9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:28:10.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.593+0000 7fae0199a700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 msgr2=0x7fade00696a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:10.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.593+0000 7fae0199a700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:28:10.621 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:10.620+0000 7f0403e51180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:28:10.677 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.677+0000 7fdb206d9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:28:10.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.757+0000 7fadf27fc700 1 -- 172.21.15.12:0/795255722 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7fadf8011cb0 con 0x7fadfc06dc70 2023-10-08T16:28:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 msgr2=0x7fade00696a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 msgr2=0x7fadfc14d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fadf80093f0 tx=0x7fadf8017000 comp rx=0 tx=0).stop 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 shutdown_connections 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fade00671f0 0x7fade00696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fadfc159530 0x7fadfc0c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fadfc06dc70 0x7fadfc14d2f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 --2- 172.21.15.12:0/795255722 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fadfc06e0e0 0x7fadfc0c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 >> 172.21.15.12:0/795255722 conn(0x7fadfc0703a0 msgr2=0x7fadfc0d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 shutdown_connections 2023-10-08T16:28:10.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.760+0000 7fae043ff700 1 -- 172.21.15.12:0/795255722 wait complete. 2023-10-08T16:28:10.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T16:28:10.784 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:10.781+0000 7fdb206d9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:28:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.986+0000 7f8ce699d700 1 Processor -- start 2023-10-08T16:28:10.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.986+0000 7f8ce699d700 1 -- start start 2023-10-08T16:28:10.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce699d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ce0153660 0x7f8ce00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce699d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce00c2200 con 0x7f8ce00c8980 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce699d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce0157250 con 0x7f8ce0153660 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce00c15f0 con 0x7f8ce0153a30 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ce0153660 0x7f8ce00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8ce0153660 0x7f8ce00c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54204/0 (socket says 172.21.15.12:54204) 2023-10-08T16:28:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce599b700 1 -- 172.21.15.12:0/2942637587 learned_addr learned my addr 172.21.15.12:0/2942637587 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce619c700 1 --1- 172.21.15.12:0/2942637587 >> v1:172.21.15.12:6789/0 conn(0x7f8ce00c8980 0x7f8ce00c8e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:32840/0 (socket says 172.21.15.12:32840) 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.987+0000 7f8ce519a700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce599b700 1 -- 172.21.15.12:0/2942637587 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 msgr2=0x7f8ce0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce599b700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce0156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce599b700 1 -- 172.21.15.12:0/2942637587 >> v1:172.21.15.12:6789/0 conn(0x7f8ce00c8980 legacy=0x7f8ce00c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce599b700 1 -- 172.21.15.12:0/2942637587 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce00c18d0 con 0x7f8ce0153660 2023-10-08T16:28:10.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce4999700 1 -- 172.21.15.12:0/2942637587 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210114278 0 0) 0x7f8ce00c2200 con 0x7f8ce00c8980 2023-10-08T16:28:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce599b700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce0153660 0x7f8ce00c0ef0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0099b0 tx=0x7f8cdc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a7c1cd3aaca35e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.988+0000 7f8ce4999700 1 -- 172.21.15.12:0/2942637587 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc009ea0 con 0x7f8ce0153660 2023-10-08T16:28:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce4999700 1 -- 172.21.15.12:0/2942637587 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00b860 con 0x7f8ce0153660 2023-10-08T16:28:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce4999700 1 -- 172.21.15.12:0/2942637587 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00bc00 con 0x7f8ce0153660 2023-10-08T16:28:10.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 -- 172.21.15.12:0/2942637587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce0153660 msgr2=0x7f8ce00c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce0153660 0x7f8ce00c0ef0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc0099b0 tx=0x7f8cdc009250 comp rx=0 tx=0).stop 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 -- 172.21.15.12:0/2942637587 shutdown_connections 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce0153660 0x7f8ce00c0ef0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 --2- 172.21.15.12:0/2942637587 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 -- 172.21.15.12:0/2942637587 >> 172.21.15.12:0/2942637587 conn(0x7f8ce006c6a0 msgr2=0x7f8ce006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 -- 172.21.15.12:0/2942637587 shutdown_connections 2023-10-08T16:28:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.989+0000 7f8ce699d700 1 -- 172.21.15.12:0/2942637587 wait complete. 2023-10-08T16:28:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.991+0000 7f8ce699d700 1 Processor -- start 2023-10-08T16:28:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.991+0000 7f8ce699d700 1 -- start start 2023-10-08T16:28:10.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce0153660 0x7f8ce0165f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:10.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0166b50 con 0x7f8ce00c8980 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce0155cb0 con 0x7f8ce0153660 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce01550a0 con 0x7f8ce0153a30 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54218/0 (socket says 172.21.15.12:54218) 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 -- 172.21.15.12:0/3686567099 learned_addr learned my addr 172.21.15.12:0/3686567099 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:11.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce519a700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce0153660 0x7f8ce0165f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce619c700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce014f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 -- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 msgr2=0x7f8ce014f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce014f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 -- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce0153660 msgr2=0x7f8ce0165f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce0153660 0x7f8ce0165f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce599b700 1 -- 172.21.15.12:0/3686567099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc0094f0 con 0x7f8ce00c8980 2023-10-08T16:28:11.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.992+0000 7f8ce619c700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8ce599b700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0067f90 tx=0x7f8cdc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc00bbe0 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc011420 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0155380 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc0117e0 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.993+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce0155940 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.994+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce0156fb0 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.995+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 59) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f8cdc011bd0 con 0x7f8ce00c8980 2023-10-08T16:28:11.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:10.996+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8cdc085e70 con 0x7f8ce00c8980 2023-10-08T16:28:11.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.000+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cdc052f60 con 0x7f8ce00c8980 2023-10-08T16:28:11.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.202+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ce004c3c0 con 0x7f8ce00c8980 2023-10-08T16:28:11.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.798+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 60) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f8cdc052a10 con 0x7f8ce00c8980 2023-10-08T16:28:11.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.798+0000 7f8cd5ffb700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 0x7f8cc406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:11.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.800+0000 7f8ce519a700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 0x7f8cc406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:11.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:11.803+0000 7f8ce519a700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 0x7f8cc406ee70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ce016a330 tx=0x7f8cd000b430 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.186+0000 7f8cd5ffb700 1 -- 172.21.15.12:0/3686567099 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cdc069f00 con 0x7f8ce00c8980 2023-10-08T16:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 msgr2=0x7f8cc406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 0x7f8cc406ee70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8ce016a330 tx=0x7f8cd000b430 comp rx=0 tx=0).stop 2023-10-08T16:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 msgr2=0x7f8ce015a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0067f90 tx=0x7f8cdc017000 comp rx=0 tx=0).stop 2023-10-08T16:28:12.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 shutdown_connections 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8cc406ca90 0x7f8cc406ee70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8ce00c8980 0x7f8ce015a050 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8ce0153a30 0x7f8ce014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 --2- 172.21.15.12:0/3686567099 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8ce0153660 0x7f8ce0165f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 >> 172.21.15.12:0/3686567099 conn(0x7f8ce006c6a0 msgr2=0x7f8ce00b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 shutdown_connections 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.190+0000 7f8ce699d700 1 -- 172.21.15.12:0/3686567099 wait complete. 2023-10-08T16:28:12.191 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T16:28:12.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T16:28:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.406+0000 7f67ee99d700 1 Processor -- start 2023-10-08T16:28:12.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.406+0000 7f67ee99d700 1 -- start start 2023-10-08T16:28:12.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67e80c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80c2fa0 con 0x7f67e806cdb0 2023-10-08T16:28:12.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e80c2390 con 0x7f67e815dc10 2023-10-08T16:28:12.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80ccdf0 con 0x7f67e815cb90 2023-10-08T16:28:12.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee19c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f67e806cdb0 0x7f67e80c3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46566/0 (socket says 172.21.15.12:46566) 2023-10-08T16:28:12.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ee19c700 1 -- 172.21.15.12:0/1228443681 learned_addr learned my addr 172.21.15.12:0/1228443681 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:12.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67e80c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187614885 0 0) 0x7f67e80c2fa0 con 0x7f67e806cdb0 2023-10-08T16:28:12.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.408+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d4003570 con 0x7f67e806cdb0 2023-10-08T16:28:12.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742296025 0 0) 0x7f67e80c2390 con 0x7f67e815dc10 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e80c2fa0 con 0x7f67e815dc10 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 879962665 0 0) 0x7f67d4003570 con 0x7f67e806cdb0 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 msgr2=0x7f67e80c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67e80c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 >> v1:172.21.15.29:6789/0 conn(0x7f67e815dc10 legacy=0x7f67e806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e80c2670 con 0x7f67e806cdb0 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f67e00017f0 con 0x7f67e806cdb0 2023-10-08T16:28:12.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 >> v1:172.21.15.12:6789/0 conn(0x7f67e806cdb0 legacy=0x7f67e80c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67d4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d40041d0 0x7f67d4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67d4004d50 0x7f67d40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80ccdf0 con 0x7f67d40041d0 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400bbf0 con 0x7f67d4004d50 2023-10-08T16:28:12.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d400bdb0 con 0x7f67e815cb90 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67d4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ed19a700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d40041d0 0x7f67d4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.409+0000 7f67ee19c700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67d4004d50 0x7f67d40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 -- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67d4004d50 msgr2=0x7f67d40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67d4004d50 0x7f67d40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 -- 172.21.15.12:0/1228443681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d40041d0 msgr2=0x7f67d4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67d40041d0 0x7f67d4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 -- 172.21.15.12:0/1228443681 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d4003570 con 0x7f67e815cb90 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67d4003c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009c00 tx=0x7f67e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18233dd982d687c8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400e710 con 0x7f67e815cb90 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e400e870 con 0x7f67e815cb90 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.410+0000 7f67ec999700 1 -- 172.21.15.12:0/1228443681 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e400ec30 con 0x7f67e815cb90 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 -- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 msgr2=0x7f67d4003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1228443681 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e815cb90 0x7f67d4003c20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009c00 tx=0x7f67e40091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee19c700 1 -- 172.21.15.12:0/1228443681 reap_dead start 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 -- 172.21.15.12:0/1228443681 shutdown_connections 2023-10-08T16:28:12.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 -- 172.21.15.12:0/1228443681 >> 172.21.15.12:0/1228443681 conn(0x7f67e80cd230 msgr2=0x7f67e80cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 -- 172.21.15.12:0/1228443681 shutdown_connections 2023-10-08T16:28:12.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.411+0000 7f67ee99d700 1 -- 172.21.15.12:0/1228443681 wait complete. 2023-10-08T16:28:12.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.412+0000 7f67ee99d700 1 Processor -- start 2023-10-08T16:28:12.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.413+0000 7f67ee99d700 1 -- start start 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.413+0000 7f67ee99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 0x7f67e8159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e816dbf0 0x7f67e813c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e816e720 con 0x7f67e816d780 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e80c47f0 con 0x7f67e815cb90 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e816e160 con 0x7f67e816dbf0 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45870/0 (socket says 172.21.15.12:45870) 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 -- 172.21.15.12:0/1818544316 learned_addr learned my addr 172.21.15.12:0/1818544316 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:12.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 0x7f67e8159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ee19c700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e816dbf0 0x7f67e813c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 -- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e816dbf0 msgr2=0x7f67e813c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e816dbf0 0x7f67e813c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 -- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 msgr2=0x7f67e8159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 0x7f67e8159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 -- 172.21.15.12:0/1818544316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e816e440 con 0x7f67e816d780 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 0x7f67e8159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.414+0000 7f67ed19a700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f67d8002c00 tx=0x7f67d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.415+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d800fb40 con 0x7f67e816d780 2023-10-08T16:28:12.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.415+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d800fcc0 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.415+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e80c4480 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.415+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d80133f0 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.415+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e8159570 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.416+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e80c42c0 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.417+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 60) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f67d80137e0 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.418+0000 7f67ddffb700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 0x7f67cc069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.418+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6375+0+0 (secure 0 0 0) 0x7f67d8084ce0 con 0x7f67e816d780 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.418+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 0x7f67cc069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:12.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.419+0000 7f67ed99b700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 0x7f67cc069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67e40091e0 tx=0x7f67e401a000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:12.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.422+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67d8089070 con 0x7f67e816d780 2023-10-08T16:28:12.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:12.623+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67e804c3c0 con 0x7f67e816d780 2023-10-08T16:28:13.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.193+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f67d8052330 con 0x7f67e816d780 2023-10-08T16:28:13.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.198+0000 7f67ddffb700 1 -- 172.21.15.12:0/1818544316 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 169+0+0 (secure 0 0 0) 0x7f67d80559f0 con 0x7f67e816d780 2023-10-08T16:28:13.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 msgr2=0x7f67cc069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 0x7f67cc069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67e40091e0 tx=0x7f67e401a000 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 msgr2=0x7f67e813bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f67d8002c00 tx=0x7f67d8007d30 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 shutdown_connections 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f67cc066d80 0x7f67cc069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67e816dbf0 0x7f67e813c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67e815cb90 0x7f67e8159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 --2- 172.21.15.12:0/1818544316 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67e816d780 0x7f67e813bfc0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 >> 172.21.15.12:0/1818544316 conn(0x7f67e80cd230 msgr2=0x7f67e806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 shutdown_connections 2023-10-08T16:28:13.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.201+0000 7f67ee99d700 1 -- 172.21.15.12:0/1818544316 wait complete. 2023-10-08T16:28:13.203 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T16:28:13.220 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T16:28:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.410+0000 7f0db0b9d700 1 Processor -- start 2023-10-08T16:28:13.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.410+0000 7f0db0b9d700 1 -- start start 2023-10-08T16:28:13.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0db0b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0dac0c7be0 0x7f0dac06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0db0b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dac13f780 0x7f0dac13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0db0b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dac1400e0 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0db0b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac06bf10 con 0x7f0dac13f780 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0db0b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dac06b290 con 0x7f0dac0c7be0 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0dabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dac13f780 0x7f0dac13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0daaffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0dac0c7fb0 0x7f0dac15a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46580/0 (socket says 172.21.15.12:46580) 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0dabfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0dac13f780 0x7f0dac13fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45876/0 (socket says 172.21.15.12:45876) 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0daaffd700 1 -- 172.21.15.12:0/2426811148 learned_addr learned my addr 172.21.15.12:0/2426811148 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.412+0000 7f0dab7fe700 1 --2- 172.21.15.12:0/2426811148 >> v2:172.21.15.29:3300/0 conn(0x7f0dac0c7be0 0x7f0dac06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0dabfff700 1 -- 172.21.15.12:0/2426811148 >> v2:172.21.15.29:3300/0 conn(0x7f0dac0c7be0 msgr2=0x7f0dac06abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0dabfff700 1 --2- 172.21.15.12:0/2426811148 >> v2:172.21.15.29:3300/0 conn(0x7f0dac0c7be0 0x7f0dac06abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0dabfff700 1 -- 172.21.15.12:0/2426811148 >> v1:172.21.15.12:6789/0 conn(0x7f0dac0c7fb0 legacy=0x7f0dac15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0dabfff700 1 -- 172.21.15.12:0/2426811148 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac06b570 con 0x7f0dac13f780 2023-10-08T16:28:13.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0dabfff700 1 --2- 172.21.15.12:0/2426811148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac13f780 0x7f0dac13fba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0c8b00 tx=0x7f0da400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7141bbc8e019df85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0daa7fc700 1 -- 172.21.15.12:0/2426811148 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da4010070 con 0x7f0dac13f780 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0daa7fc700 1 -- 172.21.15.12:0/2426811148 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da400b2e0 con 0x7f0dac13f780 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.413+0000 7f0daa7fc700 1 -- 172.21.15.12:0/2426811148 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da400dd00 con 0x7f0dac13f780 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 -- 172.21.15.12:0/2426811148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac13f780 msgr2=0x7f0dac13fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/2426811148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac13f780 0x7f0dac13fba0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0dac0c8b00 tx=0x7f0da400b990 comp rx=0 tx=0).stop 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 -- 172.21.15.12:0/2426811148 shutdown_connections 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/2426811148 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac13f780 0x7f0dac13fba0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/2426811148 >> v2:172.21.15.29:3300/0 conn(0x7f0dac0c7be0 0x7f0dac06abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 -- 172.21.15.12:0/2426811148 >> 172.21.15.12:0/2426811148 conn(0x7f0dac06d110 msgr2=0x7f0dac0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 -- 172.21.15.12:0/2426811148 shutdown_connections 2023-10-08T16:28:13.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.414+0000 7f0db0b9d700 1 -- 172.21.15.12:0/2426811148 wait complete. 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.415+0000 7f0db0b9d700 1 Processor -- start 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.415+0000 7f0db0b9d700 1 -- start start 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 0x7f0dac139640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dac13f780 0x7f0dac0b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0b0c20 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c54f0 con 0x7f0dac13f780 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.416+0000 7f0db0b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dac0c57d0 con 0x7f0dac0c7be0 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45886/0 (socket says 172.21.15.12:45886) 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 -- 172.21.15.12:0/170467093 learned_addr learned my addr 172.21.15.12:0/170467093 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0dab7fe700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 0x7f0dac139640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0dabfff700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dac13f780 0x7f0dac0b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 -- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 msgr2=0x7f0dac139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 0x7f0dac139640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 -- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dac13f780 msgr2=0x7f0dac0b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dac13f780 0x7f0dac0b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 -- 172.21.15.12:0/170467093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da400bc30 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0dab7fe700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 0x7f0dac139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.417+0000 7f0daaffd700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c7e0 tx=0x7f0da0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.418+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0005b30 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.418+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0da0005c90 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.418+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0da0007320 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.418+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dac0b08b0 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.418+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dac13b690 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.419+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dac04c3c0 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.420+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0da001b400 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.421+0000 7f0d937fe700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.421+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f0da0084280 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.421+0000 7f0dab7fe700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.422+0000 7f0dab7fe700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 0x7f0d980693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c006fd0 tx=0x7f0d9c008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.425+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0da0051470 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.630+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f0dac0b0d60 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.634+0000 7f0d937fe700 1 -- 172.21.15.12:0/170467093 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v43) v1 ==== 120+0+0 (secure 0 0 0) 0x7f0da0054a90 con 0x7f0dac0c7fb0 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 msgr2=0x7f0d980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 0x7f0d980693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c006fd0 tx=0x7f0d9c008040 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 msgr2=0x7f0dac155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0da000c7e0 tx=0x7f0da0007f00 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 shutdown_connections 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0d98066f30 0x7f0d980693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0dac13f780 0x7f0dac0b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0dac0c7be0 0x7f0dac139640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 --2- 172.21.15.12:0/170467093 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0dac0c7fb0 0x7f0dac155060 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.636+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 >> 172.21.15.12:0/170467093 conn(0x7f0dac06d110 msgr2=0x7f0dac0c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:13.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.637+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 shutdown_connections 2023-10-08T16:28:13.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.637+0000 7f0db0b9d700 1 -- 172.21.15.12:0/170467093 wait complete. 2023-10-08T16:28:13.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T16:28:13.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.853+0000 7f7f6dd9d700 1 Processor -- start 2023-10-08T16:28:13.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.853+0000 7f7f6dd9d700 1 -- start start 2023-10-08T16:28:13.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.854+0000 7f7f6dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 0x7f7f6806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.854+0000 7f7f6dd9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.854+0000 7f7f6dd9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6806b290 con 0x7f7f680c7fb0 2023-10-08T16:28:13.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.854+0000 7f7f6dd9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6806bf10 con 0x7f7f6813f780 2023-10-08T16:28:13.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.854+0000 7f7f6dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68140140 con 0x7f7f680c7be0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6d59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6cd9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 0x7f7f6806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6d59c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:48372/0 (socket says 172.21.15.12:48372) 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6d59c700 1 -- 172.21.15.12:0/3491057875 learned_addr learned my addr 172.21.15.12:0/3491057875 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6cd9b700 1 -- 172.21.15.12:0/3491057875 >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 msgr2=0x7f7f6813fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6cd9b700 1 --2- 172.21.15.12:0/3491057875 >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.855+0000 7f7f6cd9b700 1 -- 172.21.15.12:0/3491057875 >> v1:172.21.15.29:6789/0 conn(0x7f7f680c7fb0 legacy=0x7f7f6815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f6cd9b700 1 -- 172.21.15.12:0/3491057875 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6806b570 con 0x7f7f680c7be0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f6d59c700 1 --2- 172.21.15.12:0/3491057875 >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f6cd9b700 1 --2- 172.21.15.12:0/3491057875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 0x7f7f6806abd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bb90 tx=0x7f7f5c00b430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48f861ec31e963aa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f677fe700 1 -- 172.21.15.12:0/3491057875 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c00db40 con 0x7f7f680c7be0 2023-10-08T16:28:13.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f677fe700 1 -- 172.21.15.12:0/3491057875 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5c00dca0 con 0x7f7f680c7be0 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.856+0000 7f7f677fe700 1 -- 172.21.15.12:0/3491057875 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0196b0 con 0x7f7f680c7be0 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/3491057875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 msgr2=0x7f7f6806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/3491057875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 0x7f7f6806abd0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bb90 tx=0x7f7f5c00b430 comp rx=0 tx=0).stop 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/3491057875 shutdown_connections 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/3491057875 >> v2:172.21.15.29:3300/0 conn(0x7f7f6813f780 0x7f7f6813fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/3491057875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f680c7be0 0x7f7f6806abd0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/3491057875 >> 172.21.15.12:0/3491057875 conn(0x7f7f6806d110 msgr2=0x7f7f680cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/3491057875 shutdown_connections 2023-10-08T16:28:13.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.857+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/3491057875 wait complete. 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.858+0000 7f7f6dd9d700 1 Processor -- start 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.858+0000 7f7f6dd9d700 1 -- start start 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f680c7be0 0x7f7f6816caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f6813f780 0x7f7f68159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68159950 con 0x7f7f680c7fb0 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680c41a0 con 0x7f7f680c7be0 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.859+0000 7f7f6dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680c4480 con 0x7f7f6813f780 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45898/0 (socket says 172.21.15.12:45898) 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 -- 172.21.15.12:0/2949824703 learned_addr learned my addr 172.21.15.12:0/2949824703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f6cd9b700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f680c7be0 0x7f7f6816caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f6d59c700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f6813f780 0x7f7f68159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 -- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f6813f780 msgr2=0x7f7f68159410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f6813f780 0x7f7f68159410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 -- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f680c7be0 msgr2=0x7f7f6816caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:13.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f680c7be0 0x7f7f6816caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:13.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 -- 172.21.15.12:0/2949824703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60009ae0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.860+0000 7f7f67fff700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c7c0 tx=0x7f7f54007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.861+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011590 con 0x7f7f680c7fb0 2023-10-08T16:28:13.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.861+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f540116f0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.861+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f54011ab0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.861+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5c00b6d0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.861+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f680c4a40 con 0x7f7f680c7fb0 2023-10-08T16:28:13.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.862+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6804c3c0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.863+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f5401b3b0 con 0x7f7f680c7fb0 2023-10-08T16:28:13.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.864+0000 7f7f64ff9700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:13.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.864+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f7f54083a80 con 0x7f7f680c7fb0 2023-10-08T16:28:13.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.864+0000 7f7f6cd9b700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:13.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.865+0000 7f7f6cd9b700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 0x7f7f4c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bfd0 tx=0x7f7f5c01b000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:13.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:13.868+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f54050b50 con 0x7f7f680c7fb0 2023-10-08T16:28:14.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.071+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f7f6806b850 con 0x7f7f680c7fb0 2023-10-08T16:28:14.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.075+0000 7f7f64ff9700 1 -- 172.21.15.12:0/2949824703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v44) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7f54017020 con 0x7f7f680c7fb0 2023-10-08T16:28:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 msgr2=0x7f7f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 0x7f7f4c0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c00bfd0 tx=0x7f7f5c01b000 comp rx=0 tx=0).stop 2023-10-08T16:28:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 msgr2=0x7f7f68158ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c7c0 tx=0x7f7f54007f50 comp rx=0 tx=0).stop 2023-10-08T16:28:14.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 shutdown_connections 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7f4c066f30 0x7f7f4c0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7f6813f780 0x7f7f68159410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7f680c7be0 0x7f7f6816caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 --2- 172.21.15.12:0/2949824703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7f680c7fb0 0x7f7f68158ed0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 >> 172.21.15.12:0/2949824703 conn(0x7f7f6806d110 msgr2=0x7f7f6813e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 shutdown_connections 2023-10-08T16:28:14.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.077+0000 7f7f6dd9d700 1 -- 172.21.15.12:0/2949824703 wait complete. 2023-10-08T16:28:14.095 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T16:28:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.285+0000 7f6c1939d700 1 Processor -- start 2023-10-08T16:28:14.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.285+0000 7f6c1939d700 1 -- start start 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c1939d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c140c7be0 0x7f6c1406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c1939d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6c140c7fb0 0x7f6c1415a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c1939d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1415aed0 con 0x7f6c1413f780 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c1939d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1406bf10 con 0x7f6c140c7be0 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c1939d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1406b290 con 0x7f6c140c7fb0 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c13fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c140c7be0 0x7f6c1406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c18b9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6c1413f780 0x7f6c1413fb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46586/0 (socket says 172.21.15.12:46586) 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c18b9c700 1 -- 172.21.15.12:0/2827931473 learned_addr learned my addr 172.21.15.12:0/2827931473 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c137fe700 1 --2- 172.21.15.12:0/2827931473 >> v2:172.21.15.29:3300/0 conn(0x7f6c140c7fb0 0x7f6c1415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c13fff700 1 -- 172.21.15.12:0/2827931473 >> v2:172.21.15.29:3300/0 conn(0x7f6c140c7fb0 msgr2=0x7f6c1415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c13fff700 1 --2- 172.21.15.12:0/2827931473 >> v2:172.21.15.29:3300/0 conn(0x7f6c140c7fb0 0x7f6c1415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c13fff700 1 -- 172.21.15.12:0/2827931473 >> v1:172.21.15.12:6789/0 conn(0x7f6c1413f780 legacy=0x7f6c1413fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c13fff700 1 -- 172.21.15.12:0/2827931473 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1406b570 con 0x7f6c140c7be0 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.287+0000 7f6c12ffd700 1 -- 172.21.15.12:0/2827931473 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058310386 0 0) 0x7f6c1415aed0 con 0x7f6c1413f780 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c13fff700 1 --2- 172.21.15.12:0/2827931473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c1406abd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f6c140aec50 tx=0x7f6c0400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4d6e6759fdc47 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c12ffd700 1 -- 172.21.15.12:0/2827931473 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0400db40 con 0x7f6c140c7be0 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c12ffd700 1 -- 172.21.15.12:0/2827931473 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0400dca0 con 0x7f6c140c7be0 2023-10-08T16:28:14.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c12ffd700 1 -- 172.21.15.12:0/2827931473 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c040196b0 con 0x7f6c140c7be0 2023-10-08T16:28:14.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c1939d700 1 -- 172.21.15.12:0/2827931473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 msgr2=0x7f6c1406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.288+0000 7f6c1939d700 1 --2- 172.21.15.12:0/2827931473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c1406abd0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f6c140aec50 tx=0x7f6c0400b430 comp rx=0 tx=0).stop 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 -- 172.21.15.12:0/2827931473 shutdown_connections 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 --2- 172.21.15.12:0/2827931473 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c1406abd0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 --2- 172.21.15.12:0/2827931473 >> v2:172.21.15.29:3300/0 conn(0x7f6c140c7fb0 0x7f6c1415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 -- 172.21.15.12:0/2827931473 >> 172.21.15.12:0/2827931473 conn(0x7f6c1406d110 msgr2=0x7f6c140cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 -- 172.21.15.12:0/2827931473 shutdown_connections 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.289+0000 7f6c1939d700 1 -- 172.21.15.12:0/2827931473 wait complete. 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.290+0000 7f6c1939d700 1 Processor -- start 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.290+0000 7f6c1939d700 1 -- start start 2023-10-08T16:28:14.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 0x7f6c1413cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 0x7f6c140c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c4260 con 0x7f6c140c7be0 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c140c4540 con 0x7f6c140c7fb0 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c1939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1413d010 con 0x7f6c1413f780 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c13fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c13fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45910/0 (socket says 172.21.15.12:45910) 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.291+0000 7f6c13fff700 1 -- 172.21.15.12:0/1100376318 learned_addr learned my addr 172.21.15.12:0/1100376318 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 0x7f6c1413cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c18b9c700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 0x7f6c140c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 -- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 msgr2=0x7f6c140c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 0x7f6c140c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 -- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 msgr2=0x7f6c1413cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 0x7f6c1413cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 -- 172.21.15.12:0/1100376318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0400b6d0 con 0x7f6c140c7be0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 0x7f6c1413cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c18b9c700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 0x7f6c140c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c13fff700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b6a0 tx=0x7f6c0401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04010750 con 0x7f6c140c7be0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c040108b0 con 0x7f6c140c7be0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c140c21f0 con 0x7f6c140c7be0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c04010c70 con 0x7f6c140c7be0 2023-10-08T16:28:14.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.292+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c140c27b0 con 0x7f6c140c7be0 2023-10-08T16:28:14.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.293+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1404c3c0 con 0x7f6c140c7be0 2023-10-08T16:28:14.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.294+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c04023070 con 0x7f6c140c7be0 2023-10-08T16:28:14.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.295+0000 7f6bfbfff700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 0x7f6c000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.295+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f6c04014070 con 0x7f6c140c7be0 2023-10-08T16:28:14.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.295+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 0x7f6c000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.296+0000 7f6c137fe700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 0x7f6c000693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c08006f00 tx=0x7f6c08008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.300+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c04055ac0 con 0x7f6c140c7be0 2023-10-08T16:28:14.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.502+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6c1406b850 con 0x7f6c140c7be0 2023-10-08T16:28:14.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.506+0000 7f6bfbfff700 1 -- 172.21.15.12:0/1100376318 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v45) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6c0402a0b0 con 0x7f6c140c7be0 2023-10-08T16:28:14.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 msgr2=0x7f6c000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 0x7f6c000693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c08006f00 tx=0x7f6c08008040 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 msgr2=0x7f6c141579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b6a0 tx=0x7f6c0401b000 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 shutdown_connections 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6c00066f30 0x7f6c000693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c140c7be0 0x7f6c141579f0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c1413f780 0x7f6c140c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 --2- 172.21.15.12:0/1100376318 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c140c7fb0 0x7f6c1413cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.509+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 >> 172.21.15.12:0/1100376318 conn(0x7f6c1406d110 msgr2=0x7f6c1413e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.510+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 shutdown_connections 2023-10-08T16:28:14.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.510+0000 7f6c1939d700 1 -- 172.21.15.12:0/1100376318 wait complete. 2023-10-08T16:28:14.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-10-08T16:28:14.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.715+0000 7f119199d700 1 Processor -- start 2023-10-08T16:28:14.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.715+0000 7f119199d700 1 -- start start 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.716+0000 7f119199d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f118c06aaa0 0x7f118c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.716+0000 7f119199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c15ae70 con 0x7f118c13fb20 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.716+0000 7f119199d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f118c06af60 con 0x7f118c13fef0 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.716+0000 7f119199d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118c06b240 con 0x7f118c06aaa0 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f118c06aaa0 0x7f118c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f118c06aaa0 0x7f118c15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45926/0 (socket says 172.21.15.12:45926) 2023-10-08T16:28:14.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 -- 172.21.15.12:0/413505124 learned_addr learned my addr 172.21.15.12:0/413505124 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119099b700 1 --1- 172.21.15.12:0/413505124 >> v1:172.21.15.12:6789/0 conn(0x7f118c13fb20 0x7f118c0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46598/0 (socket says 172.21.15.12:46598) 2023-10-08T16:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 -- 172.21.15.12:0/413505124 >> v1:172.21.15.29:6789/0 conn(0x7f118c13fef0 legacy=0x7f118c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 -- 172.21.15.12:0/413505124 >> v1:172.21.15.12:6789/0 conn(0x7f118c13fb20 legacy=0x7f118c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 -- 172.21.15.12:0/413505124 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c06b520 con 0x7f118c06aaa0 2023-10-08T16:28:14.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.717+0000 7f119119c700 1 --2- 172.21.15.12:0/413505124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c15a930 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912fdead76cb871f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f118b7fe700 1 -- 172.21.15.12:0/413505124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118400e070 con 0x7f118c06aaa0 2023-10-08T16:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f118b7fe700 1 -- 172.21.15.12:0/413505124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118400ba80 con 0x7f118c06aaa0 2023-10-08T16:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f118b7fe700 1 -- 172.21.15.12:0/413505124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840092e0 con 0x7f118c06aaa0 2023-10-08T16:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 -- 172.21.15.12:0/413505124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 msgr2=0x7f118c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 --2- 172.21.15.12:0/413505124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c15a930 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f1184009f20 tx=0x7f1184009840 comp rx=0 tx=0).stop 2023-10-08T16:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 -- 172.21.15.12:0/413505124 shutdown_connections 2023-10-08T16:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 --2- 172.21.15.12:0/413505124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c15a930 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 -- 172.21.15.12:0/413505124 >> 172.21.15.12:0/413505124 conn(0x7f118c06d170 msgr2=0x7f118c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 -- 172.21.15.12:0/413505124 shutdown_connections 2023-10-08T16:28:14.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.718+0000 7f119199d700 1 -- 172.21.15.12:0/413505124 wait complete. 2023-10-08T16:28:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.720+0000 7f119199d700 1 Processor -- start 2023-10-08T16:28:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.720+0000 7f119199d700 1 -- start start 2023-10-08T16:28:14.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118c13fb20 0x7f118c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 0x7f118c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0ac6c0 con 0x7f118c06aaa0 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0abab0 con 0x7f118c13fb20 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118c0abd90 con 0x7f118c13fef0 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45928/0 (socket says 172.21.15.12:45928) 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119099b700 1 -- 172.21.15.12:0/1748607636 learned_addr learned my addr 172.21.15.12:0/1748607636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f119119c700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 0x7f118c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.721+0000 7f118bfff700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118c13fb20 0x7f118c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 -- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 msgr2=0x7f118c13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 0x7f118c13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 -- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118c13fb20 msgr2=0x7f118c1584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118c13fb20 0x7f118c1584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 -- 172.21.15.12:0/1748607636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009ae0 con 0x7f118c06aaa0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119119c700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 0x7f118c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119099b700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f118000c7c0 tx=0x7f1180007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180005a70 con 0x7f118c06aaa0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1180005bf0 con 0x7f118c06aaa0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800070f0 con 0x7f118c06aaa0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118c0ac070 con 0x7f118c06aaa0 2023-10-08T16:28:14.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.722+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118c1561a0 con 0x7f118c06aaa0 2023-10-08T16:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.723+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118c04c3c0 con 0x7f118c06aaa0 2023-10-08T16:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.724+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1180007460 con 0x7f118c06aaa0 2023-10-08T16:28:14.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.725+0000 7f1188ff9700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 0x7f11700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.725+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f1180083fe0 con 0x7f118c06aaa0 2023-10-08T16:28:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.725+0000 7f118bfff700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 0x7f11700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:14.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.726+0000 7f118bfff700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 0x7f11700693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f118c13df20 tx=0x7f1178009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:14.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:14.729+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1180051130 con 0x7f118c06aaa0 2023-10-08T16:28:15.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.009+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f118c15ae70 con 0x7f118c06aaa0 2023-10-08T16:28:15.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.193+0000 7f1188ff9700 1 -- 172.21.15.12:0/1748607636 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v725) v1 ==== 148+0+0 (secure 0 0 0) 0x7f118c15ae70 con 0x7f118c06aaa0 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.195+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 msgr2=0x7f11700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.195+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 0x7f11700693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f118c13df20 tx=0x7f1178009040 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 msgr2=0x7f118c155c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f118000c7c0 tx=0x7f1180007f70 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 shutdown_connections 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1170066f30 0x7f11700693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f118c06aaa0 0x7f118c155c60 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f118c13fef0 0x7f118c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 --2- 172.21.15.12:0/1748607636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f118c13fb20 0x7f118c1584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 >> 172.21.15.12:0/1748607636 conn(0x7f118c06d170 msgr2=0x7f118c0c2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 shutdown_connections 2023-10-08T16:28:15.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.196+0000 7f119199d700 1 -- 172.21.15.12:0/1748607636 wait complete. 2023-10-08T16:28:15.213 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-10-08T16:28:15.213 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that number of snaps retained are as per user spec. 2023-10-08T16:28:15.213 INFO:tasks.cephfs_test_runner:test_snap_schedule_for_number_of_snaps_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T16:28:15.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-08T16:28:15.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.401+0000 7fd06759e700 1 Processor -- start 2023-10-08T16:28:15.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.401+0000 7fd06759e700 1 -- start start 2023-10-08T16:28:15.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd06759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd06813fef0 0x7fd06815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd06759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd06806aaa0 0x7fd0680c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd06759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06815ae70 con 0x7fd06813fb20 2023-10-08T16:28:15.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd06759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06806af60 con 0x7fd06806aaa0 2023-10-08T16:28:15.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd06759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06806b240 con 0x7fd06813fef0 2023-10-08T16:28:15.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd066d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd06806aaa0 0x7fd0680c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd066d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd06806aaa0 0x7fd0680c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45938/0 (socket says 172.21.15.12:45938) 2023-10-08T16:28:15.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.402+0000 7fd066d9d700 1 -- 172.21.15.12:0/2509045170 learned_addr learned my addr 172.21.15.12:0/2509045170 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:15.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd065d9b700 1 --2- 172.21.15.12:0/2509045170 >> v2:172.21.15.29:3300/0 conn(0x7fd06813fef0 0x7fd06815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd066d9d700 1 -- 172.21.15.12:0/2509045170 >> v2:172.21.15.29:3300/0 conn(0x7fd06813fef0 msgr2=0x7fd06815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:15.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd066d9d700 1 --2- 172.21.15.12:0/2509045170 >> v2:172.21.15.29:3300/0 conn(0x7fd06813fef0 0x7fd06815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd066d9d700 1 -- 172.21.15.12:0/2509045170 >> v1:172.21.15.29:6789/0 conn(0x7fd06813fb20 legacy=0x7fd0680c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd066d9d700 1 -- 172.21.15.12:0/2509045170 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06806b520 con 0x7fd06806aaa0 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd066d9d700 1 --2- 172.21.15.12:0/2509045170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06806aaa0 0x7fd0680c9d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd06806a5e0 tx=0x7fd06000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=329d0dbfff6ff0b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd06559a700 1 -- 172.21.15.12:0/2509045170 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060010070 con 0x7fd06806aaa0 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd06559a700 1 -- 172.21.15.12:0/2509045170 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000de90 con 0x7fd06806aaa0 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.403+0000 7fd06559a700 1 -- 172.21.15.12:0/2509045170 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000b320 con 0x7fd06806aaa0 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 -- 172.21.15.12:0/2509045170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06806aaa0 msgr2=0x7fd0680c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 --2- 172.21.15.12:0/2509045170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06806aaa0 0x7fd0680c9d00 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fd06806a5e0 tx=0x7fd06000ba50 comp rx=0 tx=0).stop 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 -- 172.21.15.12:0/2509045170 shutdown_connections 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 --2- 172.21.15.12:0/2509045170 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06806aaa0 0x7fd0680c9d00 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 --2- 172.21.15.12:0/2509045170 >> v2:172.21.15.29:3300/0 conn(0x7fd06813fef0 0x7fd06815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 -- 172.21.15.12:0/2509045170 >> 172.21.15.12:0/2509045170 conn(0x7fd06806d170 msgr2=0x7fd0680cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:15.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 -- 172.21.15.12:0/2509045170 shutdown_connections 2023-10-08T16:28:15.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.404+0000 7fd06759e700 1 -- 172.21.15.12:0/2509045170 wait complete. 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.405+0000 7fd06759e700 1 Processor -- start 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.406+0000 7fd06759e700 1 -- start start 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.406+0000 7fd06759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 0x7fd0680b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.406+0000 7fd06759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 0x7fd068169b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068156240 con 0x7fd06813fef0 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06816d800 con 0x7fd06806aaa0 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06816a6f0 con 0x7fd06813fb20 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45954/0 (socket says 172.21.15.12:45954) 2023-10-08T16:28:15.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 -- 172.21.15.12:0/1649446488 learned_addr learned my addr 172.21.15.12:0/1649446488 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd065d9b700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 0x7fd068169b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 -- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 msgr2=0x7fd068169b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06659c700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 0x7fd0680b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 0x7fd068169b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 -- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 msgr2=0x7fd0680b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 0x7fd0680b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 -- 172.21.15.12:0/1649446488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06000bcf0 con 0x7fd06813fef0 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd065d9b700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 0x7fd068169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd06659c700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 0x7fd0680b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.407+0000 7fd066d9d700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd060014000 tx=0x7fd06001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.408+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000acc0 con 0x7fd06813fef0 2023-10-08T16:28:15.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.408+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd06000ae20 con 0x7fd06813fef0 2023-10-08T16:28:15.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.408+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06816d1b0 con 0x7fd06813fef0 2023-10-08T16:28:15.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.408+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06001e690 con 0x7fd06813fef0 2023-10-08T16:28:15.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.408+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06816a9d0 con 0x7fd06813fef0 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.409+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06816d9b0 con 0x7fd06813fef0 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.410+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd060003040 con 0x7fd06813fef0 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.411+0000 7fd0567fc700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 0x7fd0480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.411+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7fd060086130 con 0x7fd06813fef0 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.411+0000 7fd06659c700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 0x7fd0480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:15.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.412+0000 7fd06659c700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 0x7fd0480693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd058001840 tx=0x7fd058009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:15.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.415+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd06816d9b0 con 0x7fd06813fef0 2023-10-08T16:28:15.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:15.698+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7fd06816d970 con 0x7fd06813fef0 2023-10-08T16:28:16.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.194+0000 7fd0567fc700 1 -- 172.21.15.12:0/1649446488 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v726) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd060053200 con 0x7fd06813fef0 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 msgr2=0x7fd0480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 0x7fd0480693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd058001840 tx=0x7fd058009040 comp rx=0 tx=0).stop 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 msgr2=0x7fd06816a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fd060014000 tx=0x7fd06001a000 comp rx=0 tx=0).stop 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 shutdown_connections 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd048066f30 0x7fd0480693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd06813fef0 0x7fd06816a050 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd06806aaa0 0x7fd0680b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 --2- 172.21.15.12:0/1649446488 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd06813fb20 0x7fd068169b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 >> 172.21.15.12:0/1649446488 conn(0x7fd06806d170 msgr2=0x7fd06806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 shutdown_connections 2023-10-08T16:28:16.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.197+0000 7fd06759e700 1 -- 172.21.15.12:0/1649446488 wait complete. 2023-10-08T16:28:16.216 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T16:28:16.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.408+0000 7f46e999d700 1 Processor -- start 2023-10-08T16:28:16.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.408+0000 7f46e999d700 1 -- start start 2023-10-08T16:28:16.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7be0 0x7f46e406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46e40c7fb0 0x7f46e415a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46e413f780 0x7f46e413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e406bf10 con 0x7f46e40c7fb0 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e4140100 con 0x7f46e413f780 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415aed0 con 0x7f46e40c7be0 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.409+0000 7f46e3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46e40c7fb0 0x7f46e415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f46e40c7fb0 0x7f46e415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45962/0 (socket says 172.21.15.12:45962) 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 -- 172.21.15.12:0/241175496 learned_addr learned my addr 172.21.15.12:0/241175496 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:16.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e899b700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7be0 0x7f46e406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e919c700 1 --2- 172.21.15.12:0/241175496 >> v2:172.21.15.29:3300/0 conn(0x7f46e413f780 0x7f46e413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 -- 172.21.15.12:0/241175496 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7be0 msgr2=0x7f46e406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7be0 0x7f46e406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 -- 172.21.15.12:0/241175496 >> v2:172.21.15.29:3300/0 conn(0x7f46e413f780 msgr2=0x7f46e413fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 --2- 172.21.15.12:0/241175496 >> v2:172.21.15.29:3300/0 conn(0x7f46e413f780 0x7f46e413fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 -- 172.21.15.12:0/241175496 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e406b290 con 0x7f46e40c7fb0 2023-10-08T16:28:16.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e3fff700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e40c7fb0 0x7f46e415a990 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f46e40c6700 tx=0x7f46d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c45a582d017b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:16.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.410+0000 7f46e37fe700 1 -- 172.21.15.12:0/241175496 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000b640 con 0x7f46e40c7fb0 2023-10-08T16:28:16.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e37fe700 1 -- 172.21.15.12:0/241175496 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d000b7a0 con 0x7f46e40c7fb0 2023-10-08T16:28:16.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e37fe700 1 -- 172.21.15.12:0/241175496 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000bb60 con 0x7f46e40c7fb0 2023-10-08T16:28:16.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 -- 172.21.15.12:0/241175496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e40c7fb0 msgr2=0x7f46e415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e40c7fb0 0x7f46e415a990 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f46e40c6700 tx=0x7f46d0009250 comp rx=0 tx=0).stop 2023-10-08T16:28:16.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 -- 172.21.15.12:0/241175496 shutdown_connections 2023-10-08T16:28:16.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 --2- 172.21.15.12:0/241175496 >> v2:172.21.15.29:3300/0 conn(0x7f46e413f780 0x7f46e413fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7be0 0x7f46e406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 --2- 172.21.15.12:0/241175496 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e40c7fb0 0x7f46e415a990 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 -- 172.21.15.12:0/241175496 >> 172.21.15.12:0/241175496 conn(0x7f46e406d110 msgr2=0x7f46e40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:16.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 -- 172.21.15.12:0/241175496 shutdown_connections 2023-10-08T16:28:16.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.411+0000 7f46e999d700 1 -- 172.21.15.12:0/241175496 wait complete. 2023-10-08T16:28:16.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.413+0000 7f46e999d700 1 Processor -- start 2023-10-08T16:28:16.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.413+0000 7f46e999d700 1 -- start start 2023-10-08T16:28:16.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46e40c7be0 0x7f46e41362c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7fb0 0x7f46e40c2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c4800 con 0x7f46e413f780 2023-10-08T16:28:16.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c3bf0 con 0x7f46e40c7be0 2023-10-08T16:28:16.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c3ed0 con 0x7f46e40c7fb0 2023-10-08T16:28:16.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:16.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:45978/0 (socket says 172.21.15.12:45978) 2023-10-08T16:28:16.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 -- 172.21.15.12:0/3302309644 learned_addr learned my addr 172.21.15.12:0/3302309644 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:16.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 -- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7fb0 msgr2=0x7f46e40c2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7fb0 0x7f46e40c2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 -- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46e40c7be0 msgr2=0x7f46e41362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46e40c7be0 0x7f46e41362c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.414+0000 7f46e919c700 1 -- 172.21.15.12:0/3302309644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d00094f0 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e919c700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009df0 tx=0x7f46dc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00cb50 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00f040 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc014480 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e40c41b0 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.415+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e4136800 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.416+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e404c3c0 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.417+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46dc014830 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.418+0000 7f46e0ff9700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 0x7f46c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.418+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f46dc085030 con 0x7f46e413f780 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.418+0000 7f46e899b700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 0x7f46c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:16.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.419+0000 7f46e899b700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 0x7f46c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009bb0 tx=0x7f46d80091a0 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.422+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46dc0521a0 con 0x7f46e413f780 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.623+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f46e40c4940 con 0x7f46e413f780 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.628+0000 7f46e0ff9700 1 -- 172.21.15.12:0/3302309644 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46e40c4940 con 0x7f46e413f780 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 msgr2=0x7f46c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 0x7f46c80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009bb0 tx=0x7f46d80091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 msgr2=0x7f46e40c2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009df0 tx=0x7f46dc00b040 comp rx=0 tx=0).stop 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 shutdown_connections 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f46c8066f30 0x7f46c80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46e413f780 0x7f46e40c2650 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46e40c7be0 0x7f46e41362c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 --2- 172.21.15.12:0/3302309644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46e40c7fb0 0x7f46e40c2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 >> 172.21.15.12:0/3302309644 conn(0x7f46e406d110 msgr2=0x7f46e413c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 shutdown_connections 2023-10-08T16:28:16.853 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:16.630+0000 7f46e999d700 1 -- 172.21.15.12:0/3302309644 wait complete. 2023-10-08T16:28:16.853 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T16:28:16.853 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:28:16.936 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T16:28:17.043 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T16:28:17.044 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T16:28:17.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:17.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.251+0000 7efe0c9fe700 1 Processor -- start 2023-10-08T16:28:17.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.251+0000 7efe0c9fe700 1 -- start start 2023-10-08T16:28:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efe080c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0c9fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe0806a490 con 0x7efe08150380 2023-10-08T16:28:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0c9fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe080c7490 con 0x7efe0806f3a0 2023-10-08T16:28:17.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c7770 con 0x7efe0806e0a0 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0759e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efe08150380 0x7efe0806a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46608/0 (socket says 172.21.15.12:46608) 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.252+0000 7efe0759e700 1 -- 172.21.15.12:0/151781691 learned_addr learned my addr 172.21.15.12:0/151781691 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe06d9d700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efe080c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948114587 0 0) 0x7efe0806a490 con 0x7efe08150380 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdf0003570 con 0x7efe08150380 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3036964893 0 0) 0x7efdf0003570 con 0x7efe08150380 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 msgr2=0x7efe080c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efe080c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 >> v1:172.21.15.29:6789/0 conn(0x7efe0806f3a0 legacy=0x7efe0814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe080c7a50 con 0x7efe08150380 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7efe000017f0 con 0x7efe08150380 2023-10-08T16:28:17.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 >> v1:172.21.15.12:6789/0 conn(0x7efe08150380 legacy=0x7efe0806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efdf0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efdf0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0004d50 0x7efdf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe080c7770 con 0x7efdf0003a90 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000dd50 con 0x7efdf0004d50 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.253+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf000df10 con 0x7efe0806e0a0 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efdf0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe0759e700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0004d50 0x7efdf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe0659c700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efdf0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 -- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 msgr2=0x7efdf0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efdf0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 -- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0004d50 msgr2=0x7efdf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0004d50 0x7efdf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 -- 172.21.15.12:0/151781691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf0003570 con 0x7efdf0003a90 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe0659c700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe0806e0a0 0x7efdf0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe06d9d700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efdf0003e60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009c00 tx=0x7efdf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9774350ebec06a3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800e710 con 0x7efdf0003a90 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800e870 con 0x7efdf0003a90 2023-10-08T16:28:17.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.254+0000 7efe05d9b700 1 -- 172.21.15.12:0/151781691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800ec30 con 0x7efdf0003a90 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 -- 172.21.15.12:0/151781691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 msgr2=0x7efdf0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/151781691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efdf0003e60 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7efdf8009c00 tx=0x7efdf80091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0759e700 1 -- 172.21.15.12:0/151781691 reap_dead start 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 -- 172.21.15.12:0/151781691 shutdown_connections 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 -- 172.21.15.12:0/151781691 >> 172.21.15.12:0/151781691 conn(0x7efe0806d170 msgr2=0x7efe080cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 -- 172.21.15.12:0/151781691 shutdown_connections 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.255+0000 7efe0c9fe700 1 -- 172.21.15.12:0/151781691 wait complete. 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.256+0000 7efe0c9fe700 1 Processor -- start 2023-10-08T16:28:17.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 -- start start 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe08158ed0 0x7efe081564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe0814bee0 0x7efe0814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe0814c8c0 con 0x7efdf0003a90 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe081558b0 con 0x7efe0814bee0 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.257+0000 7efe0c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe0813cc50 con 0x7efe08158ed0 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46000/0 (socket says 172.21.15.12:46000) 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 -- 172.21.15.12:0/1595271333 learned_addr learned my addr 172.21.15.12:0/1595271333 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe0659c700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe08158ed0 0x7efe081564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe0759e700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe0814bee0 0x7efe0814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 -- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe08158ed0 msgr2=0x7efe081564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe08158ed0 0x7efe081564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 -- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe0814bee0 msgr2=0x7efe0814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe0814bee0 0x7efe0814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 -- 172.21.15.12:0/1595271333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08154ca0 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.258+0000 7efe06d9d700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7efdf800e4b0 tx=0x7efdf801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.259+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8022070 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.259+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800e9e0 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.259+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf8027470 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.259+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe08154f80 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.259+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe08155540 con 0x7efdf0003a90 2023-10-08T16:28:17.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.260+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0804c3c0 con 0x7efdf0003a90 2023-10-08T16:28:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.261+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdf8027880 con 0x7efdf0003a90 2023-10-08T16:28:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.262+0000 7efdeeffd700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 0x7efdf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.262+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7efdf8086170 con 0x7efdf0003a90 2023-10-08T16:28:17.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.262+0000 7efe0659c700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 0x7efdf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.263+0000 7efe0659c700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 0x7efdf40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efe081592e0 tx=0x7efdfc009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.266+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdf80532f0 con 0x7efdf0003a90 2023-10-08T16:28:17.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.514+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe080c7d30 con 0x7efdf0003a90 2023-10-08T16:28:17.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.515+0000 7efdeeffd700 1 -- 172.21.15.12:0/1595271333 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3529 (secure 0 0 0) 0x7efdf8017de0 con 0x7efdf0003a90 2023-10-08T16:28:17.515 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:17.515 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6653,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2501566972","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2501566972},{"type":"v1","addr":"172.21.15.29:6834","nonce":2501566972}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7761,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/2681503428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":2681503428},{"type":"v1","addr":"172.21.15.12:6833","nonce":2681503428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7764,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/3256017818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":3256017818},{"type":"v1","addr":"172.21.15.12:6835","nonce":3256017818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":8145,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2470464973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":2470464973},{"type":"v1","addr":"172.21.15.29:6835","nonce":2470464973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-10-08T16:28:17.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 msgr2=0x7efdf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 0x7efdf40693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efe081592e0 tx=0x7efdfc009040 comp rx=0 tx=0).stop 2023-10-08T16:28:17.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 msgr2=0x7efe0813c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7efdf800e4b0 tx=0x7efdf801a000 comp rx=0 tx=0).stop 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 shutdown_connections 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efdf4066f30 0x7efdf40693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0003a90 0x7efe0813c710 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe0814bee0 0x7efe0814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 --2- 172.21.15.12:0/1595271333 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe08158ed0 0x7efe081564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 >> 172.21.15.12:0/1595271333 conn(0x7efe0806d170 msgr2=0x7efe080cae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.517+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 shutdown_connections 2023-10-08T16:28:17.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.518+0000 7efe0c9fe700 1 -- 172.21.15.12:0/1595271333 wait complete. 2023-10-08T16:28:17.520 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 59 2023-10-08T16:28:17.535 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T16:28:17.535 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T16:28:17.535 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T16:28:17.535 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:28:17.536 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T16:28:17.536 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T16:28:17.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T16:28:17.536 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:28:17.536 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T16:28:17.537 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T16:28:17.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T16:28:17.537 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:28:17.537 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T16:28:17.537 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T16:28:17.537 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T16:28:17.537 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T16:28:17.552 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T16:28:17.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T16:28:17.554 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T16:28:17.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T16:28:17.555 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T16:28:17.556 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T16:28:17.557 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T16:28:17.557 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T16:28:17.597 INFO:tasks.ceph.mds.d:Started 2023-10-08T16:28:17.598 DEBUG:teuthology.parallel:result is None 2023-10-08T16:28:17.599 INFO:tasks.ceph.mds.b:Started 2023-10-08T16:28:17.599 DEBUG:teuthology.parallel:result is None 2023-10-08T16:28:17.602 INFO:tasks.ceph.mds.c:Started 2023-10-08T16:28:17.602 DEBUG:teuthology.parallel:result is None 2023-10-08T16:28:17.605 INFO:tasks.ceph.mds.a:Started 2023-10-08T16:28:17.605 DEBUG:teuthology.parallel:result is None 2023-10-08T16:28:17.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T16:28:17.736 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T16:28:17.737 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T16:28:17.742 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T16:28:17.743 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T16:28:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.801+0000 7f545759e700 1 Processor -- start 2023-10-08T16:28:17.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.801+0000 7f545759e700 1 -- start start 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f545759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f54580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f545759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545815afd0 con 0x7f54580cef40 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f545759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545815b2b0 con 0x7f5458153c30 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f545759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545815b590 con 0x7f545815de50 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f5456d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f54580cef40 0x7f545815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46620/0 (socket says 172.21.15.12:46620) 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f5456d9d700 1 -- 172.21.15.12:0/1680579185 learned_addr learned my addr 172.21.15.12:0/1680579185 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:17.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f5455d9b700 1 --2- 172.21.15.12:0/1680579185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f54580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.803+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041153197 0 0) 0x7f545815afd0 con 0x7f54580cef40 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5440003570 con 0x7f54580cef40 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3842166496 0 0) 0x7f545815b2b0 con 0x7f5458153c30 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f5455d9b700 1 -- 172.21.15.12:0/1680579185 >> v1:172.21.15.29:6789/0 conn(0x7f5458153c30 legacy=0x7f545815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f5455d9b700 1 -- 172.21.15.12:0/1680579185 >> v1:172.21.15.12:6789/0 conn(0x7f54580cef40 legacy=0x7f545815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f5455d9b700 1 -- 172.21.15.12:0/1680579185 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545815b870 con 0x7f545815de50 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f5455d9b700 1 --2- 172.21.15.12:0/1680579185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f54580cea00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f544c009910 tx=0x7f544c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f19ded6ba82d0b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00b680 con 0x7f545815de50 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c00b7e0 con 0x7f545815de50 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.804+0000 7f545559a700 1 -- 172.21.15.12:0/1680579185 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00bba0 con 0x7f545815de50 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 -- 172.21.15.12:0/1680579185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 msgr2=0x7f54580cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 --2- 172.21.15.12:0/1680579185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f54580cea00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f544c009910 tx=0x7f544c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 -- 172.21.15.12:0/1680579185 shutdown_connections 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 --2- 172.21.15.12:0/1680579185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f54580cea00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 -- 172.21.15.12:0/1680579185 >> 172.21.15.12:0/1680579185 conn(0x7f54580703a0 msgr2=0x7f54580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 -- 172.21.15.12:0/1680579185 shutdown_connections 2023-10-08T16:28:17.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.805+0000 7f545759e700 1 -- 172.21.15.12:0/1680579185 wait complete. 2023-10-08T16:28:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.806+0000 7f545759e700 1 Processor -- start 2023-10-08T16:28:17.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.806+0000 7f545759e700 1 -- start start 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 0x7f54580c8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f5458145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580c80b0 con 0x7f5458153c30 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5458153280 con 0x7f54580cef40 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f545759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580c92c0 con 0x7f545815de50 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.807+0000 7f5455d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46032/0 (socket says 172.21.15.12:46032) 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 -- 172.21.15.12:0/2147780294 learned_addr learned my addr 172.21.15.12:0/2147780294 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5456d9d700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f5458145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f545659c700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 0x7f54580c8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 -- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 msgr2=0x7f5458145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f5458145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 -- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 msgr2=0x7f54580c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 0x7f54580c8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 -- 172.21.15.12:0/2147780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c009420 con 0x7f5458153c30 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f545659c700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 0x7f54580c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.808+0000 7f5455d9b700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f544c009fb0 tx=0x7f544c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.809+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c000cc0 con 0x7f5458153c30 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.809+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c00bb60 con 0x7f5458153c30 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.809+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c027680 con 0x7f5458153c30 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.809+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54580c7710 con 0x7f5458153c30 2023-10-08T16:28:17.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.809+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54580c7cd0 con 0x7f5458153c30 2023-10-08T16:28:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.810+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54580c81f0 con 0x7f5458153c30 2023-10-08T16:28:17.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.811+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f544c0279f0 con 0x7f5458153c30 2023-10-08T16:28:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.812+0000 7f54467fc700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 0x7f54380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.812+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5961+0+0 (secure 0 0 0) 0x7f544c0865e0 con 0x7f5458153c30 2023-10-08T16:28:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.812+0000 7f545659c700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 0x7f54380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:17.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.813+0000 7f545659c700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 0x7f54380693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54480011e0 tx=0x7f5448009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:17.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:17.816+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54580c81f0 con 0x7f5458153c30 2023-10-08T16:28:18.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:18.034+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54580c81f0 con 0x7f5458153c30 2023-10-08T16:28:18.127 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:28:18.132 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:28:19.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.224+0000 7f54467fc700 1 -- 172.21.15.12:0/2147780294 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54580c81f0 con 0x7f5458153c30 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 msgr2=0x7f54380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 0x7f54380693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f54480011e0 tx=0x7f5448009040 comp rx=0 tx=0).stop 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 msgr2=0x7f54580c95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f544c009fb0 tx=0x7f544c017000 comp rx=0 tx=0).stop 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 shutdown_connections 2023-10-08T16:28:19.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5438066f30 0x7f54380693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f545815de50 0x7f5458145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f54580cef40 0x7f54580c8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.227+0000 7f545759e700 1 --2- 172.21.15.12:0/2147780294 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5458153c30 0x7f54580c95e0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.228+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 >> 172.21.15.12:0/2147780294 conn(0x7f54580703a0 msgr2=0x7f54580d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.228+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 shutdown_connections 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.228+0000 7f545759e700 1 -- 172.21.15.12:0/2147780294 wait complete. 2023-10-08T16:28:19.231 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T16:28:19.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T16:28:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.440+0000 7fdd3dd9d700 1 Processor -- start 2023-10-08T16:28:19.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.440+0000 7fdd3dd9d700 1 -- start start 2023-10-08T16:28:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.441+0000 7fdd3dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd3815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.441+0000 7fdd3dd9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd3806aaa0 0x7fdd380c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.441+0000 7fdd3dd9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3815ae70 con 0x7fdd3813fb20 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.441+0000 7fdd3dd9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3806af60 con 0x7fdd3806aaa0 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.441+0000 7fdd3dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3806b240 con 0x7fdd3813fef0 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd3806aaa0 0x7fdd380c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd3806aaa0 0x7fdd380c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46036/0 (socket says 172.21.15.12:46036) 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 -- 172.21.15.12:0/4253830101 learned_addr learned my addr 172.21.15.12:0/4253830101 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd37fff700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd3815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 -- 172.21.15.12:0/4253830101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 msgr2=0x7fdd3815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd3815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 -- 172.21.15.12:0/4253830101 >> v1:172.21.15.29:6789/0 conn(0x7fdd3813fb20 legacy=0x7fdd380c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 -- 172.21.15.12:0/4253830101 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3806b520 con 0x7fdd3806aaa0 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd377fe700 1 -- 172.21.15.12:0/4253830101 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760604483 0 0) 0x7fdd2c001110 con 0x7fdd3813fb20 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.442+0000 7fdd3d59c700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd380c9d00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009f20 tx=0x7fdd30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf94766c59bdb50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd377fe700 1 -- 172.21.15.12:0/4253830101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3000e070 con 0x7fdd3806aaa0 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd377fe700 1 -- 172.21.15.12:0/4253830101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3000b9d0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd377fe700 1 -- 172.21.15.12:0/4253830101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd300092e0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/4253830101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 msgr2=0x7fdd380c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd380c9d00 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fdd30009f20 tx=0x7fdd30009840 comp rx=0 tx=0).stop 2023-10-08T16:28:19.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/4253830101 shutdown_connections 2023-10-08T16:28:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd380c9d00 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/4253830101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd3815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/4253830101 >> 172.21.15.12:0/4253830101 conn(0x7fdd3806d170 msgr2=0x7fdd380cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/4253830101 shutdown_connections 2023-10-08T16:28:19.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.443+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/4253830101 wait complete. 2023-10-08T16:28:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.445+0000 7fdd3dd9d700 1 Processor -- start 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.445+0000 7fdd3dd9d700 1 -- start start 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 0x7fdd380acd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd380cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd380af520 con 0x7fdd3806aaa0 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38156000 con 0x7fdd3813fb20 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3dd9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38158760 con 0x7fdd3813fef0 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46044/0 (socket says 172.21.15.12:46044) 2023-10-08T16:28:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 -- 172.21.15.12:0/3844983357 learned_addr learned my addr 172.21.15.12:0/3844983357 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3d59c700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd380cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd37fff700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 0x7fdd380acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 -- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 msgr2=0x7fdd380cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd380cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 -- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 msgr2=0x7fdd380acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 0x7fdd380acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.446+0000 7fdd3cd9b700 1 -- 172.21.15.12:0/3844983357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30009ae0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd3d59c700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd380cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd37fff700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 0x7fdd380acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd3cd9b700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c7e0 tx=0x7fdd2c007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c012630 con 0x7fdd3806aaa0 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c0127b0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c012b70 con 0x7fdd3806aaa0 2023-10-08T16:28:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd38158a40 con 0x7fdd3806aaa0 2023-10-08T16:28:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.447+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd380af1b0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.448+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3804c3c0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.449+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd2c01b400 con 0x7fdd3806aaa0 2023-10-08T16:28:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.450+0000 7fdd34ff9700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.450+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5273+0+0 (secure 0 0 0) 0x7fdd2c083eb0 con 0x7fdd3806aaa0 2023-10-08T16:28:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.451+0000 7fdd37fff700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.451+0000 7fdd37fff700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 0x7fdd1c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdd38158eb0 tx=0x7fdd24008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.455+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd2c051230 con 0x7fdd3806aaa0 2023-10-08T16:28:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.740+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdd3815ae70 con 0x7fdd3806aaa0 2023-10-08T16:28:19.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.740+0000 7fdd34ff9700 1 -- 172.21.15.12:0/3844983357 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fdd3815ae70 con 0x7fdd3806aaa0 2023-10-08T16:28:19.740 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T16:28:19.741 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.742 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.743 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.744 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.746 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.747 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.748 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.749 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.750 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.751 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.752 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T16:28:19.753 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.754 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T16:28:19.755 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:28:19.756 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.757 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T16:28:19.758 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:28:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 msgr2=0x7fdd1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 0x7fdd1c0693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdd38158eb0 tx=0x7fdd24008040 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 msgr2=0x7fdd38155ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00c7e0 tx=0x7fdd2c007c60 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 shutdown_connections 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdd1c066f30 0x7fdd1c0693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd3806aaa0 0x7fdd38155ac0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd3813fef0 0x7fdd380cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 --2- 172.21.15.12:0/3844983357 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd3813fb20 0x7fdd380acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 >> 172.21.15.12:0/3844983357 conn(0x7fdd3806d170 msgr2=0x7fdd3813e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 shutdown_connections 2023-10-08T16:28:19.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.743+0000 7fdd3dd9d700 1 -- 172.21.15.12:0/3844983357 wait complete. 2023-10-08T16:28:19.761 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.948+0000 7fb1c359e700 1 Processor -- start 2023-10-08T16:28:19.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.948+0000 7fb1c359e700 1 -- start start 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.949+0000 7fb1c359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fef0 0x7fb1c415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.949+0000 7fb1c359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb1c406aaa0 0x7fb1c40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.949+0000 7fb1c359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c415ae70 con 0x7fb1c413fb20 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.949+0000 7fb1c359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c406af60 con 0x7fb1c406aaa0 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c406b240 con 0x7fb1c413fef0 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb1c413fb20 0x7fb1c40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46626/0 (socket says 172.21.15.12:46626) 2023-10-08T16:28:19.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c259c700 1 -- 172.21.15.12:0/3081012145 learned_addr learned my addr 172.21.15.12:0/3081012145 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c2d9d700 1 --2- 172.21.15.12:0/3081012145 >> v2:172.21.15.12:3300/0 conn(0x7fb1c406aaa0 0x7fb1c40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c1d9b700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fef0 0x7fb1c415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c159a700 1 -- 172.21.15.12:0/3081012145 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416774635 0 0) 0x7fb1b4001110 con 0x7fb1c413fb20 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c2d9d700 1 -- 172.21.15.12:0/3081012145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fef0 msgr2=0x7fb1c415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c2d9d700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fef0 0x7fb1c415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c2d9d700 1 -- 172.21.15.12:0/3081012145 >> v1:172.21.15.12:6789/0 conn(0x7fb1c413fb20 legacy=0x7fb1c40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.950+0000 7fb1c2d9d700 1 -- 172.21.15.12:0/3081012145 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c406b520 con 0x7fb1c406aaa0 2023-10-08T16:28:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c2d9d700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c40c9d00 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009e60 tx=0x7fb1bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8480c5bb326a2c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c159a700 1 -- 172.21.15.12:0/3081012145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc00bc30 con 0x7fb1c406aaa0 2023-10-08T16:28:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c159a700 1 -- 172.21.15.12:0/3081012145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc00bd90 con 0x7fb1c406aaa0 2023-10-08T16:28:19.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c159a700 1 -- 172.21.15.12:0/3081012145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0116b0 con 0x7fb1c406aaa0 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 -- 172.21.15.12:0/3081012145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 msgr2=0x7fb1c40c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c40c9d00 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009e60 tx=0x7fb1bc009780 comp rx=0 tx=0).stop 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 -- 172.21.15.12:0/3081012145 shutdown_connections 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c40c9d00 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 --2- 172.21.15.12:0/3081012145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fef0 0x7fb1c415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.951+0000 7fb1c359e700 1 -- 172.21.15.12:0/3081012145 >> 172.21.15.12:0/3081012145 conn(0x7fb1c406d170 msgr2=0x7fb1c40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.952+0000 7fb1c359e700 1 -- 172.21.15.12:0/3081012145 shutdown_connections 2023-10-08T16:28:19.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.952+0000 7fb1c359e700 1 -- 172.21.15.12:0/3081012145 wait complete. 2023-10-08T16:28:19.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.953+0000 7fb1c359e700 1 Processor -- start 2023-10-08T16:28:19.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.953+0000 7fb1c359e700 1 -- start start 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 0x7fb1c413b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 0x7fb1c413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40ade20 con 0x7fb1c406aaa0 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c413bc40 con 0x7fb1c413fef0 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c413bf20 con 0x7fb1c413fb20 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46068/0 (socket says 172.21.15.12:46068) 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.954+0000 7fb1c259c700 1 -- 172.21.15.12:0/2668719737 learned_addr learned my addr 172.21.15.12:0/2668719737 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:19.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 -- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 msgr2=0x7fb1c413b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c1d9b700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 0x7fb1c413b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c2d9d700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 0x7fb1c413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 0x7fb1c413b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 -- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 msgr2=0x7fb1c413b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 0x7fb1c413b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 -- 172.21.15.12:0/2668719737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc009a20 con 0x7fb1c406aaa0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c2d9d700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 0x7fb1c413b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c1d9b700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 0x7fb1c413b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c259c700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400c810 tx=0x7fb1b4007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4005b30 con 0x7fb1c406aaa0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b4005c90 con 0x7fb1c406aaa0 2023-10-08T16:28:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4007340 con 0x7fb1c406aaa0 2023-10-08T16:28:19.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c413c200 con 0x7fb1c406aaa0 2023-10-08T16:28:19.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.955+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c41695e0 con 0x7fb1c406aaa0 2023-10-08T16:28:19.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.956+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c41697d0 con 0x7fb1c406aaa0 2023-10-08T16:28:19.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.957+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1b401b400 con 0x7fb1c406aaa0 2023-10-08T16:28:19.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.958+0000 7fb1b27fc700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 0x7fb1a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:19.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.959+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5273+0+0 (secure 0 0 0) 0x7fb1b4083d60 con 0x7fb1c406aaa0 2023-10-08T16:28:19.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.959+0000 7fb1c1d9b700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 0x7fb1a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:19.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.959+0000 7fb1c1d9b700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 0x7fb1a40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8006aa0 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:19.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:19.962+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1b40510e0 con 0x7fb1c406aaa0 2023-10-08T16:28:20.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.166+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1c415ae70 con 0x7fb1c406aaa0 2023-10-08T16:28:20.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.167+0000 7fb1b27fc700 1 -- 172.21.15.12:0/2668719737 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+12832 (secure 0 0 0) 0x7fb1c415ae70 con 0x7fb1c406aaa0 2023-10-08T16:28:20.167 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:20.167 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":140,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:28:19.220867+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 msgr2=0x7fb1a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 0x7fb1a40693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8006aa0 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 msgr2=0x7fb1c4154e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fb1b400c810 tx=0x7fb1b4007c50 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 shutdown_connections 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1a4066f30 0x7fb1a40693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb1c406aaa0 0x7fb1c4154e20 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb1c413fef0 0x7fb1c413b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 --2- 172.21.15.12:0/2668719737 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb1c413fb20 0x7fb1c413b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.169+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 >> 172.21.15.12:0/2668719737 conn(0x7fb1c406d170 msgr2=0x7fb1c413dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.170+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 shutdown_connections 2023-10-08T16:28:20.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.170+0000 7fb1c359e700 1 -- 172.21.15.12:0/2668719737 wait complete. 2023-10-08T16:28:20.187 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T16:28:20.188 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T16:28:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.378+0000 7f9924d9d700 1 Processor -- start 2023-10-08T16:28:20.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.378+0000 7f9924d9d700 1 -- start start 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f9924d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9920142c00 0x7f992006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f9924d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200ca480 con 0x7f99200c7f90 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f9924d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f992015e240 con 0x7f992006bd20 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f9924d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f992006b350 con 0x7f9920142c00 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f991ffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f99200c7f90 0x7f992006c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46638/0 (socket says 172.21.15.12:46638) 2023-10-08T16:28:20.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f991ffff700 1 -- 172.21.15.12:0/1990400351 learned_addr learned my addr 172.21.15.12:0/1990400351 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:20.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.380+0000 7f991f7fe700 1 --2- 172.21.15.12:0/1990400351 >> v2:172.21.15.29:3300/0 conn(0x7f9920142c00 0x7f992006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337772039 0 0) 0x7f99200ca480 con 0x7f99200c7f90 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9908003570 con 0x7f99200c7f90 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342563993 0 0) 0x7f992015e240 con 0x7f992006bd20 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99200ca480 con 0x7f992006bd20 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991f7fe700 1 -- 172.21.15.12:0/1990400351 >> v1:172.21.15.29:6789/0 conn(0x7f992006bd20 legacy=0x7f99200c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991f7fe700 1 -- 172.21.15.12:0/1990400351 >> v1:172.21.15.12:6789/0 conn(0x7f99200c7f90 legacy=0x7f992006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3230783375 0 0) 0x7f9908003570 con 0x7f99200c7f90 2023-10-08T16:28:20.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991f7fe700 1 -- 172.21.15.12:0/1990400351 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992015df60 con 0x7f9920142c00 2023-10-08T16:28:20.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991f7fe700 1 --2- 172.21.15.12:0/1990400351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9920142c00 0x7f992006b7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f99100098e0 tx=0x7f99100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efeab1aaf2c5a4a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.381+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99180017f0 con 0x7f9920142c00 2023-10-08T16:28:20.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910011420 con 0x7f9920142c00 2023-10-08T16:28:20.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f991e7fc700 1 -- 172.21.15.12:0/1990400351 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99100117c0 con 0x7f9920142c00 2023-10-08T16:28:20.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 -- 172.21.15.12:0/1990400351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9920142c00 msgr2=0x7f992006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 --2- 172.21.15.12:0/1990400351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9920142c00 0x7f992006b7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f99100098e0 tx=0x7f99100091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 -- 172.21.15.12:0/1990400351 shutdown_connections 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 --2- 172.21.15.12:0/1990400351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9920142c00 0x7f992006b7e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 -- 172.21.15.12:0/1990400351 >> 172.21.15.12:0/1990400351 conn(0x7f99200675a0 msgr2=0x7f99200679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 -- 172.21.15.12:0/1990400351 shutdown_connections 2023-10-08T16:28:20.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.382+0000 7f9924d9d700 1 -- 172.21.15.12:0/1990400351 wait complete. 2023-10-08T16:28:20.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.383+0000 7f9924d9d700 1 Processor -- start 2023-10-08T16:28:20.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.384+0000 7f9924d9d700 1 -- start start 2023-10-08T16:28:20.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f992006bd20 0x7f9920159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9920142c00 0x7f992016a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c4a80 con 0x7f99200c7f90 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c50c0 con 0x7f992006bd20 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f9924d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99200c53a0 con 0x7f9920142c00 2023-10-08T16:28:20.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46084/0 (socket says 172.21.15.12:46084) 2023-10-08T16:28:20.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 -- 172.21.15.12:0/2058167673 learned_addr learned my addr 172.21.15.12:0/2058167673 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:20.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991f7fe700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f992006bd20 0x7f9920159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991ffff700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9920142c00 0x7f992016a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 -- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9920142c00 msgr2=0x7f992016a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9920142c00 0x7f992016a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 -- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f992006bd20 msgr2=0x7f9920159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f992006bd20 0x7f9920159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.385+0000 7f991effd700 1 -- 172.21.15.12:0/2058167673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009420 con 0x7f99200c7f90 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f991effd700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f991400c7c0 tx=0x7f9914007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914010510 con 0x7f99200c7f90 2023-10-08T16:28:20.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9914002e90 con 0x7f99200c7f90 2023-10-08T16:28:20.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140108e0 con 0x7f99200c7f90 2023-10-08T16:28:20.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99200c5680 con 0x7f99200c7f90 2023-10-08T16:28:20.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.386+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99200c5c40 con 0x7f99200c7f90 2023-10-08T16:28:20.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.387+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992004c3c0 con 0x7f99200c7f90 2023-10-08T16:28:20.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.388+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9914010cd0 con 0x7f99200c7f90 2023-10-08T16:28:20.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.389+0000 7f99077fe700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 0x7f990c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.389+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f9914083b70 con 0x7f99200c7f90 2023-10-08T16:28:20.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.390+0000 7f991f7fe700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 0x7f990c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.390+0000 7f991f7fe700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 0x7f990c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99100093f0 tx=0x7f9910016000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.394+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9914050ef0 con 0x7f99200c7f90 2023-10-08T16:28:20.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.600+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f992006ad00 con 0x7f99200c7f90 2023-10-08T16:28:20.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.600+0000 7f99077fe700 1 -- 172.21.15.12:0/2058167673 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9914017070 con 0x7f99200c7f90 2023-10-08T16:28:20.600 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.602+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 msgr2=0x7f990c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.602+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 0x7f990c0693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f99100093f0 tx=0x7f9910016000 comp rx=0 tx=0).stop 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.602+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 msgr2=0x7f9920141a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.602+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f991400c7c0 tx=0x7f9914007de0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 shutdown_connections 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f990c066f30 0x7f990c0693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9920142c00 0x7f992016a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f992006bd20 0x7f9920159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 --2- 172.21.15.12:0/2058167673 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99200c7f90 0x7f9920141a80 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 >> 172.21.15.12:0/2058167673 conn(0x7f99200675a0 msgr2=0x7f9920140f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 shutdown_connections 2023-10-08T16:28:20.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.603+0000 7f9924d9d700 1 -- 172.21.15.12:0/2058167673 wait complete. 2023-10-08T16:28:20.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T16:28:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.808+0000 7f353f59d700 1 Processor -- start 2023-10-08T16:28:20.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.808+0000 7f353f59d700 1 -- start start 2023-10-08T16:28:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.809+0000 7f353f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 0x7f35380aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.809+0000 7f353f59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380acc00 con 0x7f3538159550 2023-10-08T16:28:20.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.809+0000 7f353f59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380abff0 con 0x7f3538159920 2023-10-08T16:28:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.809+0000 7f353f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380ac2d0 con 0x7f353815dfd0 2023-10-08T16:28:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.809+0000 7f353e59b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3538159550 0x7f35380ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46644/0 (socket says 172.21.15.12:46644) 2023-10-08T16:28:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353e59b700 1 -- 172.21.15.12:0/2794089162 learned_addr learned my addr 172.21.15.12:0/2794089162 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:20.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353dd9a700 1 --2- 172.21.15.12:0/2794089162 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 0x7f35380aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92788207 0 0) 0x7f35380acc00 con 0x7f3538159550 2023-10-08T16:28:20.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3524003570 con 0x7f3538159550 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657921064 0 0) 0x7f35380abff0 con 0x7f3538159920 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35380acc00 con 0x7f3538159920 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353dd9a700 1 -- 172.21.15.12:0/2794089162 >> v1:172.21.15.29:6789/0 conn(0x7f3538159920 legacy=0x7f35380ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353dd9a700 1 -- 172.21.15.12:0/2794089162 >> v1:172.21.15.12:6789/0 conn(0x7f3538159550 legacy=0x7f35380ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.810+0000 7f353dd9a700 1 -- 172.21.15.12:0/2794089162 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380ac5b0 con 0x7f353815dfd0 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353dd9a700 1 --2- 172.21.15.12:0/2794089162 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 0x7f35380aedb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3528009910 tx=0x7f35280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac73fe7934d42b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011630 con 0x7f353815dfd0 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528011790 con 0x7f353815dfd0 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353d599700 1 -- 172.21.15.12:0/2794089162 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011b30 con 0x7f353815dfd0 2023-10-08T16:28:20.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353f59d700 1 -- 172.21.15.12:0/2794089162 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 msgr2=0x7f35380aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353f59d700 1 --2- 172.21.15.12:0/2794089162 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 0x7f35380aedb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3528009910 tx=0x7f35280091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353f59d700 1 -- 172.21.15.12:0/2794089162 shutdown_connections 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353f59d700 1 --2- 172.21.15.12:0/2794089162 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f353815dfd0 0x7f35380aedb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.811+0000 7f353f59d700 1 -- 172.21.15.12:0/2794089162 >> 172.21.15.12:0/2794089162 conn(0x7f353806ce80 msgr2=0x7f35380ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.812+0000 7f353f59d700 1 -- 172.21.15.12:0/2794089162 shutdown_connections 2023-10-08T16:28:20.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.812+0000 7f353f59d700 1 -- 172.21.15.12:0/2794089162 wait complete. 2023-10-08T16:28:20.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.813+0000 7f353f59d700 1 Processor -- start 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.813+0000 7f353f59d700 1 -- start start 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3538159550 0x7f3538150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f353815dfd0 0x7f3538151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353816a270 con 0x7f3538159920 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538169c60 con 0x7f353815dfd0 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380ca030 con 0x7f3538159550 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46088/0 (socket says 172.21.15.12:46088) 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.814+0000 7f353dd9a700 1 -- 172.21.15.12:0/2111942249 learned_addr learned my addr 172.21.15.12:0/2111942249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:20.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353ed9c700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f353815dfd0 0x7f3538151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353e59b700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3538159550 0x7f3538150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 -- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3538159550 msgr2=0x7f3538150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3538159550 0x7f3538150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 -- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f353815dfd0 msgr2=0x7f3538151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f353815dfd0 0x7f3538151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:20.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 -- 172.21.15.12:0/2111942249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009420 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f353dd9a700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f353806ad70 tx=0x7f3528017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.815+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352801f070 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.816+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528002f70 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.816+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538169f00 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.816+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528011900 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.816+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380ca310 con 0x7f3538159920 2023-10-08T16:28:20.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.817+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35380caca0 con 0x7f3538159920 2023-10-08T16:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.817+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3528023070 con 0x7f3538159920 2023-10-08T16:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.818+0000 7f352e7fc700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.818+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f3528085630 con 0x7f3538159920 2023-10-08T16:28:20.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.819+0000 7f353e59b700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:20.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.819+0000 7f353e59b700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3534007fd0 tx=0x7f3534009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:20.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:20.823+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35280529b0 con 0x7f3538159920 2023-10-08T16:28:21.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.026+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f353804c3c0 con 0x7f3538159920 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.027+0000 7f352e7fc700 1 -- 172.21.15.12:0/2111942249 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3528015090 con 0x7f3538159920 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:21.027 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:28:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 msgr2=0x7f351c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3534007fd0 tx=0x7f3534009040 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 msgr2=0x7f35380c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f353806ad70 tx=0x7f3528017000 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 shutdown_connections 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f353815dfd0 0x7f3538151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3538159550 0x7f3538150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 --2- 172.21.15.12:0/2111942249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3538159920 0x7f35380c9620 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 >> 172.21.15.12:0/2111942249 conn(0x7f353806ce80 msgr2=0x7f3538152aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 shutdown_connections 2023-10-08T16:28:21.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.029+0000 7f353f59d700 1 -- 172.21.15.12:0/2111942249 wait complete. 2023-10-08T16:28:21.046 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T16:28:21.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T16:28:21.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.238+0000 7f3d8ffff700 1 Processor -- start 2023-10-08T16:28:21.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.239+0000 7f3d8ffff700 1 -- start start 2023-10-08T16:28:21.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d90159800 0x7f3d900b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d900b1d40 0x7f3d900b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900b0c80 con 0x7f3d900b24f0 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900d10d0 con 0x7f3d900b1d40 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900b0f60 con 0x7f3d90159800 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d900b1d40 0x7f3d900b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d900b1d40 0x7f3d900b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46102/0 (socket says 172.21.15.12:46102) 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/1200358499 learned_addr learned my addr 172.21.15.12:0/1200358499 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.240+0000 7f3d8e7fc700 1 --2- 172.21.15.12:0/1200358499 >> v2:172.21.15.29:3300/0 conn(0x7f3d90159800 0x7f3d900b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/1200358499 >> v2:172.21.15.29:3300/0 conn(0x7f3d90159800 msgr2=0x7f3d900b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8f7fe700 1 --2- 172.21.15.12:0/1200358499 >> v2:172.21.15.29:3300/0 conn(0x7f3d90159800 0x7f3d900b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/1200358499 >> v1:172.21.15.29:6789/0 conn(0x7f3d900b24f0 legacy=0x7f3d901590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/1200358499 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900b1240 con 0x7f3d900b1d40 2023-10-08T16:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8f7fe700 1 --2- 172.21.15.12:0/1200358499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d900b1d40 0x7f3d900b4ae0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3d9015d1a0 tx=0x7f3d88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d346fdfe66821046 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8dffb700 1 -- 172.21.15.12:0/1200358499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800e070 con 0x7f3d900b1d40 2023-10-08T16:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8dffb700 1 -- 172.21.15.12:0/1200358499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800ba50 con 0x7f3d900b1d40 2023-10-08T16:28:21.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.241+0000 7f3d8dffb700 1 -- 172.21.15.12:0/1200358499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880092e0 con 0x7f3d900b1d40 2023-10-08T16:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 -- 172.21.15.12:0/1200358499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d900b1d40 msgr2=0x7f3d900b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/1200358499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d900b1d40 0x7f3d900b4ae0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f3d9015d1a0 tx=0x7f3d88009840 comp rx=0 tx=0).stop 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 -- 172.21.15.12:0/1200358499 shutdown_connections 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/1200358499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d900b1d40 0x7f3d900b4ae0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/1200358499 >> v2:172.21.15.29:3300/0 conn(0x7f3d90159800 0x7f3d900b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 -- 172.21.15.12:0/1200358499 >> 172.21.15.12:0/1200358499 conn(0x7f3d900703a0 msgr2=0x7f3d900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 -- 172.21.15.12:0/1200358499 shutdown_connections 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.242+0000 7f3d8ffff700 1 -- 172.21.15.12:0/1200358499 wait complete. 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.244+0000 7f3d8ffff700 1 Processor -- start 2023-10-08T16:28:21.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.244+0000 7f3d8ffff700 1 -- start start 2023-10-08T16:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d900b1d40 0x7f3d90154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d900b24f0 0x7f3d9015a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d901698e0 con 0x7f3d90159800 2023-10-08T16:28:21.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015aee0 con 0x7f3d900b1d40 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015b1c0 con 0x7f3d900b24f0 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:46112/0 (socket says 172.21.15.12:46112) 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/3978878192 learned_addr learned my addr 172.21.15.12:0/3978878192 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8e7fc700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d900b24f0 0x7f3d9015a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8effd700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d900b1d40 0x7f3d90154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.245+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d900b24f0 msgr2=0x7f3d9015a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8f7fe700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d900b24f0 0x7f3d9015a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d900b1d40 msgr2=0x7f3d90154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8f7fe700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d900b1d40 0x7f3d90154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8f7fe700 1 -- 172.21.15.12:0/3978878192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009ae0 con 0x7f3d90159800 2023-10-08T16:28:21.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8f7fe700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3d90089370 tx=0x7f3d88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800be60 con 0x7f3d90159800 2023-10-08T16:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88008d20 con 0x7f3d90159800 2023-10-08T16:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880256b0 con 0x7f3d90159800 2023-10-08T16:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9015b4a0 con 0x7f3d90159800 2023-10-08T16:28:21.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.246+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9015aba0 con 0x7f3d90159800 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.248+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9004c3c0 con 0x7f3d90159800 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.248+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d88003040 con 0x7f3d90159800 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.249+0000 7f3d76ffd700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.249+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5273+0+0 (secure 0 0 0) 0x7f3d880859a0 con 0x7f3d90159800 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.250+0000 7f3d8effd700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:21.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.250+0000 7f3d8effd700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 0x7f3d7c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d80003a80 tx=0x7f3d80007ec0 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:21.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.257+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d88052dd0 con 0x7f3d90159800 2023-10-08T16:28:21.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:21.463+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3d90169a20 con 0x7f3d90159800 2023-10-08T16:28:22.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.243+0000 7f3d76ffd700 1 -- 172.21.15.12:0/3978878192 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3d88009940 con 0x7f3d90159800 2023-10-08T16:28:22.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.249+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 msgr2=0x7f3d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.249+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 0x7f3d7c0693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3d80003a80 tx=0x7f3d80007ec0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.249+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 msgr2=0x7f3d9015c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.249+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f3d90089370 tx=0x7f3d88018000 comp rx=0 tx=0).stop 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 shutdown_connections 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d7c066f30 0x7f3d7c0693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d90159800 0x7f3d9015c3a0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d900b1d40 0x7f3d90154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 --2- 172.21.15.12:0/3978878192 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d900b24f0 0x7f3d9015a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.250+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 >> 172.21.15.12:0/3978878192 conn(0x7f3d900703a0 msgr2=0x7f3d900b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:22.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.252+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 shutdown_connections 2023-10-08T16:28:22.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.253+0000 7f3d8ffff700 1 -- 172.21.15.12:0/3978878192 wait complete. 2023-10-08T16:28:22.255 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T16:28:22.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T16:28:22.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.474+0000 7f9e8d99d700 1 Processor -- start 2023-10-08T16:28:22.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.474+0000 7f9e8d99d700 1 -- start start 2023-10-08T16:28:22.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.475+0000 7f9e8d99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 0x7f9e8815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.475+0000 7f9e8d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 0x7f9e880c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.475+0000 7f9e8d99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8815ae70 con 0x7f9e8806aaa0 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.475+0000 7f9e8d99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8806af60 con 0x7f9e8813fb20 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.475+0000 7f9e8d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8806b240 con 0x7f9e8813fef0 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e8d19c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9e8806aaa0 0x7f9e880c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33470/0 (socket says 172.21.15.12:33470) 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e8d19c700 1 -- 172.21.15.12:0/865655585 learned_addr learned my addr 172.21.15.12:0/865655585 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e87fff700 1 --2- 172.21.15.12:0/865655585 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 0x7f9e880c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e8c99b700 1 --2- 172.21.15.12:0/865655585 >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 0x7f9e8815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e877fe700 1 -- 172.21.15.12:0/865655585 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1440756100 0 0) 0x7f9e80001490 con 0x7f9e8806aaa0 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e877fe700 1 -- 172.21.15.12:0/865655585 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e78003570 con 0x7f9e8806aaa0 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e87fff700 1 -- 172.21.15.12:0/865655585 >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 msgr2=0x7f9e8815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e87fff700 1 --2- 172.21.15.12:0/865655585 >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 0x7f9e8815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e87fff700 1 -- 172.21.15.12:0/865655585 >> v1:172.21.15.12:6789/0 conn(0x7f9e8806aaa0 legacy=0x7f9e880c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e87fff700 1 -- 172.21.15.12:0/865655585 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8806b520 con 0x7f9e8813fef0 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.476+0000 7f9e8c99b700 1 --2- 172.21.15.12:0/865655585 >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 0x7f9e8815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e87fff700 1 --2- 172.21.15.12:0/865655585 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 0x7f9e880c7990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e740098d0 tx=0x7f9e74009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad7faabc7b5dd80 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:22.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e877fe700 1 -- 172.21.15.12:0/865655585 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74005c10 con 0x7f9e8813fef0 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e877fe700 1 -- 172.21.15.12:0/865655585 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74005d70 con 0x7f9e8813fef0 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e877fe700 1 -- 172.21.15.12:0/865655585 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74006260 con 0x7f9e8813fef0 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e8d99d700 1 -- 172.21.15.12:0/865655585 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 msgr2=0x7f9e880c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.477+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/865655585 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 0x7f9e880c7990 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e740098d0 tx=0x7f9e74009120 comp rx=0 tx=0).stop 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 -- 172.21.15.12:0/865655585 shutdown_connections 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/865655585 >> v2:172.21.15.29:3300/0 conn(0x7f9e8813fb20 0x7f9e8815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/865655585 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8813fef0 0x7f9e880c7990 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 -- 172.21.15.12:0/865655585 >> 172.21.15.12:0/865655585 conn(0x7f9e8806d170 msgr2=0x7f9e880cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 -- 172.21.15.12:0/865655585 shutdown_connections 2023-10-08T16:28:22.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.478+0000 7f9e8d99d700 1 -- 172.21.15.12:0/865655585 wait complete. 2023-10-08T16:28:22.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.479+0000 7f9e8d99d700 1 Processor -- start 2023-10-08T16:28:22.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.479+0000 7f9e8d99d700 1 -- start start 2023-10-08T16:28:22.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8806aaa0 0x7f9e8813cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8813fb20 0x7f9e88157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e88158670 con 0x7f9e8813fef0 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881655d0 con 0x7f9e8813fb20 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e881652d0 con 0x7f9e8806aaa0 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54966/0 (socket says 172.21.15.12:54966) 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.480+0000 7f9e8d19c700 1 -- 172.21.15.12:0/2987119240 learned_addr learned my addr 172.21.15.12:0/2987119240 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8c99b700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8806aaa0 0x7f9e8813cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e87fff700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8813fb20 0x7f9e88157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 -- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8806aaa0 msgr2=0x7f9e8813cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8806aaa0 0x7f9e8813cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 -- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8813fb20 msgr2=0x7f9e88157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8813fb20 0x7f9e88157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 -- 172.21.15.12:0/2987119240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c009420 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d19c700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000cc40 tx=0x7f9e80001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000a920 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8000aa80 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e740093c0 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.481+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8000ae00 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.482+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e881580b0 con 0x7f9e8813fef0 2023-10-08T16:28:22.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.483+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e88165780 con 0x7f9e8813fef0 2023-10-08T16:28:22.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.485+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e80007300 con 0x7f9e8813fef0 2023-10-08T16:28:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.485+0000 7f9e84ff9700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.486+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5643+0+0 (secure 0 0 0) 0x7f9e800851c0 con 0x7f9e8813fef0 2023-10-08T16:28:22.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.486+0000 7f9e8c99b700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:22.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.486+0000 7f9e8c99b700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0093f0 tx=0x7f9e7c008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:22.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.489+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e80052440 con 0x7f9e8813fef0 2023-10-08T16:28:22.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:22.693+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9e8815ae70 con 0x7f9e8813fef0 2023-10-08T16:28:23.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.252+0000 7f9e84ff9700 1 -- 172.21.15.12:0/2987119240 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9e8815ae70 con 0x7f9e8813fef0 2023-10-08T16:28:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.262+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 msgr2=0x7f9e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.262+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c0093f0 tx=0x7f9e7c008040 comp rx=0 tx=0).stop 2023-10-08T16:28:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.262+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 msgr2=0x7f9e880c18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.262+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9e8000cc40 tx=0x7f9e80001a10 comp rx=0 tx=0).stop 2023-10-08T16:28:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 shutdown_connections 2023-10-08T16:28:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9e6c066f30 0x7f9e6c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9e8813fef0 0x7f9e880c18a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9e8806aaa0 0x7f9e8813cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 --2- 172.21.15.12:0/2987119240 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9e8813fb20 0x7f9e88157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.264+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 >> 172.21.15.12:0/2987119240 conn(0x7f9e8806d170 msgr2=0x7f9e880c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:23.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.266+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 shutdown_connections 2023-10-08T16:28:23.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.268+0000 7f9e8d99d700 1 -- 172.21.15.12:0/2987119240 wait complete. 2023-10-08T16:28:23.273 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T16:28:23.295 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T16:28:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.489+0000 7f3fdb19d700 1 Processor -- start 2023-10-08T16:28:23.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.489+0000 7f3fdb19d700 1 -- start start 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fdb19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fd4142c00 0x7f3fd406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fdb19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3fd406bd20 0x7f3fd40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fdb19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd40ca480 con 0x7f3fd4142fd0 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fdb19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd415e240 con 0x7f3fd406bd20 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fdb19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd406b350 con 0x7f3fd4142c00 2023-10-08T16:28:23.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fd999a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3fd406bd20 0x7f3fd40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fda99c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3fd4142fd0 0x7f3fd406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33482/0 (socket says 172.21.15.12:33482) 2023-10-08T16:28:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fda99c700 1 -- 172.21.15.12:0/2065906576 learned_addr learned my addr 172.21.15.12:0/2065906576 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:23.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.491+0000 7f3fda19b700 1 --2- 172.21.15.12:0/2065906576 >> v2:172.21.15.29:3300/0 conn(0x7f3fd4142c00 0x7f3fd406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd999a700 1 -- 172.21.15.12:0/2065906576 >> v2:172.21.15.29:3300/0 conn(0x7f3fd4142c00 msgr2=0x7f3fd406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd999a700 1 --2- 172.21.15.12:0/2065906576 >> v2:172.21.15.29:3300/0 conn(0x7f3fd4142c00 0x7f3fd406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd999a700 1 -- 172.21.15.12:0/2065906576 >> v1:172.21.15.12:6789/0 conn(0x7f3fd4142fd0 legacy=0x7f3fd406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd999a700 1 -- 172.21.15.12:0/2065906576 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd415df60 con 0x7f3fd406bd20 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd9199700 1 -- 172.21.15.12:0/2065906576 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448307130 0 0) 0x7f3fd40ca480 con 0x7f3fd4142fd0 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd999a700 1 --2- 172.21.15.12:0/2065906576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd40c7880 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406f490 tx=0x7f3fc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9024bbda76ff07b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd9199700 1 -- 172.21.15.12:0/2065906576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4011630 con 0x7f3fd406bd20 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd9199700 1 -- 172.21.15.12:0/2065906576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc4011790 con 0x7f3fd406bd20 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.492+0000 7f3fd9199700 1 -- 172.21.15.12:0/2065906576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc4011b30 con 0x7f3fd406bd20 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2065906576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 msgr2=0x7f3fd40c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2065906576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd40c7880 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406f490 tx=0x7f3fc40091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2065906576 shutdown_connections 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2065906576 >> v2:172.21.15.29:3300/0 conn(0x7f3fd4142c00 0x7f3fd406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2065906576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd40c7880 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2065906576 >> 172.21.15.12:0/2065906576 conn(0x7f3fd40675a0 msgr2=0x7f3fd40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2065906576 shutdown_connections 2023-10-08T16:28:23.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.493+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2065906576 wait complete. 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.494+0000 7f3fdb19d700 1 Processor -- start 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 -- start start 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fd4142c00 0x7f3fd40c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fd4142fd0 0x7f3fd40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40c42f0 con 0x7f3fd406bd20 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd40c5150 con 0x7f3fd4142c00 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.495+0000 7f3fdb19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd416ae30 con 0x7f3fd4142fd0 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54990/0 (socket says 172.21.15.12:54990) 2023-10-08T16:28:23.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 -- 172.21.15.12:0/2696477234 learned_addr learned my addr 172.21.15.12:0/2696477234 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fd999a700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fd4142c00 0x7f3fd40c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda99c700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fd4142fd0 0x7f3fd40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 -- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fd4142fd0 msgr2=0x7f3fd40c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fd4142fd0 0x7f3fd40c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 -- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fd4142c00 msgr2=0x7f3fd40c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fd4142c00 0x7f3fd40c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.496+0000 7f3fda19b700 1 -- 172.21.15.12:0/2696477234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc4009420 con 0x7f3fd406bd20 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fda19b700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000ecb0 tx=0x7f3fd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000c920 con 0x7f3fd406bd20 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000ca80 con 0x7f3fd406bd20 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000ce20 con 0x7f3fd406bd20 2023-10-08T16:28:23.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd40c4540 con 0x7f3fd406bd20 2023-10-08T16:28:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.497+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd40c4b00 con 0x7f3fd406bd20 2023-10-08T16:28:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.498+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd404c3c0 con 0x7f3fd406bd20 2023-10-08T16:28:23.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.499+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd0013680 con 0x7f3fd406bd20 2023-10-08T16:28:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.500+0000 7f3fca7fc700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.500+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 6025+0+0 (secure 0 0 0) 0x7f3fd0084a10 con 0x7f3fd406bd20 2023-10-08T16:28:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.500+0000 7f3fd999a700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:23.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.501+0000 7f3fd999a700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406c180 tx=0x7f3fc4017000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:23.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.504+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd0051aa0 con 0x7f3fd406bd20 2023-10-08T16:28:23.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:23.750+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3fd406ad00 con 0x7f3fd406bd20 2023-10-08T16:28:24.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.257+0000 7f3fca7fc700 1 -- 172.21.15.12:0/2696477234 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3fd0084020 con 0x7f3fd406bd20 2023-10-08T16:28:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.272+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 msgr2=0x7f3fb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.272+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 0x7f3fb80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3fd406c180 tx=0x7f3fc4017000 comp rx=0 tx=0).stop 2023-10-08T16:28:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.272+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 msgr2=0x7f3fd416a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.272+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000ecb0 tx=0x7f3fd00091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 shutdown_connections 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3fb8066f30 0x7f3fb80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fd406bd20 0x7f3fd416a8f0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fd4142fd0 0x7f3fd40c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 --2- 172.21.15.12:0/2696477234 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fd4142c00 0x7f3fd40c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.275+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 >> 172.21.15.12:0/2696477234 conn(0x7f3fd40675a0 msgr2=0x7f3fd40cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.277+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 shutdown_connections 2023-10-08T16:28:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.277+0000 7f3fdb19d700 1 -- 172.21.15.12:0/2696477234 wait complete. 2023-10-08T16:28:24.285 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 16 and data pool 17 2023-10-08T16:28:24.307 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.496+0000 7fb219f9d700 1 Processor -- start 2023-10-08T16:28:24.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.496+0000 7fb219f9d700 1 -- start start 2023-10-08T16:28:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.497+0000 7fb219f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb214157410 0x7fb2140c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb219f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2140677b0 0x7fb214067c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb219f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2140c8080 con 0x7fb2141577e0 2023-10-08T16:28:24.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb219f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2140c75a0 con 0x7fb214157410 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb219f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2140c8a50 con 0x7fb2140677b0 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb214157410 0x7fb2140c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb214157410 0x7fb2140c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54996/0 (socket says 172.21.15.12:54996) 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 -- 172.21.15.12:0/3077783453 learned_addr learned my addr 172.21.15.12:0/3077783453 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb213fff700 1 --1- 172.21.15.12:0/3077783453 >> v1:172.21.15.12:6789/0 conn(0x7fb2141577e0 0x7fb21406a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33486/0 (socket says 172.21.15.12:33486) 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb21979c700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2140677b0 0x7fb214067c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 -- 172.21.15.12:0/3077783453 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2140677b0 msgr2=0x7fb214067c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2140677b0 0x7fb214067c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 -- 172.21.15.12:0/3077783453 >> v1:172.21.15.12:6789/0 conn(0x7fb2141577e0 legacy=0x7fb21406a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb218f9b700 1 -- 172.21.15.12:0/3077783453 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140688b0 con 0x7fb214157410 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.498+0000 7fb2137fe700 1 -- 172.21.15.12:0/3077783453 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2663216730 0 0) 0x7fb2140c8080 con 0x7fb2141577e0 2023-10-08T16:28:24.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb218f9b700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb214157410 0x7fb2140c8510 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb2080099e0 tx=0x7fb208009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488a11b11ef8012b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb2137fe700 1 -- 172.21.15.12:0/3077783453 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20800b820 con 0x7fb214157410 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb2137fe700 1 -- 172.21.15.12:0/3077783453 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20800b980 con 0x7fb214157410 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb2137fe700 1 -- 172.21.15.12:0/3077783453 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20800bd20 con 0x7fb214157410 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb219f9d700 1 -- 172.21.15.12:0/3077783453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb214157410 msgr2=0x7fb2140c8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb219f9d700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb214157410 0x7fb2140c8510 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fb2080099e0 tx=0x7fb208009250 comp rx=0 tx=0).stop 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb219f9d700 1 -- 172.21.15.12:0/3077783453 shutdown_connections 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb219f9d700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2140677b0 0x7fb214067c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.499+0000 7fb219f9d700 1 --2- 172.21.15.12:0/3077783453 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb214157410 0x7fb2140c8510 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.500+0000 7fb219f9d700 1 -- 172.21.15.12:0/3077783453 >> 172.21.15.12:0/3077783453 conn(0x7fb21406f310 msgr2=0x7fb2140cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.500+0000 7fb219f9d700 1 -- 172.21.15.12:0/3077783453 shutdown_connections 2023-10-08T16:28:24.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.500+0000 7fb219f9d700 1 -- 172.21.15.12:0/3077783453 wait complete. 2023-10-08T16:28:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.501+0000 7fb219f9d700 1 Processor -- start 2023-10-08T16:28:24.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.501+0000 7fb219f9d700 1 -- start start 2023-10-08T16:28:24.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb214157410 0x7fb214150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2141577e0 0x7fb2140ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214152a90 con 0x7fb2140677b0 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb214158180 con 0x7fb214157410 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb219f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21415a2e0 con 0x7fb2141577e0 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb218f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb218f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55000/0 (socket says 172.21.15.12:55000) 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb218f9b700 1 -- 172.21.15.12:0/2971668415 learned_addr learned my addr 172.21.15.12:0/2971668415 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb21979c700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2141577e0 0x7fb2140ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.502+0000 7fb213fff700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb214157410 0x7fb214150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 -- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2141577e0 msgr2=0x7fb2140ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2141577e0 0x7fb2140ca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 -- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb214157410 msgr2=0x7fb214150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb214157410 0x7fb214150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 -- 172.21.15.12:0/2971668415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2080094f0 con 0x7fb2140677b0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb218f9b700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb21406e050 tx=0x7fb208017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20801f070 con 0x7fb2140677b0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb208011c40 con 0x7fb2140677b0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb21415a5c0 con 0x7fb2140677b0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb208025420 con 0x7fb2140677b0 2023-10-08T16:28:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.503+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb21415ab80 con 0x7fb2140677b0 2023-10-08T16:28:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.504+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb21415ad70 con 0x7fb2140677b0 2023-10-08T16:28:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.505+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb208023070 con 0x7fb2140677b0 2023-10-08T16:28:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.506+0000 7fb210ff9700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 0x7fb1f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.506+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fb208085d50 con 0x7fb2140677b0 2023-10-08T16:28:24.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.506+0000 7fb213fff700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 0x7fb1f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.507+0000 7fb213fff700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 0x7fb1f80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2140cb690 tx=0x7fb200007bf0 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.511+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb208052dc0 con 0x7fb2140677b0 2023-10-08T16:28:24.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.717+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb21404c3c0 con 0x7fb2140677b0 2023-10-08T16:28:24.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.718+0000 7fb210ff9700 1 -- 172.21.15.12:0/2971668415 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fb2080563a0 con 0x7fb2140677b0 2023-10-08T16:28:24.718 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:24.718 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":143,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:28:23.751357+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 msgr2=0x7fb1f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 0x7fb1f80693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb2140cb690 tx=0x7fb200007bf0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 msgr2=0x7fb214157c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fb21406e050 tx=0x7fb208017000 comp rx=0 tx=0).stop 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 shutdown_connections 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb1f8066f30 0x7fb1f80693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2140677b0 0x7fb214157c40 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb2141577e0 0x7fb2140ca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 --2- 172.21.15.12:0/2971668415 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb214157410 0x7fb214150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 >> 172.21.15.12:0/2971668415 conn(0x7fb21406f310 msgr2=0x7fb214150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 shutdown_connections 2023-10-08T16:28:24.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.721+0000 7fb219f9d700 1 -- 172.21.15.12:0/2971668415 wait complete. 2023-10-08T16:28:24.738 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.925+0000 7f76c559d700 1 Processor -- start 2023-10-08T16:28:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.925+0000 7f76c559d700 1 -- start start 2023-10-08T16:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c559d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76c013fef0 0x7f76c015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c559d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f76c006aaa0 0x7f76c00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c559d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c015ae70 con 0x7f76c013fb20 2023-10-08T16:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c559d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c006af60 con 0x7f76c013fef0 2023-10-08T16:28:24.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c559d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c006b240 con 0x7f76c006aaa0 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76c013fef0 0x7f76c015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76c013fef0 0x7f76c015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55014/0 (socket says 172.21.15.12:55014) 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 -- 172.21.15.12:0/1961223213 learned_addr learned my addr 172.21.15.12:0/1961223213 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76c4d9c700 1 --2- 172.21.15.12:0/1961223213 >> v2:172.21.15.29:3300/0 conn(0x7f76c006aaa0 0x7f76c00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 -- 172.21.15.12:0/1961223213 >> v2:172.21.15.29:3300/0 conn(0x7f76c006aaa0 msgr2=0x7f76c00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 --2- 172.21.15.12:0/1961223213 >> v2:172.21.15.29:3300/0 conn(0x7f76c006aaa0 0x7f76c00c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 -- 172.21.15.12:0/1961223213 >> v1:172.21.15.29:6789/0 conn(0x7f76c013fb20 legacy=0x7f76c00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.927+0000 7f76bf7fe700 1 -- 172.21.15.12:0/1961223213 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c006b520 con 0x7f76c013fef0 2023-10-08T16:28:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76bf7fe700 1 --2- 172.21.15.12:0/1961223213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c013fef0 0x7f76c015a930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f76c0069d40 tx=0x7f76b4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21bec29adeb9f612 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76beffd700 1 -- 172.21.15.12:0/1961223213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4005c10 con 0x7f76c013fef0 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76beffd700 1 -- 172.21.15.12:0/1961223213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4005d70 con 0x7f76c013fef0 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76beffd700 1 -- 172.21.15.12:0/1961223213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b400b880 con 0x7f76c013fef0 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76c559d700 1 -- 172.21.15.12:0/1961223213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c013fef0 msgr2=0x7f76c015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.928+0000 7f76c559d700 1 --2- 172.21.15.12:0/1961223213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c013fef0 0x7f76c015a930 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f76c0069d40 tx=0x7f76b4009220 comp rx=0 tx=0).stop 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 -- 172.21.15.12:0/1961223213 shutdown_connections 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 --2- 172.21.15.12:0/1961223213 >> v2:172.21.15.29:3300/0 conn(0x7f76c006aaa0 0x7f76c00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 --2- 172.21.15.12:0/1961223213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c013fef0 0x7f76c015a930 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 -- 172.21.15.12:0/1961223213 >> 172.21.15.12:0/1961223213 conn(0x7f76c006d170 msgr2=0x7f76c00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 -- 172.21.15.12:0/1961223213 shutdown_connections 2023-10-08T16:28:24.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.929+0000 7f76c559d700 1 -- 172.21.15.12:0/1961223213 wait complete. 2023-10-08T16:28:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.930+0000 7f76c559d700 1 Processor -- start 2023-10-08T16:28:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.930+0000 7f76c559d700 1 -- start start 2023-10-08T16:28:24.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76c013fb20 0x7f76c00ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76c013fef0 0x7f76c0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c013a9f0 con 0x7f76c006aaa0 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00ad570 con 0x7f76c013fef0 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00ad840 con 0x7f76c013fb20 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76bffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55016/0 (socket says 172.21.15.12:55016) 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76bffff700 1 -- 172.21.15.12:0/2527091689 learned_addr learned my addr 172.21.15.12:0/2527091689 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76c4d9c700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76c013fef0 0x7f76c0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.931+0000 7f76bf7fe700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76c013fb20 0x7f76c00ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 -- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76c013fb20 msgr2=0x7f76c00ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76c013fb20 0x7f76c00ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 -- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76c013fef0 msgr2=0x7f76c0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76c013fef0 0x7f76c0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 -- 172.21.15.12:0/2527091689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009480 con 0x7f76c006aaa0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76bffff700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c590 tx=0x7f76b000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0011590 con 0x7f76c006aaa0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b0011710 con 0x7f76c006aaa0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c00adb20 con 0x7f76c006aaa0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0011ad0 con 0x7f76c006aaa0 2023-10-08T16:28:24.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.932+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c00ae0e0 con 0x7f76c006aaa0 2023-10-08T16:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.933+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c004c3c0 con 0x7f76c006aaa0 2023-10-08T16:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.934+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76b001b3b0 con 0x7f76c006aaa0 2023-10-08T16:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.935+0000 7f76a7fff700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 0x7f76ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.935+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f76b0083a30 con 0x7f76c006aaa0 2023-10-08T16:28:24.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.935+0000 7f76bf7fe700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 0x7f76ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:24.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.936+0000 7f76bf7fe700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 0x7f76ac0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76c0069d40 tx=0x7f76b4018000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:24.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:24.939+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76b0050a60 con 0x7f76c006aaa0 2023-10-08T16:28:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.142+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76c015ae70 con 0x7f76c006aaa0 2023-10-08T16:28:25.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.143+0000 7f76a7fff700 1 -- 172.21.15.12:0/2527091689 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f76c015ae70 con 0x7f76c006aaa0 2023-10-08T16:28:25.143 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:25.143 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":143,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:28:23.751357+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:25.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 msgr2=0x7f76ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 0x7f76ac0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f76c0069d40 tx=0x7f76b4018000 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 msgr2=0x7f76c00acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f76b000c590 tx=0x7f76b000c8a0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 shutdown_connections 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f76ac066f30 0x7f76ac0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76c006aaa0 0x7f76c00acaf0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76c013fef0 0x7f76c0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 --2- 172.21.15.12:0/2527091689 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76c013fb20 0x7f76c00ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.145+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 >> 172.21.15.12:0/2527091689 conn(0x7f76c006d170 msgr2=0x7f76c00b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.146+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 shutdown_connections 2023-10-08T16:28:25.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.146+0000 7f76c559d700 1 -- 172.21.15.12:0/2527091689 wait complete. 2023-10-08T16:28:25.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T16:28:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.358+0000 7f92f599d700 1 Processor -- start 2023-10-08T16:28:25.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.358+0000 7f92f599d700 1 -- start start 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f599d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92f0155c60 0x7f92f00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f599d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f599d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00c7e70 con 0x7f92f0155890 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f599d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f006e810 con 0x7f92f0155c60 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f599d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f006b790 con 0x7f92f006de50 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f499b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f92f0155890 0x7f92f006a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33488/0 (socket says 172.21.15.12:33488) 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f499b700 1 -- 172.21.15.12:0/236236419 learned_addr learned my addr 172.21.15.12:0/236236419 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:25.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92effff700 1 --2- 172.21.15.12:0/236236419 >> v2:172.21.15.12:3300/0 conn(0x7f92f0155c60 0x7f92f00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92f519c700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92ef7fe700 1 -- 172.21.15.12:0/236236419 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843794483 0 0) 0x7f92f00c7e70 con 0x7f92f0155890 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92ef7fe700 1 -- 172.21.15.12:0/236236419 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e0003570 con 0x7f92f0155890 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92effff700 1 -- 172.21.15.12:0/236236419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 msgr2=0x7f92f006e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92effff700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f006e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.360+0000 7f92effff700 1 -- 172.21.15.12:0/236236419 >> v1:172.21.15.12:6789/0 conn(0x7f92f0155890 legacy=0x7f92f006a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.361+0000 7f92effff700 1 -- 172.21.15.12:0/236236419 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f006ab80 con 0x7f92f0155c60 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.361+0000 7f92effff700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f00c7930 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098e0 tx=0x7f92dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a333ed913f969382 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.361+0000 7f92ef7fe700 1 -- 172.21.15.12:0/236236419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00b640 con 0x7f92f0155c60 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.361+0000 7f92ef7fe700 1 -- 172.21.15.12:0/236236419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc00b7a0 con 0x7f92f0155c60 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.361+0000 7f92ef7fe700 1 -- 172.21.15.12:0/236236419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92dc00bb40 con 0x7f92f0155c60 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 -- 172.21.15.12:0/236236419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 msgr2=0x7f92f00c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f00c7930 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f92dc0098e0 tx=0x7f92dc0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 -- 172.21.15.12:0/236236419 shutdown_connections 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f006e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 --2- 172.21.15.12:0/236236419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f00c7930 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 -- 172.21.15.12:0/236236419 >> 172.21.15.12:0/236236419 conn(0x7f92f006d110 msgr2=0x7f92f00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 -- 172.21.15.12:0/236236419 shutdown_connections 2023-10-08T16:28:25.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.362+0000 7f92f599d700 1 -- 172.21.15.12:0/236236419 wait complete. 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.363+0000 7f92f599d700 1 Processor -- start 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.363+0000 7f92f599d700 1 -- start start 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f00af8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 0x7f92f0165140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f0166250 con 0x7f92f0155c60 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00b0130 con 0x7f92f0155890 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f599d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f00b0410 con 0x7f92f006de50 2023-10-08T16:28:25.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f519c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55030/0 (socket says 172.21.15.12:55030) 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.364+0000 7f92f519c700 1 -- 172.21.15.12:0/1142179012 learned_addr learned my addr 172.21.15.12:0/1142179012 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f499b700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f00af8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92effff700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 0x7f92f0165140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 -- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 msgr2=0x7f92f00af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f00af8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 -- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 msgr2=0x7f92f0165140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 0x7f92f0165140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 -- 172.21.15.12:0/1142179012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92dc009420 con 0x7f92f0155c60 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92effff700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 0x7f92f0165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f519c700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f92e80070b0 tx=0x7f92e800b1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:25.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8010070 con 0x7f92f0155c60 2023-10-08T16:28:25.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e8008a60 con 0x7f92f0155c60 2023-10-08T16:28:25.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f00b06f0 con 0x7f92f0155c60 2023-10-08T16:28:25.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.365+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8008e00 con 0x7f92f0155c60 2023-10-08T16:28:25.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.366+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00afdf0 con 0x7f92f0155c60 2023-10-08T16:28:25.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.366+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f004c3c0 con 0x7f92f0155c60 2023-10-08T16:28:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.367+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92e8014030 con 0x7f92f0155c60 2023-10-08T16:28:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.368+0000 7f92ecff9700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 0x7f92d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.368+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f92e80848a0 con 0x7f92f0155c60 2023-10-08T16:28:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.369+0000 7f92f499b700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 0x7f92d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:25.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.369+0000 7f92f499b700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 0x7f92d40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f92e40058d0 tx=0x7f92e4009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:25.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.372+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92e80518d0 con 0x7f92f0155c60 2023-10-08T16:28:25.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:25.626+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f92f00648e0 con 0x7f92f0155c60 2023-10-08T16:28:26.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.273+0000 7f92ecff9700 1 -- 172.21.15.12:0/1142179012 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7f92f00648e0 con 0x7f92f0155c60 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 msgr2=0x7f92d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 0x7f92d40693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f92e40058d0 tx=0x7f92e4009040 comp rx=0 tx=0).stop 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 msgr2=0x7f92f0165680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f92e80070b0 tx=0x7f92e800b1b0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 shutdown_connections 2023-10-08T16:28:26.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f92d4066f30 0x7f92d40693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92f0155c60 0x7f92f0165680 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92f006de50 0x7f92f00af8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 --2- 172.21.15.12:0/1142179012 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92f0155890 0x7f92f0165140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 >> 172.21.15.12:0/1142179012 conn(0x7f92f006d110 msgr2=0x7f92f00c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 shutdown_connections 2023-10-08T16:28:26.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.277+0000 7f92f599d700 1 -- 172.21.15.12:0/1142179012 wait complete. 2023-10-08T16:28:26.297 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T16:28:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.495+0000 7f1a3259d700 1 Processor -- start 2023-10-08T16:28:26.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.495+0000 7f1a3259d700 1 -- start start 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.496+0000 7f1a3259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a2c156670 0x7f1a2c067f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.496+0000 7f1a3259d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a2c0adbc0 0x7f1a2c06b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.496+0000 7f1a3259d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2c0c8060 con 0x7f1a2c06ad00 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.496+0000 7f1a3259d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c156a40 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.496+0000 7f1a3259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2c06b690 con 0x7f1a2c156670 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a2c0adbc0 0x7f1a2c06b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1a2c0adbc0 0x7f1a2c06b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55044/0 (socket says 172.21.15.12:55044) 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 -- 172.21.15.12:0/1549681116 learned_addr learned my addr 172.21.15.12:0/1549681116 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:26.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a30d9a700 1 --1- 172.21.15.12:0/1549681116 >> v1:172.21.15.12:6789/0 conn(0x7f1a2c06ad00 0x7f1a2c069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33496/0 (socket says 172.21.15.12:33496) 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a3159b700 1 --2- 172.21.15.12:0/1549681116 >> v2:172.21.15.29:3300/0 conn(0x7f1a2c156670 0x7f1a2c067f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 -- 172.21.15.12:0/1549681116 >> v2:172.21.15.29:3300/0 conn(0x7f1a2c156670 msgr2=0x7f1a2c067f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 --2- 172.21.15.12:0/1549681116 >> v2:172.21.15.29:3300/0 conn(0x7f1a2c156670 0x7f1a2c067f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 -- 172.21.15.12:0/1549681116 >> v1:172.21.15.12:6789/0 conn(0x7f1a2c06ad00 legacy=0x7f1a2c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 -- 172.21.15.12:0/1549681116 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c0abaa0 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.497+0000 7f1a31d9c700 1 --2- 172.21.15.12:0/1549681116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c06b150 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c06aac0 tx=0x7f1a24009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e65ddab4a0ab19 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a23fff700 1 -- 172.21.15.12:0/1549681116 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2400e070 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a23fff700 1 -- 172.21.15.12:0/1549681116 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2400bae0 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a23fff700 1 -- 172.21.15.12:0/1549681116 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240092e0 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 -- 172.21.15.12:0/1549681116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c0adbc0 msgr2=0x7f1a2c06b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 --2- 172.21.15.12:0/1549681116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c06b150 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c06aac0 tx=0x7f1a24009840 comp rx=0 tx=0).stop 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 -- 172.21.15.12:0/1549681116 shutdown_connections 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 --2- 172.21.15.12:0/1549681116 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c06b150 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 --2- 172.21.15.12:0/1549681116 >> v2:172.21.15.29:3300/0 conn(0x7f1a2c156670 0x7f1a2c067f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 -- 172.21.15.12:0/1549681116 >> 172.21.15.12:0/1549681116 conn(0x7f1a2c0c9600 msgr2=0x7f1a2c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 -- 172.21.15.12:0/1549681116 shutdown_connections 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.498+0000 7f1a3259d700 1 -- 172.21.15.12:0/1549681116 wait complete. 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.500+0000 7f1a3259d700 1 Processor -- start 2023-10-08T16:28:26.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.500+0000 7f1a3259d700 1 -- start start 2023-10-08T16:28:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 0x7f1a2c14bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c153cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0aa3c0 con 0x7f1a2c156670 2023-10-08T16:28:26.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c154520 con 0x7f1a2c0adbc0 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2c0a9a90 con 0x7f1a2c06ad00 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55046/0 (socket says 172.21.15.12:55046) 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 -- 172.21.15.12:0/952469165 learned_addr learned my addr 172.21.15.12:0/952469165 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3159b700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 0x7f1a2c14bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a30d9a700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c153cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 -- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 msgr2=0x7f1a2c14bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 0x7f1a2c14bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 -- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 msgr2=0x7f1a2c153cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c153cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a31d9c700 1 -- 172.21.15.12:0/952469165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24009ae0 con 0x7f1a2c156670 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a3159b700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 0x7f1a2c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:26.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.501+0000 7f1a30d9a700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a31d9c700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009fd0 tx=0x7f1a24018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240032f0 con 0x7f1a2c156670 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24008e70 con 0x7f1a2c156670 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2401d630 con 0x7f1a2c156670 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2c0a9d70 con 0x7f1a2c156670 2023-10-08T16:28:26.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.502+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2c154200 con 0x7f1a2c156670 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.503+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c0aa570 con 0x7f1a2c156670 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.504+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a24003040 con 0x7f1a2c156670 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.505+0000 7f1a217fa700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.505+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f1a24086440 con 0x7f1a2c156670 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.505+0000 7f1a3159b700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:26.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.505+0000 7f1a3159b700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 0x7f1a100693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009990 tx=0x7f1a28008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:26.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.509+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a2c0aa570 con 0x7f1a2c156670 2023-10-08T16:28:26.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:26.755+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1a2c0aa570 con 0x7f1a2c156670 2023-10-08T16:28:27.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.279+0000 7f1a217fa700 1 -- 172.21.15.12:0/952469165 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1a2c0aa570 con 0x7f1a2c156670 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 msgr2=0x7f1a100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 0x7f1a100693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009990 tx=0x7f1a28008040 comp rx=0 tx=0).stop 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 msgr2=0x7f1a2c15d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f1a24009fd0 tx=0x7f1a24018000 comp rx=0 tx=0).stop 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 shutdown_connections 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1a10066f30 0x7f1a100693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a2c156670 0x7f1a2c15d0f0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a2c06ad00 0x7f1a2c14bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 --2- 172.21.15.12:0/952469165 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a2c0adbc0 0x7f1a2c153cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 >> 172.21.15.12:0/952469165 conn(0x7f1a2c0c9600 msgr2=0x7f1a2c0aef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:27.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.282+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 shutdown_connections 2023-10-08T16:28:27.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.283+0000 7f1a3259d700 1 -- 172.21.15.12:0/952469165 wait complete. 2023-10-08T16:28:27.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:27.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.492+0000 7fb26d59d700 1 Processor -- start 2023-10-08T16:28:27.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.492+0000 7fb26d59d700 1 -- start start 2023-10-08T16:28:27.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26d59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb26806f3a0 0x7fb26814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26d59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26806a490 con 0x7fb26806e470 2023-10-08T16:28:27.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26d59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2680c7230 con 0x7fb26806e0a0 2023-10-08T16:28:27.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26d59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680c7490 con 0x7fb26806f3a0 2023-10-08T16:28:27.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26cd9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb26806e470 0x7fb26806a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33506/0 (socket says 172.21.15.12:33506) 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb26cd9c700 1 -- 172.21.15.12:0/688928151 learned_addr learned my addr 172.21.15.12:0/688928151 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.494+0000 7fb2677fe700 1 --2- 172.21.15.12:0/688928151 >> v2:172.21.15.29:3300/0 conn(0x7fb26806f3a0 0x7fb26814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 385660560 0 0) 0x7fb26806a490 con 0x7fb26806e470 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb250003570 con 0x7fb26806e470 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089974744 0 0) 0x7fb250003570 con 0x7fb26806e470 2023-10-08T16:28:27.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 >> v2:172.21.15.29:3300/0 conn(0x7fb26806f3a0 msgr2=0x7fb26814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:27.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 --2- 172.21.15.12:0/688928151 >> v2:172.21.15.29:3300/0 conn(0x7fb26806f3a0 0x7fb26814fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 >> v1:172.21.15.29:6789/0 conn(0x7fb26806e0a0 legacy=0x7fb2680c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680c7770 con 0x7fb26806e470 2023-10-08T16:28:27.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fb2600017f0 con 0x7fb26806e470 2023-10-08T16:28:27.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 >> v1:172.21.15.12:6789/0 conn(0x7fb26806e470 legacy=0x7fb26806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250003a60 0x7fb250003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 0x7fb250004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2500051c0 0x7fb25000cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c7490 con 0x7fb250004810 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25000d160 con 0x7fb2500051c0 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25000d320 con 0x7fb250003a60 2023-10-08T16:28:27.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb2677fe700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 0x7fb250004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.495+0000 7fb267fff700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250003a60 0x7fb250003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb26cd9c700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2500051c0 0x7fb25000cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 -- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250003a60 msgr2=0x7fb250003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250003a60 0x7fb250003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 -- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2500051c0 msgr2=0x7fb25000cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2500051c0 0x7fb25000cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 -- 172.21.15.12:0/688928151 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb250003570 con 0x7fb250004810 2023-10-08T16:28:27.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb26cd9c700 1 -- 172.21.15.12:0/688928151 reap_dead start 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb2677fe700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 0x7fb250004c80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009bf0 tx=0x7fb25c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892cf0ba262f1c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c005a00 con 0x7fb250004810 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c005b60 con 0x7fb250004810 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.496+0000 7fb266ffd700 1 -- 172.21.15.12:0/688928151 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00e710 con 0x7fb250004810 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 -- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 msgr2=0x7fb250004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 0x7fb250004c80 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009bf0 tx=0x7fb25c009120 comp rx=0 tx=0).stop 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 -- 172.21.15.12:0/688928151 shutdown_connections 2023-10-08T16:28:27.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 --2- 172.21.15.12:0/688928151 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb250004810 0x7fb250004c80 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 -- 172.21.15.12:0/688928151 >> 172.21.15.12:0/688928151 conn(0x7fb26806d170 msgr2=0x7fb2680cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:27.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 -- 172.21.15.12:0/688928151 shutdown_connections 2023-10-08T16:28:27.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.497+0000 7fb26d59d700 1 -- 172.21.15.12:0/688928151 wait complete. 2023-10-08T16:28:27.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.498+0000 7fb26d59d700 1 Processor -- start 2023-10-08T16:28:27.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.498+0000 7fb26d59d700 1 -- start start 2023-10-08T16:28:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250004810 0x7fb26814bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2680af220 0x7fb2680af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c2e70 con 0x7fb2680c24c0 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb268157800 con 0x7fb2680af220 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.499+0000 7fb26d59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb268157ae0 con 0x7fb250004810 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55056/0 (socket says 172.21.15.12:55056) 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 -- 172.21.15.12:0/1466117828 learned_addr learned my addr 172.21.15.12:0/1466117828 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb267fff700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250004810 0x7fb26814bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb26cd9c700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2680af220 0x7fb2680af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 -- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250004810 msgr2=0x7fb26814bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250004810 0x7fb26814bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 -- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2680af220 msgr2=0x7fb2680af6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2680af220 0x7fb2680af6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 -- 172.21.15.12:0/1466117828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268157dc0 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.500+0000 7fb2677fe700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00e4b0 tx=0x7fb25c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.501+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c006240 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.501+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0063c0 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.501+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2681580a0 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.501+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c006780 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.501+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2680afc00 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.502+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26804c3c0 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.503+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb25c022650 con 0x7fb2680c24c0 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.503+0000 7fb24ffff700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.504+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fb25c086660 con 0x7fb2680c24c0 2023-10-08T16:28:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.504+0000 7fb267fff700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.504+0000 7fb267fff700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 0x7fb2540693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb258000f60 tx=0x7fb258009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.508+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb25c053690 con 0x7fb2680c24c0 2023-10-08T16:28:27.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.755+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2680c7a50 con 0x7fb2680c24c0 2023-10-08T16:28:27.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.756+0000 7fb24ffff700 1 -- 172.21.15.12:0/1466117828 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb25c056cb0 con 0x7fb2680c24c0 2023-10-08T16:28:27.756 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:27.757 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:28:27.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 msgr2=0x7fb2540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 0x7fb2540693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb258000f60 tx=0x7fb258009040 comp rx=0 tx=0).stop 2023-10-08T16:28:27.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 msgr2=0x7fb2680c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00e4b0 tx=0x7fb25c018000 comp rx=0 tx=0).stop 2023-10-08T16:28:27.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 shutdown_connections 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb254066f30 0x7fb2540693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb2680af220 0x7fb2680af6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb250004810 0x7fb26814bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 --2- 172.21.15.12:0/1466117828 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb2680c24c0 0x7fb2680c2930 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 >> 172.21.15.12:0/1466117828 conn(0x7fb26806d170 msgr2=0x7fb26806b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:27.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 shutdown_connections 2023-10-08T16:28:27.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.759+0000 7fb26d59d700 1 -- 172.21.15.12:0/1466117828 wait complete. 2023-10-08T16:28:27.761 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T16:28:27.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T16:28:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.963+0000 7fd9f759e700 1 Processor -- start 2023-10-08T16:28:27.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.963+0000 7fd9f759e700 1 -- start start 2023-10-08T16:28:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.964+0000 7fd9f759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd9f815de50 0x7fd9f80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.964+0000 7fd9f759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9f80cef40 0x7fd9f815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.964+0000 7fd9f759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f80cf3c0 con 0x7fd9f8153c30 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.964+0000 7fd9f759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f815afd0 con 0x7fd9f80cef40 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.964+0000 7fd9f759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f815b2b0 con 0x7fd9f815de50 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9f80cef40 0x7fd9f815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd9f8153c30 0x7fd9f815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33518/0 (socket says 172.21.15.12:33518) 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9f80cef40 0x7fd9f815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55072/0 (socket says 172.21.15.12:55072) 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f659c700 1 -- 172.21.15.12:0/896592806 learned_addr learned my addr 172.21.15.12:0/896592806 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:27.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f5d9b700 1 --2- 172.21.15.12:0/896592806 >> v2:172.21.15.29:3300/0 conn(0x7fd9f815de50 0x7fd9f80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 -- 172.21.15.12:0/896592806 >> v2:172.21.15.29:3300/0 conn(0x7fd9f815de50 msgr2=0x7fd9f80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 --2- 172.21.15.12:0/896592806 >> v2:172.21.15.29:3300/0 conn(0x7fd9f815de50 0x7fd9f80cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 -- 172.21.15.12:0/896592806 >> v1:172.21.15.12:6789/0 conn(0x7fd9f8153c30 legacy=0x7fd9f815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 -- 172.21.15.12:0/896592806 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f815b590 con 0x7fd9f80cef40 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f559a700 1 -- 172.21.15.12:0/896592806 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352939390 0 0) 0x7fd9f80cf3c0 con 0x7fd9f8153c30 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.965+0000 7fd9f6d9d700 1 --2- 172.21.15.12:0/896592806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f80cef40 0x7fd9f815c070 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80713a0 tx=0x7fd9f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed7de4ea1297399 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f559a700 1 -- 172.21.15.12:0/896592806 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f000e070 con 0x7fd9f80cef40 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f559a700 1 -- 172.21.15.12:0/896592806 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f000bc30 con 0x7fd9f80cef40 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f559a700 1 -- 172.21.15.12:0/896592806 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f0012430 con 0x7fd9f80cef40 2023-10-08T16:28:27.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 -- 172.21.15.12:0/896592806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f80cef40 msgr2=0x7fd9f815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 --2- 172.21.15.12:0/896592806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f80cef40 0x7fd9f815c070 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80713a0 tx=0x7fd9f0009780 comp rx=0 tx=0).stop 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 -- 172.21.15.12:0/896592806 shutdown_connections 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 --2- 172.21.15.12:0/896592806 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f80cef40 0x7fd9f815c070 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 --2- 172.21.15.12:0/896592806 >> v2:172.21.15.29:3300/0 conn(0x7fd9f815de50 0x7fd9f80cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 -- 172.21.15.12:0/896592806 >> 172.21.15.12:0/896592806 conn(0x7fd9f80703a0 msgr2=0x7fd9f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 -- 172.21.15.12:0/896592806 shutdown_connections 2023-10-08T16:28:27.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.966+0000 7fd9f759e700 1 -- 172.21.15.12:0/896592806 wait complete. 2023-10-08T16:28:27.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.968+0000 7fd9f759e700 1 Processor -- start 2023-10-08T16:28:27.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.968+0000 7fd9f759e700 1 -- start start 2023-10-08T16:28:27.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9f80cef40 0x7fd9f81698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 0x7fd9f80b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80c93a0 con 0x7fd9f8153c30 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80c8790 con 0x7fd9f815de50 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f80c8a70 con 0x7fd9f80cef40 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55082/0 (socket says 172.21.15.12:55082) 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f5d9b700 1 -- 172.21.15.12:0/1645276702 learned_addr learned my addr 172.21.15.12:0/1645276702 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f6d9d700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 0x7fd9f80b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f659c700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9f80cef40 0x7fd9f81698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f5d9b700 1 -- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9f80cef40 msgr2=0x7fd9f81698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.969+0000 7fd9f5d9b700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9f80cef40 0x7fd9f81698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f5d9b700 1 -- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 msgr2=0x7fd9f80b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f5d9b700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 0x7fd9f80b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f5d9b700 1 -- 172.21.15.12:0/1645276702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0009a20 con 0x7fd9f8153c30 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f6d9d700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 0x7fd9f80b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f5d9b700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00d890 tx=0x7fd9ec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00b600 con 0x7fd9f8153c30 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec00b760 con 0x7fd9f8153c30 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec00bae0 con 0x7fd9f8153c30 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f80c8d50 con 0x7fd9f8153c30 2023-10-08T16:28:27.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.970+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f8169df0 con 0x7fd9f8153c30 2023-10-08T16:28:27.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.971+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f804c3c0 con 0x7fd9f8153c30 2023-10-08T16:28:27.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.972+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9ec01e460 con 0x7fd9f8153c30 2023-10-08T16:28:27.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.973+0000 7fd9e67fc700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 0x7fd9d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:27.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.973+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fd9ec084e20 con 0x7fd9f8153c30 2023-10-08T16:28:27.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.974+0000 7fd9f659c700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 0x7fd9d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:27.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.974+0000 7fd9f659c700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 0x7fd9d80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9f816cde0 tx=0x7fd9e8009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:27.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:27.977+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9ec051e50 con 0x7fd9f8153c30 2023-10-08T16:28:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.180+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9f80c94e0 con 0x7fd9f8153c30 2023-10-08T16:28:28.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.181+0000 7fd9e67fc700 1 -- 172.21.15.12:0/1645276702 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fd9ec055470 con 0x7fd9f8153c30 2023-10-08T16:28:28.181 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:28.181 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":144,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T16:28:25.260556+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T16:28:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 msgr2=0x7fd9d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 0x7fd9d80693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd9f816cde0 tx=0x7fd9e8009040 comp rx=0 tx=0).stop 2023-10-08T16:28:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 msgr2=0x7fd9f8152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00d890 tx=0x7fd9ec008040 comp rx=0 tx=0).stop 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 shutdown_connections 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd9d8066f30 0x7fd9d80693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9f815de50 0x7fd9f80b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9f80cef40 0x7fd9f81698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 --2- 172.21.15.12:0/1645276702 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9f8153c30 0x7fd9f8152870 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 >> 172.21.15.12:0/1645276702 conn(0x7fd9f80703a0 msgr2=0x7fd9f8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 shutdown_connections 2023-10-08T16:28:28.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.183+0000 7fd9f759e700 1 -- 172.21.15.12:0/1645276702 wait complete. 2023-10-08T16:28:28.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T16:28:28.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:28:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.390+0000 7fbf8a39d700 1 Processor -- start 2023-10-08T16:28:28.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.390+0000 7fbf8a39d700 1 -- start start 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.391+0000 7fbf8a39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 0x7fbf8415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.391+0000 7fbf8a39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf8a39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8415ae70 con 0x7fbf8413fef0 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf8a39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8406af60 con 0x7fbf8413fb20 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf8a39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8406b240 con 0x7fbf8406aaa0 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf89b9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf88b9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fbf8413fef0 0x7fbf840c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48598/0 (socket says 172.21.15.12:48598) 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf8939b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 0x7fbf8415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf88b9a700 1 -- 172.21.15.12:0/4130071075 learned_addr learned my addr 172.21.15.12:0/4130071075 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:28.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf89b9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:58790/0 (socket says 172.21.15.12:58790) 2023-10-08T16:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.392+0000 7fbf7bfff700 1 -- 172.21.15.12:0/4130071075 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889621889 0 0) 0x7fbf74001160 con 0x7fbf8413fef0 2023-10-08T16:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf7bfff700 1 -- 172.21.15.12:0/4130071075 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003570 con 0x7fbf8413fef0 2023-10-08T16:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf89b9c700 1 -- 172.21.15.12:0/4130071075 >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 msgr2=0x7fbf8415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf89b9c700 1 --2- 172.21.15.12:0/4130071075 >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 0x7fbf8415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf89b9c700 1 -- 172.21.15.12:0/4130071075 >> v1:172.21.15.29:6789/0 conn(0x7fbf8413fef0 legacy=0x7fbf840c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf89b9c700 1 -- 172.21.15.12:0/4130071075 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8406b520 con 0x7fbf8406aaa0 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf8939b700 1 --2- 172.21.15.12:0/4130071075 >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 0x7fbf8415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf89b9c700 1 --2- 172.21.15.12:0/4130071075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009e60 tx=0x7fbf7c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85777fbe3aeb7b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf7bfff700 1 -- 172.21.15.12:0/4130071075 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00e070 con 0x7fbf8406aaa0 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf7bfff700 1 -- 172.21.15.12:0/4130071075 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c00bab0 con 0x7fbf8406aaa0 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.393+0000 7fbf7bfff700 1 -- 172.21.15.12:0/4130071075 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00be70 con 0x7fbf8406aaa0 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 -- 172.21.15.12:0/4130071075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 msgr2=0x7fbf840c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/4130071075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c009e60 tx=0x7fbf7c009780 comp rx=0 tx=0).stop 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 -- 172.21.15.12:0/4130071075 shutdown_connections 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/4130071075 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8406aaa0 0x7fbf840c9d00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/4130071075 >> v2:172.21.15.29:3300/0 conn(0x7fbf8413fb20 0x7fbf8415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 -- 172.21.15.12:0/4130071075 >> 172.21.15.12:0/4130071075 conn(0x7fbf8406d170 msgr2=0x7fbf840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 -- 172.21.15.12:0/4130071075 shutdown_connections 2023-10-08T16:28:28.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.394+0000 7fbf8a39d700 1 -- 172.21.15.12:0/4130071075 wait complete. 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.395+0000 7fbf8a39d700 1 Processor -- start 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.395+0000 7fbf8a39d700 1 -- start start 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8406aaa0 0x7fbf8416c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8413fef0 0x7fbf840b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840ac120 con 0x7fbf8413fb20 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840ac9c0 con 0x7fbf8406aaa0 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.396+0000 7fbf8a39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84139650 con 0x7fbf8413fef0 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55092/0 (socket says 172.21.15.12:55092) 2023-10-08T16:28:28.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 -- 172.21.15.12:0/3048099973 learned_addr learned my addr 172.21.15.12:0/3048099973 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf8939b700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8406aaa0 0x7fbf8416c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf89b9c700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8413fef0 0x7fbf840b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 -- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8413fef0 msgr2=0x7fbf840b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8413fef0 0x7fbf840b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 -- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8406aaa0 msgr2=0x7fbf8416c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8406aaa0 0x7fbf8416c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 -- 172.21.15.12:0/3048099973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf80009420 con 0x7fbf8413fb20 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.397+0000 7fbf88b9a700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400c7c0 tx=0x7fbf74007c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.398+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74005b80 con 0x7fbf8413fb20 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.398+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74005ce0 con 0x7fbf8413fb20 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.398+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf74007320 con 0x7fbf8413fb20 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.398+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c009a20 con 0x7fbf8413fb20 2023-10-08T16:28:28.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.398+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf840ac650 con 0x7fbf8413fb20 2023-10-08T16:28:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.399+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840ac7e0 con 0x7fbf8413fb20 2023-10-08T16:28:28.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.400+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf74007710 con 0x7fbf8413fb20 2023-10-08T16:28:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.401+0000 7fbf797fa700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 0x7fbf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.401+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf74083960 con 0x7fbf8413fb20 2023-10-08T16:28:28.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.402+0000 7fbf8939b700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 0x7fbf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.402+0000 7fbf8939b700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 0x7fbf680693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf840abe60 tx=0x7fbf800091a0 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.406+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf74050990 con 0x7fbf8413fb20 2023-10-08T16:28:28.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.602+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbf8415ae70 con 0x7fbf68066f30 2023-10-08T16:28:28.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.612+0000 7fbf797fa700 1 -- 172.21.15.12:0/3048099973 <== mgr.8073 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282983 (secure 0 0 0) 0x7fbf8415ae70 con 0x7fbf68066f30 2023-10-08T16:28:28.616 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 msgr2=0x7fbf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 0x7fbf680693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fbf840abe60 tx=0x7fbf800091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 msgr2=0x7fbf840b03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fbf7400c7c0 tx=0x7fbf74007c00 comp rx=0 tx=0).stop 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 shutdown_connections 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf68066f30 0x7fbf680693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8413fef0 0x7fbf840b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8406aaa0 0x7fbf8416c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 --2- 172.21.15.12:0/3048099973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8413fb20 0x7fbf840b03b0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 >> 172.21.15.12:0/3048099973 conn(0x7fbf8406d170 msgr2=0x7fbf840c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 shutdown_connections 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.617+0000 7fbf8a39d700 1 -- 172.21.15.12:0/3048099973 wait complete. 2023-10-08T16:28:28.619 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:28:28.634 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T16:28:26.806019+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":417,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":267,"ondisk_log_size":267,"up":114,"acting":114,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":103,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":2450608,"kb_used_data":14960,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752524112,"statfs":{"total":773094113280,"available":770584690688,"internally_reserved":0,"allocated":15319040,"data_stored":8114342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.563862"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288593+0000","last_change":"2023-10-08T16:28:24.278857+0000","last_active":"2023-10-08T16:28:24.288593+0000","last_peered":"2023-10-08T16:28:24.288593+0000","last_clean":"2023-10-08T16:28:24.288593+0000","last_became_active":"2023-10-08T16:28:24.278544+0000","last_became_peered":"2023-10-08T16:28:24.278544+0000","last_unstale":"2023-10-08T16:28:24.288593+0000","last_undegraded":"2023-10-08T16:28:24.288593+0000","last_fullsized":"2023-10-08T16:28:24.288593+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:43.414602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280252+0000","last_change":"2023-10-08T16:28:24.278899+0000","last_active":"2023-10-08T16:28:24.280252+0000","last_peered":"2023-10-08T16:28:24.280252+0000","last_clean":"2023-10-08T16:28:24.280252+0000","last_became_active":"2023-10-08T16:28:24.278613+0000","last_became_peered":"2023-10-08T16:28:24.278613+0000","last_unstale":"2023-10-08T16:28:24.280252+0000","last_undegraded":"2023-10-08T16:28:24.280252+0000","last_fullsized":"2023-10-08T16:28:24.280252+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:16.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.278968+0000","last_change":"2023-10-08T16:28:24.264955+0000","last_active":"2023-10-08T16:28:24.278968+0000","last_peered":"2023-10-08T16:28:24.278968+0000","last_clean":"2023-10-08T16:28:24.278968+0000","last_became_active":"2023-10-08T16:28:24.264633+0000","last_became_peered":"2023-10-08T16:28:24.264633+0000","last_unstale":"2023-10-08T16:28:24.278968+0000","last_undegraded":"2023-10-08T16:28:24.278968+0000","last_fullsized":"2023-10-08T16:28:24.278968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:08.213104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.283774+0000","last_change":"2023-10-08T16:28:24.277757+0000","last_active":"2023-10-08T16:28:24.283774+0000","last_peered":"2023-10-08T16:28:24.283774+0000","last_clean":"2023-10-08T16:28:24.283774+0000","last_became_active":"2023-10-08T16:28:24.277478+0000","last_became_peered":"2023-10-08T16:28:24.277478+0000","last_unstale":"2023-10-08T16:28:24.283774+0000","last_undegraded":"2023-10-08T16:28:24.283774+0000","last_fullsized":"2023-10-08T16:28:24.283774+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:28.235196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280318+0000","last_change":"2023-10-08T16:28:24.277253+0000","last_active":"2023-10-08T16:28:24.280318+0000","last_peered":"2023-10-08T16:28:24.280318+0000","last_clean":"2023-10-08T16:28:24.280318+0000","last_became_active":"2023-10-08T16:28:24.276859+0000","last_became_peered":"2023-10-08T16:28:24.276859+0000","last_unstale":"2023-10-08T16:28:24.280318+0000","last_undegraded":"2023-10-08T16:28:24.280318+0000","last_fullsized":"2023-10-08T16:28:24.280318+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288867+0000","last_change":"2023-10-08T16:28:24.280818+0000","last_active":"2023-10-08T16:28:24.288867+0000","last_peered":"2023-10-08T16:28:24.288867+0000","last_clean":"2023-10-08T16:28:24.288867+0000","last_became_active":"2023-10-08T16:28:24.280556+0000","last_became_peered":"2023-10-08T16:28:24.280556+0000","last_unstale":"2023-10-08T16:28:24.288867+0000","last_undegraded":"2023-10-08T16:28:24.288867+0000","last_fullsized":"2023-10-08T16:28:24.288867+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:49.236697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.289408+0000","last_change":"2023-10-08T16:28:24.283998+0000","last_active":"2023-10-08T16:28:24.289408+0000","last_peered":"2023-10-08T16:28:24.289408+0000","last_clean":"2023-10-08T16:28:24.289408+0000","last_became_active":"2023-10-08T16:28:24.283410+0000","last_became_peered":"2023-10-08T16:28:24.283410+0000","last_unstale":"2023-10-08T16:28:24.289408+0000","last_undegraded":"2023-10-08T16:28:24.289408+0000","last_fullsized":"2023-10-08T16:28:24.289408+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:45.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288448+0000","last_change":"2023-10-08T16:28:24.273176+0000","last_active":"2023-10-08T16:28:24.288448+0000","last_peered":"2023-10-08T16:28:24.288448+0000","last_clean":"2023-10-08T16:28:24.288448+0000","last_became_active":"2023-10-08T16:28:24.272870+0000","last_became_peered":"2023-10-08T16:28:24.272870+0000","last_unstale":"2023-10-08T16:28:24.288448+0000","last_undegraded":"2023-10-08T16:28:24.288448+0000","last_fullsized":"2023-10-08T16:28:24.288448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:35.854511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279385+0000","last_change":"2023-10-08T16:28:24.275937+0000","last_active":"2023-10-08T16:28:24.279385+0000","last_peered":"2023-10-08T16:28:24.279385+0000","last_clean":"2023-10-08T16:28:24.279385+0000","last_became_active":"2023-10-08T16:28:24.275677+0000","last_became_peered":"2023-10-08T16:28:24.275677+0000","last_unstale":"2023-10-08T16:28:24.279385+0000","last_undegraded":"2023-10-08T16:28:24.279385+0000","last_fullsized":"2023-10-08T16:28:24.279385+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:11:07.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279177+0000","last_change":"2023-10-08T16:28:24.274534+0000","last_active":"2023-10-08T16:28:24.279177+0000","last_peered":"2023-10-08T16:28:24.279177+0000","last_clean":"2023-10-08T16:28:24.279177+0000","last_became_active":"2023-10-08T16:28:24.274260+0000","last_became_peered":"2023-10-08T16:28:24.274260+0000","last_unstale":"2023-10-08T16:28:24.279177+0000","last_undegraded":"2023-10-08T16:28:24.279177+0000","last_fullsized":"2023-10-08T16:28:24.279177+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:08.636724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277250+0000","last_change":"2023-10-08T16:28:24.273596+0000","last_active":"2023-10-08T16:28:24.277250+0000","last_peered":"2023-10-08T16:28:24.277250+0000","last_clean":"2023-10-08T16:28:24.277250+0000","last_became_active":"2023-10-08T16:28:24.273110+0000","last_became_peered":"2023-10-08T16:28:24.273110+0000","last_unstale":"2023-10-08T16:28:24.277250+0000","last_undegraded":"2023-10-08T16:28:24.277250+0000","last_fullsized":"2023-10-08T16:28:24.277250+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:36.469826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288597+0000","last_change":"2023-10-08T16:28:24.275075+0000","last_active":"2023-10-08T16:28:24.288597+0000","last_peered":"2023-10-08T16:28:24.288597+0000","last_clean":"2023-10-08T16:28:24.288597+0000","last_became_active":"2023-10-08T16:28:24.273690+0000","last_became_peered":"2023-10-08T16:28:24.273690+0000","last_unstale":"2023-10-08T16:28:24.288597+0000","last_undegraded":"2023-10-08T16:28:24.288597+0000","last_fullsized":"2023-10-08T16:28:24.288597+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285526+0000","last_change":"2023-10-08T16:28:24.284583+0000","last_active":"2023-10-08T16:28:24.285526+0000","last_peered":"2023-10-08T16:28:24.285526+0000","last_clean":"2023-10-08T16:28:24.285526+0000","last_became_active":"2023-10-08T16:28:24.284286+0000","last_became_peered":"2023-10-08T16:28:24.284286+0000","last_unstale":"2023-10-08T16:28:24.285526+0000","last_undegraded":"2023-10-08T16:28:24.285526+0000","last_fullsized":"2023-10-08T16:28:24.285526+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:56.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285912+0000","last_change":"2023-10-08T16:28:24.276674+0000","last_active":"2023-10-08T16:28:24.285912+0000","last_peered":"2023-10-08T16:28:24.285912+0000","last_clean":"2023-10-08T16:28:24.285912+0000","last_became_active":"2023-10-08T16:28:24.276373+0000","last_became_peered":"2023-10-08T16:28:24.276373+0000","last_unstale":"2023-10-08T16:28:24.285912+0000","last_undegraded":"2023-10-08T16:28:24.285912+0000","last_fullsized":"2023-10-08T16:28:24.285912+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:16.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285902+0000","last_change":"2023-10-08T16:28:24.278123+0000","last_active":"2023-10-08T16:28:24.285902+0000","last_peered":"2023-10-08T16:28:24.285902+0000","last_clean":"2023-10-08T16:28:24.285902+0000","last_became_active":"2023-10-08T16:28:24.277872+0000","last_became_peered":"2023-10-08T16:28:24.277872+0000","last_unstale":"2023-10-08T16:28:24.285902+0000","last_undegraded":"2023-10-08T16:28:24.285902+0000","last_fullsized":"2023-10-08T16:28:24.285902+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279051+0000","last_change":"2023-10-08T16:28:24.263007+0000","last_active":"2023-10-08T16:28:24.279051+0000","last_peered":"2023-10-08T16:28:24.279051+0000","last_clean":"2023-10-08T16:28:24.279051+0000","last_became_active":"2023-10-08T16:28:24.262780+0000","last_became_peered":"2023-10-08T16:28:24.262780+0000","last_unstale":"2023-10-08T16:28:24.279051+0000","last_undegraded":"2023-10-08T16:28:24.279051+0000","last_fullsized":"2023-10-08T16:28:24.279051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:06.383099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.287567+0000","last_change":"2023-10-08T16:28:24.285419+0000","last_active":"2023-10-08T16:28:24.287567+0000","last_peered":"2023-10-08T16:28:24.287567+0000","last_clean":"2023-10-08T16:28:24.287567+0000","last_became_active":"2023-10-08T16:28:24.285158+0000","last_became_peered":"2023-10-08T16:28:24.285158+0000","last_unstale":"2023-10-08T16:28:24.287567+0000","last_undegraded":"2023-10-08T16:28:24.287567+0000","last_fullsized":"2023-10-08T16:28:24.287567+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:38.506719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.293195+0000","last_change":"2023-10-08T16:28:24.292014+0000","last_active":"2023-10-08T16:28:24.293195+0000","last_peered":"2023-10-08T16:28:24.293195+0000","last_clean":"2023-10-08T16:28:24.293195+0000","last_became_active":"2023-10-08T16:28:24.291716+0000","last_became_peered":"2023-10-08T16:28:24.291716+0000","last_unstale":"2023-10-08T16:28:24.293195+0000","last_undegraded":"2023-10-08T16:28:24.293195+0000","last_fullsized":"2023-10-08T16:28:24.293195+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:35.854511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.267266+0000","last_change":"2023-10-08T16:28:24.262290+0000","last_active":"2023-10-08T16:28:24.267266+0000","last_peered":"2023-10-08T16:28:24.267266+0000","last_clean":"2023-10-08T16:28:24.267266+0000","last_became_active":"2023-10-08T16:28:24.261983+0000","last_became_peered":"2023-10-08T16:28:24.261983+0000","last_unstale":"2023-10-08T16:28:24.267266+0000","last_undegraded":"2023-10-08T16:28:24.267266+0000","last_fullsized":"2023-10-08T16:28:24.267266+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275092+0000","last_change":"2023-10-08T16:28:24.271274+0000","last_active":"2023-10-08T16:28:24.275092+0000","last_peered":"2023-10-08T16:28:24.275092+0000","last_clean":"2023-10-08T16:28:24.275092+0000","last_became_active":"2023-10-08T16:28:24.270997+0000","last_became_peered":"2023-10-08T16:28:24.270997+0000","last_unstale":"2023-10-08T16:28:24.275092+0000","last_undegraded":"2023-10-08T16:28:24.275092+0000","last_fullsized":"2023-10-08T16:28:24.275092+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:09.344831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280184+0000","last_change":"2023-10-08T16:28:24.277085+0000","last_active":"2023-10-08T16:28:24.280184+0000","last_peered":"2023-10-08T16:28:24.280184+0000","last_clean":"2023-10-08T16:28:24.280184+0000","last_became_active":"2023-10-08T16:28:24.276832+0000","last_became_peered":"2023-10-08T16:28:24.276832+0000","last_unstale":"2023-10-08T16:28:24.280184+0000","last_undegraded":"2023-10-08T16:28:24.280184+0000","last_fullsized":"2023-10-08T16:28:24.280184+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:02.855881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285514+0000","last_change":"2023-10-08T16:28:23.266067+0000","last_active":"2023-10-08T16:28:24.285514+0000","last_peered":"2023-10-08T16:28:24.285514+0000","last_clean":"2023-10-08T16:28:24.285514+0000","last_became_active":"2023-10-08T16:28:23.265787+0000","last_became_peered":"2023-10-08T16:28:23.265787+0000","last_unstale":"2023-10-08T16:28:24.285514+0000","last_undegraded":"2023-10-08T16:28:24.285514+0000","last_fullsized":"2023-10-08T16:28:24.285514+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:16.167841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277836+0000","last_change":"2023-10-08T16:28:24.274448+0000","last_active":"2023-10-08T16:28:24.277836+0000","last_peered":"2023-10-08T16:28:24.277836+0000","last_clean":"2023-10-08T16:28:24.277836+0000","last_became_active":"2023-10-08T16:28:24.274123+0000","last_became_peered":"2023-10-08T16:28:24.274123+0000","last_unstale":"2023-10-08T16:28:24.277836+0000","last_undegraded":"2023-10-08T16:28:24.277836+0000","last_fullsized":"2023-10-08T16:28:24.277836+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:27.135839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285037+0000","last_change":"2023-10-08T16:28:24.284210+0000","last_active":"2023-10-08T16:28:24.285037+0000","last_peered":"2023-10-08T16:28:24.285037+0000","last_clean":"2023-10-08T16:28:24.285037+0000","last_became_active":"2023-10-08T16:28:24.283916+0000","last_became_peered":"2023-10-08T16:28:24.283916+0000","last_unstale":"2023-10-08T16:28:24.285037+0000","last_undegraded":"2023-10-08T16:28:24.285037+0000","last_fullsized":"2023-10-08T16:28:24.285037+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:36.741784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288976+0000","last_change":"2023-10-08T16:28:24.282230+0000","last_active":"2023-10-08T16:28:24.288976+0000","last_peered":"2023-10-08T16:28:24.288976+0000","last_clean":"2023-10-08T16:28:24.288976+0000","last_became_active":"2023-10-08T16:28:24.281936+0000","last_became_peered":"2023-10-08T16:28:24.281936+0000","last_unstale":"2023-10-08T16:28:24.288976+0000","last_undegraded":"2023-10-08T16:28:24.288976+0000","last_fullsized":"2023-10-08T16:28:24.288976+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:27.519225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285823+0000","last_change":"2023-10-08T16:28:23.267909+0000","last_active":"2023-10-08T16:28:24.285823+0000","last_peered":"2023-10-08T16:28:24.285823+0000","last_clean":"2023-10-08T16:28:24.285823+0000","last_became_active":"2023-10-08T16:28:23.267633+0000","last_became_peered":"2023-10-08T16:28:23.267633+0000","last_unstale":"2023-10-08T16:28:24.285823+0000","last_undegraded":"2023-10-08T16:28:24.285823+0000","last_fullsized":"2023-10-08T16:28:24.285823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:12.312208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288616+0000","last_change":"2023-10-08T16:28:24.275636+0000","last_active":"2023-10-08T16:28:24.288616+0000","last_peered":"2023-10-08T16:28:24.288616+0000","last_clean":"2023-10-08T16:28:24.288616+0000","last_became_active":"2023-10-08T16:28:24.275324+0000","last_became_peered":"2023-10-08T16:28:24.275324+0000","last_unstale":"2023-10-08T16:28:24.288616+0000","last_undegraded":"2023-10-08T16:28:24.288616+0000","last_fullsized":"2023-10-08T16:28:24.288616+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:59.524568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.253937+0000","last_change":"2023-10-08T16:28:23.278439+0000","last_active":"2023-10-08T16:28:24.253937+0000","last_peered":"2023-10-08T16:28:24.253937+0000","last_clean":"2023-10-08T16:28:24.253937+0000","last_became_active":"2023-10-08T16:28:23.277599+0000","last_became_peered":"2023-10-08T16:28:23.277599+0000","last_unstale":"2023-10-08T16:28:24.253937+0000","last_undegraded":"2023-10-08T16:28:24.253937+0000","last_fullsized":"2023-10-08T16:28:24.253937+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:16.167841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.265210+0000","last_change":"2023-10-08T16:28:23.267290+0000","last_active":"2023-10-08T16:28:24.265210+0000","last_peered":"2023-10-08T16:28:24.265210+0000","last_clean":"2023-10-08T16:28:24.265210+0000","last_became_active":"2023-10-08T16:28:23.266898+0000","last_became_peered":"2023-10-08T16:28:23.266898+0000","last_unstale":"2023-10-08T16:28:24.265210+0000","last_undegraded":"2023-10-08T16:28:24.265210+0000","last_fullsized":"2023-10-08T16:28:24.265210+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:49.298719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285852+0000","last_change":"2023-10-08T16:28:24.279911+0000","last_active":"2023-10-08T16:28:24.285852+0000","last_peered":"2023-10-08T16:28:24.285852+0000","last_clean":"2023-10-08T16:28:24.285852+0000","last_became_active":"2023-10-08T16:28:24.279656+0000","last_became_peered":"2023-10-08T16:28:24.279656+0000","last_unstale":"2023-10-08T16:28:24.285852+0000","last_undegraded":"2023-10-08T16:28:24.285852+0000","last_fullsized":"2023-10-08T16:28:24.285852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:08.636724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"143'3","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.290543+0000","last_change":"2023-10-08T16:28:23.279112+0000","last_active":"2023-10-08T16:28:24.290543+0000","last_peered":"2023-10-08T16:28:24.290543+0000","last_clean":"2023-10-08T16:28:24.290543+0000","last_became_active":"2023-10-08T16:28:23.278830+0000","last_became_peered":"2023-10-08T16:28:23.278830+0000","last_unstale":"2023-10-08T16:28:24.290543+0000","last_undegraded":"2023-10-08T16:28:24.290543+0000","last_fullsized":"2023-10-08T16:28:24.290543+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:14:38.128642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"143'6","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.293892+0000","last_change":"2023-10-08T16:28:23.275899+0000","last_active":"2023-10-08T16:28:24.293892+0000","last_peered":"2023-10-08T16:28:24.293892+0000","last_clean":"2023-10-08T16:28:24.293892+0000","last_became_active":"2023-10-08T16:28:23.275116+0000","last_became_peered":"2023-10-08T16:28:23.275116+0000","last_unstale":"2023-10-08T16:28:24.293892+0000","last_undegraded":"2023-10-08T16:28:24.293892+0000","last_fullsized":"2023-10-08T16:28:24.293892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:06.956947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285893+0000","last_change":"2023-10-08T16:28:24.275035+0000","last_active":"2023-10-08T16:28:24.285893+0000","last_peered":"2023-10-08T16:28:24.285893+0000","last_clean":"2023-10-08T16:28:24.285893+0000","last_became_active":"2023-10-08T16:28:24.274790+0000","last_became_peered":"2023-10-08T16:28:24.274790+0000","last_unstale":"2023-10-08T16:28:24.285893+0000","last_undegraded":"2023-10-08T16:28:24.285893+0000","last_fullsized":"2023-10-08T16:28:24.285893+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275839+0000","last_change":"2023-10-08T16:28:23.269619+0000","last_active":"2023-10-08T16:28:24.275839+0000","last_peered":"2023-10-08T16:28:24.275839+0000","last_clean":"2023-10-08T16:28:24.275839+0000","last_became_active":"2023-10-08T16:28:23.269330+0000","last_became_peered":"2023-10-08T16:28:23.269330+0000","last_unstale":"2023-10-08T16:28:24.275839+0000","last_undegraded":"2023-10-08T16:28:24.275839+0000","last_fullsized":"2023-10-08T16:28:24.275839+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:58.535546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285487+0000","last_change":"2023-10-08T16:28:24.277101+0000","last_active":"2023-10-08T16:28:24.285487+0000","last_peered":"2023-10-08T16:28:24.285487+0000","last_clean":"2023-10-08T16:28:24.285487+0000","last_became_active":"2023-10-08T16:28:24.276558+0000","last_became_peered":"2023-10-08T16:28:24.276558+0000","last_unstale":"2023-10-08T16:28:24.285487+0000","last_undegraded":"2023-10-08T16:28:24.285487+0000","last_fullsized":"2023-10-08T16:28:24.285487+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:08.213104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285443+0000","last_change":"2023-10-08T16:28:24.279302+0000","last_active":"2023-10-08T16:28:24.285443+0000","last_peered":"2023-10-08T16:28:24.285443+0000","last_clean":"2023-10-08T16:28:24.285443+0000","last_became_active":"2023-10-08T16:28:24.279046+0000","last_became_peered":"2023-10-08T16:28:24.279046+0000","last_unstale":"2023-10-08T16:28:24.285443+0000","last_undegraded":"2023-10-08T16:28:24.285443+0000","last_fullsized":"2023-10-08T16:28:24.285443+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:56.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.289085+0000","last_change":"2023-10-08T16:28:23.272679+0000","last_active":"2023-10-08T16:28:24.289085+0000","last_peered":"2023-10-08T16:28:24.289085+0000","last_clean":"2023-10-08T16:28:24.289085+0000","last_became_active":"2023-10-08T16:28:23.271840+0000","last_became_peered":"2023-10-08T16:28:23.271840+0000","last_unstale":"2023-10-08T16:28:24.289085+0000","last_undegraded":"2023-10-08T16:28:24.289085+0000","last_fullsized":"2023-10-08T16:28:24.289085+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:25.815907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291728+0000","last_change":"2023-10-08T16:28:24.290993+0000","last_active":"2023-10-08T16:28:24.291728+0000","last_peered":"2023-10-08T16:28:24.291728+0000","last_clean":"2023-10-08T16:28:24.291728+0000","last_became_active":"2023-10-08T16:28:24.290688+0000","last_became_peered":"2023-10-08T16:28:24.290688+0000","last_unstale":"2023-10-08T16:28:24.291728+0000","last_undegraded":"2023-10-08T16:28:24.291728+0000","last_fullsized":"2023-10-08T16:28:24.291728+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:42.322335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285042+0000","last_change":"2023-10-08T16:28:24.284175+0000","last_active":"2023-10-08T16:28:24.285042+0000","last_peered":"2023-10-08T16:28:24.285042+0000","last_clean":"2023-10-08T16:28:24.285042+0000","last_became_active":"2023-10-08T16:28:24.283864+0000","last_became_peered":"2023-10-08T16:28:24.283864+0000","last_unstale":"2023-10-08T16:28:24.285042+0000","last_undegraded":"2023-10-08T16:28:24.285042+0000","last_fullsized":"2023-10-08T16:28:24.285042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:47.565434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.274849+0000","last_change":"2023-10-08T16:28:24.272457+0000","last_active":"2023-10-08T16:28:24.274849+0000","last_peered":"2023-10-08T16:28:24.274849+0000","last_clean":"2023-10-08T16:28:24.274849+0000","last_became_active":"2023-10-08T16:28:24.272192+0000","last_became_peered":"2023-10-08T16:28:24.272192+0000","last_unstale":"2023-10-08T16:28:24.274849+0000","last_undegraded":"2023-10-08T16:28:24.274849+0000","last_fullsized":"2023-10-08T16:28:24.274849+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:11.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279406+0000","last_change":"2023-10-08T16:28:24.277172+0000","last_active":"2023-10-08T16:28:24.279406+0000","last_peered":"2023-10-08T16:28:24.279406+0000","last_clean":"2023-10-08T16:28:24.279406+0000","last_became_active":"2023-10-08T16:28:24.276884+0000","last_became_peered":"2023-10-08T16:28:24.276884+0000","last_unstale":"2023-10-08T16:28:24.279406+0000","last_undegraded":"2023-10-08T16:28:24.279406+0000","last_fullsized":"2023-10-08T16:28:24.279406+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.283442+0000","last_change":"2023-10-08T16:28:23.277544+0000","last_active":"2023-10-08T16:28:24.283442+0000","last_peered":"2023-10-08T16:28:24.283442+0000","last_clean":"2023-10-08T16:28:24.283442+0000","last_became_active":"2023-10-08T16:28:23.274828+0000","last_became_peered":"2023-10-08T16:28:23.274828+0000","last_unstale":"2023-10-08T16:28:24.283442+0000","last_undegraded":"2023-10-08T16:28:24.283442+0000","last_fullsized":"2023-10-08T16:28:24.283442+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:03.743651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.281415+0000","last_change":"2023-10-08T16:28:24.265491+0000","last_active":"2023-10-08T16:28:24.281415+0000","last_peered":"2023-10-08T16:28:24.281415+0000","last_clean":"2023-10-08T16:28:24.281415+0000","last_became_active":"2023-10-08T16:28:24.265173+0000","last_became_peered":"2023-10-08T16:28:24.265173+0000","last_unstale":"2023-10-08T16:28:24.281415+0000","last_undegraded":"2023-10-08T16:28:24.281415+0000","last_fullsized":"2023-10-08T16:28:24.281415+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285535+0000","last_change":"2023-10-08T16:28:24.284725+0000","last_active":"2023-10-08T16:28:24.285535+0000","last_peered":"2023-10-08T16:28:24.285535+0000","last_clean":"2023-10-08T16:28:24.285535+0000","last_became_active":"2023-10-08T16:28:24.284251+0000","last_became_peered":"2023-10-08T16:28:24.284251+0000","last_unstale":"2023-10-08T16:28:24.285535+0000","last_undegraded":"2023-10-08T16:28:24.285535+0000","last_fullsized":"2023-10-08T16:28:24.285535+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.260271+0000","last_change":"2023-10-08T16:28:23.274158+0000","last_active":"2023-10-08T16:28:24.260271+0000","last_peered":"2023-10-08T16:28:24.260271+0000","last_clean":"2023-10-08T16:28:24.260271+0000","last_became_active":"2023-10-08T16:28:23.273807+0000","last_became_peered":"2023-10-08T16:28:23.273807+0000","last_unstale":"2023-10-08T16:28:24.260271+0000","last_undegraded":"2023-10-08T16:28:24.260271+0000","last_fullsized":"2023-10-08T16:28:24.260271+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:18.415126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.292903+0000","last_change":"2023-10-08T16:28:24.291114+0000","last_active":"2023-10-08T16:28:24.292903+0000","last_peered":"2023-10-08T16:28:24.292903+0000","last_clean":"2023-10-08T16:28:24.292903+0000","last_became_active":"2023-10-08T16:28:24.290836+0000","last_became_peered":"2023-10-08T16:28:24.290836+0000","last_unstale":"2023-10-08T16:28:24.292903+0000","last_undegraded":"2023-10-08T16:28:24.292903+0000","last_fullsized":"2023-10-08T16:28:24.292903+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:04.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.254945+0000","last_change":"2023-10-08T16:28:23.279855+0000","last_active":"2023-10-08T16:28:24.254945+0000","last_peered":"2023-10-08T16:28:24.254945+0000","last_clean":"2023-10-08T16:28:24.254945+0000","last_became_active":"2023-10-08T16:28:23.276501+0000","last_became_peered":"2023-10-08T16:28:23.276501+0000","last_unstale":"2023-10-08T16:28:24.254945+0000","last_undegraded":"2023-10-08T16:28:24.254945+0000","last_fullsized":"2023-10-08T16:28:24.254945+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:13.386526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291435+0000","last_change":"2023-10-08T16:28:23.280037+0000","last_active":"2023-10-08T16:28:24.291435+0000","last_peered":"2023-10-08T16:28:24.291435+0000","last_clean":"2023-10-08T16:28:24.291435+0000","last_became_active":"2023-10-08T16:28:23.279736+0000","last_became_peered":"2023-10-08T16:28:23.279736+0000","last_unstale":"2023-10-08T16:28:24.291435+0000","last_undegraded":"2023-10-08T16:28:24.291435+0000","last_fullsized":"2023-10-08T16:28:24.291435+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:29.160812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.278974+0000","last_change":"2023-10-08T16:28:24.264270+0000","last_active":"2023-10-08T16:28:24.278974+0000","last_peered":"2023-10-08T16:28:24.278974+0000","last_clean":"2023-10-08T16:28:24.278974+0000","last_became_active":"2023-10-08T16:28:24.263999+0000","last_became_peered":"2023-10-08T16:28:24.263999+0000","last_unstale":"2023-10-08T16:28:24.278974+0000","last_undegraded":"2023-10-08T16:28:24.278974+0000","last_fullsized":"2023-10-08T16:28:24.278974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:20.166306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288610+0000","last_change":"2023-10-08T16:28:24.278868+0000","last_active":"2023-10-08T16:28:24.288610+0000","last_peered":"2023-10-08T16:28:24.288610+0000","last_clean":"2023-10-08T16:28:24.288610+0000","last_became_active":"2023-10-08T16:28:24.278585+0000","last_became_peered":"2023-10-08T16:28:24.278585+0000","last_unstale":"2023-10-08T16:28:24.288610+0000","last_undegraded":"2023-10-08T16:28:24.288610+0000","last_fullsized":"2023-10-08T16:28:24.288610+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:33.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.254182+0000","last_change":"2023-10-08T16:28:23.274093+0000","last_active":"2023-10-08T16:28:24.254182+0000","last_peered":"2023-10-08T16:28:24.254182+0000","last_clean":"2023-10-08T16:28:24.254182+0000","last_became_active":"2023-10-08T16:28:23.273795+0000","last_became_peered":"2023-10-08T16:28:23.273795+0000","last_unstale":"2023-10-08T16:28:24.254182+0000","last_undegraded":"2023-10-08T16:28:24.254182+0000","last_fullsized":"2023-10-08T16:28:24.254182+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:29.160812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.265484+0000","last_change":"2023-10-08T16:28:23.277052+0000","last_active":"2023-10-08T16:28:24.265484+0000","last_peered":"2023-10-08T16:28:24.265484+0000","last_clean":"2023-10-08T16:28:24.265484+0000","last_became_active":"2023-10-08T16:28:23.276764+0000","last_became_peered":"2023-10-08T16:28:23.276764+0000","last_unstale":"2023-10-08T16:28:24.265484+0000","last_undegraded":"2023-10-08T16:28:24.265484+0000","last_fullsized":"2023-10-08T16:28:24.265484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:13.386526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:23.241917+0000","last_change":"2023-10-08T16:28:23.241917+0000","last_active":"2023-10-08T16:28:23.241917+0000","last_peered":"2023-10-08T16:28:23.241917+0000","last_clean":"2023-10-08T16:28:23.241917+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:23.241917+0000","last_undegraded":"2023-10-08T16:28:23.241917+0000","last_fullsized":"2023-10-08T16:28:23.241917+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279439+0000","last_change":"2023-10-08T16:28:24.275149+0000","last_active":"2023-10-08T16:28:24.279439+0000","last_peered":"2023-10-08T16:28:24.279439+0000","last_clean":"2023-10-08T16:28:24.279439+0000","last_became_active":"2023-10-08T16:28:24.274887+0000","last_became_peered":"2023-10-08T16:28:24.274887+0000","last_unstale":"2023-10-08T16:28:24.279439+0000","last_undegraded":"2023-10-08T16:28:24.279439+0000","last_fullsized":"2023-10-08T16:28:24.279439+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:32.111591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288428+0000","last_change":"2023-10-08T16:28:24.278613+0000","last_active":"2023-10-08T16:28:24.288428+0000","last_peered":"2023-10-08T16:28:24.288428+0000","last_clean":"2023-10-08T16:28:24.288428+0000","last_became_active":"2023-10-08T16:28:24.278332+0000","last_became_peered":"2023-10-08T16:28:24.278332+0000","last_unstale":"2023-10-08T16:28:24.288428+0000","last_undegraded":"2023-10-08T16:28:24.288428+0000","last_fullsized":"2023-10-08T16:28:24.288428+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:00.317695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.255190+0000","last_change":"2023-10-08T16:28:23.278253+0000","last_active":"2023-10-08T16:28:24.255190+0000","last_peered":"2023-10-08T16:28:24.255190+0000","last_clean":"2023-10-08T16:28:24.255190+0000","last_became_active":"2023-10-08T16:28:23.275139+0000","last_became_peered":"2023-10-08T16:28:23.275139+0000","last_unstale":"2023-10-08T16:28:24.255190+0000","last_undegraded":"2023-10-08T16:28:24.255190+0000","last_fullsized":"2023-10-08T16:28:24.255190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:21.440117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285881+0000","last_change":"2023-10-08T16:28:24.277510+0000","last_active":"2023-10-08T16:28:24.285881+0000","last_peered":"2023-10-08T16:28:24.285881+0000","last_clean":"2023-10-08T16:28:24.285881+0000","last_became_active":"2023-10-08T16:28:24.277202+0000","last_became_peered":"2023-10-08T16:28:24.277202+0000","last_unstale":"2023-10-08T16:28:24.285881+0000","last_undegraded":"2023-10-08T16:28:24.285881+0000","last_fullsized":"2023-10-08T16:28:24.285881+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T16:28:22.233245+0000","last_change":"2023-10-08T16:28:22.233245+0000","last_active":"2023-10-08T16:28:22.233245+0000","last_peered":"2023-10-08T16:28:22.233245+0000","last_clean":"2023-10-08T16:28:22.233245+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T16:28:22.233245+0000","last_undegraded":"2023-10-08T16:28:22.233245+0000","last_fullsized":"2023-10-08T16:28:22.233245+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":743,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.266331+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:28:24.266331+0000","last_peered":"2023-10-08T16:28:24.266331+0000","last_clean":"2023-10-08T16:28:24.266331+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:28:24.266331+0000","last_undegraded":"2023-10-08T16:28:24.266331+0000","last_fullsized":"2023-10-08T16:28:24.266331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":82,"acting":82,"num_store_stats":4},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":30,"acting":30,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2387968,"data_stored":1471399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.103},"last":1.077},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93400000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.0469999999999999},"last":1.159},{"interface":"front","average":{"1min":0.747,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.54300000000000004,"15min":0.42199999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.123}]},{"osd":2,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88400000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.048,"5min":1.131,"15min":1.131},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.48199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38700000000000001},"max":{"1min":1.0009999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.66900000000000004},"min":{"1min":0.44600000000000001,"5min":0.439,"15min":0.437},"max":{"1min":1.1100000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.351,"15min":1.351},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.47099999999999997},"max":{"1min":1.02,"5min":1.173,"15min":1.173},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":1.0009999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":307176,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064664,"statfs":{"total":96636764160,"available":96322215936,"internally_reserved":0,"allocated":1736704,"data_stored":853644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67000000000000004,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.995},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68500000000000005,"15min":0.71199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.82399999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0369999999999999},"last":0.997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91100000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":1.0089999999999999}]},{"osd":2,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73399999999999999,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.998,"15min":1.081},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90300000000000002,"5min":0.94299999999999995,"15min":1.0800000000000001},"last":0.93400000000000005}]},{"osd":3,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.44900000000000001},"max":{"1min":0.94199999999999995,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.0740000000000001},"last":0.90800000000000003}]},{"osd":4,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94699999999999995,"5min":1.073,"15min":1.073},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.747,"15min":0.747},"min":{"1min":0.46999999999999997,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.95899999999999996,"5min":0.96799999999999997,"15min":1.1879999999999999},"last":0.98599999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41499999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.272},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.42999999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.72199999999999998}]},{"osd":7,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.2250000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.48999999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.3089999999999999},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1794048,"data_stored":880567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.27100000000000002},"max":{"1min":0.621,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.33400000000000002,"15min":0.29199999999999998},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.96599999999999997},"last":0.374}]},{"osd":2,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.45800000000000002,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.91200000000000003},"last":0.62}]},{"osd":3,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.86599999999999999,"15min":0.95899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.95199999999999996},"last":0.504}]},{"osd":4,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.51300000000000001},"max":{"1min":1.048,"5min":1.879,"15min":1.879},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.46300000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.94399999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80800000000000005,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.50600000000000001},"max":{"1min":1.4390000000000001,"5min":2.379,"15min":2.379},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.57299999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.224},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.995,"5min":1.0129999999999999,"15min":1.206},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.54800000000000004,"15min":0.53200000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0169999999999999,"5min":1.0780000000000001,"15min":1.1839999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0860000000000001,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575071,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303728,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068112,"statfs":{"total":96636764160,"available":96325746688,"internally_reserved":0,"allocated":2400256,"data_stored":1472459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.89400000000000002,"15min":1.1339999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64400000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.32700000000000001},"max":{"1min":0.66900000000000004,"5min":0.94799999999999995,"15min":1.093},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.32400000000000001},"max":{"1min":0.69199999999999995,"5min":1.022,"15min":1.022},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66100000000000003,"5min":0.78300000000000003,"15min":0.878},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45200000000000001},"max":{"1min":0.73499999999999999,"5min":0.98799999999999999,"15min":1.21},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55300000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.1899999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":0.97299999999999998,"5min":1.083,"15min":1.1439999999999999},"last":1.014},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.2330000000000001},"last":0.997}]},{"osd":6,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0409999999999999,"5min":1.149,"15min":1.1950000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0249999999999999,"5min":1.196,"15min":1.212},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1579999999999999},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52400000000000002},"max":{"1min":0.94099999999999995,"5min":1.163,"15min":1.202},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834575071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311272,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060568,"statfs":{"total":96636764160,"available":96318021632,"internally_reserved":0,"allocated":1736704,"data_stored":853644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.36599999999999999,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":0.96599999999999997,"15min":1.046},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":1.01,"15min":1.01},"last":0.39900000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":1.1519999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.88900000000000001,"15min":0.94399999999999995},"last":0.439}]},{"osd":3,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.53000000000000003},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.99299999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.78800000000000003,"5min":0.80100000000000005,"15min":1.1160000000000001},"last":0.57899999999999996}]},{"osd":4,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.434},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.4790000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.056,"15min":1.2909999999999999},"last":0.54400000000000004}]},{"osd":5,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0269999999999999,"5min":1.03,"15min":1.4990000000000001},"last":0.503},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.024,"5min":1.103,"15min":1.3},"last":0.59899999999999998}]},{"osd":6,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.77600000000000002},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.321},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76500000000000001,"15min":0.81100000000000005},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.163,"15min":1.5149999999999999},"last":0.63100000000000001}]},{"osd":7,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79700000000000004,"15min":0.83699999999999997},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1240000000000001,"15min":1.4410000000000001},"last":0.623},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80000000000000004,"15min":0.84699999999999998},"min":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":1.177,"15min":1.286},"last":0.69499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307228,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064612,"statfs":{"total":96636764160,"available":96322162688,"internally_reserved":0,"allocated":1789952,"data_stored":875341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.83899999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":0.68899999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.90500000000000003},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.95699999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.52400000000000002,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.89200000000000002,"5min":0.90100000000000002,"15min":1},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.3600000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75700000000000001,"15min":0.78100000000000003},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.032,"5min":1.0329999999999999,"15min":1.2110000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.214,"15min":1.3200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51200000000000001},"max":{"1min":1.1899999999999999,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0840000000000001,"5min":1.204,"15min":1.23},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81799999999999995,"15min":0.83699999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575071,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":298984,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072856,"statfs":{"total":96636764160,"available":96330604544,"internally_reserved":0,"allocated":1736704,"data_stored":853644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88900000000000001,"5min":1.0069999999999999,"15min":1.5169999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.47099999999999997,"15min":0.34200000000000003},"max":{"1min":0.88400000000000001,"5min":1.02,"15min":1.02},"last":0.57099999999999995}]},{"osd":1,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95999999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.379},"max":{"1min":1.04,"5min":1.0640000000000001,"15min":1.3959999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.88400000000000001,"5min":1.109,"15min":1.5669999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1,"5min":1.085,"15min":1.1060000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.127,"5min":1.127,"15min":1.1339999999999999},"last":0.621},{"interface":"front","average":{"1min":0.747,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.58299999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95999999999999996,"5min":1.0980000000000001,"15min":3.4169999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.47},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.71999999999999997,"15min":0.68500000000000005},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.39300000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.50800000000000001}]},{"osd":6,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":2.661},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.99199999999999999,"5min":1.0860000000000001,"15min":1.611},"last":0.78800000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.47999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":2.0720000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96399999999999997,"5min":1.137,"15min":2.6120000000000001},"last":0.63900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575070,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":311272,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060568,"statfs":{"total":96636764160,"available":96318021632,"internally_reserved":0,"allocated":1736704,"data_stored":853644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91700000000000004,"5min":0.96099999999999997,"15min":5.3250000000000002},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.53600000000000003,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.98799999999999999,"5min":1.087,"15min":1.9219999999999999},"last":0.58499999999999996}]},{"osd":1,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73299999999999998,"15min":0.753},"min":{"1min":0.53000000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":2.1120000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.82899999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94799999999999995,"5min":1.02,"15min":1.0389999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.73399999999999999},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91800000000000004,"5min":0.98699999999999999,"15min":4.931},"last":0.52000000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90300000000000002,"5min":1.123,"15min":2.0600000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":1.008,"5min":1.101,"15min":1.96},"last":0.86299999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.0529999999999999,"15min":8.3770000000000007},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0489999999999999,"15min":2.1989999999999998},"last":0.80600000000000005}]},{"osd":6,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":2.024},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.498,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":0.84499999999999997,"5min":1.0289999999999999,"15min":7.1639999999999997},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.105,"15min":2.157},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.071,"15min":2.1299999999999999},"last":0.91900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:28:28.641 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T16:28:28.642 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-10-08T16:28:28.639+0000 7f5ec1ff1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T16:28:28.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.828+0000 7f1a0b59d700 1 Processor -- start 2023-10-08T16:28:28.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.828+0000 7f1a0b59d700 1 -- start start 2023-10-08T16:28:28.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.829+0000 7f1a0b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 0x7f1a0406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.829+0000 7f1a0b59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a040c7f90 0x7f1a0406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.829 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.829+0000 7f1a0b59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a040ca480 con 0x7f1a0406bd20 2023-10-08T16:28:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.829+0000 7f1a0b59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0415e240 con 0x7f1a040c7f90 2023-10-08T16:28:28.830 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.829+0000 7f1a0b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0406b350 con 0x7f1a04142c00 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a0a59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 0x7f1a0406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a0ad9c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1a040c7f90 0x7f1a0406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a09d9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1a0406bd20 0x7f1a040c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48600/0 (socket says 172.21.15.12:48600) 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a09d9a700 1 -- 172.21.15.12:0/3186091713 learned_addr learned my addr 172.21.15.12:0/3186091713 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a09599700 1 -- 172.21.15.12:0/3186091713 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019240039 0 0) 0x7f1a040ca480 con 0x7f1a0406bd20 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.830+0000 7f1a09599700 1 -- 172.21.15.12:0/3186091713 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f0003570 con 0x7f1a0406bd20 2023-10-08T16:28:28.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a0a59b700 1 -- 172.21.15.12:0/3186091713 >> v2:172.21.15.29:3300/0 conn(0x7f1a040c7f90 msgr2=0x7f1a0406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/3186091713 >> v2:172.21.15.29:3300/0 conn(0x7f1a040c7f90 0x7f1a0406c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a0a59b700 1 -- 172.21.15.12:0/3186091713 >> v1:172.21.15.29:6789/0 conn(0x7f1a0406bd20 legacy=0x7f1a040c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a0a59b700 1 -- 172.21.15.12:0/3186091713 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0415df60 con 0x7f1a04142c00 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/3186091713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 0x7f1a0406b7e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009910 tx=0x7f1a000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d65be4f4fd08e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a09599700 1 -- 172.21.15.12:0/3186091713 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011630 con 0x7f1a04142c00 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a09599700 1 -- 172.21.15.12:0/3186091713 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a00011790 con 0x7f1a04142c00 2023-10-08T16:28:28.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.831+0000 7f1a09599700 1 -- 172.21.15.12:0/3186091713 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a00011b30 con 0x7f1a04142c00 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 -- 172.21.15.12:0/3186091713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 msgr2=0x7f1a0406b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/3186091713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 0x7f1a0406b7e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1a00009910 tx=0x7f1a000091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 -- 172.21.15.12:0/3186091713 shutdown_connections 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/3186091713 >> v2:172.21.15.29:3300/0 conn(0x7f1a040c7f90 0x7f1a0406c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/3186091713 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a04142c00 0x7f1a0406b7e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 -- 172.21.15.12:0/3186091713 >> 172.21.15.12:0/3186091713 conn(0x7f1a040675a0 msgr2=0x7f1a040679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 -- 172.21.15.12:0/3186091713 shutdown_connections 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.832+0000 7f1a0b59d700 1 -- 172.21.15.12:0/3186091713 wait complete. 2023-10-08T16:28:28.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.833+0000 7f1a0b59d700 1 Processor -- start 2023-10-08T16:28:28.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.833+0000 7f1a0b59d700 1 -- start start 2023-10-08T16:28:28.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 0x7f1a04158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a04142c00 0x7f1a040c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040c52e0 con 0x7f1a040c7f90 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041590f0 con 0x7f1a04142c00 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.834+0000 7f1a0b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040c46d0 con 0x7f1a0406bd20 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55104/0 (socket says 172.21.15.12:55104) 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 -- 172.21.15.12:0/2169410544 learned_addr learned my addr 172.21.15.12:0/2169410544 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 0x7f1a04158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a0ad9c700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a04142c00 0x7f1a040c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 -- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 msgr2=0x7f1a04158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 0x7f1a04158bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 -- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a04142c00 msgr2=0x7f1a040c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a04142c00 0x7f1a040c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 -- 172.21.15.12:0/2169410544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a00009420 con 0x7f1a040c7f90 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 0x7f1a04158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.835+0000 7f1a09d9a700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c7c0 tx=0x7f19f4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.836+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4005b30 con 0x7f1a040c7f90 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.836+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f4005cb0 con 0x7f1a040c7f90 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.836+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a040c49b0 con 0x7f1a040c7f90 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.836+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4007320 con 0x7f1a040c7f90 2023-10-08T16:28:28.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.836+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a040c4f70 con 0x7f1a040c7f90 2023-10-08T16:28:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.837+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a0404c3c0 con 0x7f1a040c7f90 2023-10-08T16:28:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.838+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19f401b3b0 con 0x7f1a040c7f90 2023-10-08T16:28:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.839+0000 7f19fa7fc700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 0x7f19e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:28.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.839+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f19f4083cf0 con 0x7f1a040c7f90 2023-10-08T16:28:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.839+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 0x7f19e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:28.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.839+0000 7f1a0a59b700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 0x7f19e80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a0413b010 tx=0x7f1a00017000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:28.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:28.843+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19f4050d20 con 0x7f1a040c7f90 2023-10-08T16:28:29.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.039+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a0413b220 con 0x7f19e8066f30 2023-10-08T16:28:29.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.048+0000 7f19fa7fc700 1 -- 172.21.15.12:0/2169410544 <== mgr.8073 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289573 (secure 0 0 0) 0x7f1a0413b220 con 0x7f19e8066f30 2023-10-08T16:28:29.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 msgr2=0x7f19e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 0x7f19e80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1a0413b010 tx=0x7f1a00017000 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 msgr2=0x7f1a040b21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f19f400c7c0 tx=0x7f19f4007e00 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 shutdown_connections 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f19e8066f30 0x7f19e80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1a04142c00 0x7f1a040c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1a0406bd20 0x7f1a04158bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 --2- 172.21.15.12:0/2169410544 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1a040c7f90 0x7f1a040b21b0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 >> 172.21.15.12:0/2169410544 conn(0x7f1a040675a0 msgr2=0x7f1a040c39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 shutdown_connections 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.052+0000 7f1a0b59d700 1 -- 172.21.15.12:0/2169410544 wait complete. 2023-10-08T16:28:29.055 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T16:28:29.070 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T16:28:28.806414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":443,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":287,"ondisk_log_size":287,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450788,"kb_used_data":15140,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752523932,"statfs":{"total":773094113280,"available":770584506368,"internally_reserved":0,"allocated":15503360,"data_stored":8208768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001148"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288593+0000","last_change":"2023-10-08T16:28:24.278857+0000","last_active":"2023-10-08T16:28:24.288593+0000","last_peered":"2023-10-08T16:28:24.288593+0000","last_clean":"2023-10-08T16:28:24.288593+0000","last_became_active":"2023-10-08T16:28:24.278544+0000","last_became_peered":"2023-10-08T16:28:24.278544+0000","last_unstale":"2023-10-08T16:28:24.288593+0000","last_undegraded":"2023-10-08T16:28:24.288593+0000","last_fullsized":"2023-10-08T16:28:24.288593+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:43.414602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279170+0000","last_change":"2023-10-08T16:28:24.277987+0000","last_active":"2023-10-08T16:28:24.279170+0000","last_peered":"2023-10-08T16:28:24.279170+0000","last_clean":"2023-10-08T16:28:24.279170+0000","last_became_active":"2023-10-08T16:28:24.277705+0000","last_became_peered":"2023-10-08T16:28:24.277705+0000","last_unstale":"2023-10-08T16:28:24.279170+0000","last_undegraded":"2023-10-08T16:28:24.279170+0000","last_fullsized":"2023-10-08T16:28:24.279170+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:34:24.990413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280252+0000","last_change":"2023-10-08T16:28:24.278899+0000","last_active":"2023-10-08T16:28:24.280252+0000","last_peered":"2023-10-08T16:28:24.280252+0000","last_clean":"2023-10-08T16:28:24.280252+0000","last_became_active":"2023-10-08T16:28:24.278613+0000","last_became_peered":"2023-10-08T16:28:24.278613+0000","last_unstale":"2023-10-08T16:28:24.280252+0000","last_undegraded":"2023-10-08T16:28:24.280252+0000","last_fullsized":"2023-10-08T16:28:24.280252+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:16.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.278968+0000","last_change":"2023-10-08T16:28:24.264955+0000","last_active":"2023-10-08T16:28:24.278968+0000","last_peered":"2023-10-08T16:28:24.278968+0000","last_clean":"2023-10-08T16:28:24.278968+0000","last_became_active":"2023-10-08T16:28:24.264633+0000","last_became_peered":"2023-10-08T16:28:24.264633+0000","last_unstale":"2023-10-08T16:28:24.278968+0000","last_undegraded":"2023-10-08T16:28:24.278968+0000","last_fullsized":"2023-10-08T16:28:24.278968+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:08.213104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291960+0000","last_change":"2023-10-08T16:28:24.287515+0000","last_active":"2023-10-08T16:28:24.291960+0000","last_peered":"2023-10-08T16:28:24.291960+0000","last_clean":"2023-10-08T16:28:24.291960+0000","last_became_active":"2023-10-08T16:28:24.287197+0000","last_became_peered":"2023-10-08T16:28:24.287197+0000","last_unstale":"2023-10-08T16:28:24.291960+0000","last_undegraded":"2023-10-08T16:28:24.291960+0000","last_fullsized":"2023-10-08T16:28:24.291960+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:28:06.953490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.283774+0000","last_change":"2023-10-08T16:28:24.277757+0000","last_active":"2023-10-08T16:28:24.283774+0000","last_peered":"2023-10-08T16:28:24.283774+0000","last_clean":"2023-10-08T16:28:24.283774+0000","last_became_active":"2023-10-08T16:28:24.277478+0000","last_became_peered":"2023-10-08T16:28:24.277478+0000","last_unstale":"2023-10-08T16:28:24.283774+0000","last_undegraded":"2023-10-08T16:28:24.283774+0000","last_fullsized":"2023-10-08T16:28:24.283774+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:39:28.235196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.269555+0000","last_change":"2023-10-08T16:28:24.266152+0000","last_active":"2023-10-08T16:28:24.269555+0000","last_peered":"2023-10-08T16:28:24.269555+0000","last_clean":"2023-10-08T16:28:24.269555+0000","last_became_active":"2023-10-08T16:28:24.265665+0000","last_became_peered":"2023-10-08T16:28:24.265665+0000","last_unstale":"2023-10-08T16:28:24.269555+0000","last_undegraded":"2023-10-08T16:28:24.269555+0000","last_fullsized":"2023-10-08T16:28:24.269555+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:45.445802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280318+0000","last_change":"2023-10-08T16:28:24.277253+0000","last_active":"2023-10-08T16:28:24.280318+0000","last_peered":"2023-10-08T16:28:24.280318+0000","last_clean":"2023-10-08T16:28:24.280318+0000","last_became_active":"2023-10-08T16:28:24.276859+0000","last_became_peered":"2023-10-08T16:28:24.276859+0000","last_unstale":"2023-10-08T16:28:24.280318+0000","last_undegraded":"2023-10-08T16:28:24.280318+0000","last_fullsized":"2023-10-08T16:28:24.280318+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288867+0000","last_change":"2023-10-08T16:28:24.280818+0000","last_active":"2023-10-08T16:28:24.288867+0000","last_peered":"2023-10-08T16:28:24.288867+0000","last_clean":"2023-10-08T16:28:24.288867+0000","last_became_active":"2023-10-08T16:28:24.280556+0000","last_became_peered":"2023-10-08T16:28:24.280556+0000","last_unstale":"2023-10-08T16:28:24.288867+0000","last_undegraded":"2023-10-08T16:28:24.288867+0000","last_fullsized":"2023-10-08T16:28:24.288867+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:49.236697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.289408+0000","last_change":"2023-10-08T16:28:24.283998+0000","last_active":"2023-10-08T16:28:24.289408+0000","last_peered":"2023-10-08T16:28:24.289408+0000","last_clean":"2023-10-08T16:28:24.289408+0000","last_became_active":"2023-10-08T16:28:24.283410+0000","last_became_peered":"2023-10-08T16:28:24.283410+0000","last_unstale":"2023-10-08T16:28:24.289408+0000","last_undegraded":"2023-10-08T16:28:24.289408+0000","last_fullsized":"2023-10-08T16:28:24.289408+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:45.654055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.271652+0000","last_change":"2023-10-08T16:28:24.269408+0000","last_active":"2023-10-08T16:28:24.271652+0000","last_peered":"2023-10-08T16:28:24.271652+0000","last_clean":"2023-10-08T16:28:24.271652+0000","last_became_active":"2023-10-08T16:28:24.269023+0000","last_became_peered":"2023-10-08T16:28:24.269023+0000","last_unstale":"2023-10-08T16:28:24.271652+0000","last_undegraded":"2023-10-08T16:28:24.271652+0000","last_fullsized":"2023-10-08T16:28:24.271652+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:16.051564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288448+0000","last_change":"2023-10-08T16:28:24.273176+0000","last_active":"2023-10-08T16:28:24.288448+0000","last_peered":"2023-10-08T16:28:24.288448+0000","last_clean":"2023-10-08T16:28:24.288448+0000","last_became_active":"2023-10-08T16:28:24.272870+0000","last_became_peered":"2023-10-08T16:28:24.272870+0000","last_unstale":"2023-10-08T16:28:24.288448+0000","last_undegraded":"2023-10-08T16:28:24.288448+0000","last_fullsized":"2023-10-08T16:28:24.288448+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:35.854511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279385+0000","last_change":"2023-10-08T16:28:24.275937+0000","last_active":"2023-10-08T16:28:24.279385+0000","last_peered":"2023-10-08T16:28:24.279385+0000","last_clean":"2023-10-08T16:28:24.279385+0000","last_became_active":"2023-10-08T16:28:24.275677+0000","last_became_peered":"2023-10-08T16:28:24.275677+0000","last_unstale":"2023-10-08T16:28:24.279385+0000","last_undegraded":"2023-10-08T16:28:24.279385+0000","last_fullsized":"2023-10-08T16:28:24.279385+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:11:07.018432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279177+0000","last_change":"2023-10-08T16:28:24.274534+0000","last_active":"2023-10-08T16:28:24.279177+0000","last_peered":"2023-10-08T16:28:24.279177+0000","last_clean":"2023-10-08T16:28:24.279177+0000","last_became_active":"2023-10-08T16:28:24.274260+0000","last_became_peered":"2023-10-08T16:28:24.274260+0000","last_unstale":"2023-10-08T16:28:24.279177+0000","last_undegraded":"2023-10-08T16:28:24.279177+0000","last_fullsized":"2023-10-08T16:28:24.279177+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:08.636724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277250+0000","last_change":"2023-10-08T16:28:24.273596+0000","last_active":"2023-10-08T16:28:24.277250+0000","last_peered":"2023-10-08T16:28:24.277250+0000","last_clean":"2023-10-08T16:28:24.277250+0000","last_became_active":"2023-10-08T16:28:24.273110+0000","last_became_peered":"2023-10-08T16:28:24.273110+0000","last_unstale":"2023-10-08T16:28:24.277250+0000","last_undegraded":"2023-10-08T16:28:24.277250+0000","last_fullsized":"2023-10-08T16:28:24.277250+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:36.469826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288597+0000","last_change":"2023-10-08T16:28:24.275075+0000","last_active":"2023-10-08T16:28:24.288597+0000","last_peered":"2023-10-08T16:28:24.288597+0000","last_clean":"2023-10-08T16:28:24.288597+0000","last_became_active":"2023-10-08T16:28:24.273690+0000","last_became_peered":"2023-10-08T16:28:24.273690+0000","last_unstale":"2023-10-08T16:28:24.288597+0000","last_undegraded":"2023-10-08T16:28:24.288597+0000","last_fullsized":"2023-10-08T16:28:24.288597+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277709+0000","last_change":"2023-10-08T16:28:24.271753+0000","last_active":"2023-10-08T16:28:24.277709+0000","last_peered":"2023-10-08T16:28:24.277709+0000","last_clean":"2023-10-08T16:28:24.277709+0000","last_became_active":"2023-10-08T16:28:24.271462+0000","last_became_peered":"2023-10-08T16:28:24.271462+0000","last_unstale":"2023-10-08T16:28:24.277709+0000","last_undegraded":"2023-10-08T16:28:24.277709+0000","last_fullsized":"2023-10-08T16:28:24.277709+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.682869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.272062+0000","last_change":"2023-10-08T16:28:24.267815+0000","last_active":"2023-10-08T16:28:24.272062+0000","last_peered":"2023-10-08T16:28:24.272062+0000","last_clean":"2023-10-08T16:28:24.272062+0000","last_became_active":"2023-10-08T16:28:24.267514+0000","last_became_peered":"2023-10-08T16:28:24.267514+0000","last_unstale":"2023-10-08T16:28:24.272062+0000","last_undegraded":"2023-10-08T16:28:24.272062+0000","last_fullsized":"2023-10-08T16:28:24.272062+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:56:19.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285526+0000","last_change":"2023-10-08T16:28:24.284583+0000","last_active":"2023-10-08T16:28:24.285526+0000","last_peered":"2023-10-08T16:28:24.285526+0000","last_clean":"2023-10-08T16:28:24.285526+0000","last_became_active":"2023-10-08T16:28:24.284286+0000","last_became_peered":"2023-10-08T16:28:24.284286+0000","last_unstale":"2023-10-08T16:28:24.285526+0000","last_undegraded":"2023-10-08T16:28:24.285526+0000","last_fullsized":"2023-10-08T16:28:24.285526+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:56.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275669+0000","last_change":"2023-10-08T16:28:24.271537+0000","last_active":"2023-10-08T16:28:24.275669+0000","last_peered":"2023-10-08T16:28:24.275669+0000","last_clean":"2023-10-08T16:28:24.275669+0000","last_became_active":"2023-10-08T16:28:24.271190+0000","last_became_peered":"2023-10-08T16:28:24.271190+0000","last_unstale":"2023-10-08T16:28:24.275669+0000","last_undegraded":"2023-10-08T16:28:24.275669+0000","last_fullsized":"2023-10-08T16:28:24.275669+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:03:53.518565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277838+0000","last_change":"2023-10-08T16:28:24.274183+0000","last_active":"2023-10-08T16:28:24.277838+0000","last_peered":"2023-10-08T16:28:24.277838+0000","last_clean":"2023-10-08T16:28:24.277838+0000","last_became_active":"2023-10-08T16:28:24.273754+0000","last_became_peered":"2023-10-08T16:28:24.273754+0000","last_unstale":"2023-10-08T16:28:24.277838+0000","last_undegraded":"2023-10-08T16:28:24.277838+0000","last_fullsized":"2023-10-08T16:28:24.277838+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:13.495560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285912+0000","last_change":"2023-10-08T16:28:24.276674+0000","last_active":"2023-10-08T16:28:24.285912+0000","last_peered":"2023-10-08T16:28:24.285912+0000","last_clean":"2023-10-08T16:28:24.285912+0000","last_became_active":"2023-10-08T16:28:24.276373+0000","last_became_peered":"2023-10-08T16:28:24.276373+0000","last_unstale":"2023-10-08T16:28:24.285912+0000","last_undegraded":"2023-10-08T16:28:24.285912+0000","last_fullsized":"2023-10-08T16:28:24.285912+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:16.264347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.270035+0000","last_change":"2023-10-08T16:28:24.266976+0000","last_active":"2023-10-08T16:28:24.270035+0000","last_peered":"2023-10-08T16:28:24.270035+0000","last_clean":"2023-10-08T16:28:24.270035+0000","last_became_active":"2023-10-08T16:28:24.266638+0000","last_became_peered":"2023-10-08T16:28:24.266638+0000","last_unstale":"2023-10-08T16:28:24.270035+0000","last_undegraded":"2023-10-08T16:28:24.270035+0000","last_fullsized":"2023-10-08T16:28:24.270035+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:47.617947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285902+0000","last_change":"2023-10-08T16:28:24.278123+0000","last_active":"2023-10-08T16:28:24.285902+0000","last_peered":"2023-10-08T16:28:24.285902+0000","last_clean":"2023-10-08T16:28:24.285902+0000","last_became_active":"2023-10-08T16:28:24.277872+0000","last_became_peered":"2023-10-08T16:28:24.277872+0000","last_unstale":"2023-10-08T16:28:24.285902+0000","last_undegraded":"2023-10-08T16:28:24.285902+0000","last_fullsized":"2023-10-08T16:28:24.285902+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275824+0000","last_change":"2023-10-08T16:28:24.271088+0000","last_active":"2023-10-08T16:28:24.275824+0000","last_peered":"2023-10-08T16:28:24.275824+0000","last_clean":"2023-10-08T16:28:24.275824+0000","last_became_active":"2023-10-08T16:28:24.270810+0000","last_became_peered":"2023-10-08T16:28:24.270810+0000","last_unstale":"2023-10-08T16:28:24.275824+0000","last_undegraded":"2023-10-08T16:28:24.275824+0000","last_fullsized":"2023-10-08T16:28:24.275824+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:32:28.986154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279051+0000","last_change":"2023-10-08T16:28:24.263007+0000","last_active":"2023-10-08T16:28:24.279051+0000","last_peered":"2023-10-08T16:28:24.279051+0000","last_clean":"2023-10-08T16:28:24.279051+0000","last_became_active":"2023-10-08T16:28:24.262780+0000","last_became_peered":"2023-10-08T16:28:24.262780+0000","last_unstale":"2023-10-08T16:28:24.279051+0000","last_undegraded":"2023-10-08T16:28:24.279051+0000","last_fullsized":"2023-10-08T16:28:24.279051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:06.383099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.287567+0000","last_change":"2023-10-08T16:28:24.285419+0000","last_active":"2023-10-08T16:28:24.287567+0000","last_peered":"2023-10-08T16:28:24.287567+0000","last_clean":"2023-10-08T16:28:24.287567+0000","last_became_active":"2023-10-08T16:28:24.285158+0000","last_became_peered":"2023-10-08T16:28:24.285158+0000","last_unstale":"2023-10-08T16:28:24.287567+0000","last_undegraded":"2023-10-08T16:28:24.287567+0000","last_fullsized":"2023-10-08T16:28:24.287567+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:37:38.506719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.293195+0000","last_change":"2023-10-08T16:28:24.292014+0000","last_active":"2023-10-08T16:28:24.293195+0000","last_peered":"2023-10-08T16:28:24.293195+0000","last_clean":"2023-10-08T16:28:24.293195+0000","last_became_active":"2023-10-08T16:28:24.291716+0000","last_became_peered":"2023-10-08T16:28:24.291716+0000","last_unstale":"2023-10-08T16:28:24.293195+0000","last_undegraded":"2023-10-08T16:28:24.293195+0000","last_fullsized":"2023-10-08T16:28:24.293195+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:57:35.854511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277818+0000","last_change":"2023-10-08T16:28:24.272102+0000","last_active":"2023-10-08T16:28:24.277818+0000","last_peered":"2023-10-08T16:28:24.277818+0000","last_clean":"2023-10-08T16:28:24.277818+0000","last_became_active":"2023-10-08T16:28:24.271842+0000","last_became_peered":"2023-10-08T16:28:24.271842+0000","last_unstale":"2023-10-08T16:28:24.277818+0000","last_undegraded":"2023-10-08T16:28:24.277818+0000","last_fullsized":"2023-10-08T16:28:24.277818+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:49:11.181223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.274274+0000","last_change":"2023-10-08T16:28:24.273463+0000","last_active":"2023-10-08T16:28:24.274274+0000","last_peered":"2023-10-08T16:28:24.274274+0000","last_clean":"2023-10-08T16:28:24.274274+0000","last_became_active":"2023-10-08T16:28:24.273168+0000","last_became_peered":"2023-10-08T16:28:24.273168+0000","last_unstale":"2023-10-08T16:28:24.274274+0000","last_undegraded":"2023-10-08T16:28:24.274274+0000","last_fullsized":"2023-10-08T16:28:24.274274+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:05:28.514194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.267266+0000","last_change":"2023-10-08T16:28:24.262290+0000","last_active":"2023-10-08T16:28:24.267266+0000","last_peered":"2023-10-08T16:28:24.267266+0000","last_clean":"2023-10-08T16:28:24.267266+0000","last_became_active":"2023-10-08T16:28:24.261983+0000","last_became_peered":"2023-10-08T16:28:24.261983+0000","last_unstale":"2023-10-08T16:28:24.267266+0000","last_undegraded":"2023-10-08T16:28:24.267266+0000","last_fullsized":"2023-10-08T16:28:24.267266+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275092+0000","last_change":"2023-10-08T16:28:24.271274+0000","last_active":"2023-10-08T16:28:24.275092+0000","last_peered":"2023-10-08T16:28:24.275092+0000","last_clean":"2023-10-08T16:28:24.275092+0000","last_became_active":"2023-10-08T16:28:24.270997+0000","last_became_peered":"2023-10-08T16:28:24.270997+0000","last_unstale":"2023-10-08T16:28:24.275092+0000","last_undegraded":"2023-10-08T16:28:24.275092+0000","last_fullsized":"2023-10-08T16:28:24.275092+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:09.344831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.280184+0000","last_change":"2023-10-08T16:28:24.277085+0000","last_active":"2023-10-08T16:28:24.280184+0000","last_peered":"2023-10-08T16:28:24.280184+0000","last_clean":"2023-10-08T16:28:24.280184+0000","last_became_active":"2023-10-08T16:28:24.276832+0000","last_became_peered":"2023-10-08T16:28:24.276832+0000","last_unstale":"2023-10-08T16:28:24.280184+0000","last_undegraded":"2023-10-08T16:28:24.280184+0000","last_fullsized":"2023-10-08T16:28:24.280184+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:45:02.855881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"143'4","reported_seq":14,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285328+0000","last_change":"2023-10-08T16:28:23.261527+0000","last_active":"2023-10-08T16:28:24.285328+0000","last_peered":"2023-10-08T16:28:24.285328+0000","last_clean":"2023-10-08T16:28:24.285328+0000","last_became_active":"2023-10-08T16:28:23.261145+0000","last_became_peered":"2023-10-08T16:28:23.261145+0000","last_unstale":"2023-10-08T16:28:24.285328+0000","last_undegraded":"2023-10-08T16:28:24.285328+0000","last_fullsized":"2023-10-08T16:28:24.285328+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:16.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.274389+0000","last_change":"2023-10-08T16:28:24.272258+0000","last_active":"2023-10-08T16:28:24.274389+0000","last_peered":"2023-10-08T16:28:24.274389+0000","last_clean":"2023-10-08T16:28:24.274389+0000","last_became_active":"2023-10-08T16:28:24.271988+0000","last_became_peered":"2023-10-08T16:28:24.271988+0000","last_unstale":"2023-10-08T16:28:24.274389+0000","last_undegraded":"2023-10-08T16:28:24.274389+0000","last_fullsized":"2023-10-08T16:28:24.274389+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:49:47.658214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285514+0000","last_change":"2023-10-08T16:28:23.266067+0000","last_active":"2023-10-08T16:28:24.285514+0000","last_peered":"2023-10-08T16:28:24.285514+0000","last_clean":"2023-10-08T16:28:24.285514+0000","last_became_active":"2023-10-08T16:28:23.265787+0000","last_became_peered":"2023-10-08T16:28:23.265787+0000","last_unstale":"2023-10-08T16:28:24.285514+0000","last_undegraded":"2023-10-08T16:28:24.285514+0000","last_fullsized":"2023-10-08T16:28:24.285514+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:16.167841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277836+0000","last_change":"2023-10-08T16:28:24.274448+0000","last_active":"2023-10-08T16:28:24.277836+0000","last_peered":"2023-10-08T16:28:24.277836+0000","last_clean":"2023-10-08T16:28:24.277836+0000","last_became_active":"2023-10-08T16:28:24.274123+0000","last_became_peered":"2023-10-08T16:28:24.274123+0000","last_unstale":"2023-10-08T16:28:24.277836+0000","last_undegraded":"2023-10-08T16:28:24.277836+0000","last_fullsized":"2023-10-08T16:28:24.277836+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:36:27.135839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279459+0000","last_change":"2023-10-08T16:28:23.269264+0000","last_active":"2023-10-08T16:28:24.279459+0000","last_peered":"2023-10-08T16:28:24.279459+0000","last_clean":"2023-10-08T16:28:24.279459+0000","last_became_active":"2023-10-08T16:28:23.268974+0000","last_became_peered":"2023-10-08T16:28:23.268974+0000","last_unstale":"2023-10-08T16:28:24.279459+0000","last_undegraded":"2023-10-08T16:28:24.279459+0000","last_fullsized":"2023-10-08T16:28:24.279459+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:58:01.202512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285037+0000","last_change":"2023-10-08T16:28:24.284210+0000","last_active":"2023-10-08T16:28:24.285037+0000","last_peered":"2023-10-08T16:28:24.285037+0000","last_clean":"2023-10-08T16:28:24.285037+0000","last_became_active":"2023-10-08T16:28:24.283916+0000","last_became_peered":"2023-10-08T16:28:24.283916+0000","last_unstale":"2023-10-08T16:28:24.285037+0000","last_undegraded":"2023-10-08T16:28:24.285037+0000","last_fullsized":"2023-10-08T16:28:24.285037+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:35:36.741784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.284310+0000","last_change":"2023-10-08T16:28:23.275082+0000","last_active":"2023-10-08T16:28:24.284310+0000","last_peered":"2023-10-08T16:28:24.284310+0000","last_clean":"2023-10-08T16:28:24.284310+0000","last_became_active":"2023-10-08T16:28:23.274796+0000","last_became_peered":"2023-10-08T16:28:23.274796+0000","last_unstale":"2023-10-08T16:28:24.284310+0000","last_undegraded":"2023-10-08T16:28:24.284310+0000","last_fullsized":"2023-10-08T16:28:24.284310+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:05:54.552495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288976+0000","last_change":"2023-10-08T16:28:24.282230+0000","last_active":"2023-10-08T16:28:24.288976+0000","last_peered":"2023-10-08T16:28:24.288976+0000","last_clean":"2023-10-08T16:28:24.288976+0000","last_became_active":"2023-10-08T16:28:24.281936+0000","last_became_peered":"2023-10-08T16:28:24.281936+0000","last_unstale":"2023-10-08T16:28:24.288976+0000","last_undegraded":"2023-10-08T16:28:24.288976+0000","last_fullsized":"2023-10-08T16:28:24.288976+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:16:27.519225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.284932+0000","last_change":"2023-10-08T16:28:23.266917+0000","last_active":"2023-10-08T16:28:24.284932+0000","last_peered":"2023-10-08T16:28:24.284932+0000","last_clean":"2023-10-08T16:28:24.284932+0000","last_became_active":"2023-10-08T16:28:23.266604+0000","last_became_peered":"2023-10-08T16:28:23.266604+0000","last_unstale":"2023-10-08T16:28:24.284932+0000","last_undegraded":"2023-10-08T16:28:24.284932+0000","last_fullsized":"2023-10-08T16:28:24.284932+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:13:37.723858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279671+0000","last_change":"2023-10-08T16:28:24.278774+0000","last_active":"2023-10-08T16:28:24.279671+0000","last_peered":"2023-10-08T16:28:24.279671+0000","last_clean":"2023-10-08T16:28:24.279671+0000","last_became_active":"2023-10-08T16:28:24.278395+0000","last_became_peered":"2023-10-08T16:28:24.278395+0000","last_unstale":"2023-10-08T16:28:24.279671+0000","last_undegraded":"2023-10-08T16:28:24.279671+0000","last_fullsized":"2023-10-08T16:28:24.279671+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:54.892776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285823+0000","last_change":"2023-10-08T16:28:23.267909+0000","last_active":"2023-10-08T16:28:24.285823+0000","last_peered":"2023-10-08T16:28:24.285823+0000","last_clean":"2023-10-08T16:28:24.285823+0000","last_became_active":"2023-10-08T16:28:23.267633+0000","last_became_peered":"2023-10-08T16:28:23.267633+0000","last_unstale":"2023-10-08T16:28:24.285823+0000","last_undegraded":"2023-10-08T16:28:24.285823+0000","last_fullsized":"2023-10-08T16:28:24.285823+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:12.312208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288616+0000","last_change":"2023-10-08T16:28:24.275636+0000","last_active":"2023-10-08T16:28:24.288616+0000","last_peered":"2023-10-08T16:28:24.288616+0000","last_clean":"2023-10-08T16:28:24.288616+0000","last_became_active":"2023-10-08T16:28:24.275324+0000","last_became_peered":"2023-10-08T16:28:24.275324+0000","last_unstale":"2023-10-08T16:28:24.288616+0000","last_undegraded":"2023-10-08T16:28:24.288616+0000","last_fullsized":"2023-10-08T16:28:24.288616+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:17:59.524568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.257083+0000","last_change":"2023-10-08T16:28:23.261585+0000","last_active":"2023-10-08T16:28:24.257083+0000","last_peered":"2023-10-08T16:28:24.257083+0000","last_clean":"2023-10-08T16:28:24.257083+0000","last_became_active":"2023-10-08T16:28:23.261241+0000","last_became_peered":"2023-10-08T16:28:23.261241+0000","last_unstale":"2023-10-08T16:28:24.257083+0000","last_undegraded":"2023-10-08T16:28:24.257083+0000","last_fullsized":"2023-10-08T16:28:24.257083+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:57.491149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.269536+0000","last_change":"2023-10-08T16:28:24.265974+0000","last_active":"2023-10-08T16:28:24.269536+0000","last_peered":"2023-10-08T16:28:24.269536+0000","last_clean":"2023-10-08T16:28:24.269536+0000","last_became_active":"2023-10-08T16:28:24.265267+0000","last_became_peered":"2023-10-08T16:28:24.265267+0000","last_unstale":"2023-10-08T16:28:24.269536+0000","last_undegraded":"2023-10-08T16:28:24.269536+0000","last_fullsized":"2023-10-08T16:28:24.269536+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:42:58.499822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.253937+0000","last_change":"2023-10-08T16:28:23.278439+0000","last_active":"2023-10-08T16:28:24.253937+0000","last_peered":"2023-10-08T16:28:24.253937+0000","last_clean":"2023-10-08T16:28:24.253937+0000","last_became_active":"2023-10-08T16:28:23.277599+0000","last_became_peered":"2023-10-08T16:28:23.277599+0000","last_unstale":"2023-10-08T16:28:24.253937+0000","last_undegraded":"2023-10-08T16:28:24.253937+0000","last_fullsized":"2023-10-08T16:28:24.253937+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:16.167841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.277377+0000","last_change":"2023-10-08T16:28:24.276658+0000","last_active":"2023-10-08T16:28:24.277377+0000","last_peered":"2023-10-08T16:28:24.277377+0000","last_clean":"2023-10-08T16:28:24.277377+0000","last_became_active":"2023-10-08T16:28:24.275607+0000","last_became_peered":"2023-10-08T16:28:24.275607+0000","last_unstale":"2023-10-08T16:28:24.277377+0000","last_undegraded":"2023-10-08T16:28:24.277377+0000","last_fullsized":"2023-10-08T16:28:24.277377+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:09:14.113988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.263713+0000","last_change":"2023-10-08T16:28:23.275800+0000","last_active":"2023-10-08T16:28:24.263713+0000","last_peered":"2023-10-08T16:28:24.263713+0000","last_clean":"2023-10-08T16:28:24.263713+0000","last_became_active":"2023-10-08T16:28:23.275470+0000","last_became_peered":"2023-10-08T16:28:23.275470+0000","last_unstale":"2023-10-08T16:28:24.263713+0000","last_undegraded":"2023-10-08T16:28:24.263713+0000","last_fullsized":"2023-10-08T16:28:24.263713+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:15.791608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291473+0000","last_change":"2023-10-08T16:28:24.290970+0000","last_active":"2023-10-08T16:28:24.291473+0000","last_peered":"2023-10-08T16:28:24.291473+0000","last_clean":"2023-10-08T16:28:24.291473+0000","last_became_active":"2023-10-08T16:28:24.290709+0000","last_became_peered":"2023-10-08T16:28:24.290709+0000","last_unstale":"2023-10-08T16:28:24.291473+0000","last_undegraded":"2023-10-08T16:28:24.291473+0000","last_fullsized":"2023-10-08T16:28:24.291473+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:13.495560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.265210+0000","last_change":"2023-10-08T16:28:23.267290+0000","last_active":"2023-10-08T16:28:24.265210+0000","last_peered":"2023-10-08T16:28:24.265210+0000","last_clean":"2023-10-08T16:28:24.265210+0000","last_became_active":"2023-10-08T16:28:23.266898+0000","last_became_peered":"2023-10-08T16:28:23.266898+0000","last_unstale":"2023-10-08T16:28:24.265210+0000","last_undegraded":"2023-10-08T16:28:24.265210+0000","last_fullsized":"2023-10-08T16:28:24.265210+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:49.298719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285852+0000","last_change":"2023-10-08T16:28:24.279911+0000","last_active":"2023-10-08T16:28:24.285852+0000","last_peered":"2023-10-08T16:28:24.285852+0000","last_clean":"2023-10-08T16:28:24.285852+0000","last_became_active":"2023-10-08T16:28:24.279656+0000","last_became_peered":"2023-10-08T16:28:24.279656+0000","last_unstale":"2023-10-08T16:28:24.285852+0000","last_undegraded":"2023-10-08T16:28:24.285852+0000","last_fullsized":"2023-10-08T16:28:24.285852+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:12:08.636724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"143'3","reported_seq":13,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.290543+0000","last_change":"2023-10-08T16:28:23.279112+0000","last_active":"2023-10-08T16:28:24.290543+0000","last_peered":"2023-10-08T16:28:24.290543+0000","last_clean":"2023-10-08T16:28:24.290543+0000","last_became_active":"2023-10-08T16:28:23.278830+0000","last_became_peered":"2023-10-08T16:28:23.278830+0000","last_unstale":"2023-10-08T16:28:24.290543+0000","last_undegraded":"2023-10-08T16:28:24.290543+0000","last_fullsized":"2023-10-08T16:28:24.290543+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:14:38.128642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.271283+0000","last_change":"2023-10-08T16:28:24.269370+0000","last_active":"2023-10-08T16:28:24.271283+0000","last_peered":"2023-10-08T16:28:24.271283+0000","last_clean":"2023-10-08T16:28:24.271283+0000","last_became_active":"2023-10-08T16:28:24.269098+0000","last_became_peered":"2023-10-08T16:28:24.269098+0000","last_unstale":"2023-10-08T16:28:24.271283+0000","last_undegraded":"2023-10-08T16:28:24.271283+0000","last_fullsized":"2023-10-08T16:28:24.271283+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:18:04.382977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"143'6","reported_seq":16,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.293892+0000","last_change":"2023-10-08T16:28:23.275899+0000","last_active":"2023-10-08T16:28:24.293892+0000","last_peered":"2023-10-08T16:28:24.293892+0000","last_clean":"2023-10-08T16:28:24.293892+0000","last_became_active":"2023-10-08T16:28:23.275116+0000","last_became_peered":"2023-10-08T16:28:23.275116+0000","last_unstale":"2023-10-08T16:28:24.293892+0000","last_undegraded":"2023-10-08T16:28:24.293892+0000","last_fullsized":"2023-10-08T16:28:24.293892+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:06.956947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285893+0000","last_change":"2023-10-08T16:28:24.275035+0000","last_active":"2023-10-08T16:28:24.285893+0000","last_peered":"2023-10-08T16:28:24.285893+0000","last_clean":"2023-10-08T16:28:24.285893+0000","last_became_active":"2023-10-08T16:28:24.274790+0000","last_became_peered":"2023-10-08T16:28:24.274790+0000","last_unstale":"2023-10-08T16:28:24.285893+0000","last_undegraded":"2023-10-08T16:28:24.285893+0000","last_fullsized":"2023-10-08T16:28:24.285893+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:37:04.203633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.275839+0000","last_change":"2023-10-08T16:28:23.269619+0000","last_active":"2023-10-08T16:28:24.275839+0000","last_peered":"2023-10-08T16:28:24.275839+0000","last_clean":"2023-10-08T16:28:24.275839+0000","last_became_active":"2023-10-08T16:28:23.269330+0000","last_became_peered":"2023-10-08T16:28:23.269330+0000","last_unstale":"2023-10-08T16:28:24.275839+0000","last_undegraded":"2023-10-08T16:28:24.275839+0000","last_fullsized":"2023-10-08T16:28:24.275839+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:26:58.535546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285487+0000","last_change":"2023-10-08T16:28:24.277101+0000","last_active":"2023-10-08T16:28:24.285487+0000","last_peered":"2023-10-08T16:28:24.285487+0000","last_clean":"2023-10-08T16:28:24.285487+0000","last_became_active":"2023-10-08T16:28:24.276558+0000","last_became_peered":"2023-10-08T16:28:24.276558+0000","last_unstale":"2023-10-08T16:28:24.285487+0000","last_undegraded":"2023-10-08T16:28:24.285487+0000","last_fullsized":"2023-10-08T16:28:24.285487+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:08.213104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.260423+0000","last_change":"2023-10-08T16:28:23.279007+0000","last_active":"2023-10-08T16:28:24.260423+0000","last_peered":"2023-10-08T16:28:24.260423+0000","last_clean":"2023-10-08T16:28:24.260423+0000","last_became_active":"2023-10-08T16:28:23.278796+0000","last_became_peered":"2023-10-08T16:28:23.278796+0000","last_unstale":"2023-10-08T16:28:24.260423+0000","last_undegraded":"2023-10-08T16:28:24.260423+0000","last_fullsized":"2023-10-08T16:28:24.260423+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:17:16.999238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285443+0000","last_change":"2023-10-08T16:28:24.279302+0000","last_active":"2023-10-08T16:28:24.285443+0000","last_peered":"2023-10-08T16:28:24.285443+0000","last_clean":"2023-10-08T16:28:24.285443+0000","last_became_active":"2023-10-08T16:28:24.279046+0000","last_became_peered":"2023-10-08T16:28:24.279046+0000","last_unstale":"2023-10-08T16:28:24.285443+0000","last_undegraded":"2023-10-08T16:28:24.285443+0000","last_fullsized":"2023-10-08T16:28:24.285443+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:46:56.527888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"143'8","reported_seq":18,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.290592+0000","last_change":"2023-10-08T16:28:23.267854+0000","last_active":"2023-10-08T16:28:24.290592+0000","last_peered":"2023-10-08T16:28:24.290592+0000","last_clean":"2023-10-08T16:28:24.290592+0000","last_became_active":"2023-10-08T16:28:23.267591+0000","last_became_peered":"2023-10-08T16:28:23.267591+0000","last_unstale":"2023-10-08T16:28:24.290592+0000","last_undegraded":"2023-10-08T16:28:24.290592+0000","last_fullsized":"2023-10-08T16:28:24.290592+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:11.366299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.290333+0000","last_change":"2023-10-08T16:28:24.287112+0000","last_active":"2023-10-08T16:28:24.290333+0000","last_peered":"2023-10-08T16:28:24.290333+0000","last_clean":"2023-10-08T16:28:24.290333+0000","last_became_active":"2023-10-08T16:28:24.286805+0000","last_became_peered":"2023-10-08T16:28:24.286805+0000","last_unstale":"2023-10-08T16:28:24.290333+0000","last_undegraded":"2023-10-08T16:28:24.290333+0000","last_fullsized":"2023-10-08T16:28:24.290333+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:26:07.873222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.289085+0000","last_change":"2023-10-08T16:28:23.272679+0000","last_active":"2023-10-08T16:28:24.289085+0000","last_peered":"2023-10-08T16:28:24.289085+0000","last_clean":"2023-10-08T16:28:24.289085+0000","last_became_active":"2023-10-08T16:28:23.271840+0000","last_became_peered":"2023-10-08T16:28:23.271840+0000","last_unstale":"2023-10-08T16:28:24.289085+0000","last_undegraded":"2023-10-08T16:28:24.289085+0000","last_fullsized":"2023-10-08T16:28:24.289085+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:25.815907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291728+0000","last_change":"2023-10-08T16:28:24.290993+0000","last_active":"2023-10-08T16:28:24.291728+0000","last_peered":"2023-10-08T16:28:24.291728+0000","last_clean":"2023-10-08T16:28:24.291728+0000","last_became_active":"2023-10-08T16:28:24.290688+0000","last_became_peered":"2023-10-08T16:28:24.290688+0000","last_unstale":"2023-10-08T16:28:24.291728+0000","last_undegraded":"2023-10-08T16:28:24.291728+0000","last_fullsized":"2023-10-08T16:28:24.291728+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:06:42.322335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.284814+0000","last_change":"2023-10-08T16:28:23.268511+0000","last_active":"2023-10-08T16:28:24.284814+0000","last_peered":"2023-10-08T16:28:24.284814+0000","last_clean":"2023-10-08T16:28:24.284814+0000","last_became_active":"2023-10-08T16:28:23.268138+0000","last_became_peered":"2023-10-08T16:28:23.268138+0000","last_unstale":"2023-10-08T16:28:24.284814+0000","last_undegraded":"2023-10-08T16:28:24.284814+0000","last_fullsized":"2023-10-08T16:28:24.284814+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:35:35.934415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285042+0000","last_change":"2023-10-08T16:28:24.284175+0000","last_active":"2023-10-08T16:28:24.285042+0000","last_peered":"2023-10-08T16:28:24.285042+0000","last_clean":"2023-10-08T16:28:24.285042+0000","last_became_active":"2023-10-08T16:28:24.283864+0000","last_became_peered":"2023-10-08T16:28:24.283864+0000","last_unstale":"2023-10-08T16:28:24.285042+0000","last_undegraded":"2023-10-08T16:28:24.285042+0000","last_fullsized":"2023-10-08T16:28:24.285042+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:53:47.565434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"143'1","reported_seq":11,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.290797+0000","last_change":"2023-10-08T16:28:23.269984+0000","last_active":"2023-10-08T16:28:24.290797+0000","last_peered":"2023-10-08T16:28:24.290797+0000","last_clean":"2023-10-08T16:28:24.290797+0000","last_became_active":"2023-10-08T16:28:23.269401+0000","last_became_peered":"2023-10-08T16:28:23.269401+0000","last_unstale":"2023-10-08T16:28:24.290797+0000","last_undegraded":"2023-10-08T16:28:24.290797+0000","last_fullsized":"2023-10-08T16:28:24.290797+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:18:19.728305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.274849+0000","last_change":"2023-10-08T16:28:24.272457+0000","last_active":"2023-10-08T16:28:24.274849+0000","last_peered":"2023-10-08T16:28:24.274849+0000","last_clean":"2023-10-08T16:28:24.274849+0000","last_became_active":"2023-10-08T16:28:24.272192+0000","last_became_peered":"2023-10-08T16:28:24.272192+0000","last_unstale":"2023-10-08T16:28:24.274849+0000","last_undegraded":"2023-10-08T16:28:24.274849+0000","last_fullsized":"2023-10-08T16:28:24.274849+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:44:11.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.255406+0000","last_change":"2023-10-08T16:28:23.276095+0000","last_active":"2023-10-08T16:28:24.255406+0000","last_peered":"2023-10-08T16:28:24.255406+0000","last_clean":"2023-10-08T16:28:24.255406+0000","last_became_active":"2023-10-08T16:28:23.275850+0000","last_became_peered":"2023-10-08T16:28:23.275850+0000","last_unstale":"2023-10-08T16:28:24.255406+0000","last_undegraded":"2023-10-08T16:28:24.255406+0000","last_fullsized":"2023-10-08T16:28:24.255406+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:56.167322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279406+0000","last_change":"2023-10-08T16:28:24.277172+0000","last_active":"2023-10-08T16:28:24.279406+0000","last_peered":"2023-10-08T16:28:24.279406+0000","last_clean":"2023-10-08T16:28:24.279406+0000","last_became_active":"2023-10-08T16:28:24.276884+0000","last_became_peered":"2023-10-08T16:28:24.276884+0000","last_unstale":"2023-10-08T16:28:24.279406+0000","last_undegraded":"2023-10-08T16:28:24.279406+0000","last_fullsized":"2023-10-08T16:28:24.279406+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.283442+0000","last_change":"2023-10-08T16:28:23.277544+0000","last_active":"2023-10-08T16:28:24.283442+0000","last_peered":"2023-10-08T16:28:24.283442+0000","last_clean":"2023-10-08T16:28:24.283442+0000","last_became_active":"2023-10-08T16:28:23.274828+0000","last_became_peered":"2023-10-08T16:28:23.274828+0000","last_unstale":"2023-10-08T16:28:24.283442+0000","last_undegraded":"2023-10-08T16:28:24.283442+0000","last_fullsized":"2023-10-08T16:28:24.283442+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:15:03.743651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.281415+0000","last_change":"2023-10-08T16:28:24.265491+0000","last_active":"2023-10-08T16:28:24.281415+0000","last_peered":"2023-10-08T16:28:24.281415+0000","last_clean":"2023-10-08T16:28:24.281415+0000","last_became_active":"2023-10-08T16:28:24.265173+0000","last_became_peered":"2023-10-08T16:28:24.265173+0000","last_unstale":"2023-10-08T16:28:24.281415+0000","last_undegraded":"2023-10-08T16:28:24.281415+0000","last_fullsized":"2023-10-08T16:28:24.281415+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.263599+0000","last_change":"2023-10-08T16:28:23.275698+0000","last_active":"2023-10-08T16:28:24.263599+0000","last_peered":"2023-10-08T16:28:24.263599+0000","last_clean":"2023-10-08T16:28:24.263599+0000","last_became_active":"2023-10-08T16:28:23.275389+0000","last_became_peered":"2023-10-08T16:28:23.275389+0000","last_unstale":"2023-10-08T16:28:24.263599+0000","last_undegraded":"2023-10-08T16:28:24.263599+0000","last_fullsized":"2023-10-08T16:28:24.263599+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:57.004803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285535+0000","last_change":"2023-10-08T16:28:24.284725+0000","last_active":"2023-10-08T16:28:24.285535+0000","last_peered":"2023-10-08T16:28:24.285535+0000","last_clean":"2023-10-08T16:28:24.285535+0000","last_became_active":"2023-10-08T16:28:24.284251+0000","last_became_peered":"2023-10-08T16:28:24.284251+0000","last_unstale":"2023-10-08T16:28:24.285535+0000","last_undegraded":"2023-10-08T16:28:24.285535+0000","last_fullsized":"2023-10-08T16:28:24.285535+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:30:58.890347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.260271+0000","last_change":"2023-10-08T16:28:23.274158+0000","last_active":"2023-10-08T16:28:24.260271+0000","last_peered":"2023-10-08T16:28:24.260271+0000","last_clean":"2023-10-08T16:28:24.260271+0000","last_became_active":"2023-10-08T16:28:23.273807+0000","last_became_peered":"2023-10-08T16:28:23.273807+0000","last_unstale":"2023-10-08T16:28:24.260271+0000","last_undegraded":"2023-10-08T16:28:24.260271+0000","last_fullsized":"2023-10-08T16:28:24.260271+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:18.415126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.292903+0000","last_change":"2023-10-08T16:28:24.291114+0000","last_active":"2023-10-08T16:28:24.292903+0000","last_peered":"2023-10-08T16:28:24.292903+0000","last_clean":"2023-10-08T16:28:24.292903+0000","last_became_active":"2023-10-08T16:28:24.290836+0000","last_became_peered":"2023-10-08T16:28:24.290836+0000","last_unstale":"2023-10-08T16:28:24.292903+0000","last_undegraded":"2023-10-08T16:28:24.292903+0000","last_fullsized":"2023-10-08T16:28:24.292903+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:04.634604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.254945+0000","last_change":"2023-10-08T16:28:23.279855+0000","last_active":"2023-10-08T16:28:24.254945+0000","last_peered":"2023-10-08T16:28:24.254945+0000","last_clean":"2023-10-08T16:28:24.254945+0000","last_became_active":"2023-10-08T16:28:23.276501+0000","last_became_peered":"2023-10-08T16:28:23.276501+0000","last_unstale":"2023-10-08T16:28:24.254945+0000","last_undegraded":"2023-10-08T16:28:24.254945+0000","last_fullsized":"2023-10-08T16:28:24.254945+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:13.386526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.283935+0000","last_change":"2023-10-08T16:28:24.283118+0000","last_active":"2023-10-08T16:28:24.283935+0000","last_peered":"2023-10-08T16:28:24.283935+0000","last_clean":"2023-10-08T16:28:24.283935+0000","last_became_active":"2023-10-08T16:28:24.282779+0000","last_became_peered":"2023-10-08T16:28:24.282779+0000","last_unstale":"2023-10-08T16:28:24.283935+0000","last_undegraded":"2023-10-08T16:28:24.283935+0000","last_fullsized":"2023-10-08T16:28:24.283935+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:32.487812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"143'2","reported_seq":12,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.291435+0000","last_change":"2023-10-08T16:28:23.280037+0000","last_active":"2023-10-08T16:28:24.291435+0000","last_peered":"2023-10-08T16:28:24.291435+0000","last_clean":"2023-10-08T16:28:24.291435+0000","last_became_active":"2023-10-08T16:28:23.279736+0000","last_became_peered":"2023-10-08T16:28:23.279736+0000","last_unstale":"2023-10-08T16:28:24.291435+0000","last_undegraded":"2023-10-08T16:28:24.291435+0000","last_fullsized":"2023-10-08T16:28:24.291435+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:29.160812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.278974+0000","last_change":"2023-10-08T16:28:24.264270+0000","last_active":"2023-10-08T16:28:24.278974+0000","last_peered":"2023-10-08T16:28:24.278974+0000","last_clean":"2023-10-08T16:28:24.278974+0000","last_became_active":"2023-10-08T16:28:24.263999+0000","last_became_peered":"2023-10-08T16:28:24.263999+0000","last_unstale":"2023-10-08T16:28:24.278974+0000","last_undegraded":"2023-10-08T16:28:24.278974+0000","last_fullsized":"2023-10-08T16:28:24.278974+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:20.166306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.261018+0000","last_change":"2023-10-08T16:28:23.268783+0000","last_active":"2023-10-08T16:28:24.261018+0000","last_peered":"2023-10-08T16:28:24.261018+0000","last_clean":"2023-10-08T16:28:24.261018+0000","last_became_active":"2023-10-08T16:28:23.268438+0000","last_became_peered":"2023-10-08T16:28:23.268438+0000","last_unstale":"2023-10-08T16:28:24.261018+0000","last_undegraded":"2023-10-08T16:28:24.261018+0000","last_fullsized":"2023-10-08T16:28:24.261018+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:44.248331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288610+0000","last_change":"2023-10-08T16:28:24.278868+0000","last_active":"2023-10-08T16:28:24.288610+0000","last_peered":"2023-10-08T16:28:24.288610+0000","last_clean":"2023-10-08T16:28:24.288610+0000","last_became_active":"2023-10-08T16:28:24.278585+0000","last_became_peered":"2023-10-08T16:28:24.278585+0000","last_unstale":"2023-10-08T16:28:24.288610+0000","last_undegraded":"2023-10-08T16:28:24.288610+0000","last_fullsized":"2023-10-08T16:28:24.288610+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:20:33.960400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.254182+0000","last_change":"2023-10-08T16:28:23.274093+0000","last_active":"2023-10-08T16:28:24.254182+0000","last_peered":"2023-10-08T16:28:24.254182+0000","last_clean":"2023-10-08T16:28:24.254182+0000","last_became_active":"2023-10-08T16:28:23.273795+0000","last_became_peered":"2023-10-08T16:28:23.273795+0000","last_unstale":"2023-10-08T16:28:24.254182+0000","last_undegraded":"2023-10-08T16:28:24.254182+0000","last_fullsized":"2023-10-08T16:28:24.254182+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:38:29.160812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288797+0000","last_change":"2023-10-08T16:28:24.288140+0000","last_active":"2023-10-08T16:28:24.288797+0000","last_peered":"2023-10-08T16:28:24.288797+0000","last_clean":"2023-10-08T16:28:24.288797+0000","last_became_active":"2023-10-08T16:28:24.287908+0000","last_became_peered":"2023-10-08T16:28:24.287908+0000","last_unstale":"2023-10-08T16:28:24.288797+0000","last_undegraded":"2023-10-08T16:28:24.288797+0000","last_fullsized":"2023-10-08T16:28:24.288797+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:42.117506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.265484+0000","last_change":"2023-10-08T16:28:23.277052+0000","last_active":"2023-10-08T16:28:24.265484+0000","last_peered":"2023-10-08T16:28:24.265484+0000","last_clean":"2023-10-08T16:28:24.265484+0000","last_became_active":"2023-10-08T16:28:23.276764+0000","last_became_peered":"2023-10-08T16:28:23.276764+0000","last_unstale":"2023-10-08T16:28:24.265484+0000","last_undegraded":"2023-10-08T16:28:24.265484+0000","last_fullsized":"2023-10-08T16:28:24.265484+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:29:13.386526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.264227+0000","last_change":"2023-10-08T16:28:24.262358+0000","last_active":"2023-10-08T16:28:24.264227+0000","last_peered":"2023-10-08T16:28:24.264227+0000","last_clean":"2023-10-08T16:28:24.264227+0000","last_became_active":"2023-10-08T16:28:24.262080+0000","last_became_peered":"2023-10-08T16:28:24.262080+0000","last_unstale":"2023-10-08T16:28:24.264227+0000","last_undegraded":"2023-10-08T16:28:24.264227+0000","last_fullsized":"2023-10-08T16:28:24.264227+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:47:14.906630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.255116+0000","last_change":"2023-10-08T16:28:23.267966+0000","last_active":"2023-10-08T16:28:24.255116+0000","last_peered":"2023-10-08T16:28:24.255116+0000","last_clean":"2023-10-08T16:28:24.255116+0000","last_became_active":"2023-10-08T16:28:23.267664+0000","last_became_peered":"2023-10-08T16:28:23.267664+0000","last_unstale":"2023-10-08T16:28:24.255116+0000","last_undegraded":"2023-10-08T16:28:24.255116+0000","last_fullsized":"2023-10-08T16:28:24.255116+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:15.791608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.278901+0000","last_change":"2023-10-08T16:28:24.276217+0000","last_active":"2023-10-08T16:28:24.278901+0000","last_peered":"2023-10-08T16:28:24.278901+0000","last_clean":"2023-10-08T16:28:24.278901+0000","last_became_active":"2023-10-08T16:28:24.275869+0000","last_became_peered":"2023-10-08T16:28:24.275869+0000","last_unstale":"2023-10-08T16:28:24.278901+0000","last_undegraded":"2023-10-08T16:28:24.278901+0000","last_fullsized":"2023-10-08T16:28:24.278901+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:33:32.487812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.257194+0000","last_change":"2023-10-08T16:28:23.267250+0000","last_active":"2023-10-08T16:28:24.257194+0000","last_peered":"2023-10-08T16:28:24.257194+0000","last_clean":"2023-10-08T16:28:24.257194+0000","last_became_active":"2023-10-08T16:28:23.266970+0000","last_became_peered":"2023-10-08T16:28:23.266970+0000","last_unstale":"2023-10-08T16:28:24.257194+0000","last_undegraded":"2023-10-08T16:28:24.257194+0000","last_fullsized":"2023-10-08T16:28:24.257194+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:44.437130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.279439+0000","last_change":"2023-10-08T16:28:24.275149+0000","last_active":"2023-10-08T16:28:24.279439+0000","last_peered":"2023-10-08T16:28:24.279439+0000","last_clean":"2023-10-08T16:28:24.279439+0000","last_became_active":"2023-10-08T16:28:24.274887+0000","last_became_peered":"2023-10-08T16:28:24.274887+0000","last_unstale":"2023-10-08T16:28:24.279439+0000","last_undegraded":"2023-10-08T16:28:24.279439+0000","last_fullsized":"2023-10-08T16:28:24.279439+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:32.111591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.263193+0000","last_change":"2023-10-08T16:28:23.268496+0000","last_active":"2023-10-08T16:28:24.263193+0000","last_peered":"2023-10-08T16:28:24.263193+0000","last_clean":"2023-10-08T16:28:24.263193+0000","last_became_active":"2023-10-08T16:28:23.268185+0000","last_became_peered":"2023-10-08T16:28:23.268185+0000","last_unstale":"2023-10-08T16:28:24.263193+0000","last_undegraded":"2023-10-08T16:28:24.263193+0000","last_fullsized":"2023-10-08T16:28:24.263193+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:16.692517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.288428+0000","last_change":"2023-10-08T16:28:24.278613+0000","last_active":"2023-10-08T16:28:24.288428+0000","last_peered":"2023-10-08T16:28:24.288428+0000","last_clean":"2023-10-08T16:28:24.288428+0000","last_became_active":"2023-10-08T16:28:24.278332+0000","last_became_peered":"2023-10-08T16:28:24.278332+0000","last_unstale":"2023-10-08T16:28:24.288428+0000","last_undegraded":"2023-10-08T16:28:24.288428+0000","last_fullsized":"2023-10-08T16:28:24.288428+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:11:00.317695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.255190+0000","last_change":"2023-10-08T16:28:23.278253+0000","last_active":"2023-10-08T16:28:24.255190+0000","last_peered":"2023-10-08T16:28:24.255190+0000","last_clean":"2023-10-08T16:28:24.255190+0000","last_became_active":"2023-10-08T16:28:23.275139+0000","last_became_peered":"2023-10-08T16:28:23.275139+0000","last_unstale":"2023-10-08T16:28:24.255190+0000","last_undegraded":"2023-10-08T16:28:24.255190+0000","last_fullsized":"2023-10-08T16:28:24.255190+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:35:21.440117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.285881+0000","last_change":"2023-10-08T16:28:24.277510+0000","last_active":"2023-10-08T16:28:24.285881+0000","last_peered":"2023-10-08T16:28:24.285881+0000","last_clean":"2023-10-08T16:28:24.285881+0000","last_became_active":"2023-10-08T16:28:24.277202+0000","last_became_peered":"2023-10-08T16:28:24.277202+0000","last_unstale":"2023-10-08T16:28:24.285881+0000","last_undegraded":"2023-10-08T16:28:24.285881+0000","last_fullsized":"2023-10-08T16:28:24.285881+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:23.241917+0000","last_clean_scrub_stamp":"2023-10-08T16:28:23.241917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:25:15.403457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.257258+0000","last_change":"2023-10-08T16:28:23.273441+0000","last_active":"2023-10-08T16:28:24.257258+0000","last_peered":"2023-10-08T16:28:24.257258+0000","last_clean":"2023-10-08T16:28:24.257258+0000","last_became_active":"2023-10-08T16:28:23.273176+0000","last_became_peered":"2023-10-08T16:28:23.273176+0000","last_unstale":"2023-10-08T16:28:24.257258+0000","last_undegraded":"2023-10-08T16:28:24.257258+0000","last_fullsized":"2023-10-08T16:28:24.257258+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:28:22.233245+0000","last_clean_scrub_stamp":"2023-10-08T16:28:22.233245+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:44:00.926655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"133'249","reported_seq":743,"reported_epoch":143,"state":"active+clean","last_fresh":"2023-10-08T16:28:24.266331+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T16:28:24.266331+0000","last_peered":"2023-10-08T16:28:24.266331+0000","last_clean":"2023-10-08T16:28:24.266331+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T16:28:24.266331+0000","last_undegraded":"2023-10-08T16:28:24.266331+0000","last_fullsized":"2023-10-08T16:28:24.266331+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307812,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064028,"statfs":{"total":96636764160,"available":96321564672,"internally_reserved":0,"allocated":2387968,"data_stored":1471399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.66600000000000004,"15min":0.70599999999999996},"min":{"1min":0.41499999999999998,"5min":0.39500000000000002,"15min":0.38300000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.103},"last":1.077},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.68400000000000005,"15min":0.70599999999999996},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.93400000000000005,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.74399999999999999,"15min":0.77200000000000002},"min":{"1min":0.47599999999999998,"5min":0.47299999999999998,"15min":0.42599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.0469999999999999},"last":1.159},{"interface":"front","average":{"1min":0.747,"5min":0.76500000000000001,"15min":0.77500000000000002},"min":{"1min":0.58199999999999996,"5min":0.54300000000000004,"15min":0.42199999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.123}]},{"osd":2,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71099999999999997,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.88400000000000001}]},{"osd":3,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.73699999999999999},"min":{"1min":0.55200000000000005,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.048,"5min":1.131,"15min":1.131},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.48199999999999998},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.63500000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38700000000000001},"max":{"1min":1.0009999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70399999999999996,"15min":0.66900000000000004},"min":{"1min":0.44600000000000001,"5min":0.439,"15min":0.437},"max":{"1min":1.1100000000000001,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71999999999999997,"15min":0.69699999999999995},"min":{"1min":0.496,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.97499999999999998,"5min":1.351,"15min":1.351},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:27:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.47099999999999997},"max":{"1min":1.02,"5min":1.173,"15min":1.173},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77600000000000002,"15min":0.749},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.48099999999999998},"max":{"1min":1.0009999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.83999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575072,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307216,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064624,"statfs":{"total":96636764160,"available":96322174976,"internally_reserved":0,"allocated":1777664,"data_stored":873805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67000000000000004,"15min":0.69699999999999995},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.35299999999999998},"max":{"1min":0.92600000000000005,"5min":0.93600000000000005,"15min":0.995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68500000000000005,"15min":0.71199999999999997},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.40100000000000002},"max":{"1min":0.97199999999999998,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80600000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.66800000000000004,"15min":0.69499999999999995},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.38},"max":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":1.0369999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.71199999999999997,"15min":0.73099999999999998},"min":{"1min":0.497,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91100000000000003,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.876}]},{"osd":2,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73399999999999999,"15min":0.76700000000000002},"min":{"1min":0.58399999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90500000000000003,"5min":0.998,"15min":1.081},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73699999999999999,"15min":0.76500000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.90300000000000002,"5min":0.94299999999999995,"15min":1.0800000000000001},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73299999999999998,"15min":0.753},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.44900000000000001},"max":{"1min":0.94199999999999995,"5min":0.96799999999999997,"15min":1.0149999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74399999999999999,"15min":0.76400000000000001},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":0.96099999999999997,"5min":1.034,"15min":1.0740000000000001},"last":0.73099999999999998}]},{"osd":4,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65400000000000003,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.94699999999999995,"5min":1.073,"15min":1.073},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.747,"15min":0.747},"min":{"1min":0.46999999999999997,"5min":0.42199999999999999,"15min":0.38700000000000001},"max":{"1min":0.95899999999999996,"5min":0.96799999999999997,"15min":1.1879999999999999},"last":0.621}]},{"osd":5,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41499999999999998},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.272},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.443,"5min":0.443,"15min":0.42999999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.70299999999999996}]},{"osd":7,"last update":"Sun Oct 8 16:27:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.73199999999999998,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.49299999999999999,"15min":0.42399999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.2250000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.73099999999999998},"min":{"1min":0.48999999999999999,"5min":0.48799999999999999,"15min":0.44800000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.3089999999999999},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575071,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303136,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068704,"statfs":{"total":96636764160,"available":96326352896,"internally_reserved":0,"allocated":1794048,"data_stored":880567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.45000000000000001},"min":{"1min":0.30599999999999999,"5min":0.29699999999999999,"15min":0.27100000000000002},"max":{"1min":0.621,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.35299999999999998,"5min":0.33400000000000002,"15min":0.29199999999999998},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.96599999999999997},"last":0.374}]},{"osd":2,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.48399999999999999,"15min":0.48699999999999999},"min":{"1min":0.34000000000000002,"5min":0.29499999999999998,"15min":0.27200000000000002},"max":{"1min":0.57399999999999995,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.57799999999999996},"min":{"1min":0.45800000000000002,"5min":0.41399999999999998,"15min":0.38700000000000001},"max":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.91200000000000003},"last":0.62}]},{"osd":3,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.61699999999999999,"15min":0.63500000000000001},"min":{"1min":0.502,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.72399999999999998,"5min":0.86599999999999999,"15min":0.95899999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56899999999999995,"15min":0.57999999999999996},"min":{"1min":0.434,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.75800000000000001,"5min":0.84299999999999997,"15min":0.95199999999999996},"last":0.504}]},{"osd":4,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.79900000000000004,"15min":0.78800000000000003},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.51300000000000001},"max":{"1min":1.048,"5min":1.879,"15min":1.879},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.77500000000000002,"15min":0.79100000000000004},"min":{"1min":0.54600000000000004,"5min":0.48999999999999999,"15min":0.46300000000000002},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.94399999999999995}]},{"osd":5,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80800000000000005,"15min":0.79300000000000004},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.50600000000000001},"max":{"1min":1.4390000000000001,"5min":2.379,"15min":2.379},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.77300000000000002,"15min":0.80100000000000005},"min":{"1min":0.57299999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.224},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78600000000000003,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.53200000000000003,"15min":0.52300000000000002},"max":{"1min":0.995,"5min":1.0129999999999999,"15min":1.206},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.59799999999999998,"5min":0.54800000000000004,"15min":0.53200000000000003},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.89200000000000002}]},{"osd":7,"last update":"Sun Oct 8 16:27:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.79900000000000004,"15min":0.82199999999999995},"min":{"1min":0.64600000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0169999999999999,"5min":1.0780000000000001,"15min":1.1839999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.0860000000000001,"5min":2.5870000000000002,"15min":2.5870000000000002},"last":0.90700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575071,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303728,"kb_used_data":2344,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068112,"statfs":{"total":96636764160,"available":96325746688,"internally_reserved":0,"allocated":2400256,"data_stored":1472459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47599999999999998,"15min":0.49299999999999999},"min":{"1min":0.32700000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.55200000000000005,"5min":0.89400000000000002,"15min":1.1339999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53400000000000003,"15min":0.55600000000000005},"min":{"1min":0.42799999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.64400000000000002,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.32700000000000001},"max":{"1min":0.66900000000000004,"5min":0.94799999999999995,"15min":1.093},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.32400000000000001},"max":{"1min":0.69199999999999995,"5min":1.022,"15min":1.022},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.503,"15min":0.52300000000000002},"min":{"1min":0.35899999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66100000000000003,"5min":0.78300000000000003,"15min":0.878},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60399999999999998,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.45300000000000001,"15min":0.45200000000000001},"max":{"1min":0.73499999999999999,"5min":0.98799999999999999,"15min":1.21},"last":0.63400000000000001}]},{"osd":4,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.753,"15min":0.76400000000000001},"min":{"1min":0.58599999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98799999999999999,"5min":1.0269999999999999,"15min":1.1579999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.75600000000000001,"15min":0.78800000000000003},"min":{"1min":0.55300000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.99199999999999999,"5min":1.0589999999999999,"15min":1.1899999999999999},"last":1.0700000000000001}]},{"osd":5,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.79300000000000004},"min":{"1min":0.59999999999999998,"5min":0.52600000000000002,"15min":0.47899999999999998},"max":{"1min":0.97299999999999998,"5min":1.083,"15min":1.1439999999999999},"last":1.014},{"interface":"front","average":{"1min":0.755,"5min":0.76300000000000001,"15min":0.79600000000000004},"min":{"1min":0.51400000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.2330000000000001},"last":0.997}]},{"osd":6,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0409999999999999,"5min":1.149,"15min":1.1950000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79900000000000004,"15min":0.81399999999999995},"min":{"1min":0.57899999999999996,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0249999999999999,"5min":1.196,"15min":1.212},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Oct 8 16:27:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.79600000000000004,"15min":0.81999999999999995},"min":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.55000000000000004},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1579999999999999},"last":0.879},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80400000000000005,"15min":0.81699999999999995},"min":{"1min":0.53800000000000003,"5min":0.53500000000000003,"15min":0.52400000000000002},"max":{"1min":0.94099999999999995,"5min":1.163,"15min":1.202},"last":1.048}]}]},{"osd":2,"up_from":13,"seq":55834575072,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311308,"kb_used_data":1732,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060532,"statfs":{"total":96636764160,"available":96317984768,"internally_reserved":0,"allocated":1773568,"data_stored":873735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.48299999999999998},"min":{"1min":0.36599999999999999,"5min":0.29199999999999998,"15min":0.25900000000000001},"max":{"1min":0.59399999999999997,"5min":0.96599999999999997,"15min":1.046},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53700000000000003,"15min":0.56100000000000005},"min":{"1min":0.437,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76300000000000001,"5min":1.01,"15min":1.01},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.38600000000000001,"5min":0.33300000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.75800000000000001,"15min":1.1519999999999999},"last":0.499},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.50700000000000001,"15min":0.52000000000000002},"min":{"1min":0.378,"5min":0.35999999999999999,"15min":0.32200000000000001},"max":{"1min":0.69099999999999995,"5min":0.88900000000000001,"15min":0.94399999999999995},"last":0.47899999999999998}]},{"osd":3,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51900000000000002,"15min":0.53000000000000003},"min":{"1min":0.35099999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.99299999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.60899999999999999,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.443,"15min":0.42699999999999999},"max":{"1min":0.78800000000000003,"5min":0.80100000000000005,"15min":1.1160000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72699999999999998,"15min":0.77300000000000002},"min":{"1min":0.53000000000000003,"5min":0.52500000000000002,"15min":0.434},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.4790000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73399999999999999,"15min":0.76800000000000002},"min":{"1min":0.503,"5min":0.495,"15min":0.495},"max":{"1min":0.93700000000000006,"5min":1.056,"15min":1.2909999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.78300000000000003,"15min":0.82799999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0269999999999999,"5min":1.03,"15min":1.4990000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.80900000000000005},"min":{"1min":0.59299999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.024,"5min":1.103,"15min":1.3},"last":0.71399999999999997}]},{"osd":6,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73499999999999999,"15min":0.77600000000000002},"min":{"1min":0.54400000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.321},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76500000000000001,"15min":0.81100000000000005},"min":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.48099999999999998},"max":{"1min":0.96299999999999997,"5min":1.163,"15min":1.5149999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Sun Oct 8 16:27:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79700000000000004,"15min":0.83699999999999997},"min":{"1min":0.57899999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.0920000000000001,"5min":1.1240000000000001,"15min":1.4410000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.80000000000000004,"15min":0.84699999999999998},"min":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":1.177,"15min":1.286},"last":0.82999999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575072,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307228,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064612,"statfs":{"total":96636764160,"available":96322162688,"internally_reserved":0,"allocated":1789952,"data_stored":875341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45100000000000001,"15min":0.46000000000000002},"min":{"1min":0.34499999999999997,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.83899999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.52200000000000002},"min":{"1min":0.36099999999999999,"5min":0.312,"15min":0.27100000000000002},"max":{"1min":0.68899999999999995,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.47899999999999998},"min":{"1min":0.34100000000000003,"5min":0.315,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53500000000000003,"15min":0.54800000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.90500000000000003},"last":0.38900000000000001}]},{"osd":2,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.57299999999999995,"15min":0.60699999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.95699999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.65400000000000003},"min":{"1min":0.52400000000000002,"5min":0.435,"15min":0.42699999999999999},"max":{"1min":0.89200000000000002,"5min":0.90100000000000002,"15min":1},"last":0.48699999999999999}]},{"osd":4,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.499,"5min":0.46600000000000003,"15min":0.39200000000000002},"max":{"1min":0.89000000000000001,"5min":1.2410000000000001,"15min":1.2789999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.73599999999999999,"15min":0.76600000000000001},"min":{"1min":0.55100000000000005,"5min":0.51100000000000001,"15min":0.42799999999999999},"max":{"1min":1.103,"5min":1.103,"15min":1.3600000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75700000000000001,"15min":0.78100000000000003},"min":{"1min":0.56299999999999994,"5min":0.495,"15min":0.495},"max":{"1min":1.032,"5min":1.0329999999999999,"15min":1.2110000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76100000000000001,"15min":0.78100000000000003},"min":{"1min":0.55700000000000005,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.0109999999999999,"5min":1.214,"15min":1.3200000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.54200000000000004,"5min":0.48399999999999999,"15min":0.45500000000000002},"max":{"1min":1.224,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.82199999999999995,"15min":0.83899999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.51200000000000001},"max":{"1min":1.1899999999999999,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":0.65600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:27:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.81799999999999995,"15min":0.84599999999999997},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.0840000000000001,"5min":1.204,"15min":1.23},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.81799999999999995,"15min":0.83699999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.139,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575072,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299032,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072808,"statfs":{"total":96636764160,"available":96330555392,"internally_reserved":0,"allocated":1785856,"data_stored":880443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67900000000000005,"15min":0.70499999999999996},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88900000000000001,"5min":1.0069999999999999,"15min":1.5169999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.747,"15min":0.72499999999999998},"min":{"1min":0.57499999999999996,"5min":0.47099999999999997,"15min":0.34200000000000003},"max":{"1min":0.88400000000000001,"5min":1.02,"15min":1.02},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.74399999999999999,"15min":0.73999999999999999},"min":{"1min":0.496,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.95999999999999996,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71499999999999997,"15min":0.72899999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.379},"max":{"1min":1.04,"5min":1.0640000000000001,"15min":1.3959999999999999},"last":0.69999999999999996}]},{"osd":2,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.73599999999999999,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.45800000000000002,"15min":0.42099999999999999},"max":{"1min":0.88400000000000001,"5min":1.109,"15min":1.5669999999999999},"last":0.751},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.753,"15min":0.752},"min":{"1min":0.59399999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1,"5min":1.085,"15min":1.1060000000000001},"last":0.71899999999999997}]},{"osd":3,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81599999999999995,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":1.127,"5min":1.127,"15min":1.1339999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.73099999999999998,"15min":0.74099999999999999},"min":{"1min":0.58299999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.95999999999999996,"5min":1.0980000000000001,"15min":3.4169999999999998},"last":0.58499999999999996}]},{"osd":5,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.63200000000000001},"min":{"1min":0.44600000000000001,"5min":0.41399999999999998,"15min":0.34599999999999997},"max":{"1min":0.93100000000000005,"5min":1.022,"15min":1.47},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.753,"5min":0.71999999999999997,"15min":0.68500000000000005},"min":{"1min":0.52100000000000002,"5min":0.5,"15min":0.39300000000000002},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.46200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97799999999999998,"5min":1.0409999999999999,"15min":2.661},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75,"15min":0.72999999999999998},"min":{"1min":0.501,"5min":0.501,"15min":0.46999999999999997},"max":{"1min":0.99199999999999999,"5min":1.0860000000000001,"15min":1.611},"last":0.78600000000000003}]},{"osd":7,"last update":"Sun Oct 8 16:27:41 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.76900000000000002},"min":{"1min":0.61099999999999999,"5min":0.505,"15min":0.47999999999999998},"max":{"1min":1.173,"5min":1.173,"15min":2.0720000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76200000000000001,"15min":0.73799999999999999},"min":{"1min":0.52300000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96399999999999997,"5min":1.137,"15min":2.6120000000000001},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575071,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311328,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060512,"statfs":{"total":96636764160,"available":96317964288,"internally_reserved":0,"allocated":1794048,"data_stored":881019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.71699999999999997},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.91700000000000004,"5min":0.96099999999999997,"15min":5.3250000000000002},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.72699999999999998,"15min":0.73499999999999999},"min":{"1min":0.53600000000000003,"5min":0.33500000000000002,"15min":0.308},"max":{"1min":0.98799999999999999,"5min":1.087,"15min":1.9219999999999999},"last":0.77400000000000002}]},{"osd":1,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73299999999999998,"15min":0.753},"min":{"1min":0.53000000000000003,"5min":0.38,"15min":0.38},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":2.1120000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.505,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.93799999999999994,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70899999999999996,"15min":0.73599999999999999},"min":{"1min":0.52400000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.94799999999999995,"5min":1.02,"15min":1.0389999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69399999999999995,"15min":0.73399999999999999},"min":{"1min":0.438,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.91800000000000004,"5min":0.98699999999999999,"15min":4.931},"last":0.82399999999999995}]},{"osd":3,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.71899999999999997,"15min":0.73999999999999999},"min":{"1min":0.48699999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90300000000000002,"5min":1.123,"15min":2.0600000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.77100000000000002},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.442},"max":{"1min":1.008,"5min":1.101,"15min":1.96},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.39500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.0529999999999999,"15min":8.3770000000000007},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.68500000000000005,"15min":0.67500000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40400000000000003},"max":{"1min":0.90700000000000003,"5min":1.0489999999999999,"15min":2.1989999999999998},"last":0.69399999999999995}]},{"osd":6,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.69499999999999995,"15min":0.68700000000000006},"min":{"1min":0.46899999999999997,"5min":0.41999999999999998,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":2.024},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.498,"5min":0.441,"15min":0.41899999999999998},"max":{"1min":0.84499999999999997,"5min":1.0289999999999999,"15min":7.1639999999999997},"last":0.755}]},{"osd":7,"last update":"Sun Oct 8 16:27:35 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.75900000000000001,"15min":0.747},"min":{"1min":0.497,"5min":0.47399999999999998,"15min":0.436},"max":{"1min":1.0900000000000001,"5min":1.105,"15min":2.157},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.50700000000000001,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.071,"15min":2.1299999999999999},"last":0.84499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T16:28:29.077 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T16:28:29.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T16:28:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.304+0000 7fc5a0d9d700 1 Processor -- start 2023-10-08T16:28:29.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.305+0000 7fc5a0d9d700 1 -- start start 2023-10-08T16:28:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc5a0d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 0x7fc59c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc5a0d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 0x7fc59c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc5a0d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c15ae70 con 0x7fc59c06aaa0 2023-10-08T16:28:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc5a0d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c06af60 con 0x7fc59c13fef0 2023-10-08T16:28:29.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc5a0d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c06b240 con 0x7fc59c13fb20 2023-10-08T16:28:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.306+0000 7fc59b7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 0x7fc59c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59bfff700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc59c06aaa0 0x7fc59c0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48614/0 (socket says 172.21.15.12:48614) 2023-10-08T16:28:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59bfff700 1 -- 172.21.15.12:0/394768949 learned_addr learned my addr 172.21.15.12:0/394768949 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59affd700 1 --2- 172.21.15.12:0/394768949 >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 0x7fc59c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59a7fc700 1 -- 172.21.15.12:0/394768949 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872884870 0 0) 0x7fc594001490 con 0x7fc59c06aaa0 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59a7fc700 1 -- 172.21.15.12:0/394768949 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc584003570 con 0x7fc59c06aaa0 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59b7fe700 1 -- 172.21.15.12:0/394768949 >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 msgr2=0x7fc59c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/394768949 >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 0x7fc59c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59b7fe700 1 -- 172.21.15.12:0/394768949 >> v1:172.21.15.29:6789/0 conn(0x7fc59c06aaa0 legacy=0x7fc59c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59b7fe700 1 -- 172.21.15.12:0/394768949 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c06b520 con 0x7fc59c13fb20 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59affd700 1 --2- 172.21.15.12:0/394768949 >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 0x7fc59c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.307+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/394768949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 0x7fc59c15a930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0098e0 tx=0x7fc58c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1f138a6bfbb4d86 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc59a7fc700 1 -- 172.21.15.12:0/394768949 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011630 con 0x7fc59c13fb20 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc59a7fc700 1 -- 172.21.15.12:0/394768949 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58c011790 con 0x7fc59c13fb20 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc59a7fc700 1 -- 172.21.15.12:0/394768949 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58c011b30 con 0x7fc59c13fb20 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/394768949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 msgr2=0x7fc59c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/394768949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 0x7fc59c15a930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0098e0 tx=0x7fc58c0091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/394768949 shutdown_connections 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/394768949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c13fb20 0x7fc59c15a930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/394768949 >> v2:172.21.15.29:3300/0 conn(0x7fc59c13fef0 0x7fc59c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/394768949 >> 172.21.15.12:0/394768949 conn(0x7fc59c06d170 msgr2=0x7fc59c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/394768949 shutdown_connections 2023-10-08T16:28:29.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.308+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/394768949 wait complete. 2023-10-08T16:28:29.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.310+0000 7fc5a0d9d700 1 Processor -- start 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.310+0000 7fc5a0d9d700 1 -- start start 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c06aaa0 0x7fc59c153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc59c13fb20 0x7fc59c0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1541f0 con 0x7fc59c13fef0 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c158ae0 con 0x7fc59c13fb20 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc5a0d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c157c70 con 0x7fc59c06aaa0 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc59bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55120/0 (socket says 172.21.15.12:55120) 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc59bfff700 1 -- 172.21.15.12:0/742355939 learned_addr learned my addr 172.21.15.12:0/742355939 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:29.312 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c06aaa0 0x7fc59c153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.311+0000 7fc59affd700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc59c13fb20 0x7fc59c0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 -- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c06aaa0 msgr2=0x7fc59c153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c06aaa0 0x7fc59c153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 -- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc59c13fb20 msgr2=0x7fc59c0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc59c13fb20 0x7fc59c0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 -- 172.21.15.12:0/742355939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5900093c0 con 0x7fc59c13fef0 2023-10-08T16:28:29.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc59bfff700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc59400cc70 tx=0x7fc594001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400a850 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc59400a9b0 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc59400ad30 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c009420 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.312+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c1581b0 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.313+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c158c70 con 0x7fc59c13fef0 2023-10-08T16:28:29.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.314+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc594007300 con 0x7fc59c13fef0 2023-10-08T16:28:29.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.315+0000 7fc5837fe700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.315+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fc594084930 con 0x7fc59c13fef0 2023-10-08T16:28:29.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.315+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.316+0000 7fc59b7fe700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0091e0 tx=0x7fc58c017000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.319+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc594051950 con 0x7fc59c13fef0 2023-10-08T16:28:29.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.602+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc59c15ae70 con 0x7fc59c13fef0 2023-10-08T16:28:29.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.607+0000 7fc5837fe700 1 -- 172.21.15.12:0/742355939 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc59c15ae70 con 0x7fc59c13fef0 2023-10-08T16:28:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 msgr2=0x7fc5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 0x7fc5880693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0091e0 tx=0x7fc58c017000 comp rx=0 tx=0).stop 2023-10-08T16:28:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 msgr2=0x7fc59c0ad3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fc59400cc70 tx=0x7fc594001ab0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 shutdown_connections 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc588066f30 0x7fc5880693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc59c13fef0 0x7fc59c0ad3b0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc59c06aaa0 0x7fc59c153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 --2- 172.21.15.12:0/742355939 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc59c13fb20 0x7fc59c0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 >> 172.21.15.12:0/742355939 conn(0x7fc59c06d170 msgr2=0x7fc59c155b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 shutdown_connections 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.609+0000 7fc5a0d9d700 1 -- 172.21.15.12:0/742355939 wait complete. 2023-10-08T16:28:29.610 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T16:28:29.626 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T16:28:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.813+0000 7fbf5759e700 1 Processor -- start 2023-10-08T16:28:29.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.813+0000 7fbf5759e700 1 -- start start 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf58140e40 0x7fbf580c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5806de50 0x7fbf580aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf580c6d50 con 0x7fbf58140a70 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf580c7030 con 0x7fbf58140e40 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580c7310 con 0x7fbf5806de50 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf55d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf58140e40 0x7fbf580c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf58140a70 0x7fbf580c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33520/0 (socket says 172.21.15.12:33520) 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5659c700 1 -- 172.21.15.12:0/3292185744 learned_addr learned my addr 172.21.15.12:0/3292185744 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:29.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf56d9d700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5806de50 0x7fbf580aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf55d9b700 1 -- 172.21.15.12:0/3292185744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5806de50 msgr2=0x7fbf580aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf55d9b700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5806de50 0x7fbf580aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf55d9b700 1 -- 172.21.15.12:0/3292185744 >> v1:172.21.15.12:6789/0 conn(0x7fbf58140a70 legacy=0x7fbf580c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf55d9b700 1 -- 172.21.15.12:0/3292185744 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf580c75f0 con 0x7fbf58140e40 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.815+0000 7fbf5559a700 1 -- 172.21.15.12:0/3292185744 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162884180 0 0) 0x7fbf580c6d50 con 0x7fbf58140a70 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf55d9b700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf580c6770 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098d0 tx=0x7fbf4c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9992c04c7d0b823 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf5559a700 1 -- 172.21.15.12:0/3292185744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c009e70 con 0x7fbf58140e40 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf5559a700 1 -- 172.21.15.12:0/3292185744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c005c10 con 0x7fbf58140e40 2023-10-08T16:28:29.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf5559a700 1 -- 172.21.15.12:0/3292185744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00b650 con 0x7fbf58140e40 2023-10-08T16:28:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf5759e700 1 -- 172.21.15.12:0/3292185744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 msgr2=0x7fbf580c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.816+0000 7fbf5759e700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf580c6770 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c0098d0 tx=0x7fbf4c009120 comp rx=0 tx=0).stop 2023-10-08T16:28:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 -- 172.21.15.12:0/3292185744 shutdown_connections 2023-10-08T16:28:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5806de50 0x7fbf580aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 --2- 172.21.15.12:0/3292185744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf580c6770 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 -- 172.21.15.12:0/3292185744 >> 172.21.15.12:0/3292185744 conn(0x7fbf5806d170 msgr2=0x7fbf580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 -- 172.21.15.12:0/3292185744 shutdown_connections 2023-10-08T16:28:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.817+0000 7fbf5759e700 1 -- 172.21.15.12:0/3292185744 wait complete. 2023-10-08T16:28:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.818+0000 7fbf5759e700 1 Processor -- start 2023-10-08T16:28:29.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.818+0000 7fbf5759e700 1 -- start start 2023-10-08T16:28:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806de50 0x7fbf58156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf58140a70 0x7fbf5816be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf58157340 con 0x7fbf58140e40 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580aeed0 con 0x7fbf5806de50 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf5759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580af1b0 con 0x7fbf58140a70 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.819+0000 7fbf56d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55134/0 (socket says 172.21.15.12:55134) 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 -- 172.21.15.12:0/1570519266 learned_addr learned my addr 172.21.15.12:0/1570519266 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf55d9b700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf58140a70 0x7fbf5816be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf5659c700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806de50 0x7fbf58156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 -- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf58140a70 msgr2=0x7fbf5816be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf58140a70 0x7fbf5816be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 -- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806de50 msgr2=0x7fbf58156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:29.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806de50 0x7fbf58156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 -- 172.21.15.12:0/1570519266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0093c0 con 0x7fbf58140e40 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf56d9d700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009fd0 tx=0x7fbf50009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000ed50 con 0x7fbf58140e40 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000eeb0 con 0x7fbf58140e40 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.820+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5816b3d0 con 0x7fbf58140e40 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.821+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50014650 con 0x7fbf58140e40 2023-10-08T16:28:29.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.821+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5816b990 con 0x7fbf58140e40 2023-10-08T16:28:29.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.822+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf580648e0 con 0x7fbf58140e40 2023-10-08T16:28:29.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.822+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf50014a00 con 0x7fbf58140e40 2023-10-08T16:28:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.824+0000 7fbf467fc700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.824+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf50084ed0 con 0x7fbf58140e40 2023-10-08T16:28:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.824+0000 7fbf5659c700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:29.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.824+0000 7fbf5659c700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf480011e0 tx=0x7fbf48009040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:29.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:29.827+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf580648e0 con 0x7fbf58140e40 2023-10-08T16:28:30.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.072+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf5804c3c0 con 0x7fbf58140e40 2023-10-08T16:28:30.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.073+0000 7fbf467fc700 1 -- 172.21.15.12:0/1570519266 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fbf50055990 con 0x7fbf58140e40 2023-10-08T16:28:30.073 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:30.073 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T16:28:30.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.075+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 msgr2=0x7fbf380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.075+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 0x7fbf380693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbf480011e0 tx=0x7fbf48009040 comp rx=0 tx=0).stop 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.075+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 msgr2=0x7fbf5816a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.075+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fbf50009fd0 tx=0x7fbf50009900 comp rx=0 tx=0).stop 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 shutdown_connections 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf38066f30 0x7fbf380693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf58140e40 0x7fbf5816a980 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806de50 0x7fbf58156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 --2- 172.21.15.12:0/1570519266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf58140a70 0x7fbf5816be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 >> 172.21.15.12:0/1570519266 conn(0x7fbf5806d170 msgr2=0x7fbf5806e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 shutdown_connections 2023-10-08T16:28:30.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.076+0000 7fbf5759e700 1 -- 172.21.15.12:0/1570519266 wait complete. 2023-10-08T16:28:30.077 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T16:28:30.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T16:28:23.751690+0000', 'modified': '2023-10-08T16:28:27.272984+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8253}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8253': {'gid': 8253, 'name': 'c', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6834/3424855851', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 3424855851}, {'type': 'v1', 'addr': '172.21.15.12:6834', 'nonce': 3424855851}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T16:28:30.497 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T16:28:30.497 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T16:28:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.688+0000 7fbf57fff700 1 Processor -- start 2023-10-08T16:28:30.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.688+0000 7fbf57fff700 1 -- start start 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf57fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf5813fef0 0x7fbf5815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf57fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf5806aaa0 0x7fbf580c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf57fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5815ae70 con 0x7fbf5813fb20 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf57fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5806af60 con 0x7fbf5813fef0 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf57fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5806b240 con 0x7fbf5806aaa0 2023-10-08T16:28:30.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf56ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf5813fb20 0x7fbf580c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33526/0 (socket says 172.21.15.12:33526) 2023-10-08T16:28:30.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf56ffd700 1 -- 172.21.15.12:0/3468074903 learned_addr learned my addr 172.21.15.12:0/3468074903 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:30.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.689+0000 7fbf567fc700 1 --2- 172.21.15.12:0/3468074903 >> v2:172.21.15.12:3300/0 conn(0x7fbf5813fef0 0x7fbf5815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf577fe700 1 --2- 172.21.15.12:0/3468074903 >> v2:172.21.15.29:3300/0 conn(0x7fbf5806aaa0 0x7fbf580c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf55ffb700 1 -- 172.21.15.12:0/3468074903 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036584962 0 0) 0x7fbf48001110 con 0x7fbf5813fb20 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf55ffb700 1 -- 172.21.15.12:0/3468074903 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf40003570 con 0x7fbf5813fb20 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf567fc700 1 -- 172.21.15.12:0/3468074903 >> v2:172.21.15.29:3300/0 conn(0x7fbf5806aaa0 msgr2=0x7fbf580c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf567fc700 1 --2- 172.21.15.12:0/3468074903 >> v2:172.21.15.29:3300/0 conn(0x7fbf5806aaa0 0x7fbf580c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf567fc700 1 -- 172.21.15.12:0/3468074903 >> v1:172.21.15.12:6789/0 conn(0x7fbf5813fb20 legacy=0x7fbf580c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf567fc700 1 -- 172.21.15.12:0/3468074903 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5806b520 con 0x7fbf5813fef0 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf567fc700 1 --2- 172.21.15.12:0/3468074903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf5815a930 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbf58069d40 tx=0x7fbf4c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f106c0822131d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf55ffb700 1 -- 172.21.15.12:0/3468074903 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c005c10 con 0x7fbf5813fef0 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf55ffb700 1 -- 172.21.15.12:0/3468074903 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c005d70 con 0x7fbf5813fef0 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.690+0000 7fbf55ffb700 1 -- 172.21.15.12:0/3468074903 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c006260 con 0x7fbf5813fef0 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 -- 172.21.15.12:0/3468074903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 msgr2=0x7fbf5815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 --2- 172.21.15.12:0/3468074903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf5815a930 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbf58069d40 tx=0x7fbf4c009120 comp rx=0 tx=0).stop 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 -- 172.21.15.12:0/3468074903 shutdown_connections 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 --2- 172.21.15.12:0/3468074903 >> v2:172.21.15.29:3300/0 conn(0x7fbf5806aaa0 0x7fbf580c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 --2- 172.21.15.12:0/3468074903 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf5815a930 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 -- 172.21.15.12:0/3468074903 >> 172.21.15.12:0/3468074903 conn(0x7fbf5806d170 msgr2=0x7fbf580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 -- 172.21.15.12:0/3468074903 shutdown_connections 2023-10-08T16:28:30.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.691+0000 7fbf57fff700 1 -- 172.21.15.12:0/3468074903 wait complete. 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.693+0000 7fbf57fff700 1 Processor -- start 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.693+0000 7fbf57fff700 1 -- start start 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806aaa0 0x7fbf580adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 0x7fbf58154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580ad670 con 0x7fbf5813fef0 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580aca60 con 0x7fbf5806aaa0 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf57fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf580acd40 con 0x7fbf5813fb20 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55138/0 (socket says 172.21.15.12:55138) 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 -- 172.21.15.12:0/356836756 learned_addr learned my addr 172.21.15.12:0/356836756 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806aaa0 0x7fbf580adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf567fc700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 0x7fbf58154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 -- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 msgr2=0x7fbf58154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 0x7fbf58154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 -- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806aaa0 msgr2=0x7fbf580adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806aaa0 0x7fbf580adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf577fe700 1 -- 172.21.15.12:0/356836756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c0093c0 con 0x7fbf5813fef0 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.694+0000 7fbf567fc700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 0x7fbf58154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf577fe700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbf50007f30 tx=0x7fbf500098e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf3effd700 1 -- 172.21.15.12:0/356836756 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5000ec40 con 0x7fbf5813fef0 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf3effd700 1 -- 172.21.15.12:0/356836756 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5000eda0 con 0x7fbf5813fef0 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf580ad020 con 0x7fbf5813fef0 2023-10-08T16:28:30.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf3effd700 1 -- 172.21.15.12:0/356836756 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50014670 con 0x7fbf5813fef0 2023-10-08T16:28:30.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.695+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580ae040 con 0x7fbf5813fef0 2023-10-08T16:28:30.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.697+0000 7fbf3effd700 1 -- 172.21.15.12:0/356836756 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf50014a20 con 0x7fbf5813fef0 2023-10-08T16:28:30.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.698+0000 7fbf3effd700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 0x7fbf440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.698+0000 7fbf3effd700 1 -- 172.21.15.12:0/356836756 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf50084ea0 con 0x7fbf5813fef0 2023-10-08T16:28:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.698+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 0x7fbf440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.699+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 0x7fbf440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001270 tx=0x7fbf48007bf0 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.700+0000 7fbf6bcf9b80 1 Processor -- start 2023-10-08T16:28:30.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.700+0000 7fbf6bcf9b80 1 -- start start 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a3b850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89f0b80 0x55cef89f0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8947a70 con 0x55cef8a3b480 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8945270 con 0x55cef89f0b80 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef8941060 con 0x55cef89ee5f0 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55154/0 (socket says 172.21.15.12:55154) 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 -- 172.21.15.12:0/3718230004 learned_addr learned my addr 172.21.15.12:0/3718230004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf577fe700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89f0b80 0x55cef89f0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf567fc700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a3b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 -- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 msgr2=0x55cef8a3b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a3b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 -- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89f0b80 msgr2=0x55cef89f0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89f0b80 0x55cef89f0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf56ffd700 1 -- 172.21.15.12:0/3718230004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cef87db270 con 0x55cef8a3b480 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.701+0000 7fbf567fc700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a3b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005ba0 tx=0x7fbf48014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a993081f41debf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf37fff700 1 -- 172.21.15.12:0/3718230004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf480064e0 con 0x55cef8a3b480 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf37fff700 1 -- 172.21.15.12:0/3718230004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf48006640 con 0x55cef8a3b480 2023-10-08T16:28:30.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf37fff700 1 -- 172.21.15.12:0/3718230004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48004830 con 0x55cef8a3b480 2023-10-08T16:28:30.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/3718230004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 msgr2=0x55cef8a1a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.702+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005ba0 tx=0x7fbf48014000 comp rx=0 tx=0).stop 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/3718230004 shutdown_connections 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1a7d0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89f0b80 0x55cef89f0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/3718230004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a3b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/3718230004 >> 172.21.15.12:0/3718230004 conn(0x55cef89f20c0 msgr2=0x55cef89f28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/3718230004 shutdown_connections 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.703+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/3718230004 wait complete. 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.704+0000 7fbf6bcf9b80 1 -- start start 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.704+0000 7fbf6bcf9b80 1 Processor -- start 2023-10-08T16:28:30.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef8a3b480 0x55cef8a38330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef88ec890 con 0x55cef89f0b80 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8907ea0 con 0x55cef8a3b480 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef87c3e30 con 0x55cef89ee5f0 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf6bcf9b80 10 client.0 _ll_register_callbacks cb 0x55cef89b42c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf567fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf567fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55160/0 (socket says 172.21.15.12:55160) 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf567fc700 1 -- 172.21.15.12:0/4033881454 learned_addr learned my addr 172.21.15.12:0/4033881454 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.705+0000 7fbf577fe700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef8a3b480 0x55cef8a38330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 -- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 msgr2=0x55cef8a37980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a37980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 -- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef8a3b480 msgr2=0x55cef8a38330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef8a3b480 0x55cef8a38330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 -- 172.21.15.12:0/4033881454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf40003570 con 0x55cef89f0b80 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf567fc700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c012000 tx=0x7fbf4c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d6c68fd9b16a9a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf357fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c023070 con 0x55cef89f0b80 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cef89e5cd0 con 0x55cef89f0b80 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf4c0068e0 con 0x55cef89f0b80 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.706+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf4c028e70 con 0x55cef89f0b80 2023-10-08T16:28:30.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 10 client.8391 fetch_fsmap learned FSMap version 65 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55cef877dfe0 con 0x55cef89f0b80 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cef89e5cd0 con 0x55cef89f0b80 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 65) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf4c005ee0 con 0x55cef89f0b80 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 10 client.8391 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 10 client.8391 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 20 client.8391 populate_metadata read hostname 'smithi012' 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1d1e0 0x55cef8a1d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 4 client.8391 mds_command: new command op to 8253 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 --> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cef89c2aa0 con 0x55cef8a1d1e0 2023-10-08T16:28:30.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.707+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1d1e0 0x55cef8a1d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.708+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1d1e0 0x55cef8a1d5b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b2ff5732678d47e server_cookie=a12759ce3857120a in_seq=0 out_seq=0 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.708+0000 7fbf357fa700 10 client.8391 ms_handle_connect on v2:172.21.15.12:6832/3424855851 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.708+0000 7fbf357fa700 1 -- 172.21.15.12:0/4033881454 <== mds.0 v2:172.21.15.12:6832/3424855851 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cef89c2aa0 con 0x55cef8a1d1e0 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf357fa700 10 client.8391 handle_command_reply: tid=0 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 client.8391 shutdown 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 msgr2=0x55cef8a14cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c012000 tx=0x7fbf4c016000 comp rx=0 tx=0).stop 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 shutdown_connections 2023-10-08T16:28:30.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1d1e0 0x55cef8a1d5b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef8a3b480 0x55cef8a38330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89ee5f0 0x55cef8a37980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf357fa700 0 client.8391 ms_handle_reset on v2:172.21.15.12:6832/3424855851 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/4033881454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef89f0b80 0x55cef8a14cf0 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 >> 172.21.15.12:0/4033881454 conn(0x55cef89f20c0 msgr2=0x55cef89f4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 shutdown_connections 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/4033881454 wait complete. 2023-10-08T16:28:30.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.709+0000 7fbf6bcf9b80 20 client.8391 trim_cache size 0 max 16384 2023-10-08T16:28:30.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 Processor -- start 2023-10-08T16:28:30.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 -- start start 2023-10-08T16:28:30.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a3ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a1af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.727+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8a39370 con 0x55cef8a3b480 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef89f4340 con 0x55cef89ee5f0 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef8a1c9e0 con 0x55cef89f0b80 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55166/0 (socket says 172.21.15.12:55166) 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 -- 172.21.15.12:0/1554386929 learned_addr learned my addr 172.21.15.12:0/1554386929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 -- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 msgr2=0x55cef8a1af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf567fc700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a1af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a3ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a1af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 -- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 msgr2=0x55cef8a3ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a3ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 -- 172.21.15.12:0/1554386929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cef890f780 con 0x55cef8a3b480 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf567fc700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a1af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a3ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf577fe700 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fbf500094d0 tx=0x7fbf50020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=767acbfe15e3b332 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.728+0000 7fbf3cff9700 1 -- 172.21.15.12:0/1554386929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50058de0 con 0x55cef8a3b480 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf3cff9700 1 -- 172.21.15.12:0/1554386929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5005cb30 con 0x55cef8a3b480 2023-10-08T16:28:30.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf3cff9700 1 -- 172.21.15.12:0/1554386929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50053f30 con 0x55cef8a3b480 2023-10-08T16:28:30.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/1554386929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 msgr2=0x55cef8a1b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fbf500094d0 tx=0x7fbf50020040 comp rx=0 tx=0).stop 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/1554386929 shutdown_connections 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a1b490 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a3ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/1554386929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a1af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/1554386929 >> 172.21.15.12:0/1554386929 conn(0x55cef89f20c0 msgr2=0x55cef8a1a240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/1554386929 shutdown_connections 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.729+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/1554386929 wait complete. 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.730+0000 7fbf6bcf9b80 1 -- start start 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.730+0000 7fbf6bcf9b80 1 Processor -- start 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a48a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8a35b50 con 0x55cef8a3b480 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cef8a35940 con 0x55cef89ee5f0 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cef8a9d8d0 con 0x55cef89f0b80 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf6bcf9b80 10 client.0 _ll_register_callbacks cb 0x55cef89b42c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf577fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55170/0 (socket says 172.21.15.12:55170) 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf577fe700 1 -- 172.21.15.12:0/77260609 learned_addr learned my addr 172.21.15.12:0/77260609 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.731+0000 7fbf567fc700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a48a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 -- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 msgr2=0x55cef8a48a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a48a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 -- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 msgr2=0x55cef8a484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 -- 172.21.15.12:0/77260609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf580ae040 con 0x55cef8a3b480 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf577fe700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fbf50056440 tx=0x7fbf50057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e36efdff8b6f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf357fa700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50053f30 con 0x55cef8a3b480 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7fbf50055080 con 0x55cef8a3b480 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbf580c11a0 con 0x55cef8a3b480 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf5005c6a0 con 0x55cef8a3b480 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf6bcf9b80 10 client.8397 fetch_fsmap learned FSMap version 65 2023-10-08T16:28:30.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.732+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x55cef88f6470 con 0x55cef8a3b480 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf580c11a0 con 0x55cef8a3b480 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 65) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbf50056ba0 con 0x55cef8a3b480 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 10 client.8397 fetch_fsmap finished waiting for FSMap version 65 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 10 client.8397 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 20 client.8397 populate_metadata read hostname 'smithi012' 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1fdb0 0x55cef8a20180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 4 client.8397 mds_command: new command op to 8253 tid=0[{"prefix": "status"}] 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 --> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fbf48006640 con 0x55cef8a1fdb0 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1fdb0 0x55cef8a20180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf56ffd700 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1fdb0 0x55cef8a20180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19ff1c480f376121 server_cookie=f996fe3969c0bb46 in_seq=0 out_seq=0 2023-10-08T16:28:30.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.733+0000 7fbf357fa700 10 client.8397 ms_handle_connect on v2:172.21.15.12:6832/3424855851 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf357fa700 1 -- 172.21.15.12:0/77260609 <== mds.0 v2:172.21.15.12:6832/3424855851 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7fbf48006640 con 0x55cef8a1fdb0 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf357fa700 10 client.8397 handle_command_reply: tid=0 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 client.8397 shutdown 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 msgr2=0x55cef8a48f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fbf50056440 tx=0x7fbf50057000 comp rx=0 tx=0).stop 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 shutdown_connections 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:6832/3424855851,v1:172.21.15.12:6834/3424855851] conn(0x55cef8a1fdb0 0x55cef8a20180 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55cef8a3b480 0x55cef8a48f70 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55cef89ee5f0 0x55cef8a484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 --2- 172.21.15.12:0/77260609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55cef89f0b80 0x55cef8a48a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf357fa700 0 client.8397 ms_handle_reset on v2:172.21.15.12:6832/3424855851 2023-10-08T16:28:30.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 >> 172.21.15.12:0/77260609 conn(0x55cef89f20c0 msgr2=0x55cef8a51180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 shutdown_connections 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 1 -- 172.21.15.12:0/77260609 wait complete. 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.734+0000 7fbf6bcf9b80 20 client.8397 trim_cache size 0 max 16384 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 8253, 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T16:28:30.740 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.4823025620000001, 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 65, 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 144, 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 144, 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.987158845 2023-10-08T16:28:30.741 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T16:28:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 msgr2=0x7fbf440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 0x7fbf440693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf48001270 tx=0x7fbf48007bf0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 msgr2=0x7fbf58158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbf50007f30 tx=0x7fbf500098e0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 shutdown_connections 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbf44066f30 0x7fbf440693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf5813fef0 0x7fbf58158af0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf5806aaa0 0x7fbf580adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 --2- 172.21.15.12:0/356836756 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf5813fb20 0x7fbf58154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 >> 172.21.15.12:0/356836756 conn(0x7fbf5806d170 msgr2=0x7fbf58155ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 shutdown_connections 2023-10-08T16:28:30.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.735+0000 7fbf57fff700 1 -- 172.21.15.12:0/356836756 wait complete. 2023-10-08T16:28:30.752 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T16:28:30.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.940+0000 7f3fa8f9d700 1 Processor -- start 2023-10-08T16:28:30.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.940+0000 7f3fa8f9d700 1 -- start start 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa4157410 0x7f3fa406a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa8f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3fa40703a0 0x7f3fa40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fa406a800 con 0x7f3fa41577e0 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa8f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fa406c6a0 con 0x7f3fa40703a0 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa406aa30 con 0x7f3fa4157410 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3fa41577e0 0x7f3fa406cb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33538/0 (socket says 172.21.15.12:33538) 2023-10-08T16:28:30.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa3fff700 1 -- 172.21.15.12:0/3885556960 learned_addr learned my addr 172.21.15.12:0/3885556960 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:30.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa37fe700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa4157410 0x7f3fa406a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/3885556960 >> v2:172.21.15.29:3300/0 conn(0x7f3fa40703a0 0x7f3fa40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.942+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082095628 0 0) 0x7f3fa406a800 con 0x7f3fa41577e0 2023-10-08T16:28:30.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f8c003570 con 0x7f3fa41577e0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa4157410 msgr2=0x7f3fa406a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa4157410 0x7f3fa406a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3852048543 0 0) 0x7f3f8c003570 con 0x7f3fa41577e0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/3885556960 >> v1:172.21.15.12:6789/0 conn(0x7f3fa41577e0 legacy=0x7f3fa406cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/3885556960 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa406ad10 con 0x7f3fa40703a0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.943+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40703a0 0x7f3fa40c93a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30e7284c6c72c96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c0017f0 con 0x7f3fa40703a0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f98011420 con 0x7f3fa40703a0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa27fc700 1 -- 172.21.15.12:0/3885556960 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f980117a0 con 0x7f3fa40703a0 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40703a0 msgr2=0x7f3fa40c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40703a0 0x7f3fa40c93a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3f980098e0 tx=0x7f3f980091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/3885556960 shutdown_connections 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa4157410 0x7f3fa406a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/3885556960 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa40703a0 0x7f3fa40c93a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/3885556960 >> 172.21.15.12:0/3885556960 conn(0x7f3fa406e720 msgr2=0x7f3fa406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/3885556960 shutdown_connections 2023-10-08T16:28:30.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.944+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/3885556960 wait complete. 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.946+0000 7f3fa8f9d700 1 Processor -- start 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.946+0000 7f3fa8f9d700 1 -- start start 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 0x7f3fa4150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa41577e0 0x7f3fa4158620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa4153d00 con 0x7f3fa4157410 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa41590e0 con 0x7f3fa41577e0 2023-10-08T16:28:30.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa41593c0 con 0x7f3fa40703a0 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55178/0 (socket says 172.21.15.12:55178) 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/2339639040 learned_addr learned my addr 172.21.15.12:0/2339639040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa37fe700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 0x7f3fa4150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa3fff700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa41577e0 0x7f3fa4158620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 msgr2=0x7f3fa4150540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 0x7f3fa4150540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa41577e0 msgr2=0x7f3fa4158620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa41577e0 0x7f3fa4158620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa2ffd700 1 -- 172.21.15.12:0/2339639040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009420 con 0x7f3fa4157410 2023-10-08T16:28:30.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.947+0000 7f3fa37fe700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 0x7f3fa4150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3fa2ffd700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4069ee0 tx=0x7f3f98016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9801cba0 con 0x7f3fa4157410 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9801cd00 con 0x7f3fa4157410 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa4153990 con 0x7f3fa4157410 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9801a680 con 0x7f3fa4157410 2023-10-08T16:28:30.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.948+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa4150fd0 con 0x7f3fa4157410 2023-10-08T16:28:30.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.949+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fa4153eb0 con 0x7f3fa4157410 2023-10-08T16:28:30.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.950+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f9801aa70 con 0x7f3fa4157410 2023-10-08T16:28:30.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.951+0000 7f3f8b7fe700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 0x7f3f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:30.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.951+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f3f980860d0 con 0x7f3fa4157410 2023-10-08T16:28:30.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.951+0000 7f3fa37fe700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 0x7f3f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:30.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.952+0000 7f3fa37fe700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 0x7f3f900693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009d80 tx=0x7f3f94008040 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:30.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:30.955+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fa4153eb0 con 0x7f3fa4157410 2023-10-08T16:28:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.204+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3fa404c3c0 con 0x7f3fa4157410 2023-10-08T16:28:31.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.204+0000 7f3f8b7fe700 1 -- 172.21.15.12:0/2339639040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3f98053100 con 0x7f3fa4157410 2023-10-08T16:28:31.204 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.206+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 msgr2=0x7f3f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.206+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 0x7f3f900693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009d80 tx=0x7f3f94008040 comp rx=0 tx=0).stop 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 msgr2=0x7f3fa4154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4069ee0 tx=0x7f3f98016000 comp rx=0 tx=0).stop 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 shutdown_connections 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f90066f30 0x7f3f900693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3fa41577e0 0x7f3fa4158620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3fa40703a0 0x7f3fa4150540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:31.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 --2- 172.21.15.12:0/2339639040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3fa4157410 0x7f3fa4154ee0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 >> 172.21.15.12:0/2339639040 conn(0x7f3fa406e720 msgr2=0x7f3fa40af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 shutdown_connections 2023-10-08T16:28:31.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:31.207+0000 7f3fa8f9d700 1 -- 172.21.15.12:0/2339639040 wait complete. 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T16:28:31.224 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T16:28:31.225 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T16:28:31.225 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:28:31.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.225 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T16:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T16:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T16:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T16:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.262 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 41030sec preferred_lft 41030sec 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.263 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.264 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T16:28:31.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.265 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T16:28:31.363 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T16:28:31.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.366 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T16:28:31.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T16:28:31.408 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T16:28:31.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.606 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T16:28:31.643 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T16:28:31.643 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T16:28:31.643 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:28:31.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:31.643 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T16:28:31.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:28:31.746 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T16:28:31.782 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T16:28:31.783 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T16:28:31.783 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:28:31.859 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T16:28:31.859 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T16:28:31.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:28:31.993 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:28:31.993 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:28:32.020 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T16:28:32.020 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T16:28:32.020 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T16:28:32.020 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T16:28:32.020 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T16:28:32.024 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T16:28:32.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T16:28:32.025 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T16:28:32.088 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T16:28:32.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.280+0000 7efca2b9d700 1 Processor -- start 2023-10-08T16:28:32.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.280+0000 7efca2b9d700 1 -- start start 2023-10-08T16:28:32.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 0x7efc9c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca2b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 0x7efc9c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca2b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc9c0c7420 con 0x7efc9c159a10 2023-10-08T16:28:32.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca2b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc9c06d5a0 con 0x7efc9c0caec0 2023-10-08T16:28:32.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c06d820 con 0x7efc9c159640 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca139a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efc9c159a10 0x7efc9c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44708/0 (socket says 172.21.15.12:44708) 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.281+0000 7efca139a700 1 -- 172.21.15.12:0/3376784755 learned_addr learned my addr 172.21.15.12:0/3376784755 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca1b9b700 1 --2- 172.21.15.12:0/3376784755 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 0x7efc9c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca239c700 1 --2- 172.21.15.12:0/3376784755 >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 0x7efc9c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca0b99700 1 -- 172.21.15.12:0/3376784755 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299845175 0 0) 0x7efc9c0c7420 con 0x7efc9c159a10 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca0b99700 1 -- 172.21.15.12:0/3376784755 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc88003570 con 0x7efc9c159a10 2023-10-08T16:28:32.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca1b9b700 1 -- 172.21.15.12:0/3376784755 >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 msgr2=0x7efc9c0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca1b9b700 1 --2- 172.21.15.12:0/3376784755 >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 0x7efc9c0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca1b9b700 1 -- 172.21.15.12:0/3376784755 >> v1:172.21.15.12:6789/0 conn(0x7efc9c159a10 legacy=0x7efc9c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca1b9b700 1 -- 172.21.15.12:0/3376784755 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c06db00 con 0x7efc9c159640 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.282+0000 7efca239c700 1 --2- 172.21.15.12:0/3376784755 >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 0x7efc9c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca1b9b700 1 --2- 172.21.15.12:0/3376784755 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 0x7efc9c06d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc980098e0 tx=0x7efc980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1782102c59dfcc21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca0b99700 1 -- 172.21.15.12:0/3376784755 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98011630 con 0x7efc9c159640 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca0b99700 1 -- 172.21.15.12:0/3376784755 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc98011790 con 0x7efc9c159640 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca0b99700 1 -- 172.21.15.12:0/3376784755 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc98011b30 con 0x7efc9c159640 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca2b9d700 1 -- 172.21.15.12:0/3376784755 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 msgr2=0x7efc9c06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.283+0000 7efca2b9d700 1 --2- 172.21.15.12:0/3376784755 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 0x7efc9c06d060 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7efc980098e0 tx=0x7efc980091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 -- 172.21.15.12:0/3376784755 shutdown_connections 2023-10-08T16:28:32.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 --2- 172.21.15.12:0/3376784755 >> v2:172.21.15.29:3300/0 conn(0x7efc9c0caec0 0x7efc9c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 --2- 172.21.15.12:0/3376784755 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159640 0x7efc9c06d060 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 -- 172.21.15.12:0/3376784755 >> 172.21.15.12:0/3376784755 conn(0x7efc9c06e720 msgr2=0x7efc9c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:32.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 -- 172.21.15.12:0/3376784755 shutdown_connections 2023-10-08T16:28:32.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.284+0000 7efca2b9d700 1 -- 172.21.15.12:0/3376784755 wait complete. 2023-10-08T16:28:32.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.285+0000 7efca2b9d700 1 Processor -- start 2023-10-08T16:28:32.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.285+0000 7efca2b9d700 1 -- start start 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0caec0 0x7efc9c14bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159a10 0x7efc9c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c4770 con 0x7efc9c159640 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c4a50 con 0x7efc9c0caec0 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.286+0000 7efca2b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c0c4d30 con 0x7efc9c159a10 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37492/0 (socket says 172.21.15.12:37492) 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 -- 172.21.15.12:0/1064752646 learned_addr learned my addr 172.21.15.12:0/1064752646 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca1b9b700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0caec0 0x7efc9c14bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca239c700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159a10 0x7efc9c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 -- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159a10 msgr2=0x7efc9c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159a10 0x7efc9c154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 -- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0caec0 msgr2=0x7efc9c14bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0caec0 0x7efc9c14bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.287+0000 7efca139a700 1 -- 172.21.15.12:0/1064752646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc94009a20 con 0x7efc9c159640 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efca139a700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c590 tx=0x7efc8c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c005cd0 con 0x7efc9c159640 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc8c005e50 con 0x7efc9c159640 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc98009420 con 0x7efc9c159640 2023-10-08T16:28:32.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc8c007320 con 0x7efc9c159640 2023-10-08T16:28:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.288+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c0c52f0 con 0x7efc9c159640 2023-10-08T16:28:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.289+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c04c3c0 con 0x7efc9c159640 2023-10-08T16:28:32.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.290+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc8c01b3b0 con 0x7efc9c159640 2023-10-08T16:28:32.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.291+0000 7efc91ffb700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 0x7efc800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.291+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7efc8c083da0 con 0x7efc9c159640 2023-10-08T16:28:32.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.291+0000 7efca1b9b700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 0x7efc800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.292+0000 7efca1b9b700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 0x7efc800693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc980091e0 tx=0x7efc98017000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.296+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc8c050e90 con 0x7efc9c159640 2023-10-08T16:28:32.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.526+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efc9c0c9340 con 0x7efc80066f30 2023-10-08T16:28:32.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.527+0000 7efc91ffb700 1 -- 172.21.15.12:0/1064752646 <== mgr.8073 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7efc9c0c9340 con 0x7efc80066f30 2023-10-08T16:28:32.527 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T16:28:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T16:28:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T16:28:32.527 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T16:28:32.528 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 msgr2=0x7efc800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 0x7efc800693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efc980091e0 tx=0x7efc98017000 comp rx=0 tx=0).stop 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 msgr2=0x7efc9c0b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7efc8c00c590 tx=0x7efc8c007e00 comp rx=0 tx=0).stop 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 shutdown_connections 2023-10-08T16:28:32.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efc80066f30 0x7efc800693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc9c159a10 0x7efc9c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc9c0caec0 0x7efc9c14bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 --2- 172.21.15.12:0/1064752646 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc9c159640 0x7efc9c0b11d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 >> 172.21.15.12:0/1064752646 conn(0x7efc9c06e720 msgr2=0x7efc9c157520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 shutdown_connections 2023-10-08T16:28:32.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.530+0000 7efca2b9d700 1 -- 172.21.15.12:0/1064752646 wait complete. 2023-10-08T16:28:32.547 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T16:28:32.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.735+0000 7f3d11f9d700 1 Processor -- start 2023-10-08T16:28:32.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.735+0000 7f3d11f9d700 1 -- start start 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.736+0000 7f3d11f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d0c142c00 0x7f3d0c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d11f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d0c06bd20 0x7f3d0c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d11f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d11f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0ca480 con 0x7f3d0c06bd20 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d11f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c15e240 con 0x7f3d0c142c00 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d11f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c06b350 con 0x7f3d0c142fd0 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d0c06bd20 0x7f3d0c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3d0c06bd20 0x7f3d0c0c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37504/0 (socket says 172.21.15.12:37504) 2023-10-08T16:28:32.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 -- 172.21.15.12:0/2398997078 learned_addr learned my addr 172.21.15.12:0/2398997078 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:32.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d10f9b700 1 --2- 172.21.15.12:0/2398997078 >> v2:172.21.15.29:3300/0 conn(0x7f3d0c142c00 0x7f3d0c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d1179c700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 -- 172.21.15.12:0/2398997078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 msgr2=0x7f3d0c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 -- 172.21.15.12:0/2398997078 >> v2:172.21.15.29:3300/0 conn(0x7f3d0c142c00 msgr2=0x7f3d0c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/2398997078 >> v2:172.21.15.29:3300/0 conn(0x7f3d0c142c00 0x7f3d0c06b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.737+0000 7f3d0bfff700 1 -- 172.21.15.12:0/2398997078 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c15df60 con 0x7f3d0c06bd20 2023-10-08T16:28:32.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.738+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c0c7880 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06f490 tx=0x7f3cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ead1ed614deeae server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.738+0000 7f3d0b7fe700 1 -- 172.21.15.12:0/2398997078 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800b640 con 0x7f3d0c06bd20 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.738+0000 7f3d0b7fe700 1 -- 172.21.15.12:0/2398997078 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf800b7a0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.738+0000 7f3d0b7fe700 1 -- 172.21.15.12:0/2398997078 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf800bb60 con 0x7f3d0c06bd20 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 -- 172.21.15.12:0/2398997078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 msgr2=0x7f3d0c0c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c0c7880 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06f490 tx=0x7f3cf8009250 comp rx=0 tx=0).stop 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 -- 172.21.15.12:0/2398997078 shutdown_connections 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/2398997078 >> v2:172.21.15.29:3300/0 conn(0x7f3d0c142c00 0x7f3d0c06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/2398997078 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c0c7880 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 -- 172.21.15.12:0/2398997078 >> 172.21.15.12:0/2398997078 conn(0x7f3d0c0675a0 msgr2=0x7f3d0c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 -- 172.21.15.12:0/2398997078 shutdown_connections 2023-10-08T16:28:32.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.739+0000 7f3d11f9d700 1 -- 172.21.15.12:0/2398997078 wait complete. 2023-10-08T16:28:32.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.740+0000 7f3d11f9d700 1 Processor -- start 2023-10-08T16:28:32.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.740+0000 7f3d11f9d700 1 -- start start 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 0x7f3d0c0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c13caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1588d0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c1592d0 con 0x7f3d0c142c00 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d11f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0b06d0 con 0x7f3d0c142fd0 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.741+0000 7f3d10f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37506/0 (socket says 172.21.15.12:37506) 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 -- 172.21.15.12:0/1097536026 learned_addr learned my addr 172.21.15.12:0/1097536026 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 0x7f3d0c0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d1179c700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c13caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 -- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 msgr2=0x7f3d0c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c13caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 -- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 msgr2=0x7f3d0c0b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 0x7f3d0c0b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 -- 172.21.15.12:0/1097536026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80094f0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 0x7f3d0c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d10f9b700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000ecb0 tx=0x7f3d000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000c9d0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0000cb30 con 0x7f3d0c06bd20 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0000ced0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.742+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c13d610 con 0x7f3d0c06bd20 2023-10-08T16:28:32.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.743+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0b0080 con 0x7f3d0c06bd20 2023-10-08T16:28:32.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.743+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c04c3c0 con 0x7f3d0c06bd20 2023-10-08T16:28:32.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.744+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 61) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d00013680 con 0x7f3d0c06bd20 2023-10-08T16:28:32.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.745+0000 7f3d08ff9700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 0x7f3cf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:32.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.745+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f3d00084b30 con 0x7f3d0c06bd20 2023-10-08T16:28:32.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.745+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 0x7f3cf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:32.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.746+0000 7f3d0bfff700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 0x7f3cf00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06f490 tx=0x7f3cf8017000 comp rx=0 tx=0).ready entity=mgr.8073 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:32.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:32.750+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d00051b60 con 0x7f3d0c06bd20 2023-10-08T16:28:33.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.012+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f3d0c06ad00 con 0x7f3d0c06bd20 2023-10-08T16:28:33.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.196+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 62) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f3d00051f30 con 0x7f3d0c06bd20 2023-10-08T16:28:33.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.198+0000 7f3d08ff9700 1 -- 172.21.15.12:0/1097536026 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v62) v1 ==== 92+0+0 (secure 0 0 0) 0x7f3d00051b60 con 0x7f3d0c06bd20 2023-10-08T16:28:33.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 msgr2=0x7f3cf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 0x7f3cf00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c06f490 tx=0x7f3cf8017000 comp rx=0 tx=0).stop 2023-10-08T16:28:33.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 msgr2=0x7f3d0c158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3d0000ecb0 tx=0x7f3d000091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 shutdown_connections 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3cf0066f30 0x7f3cf00693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d0c06bd20 0x7f3d0c158390 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d0c142fd0 0x7f3d0c13caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 --2- 172.21.15.12:0/1097536026 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d0c142c00 0x7f3d0c0b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 >> 172.21.15.12:0/1097536026 conn(0x7f3d0c0675a0 msgr2=0x7f3d0c0c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 shutdown_connections 2023-10-08T16:28:33.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.201+0000 7f3d11f9d700 1 -- 172.21.15.12:0/1097536026 wait complete. 2023-10-08T16:28:33.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T16:28:33.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.418+0000 7f7cba79d700 1 Processor -- start 2023-10-08T16:28:33.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.418+0000 7f7cba79d700 1 -- start start 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cba79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb4153dd0 0x7f7cb415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cba79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb415ac50 con 0x7f7cb40cea00 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cba79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb415d010 con 0x7f7cb4153a00 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cba79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb415af60 con 0x7f7cb4153dd0 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cb8f9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb4153dd0 0x7f7cb415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cb8f9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb4153dd0 0x7f7cb415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37516/0 (socket says 172.21.15.12:37516) 2023-10-08T16:28:33.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.420+0000 7f7cb8f9a700 1 -- 172.21.15.12:0/2956737511 learned_addr learned my addr 172.21.15.12:0/2956737511 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cb8f9a700 1 -- 172.21.15.12:0/2956737511 >> v1:172.21.15.29:6789/0 conn(0x7f7cb4153a00 legacy=0x7f7cb415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cb8f9a700 1 -- 172.21.15.12:0/2956737511 >> v1:172.21.15.12:6789/0 conn(0x7f7cb40cea00 legacy=0x7f7cb40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cb8f9a700 1 -- 172.21.15.12:0/2956737511 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb415b240 con 0x7f7cb4153dd0 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cb8f9a700 1 --2- 172.21.15.12:0/2956737511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb415de50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40099b0 tx=0x7f7ca4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8008162c25b13b97 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cabfff700 1 -- 172.21.15.12:0/2956737511 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400b860 con 0x7f7cb4153dd0 2023-10-08T16:28:33.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cabfff700 1 -- 172.21.15.12:0/2956737511 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca400b9c0 con 0x7f7cb4153dd0 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.421+0000 7f7cabfff700 1 -- 172.21.15.12:0/2956737511 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca400bd60 con 0x7f7cb4153dd0 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 -- 172.21.15.12:0/2956737511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 msgr2=0x7f7cb415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 --2- 172.21.15.12:0/2956737511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb415de50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40099b0 tx=0x7f7ca4009250 comp rx=0 tx=0).stop 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 -- 172.21.15.12:0/2956737511 shutdown_connections 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 --2- 172.21.15.12:0/2956737511 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb415de50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 -- 172.21.15.12:0/2956737511 >> 172.21.15.12:0/2956737511 conn(0x7f7cb40703a0 msgr2=0x7f7cb40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 -- 172.21.15.12:0/2956737511 shutdown_connections 2023-10-08T16:28:33.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.422+0000 7f7cba79d700 1 -- 172.21.15.12:0/2956737511 wait complete. 2023-10-08T16:28:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.423+0000 7f7cba79d700 1 Processor -- start 2023-10-08T16:28:33.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 -- start start 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb40cea00 0x7f7cb40c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb4153a00 0x7f7cb41500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb414fc20 con 0x7f7cb4153dd0 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c5cb0 con 0x7f7cb4153a00 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.424+0000 7f7cba79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb40c5f90 con 0x7f7cb40cea00 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37528/0 (socket says 172.21.15.12:37528) 2023-10-08T16:28:33.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 -- 172.21.15.12:0/3388797359 learned_addr learned my addr 172.21.15.12:0/3388797359 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb979b700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb40cea00 0x7f7cb40c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb8f9a700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb4153a00 0x7f7cb41500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb40cea00 msgr2=0x7f7cb40c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb40cea00 0x7f7cb40c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb4153a00 msgr2=0x7f7cb41500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb4153a00 0x7f7cb41500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 -- 172.21.15.12:0/3388797359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca40094f0 con 0x7f7cb4153dd0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.425+0000 7f7cb9f9c700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00c8e0 tx=0x7f7cac001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.426+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012630 con 0x7f7cb4153dd0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.426+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac012790 con 0x7f7cb4153dd0 2023-10-08T16:28:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.426+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac012b50 con 0x7f7cb4153dd0 2023-10-08T16:28:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.426+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb414f8b0 con 0x7f7cb4153dd0 2023-10-08T16:28:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.426+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb40c6850 con 0x7f7cb4153dd0 2023-10-08T16:28:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.427+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb40c6a40 con 0x7f7cb4153dd0 2023-10-08T16:28:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.428+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 62) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7cac01a3a0 con 0x7f7cb4153dd0 2023-10-08T16:28:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.429+0000 7f7ca97fa700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 0x7f7c98069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.429+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f7cac084940 con 0x7f7cb4153dd0 2023-10-08T16:28:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.429+0000 7f7cb979b700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 msgr2=0x7f7c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.429+0000 7f7cb979b700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 0x7f7c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:33.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.433+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cb40c6a40 con 0x7f7cb4153dd0 2023-10-08T16:28:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.630+0000 7f7cb979b700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 msgr2=0x7f7c98069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:33.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.630+0000 7f7cb979b700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 0x7f7c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:33.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.639+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f7cb40c6a40 con 0x7f7cb4153dd0 2023-10-08T16:28:33.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.645+0000 7f7ca97fa700 1 -- 172.21.15.12:0/3388797359 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cb40c6a40 con 0x7f7cb4153dd0 2023-10-08T16:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 msgr2=0x7f7c98069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 0x7f7c98069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 msgr2=0x7f7cb41505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f7cac00c8e0 tx=0x7f7cac001710 comp rx=0 tx=0).stop 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 shutdown_connections 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c98066f80 0x7f7c98069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb4153dd0 0x7f7cb41505f0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb40cea00 0x7f7cb40c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 --2- 172.21.15.12:0/3388797359 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb4153a00 0x7f7cb41500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 >> 172.21.15.12:0/3388797359 conn(0x7f7cb40703a0 msgr2=0x7f7cb41522f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 shutdown_connections 2023-10-08T16:28:33.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.647+0000 7f7cba79d700 1 -- 172.21.15.12:0/3388797359 wait complete. 2023-10-08T16:28:33.666 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T16:28:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.858+0000 7f834c5ff700 1 Processor -- start 2023-10-08T16:28:33.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.858+0000 7f834c5ff700 1 -- start start 2023-10-08T16:28:33.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834c5ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8344159530 0x7f83440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834c5ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f834406dc70 0x7f8344159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834c5ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83440ccfd0 con 0x7f834406e0e0 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834c5ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440cf0e0 con 0x7f8344159530 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834c5ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834415a3d0 con 0x7f834406dc70 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834a39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8344159530 0x7f83440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834a39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8344159530 0x7f83440ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37536/0 (socket says 172.21.15.12:37536) 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.859+0000 7f834a39b700 1 -- 172.21.15.12:0/2782140866 learned_addr learned my addr 172.21.15.12:0/2782140866 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f8349b9a700 1 --2- 172.21.15.12:0/2782140866 >> v2:172.21.15.29:3300/0 conn(0x7f834406dc70 0x7f8344159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f834a39b700 1 -- 172.21.15.12:0/2782140866 >> v2:172.21.15.29:3300/0 conn(0x7f834406dc70 msgr2=0x7f8344159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f834a39b700 1 --2- 172.21.15.12:0/2782140866 >> v2:172.21.15.29:3300/0 conn(0x7f834406dc70 0x7f8344159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f834a39b700 1 -- 172.21.15.12:0/2782140866 >> v1:172.21.15.29:6789/0 conn(0x7f834406e0e0 legacy=0x7f83440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f834a39b700 1 -- 172.21.15.12:0/2782140866 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834415a6b0 con 0x7f8344159530 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f834a39b700 1 --2- 172.21.15.12:0/2782140866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344159530 0x7f83440ceba0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f83440b66e0 tx=0x7f8340009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67c60d8c58686a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f8349399700 1 -- 172.21.15.12:0/2782140866 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340009e70 con 0x7f8344159530 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.860+0000 7f8349399700 1 -- 172.21.15.12:0/2782140866 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834000b860 con 0x7f8344159530 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f8349399700 1 -- 172.21.15.12:0/2782140866 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000bc00 con 0x7f8344159530 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 -- 172.21.15.12:0/2782140866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344159530 msgr2=0x7f83440ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 --2- 172.21.15.12:0/2782140866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344159530 0x7f83440ceba0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f83440b66e0 tx=0x7f8340009250 comp rx=0 tx=0).stop 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 -- 172.21.15.12:0/2782140866 shutdown_connections 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 --2- 172.21.15.12:0/2782140866 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8344159530 0x7f83440ceba0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 --2- 172.21.15.12:0/2782140866 >> v2:172.21.15.29:3300/0 conn(0x7f834406dc70 0x7f8344159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 -- 172.21.15.12:0/2782140866 >> 172.21.15.12:0/2782140866 conn(0x7f83440703a0 msgr2=0x7f83440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 -- 172.21.15.12:0/2782140866 shutdown_connections 2023-10-08T16:28:33.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.861+0000 7f834c5ff700 1 -- 172.21.15.12:0/2782140866 wait complete. 2023-10-08T16:28:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.863+0000 7f834c5ff700 1 Processor -- start 2023-10-08T16:28:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.863+0000 7f834c5ff700 1 -- start start 2023-10-08T16:28:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f834406e0e0 0x7f83440c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8344159530 0x7f83440c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440c9cf0 con 0x7f834406dc70 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834416e2d0 con 0x7f8344159530 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834c5ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834416d6c0 con 0x7f834406e0e0 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834a39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834a39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37538/0 (socket says 172.21.15.12:37538) 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834a39b700 1 -- 172.21.15.12:0/336428040 learned_addr learned my addr 172.21.15.12:0/336428040 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:33.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f8349b9a700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f834406e0e0 0x7f83440c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.864+0000 7f834ab9c700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8344159530 0x7f83440c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.865+0000 7f834a39b700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f834406e0e0 msgr2=0x7f83440c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.865+0000 7f834a39b700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f834406e0e0 0x7f83440c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.865+0000 7f834a39b700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8344159530 msgr2=0x7f83440c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.865+0000 7f834a39b700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8344159530 0x7f83440c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:33.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.865+0000 7f834a39b700 1 -- 172.21.15.12:0/336428040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83400094f0 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f834a39b700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8344089650 tx=0x7f8340017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834000bbe0 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8340028070 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8340024a60 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834416d9a0 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.866+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f834416df60 con 0x7f834406dc70 2023-10-08T16:28:33.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.867+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834404c3c0 con 0x7f834406dc70 2023-10-08T16:28:33.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.869+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 62) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f8340011420 con 0x7f834406dc70 2023-10-08T16:28:33.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.870+0000 7f833a7fc700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 0x7f8328069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.871+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f834008e470 con 0x7f834406dc70 2023-10-08T16:28:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.871+0000 7f8349b9a700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 msgr2=0x7f8328069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:33.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.871+0000 7f8349b9a700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 0x7f8328069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:33.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:33.875+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f834005b4a0 con 0x7f834406dc70 2023-10-08T16:28:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.072+0000 7f8349b9a700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 msgr2=0x7f8328069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:34.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.072+0000 7f8349b9a700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 0x7f8328069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:34.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.078+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f834415a990 con 0x7f834406dc70 2023-10-08T16:28:34.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.084+0000 7f833a7fc700 1 -- 172.21.15.12:0/336428040 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7f834005eac0 con 0x7f834406dc70 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 msgr2=0x7f8328069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 0x7f8328069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 msgr2=0x7f834415e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8344089650 tx=0x7f8340017000 comp rx=0 tx=0).stop 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 shutdown_connections 2023-10-08T16:28:34.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8328066f80 0x7f8328069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f834406dc70 0x7f834415e910 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8344159530 0x7f83440c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 --2- 172.21.15.12:0/336428040 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f834406e0e0 0x7f83440c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 >> 172.21.15.12:0/336428040 conn(0x7f83440703a0 msgr2=0x7f834415b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 shutdown_connections 2023-10-08T16:28:34.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.086+0000 7f834c5ff700 1 -- 172.21.15.12:0/336428040 wait complete. 2023-10-08T16:28:34.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T16:28:34.105 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T16:28:34.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1 1M 2023-10-08T16:28:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.379+0000 7f6d7db9d700 1 Processor -- start 2023-10-08T16:28:34.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.380+0000 7f6d7db9d700 1 -- start start 2023-10-08T16:28:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7db9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6d780cce90 0x7f6d780cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7db9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7815d570 con 0x7f6d78159fb0 2023-10-08T16:28:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7db9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7815d850 con 0x7f6d780cb440 2023-10-08T16:28:34.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7db9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d7815e180 con 0x7f6d780cce90 2023-10-08T16:28:34.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7cb9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6d78159fb0 0x7f6d7815a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44748/0 (socket says 172.21.15.12:44748) 2023-10-08T16:28:34.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d7cb9b700 1 -- 172.21.15.12:0/1580483421 learned_addr learned my addr 172.21.15.12:0/1580483421 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:34.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.382+0000 7f6d77fff700 1 --2- 172.21.15.12:0/1580483421 >> v2:172.21.15.29:3300/0 conn(0x7f6d780cce90 0x7f6d780cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015747038 0 0) 0x7f6d7815d850 con 0x7f6d780cb440 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d68003570 con 0x7f6d780cb440 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451271787 0 0) 0x7f6d7815d570 con 0x7f6d78159fb0 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d77fff700 1 -- 172.21.15.12:0/1580483421 >> v1:172.21.15.29:6789/0 conn(0x7f6d780cb440 legacy=0x7f6d780cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d77fff700 1 -- 172.21.15.12:0/1580483421 >> v1:172.21.15.12:6789/0 conn(0x7f6d78159fb0 legacy=0x7f6d7815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d77fff700 1 -- 172.21.15.12:0/1580483421 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7815db30 con 0x7f6d780cce90 2023-10-08T16:28:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d77fff700 1 --2- 172.21.15.12:0/1580483421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780cce90 0x7f6d780cd330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6d640098e0 tx=0x7f6d640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5719135a82284799 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400b640 con 0x7f6d780cce90 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400b7a0 con 0x7f6d780cce90 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.383+0000 7f6d777fe700 1 -- 172.21.15.12:0/1580483421 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400bb40 con 0x7f6d780cce90 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 -- 172.21.15.12:0/1580483421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780cce90 msgr2=0x7f6d780cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/1580483421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780cce90 0x7f6d780cd330 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6d640098e0 tx=0x7f6d640091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 -- 172.21.15.12:0/1580483421 shutdown_connections 2023-10-08T16:28:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/1580483421 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d780cce90 0x7f6d780cd330 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 -- 172.21.15.12:0/1580483421 >> 172.21.15.12:0/1580483421 conn(0x7f6d780703a0 msgr2=0x7f6d780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:34.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 -- 172.21.15.12:0/1580483421 shutdown_connections 2023-10-08T16:28:34.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.384+0000 7f6d7db9d700 1 -- 172.21.15.12:0/1580483421 wait complete. 2023-10-08T16:28:34.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.387+0000 7f6d7db9d700 1 Processor -- start 2023-10-08T16:28:34.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.387+0000 7f6d7db9d700 1 -- start start 2023-10-08T16:28:34.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.388+0000 7f6d7db9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d780cce90 0x7f6d78141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7db9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d78159fb0 0x7f6d780b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7db9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c61a0 con 0x7f6d780cb440 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7db9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c5870 con 0x7f6d78159fb0 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c5b50 con 0x7f6d780cce90 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37548/0 (socket says 172.21.15.12:37548) 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 -- 172.21.15.12:0/3802306062 learned_addr learned my addr 172.21.15.12:0/3802306062 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:34.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7d39c700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d78159fb0 0x7f6d780b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d780cce90 0x7f6d78141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d780cce90 msgr2=0x7f6d78141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d780cce90 0x7f6d78141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d78159fb0 msgr2=0x7f6d780b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d78159fb0 0x7f6d780b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.389+0000 7f6d7cb9b700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64009420 con 0x7f6d780cb440 2023-10-08T16:28:34.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d7cb9b700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00c560 tx=0x7f6d6c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:34.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c005b30 con 0x7f6d780cb440 2023-10-08T16:28:34.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c005c90 con 0x7f6d780cb440 2023-10-08T16:28:34.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c007320 con 0x7f6d780cb440 2023-10-08T16:28:34.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d780c5e30 con 0x7f6d780cb440 2023-10-08T16:28:34.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.390+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d78142330 con 0x7f6d780cb440 2023-10-08T16:28:34.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.391+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d78142520 con 0x7f6d780cb440 2023-10-08T16:28:34.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.392+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 62) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6d6c01b3b0 con 0x7f6d780cb440 2023-10-08T16:28:34.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.393+0000 7f6d74ff9700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:34.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.393+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6125+0+0 (secure 0 0 0) 0x7f6d6c083b70 con 0x7f6d780cb440 2023-10-08T16:28:34.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.393+0000 7f6d77fff700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:34.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.393+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T16:28:34.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.397+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d78142520 con 0x7f6d780cb440 2023-10-08T16:28:34.528 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:34.527+0000 7f9c3977a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:28:34.590 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:34.589+0000 7f6204634180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T16:28:34.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.594+0000 7f6d77fff700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.594+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T16:28:34.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.626+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d780c62e0 con 0x7f6d5c066fb0 2023-10-08T16:28:34.699 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:34.698+0000 7f9c3977a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:34.765 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:34.764+0000 7f6204634180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:34.787 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:34.786+0000 7f9c3977a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:28:34.856 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:34.855+0000 7f6204634180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T16:28:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.995+0000 7f6d77fff700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:34.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:34.995+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T16:28:35.019 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:35.018+0000 7f9c3977a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:35.090 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:35.089+0000 7f6204634180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:35.203 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:35.202+0000 7f9c3977a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:28:35.277 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:35.277+0000 7f6204634180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T16:28:35.299 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:35.298+0000 7f9c3977a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:28:35.375 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:35.374+0000 7f6204634180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T16:28:35.470 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:35.469+0000 7f9c3977a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:28:35.543 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:35.542+0000 7f6204634180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T16:28:35.574 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:35.573+0000 7f9c3977a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:35.650 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:35.649+0000 7f6204634180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T16:28:35.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:35.796+0000 7f6d77fff700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:35.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:35.796+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T16:28:36.076 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:36.075+0000 7f9c3977a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:28:36.159 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:36.159+0000 7f6204634180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T16:28:36.173 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:36.172+0000 7f9c3977a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:28:36.260 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:36.259+0000 7f6204634180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T16:28:36.267 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:36.266+0000 7f9c3977a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:28:36.357 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:36.356+0000 7f6204634180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T16:28:36.917 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:36.916+0000 7f9c3977a180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:28:37.017 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:37.016+0000 7f6204634180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T16:28:37.096 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:37.095+0000 7f9c3977a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:37.195 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:37.194+0000 7f9c3977a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:28:37.199 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:37.198+0000 7f6204634180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T16:28:37.301 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:37.301+0000 7f6204634180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T16:28:37.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:37.398+0000 7f6d77fff700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T16:28:37.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:37.398+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T16:28:37.498 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:37.497+0000 7f9c3977a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:28:37.818 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:37.597+0000 7f9c3977a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:28:37.818 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:37.606+0000 7f6204634180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T16:28:37.818 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:37.708+0000 7f6204634180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T16:28:38.335 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:38.335+0000 7f9c3977a180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:28:38.459 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:38.458+0000 7f6204634180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T16:28:38.628 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:38.627+0000 7f9c3977a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:28:38.724 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:38.723+0000 7f9c3977a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:28:38.753 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:38.752+0000 7f6204634180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T16:28:38.852 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:38.851+0000 7f6204634180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T16:28:38.885 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:38.884+0000 7f9c3977a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:28:38.993 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:38.992+0000 7f9c3977a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:28:39.016 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.015+0000 7f6204634180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T16:28:39.128 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.127+0000 7f6204634180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T16:28:39.190 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:39.189+0000 7f9c3977a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:28:39.287 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:39.286+0000 7f9c3977a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:28:39.331 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.330+0000 7f6204634180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T16:28:39.383 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:39.382+0000 7f9c3977a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:28:39.429 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.428+0000 7f6204634180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T16:28:39.482 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T16:28:39.481+0000 7f9c3977a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:28:39.528 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.527+0000 7f6204634180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T16:28:39.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:39.541+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 63) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f6d6c050f70 con 0x7f6d780cb440 2023-10-08T16:28:39.630 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.629+0000 7f6204634180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T16:28:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:39.639+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 64) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f6d6c05b370 con 0x7f6d780cb440 2023-10-08T16:28:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:39.640+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c069460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T16:28:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:39.640+0000 7f6d74ff9700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c069460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:39.760 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61751ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.760 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61751ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.760 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61751ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61751ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61751ae700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61799b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61799b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61799b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61799b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:39.761 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:28:39.759+0000 7f61799b7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:28:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.645+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mgrmap(e 65) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f6d6c051840 con 0x7f6d780cb440 2023-10-08T16:28:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.646+0000 7f6d74ff9700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.646+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d5c003560 con 0x7f6d5c066fb0 2023-10-08T16:28:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.649+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.652+0000 7f6d77fff700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c0693e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d640093f0 tx=0x7f6d64017000 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:40.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.720+0000 7f6d74ff9700 1 -- 172.21.15.12:0/3802306062 <== mgr.8433 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f6d5c003560 con 0x7f6d5c066fb0 2023-10-08T16:28:40.721 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 msgr2=0x7f6d5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c0693e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6d640093f0 tx=0x7f6d64017000 comp rx=0 tx=0).stop 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 msgr2=0x7f6d78153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00c560 tx=0x7f6d6c000fe0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 shutdown_connections 2023-10-08T16:28:40.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d5c066fb0 0x7f6d5c0693e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d780cb440 0x7f6d78153300 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d78159fb0 0x7f6d780b0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 --2- 172.21.15.12:0/3802306062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d780cce90 0x7f6d78141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 >> 172.21.15.12:0/3802306062 conn(0x7f6d780703a0 msgr2=0x7f6d7814ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 shutdown_connections 2023-10-08T16:28:40.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.723+0000 7f6d7db9d700 1 -- 172.21.15.12:0/3802306062 wait complete. 2023-10-08T16:28:40.743 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1 2023-10-08T16:28:40.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs /snap_test_dir1 55n 2023-10-08T16:28:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.937+0000 7f878b59e700 1 Processor -- start 2023-10-08T16:28:40.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.937+0000 7f878b59e700 1 -- start start 2023-10-08T16:28:40.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.938+0000 7f878b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 0x7f878c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.938+0000 7f878b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f878c13fef0 0x7f878c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f878b59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878c15ae70 con 0x7f878c06aaa0 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f878b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f878c06af60 con 0x7f878c13fef0 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f878b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c06b240 con 0x7f878c13fb20 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f878c13fef0 0x7f878c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f878c13fef0 0x7f878c0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37712/0 (socket says 172.21.15.12:37712) 2023-10-08T16:28:40.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 -- 172.21.15.12:0/4153598748 learned_addr learned my addr 172.21.15.12:0/4153598748 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f878a59c700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 0x7f878c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 -- 172.21.15.12:0/4153598748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 msgr2=0x7f878c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 0x7f878c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 -- 172.21.15.12:0/4153598748 >> v1:172.21.15.12:6789/0 conn(0x7f878c06aaa0 legacy=0x7f878c0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f8789d9b700 1 -- 172.21.15.12:0/4153598748 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f878c06b520 con 0x7f878c13fef0 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.939+0000 7f878a59c700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 0x7f878c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c13fef0 0x7f878c0c7990 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8780009990 tx=0x7f8780009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c1735cb1f6667a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878959a700 1 -- 172.21.15.12:0/4153598748 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780005c10 con 0x7f878c13fef0 2023-10-08T16:28:40.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878959a700 1 -- 172.21.15.12:0/4153598748 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8780005d70 con 0x7f878c13fef0 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878959a700 1 -- 172.21.15.12:0/4153598748 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878000b880 con 0x7f878c13fef0 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 -- 172.21.15.12:0/4153598748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c13fef0 msgr2=0x7f878c0c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c13fef0 0x7f878c0c7990 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f8780009990 tx=0x7f8780009220 comp rx=0 tx=0).stop 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 -- 172.21.15.12:0/4153598748 shutdown_connections 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fb20 0x7f878c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 --2- 172.21.15.12:0/4153598748 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c13fef0 0x7f878c0c7990 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.940+0000 7f878b59e700 1 -- 172.21.15.12:0/4153598748 >> 172.21.15.12:0/4153598748 conn(0x7f878c06d170 msgr2=0x7f878c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.941+0000 7f878b59e700 1 -- 172.21.15.12:0/4153598748 shutdown_connections 2023-10-08T16:28:40.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.941+0000 7f878b59e700 1 -- 172.21.15.12:0/4153598748 wait complete. 2023-10-08T16:28:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.942+0000 7f878b59e700 1 Processor -- start 2023-10-08T16:28:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.942+0000 7f878b59e700 1 -- start start 2023-10-08T16:28:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 0x7f878c156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 0x7f878c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c157eb0 con 0x7f878c06aaa0 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878c157bd0 con 0x7f878c13fb20 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878c13cc40 con 0x7f878c13fef0 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37720/0 (socket says 172.21.15.12:37720) 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.943+0000 7f878a59c700 1 -- 172.21.15.12:0/4261918940 learned_addr learned my addr 172.21.15.12:0/4261918940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 0x7f878c156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878ad9d700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 0x7f878c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 -- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 msgr2=0x7f878c0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 0x7f878c0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 -- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 msgr2=0x7f878c156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 0x7f878c156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 -- 172.21.15.12:0/4261918940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8780009480 con 0x7f878c06aaa0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 0x7f878c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878ad9d700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 0x7f878c0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878a59c700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c830 tx=0x7f877c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c011600 con 0x7f878c06aaa0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877c011760 con 0x7f878c06aaa0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877c011b20 con 0x7f878c06aaa0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f878c1572a0 con 0x7f878c06aaa0 2023-10-08T16:28:40.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.944+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f878c157860 con 0x7f878c06aaa0 2023-10-08T16:28:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.945+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f878c158190 con 0x7f878c06aaa0 2023-10-08T16:28:40.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.946+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 65) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f877c00a3e0 con 0x7f878c06aaa0 2023-10-08T16:28:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.948+0000 7f877a7fc700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 0x7f876c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.948+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f877c084740 con 0x7f878c06aaa0 2023-10-08T16:28:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.948+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 0x7f876c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:40.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.949+0000 7f8789d9b700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 0x7f876c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8780009260 tx=0x7f8780016000 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:40.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:40.952+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f877c0518f0 con 0x7f878c06aaa0 2023-10-08T16:28:41.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.183+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/snap_test_dir1", "retention_spec_or_period": "55n", "target": ["mon-mgr", ""]}) v1 -- 0x7f878c157ff0 con 0x7f876c066dd0 2023-10-08T16:28:41.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.245+0000 7f877a7fc700 1 -- 172.21.15.12:0/4261918940 <== mgr.8433 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+40 (secure 0 0 0) 0x7f8780021070 con 0x7f876c066dd0 2023-10-08T16:28:41.247 INFO:teuthology.orchestra.run.smithi012.stdout:Retention added to path /snap_test_dir1 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 msgr2=0x7f876c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 0x7f876c069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8780009260 tx=0x7f8780016000 comp rx=0 tx=0).stop 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 msgr2=0x7f878c13c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f877c00c830 tx=0x7f877c008040 comp rx=0 tx=0).stop 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 shutdown_connections 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f876c066dd0 0x7f876c069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f878c06aaa0 0x7f878c13c700 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f878c13fef0 0x7f878c0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 --2- 172.21.15.12:0/4261918940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f878c13fb20 0x7f878c156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 >> 172.21.15.12:0/4261918940 conn(0x7f878c06d170 msgr2=0x7f878c0b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 shutdown_connections 2023-10-08T16:28:41.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.248+0000 7f878b59e700 1 -- 172.21.15.12:0/4261918940 wait complete. 2023-10-08T16:28:41.266 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path /snap_test_dir1 2023-10-08T16:28:41.266 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-10-08T16:28:41.266 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json /snap_test_dir1 2023-10-08T16:28:41.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.456+0000 7f042959d700 1 Processor -- start 2023-10-08T16:28:41.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.456+0000 7f042959d700 1 -- start start 2023-10-08T16:28:41.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.457+0000 7f042959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f04240c7870 0x7f042406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f042959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 0x7f04240c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f042959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c7d10 con 0x7f042415cb90 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f042959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240ccdf0 con 0x7f04240c7870 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f042959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240c9b20 con 0x7f042406cbe0 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f0423fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f042415cb90 0x7f042415dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44768/0 (socket says 172.21.15.12:44768) 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f0423fff700 1 -- 172.21.15.12:0/2616616065 learned_addr learned my addr 172.21.15.12:0/2616616065 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f04237fe700 1 --2- 172.21.15.12:0/2616616065 >> v2:172.21.15.12:3300/0 conn(0x7f04240c7870 0x7f042406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2616616065 >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 0x7f04240c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f04237fe700 1 -- 172.21.15.12:0/2616616065 >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 msgr2=0x7f04240c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f04237fe700 1 --2- 172.21.15.12:0/2616616065 >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 0x7f04240c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f04237fe700 1 -- 172.21.15.12:0/2616616065 >> v1:172.21.15.12:6789/0 conn(0x7f042415cb90 legacy=0x7f042415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f04237fe700 1 -- 172.21.15.12:0/2616616065 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240c2fa0 con 0x7f04240c7870 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f0422ffd700 1 -- 172.21.15.12:0/2616616065 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1291068650 0 0) 0x7f0414001110 con 0x7f042415cb90 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.458+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2616616065 >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 0x7f04240c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f04237fe700 1 --2- 172.21.15.12:0/2616616065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240c7870 0x7f042406c6a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f042413fd70 tx=0x7f04180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de782bf1cd3cfea4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f0422ffd700 1 -- 172.21.15.12:0/2616616065 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800b6b0 con 0x7f04240c7870 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f0422ffd700 1 -- 172.21.15.12:0/2616616065 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800b810 con 0x7f04240c7870 2023-10-08T16:28:41.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f0422ffd700 1 -- 172.21.15.12:0/2616616065 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800bbb0 con 0x7f04240c7870 2023-10-08T16:28:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f042959d700 1 -- 172.21.15.12:0/2616616065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240c7870 msgr2=0x7f042406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.459+0000 7f042959d700 1 --2- 172.21.15.12:0/2616616065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240c7870 0x7f042406c6a0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f042413fd70 tx=0x7f04180091a0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 -- 172.21.15.12:0/2616616065 shutdown_connections 2023-10-08T16:28:41.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 --2- 172.21.15.12:0/2616616065 >> v2:172.21.15.29:3300/0 conn(0x7f042406cbe0 0x7f04240c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 --2- 172.21.15.12:0/2616616065 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04240c7870 0x7f042406c6a0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 -- 172.21.15.12:0/2616616065 >> 172.21.15.12:0/2616616065 conn(0x7f04240cd230 msgr2=0x7f04240cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 -- 172.21.15.12:0/2616616065 shutdown_connections 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.460+0000 7f042959d700 1 -- 172.21.15.12:0/2616616065 wait complete. 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.461+0000 7f042959d700 1 Processor -- start 2023-10-08T16:28:41.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.461+0000 7f042959d700 1 -- start start 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042406cbe0 0x7f04240c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04240c7870 0x7f04240a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424159670 con 0x7f042415cb90 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c53f0 con 0x7f04240c7870 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f042959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c56d0 con 0x7f042406cbe0 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f0428d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f0428d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37744/0 (socket says 172.21.15.12:37744) 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f0428d9c700 1 -- 172.21.15.12:0/2885819373 learned_addr learned my addr 172.21.15.12:0/2885819373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f0423fff700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042406cbe0 0x7f04240c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.462+0000 7f04237fe700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04240c7870 0x7f04240a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 -- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042406cbe0 msgr2=0x7f04240c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042406cbe0 0x7f04240c6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 -- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04240c7870 msgr2=0x7f04240a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04240c7870 0x7f04240a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 -- 172.21.15.12:0/2885819373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009420 con 0x7f042415cb90 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f0428d9c700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f041c00cef0 tx=0x7f041c007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:41.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00ad20 con 0x7f042415cb90 2023-10-08T16:28:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c016420 con 0x7f042415cb90 2023-10-08T16:28:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04240c59b0 con 0x7f042415cb90 2023-10-08T16:28:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.463+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00aea0 con 0x7f042415cb90 2023-10-08T16:28:41.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.464+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04240c5f70 con 0x7f042415cb90 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.464+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04240c69d0 con 0x7f042415cb90 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.465+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 65) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f041c016a70 con 0x7f042415cb90 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.466+0000 7f040bfff700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 0x7f0410069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.466+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6383+0+0 (secure 0 0 0) 0x7f041c012070 con 0x7f042415cb90 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.466+0000 7f0423fff700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 0x7f0410069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T16:28:41.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.467+0000 7f0423fff700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 0x7f0410069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0414006fc0 tx=0x7f0414007b90 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T16:28:41.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.471+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f041c04e5a0 con 0x7f042415cb90 2023-10-08T16:28:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.705+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04240c6160 con 0x7f0410066dd0 2023-10-08T16:28:41.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.714+0000 7f040bfff700 1 -- 172.21.15.12:0/2885819373 <== mgr.8433 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+74 (secure 0 0 0) 0x7f04240c6160 con 0x7f0410066dd0 2023-10-08T16:28:41.715 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T16:28:41.715 INFO:teuthology.orchestra.run.smithi012.stdout:{"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-08T16:28:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 msgr2=0x7f0410069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 0x7f0410069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0414006fc0 tx=0x7f0414007b90 comp rx=0 tx=0).stop 2023-10-08T16:28:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 msgr2=0x7f04240c89c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T16:28:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f041c00cef0 tx=0x7f041c007860 comp rx=0 tx=0).stop 2023-10-08T16:28:41.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 shutdown_connections 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0410066dd0 0x7f0410069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f042415cb90 0x7f04240c89c0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f042406cbe0 0x7f04240c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 --2- 172.21.15.12:0/2885819373 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04240c7870 0x7f04240a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 >> 172.21.15.12:0/2885819373 conn(0x7f04240cd230 msgr2=0x7f0424159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 shutdown_connections 2023-10-08T16:28:41.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T16:28:41.716+0000 7f042959d700 1 -- 172.21.15.12:0/2885819373 wait complete. 2023-10-08T16:28:41.735 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "/snap_test_dir1", "schedule": ["1M"], "retention": [{"n": 55}]} 2023-10-08T16:28:41.735 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': '/snap_test_dir1', 'schedule': ['1M'], 'retention': [{'n': 55}]} 2023-10-08T16:28:48.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:28:48.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:00.260 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:29:00.259+0000 7f6168995700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:29:00.260 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:29:00.259+0000 7f6168995700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:29:00.260 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:29:00.259+0000 7f6168995700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:29:00.261 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:29:00.259+0000 7f6168995700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:29:00.261 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T16:29:00.259+0000 7f6168995700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T16:29:18.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:18.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:48.515 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:29:48.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:30:18.635 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:30:18.640 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:30:48.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:30:48.763 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:31:18.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:31:18.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:31:49.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:31:49.033 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:32:19.160 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:32:19.165 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:32:49.279 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:32:49.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:19.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:19.400 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:49.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:33:49.528 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:19.663 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:19.669 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:49.774 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:34:49.780 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:19.883 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:19.888 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:50.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:35:50.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:20.183 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:20.188 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:50.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:36:50.305 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:20.408 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:20.413 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:50.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:37:50.531 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:38:20.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:38:20.692 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:38:50.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:38:50.834 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:39:20.945 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:39:20.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:39:51.100 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:39:51.105 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:21.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:21.234 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:51.346 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:40:51.351 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:21.463 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:21.468 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:51.580 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:41:51.586 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:21.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:21.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:51.829 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:42:51.835 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:21.965 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:21.971 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:52.106 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:43:52.111 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:22.247 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:22.252 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:52.363 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:44:52.369 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:22.489 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:22.494 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:52.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:45:52.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:22.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:22.720 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:52.847 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:46:52.852 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:22.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:22.980 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:53.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:47:53.095 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:23.200 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:23.206 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:53.350 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:48:53.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:23.548 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:23.554 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:53.685 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:49:55.197 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:25.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:25.323 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:55.434 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:50:55.440 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:25.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:25.564 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:55.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:51:55.682 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:25.785 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:25.792 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:55.913 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:52:55.918 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:26.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:26.033 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:56.156 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:53:56.161 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:26.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:26.299 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:56.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:54:56.426 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:55:26.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:55:26.542 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:55:56.662 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:55:56.668 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:56:26.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:56:26.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:56:56.911 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:56:56.916 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:27.030 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:27.035 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:57.154 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:57:57.160 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:27.263 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:27.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:57.406 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:58:57.412 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:27.524 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:27.529 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:57.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T16:59:57.673 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:27.783 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:27.789 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:57.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:00:57.900 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:28.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:28.026 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:58.129 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:01:58.135 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:02:28.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:02:28.253 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:02:58.382 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:02:58.388 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:28.506 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:28.512 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:58.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:03:58.648 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:04:28.768 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:04:28.774 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:04:58.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:04:58.891 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:05:29.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:05:29.019 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:05:59.138 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:05:59.144 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:29.262 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:29.268 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:59.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:06:59.393 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:07:29.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:07:29.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:07:59.639 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:07:59.645 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:08:29.776 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:08:29.781 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:08:59.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:08:59.922 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:09:30.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:09:30.024 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:00.143 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:00.148 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:30.272 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:10:30.278 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:00.396 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:00.402 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:30.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:11:30.549 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:00.664 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:00.670 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:30.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:12:30.822 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:00.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:00.947 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:31.067 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:13:31.073 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:01.209 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:01.215 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:31.333 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:14:31.339 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:01.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:01.589 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:31.719 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:15:31.725 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:01.876 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:01.882 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:31.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:16:31.983 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:02.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:02.092 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:32.214 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:17:32.219 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:02.339 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:02.345 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:32.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:18:32.488 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:02.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:02.629 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:32.766 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:19:32.772 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:02.891 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:02.897 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:33.025 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:20:33.030 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:03.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:03.139 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:33.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:21:33.280 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:03.400 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:03.406 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:33.527 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:22:33.532 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:23:03.651 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:23:03.657 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:23:33.777 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:23:33.785 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:24:03.950 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:24:03.956 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:24:15.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:15.736 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_30_00_UTC 2023-10-08T17:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_31_00_UTC 2023-10-08T17:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_32_00_UTC 2023-10-08T17:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_33_00_UTC 2023-10-08T17:24:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_34_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_35_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_36_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_37_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_38_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_39_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_40_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_41_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_42_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_43_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_44_00_UTC 2023-10-08T17:24:15.784 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_45_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_46_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_47_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_48_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_49_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_50_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_51_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_52_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_53_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_54_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_55_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_56_00_UTC 2023-10-08T17:24:15.785 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_57_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_58_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_59_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_00_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_01_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_02_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_03_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_04_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_05_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_06_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_07_00_UTC 2023-10-08T17:24:15.786 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_08_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_09_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_10_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_11_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_12_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_13_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_14_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_15_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_16_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_17_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_18_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_19_00_UTC 2023-10-08T17:24:15.787 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_20_00_UTC 2023-10-08T17:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_21_00_UTC 2023-10-08T17:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_22_00_UTC 2023-10-08T17:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_23_00_UTC 2023-10-08T17:24:15.788 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_24_00_UTC 2023-10-08T17:24:15.789 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-16_30_00_UTC', 'scheduled-2023-10-08-16_31_00_UTC', 'scheduled-2023-10-08-16_32_00_UTC', 'scheduled-2023-10-08-16_33_00_UTC', 'scheduled-2023-10-08-16_34_00_UTC', 'scheduled-2023-10-08-16_35_00_UTC', 'scheduled-2023-10-08-16_36_00_UTC', 'scheduled-2023-10-08-16_37_00_UTC', 'scheduled-2023-10-08-16_38_00_UTC', 'scheduled-2023-10-08-16_39_00_UTC', 'scheduled-2023-10-08-16_40_00_UTC', 'scheduled-2023-10-08-16_41_00_UTC', 'scheduled-2023-10-08-16_42_00_UTC', 'scheduled-2023-10-08-16_43_00_UTC', 'scheduled-2023-10-08-16_44_00_UTC', 'scheduled-2023-10-08-16_45_00_UTC', 'scheduled-2023-10-08-16_46_00_UTC', 'scheduled-2023-10-08-16_47_00_UTC', 'scheduled-2023-10-08-16_48_00_UTC', 'scheduled-2023-10-08-16_49_00_UTC', 'scheduled-2023-10-08-16_50_00_UTC', 'scheduled-2023-10-08-16_51_00_UTC', 'scheduled-2023-10-08-16_52_00_UTC', 'scheduled-2023-10-08-16_53_00_UTC', 'scheduled-2023-10-08-16_54_00_UTC', 'scheduled-2023-10-08-16_55_00_UTC', 'scheduled-2023-10-08-16_56_00_UTC', 'scheduled-2023-10-08-16_57_00_UTC', 'scheduled-2023-10-08-16_58_00_UTC', 'scheduled-2023-10-08-16_59_00_UTC', 'scheduled-2023-10-08-17_00_00_UTC', 'scheduled-2023-10-08-17_01_00_UTC', 'scheduled-2023-10-08-17_02_00_UTC', 'scheduled-2023-10-08-17_03_00_UTC', 'scheduled-2023-10-08-17_04_00_UTC', 'scheduled-2023-10-08-17_05_00_UTC', 'scheduled-2023-10-08-17_06_00_UTC', 'scheduled-2023-10-08-17_07_00_UTC', 'scheduled-2023-10-08-17_08_00_UTC', 'scheduled-2023-10-08-17_09_00_UTC', 'scheduled-2023-10-08-17_10_00_UTC', 'scheduled-2023-10-08-17_11_00_UTC', 'scheduled-2023-10-08-17_12_00_UTC', 'scheduled-2023-10-08-17_13_00_UTC', 'scheduled-2023-10-08-17_14_00_UTC', 'scheduled-2023-10-08-17_15_00_UTC', 'scheduled-2023-10-08-17_16_00_UTC', 'scheduled-2023-10-08-17_17_00_UTC', 'scheduled-2023-10-08-17_18_00_UTC', 'scheduled-2023-10-08-17_19_00_UTC', 'scheduled-2023-10-08-17_20_00_UTC', 'scheduled-2023-10-08-17_21_00_UTC', 'scheduled-2023-10-08-17_22_00_UTC', 'scheduled-2023-10-08-17_23_00_UTC', 'scheduled-2023-10-08-17_24_00_UTC'] 2023-10-08T17:24:15.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1 2023-10-08T17:24:15.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.984+0000 7f440299d700 1 Processor -- start 2023-10-08T17:24:15.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.984+0000 7f440299d700 1 -- start start 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43fc0c8200 0x7f43fc0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c85d0 0x7f43fc0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440299d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43fc1571b0 con 0x7f43fc0c2a90 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43fc1579b0 con 0x7f43fc0c8200 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0c1390 con 0x7f43fc0c85d0 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440199b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43fc0c8200 0x7f43fc0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440199b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f43fc0c8200 0x7f43fc0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40810/0 (socket says 172.21.15.12:40810) 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.985+0000 7f440199b700 1 -- 172.21.15.12:0/422282414 learned_addr learned my addr 172.21.15.12:0/422282414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:15.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440219c700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c85d0 0x7f43fc0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440199b700 1 -- 172.21.15.12:0/422282414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c85d0 msgr2=0x7f43fc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:15.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440199b700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c85d0 0x7f43fc0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440199b700 1 -- 172.21.15.12:0/422282414 >> v1:172.21.15.29:6789/0 conn(0x7f43fc0c2a90 legacy=0x7f43fc156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:15.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440199b700 1 -- 172.21.15.12:0/422282414 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43fc1573f0 con 0x7f43fc0c8200 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.986+0000 7f440199b700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c8200 0x7f43fc0c1820 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f43f800bc50 tx=0x7f43f800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9635eadb02fd7c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f4400999700 1 -- 172.21.15.12:0/422282414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f800be60 con 0x7f43fc0c8200 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f4400999700 1 -- 172.21.15.12:0/422282414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f800de00 con 0x7f43fc0c8200 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f4400999700 1 -- 172.21.15.12:0/422282414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f80196b0 con 0x7f43fc0c8200 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 -- 172.21.15.12:0/422282414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c8200 msgr2=0x7f43fc0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c8200 0x7f43fc0c1820 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f43f800bc50 tx=0x7f43f800b4f0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 -- 172.21.15.12:0/422282414 shutdown_connections 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c85d0 0x7f43fc0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 --2- 172.21.15.12:0/422282414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c8200 0x7f43fc0c1820 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 -- 172.21.15.12:0/422282414 >> 172.21.15.12:0/422282414 conn(0x7f43fc06c6a0 msgr2=0x7f43fc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:15.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 -- 172.21.15.12:0/422282414 shutdown_connections 2023-10-08T17:24:15.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.987+0000 7f440299d700 1 -- 172.21.15.12:0/422282414 wait complete. 2023-10-08T17:24:15.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.989+0000 7f440299d700 1 Processor -- start 2023-10-08T17:24:15.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.989+0000 7f440299d700 1 -- start start 2023-10-08T17:24:15.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c2a90 0x7f43fc0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43fc0c8200 0x7f43fc0ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0abf60 con 0x7f43fc0c85d0 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0ac240 con 0x7f43fc0c8200 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43fc0ac520 con 0x7f43fc0c2a90 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40818/0 (socket says 172.21.15.12:40818) 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440219c700 1 -- 172.21.15.12:0/1572303973 learned_addr learned my addr 172.21.15.12:0/1572303973 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440199b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c2a90 0x7f43fc0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.990+0000 7f440119a700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43fc0c8200 0x7f43fc0ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 -- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c2a90 msgr2=0x7f43fc0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:15.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c2a90 0x7f43fc0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 -- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43fc0c8200 msgr2=0x7f43fc0ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:15.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43fc0c8200 0x7f43fc0ad000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:15.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 -- 172.21.15.12:0/1572303973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f800b790 con 0x7f43fc0c85d0 2023-10-08T17:24:15.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440219c700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009fa0 tx=0x7f43f4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f400ebc0 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43f400ed20 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43f4014670 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43fc0ac800 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.991+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43fc0ada80 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.992+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43fc0ccf70 con 0x7f43fc0c85d0 2023-10-08T17:24:15.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.993+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 68) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f43f40149e0 con 0x7f43fc0c85d0 2023-10-08T17:24:15.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.994+0000 7f43f1ffb700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 0x7f43e0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:15.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.994+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f43f40850f0 con 0x7f43fc0c85d0 2023-10-08T17:24:15.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.995+0000 7f440199b700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 0x7f43e0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:15.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.995+0000 7f440199b700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 0x7f43e0069550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43f800bc50 tx=0x7f43f801b000 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:15.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:15.999+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43f4051e70 con 0x7f43fc0c85d0 2023-10-08T17:24:16.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.228+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43fc0ac3b0 con 0x7f43e00670a0 2023-10-08T17:24:16.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.237+0000 7f43f1ffb700 1 -- 172.21.15.12:0/1572303973 <== mgr.8433 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f43fc0ac3b0 con 0x7f43e00670a0 2023-10-08T17:24:16.238 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:16.238 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:28:40", "first": "2023-10-08T16:29:00", "last": "2023-10-08T17:24:00", "last_pruned": "2023-10-08T17:24:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 msgr2=0x7f43e0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 0x7f43e0069550 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f43f800bc50 tx=0x7f43f801b000 comp rx=0 tx=0).stop 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 msgr2=0x7f43fc0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f43f4009fa0 tx=0x7f43f4009900 comp rx=0 tx=0).stop 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 shutdown_connections 2023-10-08T17:24:16.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f43e00670a0 0x7f43e0069550 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f43fc0c85d0 0x7f43fc0ad540 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f43fc0c2a90 0x7f43fc0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 --2- 172.21.15.12:0/1572303973 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f43fc0c8200 0x7f43fc0ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 >> 172.21.15.12:0/1572303973 conn(0x7f43fc06c6a0 msgr2=0x7f43fc0cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 shutdown_connections 2023-10-08T17:24:16.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.240+0000 7f440299d700 1 -- 172.21.15.12:0/1572303973 wait complete. 2023-10-08T17:24:16.258 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1", "rel_path": "/snap_test_dir1", "schedule": "1M", "retention": {"n": 55}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T16:28:40", "first": "2023-10-08T16:29:00", "last": "2023-10-08T17:24:00", "last_pruned": "2023-10-08T17:24:00", "created_count": 56, "pruned_count": 1, "active": true}] 2023-10-08T17:24:16.258 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1', 'rel_path': '/snap_test_dir1', 'schedule': '1M', 'retention': {'n': 55}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T16:28:40', 'first': '2023-10-08T16:29:00', 'last': '2023-10-08T17:24:00', 'last_pruned': '2023-10-08T17:24:00', 'created_count': 56, 'pruned_count': 1, 'active': True} 2023-10-08T17:24:16.258 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 55 2023-10-08T17:24:16.258 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 56 2023-10-08T17:24:16.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1 2023-10-08T17:24:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.451+0000 7eff30fff700 1 Processor -- start 2023-10-08T17:24:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.452+0000 7eff30fff700 1 -- start start 2023-10-08T17:24:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff30fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7eff2c157710 0x7eff2c06b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff30fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06b2f0 con 0x7eff2c156480 2023-10-08T17:24:16.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff30fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2c06ace0 con 0x7eff2c06bcc0 2023-10-08T17:24:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff30fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2c157b60 con 0x7eff2c157710 2023-10-08T17:24:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff2a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7eff2c156480 0x7eff2c0c7b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38570/0 (socket says 172.21.15.12:38570) 2023-10-08T17:24:16.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff2a59c700 1 -- 172.21.15.12:0/3301424487 learned_addr learned my addr 172.21.15.12:0/3301424487 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.453+0000 7eff29d9b700 1 --2- 172.21.15.12:0/3301424487 >> v2:172.21.15.29:3300/0 conn(0x7eff2c157710 0x7eff2c06b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3389761987 0 0) 0x7eff2c06b2f0 con 0x7eff2c156480 2023-10-08T17:24:16.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff14003570 con 0x7eff2c156480 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2899892807 0 0) 0x7eff14003570 con 0x7eff2c156480 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 >> v2:172.21.15.29:3300/0 conn(0x7eff2c157710 msgr2=0x7eff2c06b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 --2- 172.21.15.12:0/3301424487 >> v2:172.21.15.29:3300/0 conn(0x7eff2c157710 0x7eff2c06b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 >> v1:172.21.15.29:6789/0 conn(0x7eff2c06bcc0 legacy=0x7eff2c0ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0c8310 con 0x7eff2c156480 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7eff1c001470 con 0x7eff2c156480 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 >> v1:172.21.15.12:6789/0 conn(0x7eff2c156480 legacy=0x7eff2c0c7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 0x7eff14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff14004810 0x7eff14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff140051c0 0x7eff1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c157b60 con 0x7eff14003a60 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400c0b0 con 0x7eff14004810 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1400c270 con 0x7eff140051c0 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff2a59c700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 0x7eff14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.454+0000 7eff29d9b700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff14004810 0x7eff14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2ad9d700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff140051c0 0x7eff1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 -- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff140051c0 msgr2=0x7eff1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff140051c0 0x7eff1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 -- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff14004810 msgr2=0x7eff14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff14004810 0x7eff14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 -- 172.21.15.12:0/3301424487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14003570 con 0x7eff14003a60 2023-10-08T17:24:16.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2ad9d700 1 -- 172.21.15.12:0/3301424487 reap_dead start 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2a59c700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 0x7eff14003e30 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c2a0 tx=0x7eff2c06b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ecc5d9a9afad80e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00cb70 con 0x7eff14003a60 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00ccd0 con 0x7eff14003a60 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.455+0000 7eff2959a700 1 -- 172.21.15.12:0/3301424487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c005b70 con 0x7eff14003a60 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 -- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 msgr2=0x7eff14003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 0x7eff14003e30 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00c2a0 tx=0x7eff2c06b260 comp rx=0 tx=0).stop 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 -- 172.21.15.12:0/3301424487 shutdown_connections 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 --2- 172.21.15.12:0/3301424487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff14003a60 0x7eff14003e30 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 -- 172.21.15.12:0/3301424487 >> 172.21.15.12:0/3301424487 conn(0x7eff2c06d170 msgr2=0x7eff2c0cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 -- 172.21.15.12:0/3301424487 shutdown_connections 2023-10-08T17:24:16.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.456+0000 7eff30fff700 1 -- 172.21.15.12:0/3301424487 wait complete. 2023-10-08T17:24:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.458+0000 7eff30fff700 1 Processor -- start 2023-10-08T17:24:16.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.458+0000 7eff30fff700 1 -- start start 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff14003a60 0x7eff2c144d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff2c0c6d30 0x7eff2c169520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c4950 con 0x7eff2c0c3380 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c71a0 con 0x7eff2c0c6d30 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff30fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff2c0c44c0 con 0x7eff14003a60 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40834/0 (socket says 172.21.15.12:40834) 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 -- 172.21.15.12:0/1864289520 learned_addr learned my addr 172.21.15.12:0/1864289520 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff2a59c700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff14003a60 0x7eff2c144d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff2ad9d700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff2c0c6d30 0x7eff2c169520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 -- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff14003a60 msgr2=0x7eff2c144d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff14003a60 0x7eff2c144d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 -- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff2c0c6d30 msgr2=0x7eff2c169520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff2c0c6d30 0x7eff2c169520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.459+0000 7eff29d9b700 1 -- 172.21.15.12:0/1864289520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2c0b1dc0 con 0x7eff2c0c3380 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff29d9b700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff20011da0 tx=0x7eff200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000fa10 con 0x7eff2c0c3380 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000fb70 con 0x7eff2c0c3380 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20014440 con 0x7eff2c0c3380 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff2c1452c0 con 0x7eff2c0c3380 2023-10-08T17:24:16.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.460+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff2c0c3b90 con 0x7eff2c0c3380 2023-10-08T17:24:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.461+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2c04c3c0 con 0x7eff2c0c3380 2023-10-08T17:24:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.462+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 68) v1 ==== 84871+0+0 (secure 0 0 0) 0x7eff20014870 con 0x7eff2c0c3380 2023-10-08T17:24:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.463+0000 7eff1a7fc700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 0x7eff0c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:16.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.463+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6529+0+0 (secure 0 0 0) 0x7eff20018030 con 0x7eff2c0c3380 2023-10-08T17:24:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.463+0000 7eff2a59c700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 0x7eff0c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:16.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.464+0000 7eff2a59c700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 0x7eff0c069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff1c007c20 tx=0x7eff1c015000 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:16.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.467+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff200521a0 con 0x7eff2c0c3380 2023-10-08T17:24:16.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.697+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7eff2c0c4670 con 0x7eff0c0670a0 2023-10-08T17:24:16.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.780+0000 7eff1a7fc700 1 -- 172.21.15.12:0/1864289520 <== mgr.8433 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+42 (secure 0 0 0) 0x7eff2c0c4670 con 0x7eff0c0670a0 2023-10-08T17:24:16.781 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1 2023-10-08T17:24:16.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 msgr2=0x7eff0c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 0x7eff0c069550 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff1c007c20 tx=0x7eff1c015000 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 msgr2=0x7eff2c0c67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7eff20011da0 tx=0x7eff200091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 shutdown_connections 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7eff0c0670a0 0x7eff0c069550 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7eff2c0c6d30 0x7eff2c169520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7eff14003a60 0x7eff2c144d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 --2- 172.21.15.12:0/1864289520 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7eff2c0c3380 0x7eff2c0c67f0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 >> 172.21.15.12:0/1864289520 conn(0x7eff2c06d170 msgr2=0x7eff2c152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 shutdown_connections 2023-10-08T17:24:16.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:16.782+0000 7eff30fff700 1 -- 172.21.15.12:0/1864289520 wait complete. 2023-10-08T17:24:16.801 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1 2023-10-08T17:24:16.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:16.801 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_30_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_31_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_32_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_33_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_34_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_35_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_36_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_37_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_38_00_UTC 2023-10-08T17:24:16.841 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_39_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_40_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_41_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_42_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_43_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_44_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_45_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_46_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_47_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_48_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_49_00_UTC 2023-10-08T17:24:16.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_50_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_51_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_52_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_53_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_54_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_55_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_56_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_57_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_58_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-16_59_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_00_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_01_00_UTC 2023-10-08T17:24:16.843 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_02_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_03_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_04_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_05_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_06_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_07_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_08_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_09_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_10_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_11_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_12_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_13_00_UTC 2023-10-08T17:24:16.844 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_14_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_15_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_16_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_17_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_18_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_19_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_20_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_21_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_22_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_23_00_UTC 2023-10-08T17:24:16.845 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_24_00_UTC 2023-10-08T17:24:16.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_30_00_UTC 2023-10-08T17:24:16.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:16.847 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_30_00_UTC) 2023-10-08T17:24:16.930 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_31_00_UTC 2023-10-08T17:24:16.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:16.931 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_31_00_UTC) 2023-10-08T17:24:17.014 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_32_00_UTC 2023-10-08T17:24:17.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.014 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_32_00_UTC) 2023-10-08T17:24:17.101 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_33_00_UTC 2023-10-08T17:24:17.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.102 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_33_00_UTC) 2023-10-08T17:24:17.145 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_34_00_UTC 2023-10-08T17:24:17.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.145 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_34_00_UTC) 2023-10-08T17:24:17.227 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_35_00_UTC 2023-10-08T17:24:17.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.228 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_35_00_UTC) 2023-10-08T17:24:17.315 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_36_00_UTC 2023-10-08T17:24:17.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.316 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_36_00_UTC) 2023-10-08T17:24:17.359 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_37_00_UTC 2023-10-08T17:24:17.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.359 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_37_00_UTC) 2023-10-08T17:24:17.442 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_38_00_UTC 2023-10-08T17:24:17.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.442 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_38_00_UTC) 2023-10-08T17:24:17.525 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_39_00_UTC 2023-10-08T17:24:17.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.525 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_39_00_UTC) 2023-10-08T17:24:17.609 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_40_00_UTC 2023-10-08T17:24:17.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.609 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_40_00_UTC) 2023-10-08T17:24:17.695 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_41_00_UTC 2023-10-08T17:24:17.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.696 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_41_00_UTC) 2023-10-08T17:24:17.778 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_42_00_UTC 2023-10-08T17:24:17.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.778 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_42_00_UTC) 2023-10-08T17:24:17.861 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_43_00_UTC 2023-10-08T17:24:17.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.862 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_43_00_UTC) 2023-10-08T17:24:17.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_44_00_UTC 2023-10-08T17:24:17.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:17.946 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_44_00_UTC) 2023-10-08T17:24:18.054 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_45_00_UTC 2023-10-08T17:24:18.054 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.054 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_45_00_UTC) 2023-10-08T17:24:18.108 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_46_00_UTC 2023-10-08T17:24:18.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.109 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_46_00_UTC) 2023-10-08T17:24:18.152 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_47_00_UTC 2023-10-08T17:24:18.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.152 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_47_00_UTC) 2023-10-08T17:24:18.235 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_48_00_UTC 2023-10-08T17:24:18.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.235 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_48_00_UTC) 2023-10-08T17:24:18.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_49_00_UTC 2023-10-08T17:24:18.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.319 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_49_00_UTC) 2023-10-08T17:24:18.404 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_50_00_UTC 2023-10-08T17:24:18.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.404 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_50_00_UTC) 2023-10-08T17:24:18.491 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_51_00_UTC 2023-10-08T17:24:18.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.492 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_51_00_UTC) 2023-10-08T17:24:18.575 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_52_00_UTC 2023-10-08T17:24:18.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.575 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_52_00_UTC) 2023-10-08T17:24:18.664 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_53_00_UTC 2023-10-08T17:24:18.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.664 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_53_00_UTC) 2023-10-08T17:24:18.707 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_54_00_UTC 2023-10-08T17:24:18.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.707 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_54_00_UTC) 2023-10-08T17:24:18.790 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_55_00_UTC 2023-10-08T17:24:18.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.791 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_55_00_UTC) 2023-10-08T17:24:18.875 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_56_00_UTC 2023-10-08T17:24:18.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.875 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_56_00_UTC) 2023-10-08T17:24:18.958 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_57_00_UTC 2023-10-08T17:24:18.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:18.959 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_57_00_UTC) 2023-10-08T17:24:19.051 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_58_00_UTC 2023-10-08T17:24:19.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.051 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_58_00_UTC) 2023-10-08T17:24:19.094 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-16_59_00_UTC 2023-10-08T17:24:19.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.094 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-16_59_00_UTC) 2023-10-08T17:24:19.177 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_00_00_UTC 2023-10-08T17:24:19.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.177 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_00_00_UTC) 2023-10-08T17:24:19.260 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_01_00_UTC 2023-10-08T17:24:19.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.260 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_01_00_UTC) 2023-10-08T17:24:19.344 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_02_00_UTC 2023-10-08T17:24:19.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.345 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_02_00_UTC) 2023-10-08T17:24:19.427 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_03_00_UTC 2023-10-08T17:24:19.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.428 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_03_00_UTC) 2023-10-08T17:24:19.511 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_04_00_UTC 2023-10-08T17:24:19.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.511 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_04_00_UTC) 2023-10-08T17:24:19.593 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_05_00_UTC 2023-10-08T17:24:19.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.594 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_05_00_UTC) 2023-10-08T17:24:19.677 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_06_00_UTC 2023-10-08T17:24:19.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.678 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_06_00_UTC) 2023-10-08T17:24:19.761 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_07_00_UTC 2023-10-08T17:24:19.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.762 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_07_00_UTC) 2023-10-08T17:24:19.845 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_08_00_UTC 2023-10-08T17:24:19.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.846 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_08_00_UTC) 2023-10-08T17:24:19.929 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_09_00_UTC 2023-10-08T17:24:19.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:19.929 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_09_00_UTC) 2023-10-08T17:24:20.012 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_10_00_UTC 2023-10-08T17:24:20.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.012 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_10_00_UTC) 2023-10-08T17:24:20.128 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_11_00_UTC 2023-10-08T17:24:20.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.129 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_11_00_UTC) 2023-10-08T17:24:20.197 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_12_00_UTC 2023-10-08T17:24:20.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.198 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_12_00_UTC) 2023-10-08T17:24:20.242 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_13_00_UTC 2023-10-08T17:24:20.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.242 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_13_00_UTC) 2023-10-08T17:24:20.326 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_14_00_UTC 2023-10-08T17:24:20.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.327 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_14_00_UTC) 2023-10-08T17:24:20.410 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_15_00_UTC 2023-10-08T17:24:20.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.410 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_15_00_UTC) 2023-10-08T17:24:20.494 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_16_00_UTC 2023-10-08T17:24:20.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.494 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_16_00_UTC) 2023-10-08T17:24:20.577 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_17_00_UTC 2023-10-08T17:24:20.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.577 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_17_00_UTC) 2023-10-08T17:24:20.660 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_18_00_UTC 2023-10-08T17:24:20.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.660 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_18_00_UTC) 2023-10-08T17:24:20.744 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_19_00_UTC 2023-10-08T17:24:20.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.744 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_19_00_UTC) 2023-10-08T17:24:20.828 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_20_00_UTC 2023-10-08T17:24:20.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.829 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_20_00_UTC) 2023-10-08T17:24:20.913 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_21_00_UTC 2023-10-08T17:24:20.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.913 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_21_00_UTC) 2023-10-08T17:24:20.996 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_22_00_UTC 2023-10-08T17:24:20.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:20.996 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_22_00_UTC) 2023-10-08T17:24:21.092 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_23_00_UTC 2023-10-08T17:24:21.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:21.093 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_23_00_UTC) 2023-10-08T17:24:21.148 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_24_00_UTC 2023-10-08T17:24:21.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:21.148 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_24_00_UTC) 2023-10-08T17:24:21.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:21.192 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T17:24:21.274 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T17:24:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.503+0000 7f3d425ff700 1 Processor -- start 2023-10-08T17:24:21.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.503+0000 7f3d425ff700 1 -- start start 2023-10-08T17:24:21.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.504+0000 7f3d425ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 0x7f3d3c0c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.504+0000 7f3d425ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 0x7f3d3c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.504+0000 7f3d425ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3c0adbc0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.504+0000 7f3d425ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c9d30 con 0x7f3d3c0c8800 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.504+0000 7f3d425ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0acfb0 con 0x7f3d3c0b1150 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3d3c0c8bd0 0x7f3d3c0b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38572/0 (socket says 172.21.15.12:38572) 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3b7fe700 1 -- 172.21.15.12:0/3145421933 learned_addr learned my addr 172.21.15.12:0/3145421933 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3145421933 >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 0x7f3d3c0c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3145421933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 0x7f3d3c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3affd700 1 -- 172.21.15.12:0/3145421933 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865589633 0 0) 0x7f3d3c0adbc0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3affd700 1 -- 172.21.15.12:0/3145421933 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d24003570 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3145421933 >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 msgr2=0x7f3d3c0c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:21.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3145421933 >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 0x7f3d3c0c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3145421933 >> v1:172.21.15.12:6789/0 conn(0x7f3d3c0c8bd0 legacy=0x7f3d3c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3145421933 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3c0ad290 con 0x7f3d3c0b1150 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.505+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3145421933 >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 0x7f3d3c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.506+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3145421933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 0x7f3d3c0ae050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009e60 tx=0x7f3d34009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71c6298f4ac9ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.506+0000 7f3d3affd700 1 -- 172.21.15.12:0/3145421933 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400e070 con 0x7f3d3c0b1150 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.506+0000 7f3d3affd700 1 -- 172.21.15.12:0/3145421933 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3400bab0 con 0x7f3d3c0b1150 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.506+0000 7f3d3affd700 1 -- 172.21.15.12:0/3145421933 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3400be70 con 0x7f3d3c0b1150 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 -- 172.21.15.12:0/3145421933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 msgr2=0x7f3d3c0ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3145421933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 0x7f3d3c0ae050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d34009e60 tx=0x7f3d34009780 comp rx=0 tx=0).stop 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 -- 172.21.15.12:0/3145421933 shutdown_connections 2023-10-08T17:24:21.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3145421933 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0b1150 0x7f3d3c0ae050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3145421933 >> v2:172.21.15.29:3300/0 conn(0x7f3d3c0c8800 0x7f3d3c0c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 -- 172.21.15.12:0/3145421933 >> 172.21.15.12:0/3145421933 conn(0x7f3d3c06d170 msgr2=0x7f3d3c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 -- 172.21.15.12:0/3145421933 shutdown_connections 2023-10-08T17:24:21.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.507+0000 7f3d425ff700 1 -- 172.21.15.12:0/3145421933 wait complete. 2023-10-08T17:24:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.508+0000 7f3d425ff700 1 Processor -- start 2023-10-08T17:24:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.508+0000 7f3d425ff700 1 -- start start 2023-10-08T17:24:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 0x7f3d3c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 0x7f3d3c154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c12b0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c1590 con 0x7f3d3c0b1150 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d425ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3c0c1870 con 0x7f3d3c0c8800 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.509+0000 7f3d40b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40848/0 (socket says 172.21.15.12:40848) 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3414836777 learned_addr learned my addr 172.21.15.12:0/3414836777 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 0x7f3d3c154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 0x7f3d3c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 msgr2=0x7f3d3c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:21.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 0x7f3d3c154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 msgr2=0x7f3d3c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 0x7f3d3c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 -- 172.21.15.12:0/3414836777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c009420 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d3b7fe700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 0x7f3d3c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 0x7f3d3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d40b9c700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3d34013000 tx=0x7f3d34019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d34027470 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d340275f0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d340279b0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.510+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d34009a20 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.511+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3c0c1e30 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.512+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d3c04c3c0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.513+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 68) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f3d34024070 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.513+0000 7f3d23fff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 0x7f3d28069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:21.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.513+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f3d340873e0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.514+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 0x7f3d28069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:21.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.514+0000 7f3d3bfff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 0x7f3d28069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0093f0 tx=0x7f3d2c008040 comp rx=0 tx=0).ready entity=mgr.8433 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:21.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.518+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d34054200 con 0x7f3d3c0c8bd0 2023-10-08T17:24:21.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:21.806+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f3d3c0cc8f0 con 0x7f3d3c0c8bd0 2023-10-08T17:24:22.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.045+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f3d34003040 con 0x7f3d3c0c8bd0 2023-10-08T17:24:22.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.046+0000 7f3d23fff700 1 -- 172.21.15.12:0/3414836777 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v69) v1 ==== 93+0+0 (secure 0 0 0) 0x7f3d34057c90 con 0x7f3d3c0c8bd0 2023-10-08T17:24:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.048+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 msgr2=0x7f3d28069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.048+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 0x7f3d28069550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c0093f0 tx=0x7f3d2c008040 comp rx=0 tx=0).stop 2023-10-08T17:24:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 msgr2=0x7f3d3c0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f3d34013000 tx=0x7f3d34019000 comp rx=0 tx=0).stop 2023-10-08T17:24:22.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 shutdown_connections 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3d280670a0 0x7f3d28069550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3d3c0c8bd0 0x7f3d3c0c27a0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3d3c0b1150 0x7f3d3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 --2- 172.21.15.12:0/3414836777 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3d3c0c8800 0x7f3d3c154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 >> 172.21.15.12:0/3414836777 conn(0x7f3d3c06d170 msgr2=0x7f3d3c159f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 shutdown_connections 2023-10-08T17:24:22.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.049+0000 7f3d425ff700 1 -- 172.21.15.12:0/3414836777 wait complete. 2023-10-08T17:24:22.069 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:24:22.069 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:24:22.157 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:24:22.240 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:24:22.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T17:24:22.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:22.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T17:24:22.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:24:22.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:22.341 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T17:24:22.395 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.605+0000 7fe32759e700 1 Processor -- start 2023-10-08T17:24:22.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.605+0000 7fe32759e700 1 -- start start 2023-10-08T17:24:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.607+0000 7fe32759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe32815b5d0 0x7fe3280c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.607+0000 7fe32759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280ca240 0x7fe3280c6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.607+0000 7fe32759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3280cb4f0 con 0x7fe3280c6ec0 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.607+0000 7fe32759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280ca6e0 con 0x7fe32815b5d0 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.607+0000 7fe32759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3281601e0 con 0x7fe3280ca240 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.608+0000 7fe32659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe32815b5d0 0x7fe3280c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.608+0000 7fe326d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3280c6ec0 0x7fe32806de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47162/0 (socket says 172.21.15.12:47162) 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.608+0000 7fe326d9d700 1 -- 172.21.15.12:0/1741260205 learned_addr learned my addr 172.21.15.12:0/1741260205 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:22.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.608+0000 7fe325d9b700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280ca240 0x7fe3280c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:22.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.609+0000 7fe32659c700 1 -- 172.21.15.12:0/1741260205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280ca240 msgr2=0x7fe3280c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.609+0000 7fe32659c700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280ca240 0x7fe3280c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.609+0000 7fe32659c700 1 -- 172.21.15.12:0/1741260205 >> v1:172.21.15.12:6789/0 conn(0x7fe3280c6ec0 legacy=0x7fe32806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.609+0000 7fe32659c700 1 -- 172.21.15.12:0/1741260205 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32815e390 con 0x7fe32815b5d0 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.609+0000 7fe32659c700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32815b5d0 0x7fe3280c9d00 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe320009e60 tx=0x7fe320009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c89f48f781b134 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.610+0000 7fe32559a700 1 -- 172.21.15.12:0/1741260205 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32000e070 con 0x7fe32815b5d0 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.610+0000 7fe32559a700 1 -- 172.21.15.12:0/1741260205 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32000bb60 con 0x7fe32815b5d0 2023-10-08T17:24:22.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.610+0000 7fe32559a700 1 -- 172.21.15.12:0/1741260205 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320012430 con 0x7fe32815b5d0 2023-10-08T17:24:22.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 -- 172.21.15.12:0/1741260205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32815b5d0 msgr2=0x7fe3280c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32815b5d0 0x7fe3280c9d00 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fe320009e60 tx=0x7fe320009780 comp rx=0 tx=0).stop 2023-10-08T17:24:22.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 -- 172.21.15.12:0/1741260205 shutdown_connections 2023-10-08T17:24:22.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe32815b5d0 0x7fe3280c9d00 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 --2- 172.21.15.12:0/1741260205 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280ca240 0x7fe3280c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 -- 172.21.15.12:0/1741260205 >> 172.21.15.12:0/1741260205 conn(0x7fe32806d170 msgr2=0x7fe3280cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 -- 172.21.15.12:0/1741260205 shutdown_connections 2023-10-08T17:24:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.611+0000 7fe32759e700 1 -- 172.21.15.12:0/1741260205 wait complete. 2023-10-08T17:24:22.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.614+0000 7fe32759e700 1 Processor -- start 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.614+0000 7fe32759e700 1 -- start start 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 0x7fe3280c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe32815b5d0 0x7fe32814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280aeed0 con 0x7fe3280ca240 2023-10-08T17:24:22.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280b17b0 con 0x7fe32815b5d0 2023-10-08T17:24:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280b1a90 con 0x7fe3280c6ec0 2023-10-08T17:24:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe325d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe32659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 0x7fe3280c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe325d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49900/0 (socket says 172.21.15.12:49900) 2023-10-08T17:24:22.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe325d9b700 1 -- 172.21.15.12:0/934790485 learned_addr learned my addr 172.21.15.12:0/934790485 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.616+0000 7fe326d9d700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe32815b5d0 0x7fe32814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe325d9b700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 msgr2=0x7fe3280c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe325d9b700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 0x7fe3280c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe325d9b700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe32815b5d0 msgr2=0x7fe32814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe325d9b700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe32815b5d0 0x7fe32814bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe325d9b700 1 -- 172.21.15.12:0/934790485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe320009a20 con 0x7fe3280ca240 2023-10-08T17:24:22.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.617+0000 7fe32659c700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 0x7fe3280c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:22.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.618+0000 7fe325d9b700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00ec80 tx=0x7fe31c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:22.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.618+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00c850 con 0x7fe3280ca240 2023-10-08T17:24:22.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.619+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00c9b0 con 0x7fe3280ca240 2023-10-08T17:24:22.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.619+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00cd30 con 0x7fe3280ca240 2023-10-08T17:24:22.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.619+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3280b1d70 con 0x7fe3280ca240 2023-10-08T17:24:22.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.619+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3280c44e0 con 0x7fe3280ca240 2023-10-08T17:24:22.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.622+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3280af360 con 0x7fe3280ca240 2023-10-08T17:24:22.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.623+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe31c013680 con 0x7fe3280ca240 2023-10-08T17:24:22.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.624+0000 7fe3167fc700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 0x7fe3080695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:22.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.624+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fe31c084f70 con 0x7fe3280ca240 2023-10-08T17:24:22.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.624+0000 7fe32659c700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 msgr2=0x7fe3080695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:22.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.624+0000 7fe32659c700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 0x7fe3080695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:22.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.631+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3280af360 con 0x7fe3280ca240 2023-10-08T17:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.825+0000 7fe32659c700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 msgr2=0x7fe3080695d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:22.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.825+0000 7fe32659c700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 0x7fe3080695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:22.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.893+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3280af360 con 0x7fe3280ca240 2023-10-08T17:24:22.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.893+0000 7fe3167fc700 1 -- 172.21.15.12:0/934790485 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fe3280af360 con 0x7fe3280ca240 2023-10-08T17:24:22.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:22.895 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T17:24:22.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 msgr2=0x7fe3080695d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 0x7fe3080695d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 msgr2=0x7fe3280c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00ec80 tx=0x7fe31c009120 comp rx=0 tx=0).stop 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 shutdown_connections 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe308067120 0x7fe3080695d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe32815b5d0 0x7fe32814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3280c6ec0 0x7fe3280c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 --2- 172.21.15.12:0/934790485 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3280ca240 0x7fe3280c4f00 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 >> 172.21.15.12:0/934790485 conn(0x7fe32806d170 msgr2=0x7fe32806b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 shutdown_connections 2023-10-08T17:24:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:22.896+0000 7fe32759e700 1 -- 172.21.15.12:0/934790485 wait complete. 2023-10-08T17:24:22.899 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T17:24:22.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:23.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.124+0000 7f05deb9d700 1 Processor -- start 2023-10-08T17:24:23.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.124+0000 7f05deb9d700 1 -- start start 2023-10-08T17:24:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.127+0000 7f05deb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f05d815de50 0x7f05d80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.127+0000 7f05deb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.128+0000 7f05de39c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.128+0000 7f05de39c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52004/0 (socket says 172.21.15.12:52004) 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.128+0000 7f05de39c700 1 -- 172.21.15.12:0/763188680 learned_addr learned my addr 172.21.15.12:0/763188680 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.128+0000 7f05deb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d80cf3c0 con 0x7f05d8153c30 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.129+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d815afd0 con 0x7f05d815de50 2023-10-08T17:24:23.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.129+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d815b2b0 con 0x7f05d80cef40 2023-10-08T17:24:23.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.131+0000 7f05de39c700 1 -- 172.21.15.12:0/763188680 >> v2:172.21.15.29:3300/0 conn(0x7f05d815de50 msgr2=0x7f05d80cea00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-08T17:24:23.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.131+0000 7f05de39c700 1 --2- 172.21.15.12:0/763188680 >> v2:172.21.15.29:3300/0 conn(0x7f05d815de50 0x7f05d80cea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.131+0000 7f05de39c700 1 -- 172.21.15.12:0/763188680 >> v1:172.21.15.29:6789/0 conn(0x7f05d8153c30 legacy=0x7f05d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.131+0000 7f05de39c700 1 -- 172.21.15.12:0/763188680 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d815b590 con 0x7f05d80cef40 2023-10-08T17:24:23.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.132+0000 7f05de39c700 1 --2- 172.21.15.12:0/763188680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009f20 tx=0x7f05d0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a265caa30847273 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:23.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.133+0000 7f05dcb99700 1 -- 172.21.15.12:0/763188680 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000e070 con 0x7f05d80cef40 2023-10-08T17:24:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.134+0000 7f05dcb99700 1 -- 172.21.15.12:0/763188680 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d000ba80 con 0x7f05d80cef40 2023-10-08T17:24:23.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.134+0000 7f05dcb99700 1 -- 172.21.15.12:0/763188680 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d00092e0 con 0x7f05d80cef40 2023-10-08T17:24:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 msgr2=0x7f05d815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 --2- 172.21.15.12:0/763188680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009f20 tx=0x7f05d0009840 comp rx=0 tx=0).stop 2023-10-08T17:24:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 shutdown_connections 2023-10-08T17:24:23.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 --2- 172.21.15.12:0/763188680 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d80cef40 0x7f05d815c070 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 --2- 172.21.15.12:0/763188680 >> v2:172.21.15.29:3300/0 conn(0x7f05d815de50 0x7f05d80cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.135+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 >> 172.21.15.12:0/763188680 conn(0x7f05d80703a0 msgr2=0x7f05d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.137+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 shutdown_connections 2023-10-08T17:24:23.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.137+0000 7f05deb9d700 1 -- 172.21.15.12:0/763188680 wait complete. 2023-10-08T17:24:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.140+0000 7f05deb9d700 1 Processor -- start 2023-10-08T17:24:23.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.140+0000 7f05deb9d700 1 -- start start 2023-10-08T17:24:23.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.142+0000 7f05deb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 0x7f05d816e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.142+0000 7f05deb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.142+0000 7f05deb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 0x7f05d80b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.142+0000 7f05dd39a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05dd39a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52010/0 (socket says 172.21.15.12:52010) 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05dd39a700 1 -- 172.21.15.12:0/338797449 learned_addr learned my addr 172.21.15.12:0/338797449 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d816eea0 con 0x7f05d80cef40 2023-10-08T17:24:23.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80cb1a0 con 0x7f05d815de50 2023-10-08T17:24:23.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05ddb9b700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 0x7f05d816e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05de39c700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 0x7f05d80b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.143+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d80c7dc0 con 0x7f05d8153c30 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05dd39a700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 msgr2=0x7f05d80b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05dd39a700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 0x7f05d80b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05dd39a700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 msgr2=0x7f05d816e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05dd39a700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 0x7f05d816e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05dd39a700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d0009ae0 con 0x7f05d8153c30 2023-10-08T17:24:23.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05ddb9b700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 0x7f05d816e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.144+0000 7f05de39c700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 0x7f05d80b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.145+0000 7f05dd39a700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05c800b5e0 tx=0x7f05c80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:23.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.146+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800f510 con 0x7f05d8153c30 2023-10-08T17:24:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.146+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c800f670 con 0x7f05d8153c30 2023-10-08T17:24:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.146+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d81719f0 con 0x7f05d8153c30 2023-10-08T17:24:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.146+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c800f510 con 0x7f05d8153c30 2023-10-08T17:24:23.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.147+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d8171fb0 con 0x7f05d8153c30 2023-10-08T17:24:23.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.148+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d80cb330 con 0x7f05d8153c30 2023-10-08T17:24:23.150 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.150+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f05c800fa10 con 0x7f05d8153c30 2023-10-08T17:24:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.151+0000 7f05cdffb700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 0x7f05bc069560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.151+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f05c8084280 con 0x7f05d8153c30 2023-10-08T17:24:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.151+0000 7f05ddb9b700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 msgr2=0x7f05bc069560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:23.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.151+0000 7f05ddb9b700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 0x7f05bc069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.160+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c8054a90 con 0x7f05d8153c30 2023-10-08T17:24:23.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.353+0000 7f05ddb9b700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 msgr2=0x7f05bc069560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:23.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.353+0000 7f05ddb9b700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 0x7f05bc069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:23.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.364+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05d804c3c0 con 0x7f05d8153c30 2023-10-08T17:24:23.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.365+0000 7f05cdffb700 1 -- 172.21.15.12:0/338797449 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f05c8054620 con 0x7f05d8153c30 2023-10-08T17:24:23.367 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:23.367 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":155,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:23.040130+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.1a","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/1341227476":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3320169592":"2023-10-09T16:28:39.632104+0000","172.21.15.12:6837/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3070795098":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3780451095":"2023-10-09T16:28:39.632104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":54,"length":4},{"begin":110,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:23.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 msgr2=0x7f05bc069560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:23.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 0x7f05bc069560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 msgr2=0x7f05d80b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f05c800b5e0 tx=0x7f05c80090f0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 shutdown_connections 2023-10-08T17:24:23.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc0670b0 0x7f05bc069560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d80cef40 0x7f05d816e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d815de50 0x7f05d80b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 --2- 172.21.15.12:0/338797449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d8153c30 0x7f05d80b32d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 >> 172.21.15.12:0/338797449 conn(0x7f05d80703a0 msgr2=0x7f05d80b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:23.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 shutdown_connections 2023-10-08T17:24:23.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.368+0000 7f05deb9d700 1 -- 172.21.15.12:0/338797449 wait complete. 2023-10-08T17:24:23.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T16:28:21.503390+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T16:28:22.733877+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 113, 'snap_epoch': 155, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T17:24:23.388 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:24:23.493 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:23.493+0000 7fa711123180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:24:23.512 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:23.511+0000 7f6052a87180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:24:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.582+0000 7fcaf519d700 1 Processor -- start 2023-10-08T17:24:23.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.582+0000 7fcaf519d700 1 -- start start 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.583+0000 7fcaf519d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcaf0153a00 0x7fcaf0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.583+0000 7fcaf519d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcaf00cea00 0x7fcaf00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.583+0000 7fcaf519d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf015ac50 con 0x7fcaf015de50 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.583+0000 7fcaf519d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf015d010 con 0x7fcaf00cea00 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.583+0000 7fcaf519d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00cf3c0 con 0x7fcaf0153a00 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcaf00cea00 0x7fcaf00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcaf00cea00 0x7fcaf00cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49918/0 (socket says 172.21.15.12:49918) 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 -- 172.21.15.12:0/2797113596 learned_addr learned my addr 172.21.15.12:0/2797113596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaef7fe700 1 --1- 172.21.15.12:0/2797113596 >> v1:172.21.15.12:6789/0 conn(0x7fcaf015de50 0x7fcaf015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47178/0 (socket says 172.21.15.12:47178) 2023-10-08T17:24:23.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaeffff700 1 --2- 172.21.15.12:0/2797113596 >> v2:172.21.15.29:3300/0 conn(0x7fcaf0153a00 0x7fcaf0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 -- 172.21.15.12:0/2797113596 >> v2:172.21.15.29:3300/0 conn(0x7fcaf0153a00 msgr2=0x7fcaf0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 --2- 172.21.15.12:0/2797113596 >> v2:172.21.15.29:3300/0 conn(0x7fcaf0153a00 0x7fcaf0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 -- 172.21.15.12:0/2797113596 >> v1:172.21.15.12:6789/0 conn(0x7fcaf015de50 legacy=0x7fcaf015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 -- 172.21.15.12:0/2797113596 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf015af60 con 0x7fcaf00cea00 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.584+0000 7fcaf499c700 1 --2- 172.21.15.12:0/2797113596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf00cee80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00cac20 tx=0x7fcae8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862262fd5e9a6943 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:23.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaeeffd700 1 -- 172.21.15.12:0/2797113596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae800e070 con 0x7fcaf00cea00 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaeeffd700 1 -- 172.21.15.12:0/2797113596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae800ba20 con 0x7fcaf00cea00 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaeeffd700 1 -- 172.21.15.12:0/2797113596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80092e0 con 0x7fcaf00cea00 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 -- 172.21.15.12:0/2797113596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 msgr2=0x7fcaf00cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2797113596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf00cee80 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00cac20 tx=0x7fcae8009840 comp rx=0 tx=0).stop 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 -- 172.21.15.12:0/2797113596 shutdown_connections 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2797113596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf00cee80 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2797113596 >> v2:172.21.15.29:3300/0 conn(0x7fcaf0153a00 0x7fcaf0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 -- 172.21.15.12:0/2797113596 >> 172.21.15.12:0/2797113596 conn(0x7fcaf00703a0 msgr2=0x7fcaf00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.585+0000 7fcaf519d700 1 -- 172.21.15.12:0/2797113596 shutdown_connections 2023-10-08T17:24:23.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.586+0000 7fcaf519d700 1 -- 172.21.15.12:0/2797113596 wait complete. 2023-10-08T17:24:23.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.587+0000 7fcaf519d700 1 Processor -- start 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.587+0000 7fcaf519d700 1 -- start start 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf0153a00 0x7fcaf00cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf015de50 0x7fcaf0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00cbbe0 con 0x7fcaf00cea00 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00cb2f0 con 0x7fcaf015de50 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.588+0000 7fcaf519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf0156be0 con 0x7fcaf0153a00 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49932/0 (socket says 172.21.15.12:49932) 2023-10-08T17:24:23.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 -- 172.21.15.12:0/2743259666 learned_addr learned my addr 172.21.15.12:0/2743259666 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaef7fe700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf0153a00 0x7fcaf00cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaf499c700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf015de50 0x7fcaf0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf0153a00 msgr2=0x7fcaf00cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf0153a00 0x7fcaf00cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf015de50 msgr2=0x7fcaf0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf015de50 0x7fcaf0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 -- 172.21.15.12:0/2743259666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8009ae0 con 0x7fcaf00cea00 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.589+0000 7fcaeffff700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcae000ec80 tx=0x7fcae00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:23.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.590+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000c850 con 0x7fcaf00cea00 2023-10-08T17:24:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.590+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae000c9b0 con 0x7fcaf00cea00 2023-10-08T17:24:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.590+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf00cb590 con 0x7fcaf00cea00 2023-10-08T17:24:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.590+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae000cd50 con 0x7fcaf00cea00 2023-10-08T17:24:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.590+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0154990 con 0x7fcaf00cea00 2023-10-08T17:24:23.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.591+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf00cbec0 con 0x7fcaf00cea00 2023-10-08T17:24:23.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.593+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fcae0013680 con 0x7fcaf00cea00 2023-10-08T17:24:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.594+0000 7fcad7fff700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 0x7fcadc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.594+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fcae0084c80 con 0x7fcaf00cea00 2023-10-08T17:24:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.594+0000 7fcaef7fe700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 msgr2=0x7fcadc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:23.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.594+0000 7fcaef7fe700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 0x7fcadc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:23.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.598+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcae0051a00 con 0x7fcaf00cea00 2023-10-08T17:24:23.665 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:23.665+0000 7fa711123180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:23.689 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:23.688+0000 7f6052a87180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:23.753 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:23.753+0000 7fa711123180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:24:23.778 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:23.777+0000 7f6052a87180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:24:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.795+0000 7fcaef7fe700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 msgr2=0x7fcadc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.795+0000 7fcaef7fe700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 0x7fcadc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:23.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.802+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcaf015d1a0 con 0x7fcaf00cea00 2023-10-08T17:24:23.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.802+0000 7fcad7fff700 1 -- 172.21.15.12:0/2743259666 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v155) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcae0055020 con 0x7fcaf00cea00 2023-10-08T17:24:23.803 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:24:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 msgr2=0x7fcadc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 0x7fcadc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 msgr2=0x7fcaf01509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcae000ec80 tx=0x7fcae00091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 shutdown_connections 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcadc067050 0x7fcadc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcaf00cea00 0x7fcaf01509e0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcaf015de50 0x7fcaf0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 --2- 172.21.15.12:0/2743259666 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcaf0153a00 0x7fcaf00cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 >> 172.21.15.12:0/2743259666 conn(0x7fcaf00703a0 msgr2=0x7fcaf00b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 shutdown_connections 2023-10-08T17:24:23.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:23.805+0000 7fcaf519d700 1 -- 172.21.15.12:0/2743259666 wait complete. 2023-10-08T17:24:23.824 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T17:24:23.985 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:23.985+0000 7fa711123180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:24.023 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:24.022+0000 7f6052a87180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:24.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.024+0000 7fc17ffff700 1 Processor -- start 2023-10-08T17:24:24.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.025+0000 7fc17ffff700 1 -- start start 2023-10-08T17:24:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17ffff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc180153dd0 0x7fc18015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc18015ac50 con 0x7fc180153a00 2023-10-08T17:24:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17ffff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18015d010 con 0x7fc180153dd0 2023-10-08T17:24:24.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800cf3e0 con 0x7fc1800cea00 2023-10-08T17:24:24.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17e7fc700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc180153dd0 0x7fc18015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52030/0 (socket says 172.21.15.12:52030) 2023-10-08T17:24:24.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.026+0000 7fc17f7fe700 1 -- 172.21.15.12:0/3462549492 learned_addr learned my addr 172.21.15.12:0/3462549492 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17e7fc700 1 -- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 msgr2=0x7fc1800ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17e7fc700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17e7fc700 1 -- 172.21.15.12:0/3462549492 >> v1:172.21.15.29:6789/0 conn(0x7fc180153a00 legacy=0x7fc18015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17e7fc700 1 -- 172.21.15.12:0/3462549492 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc18015af60 con 0x7fc180153dd0 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17f7fe700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17e7fc700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc18015de50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098e0 tx=0x7fc1740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b508c1a8cfa43cbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17dffb700 1 -- 172.21.15.12:0/3462549492 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400b640 con 0x7fc180153dd0 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17dffb700 1 -- 172.21.15.12:0/3462549492 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400b7a0 con 0x7fc180153dd0 2023-10-08T17:24:24.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.027+0000 7fc17dffb700 1 -- 172.21.15.12:0/3462549492 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17400bb40 con 0x7fc180153dd0 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 -- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 msgr2=0x7fc18015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc18015de50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098e0 tx=0x7fc1740091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 -- 172.21.15.12:0/3462549492 shutdown_connections 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc1800ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 --2- 172.21.15.12:0/3462549492 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc18015de50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 -- 172.21.15.12:0/3462549492 >> 172.21.15.12:0/3462549492 conn(0x7fc1800703a0 msgr2=0x7fc1800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 -- 172.21.15.12:0/3462549492 shutdown_connections 2023-10-08T17:24:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.028+0000 7fc17ffff700 1 -- 172.21.15.12:0/3462549492 wait complete. 2023-10-08T17:24:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.030+0000 7fc17ffff700 1 Processor -- start 2023-10-08T17:24:24.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.030+0000 7fc17ffff700 1 -- start start 2023-10-08T17:24:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc180150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc1800ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc180156230 con 0x7fc180153a00 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1800c8920 con 0x7fc180153dd0 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc180155190 con 0x7fc1800cea00 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17effd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc180150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49948/0 (socket says 172.21.15.12:49948) 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 -- 172.21.15.12:0/2688848512 learned_addr learned my addr 172.21.15.12:0/2688848512 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17f7fe700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc1800ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 msgr2=0x7fc180150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc180150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 msgr2=0x7fc1800ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.031+0000 7fc17e7fc700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc1800ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc17e7fc700 1 -- 172.21.15.12:0/2688848512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc178009ae0 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc17e7fc700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc174013000 tx=0x7fc174017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc17401bc40 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17401bdc0 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc174009420 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174011670 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.032+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc180155a30 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.034+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1800ce270 con 0x7fc180153a00 2023-10-08T17:24:24.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.034+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fc174011a20 con 0x7fc180153a00 2023-10-08T17:24:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.035+0000 7fc166ffd700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 0x7fc16c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.035+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fc174085ed0 con 0x7fc180153a00 2023-10-08T17:24:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.035+0000 7fc17effd700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 msgr2=0x7fc16c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:24.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.035+0000 7fc17effd700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 0x7fc16c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:24.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.039+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc174052cf0 con 0x7fc180153a00 2023-10-08T17:24:24.173 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:24.173+0000 7fa711123180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:24:24.215 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:24.214+0000 7f6052a87180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:24:24.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.236+0000 7fc17effd700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 msgr2=0x7fc16c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:24.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.236+0000 7fc17effd700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 0x7fc16c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:24.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.245+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc18004c3c0 con 0x7fc180153a00 2023-10-08T17:24:24.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.245+0000 7fc166ffd700 1 -- 172.21.15.12:0/2688848512 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v155) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc174056310 con 0x7fc180153a00 2023-10-08T17:24:24.246 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T17:24:24.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 msgr2=0x7fc16c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:24.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 0x7fc16c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 msgr2=0x7fc180156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fc174013000 tx=0x7fc174017000 comp rx=0 tx=0).stop 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 shutdown_connections 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc16c067050 0x7fc16c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc180153dd0 0x7fc1800ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc1800cea00 0x7fc180150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 --2- 172.21.15.12:0/2688848512 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc180153a00 0x7fc180156980 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 >> 172.21.15.12:0/2688848512 conn(0x7fc1800703a0 msgr2=0x7fc180151fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 shutdown_connections 2023-10-08T17:24:24.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.248+0000 7fc17ffff700 1 -- 172.21.15.12:0/2688848512 wait complete. 2023-10-08T17:24:24.269 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T17:24:24.270 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:24.268+0000 7fa711123180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:24:24.314 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:24.313+0000 7f6052a87180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:24:24.437 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:24.437+0000 7fa711123180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:24:24.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.465+0000 7f7bd199d700 1 Processor -- start 2023-10-08T17:24:24.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.466+0000 7f7bd199d700 1 -- start start 2023-10-08T17:24:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 0x7f7bcc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd199d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc15ac50 con 0x7f7bcc153a00 2023-10-08T17:24:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd199d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bcc15d010 con 0x7f7bcc153dd0 2023-10-08T17:24:24.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc15af60 con 0x7f7bcc0cf110 2023-10-08T17:24:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd099b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7bcc153a00 0x7f7bcc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47190/0 (socket says 172.21.15.12:47190) 2023-10-08T17:24:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd099b700 1 -- 172.21.15.12:0/3984593649 learned_addr learned my addr 172.21.15.12:0/3984593649 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:24.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.467+0000 7f7bd119c700 1 --2- 172.21.15.12:0/3984593649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 0x7f7bcc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444671904 0 0) 0x7f7bcc15ac50 con 0x7f7bcc153a00 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bbc003570 con 0x7f7bcc153a00 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134980481 0 0) 0x7f7bcc15d010 con 0x7f7bcc153dd0 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bcc15ac50 con 0x7f7bcc153dd0 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bd119c700 1 -- 172.21.15.12:0/3984593649 >> v1:172.21.15.29:6789/0 conn(0x7f7bcc153dd0 legacy=0x7f7bcc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bd119c700 1 -- 172.21.15.12:0/3984593649 >> v1:172.21.15.12:6789/0 conn(0x7f7bcc153a00 legacy=0x7f7bcc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bd119c700 1 -- 172.21.15.12:0/3984593649 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc15b240 con 0x7f7bcc0cf110 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bd119c700 1 --2- 172.21.15.12:0/3984593649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 0x7f7bcc15de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009e90 tx=0x7f7bc4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f8f307be535e70e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.468+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc400e070 con 0x7f7bcc0cf110 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400bb40 con 0x7f7bcc0cf110 2023-10-08T17:24:24.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bcb7fe700 1 -- 172.21.15.12:0/3984593649 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4012430 con 0x7f7bcc0cf110 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 -- 172.21.15.12:0/3984593649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 msgr2=0x7f7bcc15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 --2- 172.21.15.12:0/3984593649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 0x7f7bcc15de50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009e90 tx=0x7f7bc4009780 comp rx=0 tx=0).stop 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 -- 172.21.15.12:0/3984593649 shutdown_connections 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 --2- 172.21.15.12:0/3984593649 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc0cf110 0x7f7bcc15de50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 -- 172.21.15.12:0/3984593649 >> 172.21.15.12:0/3984593649 conn(0x7f7bcc0703a0 msgr2=0x7f7bcc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 -- 172.21.15.12:0/3984593649 shutdown_connections 2023-10-08T17:24:24.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.469+0000 7f7bd199d700 1 -- 172.21.15.12:0/3984593649 wait complete. 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.471+0000 7f7bd199d700 1 Processor -- start 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.471+0000 7f7bd199d700 1 -- start start 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 0x7f7bcc152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc153dd0 0x7f7bcc1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c88c0 con 0x7f7bcc0cf110 2023-10-08T17:24:24.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c7f90 con 0x7f7bcc153a00 2023-10-08T17:24:24.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd199d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0c8270 con 0x7f7bcc153dd0 2023-10-08T17:24:24.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49956/0 (socket says 172.21.15.12:49956) 2023-10-08T17:24:24.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 -- 172.21.15.12:0/4180091636 learned_addr learned my addr 172.21.15.12:0/4180091636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:24.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd119c700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc153dd0 0x7f7bcc1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bcbfff700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 0x7f7bcc152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc153dd0 msgr2=0x7f7bcc1531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc153dd0 0x7f7bcc1531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 msgr2=0x7f7bcc152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 0x7f7bcc152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bd099b700 1 -- 172.21.15.12:0/4180091636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4009a20 con 0x7f7bcc0cf110 2023-10-08T17:24:24.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.472+0000 7f7bcbfff700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 0x7f7bcc152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:24.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bd099b700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7c0 tx=0x7f7bc0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0005b30 con 0x7f7bcc0cf110 2023-10-08T17:24:24.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0005cb0 con 0x7f7bcc0cf110 2023-10-08T17:24:24.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc0c8550 con 0x7f7bcc0cf110 2023-10-08T17:24:24.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007320 con 0x7f7bcc0cf110 2023-10-08T17:24:24.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.473+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc0c8d50 con 0x7f7bcc0cf110 2023-10-08T17:24:24.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.474+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc04c3c0 con 0x7f7bcc0cf110 2023-10-08T17:24:24.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.475+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f7bc001b3b0 con 0x7f7bcc0cf110 2023-10-08T17:24:24.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.476+0000 7f7bc8ff9700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 0x7f7bb0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.476+0000 7f7bcbfff700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 msgr2=0x7f7bb0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:24.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.476+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f7bc0083f90 con 0x7f7bcc0cf110 2023-10-08T17:24:24.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.476+0000 7f7bcbfff700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 0x7f7bb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:24.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.484+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bc0050d10 con 0x7f7bcc0cf110 2023-10-08T17:24:24.490 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:24.489+0000 7f6052a87180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:24:24.542 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:24.542+0000 7fa711123180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:24.595 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:24.594+0000 7f6052a87180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.677+0000 7f7bcbfff700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 msgr2=0x7f7bb0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:24.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.677+0000 7f7bcbfff700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 0x7f7bb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:24.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.688+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7bcc15b520 con 0x7f7bcc0cf110 2023-10-08T17:24:24.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.688+0000 7f7bc8ff9700 1 -- 172.21.15.12:0/4180091636 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v155) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7bc0017020 con 0x7f7bcc0cf110 2023-10-08T17:24:24.689 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T17:24:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 msgr2=0x7f7bb0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 0x7f7bb0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 msgr2=0x7f7bcc158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c7c0 tx=0x7f7bc0007e00 comp rx=0 tx=0).stop 2023-10-08T17:24:24.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 shutdown_connections 2023-10-08T17:24:24.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7bb0067050 0x7f7bb0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7bcc0cf110 0x7f7bcc158770 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7bcc153dd0 0x7f7bcc1531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 --2- 172.21.15.12:0/4180091636 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7bcc153a00 0x7f7bcc152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.690+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 >> 172.21.15.12:0/4180091636 conn(0x7f7bcc0703a0 msgr2=0x7f7bcc0ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:24.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.691+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 shutdown_connections 2023-10-08T17:24:24.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.691+0000 7f7bd199d700 1 -- 172.21.15.12:0/4180091636 wait complete. 2023-10-08T17:24:24.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.942+0000 7f363339d700 1 Processor -- start 2023-10-08T17:24:24.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.942+0000 7f363339d700 1 -- start start 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.943+0000 7f363339d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f362c15de50 0x7f362c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.943+0000 7f363339d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c0cef40 0x7f362c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.943+0000 7f363339d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c0cf3c0 con 0x7f362c153c30 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.943+0000 7f363339d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c15afd0 con 0x7f362c15de50 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.943+0000 7f363339d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c15b2b0 con 0x7f362c0cef40 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631b9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f362c15de50 0x7f362c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f363239b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f362c153c30 0x7f362c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47202/0 (socket says 172.21.15.12:47202) 2023-10-08T17:24:24.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f363239b700 1 -- 172.21.15.12:0/864682548 learned_addr learned my addr 172.21.15.12:0/864682548 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3632b9c700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c0cef40 0x7f362c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631b9a700 1 -- 172.21.15.12:0/864682548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c0cef40 msgr2=0x7f362c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631b9a700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c0cef40 0x7f362c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631399700 1 -- 172.21.15.12:0/864682548 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029406708 0 0) 0x7f362c0cf3c0 con 0x7f362c153c30 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631b9a700 1 -- 172.21.15.12:0/864682548 >> v1:172.21.15.12:6789/0 conn(0x7f362c153c30 legacy=0x7f362c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.944+0000 7f3631b9a700 1 -- 172.21.15.12:0/864682548 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c15b590 con 0x7f362c15de50 2023-10-08T17:24:24.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f3631b9a700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c15de50 0x7f362c0cea00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f361c0098e0 tx=0x7f361c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadb196e815ba1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f3631399700 1 -- 172.21.15.12:0/864682548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00b640 con 0x7f362c15de50 2023-10-08T17:24:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f3631399700 1 -- 172.21.15.12:0/864682548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c00b7a0 con 0x7f362c15de50 2023-10-08T17:24:24.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f3631399700 1 -- 172.21.15.12:0/864682548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c00bb40 con 0x7f362c15de50 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f363339d700 1 -- 172.21.15.12:0/864682548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c15de50 msgr2=0x7f362c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.945+0000 7f363339d700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c15de50 0x7f362c0cea00 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f361c0098e0 tx=0x7f361c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 -- 172.21.15.12:0/864682548 shutdown_connections 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c0cef40 0x7f362c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 --2- 172.21.15.12:0/864682548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c15de50 0x7f362c0cea00 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 -- 172.21.15.12:0/864682548 >> 172.21.15.12:0/864682548 conn(0x7f362c0703a0 msgr2=0x7f362c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 -- 172.21.15.12:0/864682548 shutdown_connections 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.946+0000 7f363339d700 1 -- 172.21.15.12:0/864682548 wait complete. 2023-10-08T17:24:24.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.947+0000 7f363339d700 1 Processor -- start 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.947+0000 7f363339d700 1 -- start start 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c153c30 0x7f362c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f362c15de50 0x7f362c16a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0cbec0 con 0x7f362c0cef40 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0cb2b0 con 0x7f362c15de50 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363339d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0cb590 con 0x7f362c153c30 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363239b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49970/0 (socket says 172.21.15.12:49970) 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f363239b700 1 -- 172.21.15.12:0/1073603688 learned_addr learned my addr 172.21.15.12:0/1073603688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:24.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.948+0000 7f3631b9a700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c153c30 0x7f362c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f3632b9c700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f362c15de50 0x7f362c16a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c153c30 msgr2=0x7f362c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c153c30 0x7f362c0cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f362c15de50 msgr2=0x7f362c16a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f362c15de50 0x7f362c16a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 -- 172.21.15.12:0/1073603688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361c009420 con 0x7f362c0cef40 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363239b700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f362800c7e0 tx=0x7f3628007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628005b30 con 0x7f362c0cef40 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3628005c90 con 0x7f362c0cef40 2023-10-08T17:24:24.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628007300 con 0x7f362c0cef40 2023-10-08T17:24:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.949+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c0cb870 con 0x7f362c0cef40 2023-10-08T17:24:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.950+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c13e010 con 0x7f362c0cef40 2023-10-08T17:24:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.951+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c0cc1a0 con 0x7f362c0cef40 2023-10-08T17:24:24.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.952+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f362801b3b0 con 0x7f362c0cef40 2023-10-08T17:24:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.953+0000 7f36227fc700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 0x7f3610069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.953+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f3628083fb0 con 0x7f362c0cef40 2023-10-08T17:24:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.953+0000 7f3631b9a700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 msgr2=0x7f3610069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:24.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.953+0000 7f3631b9a700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 0x7f3610069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:24.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:24.957+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3628050d30 con 0x7f362c0cef40 2023-10-08T17:24:25.046 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:25.046+0000 7fa711123180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:24:25.105 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:25.104+0000 7f6052a87180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:24:25.145 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:25.145+0000 7fa711123180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:24:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.154+0000 7f3631b9a700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 msgr2=0x7f3610069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:25.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.154+0000 7f3631b9a700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 0x7f3610069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:25.203 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:25.202+0000 7f6052a87180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:24:25.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.208+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f362c04c3c0 con 0x7f362c0cef40 2023-10-08T17:24:25.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.208+0000 7f36227fc700 1 -- 172.21.15.12:0/1073603688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3628017020 con 0x7f362c0cef40 2023-10-08T17:24:25.209 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:25.209 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T17:24:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 msgr2=0x7f3610069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 0x7f3610069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 msgr2=0x7f362c13dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f362800c7e0 tx=0x7f3628007df0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 shutdown_connections 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3610067050 0x7f3610069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f362c0cef40 0x7f362c13dad0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f362c15de50 0x7f362c16a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 --2- 172.21.15.12:0/1073603688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f362c153c30 0x7f362c0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 >> 172.21.15.12:0/1073603688 conn(0x7f362c0703a0 msgr2=0x7f362c0c6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 shutdown_connections 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.211+0000 7f363339d700 1 -- 172.21.15.12:0/1073603688 wait complete. 2023-10-08T17:24:25.213 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T17:24:25.230 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:25.239 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:25.239+0000 7fa711123180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:24:25.306 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:25.305+0000 7f6052a87180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:24:25.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.424+0000 7f52e999d700 1 Processor -- start 2023-10-08T17:24:25.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.424+0000 7f52e999d700 1 -- start start 2023-10-08T17:24:25.924 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:25.887+0000 7fa711123180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.426+0000 7f52e999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52e4159a10 0x7f52e40ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.426+0000 7f52e999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52e4070410 0x7f52e40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.426+0000 7f52e999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52e40c7420 con 0x7f52e4159640 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.426+0000 7f52e999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e406d820 con 0x7f52e4070410 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.426+0000 7f52e999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52e406db00 con 0x7f52e4159a10 2023-10-08T17:24:25.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52e4070410 0x7f52e40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52e4070410 0x7f52e40cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49980/0 (socket says 172.21.15.12:49980) 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 -- 172.21.15.12:0/2168153020 learned_addr learned my addr 172.21.15.12:0/2168153020 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e3fff700 1 --2- 172.21.15.12:0/2168153020 >> v2:172.21.15.29:3300/0 conn(0x7f52e4159a10 0x7f52e40ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 -- 172.21.15.12:0/2168153020 >> v2:172.21.15.29:3300/0 conn(0x7f52e4159a10 msgr2=0x7f52e40ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 --2- 172.21.15.12:0/2168153020 >> v2:172.21.15.29:3300/0 conn(0x7f52e4159a10 0x7f52e40ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 -- 172.21.15.12:0/2168153020 >> v1:172.21.15.29:6789/0 conn(0x7f52e4159640 legacy=0x7f52e406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.427+0000 7f52e919c700 1 -- 172.21.15.12:0/2168153020 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52e406dde0 con 0x7f52e4070410 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.428+0000 7f52e919c700 1 --2- 172.21.15.12:0/2168153020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40cacf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f52e406a270 tx=0x7f52dc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f622c27b6f9538cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.428+0000 7f52e37fe700 1 -- 172.21.15.12:0/2168153020 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc00e070 con 0x7f52e4070410 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.428+0000 7f52e37fe700 1 -- 172.21.15.12:0/2168153020 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52dc00ba20 con 0x7f52e4070410 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.428+0000 7f52e37fe700 1 -- 172.21.15.12:0/2168153020 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0092e0 con 0x7f52e4070410 2023-10-08T17:24:25.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 -- 172.21.15.12:0/2168153020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 msgr2=0x7f52e40cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 --2- 172.21.15.12:0/2168153020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40cacf0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f52e406a270 tx=0x7f52dc009840 comp rx=0 tx=0).stop 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 -- 172.21.15.12:0/2168153020 shutdown_connections 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 --2- 172.21.15.12:0/2168153020 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40cacf0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 --2- 172.21.15.12:0/2168153020 >> v2:172.21.15.29:3300/0 conn(0x7f52e4159a10 0x7f52e40ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 -- 172.21.15.12:0/2168153020 >> 172.21.15.12:0/2168153020 conn(0x7f52e406e720 msgr2=0x7f52e406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 -- 172.21.15.12:0/2168153020 shutdown_connections 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.429+0000 7f52e999d700 1 -- 172.21.15.12:0/2168153020 wait complete. 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.430+0000 7f52e999d700 1 Processor -- start 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.430+0000 7f52e999d700 1 -- start start 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e4159640 0x7f52e40b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52e4159a10 0x7f52e4153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40c6860 con 0x7f52e4070410 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52e40c55a0 con 0x7f52e4159640 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.431+0000 7f52e999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52e4153650 con 0x7f52e4159a10 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49996/0 (socket says 172.21.15.12:49996) 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 -- 172.21.15.12:0/4104173025 learned_addr learned my addr 172.21.15.12:0/4104173025 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e919c700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52e4159a10 0x7f52e4153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e3fff700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e4159640 0x7f52e40b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52e4159a10 msgr2=0x7f52e4153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52e4159a10 0x7f52e4153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e4159640 msgr2=0x7f52e40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e4159640 0x7f52e40b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 -- 172.21.15.12:0/4104173025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc009ae0 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.432+0000 7f52e899b700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c590 tx=0x7f52d800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.433+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011590 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.433+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d8011710 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.433+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d8011ad0 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.433+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52e40c4c70 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.433+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52e40c5230 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.434+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52e404c3c0 con 0x7f52e4070410 2023-10-08T17:24:25.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.435+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f52d801b3b0 con 0x7f52e4070410 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.436+0000 7f52e0ff9700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 0x7f52c8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.436+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f52d8083f00 con 0x7f52e4070410 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.439+0000 7f52e3fff700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 msgr2=0x7f52c8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.439+0000 7f52e3fff700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 0x7f52c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.440+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52d8050c80 con 0x7f52e4070410 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.640+0000 7f52e3fff700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 msgr2=0x7f52c8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.640+0000 7f52e3fff700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 0x7f52c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.644+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52e40c53c0 con 0x7f52e4070410 2023-10-08T17:24:25.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.645+0000 7f52e0ff9700 1 -- 172.21.15.12:0/4104173025 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16684 (secure 0 0 0) 0x7f52d8017070 con 0x7f52e4070410 2023-10-08T17:24:25.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:25.934 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":155,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:23.040130+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.1a","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/1341227476":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3320169592":"2023-10-09T16:28:39.632104+0000","172.21.15.12:6837/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3070795098":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3780451095":"2023-10-09T16:28:39.632104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":54,"length":4},{"begin":110,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 msgr2=0x7f52c8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 0x7f52c8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 msgr2=0x7f52e40c43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f52d800c590 tx=0x7f52d800c8a0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 shutdown_connections 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f52c8067050 0x7f52c8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52e4070410 0x7f52e40c43c0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52e4159a10 0x7f52e4153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 --2- 172.21.15.12:0/4104173025 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52e4159640 0x7f52e40b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:25.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.647+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 >> 172.21.15.12:0/4104173025 conn(0x7f52e406e720 msgr2=0x7f52e41575d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:25.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.648+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 shutdown_connections 2023-10-08T17:24:25.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:25.648+0000 7f52e999d700 1 -- 172.21.15.12:0/4104173025 wait complete. 2023-10-08T17:24:25.939 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:24:25.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:25.963 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:25.963+0000 7f6052a87180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:24:26.067 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:26.067+0000 7fa711123180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.128+0000 7f2ca3fff700 1 Processor -- start 2023-10-08T17:24:26.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.128+0000 7f2ca3fff700 1 -- start start 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c9c0b1b20 0x7f2c9c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c158210 con 0x7f2c9c1579d0 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9c0cb290 con 0x7f2c9c157600 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9c0cb850 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca159a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c9c0b1b20 0x7f2c9c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c9c1579d0 0x7f2c9c161800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47218/0 (socket says 172.21.15.12:47218) 2023-10-08T17:24:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca259c700 1 -- 172.21.15.12:0/2300824075 learned_addr learned my addr 172.21.15.12:0/2300824075 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.130+0000 7f2ca1d9b700 1 --1- 172.21.15.12:0/2300824075 >> v1:172.21.15.29:6789/0 conn(0x7f2c9c157600 0x7f2c9c0b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:57828/0 (socket says 172.21.15.12:57828) 2023-10-08T17:24:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272918085 0 0) 0x7f2c9c158210 con 0x7f2c9c1579d0 2023-10-08T17:24:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c88003570 con 0x7f2c9c1579d0 2023-10-08T17:24:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494631848 0 0) 0x7f2c9c0cb290 con 0x7f2c9c157600 2023-10-08T17:24:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c9c158210 con 0x7f2c9c157600 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca159a700 1 -- 172.21.15.12:0/2300824075 >> v1:172.21.15.29:6789/0 conn(0x7f2c9c157600 legacy=0x7f2c9c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca159a700 1 -- 172.21.15.12:0/2300824075 >> v1:172.21.15.12:6789/0 conn(0x7f2c9c1579d0 legacy=0x7f2c9c161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca159a700 1 -- 172.21.15.12:0/2300824075 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c0cb570 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca159a700 1 --2- 172.21.15.12:0/2300824075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c15f2b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0098e0 tx=0x7f2c8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d674bffbbc00df50 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c011630 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8c011790 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.131+0000 7f2ca0d99700 1 -- 172.21.15.12:0/2300824075 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c011b30 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2300824075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 msgr2=0x7f2c9c15f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2300824075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c15f2b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c0098e0 tx=0x7f2c8c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2300824075 shutdown_connections 2023-10-08T17:24:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2300824075 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c15f2b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2300824075 >> 172.21.15.12:0/2300824075 conn(0x7f2c9c06d170 msgr2=0x7f2c9c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2300824075 shutdown_connections 2023-10-08T17:24:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.132+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2300824075 wait complete. 2023-10-08T17:24:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.134+0000 7f2ca3fff700 1 Processor -- start 2023-10-08T17:24:26.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.135+0000 7f2ca3fff700 1 -- start start 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c9c157600 0x7f2c9c15add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9c1579d0 0x7f2c9c0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1677a0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c1568f0 con 0x7f2c9c1579d0 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.136+0000 7f2ca3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9c15b820 con 0x7f2c9c157600 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50006/0 (socket says 172.21.15.12:50006) 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 -- 172.21.15.12:0/2036697279 learned_addr learned my addr 172.21.15.12:0/2036697279 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca259c700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9c1579d0 0x7f2c9c0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca159a700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c9c157600 0x7f2c9c15add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c9c157600 msgr2=0x7f2c9c15add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c9c157600 0x7f2c9c15add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9c1579d0 msgr2=0x7f2c9c0c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9c1579d0 0x7f2c9c0c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 -- 172.21.15.12:0/2036697279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c009420 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.137+0000 7f2ca1d9b700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c7c0 tx=0x7f2c98007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.138+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98005c10 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.138+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c98005d70 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.138+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c98007320 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.138+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c9c15bb00 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.138+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c9c15bde0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.139+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c9c04c3c0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.140+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f2c9801b3b0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.141+0000 7f2c91ffb700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 0x7f2c80069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.141+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f2c98084120 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.141+0000 7f2ca159a700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 msgr2=0x7f2c80069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:26.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.141+0000 7f2ca159a700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 0x7f2c80069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:26.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.145+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c98050ea0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.150 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:26.149+0000 7f6052a87180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:26.168 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:26.167+0000 7fa711123180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:24:26.251 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:26.250+0000 7f6052a87180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:24:26.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.342+0000 7f2ca159a700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 msgr2=0x7f2c80069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:26.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.342+0000 7f2ca159a700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 0x7f2c80069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.395+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c9c06b900 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.396+0000 7f2c91ffb700 1 -- 172.21.15.12:0/2036697279 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f2c980544c0 con 0x7f2c9c0b1b20 2023-10-08T17:24:26.397 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:26.397 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T17:24:26.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 msgr2=0x7f2c80069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 0x7f2c80069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 msgr2=0x7f2c9c1563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800c7c0 tx=0x7f2c98007e00 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 shutdown_connections 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c80067050 0x7f2c80069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c9c0b1b20 0x7f2c9c1563b0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c9c1579d0 0x7f2c9c0c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 --2- 172.21.15.12:0/2036697279 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c9c157600 0x7f2c9c15add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 >> 172.21.15.12:0/2036697279 conn(0x7f2c9c06d170 msgr2=0x7f2c9c0c2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:26.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.398+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 shutdown_connections 2023-10-08T17:24:26.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.399+0000 7f2ca3fff700 1 -- 172.21.15.12:0/2036697279 wait complete. 2023-10-08T17:24:26.401 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T17:24:26.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:26.469 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:26.469+0000 7fa711123180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:24:26.558 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:26.557+0000 7f6052a87180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:24:26.569 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:26.569+0000 7fa711123180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:24:26.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.647+0000 7fa95df9d700 1 Processor -- start 2023-10-08T17:24:26.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.647+0000 7fa95df9d700 1 -- start start 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.648+0000 7fa95df9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa95815de50 0x7fa9580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.648+0000 7fa95df9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9580cf3c0 con 0x7fa9580cef40 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa95df9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95815afd0 con 0x7fa958153c30 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa95df9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95815b2b0 con 0x7fa95815de50 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa95815de50 0x7fa9580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa95815de50 0x7fa9580cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50014/0 (socket says 172.21.15.12:50014) 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa95d79c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa9580cef40 0x7fa95815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47224/0 (socket says 172.21.15.12:47224) 2023-10-08T17:24:26.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 -- 172.21.15.12:0/265462255 learned_addr learned my addr 172.21.15.12:0/265462255 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:26.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa95cf9b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fa958153c30 0x7fa95815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:57838/0 (socket says 172.21.15.12:57838) 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 -- 172.21.15.12:0/265462255 >> v1:172.21.15.29:6789/0 conn(0x7fa958153c30 legacy=0x7fa95815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa9577fe700 1 -- 172.21.15.12:0/265462255 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 530444777 0 0) 0x7fa95815afd0 con 0x7fa958153c30 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 -- 172.21.15.12:0/265462255 >> v1:172.21.15.12:6789/0 conn(0x7fa9580cef40 legacy=0x7fa95815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.649+0000 7fa957fff700 1 -- 172.21.15.12:0/265462255 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95815b590 con 0x7fa95815de50 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa957fff700 1 --2- 172.21.15.12:0/265462255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa95815de50 0x7fa9580cea00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa9440099b0 tx=0x7fa944009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95a2a4b17b85c2d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:26.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa9577fe700 1 -- 172.21.15.12:0/265462255 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94400b860 con 0x7fa95815de50 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa9577fe700 1 -- 172.21.15.12:0/265462255 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94400b9c0 con 0x7fa95815de50 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa9577fe700 1 -- 172.21.15.12:0/265462255 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94400bd60 con 0x7fa95815de50 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa95df9d700 1 -- 172.21.15.12:0/265462255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa95815de50 msgr2=0x7fa9580cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.650+0000 7fa95df9d700 1 --2- 172.21.15.12:0/265462255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa95815de50 0x7fa9580cea00 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa9440099b0 tx=0x7fa944009250 comp rx=0 tx=0).stop 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.651+0000 7fa95df9d700 1 -- 172.21.15.12:0/265462255 shutdown_connections 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.651+0000 7fa95df9d700 1 --2- 172.21.15.12:0/265462255 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa95815de50 0x7fa9580cea00 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.651+0000 7fa95df9d700 1 -- 172.21.15.12:0/265462255 >> 172.21.15.12:0/265462255 conn(0x7fa9580703a0 msgr2=0x7fa9580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.651+0000 7fa95df9d700 1 -- 172.21.15.12:0/265462255 shutdown_connections 2023-10-08T17:24:26.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.651+0000 7fa95df9d700 1 -- 172.21.15.12:0/265462255 wait complete. 2023-10-08T17:24:26.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.652+0000 7fa95df9d700 1 Processor -- start 2023-10-08T17:24:26.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.652+0000 7fa95df9d700 1 -- start start 2023-10-08T17:24:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa958153c30 0x7fa95816a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa95815de50 0x7fa9580b40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580d1100 con 0x7fa9580cef40 2023-10-08T17:24:26.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95816b830 con 0x7fa95815de50 2023-10-08T17:24:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.653+0000 7fa95df9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9580b3820 con 0x7fa958153c30 2023-10-08T17:24:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50030/0 (socket says 172.21.15.12:50030) 2023-10-08T17:24:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 -- 172.21.15.12:0/4170130764 learned_addr learned my addr 172.21.15.12:0/4170130764 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:26.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa957fff700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa958153c30 0x7fa95816a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95d79c700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa95815de50 0x7fa9580b40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa958153c30 msgr2=0x7fa95816a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa958153c30 0x7fa95816a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa95815de50 msgr2=0x7fa9580b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa95815de50 0x7fa9580b40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 -- 172.21.15.12:0/4170130764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9440094f0 con 0x7fa9580cef40 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.654+0000 7fa95cf9b700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c810 tx=0x7fa94c007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.655+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c005b40 con 0x7fa9580cef40 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.655+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c005ca0 con 0x7fa9580cef40 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.655+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c007320 con 0x7fa9580cef40 2023-10-08T17:24:26.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.655+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95816b1e0 con 0x7fa9580cef40 2023-10-08T17:24:26.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.655+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa958143450 con 0x7fa9580cef40 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.656+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa95804c3c0 con 0x7fa9580cef40 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.657+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa94c01b3b0 con 0x7fa9580cef40 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.657+0000 7fa954ff9700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 0x7fa93c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.658+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fa94c083f40 con 0x7fa9580cef40 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.658+0000 7fa957fff700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 msgr2=0x7fa93c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:26.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.658+0000 7fa957fff700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 0x7fa93c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:26.662 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:26.661+0000 7f6052a87180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:24:26.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.662+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa94c050cc0 con 0x7fa9580cef40 2023-10-08T17:24:26.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.859+0000 7fa957fff700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 msgr2=0x7fa93c069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:26.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.859+0000 7fa957fff700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 0x7fa93c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:26.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.929+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9580cc070 con 0x7fa9580cef40 2023-10-08T17:24:26.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.930+0000 7fa954ff9700 1 -- 172.21.15.12:0/4170130764 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa94c017070 con 0x7fa9580cef40 2023-10-08T17:24:26.934 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:26.935 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":65,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T16:28:23.751690+0000","modified":"2023-10-08T16:28:27.272984+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8253},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8253":{"gid":8253,"name":"c","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6834/3424855851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3424855851},{"type":"v1","addr":"172.21.15.12:6834","nonce":3424855851}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-08T17:24:26.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 msgr2=0x7fa93c069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 0x7fa93c069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 msgr2=0x7fa958142f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa94c00c810 tx=0x7fa94c007d90 comp rx=0 tx=0).stop 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 shutdown_connections 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa93c067050 0x7fa93c069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa9580cef40 0x7fa958142f10 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa95815de50 0x7fa9580b40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 --2- 172.21.15.12:0/4170130764 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa958153c30 0x7fa95816a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 >> 172.21.15.12:0/4170130764 conn(0x7fa9580703a0 msgr2=0x7fa958151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 shutdown_connections 2023-10-08T17:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:26.932+0000 7fa95df9d700 1 -- 172.21.15.12:0/4170130764 wait complete. 2023-10-08T17:24:26.941 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 65 2023-10-08T17:24:26.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.146+0000 7fe8c5d9d700 1 Processor -- start 2023-10-08T17:24:27.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.146+0000 7fe8c5d9d700 1 -- start start 2023-10-08T17:24:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c5d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8c0153c30 0x7fe8c015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c015de50 0x7fe8c00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c5d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c015afd0 con 0x7fe8c00cef40 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c5d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c015b2b0 con 0x7fe8c0153c30 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c015b590 con 0x7fe8c015de50 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c4d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe8c0153c30 0x7fe8c015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c559c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe8c00cef40 0x7fe8c006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47234/0 (socket says 172.21.15.12:47234) 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.147+0000 7fe8c559c700 1 -- 172.21.15.12:0/3510434712 learned_addr learned my addr 172.21.15.12:0/3510434712 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:27.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8bffff700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c015de50 0x7fe8c00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3510434712 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c015de50 msgr2=0x7fe8c00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8c4d9b700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c015de50 0x7fe8c00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3510434712 >> v1:172.21.15.12:6789/0 conn(0x7fe8c00cef40 legacy=0x7fe8c006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3510434712 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c015b870 con 0x7fe8c0153c30 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8c4d9b700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c0153c30 0x7fe8c015a5e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098e0 tx=0x7fe8b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f366c451f39f03 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.148+0000 7fe8bf7fe700 1 -- 172.21.15.12:0/3510434712 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400b640 con 0x7fe8c0153c30 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8bf7fe700 1 -- 172.21.15.12:0/3510434712 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b400b7a0 con 0x7fe8c0153c30 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8bf7fe700 1 -- 172.21.15.12:0/3510434712 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b400bb40 con 0x7fe8c0153c30 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3510434712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c0153c30 msgr2=0x7fe8c015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c0153c30 0x7fe8c015a5e0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40098e0 tx=0x7fe8b40091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3510434712 shutdown_connections 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c0153c30 0x7fe8c015a5e0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3510434712 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c015de50 0x7fe8c00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3510434712 >> 172.21.15.12:0/3510434712 conn(0x7fe8c00703a0 msgr2=0x7fe8c00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3510434712 shutdown_connections 2023-10-08T17:24:27.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.149+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3510434712 wait complete. 2023-10-08T17:24:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.151+0000 7fe8c5d9d700 1 Processor -- start 2023-10-08T17:24:27.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.151+0000 7fe8c5d9d700 1 -- start start 2023-10-08T17:24:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 0x7fe8c00c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c015de50 0x7fe8c00c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00b3f10 con 0x7fe8c015de50 2023-10-08T17:24:27.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00c8bb0 con 0x7fe8c0153c30 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c5d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c00c8e90 con 0x7fe8c00cef40 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c4d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c559c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c015de50 0x7fe8c00c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c4d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52134/0 (socket says 172.21.15.12:52134) 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.152+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3795858322 learned_addr learned my addr 172.21.15.12:0/3795858322 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8bffff700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 0x7fe8c00c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 msgr2=0x7fe8c00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 0x7fe8c00c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c015de50 msgr2=0x7fe8c00c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c015de50 0x7fe8c00c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 -- 172.21.15.12:0/3795858322 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009420 con 0x7fe8c00cef40 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8bffff700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 0x7fe8c00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c4d9b700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006eb00 tx=0x7fe8b4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b401bcf0 con 0x7fe8c00cef40 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b401be70 con 0x7fe8c00cef40 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4011650 con 0x7fe8c00cef40 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.153+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c00c9170 con 0x7fe8c00cef40 2023-10-08T17:24:27.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.154+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c00c9730 con 0x7fe8c00cef40 2023-10-08T17:24:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.155+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c00c9920 con 0x7fe8c00cef40 2023-10-08T17:24:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.156+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe8b4011a00 con 0x7fe8c00cef40 2023-10-08T17:24:27.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.156+0000 7fe8bcff9700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 0x7fe8a4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.157+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7fe8b4086170 con 0x7fe8c00cef40 2023-10-08T17:24:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.157+0000 7fe8bffff700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 msgr2=0x7fe8a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:27.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.157+0000 7fe8bffff700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 0x7fe8a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:27.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.166+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8b4052f70 con 0x7fe8c00cef40 2023-10-08T17:24:27.311 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:27.311+0000 7fa711123180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:24:27.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.358+0000 7fe8bffff700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 msgr2=0x7fe8a4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:27.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.358+0000 7fe8bffff700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 0x7fe8a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:27.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.371+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8c004c3c0 con 0x7fe8c00cef40 2023-10-08T17:24:27.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.372+0000 7fe8bcff9700 1 -- 172.21.15.12:0/3795858322 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+16684 (secure 0 0 0) 0x7fe8b4011cb0 con 0x7fe8c00cef40 2023-10-08T17:24:27.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:27.426 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":155,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:23.040130+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-08T16:28:21.503390+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-08T16:28:22.733877+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":113,"snap_epoch":155,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":2}]},{"pgid":"17.1a","mappings":[{"from":0,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6836/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/1341227476":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3320169592":"2023-10-09T16:28:39.632104+0000","172.21.15.12:6837/115415":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3070795098":"2023-10-09T16:28:39.632104+0000","172.21.15.12:0/3780451095":"2023-10-09T16:28:39.632104+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":54,"length":4},{"begin":110,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 msgr2=0x7fe8a4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 0x7fe8a4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 msgr2=0x7fe8c00b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe8c006eb00 tx=0x7fe8b4017000 comp rx=0 tx=0).stop 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 shutdown_connections 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe8a4067050 0x7fe8a4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe8c015de50 0x7fe8c00c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe8c00cef40 0x7fe8c00b5a00 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 --2- 172.21.15.12:0/3795858322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe8c0153c30 0x7fe8c00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 >> 172.21.15.12:0/3795858322 conn(0x7fe8c00703a0 msgr2=0x7fe8c00d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:27.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 shutdown_connections 2023-10-08T17:24:27.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.375+0000 7fe8c5d9d700 1 -- 172.21.15.12:0/3795858322 wait complete. 2023-10-08T17:24:27.429 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T17:24:27.430 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:27.426+0000 7f6052a87180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:24:27.603 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:27.603+0000 7fa711123180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:24:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.628+0000 7f09eed9d700 1 Processor -- start 2023-10-08T17:24:27.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.628+0000 7f09eed9d700 1 -- start start 2023-10-08T17:24:27.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.629+0000 7f09eed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f09e806aaa0 0x7f09e815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.629+0000 7f09eed9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e815ae70 con 0x7f09e813fb20 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.629+0000 7f09eed9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e806af60 con 0x7f09e813fef0 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.629+0000 7f09eed9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e806b240 con 0x7f09e806aaa0 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09edd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f09e813fb20 0x7f09e80c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47240/0 (socket says 172.21.15.12:47240) 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09edd9b700 1 -- 172.21.15.12:0/634791834 learned_addr learned my addr 172.21.15.12:0/634791834 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:27.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ee59c700 1 --2- 172.21.15.12:0/634791834 >> v2:172.21.15.12:3300/0 conn(0x7f09e806aaa0 0x7f09e815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851200065 0 0) 0x7f09e4001040 con 0x7f09e813fb20 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d4003570 con 0x7f09e813fb20 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456496424 0 0) 0x7f09e806af60 con 0x7f09e813fef0 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09e4001040 con 0x7f09e813fef0 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ee59c700 1 -- 172.21.15.12:0/634791834 >> v1:172.21.15.29:6789/0 conn(0x7f09e813fef0 legacy=0x7f09e80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ee59c700 1 -- 172.21.15.12:0/634791834 >> v1:172.21.15.12:6789/0 conn(0x7f09e813fb20 legacy=0x7f09e80c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ee59c700 1 -- 172.21.15.12:0/634791834 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e806b520 con 0x7f09e806aaa0 2023-10-08T17:24:27.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.630+0000 7f09ee59c700 1 --2- 172.21.15.12:0/634791834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e806aaa0 0x7f09e815a930 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009e60 tx=0x7f09e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e3616e569611a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000e070 con 0x7f09e806aaa0 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e000bab0 con 0x7f09e806aaa0 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09ecd99700 1 -- 172.21.15.12:0/634791834 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e000be70 con 0x7f09e806aaa0 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09eed9d700 1 -- 172.21.15.12:0/634791834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e806aaa0 msgr2=0x7f09e815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09eed9d700 1 --2- 172.21.15.12:0/634791834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e806aaa0 0x7f09e815a930 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f09e0009e60 tx=0x7f09e0009780 comp rx=0 tx=0).stop 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09eed9d700 1 -- 172.21.15.12:0/634791834 shutdown_connections 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.631+0000 7f09eed9d700 1 --2- 172.21.15.12:0/634791834 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e806aaa0 0x7f09e815a930 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.632+0000 7f09eed9d700 1 -- 172.21.15.12:0/634791834 >> 172.21.15.12:0/634791834 conn(0x7f09e806d170 msgr2=0x7f09e80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.632+0000 7f09eed9d700 1 -- 172.21.15.12:0/634791834 shutdown_connections 2023-10-08T17:24:27.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.632+0000 7f09eed9d700 1 -- 172.21.15.12:0/634791834 wait complete. 2023-10-08T17:24:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.633+0000 7f09eed9d700 1 Processor -- start 2023-10-08T17:24:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.633+0000 7f09eed9d700 1 -- start start 2023-10-08T17:24:27.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09e806aaa0 0x7f09e8169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09e813fb20 0x7f09e80ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8158660 con 0x7f09e813fef0 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e8169db0 con 0x7f09e806aaa0 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09eed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09e80ac670 con 0x7f09e813fb20 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09ee59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50080/0 (socket says 172.21.15.12:50080) 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.634+0000 7f09ee59c700 1 -- 172.21.15.12:0/3747649757 learned_addr learned my addr 172.21.15.12:0/3747649757 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09edd9b700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09e806aaa0 0x7f09e8169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ed59a700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09e813fb20 0x7f09e80ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09e813fb20 msgr2=0x7f09e80ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09e813fb20 0x7f09e80ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09e806aaa0 msgr2=0x7f09e8169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09e806aaa0 0x7f09e8169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 -- 172.21.15.12:0/3747649757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e0009a20 con 0x7f09e813fef0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ee59c700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f09e0013000 tx=0x7f09e0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.635+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0012dd0 con 0x7f09e813fef0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.636+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e0026480 con 0x7f09e813fef0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.636+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e0026840 con 0x7f09e813fef0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.636+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e8157a50 con 0x7f09e813fef0 2023-10-08T17:24:27.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.636+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e8158010 con 0x7f09e813fef0 2023-10-08T17:24:27.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.637+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e8158810 con 0x7f09e813fef0 2023-10-08T17:24:27.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.638+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f09e001c400 con 0x7f09e813fef0 2023-10-08T17:24:27.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.638+0000 7f09ddffb700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 0x7f09cc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:27.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.639+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 6529+0+0 (secure 0 0 0) 0x7f09e0086a00 con 0x7f09e813fef0 2023-10-08T17:24:27.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.639+0000 7f09edd9b700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 msgr2=0x7f09cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:27.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.639+0000 7f09edd9b700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 0x7f09cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:27.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.643+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09e8158810 con 0x7f09e813fef0 2023-10-08T17:24:27.699 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:27.699+0000 7fa711123180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:24:27.730 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:27.726+0000 7f6052a87180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:24:27.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:27.825+0000 7f6052a87180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:24:27.896 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:27.860+0000 7fa711123180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:24:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.840+0000 7f09edd9b700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 msgr2=0x7f09cc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.840+0000 7f09edd9b700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 0x7f09cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:27.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.892+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09e804c3c0 con 0x7f09e813fef0 2023-10-08T17:24:27.897 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T17:24:27.893+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T17:24:27.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.897+0000 7f09ddffb700 1 -- 172.21.15.12:0/3747649757 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09e0053710 con 0x7f09e813fef0 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.899+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 msgr2=0x7f09cc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.899+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 0x7f09cc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.899+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 msgr2=0x7f09e80aab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.899+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f09e0013000 tx=0x7f09e0019000 comp rx=0 tx=0).stop 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 shutdown_connections 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f09cc067050 0x7f09cc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09e813fef0 0x7f09e80aab10 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09e806aaa0 0x7f09e8169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 --2- 172.21.15.12:0/3747649757 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09e813fb20 0x7f09e80ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 >> 172.21.15.12:0/3747649757 conn(0x7f09e806d170 msgr2=0x7f09e80c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 shutdown_connections 2023-10-08T17:24:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:27.900+0000 7f09eed9d700 1 -- 172.21.15.12:0/3747649757 wait complete. 2023-10-08T17:24:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T17:24:27.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T17:24:27.959 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:24:28.238 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:27.972+0000 7fa711123180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:24:28.239 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:28.173+0000 7fa711123180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:24:28.239 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:27.999+0000 7f6052a87180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:24:28.239 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.113+0000 7f6052a87180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.124+0000 7ff056f9d700 1 Processor -- start 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.124+0000 7ff056f9d700 1 -- start start 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.125+0000 7ff056f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 0x7ff05006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.125+0000 7ff056f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05006b290 con 0x7ff0500c7fb0 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.125+0000 7ff056f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05006b570 con 0x7ff05013f780 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.125+0000 7ff056f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05006bf10 con 0x7ff0500c7be0 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff05579a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff0500c7fb0 0x7ff05015a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47258/0 (socket says 172.21.15.12:47258) 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff05579a700 1 -- 172.21.15.12:0/3469994748 learned_addr learned my addr 172.21.15.12:0/3469994748 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:28.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff055f9b700 1 --2- 172.21.15.12:0/3469994748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 0x7ff05006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff055f9b700 1 -- 172.21.15.12:0/3469994748 >> v1:172.21.15.29:6789/0 conn(0x7ff05013f780 legacy=0x7ff0500c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff055f9b700 1 -- 172.21.15.12:0/3469994748 >> v1:172.21.15.12:6789/0 conn(0x7ff0500c7fb0 legacy=0x7ff05015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff055f9b700 1 -- 172.21.15.12:0/3469994748 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05006b850 con 0x7ff0500c7be0 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff054f99700 1 -- 172.21.15.12:0/3469994748 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958561777 0 0) 0x7ff05006b570 con 0x7ff05013f780 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.126+0000 7ff055f9b700 1 --2- 172.21.15.12:0/3469994748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 0x7ff05006abd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009910 tx=0x7ff04c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6987cb88fe69a518 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:28.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff054f99700 1 -- 172.21.15.12:0/3469994748 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00b760 con 0x7ff0500c7be0 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff054f99700 1 -- 172.21.15.12:0/3469994748 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00b8c0 con 0x7ff0500c7be0 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff054f99700 1 -- 172.21.15.12:0/3469994748 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00bc60 con 0x7ff0500c7be0 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 -- 172.21.15.12:0/3469994748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 msgr2=0x7ff05006abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 --2- 172.21.15.12:0/3469994748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 0x7ff05006abd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009910 tx=0x7ff04c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 -- 172.21.15.12:0/3469994748 shutdown_connections 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 --2- 172.21.15.12:0/3469994748 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff0500c7be0 0x7ff05006abd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 -- 172.21.15.12:0/3469994748 >> 172.21.15.12:0/3469994748 conn(0x7ff05006d110 msgr2=0x7ff0500cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:28.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 -- 172.21.15.12:0/3469994748 shutdown_connections 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.127+0000 7ff056f9d700 1 -- 172.21.15.12:0/3469994748 wait complete. 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.129+0000 7ff056f9d700 1 Processor -- start 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.129+0000 7ff056f9d700 1 -- start start 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0500c7be0 0x7ff0500c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff05013f780 0x7ff0500b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:28.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0500b08b0 con 0x7ff0500c7fb0 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050133b90 con 0x7ff0500c7be0 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff056f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff050133e70 con 0x7ff05013f780 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff05579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff05579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50100/0 (socket says 172.21.15.12:50100) 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff05579a700 1 -- 172.21.15.12:0/522983787 learned_addr learned my addr 172.21.15.12:0/522983787 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff055f9b700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0500c7be0 0x7ff0500c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.130+0000 7ff05679c700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff05013f780 0x7ff0500b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff05013f780 msgr2=0x7ff0500b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff05013f780 0x7ff0500b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0500c7be0 msgr2=0x7ff0500c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0500c7be0 0x7ff0500c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 -- 172.21.15.12:0/522983787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c009420 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff05579a700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c810 tx=0x7ff04000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040005b30 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040005c90 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040007320 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0500b0b00 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.131+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff050135410 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.132+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050135630 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.133+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 69) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ff04001b3b0 con 0x7ff0500c7fb0 2023-10-08T17:24:28.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.134+0000 7ff045ffb700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 0x7ff034069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:28.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.134+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 6571+0+0 (secure 0 0 0) 0x7ff0400840b0 con 0x7ff0500c7fb0 2023-10-08T17:24:28.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.134+0000 7ff055f9b700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 msgr2=0x7ff034069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:28.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.134+0000 7ff055f9b700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 0x7ff034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:28.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.142+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff040050e10 con 0x7ff0500c7fb0 2023-10-08T17:24:28.270 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:28.270+0000 7fa711123180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:24:28.319 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.318+0000 7f6052a87180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:24:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.335+0000 7ff055f9b700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 msgr2=0x7ff034069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:28.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.335+0000 7ff055f9b700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 0x7ff034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:28.367 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:28.366+0000 7fa711123180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:24:28.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.390+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff05004c3c0 con 0x7ff0500c7fb0 2023-10-08T17:24:28.419 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.418+0000 7f6052a87180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:24:28.465 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:28.465+0000 7fa711123180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:24:28.516 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.515+0000 7f6052a87180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:24:28.614 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.612+0000 7f6052a87180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:24:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.622+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 70) v1 ==== 84451+0+0 (secure 0 0 0) 0x7ff0400511e0 con 0x7ff0500c7fb0 2023-10-08T17:24:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.622+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 msgr2=0x7ff034069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:28.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.622+0000 7ff045ffb700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 0x7ff034069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.691+0000 7f5fcd682700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.691+0000 7f5fcd682700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.691+0000 7f5fcd682700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.692+0000 7f5fcd682700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.692+0000 7f5fcd682700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.693+0000 7f5fd0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.693+0000 7f5fd0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.708 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.693+0000 7f5fd0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.709 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.693+0000 7f5fd0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.709 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:28.693+0000 7f5fd0e89700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:24:28.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.898+0000 7ff045ffb700 1 -- 172.21.15.12:0/522983787 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff04006df50 con 0x7ff0500c7fb0 2023-10-08T17:24:28.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 msgr2=0x7ff050134ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:28.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff04000c810 tx=0x7ff04000cb20 comp rx=0 tx=0).stop 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 shutdown_connections 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff034067050 0x7ff034069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff05013f780 0x7ff0500b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff0500c7be0 0x7ff0500c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 --2- 172.21.15.12:0/522983787 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff0500c7fb0 0x7ff050134ed0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 >> 172.21.15.12:0/522983787 conn(0x7ff05006d110 msgr2=0x7ff0500caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:28.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.900+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 shutdown_connections 2023-10-08T17:24:28.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:28.901+0000 7ff056f9d700 1 -- 172.21.15.12:0/522983787 wait complete. 2023-10-08T17:24:28.920 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T17:24:29.155 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.154+0000 7f280c9fe700 1 Processor -- start 2023-10-08T17:24:29.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.154+0000 7f280c9fe700 1 -- start start 2023-10-08T17:24:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.155+0000 7f280c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28081597d0 0x7f28080c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.155+0000 7f280c9fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28080c7760 0x7f28080677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.155+0000 7f280c9fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080c1a30 con 0x7f2808067cf0 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.155+0000 7f280c9fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280815a820 con 0x7f28080c7760 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.155+0000 7f280c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080c7120 con 0x7f28081597d0 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28080c7760 0x7f28080677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280759e700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2808067cf0 0x7f28080c1ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47262/0 (socket says 172.21.15.12:47262) 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280759e700 1 -- 172.21.15.12:0/928597249 learned_addr learned my addr 172.21.15.12:0/928597249 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28080c7760 0x7f28080677b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50256/0 (socket says 172.21.15.12:50256) 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f2806d9d700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28081597d0 0x7f28080c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 -- 172.21.15.12:0/928597249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28081597d0 msgr2=0x7f28080c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:29.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28081597d0 0x7f28080c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 -- 172.21.15.12:0/928597249 >> v1:172.21.15.12:6789/0 conn(0x7f2808067cf0 legacy=0x7f28080c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 -- 172.21.15.12:0/928597249 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808068110 con 0x7f28080c7760 2023-10-08T17:24:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.156+0000 7f280659c700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28080c7760 0x7f28080677b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098e0 tx=0x7f27fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bca55d4529c140 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f2805d9b700 1 -- 172.21.15.12:0/928597249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00b640 con 0x7f28080c7760 2023-10-08T17:24:29.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f2805d9b700 1 -- 172.21.15.12:0/928597249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00b7a0 con 0x7f28080c7760 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f2805d9b700 1 -- 172.21.15.12:0/928597249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00bb40 con 0x7f28080c7760 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 -- 172.21.15.12:0/928597249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28080c7760 msgr2=0x7f28080677b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28080c7760 0x7f28080677b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098e0 tx=0x7f27fc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 -- 172.21.15.12:0/928597249 shutdown_connections 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28081597d0 0x7f28080c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 --2- 172.21.15.12:0/928597249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28080c7760 0x7f28080677b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 -- 172.21.15.12:0/928597249 >> 172.21.15.12:0/928597249 conn(0x7f280806f330 msgr2=0x7f28080cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 -- 172.21.15.12:0/928597249 shutdown_connections 2023-10-08T17:24:29.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.157+0000 7f280c9fe700 1 -- 172.21.15.12:0/928597249 wait complete. 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.159+0000 7f280c9fe700 1 Processor -- start 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.159+0000 7f280c9fe700 1 -- start start 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 0x7f280815fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 0x7f2808153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808160500 con 0x7f28081597d0 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2808154b40 con 0x7f2808067cf0 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b22e0 con 0x7f28080c7760 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 0x7f2808153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f2806d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 0x7f280815fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f2806d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 0x7f280815fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:58132/0 (socket says 172.21.15.12:58132) 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52306/0 (socket says 172.21.15.12:52306) 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f2806d9d700 1 -- 172.21.15.12:0/447552671 learned_addr learned my addr 172.21.15.12:0/447552671 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 -- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 msgr2=0x7f280815fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 0x7f280815fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 -- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 msgr2=0x7f2808153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 0x7f2808153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280659c700 1 -- 172.21.15.12:0/447552671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009420 con 0x7f28080c7760 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.160+0000 7f280759e700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 0x7f2808153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f280659c700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27fc016000 tx=0x7f27fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:29.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc01bc40 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc01bdc0 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc011670 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28080c50d0 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.161+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080c4d60 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.162+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280804c3c0 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.163+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 70) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f27fc011a20 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.164+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6829+0+0 (secure 0 0 0) 0x7f27fc0859d0 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.170+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27fc052ab0 con 0x7f28080c7760 2023-10-08T17:24:29.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.372+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2808158d50 con 0x7f28080c7760 2023-10-08T17:24:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.632+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mgrmap(e 71) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f27fc052560 con 0x7f28080c7760 2023-10-08T17:24:29.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.632+0000 7f27eeffd700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 0x7f27f406ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:29.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.634+0000 7f2806d9d700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 0x7f27f406ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:29.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:29.635+0000 7f2806d9d700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 0x7f27f406ef40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009e70 tx=0x7f27f80091a0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:30.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.063+0000 7f27eeffd700 1 -- 172.21.15.12:0/447552671 <== mon.2 v2:172.21.15.29:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7f27fc06b1b0 con 0x7f28080c7760 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 msgr2=0x7f27f406ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 0x7f27f406ef40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f27f8009e70 tx=0x7f27f80091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 msgr2=0x7f28080b0420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f27fc016000 tx=0x7f27fc017000 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 shutdown_connections 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f27f406cb60 0x7f27f406ef40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28081597d0 0x7f2808153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2808067cf0 0x7f280815fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 --2- 172.21.15.12:0/447552671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28080c7760 0x7f28080b0420 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 >> 172.21.15.12:0/447552671 conn(0x7f280806f330 msgr2=0x7f28080c1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:30.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 shutdown_connections 2023-10-08T17:24:30.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.065+0000 7f280c9fe700 1 -- 172.21.15.12:0/447552671 wait complete. 2023-10-08T17:24:30.068 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T17:24:30.087 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T17:24:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 Processor -- start 2023-10-08T17:24:30.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 -- start start 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3764067fb0 0x7f37640c1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 0x7f37640c8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376406a710 con 0x7f3764155990 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640c92e0 con 0x7f3764067fb0 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.282+0000 7f3768d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640c95c0 con 0x7f3764155520 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3764067fb0 0x7f37640c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f3764067fb0 0x7f37640c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50270/0 (socket says 172.21.15.12:50270) 2023-10-08T17:24:30.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 -- 172.21.15.12:0/2552140231 learned_addr learned my addr 172.21.15.12:0/2552140231 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f3762ffd700 1 --2- 172.21.15.12:0/2552140231 >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 0x7f37640c8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 -- 172.21.15.12:0/2552140231 >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 msgr2=0x7f37640c8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 --2- 172.21.15.12:0/2552140231 >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 0x7f37640c8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 -- 172.21.15.12:0/2552140231 >> v1:172.21.15.12:6789/0 conn(0x7f3764155990 legacy=0x7f37640cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37637fe700 1 -- 172.21.15.12:0/2552140231 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640c98a0 con 0x7f3764067fb0 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f37627fc700 1 -- 172.21.15.12:0/2552140231 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140472383 0 0) 0x7f376406a710 con 0x7f3764155990 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.283+0000 7f3762ffd700 1 --2- 172.21.15.12:0/2552140231 >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 0x7f37640c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:30.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f37637fe700 1 --2- 172.21.15.12:0/2552140231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764067fb0 0x7f37640c1740 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f3764159320 tx=0x7f375400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283c6a700beec0f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f37627fc700 1 -- 172.21.15.12:0/2552140231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400dc50 con 0x7f3764067fb0 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f37627fc700 1 -- 172.21.15.12:0/2552140231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400ddb0 con 0x7f3764067fb0 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f37627fc700 1 -- 172.21.15.12:0/2552140231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540196d0 con 0x7f3764067fb0 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 -- 172.21.15.12:0/2552140231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764067fb0 msgr2=0x7f37640c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2552140231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764067fb0 0x7f37640c1740 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f3764159320 tx=0x7f375400b4f0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 -- 172.21.15.12:0/2552140231 shutdown_connections 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2552140231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764067fb0 0x7f37640c1740 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2552140231 >> v2:172.21.15.29:3300/0 conn(0x7f3764155520 0x7f37640c8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 -- 172.21.15.12:0/2552140231 >> 172.21.15.12:0/2552140231 conn(0x7f376406c6a0 msgr2=0x7f376406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 -- 172.21.15.12:0/2552140231 shutdown_connections 2023-10-08T17:24:30.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.284+0000 7f3768d9d700 1 -- 172.21.15.12:0/2552140231 wait complete. 2023-10-08T17:24:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.286+0000 7f3768d9d700 1 Processor -- start 2023-10-08T17:24:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.286+0000 7f3768d9d700 1 -- start start 2023-10-08T17:24:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3764067fb0 0x7f3764163b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3764155990 0x7f37640b0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764164070 con 0x7f3764155520 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376416ace0 con 0x7f3764155990 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3768d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640c59b0 con 0x7f3764067fb0 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50280/0 (socket says 172.21.15.12:50280) 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 -- 172.21.15.12:0/2668085822 learned_addr learned my addr 172.21.15.12:0/2668085822 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 -- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3764067fb0 msgr2=0x7f3764163b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3764067fb0 0x7f3764163b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 -- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3764155990 msgr2=0x7f37640b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3764155990 0x7f37640b0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.287+0000 7f3762ffd700 1 -- 172.21.15.12:0/2668085822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375400b790 con 0x7f3764155520 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f3762ffd700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f375800c830 tx=0x7f3758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758011600 con 0x7f3764155520 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3758011760 con 0x7f3764155520 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758011b20 con 0x7f3764155520 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37640c5c90 con 0x7f3764155520 2023-10-08T17:24:30.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.288+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640a9980 con 0x7f3764155520 2023-10-08T17:24:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.289+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37640ab300 con 0x7f3764155520 2023-10-08T17:24:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.290+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 71) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f375800a3e0 con 0x7f3764155520 2023-10-08T17:24:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.291+0000 7f374b7fe700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 0x7f3750069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.291+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6391+0+0 (secure 0 0 0) 0x7f37580849a0 con 0x7f3764155520 2023-10-08T17:24:30.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.291+0000 7f37637fe700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 0x7f3750069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:30.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.292+0000 7f37637fe700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 0x7f3750069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3764159320 tx=0x7f375401b000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:30.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.295+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3758051c10 con 0x7f3764155520 2023-10-08T17:24:30.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:30.520+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f376404c3c0 con 0x7f3764155520 2023-10-08T17:24:31.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.079+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3758051fe0 con 0x7f3764155520 2023-10-08T17:24:31.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.080+0000 7f374b7fe700 1 -- 172.21.15.12:0/2668085822 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7f375804ed00 con 0x7f3764155520 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.083+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 msgr2=0x7f3750069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.083+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 0x7f3750069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3764159320 tx=0x7f375401b000 comp rx=0 tx=0).stop 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.083+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 msgr2=0x7f37640c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.083+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f375800c830 tx=0x7f3758008040 comp rx=0 tx=0).stop 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 shutdown_connections 2023-10-08T17:24:31.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3750066d80 0x7f3750069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3764155990 0x7f37640b0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3764067fb0 0x7f3764163b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 --2- 172.21.15.12:0/2668085822 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3764155520 0x7f37640c5040 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 >> 172.21.15.12:0/2668085822 conn(0x7f376406c6a0 msgr2=0x7f37640cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 shutdown_connections 2023-10-08T17:24:31.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.084+0000 7f3768d9d700 1 -- 172.21.15.12:0/2668085822 wait complete. 2023-10-08T17:24:31.088 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T17:24:31.107 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T17:24:31.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 Processor -- start 2023-10-08T17:24:31.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 -- start start 2023-10-08T17:24:31.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f866015dfd0 0x7f86600aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600acc00 con 0x7f8660159920 2023-10-08T17:24:31.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86600abff0 con 0x7f8660159550 2023-10-08T17:24:31.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.309+0000 7f866739d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600ac2d0 con 0x7f866015dfd0 2023-10-08T17:24:31.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8666b9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8660159920 0x7f86600ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47272/0 (socket says 172.21.15.12:47272) 2023-10-08T17:24:31.311 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8666b9c700 1 -- 172.21.15.12:0/63288551 learned_addr learned my addr 172.21.15.12:0/63288551 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665b9a700 1 --2- 172.21.15.12:0/63288551 >> v2:172.21.15.29:3300/0 conn(0x7f866015dfd0 0x7f86600aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214855847 0 0) 0x7f86600acc00 con 0x7f8660159920 2023-10-08T17:24:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f864c003570 con 0x7f8660159920 2023-10-08T17:24:31.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837263652 0 0) 0x7f86600abff0 con 0x7f8660159550 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86600acc00 con 0x7f8660159550 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2382422766 0 0) 0x7f864c003570 con 0x7f8660159920 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 >> v2:172.21.15.29:3300/0 conn(0x7f866015dfd0 msgr2=0x7f86600aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.310+0000 7f8665399700 1 --2- 172.21.15.12:0/63288551 >> v2:172.21.15.29:3300/0 conn(0x7f866015dfd0 0x7f86600aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 >> v1:172.21.15.29:6789/0 conn(0x7f8660159550 legacy=0x7f86600ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600ac5b0 con 0x7f8660159920 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f86580017f0 con 0x7f8660159920 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 >> v1:172.21.15.12:6789/0 conn(0x7f8660159920 legacy=0x7f86600ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 0x7f864c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c004810 0x7f864c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f864c0051c0 0x7f864c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600ac2d0 con 0x7f864c003bf0 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c0b0 con 0x7f864c004810 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c00c270 con 0x7f864c0051c0 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 0x7f864c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8665b9a700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c004810 0x7f864c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8666b9c700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f864c0051c0 0x7f864c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 -- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f864c0051c0 msgr2=0x7f864c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f864c0051c0 0x7f864c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 -- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c004810 msgr2=0x7f864c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c004810 0x7f864c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f866639b700 1 -- 172.21.15.12:0/63288551 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c003570 con 0x7f864c003bf0 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.311+0000 7f8666b9c700 1 -- 172.21.15.12:0/63288551 reap_dead start 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866639b700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 0x7f864c003fe0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f865c001a10 tx=0x7f865c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4eb3937aa49bde7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00c5d0 con 0x7f864c003bf0 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00c730 con 0x7f864c003bf0 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f8665399700 1 -- 172.21.15.12:0/63288551 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00cad0 con 0x7f864c003bf0 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 -- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 msgr2=0x7f864c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 0x7f864c003fe0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f865c001a10 tx=0x7f865c007d30 comp rx=0 tx=0).stop 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 -- 172.21.15.12:0/63288551 shutdown_connections 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 --2- 172.21.15.12:0/63288551 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f864c003bf0 0x7f864c003fe0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 -- 172.21.15.12:0/63288551 >> 172.21.15.12:0/63288551 conn(0x7f866006ce80 msgr2=0x7f86600ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:31.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 -- 172.21.15.12:0/63288551 shutdown_connections 2023-10-08T17:24:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.312+0000 7f866739d700 1 -- 172.21.15.12:0/63288551 wait complete. 2023-10-08T17:24:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.314+0000 7f866739d700 1 Processor -- start 2023-10-08T17:24:31.319 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.314+0000 7f866739d700 1 -- start start 2023-10-08T17:24:31.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 0x7f8660151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 0x7f8660154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c8e00 con 0x7f86601576c0 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660154ac0 con 0x7f864c003bf0 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8660151bc0 con 0x7f8660154130 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50300/0 (socket says 172.21.15.12:50300) 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 -- 172.21.15.12:0/2462611004 learned_addr learned my addr 172.21.15.12:0/2462611004 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8666b9c700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 0x7f8660154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866639b700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 0x7f8660151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 -- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 msgr2=0x7f8660154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 0x7f8660154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 -- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 msgr2=0x7f8660151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.322 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 0x7f8660151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8665b9a700 1 -- 172.21.15.12:0/2462611004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600c81f0 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f8666b9c700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 0x7f8660154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.315+0000 7f866639b700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 0x7f8660151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f8665b9a700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8650011d40 tx=0x7f86500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000fb50 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865000fcb0 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86600c84d0 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650014650 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.316+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600c8a90 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.317+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660157500 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.318+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8650014a80 con 0x7f86601576c0 2023-10-08T17:24:31.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.319+0000 7f86567fc700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 0x7f86440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.320+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f8650018030 con 0x7f86601576c0 2023-10-08T17:24:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.320+0000 7f866639b700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 0x7f86440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.320+0000 7f866639b700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 0x7f86440693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c015000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.324+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86500523e0 con 0x7f86601576c0 2023-10-08T17:24:31.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.528+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f86600c8f90 con 0x7f86601576c0 2023-10-08T17:24:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.532+0000 7f86567fc700 1 -- 172.21.15.12:0/2462611004 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v49) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8650055a00 con 0x7f86601576c0 2023-10-08T17:24:31.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.534+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 msgr2=0x7f86440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.534+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 0x7f86440693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f865c000c00 tx=0x7f865c015000 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 msgr2=0x7f86600c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f8650011d40 tx=0x7f86500091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 shutdown_connections 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8644066f30 0x7f86440693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8660154130 0x7f8660154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f864c003bf0 0x7f8660151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 --2- 172.21.15.12:0/2462611004 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f86601576c0 0x7f86600c79a0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 >> 172.21.15.12:0/2462611004 conn(0x7f866006ce80 msgr2=0x7f8660068780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 shutdown_connections 2023-10-08T17:24:31.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.535+0000 7f866739d700 1 -- 172.21.15.12:0/2462611004 wait complete. 2023-10-08T17:24:31.624 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T17:24:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 Processor -- start 2023-10-08T17:24:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 -- start start 2023-10-08T17:24:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 0x7fbc8015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbc800cea00 0x7fbc800cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8015ac50 con 0x7fbc80153a00 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8015d010 con 0x7fbc800cea00 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.814+0000 7fbc86d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8015af60 con 0x7fbc80153dd0 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc85d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbc80153a00 0x7fbc8015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:47282/0 (socket says 172.21.15.12:47282) 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc85d9b700 1 -- 172.21.15.12:0/3704159211 learned_addr learned my addr 172.21.15.12:0/3704159211 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:31.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8659c700 1 --2- 172.21.15.12:0/3704159211 >> v2:172.21.15.12:3300/0 conn(0x7fbc800cea00 0x7fbc800cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8559a700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 0x7fbc8015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc84d99700 1 -- 172.21.15.12:0/3704159211 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182784183 0 0) 0x7fbc8015ac50 con 0x7fbc80153a00 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc84d99700 1 -- 172.21.15.12:0/3704159211 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc6c003570 con 0x7fbc80153a00 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8659c700 1 -- 172.21.15.12:0/3704159211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 msgr2=0x7fbc8015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8659c700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 0x7fbc8015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8659c700 1 -- 172.21.15.12:0/3704159211 >> v1:172.21.15.12:6789/0 conn(0x7fbc80153a00 legacy=0x7fbc8015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8659c700 1 -- 172.21.15.12:0/3704159211 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8015b240 con 0x7fbc800cea00 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.815+0000 7fbc8559a700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 0x7fbc8015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc8659c700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800cea00 0x7fbc800cee60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009e90 tx=0x7fbc78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24e7d6cacdee5f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc84d99700 1 -- 172.21.15.12:0/3704159211 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7800e070 con 0x7fbc800cea00 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc84d99700 1 -- 172.21.15.12:0/3704159211 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7800bbf0 con 0x7fbc800cea00 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc84d99700 1 -- 172.21.15.12:0/3704159211 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78012430 con 0x7fbc800cea00 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 -- 172.21.15.12:0/3704159211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800cea00 msgr2=0x7fbc800cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800cea00 0x7fbc800cee60 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009e90 tx=0x7fbc78009780 comp rx=0 tx=0).stop 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 -- 172.21.15.12:0/3704159211 shutdown_connections 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc800cea00 0x7fbc800cee60 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/3704159211 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc80153dd0 0x7fbc8015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 -- 172.21.15.12:0/3704159211 >> 172.21.15.12:0/3704159211 conn(0x7fbc800703a0 msgr2=0x7fbc800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:31.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 -- 172.21.15.12:0/3704159211 shutdown_connections 2023-10-08T17:24:31.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.816+0000 7fbc86d9d700 1 -- 172.21.15.12:0/3704159211 wait complete. 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.818+0000 7fbc86d9d700 1 Processor -- start 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.818+0000 7fbc86d9d700 1 -- start start 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 0x7fbc800cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 0x7fbc800c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800cd3c0 con 0x7fbc80153dd0 2023-10-08T17:24:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc800c76f0 con 0x7fbc80153a00 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc86d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc801544b0 con 0x7fbc800cea00 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc8659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc8659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50328/0 (socket says 172.21.15.12:50328) 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc8659c700 1 -- 172.21.15.12:0/1718239930 learned_addr learned my addr 172.21.15.12:0/1718239930 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc85d9b700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 0x7fbc800cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.819+0000 7fbc8559a700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 0x7fbc800c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 -- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 msgr2=0x7fbc800cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 0x7fbc800cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 -- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 msgr2=0x7fbc800c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 0x7fbc800c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:31.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 -- 172.21.15.12:0/1718239930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78009a20 con 0x7fbc80153dd0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8559a700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 0x7fbc800c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc85d9b700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 0x7fbc800cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc8659c700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fbc8006eb00 tx=0x7fbc78019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7801e630 con 0x7fbc80153dd0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7801e7b0 con 0x7fbc80153dd0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7801eb70 con 0x7fbc80153dd0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.820+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc800cd0e0 con 0x7fbc80153dd0 2023-10-08T17:24:31.824 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.821+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc80154a30 con 0x7fbc80153dd0 2023-10-08T17:24:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.821+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc80154310 con 0x7fbc80153dd0 2023-10-08T17:24:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.822+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc78024070 con 0x7fbc80153dd0 2023-10-08T17:24:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.823+0000 7fbc75ffb700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 0x7fbc640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:31.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.823+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fbc78086e90 con 0x7fbc80153dd0 2023-10-08T17:24:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.823+0000 7fbc85d9b700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 0x7fbc640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:31.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.824+0000 7fbc85d9b700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 0x7fbc640693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc800cbda0 tx=0x7fbc7c009040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:31.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:31.827+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc80154310 con 0x7fbc80153dd0 2023-10-08T17:24:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.031+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbc80154310 con 0x7fbc80153dd0 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.036+0000 7fbc75ffb700 1 -- 172.21.15.12:0/1718239930 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbc80154310 con 0x7fbc80153dd0 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 msgr2=0x7fbc640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 0x7fbc640693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fbc800cbda0 tx=0x7fbc7c009040 comp rx=0 tx=0).stop 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 msgr2=0x7fbc800c6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fbc8006eb00 tx=0x7fbc78019000 comp rx=0 tx=0).stop 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 shutdown_connections 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbc64066f30 0x7fbc640693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbc80153dd0 0x7fbc800c6ea0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbc800cea00 0x7fbc800cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 --2- 172.21.15.12:0/1718239930 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbc80153a00 0x7fbc800c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.039+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 >> 172.21.15.12:0/1718239930 conn(0x7fbc800703a0 msgr2=0x7fbc800b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.040+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 shutdown_connections 2023-10-08T17:24:32.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.040+0000 7fbc86d9d700 1 -- 172.21.15.12:0/1718239930 wait complete. 2023-10-08T17:24:32.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T17:24:32.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.248+0000 7fd4f899d700 1 Processor -- start 2023-10-08T17:24:32.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.248+0000 7fd4f899d700 1 -- start start 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4f4140a70 0x7fd4f4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f406de50 0x7fd4f406a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd4f415b0a0 0x7fd4f4157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f40c6800 con 0x7fd4f4140a70 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f415b640 con 0x7fd4f415b0a0 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.249+0000 7fd4f899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f415b920 con 0x7fd4f406de50 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4f4140a70 0x7fd4f4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd4f4140a70 0x7fd4f4069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36344/0 (socket says 172.21.15.12:36344) 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 -- 172.21.15.12:0/2977086881 learned_addr learned my addr 172.21.15.12:0/2977086881 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f3fff700 1 --2- 172.21.15.12:0/2977086881 >> v2:172.21.15.29:3300/0 conn(0x7fd4f415b0a0 0x7fd4f4157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f2ffd700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f406de50 0x7fd4f406a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 -- 172.21.15.12:0/2977086881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f406de50 msgr2=0x7fd4f406a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f406de50 0x7fd4f406a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 -- 172.21.15.12:0/2977086881 >> v2:172.21.15.29:3300/0 conn(0x7fd4f415b0a0 msgr2=0x7fd4f4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/2977086881 >> v2:172.21.15.29:3300/0 conn(0x7fd4f415b0a0 0x7fd4f4157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 -- 172.21.15.12:0/2977086881 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f415bc00 con 0x7fd4f4140a70 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.250+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f4140a70 0x7fd4f4069b00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40698d0 tx=0x7fd4e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79effcfb0e0cfca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f27fc700 1 -- 172.21.15.12:0/2977086881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400b860 con 0x7fd4f4140a70 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f27fc700 1 -- 172.21.15.12:0/2977086881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e400b9c0 con 0x7fd4f4140a70 2023-10-08T17:24:32.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f27fc700 1 -- 172.21.15.12:0/2977086881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e400bd60 con 0x7fd4f4140a70 2023-10-08T17:24:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 -- 172.21.15.12:0/2977086881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f4140a70 msgr2=0x7fd4f4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f4140a70 0x7fd4f4069b00 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40698d0 tx=0x7fd4e4009250 comp rx=0 tx=0).stop 2023-10-08T17:24:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 -- 172.21.15.12:0/2977086881 shutdown_connections 2023-10-08T17:24:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 --2- 172.21.15.12:0/2977086881 >> v2:172.21.15.29:3300/0 conn(0x7fd4f415b0a0 0x7fd4f4157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f4140a70 0x7fd4f4069b00 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 --2- 172.21.15.12:0/2977086881 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f406de50 0x7fd4f406a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 -- 172.21.15.12:0/2977086881 >> 172.21.15.12:0/2977086881 conn(0x7fd4f406d110 msgr2=0x7fd4f40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 -- 172.21.15.12:0/2977086881 shutdown_connections 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.251+0000 7fd4f899d700 1 -- 172.21.15.12:0/2977086881 wait complete. 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.253+0000 7fd4f899d700 1 Processor -- start 2023-10-08T17:24:32.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.253+0000 7fd4f899d700 1 -- start start 2023-10-08T17:24:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f4140a70 0x7fd4f413c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4f415b0a0 0x7fd4f413f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40aeed0 con 0x7fd4f406de50 2023-10-08T17:24:32.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40af490 con 0x7fd4f415b0a0 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f415dee0 con 0x7fd4f4140a70 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36360/0 (socket says 172.21.15.12:36360) 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f37fe700 1 -- 172.21.15.12:0/831032392 learned_addr learned my addr 172.21.15.12:0/831032392 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f2ffd700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f4140a70 0x7fd4f413c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.254+0000 7fd4f3fff700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4f415b0a0 0x7fd4f413f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 -- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f4140a70 msgr2=0x7fd4f413c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f4140a70 0x7fd4f413c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 -- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4f415b0a0 msgr2=0x7fd4f413f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4f415b0a0 0x7fd4f413f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 -- 172.21.15.12:0/831032392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40094f0 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f37fe700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4006fd0 tx=0x7fd4e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4011d80 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e4024440 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4024800 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f415e1c0 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.255+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f413c700 con 0x7fd4f406de50 2023-10-08T17:24:32.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.256+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f404c3c0 con 0x7fd4f406de50 2023-10-08T17:24:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.257+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4e401a420 con 0x7fd4f406de50 2023-10-08T17:24:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.258+0000 7fd4db7fe700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.258+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fd4e40864f0 con 0x7fd4f406de50 2023-10-08T17:24:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.258+0000 7fd4f2ffd700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.259+0000 7fd4f2ffd700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 0x7fd4e00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40c24a0 tx=0x7fd4e8008040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.262+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4e4053670 con 0x7fd4f406de50 2023-10-08T17:24:32.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.466+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fd4f415bee0 con 0x7fd4f406de50 2023-10-08T17:24:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.470+0000 7fd4db7fe700 1 -- 172.21.15.12:0/831032392 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v51) v1 ==== 115+0+0 (secure 0 0 0) 0x7fd4e4056c90 con 0x7fd4f406de50 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.472+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 msgr2=0x7fd4e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.472+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 0x7fd4e00693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40c24a0 tx=0x7fd4e8008040 comp rx=0 tx=0).stop 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 msgr2=0x7fd4f413dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4006fd0 tx=0x7fd4e4017000 comp rx=0 tx=0).stop 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 shutdown_connections 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd4e0066f30 0x7fd4e00693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd4f406de50 0x7fd4f413dc40 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd4f415b0a0 0x7fd4f413f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 --2- 172.21.15.12:0/831032392 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd4f4140a70 0x7fd4f413c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 >> 172.21.15.12:0/831032392 conn(0x7fd4f406d110 msgr2=0x7fd4f406f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 shutdown_connections 2023-10-08T17:24:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.473+0000 7fd4f899d700 1 -- 172.21.15.12:0/831032392 wait complete. 2023-10-08T17:24:32.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention' 2023-10-08T17:24:32.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.701+0000 7faad9f9d700 1 Processor -- start 2023-10-08T17:24:32.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.701+0000 7faad9f9d700 1 -- start start 2023-10-08T17:24:32.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.702+0000 7faad9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 0x7faad415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad9f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad415ae70 con 0x7faad413fb20 2023-10-08T17:24:32.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad9f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad406af60 con 0x7faad406aaa0 2023-10-08T17:24:32.717 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad9f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad406b240 con 0x7faad413fef0 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad8f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7faad413fb20 0x7faad40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35086/0 (socket says 172.21.15.12:35086) 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad8f9b700 1 -- 172.21.15.12:0/1191117048 learned_addr learned my addr 172.21.15.12:0/1191117048 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad3fff700 1 --2- 172.21.15.12:0/1191117048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 0x7faad415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203417760 0 0) 0x7faac8001110 con 0x7faad413fb20 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac4003570 con 0x7faad413fb20 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871046960 0 0) 0x7faad406af60 con 0x7faad406aaa0 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.703+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8001110 con 0x7faad406aaa0 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2228314258 0 0) 0x7faac4003570 con 0x7faad413fb20 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad3fff700 1 -- 172.21.15.12:0/1191117048 >> v1:172.21.15.29:6789/0 conn(0x7faad406aaa0 legacy=0x7faad40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad3fff700 1 -- 172.21.15.12:0/1191117048 >> v1:172.21.15.12:6789/0 conn(0x7faad413fb20 legacy=0x7faad40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad3fff700 1 -- 172.21.15.12:0/1191117048 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad406b520 con 0x7faad413fef0 2023-10-08T17:24:32.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad3fff700 1 --2- 172.21.15.12:0/1191117048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 0x7faad415a930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faac0009900 tx=0x7faac0009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb3f044abf6d2079 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac8001600 con 0x7faad413fef0 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0011420 con 0x7faad413fef0 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.704+0000 7faad37fe700 1 -- 172.21.15.12:0/1191117048 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac00117c0 con 0x7faad413fef0 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 -- 172.21.15.12:0/1191117048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 msgr2=0x7faad415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 --2- 172.21.15.12:0/1191117048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 0x7faad415a930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faac0009900 tx=0x7faac0009120 comp rx=0 tx=0).stop 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 -- 172.21.15.12:0/1191117048 shutdown_connections 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 --2- 172.21.15.12:0/1191117048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fef0 0x7faad415a930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 -- 172.21.15.12:0/1191117048 >> 172.21.15.12:0/1191117048 conn(0x7faad406d170 msgr2=0x7faad40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 -- 172.21.15.12:0/1191117048 shutdown_connections 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.705+0000 7faad9f9d700 1 -- 172.21.15.12:0/1191117048 wait complete. 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.706+0000 7faad9f9d700 1 Processor -- start 2023-10-08T17:24:32.719 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.706+0000 7faad9f9d700 1 -- start start 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fb20 0x7faad40b16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad4159200 con 0x7faad413fef0 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad40ad420 con 0x7faad406aaa0 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.707+0000 7faad9f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad40ac810 con 0x7faad413fb20 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad8f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36362/0 (socket says 172.21.15.12:36362) 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 -- 172.21.15.12:0/2154286172 learned_addr learned my addr 172.21.15.12:0/2154286172 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad8f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:42984/0 (socket says 172.21.15.12:42984) 2023-10-08T17:24:32.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad3fff700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fb20 0x7faad40b16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 -- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fb20 msgr2=0x7faad40b16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fb20 0x7faad40b16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 -- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 msgr2=0x7faad40addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad979c700 1 -- 172.21.15.12:0/2154286172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac00093c0 con 0x7faad413fef0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.708+0000 7faad8f9b700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad979c700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c830 tx=0x7faacc007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc012630 con 0x7faad413fef0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc012790 con 0x7faad413fef0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad40acaf0 con 0x7faad413fef0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc012b50 con 0x7faad413fef0 2023-10-08T17:24:32.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.709+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad40ad0b0 con 0x7faad413fef0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.710+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad40ad7b0 con 0x7faad413fef0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.711+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faacc01a3b0 con 0x7faad413fef0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.712+0000 7faad0ff9700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 0x7faab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.712+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7faacc084330 con 0x7faad413fef0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.712+0000 7faad8f9b700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 0x7faab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.712+0000 7faad8f9b700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 0x7faab80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faac8000ff0 tx=0x7faac80017b0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:32.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:32.716+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faacc051430 con 0x7faad413fef0 2023-10-08T17:24:33.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.001+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]} v 0) v1 -- 0x7faad404c3c0 con 0x7faad413fef0 2023-10-08T17:24:33.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.076+0000 7faad0ff9700 1 -- 172.21.15.12:0/2154286172 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_for_number_of_snaps_retention"]}]=0 v2435) v1 ==== 178+0+0 (secure 0 0 0) 0x7faacc054a50 con 0x7faad413fef0 2023-10-08T17:24:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 msgr2=0x7faab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 0x7faab80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faac8000ff0 tx=0x7faac80017b0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 msgr2=0x7faad4137700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7faacc00c830 tx=0x7faacc007f90 comp rx=0 tx=0).stop 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 shutdown_connections 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7faab8066f30 0x7faab80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7faad413fef0 0x7faad4137700 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7faad406aaa0 0x7faad40addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 --2- 172.21.15.12:0/2154286172 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7faad413fb20 0x7faad40b16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 >> 172.21.15.12:0/2154286172 conn(0x7faad406d170 msgr2=0x7faad40cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 shutdown_connections 2023-10-08T17:24:33.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.079+0000 7faad9f9d700 1 -- 172.21.15.12:0/2154286172 wait complete. 2023-10-08T17:24:33.097 INFO:tasks.cephfs_test_runner:Test that number of snaps retained are as per user spec. ... ok 2023-10-08T17:24:33.097 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-10-08T17:24:33.097 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T17:24:33.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-08T17:24:33.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.285+0000 7fe931d9d700 1 Processor -- start 2023-10-08T17:24:33.286 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.285+0000 7fe931d9d700 1 -- start start 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe931d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe92c13fb20 0x7fe92c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe931d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c06aaa0 0x7fe92c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe931d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c15ae70 con 0x7fe92c13fef0 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe931d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c06af60 con 0x7fe92c13fb20 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe931d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c06b240 con 0x7fe92c06aaa0 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe930d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe92c13fb20 0x7fe92c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe92bfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe92c13fef0 0x7fe92c0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35094/0 (socket says 172.21.15.12:35094) 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe92bfff700 1 -- 172.21.15.12:0/1550851220 learned_addr learned my addr 172.21.15.12:0/1550851220 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:33.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.287+0000 7fe93159c700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c06aaa0 0x7fe92c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe92b7fe700 1 -- 172.21.15.12:0/1550851220 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575080836 0 0) 0x7fe918001290 con 0x7fe92c13fef0 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe92b7fe700 1 -- 172.21.15.12:0/1550851220 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe91c003570 con 0x7fe92c13fef0 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe930d9b700 1 -- 172.21.15.12:0/1550851220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c06aaa0 msgr2=0x7fe92c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe930d9b700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c06aaa0 0x7fe92c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe930d9b700 1 -- 172.21.15.12:0/1550851220 >> v1:172.21.15.12:6789/0 conn(0x7fe92c13fef0 legacy=0x7fe92c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe930d9b700 1 -- 172.21.15.12:0/1550851220 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c06b520 con 0x7fe92c13fb20 2023-10-08T17:24:33.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe930d9b700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c15a930 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe9200098e0 tx=0x7fe9200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d986b049cd284302 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe92b7fe700 1 -- 172.21.15.12:0/1550851220 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920011630 con 0x7fe92c13fb20 2023-10-08T17:24:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe92b7fe700 1 -- 172.21.15.12:0/1550851220 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe920011790 con 0x7fe92c13fb20 2023-10-08T17:24:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.288+0000 7fe92b7fe700 1 -- 172.21.15.12:0/1550851220 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe920011b30 con 0x7fe92c13fb20 2023-10-08T17:24:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 -- 172.21.15.12:0/1550851220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 msgr2=0x7fe92c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c15a930 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fe9200098e0 tx=0x7fe9200091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 -- 172.21.15.12:0/1550851220 shutdown_connections 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c06aaa0 0x7fe92c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 --2- 172.21.15.12:0/1550851220 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c15a930 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 -- 172.21.15.12:0/1550851220 >> 172.21.15.12:0/1550851220 conn(0x7fe92c06d170 msgr2=0x7fe92c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 -- 172.21.15.12:0/1550851220 shutdown_connections 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.289+0000 7fe931d9d700 1 -- 172.21.15.12:0/1550851220 wait complete. 2023-10-08T17:24:33.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.290+0000 7fe931d9d700 1 Processor -- start 2023-10-08T17:24:33.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.290+0000 7fe931d9d700 1 -- start start 2023-10-08T17:24:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe92c06aaa0 0x7fe92c159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 0x7fe92c16da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c13dc40 con 0x7fe92c13fb20 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c13df20 con 0x7fe92c06aaa0 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.291+0000 7fe931d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c156e10 con 0x7fe92c13fef0 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36382/0 (socket says 172.21.15.12:36382) 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 -- 172.21.15.12:0/447980420 learned_addr learned my addr 172.21.15.12:0/447980420 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe93159c700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 0x7fe92c16da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 -- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 msgr2=0x7fe92c16da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 0x7fe92c16da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 -- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe92c06aaa0 msgr2=0x7fe92c159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe930d9b700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe92c06aaa0 0x7fe92c159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe92c06aaa0 0x7fe92c159330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 -- 172.21.15.12:0/447980420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe920009420 con 0x7fe92c13fb20 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe93159c700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 0x7fe92c16da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe92bfff700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c7c0 tx=0x7fe918007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180072e0 con 0x7fe92c13fb20 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe918007440 con 0x7fe92c13fb20 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.292+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9180057f0 con 0x7fe92c13fb20 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.293+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c1570f0 con 0x7fe92c13fb20 2023-10-08T17:24:33.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.293+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c13d120 con 0x7fe92c13fb20 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.294+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c04c3c0 con 0x7fe92c13fb20 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.295+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe918005ba0 con 0x7fe92c13fb20 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.295+0000 7fe928ff9700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.295+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fe918083a60 con 0x7fe92c13fb20 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.296+0000 7fe930d9b700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.296+0000 7fe930d9b700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 0x7fe9100693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe920003080 tx=0x7fe920017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.300+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe918050b60 con 0x7fe92c13fb20 2023-10-08T17:24:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:33.587+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fe92c15ae70 con 0x7fe92c13fb20 2023-10-08T17:24:34.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:24:34.060 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:24:34.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.078+0000 7fe928ff9700 1 -- 172.21.15.12:0/447980420 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2436) v1 ==== 177+0+0 (secure 0 0 0) 0x7fe92c15ae70 con 0x7fe92c13fb20 2023-10-08T17:24:34.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 msgr2=0x7fe9100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 0x7fe9100693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe920003080 tx=0x7fe920017000 comp rx=0 tx=0).stop 2023-10-08T17:24:34.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 msgr2=0x7fe92c16d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fe91800c7c0 tx=0x7fe918007a80 comp rx=0 tx=0).stop 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 shutdown_connections 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe910066f30 0x7fe9100693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe92c13fef0 0x7fe92c16da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe92c06aaa0 0x7fe92c159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 --2- 172.21.15.12:0/447980420 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe92c13fb20 0x7fe92c16d4c0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 >> 172.21.15.12:0/447980420 conn(0x7fe92c06d170 msgr2=0x7fe92c0c1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:34.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 shutdown_connections 2023-10-08T17:24:34.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.081+0000 7fe931d9d700 1 -- 172.21.15.12:0/447980420 wait complete. 2023-10-08T17:24:34.116 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T17:24:34.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.381+0000 7f606f59e700 1 Processor -- start 2023-10-08T17:24:34.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.381+0000 7f606f59e700 1 -- start start 2023-10-08T17:24:34.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6070153a00 0x7f6070153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f607015de50 0x7f607015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f60700cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60700cf3c0 con 0x7f607015de50 2023-10-08T17:24:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607015af60 con 0x7f6070153a00 2023-10-08T17:24:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.382+0000 7f606f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607015b240 con 0x7f60700cea00 2023-10-08T17:24:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f607015de50 0x7f607015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f607015de50 0x7f607015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36386/0 (socket says 172.21.15.12:36386) 2023-10-08T17:24:34.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 -- 172.21.15.12:0/603557418 learned_addr learned my addr 172.21.15.12:0/603557418 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606e59c700 1 --2- 172.21.15.12:0/603557418 >> v2:172.21.15.29:3300/0 conn(0x7f6070153a00 0x7f6070153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606ed9d700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f60700cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 -- 172.21.15.12:0/603557418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 msgr2=0x7f60700cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f60700cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 -- 172.21.15.12:0/603557418 >> v2:172.21.15.29:3300/0 conn(0x7f6070153a00 msgr2=0x7f6070153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 --2- 172.21.15.12:0/603557418 >> v2:172.21.15.29:3300/0 conn(0x7f6070153a00 0x7f6070153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.383+0000 7f606dd9b700 1 -- 172.21.15.12:0/603557418 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607015b520 con 0x7f607015de50 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606dd9b700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f607015a540 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f60700cac20 tx=0x7f6064009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22780481613a6ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606d59a700 1 -- 172.21.15.12:0/603557418 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400b640 con 0x7f607015de50 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606d59a700 1 -- 172.21.15.12:0/603557418 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400b7a0 con 0x7f607015de50 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606d59a700 1 -- 172.21.15.12:0/603557418 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400bb60 con 0x7f607015de50 2023-10-08T17:24:34.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 -- 172.21.15.12:0/603557418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 msgr2=0x7f607015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f607015a540 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f60700cac20 tx=0x7f6064009250 comp rx=0 tx=0).stop 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 -- 172.21.15.12:0/603557418 shutdown_connections 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f60700cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 --2- 172.21.15.12:0/603557418 >> v2:172.21.15.29:3300/0 conn(0x7f6070153a00 0x7f6070153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 --2- 172.21.15.12:0/603557418 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f607015a540 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 -- 172.21.15.12:0/603557418 >> 172.21.15.12:0/603557418 conn(0x7f60700703a0 msgr2=0x7f60700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.384+0000 7f606f59e700 1 -- 172.21.15.12:0/603557418 shutdown_connections 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.385+0000 7f606f59e700 1 -- 172.21.15.12:0/603557418 wait complete. 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.386+0000 7f606f59e700 1 Processor -- start 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.386+0000 7f606f59e700 1 -- start start 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f6070144f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6070153a00 0x7f60700c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070151710 con 0x7f607015de50 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070157870 con 0x7f6070153a00 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6070158110 con 0x7f60700cea00 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36396/0 (socket says 172.21.15.12:36396) 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606ed9d700 1 -- 172.21.15.12:0/3677818812 learned_addr learned my addr 172.21.15.12:0/3677818812 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606e59c700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f6070144f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.387+0000 7f606dd9b700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6070153a00 0x7f60700c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 -- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 msgr2=0x7f6070144f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f6070144f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 -- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6070153a00 msgr2=0x7f60700c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6070153a00 0x7f60700c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 -- 172.21.15.12:0/3677818812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60640094f0 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606ed9d700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f6068009e20 tx=0x7f606800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800caa0 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800f040 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070145470 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800ce70 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.388+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6070157ac0 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.389+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60701582a0 con 0x7f607015de50 2023-10-08T17:24:34.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.390+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6068014690 con 0x7f607015de50 2023-10-08T17:24:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.392+0000 7f605e7fc700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.392+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f60680850d0 con 0x7f607015de50 2023-10-08T17:24:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.392+0000 7f606e59c700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.392+0000 7f606e59c700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 0x7f60500693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6060009c80 tx=0x7f60600091a0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:34.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.395+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6068055d00 con 0x7f607015de50 2023-10-08T17:24:34.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.598+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f607004c3c0 con 0x7f607015de50 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.603+0000 7f605e7fc700 1 -- 172.21.15.12:0/3677818812 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6068055890 con 0x7f607015de50 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 msgr2=0x7f60500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 0x7f60500693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6060009c80 tx=0x7f60600091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 msgr2=0x7f6070151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f6068009e20 tx=0x7f606800b040 comp rx=0 tx=0).stop 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 shutdown_connections 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6050066f30 0x7f60500693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f607015de50 0x7f6070151e10 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60700cea00 0x7f6070144f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 --2- 172.21.15.12:0/3677818812 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6070153a00 0x7f60700c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 >> 172.21.15.12:0/3677818812 conn(0x7f60700703a0 msgr2=0x7f60700b1c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:34.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 shutdown_connections 2023-10-08T17:24:34.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:34.605+0000 7f606f59e700 1 -- 172.21.15.12:0/3677818812 wait complete. 2023-10-08T17:24:34.696 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:24:34.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:24:34.775 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:24:34.866 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:24:34.874 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T17:24:34.874 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:35.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.061+0000 7f2c3d19d700 1 Processor -- start 2023-10-08T17:24:35.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.061+0000 7f2c3d19d700 1 -- start start 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.062+0000 7f2c3d19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2c38140e40 0x7f2c380c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.062+0000 7f2c3d19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380c6d50 con 0x7f2c38140a70 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.062+0000 7f2c3d19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c380c7030 con 0x7f2c3806de50 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.062+0000 7f2c3d19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c380c7310 con 0x7f2c38140e40 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c37fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2c38140a70 0x7f2c380c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35102/0 (socket says 172.21.15.12:35102) 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c37fff700 1 -- 172.21.15.12:0/3760504154 learned_addr learned my addr 172.21.15.12:0/3760504154 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c377fe700 1 --2- 172.21.15.12:0/3760504154 >> v2:172.21.15.29:3300/0 conn(0x7f2c38140e40 0x7f2c380c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623418951 0 0) 0x7f2c380c6d50 con 0x7f2c38140a70 2023-10-08T17:24:35.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c20003570 con 0x7f2c38140a70 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762967674 0 0) 0x7f2c20003570 con 0x7f2c38140a70 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 >> v2:172.21.15.29:3300/0 conn(0x7f2c38140e40 msgr2=0x7f2c380c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 --2- 172.21.15.12:0/3760504154 >> v2:172.21.15.29:3300/0 conn(0x7f2c38140e40 0x7f2c380c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 >> v1:172.21.15.29:6789/0 conn(0x7f2c3806de50 legacy=0x7f2c380aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380c75f0 con 0x7f2c38140a70 2023-10-08T17:24:35.066 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.063+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f2c28001470 con 0x7f2c38140a70 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 >> v1:172.21.15.12:6789/0 conn(0x7f2c38140a70 legacy=0x7f2c380c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c20003a60 0x7f2c20003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c20004810 0x7f2c20004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 0x7f2c2000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380c7310 con 0x7f2c200051c0 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2000c0d0 con 0x7f2c20004810 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2000c290 con 0x7f2c20003a60 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 0x7f2c2000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c377fe700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c20004810 0x7f2c20004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c37fff700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c20003a60 0x7f2c20003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 -- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c20003a60 msgr2=0x7f2c20003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:35.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c20003a60 0x7f2c20003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 -- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c20004810 msgr2=0x7f2c20004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c20004810 0x7f2c20004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c3c99c700 1 -- 172.21.15.12:0/3760504154 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c20003570 con 0x7f2c200051c0 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.064+0000 7f2c377fe700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c20004810 0x7f2c20004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3c99c700 1 -- 172.21.15.12:0/3760504154 reap_dead start 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 0x7f2c2000ba60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f2c30001fc0 tx=0x7f2c30001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea87f035db3ad451 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30001950 con 0x7f2c200051c0 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000c8b0 con 0x7f2c200051c0 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c36ffd700 1 -- 172.21.15.12:0/3760504154 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3000cc90 con 0x7f2c200051c0 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3d19d700 1 -- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 msgr2=0x7f2c2000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 0x7f2c2000ba60 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f2c30001fc0 tx=0x7f2c30001640 comp rx=0 tx=0).stop 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3d19d700 1 -- 172.21.15.12:0/3760504154 shutdown_connections 2023-10-08T17:24:35.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/3760504154 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c200051c0 0x7f2c2000ba60 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.065+0000 7f2c3d19d700 1 -- 172.21.15.12:0/3760504154 >> 172.21.15.12:0/3760504154 conn(0x7f2c3806d170 msgr2=0x7f2c380cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:35.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.066+0000 7f2c3d19d700 1 -- 172.21.15.12:0/3760504154 shutdown_connections 2023-10-08T17:24:35.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.066+0000 7f2c3d19d700 1 -- 172.21.15.12:0/3760504154 wait complete. 2023-10-08T17:24:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.067+0000 7f2c3d19d700 1 Processor -- start 2023-10-08T17:24:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.067+0000 7f2c3d19d700 1 -- start start 2023-10-08T17:24:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 0x7f2c380aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.071 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c3816ab10 0x7f2c38156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380cbbc0 con 0x7f2c380cb210 2023-10-08T17:24:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c380af590 con 0x7f2c200051c0 2023-10-08T17:24:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3816af80 con 0x7f2c3816ab10 2023-10-08T17:24:35.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36414/0 (socket says 172.21.15.12:36414) 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.068+0000 7f2c3c99c700 1 -- 172.21.15.12:0/1737841908 learned_addr learned my addr 172.21.15.12:0/1737841908 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c37fff700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 0x7f2c380aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c377fe700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c3816ab10 0x7f2c38156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 -- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c3816ab10 msgr2=0x7f2c38156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c3816ab10 0x7f2c38156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 -- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 msgr2=0x7f2c380aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 0x7f2c380aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 -- 172.21.15.12:0/1737841908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3816d810 con 0x7f2c380cb210 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c37fff700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 0x7f2c380aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3c99c700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f2c3806f940 tx=0x7f2c30015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c30001950 con 0x7f2c380cb210 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3000c6d0 con 0x7f2c380cb210 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3001e850 con 0x7f2c380cb210 2023-10-08T17:24:35.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3816daf0 con 0x7f2c380cb210 2023-10-08T17:24:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.069+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3816e0b0 con 0x7f2c380cb210 2023-10-08T17:24:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.070+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3816e2d0 con 0x7f2c380cb210 2023-10-08T17:24:35.075 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.071+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c3001ec00 con 0x7f2c380cb210 2023-10-08T17:24:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.072+0000 7f2c1ffff700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.072+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5919+0+0 (secure 0 0 0) 0x7f2c300861c0 con 0x7f2c380cb210 2023-10-08T17:24:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.072+0000 7f2c37fff700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:35.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.073+0000 7f2c37fff700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 0x7f2c240693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c280010e0 tx=0x7f2c28009040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:35.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.076+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c300532c0 con 0x7f2c380cb210 2023-10-08T17:24:35.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.323+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c3813f4c0 con 0x7f2c380cb210 2023-10-08T17:24:35.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.324+0000 7f2c1ffff700 1 -- 172.21.15.12:0/1737841908 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f2c30017de0 con 0x7f2c380cb210 2023-10-08T17:24:35.339 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:35.339 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":67,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7217,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/3686324356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3686324356},{"type":"v1","addr":"172.21.15.12:6834","nonce":3686324356}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1078548327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1078548327},{"type":"v1","addr":"172.21.15.29:6835","nonce":1078548327}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7843,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2198340433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":2198340433},{"type":"v1","addr":"172.21.15.12:6835","nonce":2198340433}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2081690333","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2081690333},{"type":"v1","addr":"172.21.15.29:6834","nonce":2081690333}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[]} 2023-10-08T17:24:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 msgr2=0x7f2c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 0x7f2c240693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2c280010e0 tx=0x7f2c28009040 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 msgr2=0x7f2c380cb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f2c3806f940 tx=0x7f2c30015000 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 shutdown_connections 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c24066f30 0x7f2c240693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c380cb210 0x7f2c380cb680 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c200051c0 0x7f2c380aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 --2- 172.21.15.12:0/1737841908 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c3816ab10 0x7f2c38156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 >> 172.21.15.12:0/1737841908 conn(0x7f2c3806d170 msgr2=0x7f2c3815c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 shutdown_connections 2023-10-08T17:24:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:35.326+0000 7f2c3d19d700 1 -- 172.21.15.12:0/1737841908 wait complete. 2023-10-08T17:24:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 67 2023-10-08T17:24:35.344 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T17:24:35.344 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T17:24:35.344 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T17:24:35.344 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:24:35.344 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T17:24:35.344 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T17:24:35.345 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T17:24:35.345 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:24:35.345 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T17:24:35.345 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T17:24:35.346 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T17:24:35.346 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:24:35.346 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T17:24:35.346 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T17:24:35.347 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T17:24:35.347 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:24:35.359 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T17:24:35.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T17:24:35.360 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T17:24:35.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T17:24:35.363 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T17:24:35.481 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T17:24:35.486 INFO:tasks.ceph.mds.a:Started 2023-10-08T17:24:35.487 DEBUG:teuthology.parallel:result is None 2023-10-08T17:24:35.502 INFO:tasks.ceph.mds.c:Started 2023-10-08T17:24:35.919 DEBUG:teuthology.parallel:result is None 2023-10-08T17:24:35.920 INFO:tasks.ceph.mds.b:Started 2023-10-08T17:24:35.920 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T17:24:35.920 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T17:24:35.920 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:24:35.921 DEBUG:teuthology.parallel:result is None 2023-10-08T17:24:37.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-08T17:24:41.484 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T17:24:41.484 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T17:24:41.490 INFO:tasks.ceph.mds.d:Started 2023-10-08T17:24:41.490 DEBUG:teuthology.parallel:result is None 2023-10-08T17:24:41.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T17:24:41.632 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T17:24:41.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.690+0000 7fc134b9d700 1 Processor -- start 2023-10-08T17:24:41.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.690+0000 7fc134b9d700 1 -- start start 2023-10-08T17:24:41.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.691+0000 7fc134b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 0x7fc13015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.691+0000 7fc134b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13013fef0 0x7fc1300c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc134b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13015ae70 con 0x7fc13006aaa0 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc134b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13006af60 con 0x7fc13013fef0 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc134b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc13006b240 con 0x7fc13013fb20 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 0x7fc13015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13013fef0 0x7fc1300c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc13013fef0 0x7fc1300c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:43048/0 (socket says 172.21.15.12:43048) 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12f7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 0x7fc13015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:49232/0 (socket says 172.21.15.12:49232) 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 -- 172.21.15.12:0/4259410686 learned_addr learned my addr 172.21.15.12:0/4259410686 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:41.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 -- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 msgr2=0x7fc13015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 --2- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 0x7fc13015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 -- 172.21.15.12:0/4259410686 >> v1:172.21.15.29:6789/0 conn(0x7fc13006aaa0 legacy=0x7fc1300c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12effd700 1 -- 172.21.15.12:0/4259410686 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13006b520 con 0x7fc13013fef0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.692+0000 7fc12e7fc700 1 -- 172.21.15.12:0/4259410686 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057825495 0 0) 0x7fc128001490 con 0x7fc13006aaa0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc12effd700 1 --2- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13013fef0 0x7fc1300c7990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc124009990 tx=0x7fc124009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7322fa082e39e96 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc12e7fc700 1 -- 172.21.15.12:0/4259410686 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124009e80 con 0x7fc13013fef0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc12e7fc700 1 -- 172.21.15.12:0/4259410686 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc124005c10 con 0x7fc13013fef0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc12e7fc700 1 -- 172.21.15.12:0/4259410686 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400b650 con 0x7fc13013fef0 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc134b9d700 1 -- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13013fef0 msgr2=0x7fc1300c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.693+0000 7fc134b9d700 1 --2- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13013fef0 0x7fc1300c7990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc124009990 tx=0x7fc124009220 comp rx=0 tx=0).stop 2023-10-08T17:24:41.697 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 -- 172.21.15.12:0/4259410686 shutdown_connections 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 --2- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fb20 0x7fc13015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 --2- 172.21.15.12:0/4259410686 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13013fef0 0x7fc1300c7990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 -- 172.21.15.12:0/4259410686 >> 172.21.15.12:0/4259410686 conn(0x7fc13006d170 msgr2=0x7fc1300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 -- 172.21.15.12:0/4259410686 shutdown_connections 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.694+0000 7fc134b9d700 1 -- 172.21.15.12:0/4259410686 wait complete. 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.695+0000 7fc134b9d700 1 Processor -- start 2023-10-08T17:24:41.698 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.695+0000 7fc134b9d700 1 -- start start 2023-10-08T17:24:41.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 0x7fc1300ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fef0 0x7fc130158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300ad270 con 0x7fc13013fb20 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300ac370 con 0x7fc13006aaa0 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.696+0000 7fc134b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1300abdf0 con 0x7fc13013fef0 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36440/0 (socket says 172.21.15.12:36440) 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 -- 172.21.15.12:0/3405459929 learned_addr learned my addr 172.21.15.12:0/3405459929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12f7fe700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 0x7fc1300ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12ffff700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fef0 0x7fc130158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 -- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fef0 msgr2=0x7fc130158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fef0 0x7fc130158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 -- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 msgr2=0x7fc1300ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 0x7fc1300ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 -- 172.21.15.12:0/3405459929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc124009480 con 0x7fc13013fb20 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12f7fe700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 0x7fc1300ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.697+0000 7fc12effd700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b3c0 tx=0x7fc124016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.698+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12401db50 con 0x7fc13013fb20 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.698+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12401dcd0 con 0x7fc13013fb20 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.698+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12401b6d0 con 0x7fc13013fb20 2023-10-08T17:24:41.702 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.698+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1300adbd0 con 0x7fc13013fb20 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.698+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1300ac090 con 0x7fc13013fb20 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.699+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1300ad3b0 con 0x7fc13013fb20 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.700+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc12401ba40 con 0x7fc13013fb20 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.701+0000 7fc1177fe700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.701+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5919+0+0 (secure 0 0 0) 0x7fc1240865b0 con 0x7fc13013fb20 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.701+0000 7fc12f7fe700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:41.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.701+0000 7fc12f7fe700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 0x7fc11c0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc120011480 tx=0x7fc1200091a0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:41.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.705+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1300ad3b0 con 0x7fc13013fb20 2023-10-08T17:24:41.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:41.922+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc1300ad3b0 con 0x7fc13013fb20 2023-10-08T17:24:43.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.026+0000 7fc1177fe700 1 -- 172.21.15.12:0/3405459929 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc1300ad3b0 con 0x7fc13013fb20 2023-10-08T17:24:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 msgr2=0x7fc11c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 0x7fc11c0693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc120011480 tx=0x7fc1200091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 msgr2=0x7fc1300ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fc12400b3c0 tx=0x7fc124016000 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 shutdown_connections 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc11c066f30 0x7fc11c0693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc13013fef0 0x7fc130158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc13006aaa0 0x7fc1300ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 --2- 172.21.15.12:0/3405459929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc13013fb20 0x7fc1300ad690 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 >> 172.21.15.12:0/3405459929 conn(0x7fc13006d170 msgr2=0x7fc13006de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 shutdown_connections 2023-10-08T17:24:43.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.029+0000 7fc134b9d700 1 -- 172.21.15.12:0/3405459929 wait complete. 2023-10-08T17:24:43.031 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T17:24:43.051 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T17:24:43.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.243+0000 7f0ca759e700 1 Processor -- start 2023-10-08T17:24:43.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.243+0000 7f0ca759e700 1 -- start start 2023-10-08T17:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0ca8150380 0x7f0ca8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca806a490 con 0x7f0ca806f3a0 2023-10-08T17:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca80c7230 con 0x7f0ca806e0a0 2023-10-08T17:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca806b930 con 0x7f0ca8150380 2023-10-08T17:24:43.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0ca806f3a0 0x7f0ca814fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42952/0 (socket says 172.21.15.12:42952) 2023-10-08T17:24:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca5d9b700 1 -- 172.21.15.12:0/2434114660 learned_addr learned my addr 172.21.15.12:0/2434114660 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:43.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.245+0000 7f0ca6d9d700 1 --2- 172.21.15.12:0/2434114660 >> v2:172.21.15.29:3300/0 conn(0x7f0ca8150380 0x7f0ca8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729896535 0 0) 0x7f0ca806a490 con 0x7f0ca806f3a0 2023-10-08T17:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c90003570 con 0x7f0ca806f3a0 2023-10-08T17:24:43.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274466399 0 0) 0x7f0ca80c7230 con 0x7f0ca806e0a0 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca806a490 con 0x7f0ca806e0a0 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca6d9d700 1 -- 172.21.15.12:0/2434114660 >> v1:172.21.15.29:6789/0 conn(0x7f0ca806e0a0 legacy=0x7f0ca80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca6d9d700 1 -- 172.21.15.12:0/2434114660 >> v1:172.21.15.12:6789/0 conn(0x7f0ca806f3a0 legacy=0x7f0ca814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca6d9d700 1 -- 172.21.15.12:0/2434114660 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80c7490 con 0x7f0ca8150380 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca6d9d700 1 --2- 172.21.15.12:0/2434114660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8150380 0x7f0ca8160ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000af70 tx=0x7f0ca000a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=658112c463eb6904 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000f070 con 0x7f0ca8150380 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000a2e0 con 0x7f0ca8150380 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.246+0000 7f0ca559a700 1 -- 172.21.15.12:0/2434114660 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000cbc0 con 0x7f0ca8150380 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 -- 172.21.15.12:0/2434114660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8150380 msgr2=0x7f0ca8160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 --2- 172.21.15.12:0/2434114660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8150380 0x7f0ca8160ae0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000af70 tx=0x7f0ca000a890 comp rx=0 tx=0).stop 2023-10-08T17:24:43.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 -- 172.21.15.12:0/2434114660 shutdown_connections 2023-10-08T17:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 --2- 172.21.15.12:0/2434114660 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca8150380 0x7f0ca8160ae0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 -- 172.21.15.12:0/2434114660 >> 172.21.15.12:0/2434114660 conn(0x7f0ca806d170 msgr2=0x7f0ca80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 -- 172.21.15.12:0/2434114660 shutdown_connections 2023-10-08T17:24:43.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.247+0000 7f0ca759e700 1 -- 172.21.15.12:0/2434114660 wait complete. 2023-10-08T17:24:43.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.249+0000 7f0ca759e700 1 Processor -- start 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.249+0000 7f0ca759e700 1 -- start start 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca806f3a0 0x7f0ca8168e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca8150380 0x7f0ca8139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81593b0 con 0x7f0ca806e0a0 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca8158df0 con 0x7f0ca806f3a0 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca81590d0 con 0x7f0ca8150380 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36916/0 (socket says 172.21.15.12:36916) 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 -- 172.21.15.12:0/1421930092 learned_addr learned my addr 172.21.15.12:0/1421930092 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:43.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca6d9d700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca8150380 0x7f0ca8139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca5d9b700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca806f3a0 0x7f0ca8168e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 -- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca8150380 msgr2=0x7f0ca8139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca8150380 0x7f0ca8139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 -- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca806f3a0 msgr2=0x7f0ca8168e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca806f3a0 0x7f0ca8168e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.250+0000 7f0ca659c700 1 -- 172.21.15.12:0/1421930092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca000ab30 con 0x7f0ca806e0a0 2023-10-08T17:24:43.252 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0ca659c700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c7c0 tx=0x7f0c98007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98002ea0 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c98010510 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c980108b0 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca814aa70 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.251+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8156790 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.252+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca814af90 con 0x7f0ca806e0a0 2023-10-08T17:24:43.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.253+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c98010ca0 con 0x7f0ca806e0a0 2023-10-08T17:24:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.255+0000 7f0c967fc700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.255+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f0c98083a00 con 0x7f0ca806e0a0 2023-10-08T17:24:43.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.255+0000 7f0ca5d9b700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.256+0000 7f0ca5d9b700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 0x7f0c880693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8163210 tx=0x7f0c9c009040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.259+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c98050d50 con 0x7f0ca806e0a0 2023-10-08T17:24:43.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.536+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0ca804c3c0 con 0x7f0ca806e0a0 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.537+0000 7f0c967fc700 1 -- 172.21.15.12:0/1421930092 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v37) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0c98017070 con 0x7f0ca806e0a0 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.537 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T17:24:43.538 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:24:43.539 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.540 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T17:24:43.541 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.542 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.543 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.544 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.545 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T17:24:43.546 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:24:43.547 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.548 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T17:24:43.549 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T17:24:43.550 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.550 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:24:43.550 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:24:43.550 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:24:43.552 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.552 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.552 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:24:43.553 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T17:24:43.554 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 msgr2=0x7f0c880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 0x7f0c880693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8163210 tx=0x7f0c9c009040 comp rx=0 tx=0).stop 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 msgr2=0x7f0ca8156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f0c9800c7c0 tx=0x7f0c98007dc0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 shutdown_connections 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0c88066f30 0x7f0c880693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0ca806e0a0 0x7f0ca8156250 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0ca8150380 0x7f0ca8139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 --2- 172.21.15.12:0/1421930092 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0ca806f3a0 0x7f0ca8168e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 >> 172.21.15.12:0/1421930092 conn(0x7f0ca806d170 msgr2=0x7f0ca814d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 shutdown_connections 2023-10-08T17:24:43.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.539+0000 7f0ca759e700 1 -- 172.21.15.12:0/1421930092 wait complete. 2023-10-08T17:24:43.558 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:43.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.745+0000 7fefee79d700 1 Processor -- start 2023-10-08T17:24:43.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.746+0000 7fefee79d700 1 -- start start 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefee79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe80c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefee79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fefe806f3a0 0x7fefe814fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefee79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe806a490 con 0x7fefe806e470 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefee79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe806b930 con 0x7fefe806f3a0 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefee79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80c7490 con 0x7fefe806e0a0 2023-10-08T17:24:43.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefedf9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fefe806e470 0x7fefe8159740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42956/0 (socket says 172.21.15.12:42956) 2023-10-08T17:24:43.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefedf9c700 1 -- 172.21.15.12:0/1808574813 learned_addr learned my addr 172.21.15.12:0/1808574813 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:43.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefed79b700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe80c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.747+0000 7fefecf9a700 1 --2- 172.21.15.12:0/1808574813 >> v2:172.21.15.29:3300/0 conn(0x7fefe806f3a0 0x7fefe814fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefdffff700 1 -- 172.21.15.12:0/1808574813 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002117794 0 0) 0x7fefe806a490 con 0x7fefe806e470 2023-10-08T17:24:43.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefdffff700 1 -- 172.21.15.12:0/1808574813 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd4003570 con 0x7fefe806e470 2023-10-08T17:24:43.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefecf9a700 1 -- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 msgr2=0x7fefe80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:43.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefecf9a700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe80c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefecf9a700 1 -- 172.21.15.12:0/1808574813 >> v1:172.21.15.12:6789/0 conn(0x7fefe806e470 legacy=0x7fefe8159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefecf9a700 1 -- 172.21.15.12:0/1808574813 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80c7770 con 0x7fefe806f3a0 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefecf9a700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe814fc70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098d0 tx=0x7fefd8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5e171bc5060cbaf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefdffff700 1 -- 172.21.15.12:0/1808574813 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8005c10 con 0x7fefe806f3a0 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefdffff700 1 -- 172.21.15.12:0/1808574813 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8005d70 con 0x7fefe806f3a0 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.748+0000 7fefdffff700 1 -- 172.21.15.12:0/1808574813 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8006260 con 0x7fefe806f3a0 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 -- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 msgr2=0x7fefe814fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe814fc70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098d0 tx=0x7fefd8009120 comp rx=0 tx=0).stop 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 -- 172.21.15.12:0/1808574813 shutdown_connections 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe80c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 --2- 172.21.15.12:0/1808574813 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe814fc70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 -- 172.21.15.12:0/1808574813 >> 172.21.15.12:0/1808574813 conn(0x7fefe806d170 msgr2=0x7fefe80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:43.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 -- 172.21.15.12:0/1808574813 shutdown_connections 2023-10-08T17:24:43.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.749+0000 7fefee79d700 1 -- 172.21.15.12:0/1808574813 wait complete. 2023-10-08T17:24:43.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.750+0000 7fefee79d700 1 Processor -- start 2023-10-08T17:24:43.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.751+0000 7fefee79d700 1 -- start start 2023-10-08T17:24:43.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.751+0000 7fefee79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe8145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.751+0000 7fefee79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.751+0000 7fefee79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe80c1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefee79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe814a780 con 0x7fefe806e470 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefee79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe814aa60 con 0x7fefe806f3a0 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefee79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80af050 con 0x7fefe806e0a0 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36928/0 (socket says 172.21.15.12:36928) 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 -- 172.21.15.12:0/3821396322 learned_addr learned my addr 172.21.15.12:0/3821396322 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefed79b700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe8145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefedf9c700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe80c1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 -- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 msgr2=0x7fefe8145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe8145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 -- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 msgr2=0x7fefe80c1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe80c1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 -- 172.21.15.12:0/3821396322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd80093c0 con 0x7fefe806e470 2023-10-08T17:24:43.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.752+0000 7fefecf9a700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fefe8071320 tx=0x7fefd8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.753+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd801d910 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.753+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd801da70 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.753+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe80af330 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.753+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd801de30 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.753+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe81462f0 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.754+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80af570 con 0x7fefe806e470 2023-10-08T17:24:43.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.755+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefd801a630 con 0x7fefe806e470 2023-10-08T17:24:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.756+0000 7fefdd7fa700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 0x7fefcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.756+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fefd80859b0 con 0x7fefe806e470 2023-10-08T17:24:43.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.756+0000 7fefed79b700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 0x7fefcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:43.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.757+0000 7fefed79b700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 0x7fefcc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009d40 tx=0x7fefe4008040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:43.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.760+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefe80af570 con 0x7fefe806e470 2023-10-08T17:24:43.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.964+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefe80af520 con 0x7fefe806e470 2023-10-08T17:24:43.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.965+0000 7fefdd7fa700 1 -- 172.21.15.12:0/3821396322 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12903 (secure 0 0 0) 0x7fefd802b020 con 0x7fefe806e470 2023-10-08T17:24:43.966 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:43.966 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":164,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:43.021919+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.967+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 msgr2=0x7fefcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 0x7fefcc0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fefe4009d40 tx=0x7fefe4008040 comp rx=0 tx=0).stop 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 msgr2=0x7fefe81570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fefe8071320 tx=0x7fefd8016000 comp rx=0 tx=0).stop 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 shutdown_connections 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefcc066f30 0x7fefcc0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefe806f3a0 0x7fefe80c1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefe806e0a0 0x7fefe8145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 --2- 172.21.15.12:0/3821396322 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefe806e470 0x7fefe81570c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:43.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 >> 172.21.15.12:0/3821396322 conn(0x7fefe806d170 msgr2=0x7fefe814db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:43.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 shutdown_connections 2023-10-08T17:24:43.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:43.968+0000 7fefee79d700 1 -- 172.21.15.12:0/3821396322 wait complete. 2023-10-08T17:24:43.986 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T17:24:43.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:24:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.178+0000 7f7bab59d700 1 Processor -- start 2023-10-08T17:24:44.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.178+0000 7f7bab59d700 1 -- start start 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.179+0000 7f7bab59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7ba4142c00 0x7f7ba406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.179+0000 7f7bab59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ba406bd20 0x7f7ba40c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7bab59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40ca480 con 0x7f7ba4142fd0 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7bab59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba415e240 con 0x7f7ba406bd20 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7bab59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba406b350 con 0x7f7ba4142c00 2023-10-08T17:24:44.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ba406bd20 0x7f7ba40c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7ba406bd20 0x7f7ba40c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36934/0 (socket says 172.21.15.12:36934) 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 -- 172.21.15.12:0/3153973006 learned_addr learned my addr 172.21.15.12:0/3153973006 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7baa59b700 1 --2- 172.21.15.12:0/3153973006 >> v2:172.21.15.29:3300/0 conn(0x7f7ba4142c00 0x7f7ba406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 -- 172.21.15.12:0/3153973006 >> v2:172.21.15.29:3300/0 conn(0x7f7ba4142c00 msgr2=0x7f7ba406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 --2- 172.21.15.12:0/3153973006 >> v2:172.21.15.29:3300/0 conn(0x7f7ba4142c00 0x7f7ba406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 -- 172.21.15.12:0/3153973006 >> v1:172.21.15.29:6789/0 conn(0x7f7ba4142fd0 legacy=0x7f7ba406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:44.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.180+0000 7f7ba9d9a700 1 -- 172.21.15.12:0/3153973006 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba415df60 con 0x7f7ba406bd20 2023-10-08T17:24:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7ba9d9a700 1 --2- 172.21.15.12:0/3153973006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40c7880 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f7ba406f490 tx=0x7f7b94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e221ca00a8dbef server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7ba9599700 1 -- 172.21.15.12:0/3153973006 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400b820 con 0x7f7ba406bd20 2023-10-08T17:24:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7ba9599700 1 -- 172.21.15.12:0/3153973006 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400b980 con 0x7f7ba406bd20 2023-10-08T17:24:44.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7ba9599700 1 -- 172.21.15.12:0/3153973006 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400bd20 con 0x7f7ba406bd20 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 -- 172.21.15.12:0/3153973006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 msgr2=0x7f7ba40c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 --2- 172.21.15.12:0/3153973006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40c7880 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f7ba406f490 tx=0x7f7b94009250 comp rx=0 tx=0).stop 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 -- 172.21.15.12:0/3153973006 shutdown_connections 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 --2- 172.21.15.12:0/3153973006 >> v2:172.21.15.29:3300/0 conn(0x7f7ba4142c00 0x7f7ba406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 --2- 172.21.15.12:0/3153973006 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40c7880 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 -- 172.21.15.12:0/3153973006 >> 172.21.15.12:0/3153973006 conn(0x7f7ba40675a0 msgr2=0x7f7ba40679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.181+0000 7f7bab59d700 1 -- 172.21.15.12:0/3153973006 shutdown_connections 2023-10-08T17:24:44.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.182+0000 7f7bab59d700 1 -- 172.21.15.12:0/3153973006 wait complete. 2023-10-08T17:24:44.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.183+0000 7f7bab59d700 1 Processor -- start 2023-10-08T17:24:44.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.183+0000 7f7bab59d700 1 -- start start 2023-10-08T17:24:44.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ba4142c00 0x7f7ba4169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 0x7f7ba413d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c52e0 con 0x7f7ba406bd20 2023-10-08T17:24:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40b2f00 con 0x7f7ba4142fd0 2023-10-08T17:24:44.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7bab59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c4760 con 0x7f7ba4142c00 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7baa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7baa59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36944/0 (socket says 172.21.15.12:36944) 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7baa59b700 1 -- 172.21.15.12:0/2322307989 learned_addr learned my addr 172.21.15.12:0/2322307989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.184+0000 7f7ba9d9a700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ba4142c00 0x7f7ba4169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baad9c700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 0x7f7ba413d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 -- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ba4142c00 msgr2=0x7f7ba4169990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ba4142c00 0x7f7ba4169990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 -- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 msgr2=0x7f7ba413d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 0x7f7ba413d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 -- 172.21.15.12:0/2322307989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940094f0 con 0x7f7ba406bd20 2023-10-08T17:24:44.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baad9c700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 0x7f7ba413d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7baa59b700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d890 tx=0x7f7ba0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba00125f0 con 0x7f7ba406bd20 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba0012770 con 0x7f7ba406bd20 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba40c4a40 con 0x7f7ba406bd20 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0012b30 con 0x7f7ba406bd20 2023-10-08T17:24:44.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.185+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba40c5000 con 0x7f7ba406bd20 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.186+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba404c3c0 con 0x7f7ba406bd20 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.187+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ba001e460 con 0x7f7ba406bd20 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.188+0000 7f7b9a7fc700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 0x7f7b880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.188+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f7ba0084b70 con 0x7f7ba406bd20 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.188+0000 7f7ba9d9a700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 0x7f7b880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.189+0000 7f7ba9d9a700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 0x7f7b880693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ba406f490 tx=0x7f7b94016000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.192+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ba0051ec0 con 0x7f7ba406bd20 2023-10-08T17:24:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.391+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ba406ad00 con 0x7f7ba406bd20 2023-10-08T17:24:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.392+0000 7f7b9a7fc700 1 -- 172.21.15.12:0/2322307989 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ba00554e0 con 0x7f7ba406bd20 2023-10-08T17:24:44.392 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 msgr2=0x7f7b880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 0x7f7b880693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ba406f490 tx=0x7f7b94016000 comp rx=0 tx=0).stop 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 msgr2=0x7f7ba40b1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000d890 tx=0x7f7ba0008040 comp rx=0 tx=0).stop 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 shutdown_connections 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7b88066f30 0x7f7b880693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7ba406bd20 0x7f7ba40b1d40 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7ba4142fd0 0x7f7ba413d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 --2- 172.21.15.12:0/2322307989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7ba4142c00 0x7f7ba4169990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 >> 172.21.15.12:0/2322307989 conn(0x7f7ba40675a0 msgr2=0x7f7ba40cadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 shutdown_connections 2023-10-08T17:24:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.394+0000 7f7bab59d700 1 -- 172.21.15.12:0/2322307989 wait complete. 2023-10-08T17:24:44.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-08T17:24:44.412 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T17:24:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.599+0000 7f12e6f9d700 1 Processor -- start 2023-10-08T17:24:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.599+0000 7f12e6f9d700 1 -- start start 2023-10-08T17:24:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.600+0000 7f12e6f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12e0159550 0x7f12e00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.600+0000 7f12e6f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00acc00 con 0x7f12e0159920 2023-10-08T17:24:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.600+0000 7f12e6f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e00abff0 con 0x7f12e015dfd0 2023-10-08T17:24:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.600+0000 7f12e6f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e00ac2d0 con 0x7f12e0159550 2023-10-08T17:24:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e5f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f12e0159550 0x7f12e00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e679c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f12e0159920 0x7f12e00ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42962/0 (socket says 172.21.15.12:42962) 2023-10-08T17:24:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e679c700 1 -- 172.21.15.12:0/3086137922 learned_addr learned my addr 172.21.15.12:0/3086137922 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e5f9b700 1 -- 172.21.15.12:0/3086137922 >> v1:172.21.15.29:6789/0 conn(0x7f12e015dfd0 legacy=0x7f12e00aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e5f9b700 1 -- 172.21.15.12:0/3086137922 >> v1:172.21.15.12:6789/0 conn(0x7f12e0159920 legacy=0x7f12e00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e5f9b700 1 -- 172.21.15.12:0/3086137922 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e00ac5b0 con 0x7f12e0159550 2023-10-08T17:24:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e4f99700 1 -- 172.21.15.12:0/3086137922 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925333347 0 0) 0x7f12e00acc00 con 0x7f12e0159920 2023-10-08T17:24:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e5f9b700 1 --2- 172.21.15.12:0/3086137922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159550 0x7f12e00ceac0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098e0 tx=0x7f12dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07fcead8bb7dc99 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.601+0000 7f12e4f99700 1 -- 172.21.15.12:0/3086137922 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc009e80 con 0x7f12e0159550 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e4f99700 1 -- 172.21.15.12:0/3086137922 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00b820 con 0x7f12e0159550 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e4f99700 1 -- 172.21.15.12:0/3086137922 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00bba0 con 0x7f12e0159550 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 -- 172.21.15.12:0/3086137922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159550 msgr2=0x7f12e00ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/3086137922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159550 0x7f12e00ceac0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098e0 tx=0x7f12dc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 -- 172.21.15.12:0/3086137922 shutdown_connections 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/3086137922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159550 0x7f12e00ceac0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 -- 172.21.15.12:0/3086137922 >> 172.21.15.12:0/3086137922 conn(0x7f12e006ce80 msgr2=0x7f12e00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 -- 172.21.15.12:0/3086137922 shutdown_connections 2023-10-08T17:24:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.602+0000 7f12e6f9d700 1 -- 172.21.15.12:0/3086137922 wait complete. 2023-10-08T17:24:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.604+0000 7f12e6f9d700 1 Processor -- start 2023-10-08T17:24:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.604+0000 7f12e6f9d700 1 -- start start 2023-10-08T17:24:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12e0159550 0x7f12e0151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12e015dfd0 0x7f12e00cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c8650 con 0x7f12e0159920 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c7a40 con 0x7f12e015dfd0 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e6f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c7d20 con 0x7f12e0159550 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36964/0 (socket says 172.21.15.12:36964) 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 -- 172.21.15.12:0/531506323 learned_addr learned my addr 172.21.15.12:0/531506323 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e679c700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12e015dfd0 0x7f12e00cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e5f9b700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12e0159550 0x7f12e0151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 -- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12e0159550 msgr2=0x7f12e0151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12e0159550 0x7f12e0151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 -- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12e015dfd0 msgr2=0x7f12e00cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12e015dfd0 0x7f12e00cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.605+0000 7f12e579a700 1 -- 172.21.15.12:0/531506323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009420 con 0x7f12e0159920 2023-10-08T17:24:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12e579a700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f12d000b5e0 tx=0x7f12d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000f510 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d000f690 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d000fa50 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00c8000 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.606+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e0151510 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.607+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e004c3c0 con 0x7f12e0159920 2023-10-08T17:24:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.608+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12d001a400 con 0x7f12e0159920 2023-10-08T17:24:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.609+0000 7f12d5ffb700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 0x7f12c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.609+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f12d0083e40 con 0x7f12e0159920 2023-10-08T17:24:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.609+0000 7f12e5f9b700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 0x7f12c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.610+0000 7f12e5f9b700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 0x7f12c40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0030c0 tx=0x7f12dc016000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.613+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12d0051210 con 0x7f12e0159920 2023-10-08T17:24:44.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.815+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f12e00caca0 con 0x7f12e0159920 2023-10-08T17:24:44.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.816+0000 7f12d5ffb700 1 -- 172.21.15.12:0/531506323 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+65 (secure 0 0 0) 0x7f12d0058e60 con 0x7f12e0159920 2023-10-08T17:24:44.816 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:44.816 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:24:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T17:24:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T17:24:44.817 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:44.817 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 msgr2=0x7f12c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 0x7f12c40693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0030c0 tx=0x7f12dc016000 comp rx=0 tx=0).stop 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 msgr2=0x7f12e0150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f12d000b5e0 tx=0x7f12d00090f0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 shutdown_connections 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12c4066f30 0x7f12c40693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f12e015dfd0 0x7f12e00cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f12e0159550 0x7f12e0151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.818+0000 7f12e6f9d700 1 --2- 172.21.15.12:0/531506323 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f12e0159920 0x7f12e0150fd0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.819+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 >> 172.21.15.12:0/531506323 conn(0x7f12e006ce80 msgr2=0x7f12e0152cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.819+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 shutdown_connections 2023-10-08T17:24:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:44.819+0000 7f12e6f9d700 1 -- 172.21.15.12:0/531506323 wait complete. 2023-10-08T17:24:44.836 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T17:24:44.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T17:24:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.027+0000 7f8f1279d700 1 Processor -- start 2023-10-08T17:24:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.027+0000 7f8f1279d700 1 -- start start 2023-10-08T17:24:45.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1279d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f0c157380 0x7f8f0c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1279d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8f0c157750 0x7f8f0c0ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1279d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c0c8680 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1279d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c06a7f0 con 0x7f8f0c157380 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1279d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0c7270 con 0x7f8f0c157750 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f0c157380 0x7f8f0c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f0c157380 0x7f8f0c1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36970/0 (socket says 172.21.15.12:36970) 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 -- 172.21.15.12:0/1663261147 learned_addr learned my addr 172.21.15.12:0/1663261147 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f11f9c700 1 --2- 172.21.15.12:0/1663261147 >> v2:172.21.15.29:3300/0 conn(0x7f8f0c157750 0x7f8f0c0ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 -- 172.21.15.12:0/1663261147 >> v2:172.21.15.29:3300/0 conn(0x7f8f0c157750 msgr2=0x7f8f0c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:45.030 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 --2- 172.21.15.12:0/1663261147 >> v2:172.21.15.29:3300/0 conn(0x7f8f0c157750 0x7f8f0c0ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 -- 172.21.15.12:0/1663261147 >> v1:172.21.15.29:6789/0 conn(0x7f8f0c15b1a0 legacy=0x7f8f0c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.029+0000 7f8f1179b700 1 -- 172.21.15.12:0/1663261147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c158b30 con 0x7f8f0c157380 2023-10-08T17:24:45.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f1179b700 1 --2- 172.21.15.12:0/1663261147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c157380 0x7f8f0c1585f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06bb70 tx=0x7f8f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ae1e9bac023476 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f03fff700 1 -- 172.21.15.12:0/1663261147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08009ea0 con 0x7f8f0c157380 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f03fff700 1 -- 172.21.15.12:0/1663261147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0800b820 con 0x7f8f0c157380 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f03fff700 1 -- 172.21.15.12:0/1663261147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800bbc0 con 0x7f8f0c157380 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f1279d700 1 -- 172.21.15.12:0/1663261147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c157380 msgr2=0x7f8f0c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.030+0000 7f8f1279d700 1 --2- 172.21.15.12:0/1663261147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c157380 0x7f8f0c1585f0 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06bb70 tx=0x7f8f08009250 comp rx=0 tx=0).stop 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 -- 172.21.15.12:0/1663261147 shutdown_connections 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 --2- 172.21.15.12:0/1663261147 >> v2:172.21.15.29:3300/0 conn(0x7f8f0c157750 0x7f8f0c0ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:45.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 --2- 172.21.15.12:0/1663261147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c157380 0x7f8f0c1585f0 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 -- 172.21.15.12:0/1663261147 >> 172.21.15.12:0/1663261147 conn(0x7f8f0c06c6a0 msgr2=0x7f8f0c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 -- 172.21.15.12:0/1663261147 shutdown_connections 2023-10-08T17:24:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.031+0000 7f8f1279d700 1 -- 172.21.15.12:0/1663261147 wait complete. 2023-10-08T17:24:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.032+0000 7f8f1279d700 1 Processor -- start 2023-10-08T17:24:45.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.032+0000 7f8f1279d700 1 -- start start 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f0c157380 0x7f8f0c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 0x7f8f0c151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b15f0 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b18d0 con 0x7f8f0c157750 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1279d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b1bb0 con 0x7f8f0c157380 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f11f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f11f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36974/0 (socket says 172.21.15.12:36974) 2023-10-08T17:24:45.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f11f9c700 1 -- 172.21.15.12:0/3305698233 learned_addr learned my addr 172.21.15.12:0/3305698233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f1179b700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f0c157380 0x7f8f0c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.033+0000 7f8f10f9a700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 0x7f8f0c151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 -- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f0c157380 msgr2=0x7f8f0c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f0c157380 0x7f8f0c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 -- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 msgr2=0x7f8f0c151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 0x7f8f0c151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 -- 172.21.15.12:0/3305698233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080094f0 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f10f9a700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 0x7f8f0c151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f11f9c700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009e90 tx=0x7f8f0400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0400cb50 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0400f040 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04014480 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c0b1e90 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.034+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c0c1430 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.035+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c04c3c0 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.036+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f04014830 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.037+0000 7f8f017fa700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 0x7f8ef00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.037+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f8f040850e0 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.037+0000 7f8f1179b700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 0x7f8ef00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:45.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.038+0000 7f8f1179b700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 0x7f8ef00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06bb70 tx=0x7f8f08017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:45.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.041+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f04052430 con 0x7f8f0c15b1a0 2023-10-08T17:24:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:45.245+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8f0c0c6940 con 0x7f8f0c15b1a0 2023-10-08T17:24:46.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.118+0000 7f8f017fa700 1 -- 172.21.15.12:0/3305698233 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8f04055a50 con 0x7f8f0c15b1a0 2023-10-08T17:24:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.123+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 msgr2=0x7f8ef00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.123+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 0x7f8ef00693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c06bb70 tx=0x7f8f08017000 comp rx=0 tx=0).stop 2023-10-08T17:24:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.123+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 msgr2=0x7f8f0c0c5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.123+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f8f04009e90 tx=0x7f8f0400b040 comp rx=0 tx=0).stop 2023-10-08T17:24:46.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 shutdown_connections 2023-10-08T17:24:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8ef0066f30 0x7f8ef00693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c15b1a0 0x7f8f0c0c5d80 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f0c157380 0x7f8f0c0c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 --2- 172.21.15.12:0/3305698233 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c157750 0x7f8f0c151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.126+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 >> 172.21.15.12:0/3305698233 conn(0x7f8f0c06c6a0 msgr2=0x7f8f0c06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.127+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 shutdown_connections 2023-10-08T17:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.127+0000 7f8f1279d700 1 -- 172.21.15.12:0/3305698233 wait complete. 2023-10-08T17:24:46.129 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T17:24:46.149 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T17:24:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.348+0000 7f6d8d19d700 1 Processor -- start 2023-10-08T17:24:46.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.348+0000 7f6d8d19d700 1 -- start start 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.349+0000 7f6d8d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 0x7f6d880c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.349+0000 7f6d8d19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d880c7dc0 0x7f6d8806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.349+0000 7f6d8d19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d880ca480 con 0x7f6d88142c00 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.349+0000 7f6d8d19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d880c8240 con 0x7f6d880c7dc0 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.349+0000 7f6d8d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8815e240 con 0x7f6d88142fd0 2023-10-08T17:24:46.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d880c7dc0 0x7f6d8806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6d880c7dc0 0x7f6d8806c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36984/0 (socket says 172.21.15.12:36984) 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 -- 172.21.15.12:0/666745608 learned_addr learned my addr 172.21.15.12:0/666745608 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d87fff700 1 --1- 172.21.15.12:0/666745608 >> v1:172.21.15.12:6789/0 conn(0x7f6d88142c00 0x7f6d8806b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42966/0 (socket says 172.21.15.12:42966) 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d877fe700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 0x7f6d880c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 -- 172.21.15.12:0/666745608 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 msgr2=0x7f6d880c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:46.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 0x7f6d880c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 -- 172.21.15.12:0/666745608 >> v1:172.21.15.12:6789/0 conn(0x7f6d88142c00 legacy=0x7f6d8806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d8c99c700 1 -- 172.21.15.12:0/666745608 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8806b350 con 0x7f6d880c7dc0 2023-10-08T17:24:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d86ffd700 1 -- 172.21.15.12:0/666745608 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102554168 0 0) 0x7f6d880ca480 con 0x7f6d88142c00 2023-10-08T17:24:46.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.350+0000 7f6d877fe700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 0x7f6d880c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8c99c700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d880c7dc0 0x7f6d8806c6a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009f20 tx=0x7f6d80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7bc90b33a90ca1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d86ffd700 1 -- 172.21.15.12:0/666745608 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000e070 con 0x7f6d880c7dc0 2023-10-08T17:24:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d86ffd700 1 -- 172.21.15.12:0/666745608 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000ba80 con 0x7f6d880c7dc0 2023-10-08T17:24:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d86ffd700 1 -- 172.21.15.12:0/666745608 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800092e0 con 0x7f6d880c7dc0 2023-10-08T17:24:46.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 -- 172.21.15.12:0/666745608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d880c7dc0 msgr2=0x7f6d8806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d880c7dc0 0x7f6d8806c6a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009f20 tx=0x7f6d80009840 comp rx=0 tx=0).stop 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 -- 172.21.15.12:0/666745608 shutdown_connections 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d880c7dc0 0x7f6d8806c6a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/666745608 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142fd0 0x7f6d880c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 -- 172.21.15.12:0/666745608 >> 172.21.15.12:0/666745608 conn(0x7f6d880675a0 msgr2=0x7f6d880679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 -- 172.21.15.12:0/666745608 shutdown_connections 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.351+0000 7f6d8d19d700 1 -- 172.21.15.12:0/666745608 wait complete. 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.353+0000 7f6d8d19d700 1 Processor -- start 2023-10-08T17:24:46.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.353+0000 7f6d8d19d700 1 -- start start 2023-10-08T17:24:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 0x7f6d88158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142c00 0x7f6d88137c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d881370a0 con 0x7f6d88142fd0 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88138860 con 0x7f6d880c7dc0 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d88138b40 con 0x7f6d88142c00 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:36996/0 (socket says 172.21.15.12:36996) 2023-10-08T17:24:46.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 -- 172.21.15.12:0/283670005 learned_addr learned my addr 172.21.15.12:0/283670005 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d877fe700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142c00 0x7f6d88137c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d87fff700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 0x7f6d88158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 -- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142c00 msgr2=0x7f6d88137c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142c00 0x7f6d88137c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 -- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 msgr2=0x7f6d88158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 0x7f6d88158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d8c99c700 1 -- 172.21.15.12:0/283670005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d80009ae0 con 0x7f6d88142fd0 2023-10-08T17:24:46.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.354+0000 7f6d87fff700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 0x7f6d88158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d8c99c700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009880 tx=0x7f6d80018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800032f0 con 0x7f6d88142fd0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80008e10 con 0x7f6d88142fd0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800266b0 con 0x7f6d88142fd0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d88138e20 con 0x7f6d88142fd0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.355+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d881594b0 con 0x7f6d88142fd0 2023-10-08T17:24:46.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.356+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d8804c3c0 con 0x7f6d88142fd0 2023-10-08T17:24:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.357+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d80003040 con 0x7f6d88142fd0 2023-10-08T17:24:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.358+0000 7f6d6ffff700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.358+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f6d800865e0 con 0x7f6d88142fd0 2023-10-08T17:24:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.358+0000 7f6d87fff700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:46.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.359+0000 7f6d87fff700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 0x7f6d740693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d780011e0 tx=0x7f6d78007c90 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:46.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.362+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d80053840 con 0x7f6d88142fd0 2023-10-08T17:24:46.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:46.567+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6d8815df60 con 0x7f6d88142fd0 2023-10-08T17:24:47.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.125+0000 7f6d6ffff700 1 -- 172.21.15.12:0/283670005 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6d80056e60 con 0x7f6d88142fd0 2023-10-08T17:24:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.131+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 msgr2=0x7f6d740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.131+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 0x7f6d740693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d780011e0 tx=0x7f6d78007c90 comp rx=0 tx=0).stop 2023-10-08T17:24:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.131+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 msgr2=0x7f6d881381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.131+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009880 tx=0x7f6d80018000 comp rx=0 tx=0).stop 2023-10-08T17:24:47.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 shutdown_connections 2023-10-08T17:24:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6d74066f30 0x7f6d740693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d88142fd0 0x7f6d881381c0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d880c7dc0 0x7f6d88158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 --2- 172.21.15.12:0/283670005 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d88142c00 0x7f6d88137c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.135+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 >> 172.21.15.12:0/283670005 conn(0x7f6d880675a0 msgr2=0x7f6d8806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:47.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.142+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 shutdown_connections 2023-10-08T17:24:47.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.143+0000 7f6d8d19d700 1 -- 172.21.15.12:0/283670005 wait complete. 2023-10-08T17:24:47.147 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T17:24:47.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T17:24:47.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.359+0000 7f82b639d700 1 Processor -- start 2023-10-08T17:24:47.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.359+0000 7f82b639d700 1 -- start start 2023-10-08T17:24:47.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b639d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b00aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b639d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82b00acc00 con 0x7f82b0159920 2023-10-08T17:24:47.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b639d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82b00abff0 con 0x7f82b0159550 2023-10-08T17:24:47.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00ac2d0 con 0x7f82b015dfd0 2023-10-08T17:24:47.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b539b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b4b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b00aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b539b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:57050/0 (socket says 172.21.15.12:57050) 2023-10-08T17:24:47.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.361+0000 7f82b539b700 1 -- 172.21.15.12:0/3405244121 learned_addr learned my addr 172.21.15.12:0/3405244121 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b4b9a700 1 -- 172.21.15.12:0/3405244121 >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 msgr2=0x7f82b00ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b4b9a700 1 --2- 172.21.15.12:0/3405244121 >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b4b9a700 1 -- 172.21.15.12:0/3405244121 >> v1:172.21.15.29:6789/0 conn(0x7f82b0159920 legacy=0x7f82b00ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b4b9a700 1 -- 172.21.15.12:0/3405244121 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b00ac5b0 con 0x7f82b015dfd0 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b539b700 1 --2- 172.21.15.12:0/3405244121 >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:47.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.362+0000 7f82b4b9a700 1 --2- 172.21.15.12:0/3405244121 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b00aedb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82a00098e0 tx=0x7f82a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da9ee51b012e7b8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82a7fff700 1 -- 172.21.15.12:0/3405244121 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000b640 con 0x7f82b015dfd0 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82a7fff700 1 -- 172.21.15.12:0/3405244121 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000b7a0 con 0x7f82b015dfd0 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82a7fff700 1 -- 172.21.15.12:0/3405244121 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000bb40 con 0x7f82b015dfd0 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 -- 172.21.15.12:0/3405244121 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 msgr2=0x7f82b00aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 --2- 172.21.15.12:0/3405244121 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b00aedb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82a00098e0 tx=0x7f82a00091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 -- 172.21.15.12:0/3405244121 shutdown_connections 2023-10-08T17:24:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 --2- 172.21.15.12:0/3405244121 >> v2:172.21.15.29:3300/0 conn(0x7f82b0159550 0x7f82b00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 --2- 172.21.15.12:0/3405244121 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b00aedb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 -- 172.21.15.12:0/3405244121 >> 172.21.15.12:0/3405244121 conn(0x7f82b006ce80 msgr2=0x7f82b00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 -- 172.21.15.12:0/3405244121 shutdown_connections 2023-10-08T17:24:47.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.363+0000 7f82b639d700 1 -- 172.21.15.12:0/3405244121 wait complete. 2023-10-08T17:24:47.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.365+0000 7f82b639d700 1 Processor -- start 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.365+0000 7f82b639d700 1 -- start start 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82b0159920 0x7f82b0146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b0146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b01473e0 con 0x7f82b0159550 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cbda0 con 0x7f82b0159920 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82b00cc080 con 0x7f82b015dfd0 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37008/0 (socket says 172.21.15.12:37008) 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 -- 172.21.15.12:0/2530866224 learned_addr learned my addr 172.21.15.12:0/2530866224 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b5b9c700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b0146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b4b9a700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82b0159920 0x7f82b0146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 -- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 msgr2=0x7f82b0146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b0146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 -- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82b0159920 msgr2=0x7f82b0146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82b0159920 0x7f82b0146960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.366+0000 7f82b539b700 1 -- 172.21.15.12:0/2530866224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ac0094f0 con 0x7f82b0159550 2023-10-08T17:24:47.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82b539b700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ec50 tx=0x7f82ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00c850 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ac00c9b0 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ac00cd30 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a0009420 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.367+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00cc640 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.368+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82b004c3c0 con 0x7f82b0159550 2023-10-08T17:24:47.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.369+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82ac013680 con 0x7f82b0159550 2023-10-08T17:24:47.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.370+0000 7f82a57fa700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 0x7f8294069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:47.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.370+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f82ac084970 con 0x7f82b0159550 2023-10-08T17:24:47.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.370+0000 7f82b4b9a700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 0x7f8294069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:47.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.371+0000 7f82b4b9a700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 0x7f8294069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82a00093f0 tx=0x7f82a0017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:47.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.375+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82ac0519d0 con 0x7f82b0159550 2023-10-08T17:24:47.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:47.620+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f82b006e7c0 con 0x7f82b0159550 2023-10-08T17:24:48.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.128+0000 7f82a57fa700 1 -- 172.21.15.12:0/2530866224 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v70) v1 ==== 174+0+0 (secure 0 0 0) 0x7f82ac054ff0 con 0x7f82b0159550 2023-10-08T17:24:48.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.136+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 msgr2=0x7f8294069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.136+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 0x7f8294069410 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f82a00093f0 tx=0x7f82a0017000 comp rx=0 tx=0).stop 2023-10-08T17:24:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.137+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 msgr2=0x7f82b00afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.137+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00ec50 tx=0x7f82ac009250 comp rx=0 tx=0).stop 2023-10-08T17:24:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.143+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 shutdown_connections 2023-10-08T17:24:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.143+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8294066f60 0x7f8294069410 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.143+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f82b0159550 0x7f82b00afc00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.143+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f82b015dfd0 0x7f82b0146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.143+0000 7f82b639d700 1 --2- 172.21.15.12:0/2530866224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f82b0159920 0x7f82b0146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.144+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 >> 172.21.15.12:0/2530866224 conn(0x7f82b006ce80 msgr2=0x7f82b00b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.145+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 shutdown_connections 2023-10-08T17:24:48.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.146+0000 7f82b639d700 1 -- 172.21.15.12:0/2530866224 wait complete. 2023-10-08T17:24:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 18 and data pool 19 2023-10-08T17:24:48.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.363+0000 7f5a4e79d700 1 Processor -- start 2023-10-08T17:24:48.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.363+0000 7f5a4e79d700 1 -- start start 2023-10-08T17:24:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 0x7f5a4815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a4815de50 0x7f5a480cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5a480cef40 0x7f5a4806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4815afd0 con 0x7f5a4815de50 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4815b2b0 con 0x7f5a480cef40 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.364+0000 7f5a4e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815b590 con 0x7f5a48153c30 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a4815de50 0x7f5a480cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a4815de50 0x7f5a480cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37020/0 (socket says 172.21.15.12:37020) 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 -- 172.21.15.12:0/3493291483 learned_addr learned my addr 172.21.15.12:0/3493291483 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4d79b700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 0x7f5a4815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4df9c700 1 --2- 172.21.15.12:0/3493291483 >> v2:172.21.15.29:3300/0 conn(0x7f5a480cef40 0x7f5a4806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 -- 172.21.15.12:0/3493291483 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 msgr2=0x7f5a4815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:48.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 0x7f5a4815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 -- 172.21.15.12:0/3493291483 >> v2:172.21.15.29:3300/0 conn(0x7f5a480cef40 msgr2=0x7f5a4806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/3493291483 >> v2:172.21.15.29:3300/0 conn(0x7f5a480cef40 0x7f5a4806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 -- 172.21.15.12:0/3493291483 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4815b870 con 0x7f5a4815de50 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4d79b700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 0x7f5a4815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.365+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a4815de50 0x7f5a480cea00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f5a48071370 tx=0x7f5a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11b0aa368463527 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a3ffff700 1 -- 172.21.15.12:0/3493291483 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a38009e70 con 0x7f5a4815de50 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a3ffff700 1 -- 172.21.15.12:0/3493291483 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3800b860 con 0x7f5a4815de50 2023-10-08T17:24:48.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a3ffff700 1 -- 172.21.15.12:0/3493291483 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3800bc00 con 0x7f5a4815de50 2023-10-08T17:24:48.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 -- 172.21.15.12:0/3493291483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a4815de50 msgr2=0x7f5a480cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a4815de50 0x7f5a480cea00 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f5a48071370 tx=0x7f5a38009250 comp rx=0 tx=0).stop 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 -- 172.21.15.12:0/3493291483 shutdown_connections 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/3493291483 >> v2:172.21.15.29:3300/0 conn(0x7f5a480cef40 0x7f5a4806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a48153c30 0x7f5a4815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/3493291483 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a4815de50 0x7f5a480cea00 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 -- 172.21.15.12:0/3493291483 >> 172.21.15.12:0/3493291483 conn(0x7f5a480703a0 msgr2=0x7f5a480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 -- 172.21.15.12:0/3493291483 shutdown_connections 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.366+0000 7f5a4e79d700 1 -- 172.21.15.12:0/3493291483 wait complete. 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.368+0000 7f5a4e79d700 1 Processor -- start 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.368+0000 7f5a4e79d700 1 -- start start 2023-10-08T17:24:48.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 0x7f5a480b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a4815de50 0x7f5a48159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480b60e0 con 0x7f5a480cef40 2023-10-08T17:24:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c8b70 con 0x7f5a48153c30 2023-10-08T17:24:48.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480c7f60 con 0x7f5a4815de50 2023-10-08T17:24:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37024/0 (socket says 172.21.15.12:37024) 2023-10-08T17:24:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 -- 172.21.15.12:0/524293500 learned_addr learned my addr 172.21.15.12:0/524293500 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 0x7f5a480b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4df9c700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a4815de50 0x7f5a48159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 -- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a4815de50 msgr2=0x7f5a48159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a4815de50 0x7f5a48159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 -- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 msgr2=0x7f5a480b5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 0x7f5a480b5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4d79b700 1 -- 172.21.15.12:0/524293500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380094f0 con 0x7f5a480cef40 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.369+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 0x7f5a480b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a4d79b700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400e8d0 tx=0x7f5a44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44013410 con 0x7f5a480cef40 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a44013570 con 0x7f5a480cef40 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a44013910 con 0x7f5a480cef40 2023-10-08T17:24:48.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480c8240 con 0x7f5a480cef40 2023-10-08T17:24:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.370+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480c8800 con 0x7f5a480cef40 2023-10-08T17:24:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.371+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4804c3c0 con 0x7f5a480cef40 2023-10-08T17:24:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.372+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a44013d00 con 0x7f5a480cef40 2023-10-08T17:24:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.373+0000 7f5a3d7fa700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.373+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5a44084510 con 0x7f5a480cef40 2023-10-08T17:24:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.373+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.374+0000 7f5a4cf9a700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a48071370 tx=0x7f5a38017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.377+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a44051510 con 0x7f5a480cef40 2023-10-08T17:24:48.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.581+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a4815bb50 con 0x7f5a480cef40 2023-10-08T17:24:48.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.582+0000 7f5a3d7fa700 1 -- 172.21.15.12:0/524293500 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16136 (secure 0 0 0) 0x7f5a44054b30 con 0x7f5a480cef40 2023-10-08T17:24:48.583 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:48.583 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":167,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:47.621384+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:48.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 msgr2=0x7f5a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a48071370 tx=0x7f5a38017000 comp rx=0 tx=0).stop 2023-10-08T17:24:48.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 msgr2=0x7f5a480c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f5a4400e8d0 tx=0x7f5a44008040 comp rx=0 tx=0).stop 2023-10-08T17:24:48.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 shutdown_connections 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a480cef40 0x7f5a480c78d0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a4815de50 0x7f5a48159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 --2- 172.21.15.12:0/524293500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a48153c30 0x7f5a480b5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 >> 172.21.15.12:0/524293500 conn(0x7f5a480703a0 msgr2=0x7f5a4815bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 shutdown_connections 2023-10-08T17:24:48.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.585+0000 7f5a4e79d700 1 -- 172.21.15.12:0/524293500 wait complete. 2023-10-08T17:24:48.603 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.790+0000 7f271f19d700 1 Processor -- start 2023-10-08T17:24:48.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.790+0000 7f271f19d700 1 -- start start 2023-10-08T17:24:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.791+0000 7f271f19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.791+0000 7f271f19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f271815de50 0x7f27180cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.791+0000 7f271f19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271815afd0 con 0x7f27180cef40 2023-10-08T17:24:48.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.791+0000 7f271f19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271815b2b0 con 0x7f271815de50 2023-10-08T17:24:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.791+0000 7f271f19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271815b590 con 0x7f2718153c30 2023-10-08T17:24:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271e99c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f27180cef40 0x7f271806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42968/0 (socket says 172.21.15.12:42968) 2023-10-08T17:24:48.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271e99c700 1 -- 172.21.15.12:0/634370154 learned_addr learned my addr 172.21.15.12:0/634370154 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d99a700 1 --2- 172.21.15.12:0/634370154 >> v2:172.21.15.29:3300/0 conn(0x7f271815de50 0x7f27180cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271e19b700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059091379 0 0) 0x7f271815afd0 con 0x7f27180cef40 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2704003570 con 0x7f27180cef40 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 34447172 0 0) 0x7f2704003570 con 0x7f27180cef40 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d99a700 1 -- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 msgr2=0x7f271815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d99a700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d99a700 1 -- 172.21.15.12:0/634370154 >> v1:172.21.15.12:6789/0 conn(0x7f27180cef40 legacy=0x7f271806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.792+0000 7f271d99a700 1 -- 172.21.15.12:0/634370154 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271815b870 con 0x7f271815de50 2023-10-08T17:24:48.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.793+0000 7f271d99a700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180cea00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f27080098e0 tx=0x7f27080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2238e61d026644f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.793+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100017f0 con 0x7f271815de50 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.793+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2708011420 con 0x7f271815de50 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.793+0000 7f271d199700 1 -- 172.21.15.12:0/634370154 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27080117c0 con 0x7f271815de50 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 -- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 msgr2=0x7f27180cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180cea00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f27080098e0 tx=0x7f27080091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 -- 172.21.15.12:0/634370154 shutdown_connections 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 --2- 172.21.15.12:0/634370154 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180cea00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 -- 172.21.15.12:0/634370154 >> 172.21.15.12:0/634370154 conn(0x7f27180703a0 msgr2=0x7f27180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 -- 172.21.15.12:0/634370154 shutdown_connections 2023-10-08T17:24:48.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.794+0000 7f271f19d700 1 -- 172.21.15.12:0/634370154 wait complete. 2023-10-08T17:24:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.795+0000 7f271f19d700 1 Processor -- start 2023-10-08T17:24:48.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 -- start start 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271816ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180b5000 con 0x7f27180cef40 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271816a200 con 0x7f271815de50 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.796+0000 7f271f19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271816a4e0 con 0x7f2718153c30 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37032/0 (socket says 172.21.15.12:37032) 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 -- 172.21.15.12:0/1725792917 learned_addr learned my addr 172.21.15.12:0/1725792917 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e99c700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271d99a700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271816ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 -- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 msgr2=0x7f271816ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271816ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 -- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 msgr2=0x7f27180b53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180b53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 -- 172.21.15.12:0/1725792917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2708009420 con 0x7f27180cef40 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271d99a700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e99c700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.797+0000 7f271e19b700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f271400ec80 tx=0x7f27140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.798+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271400c9d0 con 0x7f27180cef40 2023-10-08T17:24:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.798+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271400cb30 con 0x7f27180cef40 2023-10-08T17:24:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.798+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271816a7c0 con 0x7f27180cef40 2023-10-08T17:24:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.798+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2714013470 con 0x7f27180cef40 2023-10-08T17:24:48.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.798+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27180b32d0 con 0x7f27180cef40 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.799+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180b3640 con 0x7f27180cef40 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.800+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2714013820 con 0x7f27180cef40 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.800+0000 7f270e7fc700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 0x7f26fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.801+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2714084b30 con 0x7f27180cef40 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.801+0000 7f271d99a700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 0x7f26fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:48.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.801+0000 7f271d99a700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 0x7f26fc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27080030c0 tx=0x7f2708016000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:48.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:48.804+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2714051b30 con 0x7f27180cef40 2023-10-08T17:24:49.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.006+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f271804c3c0 con 0x7f27180cef40 2023-10-08T17:24:49.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.007+0000 7f270e7fc700 1 -- 172.21.15.12:0/1725792917 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16136 (secure 0 0 0) 0x7f2714055150 con 0x7f27180cef40 2023-10-08T17:24:49.007 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:49.007 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":167,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:47.621384+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 msgr2=0x7f26fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 0x7f26fc0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27080030c0 tx=0x7f2708016000 comp rx=0 tx=0).stop 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 msgr2=0x7f2718169ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f271400ec80 tx=0x7f27140091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 shutdown_connections 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f26fc066f30 0x7f26fc0693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f27180cef40 0x7f2718169ba0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f271815de50 0x7f27180b53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 --2- 172.21.15.12:0/1725792917 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2718153c30 0x7f271816ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 >> 172.21.15.12:0/1725792917 conn(0x7f27180703a0 msgr2=0x7f27180b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 shutdown_connections 2023-10-08T17:24:49.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.009+0000 7f271f19d700 1 -- 172.21.15.12:0/1725792917 wait complete. 2023-10-08T17:24:49.027 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T17:24:49.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.219+0000 7f05d499d700 1 Processor -- start 2023-10-08T17:24:49.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.219+0000 7f05d499d700 1 -- start start 2023-10-08T17:24:49.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.220+0000 7f05d499d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f05d0153dd0 0x7f05d015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:49.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.220+0000 7f05d499d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d015ac50 con 0x7f05d00cea00 2023-10-08T17:24:49.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.220+0000 7f05d499d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d015d010 con 0x7f05d0153a00 2023-10-08T17:24:49.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.220+0000 7f05d499d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d015af60 con 0x7f05d0153dd0 2023-10-08T17:24:49.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05cffff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f05d00cea00 0x7f05d00ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42982/0 (socket says 172.21.15.12:42982) 2023-10-08T17:24:49.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05cffff700 1 -- 172.21.15.12:0/460474888 learned_addr learned my addr 172.21.15.12:0/460474888 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:49.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ceffd700 1 --2- 172.21.15.12:0/460474888 >> v2:172.21.15.29:3300/0 conn(0x7f05d0153dd0 0x7f05d015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:49.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ce7fc700 1 -- 172.21.15.12:0/460474888 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279979162 0 0) 0x7f05d015ac50 con 0x7f05d00cea00 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ce7fc700 1 -- 172.21.15.12:0/460474888 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05b8003570 con 0x7f05d00cea00 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ceffd700 1 -- 172.21.15.12:0/460474888 >> v1:172.21.15.29:6789/0 conn(0x7f05d0153a00 legacy=0x7f05d015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ceffd700 1 -- 172.21.15.12:0/460474888 >> v1:172.21.15.12:6789/0 conn(0x7f05d00cea00 legacy=0x7f05d00ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.221+0000 7f05ceffd700 1 -- 172.21.15.12:0/460474888 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d015b240 con 0x7f05d0153dd0 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05ceffd700 1 --2- 172.21.15.12:0/460474888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153dd0 0x7f05d015de50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098e0 tx=0x7f05c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=700bde43762c8530 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05ce7fc700 1 -- 172.21.15.12:0/460474888 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c400b640 con 0x7f05d0153dd0 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05ce7fc700 1 -- 172.21.15.12:0/460474888 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c400b7a0 con 0x7f05d0153dd0 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05ce7fc700 1 -- 172.21.15.12:0/460474888 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c400bb20 con 0x7f05d0153dd0 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05d499d700 1 -- 172.21.15.12:0/460474888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153dd0 msgr2=0x7f05d015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05d499d700 1 --2- 172.21.15.12:0/460474888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153dd0 0x7f05d015de50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098e0 tx=0x7f05c40091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05d499d700 1 -- 172.21.15.12:0/460474888 shutdown_connections 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05d499d700 1 --2- 172.21.15.12:0/460474888 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153dd0 0x7f05d015de50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.222+0000 7f05d499d700 1 -- 172.21.15.12:0/460474888 >> 172.21.15.12:0/460474888 conn(0x7f05d00703a0 msgr2=0x7f05d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.223+0000 7f05d499d700 1 -- 172.21.15.12:0/460474888 shutdown_connections 2023-10-08T17:24:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.223+0000 7f05d499d700 1 -- 172.21.15.12:0/460474888 wait complete. 2023-10-08T17:24:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.224+0000 7f05d499d700 1 Processor -- start 2023-10-08T17:24:49.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.224+0000 7f05d499d700 1 -- start start 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153a00 0x7f05d0158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d0153dd0 0x7f05d0148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d00c9a60 con 0x7f05d00cea00 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d01594e0 con 0x7f05d0153a00 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05d499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d0150560 con 0x7f05d0153dd0 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05cf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05cf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37038/0 (socket says 172.21.15.12:37038) 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05cf7fe700 1 -- 172.21.15.12:0/616526780 learned_addr learned my addr 172.21.15.12:0/616526780 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05ceffd700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153a00 0x7f05d0158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:49.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.225+0000 7f05cffff700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d0153dd0 0x7f05d0148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 -- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d0153dd0 msgr2=0x7f05d0148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d0153dd0 0x7f05d0148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 -- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153a00 msgr2=0x7f05d0158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153a00 0x7f05d0158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 -- 172.21.15.12:0/616526780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4009420 con 0x7f05d00cea00 2023-10-08T17:24:49.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05cf7fe700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c790 tx=0x7f05c0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011590 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c00116f0 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c0011ab0 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d01491d0 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.226+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d00c9f70 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.227+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d004c3c0 con 0x7f05d00cea00 2023-10-08T17:24:49.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.229+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05c001b3b0 con 0x7f05d00cea00 2023-10-08T17:24:49.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.230+0000 7f05b77fe700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 0x7f05bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.230+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f05c0083a00 con 0x7f05d00cea00 2023-10-08T17:24:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.230+0000 7f05ceffd700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 0x7f05bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:49.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.230+0000 7f05ceffd700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 0x7f05bc0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098e0 tx=0x7f05c4017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:49.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.234+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05c0050a00 con 0x7f05d00cea00 2023-10-08T17:24:49.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:49.482+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f05d015b520 con 0x7f05d00cea00 2023-10-08T17:24:50.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.153+0000 7f05b77fe700 1 -- 172.21.15.12:0/616526780 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) v1 ==== 118+0+0 (secure 0 0 0) 0x7f05c0017070 con 0x7f05d00cea00 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 msgr2=0x7f05bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 0x7f05bc0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f05c40098e0 tx=0x7f05c4017000 comp rx=0 tx=0).stop 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 msgr2=0x7f05d00c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f05c000c790 tx=0x7f05c0007f40 comp rx=0 tx=0).stop 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 shutdown_connections 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f05bc066f30 0x7f05bc0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f05d00cea00 0x7f05d00c9520 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f05d0153dd0 0x7f05d0148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 --2- 172.21.15.12:0/616526780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f05d0153a00 0x7f05d0158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 >> 172.21.15.12:0/616526780 conn(0x7f05d00703a0 msgr2=0x7f05d00b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 shutdown_connections 2023-10-08T17:24:50.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.156+0000 7f05d499d700 1 -- 172.21.15.12:0/616526780 wait complete. 2023-10-08T17:24:50.176 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T17:24:50.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.368+0000 7fd73db9d700 1 Processor -- start 2023-10-08T17:24:50.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.369+0000 7fd73db9d700 1 -- start start 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd73db9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd73806db20 0x7fd73815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd73db9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73815ada0 con 0x7fd7380caec0 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd73db9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73806ca80 con 0x7fd738153c90 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd73db9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd73806cd60 con 0x7fd73806db20 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd737fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd73806db20 0x7fd73815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd737fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd73806db20 0x7fd73815a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37040/0 (socket says 172.21.15.12:37040) 2023-10-08T17:24:50.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd737fff700 1 -- 172.21.15.12:0/1385267375 learned_addr learned my addr 172.21.15.12:0/1385267375 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.370+0000 7fd73d39c700 1 --1- 172.21.15.12:0/1385267375 >> v1:172.21.15.12:6789/0 conn(0x7fd7380caec0 0x7fd73815afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42994/0 (socket says 172.21.15.12:42994) 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd737fff700 1 -- 172.21.15.12:0/1385267375 >> v1:172.21.15.29:6789/0 conn(0x7fd738153c90 legacy=0x7fd7380ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd737fff700 1 -- 172.21.15.12:0/1385267375 >> v1:172.21.15.12:6789/0 conn(0x7fd7380caec0 legacy=0x7fd73815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd737fff700 1 -- 172.21.15.12:0/1385267375 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73806d040 con 0x7fd73806db20 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd7377fe700 1 -- 172.21.15.12:0/1385267375 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261066665 0 0) 0x7fd730001490 con 0x7fd7380caec0 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd737fff700 1 --2- 172.21.15.12:0/1385267375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd73806db20 0x7fd73815a860 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd7240099b0 tx=0x7fd724009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d7beac16ef34054 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd7377fe700 1 -- 172.21.15.12:0/1385267375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400b860 con 0x7fd73806db20 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd7377fe700 1 -- 172.21.15.12:0/1385267375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72400b9c0 con 0x7fd73806db20 2023-10-08T17:24:50.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.371+0000 7fd7377fe700 1 -- 172.21.15.12:0/1385267375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72400bd60 con 0x7fd73806db20 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 -- 172.21.15.12:0/1385267375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd73806db20 msgr2=0x7fd73815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 --2- 172.21.15.12:0/1385267375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd73806db20 0x7fd73815a860 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd7240099b0 tx=0x7fd724009250 comp rx=0 tx=0).stop 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 -- 172.21.15.12:0/1385267375 shutdown_connections 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 --2- 172.21.15.12:0/1385267375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd73806db20 0x7fd73815a860 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 -- 172.21.15.12:0/1385267375 >> 172.21.15.12:0/1385267375 conn(0x7fd73806e720 msgr2=0x7fd73806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:50.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 -- 172.21.15.12:0/1385267375 shutdown_connections 2023-10-08T17:24:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.372+0000 7fd73db9d700 1 -- 172.21.15.12:0/1385267375 wait complete. 2023-10-08T17:24:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.374+0000 7fd73db9d700 1 Processor -- start 2023-10-08T17:24:50.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.374+0000 7fd73db9d700 1 -- start start 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73806db20 0x7fd7380c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7380caec0 0x7fd738143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738144a00 con 0x7fd738153c90 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738169a20 con 0x7fd73806db20 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738169d00 con 0x7fd7380caec0 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:50.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37046/0 (socket says 172.21.15.12:37046) 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 -- 172.21.15.12:0/4288988981 learned_addr learned my addr 172.21.15.12:0/4288988981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73cb9b700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73806db20 0x7fd7380c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd737fff700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7380caec0 0x7fd738143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 -- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7380caec0 msgr2=0x7fd738143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7380caec0 0x7fd738143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 -- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73806db20 msgr2=0x7fd7380c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.375+0000 7fd73d39c700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73806db20 0x7fd7380c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd73d39c700 1 -- 172.21.15.12:0/4288988981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240094f0 con 0x7fd738153c90 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd73d39c700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd73000cd20 tx=0x7fd730001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000ce80 con 0x7fd738153c90 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd730005df0 con 0x7fd738153c90 2023-10-08T17:24:50.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd73000aae0 con 0x7fd738153c90 2023-10-08T17:24:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd738169fe0 con 0x7fd738153c90 2023-10-08T17:24:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.376+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd73816a5a0 con 0x7fd738153c90 2023-10-08T17:24:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.377+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73816a7c0 con 0x7fd738153c90 2023-10-08T17:24:50.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.378+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7300070f0 con 0x7fd738153c90 2023-10-08T17:24:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.379+0000 7fd734ff9700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 0x7fd71c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.379+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd730084650 con 0x7fd738153c90 2023-10-08T17:24:50.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.379+0000 7fd73cb9b700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 0x7fd71c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:50.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.380+0000 7fd73cb9b700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 0x7fd71c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd72c003a80 tx=0x7fd72c007ec0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:50.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.383+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd7300516d0 con 0x7fd738153c90 2023-10-08T17:24:50.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:50.634+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd73804c3c0 con 0x7fd738153c90 2023-10-08T17:24:51.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.158+0000 7fd734ff9700 1 -- 172.21.15.12:0/4288988981 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd730054cf0 con 0x7fd738153c90 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.161+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 msgr2=0x7fd71c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.161+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 0x7fd71c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd72c003a80 tx=0x7fd72c007ec0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.161+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 msgr2=0x7fd7381444c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.161+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd73000cd20 tx=0x7fd730001af0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 shutdown_connections 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd71c066f30 0x7fd71c0693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd738153c90 0x7fd7381444c0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd73806db20 0x7fd7380c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 --2- 172.21.15.12:0/4288988981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7380caec0 0x7fd738143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 >> 172.21.15.12:0/4288988981 conn(0x7fd73806e720 msgr2=0x7fd738159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 shutdown_connections 2023-10-08T17:24:51.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.162+0000 7fd73db9d700 1 -- 172.21.15.12:0/4288988981 wait complete. 2023-10-08T17:24:51.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:51.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.371+0000 7f55a5b9d700 1 Processor -- start 2023-10-08T17:24:51.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.372+0000 7f55a5b9d700 1 -- start start 2023-10-08T17:24:51.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a5b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a013fb20 0x7f55a015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a5b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f55a006aaa0 0x7f55a00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a5b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a015ae70 con 0x7f55a013fef0 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a5b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a006af60 con 0x7f55a013fb20 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a5b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a006b240 con 0x7f55a006aaa0 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a4b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a013fb20 0x7f55a015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a4b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f55a013fb20 0x7f55a015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37056/0 (socket says 172.21.15.12:37056) 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f55a4b9b700 1 -- 172.21.15.12:0/3897052984 learned_addr learned my addr 172.21.15.12:0/3897052984 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.373+0000 7f559ffff700 1 --1- 172.21.15.12:0/3897052984 >> v1:172.21.15.12:6789/0 conn(0x7f55a013fef0 0x7f55a00c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43008/0 (socket says 172.21.15.12:43008) 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f55a4b9b700 1 -- 172.21.15.12:0/3897052984 >> v2:172.21.15.29:3300/0 conn(0x7f55a006aaa0 msgr2=0x7f55a00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f55a4b9b700 1 --2- 172.21.15.12:0/3897052984 >> v2:172.21.15.29:3300/0 conn(0x7f55a006aaa0 0x7f55a00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f55a4b9b700 1 -- 172.21.15.12:0/3897052984 >> v1:172.21.15.12:6789/0 conn(0x7f55a013fef0 legacy=0x7f55a00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f55a4b9b700 1 -- 172.21.15.12:0/3897052984 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a006b520 con 0x7f55a013fb20 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f559f7fe700 1 -- 172.21.15.12:0/3897052984 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886180664 0 0) 0x7f558c0011d0 con 0x7f55a013fef0 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f55a4b9b700 1 --2- 172.21.15.12:0/3897052984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a013fb20 0x7f55a015a930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f55a0069d40 tx=0x7f559400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d217edfef9ca277 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f559f7fe700 1 -- 172.21.15.12:0/3897052984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559400dc50 con 0x7f55a013fb20 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f559f7fe700 1 -- 172.21.15.12:0/3897052984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400ddb0 con 0x7f55a013fb20 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.374+0000 7f559f7fe700 1 -- 172.21.15.12:0/3897052984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55940196d0 con 0x7f55a013fb20 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 -- 172.21.15.12:0/3897052984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a013fb20 msgr2=0x7f55a015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/3897052984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a013fb20 0x7f55a015a930 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f55a0069d40 tx=0x7f559400b4f0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 -- 172.21.15.12:0/3897052984 shutdown_connections 2023-10-08T17:24:51.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/3897052984 >> v2:172.21.15.29:3300/0 conn(0x7f55a006aaa0 0x7f55a00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/3897052984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a013fb20 0x7f55a015a930 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 -- 172.21.15.12:0/3897052984 >> 172.21.15.12:0/3897052984 conn(0x7f55a006d170 msgr2=0x7f55a00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 -- 172.21.15.12:0/3897052984 shutdown_connections 2023-10-08T17:24:51.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.375+0000 7f55a5b9d700 1 -- 172.21.15.12:0/3897052984 wait complete. 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.376+0000 7f55a5b9d700 1 Processor -- start 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.377+0000 7f55a5b9d700 1 -- start start 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 0x7f55a00ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 0x7f55a0158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a016edf0 con 0x7f55a006aaa0 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a013dd90 con 0x7f55a013fb20 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a5b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a013e070 con 0x7f55a013fef0 2023-10-08T17:24:51.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37070/0 (socket says 172.21.15.12:37070) 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 -- 172.21.15.12:0/590079394 learned_addr learned my addr 172.21.15.12:0/590079394 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 -- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 msgr2=0x7f55a0158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f559ffff700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 0x7f55a00ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a539c700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 0x7f55a0158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 0x7f55a0158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 -- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 msgr2=0x7f55a00ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 0x7f55a00ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a4b9b700 1 -- 172.21.15.12:0/590079394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559400b790 con 0x7f55a006aaa0 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f559ffff700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 0x7f55a00ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:51.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.378+0000 7f55a539c700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 0x7f55a0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f55a4b9b700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f55a0071320 tx=0x7f559401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594010680 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5594010800 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594010bc0 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a013e350 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.379+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a013d9b0 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.380+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a013dba0 con 0x7f55a006aaa0 2023-10-08T17:24:51.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.381+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55940183e0 con 0x7f55a006aaa0 2023-10-08T17:24:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.382+0000 7f559cff9700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 0x7f55840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.382+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f5594014070 con 0x7f55a006aaa0 2023-10-08T17:24:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.382+0000 7f559ffff700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 0x7f55840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.383+0000 7f559ffff700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 0x7f55840693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a0158600 tx=0x7f558c009040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.387+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5594053890 con 0x7f55a006aaa0 2023-10-08T17:24:51.613 INFO:tasks.ceph.mds.a.smithi012.stderr:2023-10-08T17:24:51.613+0000 7fa1253f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:24:51.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.633+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55a004c3c0 con 0x7f55a006aaa0 2023-10-08T17:24:51.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.634+0000 7f559cff9700 1 -- 172.21.15.12:0/590079394 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f5594056eb0 con 0x7f55a006aaa0 2023-10-08T17:24:51.634 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:51.634 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 msgr2=0x7f55840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 0x7f55840693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f55a0158600 tx=0x7f558c009040 comp rx=0 tx=0).stop 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 msgr2=0x7f55a0155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f55a0071320 tx=0x7f559401b000 comp rx=0 tx=0).stop 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 shutdown_connections 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5584066f30 0x7f55840693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f55a006aaa0 0x7f55a0155cf0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f55a013fef0 0x7f55a0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 --2- 172.21.15.12:0/590079394 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f55a013fb20 0x7f55a00ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 >> 172.21.15.12:0/590079394 conn(0x7f55a006d170 msgr2=0x7f55a00638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 shutdown_connections 2023-10-08T17:24:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.636+0000 7f55a5b9d700 1 -- 172.21.15.12:0/590079394 wait complete. 2023-10-08T17:24:51.638 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:24:51.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:24:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.841+0000 7f3f78b9d700 1 Processor -- start 2023-10-08T17:24:51.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.841+0000 7f3f78b9d700 1 -- start start 2023-10-08T17:24:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f78b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f78b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f7406e470 0x7f3f741501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f78b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7406a490 con 0x7f3f7406e0a0 2023-10-08T17:24:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f78b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f740c7230 con 0x7f3f7406e470 2023-10-08T17:24:51.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f78b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7406b930 con 0x7f3f7406f3a0 2023-10-08T17:24:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f72ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f73fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f7406e470 0x7f3f741501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f73fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3f7406e470 0x7f3f741501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:57158/0 (socket says 172.21.15.12:57158) 2023-10-08T17:24:51.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f72ffd700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:41444/0 (socket says 172.21.15.12:41444) 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.843+0000 7f3f73fff700 1 -- 172.21.15.12:0/4228694566 learned_addr learned my addr 172.21.15.12:0/4228694566 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f73fff700 1 -- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 msgr2=0x7f3f7414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f73fff700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f73fff700 1 -- 172.21.15.12:0/4228694566 >> v1:172.21.15.29:6789/0 conn(0x7f3f7406e0a0 legacy=0x7f3f740c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f73fff700 1 -- 172.21.15.12:0/4228694566 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f740c7490 con 0x7f3f7406e470 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f72ffd700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f73fff700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e470 0x7f3f741501b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009f20 tx=0x7f3f6c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c407d024ab7431 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f727fc700 1 -- 172.21.15.12:0/4228694566 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c00e070 con 0x7f3f7406e470 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f727fc700 1 -- 172.21.15.12:0/4228694566 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f6c00b9d0 con 0x7f3f7406e470 2023-10-08T17:24:51.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.844+0000 7f3f727fc700 1 -- 172.21.15.12:0/4228694566 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0092e0 con 0x7f3f7406e470 2023-10-08T17:24:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 -- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e470 msgr2=0x7f3f741501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e470 0x7f3f741501b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c009f20 tx=0x7f3f6c009840 comp rx=0 tx=0).stop 2023-10-08T17:24:51.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 -- 172.21.15.12:0/4228694566 shutdown_connections 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e470 0x7f3f741501b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/4228694566 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f7414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 -- 172.21.15.12:0/4228694566 >> 172.21.15.12:0/4228694566 conn(0x7f3f7406d170 msgr2=0x7f3f740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 -- 172.21.15.12:0/4228694566 shutdown_connections 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.845+0000 7f3f78b9d700 1 -- 172.21.15.12:0/4228694566 wait complete. 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.846+0000 7f3f78b9d700 1 Processor -- start 2023-10-08T17:24:51.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.847+0000 7f3f78b9d700 1 -- start start 2023-10-08T17:24:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e0a0 0x7f3f74156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f740c33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74155ce0 con 0x7f3f7406e470 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f74154fe0 con 0x7f3f7406e0a0 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f78b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f741552c0 con 0x7f3f7406f3a0 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:37080/0 (socket says 172.21.15.12:37080) 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 -- 172.21.15.12:0/1492839708 learned_addr learned my addr 172.21.15.12:0/1492839708 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f737fe700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e0a0 0x7f3f74156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f73fff700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f740c33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 -- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 msgr2=0x7f3f740c33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f740c33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 -- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e0a0 msgr2=0x7f3f74156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e0a0 0x7f3f74156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:51.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.848+0000 7f3f72ffd700 1 -- 172.21.15.12:0/1492839708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6800a560 con 0x7f3f7406e470 2023-10-08T17:24:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f72ffd700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9a0 tx=0x7f3f6800a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f68005a00 con 0x7f3f7406e470 2023-10-08T17:24:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f68005b60 con 0x7f3f7406e470 2023-10-08T17:24:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6c009ae0 con 0x7f3f7406e470 2023-10-08T17:24:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f6800c770 con 0x7f3f7406e470 2023-10-08T17:24:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.849+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f74157060 con 0x7f3f7406e470 2023-10-08T17:24:51.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.850+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f741556b0 con 0x7f3f7406e470 2023-10-08T17:24:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.851+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f68017030 con 0x7f3f7406e470 2023-10-08T17:24:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.852+0000 7f3f5b7fe700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 0x7f3f600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.852+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f3f68015070 con 0x7f3f7406e470 2023-10-08T17:24:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.852+0000 7f3f737fe700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 0x7f3f600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:51.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.853+0000 7f3f737fe700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 0x7f3f600693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f64003a80 tx=0x7f3f64007ec0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:51.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:51.856+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f68051370 con 0x7f3f7406e470 2023-10-08T17:24:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.060+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f74155480 con 0x7f3f7406e470 2023-10-08T17:24:52.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.061+0000 7f3f5b7fe700 1 -- 172.21.15.12:0/1492839708 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16123 (secure 0 0 0) 0x7f3f68054990 con 0x7f3f7406e470 2023-10-08T17:24:52.061 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:52.061 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":168,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:24:49.123866+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:24:52.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 msgr2=0x7f3f600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 0x7f3f600693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3f64003a80 tx=0x7f3f64007ec0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 msgr2=0x7f3f74157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800e9a0 tx=0x7f3f6800a2e0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 shutdown_connections 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f3f60066f30 0x7f3f600693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3f7406f3a0 0x7f3f740c33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3f7406e0a0 0x7f3f74156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 --2- 172.21.15.12:0/1492839708 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3f7406e470 0x7f3f74157680 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 >> 172.21.15.12:0/1492839708 conn(0x7f3f7406d170 msgr2=0x7f3f7414fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:52.064 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 shutdown_connections 2023-10-08T17:24:52.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.063+0000 7f3f78b9d700 1 -- 172.21.15.12:0/1492839708 wait complete. 2023-10-08T17:24:52.081 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T17:24:52.082 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:24:52.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.269+0000 7fefdb59e700 1 Processor -- start 2023-10-08T17:24:52.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.270+0000 7fefdb59e700 1 -- start start 2023-10-08T17:24:52.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdb59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdb59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefdc06de50 0x7fefdc0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdb59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefdc0c6d50 con 0x7fefdc140a70 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdb59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefdc0c7030 con 0x7fefdc06de50 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdb59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc0c7310 con 0x7fefdc140e40 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefdc06de50 0x7fefdc0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fefdc06de50 0x7fefdc0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55628/0 (socket says 172.21.15.12:55628) 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefdad9d700 1 -- 172.21.15.12:0/2532415233 learned_addr learned my addr 172.21.15.12:0/2532415233 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.271+0000 7fefd9d9b700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefdad9d700 1 -- 172.21.15.12:0/2532415233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 msgr2=0x7fefdc0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefdad9d700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefdad9d700 1 -- 172.21.15.12:0/2532415233 >> v1:172.21.15.29:6789/0 conn(0x7fefdc140a70 legacy=0x7fefdc0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefdad9d700 1 -- 172.21.15.12:0/2532415233 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc0c75f0 con 0x7fefdc06de50 2023-10-08T17:24:52.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefd9d9b700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:52.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefdad9d700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc06de50 0x7fefdc0aeef0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009f20 tx=0x7fefd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9355b7e773e50217 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefd959a700 1 -- 172.21.15.12:0/2532415233 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd400e070 con 0x7fefdc06de50 2023-10-08T17:24:52.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefd959a700 1 -- 172.21.15.12:0/2532415233 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd400ba80 con 0x7fefdc06de50 2023-10-08T17:24:52.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.272+0000 7fefd959a700 1 -- 172.21.15.12:0/2532415233 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd40092e0 con 0x7fefdc06de50 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 -- 172.21.15.12:0/2532415233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc06de50 msgr2=0x7fefdc0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc06de50 0x7fefdc0aeef0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009f20 tx=0x7fefd4009840 comp rx=0 tx=0).stop 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 -- 172.21.15.12:0/2532415233 shutdown_connections 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc06de50 0x7fefdc0aeef0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 --2- 172.21.15.12:0/2532415233 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 -- 172.21.15.12:0/2532415233 >> 172.21.15.12:0/2532415233 conn(0x7fefdc06d170 msgr2=0x7fefdc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 -- 172.21.15.12:0/2532415233 shutdown_connections 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.273+0000 7fefdb59e700 1 -- 172.21.15.12:0/2532415233 wait complete. 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.274+0000 7fefdb59e700 1 Processor -- start 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.275+0000 7fefdb59e700 1 -- start start 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.275+0000 7fefdb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefdc06de50 0x7fefdc13e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.275+0000 7fefdb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.275+0000 7fefdb59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.275+0000 7fefdb59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc169d80 con 0x7fefdc140a70 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefdb59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc13e610 con 0x7fefdc06de50 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefdb59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefdc169170 con 0x7fefdc140e40 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55632/0 (socket says 172.21.15.12:55632) 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 -- 172.21.15.12:0/3808214117 learned_addr learned my addr 172.21.15.12:0/3808214117 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefda59c700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefdc06de50 0x7fefdc13e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefdad9d700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 -- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 msgr2=0x7fefdc0c1ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c1ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 -- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefdc06de50 msgr2=0x7fefdc13e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefdc06de50 0x7fefdc13e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 -- 172.21.15.12:0/3808214117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4009ae0 con 0x7fefdc140a70 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.276+0000 7fefd9d9b700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d890 tx=0x7fefd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.277+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0005a00 con 0x7fefdc140a70 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.277+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0005b60 con 0x7fefdc140a70 2023-10-08T17:24:52.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.277+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00125f0 con 0x7fefdc140a70 2023-10-08T17:24:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.277+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefdc169450 con 0x7fefdc140a70 2023-10-08T17:24:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.277+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc169a10 con 0x7fefdc140a70 2023-10-08T17:24:52.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.278+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefdc169ef0 con 0x7fefdc140a70 2023-10-08T17:24:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.279+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefd00129a0 con 0x7fefdc140a70 2023-10-08T17:24:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.280+0000 7fefca7fc700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.281+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fefd0084510 con 0x7fefdc140a70 2023-10-08T17:24:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.281+0000 7fefda59c700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.281+0000 7fefda59c700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefdc15ad80 tx=0x7fefcc009040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.285+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd004d5a0 con 0x7fefdc140a70 2023-10-08T17:24:52.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.483+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefdc13e780 con 0x7fefbc066f30 2023-10-08T17:24:52.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.494+0000 7fefca7fc700 1 -- 172.21.15.12:0/3808214117 <== mgr.8544 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289410 (secure 0 0 0) 0x7fefcc001ca0 con 0x7fefbc066f30 2023-10-08T17:24:52.497 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 msgr2=0x7fefbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 0x7fefbc0693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fefdc15ad80 tx=0x7fefcc009040 comp rx=0 tx=0).stop 2023-10-08T17:24:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 msgr2=0x7fefdc0c19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fefd000d890 tx=0x7fefd0008040 comp rx=0 tx=0).stop 2023-10-08T17:24:52.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 shutdown_connections 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fefbc066f30 0x7fefbc0693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fefdc140e40 0x7fefdc0c1ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fefdc06de50 0x7fefdc13e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 --2- 172.21.15.12:0/3808214117 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fefdc140a70 0x7fefdc0c19b0 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 >> 172.21.15.12:0/3808214117 conn(0x7fefdc06d170 msgr2=0x7fefdc063a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 shutdown_connections 2023-10-08T17:24:52.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.498+0000 7fefdb59e700 1 -- 172.21.15.12:0/3808214117 wait complete. 2023-10-08T17:24:52.502 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:24:52.516 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-08T17:24:50.638475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453132,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752521588,"statfs":{"total":773094113280,"available":770582106112,"internally_reserved":0,"allocated":17903616,"data_stored":9492844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.521282"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159702+0000","last_change":"2023-10-08T17:24:48.156998+0000","last_active":"2023-10-08T17:24:48.159702+0000","last_peered":"2023-10-08T17:24:48.159702+0000","last_clean":"2023-10-08T17:24:48.159702+0000","last_became_active":"2023-10-08T17:24:48.156772+0000","last_became_peered":"2023-10-08T17:24:48.156772+0000","last_unstale":"2023-10-08T17:24:48.159702+0000","last_undegraded":"2023-10-08T17:24:48.159702+0000","last_fullsized":"2023-10-08T17:24:48.159702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:14.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160186+0000","last_change":"2023-10-08T17:24:48.154877+0000","last_active":"2023-10-08T17:24:48.160186+0000","last_peered":"2023-10-08T17:24:48.160186+0000","last_clean":"2023-10-08T17:24:48.160186+0000","last_became_active":"2023-10-08T17:24:48.154606+0000","last_became_peered":"2023-10-08T17:24:48.154606+0000","last_unstale":"2023-10-08T17:24:48.160186+0000","last_undegraded":"2023-10-08T17:24:48.160186+0000","last_fullsized":"2023-10-08T17:24:48.160186+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.184932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154882+0000","last_change":"2023-10-08T17:24:48.147911+0000","last_active":"2023-10-08T17:24:48.154882+0000","last_peered":"2023-10-08T17:24:48.154882+0000","last_clean":"2023-10-08T17:24:48.154882+0000","last_became_active":"2023-10-08T17:24:48.147145+0000","last_became_peered":"2023-10-08T17:24:48.147145+0000","last_unstale":"2023-10-08T17:24:48.154882+0000","last_undegraded":"2023-10-08T17:24:48.154882+0000","last_fullsized":"2023-10-08T17:24:48.154882+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:41.118460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157607+0000","last_change":"2023-10-08T17:24:48.155657+0000","last_active":"2023-10-08T17:24:48.157607+0000","last_peered":"2023-10-08T17:24:48.157607+0000","last_clean":"2023-10-08T17:24:48.157607+0000","last_became_active":"2023-10-08T17:24:48.155417+0000","last_became_peered":"2023-10-08T17:24:48.155417+0000","last_unstale":"2023-10-08T17:24:48.157607+0000","last_undegraded":"2023-10-08T17:24:48.157607+0000","last_fullsized":"2023-10-08T17:24:48.157607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:46:16.889799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147472+0000","last_change":"2023-10-08T17:24:48.136550+0000","last_active":"2023-10-08T17:24:48.147472+0000","last_peered":"2023-10-08T17:24:48.147472+0000","last_clean":"2023-10-08T17:24:48.147472+0000","last_became_active":"2023-10-08T17:24:48.136170+0000","last_became_peered":"2023-10-08T17:24:48.136170+0000","last_unstale":"2023-10-08T17:24:48.147472+0000","last_undegraded":"2023-10-08T17:24:48.147472+0000","last_fullsized":"2023-10-08T17:24:48.147472+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:58.560295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151372+0000","last_change":"2023-10-08T17:24:48.145240+0000","last_active":"2023-10-08T17:24:48.151372+0000","last_peered":"2023-10-08T17:24:48.151372+0000","last_clean":"2023-10-08T17:24:48.151372+0000","last_became_active":"2023-10-08T17:24:48.144734+0000","last_became_peered":"2023-10-08T17:24:48.144734+0000","last_unstale":"2023-10-08T17:24:48.151372+0000","last_undegraded":"2023-10-08T17:24:48.151372+0000","last_fullsized":"2023-10-08T17:24:48.151372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:08:08.629536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150130+0000","last_change":"2023-10-08T17:24:48.142902+0000","last_active":"2023-10-08T17:24:48.150130+0000","last_peered":"2023-10-08T17:24:48.150130+0000","last_clean":"2023-10-08T17:24:48.150130+0000","last_became_active":"2023-10-08T17:24:48.142615+0000","last_became_peered":"2023-10-08T17:24:48.142615+0000","last_unstale":"2023-10-08T17:24:48.150130+0000","last_undegraded":"2023-10-08T17:24:48.150130+0000","last_fullsized":"2023-10-08T17:24:48.150130+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:04.257020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156938+0000","last_change":"2023-10-08T17:24:48.152085+0000","last_active":"2023-10-08T17:24:48.156938+0000","last_peered":"2023-10-08T17:24:48.156938+0000","last_clean":"2023-10-08T17:24:48.156938+0000","last_became_active":"2023-10-08T17:24:48.149546+0000","last_became_peered":"2023-10-08T17:24:48.149546+0000","last_unstale":"2023-10-08T17:24:48.156938+0000","last_undegraded":"2023-10-08T17:24:48.156938+0000","last_fullsized":"2023-10-08T17:24:48.156938+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:16.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157413+0000","last_change":"2023-10-08T17:24:48.154070+0000","last_active":"2023-10-08T17:24:48.157413+0000","last_peered":"2023-10-08T17:24:48.157413+0000","last_clean":"2023-10-08T17:24:48.157413+0000","last_became_active":"2023-10-08T17:24:48.153792+0000","last_became_peered":"2023-10-08T17:24:48.153792+0000","last_unstale":"2023-10-08T17:24:48.157413+0000","last_undegraded":"2023-10-08T17:24:48.157413+0000","last_fullsized":"2023-10-08T17:24:48.157413+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:17.308156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160165+0000","last_change":"2023-10-08T17:24:48.154324+0000","last_active":"2023-10-08T17:24:48.160165+0000","last_peered":"2023-10-08T17:24:48.160165+0000","last_clean":"2023-10-08T17:24:48.160165+0000","last_became_active":"2023-10-08T17:24:48.154042+0000","last_became_peered":"2023-10-08T17:24:48.154042+0000","last_unstale":"2023-10-08T17:24:48.160165+0000","last_undegraded":"2023-10-08T17:24:48.160165+0000","last_fullsized":"2023-10-08T17:24:48.160165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:05.267750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151756+0000","last_change":"2023-10-08T17:24:48.151015+0000","last_active":"2023-10-08T17:24:48.151756+0000","last_peered":"2023-10-08T17:24:48.151756+0000","last_clean":"2023-10-08T17:24:48.151756+0000","last_became_active":"2023-10-08T17:24:48.150750+0000","last_became_peered":"2023-10-08T17:24:48.150750+0000","last_unstale":"2023-10-08T17:24:48.151756+0000","last_undegraded":"2023-10-08T17:24:48.151756+0000","last_fullsized":"2023-10-08T17:24:48.151756+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:13.545640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.155120+0000","last_change":"2023-10-08T17:24:48.147511+0000","last_active":"2023-10-08T17:24:48.155120+0000","last_peered":"2023-10-08T17:24:48.155120+0000","last_clean":"2023-10-08T17:24:48.155120+0000","last_became_active":"2023-10-08T17:24:48.147202+0000","last_became_peered":"2023-10-08T17:24:48.147202+0000","last_unstale":"2023-10-08T17:24:48.155120+0000","last_undegraded":"2023-10-08T17:24:48.155120+0000","last_fullsized":"2023-10-08T17:24:48.155120+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:56.176739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157602+0000","last_change":"2023-10-08T17:24:48.156444+0000","last_active":"2023-10-08T17:24:48.157602+0000","last_peered":"2023-10-08T17:24:48.157602+0000","last_clean":"2023-10-08T17:24:48.157602+0000","last_became_active":"2023-10-08T17:24:48.156048+0000","last_became_peered":"2023-10-08T17:24:48.156048+0000","last_unstale":"2023-10-08T17:24:48.157602+0000","last_undegraded":"2023-10-08T17:24:48.157602+0000","last_fullsized":"2023-10-08T17:24:48.157602+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:07.822647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161281+0000","last_change":"2023-10-08T17:24:48.159730+0000","last_active":"2023-10-08T17:24:48.161281+0000","last_peered":"2023-10-08T17:24:48.161281+0000","last_clean":"2023-10-08T17:24:48.161281+0000","last_became_active":"2023-10-08T17:24:48.159425+0000","last_became_peered":"2023-10-08T17:24:48.159425+0000","last_unstale":"2023-10-08T17:24:48.161281+0000","last_undegraded":"2023-10-08T17:24:48.161281+0000","last_fullsized":"2023-10-08T17:24:48.161281+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:14.591061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160154+0000","last_change":"2023-10-08T17:24:48.158371+0000","last_active":"2023-10-08T17:24:48.160154+0000","last_peered":"2023-10-08T17:24:48.160154+0000","last_clean":"2023-10-08T17:24:48.160154+0000","last_became_active":"2023-10-08T17:24:48.157735+0000","last_became_peered":"2023-10-08T17:24:48.157735+0000","last_unstale":"2023-10-08T17:24:48.160154+0000","last_undegraded":"2023-10-08T17:24:48.160154+0000","last_fullsized":"2023-10-08T17:24:48.160154+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:55.535063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159602+0000","last_change":"2023-10-08T17:24:48.148485+0000","last_active":"2023-10-08T17:24:48.159602+0000","last_peered":"2023-10-08T17:24:48.159602+0000","last_clean":"2023-10-08T17:24:48.159602+0000","last_became_active":"2023-10-08T17:24:48.148240+0000","last_became_peered":"2023-10-08T17:24:48.148240+0000","last_unstale":"2023-10-08T17:24:48.159602+0000","last_undegraded":"2023-10-08T17:24:48.159602+0000","last_fullsized":"2023-10-08T17:24:48.159602+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:56.252965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143304+0000","last_change":"2023-10-08T17:24:48.135910+0000","last_active":"2023-10-08T17:24:48.143304+0000","last_peered":"2023-10-08T17:24:48.143304+0000","last_clean":"2023-10-08T17:24:48.143304+0000","last_became_active":"2023-10-08T17:24:48.135559+0000","last_became_peered":"2023-10-08T17:24:48.135559+0000","last_unstale":"2023-10-08T17:24:48.143304+0000","last_undegraded":"2023-10-08T17:24:48.143304+0000","last_fullsized":"2023-10-08T17:24:48.143304+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:08.391296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147898+0000","last_change":"2023-10-08T17:24:48.145141+0000","last_active":"2023-10-08T17:24:48.147898+0000","last_peered":"2023-10-08T17:24:48.147898+0000","last_clean":"2023-10-08T17:24:48.147898+0000","last_became_active":"2023-10-08T17:24:48.144887+0000","last_became_peered":"2023-10-08T17:24:48.144887+0000","last_unstale":"2023-10-08T17:24:48.147898+0000","last_undegraded":"2023-10-08T17:24:48.147898+0000","last_fullsized":"2023-10-08T17:24:48.147898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:27.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143106+0000","last_change":"2023-10-08T17:24:48.137036+0000","last_active":"2023-10-08T17:24:48.143106+0000","last_peered":"2023-10-08T17:24:48.143106+0000","last_clean":"2023-10-08T17:24:48.143106+0000","last_became_active":"2023-10-08T17:24:48.136259+0000","last_became_peered":"2023-10-08T17:24:48.136259+0000","last_unstale":"2023-10-08T17:24:48.143106+0000","last_undegraded":"2023-10-08T17:24:48.143106+0000","last_fullsized":"2023-10-08T17:24:48.143106+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:17.698655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.163539+0000","last_change":"2023-10-08T17:24:48.152691+0000","last_active":"2023-10-08T17:24:48.163539+0000","last_peered":"2023-10-08T17:24:48.163539+0000","last_clean":"2023-10-08T17:24:48.163539+0000","last_became_active":"2023-10-08T17:24:48.152431+0000","last_became_peered":"2023-10-08T17:24:48.152431+0000","last_unstale":"2023-10-08T17:24:48.163539+0000","last_undegraded":"2023-10-08T17:24:48.163539+0000","last_fullsized":"2023-10-08T17:24:48.163539+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:13.392924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147451+0000","last_change":"2023-10-08T17:24:48.136462+0000","last_active":"2023-10-08T17:24:48.147451+0000","last_peered":"2023-10-08T17:24:48.147451+0000","last_clean":"2023-10-08T17:24:48.147451+0000","last_became_active":"2023-10-08T17:24:48.136146+0000","last_became_peered":"2023-10-08T17:24:48.136146+0000","last_unstale":"2023-10-08T17:24:48.147451+0000","last_undegraded":"2023-10-08T17:24:48.147451+0000","last_fullsized":"2023-10-08T17:24:48.147451+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:17.698655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157361+0000","last_change":"2023-10-08T17:24:48.155007+0000","last_active":"2023-10-08T17:24:48.157361+0000","last_peered":"2023-10-08T17:24:48.157361+0000","last_clean":"2023-10-08T17:24:48.157361+0000","last_became_active":"2023-10-08T17:24:48.154677+0000","last_became_peered":"2023-10-08T17:24:48.154677+0000","last_unstale":"2023-10-08T17:24:48.157361+0000","last_undegraded":"2023-10-08T17:24:48.157361+0000","last_fullsized":"2023-10-08T17:24:48.157361+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:24.106408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157277+0000","last_change":"2023-10-08T17:24:48.153523+0000","last_active":"2023-10-08T17:24:48.157277+0000","last_peered":"2023-10-08T17:24:48.157277+0000","last_clean":"2023-10-08T17:24:48.157277+0000","last_became_active":"2023-10-08T17:24:48.153264+0000","last_became_peered":"2023-10-08T17:24:48.153264+0000","last_unstale":"2023-10-08T17:24:48.157277+0000","last_undegraded":"2023-10-08T17:24:48.157277+0000","last_fullsized":"2023-10-08T17:24:48.157277+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:03.933122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.145839+0000","last_change":"2023-10-08T17:24:48.143669+0000","last_active":"2023-10-08T17:24:48.145839+0000","last_peered":"2023-10-08T17:24:48.145839+0000","last_clean":"2023-10-08T17:24:48.145839+0000","last_became_active":"2023-10-08T17:24:48.143414+0000","last_became_peered":"2023-10-08T17:24:48.143414+0000","last_unstale":"2023-10-08T17:24:48.145839+0000","last_undegraded":"2023-10-08T17:24:48.145839+0000","last_fullsized":"2023-10-08T17:24:48.145839+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:57.143272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159147+0000","last_change":"2023-10-08T17:24:48.154004+0000","last_active":"2023-10-08T17:24:48.159147+0000","last_peered":"2023-10-08T17:24:48.159147+0000","last_clean":"2023-10-08T17:24:48.159147+0000","last_became_active":"2023-10-08T17:24:48.153712+0000","last_became_peered":"2023-10-08T17:24:48.153712+0000","last_unstale":"2023-10-08T17:24:48.159147+0000","last_undegraded":"2023-10-08T17:24:48.159147+0000","last_fullsized":"2023-10-08T17:24:48.159147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:52.837390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159637+0000","last_change":"2023-10-08T17:24:48.147973+0000","last_active":"2023-10-08T17:24:48.159637+0000","last_peered":"2023-10-08T17:24:48.159637+0000","last_clean":"2023-10-08T17:24:48.159637+0000","last_became_active":"2023-10-08T17:24:48.147684+0000","last_became_peered":"2023-10-08T17:24:48.147684+0000","last_unstale":"2023-10-08T17:24:48.159637+0000","last_undegraded":"2023-10-08T17:24:48.159637+0000","last_fullsized":"2023-10-08T17:24:48.159637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:09.319599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160965+0000","last_change":"2023-10-08T17:24:48.157609+0000","last_active":"2023-10-08T17:24:48.160965+0000","last_peered":"2023-10-08T17:24:48.160965+0000","last_clean":"2023-10-08T17:24:48.160965+0000","last_became_active":"2023-10-08T17:24:48.157337+0000","last_became_peered":"2023-10-08T17:24:48.157337+0000","last_unstale":"2023-10-08T17:24:48.160965+0000","last_undegraded":"2023-10-08T17:24:48.160965+0000","last_fullsized":"2023-10-08T17:24:48.160965+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:00.754012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152032+0000","last_change":"2023-10-08T17:24:48.149460+0000","last_active":"2023-10-08T17:24:48.152032+0000","last_peered":"2023-10-08T17:24:48.152032+0000","last_clean":"2023-10-08T17:24:48.152032+0000","last_became_active":"2023-10-08T17:24:48.149161+0000","last_became_peered":"2023-10-08T17:24:48.149161+0000","last_unstale":"2023-10-08T17:24:48.152032+0000","last_undegraded":"2023-10-08T17:24:48.152032+0000","last_fullsized":"2023-10-08T17:24:48.152032+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:29.800765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161622+0000","last_change":"2023-10-08T17:24:48.158717+0000","last_active":"2023-10-08T17:24:48.161622+0000","last_peered":"2023-10-08T17:24:48.161622+0000","last_clean":"2023-10-08T17:24:48.161622+0000","last_became_active":"2023-10-08T17:24:48.158041+0000","last_became_peered":"2023-10-08T17:24:48.158041+0000","last_unstale":"2023-10-08T17:24:48.161622+0000","last_undegraded":"2023-10-08T17:24:48.161622+0000","last_fullsized":"2023-10-08T17:24:48.161622+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:47.355280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148989+0000","last_change":"2023-10-08T17:24:48.142752+0000","last_active":"2023-10-08T17:24:48.148989+0000","last_peered":"2023-10-08T17:24:48.148989+0000","last_clean":"2023-10-08T17:24:48.148989+0000","last_became_active":"2023-10-08T17:24:48.142481+0000","last_became_peered":"2023-10-08T17:24:48.142481+0000","last_unstale":"2023-10-08T17:24:48.148989+0000","last_undegraded":"2023-10-08T17:24:48.148989+0000","last_fullsized":"2023-10-08T17:24:48.148989+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:55.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148634+0000","last_change":"2023-10-08T17:24:48.147103+0000","last_active":"2023-10-08T17:24:48.148634+0000","last_peered":"2023-10-08T17:24:48.148634+0000","last_clean":"2023-10-08T17:24:48.148634+0000","last_became_active":"2023-10-08T17:24:48.146800+0000","last_became_peered":"2023-10-08T17:24:48.146800+0000","last_unstale":"2023-10-08T17:24:48.148634+0000","last_undegraded":"2023-10-08T17:24:48.148634+0000","last_fullsized":"2023-10-08T17:24:48.148634+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:31:47.115478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154109+0000","last_change":"2023-10-08T17:24:48.150567+0000","last_active":"2023-10-08T17:24:48.154109+0000","last_peered":"2023-10-08T17:24:48.154109+0000","last_clean":"2023-10-08T17:24:48.154109+0000","last_became_active":"2023-10-08T17:24:48.150301+0000","last_became_peered":"2023-10-08T17:24:48.150301+0000","last_unstale":"2023-10-08T17:24:48.154109+0000","last_undegraded":"2023-10-08T17:24:48.154109+0000","last_fullsized":"2023-10-08T17:24:48.154109+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:03.111831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159685+0000","last_change":"2023-10-08T17:24:48.149550+0000","last_active":"2023-10-08T17:24:48.159685+0000","last_peered":"2023-10-08T17:24:48.159685+0000","last_clean":"2023-10-08T17:24:48.159685+0000","last_became_active":"2023-10-08T17:24:48.148886+0000","last_became_peered":"2023-10-08T17:24:48.148886+0000","last_unstale":"2023-10-08T17:24:48.159685+0000","last_undegraded":"2023-10-08T17:24:48.159685+0000","last_fullsized":"2023-10-08T17:24:48.159685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:48.927642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158386+0000","last_change":"2023-10-08T17:24:47.144373+0000","last_active":"2023-10-08T17:24:48.158386+0000","last_peered":"2023-10-08T17:24:48.158386+0000","last_clean":"2023-10-08T17:24:48.158386+0000","last_became_active":"2023-10-08T17:24:47.143931+0000","last_became_peered":"2023-10-08T17:24:47.143931+0000","last_unstale":"2023-10-08T17:24:48.158386+0000","last_undegraded":"2023-10-08T17:24:48.158386+0000","last_fullsized":"2023-10-08T17:24:48.158386+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:11.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154196+0000","last_change":"2023-10-08T17:24:48.141775+0000","last_active":"2023-10-08T17:24:48.154196+0000","last_peered":"2023-10-08T17:24:48.154196+0000","last_clean":"2023-10-08T17:24:48.154196+0000","last_became_active":"2023-10-08T17:24:48.141497+0000","last_became_peered":"2023-10-08T17:24:48.141497+0000","last_unstale":"2023-10-08T17:24:48.154196+0000","last_undegraded":"2023-10-08T17:24:48.154196+0000","last_fullsized":"2023-10-08T17:24:48.154196+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:03.519408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157360+0000","last_change":"2023-10-08T17:24:47.137823+0000","last_active":"2023-10-08T17:24:48.157360+0000","last_peered":"2023-10-08T17:24:48.157360+0000","last_clean":"2023-10-08T17:24:48.157360+0000","last_became_active":"2023-10-08T17:24:47.137503+0000","last_became_peered":"2023-10-08T17:24:47.137503+0000","last_unstale":"2023-10-08T17:24:48.157360+0000","last_undegraded":"2023-10-08T17:24:48.157360+0000","last_fullsized":"2023-10-08T17:24:48.157360+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:46.177216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135726+0000","last_change":"2023-10-08T17:24:48.134553+0000","last_active":"2023-10-08T17:24:48.135726+0000","last_peered":"2023-10-08T17:24:48.135726+0000","last_clean":"2023-10-08T17:24:48.135726+0000","last_became_active":"2023-10-08T17:24:48.134236+0000","last_became_peered":"2023-10-08T17:24:48.134236+0000","last_unstale":"2023-10-08T17:24:48.135726+0000","last_undegraded":"2023-10-08T17:24:48.135726+0000","last_fullsized":"2023-10-08T17:24:48.135726+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:13.545640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.162665+0000","last_change":"2023-10-08T17:24:47.148143+0000","last_active":"2023-10-08T17:24:48.162665+0000","last_peered":"2023-10-08T17:24:48.162665+0000","last_clean":"2023-10-08T17:24:48.162665+0000","last_became_active":"2023-10-08T17:24:47.147803+0000","last_became_peered":"2023-10-08T17:24:47.147803+0000","last_unstale":"2023-10-08T17:24:48.162665+0000","last_undegraded":"2023-10-08T17:24:48.162665+0000","last_fullsized":"2023-10-08T17:24:48.162665+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:08.352506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157647+0000","last_change":"2023-10-08T17:24:48.151705+0000","last_active":"2023-10-08T17:24:48.157647+0000","last_peered":"2023-10-08T17:24:48.157647+0000","last_clean":"2023-10-08T17:24:48.157647+0000","last_became_active":"2023-10-08T17:24:48.151416+0000","last_became_peered":"2023-10-08T17:24:48.151416+0000","last_unstale":"2023-10-08T17:24:48.157647+0000","last_undegraded":"2023-10-08T17:24:48.157647+0000","last_fullsized":"2023-10-08T17:24:48.157647+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:54.297504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.165621+0000","last_change":"2023-10-08T17:24:47.143178+0000","last_active":"2023-10-08T17:24:48.165621+0000","last_peered":"2023-10-08T17:24:48.165621+0000","last_clean":"2023-10-08T17:24:48.165621+0000","last_became_active":"2023-10-08T17:24:47.142918+0000","last_became_peered":"2023-10-08T17:24:47.142918+0000","last_unstale":"2023-10-08T17:24:48.165621+0000","last_undegraded":"2023-10-08T17:24:48.165621+0000","last_fullsized":"2023-10-08T17:24:48.165621+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:26.776697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159755+0000","last_change":"2023-10-08T17:24:48.150557+0000","last_active":"2023-10-08T17:24:48.159755+0000","last_peered":"2023-10-08T17:24:48.159755+0000","last_clean":"2023-10-08T17:24:48.159755+0000","last_became_active":"2023-10-08T17:24:48.149617+0000","last_became_peered":"2023-10-08T17:24:48.149617+0000","last_unstale":"2023-10-08T17:24:48.159755+0000","last_undegraded":"2023-10-08T17:24:48.159755+0000","last_fullsized":"2023-10-08T17:24:48.159755+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:43.051551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.165623+0000","last_change":"2023-10-08T17:24:47.146822+0000","last_active":"2023-10-08T17:24:48.165623+0000","last_peered":"2023-10-08T17:24:48.165623+0000","last_clean":"2023-10-08T17:24:48.165623+0000","last_became_active":"2023-10-08T17:24:47.146565+0000","last_became_peered":"2023-10-08T17:24:47.146565+0000","last_unstale":"2023-10-08T17:24:48.165623+0000","last_undegraded":"2023-10-08T17:24:48.165623+0000","last_fullsized":"2023-10-08T17:24:48.165623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:08.902431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143406+0000","last_change":"2023-10-08T17:24:48.136454+0000","last_active":"2023-10-08T17:24:48.143406+0000","last_peered":"2023-10-08T17:24:48.143406+0000","last_clean":"2023-10-08T17:24:48.143406+0000","last_became_active":"2023-10-08T17:24:48.136147+0000","last_became_peered":"2023-10-08T17:24:48.136147+0000","last_unstale":"2023-10-08T17:24:48.143406+0000","last_undegraded":"2023-10-08T17:24:48.143406+0000","last_fullsized":"2023-10-08T17:24:48.143406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:56.254527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.166431+0000","last_change":"2023-10-08T17:24:47.147325+0000","last_active":"2023-10-08T17:24:48.166431+0000","last_peered":"2023-10-08T17:24:48.166431+0000","last_clean":"2023-10-08T17:24:48.166431+0000","last_became_active":"2023-10-08T17:24:47.147019+0000","last_became_peered":"2023-10-08T17:24:47.147019+0000","last_unstale":"2023-10-08T17:24:48.166431+0000","last_undegraded":"2023-10-08T17:24:48.166431+0000","last_fullsized":"2023-10-08T17:24:48.166431+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:22.416891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156960+0000","last_change":"2023-10-08T17:24:48.152185+0000","last_active":"2023-10-08T17:24:48.156960+0000","last_peered":"2023-10-08T17:24:48.156960+0000","last_clean":"2023-10-08T17:24:48.156960+0000","last_became_active":"2023-10-08T17:24:48.149894+0000","last_became_peered":"2023-10-08T17:24:48.149894+0000","last_unstale":"2023-10-08T17:24:48.156960+0000","last_undegraded":"2023-10-08T17:24:48.156960+0000","last_fullsized":"2023-10-08T17:24:48.156960+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:19.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128773+0000","last_change":"2023-10-08T17:24:47.139638+0000","last_active":"2023-10-08T17:24:48.128773+0000","last_peered":"2023-10-08T17:24:48.128773+0000","last_clean":"2023-10-08T17:24:48.128773+0000","last_became_active":"2023-10-08T17:24:47.139006+0000","last_became_peered":"2023-10-08T17:24:47.139006+0000","last_unstale":"2023-10-08T17:24:48.128773+0000","last_undegraded":"2023-10-08T17:24:48.128773+0000","last_fullsized":"2023-10-08T17:24:48.128773+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:19.827987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156954+0000","last_change":"2023-10-08T17:24:48.153394+0000","last_active":"2023-10-08T17:24:48.156954+0000","last_peered":"2023-10-08T17:24:48.156954+0000","last_clean":"2023-10-08T17:24:48.156954+0000","last_became_active":"2023-10-08T17:24:48.153069+0000","last_became_peered":"2023-10-08T17:24:48.153069+0000","last_unstale":"2023-10-08T17:24:48.156954+0000","last_undegraded":"2023-10-08T17:24:48.156954+0000","last_fullsized":"2023-10-08T17:24:48.156954+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:14.624610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.141171+0000","last_change":"2023-10-08T17:24:47.145131+0000","last_active":"2023-10-08T17:24:48.141171+0000","last_peered":"2023-10-08T17:24:48.141171+0000","last_clean":"2023-10-08T17:24:48.141171+0000","last_became_active":"2023-10-08T17:24:47.144876+0000","last_became_peered":"2023-10-08T17:24:47.144876+0000","last_unstale":"2023-10-08T17:24:48.141171+0000","last_undegraded":"2023-10-08T17:24:48.141171+0000","last_fullsized":"2023-10-08T17:24:48.141171+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:48.039365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150523+0000","last_change":"2023-10-08T17:24:48.147762+0000","last_active":"2023-10-08T17:24:48.150523+0000","last_peered":"2023-10-08T17:24:48.150523+0000","last_clean":"2023-10-08T17:24:48.150523+0000","last_became_active":"2023-10-08T17:24:48.147465+0000","last_became_peered":"2023-10-08T17:24:48.147465+0000","last_unstale":"2023-10-08T17:24:48.150523+0000","last_undegraded":"2023-10-08T17:24:48.150523+0000","last_fullsized":"2023-10-08T17:24:48.150523+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:07.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133319+0000","last_change":"2023-10-08T17:24:47.142870+0000","last_active":"2023-10-08T17:24:48.133319+0000","last_peered":"2023-10-08T17:24:48.133319+0000","last_clean":"2023-10-08T17:24:48.133319+0000","last_became_active":"2023-10-08T17:24:47.142591+0000","last_became_peered":"2023-10-08T17:24:47.142591+0000","last_unstale":"2023-10-08T17:24:48.133319+0000","last_undegraded":"2023-10-08T17:24:48.133319+0000","last_fullsized":"2023-10-08T17:24:48.133319+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:48.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152869+0000","last_change":"2023-10-08T17:24:48.150916+0000","last_active":"2023-10-08T17:24:48.152869+0000","last_peered":"2023-10-08T17:24:48.152869+0000","last_clean":"2023-10-08T17:24:48.152869+0000","last_became_active":"2023-10-08T17:24:48.150618+0000","last_became_peered":"2023-10-08T17:24:48.150618+0000","last_unstale":"2023-10-08T17:24:48.152869+0000","last_undegraded":"2023-10-08T17:24:48.152869+0000","last_fullsized":"2023-10-08T17:24:48.152869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:35.450962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.134275+0000","last_change":"2023-10-08T17:24:47.147241+0000","last_active":"2023-10-08T17:24:48.134275+0000","last_peered":"2023-10-08T17:24:48.134275+0000","last_clean":"2023-10-08T17:24:48.134275+0000","last_became_active":"2023-10-08T17:24:47.146574+0000","last_became_peered":"2023-10-08T17:24:47.146574+0000","last_unstale":"2023-10-08T17:24:48.134275+0000","last_undegraded":"2023-10-08T17:24:48.134275+0000","last_fullsized":"2023-10-08T17:24:48.134275+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:34.408449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151402+0000","last_change":"2023-10-08T17:24:48.147664+0000","last_active":"2023-10-08T17:24:48.151402+0000","last_peered":"2023-10-08T17:24:48.151402+0000","last_clean":"2023-10-08T17:24:48.151402+0000","last_became_active":"2023-10-08T17:24:48.146656+0000","last_became_peered":"2023-10-08T17:24:48.146656+0000","last_unstale":"2023-10-08T17:24:48.151402+0000","last_undegraded":"2023-10-08T17:24:48.151402+0000","last_fullsized":"2023-10-08T17:24:48.151402+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:27.653406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.166021+0000","last_change":"2023-10-08T17:24:47.147282+0000","last_active":"2023-10-08T17:24:48.166021+0000","last_peered":"2023-10-08T17:24:48.166021+0000","last_clean":"2023-10-08T17:24:48.166021+0000","last_became_active":"2023-10-08T17:24:47.147021+0000","last_became_peered":"2023-10-08T17:24:47.147021+0000","last_unstale":"2023-10-08T17:24:48.166021+0000","last_undegraded":"2023-10-08T17:24:48.166021+0000","last_fullsized":"2023-10-08T17:24:48.166021+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.732870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.146176+0000","last_change":"2023-10-08T17:24:48.141364+0000","last_active":"2023-10-08T17:24:48.146176+0000","last_peered":"2023-10-08T17:24:48.146176+0000","last_clean":"2023-10-08T17:24:48.146176+0000","last_became_active":"2023-10-08T17:24:48.140657+0000","last_became_peered":"2023-10-08T17:24:48.140657+0000","last_unstale":"2023-10-08T17:24:48.146176+0000","last_undegraded":"2023-10-08T17:24:48.146176+0000","last_fullsized":"2023-10-08T17:24:48.146176+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:43:28.212136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"167'6","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.167222+0000","last_change":"2023-10-08T17:24:47.141364+0000","last_active":"2023-10-08T17:24:48.167222+0000","last_peered":"2023-10-08T17:24:48.167222+0000","last_clean":"2023-10-08T17:24:48.167222+0000","last_became_active":"2023-10-08T17:24:47.141098+0000","last_became_peered":"2023-10-08T17:24:47.141098+0000","last_unstale":"2023-10-08T17:24:48.167222+0000","last_undegraded":"2023-10-08T17:24:48.167222+0000","last_fullsized":"2023-10-08T17:24:48.167222+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:36:16.218080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152898+0000","last_change":"2023-10-08T17:24:48.145555+0000","last_active":"2023-10-08T17:24:48.152898+0000","last_peered":"2023-10-08T17:24:48.152898+0000","last_clean":"2023-10-08T17:24:48.152898+0000","last_became_active":"2023-10-08T17:24:48.145148+0000","last_became_peered":"2023-10-08T17:24:48.145148+0000","last_unstale":"2023-10-08T17:24:48.152898+0000","last_undegraded":"2023-10-08T17:24:48.152898+0000","last_fullsized":"2023-10-08T17:24:48.152898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:18.904721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.131395+0000","last_change":"2023-10-08T17:24:47.134018+0000","last_active":"2023-10-08T17:24:48.131395+0000","last_peered":"2023-10-08T17:24:48.131395+0000","last_clean":"2023-10-08T17:24:48.131395+0000","last_became_active":"2023-10-08T17:24:47.133695+0000","last_became_peered":"2023-10-08T17:24:47.133695+0000","last_unstale":"2023-10-08T17:24:48.131395+0000","last_undegraded":"2023-10-08T17:24:48.131395+0000","last_fullsized":"2023-10-08T17:24:48.131395+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:51.829673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160844+0000","last_change":"2023-10-08T17:24:48.159868+0000","last_active":"2023-10-08T17:24:48.160844+0000","last_peered":"2023-10-08T17:24:48.160844+0000","last_clean":"2023-10-08T17:24:48.160844+0000","last_became_active":"2023-10-08T17:24:48.159544+0000","last_became_peered":"2023-10-08T17:24:48.159544+0000","last_unstale":"2023-10-08T17:24:48.160844+0000","last_undegraded":"2023-10-08T17:24:48.160844+0000","last_fullsized":"2023-10-08T17:24:48.160844+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:21.574021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.138754+0000","last_change":"2023-10-08T17:24:47.141072+0000","last_active":"2023-10-08T17:24:48.138754+0000","last_peered":"2023-10-08T17:24:48.138754+0000","last_clean":"2023-10-08T17:24:48.138754+0000","last_became_active":"2023-10-08T17:24:47.140804+0000","last_became_peered":"2023-10-08T17:24:47.140804+0000","last_unstale":"2023-10-08T17:24:48.138754+0000","last_undegraded":"2023-10-08T17:24:48.138754+0000","last_fullsized":"2023-10-08T17:24:48.138754+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:33:27.108489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156846+0000","last_change":"2023-10-08T17:24:48.152861+0000","last_active":"2023-10-08T17:24:48.156846+0000","last_peered":"2023-10-08T17:24:48.156846+0000","last_clean":"2023-10-08T17:24:48.156846+0000","last_became_active":"2023-10-08T17:24:48.152600+0000","last_became_peered":"2023-10-08T17:24:48.152600+0000","last_unstale":"2023-10-08T17:24:48.156846+0000","last_undegraded":"2023-10-08T17:24:48.156846+0000","last_fullsized":"2023-10-08T17:24:48.156846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:20.835704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.167084+0000","last_change":"2023-10-08T17:24:47.146894+0000","last_active":"2023-10-08T17:24:48.167084+0000","last_peered":"2023-10-08T17:24:48.167084+0000","last_clean":"2023-10-08T17:24:48.167084+0000","last_became_active":"2023-10-08T17:24:47.146574+0000","last_became_peered":"2023-10-08T17:24:47.146574+0000","last_unstale":"2023-10-08T17:24:48.167084+0000","last_undegraded":"2023-10-08T17:24:48.167084+0000","last_fullsized":"2023-10-08T17:24:48.167084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:51.197082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151918+0000","last_change":"2023-10-08T17:24:48.142601+0000","last_active":"2023-10-08T17:24:48.151918+0000","last_peered":"2023-10-08T17:24:48.151918+0000","last_clean":"2023-10-08T17:24:48.151918+0000","last_became_active":"2023-10-08T17:24:48.142319+0000","last_became_peered":"2023-10-08T17:24:48.142319+0000","last_unstale":"2023-10-08T17:24:48.151918+0000","last_undegraded":"2023-10-08T17:24:48.151918+0000","last_fullsized":"2023-10-08T17:24:48.151918+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:27.978660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158043+0000","last_change":"2023-10-08T17:24:47.141560+0000","last_active":"2023-10-08T17:24:48.158043+0000","last_peered":"2023-10-08T17:24:48.158043+0000","last_clean":"2023-10-08T17:24:48.158043+0000","last_became_active":"2023-10-08T17:24:47.141257+0000","last_became_peered":"2023-10-08T17:24:47.141257+0000","last_unstale":"2023-10-08T17:24:48.158043+0000","last_undegraded":"2023-10-08T17:24:48.158043+0000","last_fullsized":"2023-10-08T17:24:48.158043+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:29.637559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150611+0000","last_change":"2023-10-08T17:24:48.144274+0000","last_active":"2023-10-08T17:24:48.150611+0000","last_peered":"2023-10-08T17:24:48.150611+0000","last_clean":"2023-10-08T17:24:48.150611+0000","last_became_active":"2023-10-08T17:24:48.143948+0000","last_became_peered":"2023-10-08T17:24:48.143948+0000","last_unstale":"2023-10-08T17:24:48.150611+0000","last_undegraded":"2023-10-08T17:24:48.150611+0000","last_fullsized":"2023-10-08T17:24:48.150611+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:52.837390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156323+0000","last_change":"2023-10-08T17:24:47.146240+0000","last_active":"2023-10-08T17:24:48.156323+0000","last_peered":"2023-10-08T17:24:48.156323+0000","last_clean":"2023-10-08T17:24:48.156323+0000","last_became_active":"2023-10-08T17:24:47.145953+0000","last_became_peered":"2023-10-08T17:24:47.145953+0000","last_unstale":"2023-10-08T17:24:48.156323+0000","last_undegraded":"2023-10-08T17:24:48.156323+0000","last_fullsized":"2023-10-08T17:24:48.156323+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:13.634949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159963+0000","last_change":"2023-10-08T17:24:48.148448+0000","last_active":"2023-10-08T17:24:48.159963+0000","last_peered":"2023-10-08T17:24:48.159963+0000","last_clean":"2023-10-08T17:24:48.159963+0000","last_became_active":"2023-10-08T17:24:48.148171+0000","last_became_peered":"2023-10-08T17:24:48.148171+0000","last_unstale":"2023-10-08T17:24:48.159963+0000","last_undegraded":"2023-10-08T17:24:48.159963+0000","last_fullsized":"2023-10-08T17:24:48.159963+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:10.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153167+0000","last_change":"2023-10-08T17:24:47.148889+0000","last_active":"2023-10-08T17:24:48.153167+0000","last_peered":"2023-10-08T17:24:48.153167+0000","last_clean":"2023-10-08T17:24:48.153167+0000","last_became_active":"2023-10-08T17:24:47.148561+0000","last_became_peered":"2023-10-08T17:24:47.148561+0000","last_unstale":"2023-10-08T17:24:48.153167+0000","last_undegraded":"2023-10-08T17:24:48.153167+0000","last_fullsized":"2023-10-08T17:24:48.153167+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:18:14.591483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156840+0000","last_change":"2023-10-08T17:24:48.153502+0000","last_active":"2023-10-08T17:24:48.156840+0000","last_peered":"2023-10-08T17:24:48.156840+0000","last_clean":"2023-10-08T17:24:48.156840+0000","last_became_active":"2023-10-08T17:24:48.153208+0000","last_became_peered":"2023-10-08T17:24:48.153208+0000","last_unstale":"2023-10-08T17:24:48.156840+0000","last_undegraded":"2023-10-08T17:24:48.156840+0000","last_fullsized":"2023-10-08T17:24:48.156840+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:46.151235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133012+0000","last_change":"2023-10-08T17:24:47.138481+0000","last_active":"2023-10-08T17:24:48.133012+0000","last_peered":"2023-10-08T17:24:48.133012+0000","last_clean":"2023-10-08T17:24:48.133012+0000","last_became_active":"2023-10-08T17:24:47.138147+0000","last_became_peered":"2023-10-08T17:24:47.138147+0000","last_unstale":"2023-10-08T17:24:48.133012+0000","last_undegraded":"2023-10-08T17:24:48.133012+0000","last_fullsized":"2023-10-08T17:24:48.133012+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.727191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.141040+0000","last_change":"2023-10-08T17:24:48.139171+0000","last_active":"2023-10-08T17:24:48.141040+0000","last_peered":"2023-10-08T17:24:48.141040+0000","last_clean":"2023-10-08T17:24:48.141040+0000","last_became_active":"2023-10-08T17:24:48.138861+0000","last_became_peered":"2023-10-08T17:24:48.138861+0000","last_unstale":"2023-10-08T17:24:48.141040+0000","last_undegraded":"2023-10-08T17:24:48.141040+0000","last_fullsized":"2023-10-08T17:24:48.141040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:52.204799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160761+0000","last_change":"2023-10-08T17:24:47.143361+0000","last_active":"2023-10-08T17:24:48.160761+0000","last_peered":"2023-10-08T17:24:48.160761+0000","last_clean":"2023-10-08T17:24:48.160761+0000","last_became_active":"2023-10-08T17:24:47.143032+0000","last_became_peered":"2023-10-08T17:24:47.143032+0000","last_unstale":"2023-10-08T17:24:48.160761+0000","last_undegraded":"2023-10-08T17:24:48.160761+0000","last_fullsized":"2023-10-08T17:24:48.160761+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:04.260033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.149893+0000","last_change":"2023-10-08T17:24:48.143540+0000","last_active":"2023-10-08T17:24:48.149893+0000","last_peered":"2023-10-08T17:24:48.149893+0000","last_clean":"2023-10-08T17:24:48.149893+0000","last_became_active":"2023-10-08T17:24:48.143211+0000","last_became_peered":"2023-10-08T17:24:48.143211+0000","last_unstale":"2023-10-08T17:24:48.149893+0000","last_undegraded":"2023-10-08T17:24:48.149893+0000","last_fullsized":"2023-10-08T17:24:48.149893+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:13.385108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133348+0000","last_change":"2023-10-08T17:24:47.143831+0000","last_active":"2023-10-08T17:24:48.133348+0000","last_peered":"2023-10-08T17:24:48.133348+0000","last_clean":"2023-10-08T17:24:48.133348+0000","last_became_active":"2023-10-08T17:24:47.143571+0000","last_became_peered":"2023-10-08T17:24:47.143571+0000","last_unstale":"2023-10-08T17:24:48.133348+0000","last_undegraded":"2023-10-08T17:24:48.133348+0000","last_fullsized":"2023-10-08T17:24:48.133348+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:37.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153919+0000","last_change":"2023-10-08T17:24:48.150830+0000","last_active":"2023-10-08T17:24:48.153919+0000","last_peered":"2023-10-08T17:24:48.153919+0000","last_clean":"2023-10-08T17:24:48.153919+0000","last_became_active":"2023-10-08T17:24:48.150553+0000","last_became_peered":"2023-10-08T17:24:48.150553+0000","last_unstale":"2023-10-08T17:24:48.153919+0000","last_undegraded":"2023-10-08T17:24:48.153919+0000","last_fullsized":"2023-10-08T17:24:48.153919+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:49.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132600+0000","last_change":"2023-10-08T17:24:47.147978+0000","last_active":"2023-10-08T17:24:48.132600+0000","last_peered":"2023-10-08T17:24:48.132600+0000","last_clean":"2023-10-08T17:24:48.132600+0000","last_became_active":"2023-10-08T17:24:47.146431+0000","last_became_peered":"2023-10-08T17:24:47.146431+0000","last_unstale":"2023-10-08T17:24:48.132600+0000","last_undegraded":"2023-10-08T17:24:48.132600+0000","last_fullsized":"2023-10-08T17:24:48.132600+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:23.155209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148654+0000","last_change":"2023-10-08T17:24:48.147295+0000","last_active":"2023-10-08T17:24:48.148654+0000","last_peered":"2023-10-08T17:24:48.148654+0000","last_clean":"2023-10-08T17:24:48.148654+0000","last_became_active":"2023-10-08T17:24:48.146075+0000","last_became_peered":"2023-10-08T17:24:48.146075+0000","last_unstale":"2023-10-08T17:24:48.148654+0000","last_undegraded":"2023-10-08T17:24:48.148654+0000","last_fullsized":"2023-10-08T17:24:48.148654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:22.605339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.130675+0000","last_change":"2023-10-08T17:24:47.145824+0000","last_active":"2023-10-08T17:24:48.130675+0000","last_peered":"2023-10-08T17:24:48.130675+0000","last_clean":"2023-10-08T17:24:48.130675+0000","last_became_active":"2023-10-08T17:24:47.145473+0000","last_became_peered":"2023-10-08T17:24:47.145473+0000","last_unstale":"2023-10-08T17:24:48.130675+0000","last_undegraded":"2023-10-08T17:24:48.130675+0000","last_fullsized":"2023-10-08T17:24:48.130675+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:38.579768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150126+0000","last_change":"2023-10-08T17:24:48.143461+0000","last_active":"2023-10-08T17:24:48.150126+0000","last_peered":"2023-10-08T17:24:48.150126+0000","last_clean":"2023-10-08T17:24:48.150126+0000","last_became_active":"2023-10-08T17:24:48.143157+0000","last_became_peered":"2023-10-08T17:24:48.143157+0000","last_unstale":"2023-10-08T17:24:48.150126+0000","last_undegraded":"2023-10-08T17:24:48.150126+0000","last_fullsized":"2023-10-08T17:24:48.150126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:46.558310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157961+0000","last_change":"2023-10-08T17:24:47.140604+0000","last_active":"2023-10-08T17:24:48.157961+0000","last_peered":"2023-10-08T17:24:48.157961+0000","last_clean":"2023-10-08T17:24:48.157961+0000","last_became_active":"2023-10-08T17:24:47.140351+0000","last_became_peered":"2023-10-08T17:24:47.140351+0000","last_unstale":"2023-10-08T17:24:48.157961+0000","last_undegraded":"2023-10-08T17:24:48.157961+0000","last_fullsized":"2023-10-08T17:24:48.157961+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:34.443246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161731+0000","last_change":"2023-10-08T17:24:48.158387+0000","last_active":"2023-10-08T17:24:48.161731+0000","last_peered":"2023-10-08T17:24:48.161731+0000","last_clean":"2023-10-08T17:24:48.161731+0000","last_became_active":"2023-10-08T17:24:48.158055+0000","last_became_peered":"2023-10-08T17:24:48.158055+0000","last_unstale":"2023-10-08T17:24:48.161731+0000","last_undegraded":"2023-10-08T17:24:48.161731+0000","last_fullsized":"2023-10-08T17:24:48.161731+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:36:17.225796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128058+0000","last_change":"2023-10-08T17:24:47.141612+0000","last_active":"2023-10-08T17:24:48.128058+0000","last_peered":"2023-10-08T17:24:48.128058+0000","last_clean":"2023-10-08T17:24:48.128058+0000","last_became_active":"2023-10-08T17:24:47.141277+0000","last_became_peered":"2023-10-08T17:24:47.141277+0000","last_unstale":"2023-10-08T17:24:48.128058+0000","last_undegraded":"2023-10-08T17:24:48.128058+0000","last_fullsized":"2023-10-08T17:24:48.128058+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:47.841603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.163265+0000","last_change":"2023-10-08T17:24:48.157594+0000","last_active":"2023-10-08T17:24:48.163265+0000","last_peered":"2023-10-08T17:24:48.163265+0000","last_clean":"2023-10-08T17:24:48.163265+0000","last_became_active":"2023-10-08T17:24:48.155073+0000","last_became_peered":"2023-10-08T17:24:48.155073+0000","last_unstale":"2023-10-08T17:24:48.163265+0000","last_undegraded":"2023-10-08T17:24:48.163265+0000","last_fullsized":"2023-10-08T17:24:48.163265+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:02.734908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.137322+0000","last_change":"2023-10-08T17:24:47.144563+0000","last_active":"2023-10-08T17:24:48.137322+0000","last_peered":"2023-10-08T17:24:48.137322+0000","last_clean":"2023-10-08T17:24:48.137322+0000","last_became_active":"2023-10-08T17:24:47.144303+0000","last_became_peered":"2023-10-08T17:24:47.144303+0000","last_unstale":"2023-10-08T17:24:48.137322+0000","last_undegraded":"2023-10-08T17:24:48.137322+0000","last_fullsized":"2023-10-08T17:24:48.137322+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:56.082950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153253+0000","last_change":"2023-10-08T17:24:48.146813+0000","last_active":"2023-10-08T17:24:48.153253+0000","last_peered":"2023-10-08T17:24:48.153253+0000","last_clean":"2023-10-08T17:24:48.153253+0000","last_became_active":"2023-10-08T17:24:48.144969+0000","last_became_peered":"2023-10-08T17:24:48.144969+0000","last_unstale":"2023-10-08T17:24:48.153253+0000","last_undegraded":"2023-10-08T17:24:48.153253+0000","last_fullsized":"2023-10-08T17:24:48.153253+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:48.849320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132861+0000","last_change":"2023-10-08T17:24:47.148515+0000","last_active":"2023-10-08T17:24:48.132861+0000","last_peered":"2023-10-08T17:24:48.132861+0000","last_clean":"2023-10-08T17:24:48.132861+0000","last_became_active":"2023-10-08T17:24:47.148201+0000","last_became_peered":"2023-10-08T17:24:47.148201+0000","last_unstale":"2023-10-08T17:24:48.132861+0000","last_undegraded":"2023-10-08T17:24:48.132861+0000","last_fullsized":"2023-10-08T17:24:48.132861+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:23.155209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135824+0000","last_change":"2023-10-08T17:24:48.134694+0000","last_active":"2023-10-08T17:24:48.135824+0000","last_peered":"2023-10-08T17:24:48.135824+0000","last_clean":"2023-10-08T17:24:48.135824+0000","last_became_active":"2023-10-08T17:24:48.134318+0000","last_became_peered":"2023-10-08T17:24:48.134318+0000","last_unstale":"2023-10-08T17:24:48.135824+0000","last_undegraded":"2023-10-08T17:24:48.135824+0000","last_fullsized":"2023-10-08T17:24:48.135824+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:24.106408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135882+0000","last_change":"2023-10-08T17:24:47.142586+0000","last_active":"2023-10-08T17:24:48.135882+0000","last_peered":"2023-10-08T17:24:48.135882+0000","last_clean":"2023-10-08T17:24:48.135882+0000","last_became_active":"2023-10-08T17:24:47.142312+0000","last_became_peered":"2023-10-08T17:24:47.142312+0000","last_unstale":"2023-10-08T17:24:48.135882+0000","last_undegraded":"2023-10-08T17:24:48.135882+0000","last_fullsized":"2023-10-08T17:24:48.135882+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:35.302470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.145872+0000","last_change":"2023-10-08T17:24:48.141343+0000","last_active":"2023-10-08T17:24:48.145872+0000","last_peered":"2023-10-08T17:24:48.145872+0000","last_clean":"2023-10-08T17:24:48.145872+0000","last_became_active":"2023-10-08T17:24:48.141069+0000","last_became_peered":"2023-10-08T17:24:48.141069+0000","last_unstale":"2023-10-08T17:24:48.145872+0000","last_undegraded":"2023-10-08T17:24:48.145872+0000","last_fullsized":"2023-10-08T17:24:48.145872+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:42:33.977260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.130029+0000","last_change":"2023-10-08T17:24:47.140541+0000","last_active":"2023-10-08T17:24:48.130029+0000","last_peered":"2023-10-08T17:24:48.130029+0000","last_clean":"2023-10-08T17:24:48.130029+0000","last_became_active":"2023-10-08T17:24:47.140269+0000","last_became_peered":"2023-10-08T17:24:47.140269+0000","last_unstale":"2023-10-08T17:24:48.130029+0000","last_undegraded":"2023-10-08T17:24:48.130029+0000","last_fullsized":"2023-10-08T17:24:48.130029+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:52.929342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147458+0000","last_change":"2023-10-08T17:24:48.144073+0000","last_active":"2023-10-08T17:24:48.147458+0000","last_peered":"2023-10-08T17:24:48.147458+0000","last_clean":"2023-10-08T17:24:48.147458+0000","last_became_active":"2023-10-08T17:24:48.143811+0000","last_became_peered":"2023-10-08T17:24:48.143811+0000","last_unstale":"2023-10-08T17:24:48.147458+0000","last_undegraded":"2023-10-08T17:24:48.147458+0000","last_fullsized":"2023-10-08T17:24:48.147458+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:27.653406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132701+0000","last_change":"2023-10-08T17:24:47.143334+0000","last_active":"2023-10-08T17:24:48.132701+0000","last_peered":"2023-10-08T17:24:48.132701+0000","last_clean":"2023-10-08T17:24:48.132701+0000","last_became_active":"2023-10-08T17:24:47.143043+0000","last_became_peered":"2023-10-08T17:24:47.143043+0000","last_unstale":"2023-10-08T17:24:48.132701+0000","last_undegraded":"2023-10-08T17:24:48.132701+0000","last_fullsized":"2023-10-08T17:24:48.132701+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.689518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156933+0000","last_change":"2023-10-08T17:24:48.152912+0000","last_active":"2023-10-08T17:24:48.156933+0000","last_peered":"2023-10-08T17:24:48.156933+0000","last_clean":"2023-10-08T17:24:48.156933+0000","last_became_active":"2023-10-08T17:24:48.152643+0000","last_became_peered":"2023-10-08T17:24:48.152643+0000","last_unstale":"2023-10-08T17:24:48.156933+0000","last_undegraded":"2023-10-08T17:24:48.156933+0000","last_fullsized":"2023-10-08T17:24:48.156933+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:46.792265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132553+0000","last_change":"2023-10-08T17:24:47.141191+0000","last_active":"2023-10-08T17:24:48.132553+0000","last_peered":"2023-10-08T17:24:48.132553+0000","last_clean":"2023-10-08T17:24:48.132553+0000","last_became_active":"2023-10-08T17:24:47.140707+0000","last_became_peered":"2023-10-08T17:24:47.140707+0000","last_unstale":"2023-10-08T17:24:48.132553+0000","last_undegraded":"2023-10-08T17:24:48.132553+0000","last_fullsized":"2023-10-08T17:24:48.132553+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:52.929342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.146831+0000","last_change":"2023-10-08T17:24:48.145346+0000","last_active":"2023-10-08T17:24:48.146831+0000","last_peered":"2023-10-08T17:24:48.146831+0000","last_clean":"2023-10-08T17:24:48.146831+0000","last_became_active":"2023-10-08T17:24:48.145053+0000","last_became_peered":"2023-10-08T17:24:48.145053+0000","last_unstale":"2023-10-08T17:24:48.146831+0000","last_undegraded":"2023-10-08T17:24:48.146831+0000","last_fullsized":"2023-10-08T17:24:48.146831+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:27.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158283+0000","last_change":"2023-10-08T17:24:47.141166+0000","last_active":"2023-10-08T17:24:48.158283+0000","last_peered":"2023-10-08T17:24:48.158283+0000","last_clean":"2023-10-08T17:24:48.158283+0000","last_became_active":"2023-10-08T17:24:47.140775+0000","last_became_peered":"2023-10-08T17:24:47.140775+0000","last_unstale":"2023-10-08T17:24:48.158283+0000","last_undegraded":"2023-10-08T17:24:48.158283+0000","last_fullsized":"2023-10-08T17:24:48.158283+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.730556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"157'271","reported_seq":843,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128574+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:24:48.128574+0000","last_peered":"2023-10-08T17:24:48.128574+0000","last_clean":"2023-10-08T17:24:48.128574+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:24:48.128574+0000","last_undegraded":"2023-10-08T17:24:48.128574+0000","last_fullsized":"2023-10-08T17:24:48.128574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575746,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312220,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059620,"statfs":{"total":96636764160,"available":96317050880,"internally_reserved":0,"allocated":2707456,"data_stored":1635171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91500000000000004,"5min":1.024,"15min":1.1100000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":1.0880000000000001,"15min":1.1379999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.47899999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.745}]},{"osd":4,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.628,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.432,"15min":0.36899999999999999},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.38800000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.71099999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.79100000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.48199999999999998},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.44700000000000001},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575747,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299328,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072512,"statfs":{"total":96636764160,"available":96330252288,"internally_reserved":0,"allocated":2088960,"data_stored":1037441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34399999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.175},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.40400000000000003},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.44900000000000001},"max":{"1min":1.012,"5min":1.0860000000000001,"15min":1.1399999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0109999999999999,"5min":1.073,"15min":1.113},"last":0.503},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0589999999999999,"5min":1.069,"15min":1.097},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":0.996,"15min":1.034},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.749,"15min":0.754},"min":{"1min":0.69199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.125},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.505,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.93700000000000006,"5min":1.202,"15min":1.202},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":1.1120000000000001,"15min":1.327},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.442},"max":{"1min":1.03,"5min":1.0469999999999999,"15min":1.1160000000000001},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834575746,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303424,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068416,"statfs":{"total":96636764160,"available":96326057984,"internally_reserved":0,"allocated":2088960,"data_stored":1042657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.59499999999999997,"5min":0.69699999999999995,"15min":0.89600000000000002},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.879,"15min":0.879},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.67100000000000004,"5min":0.76800000000000002,"15min":1.0660000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":1.038},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.53500000000000003,"5min":0.50700000000000001,"15min":0.47299999999999998},"max":{"1min":0.84999999999999998,"5min":0.98299999999999998,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"max":{"1min":0.93300000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82499999999999996,"15min":0.82799999999999996},"min":{"1min":0.64800000000000002,"5min":0.56299999999999994,"15min":0.51400000000000001},"max":{"1min":1.198,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.57099999999999995,"15min":0.44700000000000001},"max":{"1min":1.002,"5min":1.169,"15min":1.379},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.58999999999999997,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.71299999999999997,"5min":0.64600000000000002,"15min":0.56299999999999994},"max":{"1min":0.94299999999999995,"5min":1.242,"15min":1.242},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.85599999999999998},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.54700000000000004},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":1.002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.55200000000000005},"max":{"1min":1.0429999999999999,"5min":1.1599999999999999,"15min":1.3029999999999999},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.69999999999999996,"5min":0.60799999999999998,"15min":0.55700000000000005},"max":{"1min":0.97799999999999998,"5min":1.1950000000000001,"15min":1.4199999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.71499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308088,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063752,"statfs":{"total":96636764160,"available":96321282048,"internally_reserved":0,"allocated":2670592,"data_stored":1626273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.379},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.58599999999999997},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80900000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68799999999999994,"5min":0.82799999999999996,"15min":0.92200000000000004},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.40200000000000002,"5min":0.35799999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.79800000000000004,"15min":0.98299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86799999999999999,"15min":0.93400000000000005},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80200000000000005},"min":{"1min":0.60699999999999998,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.0349999999999999,"5min":1.1180000000000001,"15min":1.1970000000000001},"last":0.75},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82999999999999996,"15min":0.81999999999999995},"min":{"1min":0.65200000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0820000000000001,"5min":1.214,"15min":1.214},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.82299999999999995},"min":{"1min":0.64900000000000002,"5min":0.60399999999999998,"15min":0.51000000000000001},"max":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.3180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82399999999999995,"15min":0.81699999999999995},"min":{"1min":0.625,"5min":0.59099999999999997,"15min":0.53500000000000003},"max":{"1min":1.0089999999999999,"5min":1.196,"15min":1.3180000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86599999999999999,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"max":{"1min":1.1359999999999999,"5min":1.149,"15min":1.25},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86199999999999999,"15min":0.84699999999999998},"min":{"1min":0.66600000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88900000000000001,"15min":0.872},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.57799999999999996},"max":{"1min":1.1619999999999999,"5min":1.181,"15min":1.3520000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85399999999999998},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57099999999999995},"max":{"1min":1.1100000000000001,"5min":1.1499999999999999,"15min":1.3480000000000001},"last":0.97499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575747,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311612,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060228,"statfs":{"total":96636764160,"available":96317673472,"internally_reserved":0,"allocated":2084864,"data_stored":1036493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.755,"15min":0.84099999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.42699999999999999},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.92300000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.66600000000000004,"5min":0.753,"15min":0.97499999999999998},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.78000000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50900000000000001},"max":{"1min":0.85899999999999999,"5min":0.91300000000000003,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.51200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.1319999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.224},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85699999999999998,"15min":0.85799999999999998},"min":{"1min":0.65900000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.224},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.85499999999999998,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.1519999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82999999999999996,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.61499999999999999,"15min":0.51000000000000001},"max":{"1min":1.091,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.84899999999999998,"15min":0.84599999999999997},"min":{"1min":0.64700000000000002,"5min":0.63,"15min":0.61399999999999999},"max":{"1min":1.083,"5min":1.123,"15min":1.242},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86899999999999999,"15min":0.874},"min":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.58899999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.88500000000000001},"min":{"1min":0.68999999999999995,"5min":0.61199999999999999,"15min":0.59799999999999998},"max":{"1min":1.204,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.84699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311612,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060228,"statfs":{"total":96636764160,"available":96317673472,"internally_reserved":0,"allocated":2084864,"data_stored":1036065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71599999999999997,"5min":0.86599999999999999,"15min":0.88400000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70799999999999996,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.96899999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.204},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":1.679,"15min":1.679},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.54600000000000004},"max":{"1min":1.143,"5min":1.893,"15min":1.893},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.498},"max":{"1min":1.0640000000000001,"5min":1.2290000000000001,"15min":1.347},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.218,"5min":1.258,"15min":1.258},"last":0.749},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.59199999999999997,"15min":0.52600000000000002},"max":{"1min":1.1619999999999999,"5min":1.859,"15min":1.859},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575747,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":1042727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0269999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.44},"max":{"1min":0.97799999999999998,"5min":1.079,"15min":1.1639999999999999},"last":0.91700000000000004}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80000000000000004,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.46700000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.83199999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":0.93400000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.0469999999999999,"15min":1.0880000000000001},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98299999999999998,"5min":1.246,"15min":1.246},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":1.115,"15min":1.115},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1000000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.0609999999999999},"last":1.0029999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.99299999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":1.1459999999999999,"15min":1.2909999999999999},"last":0.873}]},{"osd":7,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":1.177,"15min":1.177},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.44},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2490000000000001},"last":0.93400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575746,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303420,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068420,"statfs":{"total":96636764160,"available":96326062080,"internally_reserved":0,"allocated":2084864,"data_stored":1036017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":0.98099999999999998,"15min":0.997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.39700000000000002},"max":{"1min":0.89300000000000002,"5min":1.0089999999999999,"15min":1.0289999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46400000000000002},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.054},"last":0.746},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98099999999999998,"5min":1.073,"15min":1.1020000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79000000000000004,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.45800000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":0.95699999999999996,"15min":1.0089999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.97099999999999997}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82899999999999996,"5min":0.97499999999999998,"15min":1.0680000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.99399999999999999,"15min":1.056},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.02,"5min":1.0269999999999999,"15min":1.107},"last":1.03},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70399999999999996},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96799999999999997,"15min":1.0620000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.1100000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.107},"last":1.079}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:24:52.523 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:24:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.744+0000 7f9c5359d700 1 Processor -- start 2023-10-08T17:24:52.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.744+0000 7f9c5359d700 1 -- start start 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.745+0000 7f9c5359d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c4c142c00 0x7f9c4c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.745+0000 7f9c5359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c06bd20 0x7f9c4c0c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.745+0000 7f9c5359d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c4c0ca480 con 0x7f9c4c142fd0 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.745+0000 7f9c5359d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4c15e240 con 0x7f9c4c142c00 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.745+0000 7f9c5359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c06b350 con 0x7f9c4c06bd20 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c4c142c00 0x7f9c4c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9c4c142c00 0x7f9c4c06b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55638/0 (socket says 172.21.15.12:55638) 2023-10-08T17:24:52.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 -- 172.21.15.12:0/3904548677 learned_addr learned my addr 172.21.15.12:0/3904548677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c51d9a700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c06bd20 0x7f9c4c0c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 -- 172.21.15.12:0/3904548677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c06bd20 msgr2=0x7f9c4c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c06bd20 0x7f9c4c0c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 -- 172.21.15.12:0/3904548677 >> v1:172.21.15.29:6789/0 conn(0x7f9c4c142fd0 legacy=0x7f9c4c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.746+0000 7f9c5259b700 1 -- 172.21.15.12:0/3904548677 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c15df60 con 0x7f9c4c142c00 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5259b700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142c00 0x7f9c4c06b7e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9c480099b0 tx=0x7f9c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=924a844beb3f8392 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c51599700 1 -- 172.21.15.12:0/3904548677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800b860 con 0x7f9c4c142c00 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c51599700 1 -- 172.21.15.12:0/3904548677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4800b9c0 con 0x7f9c4c142c00 2023-10-08T17:24:52.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c51599700 1 -- 172.21.15.12:0/3904548677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800bd80 con 0x7f9c4c142c00 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 -- 172.21.15.12:0/3904548677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142c00 msgr2=0x7f9c4c06b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142c00 0x7f9c4c06b7e0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9c480099b0 tx=0x7f9c48009250 comp rx=0 tx=0).stop 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 -- 172.21.15.12:0/3904548677 shutdown_connections 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142c00 0x7f9c4c06b7e0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 --2- 172.21.15.12:0/3904548677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c06bd20 0x7f9c4c0c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.747+0000 7f9c5359d700 1 -- 172.21.15.12:0/3904548677 >> 172.21.15.12:0/3904548677 conn(0x7f9c4c0675a0 msgr2=0x7f9c4c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.748+0000 7f9c5359d700 1 -- 172.21.15.12:0/3904548677 shutdown_connections 2023-10-08T17:24:52.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.748+0000 7f9c5359d700 1 -- 172.21.15.12:0/3904548677 wait complete. 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.749+0000 7f9c5359d700 1 Processor -- start 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.749+0000 7f9c5359d700 1 -- start start 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4c06bd20 0x7f9c4c159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c142c00 0x7f9c4c15b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c13daf0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c13b320 con 0x7f9c4c06bd20 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4c13a9f0 con 0x7f9c4c142c00 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c52d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c52d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55642/0 (socket says 172.21.15.12:55642) 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c52d9c700 1 -- 172.21.15.12:0/2699944375 learned_addr learned my addr 172.21.15.12:0/2699944375 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c5259b700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4c06bd20 0x7f9c4c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.750+0000 7f9c51d9a700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c142c00 0x7f9c4c15b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 -- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c142c00 msgr2=0x7f9c4c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c142c00 0x7f9c4c15b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 -- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4c06bd20 msgr2=0x7f9c4c159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4c06bd20 0x7f9c4c159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 -- 172.21.15.12:0/2699944375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c480094f0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c52d9c700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c840 tx=0x7f9c44001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44012630 con 0x7f9c4c142fd0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c440127b0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c4c13acd0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.751+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44012b70 con 0x7f9c4c142fd0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.752+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4c0c2e40 con 0x7f9c4c142fd0 2023-10-08T17:24:52.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.753+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4c13b4d0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.753+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c4401a3a0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.754+0000 7f9c427fc700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 0x7f9c300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.754+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f9c440848d0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.755+0000 7f9c5259b700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 0x7f9c300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:52.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.755+0000 7f9c5259b700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 0x7f9c300693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c480099b0 tx=0x7f9c48017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:52.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.758+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c440518d0 con 0x7f9c4c142fd0 2023-10-08T17:24:52.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.955+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c4c04c3c0 con 0x7f9c30066f30 2023-10-08T17:24:52.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.963+0000 7f9c427fc700 1 -- 172.21.15.12:0/2699944375 <== mgr.8544 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289410 (secure 0 0 0) 0x7f9c4c04c3c0 con 0x7f9c30066f30 2023-10-08T17:24:52.970 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 msgr2=0x7f9c300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 0x7f9c300693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9c480099b0 tx=0x7f9c48017000 comp rx=0 tx=0).stop 2023-10-08T17:24:52.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 msgr2=0x7f9c4c13d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400c840 tx=0x7f9c44001670 comp rx=0 tx=0).stop 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 shutdown_connections 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f9c30066f30 0x7f9c300693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c4c142fd0 0x7f9c4c13d030 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c4c06bd20 0x7f9c4c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 --2- 172.21.15.12:0/2699944375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c4c142c00 0x7f9c4c15b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:52.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.967+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 >> 172.21.15.12:0/2699944375 conn(0x7f9c4c0675a0 msgr2=0x7f9c4c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:52.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.968+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 shutdown_connections 2023-10-08T17:24:52.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:52.968+0000 7f9c5359d700 1 -- 172.21.15.12:0/2699944375 wait complete. 2023-10-08T17:24:52.974 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:24:52.985 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-08T17:24:52.638878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":483,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":309,"ondisk_log_size":309,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453132,"kb_used_data":17484,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752521588,"statfs":{"total":773094113280,"available":770582106112,"internally_reserved":0,"allocated":17903616,"data_stored":9492844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001086"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159702+0000","last_change":"2023-10-08T17:24:48.156998+0000","last_active":"2023-10-08T17:24:48.159702+0000","last_peered":"2023-10-08T17:24:48.159702+0000","last_clean":"2023-10-08T17:24:48.159702+0000","last_became_active":"2023-10-08T17:24:48.156772+0000","last_became_peered":"2023-10-08T17:24:48.156772+0000","last_unstale":"2023-10-08T17:24:48.159702+0000","last_undegraded":"2023-10-08T17:24:48.159702+0000","last_fullsized":"2023-10-08T17:24:48.159702+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:14.029462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160186+0000","last_change":"2023-10-08T17:24:48.154877+0000","last_active":"2023-10-08T17:24:48.160186+0000","last_peered":"2023-10-08T17:24:48.160186+0000","last_clean":"2023-10-08T17:24:48.160186+0000","last_became_active":"2023-10-08T17:24:48.154606+0000","last_became_peered":"2023-10-08T17:24:48.154606+0000","last_unstale":"2023-10-08T17:24:48.160186+0000","last_undegraded":"2023-10-08T17:24:48.160186+0000","last_fullsized":"2023-10-08T17:24:48.160186+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:47.184932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154882+0000","last_change":"2023-10-08T17:24:48.147911+0000","last_active":"2023-10-08T17:24:48.154882+0000","last_peered":"2023-10-08T17:24:48.154882+0000","last_clean":"2023-10-08T17:24:48.154882+0000","last_became_active":"2023-10-08T17:24:48.147145+0000","last_became_peered":"2023-10-08T17:24:48.147145+0000","last_unstale":"2023-10-08T17:24:48.154882+0000","last_undegraded":"2023-10-08T17:24:48.154882+0000","last_fullsized":"2023-10-08T17:24:48.154882+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:41.118460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157607+0000","last_change":"2023-10-08T17:24:48.155657+0000","last_active":"2023-10-08T17:24:48.157607+0000","last_peered":"2023-10-08T17:24:48.157607+0000","last_clean":"2023-10-08T17:24:48.157607+0000","last_became_active":"2023-10-08T17:24:48.155417+0000","last_became_peered":"2023-10-08T17:24:48.155417+0000","last_unstale":"2023-10-08T17:24:48.157607+0000","last_undegraded":"2023-10-08T17:24:48.157607+0000","last_fullsized":"2023-10-08T17:24:48.157607+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:46:16.889799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147472+0000","last_change":"2023-10-08T17:24:48.136550+0000","last_active":"2023-10-08T17:24:48.147472+0000","last_peered":"2023-10-08T17:24:48.147472+0000","last_clean":"2023-10-08T17:24:48.147472+0000","last_became_active":"2023-10-08T17:24:48.136170+0000","last_became_peered":"2023-10-08T17:24:48.136170+0000","last_unstale":"2023-10-08T17:24:48.147472+0000","last_undegraded":"2023-10-08T17:24:48.147472+0000","last_fullsized":"2023-10-08T17:24:48.147472+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:55:58.560295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151372+0000","last_change":"2023-10-08T17:24:48.145240+0000","last_active":"2023-10-08T17:24:48.151372+0000","last_peered":"2023-10-08T17:24:48.151372+0000","last_clean":"2023-10-08T17:24:48.151372+0000","last_became_active":"2023-10-08T17:24:48.144734+0000","last_became_peered":"2023-10-08T17:24:48.144734+0000","last_unstale":"2023-10-08T17:24:48.151372+0000","last_undegraded":"2023-10-08T17:24:48.151372+0000","last_fullsized":"2023-10-08T17:24:48.151372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:08:08.629536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150130+0000","last_change":"2023-10-08T17:24:48.142902+0000","last_active":"2023-10-08T17:24:48.150130+0000","last_peered":"2023-10-08T17:24:48.150130+0000","last_clean":"2023-10-08T17:24:48.150130+0000","last_became_active":"2023-10-08T17:24:48.142615+0000","last_became_peered":"2023-10-08T17:24:48.142615+0000","last_unstale":"2023-10-08T17:24:48.150130+0000","last_undegraded":"2023-10-08T17:24:48.150130+0000","last_fullsized":"2023-10-08T17:24:48.150130+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:04.257020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156938+0000","last_change":"2023-10-08T17:24:48.152085+0000","last_active":"2023-10-08T17:24:48.156938+0000","last_peered":"2023-10-08T17:24:48.156938+0000","last_clean":"2023-10-08T17:24:48.156938+0000","last_became_active":"2023-10-08T17:24:48.149546+0000","last_became_peered":"2023-10-08T17:24:48.149546+0000","last_unstale":"2023-10-08T17:24:48.156938+0000","last_undegraded":"2023-10-08T17:24:48.156938+0000","last_fullsized":"2023-10-08T17:24:48.156938+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:16.768902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157413+0000","last_change":"2023-10-08T17:24:48.154070+0000","last_active":"2023-10-08T17:24:48.157413+0000","last_peered":"2023-10-08T17:24:48.157413+0000","last_clean":"2023-10-08T17:24:48.157413+0000","last_became_active":"2023-10-08T17:24:48.153792+0000","last_became_peered":"2023-10-08T17:24:48.153792+0000","last_unstale":"2023-10-08T17:24:48.157413+0000","last_undegraded":"2023-10-08T17:24:48.157413+0000","last_fullsized":"2023-10-08T17:24:48.157413+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:17.308156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160165+0000","last_change":"2023-10-08T17:24:48.154324+0000","last_active":"2023-10-08T17:24:48.160165+0000","last_peered":"2023-10-08T17:24:48.160165+0000","last_clean":"2023-10-08T17:24:48.160165+0000","last_became_active":"2023-10-08T17:24:48.154042+0000","last_became_peered":"2023-10-08T17:24:48.154042+0000","last_unstale":"2023-10-08T17:24:48.160165+0000","last_undegraded":"2023-10-08T17:24:48.160165+0000","last_fullsized":"2023-10-08T17:24:48.160165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:05.267750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151756+0000","last_change":"2023-10-08T17:24:48.151015+0000","last_active":"2023-10-08T17:24:48.151756+0000","last_peered":"2023-10-08T17:24:48.151756+0000","last_clean":"2023-10-08T17:24:48.151756+0000","last_became_active":"2023-10-08T17:24:48.150750+0000","last_became_peered":"2023-10-08T17:24:48.150750+0000","last_unstale":"2023-10-08T17:24:48.151756+0000","last_undegraded":"2023-10-08T17:24:48.151756+0000","last_fullsized":"2023-10-08T17:24:48.151756+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:13.545640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.155120+0000","last_change":"2023-10-08T17:24:48.147511+0000","last_active":"2023-10-08T17:24:48.155120+0000","last_peered":"2023-10-08T17:24:48.155120+0000","last_clean":"2023-10-08T17:24:48.155120+0000","last_became_active":"2023-10-08T17:24:48.147202+0000","last_became_peered":"2023-10-08T17:24:48.147202+0000","last_unstale":"2023-10-08T17:24:48.155120+0000","last_undegraded":"2023-10-08T17:24:48.155120+0000","last_fullsized":"2023-10-08T17:24:48.155120+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:56.176739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157602+0000","last_change":"2023-10-08T17:24:48.156444+0000","last_active":"2023-10-08T17:24:48.157602+0000","last_peered":"2023-10-08T17:24:48.157602+0000","last_clean":"2023-10-08T17:24:48.157602+0000","last_became_active":"2023-10-08T17:24:48.156048+0000","last_became_peered":"2023-10-08T17:24:48.156048+0000","last_unstale":"2023-10-08T17:24:48.157602+0000","last_undegraded":"2023-10-08T17:24:48.157602+0000","last_fullsized":"2023-10-08T17:24:48.157602+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:07.822647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161281+0000","last_change":"2023-10-08T17:24:48.159730+0000","last_active":"2023-10-08T17:24:48.161281+0000","last_peered":"2023-10-08T17:24:48.161281+0000","last_clean":"2023-10-08T17:24:48.161281+0000","last_became_active":"2023-10-08T17:24:48.159425+0000","last_became_peered":"2023-10-08T17:24:48.159425+0000","last_unstale":"2023-10-08T17:24:48.161281+0000","last_undegraded":"2023-10-08T17:24:48.161281+0000","last_fullsized":"2023-10-08T17:24:48.161281+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:35:14.591061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160154+0000","last_change":"2023-10-08T17:24:48.158371+0000","last_active":"2023-10-08T17:24:48.160154+0000","last_peered":"2023-10-08T17:24:48.160154+0000","last_clean":"2023-10-08T17:24:48.160154+0000","last_became_active":"2023-10-08T17:24:48.157735+0000","last_became_peered":"2023-10-08T17:24:48.157735+0000","last_unstale":"2023-10-08T17:24:48.160154+0000","last_undegraded":"2023-10-08T17:24:48.160154+0000","last_fullsized":"2023-10-08T17:24:48.160154+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:55.535063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159602+0000","last_change":"2023-10-08T17:24:48.148485+0000","last_active":"2023-10-08T17:24:48.159602+0000","last_peered":"2023-10-08T17:24:48.159602+0000","last_clean":"2023-10-08T17:24:48.159602+0000","last_became_active":"2023-10-08T17:24:48.148240+0000","last_became_peered":"2023-10-08T17:24:48.148240+0000","last_unstale":"2023-10-08T17:24:48.159602+0000","last_undegraded":"2023-10-08T17:24:48.159602+0000","last_fullsized":"2023-10-08T17:24:48.159602+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:56.252965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143304+0000","last_change":"2023-10-08T17:24:48.135910+0000","last_active":"2023-10-08T17:24:48.143304+0000","last_peered":"2023-10-08T17:24:48.143304+0000","last_clean":"2023-10-08T17:24:48.143304+0000","last_became_active":"2023-10-08T17:24:48.135559+0000","last_became_peered":"2023-10-08T17:24:48.135559+0000","last_unstale":"2023-10-08T17:24:48.143304+0000","last_undegraded":"2023-10-08T17:24:48.143304+0000","last_fullsized":"2023-10-08T17:24:48.143304+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:08.391296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147898+0000","last_change":"2023-10-08T17:24:48.145141+0000","last_active":"2023-10-08T17:24:48.147898+0000","last_peered":"2023-10-08T17:24:48.147898+0000","last_clean":"2023-10-08T17:24:48.147898+0000","last_became_active":"2023-10-08T17:24:48.144887+0000","last_became_peered":"2023-10-08T17:24:48.144887+0000","last_unstale":"2023-10-08T17:24:48.147898+0000","last_undegraded":"2023-10-08T17:24:48.147898+0000","last_fullsized":"2023-10-08T17:24:48.147898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:27.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143106+0000","last_change":"2023-10-08T17:24:48.137036+0000","last_active":"2023-10-08T17:24:48.143106+0000","last_peered":"2023-10-08T17:24:48.143106+0000","last_clean":"2023-10-08T17:24:48.143106+0000","last_became_active":"2023-10-08T17:24:48.136259+0000","last_became_peered":"2023-10-08T17:24:48.136259+0000","last_unstale":"2023-10-08T17:24:48.143106+0000","last_undegraded":"2023-10-08T17:24:48.143106+0000","last_fullsized":"2023-10-08T17:24:48.143106+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:17.698655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.163539+0000","last_change":"2023-10-08T17:24:48.152691+0000","last_active":"2023-10-08T17:24:48.163539+0000","last_peered":"2023-10-08T17:24:48.163539+0000","last_clean":"2023-10-08T17:24:48.163539+0000","last_became_active":"2023-10-08T17:24:48.152431+0000","last_became_peered":"2023-10-08T17:24:48.152431+0000","last_unstale":"2023-10-08T17:24:48.163539+0000","last_undegraded":"2023-10-08T17:24:48.163539+0000","last_fullsized":"2023-10-08T17:24:48.163539+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:13.392924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147451+0000","last_change":"2023-10-08T17:24:48.136462+0000","last_active":"2023-10-08T17:24:48.147451+0000","last_peered":"2023-10-08T17:24:48.147451+0000","last_clean":"2023-10-08T17:24:48.147451+0000","last_became_active":"2023-10-08T17:24:48.136146+0000","last_became_peered":"2023-10-08T17:24:48.136146+0000","last_unstale":"2023-10-08T17:24:48.147451+0000","last_undegraded":"2023-10-08T17:24:48.147451+0000","last_fullsized":"2023-10-08T17:24:48.147451+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:17.698655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157361+0000","last_change":"2023-10-08T17:24:48.155007+0000","last_active":"2023-10-08T17:24:48.157361+0000","last_peered":"2023-10-08T17:24:48.157361+0000","last_clean":"2023-10-08T17:24:48.157361+0000","last_became_active":"2023-10-08T17:24:48.154677+0000","last_became_peered":"2023-10-08T17:24:48.154677+0000","last_unstale":"2023-10-08T17:24:48.157361+0000","last_undegraded":"2023-10-08T17:24:48.157361+0000","last_fullsized":"2023-10-08T17:24:48.157361+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:24.106408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157277+0000","last_change":"2023-10-08T17:24:48.153523+0000","last_active":"2023-10-08T17:24:48.157277+0000","last_peered":"2023-10-08T17:24:48.157277+0000","last_clean":"2023-10-08T17:24:48.157277+0000","last_became_active":"2023-10-08T17:24:48.153264+0000","last_became_peered":"2023-10-08T17:24:48.153264+0000","last_unstale":"2023-10-08T17:24:48.157277+0000","last_undegraded":"2023-10-08T17:24:48.157277+0000","last_fullsized":"2023-10-08T17:24:48.157277+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:29:03.933122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.145839+0000","last_change":"2023-10-08T17:24:48.143669+0000","last_active":"2023-10-08T17:24:48.145839+0000","last_peered":"2023-10-08T17:24:48.145839+0000","last_clean":"2023-10-08T17:24:48.145839+0000","last_became_active":"2023-10-08T17:24:48.143414+0000","last_became_peered":"2023-10-08T17:24:48.143414+0000","last_unstale":"2023-10-08T17:24:48.145839+0000","last_undegraded":"2023-10-08T17:24:48.145839+0000","last_fullsized":"2023-10-08T17:24:48.145839+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:57.143272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159147+0000","last_change":"2023-10-08T17:24:48.154004+0000","last_active":"2023-10-08T17:24:48.159147+0000","last_peered":"2023-10-08T17:24:48.159147+0000","last_clean":"2023-10-08T17:24:48.159147+0000","last_became_active":"2023-10-08T17:24:48.153712+0000","last_became_peered":"2023-10-08T17:24:48.153712+0000","last_unstale":"2023-10-08T17:24:48.159147+0000","last_undegraded":"2023-10-08T17:24:48.159147+0000","last_fullsized":"2023-10-08T17:24:48.159147+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:52.837390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159637+0000","last_change":"2023-10-08T17:24:48.147973+0000","last_active":"2023-10-08T17:24:48.159637+0000","last_peered":"2023-10-08T17:24:48.159637+0000","last_clean":"2023-10-08T17:24:48.159637+0000","last_became_active":"2023-10-08T17:24:48.147684+0000","last_became_peered":"2023-10-08T17:24:48.147684+0000","last_unstale":"2023-10-08T17:24:48.159637+0000","last_undegraded":"2023-10-08T17:24:48.159637+0000","last_fullsized":"2023-10-08T17:24:48.159637+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:09.319599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160965+0000","last_change":"2023-10-08T17:24:48.157609+0000","last_active":"2023-10-08T17:24:48.160965+0000","last_peered":"2023-10-08T17:24:48.160965+0000","last_clean":"2023-10-08T17:24:48.160965+0000","last_became_active":"2023-10-08T17:24:48.157337+0000","last_became_peered":"2023-10-08T17:24:48.157337+0000","last_unstale":"2023-10-08T17:24:48.160965+0000","last_undegraded":"2023-10-08T17:24:48.160965+0000","last_fullsized":"2023-10-08T17:24:48.160965+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:00.754012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152032+0000","last_change":"2023-10-08T17:24:48.149460+0000","last_active":"2023-10-08T17:24:48.152032+0000","last_peered":"2023-10-08T17:24:48.152032+0000","last_clean":"2023-10-08T17:24:48.152032+0000","last_became_active":"2023-10-08T17:24:48.149161+0000","last_became_peered":"2023-10-08T17:24:48.149161+0000","last_unstale":"2023-10-08T17:24:48.152032+0000","last_undegraded":"2023-10-08T17:24:48.152032+0000","last_fullsized":"2023-10-08T17:24:48.152032+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:29.800765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161622+0000","last_change":"2023-10-08T17:24:48.158717+0000","last_active":"2023-10-08T17:24:48.161622+0000","last_peered":"2023-10-08T17:24:48.161622+0000","last_clean":"2023-10-08T17:24:48.161622+0000","last_became_active":"2023-10-08T17:24:48.158041+0000","last_became_peered":"2023-10-08T17:24:48.158041+0000","last_unstale":"2023-10-08T17:24:48.161622+0000","last_undegraded":"2023-10-08T17:24:48.161622+0000","last_fullsized":"2023-10-08T17:24:48.161622+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:47.355280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148989+0000","last_change":"2023-10-08T17:24:48.142752+0000","last_active":"2023-10-08T17:24:48.148989+0000","last_peered":"2023-10-08T17:24:48.148989+0000","last_clean":"2023-10-08T17:24:48.148989+0000","last_became_active":"2023-10-08T17:24:48.142481+0000","last_became_peered":"2023-10-08T17:24:48.142481+0000","last_unstale":"2023-10-08T17:24:48.148989+0000","last_undegraded":"2023-10-08T17:24:48.148989+0000","last_fullsized":"2023-10-08T17:24:48.148989+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:17:55.119533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148634+0000","last_change":"2023-10-08T17:24:48.147103+0000","last_active":"2023-10-08T17:24:48.148634+0000","last_peered":"2023-10-08T17:24:48.148634+0000","last_clean":"2023-10-08T17:24:48.148634+0000","last_became_active":"2023-10-08T17:24:48.146800+0000","last_became_peered":"2023-10-08T17:24:48.146800+0000","last_unstale":"2023-10-08T17:24:48.148634+0000","last_undegraded":"2023-10-08T17:24:48.148634+0000","last_fullsized":"2023-10-08T17:24:48.148634+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:31:47.115478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154109+0000","last_change":"2023-10-08T17:24:48.150567+0000","last_active":"2023-10-08T17:24:48.154109+0000","last_peered":"2023-10-08T17:24:48.154109+0000","last_clean":"2023-10-08T17:24:48.154109+0000","last_became_active":"2023-10-08T17:24:48.150301+0000","last_became_peered":"2023-10-08T17:24:48.150301+0000","last_unstale":"2023-10-08T17:24:48.154109+0000","last_undegraded":"2023-10-08T17:24:48.154109+0000","last_fullsized":"2023-10-08T17:24:48.154109+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:03.111831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159685+0000","last_change":"2023-10-08T17:24:48.149550+0000","last_active":"2023-10-08T17:24:48.159685+0000","last_peered":"2023-10-08T17:24:48.159685+0000","last_clean":"2023-10-08T17:24:48.159685+0000","last_became_active":"2023-10-08T17:24:48.148886+0000","last_became_peered":"2023-10-08T17:24:48.148886+0000","last_unstale":"2023-10-08T17:24:48.159685+0000","last_undegraded":"2023-10-08T17:24:48.159685+0000","last_fullsized":"2023-10-08T17:24:48.159685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:48.927642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"167'4","reported_seq":14,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158386+0000","last_change":"2023-10-08T17:24:47.144373+0000","last_active":"2023-10-08T17:24:48.158386+0000","last_peered":"2023-10-08T17:24:48.158386+0000","last_clean":"2023-10-08T17:24:48.158386+0000","last_became_active":"2023-10-08T17:24:47.143931+0000","last_became_peered":"2023-10-08T17:24:47.143931+0000","last_unstale":"2023-10-08T17:24:48.158386+0000","last_undegraded":"2023-10-08T17:24:48.158386+0000","last_fullsized":"2023-10-08T17:24:48.158386+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:11.667346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.154196+0000","last_change":"2023-10-08T17:24:48.141775+0000","last_active":"2023-10-08T17:24:48.154196+0000","last_peered":"2023-10-08T17:24:48.154196+0000","last_clean":"2023-10-08T17:24:48.154196+0000","last_became_active":"2023-10-08T17:24:48.141497+0000","last_became_peered":"2023-10-08T17:24:48.141497+0000","last_unstale":"2023-10-08T17:24:48.154196+0000","last_undegraded":"2023-10-08T17:24:48.154196+0000","last_fullsized":"2023-10-08T17:24:48.154196+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:03.519408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157360+0000","last_change":"2023-10-08T17:24:47.137823+0000","last_active":"2023-10-08T17:24:48.157360+0000","last_peered":"2023-10-08T17:24:48.157360+0000","last_clean":"2023-10-08T17:24:48.157360+0000","last_became_active":"2023-10-08T17:24:47.137503+0000","last_became_peered":"2023-10-08T17:24:47.137503+0000","last_unstale":"2023-10-08T17:24:48.157360+0000","last_undegraded":"2023-10-08T17:24:48.157360+0000","last_fullsized":"2023-10-08T17:24:48.157360+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:04:46.177216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135726+0000","last_change":"2023-10-08T17:24:48.134553+0000","last_active":"2023-10-08T17:24:48.135726+0000","last_peered":"2023-10-08T17:24:48.135726+0000","last_clean":"2023-10-08T17:24:48.135726+0000","last_became_active":"2023-10-08T17:24:48.134236+0000","last_became_peered":"2023-10-08T17:24:48.134236+0000","last_unstale":"2023-10-08T17:24:48.135726+0000","last_undegraded":"2023-10-08T17:24:48.135726+0000","last_fullsized":"2023-10-08T17:24:48.135726+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:33:13.545640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.162665+0000","last_change":"2023-10-08T17:24:47.148143+0000","last_active":"2023-10-08T17:24:48.162665+0000","last_peered":"2023-10-08T17:24:48.162665+0000","last_clean":"2023-10-08T17:24:48.162665+0000","last_became_active":"2023-10-08T17:24:47.147803+0000","last_became_peered":"2023-10-08T17:24:47.147803+0000","last_unstale":"2023-10-08T17:24:48.162665+0000","last_undegraded":"2023-10-08T17:24:48.162665+0000","last_fullsized":"2023-10-08T17:24:48.162665+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:28:08.352506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157647+0000","last_change":"2023-10-08T17:24:48.151705+0000","last_active":"2023-10-08T17:24:48.157647+0000","last_peered":"2023-10-08T17:24:48.157647+0000","last_clean":"2023-10-08T17:24:48.157647+0000","last_became_active":"2023-10-08T17:24:48.151416+0000","last_became_peered":"2023-10-08T17:24:48.151416+0000","last_unstale":"2023-10-08T17:24:48.157647+0000","last_undegraded":"2023-10-08T17:24:48.157647+0000","last_fullsized":"2023-10-08T17:24:48.157647+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:45:54.297504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.165621+0000","last_change":"2023-10-08T17:24:47.143178+0000","last_active":"2023-10-08T17:24:48.165621+0000","last_peered":"2023-10-08T17:24:48.165621+0000","last_clean":"2023-10-08T17:24:48.165621+0000","last_became_active":"2023-10-08T17:24:47.142918+0000","last_became_peered":"2023-10-08T17:24:47.142918+0000","last_unstale":"2023-10-08T17:24:48.165621+0000","last_undegraded":"2023-10-08T17:24:48.165621+0000","last_fullsized":"2023-10-08T17:24:48.165621+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:21:26.776697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159755+0000","last_change":"2023-10-08T17:24:48.150557+0000","last_active":"2023-10-08T17:24:48.159755+0000","last_peered":"2023-10-08T17:24:48.159755+0000","last_clean":"2023-10-08T17:24:48.159755+0000","last_became_active":"2023-10-08T17:24:48.149617+0000","last_became_peered":"2023-10-08T17:24:48.149617+0000","last_unstale":"2023-10-08T17:24:48.159755+0000","last_undegraded":"2023-10-08T17:24:48.159755+0000","last_fullsized":"2023-10-08T17:24:48.159755+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:22:43.051551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.165623+0000","last_change":"2023-10-08T17:24:47.146822+0000","last_active":"2023-10-08T17:24:48.165623+0000","last_peered":"2023-10-08T17:24:48.165623+0000","last_clean":"2023-10-08T17:24:48.165623+0000","last_became_active":"2023-10-08T17:24:47.146565+0000","last_became_peered":"2023-10-08T17:24:47.146565+0000","last_unstale":"2023-10-08T17:24:48.165623+0000","last_undegraded":"2023-10-08T17:24:48.165623+0000","last_fullsized":"2023-10-08T17:24:48.165623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:19:08.902431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.143406+0000","last_change":"2023-10-08T17:24:48.136454+0000","last_active":"2023-10-08T17:24:48.143406+0000","last_peered":"2023-10-08T17:24:48.143406+0000","last_clean":"2023-10-08T17:24:48.143406+0000","last_became_active":"2023-10-08T17:24:48.136147+0000","last_became_peered":"2023-10-08T17:24:48.136147+0000","last_unstale":"2023-10-08T17:24:48.143406+0000","last_undegraded":"2023-10-08T17:24:48.143406+0000","last_fullsized":"2023-10-08T17:24:48.143406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:47:56.254527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.166431+0000","last_change":"2023-10-08T17:24:47.147325+0000","last_active":"2023-10-08T17:24:48.166431+0000","last_peered":"2023-10-08T17:24:48.166431+0000","last_clean":"2023-10-08T17:24:48.166431+0000","last_became_active":"2023-10-08T17:24:47.147019+0000","last_became_peered":"2023-10-08T17:24:47.147019+0000","last_unstale":"2023-10-08T17:24:48.166431+0000","last_undegraded":"2023-10-08T17:24:48.166431+0000","last_fullsized":"2023-10-08T17:24:48.166431+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:07:22.416891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156960+0000","last_change":"2023-10-08T17:24:48.152185+0000","last_active":"2023-10-08T17:24:48.156960+0000","last_peered":"2023-10-08T17:24:48.156960+0000","last_clean":"2023-10-08T17:24:48.156960+0000","last_became_active":"2023-10-08T17:24:48.149894+0000","last_became_peered":"2023-10-08T17:24:48.149894+0000","last_unstale":"2023-10-08T17:24:48.156960+0000","last_undegraded":"2023-10-08T17:24:48.156960+0000","last_fullsized":"2023-10-08T17:24:48.156960+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:19.876316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128773+0000","last_change":"2023-10-08T17:24:47.139638+0000","last_active":"2023-10-08T17:24:48.128773+0000","last_peered":"2023-10-08T17:24:48.128773+0000","last_clean":"2023-10-08T17:24:48.128773+0000","last_became_active":"2023-10-08T17:24:47.139006+0000","last_became_peered":"2023-10-08T17:24:47.139006+0000","last_unstale":"2023-10-08T17:24:48.128773+0000","last_undegraded":"2023-10-08T17:24:48.128773+0000","last_fullsized":"2023-10-08T17:24:48.128773+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:19.827987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156954+0000","last_change":"2023-10-08T17:24:48.153394+0000","last_active":"2023-10-08T17:24:48.156954+0000","last_peered":"2023-10-08T17:24:48.156954+0000","last_clean":"2023-10-08T17:24:48.156954+0000","last_became_active":"2023-10-08T17:24:48.153069+0000","last_became_peered":"2023-10-08T17:24:48.153069+0000","last_unstale":"2023-10-08T17:24:48.156954+0000","last_undegraded":"2023-10-08T17:24:48.156954+0000","last_fullsized":"2023-10-08T17:24:48.156954+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:00:14.624610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.141171+0000","last_change":"2023-10-08T17:24:47.145131+0000","last_active":"2023-10-08T17:24:48.141171+0000","last_peered":"2023-10-08T17:24:48.141171+0000","last_clean":"2023-10-08T17:24:48.141171+0000","last_became_active":"2023-10-08T17:24:47.144876+0000","last_became_peered":"2023-10-08T17:24:47.144876+0000","last_unstale":"2023-10-08T17:24:48.141171+0000","last_undegraded":"2023-10-08T17:24:48.141171+0000","last_fullsized":"2023-10-08T17:24:48.141171+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:15:48.039365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150523+0000","last_change":"2023-10-08T17:24:48.147762+0000","last_active":"2023-10-08T17:24:48.150523+0000","last_peered":"2023-10-08T17:24:48.150523+0000","last_clean":"2023-10-08T17:24:48.150523+0000","last_became_active":"2023-10-08T17:24:48.147465+0000","last_became_peered":"2023-10-08T17:24:48.147465+0000","last_unstale":"2023-10-08T17:24:48.150523+0000","last_undegraded":"2023-10-08T17:24:48.150523+0000","last_fullsized":"2023-10-08T17:24:48.150523+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:50:07.890539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133319+0000","last_change":"2023-10-08T17:24:47.142870+0000","last_active":"2023-10-08T17:24:48.133319+0000","last_peered":"2023-10-08T17:24:48.133319+0000","last_clean":"2023-10-08T17:24:48.133319+0000","last_became_active":"2023-10-08T17:24:47.142591+0000","last_became_peered":"2023-10-08T17:24:47.142591+0000","last_unstale":"2023-10-08T17:24:48.133319+0000","last_undegraded":"2023-10-08T17:24:48.133319+0000","last_fullsized":"2023-10-08T17:24:48.133319+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:48.969660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152869+0000","last_change":"2023-10-08T17:24:48.150916+0000","last_active":"2023-10-08T17:24:48.152869+0000","last_peered":"2023-10-08T17:24:48.152869+0000","last_clean":"2023-10-08T17:24:48.152869+0000","last_became_active":"2023-10-08T17:24:48.150618+0000","last_became_peered":"2023-10-08T17:24:48.150618+0000","last_unstale":"2023-10-08T17:24:48.152869+0000","last_undegraded":"2023-10-08T17:24:48.152869+0000","last_fullsized":"2023-10-08T17:24:48.152869+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:35.450962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.134275+0000","last_change":"2023-10-08T17:24:47.147241+0000","last_active":"2023-10-08T17:24:48.134275+0000","last_peered":"2023-10-08T17:24:48.134275+0000","last_clean":"2023-10-08T17:24:48.134275+0000","last_became_active":"2023-10-08T17:24:47.146574+0000","last_became_peered":"2023-10-08T17:24:47.146574+0000","last_unstale":"2023-10-08T17:24:48.134275+0000","last_undegraded":"2023-10-08T17:24:48.134275+0000","last_fullsized":"2023-10-08T17:24:48.134275+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:34.408449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151402+0000","last_change":"2023-10-08T17:24:48.147664+0000","last_active":"2023-10-08T17:24:48.151402+0000","last_peered":"2023-10-08T17:24:48.151402+0000","last_clean":"2023-10-08T17:24:48.151402+0000","last_became_active":"2023-10-08T17:24:48.146656+0000","last_became_peered":"2023-10-08T17:24:48.146656+0000","last_unstale":"2023-10-08T17:24:48.151402+0000","last_undegraded":"2023-10-08T17:24:48.151402+0000","last_fullsized":"2023-10-08T17:24:48.151402+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:27.653406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"167'3","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.166021+0000","last_change":"2023-10-08T17:24:47.147282+0000","last_active":"2023-10-08T17:24:48.166021+0000","last_peered":"2023-10-08T17:24:48.166021+0000","last_clean":"2023-10-08T17:24:48.166021+0000","last_became_active":"2023-10-08T17:24:47.147021+0000","last_became_peered":"2023-10-08T17:24:47.147021+0000","last_unstale":"2023-10-08T17:24:48.166021+0000","last_undegraded":"2023-10-08T17:24:48.166021+0000","last_fullsized":"2023-10-08T17:24:48.166021+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:15.732870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.146176+0000","last_change":"2023-10-08T17:24:48.141364+0000","last_active":"2023-10-08T17:24:48.146176+0000","last_peered":"2023-10-08T17:24:48.146176+0000","last_clean":"2023-10-08T17:24:48.146176+0000","last_became_active":"2023-10-08T17:24:48.140657+0000","last_became_peered":"2023-10-08T17:24:48.140657+0000","last_unstale":"2023-10-08T17:24:48.146176+0000","last_undegraded":"2023-10-08T17:24:48.146176+0000","last_fullsized":"2023-10-08T17:24:48.146176+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:43:28.212136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"167'6","reported_seq":16,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.167222+0000","last_change":"2023-10-08T17:24:47.141364+0000","last_active":"2023-10-08T17:24:48.167222+0000","last_peered":"2023-10-08T17:24:48.167222+0000","last_clean":"2023-10-08T17:24:48.167222+0000","last_became_active":"2023-10-08T17:24:47.141098+0000","last_became_peered":"2023-10-08T17:24:47.141098+0000","last_unstale":"2023-10-08T17:24:48.167222+0000","last_undegraded":"2023-10-08T17:24:48.167222+0000","last_fullsized":"2023-10-08T17:24:48.167222+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:36:16.218080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.152898+0000","last_change":"2023-10-08T17:24:48.145555+0000","last_active":"2023-10-08T17:24:48.152898+0000","last_peered":"2023-10-08T17:24:48.152898+0000","last_clean":"2023-10-08T17:24:48.152898+0000","last_became_active":"2023-10-08T17:24:48.145148+0000","last_became_peered":"2023-10-08T17:24:48.145148+0000","last_unstale":"2023-10-08T17:24:48.152898+0000","last_undegraded":"2023-10-08T17:24:48.152898+0000","last_fullsized":"2023-10-08T17:24:48.152898+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:54:18.904721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.131395+0000","last_change":"2023-10-08T17:24:47.134018+0000","last_active":"2023-10-08T17:24:48.131395+0000","last_peered":"2023-10-08T17:24:48.131395+0000","last_clean":"2023-10-08T17:24:48.131395+0000","last_became_active":"2023-10-08T17:24:47.133695+0000","last_became_peered":"2023-10-08T17:24:47.133695+0000","last_unstale":"2023-10-08T17:24:48.131395+0000","last_undegraded":"2023-10-08T17:24:48.131395+0000","last_fullsized":"2023-10-08T17:24:48.131395+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:51.829673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160844+0000","last_change":"2023-10-08T17:24:48.159868+0000","last_active":"2023-10-08T17:24:48.160844+0000","last_peered":"2023-10-08T17:24:48.160844+0000","last_clean":"2023-10-08T17:24:48.160844+0000","last_became_active":"2023-10-08T17:24:48.159544+0000","last_became_peered":"2023-10-08T17:24:48.159544+0000","last_unstale":"2023-10-08T17:24:48.160844+0000","last_undegraded":"2023-10-08T17:24:48.160844+0000","last_fullsized":"2023-10-08T17:24:48.160844+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:21.574021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.138754+0000","last_change":"2023-10-08T17:24:47.141072+0000","last_active":"2023-10-08T17:24:48.138754+0000","last_peered":"2023-10-08T17:24:48.138754+0000","last_clean":"2023-10-08T17:24:48.138754+0000","last_became_active":"2023-10-08T17:24:47.140804+0000","last_became_peered":"2023-10-08T17:24:47.140804+0000","last_unstale":"2023-10-08T17:24:48.138754+0000","last_undegraded":"2023-10-08T17:24:48.138754+0000","last_fullsized":"2023-10-08T17:24:48.138754+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:33:27.108489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156846+0000","last_change":"2023-10-08T17:24:48.152861+0000","last_active":"2023-10-08T17:24:48.156846+0000","last_peered":"2023-10-08T17:24:48.156846+0000","last_clean":"2023-10-08T17:24:48.156846+0000","last_became_active":"2023-10-08T17:24:48.152600+0000","last_became_peered":"2023-10-08T17:24:48.152600+0000","last_unstale":"2023-10-08T17:24:48.156846+0000","last_undegraded":"2023-10-08T17:24:48.156846+0000","last_fullsized":"2023-10-08T17:24:48.156846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:20.835704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"167'8","reported_seq":18,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.167084+0000","last_change":"2023-10-08T17:24:47.146894+0000","last_active":"2023-10-08T17:24:48.167084+0000","last_peered":"2023-10-08T17:24:48.167084+0000","last_clean":"2023-10-08T17:24:48.167084+0000","last_became_active":"2023-10-08T17:24:47.146574+0000","last_became_peered":"2023-10-08T17:24:47.146574+0000","last_unstale":"2023-10-08T17:24:48.167084+0000","last_undegraded":"2023-10-08T17:24:48.167084+0000","last_fullsized":"2023-10-08T17:24:48.167084+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:51.197082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.151918+0000","last_change":"2023-10-08T17:24:48.142601+0000","last_active":"2023-10-08T17:24:48.151918+0000","last_peered":"2023-10-08T17:24:48.151918+0000","last_clean":"2023-10-08T17:24:48.151918+0000","last_became_active":"2023-10-08T17:24:48.142319+0000","last_became_peered":"2023-10-08T17:24:48.142319+0000","last_unstale":"2023-10-08T17:24:48.151918+0000","last_undegraded":"2023-10-08T17:24:48.151918+0000","last_fullsized":"2023-10-08T17:24:48.151918+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:03:27.978660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158043+0000","last_change":"2023-10-08T17:24:47.141560+0000","last_active":"2023-10-08T17:24:48.158043+0000","last_peered":"2023-10-08T17:24:48.158043+0000","last_clean":"2023-10-08T17:24:48.158043+0000","last_became_active":"2023-10-08T17:24:47.141257+0000","last_became_peered":"2023-10-08T17:24:47.141257+0000","last_unstale":"2023-10-08T17:24:48.158043+0000","last_undegraded":"2023-10-08T17:24:48.158043+0000","last_fullsized":"2023-10-08T17:24:48.158043+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:29.637559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150611+0000","last_change":"2023-10-08T17:24:48.144274+0000","last_active":"2023-10-08T17:24:48.150611+0000","last_peered":"2023-10-08T17:24:48.150611+0000","last_clean":"2023-10-08T17:24:48.150611+0000","last_became_active":"2023-10-08T17:24:48.143948+0000","last_became_peered":"2023-10-08T17:24:48.143948+0000","last_unstale":"2023-10-08T17:24:48.150611+0000","last_undegraded":"2023-10-08T17:24:48.150611+0000","last_fullsized":"2023-10-08T17:24:48.150611+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:44:52.837390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156323+0000","last_change":"2023-10-08T17:24:47.146240+0000","last_active":"2023-10-08T17:24:48.156323+0000","last_peered":"2023-10-08T17:24:48.156323+0000","last_clean":"2023-10-08T17:24:48.156323+0000","last_became_active":"2023-10-08T17:24:47.145953+0000","last_became_peered":"2023-10-08T17:24:47.145953+0000","last_unstale":"2023-10-08T17:24:48.156323+0000","last_undegraded":"2023-10-08T17:24:48.156323+0000","last_fullsized":"2023-10-08T17:24:48.156323+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:30:13.634949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.159963+0000","last_change":"2023-10-08T17:24:48.148448+0000","last_active":"2023-10-08T17:24:48.159963+0000","last_peered":"2023-10-08T17:24:48.159963+0000","last_clean":"2023-10-08T17:24:48.159963+0000","last_became_active":"2023-10-08T17:24:48.148171+0000","last_became_peered":"2023-10-08T17:24:48.148171+0000","last_unstale":"2023-10-08T17:24:48.159963+0000","last_undegraded":"2023-10-08T17:24:48.159963+0000","last_fullsized":"2023-10-08T17:24:48.159963+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:10.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153167+0000","last_change":"2023-10-08T17:24:47.148889+0000","last_active":"2023-10-08T17:24:48.153167+0000","last_peered":"2023-10-08T17:24:48.153167+0000","last_clean":"2023-10-08T17:24:48.153167+0000","last_became_active":"2023-10-08T17:24:47.148561+0000","last_became_peered":"2023-10-08T17:24:47.148561+0000","last_unstale":"2023-10-08T17:24:48.153167+0000","last_undegraded":"2023-10-08T17:24:48.153167+0000","last_fullsized":"2023-10-08T17:24:48.153167+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:18:14.591483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156840+0000","last_change":"2023-10-08T17:24:48.153502+0000","last_active":"2023-10-08T17:24:48.156840+0000","last_peered":"2023-10-08T17:24:48.156840+0000","last_clean":"2023-10-08T17:24:48.156840+0000","last_became_active":"2023-10-08T17:24:48.153208+0000","last_became_peered":"2023-10-08T17:24:48.153208+0000","last_unstale":"2023-10-08T17:24:48.156840+0000","last_undegraded":"2023-10-08T17:24:48.156840+0000","last_fullsized":"2023-10-08T17:24:48.156840+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:46.151235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133012+0000","last_change":"2023-10-08T17:24:47.138481+0000","last_active":"2023-10-08T17:24:48.133012+0000","last_peered":"2023-10-08T17:24:48.133012+0000","last_clean":"2023-10-08T17:24:48.133012+0000","last_became_active":"2023-10-08T17:24:47.138147+0000","last_became_peered":"2023-10-08T17:24:47.138147+0000","last_unstale":"2023-10-08T17:24:48.133012+0000","last_undegraded":"2023-10-08T17:24:48.133012+0000","last_fullsized":"2023-10-08T17:24:48.133012+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:01.727191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.141040+0000","last_change":"2023-10-08T17:24:48.139171+0000","last_active":"2023-10-08T17:24:48.141040+0000","last_peered":"2023-10-08T17:24:48.141040+0000","last_clean":"2023-10-08T17:24:48.141040+0000","last_became_active":"2023-10-08T17:24:48.138861+0000","last_became_peered":"2023-10-08T17:24:48.138861+0000","last_unstale":"2023-10-08T17:24:48.141040+0000","last_undegraded":"2023-10-08T17:24:48.141040+0000","last_fullsized":"2023-10-08T17:24:48.141040+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:37:52.204799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.160761+0000","last_change":"2023-10-08T17:24:47.143361+0000","last_active":"2023-10-08T17:24:48.160761+0000","last_peered":"2023-10-08T17:24:48.160761+0000","last_clean":"2023-10-08T17:24:48.160761+0000","last_became_active":"2023-10-08T17:24:47.143032+0000","last_became_peered":"2023-10-08T17:24:47.143032+0000","last_unstale":"2023-10-08T17:24:48.160761+0000","last_undegraded":"2023-10-08T17:24:48.160761+0000","last_fullsized":"2023-10-08T17:24:48.160761+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:16:04.260033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.149893+0000","last_change":"2023-10-08T17:24:48.143540+0000","last_active":"2023-10-08T17:24:48.149893+0000","last_peered":"2023-10-08T17:24:48.149893+0000","last_clean":"2023-10-08T17:24:48.149893+0000","last_became_active":"2023-10-08T17:24:48.143211+0000","last_became_peered":"2023-10-08T17:24:48.143211+0000","last_unstale":"2023-10-08T17:24:48.149893+0000","last_undegraded":"2023-10-08T17:24:48.149893+0000","last_fullsized":"2023-10-08T17:24:48.149893+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:43:13.385108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.133348+0000","last_change":"2023-10-08T17:24:47.143831+0000","last_active":"2023-10-08T17:24:48.133348+0000","last_peered":"2023-10-08T17:24:48.133348+0000","last_clean":"2023-10-08T17:24:48.133348+0000","last_became_active":"2023-10-08T17:24:47.143571+0000","last_became_peered":"2023-10-08T17:24:47.143571+0000","last_unstale":"2023-10-08T17:24:48.133348+0000","last_undegraded":"2023-10-08T17:24:48.133348+0000","last_fullsized":"2023-10-08T17:24:48.133348+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:37.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153919+0000","last_change":"2023-10-08T17:24:48.150830+0000","last_active":"2023-10-08T17:24:48.153919+0000","last_peered":"2023-10-08T17:24:48.153919+0000","last_clean":"2023-10-08T17:24:48.153919+0000","last_became_active":"2023-10-08T17:24:48.150553+0000","last_became_peered":"2023-10-08T17:24:48.150553+0000","last_unstale":"2023-10-08T17:24:48.153919+0000","last_undegraded":"2023-10-08T17:24:48.153919+0000","last_fullsized":"2023-10-08T17:24:48.153919+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:10:49.977377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132600+0000","last_change":"2023-10-08T17:24:47.147978+0000","last_active":"2023-10-08T17:24:48.132600+0000","last_peered":"2023-10-08T17:24:48.132600+0000","last_clean":"2023-10-08T17:24:48.132600+0000","last_became_active":"2023-10-08T17:24:47.146431+0000","last_became_peered":"2023-10-08T17:24:47.146431+0000","last_unstale":"2023-10-08T17:24:48.132600+0000","last_undegraded":"2023-10-08T17:24:48.132600+0000","last_fullsized":"2023-10-08T17:24:48.132600+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:23.155209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.148654+0000","last_change":"2023-10-08T17:24:48.147295+0000","last_active":"2023-10-08T17:24:48.148654+0000","last_peered":"2023-10-08T17:24:48.148654+0000","last_clean":"2023-10-08T17:24:48.148654+0000","last_became_active":"2023-10-08T17:24:48.146075+0000","last_became_peered":"2023-10-08T17:24:48.146075+0000","last_unstale":"2023-10-08T17:24:48.148654+0000","last_undegraded":"2023-10-08T17:24:48.148654+0000","last_fullsized":"2023-10-08T17:24:48.148654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:15:22.605339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.130675+0000","last_change":"2023-10-08T17:24:47.145824+0000","last_active":"2023-10-08T17:24:48.130675+0000","last_peered":"2023-10-08T17:24:48.130675+0000","last_clean":"2023-10-08T17:24:48.130675+0000","last_became_active":"2023-10-08T17:24:47.145473+0000","last_became_peered":"2023-10-08T17:24:47.145473+0000","last_unstale":"2023-10-08T17:24:48.130675+0000","last_undegraded":"2023-10-08T17:24:48.130675+0000","last_fullsized":"2023-10-08T17:24:48.130675+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:06:38.579768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.150126+0000","last_change":"2023-10-08T17:24:48.143461+0000","last_active":"2023-10-08T17:24:48.150126+0000","last_peered":"2023-10-08T17:24:48.150126+0000","last_clean":"2023-10-08T17:24:48.150126+0000","last_became_active":"2023-10-08T17:24:48.143157+0000","last_became_peered":"2023-10-08T17:24:48.143157+0000","last_unstale":"2023-10-08T17:24:48.150126+0000","last_undegraded":"2023-10-08T17:24:48.150126+0000","last_fullsized":"2023-10-08T17:24:48.150126+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:29:46.558310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.157961+0000","last_change":"2023-10-08T17:24:47.140604+0000","last_active":"2023-10-08T17:24:48.157961+0000","last_peered":"2023-10-08T17:24:48.157961+0000","last_clean":"2023-10-08T17:24:48.157961+0000","last_became_active":"2023-10-08T17:24:47.140351+0000","last_became_peered":"2023-10-08T17:24:47.140351+0000","last_unstale":"2023-10-08T17:24:48.157961+0000","last_undegraded":"2023-10-08T17:24:48.157961+0000","last_fullsized":"2023-10-08T17:24:48.157961+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:35:34.443246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.161731+0000","last_change":"2023-10-08T17:24:48.158387+0000","last_active":"2023-10-08T17:24:48.161731+0000","last_peered":"2023-10-08T17:24:48.161731+0000","last_clean":"2023-10-08T17:24:48.161731+0000","last_became_active":"2023-10-08T17:24:48.158055+0000","last_became_peered":"2023-10-08T17:24:48.158055+0000","last_unstale":"2023-10-08T17:24:48.161731+0000","last_undegraded":"2023-10-08T17:24:48.161731+0000","last_fullsized":"2023-10-08T17:24:48.161731+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:36:17.225796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128058+0000","last_change":"2023-10-08T17:24:47.141612+0000","last_active":"2023-10-08T17:24:48.128058+0000","last_peered":"2023-10-08T17:24:48.128058+0000","last_clean":"2023-10-08T17:24:48.128058+0000","last_became_active":"2023-10-08T17:24:47.141277+0000","last_became_peered":"2023-10-08T17:24:47.141277+0000","last_unstale":"2023-10-08T17:24:48.128058+0000","last_undegraded":"2023-10-08T17:24:48.128058+0000","last_fullsized":"2023-10-08T17:24:48.128058+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:47.841603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.163265+0000","last_change":"2023-10-08T17:24:48.157594+0000","last_active":"2023-10-08T17:24:48.163265+0000","last_peered":"2023-10-08T17:24:48.163265+0000","last_clean":"2023-10-08T17:24:48.163265+0000","last_became_active":"2023-10-08T17:24:48.155073+0000","last_became_peered":"2023-10-08T17:24:48.155073+0000","last_unstale":"2023-10-08T17:24:48.163265+0000","last_undegraded":"2023-10-08T17:24:48.163265+0000","last_fullsized":"2023-10-08T17:24:48.163265+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:02.734908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.137322+0000","last_change":"2023-10-08T17:24:47.144563+0000","last_active":"2023-10-08T17:24:48.137322+0000","last_peered":"2023-10-08T17:24:48.137322+0000","last_clean":"2023-10-08T17:24:48.137322+0000","last_became_active":"2023-10-08T17:24:47.144303+0000","last_became_peered":"2023-10-08T17:24:47.144303+0000","last_unstale":"2023-10-08T17:24:48.137322+0000","last_undegraded":"2023-10-08T17:24:48.137322+0000","last_fullsized":"2023-10-08T17:24:48.137322+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:25:56.082950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.153253+0000","last_change":"2023-10-08T17:24:48.146813+0000","last_active":"2023-10-08T17:24:48.153253+0000","last_peered":"2023-10-08T17:24:48.153253+0000","last_clean":"2023-10-08T17:24:48.153253+0000","last_became_active":"2023-10-08T17:24:48.144969+0000","last_became_peered":"2023-10-08T17:24:48.144969+0000","last_unstale":"2023-10-08T17:24:48.153253+0000","last_undegraded":"2023-10-08T17:24:48.153253+0000","last_fullsized":"2023-10-08T17:24:48.153253+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:31:48.849320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132861+0000","last_change":"2023-10-08T17:24:47.148515+0000","last_active":"2023-10-08T17:24:48.132861+0000","last_peered":"2023-10-08T17:24:48.132861+0000","last_clean":"2023-10-08T17:24:48.132861+0000","last_became_active":"2023-10-08T17:24:47.148201+0000","last_became_peered":"2023-10-08T17:24:47.148201+0000","last_unstale":"2023-10-08T17:24:48.132861+0000","last_undegraded":"2023-10-08T17:24:48.132861+0000","last_fullsized":"2023-10-08T17:24:48.132861+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:23.155209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135824+0000","last_change":"2023-10-08T17:24:48.134694+0000","last_active":"2023-10-08T17:24:48.135824+0000","last_peered":"2023-10-08T17:24:48.135824+0000","last_clean":"2023-10-08T17:24:48.135824+0000","last_became_active":"2023-10-08T17:24:48.134318+0000","last_became_peered":"2023-10-08T17:24:48.134318+0000","last_unstale":"2023-10-08T17:24:48.135824+0000","last_undegraded":"2023-10-08T17:24:48.135824+0000","last_fullsized":"2023-10-08T17:24:48.135824+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:03:24.106408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.135882+0000","last_change":"2023-10-08T17:24:47.142586+0000","last_active":"2023-10-08T17:24:48.135882+0000","last_peered":"2023-10-08T17:24:48.135882+0000","last_clean":"2023-10-08T17:24:48.135882+0000","last_became_active":"2023-10-08T17:24:47.142312+0000","last_became_peered":"2023-10-08T17:24:47.142312+0000","last_unstale":"2023-10-08T17:24:48.135882+0000","last_undegraded":"2023-10-08T17:24:48.135882+0000","last_fullsized":"2023-10-08T17:24:48.135882+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:51:35.302470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.145872+0000","last_change":"2023-10-08T17:24:48.141343+0000","last_active":"2023-10-08T17:24:48.145872+0000","last_peered":"2023-10-08T17:24:48.145872+0000","last_clean":"2023-10-08T17:24:48.145872+0000","last_became_active":"2023-10-08T17:24:48.141069+0000","last_became_peered":"2023-10-08T17:24:48.141069+0000","last_unstale":"2023-10-08T17:24:48.145872+0000","last_undegraded":"2023-10-08T17:24:48.145872+0000","last_fullsized":"2023-10-08T17:24:48.145872+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:42:33.977260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.130029+0000","last_change":"2023-10-08T17:24:47.140541+0000","last_active":"2023-10-08T17:24:48.130029+0000","last_peered":"2023-10-08T17:24:48.130029+0000","last_clean":"2023-10-08T17:24:48.130029+0000","last_became_active":"2023-10-08T17:24:47.140269+0000","last_became_peered":"2023-10-08T17:24:47.140269+0000","last_unstale":"2023-10-08T17:24:48.130029+0000","last_undegraded":"2023-10-08T17:24:48.130029+0000","last_fullsized":"2023-10-08T17:24:48.130029+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:52.929342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.147458+0000","last_change":"2023-10-08T17:24:48.144073+0000","last_active":"2023-10-08T17:24:48.147458+0000","last_peered":"2023-10-08T17:24:48.147458+0000","last_clean":"2023-10-08T17:24:48.147458+0000","last_became_active":"2023-10-08T17:24:48.143811+0000","last_became_peered":"2023-10-08T17:24:48.143811+0000","last_unstale":"2023-10-08T17:24:48.147458+0000","last_undegraded":"2023-10-08T17:24:48.147458+0000","last_fullsized":"2023-10-08T17:24:48.147458+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:48:27.653406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132701+0000","last_change":"2023-10-08T17:24:47.143334+0000","last_active":"2023-10-08T17:24:48.132701+0000","last_peered":"2023-10-08T17:24:48.132701+0000","last_clean":"2023-10-08T17:24:48.132701+0000","last_became_active":"2023-10-08T17:24:47.143043+0000","last_became_peered":"2023-10-08T17:24:47.143043+0000","last_unstale":"2023-10-08T17:24:48.132701+0000","last_undegraded":"2023-10-08T17:24:48.132701+0000","last_fullsized":"2023-10-08T17:24:48.132701+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:56:22.689518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.156933+0000","last_change":"2023-10-08T17:24:48.152912+0000","last_active":"2023-10-08T17:24:48.156933+0000","last_peered":"2023-10-08T17:24:48.156933+0000","last_clean":"2023-10-08T17:24:48.156933+0000","last_became_active":"2023-10-08T17:24:48.152643+0000","last_became_peered":"2023-10-08T17:24:48.152643+0000","last_unstale":"2023-10-08T17:24:48.156933+0000","last_undegraded":"2023-10-08T17:24:48.156933+0000","last_fullsized":"2023-10-08T17:24:48.156933+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:46.792265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.132553+0000","last_change":"2023-10-08T17:24:47.141191+0000","last_active":"2023-10-08T17:24:48.132553+0000","last_peered":"2023-10-08T17:24:48.132553+0000","last_clean":"2023-10-08T17:24:48.132553+0000","last_became_active":"2023-10-08T17:24:47.140707+0000","last_became_peered":"2023-10-08T17:24:47.140707+0000","last_unstale":"2023-10-08T17:24:48.132553+0000","last_undegraded":"2023-10-08T17:24:48.132553+0000","last_fullsized":"2023-10-08T17:24:48.132553+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:52.929342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.146831+0000","last_change":"2023-10-08T17:24:48.145346+0000","last_active":"2023-10-08T17:24:48.146831+0000","last_peered":"2023-10-08T17:24:48.146831+0000","last_clean":"2023-10-08T17:24:48.146831+0000","last_became_active":"2023-10-08T17:24:48.145053+0000","last_became_peered":"2023-10-08T17:24:48.145053+0000","last_unstale":"2023-10-08T17:24:48.146831+0000","last_undegraded":"2023-10-08T17:24:48.146831+0000","last_fullsized":"2023-10-08T17:24:48.146831+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:47.117040+0000","last_clean_scrub_stamp":"2023-10-08T17:24:47.117040+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:33:27.056760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.158283+0000","last_change":"2023-10-08T17:24:47.141166+0000","last_active":"2023-10-08T17:24:48.158283+0000","last_peered":"2023-10-08T17:24:48.158283+0000","last_clean":"2023-10-08T17:24:48.158283+0000","last_became_active":"2023-10-08T17:24:47.140775+0000","last_became_peered":"2023-10-08T17:24:47.140775+0000","last_unstale":"2023-10-08T17:24:48.158283+0000","last_undegraded":"2023-10-08T17:24:48.158283+0000","last_fullsized":"2023-10-08T17:24:48.158283+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:24:46.109323+0000","last_clean_scrub_stamp":"2023-10-08T17:24:46.109323+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:19:37.730556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"157'271","reported_seq":843,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-08T17:24:48.128574+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:24:48.128574+0000","last_peered":"2023-10-08T17:24:48.128574+0000","last_clean":"2023-10-08T17:24:48.128574+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:24:48.128574+0000","last_undegraded":"2023-10-08T17:24:48.128574+0000","last_fullsized":"2023-10-08T17:24:48.128574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575746,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312220,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059620,"statfs":{"total":96636764160,"available":96317050880,"internally_reserved":0,"allocated":2707456,"data_stored":1635171,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91500000000000004,"5min":1.024,"15min":1.1100000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.68500000000000005}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":1.0880000000000001,"15min":1.1379999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.72899999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.69599999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.47899999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.745}]},{"osd":4,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.628,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.432,"15min":0.36899999999999999},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.63},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.38800000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.71099999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.77800000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.79100000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.48199999999999998},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.44700000000000001},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.76400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575747,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299328,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072512,"statfs":{"total":96636764160,"available":96330252288,"internally_reserved":0,"allocated":2088960,"data_stored":1037441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34399999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.175},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.40400000000000003},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.58399999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.44900000000000001},"max":{"1min":1.012,"5min":1.0860000000000001,"15min":1.1399999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0109999999999999,"5min":1.073,"15min":1.113},"last":0.503},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0589999999999999,"5min":1.069,"15min":1.097},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":0.996,"15min":1.034},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.749,"15min":0.754},"min":{"1min":0.69199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.125},"last":0.69199999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.505,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.93700000000000006,"5min":1.202,"15min":1.202},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":1.1120000000000001,"15min":1.327},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.442},"max":{"1min":1.03,"5min":1.0469999999999999,"15min":1.1160000000000001},"last":0.625}]}]},{"osd":1,"up_from":13,"seq":55834575746,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303424,"kb_used_data":2040,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068416,"statfs":{"total":96636764160,"available":96326057984,"internally_reserved":0,"allocated":2088960,"data_stored":1042657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47399999999999998,"15min":0.47499999999999998},"min":{"1min":0.33300000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.59499999999999997,"5min":0.69699999999999995,"15min":0.89600000000000002},"last":0.377},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.36299999999999999,"15min":0.34000000000000002},"max":{"1min":0.85599999999999998,"5min":0.879,"15min":0.879},"last":0.39600000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.378,"5min":0.34399999999999997,"15min":0.33800000000000002},"max":{"1min":0.67100000000000004,"5min":0.76800000000000002,"15min":1.0660000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.64200000000000002,"15min":0.63600000000000001},"min":{"1min":0.52000000000000002,"5min":0.47199999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.94999999999999996,"15min":1.038},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.68100000000000005},"min":{"1min":0.53500000000000003,"5min":0.50700000000000001,"15min":0.47299999999999998},"max":{"1min":0.84999999999999998,"5min":0.98299999999999998,"15min":1.032},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.63200000000000001},"min":{"1min":0.45100000000000001,"5min":0.41099999999999998,"15min":0.39600000000000002},"max":{"1min":0.93300000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82499999999999996,"15min":0.82799999999999996},"min":{"1min":0.64800000000000002,"5min":0.56299999999999994,"15min":0.51400000000000001},"max":{"1min":1.198,"5min":1.276,"15min":1.276},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.81599999999999995,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.57099999999999995,"15min":0.44700000000000001},"max":{"1min":1.002,"5min":1.169,"15min":1.379},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.81499999999999995,"15min":0.81999999999999995},"min":{"1min":0.64800000000000002,"5min":0.58999999999999997,"15min":0.46200000000000002},"max":{"1min":0.97799999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.83899999999999997,"15min":0.84499999999999997},"min":{"1min":0.71299999999999997,"5min":0.64600000000000002,"15min":0.56299999999999994},"max":{"1min":0.94299999999999995,"5min":1.242,"15min":1.242},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.84699999999999998,"15min":0.85599999999999998},"min":{"1min":0.66300000000000003,"5min":0.61799999999999999,"15min":0.54700000000000004},"max":{"1min":1.052,"5min":1.165,"15min":1.165},"last":1.002},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86499999999999999,"15min":0.86899999999999999},"min":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.55200000000000005},"max":{"1min":1.0429999999999999,"5min":1.1599999999999999,"15min":1.3029999999999999},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:23:49 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.88500000000000001,"15min":0.88300000000000001},"min":{"1min":0.69999999999999996,"5min":0.60799999999999998,"15min":0.55700000000000005},"max":{"1min":0.97799999999999998,"5min":1.1950000000000001,"15min":1.4199999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.89200000000000002,"15min":0.90000000000000002},"min":{"1min":0.71499999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.129,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.84299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575746,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308088,"kb_used_data":2608,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063752,"statfs":{"total":96636764160,"available":96321282048,"internally_reserved":0,"allocated":2670592,"data_stored":1626273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.5,"15min":0.49399999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.379},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60099999999999998,"15min":0.58599999999999997},"min":{"1min":0.48699999999999999,"5min":0.436,"15min":0.42399999999999999},"max":{"1min":0.79600000000000004,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.54700000000000004,"15min":0.53300000000000003},"min":{"1min":0.41399999999999998,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.80900000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.68799999999999994,"5min":0.82799999999999996,"15min":0.92200000000000004},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.40200000000000002,"5min":0.35799999999999998,"15min":0.35299999999999998},"max":{"1min":0.73199999999999998,"5min":0.79800000000000004,"15min":0.98299999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.41199999999999998},"max":{"1min":0.86499999999999999,"5min":0.86799999999999999,"15min":0.93400000000000005},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80200000000000005},"min":{"1min":0.60699999999999998,"5min":0.54400000000000004,"15min":0.52800000000000002},"max":{"1min":1.0349999999999999,"5min":1.1180000000000001,"15min":1.1970000000000001},"last":0.75},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.82999999999999996,"15min":0.81999999999999995},"min":{"1min":0.65200000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.0820000000000001,"5min":1.214,"15min":1.214},"last":0.69499999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.84499999999999997,"15min":0.82299999999999995},"min":{"1min":0.64900000000000002,"5min":0.60399999999999998,"15min":0.51000000000000001},"max":{"1min":1.1020000000000001,"5min":1.3009999999999999,"15min":1.3180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.82399999999999995,"15min":0.81699999999999995},"min":{"1min":0.625,"5min":0.59099999999999997,"15min":0.53500000000000003},"max":{"1min":1.0089999999999999,"5min":1.196,"15min":1.3180000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.86599999999999999,"15min":0.84799999999999998},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"max":{"1min":1.1359999999999999,"5min":1.149,"15min":1.25},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.86199999999999999,"15min":0.84699999999999998},"min":{"1min":0.66600000000000004,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.04,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.84299999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:21 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88900000000000001,"15min":0.872},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.57799999999999996},"max":{"1min":1.1619999999999999,"5min":1.181,"15min":1.3520000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.86499999999999999,"15min":0.85399999999999998},"min":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57099999999999995},"max":{"1min":1.1100000000000001,"5min":1.1499999999999999,"15min":1.3480000000000001},"last":0.97499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575747,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311612,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060228,"statfs":{"total":96636764160,"available":96317673472,"internally_reserved":0,"allocated":2084864,"data_stored":1036493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.49099999999999999,"15min":0.502},"min":{"1min":0.316,"5min":0.30399999999999999,"15min":0.30299999999999999},"max":{"1min":0.72199999999999998,"5min":0.755,"15min":0.84099999999999997},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.48399999999999999,"5min":0.43099999999999999,"15min":0.42699999999999999},"max":{"1min":0.73899999999999999,"5min":0.81999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54400000000000004,"15min":0.54300000000000004},"min":{"1min":0.41699999999999998,"5min":0.371,"15min":0.35699999999999998},"max":{"1min":0.79300000000000004,"5min":0.84599999999999997,"15min":0.92300000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54900000000000004,"15min":0.56000000000000005},"min":{"1min":0.40300000000000002,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.66600000000000004,"5min":0.753,"15min":0.97499999999999998},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.57099999999999995,"15min":0.55900000000000005},"min":{"1min":0.437,"5min":0.38100000000000001,"15min":0.36699999999999999},"max":{"1min":0.78000000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66800000000000004,"15min":0.66700000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.50900000000000001},"max":{"1min":0.85899999999999999,"5min":0.91300000000000003,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80700000000000005,"15min":0.80300000000000005},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.51200000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.1319999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.61799999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1,"5min":1.2070000000000001,"15min":1.224},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.85699999999999998,"15min":0.85799999999999998},"min":{"1min":0.65900000000000003,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.224},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.875,"5min":0.85499999999999998,"15min":0.84899999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.1519999999999999,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.751}]},{"osd":6,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82999999999999996,"15min":0.81499999999999995},"min":{"1min":0.63300000000000001,"5min":0.61499999999999999,"15min":0.51000000000000001},"max":{"1min":1.091,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.89000000000000001,"5min":0.84899999999999998,"15min":0.84599999999999997},"min":{"1min":0.64700000000000002,"5min":0.63,"15min":0.61399999999999999},"max":{"1min":1.083,"5min":1.123,"15min":1.242},"last":0.97299999999999998}]},{"osd":7,"last update":"Sun Oct 8 17:23:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.86899999999999999,"15min":0.874},"min":{"1min":0.70199999999999996,"5min":0.63200000000000001,"15min":0.58899999999999997},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.89400000000000002,"15min":0.88500000000000001},"min":{"1min":0.68999999999999995,"5min":0.61199999999999999,"15min":0.59799999999999998},"max":{"1min":1.204,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.84699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311612,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060228,"statfs":{"total":96636764160,"available":96317673472,"internally_reserved":0,"allocated":2084864,"data_stored":1036065,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71599999999999997,"5min":0.86599999999999999,"15min":0.88400000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70799999999999996,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.96899999999999997},"last":0.46000000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.204},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":1.679,"15min":1.679},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.54600000000000004},"max":{"1min":1.143,"5min":1.893,"15min":1.893},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.498},"max":{"1min":1.0640000000000001,"5min":1.2290000000000001,"15min":1.347},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.71999999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.218,"5min":1.258,"15min":1.258},"last":0.749},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.59199999999999997,"15min":0.52600000000000002},"max":{"1min":1.1619999999999999,"5min":1.859,"15min":1.859},"last":0.78300000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575747,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303428,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068412,"statfs":{"total":96636764160,"available":96326053888,"internally_reserved":0,"allocated":2093056,"data_stored":1042727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0269999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.44},"max":{"1min":0.97799999999999998,"5min":1.079,"15min":1.1639999999999999},"last":0.91700000000000004}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80000000000000004,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.46700000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.83199999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":0.93400000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.0469999999999999,"15min":1.0880000000000001},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98299999999999998,"5min":1.246,"15min":1.246},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":1.115,"15min":1.115},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1000000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.0609999999999999},"last":1.0029999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.99299999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":1.1459999999999999,"15min":1.2909999999999999},"last":0.873}]},{"osd":7,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":1.177,"15min":1.177},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.44},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2490000000000001},"last":0.93400000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575746,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303420,"kb_used_data":2036,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068420,"statfs":{"total":96636764160,"available":96326062080,"internally_reserved":0,"allocated":2084864,"data_stored":1036017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":0.98099999999999998,"15min":0.997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.39700000000000002},"max":{"1min":0.89300000000000002,"5min":1.0089999999999999,"15min":1.0289999999999999},"last":0.81299999999999994}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46400000000000002},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.054},"last":0.746},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98099999999999998,"5min":1.073,"15min":1.1020000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79000000000000004,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.45800000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":0.95699999999999996,"15min":1.0089999999999999},"last":0.83499999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.97099999999999997}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82899999999999996,"5min":0.97499999999999998,"15min":1.0680000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.99399999999999999,"15min":1.056},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.02,"5min":1.0269999999999999,"15min":1.107},"last":1.03},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70399999999999996},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96799999999999997,"15min":1.0620000000000001},"last":0.95899999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.1100000000000001},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.107},"last":1.079}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:24:52.994 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T17:24:52.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T17:24:53.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.220+0000 7f70a3fff700 1 Processor -- start 2023-10-08T17:24:53.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.220+0000 7f70a3fff700 1 -- start start 2023-10-08T17:24:53.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70a413fb20 0x7f70a415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f70a413fef0 0x7f70a40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a3fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70a415ae70 con 0x7f70a406aaa0 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a3fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a406af60 con 0x7f70a413fb20 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a3fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70a406b240 con 0x7f70a413fef0 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70a413fb20 0x7f70a415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a2ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f70a413fb20 0x7f70a415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55652/0 (socket says 172.21.15.12:55652) 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a2ffd700 1 -- 172.21.15.12:0/3793010371 learned_addr learned my addr 172.21.15.12:0/3793010371 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a27fc700 1 --2- 172.21.15.12:0/3793010371 >> v2:172.21.15.29:3300/0 conn(0x7f70a413fef0 0x7f70a40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a2ffd700 1 -- 172.21.15.12:0/3793010371 >> v2:172.21.15.29:3300/0 conn(0x7f70a413fef0 msgr2=0x7f70a40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.222+0000 7f70a2ffd700 1 --2- 172.21.15.12:0/3793010371 >> v2:172.21.15.29:3300/0 conn(0x7f70a413fef0 0x7f70a40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a2ffd700 1 -- 172.21.15.12:0/3793010371 >> v1:172.21.15.29:6789/0 conn(0x7f70a406aaa0 legacy=0x7f70a40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:53.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a2ffd700 1 -- 172.21.15.12:0/3793010371 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a406b520 con 0x7f70a413fb20 2023-10-08T17:24:53.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a2ffd700 1 --2- 172.21.15.12:0/3793010371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a415a930 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f70a406a5e0 tx=0x7f7094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c51213c537cab0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a1ffb700 1 -- 172.21.15.12:0/3793010371 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400b860 con 0x7f70a413fb20 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a1ffb700 1 -- 172.21.15.12:0/3793010371 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709400b9c0 con 0x7f70a413fb20 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.223+0000 7f70a1ffb700 1 -- 172.21.15.12:0/3793010371 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709400bd60 con 0x7f70a413fb20 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 -- 172.21.15.12:0/3793010371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 msgr2=0x7f70a415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 --2- 172.21.15.12:0/3793010371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a415a930 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f70a406a5e0 tx=0x7f7094009250 comp rx=0 tx=0).stop 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 -- 172.21.15.12:0/3793010371 shutdown_connections 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 --2- 172.21.15.12:0/3793010371 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a415a930 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 --2- 172.21.15.12:0/3793010371 >> v2:172.21.15.29:3300/0 conn(0x7f70a413fef0 0x7f70a40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 -- 172.21.15.12:0/3793010371 >> 172.21.15.12:0/3793010371 conn(0x7f70a406d170 msgr2=0x7f70a40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 -- 172.21.15.12:0/3793010371 shutdown_connections 2023-10-08T17:24:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.224+0000 7f70a3fff700 1 -- 172.21.15.12:0/3793010371 wait complete. 2023-10-08T17:24:53.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.225+0000 7f70a3fff700 1 Processor -- start 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.225+0000 7f70a3fff700 1 -- start start 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70a406aaa0 0x7f70a4155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70a413fef0 0x7f70a40c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4158ac0 con 0x7f70a413fb20 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4157eb0 con 0x7f70a406aaa0 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4158190 con 0x7f70a413fef0 2023-10-08T17:24:53.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.226+0000 7f70a27fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55654/0 (socket says 172.21.15.12:55654) 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 -- 172.21.15.12:0/909920902 learned_addr learned my addr 172.21.15.12:0/909920902 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a2ffd700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70a406aaa0 0x7f70a4155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a37fe700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70a413fef0 0x7f70a40c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 -- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70a413fef0 msgr2=0x7f70a40c0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70a413fef0 0x7f70a40c0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 -- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70a406aaa0 msgr2=0x7f70a4155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70a406aaa0 0x7f70a4155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 -- 172.21.15.12:0/909920902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940094f0 con 0x7f70a413fb20 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a27fc700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f709800d860 tx=0x7f7098008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098018070 con 0x7f70a413fb20 2023-10-08T17:24:53.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7098012630 con 0x7f70a413fb20 2023-10-08T17:24:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70980129f0 con 0x7f70a413fb20 2023-10-08T17:24:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.227+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a4158470 con 0x7f70a413fb20 2023-10-08T17:24:53.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.228+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a41562a0 con 0x7f70a413fb20 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.229+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a4158c70 con 0x7f70a413fb20 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.229+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f709801d410 con 0x7f70a413fb20 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.231+0000 7f708affd700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 0x7f70900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.231+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f70980848e0 con 0x7f70a413fb20 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.231+0000 7f70a2ffd700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 0x7f70900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.231+0000 7f70a2ffd700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 0x7f70900693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70a406a5e0 tx=0x7f7094017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.234+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70a4158c70 con 0x7f70a413fb20 2023-10-08T17:24:53.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.515+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f70a404c3c0 con 0x7f70a413fb20 2023-10-08T17:24:53.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.522+0000 7f708affd700 1 -- 172.21.15.12:0/909920902 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v38) v1 ==== 190+0+0 (secure 0 0 0) 0x7f70980518e0 con 0x7f70a413fb20 2023-10-08T17:24:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 msgr2=0x7f70900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 0x7f70900693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70a406a5e0 tx=0x7f7094017000 comp rx=0 tx=0).stop 2023-10-08T17:24:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 msgr2=0x7f70a40b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f709800d860 tx=0x7f7098008040 comp rx=0 tx=0).stop 2023-10-08T17:24:53.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 shutdown_connections 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7090066f30 0x7f70900693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70a413fef0 0x7f70a40c0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70a406aaa0 0x7f70a4155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 --2- 172.21.15.12:0/909920902 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f70a413fb20 0x7f70a40b1800 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 >> 172.21.15.12:0/909920902 conn(0x7f70a406d170 msgr2=0x7f70a41366f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 shutdown_connections 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.524+0000 7f70a3fff700 1 -- 172.21.15.12:0/909920902 wait complete. 2023-10-08T17:24:53.525 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T17:24:53.542 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:24:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.729+0000 7f41bc9ff700 1 Processor -- start 2023-10-08T17:24:53.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.729+0000 7f41bc9ff700 1 -- start start 2023-10-08T17:24:53.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.730+0000 7f41bc9ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41b8159850 0x7f41b80adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.730+0000 7f41bc9ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80adb20 con 0x7f41b8159c20 2023-10-08T17:24:53.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.730+0000 7f41bc9ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41b80acf10 con 0x7f41b80b1040 2023-10-08T17:24:53.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.730+0000 7f41bc9ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41b80ccdc0 con 0x7f41b8159850 2023-10-08T17:24:53.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41b8159850 0x7f41b80adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f41b8159850 0x7f41b80adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55658/0 (socket says 172.21.15.12:55658) 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 -- 172.21.15.12:0/3892847252 learned_addr learned my addr 172.21.15.12:0/3892847252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b5d9b700 1 --1- 172.21.15.12:0/3892847252 >> v1:172.21.15.12:6789/0 conn(0x7f41b8159c20 0x7f41b80b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46374/0 (socket says 172.21.15.12:46374) 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 -- 172.21.15.12:0/3892847252 >> v1:172.21.15.29:6789/0 conn(0x7f41b80b1040 legacy=0x7f41b80c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 -- 172.21.15.12:0/3892847252 >> v1:172.21.15.12:6789/0 conn(0x7f41b8159c20 legacy=0x7f41b80b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 -- 172.21.15.12:0/3892847252 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80ad1f0 con 0x7f41b8159850 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b559a700 1 -- 172.21.15.12:0/3892847252 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138140450 0 0) 0x7f41b80adb20 con 0x7f41b8159c20 2023-10-08T17:24:53.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.731+0000 7f41b659c700 1 --2- 172.21.15.12:0/3892847252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b80adfb0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba233c9a56356048 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41b559a700 1 -- 172.21.15.12:0/3892847252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800b860 con 0x7f41b8159850 2023-10-08T17:24:53.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41b559a700 1 -- 172.21.15.12:0/3892847252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a800b9c0 con 0x7f41b8159850 2023-10-08T17:24:53.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41b559a700 1 -- 172.21.15.12:0/3892847252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a800bd60 con 0x7f41b8159850 2023-10-08T17:24:53.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 -- 172.21.15.12:0/3892847252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 msgr2=0x7f41b80adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/3892847252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b80adfb0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8009250 comp rx=0 tx=0).stop 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 -- 172.21.15.12:0/3892847252 shutdown_connections 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/3892847252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b80adfb0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 -- 172.21.15.12:0/3892847252 >> 172.21.15.12:0/3892847252 conn(0x7f41b806d170 msgr2=0x7f41b80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 -- 172.21.15.12:0/3892847252 shutdown_connections 2023-10-08T17:24:53.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.732+0000 7f41bc9ff700 1 -- 172.21.15.12:0/3892847252 wait complete. 2023-10-08T17:24:53.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.734+0000 7f41bc9ff700 1 Processor -- start 2023-10-08T17:24:53.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.734+0000 7f41bc9ff700 1 -- start start 2023-10-08T17:24:53.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41b80b1040 0x7f41b815e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41b8159c20 0x7f41b80ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b81448a0 con 0x7f41b8159850 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41b815c570 con 0x7f41b8159c20 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41bc9ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b80cb550 con 0x7f41b80b1040 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41b5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41b5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55662/0 (socket says 172.21.15.12:55662) 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41b5d9b700 1 -- 172.21.15.12:0/2321619709 learned_addr learned my addr 172.21.15.12:0/2321619709 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41b6d9d700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41b8159c20 0x7f41b80ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.735+0000 7f41b659c700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41b80b1040 0x7f41b815e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 -- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41b80b1040 msgr2=0x7f41b815e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41b80b1040 0x7f41b815e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 -- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41b8159c20 msgr2=0x7f41b80ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41b8159c20 0x7f41b80ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 -- 172.21.15.12:0/2321619709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a80094f0 con 0x7f41b8159850 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41b5d9b700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c590 tx=0x7f41ac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac005a70 con 0x7f41b8159850 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ac005bd0 con 0x7f41b8159850 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41b815bc40 con 0x7f41b8159850 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ac0070d0 con 0x7f41b8159850 2023-10-08T17:24:53.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.736+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41b815c200 con 0x7f41b8159850 2023-10-08T17:24:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.737+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41b804c3c0 con 0x7f41b8159850 2023-10-08T17:24:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.738+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41ac0074c0 con 0x7f41b8159850 2023-10-08T17:24:53.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.739+0000 7f41a67fc700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 0x7f41980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.739+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f41ac083b50 con 0x7f41b8159850 2023-10-08T17:24:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.739+0000 7f41b659c700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 0x7f41980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.740+0000 7f41b659c700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 0x7f41980693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8017000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:53.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.743+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41ac050b50 con 0x7f41b8159850 2023-10-08T17:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.992+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41b815c6b0 con 0x7f41b8159850 2023-10-08T17:24:53.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.992+0000 7f41a67fc700 1 -- 172.21.15.12:0/2321619709 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f41ac017070 con 0x7f41b8159850 2023-10-08T17:24:53.992 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:24:53.992 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.994+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 msgr2=0x7f41980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.994+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 0x7f41980693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f41a80099b0 tx=0x7f41a8017000 comp rx=0 tx=0).stop 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 msgr2=0x7f41b815ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f41ac00c590 tx=0x7f41ac007f60 comp rx=0 tx=0).stop 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 shutdown_connections 2023-10-08T17:24:53.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4198066f30 0x7f41980693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f41b8159c20 0x7f41b80ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f41b80b1040 0x7f41b815e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 --2- 172.21.15.12:0/2321619709 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f41b8159850 0x7f41b815ea00 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 >> 172.21.15.12:0/2321619709 conn(0x7f41b806d170 msgr2=0x7f41b80adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 shutdown_connections 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:53.995+0000 7f41bc9ff700 1 -- 172.21.15.12:0/2321619709 wait complete. 2023-10-08T17:24:53.996 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:24:54.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T17:24:47.621722+0000', 'modified': '2023-10-08T17:24:51.151967+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8751}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8751': {'gid': 8751, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.12:6834/1897099896', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6832', 'nonce': 1897099896}, {'type': 'v1', 'addr': '172.21.15.12:6834', 'nonce': 1897099896}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T17:24:54.415 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T17:24:54.415 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-08T17:24:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.607+0000 7f48f0b9d700 1 Processor -- start 2023-10-08T17:24:54.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.607+0000 7f48f0b9d700 1 -- start start 2023-10-08T17:24:54.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.608+0000 7f48f0b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48ec159640 0x7f48ec06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.608+0000 7f48f0b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48ec0caec0 0x7f48ec0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.608+0000 7f48f0b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ec0c7420 con 0x7f48ec159a10 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48f0b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec06d5a0 con 0x7f48ec0caec0 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48f0b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48ec06d820 con 0x7f48ec159640 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48ec0caec0 0x7f48ec0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48ec0caec0 0x7f48ec0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55666/0 (socket says 172.21.15.12:55666) 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 -- 172.21.15.12:0/3815777999 learned_addr learned my addr 172.21.15.12:0/3815777999 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48eaffd700 1 --1- 172.21.15.12:0/3815777999 >> v1:172.21.15.12:6789/0 conn(0x7f48ec159a10 0x7f48ec0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46380/0 (socket says 172.21.15.12:46380) 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/3815777999 >> v2:172.21.15.29:3300/0 conn(0x7f48ec159640 0x7f48ec06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 -- 172.21.15.12:0/3815777999 >> v2:172.21.15.29:3300/0 conn(0x7f48ec159640 msgr2=0x7f48ec06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 --2- 172.21.15.12:0/3815777999 >> v2:172.21.15.29:3300/0 conn(0x7f48ec159640 0x7f48ec06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 -- 172.21.15.12:0/3815777999 >> v1:172.21.15.12:6789/0 conn(0x7f48ec159a10 legacy=0x7f48ec0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.609+0000 7f48ebfff700 1 -- 172.21.15.12:0/3815777999 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ec06db00 con 0x7f48ec0caec0 2023-10-08T17:24:54.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48ebfff700 1 --2- 172.21.15.12:0/3815777999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec0caec0 0x7f48ec0c78b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009f20 tx=0x7f48e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7296a11a3817d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48ea7fc700 1 -- 172.21.15.12:0/3815777999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400e070 con 0x7f48ec0caec0 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48ea7fc700 1 -- 172.21.15.12:0/3815777999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e400ba40 con 0x7f48ec0caec0 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48ea7fc700 1 -- 172.21.15.12:0/3815777999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e40092e0 con 0x7f48ec0caec0 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 -- 172.21.15.12:0/3815777999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec0caec0 msgr2=0x7f48ec0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/3815777999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec0caec0 0x7f48ec0c78b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009f20 tx=0x7f48e4009840 comp rx=0 tx=0).stop 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 -- 172.21.15.12:0/3815777999 shutdown_connections 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/3815777999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec0caec0 0x7f48ec0c78b0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/3815777999 >> v2:172.21.15.29:3300/0 conn(0x7f48ec159640 0x7f48ec06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.610+0000 7f48f0b9d700 1 -- 172.21.15.12:0/3815777999 >> 172.21.15.12:0/3815777999 conn(0x7f48ec06e720 msgr2=0x7f48ec06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.611+0000 7f48f0b9d700 1 -- 172.21.15.12:0/3815777999 shutdown_connections 2023-10-08T17:24:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.611+0000 7f48f0b9d700 1 -- 172.21.15.12:0/3815777999 wait complete. 2023-10-08T17:24:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.612+0000 7f48f0b9d700 1 Processor -- start 2023-10-08T17:24:54.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.612+0000 7f48f0b9d700 1 -- start start 2023-10-08T17:24:54.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 0x7f48ec16ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48ec159a10 0x7f48ec14f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec152da0 con 0x7f48ec159640 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec14e9b0 con 0x7f48ec159a10 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48f0b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ec0c1f60 con 0x7f48ec0caec0 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48eaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48eaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55672/0 (socket says 172.21.15.12:55672) 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.613+0000 7f48eaffd700 1 -- 172.21.15.12:0/2092284864 learned_addr learned my addr 172.21.15.12:0/2092284864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48ebfff700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48ec159a10 0x7f48ec14f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 0x7f48ec16ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 -- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 msgr2=0x7f48ec16ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 0x7f48ec16ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 -- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48ec159a10 msgr2=0x7f48ec14f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48ec159a10 0x7f48ec14f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 -- 172.21.15.12:0/2092284864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4009ae0 con 0x7f48ec159640 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 0x7f48ec16ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48eaffd700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001eb0 tx=0x7f48e0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48d37fe700 1 -- 172.21.15.12:0/2092284864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e0005a70 con 0x7f48ec159640 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48d37fe700 1 -- 172.21.15.12:0/2092284864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e0005bd0 con 0x7f48ec159640 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec152ac0 con 0x7f48ec159640 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48d37fe700 1 -- 172.21.15.12:0/2092284864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e00070d0 con 0x7f48ec159640 2023-10-08T17:24:54.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.614+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec0c1bf0 con 0x7f48ec159640 2023-10-08T17:24:54.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.616+0000 7f48d37fe700 1 -- 172.21.15.12:0/2092284864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48e0007480 con 0x7f48ec159640 2023-10-08T17:24:54.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.618+0000 7f48d37fe700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.618+0000 7f48d37fe700 1 -- 172.21.15.12:0/2092284864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f48e0083c40 con 0x7f48ec159640 2023-10-08T17:24:54.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.618+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.619+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 0x7f48d80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48dc006fd0 tx=0x7f48dc008040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.620+0000 7f4900564b80 1 Processor -- start 2023-10-08T17:24:54.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.620+0000 7f4900564b80 1 -- start start 2023-10-08T17:24:54.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b63850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b18ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4a6fa70 con 0x55a8f4b63480 2023-10-08T17:24:54.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4a6d270 con 0x55a8f4b18b80 2023-10-08T17:24:54.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4a69060 con 0x55a8f4b165f0 2023-10-08T17:24:54.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55684/0 (socket says 172.21.15.12:55684) 2023-10-08T17:24:54.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 -- 172.21.15.12:0/695200489 learned_addr learned my addr 172.21.15.12:0/695200489 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48ebfff700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b18ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eaffd700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b63850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 -- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 msgr2=0x55a8f4b63850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b63850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 -- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 msgr2=0x55a8f4b18ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b18ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eb7fe700 1 -- 172.21.15.12:0/695200489 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f4903270 con 0x55a8f4b63480 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48ebfff700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b18ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:54.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.621+0000 7f48eaffd700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b63850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:54.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00ea80 tx=0x7f48dc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46afcb8ae3fa04a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f48d0ff9700 1 -- 172.21.15.12:0/695200489 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc0158d0 con 0x55a8f4b63480 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f48d0ff9700 1 -- 172.21.15.12:0/695200489 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc015a30 con 0x55a8f4b63480 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f48d0ff9700 1 -- 172.21.15.12:0/695200489 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc015dd0 con 0x55a8f4b63480 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 -- 172.21.15.12:0/695200489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 msgr2=0x55a8f4b427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00ea80 tx=0x7f48dc015000 comp rx=0 tx=0).stop 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 -- 172.21.15.12:0/695200489 shutdown_connections 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b427d0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b18ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 --2- 172.21.15.12:0/695200489 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b63850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.622+0000 7f4900564b80 1 -- 172.21.15.12:0/695200489 >> 172.21.15.12:0/695200489 conn(0x55a8f4b1a0c0 msgr2=0x55a8f4b1a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.623+0000 7f4900564b80 1 -- 172.21.15.12:0/695200489 shutdown_connections 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.623+0000 7f4900564b80 1 -- 172.21.15.12:0/695200489 wait complete. 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.623+0000 7f4900564b80 1 -- start start 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.623+0000 7f4900564b80 1 Processor -- start 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b45450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 0x55a8f4b60290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4a14890 con 0x55a8f4b165f0 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4a2fea0 con 0x55a8f4b18b80 2023-10-08T17:24:54.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.624+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f48ebe30 con 0x55a8f4b63480 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f4900564b80 10 client.0 _ll_register_callbacks cb 0x55a8f4adc2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55692/0 (socket says 172.21.15.12:55692) 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 -- 172.21.15.12:0/1938136515 learned_addr learned my addr 172.21.15.12:0/1938136515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eaffd700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b45450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48ebfff700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 0x55a8f4b60290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 -- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 msgr2=0x55a8f4b60290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 0x55a8f4b60290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 -- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 msgr2=0x55a8f4b45450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b45450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 -- 172.21.15.12:0/1938136515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48dc00e680 con 0x55a8f4b165f0 2023-10-08T17:24:54.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48ebfff700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 0x55a8f4b60290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eaffd700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f48dc008010 tx=0x7f48dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83efeaa1e89f908 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.625+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc015850 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f48dc020820 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8f4b0dcd0 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48dc020bf0 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 10 client.8895 fetch_fsmap learned FSMap version 74 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a8f48a5fe0 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a8f4b0dcd0 con 0x55a8f4b165f0 2023-10-08T17:24:54.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f48dc02c450 con 0x55a8f4b165f0 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 10 client.8895 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 10 client.8895 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 20 client.8895 populate_metadata read hostname 'smithi012' 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b5f410 0x55a8f4b728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 4 client.8895 mds_command: new command op to 8751 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 --> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8f4aeaaa0 con 0x55a8f4b5f410 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.626+0000 7f48eaffd700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b5f410 0x55a8f4b728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.627+0000 7f48eaffd700 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b5f410 0x55a8f4b728b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac2bdd1437031e2 server_cookie=b7f116860a39de9a in_seq=0 out_seq=0 2023-10-08T17:24:54.631 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.627+0000 7f48c9ffb700 10 client.8895 ms_handle_connect on v2:172.21.15.12:6832/1897099896 2023-10-08T17:24:54.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f48c9ffb700 1 -- 172.21.15.12:0/1938136515 <== mds.0 v2:172.21.15.12:6832/1897099896 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a8f4aeaaa0 con 0x55a8f4b5f410 2023-10-08T17:24:54.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f48c9ffb700 10 client.8895 handle_command_reply: tid=0 2023-10-08T17:24:54.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 client.8895 shutdown 2023-10-08T17:24:54.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 msgr2=0x55a8f4b403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f48dc008010 tx=0x7f48dc018000 comp rx=0 tx=0).stop 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 shutdown_connections 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b5f410 0x55a8f4b728b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b403d0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b63480 0x55a8f4b60290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 --2- 172.21.15.12:0/1938136515 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b45450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 >> 172.21.15.12:0/1938136515 conn(0x55a8f4b1a0c0 msgr2=0x55a8f4b1c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f48c9ffb700 0 client.8895 ms_handle_reset on v2:172.21.15.12:6832/1897099896 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 shutdown_connections 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 1 -- 172.21.15.12:0/1938136515 wait complete. 2023-10-08T17:24:54.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.628+0000 7f4900564b80 20 client.8895 trim_cache size 0 max 16384 2023-10-08T17:24:54.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 Processor -- start 2023-10-08T17:24:54.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 -- start start 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b1a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b6e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4b0dca0 con 0x55a8f4b63480 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4b61ef0 con 0x55a8f4b18b80 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.647+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4af8510 con 0x55a8f4b165f0 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55694/0 (socket says 172.21.15.12:55694) 2023-10-08T17:24:54.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 -- 172.21.15.12:0/732081305 learned_addr learned my addr 172.21.15.12:0/732081305 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b1a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 -- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 msgr2=0x55a8f4b1a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b1a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 -- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 msgr2=0x55a8f4b6e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48eaffd700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b6e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b6e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48ebfff700 1 -- 172.21.15.12:0/732081305 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8f4a37780 con 0x55a8f4b63480 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.648+0000 7f48eaffd700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b6e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f48ebfff700 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009880 tx=0x7f48e4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611864808c7c7a7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f48d17fa700 1 -- 172.21.15.12:0/732081305 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e400be50 con 0x55a8f4b63480 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f48d17fa700 1 -- 172.21.15.12:0/732081305 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e4007200 con 0x55a8f4b63480 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f48d17fa700 1 -- 172.21.15.12:0/732081305 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e4007610 con 0x55a8f4b63480 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 -- 172.21.15.12:0/732081305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 msgr2=0x55a8f4b15a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f48e4009880 tx=0x7f48e4018000 comp rx=0 tx=0).stop 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 -- 172.21.15.12:0/732081305 shutdown_connections 2023-10-08T17:24:54.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b63480 0x55a8f4b15a70 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b165f0 0x55a8f4b1a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.649+0000 7f4900564b80 1 --2- 172.21.15.12:0/732081305 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b18b80 0x55a8f4b6e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.650+0000 7f4900564b80 1 -- 172.21.15.12:0/732081305 >> 172.21.15.12:0/732081305 conn(0x55a8f4b1a0c0 msgr2=0x55a8f4b40e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.650+0000 7f4900564b80 1 -- 172.21.15.12:0/732081305 shutdown_connections 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.650+0000 7f4900564b80 1 -- 172.21.15.12:0/732081305 wait complete. 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.650+0000 7f4900564b80 1 -- start start 2023-10-08T17:24:54.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.650+0000 7f4900564b80 1 Processor -- start 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b18b80 0x55a8f4b3f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b63480 0x55a8f4bc29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4b45f80 con 0x55a8f4b165f0 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4b3f270 con 0x55a8f4b63480 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a8f4bc2ef0 con 0x55a8f4b18b80 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.651+0000 7f4900564b80 10 client.0 _ll_register_callbacks cb 0x55a8f4adc2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55696/0 (socket says 172.21.15.12:55696) 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 -- 172.21.15.12:0/7313390 learned_addr learned my addr 172.21.15.12:0/7313390 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.656 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48ebfff700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b63480 0x55a8f4bc29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eaffd700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b18b80 0x55a8f4b3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 -- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b18b80 msgr2=0x55a8f4b3f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b18b80 0x55a8f4b3f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 -- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b63480 msgr2=0x55a8f4bc29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b63480 0x55a8f4bc29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 -- 172.21.15.12:0/7313390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ec06db00 con 0x55a8f4b165f0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48eb7fe700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009740 tx=0x7f48dc029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f07c156f032a90 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc020820 con 0x55a8f4b165f0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f48dc0157d0 con 0x55a8f4b165f0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.652+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48ec16c580 con 0x55a8f4b165f0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48dc02c910 con 0x55a8f4b165f0 2023-10-08T17:24:54.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 10 client.8901 fetch_fsmap learned FSMap version 74 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55a8f4a1e470 con 0x55a8f4b165f0 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec16c580 con 0x55a8f4b165f0 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f48dc02a400 con 0x55a8f4b165f0 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 10 client.8901 fetch_fsmap finished waiting for FSMap version 74 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 10 client.8901 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 20 client.8901 populate_metadata read hostname 'smithi012' 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b45820 0x55a8f4b15a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 4 client.8901 mds_command: new command op to 8751 tid=0[{"prefix": "status"}] 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 --> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f48dc015a30 con 0x55a8f4b45820 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.653+0000 7f48eaffd700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b45820 0x55a8f4b15a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f48eaffd700 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b45820 0x55a8f4b15a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3cdb4fa5d159799 server_cookie=4e2396f1cc88ceb4 in_seq=0 out_seq=0 2023-10-08T17:24:54.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f48c9ffb700 10 client.8901 ms_handle_connect on v2:172.21.15.12:6832/1897099896 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f48c9ffb700 1 -- 172.21.15.12:0/7313390 <== mds.0 v2:172.21.15.12:6832/1897099896 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f48dc015a30 con 0x55a8f4b45820 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f48c9ffb700 10 client.8901 handle_command_reply: tid=0 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 client.8901 shutdown 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 msgr2=0x55a8f4b19490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f48dc009740 tx=0x7f48dc029000 comp rx=0 tx=0).stop 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 shutdown_connections 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:6832/1897099896,v1:172.21.15.12:6834/1897099896] conn(0x55a8f4b45820 0x55a8f4b15a70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55a8f4b165f0 0x55a8f4b19490 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55a8f4b63480 0x55a8f4bc29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 --2- 172.21.15.12:0/7313390 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55a8f4b18b80 0x55a8f4b3f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 >> 172.21.15.12:0/7313390 conn(0x55a8f4b1a0c0 msgr2=0x55a8f4b6e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.654+0000 7f48c9ffb700 0 client.8901 ms_handle_reset on v2:172.21.15.12:6832/1897099896 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 shutdown_connections 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f4900564b80 1 -- 172.21.15.12:0/7313390 wait complete. 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f4900564b80 20 client.8901 trim_cache size 0 max 16384 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 8751, 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T17:24:54.660 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.5300395120000001, 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 74, 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 168, 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 168, 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 19.029437209000001 2023-10-08T17:24:54.661 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 msgr2=0x7f48d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 0x7f48d80693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f48dc006fd0 tx=0x7f48dc008040 comp rx=0 tx=0).stop 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 msgr2=0x7f48ec13bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f48e0001eb0 tx=0x7f48e0007f40 comp rx=0 tx=0).stop 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 shutdown_connections 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48d8066f30 0x7f48d80693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48ec159a10 0x7f48ec14f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48ec0caec0 0x7f48ec16ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 --2- 172.21.15.12:0/2092284864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48ec159640 0x7f48ec13bb10 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 >> 172.21.15.12:0/2092284864 conn(0x7f48ec06e720 msgr2=0x7f48ec1587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.655+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 shutdown_connections 2023-10-08T17:24:54.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.656+0000 7f48f0b9d700 1 -- 172.21.15.12:0/2092284864 wait complete. 2023-10-08T17:24:54.672 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T17:24:54.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.860+0000 7f0e9e39d700 1 Processor -- start 2023-10-08T17:24:54.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.860+0000 7f0e9e39d700 1 -- start start 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9e39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e98142c00 0x7f0e9806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e980c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9e39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980ca480 con 0x7f0e98142fd0 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9e39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9815e240 con 0x7f0e98142c00 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9806b350 con 0x7f0e9806bd20 2023-10-08T17:24:54.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9db9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0e98142fd0 0x7f0e9806c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46394/0 (socket says 172.21.15.12:46394) 2023-10-08T17:24:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9db9c700 1 -- 172.21.15.12:0/3731812201 learned_addr learned my addr 172.21.15.12:0/3731812201 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9cb9a700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e980c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.862+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/3731812201 >> v2:172.21.15.29:3300/0 conn(0x7f0e98142c00 0x7f0e9806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793926690 0 0) 0x7f0e980ca480 con 0x7f0e98142fd0 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e84003570 con 0x7f0e98142fd0 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3938111601 0 0) 0x7f0e84003570 con 0x7f0e98142fd0 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 msgr2=0x7f0e980c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e980c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 >> v2:172.21.15.29:3300/0 conn(0x7f0e98142c00 msgr2=0x7f0e9806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 --2- 172.21.15.12:0/3731812201 >> v2:172.21.15.29:3300/0 conn(0x7f0e98142c00 0x7f0e9806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9815df60 con 0x7f0e98142fd0 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f0e900017f0 con 0x7f0e98142fd0 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e9cb9a700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e980c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 >> v1:172.21.15.12:6789/0 conn(0x7f0e98142fd0 legacy=0x7f0e9806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e84004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e84004d50 0x7f0e840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9815e240 con 0x7f0e84003a60 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9806b350 con 0x7f0e84004d50 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8400bae0 con 0x7f0e9806bd20 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e84003a60 0x7f0e84003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e9cb9a700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e84004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.863+0000 7f0e9db9c700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e84004d50 0x7f0e840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 -- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 msgr2=0x7f0e84004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e9806bd20 0x7f0e84004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 -- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e84004d50 msgr2=0x7f0e840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e84004d50 0x7f0e840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 -- 172.21.15.12:0/3731812201 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e88009420 con 0x7f0e84003a60 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e84003a60 0x7f0e84003e70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009c00 tx=0x7f0e940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7781bc2d6ecd707b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400e710 con 0x7f0e84003a60 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9400e870 con 0x7f0e84003a60 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.864+0000 7f0e8ffff700 1 -- 172.21.15.12:0/3731812201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9400ec30 con 0x7f0e84003a60 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 -- 172.21.15.12:0/3731812201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e84003a60 msgr2=0x7f0e84003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/3731812201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e84003a60 0x7f0e84003e70 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0e94009c00 tx=0x7f0e940091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9db9c700 1 -- 172.21.15.12:0/3731812201 reap_dead start 2023-10-08T17:24:54.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 -- 172.21.15.12:0/3731812201 shutdown_connections 2023-10-08T17:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 -- 172.21.15.12:0/3731812201 >> 172.21.15.12:0/3731812201 conn(0x7f0e980675a0 msgr2=0x7f0e980679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 -- 172.21.15.12:0/3731812201 shutdown_connections 2023-10-08T17:24:54.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.865+0000 7f0e9e39d700 1 -- 172.21.15.12:0/3731812201 wait complete. 2023-10-08T17:24:54.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.866+0000 7f0e9e39d700 1 Processor -- start 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.867+0000 7f0e9e39d700 1 -- start start 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.867+0000 7f0e9e39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e84003a60 0x7f0e980c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.867+0000 7f0e9e39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98158a60 0x7f0e980b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.867+0000 7f0e9e39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9e39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b1790 con 0x7f0e980b23e0 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9e39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98159310 con 0x7f0e98158a60 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9e39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980c49d0 con 0x7f0e84003a60 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55718/0 (socket says 172.21.15.12:55718) 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 -- 172.21.15.12:0/469705890 learned_addr learned my addr 172.21.15.12:0/469705890 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9cb9a700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98158a60 0x7f0e980b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e84003a60 0x7f0e980c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 -- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e84003a60 msgr2=0x7f0e980c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e84003a60 0x7f0e980c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 -- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98158a60 msgr2=0x7f0e980b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98158a60 0x7f0e980b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 -- 172.21.15.12:0/469705890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980c4cb0 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.868+0000 7f0e9db9c700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0e981433a0 tx=0x7f0e9806b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.869+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90017070 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.869+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000ebc0 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.869+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e980c4f90 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.869+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90013420 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.869+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e98158510 con 0x7f0e980b23e0 2023-10-08T17:24:54.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.870+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9804c3c0 con 0x7f0e980b23e0 2023-10-08T17:24:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.871+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e900137d0 con 0x7f0e980b23e0 2023-10-08T17:24:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.871+0000 7f0e8d7fa700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 0x7f0e7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.872+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0e90084610 con 0x7f0e980b23e0 2023-10-08T17:24:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.872+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 0x7f0e7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:54.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.872+0000 7f0e9d39b700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 0x7f0e7c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e940091e0 tx=0x7f0e9401a000 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:54.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:54.876+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e90051610 con 0x7f0e980b23e0 2023-10-08T17:24:55.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.126+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e9806ad00 con 0x7f0e980b23e0 2023-10-08T17:24:55.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.127+0000 7f0e8d7fa700 1 -- 172.21.15.12:0/469705890 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0e90054c30 con 0x7f0e980b23e0 2023-10-08T17:24:55.127 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 msgr2=0x7f0e7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 0x7f0e7c0693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0e940091e0 tx=0x7f0e9401a000 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 msgr2=0x7f0e980c2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f0e981433a0 tx=0x7f0e9806b2c0 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 shutdown_connections 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0e7c066f30 0x7f0e7c0693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e980b23e0 0x7f0e980c2ba0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e84003a60 0x7f0e980c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 --2- 172.21.15.12:0/469705890 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e98158a60 0x7f0e980b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 >> 172.21.15.12:0/469705890 conn(0x7f0e980675a0 msgr2=0x7f0e980c3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:55.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 shutdown_connections 2023-10-08T17:24:55.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:55.129+0000 7f0e9e39d700 1 -- 172.21.15.12:0/469705890 wait complete. 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T17:24:55.148 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:24:55.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.150 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:24:55.188 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 37647sec preferred_lft 37647sec 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:24:55.189 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T17:24:55.190 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:24:55.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.191 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T17:24:55.288 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T17:24:55.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.291 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T17:24:55.330 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T17:24:55.330 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T17:24:55.330 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T17:24:55.330 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T17:24:55.330 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T17:24:55.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T17:24:55.332 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T17:24:55.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.530 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:24:55.568 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T17:24:55.568 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T17:24:55.568 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:24:55.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T17:24:55.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:24:55.671 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T17:24:55.707 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:24:55.708 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:24:55.708 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:24:55.784 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T17:24:55.784 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T17:24:55.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:24:55.917 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:24:55.917 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:24:55.945 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:24:55.945 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:24:55.945 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T17:24:55.946 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T17:24:55.946 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T17:24:55.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T17:24:55.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:24:55.950 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:24:56.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T17:24:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.206+0000 7f019d19d700 1 Processor -- start 2023-10-08T17:24:56.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.207+0000 7f019d19d700 1 -- start start 2023-10-08T17:24:56.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019d19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f019813fb20 0x7f019815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019d19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f019806aaa0 0x7f01980c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019d19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019815ae70 con 0x7f019813fef0 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019d19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806af60 con 0x7f019806aaa0 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019d19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019806b240 con 0x7f019813fb20 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019c99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f019806aaa0 0x7f01980c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019c99c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f019806aaa0 0x7f01980c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55726/0 (socket says 172.21.15.12:55726) 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f019c99c700 1 -- 172.21.15.12:0/3943630562 learned_addr learned my addr 172.21.15.12:0/3943630562 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.208+0000 7f0197fff700 1 --2- 172.21.15.12:0/3943630562 >> v2:172.21.15.29:3300/0 conn(0x7f019813fb20 0x7f019815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f019c99c700 1 -- 172.21.15.12:0/3943630562 >> v2:172.21.15.29:3300/0 conn(0x7f019813fb20 msgr2=0x7f019815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f019c99c700 1 --2- 172.21.15.12:0/3943630562 >> v2:172.21.15.29:3300/0 conn(0x7f019813fb20 0x7f019815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f019c99c700 1 -- 172.21.15.12:0/3943630562 >> v1:172.21.15.12:6789/0 conn(0x7f019813fef0 legacy=0x7f01980c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f019c99c700 1 -- 172.21.15.12:0/3943630562 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019806b520 con 0x7f019806aaa0 2023-10-08T17:24:56.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f0196ffd700 1 -- 172.21.15.12:0/3943630562 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939403178 0 0) 0x7f018c001180 con 0x7f019813fef0 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f019c99c700 1 --2- 172.21.15.12:0/3943630562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019806aaa0 0x7f01980c9d00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f01980695b0 tx=0x7f0190009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8571c775cc22b52 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f0196ffd700 1 -- 172.21.15.12:0/3943630562 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019000e070 con 0x7f019806aaa0 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f0196ffd700 1 -- 172.21.15.12:0/3943630562 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000ba20 con 0x7f019806aaa0 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.209+0000 7f0196ffd700 1 -- 172.21.15.12:0/3943630562 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900092e0 con 0x7f019806aaa0 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 -- 172.21.15.12:0/3943630562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019806aaa0 msgr2=0x7f01980c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 --2- 172.21.15.12:0/3943630562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019806aaa0 0x7f01980c9d00 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f01980695b0 tx=0x7f0190009840 comp rx=0 tx=0).stop 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 -- 172.21.15.12:0/3943630562 shutdown_connections 2023-10-08T17:24:56.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 --2- 172.21.15.12:0/3943630562 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019806aaa0 0x7f01980c9d00 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 --2- 172.21.15.12:0/3943630562 >> v2:172.21.15.29:3300/0 conn(0x7f019813fb20 0x7f019815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 -- 172.21.15.12:0/3943630562 >> 172.21.15.12:0/3943630562 conn(0x7f019806d170 msgr2=0x7f01980cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 -- 172.21.15.12:0/3943630562 shutdown_connections 2023-10-08T17:24:56.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.210+0000 7f019d19d700 1 -- 172.21.15.12:0/3943630562 wait complete. 2023-10-08T17:24:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.211+0000 7f019d19d700 1 Processor -- start 2023-10-08T17:24:56.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.212+0000 7f019d19d700 1 -- start start 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 0x7f01980c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f019813fb20 0x7f019815cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01980c15c0 con 0x7f019813fef0 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019815d460 con 0x7f019806aaa0 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980c0f70 con 0x7f019813fb20 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55740/0 (socket says 172.21.15.12:55740) 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 -- 172.21.15.12:0/4078998671 learned_addr learned my addr 172.21.15.12:0/4078998671 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f0197fff700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 0x7f01980c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f01977fe700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f019813fb20 0x7f019815cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 -- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f019813fb20 msgr2=0x7f019815cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f019813fb20 0x7f019815cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 -- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 msgr2=0x7f01980c1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 0x7f01980c1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f019c99c700 1 -- 172.21.15.12:0/4078998671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190009ae0 con 0x7f019813fef0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.213+0000 7f0197fff700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 0x7f01980c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f019c99c700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0190012000 tx=0x7f0190018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0190008c20 con 0x7f019813fef0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0190008da0 con 0x7f019813fef0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01980c1250 con 0x7f019813fef0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01900266b0 con 0x7f019813fef0 2023-10-08T17:24:56.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.214+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019815d740 con 0x7f019813fef0 2023-10-08T17:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.215+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01980c1730 con 0x7f019813fef0 2023-10-08T17:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.216+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0190003040 con 0x7f019813fef0 2023-10-08T17:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.217+0000 7f017ffff700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.217+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0190086830 con 0x7f019813fef0 2023-10-08T17:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.217+0000 7f0197fff700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.218+0000 7f0197fff700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 0x7f01840693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d80 tx=0x7f0188008040 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.221+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01900538e0 con 0x7f019813fef0 2023-10-08T17:24:56.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.450+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f019804c3c0 con 0x7f0184066f30 2023-10-08T17:24:56.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.452+0000 7f017ffff700 1 -- 172.21.15.12:0/4078998671 <== mgr.8544 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f019804c3c0 con 0x7f0184066f30 2023-10-08T17:24:56.452 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:24:56.452 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:24:56.452 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T17:24:56.452 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:24:56.452 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 msgr2=0x7f01840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 0x7f01840693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0188009d80 tx=0x7f0188008040 comp rx=0 tx=0).stop 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 msgr2=0x7f01980c7840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0190012000 tx=0x7f0190018000 comp rx=0 tx=0).stop 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 shutdown_connections 2023-10-08T17:24:56.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f019813fef0 0x7f01980c7840 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f019806aaa0 0x7f01980c1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 --2- 172.21.15.12:0/4078998671 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f019813fb20 0x7f019815cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 >> 172.21.15.12:0/4078998671 conn(0x7f019806d170 msgr2=0x7f01980aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 shutdown_connections 2023-10-08T17:24:56.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.454+0000 7f019d19d700 1 -- 172.21.15.12:0/4078998671 wait complete. 2023-10-08T17:24:56.471 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T17:24:56.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.660+0000 7f1ae759e700 1 Processor -- start 2023-10-08T17:24:56.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.660+0000 7f1ae759e700 1 -- start start 2023-10-08T17:24:56.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.661+0000 7f1ae759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.661+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 0x7f1ae813fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.661+0000 7f1ae759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae8140120 con 0x7f1ae80c7be0 2023-10-08T17:24:56.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.661+0000 7f1ae759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae806bf10 con 0x7f1ae80c7fb0 2023-10-08T17:24:56.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.661+0000 7f1ae759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae806b290 con 0x7f1ae813f780 2023-10-08T17:24:56.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.662+0000 7f1ae5d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.662+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 0x7f1ae813fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.662+0000 7f1ae5d9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46594/0 (socket says 172.21.15.12:46594) 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.662+0000 7f1ae5d9b700 1 -- 172.21.15.12:0/1208743119 learned_addr learned my addr 172.21.15.12:0/1208743119 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.662+0000 7f1ae559a700 1 -- 172.21.15.12:0/1208743119 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817397171 0 0) 0x7f1ad8001110 con 0x7f1ae80c7be0 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae559a700 1 -- 172.21.15.12:0/1208743119 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad0003570 con 0x7f1ae80c7be0 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/1208743119 >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 msgr2=0x7f1ae806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae6d9d700 1 --2- 172.21.15.12:0/1208743119 >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/1208743119 >> v1:172.21.15.29:6789/0 conn(0x7f1ae80c7be0 legacy=0x7f1ae815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/1208743119 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae806b570 con 0x7f1ae813f780 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae5d9b700 1 --2- 172.21.15.12:0/1208743119 >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae6d9d700 1 --2- 172.21.15.12:0/1208743119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 0x7f1ae813fbe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009e60 tx=0x7f1ae0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e18538025c5525b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae559a700 1 -- 172.21.15.12:0/1208743119 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000e070 con 0x7f1ae813f780 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae559a700 1 -- 172.21.15.12:0/1208743119 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae000bab0 con 0x7f1ae813f780 2023-10-08T17:24:56.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.663+0000 7f1ae559a700 1 -- 172.21.15.12:0/1208743119 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae000be70 con 0x7f1ae813f780 2023-10-08T17:24:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 -- 172.21.15.12:0/1208743119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 msgr2=0x7f1ae813fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 --2- 172.21.15.12:0/1208743119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 0x7f1ae813fbe0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009e60 tx=0x7f1ae0009780 comp rx=0 tx=0).stop 2023-10-08T17:24:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 -- 172.21.15.12:0/1208743119 shutdown_connections 2023-10-08T17:24:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 --2- 172.21.15.12:0/1208743119 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae813f780 0x7f1ae813fbe0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 --2- 172.21.15.12:0/1208743119 >> v2:172.21.15.29:3300/0 conn(0x7f1ae80c7fb0 0x7f1ae806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 -- 172.21.15.12:0/1208743119 >> 172.21.15.12:0/1208743119 conn(0x7f1ae806d110 msgr2=0x7f1ae80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:56.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 -- 172.21.15.12:0/1208743119 shutdown_connections 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.664+0000 7f1ae759e700 1 -- 172.21.15.12:0/1208743119 wait complete. 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.665+0000 7f1ae759e700 1 Processor -- start 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.665+0000 7f1ae759e700 1 -- start start 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae80c7be0 0x7f1ae813dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae80c7fb0 0x7f1ae815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae81675a0 con 0x7f1ae813f780 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae815b330 con 0x7f1ae80c7be0 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.666+0000 7f1ae759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae815b610 con 0x7f1ae80c7fb0 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55754/0 (socket says 172.21.15.12:55754) 2023-10-08T17:24:56.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/273630369 learned_addr learned my addr 172.21.15.12:0/273630369 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae5d9b700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae80c7fb0 0x7f1ae815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae659c700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae80c7be0 0x7f1ae813dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae80c7fb0 msgr2=0x7f1ae815a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae80c7fb0 0x7f1ae815a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae80c7be0 msgr2=0x7f1ae813dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae80c7be0 0x7f1ae813dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 -- 172.21.15.12:0/273630369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0094f0 con 0x7f1ae813f780 2023-10-08T17:24:56.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.667+0000 7f1ae6d9d700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1ae806b3d0 tx=0x7f1ae0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.668+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0012e50 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.668+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae0027470 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.668+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0027830 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.668+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae0009a20 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.668+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae815bbd0 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.669+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae8167710 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.670+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 72) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ae0024070 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.671+0000 7f1ad67fc700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.671+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f1ae0086e80 con 0x7f1ae813f780 2023-10-08T17:24:56.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.671+0000 7f1ae659c700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:56.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.672+0000 7f1ae659c700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 0x7f1ac80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8002a30 tx=0x7f1ad8007bc0 comp rx=0 tx=0).ready entity=mgr.8544 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:56.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.675+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ae0053e80 con 0x7f1ae813f780 2023-10-08T17:24:56.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:56.932+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f1ae804c3c0 con 0x7f1ae813f780 2023-10-08T17:24:57.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.709+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 73) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f1ae0003040 con 0x7f1ae813f780 2023-10-08T17:24:57.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.710+0000 7f1ad67fc700 1 -- 172.21.15.12:0/273630369 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v73) v1 ==== 92+0+0 (secure 0 0 0) 0x7f1ae0057910 con 0x7f1ae813f780 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 msgr2=0x7f1ac80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 0x7f1ac80693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8002a30 tx=0x7f1ad8007bc0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 msgr2=0x7f1ae8167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f1ae806b3d0 tx=0x7f1ae0019000 comp rx=0 tx=0).stop 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 shutdown_connections 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ac8066f30 0x7f1ac80693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae813f780 0x7f1ae8167a30 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae80c7be0 0x7f1ae813dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 --2- 172.21.15.12:0/273630369 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae80c7fb0 0x7f1ae815a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.713+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 >> 172.21.15.12:0/273630369 conn(0x7f1ae806d110 msgr2=0x7f1ae80cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.714+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 shutdown_connections 2023-10-08T17:24:57.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.714+0000 7f1ae759e700 1 -- 172.21.15.12:0/273630369 wait complete. 2023-10-08T17:24:57.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T17:24:57.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.934+0000 7f4d97fff700 1 Processor -- start 2023-10-08T17:24:57.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.935+0000 7f4d97fff700 1 -- start start 2023-10-08T17:24:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d97fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d98153a00 0x7f4d98153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d980cea00 0x7f4d980cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d97fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9815ac50 con 0x7f4d9815de50 2023-10-08T17:24:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d97fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9815d010 con 0x7f4d98153a00 2023-10-08T17:24:57.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d97fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980cf3c0 con 0x7f4d980cea00 2023-10-08T17:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d96ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d98153a00 0x7f4d98153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d967fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d9815de50 0x7f4d9815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46426/0 (socket says 172.21.15.12:46426) 2023-10-08T17:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d967fc700 1 -- 172.21.15.12:0/1959007017 learned_addr learned my addr 172.21.15.12:0/1959007017 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:57.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.936+0000 7f4d977fe700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d980cea00 0x7f4d980cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d96ffd700 1 -- 172.21.15.12:0/1959007017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d980cea00 msgr2=0x7f4d980cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:57.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d96ffd700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d980cea00 0x7f4d980cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d96ffd700 1 -- 172.21.15.12:0/1959007017 >> v1:172.21.15.12:6789/0 conn(0x7f4d9815de50 legacy=0x7f4d9815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d96ffd700 1 -- 172.21.15.12:0/1959007017 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9815af60 con 0x7f4d98153a00 2023-10-08T17:24:57.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1959007017 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1325882154 0 0) 0x7f4d9815ac50 con 0x7f4d9815de50 2023-10-08T17:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d96ffd700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98153dd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4d880098e0 tx=0x7f4d880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6630ab83f1d7d139 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1959007017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800b640 con 0x7f4d98153a00 2023-10-08T17:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1959007017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8800b7a0 con 0x7f4d98153a00 2023-10-08T17:24:57.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.937+0000 7f4d95ffb700 1 -- 172.21.15.12:0/1959007017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8800bb40 con 0x7f4d98153a00 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 -- 172.21.15.12:0/1959007017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 msgr2=0x7f4d98153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98153dd0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f4d880098e0 tx=0x7f4d880091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 -- 172.21.15.12:0/1959007017 shutdown_connections 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d980cea00 0x7f4d980cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1959007017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98153dd0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 -- 172.21.15.12:0/1959007017 >> 172.21.15.12:0/1959007017 conn(0x7f4d980703a0 msgr2=0x7f4d980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 -- 172.21.15.12:0/1959007017 shutdown_connections 2023-10-08T17:24:57.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.938+0000 7f4d97fff700 1 -- 172.21.15.12:0/1959007017 wait complete. 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.939+0000 7f4d97fff700 1 Processor -- start 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.940+0000 7f4d97fff700 1 -- start start 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d980cea00 0x7f4d980b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d9815de50 0x7f4d98152b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9816a350 con 0x7f4d98153a00 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9816a070 con 0x7f4d980cea00 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d97fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d981576f0 con 0x7f4d9815de50 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:57.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55774/0 (socket says 172.21.15.12:55774) 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 -- 172.21.15.12:0/1517331874 learned_addr learned my addr 172.21.15.12:0/1517331874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d96ffd700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d980cea00 0x7f4d980b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d977fe700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d9815de50 0x7f4d98152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d9815de50 msgr2=0x7f4d98152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d9815de50 0x7f4d98152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d980cea00 msgr2=0x7f4d980b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d980cea00 0x7f4d980b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.941+0000 7f4d967fc700 1 -- 172.21.15.12:0/1517331874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009420 con 0x7f4d98153a00 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d967fc700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c5b0 tx=0x7f4d8c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c005b30 con 0x7f4d98153a00 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8c005c90 con 0x7f4d98153a00 2023-10-08T17:24:57.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c007300 con 0x7f4d98153a00 2023-10-08T17:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d981579d0 con 0x7f4d98153a00 2023-10-08T17:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.942+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d981550c0 con 0x7f4d98153a00 2023-10-08T17:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.943+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d981552e0 con 0x7f4d98153a00 2023-10-08T17:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.944+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 73) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f4d8c01b3b0 con 0x7f4d98153a00 2023-10-08T17:24:57.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.945+0000 7f4d7effd700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 0x7f4d84069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.945+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f4d8c083c00 con 0x7f4d98153a00 2023-10-08T17:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.945+0000 7f4d96ffd700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 msgr2=0x7f4d84069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:57.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.945+0000 7f4d96ffd700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 0x7f4d84069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:57.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:57.953+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d8c050c00 con 0x7f4d98153a00 2023-10-08T17:24:58.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.146+0000 7f4d96ffd700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 msgr2=0x7f4d84069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:58.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.146+0000 7f4d96ffd700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 0x7f4d84069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:58.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.159+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f4d98157550 con 0x7f4d98153a00 2023-10-08T17:24:58.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.164+0000 7f4d7effd700 1 -- 172.21.15.12:0/1517331874 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d98157550 con 0x7f4d98153a00 2023-10-08T17:24:58.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 msgr2=0x7f4d84069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:58.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 0x7f4d84069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 msgr2=0x7f4d98154b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c00c5b0 tx=0x7f4d8c001070 comp rx=0 tx=0).stop 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 shutdown_connections 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4d84066f80 0x7f4d84069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d9815de50 0x7f4d98152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d980cea00 0x7f4d980b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 --2- 172.21.15.12:0/1517331874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d98153a00 0x7f4d98154b80 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 >> 172.21.15.12:0/1517331874 conn(0x7f4d980703a0 msgr2=0x7f4d980c62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 shutdown_connections 2023-10-08T17:24:58.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.167+0000 7f4d97fff700 1 -- 172.21.15.12:0/1517331874 wait complete. 2023-10-08T17:24:58.185 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T17:24:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.377+0000 7fe2e0b9d700 1 Processor -- start 2023-10-08T17:24:58.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.377+0000 7fe2e0b9d700 1 -- start start 2023-10-08T17:24:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.378+0000 7fe2e0b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe2dc153dd0 0x7fe2dc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.378+0000 7fe2e0b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2dc0cea00 0x7fe2dc0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.378+0000 7fe2e0b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2dc15ac50 con 0x7fe2dc153a00 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2e0b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc15d010 con 0x7fe2dc153dd0 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2e0b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2dc0cf3e0 con 0x7fe2dc0cea00 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe2dc153dd0 0x7fe2dc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2db7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe2dc153a00 0x7fe2dc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:54440/0 (socket says 172.21.15.12:54440) 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe2dc153dd0 0x7fe2dc15de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55778/0 (socket says 172.21.15.12:55778) 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2db7fe700 1 -- 172.21.15.12:0/1611400072 learned_addr learned my addr 172.21.15.12:0/1611400072 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2dbfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe2dc0cea00 0x7fe2dc0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 -- 172.21.15.12:0/1611400072 >> v2:172.21.15.29:3300/0 conn(0x7fe2dc0cea00 msgr2=0x7fe2dc0ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2da7fc700 1 -- 172.21.15.12:0/1611400072 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4159007738 0 0) 0x7fe2dc15ac50 con 0x7fe2dc153a00 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 --2- 172.21.15.12:0/1611400072 >> v2:172.21.15.29:3300/0 conn(0x7fe2dc0cea00 0x7fe2dc0ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 -- 172.21.15.12:0/1611400072 >> v1:172.21.15.29:6789/0 conn(0x7fe2dc153a00 legacy=0x7fe2dc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.379+0000 7fe2daffd700 1 -- 172.21.15.12:0/1611400072 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc15af60 con 0x7fe2dc153dd0 2023-10-08T17:24:58.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2daffd700 1 --2- 172.21.15.12:0/1611400072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc15de50 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0d03b0 tx=0x7fe2d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e8e2c2e15e6f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:58.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2da7fc700 1 -- 172.21.15.12:0/1611400072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011630 con 0x7fe2dc153dd0 2023-10-08T17:24:58.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2da7fc700 1 -- 172.21.15.12:0/1611400072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0011790 con 0x7fe2dc153dd0 2023-10-08T17:24:58.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2da7fc700 1 -- 172.21.15.12:0/1611400072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0011b30 con 0x7fe2dc153dd0 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/1611400072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153dd0 msgr2=0x7fe2dc15de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.380+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/1611400072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc15de50 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0d03b0 tx=0x7fe2d00091a0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/1611400072 shutdown_connections 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/1611400072 >> v2:172.21.15.29:3300/0 conn(0x7fe2dc0cea00 0x7fe2dc0ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/1611400072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc15de50 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/1611400072 >> 172.21.15.12:0/1611400072 conn(0x7fe2dc0703a0 msgr2=0x7fe2dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/1611400072 shutdown_connections 2023-10-08T17:24:58.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.381+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/1611400072 wait complete. 2023-10-08T17:24:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.382+0000 7fe2e0b9d700 1 Processor -- start 2023-10-08T17:24:58.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.382+0000 7fe2e0b9d700 1 -- start start 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 0x7fe2dc169e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc16a350 con 0x7fe2dc153a00 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc169980 con 0x7fe2dc153dd0 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2e0b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2dc169360 con 0x7fe2dc0cea00 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2daffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55794/0 (socket says 172.21.15.12:55794) 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2db7fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 0x7fe2dc169e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.383+0000 7fe2daffd700 1 -- 172.21.15.12:0/3840155688 learned_addr learned my addr 172.21.15.12:0/3840155688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2dbfff700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 msgr2=0x7fe2dc169e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 0x7fe2dc169e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 msgr2=0x7fe2dc159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 -- 172.21.15.12:0/3840155688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d0009420 con 0x7fe2dc153a00 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2db7fe700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 0x7fe2dc169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2dbfff700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:58.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.384+0000 7fe2daffd700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06eb00 tx=0x7fe2d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.385+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0000d10 con 0x7fe2dc153a00 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.385+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d0011b10 con 0x7fe2dc153a00 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.385+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d0025640 con 0x7fe2dc153a00 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.385+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2dc156cb0 con 0x7fe2dc153a00 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.385+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2dc169610 con 0x7fe2dc153a00 2023-10-08T17:24:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.386+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2dc169b10 con 0x7fe2dc153a00 2023-10-08T17:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.388+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 73) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe2d0025a30 con 0x7fe2dc153a00 2023-10-08T17:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.389+0000 7fe2c37fe700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.389+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe2d0086710 con 0x7fe2dc153a00 2023-10-08T17:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.389+0000 7fe2db7fe700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.389+0000 7fe2db7fe700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:58.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.391+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d0053790 con 0x7fe2dc153a00 2023-10-08T17:24:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.590+0000 7fe2db7fe700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:58.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.590+0000 7fe2db7fe700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:58.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.596+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe2dc04c3c0 con 0x7fe2dc153a00 2023-10-08T17:24:58.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.601+0000 7fe2c37fe700 1 -- 172.21.15.12:0/3840155688 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe2d00150c0 con 0x7fe2dc153a00 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.603+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 msgr2=0x7fe2c8069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.603+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 msgr2=0x7fe2dc159390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc06eb00 tx=0x7fe2d0017000 comp rx=0 tx=0).stop 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 shutdown_connections 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe2c8066f80 0x7fe2c8069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe2dc153dd0 0x7fe2dc159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe2dc0cea00 0x7fe2dc169e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 --2- 172.21.15.12:0/3840155688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe2dc153a00 0x7fe2dc159390 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 >> 172.21.15.12:0/3840155688 conn(0x7fe2dc0703a0 msgr2=0x7fe2dc0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 shutdown_connections 2023-10-08T17:24:58.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.604+0000 7fe2e0b9d700 1 -- 172.21.15.12:0/3840155688 wait complete. 2023-10-08T17:24:58.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:24:58.622 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T17:24:58.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-10-08T17:24:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.901+0000 7f7c6359e700 1 Processor -- start 2023-10-08T17:24:58.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.902+0000 7f7c6359e700 1 -- start start 2023-10-08T17:24:58.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 0x7f7c640b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640b0c80 con 0x7f7c640b24f0 2023-10-08T17:24:58.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640b0f60 con 0x7f7c64159800 2023-10-08T17:24:58.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640d10d0 con 0x7f7c640b1d40 2023-10-08T17:24:58.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6259c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7c640b24f0 0x7f7c641590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:46432/0 (socket says 172.21.15.12:46432) 2023-10-08T17:24:58.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c6259c700 1 -- 172.21.15.12:0/2486928528 learned_addr learned my addr 172.21.15.12:0/2486928528 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:24:58.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.903+0000 7f7c62d9d700 1 --2- 172.21.15.12:0/2486928528 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 0x7f7c640b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286446262 0 0) 0x7f7c640b0f60 con 0x7f7c64159800 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c4c003570 con 0x7f7c64159800 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519709895 0 0) 0x7f7c640b0c80 con 0x7f7c640b24f0 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c640b0f60 con 0x7f7c640b24f0 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c62d9d700 1 -- 172.21.15.12:0/2486928528 >> v1:172.21.15.29:6789/0 conn(0x7f7c64159800 legacy=0x7f7c640b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c62d9d700 1 -- 172.21.15.12:0/2486928528 >> v1:172.21.15.12:6789/0 conn(0x7f7c640b24f0 legacy=0x7f7c641590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c62d9d700 1 -- 172.21.15.12:0/2486928528 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640b1240 con 0x7f7c640b1d40 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.904+0000 7f7c62d9d700 1 --2- 172.21.15.12:0/2486928528 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 0x7f7c640b0580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009e90 tx=0x7f7c5c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23168cf7aea80d55 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00e070 con 0x7f7c640b1d40 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00bb80 con 0x7f7c640b1d40 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6159a700 1 -- 172.21.15.12:0/2486928528 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c012430 con 0x7f7c640b1d40 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 -- 172.21.15.12:0/2486928528 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 msgr2=0x7f7c640b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2486928528 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 0x7f7c640b0580 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009e90 tx=0x7f7c5c009780 comp rx=0 tx=0).stop 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 -- 172.21.15.12:0/2486928528 shutdown_connections 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2486928528 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c640b1d40 0x7f7c640b0580 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 -- 172.21.15.12:0/2486928528 >> 172.21.15.12:0/2486928528 conn(0x7f7c640703a0 msgr2=0x7f7c640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 -- 172.21.15.12:0/2486928528 shutdown_connections 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.905+0000 7f7c6359e700 1 -- 172.21.15.12:0/2486928528 wait complete. 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.907+0000 7f7c6359e700 1 Processor -- start 2023-10-08T17:24:58.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.907+0000 7f7c6359e700 1 -- start start 2023-10-08T17:24:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 0x7f7c64150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c64159800 0x7f7c6415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640af1b0 con 0x7f7c640b1d40 2023-10-08T17:24:58.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c641503d0 con 0x7f7c640b24f0 2023-10-08T17:24:58.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6414fc00 con 0x7f7c64159800 2023-10-08T17:24:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c61d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 0x7f7c64150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c62d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c64159800 0x7f7c6415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:24:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:55798/0 (socket says 172.21.15.12:55798) 2023-10-08T17:24:58.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.908+0000 7f7c6259c700 1 -- 172.21.15.12:0/2403907147 learned_addr learned my addr 172.21.15.12:0/2403907147 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c64159800 msgr2=0x7f7c6415b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c64159800 0x7f7c6415b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 msgr2=0x7f7c64150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 0x7f7c64150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c009a20 con 0x7f7c640b1d40 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 0x7f7c64150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6259c700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c7f0 tx=0x7f7c54007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54005cd0 con 0x7f7c640b1d40 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54005e50 con 0x7f7c640b1d40 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54007320 con 0x7f7c640b1d40 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.909+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c64151ea0 con 0x7f7c640b1d40 2023-10-08T17:24:58.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.910+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6414fe10 con 0x7f7c640b1d40 2023-10-08T17:24:58.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.911+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6404c3c0 con 0x7f7c640b1d40 2023-10-08T17:24:58.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.912+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 73) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7c5401b3b0 con 0x7f7c640b1d40 2023-10-08T17:24:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.913+0000 7f7c527fc700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:24:58.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.913+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f7c54084200 con 0x7f7c640b1d40 2023-10-08T17:24:58.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.913+0000 7f7c61d9b700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:58.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.913+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:24:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:58.917+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c54051320 con 0x7f7c640b1d40 2023-10-08T17:24:59.041 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.039+0000 7f7230b2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:24:59.094 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.094+0000 7fc888ca6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:24:59.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:59.114+0000 7f7c61d9b700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:59.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:59.114+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:24:59.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:59.145+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c640aff80 con 0x7f7c44066f80 2023-10-08T17:24:59.213 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.212+0000 7f7230b2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:59.266 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.265+0000 7fc888ca6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:24:59.302 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.301+0000 7f7230b2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:24:59.356 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.355+0000 7fc888ca6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:24:59.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:59.514+0000 7f7c61d9b700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:24:59.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:24:59.514+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:24:59.534 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.533+0000 7f7230b2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:59.588 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.587+0000 7fc888ca6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:24:59.720 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.719+0000 7f7230b2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:24:59.773 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.772+0000 7fc888ca6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:24:59.816 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.815+0000 7f7230b2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:24:59.870 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:24:59.869+0000 7fc888ca6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:24:59.983 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:24:59.982+0000 7f7230b2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:00.036 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:00.035+0000 7fc888ca6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:00.088 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:00.087+0000 7f7230b2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:00.141 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:00.140+0000 7fc888ca6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:00.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:00.315+0000 7f7c61d9b700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:00.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:00.315+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T17:25:00.594 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:00.593+0000 7f7230b2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:00.647 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:00.646+0000 7fc888ca6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:00.693 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:00.691+0000 7f7230b2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:00.746 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:00.745+0000 7fc888ca6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:00.787 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:00.786+0000 7f7230b2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:00.841 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:00.840+0000 7fc888ca6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:01.436 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:01.435+0000 7f7230b2d180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:01.493 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:01.492+0000 7fc888ca6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:01.616 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:01.615+0000 7f7230b2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:01.674 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:01.673+0000 7fc888ca6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:01.716 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:01.715+0000 7f7230b2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:01.775 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:01.774+0000 7fc888ca6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:01.917+0000 7f7c61d9b700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:01.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:01.917+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T17:25:02.018 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:02.017+0000 7f7230b2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:02.077 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:02.076+0000 7fc888ca6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:02.119 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:02.118+0000 7f7230b2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:02.178 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:02.177+0000 7fc888ca6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:02.856 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:02.854+0000 7f7230b2d180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:02.920 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:02.919+0000 7fc888ca6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:03.150 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.149+0000 7f7230b2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:03.214 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.213+0000 7fc888ca6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:03.248 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.246+0000 7f7230b2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:03.312 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.311+0000 7fc888ca6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:03.409 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.407+0000 7f7230b2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:03.475 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.473+0000 7fc888ca6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:03.517 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.516+0000 7f7230b2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:03.586 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.585+0000 7fc888ca6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:03.716 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.715+0000 7f7230b2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:03.785 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.784+0000 7fc888ca6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:03.813 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.812+0000 7f7230b2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:03.882 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.881+0000 7fc888ca6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:03.909 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:03.908+0000 7f7230b2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:03.979 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:03.978+0000 7fc888ca6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:04.007 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:04.006+0000 7f7230b2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:04.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:04.066+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 74) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7c540516f0 con 0x7f7c640b1d40 2023-10-08T17:25:04.123 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.080+0000 7fc888ca6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:04.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:04.092+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 75) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f7c540526d0 con 0x7f7c640b1d40 2023-10-08T17:25:04.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:04.092+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c44069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:04.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:04.092+0000 7f7c527fc700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c44069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:04.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:04.203 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:04.216 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.215+0000 7fc7fdff7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.216 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.215+0000 7fc7fdff7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.216 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.215+0000 7fc7fdff7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.217 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.215+0000 7fc7fdff7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.217 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.215+0000 7fc7fdff7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.218 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.216+0000 7fc7fa7f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.218 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.216+0000 7fc7fa7f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.218 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.216+0000 7fc7fa7f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.218 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.216+0000 7fc7fa7f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:04.218 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:04.216+0000 7fc7fa7f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.095+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mgrmap(e 76) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f7c54051fc0 con 0x7f7c640b1d40 2023-10-08T17:25:05.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.096+0000 7f7c527fc700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c440693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.096+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c640aff80 con 0x7f7c44066f80 2023-10-08T17:25:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.098+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c440693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.152 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.104+0000 7f7c61d9b700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c440693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7c64158850 tx=0x7f7c58007de0 comp rx=0 tx=0).ready entity=mgr.8937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.173+0000 7f7c527fc700 1 -- 172.21.15.12:0/2403907147 <== mgr.8937 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7c640aff80 con 0x7f7c44066f80 2023-10-08T17:25:05.175 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T17:25:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.176+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 msgr2=0x7f7c440693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.176+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c440693b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7c64158850 tx=0x7f7c58007de0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.176+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 msgr2=0x7f7c6414ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.176+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f7c5400c7f0 tx=0x7f7c54007e00 comp rx=0 tx=0).stop 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 shutdown_connections 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7c44066f80 0x7f7c440693b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7c640b1d40 0x7f7c6414ec10 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7c64159800 0x7f7c6415b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 --2- 172.21.15.12:0/2403907147 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7c640b24f0 0x7f7c64150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 >> 172.21.15.12:0/2403907147 conn(0x7f7c640703a0 msgr2=0x7f7c640cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 shutdown_connections 2023-10-08T17:25:05.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.177+0000 7f7c6359e700 1 -- 172.21.15.12:0/2403907147 wait complete. 2023-10-08T17:25:05.198 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T17:25:05.198 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-08T17:25:05.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.392+0000 7f1ad759e700 1 Processor -- start 2023-10-08T17:25:05.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.392+0000 7f1ad759e700 1 -- start start 2023-10-08T17:25:05.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.393+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 0x7f1ad80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.393+0000 7f1ad759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad80c8680 con 0x7f1ad8157750 2023-10-08T17:25:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.393+0000 7f1ad759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad815b6a0 con 0x7f1ad8157380 2023-10-08T17:25:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.393+0000 7f1ad759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad806a7f0 con 0x7f1ad815b1a0 2023-10-08T17:25:05.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad6d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1ad8157750 0x7f1ad80ae080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38440/0 (socket says 172.21.15.12:38440) 2023-10-08T17:25:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad6d9d700 1 -- 172.21.15.12:0/1987528259 learned_addr learned my addr 172.21.15.12:0/1987528259 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad5d9b700 1 --2- 172.21.15.12:0/1987528259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 0x7f1ad80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570626278 0 0) 0x7f1ad80c8680 con 0x7f1ad8157750 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac0003570 con 0x7f1ad8157750 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113789440 0 0) 0x7f1ad815b6a0 con 0x7f1ad8157380 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad5d9b700 1 -- 172.21.15.12:0/1987528259 >> v1:172.21.15.29:6789/0 conn(0x7f1ad8157380 legacy=0x7f1ad81585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad5d9b700 1 -- 172.21.15.12:0/1987528259 >> v1:172.21.15.12:6789/0 conn(0x7f1ad8157750 legacy=0x7f1ad80ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.394+0000 7f1ad5d9b700 1 -- 172.21.15.12:0/1987528259 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad815b980 con 0x7f1ad815b1a0 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.395+0000 7f1ad5d9b700 1 --2- 172.21.15.12:0/1987528259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 0x7f1ad80c6b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009910 tx=0x7f1acc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1a11360c57d006f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.395+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00b680 con 0x7f1ad815b1a0 2023-10-08T17:25:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.395+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc00b7e0 con 0x7f1ad815b1a0 2023-10-08T17:25:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.395+0000 7f1ad559a700 1 -- 172.21.15.12:0/1987528259 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc00bb60 con 0x7f1ad815b1a0 2023-10-08T17:25:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 -- 172.21.15.12:0/1987528259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 msgr2=0x7f1ad80c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 --2- 172.21.15.12:0/1987528259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 0x7f1ad80c6b60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009910 tx=0x7f1acc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 -- 172.21.15.12:0/1987528259 shutdown_connections 2023-10-08T17:25:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 --2- 172.21.15.12:0/1987528259 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad815b1a0 0x7f1ad80c6b60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 -- 172.21.15.12:0/1987528259 >> 172.21.15.12:0/1987528259 conn(0x7f1ad806c6a0 msgr2=0x7f1ad806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 -- 172.21.15.12:0/1987528259 shutdown_connections 2023-10-08T17:25:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.396+0000 7f1ad759e700 1 -- 172.21.15.12:0/1987528259 wait complete. 2023-10-08T17:25:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.397+0000 7f1ad759e700 1 Processor -- start 2023-10-08T17:25:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.397+0000 7f1ad759e700 1 -- start start 2023-10-08T17:25:05.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8157380 0x7f1ad814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad8157750 0x7f1ad80ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80adb00 con 0x7f1ad815b1a0 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad815d390 con 0x7f1ad8157380 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80ac740 con 0x7f1ad8157750 2023-10-08T17:25:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.398+0000 7f1ad6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47200/0 (socket says 172.21.15.12:47200) 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 -- 172.21.15.12:0/4155281947 learned_addr learned my addr 172.21.15.12:0/4155281947 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad5d9b700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad8157750 0x7f1ad80ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad659c700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8157380 0x7f1ad814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 -- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad8157750 msgr2=0x7f1ad80ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad8157750 0x7f1ad80ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 -- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8157380 msgr2=0x7f1ad814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8157380 0x7f1ad814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 -- 172.21.15.12:0/4155281947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009420 con 0x7f1ad815b1a0 2023-10-08T17:25:05.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.399+0000 7f1ad6d9d700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0001460 tx=0x7f1ad0001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.400+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000a890 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.400+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000a9f0 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.400+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000ad70 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.400+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80aca20 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.400+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad80acd00 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.401+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad804c3c0 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.402+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 76) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f1ad0007300 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.403+0000 7f1ac67fc700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 0x7f1ab8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.403+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1ad0084850 con 0x7f1ad815b1a0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.403+0000 7f1ad659c700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 0x7f1ab8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.403+0000 7f1ad659c700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 0x7f1ab8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80ad2a0 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.8937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.407+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad0051b20 con 0x7f1ad815b1a0 2023-10-08T17:25:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.635+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad80c6940 con 0x7f1ab8066dd0 2023-10-08T17:25:05.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.707+0000 7f1ac67fc700 1 -- 172.21.15.12:0/4155281947 <== mgr.8937 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1ad80c6940 con 0x7f1ab8066dd0 2023-10-08T17:25:05.781 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path snap_test_dir1 2023-10-08T17:25:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 msgr2=0x7f1ab8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 0x7f1ab8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80ad2a0 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 msgr2=0x7f1ad815d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f1ad0001460 tx=0x7f1ad0001ae0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 shutdown_connections 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1ab8066dd0 0x7f1ab8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ad815b1a0 0x7f1ad815d820 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ad8157380 0x7f1ad814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 --2- 172.21.15.12:0/4155281947 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ad8157750 0x7f1ad80ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.709+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 >> 172.21.15.12:0/4155281947 conn(0x7f1ad806c6a0 msgr2=0x7f1ad80c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.710+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 shutdown_connections 2023-10-08T17:25:05.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.710+0000 7f1ad759e700 1 -- 172.21.15.12:0/4155281947 wait complete. 2023-10-08T17:25:05.783 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-08T17:25:05.784 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-10-08T17:25:05.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.974+0000 7efe9259d700 1 Processor -- start 2023-10-08T17:25:05.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.974+0000 7efe9259d700 1 -- start start 2023-10-08T17:25:05.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.975+0000 7efe9259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe8c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe9259d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c0c8680 con 0x7efe8c15b1a0 2023-10-08T17:25:05.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe9259d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c158b30 con 0x7efe8c157750 2023-10-08T17:25:05.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe9259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06a7f0 con 0x7efe8c157380 2023-10-08T17:25:05.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe90d9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efe8c15b1a0 0x7efe8c0c6b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38456/0 (socket says 172.21.15.12:38456) 2023-10-08T17:25:05.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe90d9a700 1 -- 172.21.15.12:0/1339076693 learned_addr learned my addr 172.21.15.12:0/1339076693 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe9159b700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe8c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271320807 0 0) 0x7efe8c0c8680 con 0x7efe8c15b1a0 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe78003570 con 0x7efe8c15b1a0 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152788272 0 0) 0x7efe8c158b30 con 0x7efe8c157750 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.976+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8c0c8680 con 0x7efe8c157750 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3876841494 0 0) 0x7efe78003570 con 0x7efe8c15b1a0 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 msgr2=0x7efe8c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe8c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 >> v1:172.21.15.29:6789/0 conn(0x7efe8c157750 legacy=0x7efe8c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c15b6a0 con 0x7efe8c15b1a0 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7efe7c001470 con 0x7efe8c15b1a0 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 >> v1:172.21.15.12:6789/0 conn(0x7efe8c15b1a0 legacy=0x7efe8c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe78003c20 0x7efe78004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe78004d50 0x7efe780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c06a7f0 con 0x7efe78003c20 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7800bb40 con 0x7efe78004d50 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe7800bd00 con 0x7efe8c157380 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe78003c20 0x7efe78004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe90d9a700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe91d9c700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe78004d50 0x7efe780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 -- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 msgr2=0x7efe78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe8c157380 0x7efe78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 -- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe78004d50 msgr2=0x7efe780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe78004d50 0x7efe780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.977+0000 7efe9159b700 1 -- 172.21.15.12:0/1339076693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78003570 con 0x7efe78003c20 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe9159b700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe78003c20 0x7efe78004010 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efe88009c00 tx=0x7efe880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de8e68af34d7e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800e710 con 0x7efe78003c20 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8800e870 con 0x7efe78003c20 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe83fff700 1 -- 172.21.15.12:0/1339076693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8800ec30 con 0x7efe78003c20 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe9259d700 1 -- 172.21.15.12:0/1339076693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe78003c20 msgr2=0x7efe78004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe9259d700 1 --2- 172.21.15.12:0/1339076693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe78003c20 0x7efe78004010 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7efe88009c00 tx=0x7efe880091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe91d9c700 1 -- 172.21.15.12:0/1339076693 reap_dead start 2023-10-08T17:25:05.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe9259d700 1 -- 172.21.15.12:0/1339076693 shutdown_connections 2023-10-08T17:25:05.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.978+0000 7efe9259d700 1 -- 172.21.15.12:0/1339076693 >> 172.21.15.12:0/1339076693 conn(0x7efe8c06c6a0 msgr2=0x7efe8c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:05.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.979+0000 7efe9259d700 1 -- 172.21.15.12:0/1339076693 shutdown_connections 2023-10-08T17:25:05.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.979+0000 7efe9259d700 1 -- 172.21.15.12:0/1339076693 wait complete. 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.980+0000 7efe9259d700 1 Processor -- start 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.980+0000 7efe9259d700 1 -- start start 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe78003c20 0x7efe8c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe8c0c1b40 0x7efe8c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8c0ac180 0x7efe8c0ac990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1507e0 con 0x7efe8c0c1b40 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0c4240 con 0x7efe8c0ac180 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0c4a80 con 0x7efe78003c20 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe90d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe8c0c1b40 0x7efe8c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe90d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe8c0c1b40 0x7efe8c1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47214/0 (socket says 172.21.15.12:47214) 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe90d9a700 1 -- 172.21.15.12:0/1030040726 learned_addr learned my addr 172.21.15.12:0/1030040726 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe91d9c700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8c0ac180 0x7efe8c0ac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.981+0000 7efe9159b700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe78003c20 0x7efe8c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 -- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe78003c20 msgr2=0x7efe8c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efe78003c20 0x7efe8c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 -- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8c0ac180 msgr2=0x7efe8c0ac990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8c0ac180 0x7efe8c0ac990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 -- 172.21.15.12:0/1030040726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0c2320 con 0x7efe8c0c1b40 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe91d9c700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efe8c0ac180 0x7efe8c0ac990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe90d9a700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efe8c0c1b40 0x7efe8c1502a0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00ebf0 tx=0x7efe7c0010b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00c7e0 con 0x7efe8c0c1b40 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c00c960 con 0x7efe8c0c1b40 2023-10-08T17:25:05.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c00cd20 con 0x7efe8c0c1b40 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe9259d700 1 -- 172.21.15.12:0/1030040726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c0c4470 con 0x7efe8c0c1b40 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.982+0000 7efe9259d700 1 -- 172.21.15.12:0/1030040726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c0c4710 con 0x7efe8c0c1b40 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.983+0000 7efe9259d700 1 -- 172.21.15.12:0/1030040726 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c0cbee0 con 0x7efe8c0c1b40 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.984+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 76) v1 ==== 84595+0+0 (secure 0 0 0) 0x7efe7c013630 con 0x7efe8c0c1b40 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.985+0000 7efe817fa700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe70066dd0 0x7efe70069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:05.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.985+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7efe7c084580 con 0x7efe8c0c1b40 2023-10-08T17:25:05.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.985+0000 7efe9159b700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe70066dd0 0x7efe70069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:05.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.986+0000 7efe9159b700 1 --2- 172.21.15.12:0/1030040726 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efe70066dd0 0x7efe70069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efe880091e0 tx=0x7efe8801a000 comp rx=0 tx=0).ready entity=mgr.8937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:05.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:05.989+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe7c051700 con 0x7efe8c0c1b40 2023-10-08T17:25:06.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.103+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 77) v1 ==== 84916+0+0 (secure 0 0 0) 0x7efe7c051ad0 con 0x7efe8c0c1b40 2023-10-08T17:25:06.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.224+0000 7efe9259d700 1 -- 172.21.15.12:0/1030040726 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7efe8c0c6560 con 0x7efe70066dd0 2023-10-08T17:25:06.586 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:06.232+0000 7fc805005700 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-10-08T17:25:06.587 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-08T17:25:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.232+0000 7efe817fa700 1 -- 172.21.15.12:0/1030040726 <== mgr.8937 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7efe8c0c6560 con 0x7efe70066dd0 2023-10-08T17:25:06.587 INFO:teuthology.orchestra.run.smithi012.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-10-08T17:25:06.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:25:06.588 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T17:25:06.628 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T17:25:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.858+0000 7ffbb759e700 1 Processor -- start 2023-10-08T17:25:07.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.858+0000 7ffbb759e700 1 -- start start 2023-10-08T17:25:07.007 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.859+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb80aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.859+0000 7ffbb759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbb80ceac0 0x7ffbb80af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.859+0000 7ffbb759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbb80ac840 con 0x7ffbb8157420 2023-10-08T17:25:07.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.859+0000 7ffbb759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbb80abf50 con 0x7ffbb80ceac0 2023-10-08T17:25:07.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.859+0000 7ffbb759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80aea60 con 0x7ffbb806d250 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbb80ceac0 0x7ffbb80af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb5d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb80aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffbb80ceac0 0x7ffbb80af4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:50958/0 (socket says 172.21.15.12:50958) 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/153011817 learned_addr learned my addr 172.21.15.12:0/153011817 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 msgr2=0x7ffbb80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb80aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/153011817 >> v1:172.21.15.29:6789/0 conn(0x7ffbb8157420 legacy=0x7ffbb80b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/153011817 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb80ac1f0 con 0x7ffbb80ceac0 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb5d9b700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb80aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.860+0000 7ffbb6d9d700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80af4e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009f20 tx=0x7ffbb0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f3768336080662 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb559a700 1 -- 172.21.15.12:0/153011817 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb000e070 con 0x7ffbb80ceac0 2023-10-08T17:25:07.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb559a700 1 -- 172.21.15.12:0/153011817 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb000b9d0 con 0x7ffbb80ceac0 2023-10-08T17:25:07.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb559a700 1 -- 172.21.15.12:0/153011817 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00092e0 con 0x7ffbb80ceac0 2023-10-08T17:25:07.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 -- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 msgr2=0x7ffbb80af4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:07.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80af4e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009f20 tx=0x7ffbb0009840 comp rx=0 tx=0).stop 2023-10-08T17:25:07.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 -- 172.21.15.12:0/153011817 shutdown_connections 2023-10-08T17:25:07.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80af4e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:07.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 --2- 172.21.15.12:0/153011817 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb80aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:07.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 -- 172.21.15.12:0/153011817 >> 172.21.15.12:0/153011817 conn(0x7ffbb806ce80 msgr2=0x7ffbb80ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:07.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 -- 172.21.15.12:0/153011817 shutdown_connections 2023-10-08T17:25:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.861+0000 7ffbb759e700 1 -- 172.21.15.12:0/153011817 wait complete. 2023-10-08T17:25:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.863+0000 7ffbb759e700 1 Processor -- start 2023-10-08T17:25:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.863+0000 7ffbb759e700 1 -- start start 2023-10-08T17:25:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b2020 con 0x7ffbb8157420 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b1410 con 0x7ffbb80ceac0 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb80b16f0 con 0x7ffbb806d250 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb5d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47218/0 (socket says 172.21.15.12:47218) 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/990125850 learned_addr learned my addr 172.21.15.12:0/990125850 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.864+0000 7ffbb659c700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 msgr2=0x7ffbb8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb8154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 msgr2=0x7ffbb80682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 -- 172.21.15.12:0/990125850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbac009420 con 0x7ffbb8157420 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb5d9b700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb6d9d700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b610 tx=0x7ffbb0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0008ad0 con 0x7ffbb8157420 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb0008c30 con 0x7ffbb8157420 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0025460 con 0x7ffbb8157420 2023-10-08T17:25:07.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb0009ae0 con 0x7ffbb8157420 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.865+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb80b1cb0 con 0x7ffbb8157420 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.866+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb80b2190 con 0x7ffbb8157420 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.867+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 77) v1 ==== 84916+0+0 (secure 0 0 0) 0x7ffbb0003040 con 0x7ffbb8157420 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.868+0000 7ffba67fc700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 0x7ffb980695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.868+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ffbb00861e0 con 0x7ffbb8157420 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.868+0000 7ffbb659c700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 0x7ffb980695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.869+0000 7ffbb659c700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 0x7ffb980695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003a80 tx=0x7ffba8007ec0 comp rx=0 tx=0).ready entity=mgr.8937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:07.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:06.872+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbb0052df0 con 0x7ffbb8157420 2023-10-08T17:25:07.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:07.135+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ffbb804c3c0 con 0x7ffbb8157420 2023-10-08T17:25:08.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.118+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ffbb00531c0 con 0x7ffbb8157420 2023-10-08T17:25:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.118+0000 7ffba67fc700 1 -- 172.21.15.12:0/990125850 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v78) v1 ==== 93+0+0 (secure 0 0 0) 0x7ffbb0056880 con 0x7ffbb8157420 2023-10-08T17:25:08.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.121+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 msgr2=0x7ffb980695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.121+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 0x7ffb980695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffba8003a80 tx=0x7ffba8007ec0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.121+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 msgr2=0x7ffbb81509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:08.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.121+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7ffbb000b610 tx=0x7ffbb0018000 comp rx=0 tx=0).stop 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 shutdown_connections 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffb98067130 0x7ffb980695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbb8157420 0x7ffbb81509e0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbb806d250 0x7ffbb8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 --2- 172.21.15.12:0/990125850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbb80ceac0 0x7ffbb80682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 >> 172.21.15.12:0/990125850 conn(0x7ffbb806ce80 msgr2=0x7ffbb806f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 shutdown_connections 2023-10-08T17:25:08.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.122+0000 7ffbb759e700 1 -- 172.21.15.12:0/990125850 wait complete. 2023-10-08T17:25:08.179 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:25:08.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:25:08.269 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:25:08.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:25:08.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T17:25:08.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:25:08.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T17:25:08.571 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:25:08.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:08.637 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T17:25:08.675 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.991+0000 7f6b0d79d700 1 Processor -- start 2023-10-08T17:25:08.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.991+0000 7f6b0d79d700 1 -- start start 2023-10-08T17:25:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0d79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6b0815de50 0x7f6b080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:08.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0d79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6b080cef40 0x7f6b0815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0d79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b080cf3c0 con 0x7f6b08153c30 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0d79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0815afd0 con 0x7f6b080cef40 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0d79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b0815b2b0 con 0x7f6b0815de50 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b07fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6b08153c30 0x7f6b0815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38460/0 (socket says 172.21.15.12:38460) 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b07fff700 1 -- 172.21.15.12:0/1740308001 learned_addr learned my addr 172.21.15.12:0/1740308001 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.992+0000 7f6b0cf9c700 1 --2- 172.21.15.12:0/1740308001 >> v2:172.21.15.12:3300/0 conn(0x7f6b080cef40 0x7f6b0815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:08.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b077fe700 1 --2- 172.21.15.12:0/1740308001 >> v2:172.21.15.29:3300/0 conn(0x7f6b0815de50 0x7f6b080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b0cf9c700 1 -- 172.21.15.12:0/1740308001 >> v2:172.21.15.29:3300/0 conn(0x7f6b0815de50 msgr2=0x7f6b080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b0cf9c700 1 --2- 172.21.15.12:0/1740308001 >> v2:172.21.15.29:3300/0 conn(0x7f6b0815de50 0x7f6b080cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b0cf9c700 1 -- 172.21.15.12:0/1740308001 >> v1:172.21.15.12:6789/0 conn(0x7f6b08153c30 legacy=0x7f6b0815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b0cf9c700 1 -- 172.21.15.12:0/1740308001 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0815b590 con 0x7f6b080cef40 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b06ffd700 1 -- 172.21.15.12:0/1740308001 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498739648 0 0) 0x7f6b080cf3c0 con 0x7f6b08153c30 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.993+0000 7f6b0cf9c700 1 --2- 172.21.15.12:0/1740308001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b080cef40 0x7f6b0815c070 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f6b080713a0 tx=0x7f6b00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b3ae3d161af637 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b06ffd700 1 -- 172.21.15.12:0/1740308001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0000e070 con 0x7f6b080cef40 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b06ffd700 1 -- 172.21.15.12:0/1740308001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0000bb60 con 0x7f6b080cef40 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b06ffd700 1 -- 172.21.15.12:0/1740308001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b00012430 con 0x7f6b080cef40 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 -- 172.21.15.12:0/1740308001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b080cef40 msgr2=0x7f6b0815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:08.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/1740308001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b080cef40 0x7f6b0815c070 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f6b080713a0 tx=0x7f6b00009780 comp rx=0 tx=0).stop 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 -- 172.21.15.12:0/1740308001 shutdown_connections 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/1740308001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b080cef40 0x7f6b0815c070 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/1740308001 >> v2:172.21.15.29:3300/0 conn(0x7f6b0815de50 0x7f6b080cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 -- 172.21.15.12:0/1740308001 >> 172.21.15.12:0/1740308001 conn(0x7f6b080703a0 msgr2=0x7f6b080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.994+0000 7f6b0d79d700 1 -- 172.21.15.12:0/1740308001 shutdown_connections 2023-10-08T17:25:08.997 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.995+0000 7f6b0d79d700 1 -- 172.21.15.12:0/1740308001 wait complete. 2023-10-08T17:25:08.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.997+0000 7f6b0d79d700 1 Processor -- start 2023-10-08T17:25:08.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.997+0000 7f6b0d79d700 1 -- start start 2023-10-08T17:25:09.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.998+0000 7f6b0d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b080cef40 0x7f6b081698b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0d79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 0x7f6b080b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c93a0 con 0x7f6b08153c30 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0d79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c8790 con 0x7f6b0815de50 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b080c8a70 con 0x7f6b080cef40 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47234/0 (socket says 172.21.15.12:47234) 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 -- 172.21.15.12:0/650662988 learned_addr learned my addr 172.21.15.12:0/650662988 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0cf9c700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 0x7f6b080b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b07fff700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b080cef40 0x7f6b081698b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b080cef40 msgr2=0x7f6b081698b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b080cef40 0x7f6b081698b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 msgr2=0x7f6b080b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 0x7f6b080b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b077fe700 1 -- 172.21.15.12:0/650662988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b00009a20 con 0x7f6b08153c30 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:08.999+0000 7f6b0cf9c700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 0x7f6b080b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:09.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6b077fe700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00ec80 tx=0x7f6afc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00c850 con 0x7f6b08153c30 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00c9b0 con 0x7f6b08153c30 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00cd50 con 0x7f6b08153c30 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b080c8d50 con 0x7f6b08153c30 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.000+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b08169df0 con 0x7f6b08153c30 2023-10-08T17:25:09.003 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.001+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0804c3c0 con 0x7f6b08153c30 2023-10-08T17:25:09.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.002+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f6afc013680 con 0x7f6b08153c30 2023-10-08T17:25:09.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.003+0000 7f6aeffff700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 0x7f6af4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.004+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f6afc084da0 con 0x7f6b08153c30 2023-10-08T17:25:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.004+0000 7f6b07fff700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 msgr2=0x7f6af4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:09.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.004+0000 7f6b07fff700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 0x7f6af4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:09.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.008+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6afc051ac0 con 0x7f6b08153c30 2023-10-08T17:25:09.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.205+0000 7f6b07fff700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 msgr2=0x7f6af4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:09.421 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.205+0000 7f6b07fff700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 0x7f6af4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.257+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b080c94e0 con 0x7f6b08153c30 2023-10-08T17:25:09.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.257+0000 7f6aeffff700 1 -- 172.21.15.12:0/650662988 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f6afc0550e0 con 0x7f6b08153c30 2023-10-08T17:25:09.425 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:09.426 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:25:09.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 msgr2=0x7f6af4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 0x7f6af4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 msgr2=0x7f6b08152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f6afc00ec80 tx=0x7f6afc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 shutdown_connections 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f6af40670e0 0x7f6af4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6b0815de50 0x7f6b080b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6b080cef40 0x7f6b081698b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 --2- 172.21.15.12:0/650662988 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6b08153c30 0x7f6b08152870 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 >> 172.21.15.12:0/650662988 conn(0x7f6b080703a0 msgr2=0x7f6b08070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 shutdown_connections 2023-10-08T17:25:09.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.260+0000 7f6b0d79d700 1 -- 172.21.15.12:0/650662988 wait complete. 2023-10-08T17:25:09.574 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:25:09.574 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:09.575 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:09.480+0000 7fcbe9862180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:25:09.575 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:09.458+0000 7f07a1ea9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:25:09.629 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:09.629+0000 7f07a1ea9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:09.654 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:09.653+0000 7fcbe9862180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:09.735 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:09.717+0000 7f07a1ea9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:25:09.744 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:09.743+0000 7fcbe9862180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:25:09.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.764+0000 7f5f10f9d700 1 Processor -- start 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.764+0000 7f5f10f9d700 1 -- start start 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f10f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f10f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5f0c0cef40 0x7f5f0c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f10f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0c15afd0 con 0x7f5f0c153c30 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f10f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f0c15b2b0 con 0x7f5f0c0cef40 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f10f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c15b590 con 0x7f5f0c15de50 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f0b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f5f0c153c30 0x7f5f0c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38466/0 (socket says 172.21.15.12:38466) 2023-10-08T17:25:09.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.765+0000 7f5f0b7fe700 1 -- 172.21.15.12:0/2857466927 learned_addr learned my addr 172.21.15.12:0/2857466927 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 --2- 172.21.15.12:0/2857466927 >> v2:172.21.15.29:3300/0 conn(0x7f5f0c0cef40 0x7f5f0c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0affd700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0a7fc700 1 -- 172.21.15.12:0/2857466927 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539978683 0 0) 0x7f5f0c15afd0 con 0x7f5f0c153c30 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0a7fc700 1 -- 172.21.15.12:0/2857466927 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ef4003570 con 0x7f5f0c153c30 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 -- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 msgr2=0x7f5f0c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 -- 172.21.15.12:0/2857466927 >> v1:172.21.15.12:6789/0 conn(0x7f5f0c153c30 legacy=0x7f5f0c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 -- 172.21.15.12:0/2857466927 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c15b870 con 0x7f5f0c0cef40 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.766+0000 7f5f0bfff700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c15c070 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009e60 tx=0x7f5f04009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da1f5e801a7082e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:09.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.767+0000 7f5f0a7fc700 1 -- 172.21.15.12:0/2857466927 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400e070 con 0x7f5f0c0cef40 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.767+0000 7f5f0a7fc700 1 -- 172.21.15.12:0/2857466927 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0400bab0 con 0x7f5f0c0cef40 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.767+0000 7f5f0a7fc700 1 -- 172.21.15.12:0/2857466927 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0400be70 con 0x7f5f0c0cef40 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.767+0000 7f5f10f9d700 1 -- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 msgr2=0x7f5f0c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.767+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c15c070 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009e60 tx=0x7f5f04009780 comp rx=0 tx=0).stop 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 -- 172.21.15.12:0/2857466927 shutdown_connections 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c15c070 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/2857466927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 -- 172.21.15.12:0/2857466927 >> 172.21.15.12:0/2857466927 conn(0x7f5f0c0703a0 msgr2=0x7f5f0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:09.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 -- 172.21.15.12:0/2857466927 shutdown_connections 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.768+0000 7f5f10f9d700 1 -- 172.21.15.12:0/2857466927 wait complete. 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.769+0000 7f5f10f9d700 1 Processor -- start 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.769+0000 7f5f10f9d700 1 -- start start 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c8540 con 0x7f5f0c153c30 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c14ef00 con 0x7f5f0c0cef40 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.770+0000 7f5f10f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0c0c7930 con 0x7f5f0c15de50 2023-10-08T17:25:09.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47248/0 (socket says 172.21.15.12:47248) 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 -- 172.21.15.12:0/3938465691 learned_addr learned my addr 172.21.15.12:0/3938465691 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0b7fe700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0bfff700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 msgr2=0x7f5f0c0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 msgr2=0x7f5f0c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c14e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:09.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 -- 172.21.15.12:0/3938465691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f04009a20 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0bfff700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.771+0000 7f5f0affd700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000ecb0 tx=0x7f5f000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.772+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000c920 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.772+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0000ca80 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.772+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f0c0c7c10 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.772+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0000ce20 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.772+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0c0c81d0 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.773+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0c0c86f0 con 0x7f5f0c153c30 2023-10-08T17:25:09.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.774+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f5f00013680 con 0x7f5f0c153c30 2023-10-08T17:25:09.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.775+0000 7f5ef37fe700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 0x7f5ef8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:09.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.775+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f5f00084f40 con 0x7f5f0c153c30 2023-10-08T17:25:09.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.775+0000 7f5f0b7fe700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 msgr2=0x7f5ef8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:09.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.775+0000 7f5f0b7fe700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 0x7f5ef8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:09.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.779+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f0c0c86f0 con 0x7f5f0c153c30 2023-10-08T17:25:09.949 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:09.949+0000 7f07a1ea9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.976+0000 7f5f0b7fe700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 msgr2=0x7f5ef8069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:10.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.976+0000 7f5f0b7fe700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 0x7f5ef8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:10.047 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:09.977+0000 7fcbe9862180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.984+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f0c0c86f0 con 0x7f5f0c153c30 2023-10-08T17:25:10.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.985+0000 7f5ef37fe700 1 -- 172.21.15.12:0/3938465691 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16490 (secure 0 0 0) 0x7f5f00017090 con 0x7f5f0c153c30 2023-10-08T17:25:10.048 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:10.049 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":169,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:04.083291+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/2390616266":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/733332394":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/3712260975":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/233385736":"2023-10-09T17:25:04.083261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 msgr2=0x7f5ef8069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 0x7f5ef8069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 msgr2=0x7f5f0c14f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f5f0000ecb0 tx=0x7f5f000091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 shutdown_connections 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f5ef80670e0 0x7f5ef8069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5f0c15de50 0x7f5f0c0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5f0c0cef40 0x7f5f0c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 --2- 172.21.15.12:0/3938465691 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5f0c153c30 0x7f5f0c14f100 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 >> 172.21.15.12:0/3938465691 conn(0x7f5f0c0703a0 msgr2=0x7f5f0c0c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 shutdown_connections 2023-10-08T17:25:10.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:09.988+0000 7f5f10f9d700 1 -- 172.21.15.12:0/3938465691 wait complete. 2023-10-08T17:25:10.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T17:24:45.287105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T17:24:46.609576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T17:25:10.054 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:25:10.137 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:10.137+0000 7f07a1ea9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:25:10.199 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:10.168+0000 7fcbe9862180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:25:10.232 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:10.232+0000 7f07a1ea9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:25:10.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.247+0000 7fcdae1ff700 1 Processor -- start 2023-10-08T17:25:10.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.247+0000 7fcdae1ff700 1 -- start start 2023-10-08T17:25:10.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.248+0000 7fcdae1ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcda8159530 0x7fcda80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcdae1ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 0x7fcda80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcdae1ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda80ccfd0 con 0x7fcda806dc70 2023-10-08T17:25:10.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcdae1ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80cf0e0 con 0x7fcda8159530 2023-10-08T17:25:10.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcdae1ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda815a3d0 con 0x7fcda806e0e0 2023-10-08T17:25:10.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcda8159530 0x7fcda80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fcda8159530 0x7fcda80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47264/0 (socket says 172.21.15.12:47264) 2023-10-08T17:25:10.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 -- 172.21.15.12:0/1935524134 learned_addr learned my addr 172.21.15.12:0/1935524134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:10.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda7fff700 1 --2- 172.21.15.12:0/1935524134 >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 0x7fcda80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 -- 172.21.15.12:0/1935524134 >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 msgr2=0x7fcda80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:10.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 --2- 172.21.15.12:0/1935524134 >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 0x7fcda80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 -- 172.21.15.12:0/1935524134 >> v1:172.21.15.29:6789/0 conn(0x7fcda806dc70 legacy=0x7fcda8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda77fe700 1 -- 172.21.15.12:0/1935524134 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda815a6b0 con 0x7fcda8159530 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.249+0000 7fcda7fff700 1 --2- 172.21.15.12:0/1935524134 >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 0x7fcda80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcda77fe700 1 --2- 172.21.15.12:0/1935524134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80ceba0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcda80caef0 tx=0x7fcd98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffac474390483e0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcda67fc700 1 -- 172.21.15.12:0/1935524134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800b860 con 0x7fcda8159530 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcda67fc700 1 -- 172.21.15.12:0/1935524134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9800b9c0 con 0x7fcda8159530 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcda67fc700 1 -- 172.21.15.12:0/1935524134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800bd60 con 0x7fcda8159530 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1935524134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 msgr2=0x7fcda80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1935524134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80ceba0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcda80caef0 tx=0x7fcd98009250 comp rx=0 tx=0).stop 2023-10-08T17:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1935524134 shutdown_connections 2023-10-08T17:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1935524134 >> v2:172.21.15.29:3300/0 conn(0x7fcda806e0e0 0x7fcda80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1935524134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80ceba0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.250+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1935524134 >> 172.21.15.12:0/1935524134 conn(0x7fcda80703a0 msgr2=0x7fcda80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.251+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1935524134 shutdown_connections 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.251+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1935524134 wait complete. 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.252+0000 7fcdae1ff700 1 Processor -- start 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.252+0000 7fcdae1ff700 1 -- start start 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 0x7fcda814b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcda806e0e0 0x7fcda80d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda8158ed0 con 0x7fcda8159530 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda815e250 con 0x7fcda806e0e0 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcdae1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda815f2b0 con 0x7fcda806dc70 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcda77fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 0x7fcda814b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcda7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcda77fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 0x7fcda814b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44122/0 (socket says 172.21.15.12:44122) 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcda77fe700 1 -- 172.21.15.12:0/1188101417 learned_addr learned my addr 172.21.15.12:0/1188101417 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.253+0000 7fcda6ffd700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcda806e0e0 0x7fcda80d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 msgr2=0x7fcda814b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 0x7fcda814b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcda806e0e0 msgr2=0x7fcda80d08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcda806e0e0 0x7fcda80d08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 -- 172.21.15.12:0/1188101417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd980094f0 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcda7fff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80d0df0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009fa0 tx=0x7fcda0009990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000dbb0 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000f040 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda815e4f0 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.254+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0015440 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.255+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda815eab0 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.255+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda804c3c0 con 0x7fcda8159530 2023-10-08T17:25:10.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.257+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fcda00143a0 con 0x7fcda8159530 2023-10-08T17:25:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.258+0000 7fcd8f7fe700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 0x7fcd94069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.258+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fcda0085070 con 0x7fcda8159530 2023-10-08T17:25:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.258+0000 7fcda77fe700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 msgr2=0x7fcd94069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.258+0000 7fcda77fe700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 0x7fcd94069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:10.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.262+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcda0051be0 con 0x7fcda8159530 2023-10-08T17:25:10.360 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:10.268+0000 7fcbe9862180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:25:10.399 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:10.398+0000 7f07a1ea9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:10.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:10.435+0000 7fcbe9862180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:10.511 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:10.503+0000 7f07a1ea9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:10.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.459+0000 7fcda77fe700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 msgr2=0x7fcd94069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.459+0000 7fcda77fe700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 0x7fcd94069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.468+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcda80ce6a0 con 0x7fcda8159530 2023-10-08T17:25:10.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.468+0000 7fcd8f7fe700 1 -- 172.21.15.12:0/1188101417 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v169) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcda001a0a0 con 0x7fcda8159530 2023-10-08T17:25:10.514 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:25:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.470+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 msgr2=0x7fcd94069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:10.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.470+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 0x7fcd94069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.470+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 msgr2=0x7fcda80d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.470+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80d0df0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fcda0009fa0 tx=0x7fcda0009990 comp rx=0 tx=0).stop 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 shutdown_connections 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fcd940670e0 0x7fcd94069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fcda8159530 0x7fcda80d0df0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fcda806dc70 0x7fcda814b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 --2- 172.21.15.12:0/1188101417 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fcda806e0e0 0x7fcda80d08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 >> 172.21.15.12:0/1188101417 conn(0x7fcda80703a0 msgr2=0x7fcda815afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 shutdown_connections 2023-10-08T17:25:10.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.471+0000 7fcdae1ff700 1 -- 172.21.15.12:0/1188101417 wait complete. 2023-10-08T17:25:10.520 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T17:25:10.543 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:10.542+0000 7fcbe9862180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:10.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.712+0000 7fdd10dff700 1 Processor -- start 2023-10-08T17:25:10.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.712+0000 7fdd10dff700 1 -- start start 2023-10-08T17:25:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd10dff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd0c0cc320 0x7fdd0c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd10dff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c06d7b0 con 0x7fdd0c06a110 2023-10-08T17:25:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd10dff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd0c06e330 con 0x7fdd0c0cc6f0 2023-10-08T17:25:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd10dff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd0c06a570 con 0x7fdd0c0cc320 2023-10-08T17:25:10.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd0a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdd0c0cc320 0x7fdd0c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.713+0000 7fdd0ad9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdd0c06a110 0x7fdd0c06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:38474/0 (socket says 172.21.15.12:38474) 2023-10-08T17:25:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0ad9d700 1 -- 172.21.15.12:0/3964073463 learned_addr learned my addr 172.21.15.12:0/3964073463 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:10.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0a59c700 1 -- 172.21.15.12:0/3964073463 >> v1:172.21.15.29:6789/0 conn(0x7fdd0c0cc6f0 legacy=0x7fdd0c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0a59c700 1 -- 172.21.15.12:0/3964073463 >> v1:172.21.15.12:6789/0 conn(0x7fdd0c06a110 legacy=0x7fdd0c06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0a59c700 1 -- 172.21.15.12:0/3964073463 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c06da00 con 0x7fdd0c0cc320 2023-10-08T17:25:10.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0959a700 1 -- 172.21.15.12:0/3964073463 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923445821 0 0) 0x7fdd0c06d7b0 con 0x7fdd0c06a110 2023-10-08T17:25:10.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.714+0000 7fdd0a59c700 1 --2- 172.21.15.12:0/3964073463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c0cc320 0x7fdd0c13c2a0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098e0 tx=0x7fdcfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29c2cbb0c0c6a0c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:10.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd0959a700 1 -- 172.21.15.12:0/3964073463 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc009e80 con 0x7fdd0c0cc320 2023-10-08T17:25:10.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd0959a700 1 -- 172.21.15.12:0/3964073463 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00b860 con 0x7fdd0c0cc320 2023-10-08T17:25:10.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd0959a700 1 -- 172.21.15.12:0/3964073463 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00bbe0 con 0x7fdd0c0cc320 2023-10-08T17:25:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd10dff700 1 -- 172.21.15.12:0/3964073463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c0cc320 msgr2=0x7fdd0c13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd10dff700 1 --2- 172.21.15.12:0/3964073463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c0cc320 0x7fdd0c13c2a0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0098e0 tx=0x7fdcfc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd10dff700 1 -- 172.21.15.12:0/3964073463 shutdown_connections 2023-10-08T17:25:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.715+0000 7fdd10dff700 1 --2- 172.21.15.12:0/3964073463 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c0cc320 0x7fdd0c13c2a0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.716+0000 7fdd10dff700 1 -- 172.21.15.12:0/3964073463 >> 172.21.15.12:0/3964073463 conn(0x7fdd0c067f00 msgr2=0x7fdd0c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.716+0000 7fdd10dff700 1 -- 172.21.15.12:0/3964073463 shutdown_connections 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.716+0000 7fdd10dff700 1 -- 172.21.15.12:0/3964073463 wait complete. 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.718+0000 7fdd10dff700 1 Processor -- start 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.718+0000 7fdd10dff700 1 -- start start 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 0x7fdd0c0aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd0c0cc6f0 0x7fdd0c13b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0b02a0 con 0x7fdd0c06a110 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0af620 con 0x7fdd0c0cc6f0 2023-10-08T17:25:10.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd10dff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0c0af900 con 0x7fdd0c0cc320 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47288/0 (socket says 172.21.15.12:47288) 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 -- 172.21.15.12:0/317037875 learned_addr learned my addr 172.21.15.12:0/317037875 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0ad9d700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd0c0cc6f0 0x7fdd0c13b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd09d9b700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 0x7fdd0c0aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 msgr2=0x7fdd0c0aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 0x7fdd0c0aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd0c0cc6f0 msgr2=0x7fdd0c13b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd0c0cc6f0 0x7fdd0c13b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd0a59c700 1 -- 172.21.15.12:0/317037875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc009420 con 0x7fdd0c06a110 2023-10-08T17:25:10.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.720+0000 7fdd09d9b700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 0x7fdd0c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:10.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdd0a59c700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0cf610 tx=0x7fdcfc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:10.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00bbe0 con 0x7fdd0c06a110 2023-10-08T17:25:10.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc011420 con 0x7fdd0c06a110 2023-10-08T17:25:10.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0117c0 con 0x7fdd0c06a110 2023-10-08T17:25:10.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0c0afbe0 con 0x7fdd0c06a110 2023-10-08T17:25:10.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.721+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0c138e80 con 0x7fdd0c06a110 2023-10-08T17:25:10.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.722+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd0c04c3c0 con 0x7fdd0c06a110 2023-10-08T17:25:10.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.723+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fdcfc011b30 con 0x7fdd0c06a110 2023-10-08T17:25:10.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.724+0000 7fdcfa7fc700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 0x7fdcec069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:10.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.724+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fdcfc086650 con 0x7fdd0c06a110 2023-10-08T17:25:10.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.724+0000 7fdd09d9b700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 msgr2=0x7fdcec069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:10.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.724+0000 7fdd09d9b700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 0x7fdcec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:10.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.728+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcfc053350 con 0x7fdd0c06a110 2023-10-08T17:25:10.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.925+0000 7fdd09d9b700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 msgr2=0x7fdcec069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.925+0000 7fdd09d9b700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 0x7fdcec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.932+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd0c0b05c0 con 0x7fdd0c06a110 2023-10-08T17:25:10.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.933+0000 7fdcfa7fc700 1 -- 172.21.15.12:0/317037875 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v169) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdcfc056970 con 0x7fdd0c06a110 2023-10-08T17:25:10.976 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T17:25:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 msgr2=0x7fdcec069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 0x7fdcec069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 msgr2=0x7fdd0c138940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:10.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0cf610 tx=0x7fdcfc017000 comp rx=0 tx=0).stop 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 shutdown_connections 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fdcec0670e0 0x7fdcec069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdd0c06a110 0x7fdd0c138940 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdd0c0cc6f0 0x7fdd0c13b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 --2- 172.21.15.12:0/317037875 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdd0c0cc320 0x7fdd0c0aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 >> 172.21.15.12:0/317037875 conn(0x7fdd0c067f00 msgr2=0x7fdd0c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 shutdown_connections 2023-10-08T17:25:10.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:10.936+0000 7fdd10dff700 1 -- 172.21.15.12:0/317037875 wait complete. 2023-10-08T17:25:10.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T17:25:11.006 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:11.006+0000 7f07a1ea9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:11.123 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:11.055+0000 7fcbe9862180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:11.123 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:11.104+0000 7f07a1ea9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:11.159 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:11.158+0000 7fcbe9862180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:11.200 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:11.200+0000 7f07a1ea9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:11.257 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:11.255+0000 7fcbe9862180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:11.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.315+0000 7ff60719d700 1 Processor -- start 2023-10-08T17:25:11.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.315+0000 7ff60719d700 1 -- start start 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.316+0000 7ff60719d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff600153a00 0x7ff600153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6000cea00 0x7ff6000cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60015ac50 con 0x7ff60015de50 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60015d010 con 0x7ff6000cea00 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60719d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6000cf3c0 con 0x7ff600153a00 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6000cea00 0x7ff6000cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff6000cea00 0x7ff6000cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47300/0 (socket says 172.21.15.12:47300) 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 -- 172.21.15.12:0/604605816 learned_addr learned my addr 172.21.15.12:0/604605816 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60619b700 1 --2- 172.21.15.12:0/604605816 >> v2:172.21.15.29:3300/0 conn(0x7ff600153a00 0x7ff600153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 -- 172.21.15.12:0/604605816 >> v2:172.21.15.29:3300/0 conn(0x7ff600153a00 msgr2=0x7ff600153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 --2- 172.21.15.12:0/604605816 >> v2:172.21.15.29:3300/0 conn(0x7ff600153a00 0x7ff600153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 -- 172.21.15.12:0/604605816 >> v1:172.21.15.12:6789/0 conn(0x7ff60015de50 legacy=0x7ff60015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.317+0000 7ff60699c700 1 -- 172.21.15.12:0/604605816 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60015af60 con 0x7ff6000cea00 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.318+0000 7ff60699c700 1 --2- 172.21.15.12:0/604605816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6000cea00 0x7ff6000cee80 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ff6000cac20 tx=0x7ff5f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232e98ac83990ec0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.318+0000 7ff605199700 1 -- 172.21.15.12:0/604605816 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f800e070 con 0x7ff6000cea00 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.318+0000 7ff605199700 1 -- 172.21.15.12:0/604605816 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f800ba20 con 0x7ff6000cea00 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.318+0000 7ff605199700 1 -- 172.21.15.12:0/604605816 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f80092e0 con 0x7ff6000cea00 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 -- 172.21.15.12:0/604605816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6000cea00 msgr2=0x7ff6000cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 --2- 172.21.15.12:0/604605816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6000cea00 0x7ff6000cee80 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ff6000cac20 tx=0x7ff5f8009840 comp rx=0 tx=0).stop 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 -- 172.21.15.12:0/604605816 shutdown_connections 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 --2- 172.21.15.12:0/604605816 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff6000cea00 0x7ff6000cee80 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 --2- 172.21.15.12:0/604605816 >> v2:172.21.15.29:3300/0 conn(0x7ff600153a00 0x7ff600153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 -- 172.21.15.12:0/604605816 >> 172.21.15.12:0/604605816 conn(0x7ff6000703a0 msgr2=0x7ff6000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 -- 172.21.15.12:0/604605816 shutdown_connections 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.319+0000 7ff60719d700 1 -- 172.21.15.12:0/604605816 wait complete. 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.320+0000 7ff60719d700 1 Processor -- start 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.320+0000 7ff60719d700 1 -- start start 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 0x7ff6001509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff600153a00 0x7ff6000cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 0x7ff600153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000cbbe0 con 0x7ff60015de50 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000cb2f0 con 0x7ff600153a00 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.321+0000 7ff60719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600156be0 con 0x7ff6000cea00 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 0x7ff600153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60619b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 0x7ff6001509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60599a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff600153a00 0x7ff6000cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60619b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 0x7ff6001509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44130/0 (socket says 172.21.15.12:44130) 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60619b700 1 -- 172.21.15.12:0/1763505982 learned_addr learned my addr 172.21.15.12:0/1763505982 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 msgr2=0x7ff6001509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 0x7ff6001509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff600153a00 msgr2=0x7ff6000cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff600153a00 0x7ff6000cc070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 -- 172.21.15.12:0/1763505982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f8009ae0 con 0x7ff60015de50 2023-10-08T17:25:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.322+0000 7ff60699c700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 0x7ff600153dd0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8015000 tx=0x7ff5f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:11.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.323+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8008a80 con 0x7ff60015de50 2023-10-08T17:25:11.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.323+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f8008c20 con 0x7ff60015de50 2023-10-08T17:25:11.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.323+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8025460 con 0x7ff60015de50 2023-10-08T17:25:11.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.323+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6000cb590 con 0x7ff60015de50 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.323+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff600154990 con 0x7ff60015de50 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.324+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60015d1a0 con 0x7ff60015de50 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.325+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ff5f8003040 con 0x7ff60015de50 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.326+0000 7ff5f67fc700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 0x7ff5e4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.326+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7ff5f8086130 con 0x7ff60015de50 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.326+0000 7ff60619b700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 msgr2=0x7ff5e4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.326+0000 7ff60619b700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 0x7ff5e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:11.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.330+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5f8052ca0 con 0x7ff60015de50 2023-10-08T17:25:11.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.527+0000 7ff60619b700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 msgr2=0x7ff5e4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:11.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.527+0000 7ff60619b700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 0x7ff5e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:11.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.531+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff60004c3c0 con 0x7ff60015de50 2023-10-08T17:25:11.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.531+0000 7ff5f67fc700 1 -- 172.21.15.12:0/1763505982 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v169) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff5f80562c0 con 0x7ff60015de50 2023-10-08T17:25:11.600 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 msgr2=0x7ff5e4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 0x7ff5e4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 msgr2=0x7ff600153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 0x7ff600153dd0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8015000 tx=0x7ff5f8018000 comp rx=0 tx=0).stop 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 shutdown_connections 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff5e40670e0 0x7ff5e4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff60015de50 0x7ff600153dd0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6000cea00 0x7ff6001509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 --2- 172.21.15.12:0/1763505982 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff600153a00 0x7ff6000cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 >> 172.21.15.12:0/1763505982 conn(0x7ff6000703a0 msgr2=0x7ff6000b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 shutdown_connections 2023-10-08T17:25:11.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.534+0000 7ff60719d700 1 -- 172.21.15.12:0/1763505982 wait complete. 2023-10-08T17:25:11.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:11.849 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:11.849+0000 7f07a1ea9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.863+0000 7f161259d700 1 Processor -- start 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.863+0000 7f161259d700 1 -- start start 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c153c30 0x7f160c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f160c15de50 0x7f160c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f160c0cef40 0x7f160c06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c15afd0 con 0x7f160c0cef40 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160c15b2b0 con 0x7f160c15de50 2023-10-08T17:25:11.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.864+0000 7f161259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c15b590 con 0x7f160c153c30 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f160c0cef40 0x7f160c06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f161159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c153c30 0x7f160c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f160c0cef40 0x7f160c06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47310/0 (socket says 172.21.15.12:47310) 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 -- 172.21.15.12:0/84102991 learned_addr learned my addr 172.21.15.12:0/84102991 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1610d9a700 1 --2- 172.21.15.12:0/84102991 >> v2:172.21.15.29:3300/0 conn(0x7f160c15de50 0x7f160c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 -- 172.21.15.12:0/84102991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c153c30 msgr2=0x7f160c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 --2- 172.21.15.12:0/84102991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c153c30 0x7f160c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 -- 172.21.15.12:0/84102991 >> v2:172.21.15.29:3300/0 conn(0x7f160c15de50 msgr2=0x7f160c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 --2- 172.21.15.12:0/84102991 >> v2:172.21.15.29:3300/0 conn(0x7f160c15de50 0x7f160c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.865+0000 7f1611d9c700 1 -- 172.21.15.12:0/84102991 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f160c15b870 con 0x7f160c0cef40 2023-10-08T17:25:11.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f1611d9c700 1 --2- 172.21.15.12:0/84102991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c0cef40 0x7f160c06d790 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f160c06e800 tx=0x7f1604009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae78669d8b53022e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f1603fff700 1 -- 172.21.15.12:0/84102991 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160400e070 con 0x7f160c0cef40 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f1603fff700 1 -- 172.21.15.12:0/84102991 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160400b970 con 0x7f160c0cef40 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f1603fff700 1 -- 172.21.15.12:0/84102991 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16040092e0 con 0x7f160c0cef40 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f161259d700 1 -- 172.21.15.12:0/84102991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c0cef40 msgr2=0x7f160c06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.866+0000 7f161259d700 1 --2- 172.21.15.12:0/84102991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c0cef40 0x7f160c06d790 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f160c06e800 tx=0x7f1604009840 comp rx=0 tx=0).stop 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 -- 172.21.15.12:0/84102991 shutdown_connections 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 --2- 172.21.15.12:0/84102991 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c0cef40 0x7f160c06d790 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 --2- 172.21.15.12:0/84102991 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c153c30 0x7f160c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 --2- 172.21.15.12:0/84102991 >> v2:172.21.15.29:3300/0 conn(0x7f160c15de50 0x7f160c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 -- 172.21.15.12:0/84102991 >> 172.21.15.12:0/84102991 conn(0x7f160c0703a0 msgr2=0x7f160c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 -- 172.21.15.12:0/84102991 shutdown_connections 2023-10-08T17:25:11.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.867+0000 7f161259d700 1 -- 172.21.15.12:0/84102991 wait complete. 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.868+0000 7f161259d700 1 Processor -- start 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.868+0000 7f161259d700 1 -- start start 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 0x7f160c14ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c153c30 0x7f160c0c9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 0x7f160c0cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c0ca4a0 con 0x7f160c15de50 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c142520 con 0x7f160c153c30 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.869+0000 7f161259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f160c151080 con 0x7f160c0cef40 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f161159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 0x7f160c14ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 0x7f160c0cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f161159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 0x7f160c14ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44138/0 (socket says 172.21.15.12:44138) 2023-10-08T17:25:11.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1610d9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c153c30 0x7f160c0c9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f161159b700 1 -- 172.21.15.12:0/3938687678 learned_addr learned my addr 172.21.15.12:0/3938687678 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:11.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 msgr2=0x7f160c14ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 0x7f160c14ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c153c30 msgr2=0x7f160c0c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c153c30 0x7f160c0c9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 -- 172.21.15.12:0/3938687678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1604009ae0 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.870+0000 7f1611d9c700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 0x7f160c0cb620 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f160c071370 tx=0x7f1604018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.871+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604008ad0 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.871+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1604008c50 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.871+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1604026410 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.871+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c151360 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.871+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c151920 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.872+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c151b10 con 0x7f160c15de50 2023-10-08T17:25:11.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.873+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f16040267c0 con 0x7f160c15de50 2023-10-08T17:25:11.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.874+0000 7f16017fa700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 0x7f15f0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:11.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.874+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f16040869a0 con 0x7f160c15de50 2023-10-08T17:25:11.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.874+0000 7f161159b700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 msgr2=0x7f15f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:11.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.874+0000 7f161159b700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 0x7f15f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:11.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:11.878+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1604053670 con 0x7f160c15de50 2023-10-08T17:25:11.922 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:11.921+0000 7fcbe9862180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:12.028 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:12.028+0000 7f07a1ea9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.075+0000 7f161159b700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 msgr2=0x7f15f0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:12.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.075+0000 7f161159b700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 0x7f15f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:12.104 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:12.103+0000 7fcbe9862180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:12.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.127+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f160c04c3c0 con 0x7f160c15de50 2023-10-08T17:25:12.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.127+0000 7f16017fa700 1 -- 172.21.15.12:0/3938687678 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f1604056c90 con 0x7f160c15de50 2023-10-08T17:25:12.128 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:12.129 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:25:12.129 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:12.128+0000 7f07a1ea9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:12.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 msgr2=0x7f15f0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:12.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 0x7f15f0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 msgr2=0x7f160c0cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 0x7f160c0cb620 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f160c071370 tx=0x7f1604018000 comp rx=0 tx=0).stop 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 shutdown_connections 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f15f00670e0 0x7f15f0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f160c15de50 0x7f160c0cb620 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f160c0cef40 0x7f160c14ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 --2- 172.21.15.12:0/3938687678 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f160c153c30 0x7f160c0c9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 >> 172.21.15.12:0/3938687678 conn(0x7f160c0703a0 msgr2=0x7f160c15a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 shutdown_connections 2023-10-08T17:25:12.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.130+0000 7f161259d700 1 -- 172.21.15.12:0/3938687678 wait complete. 2023-10-08T17:25:12.133 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:25:12.151 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:12.213 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:12.212+0000 7fcbe9862180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:12.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.342+0000 7f1232f9d700 1 Processor -- start 2023-10-08T17:25:12.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.342+0000 7f1232f9d700 1 -- start start 2023-10-08T17:25:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f1232f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f122c15de50 0x7f122c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f1232f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c0cf3c0 con 0x7f122c153c30 2023-10-08T17:25:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f1232f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122c15afd0 con 0x7f122c0cef40 2023-10-08T17:25:12.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f1232f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122c15b2b0 con 0x7f122c15de50 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f123179a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f122c15de50 0x7f122c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f123179a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f122c15de50 0x7f122c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34038/0 (socket says 172.21.15.12:34038) 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f123179a700 1 -- 172.21.15.12:0/3039825510 learned_addr learned my addr 172.21.15.12:0/3039825510 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.344+0000 7f1231f9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f122c153c30 0x7f122c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58702/0 (socket says 172.21.15.12:58702) 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f123179a700 1 -- 172.21.15.12:0/3039825510 >> v1:172.21.15.29:6789/0 conn(0x7f122c0cef40 legacy=0x7f122c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f123179a700 1 -- 172.21.15.12:0/3039825510 >> v1:172.21.15.12:6789/0 conn(0x7f122c153c30 legacy=0x7f122c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f123179a700 1 -- 172.21.15.12:0/3039825510 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c15b590 con 0x7f122c15de50 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f123179a700 1 --2- 172.21.15.12:0/3039825510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0cea00 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f121c0099b0 tx=0x7f121c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dfb6d2ed3b8954 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:12.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f1230f99700 1 -- 172.21.15.12:0/3039825510 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00b860 con 0x7f122c15de50 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f1230f99700 1 -- 172.21.15.12:0/3039825510 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c00b9c0 con 0x7f122c15de50 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.345+0000 7f1230f99700 1 -- 172.21.15.12:0/3039825510 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00bd60 con 0x7f122c15de50 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 -- 172.21.15.12:0/3039825510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 msgr2=0x7f122c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3039825510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0cea00 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f121c0099b0 tx=0x7f121c009250 comp rx=0 tx=0).stop 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 -- 172.21.15.12:0/3039825510 shutdown_connections 2023-10-08T17:25:12.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3039825510 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0cea00 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 -- 172.21.15.12:0/3039825510 >> 172.21.15.12:0/3039825510 conn(0x7f122c0703a0 msgr2=0x7f122c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 -- 172.21.15.12:0/3039825510 shutdown_connections 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.346+0000 7f1232f9d700 1 -- 172.21.15.12:0/3039825510 wait complete. 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.348+0000 7f1232f9d700 1 Processor -- start 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.348+0000 7f1232f9d700 1 -- start start 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 0x7f122c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f122c153c30 0x7f122c13eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0cc300 con 0x7f122c15de50 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122c13f020 con 0x7f122c0cef40 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1232f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122c0cb6f0 con 0x7f122c153c30 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f123279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f1231f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 0x7f122c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f123179a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f122c153c30 0x7f122c13eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f123279c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34048/0 (socket says 172.21.15.12:34048) 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.349+0000 7f123279c700 1 -- 172.21.15.12:0/3411433802 learned_addr learned my addr 172.21.15.12:0/3411433802 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:12.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f122c153c30 msgr2=0x7f122c13eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f122c153c30 0x7f122c13eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 msgr2=0x7f122c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 0x7f122c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 -- 172.21.15.12:0/3411433802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c0094f0 con 0x7f122c15de50 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1231f9b700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 0x7f122c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f123279c700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f122400c840 tx=0x7f1224001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:12.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224012630 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12240127b0 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224012b70 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122c0cb9d0 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.350+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122c0cbf90 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.352+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122c04c3c0 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.352+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f122401a3a0 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.353+0000 7f1221ffb700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 0x7f1210069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.353+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1224084cf0 con 0x7f122c15de50 2023-10-08T17:25:12.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.353+0000 7f1231f9b700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 msgr2=0x7f1210069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.354+0000 7f1231f9b700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 0x7f1210069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:12.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.358+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1224051970 con 0x7f122c15de50 2023-10-08T17:25:12.433 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:12.433+0000 7f07a1ea9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:12.521 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:12.520+0000 7fcbe9862180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:12.532 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:12.532+0000 7f07a1ea9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:12.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.555+0000 7f1231f9b700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 msgr2=0x7f1210069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:12.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.555+0000 7f1231f9b700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 0x7f1210069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:12.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.564+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f122c0cc440 con 0x7f122c15de50 2023-10-08T17:25:12.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.565+0000 7f1221ffb700 1 -- 172.21.15.12:0/3411433802 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16490 (secure 0 0 0) 0x7f1224054f90 con 0x7f122c15de50 2023-10-08T17:25:12.595 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:12.595 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":169,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:04.083291+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/2390616266":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/733332394":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/3712260975":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/233385736":"2023-10-09T17:25:04.083261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:12.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 msgr2=0x7f1210069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 0x7f1210069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 msgr2=0x7f122c0b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f122400c840 tx=0x7f1224001670 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 shutdown_connections 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12100670e0 0x7f1210069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f122c15de50 0x7f122c0b5ab0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f122c0cef40 0x7f122c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 --2- 172.21.15.12:0/3411433802 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f122c153c30 0x7f122c13eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.567+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 >> 172.21.15.12:0/3411433802 conn(0x7f122c0703a0 msgr2=0x7f122c0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.568+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 shutdown_connections 2023-10-08T17:25:12.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.568+0000 7f1232f9d700 1 -- 172.21.15.12:0/3411433802 wait complete. 2023-10-08T17:25:12.600 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:25:12.681 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:12.682 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:12.622+0000 7fcbe9862180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:12.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.871+0000 7f1f8f59d700 1 Processor -- start 2023-10-08T17:25:12.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.871+0000 7f1f8f59d700 1 -- start start 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 0x7f1f880cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8f59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f880cef40 0x7f1f8815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8f59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f8815afd0 con 0x7f1f88153c30 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8f59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8815b2b0 con 0x7f1f880cef40 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8815b590 con 0x7f1f8815de50 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8ed9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1f880cef40 0x7f1f8815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8e59b700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1f88153c30 0x7f1f8815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48932/0 (socket says 172.21.15.12:48932) 2023-10-08T17:25:12.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8e59b700 1 -- 172.21.15.12:0/3872959441 learned_addr learned my addr 172.21.15.12:0/3872959441 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.873+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/3872959441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 0x7f1f880cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8d599700 1 -- 172.21.15.12:0/3872959441 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2565472812 0 0) 0x7f1f8815afd0 con 0x7f1f88153c30 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8d599700 1 -- 172.21.15.12:0/3872959441 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f74003570 con 0x7f1f88153c30 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/3872959441 >> v2:172.21.15.12:3300/0 conn(0x7f1f880cef40 msgr2=0x7f1f8815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/3872959441 >> v2:172.21.15.12:3300/0 conn(0x7f1f880cef40 0x7f1f8815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/3872959441 >> v1:172.21.15.29:6789/0 conn(0x7f1f88153c30 legacy=0x7f1f8815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/3872959441 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8815b870 con 0x7f1f8815de50 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/3872959441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 0x7f1f880cea00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f780098e0 tx=0x7f1f780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1115f2cb2b98b1c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8d599700 1 -- 172.21.15.12:0/3872959441 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78011630 con 0x7f1f8815de50 2023-10-08T17:25:12.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8d599700 1 -- 172.21.15.12:0/3872959441 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78011790 con 0x7f1f8815de50 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.874+0000 7f1f8d599700 1 -- 172.21.15.12:0/3872959441 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78011b30 con 0x7f1f8815de50 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 -- 172.21.15.12:0/3872959441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 msgr2=0x7f1f880cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/3872959441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 0x7f1f880cea00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1f780098e0 tx=0x7f1f780091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 -- 172.21.15.12:0/3872959441 shutdown_connections 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/3872959441 >> v2:172.21.15.12:3300/0 conn(0x7f1f880cef40 0x7f1f8815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/3872959441 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f8815de50 0x7f1f880cea00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 -- 172.21.15.12:0/3872959441 >> 172.21.15.12:0/3872959441 conn(0x7f1f880703a0 msgr2=0x7f1f880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 -- 172.21.15.12:0/3872959441 shutdown_connections 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.875+0000 7f1f8f59d700 1 -- 172.21.15.12:0/3872959441 wait complete. 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.876+0000 7f1f8f59d700 1 Processor -- start 2023-10-08T17:25:12.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 -- start start 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 0x7f1f880ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f8815de50 0x7f1f88151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880b1490 con 0x7f1f88153c30 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880b0880 con 0x7f1f8815de50 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.877+0000 7f1f8f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880b0b60 con 0x7f1f880cef40 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8e59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 0x7f1f880ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8e59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:52824/0 (socket says 172.21.15.12:52824) 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8e59b700 1 -- 172.21.15.12:0/1565110342 learned_addr learned my addr 172.21.15.12:0/1565110342 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:12.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8ed9c700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f8815de50 0x7f1f88151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 msgr2=0x7f1f880b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f8815de50 msgr2=0x7f1f88151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f8815de50 0x7f1f88151a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8dd9a700 1 -- 172.21.15.12:0/1565110342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f78009420 con 0x7f1f88153c30 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.878+0000 7f1f8e59b700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f8dd9a700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 0x7f1f880ccce0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1f78016000 tx=0x7f1f78017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78000c40 con 0x7f1f88153c30 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f78011900 con 0x7f1f88153c30 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f78025420 con 0x7f1f88153c30 2023-10-08T17:25:12.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f880b0e40 con 0x7f1f88153c30 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.879+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f880cd220 con 0x7f1f88153c30 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.880+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8804c3c0 con 0x7f1f88153c30 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.881+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1f78023070 con 0x7f1f88153c30 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.882+0000 7f1f7e7fc700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 0x7f1f6c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.882+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1f78085c60 con 0x7f1f88153c30 2023-10-08T17:25:12.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.882+0000 7f1f8e59b700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 msgr2=0x7f1f6c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:12.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.882+0000 7f1f8e59b700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 0x7f1f6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:12.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:12.886+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f780528e0 con 0x7f1f88153c30 2023-10-08T17:25:13.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.083+0000 7f1f8e59b700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 msgr2=0x7f1f6c069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:13.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.083+0000 7f1f8e59b700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 0x7f1f6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:13.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.157+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f880b15d0 con 0x7f1f88153c30 2023-10-08T17:25:13.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.157+0000 7f1f7e7fc700 1 -- 172.21.15.12:0/1565110342 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f1f7802a090 con 0x7f1f88153c30 2023-10-08T17:25:13.158 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:13.159 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:25:13.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 msgr2=0x7f1f6c069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:13.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 0x7f1f6c069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 msgr2=0x7f1f880ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 0x7f1f880ccce0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f1f78016000 tx=0x7f1f78017000 comp rx=0 tx=0).stop 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 shutdown_connections 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1f6c0670e0 0x7f1f6c069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1f8815de50 0x7f1f88151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1f880cef40 0x7f1f880b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 --2- 172.21.15.12:0/1565110342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1f88153c30 0x7f1f880ccce0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 >> 172.21.15.12:0/1565110342 conn(0x7f1f880703a0 msgr2=0x7f1f880c68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:13.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 shutdown_connections 2023-10-08T17:25:13.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.160+0000 7f1f8f59d700 1 -- 172.21.15.12:0/1565110342 wait complete. 2023-10-08T17:25:13.163 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:25:13.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:13.277 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:13.276+0000 7f07a1ea9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:13.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.368+0000 7fa4cef9d700 1 Processor -- start 2023-10-08T17:25:13.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.369+0000 7fa4cef9d700 1 -- start start 2023-10-08T17:25:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cef9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4c80af600 0x7fa4c80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cef9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c80c6d50 con 0x7fa4c8140e40 2023-10-08T17:25:13.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cef9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c80c7030 con 0x7fa4c8140a70 2023-10-08T17:25:13.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cef9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c80c7310 con 0x7fa4c80af600 2023-10-08T17:25:13.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cd79a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa4c8140e40 0x7fa4c80aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58716/0 (socket says 172.21.15.12:58716) 2023-10-08T17:25:13.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4cd79a700 1 -- 172.21.15.12:0/4017079617 learned_addr learned my addr 172.21.15.12:0/4017079617 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:13.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.370+0000 7fa4ce79c700 1 --2- 172.21.15.12:0/4017079617 >> v2:172.21.15.12:3300/0 conn(0x7fa4c80af600 0x7fa4c80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560797348 0 0) 0x7fa4c80c6d50 con 0x7fa4c8140e40 2023-10-08T17:25:13.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4b4003570 con 0x7fa4c8140e40 2023-10-08T17:25:13.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 453564423 0 0) 0x7fa4c80c7030 con 0x7fa4c8140a70 2023-10-08T17:25:13.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ce79c700 1 -- 172.21.15.12:0/4017079617 >> v1:172.21.15.29:6789/0 conn(0x7fa4c8140a70 legacy=0x7fa4c80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ce79c700 1 -- 172.21.15.12:0/4017079617 >> v1:172.21.15.12:6789/0 conn(0x7fa4c8140e40 legacy=0x7fa4c80aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ce79c700 1 -- 172.21.15.12:0/4017079617 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80c75f0 con 0x7fa4c80af600 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ce79c700 1 --2- 172.21.15.12:0/4017079617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c80af600 0x7fa4c80c6770 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009e60 tx=0x7fa4c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64e8ec1e5c658dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.371+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000e070 con 0x7fa4c80af600 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000bb60 con 0x7fa4c80af600 2023-10-08T17:25:13.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4ccf99700 1 -- 172.21.15.12:0/4017079617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000bee0 con 0x7fa4c80af600 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 -- 172.21.15.12:0/4017079617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c80af600 msgr2=0x7fa4c80c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/4017079617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c80af600 0x7fa4c80c6770 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0009e60 tx=0x7fa4c0009780 comp rx=0 tx=0).stop 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 -- 172.21.15.12:0/4017079617 shutdown_connections 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/4017079617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c80af600 0x7fa4c80c6770 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 -- 172.21.15.12:0/4017079617 >> 172.21.15.12:0/4017079617 conn(0x7fa4c806d170 msgr2=0x7fa4c80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 -- 172.21.15.12:0/4017079617 shutdown_connections 2023-10-08T17:25:13.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.372+0000 7fa4cef9d700 1 -- 172.21.15.12:0/4017079617 wait complete. 2023-10-08T17:25:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.374+0000 7fa4cef9d700 1 Processor -- start 2023-10-08T17:25:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.374+0000 7fa4cef9d700 1 -- start start 2023-10-08T17:25:13.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80af600 0x7fa4c815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4c8140e40 0x7fa4c813f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8159550 con 0x7fa4c8140a70 2023-10-08T17:25:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c81597f0 con 0x7fa4c80af600 2023-10-08T17:25:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cef9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8159ad0 con 0x7fa4c8140e40 2023-10-08T17:25:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cd79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cd79a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34090/0 (socket says 172.21.15.12:34090) 2023-10-08T17:25:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cd79a700 1 -- 172.21.15.12:0/687762827 learned_addr learned my addr 172.21.15.12:0/687762827 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4cdf9b700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80af600 0x7fa4c815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.375+0000 7fa4ce79c700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4c8140e40 0x7fa4c813f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4c8140e40 msgr2=0x7fa4c813f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4c8140e40 0x7fa4c813f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80af600 msgr2=0x7fa4c815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80af600 0x7fa4c815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 -- 172.21.15.12:0/687762827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c0009a20 con 0x7fa4c8140a70 2023-10-08T17:25:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cd79a700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8001260 tx=0x7fa4b8007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:13.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80072e0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b8007460 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c8159db0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b80057f0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.376+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c80c33a0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.377+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c815a2d0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.378+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fa4b8005c40 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.380+0000 7fa4bdffb700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 0x7fa4ac069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.380+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7fa4b8083ff0 con 0x7fa4c8140a70 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.380+0000 7fa4cdf9b700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 msgr2=0x7fa4ac069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.380+0000 7fa4cdf9b700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 0x7fa4ac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:13.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.384+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4c815a2d0 con 0x7fa4c8140a70 2023-10-08T17:25:13.470 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:13.400+0000 7fcbe9862180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:13.568 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:13.567+0000 7f07a1ea9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.581+0000 7fa4cdf9b700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 msgr2=0x7fa4ac069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:13.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.581+0000 7fa4cdf9b700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 0x7fa4ac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:13.636 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.635+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4c815a2d0 con 0x7fa4c8140a70 2023-10-08T17:25:13.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.636+0000 7fa4bdffb700 1 -- 172.21.15.12:0/687762827 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fa4c815a2d0 con 0x7fa4c8140a70 2023-10-08T17:25:13.664 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:13.664 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":74,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:24:47.621722+0000","modified":"2023-10-08T17:24:51.151967+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8751},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8751":{"gid":8751,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":5,"addr":"172.21.15.12:6834/1897099896","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1897099896},{"type":"v1","addr":"172.21.15.12:6834","nonce":1897099896}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-08T17:25:13.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.638+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 msgr2=0x7fa4ac069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:13.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.638+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 0x7fa4ac069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.638+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 msgr2=0x7fa4c813ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.638+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8001260 tx=0x7fa4b8007c40 comp rx=0 tx=0).stop 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 shutdown_connections 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fa4ac0670e0 0x7fa4ac069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4c8140e40 0x7fa4c813f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa4c80af600 0x7fa4c815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 --2- 172.21.15.12:0/687762827 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4c8140a70 0x7fa4c813ead0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 >> 172.21.15.12:0/687762827 conn(0x7fa4c806d170 msgr2=0x7fa4c813f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:13.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 shutdown_connections 2023-10-08T17:25:13.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.639+0000 7fa4cef9d700 1 -- 172.21.15.12:0/687762827 wait complete. 2023-10-08T17:25:13.668 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 74 2023-10-08T17:25:13.669 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:13.670 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:13.664+0000 7f07a1ea9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:13.697 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:13.696+0000 7fcbe9862180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:13.797 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:13.796+0000 7fcbe9862180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:13.894 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:13.825+0000 7f07a1ea9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.857+0000 7f1b97fff700 1 Processor -- start 2023-10-08T17:25:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.858+0000 7f1b97fff700 1 -- start start 2023-10-08T17:25:13.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b97fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1b9813fef0 0x7f1b9815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b97fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b9806aaa0 0x7f1b980c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b97fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9815ae70 con 0x7f1b9813fb20 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b97fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9806af60 con 0x7f1b9806aaa0 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b97fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b9806b240 con 0x7f1b9813fef0 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b977fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1b9806aaa0 0x7f1b980c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b96ffd700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f1b9813fb20 0x7f1b980c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48956/0 (socket says 172.21.15.12:48956) 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b96ffd700 1 -- 172.21.15.12:0/3254159810 learned_addr learned my addr 172.21.15.12:0/3254159810 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.859+0000 7f1b967fc700 1 --2- 172.21.15.12:0/3254159810 >> v2:172.21.15.29:3300/0 conn(0x7f1b9813fef0 0x7f1b9815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b95ffb700 1 -- 172.21.15.12:0/3254159810 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727832862 0 0) 0x7f1b88001110 con 0x7f1b9813fb20 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b95ffb700 1 -- 172.21.15.12:0/3254159810 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b80003570 con 0x7f1b9813fb20 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b977fe700 1 -- 172.21.15.12:0/3254159810 >> v2:172.21.15.29:3300/0 conn(0x7f1b9813fef0 msgr2=0x7f1b9815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:13.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b977fe700 1 --2- 172.21.15.12:0/3254159810 >> v2:172.21.15.29:3300/0 conn(0x7f1b9813fef0 0x7f1b9815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b977fe700 1 -- 172.21.15.12:0/3254159810 >> v1:172.21.15.29:6789/0 conn(0x7f1b9813fb20 legacy=0x7f1b980c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b977fe700 1 -- 172.21.15.12:0/3254159810 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9806b520 con 0x7f1b9806aaa0 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b977fe700 1 --2- 172.21.15.12:0/3254159810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980c9d00 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1b9806a5e0 tx=0x7f1b90009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f44760e1233ed6b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.860+0000 7f1b95ffb700 1 -- 172.21.15.12:0/3254159810 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9000e070 con 0x7f1b9806aaa0 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b95ffb700 1 -- 172.21.15.12:0/3254159810 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9000bab0 con 0x7f1b9806aaa0 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b95ffb700 1 -- 172.21.15.12:0/3254159810 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9000be30 con 0x7f1b9806aaa0 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 -- 172.21.15.12:0/3254159810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 msgr2=0x7f1b980c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.931 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 --2- 172.21.15.12:0/3254159810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980c9d00 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1b9806a5e0 tx=0x7f1b90009780 comp rx=0 tx=0).stop 2023-10-08T17:25:13.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 -- 172.21.15.12:0/3254159810 shutdown_connections 2023-10-08T17:25:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 --2- 172.21.15.12:0/3254159810 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980c9d00 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 --2- 172.21.15.12:0/3254159810 >> v2:172.21.15.29:3300/0 conn(0x7f1b9813fef0 0x7f1b9815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 -- 172.21.15.12:0/3254159810 >> 172.21.15.12:0/3254159810 conn(0x7f1b9806d170 msgr2=0x7f1b980cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 -- 172.21.15.12:0/3254159810 shutdown_connections 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.861+0000 7f1b97fff700 1 -- 172.21.15.12:0/3254159810 wait complete. 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.863+0000 7f1b97fff700 1 Processor -- start 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.863+0000 7f1b97fff700 1 -- start start 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1b9813fb20 0x7f1b980c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b9813fef0 0x7f1b98158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980ad2e0 con 0x7f1b9806aaa0 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980acd00 con 0x7f1b9813fef0 2023-10-08T17:25:13.934 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b97fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b980adcb0 con 0x7f1b9813fb20 2023-10-08T17:25:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b96ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34114/0 (socket says 172.21.15.12:34114) 2023-10-08T17:25:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b96ffd700 1 -- 172.21.15.12:0/1330350999 learned_addr learned my addr 172.21.15.12:0/1330350999 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:13.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b977fe700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b9813fef0 0x7f1b98158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.864+0000 7f1b967fc700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1b9813fb20 0x7f1b980c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1b9813fb20 msgr2=0x7f1b980c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1b9813fb20 0x7f1b980c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b9813fef0 msgr2=0x7f1b98158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:13.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b9813fef0 0x7f1b98158a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:13.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 -- 172.21.15.12:0/1330350999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b90009a20 con 0x7f1b9806aaa0 2023-10-08T17:25:13.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b96ffd700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c7f0 tx=0x7f1b88007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88005b30 con 0x7f1b9806aaa0 2023-10-08T17:25:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b88005c90 con 0x7f1b9806aaa0 2023-10-08T17:25:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b88007320 con 0x7f1b9806aaa0 2023-10-08T17:25:13.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.865+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b98159440 con 0x7f1b9806aaa0 2023-10-08T17:25:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.866+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b98159720 con 0x7f1b9806aaa0 2023-10-08T17:25:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.867+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b9804c3c0 con 0x7f1b9806aaa0 2023-10-08T17:25:13.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.868+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f1b880076d0 con 0x7f1b9806aaa0 2023-10-08T17:25:13.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.869+0000 7f1b7effd700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 0x7f1b84069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:13.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.869+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f1b88083e00 con 0x7f1b9806aaa0 2023-10-08T17:25:13.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.870+0000 7f1b967fc700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 msgr2=0x7f1b84069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.870+0000 7f1b967fc700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 0x7f1b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:13.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:13.873+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b88050a80 con 0x7f1b9806aaa0 2023-10-08T17:25:13.974 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:13.934+0000 7f07a1ea9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:13.974 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:13.964+0000 7fcbe9862180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:14.072 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.071+0000 7f1b967fc700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 msgr2=0x7f1b84069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:14.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.071+0000 7f1b967fc700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 0x7f1b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:14.087 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.074+0000 7fcbe9862180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.079+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b9815ae70 con 0x7f1b9806aaa0 2023-10-08T17:25:14.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.080+0000 7f1b7effd700 1 -- 172.21.15.12:0/1330350999 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16490 (secure 0 0 0) 0x7f1b9815ae70 con 0x7f1b9806aaa0 2023-10-08T17:25:14.088 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:14.088 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":169,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:04.083291+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:24:45.287105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-08T17:24:46.609576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/2390616266":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/733332394":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/3712260975":"2023-10-09T17:25:04.083261+0000","172.21.15.12:0/233385736":"2023-10-09T17:25:04.083261+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:14.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 msgr2=0x7f1b84069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 0x7f1b84069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 msgr2=0x7f1b980ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1b8800c7f0 tx=0x7f1b88007c30 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 shutdown_connections 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1b840670e0 0x7f1b84069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1b9806aaa0 0x7f1b980ad770 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1b9813fef0 0x7f1b98158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.084+0000 7f1b97fff700 1 --2- 172.21.15.12:0/1330350999 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1b9813fb20 0x7f1b980c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.085+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 >> 172.21.15.12:0/1330350999 conn(0x7f1b9806d170 msgr2=0x7f1b980cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.085+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 shutdown_connections 2023-10-08T17:25:14.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.085+0000 7f1b97fff700 1 -- 172.21.15.12:0/1330350999 wait complete. 2023-10-08T17:25:14.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T17:25:14.132 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:14.131+0000 7f07a1ea9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:14.228 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:14.228+0000 7f07a1ea9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:14.290 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.289+0000 7fcbe9862180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:14.369 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:14.323+0000 7f07a1ea9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.342+0000 7f4e7119d700 1 Processor -- start 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.342+0000 7f4e7119d700 1 -- start start 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.343+0000 7f4e7119d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4e6c0caec0 0x7f4e6c164450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.343+0000 7f4e7119d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c0c7420 con 0x7f4e6c159a10 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.343+0000 7f4e7119d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c06d820 con 0x7f4e6c159640 2023-10-08T17:25:14.373 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.343+0000 7f4e7119d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c06db00 con 0x7f4e6c0caec0 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e6b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4e6c159a10 0x7f4e6c0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58732/0 (socket says 172.21.15.12:58732) 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e6b7fe700 1 -- 172.21.15.12:0/3061762899 learned_addr learned my addr 172.21.15.12:0/3061762899 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e7099c700 1 --2- 172.21.15.12:0/3061762899 >> v2:172.21.15.29:3300/0 conn(0x7f4e6c0caec0 0x7f4e6c164450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2513405939 0 0) 0x7f4e6c0c7420 con 0x7f4e6c159a10 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e54003570 con 0x7f4e6c159a10 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e7099c700 1 -- 172.21.15.12:0/3061762899 >> v1:172.21.15.29:6789/0 conn(0x7f4e6c159640 legacy=0x7f4e6c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244028812 0 0) 0x7f4e6c06d820 con 0x7f4e6c159640 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e7099c700 1 -- 172.21.15.12:0/3061762899 >> v1:172.21.15.12:6789/0 conn(0x7f4e6c159a10 legacy=0x7f4e6c0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.344+0000 7f4e7099c700 1 -- 172.21.15.12:0/3061762899 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c06dde0 con 0x7f4e6c0caec0 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7099c700 1 --2- 172.21.15.12:0/3061762899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c0caec0 0x7f4e6c164450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009e90 tx=0x7f4e64009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb016da32987dd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400e070 con 0x7f4e6c0caec0 2023-10-08T17:25:14.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6400bc40 con 0x7f4e6c0caec0 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e6affd700 1 -- 172.21.15.12:0/3061762899 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64012430 con 0x7f4e6c0caec0 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7119d700 1 -- 172.21.15.12:0/3061762899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c0caec0 msgr2=0x7f4e6c164450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7119d700 1 --2- 172.21.15.12:0/3061762899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c0caec0 0x7f4e6c164450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009e90 tx=0x7f4e64009780 comp rx=0 tx=0).stop 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7119d700 1 -- 172.21.15.12:0/3061762899 shutdown_connections 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7119d700 1 --2- 172.21.15.12:0/3061762899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c0caec0 0x7f4e6c164450 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.345+0000 7f4e7119d700 1 -- 172.21.15.12:0/3061762899 >> 172.21.15.12:0/3061762899 conn(0x7f4e6c06e720 msgr2=0x7f4e6c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.346+0000 7f4e7119d700 1 -- 172.21.15.12:0/3061762899 shutdown_connections 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.346+0000 7f4e7119d700 1 -- 172.21.15.12:0/3061762899 wait complete. 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.347+0000 7f4e7119d700 1 Processor -- start 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.347+0000 7f4e7119d700 1 -- start start 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e6c0caec0 0x7f4e6c1442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c159a10 0x7f4e6c06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c150980 con 0x7f4e6c159640 2023-10-08T17:25:14.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c3dd0 con 0x7f4e6c159a10 2023-10-08T17:25:14.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c40b0 con 0x7f4e6c0caec0 2023-10-08T17:25:14.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e6b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e6b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34120/0 (socket says 172.21.15.12:34120) 2023-10-08T17:25:14.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e6b7fe700 1 -- 172.21.15.12:0/2732637163 learned_addr learned my addr 172.21.15.12:0/2732637163 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:14.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e6bfff700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e6c0caec0 0x7f4e6c1442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.348+0000 7f4e7099c700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c159a10 0x7f4e6c06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e6c0caec0 msgr2=0x7f4e6c1442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e6c0caec0 0x7f4e6c1442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c159a10 msgr2=0x7f4e6c06eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c159a10 0x7f4e6c06eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 -- 172.21.15.12:0/2732637163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009a20 con 0x7f4e6c159640 2023-10-08T17:25:14.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e6b7fe700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c7c0 tx=0x7f4e60007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:14.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60005c00 con 0x7f4e6c159640 2023-10-08T17:25:14.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60005d60 con 0x7f4e6c159640 2023-10-08T17:25:14.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600072e0 con 0x7f4e6c159640 2023-10-08T17:25:14.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c0c4390 con 0x7f4e6c159640 2023-10-08T17:25:14.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.349+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c0c4950 con 0x7f4e6c159640 2023-10-08T17:25:14.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.350+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c0c4b70 con 0x7f4e6c159640 2023-10-08T17:25:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.352+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 78) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f4e60007650 con 0x7f4e6c159640 2023-10-08T17:25:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.352+0000 7f4e53fff700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 0x7f4e58069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.353+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f4e60083e70 con 0x7f4e6c159640 2023-10-08T17:25:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.353+0000 7f4e6bfff700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 msgr2=0x7f4e58069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.353+0000 7f4e6bfff700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 0x7f4e58069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:14.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.357+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e6004b5a0 con 0x7f4e6c159640 2023-10-08T17:25:14.408 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.390+0000 7fcbe9862180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:14.422 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:14.421+0000 7f07a1ea9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:14.489 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.487+0000 7fcbe9862180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.554+0000 7f4e6bfff700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 msgr2=0x7f4e58069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:14.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.554+0000 7f4e6bfff700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 0x7f4e58069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:14.586 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.585+0000 7fcbe9862180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:14.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.597+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 79) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f4e60050f70 con 0x7f4e6c159640 2023-10-08T17:25:14.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.597+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 msgr2=0x7f4e58069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:14.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.597+0000 7f4e53fff700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 0x7f4e58069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.619+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4e6c0cb2f0 con 0x7f4e6c159640 2023-10-08T17:25:14.622 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T17:25:14.620+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T17:25:14.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.625+0000 7f4e53fff700 1 -- 172.21.15.12:0/2732637163 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4e6007f120 con 0x7f4e6c159640 2023-10-08T17:25:14.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 msgr2=0x7f4e6c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c7c0 tx=0x7f4e60007d90 comp rx=0 tx=0).stop 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 shutdown_connections 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f4e580670e0 0x7f4e58069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e6c159a10 0x7f4e6c06eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e6c0caec0 0x7f4e6c1442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 --2- 172.21.15.12:0/2732637163 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e6c159640 0x7f4e6c06aa50 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 >> 172.21.15.12:0/2732637163 conn(0x7f4e6c06e720 msgr2=0x7f4e6c0c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.628+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 shutdown_connections 2023-10-08T17:25:14.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.629+0000 7f4e7119d700 1 -- 172.21.15.12:0/2732637163 wait complete. 2023-10-08T17:25:14.632 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T17:25:14.633 INFO:tasks.ceph.mds.a.smithi012.stderr: -2631> 2023-10-08T17:24:51.613+0000 7fa1253f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:25:14.653 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb63440700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb63440700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb63440700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb63440700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb63440700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb67c49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.678 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb67c49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb67c49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb67c49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:14.668+0000 7fcb67c49700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:14.685 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T17:25:14.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.873+0000 7f65ea59d700 1 Processor -- start 2023-10-08T17:25:14.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.874+0000 7f65ea59d700 1 -- start start 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65ea59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f65e4155890 0x7f65e40c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65ea59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65e406de50 0x7f65e406e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65ea59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e40c7e70 con 0x7f65e4155c60 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65ea59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e406e7f0 con 0x7f65e406de50 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65ea59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e406b790 con 0x7f65e4155890 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65e9d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f65e406de50 0x7f65e406e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65e8d9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f65e4155c60 0x7f65e406a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58754/0 (socket says 172.21.15.12:58754) 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65e8d9a700 1 -- 172.21.15.12:0/3930901813 learned_addr learned my addr 172.21.15.12:0/3930901813 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.875+0000 7f65e959b700 1 --2- 172.21.15.12:0/3930901813 >> v2:172.21.15.29:3300/0 conn(0x7f65e4155890 0x7f65e40c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65dbfff700 1 -- 172.21.15.12:0/3930901813 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830668939 0 0) 0x7f65e40c7e70 con 0x7f65e4155c60 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3930901813 >> v2:172.21.15.29:3300/0 conn(0x7f65e4155890 msgr2=0x7f65e40c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65e9d9c700 1 --2- 172.21.15.12:0/3930901813 >> v2:172.21.15.29:3300/0 conn(0x7f65e4155890 0x7f65e40c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3930901813 >> v1:172.21.15.12:6789/0 conn(0x7f65e4155c60 legacy=0x7f65e406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3930901813 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e406ab80 con 0x7f65e406de50 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65e9d9c700 1 --2- 172.21.15.12:0/3930901813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e406de50 0x7f65e406e2b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00af70 tx=0x7f65dc00a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714383864a08687 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65dbfff700 1 -- 172.21.15.12:0/3930901813 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00f070 con 0x7f65e406de50 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65dbfff700 1 -- 172.21.15.12:0/3930901813 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc00a2e0 con 0x7f65e406de50 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.876+0000 7f65dbfff700 1 -- 172.21.15.12:0/3930901813 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00cc30 con 0x7f65e406de50 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 -- 172.21.15.12:0/3930901813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e406de50 msgr2=0x7f65e406e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3930901813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e406de50 0x7f65e406e2b0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00af70 tx=0x7f65dc00a890 comp rx=0 tx=0).stop 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 -- 172.21.15.12:0/3930901813 shutdown_connections 2023-10-08T17:25:14.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3930901813 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e406de50 0x7f65e406e2b0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3930901813 >> v2:172.21.15.29:3300/0 conn(0x7f65e4155890 0x7f65e40c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 -- 172.21.15.12:0/3930901813 >> 172.21.15.12:0/3930901813 conn(0x7f65e406d110 msgr2=0x7f65e40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 -- 172.21.15.12:0/3930901813 shutdown_connections 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.877+0000 7f65ea59d700 1 -- 172.21.15.12:0/3930901813 wait complete. 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.878+0000 7f65ea59d700 1 Processor -- start 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 -- start start 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65e406de50 0x7f65e41533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65e4155890 0x7f65e40c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e4153900 con 0x7f65e4155c60 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e416a4c0 con 0x7f65e406de50 2023-10-08T17:25:14.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.879+0000 7f65ea59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e40c4230 con 0x7f65e4155890 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34298/0 (socket says 172.21.15.12:34298) 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3949695089 learned_addr learned my addr 172.21.15.12:0/3949695089 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e959b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65e406de50 0x7f65e41533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e8d9a700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65e4155890 0x7f65e40c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65e4155890 msgr2=0x7f65e40c2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65e4155890 0x7f65e40c2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65e406de50 msgr2=0x7f65e41533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65e406de50 0x7f65e41533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 -- 172.21.15.12:0/3949695089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65dc00ab30 con 0x7f65e4155c60 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.880+0000 7f65e9d9c700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00a8d0 tx=0x7f65dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:14.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.881+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc009b20 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.881+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65dc009cc0 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.881+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc01d690 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.881+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e40aa760 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.881+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e416a9f0 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.882+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e40c43e0 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.883+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 79) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f65dc003020 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.884+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6814+0+0 (secure 0 0 0) 0x7f65dc085ab0 con 0x7f65e4155c60 2023-10-08T17:25:14.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:14.888+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65e40c43e0 con 0x7f65e4155c60 2023-10-08T17:25:15.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.140+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f65e406f650 con 0x7f65e4155c60 2023-10-08T17:25:15.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.599+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 80) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f65dc052650 con 0x7f65e4155c60 2023-10-08T17:25:15.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.601+0000 7f65d97fa700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 0x7f65c806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.603+0000 7f65e959b700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 0x7f65c806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.607+0000 7f65e959b700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 0x7f65c806eee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009db0 tx=0x7f65e00091a0 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:15.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.625+0000 7f65d97fa700 1 -- 172.21.15.12:0/3949695089 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 104+0+0 (secure 0 0 0) 0x7f65dc06bcf0 con 0x7f65e4155c60 2023-10-08T17:25:15.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 msgr2=0x7f65c806eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 0x7f65c806eee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009db0 tx=0x7f65e00091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 msgr2=0x7f65e40c2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00a8d0 tx=0x7f65dc019000 comp rx=0 tx=0).stop 2023-10-08T17:25:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 shutdown_connections 2023-10-08T17:25:15.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f65c806cb00 0x7f65c806eee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f65e4155c60 0x7f65e40c2790 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f65e406de50 0x7f65e41533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 --2- 172.21.15.12:0/3949695089 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f65e4155890 0x7f65e40c2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 >> 172.21.15.12:0/3949695089 conn(0x7f65e406d110 msgr2=0x7f65e40c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.628+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 shutdown_connections 2023-10-08T17:25:15.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.629+0000 7f65ea59d700 1 -- 172.21.15.12:0/3949695089 wait complete. 2023-10-08T17:25:15.760 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T17:25:15.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.951+0000 7fb6ad79d700 1 Processor -- start 2023-10-08T17:25:15.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.951+0000 7fb6ad79d700 1 -- start start 2023-10-08T17:25:15.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.952+0000 7fb6ad79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.952+0000 7fb6ad79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6a80c9090 0x7fb6a8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6ad79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6a80c2200 con 0x7fb6a8153a30 2023-10-08T17:25:15.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6ad79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8157250 con 0x7fb6a80c9090 2023-10-08T17:25:15.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6ad79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80c15f0 con 0x7fb6a8153660 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6acf9c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb6a80c9090 0x7fb6a8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6a77fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb6a8153a30 0x7fb6a80c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:48974/0 (socket says 172.21.15.12:48974) 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:53004/0 (socket says 172.21.15.12:53004) 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.953+0000 7fb6a77fe700 1 -- 172.21.15.12:0/4294342287 learned_addr learned my addr 172.21.15.12:0/4294342287 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a7fff700 1 -- 172.21.15.12:0/4294342287 >> v2:172.21.15.29:3300/0 conn(0x7fb6a80c9090 msgr2=0x7fb6a8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a7fff700 1 --2- 172.21.15.12:0/4294342287 >> v2:172.21.15.29:3300/0 conn(0x7fb6a80c9090 0x7fb6a8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a6ffd700 1 -- 172.21.15.12:0/4294342287 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425168392 0 0) 0x7fb6a80c2200 con 0x7fb6a8153a30 2023-10-08T17:25:15.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a7fff700 1 -- 172.21.15.12:0/4294342287 >> v1:172.21.15.29:6789/0 conn(0x7fb6a8153a30 legacy=0x7fb6a80c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a7fff700 1 -- 172.21.15.12:0/4294342287 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a80c18d0 con 0x7fb6a8153660 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a7fff700 1 --2- 172.21.15.12:0/4294342287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb6980098e0 tx=0x7fb6980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=635f1f63669069ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a6ffd700 1 -- 172.21.15.12:0/4294342287 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800f6b0 con 0x7fb6a8153660 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a6ffd700 1 -- 172.21.15.12:0/4294342287 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69800f810 con 0x7fb6a8153660 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.954+0000 7fb6a6ffd700 1 -- 172.21.15.12:0/4294342287 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800fbb0 con 0x7fb6a8153660 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 -- 172.21.15.12:0/4294342287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 msgr2=0x7fb6a80c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/4294342287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb6980098e0 tx=0x7fb6980091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 -- 172.21.15.12:0/4294342287 shutdown_connections 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/4294342287 >> v2:172.21.15.29:3300/0 conn(0x7fb6a80c9090 0x7fb6a8156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/4294342287 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a80c0ef0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 -- 172.21.15.12:0/4294342287 >> 172.21.15.12:0/4294342287 conn(0x7fb6a806c6a0 msgr2=0x7fb6a806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:15.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 -- 172.21.15.12:0/4294342287 shutdown_connections 2023-10-08T17:25:15.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.955+0000 7fb6ad79d700 1 -- 172.21.15.12:0/4294342287 wait complete. 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.956+0000 7fb6ad79d700 1 Processor -- start 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.956+0000 7fb6ad79d700 1 -- start start 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a8144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 0x7fb6a80b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a81451d0 con 0x7fb6a80c9090 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a815b380 con 0x7fb6a8153a30 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.957+0000 7fb6ad79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b12e0 con 0x7fb6a8153660 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34314/0 (socket says 172.21.15.12:34314) 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 -- 172.21.15.12:0/2255525746 learned_addr learned my addr 172.21.15.12:0/2255525746 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a77fe700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a8144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6acf9c700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 0x7fb6a80b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 -- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 msgr2=0x7fb6a8144c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a8144c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 -- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 msgr2=0x7fb6a80b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 0x7fb6a80b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 -- 172.21.15.12:0/2255525746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb698009420 con 0x7fb6a80c9090 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6acf9c700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 0x7fb6a80b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.958+0000 7fb6a7fff700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb6980093f0 tx=0x7fb698019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:15.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.959+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800fb90 con 0x7fb6a80c9090 2023-10-08T17:25:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.959+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb698010470 con 0x7fb6a80c9090 2023-10-08T17:25:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.959+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a815aa50 con 0x7fb6a80c9090 2023-10-08T17:25:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.959+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698010830 con 0x7fb6a80c9090 2023-10-08T17:25:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.959+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a815b010 con 0x7fb6a80c9090 2023-10-08T17:25:15.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.960+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a804c3c0 con 0x7fb6a80c9090 2023-10-08T17:25:15.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.960+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 80) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fb6980223f0 con 0x7fb6a80c9090 2023-10-08T17:25:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.961+0000 7fb68ffff700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 0x7fb694069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.961+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6814+0+0 (secure 0 0 0) 0x7fb698014070 con 0x7fb6a80c9090 2023-10-08T17:25:15.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.962+0000 7fb6a77fe700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 0x7fb694069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:15.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.962+0000 7fb6a77fe700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 0x7fb694069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:15.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:15.966+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb698052e00 con 0x7fb6a80c9090 2023-10-08T17:25:16.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:16.172+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb6a80ccd60 con 0x7fb6a80c9090 2023-10-08T17:25:17.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.143+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6980531d0 con 0x7fb6a80c9090 2023-10-08T17:25:17.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.144+0000 7fb68ffff700 1 -- 172.21.15.12:0/2255525746 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v172) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb698050850 con 0x7fb6a80c9090 2023-10-08T17:25:17.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 msgr2=0x7fb694069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:17.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 0x7fb694069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb69c007fd0 tx=0x7fb69c009040 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 msgr2=0x7fb6a80afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7fb6980093f0 tx=0x7fb698019000 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 shutdown_connections 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fb694066d80 0x7fb694069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb6a80c9090 0x7fb6a80afbe0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb6a8153a30 0x7fb6a80b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 --2- 172.21.15.12:0/2255525746 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb6a8153660 0x7fb6a8144c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 >> 172.21.15.12:0/2255525746 conn(0x7fb6a806c6a0 msgr2=0x7fb6a80ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:17.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 shutdown_connections 2023-10-08T17:25:17.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.147+0000 7fb6ad79d700 1 -- 172.21.15.12:0/2255525746 wait complete. 2023-10-08T17:25:17.179 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T17:25:17.179 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T17:25:17.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.375+0000 7f76af59e700 1 Processor -- start 2023-10-08T17:25:17.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.375+0000 7f76af59e700 1 -- start start 2023-10-08T17:25:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76b0153660 0x7f76b00c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 0x7f76b0156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f76b00c8980 0x7f76b00c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b0157250 con 0x7f76b0153660 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b00c2200 con 0x7f76b00c8980 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.376+0000 7f76af59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00c9360 con 0x7f76b0153a30 2023-10-08T17:25:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76b0153660 0x7f76b00c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f76b0153660 0x7f76b00c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34318/0 (socket says 172.21.15.12:34318) 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 -- 172.21.15.12:0/3500063056 learned_addr learned my addr 172.21.15.12:0/3500063056 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76aed9d700 1 --2- 172.21.15.12:0/3500063056 >> v2:172.21.15.29:3300/0 conn(0x7f76b00c8980 0x7f76b00c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76add9b700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 0x7f76b0156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 -- 172.21.15.12:0/3500063056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 msgr2=0x7f76b0156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:17.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 0x7f76b0156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 -- 172.21.15.12:0/3500063056 >> v2:172.21.15.29:3300/0 conn(0x7f76b00c8980 msgr2=0x7f76b00c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 --2- 172.21.15.12:0/3500063056 >> v2:172.21.15.29:3300/0 conn(0x7f76b00c8980 0x7f76b00c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 -- 172.21.15.12:0/3500063056 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00c15f0 con 0x7f76b0153660 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76add9b700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 0x7f76b0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.377+0000 7f76ae59c700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153660 0x7f76b00c0ef0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f76b00aec10 tx=0x7f76a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccdc415bed205b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:17.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76ad59a700 1 -- 172.21.15.12:0/3500063056 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000b860 con 0x7f76b0153660 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76ad59a700 1 -- 172.21.15.12:0/3500063056 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000b9c0 con 0x7f76b0153660 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76ad59a700 1 -- 172.21.15.12:0/3500063056 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000bd60 con 0x7f76b0153660 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 -- 172.21.15.12:0/3500063056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153660 msgr2=0x7f76b00c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153660 0x7f76b00c0ef0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f76b00aec10 tx=0x7f76a0009250 comp rx=0 tx=0).stop 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 -- 172.21.15.12:0/3500063056 shutdown_connections 2023-10-08T17:25:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 --2- 172.21.15.12:0/3500063056 >> v2:172.21.15.29:3300/0 conn(0x7f76b00c8980 0x7f76b00c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153660 0x7f76b00c0ef0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 --2- 172.21.15.12:0/3500063056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153a30 0x7f76b0156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 -- 172.21.15.12:0/3500063056 >> 172.21.15.12:0/3500063056 conn(0x7f76b006c6a0 msgr2=0x7f76b006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 -- 172.21.15.12:0/3500063056 shutdown_connections 2023-10-08T17:25:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.378+0000 7f76af59e700 1 -- 172.21.15.12:0/3500063056 wait complete. 2023-10-08T17:25:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.380+0000 7f76af59e700 1 Processor -- start 2023-10-08T17:25:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.380+0000 7f76af59e700 1 -- start start 2023-10-08T17:25:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b00c8980 0x7f76b006b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153660 0x7f76b00afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b006b980 con 0x7f76b0153a30 2023-10-08T17:25:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b014e110 con 0x7f76b00c8980 2023-10-08T17:25:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76af59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00af980 con 0x7f76b0153660 2023-10-08T17:25:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76ae59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b00c8980 0x7f76b006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34320/0 (socket says 172.21.15.12:34320) 2023-10-08T17:25:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76aed9d700 1 -- 172.21.15.12:0/1713118132 learned_addr learned my addr 172.21.15.12:0/1713118132 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.381+0000 7f76add9b700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153660 0x7f76b00afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 -- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153660 msgr2=0x7f76b00afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153660 0x7f76b00afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 -- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b00c8980 msgr2=0x7f76b006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b00c8980 0x7f76b006b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 -- 172.21.15.12:0/1713118132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00094f0 con 0x7f76b0153a30 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76aed9d700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009fd0 tx=0x7f76a8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a800ebf0 con 0x7f76b0153a30 2023-10-08T17:25:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a800ed50 con 0x7f76b0153a30 2023-10-08T17:25:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8014670 con 0x7f76b0153a30 2023-10-08T17:25:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00af090 con 0x7f76b0153a30 2023-10-08T17:25:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.382+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b00af610 con 0x7f76b0153a30 2023-10-08T17:25:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.383+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b004c3c0 con 0x7f76b0153a30 2023-10-08T17:25:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.384+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76a80149e0 con 0x7f76b0153a30 2023-10-08T17:25:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.385+0000 7f769e7fc700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:17.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.385+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 6376+0+0 (secure 0 0 0) 0x7f76a8084f10 con 0x7f76b0153a30 2023-10-08T17:25:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.385+0000 7f76ae59c700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.386+0000 7f76ae59c700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 0x7f76900693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76b00aec10 tx=0x7f76a0017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:17.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.389+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76a8051e40 con 0x7f76b0153a30 2023-10-08T17:25:17.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:17.595+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76b00afac0 con 0x7f76b0153a30 2023-10-08T17:25:18.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.139+0000 7f769e7fc700 1 -- 172.21.15.12:0/1713118132 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v173) v1 ==== 169+0+0 (secure 0 0 0) 0x7f76a8055460 con 0x7f76b0153a30 2023-10-08T17:25:18.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.142+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 msgr2=0x7f76900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.142+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 0x7f76900693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f76b00aec10 tx=0x7f76a0017000 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.142+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 msgr2=0x7f76b00b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.142+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009fd0 tx=0x7f76a8009900 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 shutdown_connections 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7690066f30 0x7f76900693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76b0153a30 0x7f76b00b0f50 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76b00c8980 0x7f76b006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 --2- 172.21.15.12:0/1713118132 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76b0153660 0x7f76b00afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 >> 172.21.15.12:0/1713118132 conn(0x7f76b006c6a0 msgr2=0x7f76b006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:18.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 shutdown_connections 2023-10-08T17:25:18.146 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.143+0000 7f76af59e700 1 -- 172.21.15.12:0/1713118132 wait complete. 2023-10-08T17:25:18.146 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T17:25:18.164 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T17:25:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.357+0000 7ff7d539d700 1 Processor -- start 2023-10-08T17:25:18.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.357+0000 7ff7d539d700 1 -- start start 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.358+0000 7ff7d539d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff7d0153dd0 0x7ff7d015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.358+0000 7ff7d539d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff7d00cea00 0x7ff7d00ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.358+0000 7ff7d539d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d015ac50 con 0x7ff7d0153a00 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.358+0000 7ff7d539d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d015d010 con 0x7ff7d0153dd0 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.358+0000 7ff7d539d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d00cf3e0 con 0x7ff7d00cea00 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff7d0153dd0 0x7ff7d015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff7d0153dd0 0x7ff7d015de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34336/0 (socket says 172.21.15.12:34336) 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/804240994 learned_addr learned my addr 172.21.15.12:0/804240994 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7d4b9c700 1 --2- 172.21.15.12:0/804240994 >> v2:172.21.15.29:3300/0 conn(0x7ff7d00cea00 0x7ff7d00ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/804240994 >> v2:172.21.15.29:3300/0 conn(0x7ff7d00cea00 msgr2=0x7ff7d00ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 --2- 172.21.15.12:0/804240994 >> v2:172.21.15.29:3300/0 conn(0x7ff7d00cea00 0x7ff7d00ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/804240994 >> v1:172.21.15.29:6789/0 conn(0x7ff7d0153a00 legacy=0x7ff7d015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/804240994 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d015af60 con 0x7ff7d0153dd0 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.359+0000 7ff7cf7fe700 1 --2- 172.21.15.12:0/804240994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153dd0 0x7ff7d015de50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00d03b0 tx=0x7ff7c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a55fb681c8288f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7ceffd700 1 -- 172.21.15.12:0/804240994 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400b860 con 0x7ff7d0153dd0 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7ceffd700 1 -- 172.21.15.12:0/804240994 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400b9c0 con 0x7ff7d0153dd0 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7ceffd700 1 -- 172.21.15.12:0/804240994 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c400bd60 con 0x7ff7d0153dd0 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 -- 172.21.15.12:0/804240994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153dd0 msgr2=0x7ff7d015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 --2- 172.21.15.12:0/804240994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153dd0 0x7ff7d015de50 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00d03b0 tx=0x7ff7c4009250 comp rx=0 tx=0).stop 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 -- 172.21.15.12:0/804240994 shutdown_connections 2023-10-08T17:25:18.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 --2- 172.21.15.12:0/804240994 >> v2:172.21.15.29:3300/0 conn(0x7ff7d00cea00 0x7ff7d00ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 --2- 172.21.15.12:0/804240994 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153dd0 0x7ff7d015de50 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 -- 172.21.15.12:0/804240994 >> 172.21.15.12:0/804240994 conn(0x7ff7d00703a0 msgr2=0x7ff7d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 -- 172.21.15.12:0/804240994 shutdown_connections 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.360+0000 7ff7d539d700 1 -- 172.21.15.12:0/804240994 wait complete. 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.362+0000 7ff7d539d700 1 Processor -- start 2023-10-08T17:25:18.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.362+0000 7ff7d539d700 1 -- start start 2023-10-08T17:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff7d00cea00 0x7ff7d016cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7d0153dd0 0x7ff7d0144e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00c85d0 con 0x7ff7d0153a00 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d016d610 con 0x7ff7d0153dd0 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d539d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d016d8f0 con 0x7ff7d00cea00 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34344/0 (socket says 172.21.15.12:34344) 2023-10-08T17:25:18.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/1847247945 learned_addr learned my addr 172.21.15.12:0/1847247945 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7d4b9c700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7d0153dd0 0x7ff7d0144e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cffff700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff7d00cea00 0x7ff7d016cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff7d00cea00 msgr2=0x7ff7d016cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff7d00cea00 0x7ff7d016cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7d0153dd0 msgr2=0x7ff7d0144e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7d0153dd0 0x7ff7d0144e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.363+0000 7ff7cf7fe700 1 -- 172.21.15.12:0/1847247945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c40094f0 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7cf7fe700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff7d006eb00 tx=0x7ff7c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c4011e60 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c401a630 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d016dbd0 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c401a9f0 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.364+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d01453b0 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.365+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d00cbd40 con 0x7ff7d0153a00 2023-10-08T17:25:18.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.366+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7c402d440 con 0x7ff7d0153a00 2023-10-08T17:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.367+0000 7ff7b7fff700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 0x7ff7bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.367+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ff7c40861b0 con 0x7ff7d0153a00 2023-10-08T17:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.367+0000 7ff7cffff700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 0x7ff7bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.368+0000 7ff7cffff700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 0x7ff7bc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01536e0 tx=0x7ff7c0009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.371+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7d00cbd40 con 0x7ff7d0153a00 2023-10-08T17:25:18.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.574+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7ff7d00cbd40 con 0x7ff7d0153a00 2023-10-08T17:25:18.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.578+0000 7ff7b7fff700 1 -- 172.21.15.12:0/1847247945 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v55) v1 ==== 120+0+0 (secure 0 0 0) 0x7ff7d00cbd40 con 0x7ff7d0153a00 2023-10-08T17:25:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 msgr2=0x7ff7bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 0x7ff7bc0693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff7d01536e0 tx=0x7ff7c0009040 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 msgr2=0x7ff7d00c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff7d006eb00 tx=0x7ff7c4017000 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 shutdown_connections 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff7bc066f30 0x7ff7bc0693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff7d0153dd0 0x7ff7d0144e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff7d00cea00 0x7ff7d016cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 --2- 172.21.15.12:0/1847247945 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7d0153a00 0x7ff7d00c8090 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 >> 172.21.15.12:0/1847247945 conn(0x7ff7d00703a0 msgr2=0x7ff7d01509b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 shutdown_connections 2023-10-08T17:25:18.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.581+0000 7ff7d539d700 1 -- 172.21.15.12:0/1847247945 wait complete. 2023-10-08T17:25:18.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T17:25:18.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.789+0000 7ffa5959d700 1 Processor -- start 2023-10-08T17:25:18.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.789+0000 7ffa5959d700 1 -- start start 2023-10-08T17:25:18.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54153c90 0x7ffa5415a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa5406db20 0x7ffa540ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa54154060 0x7ffa540cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5415ada0 con 0x7ffa54154060 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5406ca80 con 0x7ffa5406db20 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.790+0000 7ffa5959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5406cd60 con 0x7ffa54153c90 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa54154060 0x7ffa540cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa54154060 0x7ffa540cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34358/0 (socket says 172.21.15.12:34358) 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 -- 172.21.15.12:0/3698491232 learned_addr learned my addr 172.21.15.12:0/3698491232 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa537fe700 1 --2- 172.21.15.12:0/3698491232 >> v2:172.21.15.29:3300/0 conn(0x7ffa5406db20 0x7ffa540ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa53fff700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54153c90 0x7ffa5415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 -- 172.21.15.12:0/3698491232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54153c90 msgr2=0x7ffa5415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:18.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54153c90 0x7ffa5415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 -- 172.21.15.12:0/3698491232 >> v2:172.21.15.29:3300/0 conn(0x7ffa5406db20 msgr2=0x7ffa540ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 --2- 172.21.15.12:0/3698491232 >> v2:172.21.15.29:3300/0 conn(0x7ffa5406db20 0x7ffa540ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.791+0000 7ffa58d9c700 1 -- 172.21.15.12:0/3698491232 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5406d040 con 0x7ffa54154060 2023-10-08T17:25:18.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa58d9c700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54154060 0x7ffa540cacf0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ffa540cdaa0 tx=0x7ffa4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76c35a5e4bf43ea server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa52ffd700 1 -- 172.21.15.12:0/3698491232 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00e070 con 0x7ffa54154060 2023-10-08T17:25:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa52ffd700 1 -- 172.21.15.12:0/3698491232 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00b970 con 0x7ffa54154060 2023-10-08T17:25:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa52ffd700 1 -- 172.21.15.12:0/3698491232 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0092e0 con 0x7ffa54154060 2023-10-08T17:25:18.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa5959d700 1 -- 172.21.15.12:0/3698491232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54154060 msgr2=0x7ffa540cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.792+0000 7ffa5959d700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54154060 0x7ffa540cacf0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ffa540cdaa0 tx=0x7ffa4c009840 comp rx=0 tx=0).stop 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 -- 172.21.15.12:0/3698491232 shutdown_connections 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54154060 0x7ffa540cacf0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 --2- 172.21.15.12:0/3698491232 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54153c90 0x7ffa5415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 --2- 172.21.15.12:0/3698491232 >> v2:172.21.15.29:3300/0 conn(0x7ffa5406db20 0x7ffa540ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 -- 172.21.15.12:0/3698491232 >> 172.21.15.12:0/3698491232 conn(0x7ffa5406e720 msgr2=0x7ffa5406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 -- 172.21.15.12:0/3698491232 shutdown_connections 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.793+0000 7ffa5959d700 1 -- 172.21.15.12:0/3698491232 wait complete. 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.794+0000 7ffa5959d700 1 Processor -- start 2023-10-08T17:25:18.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.794+0000 7ffa5959d700 1 -- start start 2023-10-08T17:25:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa5406db20 0x7ffa54146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54154060 0x7ffa540c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5416ab20 con 0x7ffa54153c90 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa54169f10 con 0x7ffa5406db20 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.795+0000 7ffa5959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5416a1f0 con 0x7ffa54154060 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34372/0 (socket says 172.21.15.12:34372) 2023-10-08T17:25:18.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 -- 172.21.15.12:0/1554884299 learned_addr learned my addr 172.21.15.12:0/1554884299 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa53fff700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa5406db20 0x7ffa54146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa58d9c700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54154060 0x7ffa540c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 -- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54154060 msgr2=0x7ffa540c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54154060 0x7ffa540c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 -- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa5406db20 msgr2=0x7ffa54146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa5406db20 0x7ffa54146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 -- 172.21.15.12:0/1554884299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009ae0 con 0x7ffa54153c90 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa537fe700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e900 tx=0x7ffa480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.796+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48013680 con 0x7ffa54153c90 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.797+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa480137e0 con 0x7ffa54153c90 2023-10-08T17:25:18.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.797+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa48013ba0 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.797+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5416a4d0 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.797+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa541468a0 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.798+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5416acd0 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.799+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa480123d0 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.800+0000 7ffa3bfff700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 0x7ffa400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.800+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7ffa48084750 con 0x7ffa54153c90 2023-10-08T17:25:18.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.800+0000 7ffa53fff700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 0x7ffa400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:18.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.801+0000 7ffa53fff700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 0x7ffa400693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009db0 tx=0x7ffa440091a0 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:18.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:18.804+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa5416acd0 con 0x7ffa54153c90 2023-10-08T17:25:19.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.009+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffa5416acd0 con 0x7ffa54153c90 2023-10-08T17:25:19.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.015+0000 7ffa3bfff700 1 -- 172.21.15.12:0/1554884299 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v56) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffa5416acd0 con 0x7ffa54153c90 2023-10-08T17:25:19.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 msgr2=0x7ffa400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 0x7ffa400693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009db0 tx=0x7ffa440091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 msgr2=0x7ffa540c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7ffa4800e900 tx=0x7ffa480091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 shutdown_connections 2023-10-08T17:25:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ffa40066f30 0x7ffa400693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa54154060 0x7ffa540c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa5406db20 0x7ffa54146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 --2- 172.21.15.12:0/1554884299 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa54153c90 0x7ffa540c7f70 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 >> 172.21.15.12:0/1554884299 conn(0x7ffa5406e720 msgr2=0x7ffa5415c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 shutdown_connections 2023-10-08T17:25:19.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.018+0000 7ffa5959d700 1 -- 172.21.15.12:0/1554884299 wait complete. 2023-10-08T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T17:25:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.232+0000 7f855179d700 1 Processor -- start 2023-10-08T17:25:19.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.232+0000 7f855179d700 1 -- start start 2023-10-08T17:25:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c0c7be0 0x7f854c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7fb0 0x7f854c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 0x7f854c13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c06bf10 con 0x7f854c0c7be0 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c140100 con 0x7f854c13f780 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.233+0000 7f855179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c15aed0 con 0x7f854c0c7fb0 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c0c7be0 0x7f854c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f854c0c7be0 0x7f854c06abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34386/0 (socket says 172.21.15.12:34386) 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 -- 172.21.15.12:0/3470940455 learned_addr learned my addr 172.21.15.12:0/3470940455 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854b7fe700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7fb0 0x7f854c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f8550f9c700 1 --2- 172.21.15.12:0/3470940455 >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 0x7f854c13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 -- 172.21.15.12:0/3470940455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7fb0 msgr2=0x7f854c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7fb0 0x7f854c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 -- 172.21.15.12:0/3470940455 >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 msgr2=0x7f854c13fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 --2- 172.21.15.12:0/3470940455 >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 0x7f854c13fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 -- 172.21.15.12:0/3470940455 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c06b290 con 0x7f854c0c7be0 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f8550f9c700 1 --2- 172.21.15.12:0/3470940455 >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 0x7f854c13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854bfff700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c0c7be0 0x7f854c06abd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c6700 tx=0x7f853c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440569da6ebc7362 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.234+0000 7f854affd700 1 -- 172.21.15.12:0/3470940455 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00b860 con 0x7f854c0c7be0 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f854affd700 1 -- 172.21.15.12:0/3470940455 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c00b9c0 con 0x7f854c0c7be0 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f854affd700 1 -- 172.21.15.12:0/3470940455 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c00bd60 con 0x7f854c0c7be0 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 -- 172.21.15.12:0/3470940455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c0c7be0 msgr2=0x7f854c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c0c7be0 0x7f854c06abd0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c6700 tx=0x7f853c009250 comp rx=0 tx=0).stop 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 -- 172.21.15.12:0/3470940455 shutdown_connections 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 --2- 172.21.15.12:0/3470940455 >> v2:172.21.15.29:3300/0 conn(0x7f854c13f780 0x7f854c13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c0c7be0 0x7f854c06abd0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 --2- 172.21.15.12:0/3470940455 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7fb0 0x7f854c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 -- 172.21.15.12:0/3470940455 >> 172.21.15.12:0/3470940455 conn(0x7f854c06d110 msgr2=0x7f854c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 -- 172.21.15.12:0/3470940455 shutdown_connections 2023-10-08T17:25:19.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.235+0000 7f855179d700 1 -- 172.21.15.12:0/3470940455 wait complete. 2023-10-08T17:25:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.237+0000 7f855179d700 1 Processor -- start 2023-10-08T17:25:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.237+0000 7f855179d700 1 -- start start 2023-10-08T17:25:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7be0 0x7f854c0c24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f854c0c7fb0 0x7f854c16a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c0b0030 con 0x7f854c13f780 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c153fb0 con 0x7f854c0c7fb0 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f855179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c16aae0 con 0x7f854c0c7be0 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34390/0 (socket says 172.21.15.12:34390) 2023-10-08T17:25:19.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 -- 172.21.15.12:0/2810711617 learned_addr learned my addr 172.21.15.12:0/2810711617 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f854bfff700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7be0 0x7f854c0c24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f854b7fe700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f854c0c7fb0 0x7f854c16a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 -- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7be0 msgr2=0x7f854c0c24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7be0 0x7f854c0c24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 -- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f854c0c7fb0 msgr2=0x7f854c16a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f854c0c7fb0 0x7f854c16a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.238+0000 7f8550f9c700 1 -- 172.21.15.12:0/2810711617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c0094f0 con 0x7f854c13f780 2023-10-08T17:25:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f8550f9c700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f854400cef0 tx=0x7f8544007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400ad20 con 0x7f854c13f780 2023-10-08T17:25:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8544016420 con 0x7f854c13f780 2023-10-08T17:25:19.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400aea0 con 0x7f854c13f780 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c0af3b0 con 0x7f854c13f780 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.239+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c0af970 con 0x7f854c13f780 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.240+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c04c3c0 con 0x7f854c13f780 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.241+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8544016a70 con 0x7f854c13f780 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.242+0000 7f8533fff700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.242+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8544012070 con 0x7f854c13f780 2023-10-08T17:25:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.242+0000 7f854bfff700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.243+0000 7f854bfff700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 0x7f85380693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c6700 tx=0x7f853c017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.251 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.246+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f854404e5a0 con 0x7f854c13f780 2023-10-08T17:25:19.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.447+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f854c06b570 con 0x7f854c13f780 2023-10-08T17:25:19.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.451+0000 7f8533fff700 1 -- 172.21.15.12:0/2810711617 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v57) v1 ==== 115+0+0 (secure 0 0 0) 0x7f8544055a50 con 0x7f854c13f780 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 msgr2=0x7f85380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 0x7f85380693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f854c0c6700 tx=0x7f853c017000 comp rx=0 tx=0).stop 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 msgr2=0x7f854c0b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f854400cef0 tx=0x7f8544007860 comp rx=0 tx=0).stop 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 shutdown_connections 2023-10-08T17:25:19.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8538066f30 0x7f85380693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f854c13f780 0x7f854c0b0230 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f854c0c7be0 0x7f854c0c24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 --2- 172.21.15.12:0/2810711617 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f854c0c7fb0 0x7f854c16a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 >> 172.21.15.12:0/2810711617 conn(0x7f854c06d110 msgr2=0x7f854c155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 shutdown_connections 2023-10-08T17:25:19.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.454+0000 7f855179d700 1 -- 172.21.15.12:0/2810711617 wait complete. 2023-10-08T17:25:19.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-10-08T17:25:19.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.659+0000 7f8f1b59e700 1 Processor -- start 2023-10-08T17:25:19.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.659+0000 7f8f1b59e700 1 -- start start 2023-10-08T17:25:19.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06f3a0 0x7f8f1c14fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f1c06e470 0x7f8f1c1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1b59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c06a490 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0c7230 con 0x7f8f1c06e470 2023-10-08T17:25:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c06b930 con 0x7f8f1c06f3a0 2023-10-08T17:25:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1ad9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8f1c06e470 0x7f8f1c1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1a59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8f1c06e0a0 0x7f8f1c0c6b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58760/0 (socket says 172.21.15.12:58760) 2023-10-08T17:25:19.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1a59c700 1 -- 172.21.15.12:0/4107433072 learned_addr learned my addr 172.21.15.12:0/4107433072 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f19d9b700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06f3a0 0x7f8f1c14fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1ad9d700 1 -- 172.21.15.12:0/4107433072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06f3a0 msgr2=0x7f8f1c14fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1ad9d700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06f3a0 0x7f8f1c14fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1ad9d700 1 -- 172.21.15.12:0/4107433072 >> v1:172.21.15.12:6789/0 conn(0x7f8f1c06e0a0 legacy=0x7f8f1c0c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.661+0000 7f8f1ad9d700 1 -- 172.21.15.12:0/4107433072 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0c7490 con 0x7f8f1c06e470 2023-10-08T17:25:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1ad9d700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e470 0x7f8f1c1501b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e60 tx=0x7f8f14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7071108c5c2869b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1959a700 1 -- 172.21.15.12:0/4107433072 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1400e070 con 0x7f8f1c06e470 2023-10-08T17:25:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1959a700 1 -- 172.21.15.12:0/4107433072 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1400bc30 con 0x7f8f1c06e470 2023-10-08T17:25:19.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1959a700 1 -- 172.21.15.12:0/4107433072 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14012430 con 0x7f8f1c06e470 2023-10-08T17:25:19.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1b59e700 1 -- 172.21.15.12:0/4107433072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e470 msgr2=0x7f8f1c1501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.662+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e470 0x7f8f1c1501b0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f8f14009e60 tx=0x7f8f14009780 comp rx=0 tx=0).stop 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 -- 172.21.15.12:0/4107433072 shutdown_connections 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e470 0x7f8f1c1501b0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/4107433072 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06f3a0 0x7f8f1c14fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 -- 172.21.15.12:0/4107433072 >> 172.21.15.12:0/4107433072 conn(0x7f8f1c06d170 msgr2=0x7f8f1c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 -- 172.21.15.12:0/4107433072 shutdown_connections 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.663+0000 7f8f1b59e700 1 -- 172.21.15.12:0/4107433072 wait complete. 2023-10-08T17:25:19.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.664+0000 7f8f1b59e700 1 Processor -- start 2023-10-08T17:25:19.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.664+0000 7f8f1b59e700 1 -- start start 2023-10-08T17:25:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06e470 0x7f8f1c156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f1c06f3a0 0x7f8f1c157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c1566a0 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c1568d0 con 0x7f8f1c06f3a0 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c156bb0 con 0x7f8f1c06e470 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1a59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34404/0 (socket says 172.21.15.12:34404) 2023-10-08T17:25:19.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.665+0000 7f8f1a59c700 1 -- 172.21.15.12:0/1065751351 learned_addr learned my addr 172.21.15.12:0/1065751351 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 -- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06e470 msgr2=0x7f8f1c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06e470 0x7f8f1c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 -- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f1c06f3a0 msgr2=0x7f8f1c157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f1c06f3a0 0x7f8f1c157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 -- 172.21.15.12:0/1065751351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f14009a20 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1a59c700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c7c0 tx=0x7f8f0c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c005b30 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c005cb0 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c004a80 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c156e90 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.666+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c157450 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.667+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1c157660 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.668+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f0c0070f0 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.669+0000 7f8f0a7fc700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 0x7f8efc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.669+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f8f0c083b50 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.669+0000 7f8f19d9b700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 0x7f8efc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:19.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.670+0000 7f8f19d9b700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 0x7f8efc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006fd0 tx=0x7f8f10008040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:19.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.673+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f0c050ca0 con 0x7f8f1c06e0a0 2023-10-08T17:25:19.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:19.956+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f8f1c04c3c0 con 0x7f8f1c06e0a0 2023-10-08T17:25:20.153 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.152+0000 7f8f0a7fc700 1 -- 172.21.15.12:0/1065751351 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v2474) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8f0c018070 con 0x7f8f1c06e0a0 2023-10-08T17:25:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 msgr2=0x7f8efc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 0x7f8efc0693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f10006fd0 tx=0x7f8f10008040 comp rx=0 tx=0).stop 2023-10-08T17:25:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 msgr2=0x7f8f1c0b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c00c7c0 tx=0x7f8f0c007f70 comp rx=0 tx=0).stop 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 shutdown_connections 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8efc066f30 0x7f8efc0693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f1c06e0a0 0x7f8f1c0b1ab0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f1c06f3a0 0x7f8f1c157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 --2- 172.21.15.12:0/1065751351 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f1c06e470 0x7f8f1c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 >> 172.21.15.12:0/1065751351 conn(0x7f8f1c06d170 msgr2=0x7f8f1c14e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 shutdown_connections 2023-10-08T17:25:20.157 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.155+0000 7f8f1b59e700 1 -- 172.21.15.12:0/1065751351 wait complete. 2023-10-08T17:25:20.174 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-10-08T17:25:20.174 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-10-08T17:25:20.175 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T17:25:20.175 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-08T17:25:20.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.362+0000 7f708cb9d700 1 Processor -- start 2023-10-08T17:25:20.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.362+0000 7f708cb9d700 1 -- start start 2023-10-08T17:25:20.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f708cb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f708815de50 0x7f70880cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f708cb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880cf3c0 con 0x7f7088153c30 2023-10-08T17:25:20.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f708cb9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708815afd0 con 0x7f70880cef40 2023-10-08T17:25:20.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f708cb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708815b2b0 con 0x7f708815de50 2023-10-08T17:25:20.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f70877fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7088153c30 0x7f708815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58770/0 (socket says 172.21.15.12:58770) 2023-10-08T17:25:20.365 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.363+0000 7f70877fe700 1 -- 172.21.15.12:0/1188826280 learned_addr learned my addr 172.21.15.12:0/1188826280 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909035550 0 0) 0x7f70880cf3c0 con 0x7f7088153c30 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7070003570 con 0x7f7088153c30 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1188826280 >> v2:172.21.15.29:3300/0 conn(0x7f708815de50 0x7f70880cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 542736618 0 0) 0x7f7070003570 con 0x7f7088153c30 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 >> v2:172.21.15.29:3300/0 conn(0x7f708815de50 msgr2=0x7f70880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 --2- 172.21.15.12:0/1188826280 >> v2:172.21.15.29:3300/0 conn(0x7f708815de50 0x7f70880cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 >> v1:172.21.15.29:6789/0 conn(0x7f70880cef40 legacy=0x7f708815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708815b590 con 0x7f7088153c30 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f7078001470 con 0x7f7088153c30 2023-10-08T17:25:20.368 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 >> v1:172.21.15.12:6789/0 conn(0x7f7088153c30 legacy=0x7f708815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7070003a60 0x7f7070003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.364+0000 7f70867fc700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f70867fc700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708815b2b0 con 0x7f7070004810 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707000c0d0 con 0x7f7070003a60 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707000c290 con 0x7f70700051c0 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f70877fe700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7070003a60 0x7f7070003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7087fff700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 -- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70700051c0 msgr2=0x7f707000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 -- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7070003a60 msgr2=0x7f7070003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7070003a60 0x7f7070003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7086ffd700 1 -- 172.21.15.12:0/1188826280 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7070003570 con 0x7f7070004810 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7087fff700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70700051c0 0x7f707000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.365+0000 7f7087fff700 1 -- 172.21.15.12:0/1188826280 reap_dead start 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f7086ffd700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7070004c80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c00 tx=0x7f707c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c904125f30ba2b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00e710 con 0x7f7070004810 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707c00e870 con 0x7f7070004810 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f70867fc700 1 -- 172.21.15.12:0/1188826280 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707c00ec30 con 0x7f7070004810 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 -- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 msgr2=0x7f7070004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7070004c80 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f707c009c00 tx=0x7f707c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 -- 172.21.15.12:0/1188826280 shutdown_connections 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 --2- 172.21.15.12:0/1188826280 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7070004c80 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 -- 172.21.15.12:0/1188826280 >> 172.21.15.12:0/1188826280 conn(0x7f70880703a0 msgr2=0x7f70880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:20.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.366+0000 7f708cb9d700 1 -- 172.21.15.12:0/1188826280 shutdown_connections 2023-10-08T17:25:20.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.367+0000 7f708cb9d700 1 -- 172.21.15.12:0/1188826280 wait complete. 2023-10-08T17:25:20.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.368+0000 7f708cb9d700 1 Processor -- start 2023-10-08T17:25:20.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.368+0000 7f708cb9d700 1 -- start start 2023-10-08T17:25:20.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70880b58f0 0x7f708815c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70880b5d60 0x7f708815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c8380 con 0x7f7070004810 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c7770 con 0x7f70880b5d60 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f708cb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c7a50 con 0x7f70880b58f0 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f70877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34416/0 (socket says 172.21.15.12:34416) 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f70877fe700 1 -- 172.21.15.12:0/2242156610 learned_addr learned my addr 172.21.15.12:0/2242156610 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f7086ffd700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70880b58f0 0x7f708815c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.369+0000 7f7087fff700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70880b5d60 0x7f708815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 -- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70880b58f0 msgr2=0x7f708815c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70880b58f0 0x7f708815c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 -- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70880b5d60 msgr2=0x7f708815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70880b5d60 0x7f708815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 -- 172.21.15.12:0/2242156610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880c7d30 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f70877fe700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7078007390 tx=0x7f7078001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078018030 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800f8d0 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800fc70 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70880c8010 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.370+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7088169c70 con 0x7f7070004810 2023-10-08T17:25:20.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.371+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70880c9890 con 0x7f7070004810 2023-10-08T17:25:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.372+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f707801b070 con 0x7f7070004810 2023-10-08T17:25:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.373+0000 7f706f7fe700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.373+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7078019070 con 0x7f7070004810 2023-10-08T17:25:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.374+0000 7f7086ffd700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:20.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.374+0000 7f7086ffd700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 0x7f70740693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f707c0091e0 tx=0x7f707c01a000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:20.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.377+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7078051640 con 0x7f7070004810 2023-10-08T17:25:20.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:20.662+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f708804c3c0 con 0x7f7070004810 2023-10-08T17:25:21.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.157+0000 7f706f7fe700 1 -- 172.21.15.12:0/2242156610 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2475) v1 ==== 168+0+0 (secure 0 0 0) 0x7f7078054c60 con 0x7f7070004810 2023-10-08T17:25:21.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 msgr2=0x7f70740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 0x7f70740693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f707c0091e0 tx=0x7f707c01a000 comp rx=0 tx=0).stop 2023-10-08T17:25:21.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 msgr2=0x7f7088144f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f7078007390 tx=0x7f7078001e50 comp rx=0 tx=0).stop 2023-10-08T17:25:21.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 shutdown_connections 2023-10-08T17:25:21.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7074066f30 0x7f70740693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7070004810 0x7f7088144f10 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f70880b5d60 0x7f708815c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 --2- 172.21.15.12:0/2242156610 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f70880b58f0 0x7f708815c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 >> 172.21.15.12:0/2242156610 conn(0x7f70880703a0 msgr2=0x7f70880c6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 shutdown_connections 2023-10-08T17:25:21.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.160+0000 7f708cb9d700 1 -- 172.21.15.12:0/2242156610 wait complete. 2023-10-08T17:25:21.181 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T17:25:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.373+0000 7fbe8f59e700 1 Processor -- start 2023-10-08T17:25:21.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.373+0000 7fbe8f59e700 1 -- start start 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.374+0000 7fbe8f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 0x7fbe900adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.374+0000 7fbe8f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbe9006e580 0x7fbe9006a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.374+0000 7fbe8f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe900c6700 con 0x7fbe900abf10 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.374+0000 7fbe8f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe900c69a0 con 0x7fbe9006e580 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.374+0000 7fbe8f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900c6c80 con 0x7fbe900adb30 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8dd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbe900abf10 0x7fbe9006de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58778/0 (socket says 172.21.15.12:58778) 2023-10-08T17:25:21.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8dd9b700 1 -- 172.21.15.12:0/1811133056 learned_addr learned my addr 172.21.15.12:0/1811133056 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8e59c700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 0x7fbe900adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/1811133056 >> v2:172.21.15.29:3300/0 conn(0x7fbe9006e580 0x7fbe9006a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8d59a700 1 -- 172.21.15.12:0/1811133056 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 901018299 0 0) 0x7fbe900c6700 con 0x7fbe900abf10 2023-10-08T17:25:21.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8d59a700 1 -- 172.21.15.12:0/1811133056 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe78003570 con 0x7fbe900abf10 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 msgr2=0x7fbe900adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 0x7fbe900adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/1811133056 >> v1:172.21.15.12:6789/0 conn(0x7fbe900abf10 legacy=0x7fbe9006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/1811133056 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe900c6f60 con 0x7fbe9006e580 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.375+0000 7fbe8e59c700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 0x7fbe900adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9006e580 0x7fbe9006a560 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009e60 tx=0x7fbe88009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f26074e6ebb7ca87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8d59a700 1 -- 172.21.15.12:0/1811133056 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800e070 con 0x7fbe9006e580 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8d59a700 1 -- 172.21.15.12:0/1811133056 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe8800bab0 con 0x7fbe9006e580 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8d59a700 1 -- 172.21.15.12:0/1811133056 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe8800be70 con 0x7fbe9006e580 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8f59e700 1 -- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9006e580 msgr2=0x7fbe9006a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.376+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9006e580 0x7fbe9006a560 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbe88009e60 tx=0x7fbe88009780 comp rx=0 tx=0).stop 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 -- 172.21.15.12:0/1811133056 shutdown_connections 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe9006e580 0x7fbe9006a560 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/1811133056 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe900adb30 0x7fbe900adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 -- 172.21.15.12:0/1811133056 >> 172.21.15.12:0/1811133056 conn(0x7fbe900c9600 msgr2=0x7fbe900cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 -- 172.21.15.12:0/1811133056 shutdown_connections 2023-10-08T17:25:21.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.377+0000 7fbe8f59e700 1 -- 172.21.15.12:0/1811133056 wait complete. 2023-10-08T17:25:21.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.378+0000 7fbe8f59e700 1 Processor -- start 2023-10-08T17:25:21.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.378+0000 7fbe8f59e700 1 -- start start 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe9006e580 0x7fbe90152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe900abf10 0x7fbe900b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9016c8a0 con 0x7fbe900adb30 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900c4e20 con 0x7fbe900abf10 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900c5100 con 0x7fbe9006e580 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34422/0 (socket says 172.21.15.12:34422) 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.379+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/3877806826 learned_addr learned my addr 172.21.15.12:0/3877806826 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8dd9b700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe900abf10 0x7fbe900b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8e59c700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe9006e580 0x7fbe90152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe9006e580 msgr2=0x7fbe90152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe9006e580 0x7fbe90152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe900abf10 msgr2=0x7fbe900b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe900abf10 0x7fbe900b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 -- 172.21.15.12:0/3877806826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8000a5d0 con 0x7fbe900adb30 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8ed9d700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fbe88013000 tx=0x7fbe88019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88012e50 con 0x7fbe900adb30 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88027470 con 0x7fbe900adb30 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe88009a20 con 0x7fbe900adb30 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.380+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88027830 con 0x7fbe900adb30 2023-10-08T17:25:21.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.381+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe900c56c0 con 0x7fbe900adb30 2023-10-08T17:25:21.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.381+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe90068d40 con 0x7fbe900adb30 2023-10-08T17:25:21.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.382+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe88024070 con 0x7fbe900adb30 2023-10-08T17:25:21.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.383+0000 7fbe7e7fc700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 0x7fbe700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.383+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fbe88086d50 con 0x7fbe900adb30 2023-10-08T17:25:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.383+0000 7fbe8e59c700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 0x7fbe700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.384+0000 7fbe8e59c700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 0x7fbe700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a5a0 tx=0x7fbe8000a330 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.388+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe88053e20 con 0x7fbe900adb30 2023-10-08T17:25:21.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.590+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbe90067e10 con 0x7fbe900adb30 2023-10-08T17:25:21.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.594+0000 7fbe7e7fc700 1 -- 172.21.15.12:0/3877806826 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe8802c0c0 con 0x7fbe900adb30 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.596+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 msgr2=0x7fbe700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.596+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 0x7fbe700693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000a5a0 tx=0x7fbe8000a330 comp rx=0 tx=0).stop 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.596+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 msgr2=0x7fbe900b1070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.596+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fbe88013000 tx=0x7fbe88019000 comp rx=0 tx=0).stop 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 shutdown_connections 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fbe70066f30 0x7fbe700693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbe900adb30 0x7fbe900b1070 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbe9006e580 0x7fbe90152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 --2- 172.21.15.12:0/3877806826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbe900abf10 0x7fbe900b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 >> 172.21.15.12:0/3877806826 conn(0x7fbe900c9600 msgr2=0x7fbe900cbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 shutdown_connections 2023-10-08T17:25:21.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.597+0000 7fbe8f59e700 1 -- 172.21.15.12:0/3877806826 wait complete. 2023-10-08T17:25:21.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:25:21.616 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:25:21.701 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:25:21.795 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:25:21.795 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T17:25:21.795 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.980+0000 7f7d049fe700 1 Processor -- start 2023-10-08T17:25:21.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.981+0000 7f7d049fe700 1 -- start start 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7d049fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d000ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7d049fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d0015dfd0 0x7f7d000aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7d049fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d000acc00 con 0x7f7d00159920 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7d049fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000abff0 con 0x7f7d0015dfd0 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7d049fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000ac2d0 con 0x7f7d00159550 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7cfe59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d0015dfd0 0x7f7d000aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7cfe59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7d0015dfd0 0x7f7d000aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34434/0 (socket says 172.21.15.12:34434) 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7cfe59c700 1 -- 172.21.15.12:0/3779859624 learned_addr learned my addr 172.21.15.12:0/3779859624 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7cff59e700 1 --1- 172.21.15.12:0/3779859624 >> v1:172.21.15.12:6789/0 conn(0x7f7d00159920 0x7f7d000ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:58790/0 (socket says 172.21.15.12:58790) 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.982+0000 7f7cfed9d700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d000ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfe59c700 1 -- 172.21.15.12:0/3779859624 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 msgr2=0x7f7d000ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfe59c700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d000ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfe59c700 1 -- 172.21.15.12:0/3779859624 >> v1:172.21.15.12:6789/0 conn(0x7f7d00159920 legacy=0x7f7d000ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfe59c700 1 -- 172.21.15.12:0/3779859624 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000ac5b0 con 0x7f7d0015dfd0 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfe59c700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d000aedb0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40099b0 tx=0x7f7cf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87397bcc80f9c4dd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfdd9b700 1 -- 172.21.15.12:0/3779859624 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4009ea0 con 0x7f7d0015dfd0 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfdd9b700 1 -- 172.21.15.12:0/3779859624 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400b860 con 0x7f7d0015dfd0 2023-10-08T17:25:21.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.983+0000 7f7cfdd9b700 1 -- 172.21.15.12:0/3779859624 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400bc00 con 0x7f7d0015dfd0 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 -- 172.21.15.12:0/3779859624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 msgr2=0x7f7d000aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d000aedb0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40099b0 tx=0x7f7cf4009250 comp rx=0 tx=0).stop 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 -- 172.21.15.12:0/3779859624 shutdown_connections 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d000ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 --2- 172.21.15.12:0/3779859624 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d000aedb0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 -- 172.21.15.12:0/3779859624 >> 172.21.15.12:0/3779859624 conn(0x7f7d0006ce80 msgr2=0x7f7d000ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 -- 172.21.15.12:0/3779859624 shutdown_connections 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.984+0000 7f7d049fe700 1 -- 172.21.15.12:0/3779859624 wait complete. 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.985+0000 7f7d049fe700 1 Processor -- start 2023-10-08T17:25:21.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.985+0000 7f7d049fe700 1 -- start start 2023-10-08T17:25:21.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.986+0000 7f7d049fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d001678f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.986+0000 7f7d049fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d00159920 0x7f7d000b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.986+0000 7f7d049fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.986+0000 7f7d049fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000cce50 con 0x7f7d0015dfd0 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.986+0000 7f7d049fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000b2f60 con 0x7f7d00159920 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7d049fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000b3240 con 0x7f7d00159550 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:34448/0 (socket says 172.21.15.12:34448) 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 -- 172.21.15.12:0/2050486107 learned_addr learned my addr 172.21.15.12:0/2050486107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cfed9d700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d001678f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cfe59c700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d00159920 0x7f7d000b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 -- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 msgr2=0x7f7d001678f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d001678f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 -- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d00159920 msgr2=0x7f7d000b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:21.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d00159920 0x7f7d000b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 -- 172.21.15.12:0/2050486107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40094f0 con 0x7f7d0015dfd0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.987+0000 7f7cff59e700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800cd00 tx=0x7f7cf8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.988+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8005df0 con 0x7f7d0015dfd0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.988+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800a960 con 0x7f7d0015dfd0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.988+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800ad00 con 0x7f7d0015dfd0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.988+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000b3520 con 0x7f7d0015dfd0 2023-10-08T17:25:21.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.988+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000b2b90 con 0x7f7d0015dfd0 2023-10-08T17:25:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.989+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d000cd000 con 0x7f7d0015dfd0 2023-10-08T17:25:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.990+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cf8007300 con 0x7f7d0015dfd0 2023-10-08T17:25:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.991+0000 7f7ce6ffd700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 0x7f7cec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.991+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7cf8084780 con 0x7f7d0015dfd0 2023-10-08T17:25:21.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.991+0000 7f7cfed9d700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 0x7f7cec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:21.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.992+0000 7f7cfed9d700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 0x7f7cec0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ca0 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:21.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:21.995+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d000cd000 con 0x7f7d0015dfd0 2023-10-08T17:25:22.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.242+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d000cd000 con 0x7f7d0015dfd0 2023-10-08T17:25:22.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.243+0000 7f7ce6ffd700 1 -- 172.21.15.12:0/2050486107 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+3520 (secure 0 0 0) 0x7f7d000cd000 con 0x7f7d0015dfd0 2023-10-08T17:25:22.244 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:22.244 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":76,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/41143899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6833","nonce":41143899},{"type":"v1","addr":"172.21.15.12:6835","nonce":41143899}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8269,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6833/906984728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":906984728},{"type":"v1","addr":"172.21.15.29:6833","nonce":906984728}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":8272,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1829213764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6834","nonce":1829213764},{"type":"v1","addr":"172.21.15.29:6835","nonce":1829213764}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":69},{"gid":8641,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6834/1215155680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1215155680},{"type":"v1","addr":"172.21.15.12:6834","nonce":1215155680}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[]} 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 msgr2=0x7f7cec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 0x7f7cec0693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ca0 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 msgr2=0x7f7d0016d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f7cf800cd00 tx=0x7f7cf8001b10 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 shutdown_connections 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f7cec066f30 0x7f7cec0693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7d0015dfd0 0x7f7d0016d960 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7d00159550 0x7f7d001678f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 --2- 172.21.15.12:0/2050486107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7d00159920 0x7f7d000b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 >> 172.21.15.12:0/2050486107 conn(0x7f7d0006ce80 msgr2=0x7f7d000b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:22.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 shutdown_connections 2023-10-08T17:25:22.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.245+0000 7f7d049fe700 1 -- 172.21.15.12:0/2050486107 wait complete. 2023-10-08T17:25:22.248 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 76 2023-10-08T17:25:22.264 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T17:25:22.264 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T17:25:22.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T17:25:22.264 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:25:22.264 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T17:25:22.265 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T17:25:22.265 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T17:25:22.265 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:25:22.265 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T17:25:22.265 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T17:25:22.265 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T17:25:22.266 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:25:22.266 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T17:25:22.266 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T17:25:22.266 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T17:25:22.266 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:25:22.278 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T17:25:22.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T17:25:22.283 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T17:25:22.284 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T17:25:22.284 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T17:25:22.284 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T17:25:22.285 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T17:25:22.285 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T17:25:22.328 INFO:tasks.ceph.mds.a:Started 2023-10-08T17:25:22.328 DEBUG:teuthology.parallel:result is None 2023-10-08T17:25:22.329 INFO:tasks.ceph.mds.d:Started 2023-10-08T17:25:22.329 DEBUG:teuthology.parallel:result is None 2023-10-08T17:25:22.331 INFO:tasks.ceph.mds.b:Started 2023-10-08T17:25:22.331 DEBUG:teuthology.parallel:result is None 2023-10-08T17:25:22.331 INFO:tasks.ceph.mds.c:Started 2023-10-08T17:25:22.332 DEBUG:teuthology.parallel:result is None 2023-10-08T17:25:22.332 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T17:25:22.465 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T17:25:22.469 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:25:22.472 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T17:25:22.473 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T17:25:22.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.526+0000 7fe4ca59d700 1 Processor -- start 2023-10-08T17:25:22.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.527+0000 7fe4ca59d700 1 -- start start 2023-10-08T17:25:22.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4ca59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4c4159550 0x7fe4c40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4ca59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe4c4159920 0x7fe4c40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4ca59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c40acc00 con 0x7fe4c415dfd0 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4ca59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40abff0 con 0x7fe4c4159550 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4ca59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40ac2d0 con 0x7fe4c4159920 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4c959b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4c4159550 0x7fe4c40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4c959b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe4c4159550 0x7fe4c40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58550/0 (socket says 172.21.15.12:58550) 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4c959b700 1 -- 172.21.15.12:0/1784741651 learned_addr learned my addr 172.21.15.12:0/1784741651 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.528+0000 7fe4c9d9c700 1 --2- 172.21.15.12:0/1784741651 >> v2:172.21.15.29:3300/0 conn(0x7fe4c4159920 0x7fe4c40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4c959b700 1 -- 172.21.15.12:0/1784741651 >> v2:172.21.15.29:3300/0 conn(0x7fe4c4159920 msgr2=0x7fe4c40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4c959b700 1 --2- 172.21.15.12:0/1784741651 >> v2:172.21.15.29:3300/0 conn(0x7fe4c4159920 0x7fe4c40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4c959b700 1 -- 172.21.15.12:0/1784741651 >> v1:172.21.15.29:6789/0 conn(0x7fe4c415dfd0 legacy=0x7fe4c40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4c959b700 1 -- 172.21.15.12:0/1784741651 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40ac5b0 con 0x7fe4c4159550 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4c959b700 1 --2- 172.21.15.12:0/1784741651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c4159550 0x7fe4c40ceac0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406b0f0 tx=0x7fe4c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fecc49b9b0cb5543 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4bbfff700 1 -- 172.21.15.12:0/1784741651 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0009e70 con 0x7fe4c4159550 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4bbfff700 1 -- 172.21.15.12:0/1784741651 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000b860 con 0x7fe4c4159550 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.529+0000 7fe4bbfff700 1 -- 172.21.15.12:0/1784741651 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000bc00 con 0x7fe4c4159550 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 -- 172.21.15.12:0/1784741651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c4159550 msgr2=0x7fe4c40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/1784741651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c4159550 0x7fe4c40ceac0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406b0f0 tx=0x7fe4c0009250 comp rx=0 tx=0).stop 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 -- 172.21.15.12:0/1784741651 shutdown_connections 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/1784741651 >> v2:172.21.15.29:3300/0 conn(0x7fe4c4159920 0x7fe4c40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/1784741651 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c4159550 0x7fe4c40ceac0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 -- 172.21.15.12:0/1784741651 >> 172.21.15.12:0/1784741651 conn(0x7fe4c406ce80 msgr2=0x7fe4c40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:22.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 -- 172.21.15.12:0/1784741651 shutdown_connections 2023-10-08T17:25:22.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.530+0000 7fe4ca59d700 1 -- 172.21.15.12:0/1784741651 wait complete. 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.531+0000 7fe4ca59d700 1 Processor -- start 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.531+0000 7fe4ca59d700 1 -- start start 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4c4159550 0x7fe4c4157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4c4159920 0x7fe4c40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40c8e90 con 0x7fe4c415dfd0 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40c85d0 con 0x7fe4c4159550 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.532+0000 7fe4ca59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c4158480 con 0x7fe4c4159920 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58566/0 (socket says 172.21.15.12:58566) 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 -- 172.21.15.12:0/3709863703 learned_addr learned my addr 172.21.15.12:0/3709863703 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c959b700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4c4159550 0x7fe4c4157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c8d9a700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4c4159920 0x7fe4c40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 -- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4c4159920 msgr2=0x7fe4c40cca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4c4159920 0x7fe4c40cca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 -- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4c4159550 msgr2=0x7fe4c4157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4c4159550 0x7fe4c4157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 -- 172.21.15.12:0/3709863703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094f0 con 0x7fe4c415dfd0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4c9d9c700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009e90 tx=0x7fe4bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.533+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00cc20 con 0x7fe4c415dfd0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.534+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00f040 con 0x7fe4c415dfd0 2023-10-08T17:25:22.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.534+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c40c8840 con 0x7fe4c415dfd0 2023-10-08T17:25:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.534+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc014480 con 0x7fe4c415dfd0 2023-10-08T17:25:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.534+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c40cd600 con 0x7fe4c415dfd0 2023-10-08T17:25:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.535+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c40c9000 con 0x7fe4c415dfd0 2023-10-08T17:25:22.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.535+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4bc014830 con 0x7fe4c415dfd0 2023-10-08T17:25:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.536+0000 7fe4b97fa700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 0x7fe4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.536+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fe4bc0850f0 con 0x7fe4c415dfd0 2023-10-08T17:25:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.537+0000 7fe4c959b700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 0x7fe4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:22.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.537+0000 7fe4c959b700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 0x7fe4a80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406b0f0 tx=0x7fe4c0017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:22.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.541+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4bc055c50 con 0x7fe4c415dfd0 2023-10-08T17:25:22.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:22.760+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe4c404c3c0 con 0x7fe4c415dfd0 2023-10-08T17:25:23.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.171+0000 7fe4b97fa700 1 -- 172.21.15.12:0/3709863703 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v175) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe4bc0557e0 con 0x7fe4c415dfd0 2023-10-08T17:25:23.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 msgr2=0x7fe4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 0x7fe4a80693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4c406b0f0 tx=0x7fe4c0017000 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 msgr2=0x7fe4c40ccf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009e90 tx=0x7fe4bc00b040 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 shutdown_connections 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe4a8066f30 0x7fe4a80693e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe4c415dfd0 0x7fe4c40ccf60 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe4c4159550 0x7fe4c4157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 --2- 172.21.15.12:0/3709863703 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4c4159920 0x7fe4c40cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 >> 172.21.15.12:0/3709863703 conn(0x7fe4c406ce80 msgr2=0x7fe4c4158830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 shutdown_connections 2023-10-08T17:25:23.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.174+0000 7fe4ca59d700 1 -- 172.21.15.12:0/3709863703 wait complete. 2023-10-08T17:25:23.177 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T17:25:23.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T17:25:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.384+0000 7ff2ea99d700 1 Processor -- start 2023-10-08T17:25:23.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.384+0000 7ff2ea99d700 1 -- start start 2023-10-08T17:25:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2ea99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2e415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2ea99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e415ae70 con 0x7ff2e413fb20 2023-10-08T17:25:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2ea99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e406af60 con 0x7ff2e413fef0 2023-10-08T17:25:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2ea99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e406b240 con 0x7ff2e406aaa0 2023-10-08T17:25:23.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2e999b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff2e413fb20 0x7ff2e40c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54408/0 (socket says 172.21.15.12:54408) 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.385+0000 7ff2e999b700 1 -- 172.21.15.12:0/166152513 learned_addr learned my addr 172.21.15.12:0/166152513 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2ea19c700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2e415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722290147 0 0) 0x7ff2e0001110 con 0x7ff2e413fb20 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2d0003570 con 0x7ff2e413fb20 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426120913 0 0) 0x7ff2e406af60 con 0x7ff2e413fef0 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2e0001110 con 0x7ff2e413fef0 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944172229 0 0) 0x7ff2d0003570 con 0x7ff2e413fb20 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 msgr2=0x7ff2e415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2e415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 >> v1:172.21.15.29:6789/0 conn(0x7ff2e413fef0 legacy=0x7ff2e40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e406b520 con 0x7ff2e413fb20 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7ff2e0001600 con 0x7ff2e413fb20 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 >> v1:172.21.15.12:6789/0 conn(0x7ff2e413fb20 legacy=0x7ff2e40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d0003c20 0x7ff2d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2d0005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e406b240 con 0x7ff2d0004810 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000bc50 con 0x7ff2d0003c20 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.386+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d000be10 con 0x7ff2e406aaa0 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2ea19c700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2d0005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e999b700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d0003c20 0x7ff2d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 -- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 msgr2=0x7ff2d0005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2d0005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 -- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d0003c20 msgr2=0x7ff2d0004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d0003c20 0x7ff2d0004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 -- 172.21.15.12:0/166152513 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0003570 con 0x7ff2d0004810 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2ea19c700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406aaa0 0x7ff2d0005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e999b700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2d0003c20 0x7ff2d0004010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.387+0000 7ff2e919a700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2d0004c80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40cd200 tx=0x7ff2d4007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d498ffcfc19e35 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40013f0 con 0x7ff2d0004810 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400c5a0 con 0x7ff2d0004810 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2e8999700 1 -- 172.21.15.12:0/166152513 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400c750 con 0x7ff2d0004810 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 -- 172.21.15.12:0/166152513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 msgr2=0x7ff2d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/166152513 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2d0004c80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40cd200 tx=0x7ff2d4007d80 comp rx=0 tx=0).stop 2023-10-08T17:25:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea19c700 1 -- 172.21.15.12:0/166152513 reap_dead start 2023-10-08T17:25:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 -- 172.21.15.12:0/166152513 shutdown_connections 2023-10-08T17:25:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 -- 172.21.15.12:0/166152513 >> 172.21.15.12:0/166152513 conn(0x7ff2e406d170 msgr2=0x7ff2e40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 -- 172.21.15.12:0/166152513 shutdown_connections 2023-10-08T17:25:23.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.388+0000 7ff2ea99d700 1 -- 172.21.15.12:0/166152513 wait complete. 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.390+0000 7ff2ea99d700 1 Processor -- start 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.390+0000 7ff2ea99d700 1 -- start start 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406e6d0 0x7ff2e406eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 0x7ff2e416a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e41562a0 con 0x7ff2d0004810 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e406f080 con 0x7ff2e4169dd0 2023-10-08T17:25:23.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40aef80 con 0x7ff2e406e6d0 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58582/0 (socket says 172.21.15.12:58582) 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 -- 172.21.15.12:0/3356143773 learned_addr learned my addr 172.21.15.12:0/3356143773 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e919a700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406e6d0 0x7ff2e406eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea19c700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 0x7ff2e416a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 -- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406e6d0 msgr2=0x7ff2e406eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406e6d0 0x7ff2e406eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 -- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 msgr2=0x7ff2e416a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 0x7ff2e416a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2e999b700 1 -- 172.21.15.12:0/3356143773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40af820 con 0x7ff2d0004810 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.391+0000 7ff2ea19c700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 0x7ff2e416a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:23.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2e999b700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000ebc0 tx=0x7ff2e0001600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000c700 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000c860 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e416ab00 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e000cc00 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.392+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e40af4b0 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.393+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e404c3c0 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.394+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2e001d460 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.395+0000 7ff2d9ffb700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 0x7ff2c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.395+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5317+0+0 (secure 0 0 0) 0x7ff2e0084300 con 0x7ff2d0004810 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.395+0000 7ff2e919a700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 0x7ff2c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.396+0000 7ff2e919a700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 0x7ff2c80693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d4017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.399+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2e0051650 con 0x7ff2d0004810 2023-10-08T17:25:23.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.681+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff2e415ae70 con 0x7ff2d0004810 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.682+0000 7ff2d9ffb700 1 -- 172.21.15.12:0/3356143773 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v40) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff2e415ae70 con 0x7ff2d0004810 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.683 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:25:23.684 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.685 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.686 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T17:25:23.687 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.688 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.689 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.690 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T17:25:23.691 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T17:25:23.692 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T17:25:23.693 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:25:23.694 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.695 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.696 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T17:25:23.697 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.698 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.699 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T17:25:23.699 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T17:25:23.699 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.699 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:25:23.699 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:25:23.700 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.700 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.700 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:25:23.700 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:23.700 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T17:25:23.701 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T17:25:23.701 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:25:23.701 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:25:23.701 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:25:23.702 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:25:23.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.702 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:23.703 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T17:25:23.703 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:25:23.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 msgr2=0x7ff2c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 0x7ff2c80693e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4000c00 tx=0x7ff2d4017000 comp rx=0 tx=0).stop 2023-10-08T17:25:23.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 msgr2=0x7ff2e4155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000ebc0 tx=0x7ff2e0001600 comp rx=0 tx=0).stop 2023-10-08T17:25:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 shutdown_connections 2023-10-08T17:25:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2c8066f30 0x7ff2c80693e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2d0004810 0x7ff2e4155d60 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2e4169dd0 0x7ff2e416a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 --2- 172.21.15.12:0/3356143773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2e406e6d0 0x7ff2e406eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 >> 172.21.15.12:0/3356143773 conn(0x7ff2e406d170 msgr2=0x7ff2e413e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 shutdown_connections 2023-10-08T17:25:23.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.684+0000 7ff2ea99d700 1 -- 172.21.15.12:0/3356143773 wait complete. 2023-10-08T17:25:23.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.901+0000 7fc35e59d700 1 Processor -- start 2023-10-08T17:25:23.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.901+0000 7fc35e59d700 1 -- start start 2023-10-08T17:25:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.902+0000 7fc35e59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc35815dfd0 0x7fc3580aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.902+0000 7fc35e59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159920 0x7fc3580ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.902+0000 7fc35e59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3580acc00 con 0x7fc358159550 2023-10-08T17:25:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.902+0000 7fc35e59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580abff0 con 0x7fc35815dfd0 2023-10-08T17:25:23.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35e59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580ac2d0 con 0x7fc358159920 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35d59b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc358159550 0x7fc3580ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54414/0 (socket says 172.21.15.12:54414) 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35d59b700 1 -- 172.21.15.12:0/31864751 learned_addr learned my addr 172.21.15.12:0/31864751 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/31864751 >> v2:172.21.15.29:3300/0 conn(0x7fc35815dfd0 0x7fc3580aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35dd9c700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159920 0x7fc3580ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc34ffff700 1 -- 172.21.15.12:0/31864751 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669643017 0 0) 0x7fc3580acc00 con 0x7fc358159550 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc34ffff700 1 -- 172.21.15.12:0/31864751 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc344003570 con 0x7fc358159550 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35cd9a700 1 -- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159920 msgr2=0x7fc3580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159920 0x7fc3580ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35cd9a700 1 -- 172.21.15.12:0/31864751 >> v1:172.21.15.12:6789/0 conn(0x7fc358159550 legacy=0x7fc3580ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.903+0000 7fc35cd9a700 1 -- 172.21.15.12:0/31864751 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580ac5b0 con 0x7fc35815dfd0 2023-10-08T17:25:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.904+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc3580aedb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3480098e0 tx=0x7fc3480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc9d544047b2a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.904+0000 7fc34ffff700 1 -- 172.21.15.12:0/31864751 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011630 con 0x7fc35815dfd0 2023-10-08T17:25:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.904+0000 7fc34ffff700 1 -- 172.21.15.12:0/31864751 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348011790 con 0x7fc35815dfd0 2023-10-08T17:25:23.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.904+0000 7fc34ffff700 1 -- 172.21.15.12:0/31864751 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011b30 con 0x7fc35815dfd0 2023-10-08T17:25:23.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 -- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 msgr2=0x7fc3580aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc3580aedb0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc3480098e0 tx=0x7fc3480091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 -- 172.21.15.12:0/31864751 shutdown_connections 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159920 0x7fc3580ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 --2- 172.21.15.12:0/31864751 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc3580aedb0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 -- 172.21.15.12:0/31864751 >> 172.21.15.12:0/31864751 conn(0x7fc35806ce80 msgr2=0x7fc3580ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 -- 172.21.15.12:0/31864751 shutdown_connections 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.905+0000 7fc35e59d700 1 -- 172.21.15.12:0/31864751 wait complete. 2023-10-08T17:25:23.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.906+0000 7fc35e59d700 1 Processor -- start 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.906+0000 7fc35e59d700 1 -- start start 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 0x7fc3580c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc358169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580c84e0 con 0x7fc358159920 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580c78d0 con 0x7fc35815dfd0 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35e59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580c7bb0 con 0x7fc358159550 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.907+0000 7fc35cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58584/0 (socket says 172.21.15.12:58584) 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 -- 172.21.15.12:0/1434503836 learned_addr learned my addr 172.21.15.12:0/1434503836 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35d59b700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 0x7fc3580c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35dd9c700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc358169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 -- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 msgr2=0x7fc3580c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 0x7fc3580c8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 -- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 msgr2=0x7fc358169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc358169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 -- 172.21.15.12:0/1434503836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009420 con 0x7fc358159920 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35d59b700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 0x7fc3580c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:23.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35cd9a700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc35806ad70 tx=0x7fc348017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348011b10 con 0x7fc358159920 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480253f0 con 0x7fc358159920 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480257b0 con 0x7fc358159920 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.908+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3580c7e90 con 0x7fc358159920 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.909+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3580c8eb0 con 0x7fc358159920 2023-10-08T17:25:23.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.910+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3580c8650 con 0x7fc358159920 2023-10-08T17:25:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.910+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc348025ba0 con 0x7fc358159920 2023-10-08T17:25:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.912+0000 7fc34d7fa700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.912+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5317+0+0 (secure 0 0 0) 0x7fc348085cf0 con 0x7fc358159920 2023-10-08T17:25:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.912+0000 7fc35d59b700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:23.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.913+0000 7fc35d59b700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 0x7fc33c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc3540058d0 tx=0x7fc354009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:23.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:23.916+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc348053040 con 0x7fc358159920 2023-10-08T17:25:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.119+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc35804c3c0 con 0x7fc358159920 2023-10-08T17:25:24.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.120+0000 7fc34d7fa700 1 -- 172.21.15.12:0/1434503836 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+12903 (secure 0 0 0) 0x7fc348015090 con 0x7fc358159920 2023-10-08T17:25:24.121 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:24.121 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":177,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:23.176921+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 msgr2=0x7fc33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 0x7fc33c0693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc3540058d0 tx=0x7fc354009040 comp rx=0 tx=0).stop 2023-10-08T17:25:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 msgr2=0x7fc3580cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fc35806ad70 tx=0x7fc348017000 comp rx=0 tx=0).stop 2023-10-08T17:25:24.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 shutdown_connections 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fc33c066f30 0x7fc33c0693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc35815dfd0 0x7fc358169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc358159550 0x7fc3580c8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 --2- 172.21.15.12:0/1434503836 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc358159920 0x7fc3580cb890 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 >> 172.21.15.12:0/1434503836 conn(0x7fc35806ce80 msgr2=0x7fc3580b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 shutdown_connections 2023-10-08T17:25:24.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.122+0000 7fc35e59d700 1 -- 172.21.15.12:0/1434503836 wait complete. 2023-10-08T17:25:24.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T17:25:24.142 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:25:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.333+0000 7f198ed9d700 1 Processor -- start 2023-10-08T17:25:24.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.333+0000 7f198ed9d700 1 -- start start 2023-10-08T17:25:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.334+0000 7f198ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1988153a00 0x7f1988153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.334+0000 7f198ed9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198815ac50 con 0x7f198815de50 2023-10-08T17:25:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.334+0000 7f198ed9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198815d010 con 0x7f19880cea00 2023-10-08T17:25:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.334+0000 7f198ed9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198815af60 con 0x7f1988153a00 2023-10-08T17:25:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.334+0000 7f198dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1988153a00 0x7f1988153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1988153a00 0x7f1988153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58592/0 (socket says 172.21.15.12:58592) 2023-10-08T17:25:24.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 -- 172.21.15.12:0/2166812377 learned_addr learned my addr 172.21.15.12:0/2166812377 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:24.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 -- 172.21.15.12:0/2166812377 >> v1:172.21.15.29:6789/0 conn(0x7f19880cea00 legacy=0x7f19880cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:24.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 -- 172.21.15.12:0/2166812377 >> v1:172.21.15.12:6789/0 conn(0x7f198815de50 legacy=0x7f198815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 -- 172.21.15.12:0/2166812377 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198815b240 con 0x7f1988153a00 2023-10-08T17:25:24.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198dd9b700 1 --2- 172.21.15.12:0/2166812377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1988153a00 0x7f1988153dd0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f19840099b0 tx=0x7f1984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad26fe080146451d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.335+0000 7f198cd99700 1 -- 172.21.15.12:0/2166812377 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400b860 con 0x7f1988153a00 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198cd99700 1 -- 172.21.15.12:0/2166812377 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198400b9c0 con 0x7f1988153a00 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198cd99700 1 -- 172.21.15.12:0/2166812377 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198400bd60 con 0x7f1988153a00 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 -- 172.21.15.12:0/2166812377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1988153a00 msgr2=0x7f1988153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 --2- 172.21.15.12:0/2166812377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1988153a00 0x7f1988153dd0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f19840099b0 tx=0x7f1984009250 comp rx=0 tx=0).stop 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 -- 172.21.15.12:0/2166812377 shutdown_connections 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 --2- 172.21.15.12:0/2166812377 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1988153a00 0x7f1988153dd0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 -- 172.21.15.12:0/2166812377 >> 172.21.15.12:0/2166812377 conn(0x7f19880703a0 msgr2=0x7f19880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 -- 172.21.15.12:0/2166812377 shutdown_connections 2023-10-08T17:25:24.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.336+0000 7f198ed9d700 1 -- 172.21.15.12:0/2166812377 wait complete. 2023-10-08T17:25:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.338+0000 7f198ed9d700 1 Processor -- start 2023-10-08T17:25:24.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.338+0000 7f198ed9d700 1 -- start start 2023-10-08T17:25:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1988153a00 0x7f19880b34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f198815de50 0x7f19880c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19881410e0 con 0x7f19880cea00 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19880c8480 con 0x7f198815de50 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198ed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19880b5f90 con 0x7f1988153a00 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58596/0 (socket says 172.21.15.12:58596) 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 -- 172.21.15.12:0/1510148269 learned_addr learned my addr 172.21.15.12:0/1510148269 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 -- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1988153a00 msgr2=0x7f19880b34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1988153a00 0x7f19880b34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 -- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f198815de50 msgr2=0x7f19880c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f198815de50 0x7f19880c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 -- 172.21.15.12:0/1510148269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840094f0 con 0x7f19880cea00 2023-10-08T17:25:24.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.339+0000 7f198dd9b700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f198806eb00 tx=0x7f1984016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.340+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984011d10 con 0x7f19880cea00 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.340+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984020070 con 0x7f19880cea00 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.340+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198401b6a0 con 0x7f19880cea00 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.340+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19880b5380 con 0x7f19880cea00 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.340+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19880b5940 con 0x7f19880cea00 2023-10-08T17:25:24.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.341+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19880b6270 con 0x7f19880cea00 2023-10-08T17:25:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.342+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1984022030 con 0x7f19880cea00 2023-10-08T17:25:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.343+0000 7f197dffb700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 0x7f196c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.343+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f19840863e0 con 0x7f19880cea00 2023-10-08T17:25:24.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.343+0000 7f198d59a700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 0x7f196c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.344+0000 7f198d59a700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 0x7f196c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19880c5c70 tx=0x7f1978007b40 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.347+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1984053730 con 0x7f19880cea00 2023-10-08T17:25:24.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.546+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19880b6270 con 0x7f19880cea00 2023-10-08T17:25:24.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.547+0000 7f197dffb700 1 -- 172.21.15.12:0/1510148269 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1984056d50 con 0x7f19880cea00 2023-10-08T17:25:24.548 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 msgr2=0x7f196c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 0x7f196c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f19880c5c70 tx=0x7f1978007b40 comp rx=0 tx=0).stop 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 msgr2=0x7f1988140ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f198806eb00 tx=0x7f1984016000 comp rx=0 tx=0).stop 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 shutdown_connections 2023-10-08T17:25:24.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f196c066f30 0x7f196c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f19880cea00 0x7f1988140ba0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f198815de50 0x7f19880c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 --2- 172.21.15.12:0/1510148269 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1988153a00 0x7f19880b34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 >> 172.21.15.12:0/1510148269 conn(0x7f19880703a0 msgr2=0x7f1988153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 shutdown_connections 2023-10-08T17:25:24.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.549+0000 7f198ed9d700 1 -- 172.21.15.12:0/1510148269 wait complete. 2023-10-08T17:25:24.567 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T17:25:24.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.753+0000 7f8f2659d700 1 Processor -- start 2023-10-08T17:25:24.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.753+0000 7f8f2659d700 1 -- start start 2023-10-08T17:25:24.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.754+0000 7f8f2659d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f200c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.754+0000 7f8f2659d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f200c6d50 con 0x7f8f2006de50 2023-10-08T17:25:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.754+0000 7f8f2659d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f200c7030 con 0x7f8f20140e40 2023-10-08T17:25:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.754+0000 7f8f2659d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200c7310 con 0x7f8f20140a70 2023-10-08T17:25:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f25d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8f2006de50 0x7f8f200aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54432/0 (socket says 172.21.15.12:54432) 2023-10-08T17:25:24.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f25d9c700 1 -- 172.21.15.12:0/3311537321 learned_addr learned my addr 172.21.15.12:0/3311537321 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:24.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f2559b700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f200c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892138143 0 0) 0x7f8f200c6d50 con 0x7f8f2006de50 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c003570 con 0x7f8f2006de50 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 920794677 0 0) 0x7f8f0c003570 con 0x7f8f2006de50 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 msgr2=0x7f8f200c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f200c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 >> v1:172.21.15.29:6789/0 conn(0x7f8f20140e40 legacy=0x7f8f200c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200c75f0 con 0x7f8f2006de50 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.755+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f8f180017f0 con 0x7f8f2006de50 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 >> v1:172.21.15.12:6789/0 conn(0x7f8f2006de50 legacy=0x7f8f200aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f0c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f0c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004d50 0x7f8f0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200c7310 con 0x7f8f0c003fd0 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c00bba0 con 0x7f8f0c004d50 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c00bd60 con 0x7f8f20140a70 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f0c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f2559b700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f0c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f25d9c700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004d50 0x7f8f0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 -- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 msgr2=0x7f8f0c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f20140a70 0x7f8f0c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 -- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004d50 msgr2=0x7f8f0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:24.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004d50 0x7f8f0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f24d9a700 1 -- 172.21.15.12:0/3311537321 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c003570 con 0x7f8f0c003fd0 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.756+0000 7f8f25d9c700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f0c004d50 0x7f8f0c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f0c004810 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8f100019c0 tx=0x7f8f10007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ca5bf6a78df3019 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10001330 con 0x7f8f0c003fd0 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1000c5d0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f17fff700 1 -- 172.21.15.12:0/3311537321 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000c970 con 0x7f8f0c003fd0 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f2659d700 1 -- 172.21.15.12:0/3311537321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 msgr2=0x7f8f0c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f2659d700 1 --2- 172.21.15.12:0/3311537321 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f0c004810 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f8f100019c0 tx=0x7f8f10007d60 comp rx=0 tx=0).stop 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f25d9c700 1 -- 172.21.15.12:0/3311537321 reap_dead start 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f2659d700 1 -- 172.21.15.12:0/3311537321 shutdown_connections 2023-10-08T17:25:24.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.757+0000 7f8f2659d700 1 -- 172.21.15.12:0/3311537321 >> 172.21.15.12:0/3311537321 conn(0x7f8f2006d170 msgr2=0x7f8f200cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.758+0000 7f8f2659d700 1 -- 172.21.15.12:0/3311537321 shutdown_connections 2023-10-08T17:25:24.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.758+0000 7f8f2659d700 1 -- 172.21.15.12:0/3311537321 wait complete. 2023-10-08T17:25:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.759+0000 7f8f2659d700 1 Processor -- start 2023-10-08T17:25:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.759+0000 7f8f2659d700 1 -- start start 2023-10-08T17:25:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 0x7f8f200c21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 0x7f8f200b0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200c2700 con 0x7f8f0c003fd0 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200c5c60 con 0x7f8f200c1d50 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2659d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f200c60f0 con 0x7f8f200afff0 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2559b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2559b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58624/0 (socket says 172.21.15.12:58624) 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f2559b700 1 -- 172.21.15.12:0/1801800953 learned_addr learned my addr 172.21.15.12:0/1801800953 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 0x7f8f200c21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.760+0000 7f8f25d9c700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 0x7f8f200b0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 -- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 msgr2=0x7f8f200b0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 0x7f8f200b0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 -- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 msgr2=0x7f8f200c21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 0x7f8f200c21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 -- 172.21.15.12:0/1801800953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f200c5050 con 0x7f8f0c003fd0 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 0x7f8f200c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f25d9c700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 0x7f8f200b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2559b700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c011d40 tx=0x7f8f1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c00fac0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c00fc20 con 0x7f8f0c003fd0 2023-10-08T17:25:24.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c014440 con 0x7f8f0c003fd0 2023-10-08T17:25:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f200c5330 con 0x7f8f0c003fd0 2023-10-08T17:25:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.761+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f200c58f0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.762+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2004c3c0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.763+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f1c014a80 con 0x7f8f0c003fd0 2023-10-08T17:25:24.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.764+0000 7f8f157fa700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 0x7f8f04069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.764+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f8f1c018030 con 0x7f8f0c003fd0 2023-10-08T17:25:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.764+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 0x7f8f04069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:24.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.765+0000 7f8f24d9a700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 0x7f8f04069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f200aff50 tx=0x7f8f10015000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:24.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.768+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f1c0524d0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.971+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8f200c78d0 con 0x7f8f0c003fd0 2023-10-08T17:25:24.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.971+0000 7f8f157fa700 1 -- 172.21.15.12:0/1801800953 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v177) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8f1c022020 con 0x7f8f0c003fd0 2023-10-08T17:25:24.972 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:24.973 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:25:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 msgr2=0x7f8f04069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 0x7f8f04069410 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f200aff50 tx=0x7f8f10015000 comp rx=0 tx=0).stop 2023-10-08T17:25:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 msgr2=0x7f8f2012e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c011d40 tx=0x7f8f1c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 shutdown_connections 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8f04066f60 0x7f8f04069410 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8f0c003fd0 0x7f8f2012e3f0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8f200afff0 0x7f8f200b0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 --2- 172.21.15.12:0/1801800953 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8f200c1d50 0x7f8f200c21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 >> 172.21.15.12:0/1801800953 conn(0x7f8f2006d170 msgr2=0x7f8f2013fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 shutdown_connections 2023-10-08T17:25:24.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:24.974+0000 7f8f2659d700 1 -- 172.21.15.12:0/1801800953 wait complete. 2023-10-08T17:25:24.992 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T17:25:24.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T17:25:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.182+0000 7f48e719d700 1 Processor -- start 2023-10-08T17:25:25.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.183+0000 7f48e719d700 1 -- start start 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e719d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f48e0142ca0 0x7f48e015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e00cb450 0x7f48e00cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e015d8d0 con 0x7f48e0143070 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e015d2f0 con 0x7f48e00cb450 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e719d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00cc630 con 0x7f48e0142ca0 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e00cb450 0x7f48e00cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e699c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f48e00cb450 0x7f48e00cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58640/0 (socket says 172.21.15.12:58640) 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.184+0000 7f48e699c700 1 -- 172.21.15.12:0/189814758 learned_addr learned my addr 172.21.15.12:0/189814758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e619b700 1 --2- 172.21.15.12:0/189814758 >> v2:172.21.15.29:3300/0 conn(0x7f48e0142ca0 0x7f48e015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e699c700 1 -- 172.21.15.12:0/189814758 >> v2:172.21.15.29:3300/0 conn(0x7f48e0142ca0 msgr2=0x7f48e015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:25.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e699c700 1 --2- 172.21.15.12:0/189814758 >> v2:172.21.15.29:3300/0 conn(0x7f48e0142ca0 0x7f48e015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e699c700 1 -- 172.21.15.12:0/189814758 >> v1:172.21.15.12:6789/0 conn(0x7f48e0143070 legacy=0x7f48e00cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e699c700 1 -- 172.21.15.12:0/189814758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e015d560 con 0x7f48e00cb450 2023-10-08T17:25:25.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e699c700 1 --2- 172.21.15.12:0/189814758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00cbf30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f48e006fd50 tx=0x7f48d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4df5dc3f5cba20 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e5199700 1 -- 172.21.15.12:0/189814758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d800e070 con 0x7f48e00cb450 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e5199700 1 -- 172.21.15.12:0/189814758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d800ba50 con 0x7f48e00cb450 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.185+0000 7f48e5199700 1 -- 172.21.15.12:0/189814758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d80092e0 con 0x7f48e00cb450 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 -- 172.21.15.12:0/189814758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 msgr2=0x7f48e00cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 --2- 172.21.15.12:0/189814758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00cbf30 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f48e006fd50 tx=0x7f48d8009840 comp rx=0 tx=0).stop 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 -- 172.21.15.12:0/189814758 shutdown_connections 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 --2- 172.21.15.12:0/189814758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00cbf30 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 --2- 172.21.15.12:0/189814758 >> v2:172.21.15.29:3300/0 conn(0x7f48e0142ca0 0x7f48e015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:25.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 -- 172.21.15.12:0/189814758 >> 172.21.15.12:0/189814758 conn(0x7f48e0067c80 msgr2=0x7f48e0068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 -- 172.21.15.12:0/189814758 shutdown_connections 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.186+0000 7f48e719d700 1 -- 172.21.15.12:0/189814758 wait complete. 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.187+0000 7f48e719d700 1 Processor -- start 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.187+0000 7f48e719d700 1 -- start start 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 0x7f48e00b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e0143070 0x7f48e0140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00aa4d0 con 0x7f48e00cb450 2023-10-08T17:25:25.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00af470 con 0x7f48e0142ca0 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.188+0000 7f48e719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00b0940 con 0x7f48e0143070 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58650/0 (socket says 172.21.15.12:58650) 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 -- 172.21.15.12:0/3479690036 learned_addr learned my addr 172.21.15.12:0/3479690036 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 -- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e0143070 msgr2=0x7f48e0140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e0143070 0x7f48e0140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 -- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 msgr2=0x7f48e00b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e599a700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 0x7f48e00b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 0x7f48e00b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 -- 172.21.15.12:0/3479690036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d8009ae0 con 0x7f48e00cb450 2023-10-08T17:25:25.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e599a700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 0x7f48e00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48e619b700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00d890 tx=0x7f48dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.189+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00b600 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.190+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00b760 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.190+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00bae0 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.190+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00aebd0 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.190+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00af190 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.191+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00aaa70 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.192+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48dc01e460 con 0x7f48e00cb450 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.192+0000 7f48d67fc700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 0x7f48c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:25.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.193+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5317+0+0 (secure 0 0 0) 0x7f48dc084b30 con 0x7f48e00cb450 2023-10-08T17:25:25.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.193+0000 7f48e599a700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 0x7f48c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:25.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.193+0000 7f48e599a700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 0x7f48c40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e015fdd0 tx=0x7f48d0009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:25.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.197+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48dc051e80 con 0x7f48e00cb450 2023-10-08T17:25:25.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:25.399+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f48e004c3c0 con 0x7f48e00cb450 2023-10-08T17:25:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.187+0000 7f48d67fc700 1 -- 172.21.15.12:0/3479690036 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v178) v1 ==== 138+0+0 (secure 0 0 0) 0x7f48dc0554a0 con 0x7f48e00cb450 2023-10-08T17:25:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.195+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 msgr2=0x7f48c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.195+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 0x7f48c40693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f48e015fdd0 tx=0x7f48d0009040 comp rx=0 tx=0).stop 2023-10-08T17:25:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.195+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 msgr2=0x7f48e00ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.195+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00d890 tx=0x7f48dc008040 comp rx=0 tx=0).stop 2023-10-08T17:25:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 shutdown_connections 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f48c4066f30 0x7f48c40693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f48e00cb450 0x7f48e00ae4f0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f48e0143070 0x7f48e0140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 --2- 172.21.15.12:0/3479690036 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f48e0142ca0 0x7f48e00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 >> 172.21.15.12:0/3479690036 conn(0x7f48e0067c80 msgr2=0x7f48e00c3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 shutdown_connections 2023-10-08T17:25:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.196+0000 7f48e719d700 1 -- 172.21.15.12:0/3479690036 wait complete. 2023-10-08T17:25:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T17:25:26.219 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T17:25:26.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.416+0000 7f66e759e700 1 Processor -- start 2023-10-08T17:25:26.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.416+0000 7f66e759e700 1 -- start start 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66e80ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e80acc00 con 0x7f66e815dfd0 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e80abff0 con 0x7f66e8159550 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80ac2d0 con 0x7f66e8159920 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f66e815dfd0 0x7f66e80aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54450/0 (socket says 172.21.15.12:54450) 2023-10-08T17:25:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e5d9b700 1 -- 172.21.15.12:0/2844816475 learned_addr learned my addr 172.21.15.12:0/2844816475 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e6d9d700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66e80ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077773963 0 0) 0x7f66e80acc00 con 0x7f66e815dfd0 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.418+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d0003570 con 0x7f66e815dfd0 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3494249589 0 0) 0x7f66e80abff0 con 0x7f66e8159550 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66e80acc00 con 0x7f66e8159550 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2689292008 0 0) 0x7f66d0003570 con 0x7f66e815dfd0 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 msgr2=0x7f66e80ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:26.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66e80ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 >> v1:172.21.15.29:6789/0 conn(0x7f66e8159550 legacy=0x7f66e80ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80ac5b0 con 0x7f66e815dfd0 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f66dc001470 con 0x7f66e815dfd0 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e6d9d700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66e80ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 >> v1:172.21.15.12:6789/0 conn(0x7f66e815dfd0 legacy=0x7f66e80aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66d0004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66d0004810 0x7f66d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66d00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80ac2d0 con 0x7f66d0003c20 2023-10-08T17:25:26.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66d000bbe0 con 0x7f66d0004810 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66d000bda0 con 0x7f66e8159920 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e659c700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66d0004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e5d9b700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66d0004810 0x7f66d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.419+0000 7f66e6d9d700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66d00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 -- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 msgr2=0x7f66d00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8159920 0x7f66d00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 -- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66d0004810 msgr2=0x7f66d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66d0004810 0x7f66d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 -- 172.21.15.12:0/2844816475 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e0009a20 con 0x7f66d0003c20 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e659c700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66d0004010 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f66d8001a10 tx=0x7f66d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430ad6436cc783bb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:26.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800c5d0 con 0x7f66d0003c20 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800c730 con 0x7f66d0003c20 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.420+0000 7f66e559a700 1 -- 172.21.15.12:0/2844816475 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d800cad0 con 0x7f66d0003c20 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 -- 172.21.15.12:0/2844816475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 msgr2=0x7f66d0004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 --2- 172.21.15.12:0/2844816475 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66d0004010 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f66d8001a10 tx=0x7f66d8007d30 comp rx=0 tx=0).stop 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e6d9d700 1 -- 172.21.15.12:0/2844816475 reap_dead start 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 -- 172.21.15.12:0/2844816475 shutdown_connections 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 -- 172.21.15.12:0/2844816475 >> 172.21.15.12:0/2844816475 conn(0x7f66e806ce80 msgr2=0x7f66e80ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:26.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 -- 172.21.15.12:0/2844816475 shutdown_connections 2023-10-08T17:25:26.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.421+0000 7f66e759e700 1 -- 172.21.15.12:0/2844816475 wait complete. 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.422+0000 7f66e759e700 1 Processor -- start 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.422+0000 7f66e759e700 1 -- start start 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e80c9980 0x7f66e80c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 0x7f66e80984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e8098a20 con 0x7f66d0003c20 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80c8f80 con 0x7f66e80c9980 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e80c8af0 con 0x7f66e8098040 2023-10-08T17:25:26.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58678/0 (socket says 172.21.15.12:58678) 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.423+0000 7f66e659c700 1 -- 172.21.15.12:0/4008181905 learned_addr learned my addr 172.21.15.12:0/4008181905 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e5d9b700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e80c9980 0x7f66e80c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e6d9d700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 0x7f66e80984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 -- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 msgr2=0x7f66e80984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 0x7f66e80984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 -- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e80c9980 msgr2=0x7f66e80c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e80c9980 0x7f66e80c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 -- 172.21.15.12:0/4008181905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80c7f10 con 0x7f66d0003c20 2023-10-08T17:25:26.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e6d9d700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 0x7f66e80984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e659c700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f66d8012f80 tx=0x7f66d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8000fe0 con 0x7f66d0003c20 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d800cab0 con 0x7f66d0003c20 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d8006a70 con 0x7f66d0003c20 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.424+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e80c81c0 con 0x7f66d0003c20 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.425+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e80c8780 con 0x7f66d0003c20 2023-10-08T17:25:26.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.426+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e804c3c0 con 0x7f66d0003c20 2023-10-08T17:25:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.428+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66d8019070 con 0x7f66d0003c20 2023-10-08T17:25:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.429+0000 7f66d67fc700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 0x7f66c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.429+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5687+0+0 (secure 0 0 0) 0x7f66d8086190 con 0x7f66d0003c20 2023-10-08T17:25:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.429+0000 7f66e5d9b700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 0x7f66c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:26.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.430+0000 7f66e5d9b700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 0x7f66c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f66dc001bb0 tx=0x7f66dc001d20 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:26.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.432+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66d8053550 con 0x7f66d0003c20 2023-10-08T17:25:26.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:26.641+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f66e806e7c0 con 0x7f66d0003c20 2023-10-08T17:25:27.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.195+0000 7f66d67fc700 1 -- 172.21.15.12:0/4008181905 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v179) v1 ==== 170+0+0 (secure 0 0 0) 0x7f66d80170d0 con 0x7f66d0003c20 2023-10-08T17:25:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.209+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 msgr2=0x7f66c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.209+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 0x7f66c80693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f66dc001bb0 tx=0x7f66dc001d20 comp rx=0 tx=0).stop 2023-10-08T17:25:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.209+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 msgr2=0x7f66e8150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.209+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f66d8012f80 tx=0x7f66d8015000 comp rx=0 tx=0).stop 2023-10-08T17:25:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 shutdown_connections 2023-10-08T17:25:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66c8066f30 0x7f66c80693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66d0003c20 0x7f66e8150bd0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e8098040 0x7f66e80984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 --2- 172.21.15.12:0/4008181905 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e80c9980 0x7f66e80c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 >> 172.21.15.12:0/4008181905 conn(0x7f66e806ce80 msgr2=0x7f66e81528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.215+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 shutdown_connections 2023-10-08T17:25:27.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.216+0000 7f66e759e700 1 -- 172.21.15.12:0/4008181905 wait complete. 2023-10-08T17:25:27.218 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T17:25:27.237 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T17:25:27.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.430+0000 7f12a0b9d700 1 Processor -- start 2023-10-08T17:25:27.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.430+0000 7f12a0b9d700 1 -- start start 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.431+0000 7f12a0b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f129c159550 0x7f129c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.431+0000 7f12a0b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0acc00 con 0x7f129c15dfd0 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f12a0b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0abff0 con 0x7f129c159920 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f12a0b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129c0ac2d0 con 0x7f129c159550 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f129c159550 0x7f129c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f129c159550 0x7f129c0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58680/0 (socket says 172.21.15.12:58680) 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 -- 172.21.15.12:0/2289929090 learned_addr learned my addr 172.21.15.12:0/2289929090 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:27.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129affd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f129c15dfd0 0x7f129c0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54454/0 (socket says 172.21.15.12:54454) 2023-10-08T17:25:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 -- 172.21.15.12:0/2289929090 >> v1:172.21.15.29:6789/0 conn(0x7f129c159920 legacy=0x7f129c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 -- 172.21.15.12:0/2289929090 >> v1:172.21.15.12:6789/0 conn(0x7f129c15dfd0 legacy=0x7f129c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.432+0000 7f129b7fe700 1 -- 172.21.15.12:0/2289929090 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0ac5b0 con 0x7f129c159550 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f129b7fe700 1 --2- 172.21.15.12:0/2289929090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159550 0x7f129c0ceac0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f128c0099b0 tx=0x7f128c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37823689ad8d1e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f129a7fc700 1 -- 172.21.15.12:0/2289929090 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00b820 con 0x7f129c159550 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f129a7fc700 1 -- 172.21.15.12:0/2289929090 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c00b980 con 0x7f129c159550 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f129a7fc700 1 -- 172.21.15.12:0/2289929090 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c00bd20 con 0x7f129c159550 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 -- 172.21.15.12:0/2289929090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159550 msgr2=0x7f129c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/2289929090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159550 0x7f129c0ceac0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f128c0099b0 tx=0x7f128c009250 comp rx=0 tx=0).stop 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 -- 172.21.15.12:0/2289929090 shutdown_connections 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/2289929090 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159550 0x7f129c0ceac0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 -- 172.21.15.12:0/2289929090 >> 172.21.15.12:0/2289929090 conn(0x7f129c06ce80 msgr2=0x7f129c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.433+0000 7f12a0b9d700 1 -- 172.21.15.12:0/2289929090 shutdown_connections 2023-10-08T17:25:27.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.434+0000 7f12a0b9d700 1 -- 172.21.15.12:0/2289929090 wait complete. 2023-10-08T17:25:27.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.435+0000 7f12a0b9d700 1 Processor -- start 2023-10-08T17:25:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.435+0000 7f12a0b9d700 1 -- start start 2023-10-08T17:25:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f129c159550 0x7f129c09b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:27.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f129c15dfd0 0x7f129c0c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c152870 con 0x7f129c159920 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c8ce0 con 0x7f129c159550 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f12a0b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c09beb0 con 0x7f129c15dfd0 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f129affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:27.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f129affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58684/0 (socket says 172.21.15.12:58684) 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f129affd700 1 -- 172.21.15.12:0/734479356 learned_addr learned my addr 172.21.15.12:0/734479356 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.436+0000 7f129b7fe700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f129c159550 0x7f129c09b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129bfff700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f129c15dfd0 0x7f129c0c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 -- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f129c15dfd0 msgr2=0x7f129c0c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f129c15dfd0 0x7f129c0c95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 -- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f129c159550 msgr2=0x7f129c09b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:27.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f129c159550 0x7f129c09b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 -- 172.21.15.12:0/734479356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c0094f0 con 0x7f129c159920 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f129affd700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f129000c560 tx=0x7f1290007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290005a70 con 0x7f129c159920 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290005bd0 con 0x7f129c159920 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900070d0 con 0x7f129c159920 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0c8720 con 0x7f129c159920 2023-10-08T17:25:27.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.437+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c0b3020 con 0x7f129c159920 2023-10-08T17:25:27.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.438+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c04c3c0 con 0x7f129c159920 2023-10-08T17:25:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.440+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1290007440 con 0x7f129c159920 2023-10-08T17:25:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.440+0000 7f12837fe700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.441+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 6069+0+0 (secure 0 0 0) 0x7f1290083f70 con 0x7f129c159920 2023-10-08T17:25:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.441+0000 7f129b7fe700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:27.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.441+0000 7f129b7fe700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f128c0099b0 tx=0x7f128c016000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:27.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.444+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1290051050 con 0x7f129c159920 2023-10-08T17:25:27.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:27.692+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f129c06e7c0 con 0x7f129c159920 2023-10-08T17:25:28.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.198+0000 7f12837fe700 1 -- 172.21.15.12:0/734479356 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v79) v1 ==== 174+0+0 (secure 0 0 0) 0x7f12900170c0 con 0x7f129c159920 2023-10-08T17:25:28.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.208+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 msgr2=0x7f12880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.208+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 0x7f12880693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f128c0099b0 tx=0x7f128c016000 comp rx=0 tx=0).stop 2023-10-08T17:25:28.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.208+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 msgr2=0x7f129c152330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.208+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f129000c560 tx=0x7f1290007f70 comp rx=0 tx=0).stop 2023-10-08T17:25:28.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 shutdown_connections 2023-10-08T17:25:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f1288066f30 0x7f12880693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f129c15dfd0 0x7f129c0c95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f129c159550 0x7f129c09b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 --2- 172.21.15.12:0/734479356 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f129c159920 0x7f129c152330 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.210+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 >> 172.21.15.12:0/734479356 conn(0x7f129c06ce80 msgr2=0x7f129c0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:28.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.213+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 shutdown_connections 2023-10-08T17:25:28.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.214+0000 7f12a0b9d700 1 -- 172.21.15.12:0/734479356 wait complete. 2023-10-08T17:25:28.221 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 20 and data pool 21 2023-10-08T17:25:28.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.429+0000 7f78b919d700 1 Processor -- start 2023-10-08T17:25:28.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.430+0000 7f78b919d700 1 -- start start 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b919d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78b4153c30 0x7f78b415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 0x7f78b40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b919d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b415afd0 con 0x7f78b40cef40 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b919d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b415b2b0 con 0x7f78b4153c30 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b415b590 con 0x7f78b415de50 2023-10-08T17:25:28.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f78b4153c30 0x7f78b415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b899c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f78b40cef40 0x7f78b406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54456/0 (socket says 172.21.15.12:54456) 2023-10-08T17:25:28.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.431+0000 7f78b899c700 1 -- 172.21.15.12:0/2850932807 learned_addr learned my addr 172.21.15.12:0/2850932807 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:28.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b2ffd700 1 -- 172.21.15.12:0/2850932807 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240076652 0 0) 0x7f78b415afd0 con 0x7f78b40cef40 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b2ffd700 1 -- 172.21.15.12:0/2850932807 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f789c003570 con 0x7f78b40cef40 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b37fe700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 0x7f78b40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b3fff700 1 -- 172.21.15.12:0/2850932807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 msgr2=0x7f78b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b3fff700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 0x7f78b40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b3fff700 1 -- 172.21.15.12:0/2850932807 >> v1:172.21.15.12:6789/0 conn(0x7f78b40cef40 legacy=0x7f78b406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b3fff700 1 -- 172.21.15.12:0/2850932807 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b415b870 con 0x7f78b4153c30 2023-10-08T17:25:28.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b37fe700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 0x7f78b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b3fff700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b4153c30 0x7f78b415a5e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f78a40098e0 tx=0x7f78a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3596cb6c27afcb7c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b2ffd700 1 -- 172.21.15.12:0/2850932807 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400b640 con 0x7f78b4153c30 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b2ffd700 1 -- 172.21.15.12:0/2850932807 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a400b7a0 con 0x7f78b4153c30 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.432+0000 7f78b2ffd700 1 -- 172.21.15.12:0/2850932807 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a400bb40 con 0x7f78b4153c30 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 -- 172.21.15.12:0/2850932807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b4153c30 msgr2=0x7f78b415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b4153c30 0x7f78b415a5e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f78a40098e0 tx=0x7f78a40091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 -- 172.21.15.12:0/2850932807 shutdown_connections 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b4153c30 0x7f78b415a5e0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 --2- 172.21.15.12:0/2850932807 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b415de50 0x7f78b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 -- 172.21.15.12:0/2850932807 >> 172.21.15.12:0/2850932807 conn(0x7f78b40703a0 msgr2=0x7f78b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 -- 172.21.15.12:0/2850932807 shutdown_connections 2023-10-08T17:25:28.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.433+0000 7f78b919d700 1 -- 172.21.15.12:0/2850932807 wait complete. 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.434+0000 7f78b919d700 1 Processor -- start 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.434+0000 7f78b919d700 1 -- start start 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 0x7f78b4151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b4153c30 0x7f78b40c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c8910 con 0x7f78b415de50 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c8bf0 con 0x7f78b40cef40 2023-10-08T17:25:28.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.435+0000 7f78b919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40c8ed0 con 0x7f78b4153c30 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58714/0 (socket says 172.21.15.12:58714) 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 -- 172.21.15.12:0/1837270296 learned_addr learned my addr 172.21.15.12:0/1837270296 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b37fe700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b4153c30 0x7f78b40c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b3fff700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 0x7f78b4151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 -- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b4153c30 msgr2=0x7f78b40c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b4153c30 0x7f78b40c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 -- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 msgr2=0x7f78b4151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 0x7f78b4151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 -- 172.21.15.12:0/1837270296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a4009420 con 0x7f78b415de50 2023-10-08T17:25:28.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b3fff700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 0x7f78b4151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f78b899c700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001460 tx=0x7f78ac001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00a950 con 0x7f78b415de50 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac00aab0 con 0x7f78b415de50 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.436+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac00ae30 con 0x7f78b415de50 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.437+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b40c91b0 con 0x7f78b415de50 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.437+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b40c85e0 con 0x7f78b415de50 2023-10-08T17:25:28.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.438+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b404c3c0 con 0x7f78b415de50 2023-10-08T17:25:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.438+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f78ac007300 con 0x7f78b415de50 2023-10-08T17:25:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.439+0000 7f789bfff700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.439+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f78ac084ba0 con 0x7f78b415de50 2023-10-08T17:25:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.440+0000 7f78b3fff700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.440+0000 7f78b3fff700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78b415d6a0 tx=0x7f78a4017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.444+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f78ac051c30 con 0x7f78b415de50 2023-10-08T17:25:28.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.648+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78b40c6770 con 0x7f78b415de50 2023-10-08T17:25:28.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.649+0000 7f789bfff700 1 -- 172.21.15.12:0/1837270296 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16136 (secure 0 0 0) 0x7f78ac055250 con 0x7f78b415de50 2023-10-08T17:25:28.650 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:28.651 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":180,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:27.693900+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 msgr2=0x7f78a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 0x7f78a00693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f78b415d6a0 tx=0x7f78a4017000 comp rx=0 tx=0).stop 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 msgr2=0x7f78b40b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f78ac001460 tx=0x7f78ac001a40 comp rx=0 tx=0).stop 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 shutdown_connections 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f78a0066f30 0x7f78a00693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f78b415de50 0x7f78b40b32d0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f78b40cef40 0x7f78b4151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 --2- 172.21.15.12:0/1837270296 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f78b4153c30 0x7f78b40c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.651+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 >> 172.21.15.12:0/1837270296 conn(0x7f78b40703a0 msgr2=0x7f78b40c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:28.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.652+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 shutdown_connections 2023-10-08T17:25:28.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.652+0000 7f78b919d700 1 -- 172.21.15.12:0/1837270296 wait complete. 2023-10-08T17:25:28.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.857+0000 7f368e79d700 1 Processor -- start 2023-10-08T17:25:28.858 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.857+0000 7f368e79d700 1 -- start start 2023-10-08T17:25:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.858+0000 7f368e79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3688140a70 0x7f36880c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.858+0000 7f368e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.858+0000 7f368e79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36880c6d50 con 0x7f3688140e40 2023-10-08T17:25:28.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.858+0000 7f368e79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36880c7030 con 0x7f3688140a70 2023-10-08T17:25:28.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.858+0000 7f368e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36880c7310 con 0x7f368806de50 2023-10-08T17:25:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3688140a70 0x7f36880c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368df9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368df9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:40986/0 (socket says 172.21.15.12:40986) 2023-10-08T17:25:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368cf9a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f3688140e40 0x7f36880c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52100/0 (socket says 172.21.15.12:52100) 2023-10-08T17:25:28.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3688140a70 0x7f36880c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:48784/0 (socket says 172.21.15.12:48784) 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368df9c700 1 -- 172.21.15.12:0/1448896769 learned_addr learned my addr 172.21.15.12:0/1448896769 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f367ffff700 1 -- 172.21.15.12:0/1448896769 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176518814 0 0) 0x7f36880c6d50 con 0x7f3688140e40 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f367ffff700 1 -- 172.21.15.12:0/1448896769 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3674003570 con 0x7f3688140e40 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 -- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 msgr2=0x7f36880aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 -- 172.21.15.12:0/1448896769 >> v1:172.21.15.29:6789/0 conn(0x7f3688140e40 legacy=0x7f36880c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368d79b700 1 -- 172.21.15.12:0/1448896769 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880c75f0 con 0x7f3688140a70 2023-10-08T17:25:28.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.859+0000 7f368df9c700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f368d79b700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c6770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f36840098e0 tx=0x7f36840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88dc02df25134963 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f367ffff700 1 -- 172.21.15.12:0/1448896769 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684011630 con 0x7f3688140a70 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f367ffff700 1 -- 172.21.15.12:0/1448896769 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684011790 con 0x7f3688140a70 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f367ffff700 1 -- 172.21.15.12:0/1448896769 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684011b30 con 0x7f3688140a70 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f368e79d700 1 -- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 msgr2=0x7f36880c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.860+0000 7f368e79d700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c6770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f36840098e0 tx=0x7f36840091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 -- 172.21.15.12:0/1448896769 shutdown_connections 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 --2- 172.21.15.12:0/1448896769 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c6770 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 -- 172.21.15.12:0/1448896769 >> 172.21.15.12:0/1448896769 conn(0x7f368806d170 msgr2=0x7f36880cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:28.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 -- 172.21.15.12:0/1448896769 shutdown_connections 2023-10-08T17:25:28.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.861+0000 7f368e79d700 1 -- 172.21.15.12:0/1448896769 wait complete. 2023-10-08T17:25:28.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.862+0000 7f368e79d700 1 Processor -- start 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.862+0000 7f368e79d700 1 -- start start 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880c3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36880ae230 con 0x7f3688140e40 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36881595a0 con 0x7f3688140a70 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368e79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3688159880 con 0x7f368806de50 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368df9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58724/0 (socket says 172.21.15.12:58724) 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.863+0000 7f368df9c700 1 -- 172.21.15.12:0/2828764672 learned_addr learned my addr 172.21.15.12:0/2828764672 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:28.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368cf9a700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368d79b700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 -- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 msgr2=0x7f36880c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 -- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 msgr2=0x7f36880c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 -- 172.21.15.12:0/2828764672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3680009ae0 con 0x7f3688140e40 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368df9c700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3680009fd0 tx=0x7f368000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3680018070 con 0x7f3688140e40 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368000f040 con 0x7f3688140e40 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368000cd30 con 0x7f3688140e40 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.864+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3684009420 con 0x7f3688140e40 2023-10-08T17:25:28.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.865+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3688159290 con 0x7f3688140e40 2023-10-08T17:25:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.865+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3688159da0 con 0x7f3688140e40 2023-10-08T17:25:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.866+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3680003020 con 0x7f3688140e40 2023-10-08T17:25:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.867+0000 7f367d7fa700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:28.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.867+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f3680084d20 con 0x7f3688140e40 2023-10-08T17:25:28.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.868+0000 7f368d79b700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:28.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.868+0000 7f368d79b700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 0x7f366c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36840091e0 tx=0x7f3684017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:28.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:28.871+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3688159da0 con 0x7f3688140e40 2023-10-08T17:25:29.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.076+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3688159da0 con 0x7f3688140e40 2023-10-08T17:25:29.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.077+0000 7f367d7fa700 1 -- 172.21.15.12:0/2828764672 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16136 (secure 0 0 0) 0x7f3688159da0 con 0x7f3688140e40 2023-10-08T17:25:29.078 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:29.079 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":180,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:27.693900+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:29.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 msgr2=0x7f366c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 0x7f366c0693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f36840091e0 tx=0x7f3684017000 comp rx=0 tx=0).stop 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 msgr2=0x7f36880c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f3680009fd0 tx=0x7f368000b040 comp rx=0 tx=0).stop 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 shutdown_connections 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f366c066f30 0x7f366c0693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3688140e40 0x7f36880c4360 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f368806de50 0x7f36880c3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 --2- 172.21.15.12:0/2828764672 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3688140a70 0x7f36880c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 >> 172.21.15.12:0/2828764672 conn(0x7f368806d170 msgr2=0x7f368813ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:29.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 shutdown_connections 2023-10-08T17:25:29.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.079+0000 7f368e79d700 1 -- 172.21.15.12:0/2828764672 wait complete. 2023-10-08T17:25:29.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T17:25:29.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.291+0000 7fe67d79d700 1 Processor -- start 2023-10-08T17:25:29.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.291+0000 7fe67d79d700 1 -- start start 2023-10-08T17:25:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe678159580 0x7fe6780b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6780cb1e0 0x7fe6780b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe67806d7c0 0x7fe67806dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67806e180 con 0x7fe67806d7c0 2023-10-08T17:25:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67815bc40 con 0x7fe678159580 2023-10-08T17:25:29.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.292+0000 7fe67d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67815b070 con 0x7fe6780cb1e0 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe67806d7c0 0x7fe67806dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe67806d7c0 0x7fe67806dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58726/0 (socket says 172.21.15.12:58726) 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 -- 172.21.15.12:0/1981088370 learned_addr learned my addr 172.21.15.12:0/1981088370 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe677fff700 1 --2- 172.21.15.12:0/1981088370 >> v2:172.21.15.29:3300/0 conn(0x7fe678159580 0x7fe6780b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe6777fe700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6780cb1e0 0x7fe6780b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 -- 172.21.15.12:0/1981088370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6780cb1e0 msgr2=0x7fe6780b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6780cb1e0 0x7fe6780b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 -- 172.21.15.12:0/1981088370 >> v2:172.21.15.29:3300/0 conn(0x7fe678159580 msgr2=0x7fe6780b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/1981088370 >> v2:172.21.15.29:3300/0 conn(0x7fe678159580 0x7fe6780b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 -- 172.21.15.12:0/1981088370 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67815b310 con 0x7fe67806d7c0 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.293+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe67806d7c0 0x7fe67806dc40 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fe67806e7d0 tx=0x7fe670009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d59d6eb752d7a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe676ffd700 1 -- 172.21.15.12:0/1981088370 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67000e070 con 0x7fe67806d7c0 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe676ffd700 1 -- 172.21.15.12:0/1981088370 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000b930 con 0x7fe67806d7c0 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe676ffd700 1 -- 172.21.15.12:0/1981088370 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700092e0 con 0x7fe67806d7c0 2023-10-08T17:25:29.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 -- 172.21.15.12:0/1981088370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe67806d7c0 msgr2=0x7fe67806dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe67806d7c0 0x7fe67806dc40 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fe67806e7d0 tx=0x7fe670009840 comp rx=0 tx=0).stop 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 -- 172.21.15.12:0/1981088370 shutdown_connections 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe67806d7c0 0x7fe67806dc40 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 --2- 172.21.15.12:0/1981088370 >> v2:172.21.15.29:3300/0 conn(0x7fe678159580 0x7fe6780b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 --2- 172.21.15.12:0/1981088370 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6780cb1e0 0x7fe6780b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 -- 172.21.15.12:0/1981088370 >> 172.21.15.12:0/1981088370 conn(0x7fe6780703a0 msgr2=0x7fe6780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 -- 172.21.15.12:0/1981088370 shutdown_connections 2023-10-08T17:25:29.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.294+0000 7fe67d79d700 1 -- 172.21.15.12:0/1981088370 wait complete. 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.296+0000 7fe67d79d700 1 Processor -- start 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.296+0000 7fe67d79d700 1 -- start start 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe67806d7c0 0x7fe6780b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6780cb1e0 0x7fe6780cc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6781564a0 con 0x7fe678159580 2023-10-08T17:25:29.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780c74c0 con 0x7fe6780cb1e0 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780ca340 con 0x7fe67806d7c0 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67cf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67cf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58730/0 (socket says 172.21.15.12:58730) 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67cf9c700 1 -- 172.21.15.12:0/3815226677 learned_addr learned my addr 172.21.15.12:0/3815226677 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe677fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe67806d7c0 0x7fe6780b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe6777fe700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6780cb1e0 0x7fe6780cc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67cf9c700 1 -- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe67806d7c0 msgr2=0x7fe6780b06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.297+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe67806d7c0 0x7fe6780b06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67cf9c700 1 -- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6780cb1e0 msgr2=0x7fe6780cc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6780cb1e0 0x7fe6780cc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67cf9c700 1 -- 172.21.15.12:0/3815226677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe670009ae0 con 0x7fe678159580 2023-10-08T17:25:29.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67cf9c700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ab0 tx=0x7fe670018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670008ad0 con 0x7fe678159580 2023-10-08T17:25:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe670008c30 con 0x7fe678159580 2023-10-08T17:25:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670026460 con 0x7fe678159580 2023-10-08T17:25:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6780b0be0 con 0x7fe678159580 2023-10-08T17:25:29.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.298+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6780c79f0 con 0x7fe678159580 2023-10-08T17:25:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.299+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678088b50 con 0x7fe678159580 2023-10-08T17:25:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.300+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe670003040 con 0x7fe678159580 2023-10-08T17:25:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.301+0000 7fe65ffff700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 0x7fe6640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.302+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe6700864a0 con 0x7fe678159580 2023-10-08T17:25:29.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.302+0000 7fe677fff700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 0x7fe6640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.302+0000 7fe677fff700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 0x7fe6640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe67806dd60 tx=0x7fe6680091a0 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:29.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.306+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe670053550 con 0x7fe678159580 2023-10-08T17:25:29.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:29.556+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe67815b5f0 con 0x7fe678159580 2023-10-08T17:25:30.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.221+0000 7fe65ffff700 1 -- 172.21.15.12:0/3815226677 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v82) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe670056b70 con 0x7fe678159580 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.224+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 msgr2=0x7fe6640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.224+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 0x7fe6640693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe67806dd60 tx=0x7fe6680091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.224+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 msgr2=0x7fe6780ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.224+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fe670009ab0 tx=0x7fe670018000 comp rx=0 tx=0).stop 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 shutdown_connections 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe664066f30 0x7fe6640693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe678159580 0x7fe6780ccae0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe67806d7c0 0x7fe6780b06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 --2- 172.21.15.12:0/3815226677 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6780cb1e0 0x7fe6780cc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 >> 172.21.15.12:0/3815226677 conn(0x7fe6780703a0 msgr2=0x7fe6780b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 shutdown_connections 2023-10-08T17:25:30.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.225+0000 7fe67d79d700 1 -- 172.21.15.12:0/3815226677 wait complete. 2023-10-08T17:25:30.246 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T17:25:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.439+0000 7f66e559d700 1 Processor -- start 2023-10-08T17:25:30.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.439+0000 7f66e559d700 1 -- start start 2023-10-08T17:25:30.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66e559d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66e559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 0x7f66e00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66e559d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e015ac50 con 0x7f66e015de50 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66e559d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e015d010 con 0x7f66e0153a00 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66e559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00cf3c0 con 0x7f66e00cea00 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66dffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.440+0000 7f66df7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f66e015de50 0x7f66e015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54468/0 (socket says 172.21.15.12:54468) 2023-10-08T17:25:30.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66df7fe700 1 -- 172.21.15.12:0/3492769080 learned_addr learned my addr 172.21.15.12:0/3492769080 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66e4d9c700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 0x7f66e00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66dffff700 1 -- 172.21.15.12:0/3492769080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 msgr2=0x7f66e00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66dffff700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 0x7f66e00cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66dffff700 1 -- 172.21.15.12:0/3492769080 >> v1:172.21.15.12:6789/0 conn(0x7f66e015de50 legacy=0x7f66e015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66dffff700 1 -- 172.21.15.12:0/3492769080 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e015af60 con 0x7f66e0153a00 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66e4d9c700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 0x7f66e00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66deffd700 1 -- 172.21.15.12:0/3492769080 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378515117 0 0) 0x7f66e015ac50 con 0x7f66e015de50 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66dffff700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f66d00098e0 tx=0x7f66d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22f0b832c7d7bd3c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.441+0000 7f66deffd700 1 -- 172.21.15.12:0/3492769080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d0009e80 con 0x7f66e0153a00 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66deffd700 1 -- 172.21.15.12:0/3492769080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d000b860 con 0x7f66e0153a00 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66deffd700 1 -- 172.21.15.12:0/3492769080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000bbe0 con 0x7f66e0153a00 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 -- 172.21.15.12:0/3492769080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e0153a00 msgr2=0x7f66e0153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f66d00098e0 tx=0x7f66d00091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 -- 172.21.15.12:0/3492769080 shutdown_connections 2023-10-08T17:25:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e00cea00 0x7f66e00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 --2- 172.21.15.12:0/3492769080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 -- 172.21.15.12:0/3492769080 >> 172.21.15.12:0/3492769080 conn(0x7f66e00703a0 msgr2=0x7f66e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 -- 172.21.15.12:0/3492769080 shutdown_connections 2023-10-08T17:25:30.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.442+0000 7f66e559d700 1 -- 172.21.15.12:0/3492769080 wait complete. 2023-10-08T17:25:30.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.444+0000 7f66e559d700 1 Processor -- start 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.444+0000 7f66e559d700 1 -- start start 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e015de50 0x7f66e0141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00c93d0 con 0x7f66e00cea00 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00ca440 con 0x7f66e0153a00 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e00b1890 con 0x7f66e015de50 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58744/0 (socket says 172.21.15.12:58744) 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 -- 172.21.15.12:0/3152023416 learned_addr learned my addr 172.21.15.12:0/3152023416 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:30.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66df7fe700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66e4d9c700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e015de50 0x7f66e0141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 -- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e015de50 msgr2=0x7f66e0141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e015de50 0x7f66e0141dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 -- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e0153a00 msgr2=0x7f66e0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.445+0000 7f66dffff700 1 -- 172.21.15.12:0/3152023416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d0009420 con 0x7f66e00cea00 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66dffff700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f66e006eb00 tx=0x7f66d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d000bbe0 con 0x7f66e00cea00 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d0011420 con 0x7f66e00cea00 2023-10-08T17:25:30.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d00117c0 con 0x7f66e00cea00 2023-10-08T17:25:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e00b1260 con 0x7f66e00cea00 2023-10-08T17:25:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.446+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e00b0da0 con 0x7f66e00cea00 2023-10-08T17:25:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.447+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66e004c3c0 con 0x7f66e00cea00 2023-10-08T17:25:30.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.448+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66d0011bb0 con 0x7f66e00cea00 2023-10-08T17:25:30.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.449+0000 7f66c7fff700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 0x7f66cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:30.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.449+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f66d0085f00 con 0x7f66e00cea00 2023-10-08T17:25:30.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.449+0000 7f66df7fe700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 0x7f66cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:30.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.450+0000 7f66df7fe700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 0x7f66cc0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f66e00cd810 tx=0x7f66d4009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:30.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.453+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66d0052f00 con 0x7f66e00cea00 2023-10-08T17:25:30.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:30.705+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f66e0159a40 con 0x7f66e00cea00 2023-10-08T17:25:31.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.228+0000 7f66c7fff700 1 -- 172.21.15.12:0/3152023416 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v83) v1 ==== 122+0+0 (secure 0 0 0) 0x7f66d0011e60 con 0x7f66e00cea00 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 msgr2=0x7f66cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 0x7f66cc0693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f66e00cd810 tx=0x7f66d4009040 comp rx=0 tx=0).stop 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 msgr2=0x7f66e00c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f66e006eb00 tx=0x7f66d0017000 comp rx=0 tx=0).stop 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 shutdown_connections 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f66cc066f30 0x7f66cc0693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f66e00cea00 0x7f66e00c9f00 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f66e015de50 0x7f66e0141dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 --2- 172.21.15.12:0/3152023416 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f66e0153a00 0x7f66e0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 >> 172.21.15.12:0/3152023416 conn(0x7f66e00703a0 msgr2=0x7f66e00d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 shutdown_connections 2023-10-08T17:25:31.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.231+0000 7f66e559d700 1 -- 172.21.15.12:0/3152023416 wait complete. 2023-10-08T17:25:31.251 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:31.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.440+0000 7ff2fb59e700 1 Processor -- start 2023-10-08T17:25:31.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.441+0000 7ff2fb59e700 1 -- start start 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 0x7ff2fc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 0x7ff2fc0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c7420 con 0x7ff2fc159a10 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc06d5a0 con 0x7ff2fc070410 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2fb59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc06d820 con 0x7ff2fc159640 2023-10-08T17:25:31.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2f9d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2f9d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58746/0 (socket says 172.21.15.12:58746) 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.442+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/3662327850 learned_addr learned my addr 172.21.15.12:0/3662327850 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2fad9d700 1 --2- 172.21.15.12:0/3662327850 >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 0x7ff2fc0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2fa59c700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 0x7ff2fc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/3662327850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 msgr2=0x7ff2fc06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 0x7ff2fc06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/3662327850 >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 msgr2=0x7ff2fc0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/3662327850 >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 0x7ff2fc0cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/3662327850 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc06db00 con 0x7ff2fc159a10 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2fad9d700 1 --2- 172.21.15.12:0/3662327850 >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 0x7ff2fc0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:31.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2fa59c700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 0x7ff2fc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc070990 tx=0x7ff2f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e2c51f266bf2833 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f959a700 1 -- 172.21.15.12:0/3662327850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000b860 con 0x7ff2fc159a10 2023-10-08T17:25:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f959a700 1 -- 172.21.15.12:0/3662327850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f000b9c0 con 0x7ff2fc159a10 2023-10-08T17:25:31.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.443+0000 7ff2f959a700 1 -- 172.21.15.12:0/3662327850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f000bd60 con 0x7ff2fc159a10 2023-10-08T17:25:31.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 -- 172.21.15.12:0/3662327850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159a10 msgr2=0x7ff2fc0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc070990 tx=0x7ff2f0009250 comp rx=0 tx=0).stop 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 -- 172.21.15.12:0/3662327850 shutdown_connections 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/3662327850 >> v2:172.21.15.29:3300/0 conn(0x7ff2fc070410 0x7ff2fc0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc159640 0x7ff2fc06d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/3662327850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159a10 0x7ff2fc0ca7b0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 -- 172.21.15.12:0/3662327850 >> 172.21.15.12:0/3662327850 conn(0x7ff2fc06e720 msgr2=0x7ff2fc06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 -- 172.21.15.12:0/3662327850 shutdown_connections 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.444+0000 7ff2fb59e700 1 -- 172.21.15.12:0/3662327850 wait complete. 2023-10-08T17:25:31.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.445+0000 7ff2fb59e700 1 Processor -- start 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.445+0000 7ff2fb59e700 1 -- start start 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc070410 0x7ff2fc151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 0x7ff2fc159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc150d10 con 0x7ff2fc159640 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0c22b0 con 0x7ff2fc159a10 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.446+0000 7ff2fb59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0af280 con 0x7ff2fc070410 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58754/0 (socket says 172.21.15.12:58754) 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/1131810001 learned_addr learned my addr 172.21.15.12:0/1131810001 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2fad9d700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 0x7ff2fc159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc070410 msgr2=0x7ff2fc151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc070410 0x7ff2fc151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 msgr2=0x7ff2fc159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 0x7ff2fc159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 -- 172.21.15.12:0/1131810001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f00094f0 con 0x7ff2fc159640 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2fad9d700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 0x7ff2fc159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2f9d9b700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c3820 tx=0x7ff2f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0024440 con 0x7ff2fc159640 2023-10-08T17:25:31.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f00245a0 con 0x7ff2fc159640 2023-10-08T17:25:31.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.447+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc0aecc0 con 0x7ff2fc159640 2023-10-08T17:25:31.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.448+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0024960 con 0x7ff2fc159640 2023-10-08T17:25:31.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.448+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc0b25d0 con 0x7ff2fc159640 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.448+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc04c3c0 con 0x7ff2fc159640 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.449+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2f001a420 con 0x7ff2fc159640 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.451+0000 7ff2ea7fc700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.451+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7ff2f00865b0 con 0x7ff2fc159640 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.451+0000 7ff2fa59c700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.451+0000 7ff2fa59c700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007aa0 tx=0x7ff2ec008040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.455+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2f00535b0 con 0x7ff2fc159640 2023-10-08T17:25:31.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.706+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff2fc0c2420 con 0x7ff2fc159640 2023-10-08T17:25:31.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.706+0000 7ff2ea7fc700 1 -- 172.21.15.12:0/1131810001 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7ff2f0056bd0 con 0x7ff2fc159640 2023-10-08T17:25:31.710 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:31.710 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:25:31.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 msgr2=0x7ff2dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 0x7ff2dc0693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec007aa0 tx=0x7ff2ec008040 comp rx=0 tx=0).stop 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 msgr2=0x7ff2fc1507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0c3820 tx=0x7ff2f0017000 comp rx=0 tx=0).stop 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 shutdown_connections 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7ff2dc066f30 0x7ff2dc0693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff2fc159a10 0x7ff2fc159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff2fc070410 0x7ff2fc151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 --2- 172.21.15.12:0/1131810001 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff2fc159640 0x7ff2fc1507d0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 >> 172.21.15.12:0/1131810001 conn(0x7ff2fc06e720 msgr2=0x7ff2fc154980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 shutdown_connections 2023-10-08T17:25:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.709+0000 7ff2fb59e700 1 -- 172.21.15.12:0/1131810001 wait complete. 2023-10-08T17:25:31.713 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:25:31.728 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.914+0000 7f131299d700 1 Processor -- start 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.914+0000 7f131299d700 1 -- start start 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.915+0000 7f131299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f130c140e40 0x7f130c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.915+0000 7f131299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f130c06de50 0x7f130c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.915+0000 7f131299d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130c0c6d50 con 0x7f130c140a70 2023-10-08T17:25:31.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.915+0000 7f131299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0c7030 con 0x7f130c140e40 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.915+0000 7f131299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130c0c7310 con 0x7f130c06de50 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f130c140e40 0x7f130c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f130c140e40 0x7f130c0c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58756/0 (socket says 172.21.15.12:58756) 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 -- 172.21.15.12:0/2736280384 learned_addr learned my addr 172.21.15.12:0/2736280384 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131219c700 1 --2- 172.21.15.12:0/2736280384 >> v2:172.21.15.29:3300/0 conn(0x7f130c06de50 0x7f130c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 -- 172.21.15.12:0/2736280384 >> v2:172.21.15.29:3300/0 conn(0x7f130c06de50 msgr2=0x7f130c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 --2- 172.21.15.12:0/2736280384 >> v2:172.21.15.29:3300/0 conn(0x7f130c06de50 0x7f130c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 -- 172.21.15.12:0/2736280384 >> v1:172.21.15.29:6789/0 conn(0x7f130c140a70 legacy=0x7f130c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.916+0000 7f131119a700 1 -- 172.21.15.12:0/2736280384 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130c0c75f0 con 0x7f130c140e40 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f131119a700 1 --2- 172.21.15.12:0/2736280384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0c6770 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f130c0aec50 tx=0x7f12fc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24c7998ac56f3a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f1310999700 1 -- 172.21.15.12:0/2736280384 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc005c10 con 0x7f130c140e40 2023-10-08T17:25:31.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f1310999700 1 -- 172.21.15.12:0/2736280384 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc005d70 con 0x7f130c140e40 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f1310999700 1 -- 172.21.15.12:0/2736280384 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc006260 con 0x7f130c140e40 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f131299d700 1 -- 172.21.15.12:0/2736280384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 msgr2=0x7f130c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.917+0000 7f131299d700 1 --2- 172.21.15.12:0/2736280384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0c6770 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f130c0aec50 tx=0x7f12fc009220 comp rx=0 tx=0).stop 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 -- 172.21.15.12:0/2736280384 shutdown_connections 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 --2- 172.21.15.12:0/2736280384 >> v2:172.21.15.29:3300/0 conn(0x7f130c06de50 0x7f130c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 --2- 172.21.15.12:0/2736280384 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0c6770 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 -- 172.21.15.12:0/2736280384 >> 172.21.15.12:0/2736280384 conn(0x7f130c06d170 msgr2=0x7f130c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 -- 172.21.15.12:0/2736280384 shutdown_connections 2023-10-08T17:25:31.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.918+0000 7f131299d700 1 -- 172.21.15.12:0/2736280384 wait complete. 2023-10-08T17:25:31.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.919+0000 7f131299d700 1 Processor -- start 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.919+0000 7f131299d700 1 -- start start 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f130c06de50 0x7f130c0c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c140a70 0x7f130c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c5c20 con 0x7f130c140e40 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c5250 con 0x7f130c140a70 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130c0c4640 con 0x7f130c06de50 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131219c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:58772/0 (socket says 172.21.15.12:58772) 2023-10-08T17:25:31.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131219c700 1 -- 172.21.15.12:0/3414058199 learned_addr learned my addr 172.21.15.12:0/3414058199 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131119a700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c140a70 0x7f130c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.920+0000 7f131199b700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f130c06de50 0x7f130c0c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 -- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f130c06de50 msgr2=0x7f130c0c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f130c06de50 0x7f130c0c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 -- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c140a70 msgr2=0x7f130c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:31.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c140a70 0x7f130c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 -- 172.21.15.12:0/3414058199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009480 con 0x7f130c140e40 2023-10-08T17:25:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131219c700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e90 tx=0x7f130400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f130400cb70 con 0x7f130c140e40 2023-10-08T17:25:31.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130400f040 con 0x7f130c140e40 2023-10-08T17:25:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304014480 con 0x7f130c140e40 2023-10-08T17:25:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.921+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130c0c4920 con 0x7f130c140e40 2023-10-08T17:25:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.922+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130c0c4ee0 con 0x7f130c140e40 2023-10-08T17:25:31.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.922+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130c0c53e0 con 0x7f130c140e40 2023-10-08T17:25:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.923+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1304014830 con 0x7f130c140e40 2023-10-08T17:25:31.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.924+0000 7f1301ffb700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.924+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f13040851d0 con 0x7f130c140e40 2023-10-08T17:25:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.925+0000 7f131199b700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.925+0000 7f131199b700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13080039f0 tx=0x7f1308007ec0 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:31.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:31.929+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13040521d0 con 0x7f130c140e40 2023-10-08T17:25:32.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.132+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f130c0c78d0 con 0x7f130c140e40 2023-10-08T17:25:32.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.133+0000 7f1301ffb700 1 -- 172.21.15.12:0/3414058199 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) v1 ==== 74+0+16123 (secure 0 0 0) 0x7f13040557f0 con 0x7f130c140e40 2023-10-08T17:25:32.135 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:32.135 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":181,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:25:29.203471+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:25:32.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 msgr2=0x7f12f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 0x7f12f00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13080039f0 tx=0x7f1308007ec0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 msgr2=0x7f130c0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f1304009e90 tx=0x7f130400b040 comp rx=0 tx=0).stop 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 shutdown_connections 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f12f0066f30 0x7f12f00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f130c140e40 0x7f130c0b14f0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f130c06de50 0x7f130c0c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 --2- 172.21.15.12:0/3414058199 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f130c140a70 0x7f130c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 >> 172.21.15.12:0/3414058199 conn(0x7f130c06d170 msgr2=0x7f130c13e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 shutdown_connections 2023-10-08T17:25:32.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.136+0000 7f131299d700 1 -- 172.21.15.12:0/3414058199 wait complete. 2023-10-08T17:25:32.155 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T17:25:32.155 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:25:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.343+0000 7efed099d700 1 Processor -- start 2023-10-08T17:25:32.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.343+0000 7efed099d700 1 -- start start 2023-10-08T17:25:32.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.344+0000 7efed099d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efecc159550 0x7efecc0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.344+0000 7efed099d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efecc159920 0x7efecc0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efed099d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0acc00 con 0x7efecc15dfd0 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efed099d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0abff0 con 0x7efecc159550 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efed099d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0ac2d0 con 0x7efecc159920 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecb7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efecc159550 0x7efecc0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecaffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efecc15dfd0 0x7efecc0aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41630/0 (socket says 172.21.15.12:41630) 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecaffd700 1 -- 172.21.15.12:0/1452519891 learned_addr learned my addr 172.21.15.12:0/1452519891 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecbfff700 1 --2- 172.21.15.12:0/1452519891 >> v2:172.21.15.29:3300/0 conn(0x7efecc159920 0x7efecc0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecb7fe700 1 -- 172.21.15.12:0/1452519891 >> v2:172.21.15.29:3300/0 conn(0x7efecc159920 msgr2=0x7efecc0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecb7fe700 1 --2- 172.21.15.12:0/1452519891 >> v2:172.21.15.29:3300/0 conn(0x7efecc159920 0x7efecc0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecb7fe700 1 -- 172.21.15.12:0/1452519891 >> v1:172.21.15.12:6789/0 conn(0x7efecc15dfd0 legacy=0x7efecc0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efecb7fe700 1 -- 172.21.15.12:0/1452519891 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0ac5b0 con 0x7efecc159550 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.345+0000 7efeca7fc700 1 -- 172.21.15.12:0/1452519891 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1647241565 0 0) 0x7efecc0acc00 con 0x7efecc15dfd0 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efecb7fe700 1 --2- 172.21.15.12:0/1452519891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc159550 0x7efecc0ceac0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7efecc06b0f0 tx=0x7efebc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0298326aa2899e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efeca7fc700 1 -- 172.21.15.12:0/1452519891 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00b6b0 con 0x7efecc159550 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efeca7fc700 1 -- 172.21.15.12:0/1452519891 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc00b810 con 0x7efecc159550 2023-10-08T17:25:32.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efeca7fc700 1 -- 172.21.15.12:0/1452519891 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc00bbb0 con 0x7efecc159550 2023-10-08T17:25:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 -- 172.21.15.12:0/1452519891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc159550 msgr2=0x7efecc0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 --2- 172.21.15.12:0/1452519891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc159550 0x7efecc0ceac0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7efecc06b0f0 tx=0x7efebc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 -- 172.21.15.12:0/1452519891 shutdown_connections 2023-10-08T17:25:32.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 --2- 172.21.15.12:0/1452519891 >> v2:172.21.15.29:3300/0 conn(0x7efecc159920 0x7efecc0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 --2- 172.21.15.12:0/1452519891 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc159550 0x7efecc0ceac0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.346+0000 7efed099d700 1 -- 172.21.15.12:0/1452519891 >> 172.21.15.12:0/1452519891 conn(0x7efecc06ce80 msgr2=0x7efecc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.347+0000 7efed099d700 1 -- 172.21.15.12:0/1452519891 shutdown_connections 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.347+0000 7efed099d700 1 -- 172.21.15.12:0/1452519891 wait complete. 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.348+0000 7efed099d700 1 Processor -- start 2023-10-08T17:25:32.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.348+0000 7efed099d700 1 -- start start 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efecc159550 0x7efecc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efecc159920 0x7efecc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc169ac0 con 0x7efecc15dfd0 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc1524b0 con 0x7efecc159920 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efed099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0cd5a0 con 0x7efecc159550 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.349+0000 7efecbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47566/0 (socket says 172.21.15.12:47566) 2023-10-08T17:25:32.352 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 -- 172.21.15.12:0/1407192429 learned_addr learned my addr 172.21.15.12:0/1407192429 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecb7fe700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efecc159550 0x7efecc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecaffd700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efecc159920 0x7efecc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 -- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efecc159550 msgr2=0x7efecc151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efecc159550 0x7efecc151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 -- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efecc159920 msgr2=0x7efecc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efecc159920 0x7efecc0cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 -- 172.21.15.12:0/1407192429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009420 con 0x7efecc15dfd0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efecbfff700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efec4009fa0 tx=0x7efec4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.350+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec400ebc0 con 0x7efecc15dfd0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.351+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec400ed20 con 0x7efecc15dfd0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.351+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc0c7b20 con 0x7efecc15dfd0 2023-10-08T17:25:32.353 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.351+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4014670 con 0x7efecc15dfd0 2023-10-08T17:25:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.351+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc0c80e0 con 0x7efecc15dfd0 2023-10-08T17:25:32.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.352+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc04c3c0 con 0x7efecc15dfd0 2023-10-08T17:25:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.353+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efec40149e0 con 0x7efecc15dfd0 2023-10-08T17:25:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.353+0000 7efeb37fe700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.354+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7efec4084e40 con 0x7efecc15dfd0 2023-10-08T17:25:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.354+0000 7efecb7fe700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.354+0000 7efecb7fe700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 0x7efeb80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efebc0093f0 tx=0x7efebc017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.358+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec4051e40 con 0x7efecc15dfd0 2023-10-08T17:25:32.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.558+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efecc06e7c0 con 0x7efeb8066f30 2023-10-08T17:25:32.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.569+0000 7efeb37fe700 1 -- 172.21.15.12:0/1407192429 <== mgr.9024 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289159 (secure 0 0 0) 0x7efecc06e7c0 con 0x7efeb8066f30 2023-10-08T17:25:32.574 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.573+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 msgr2=0x7efeb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.573+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 0x7efeb80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efebc0093f0 tx=0x7efebc017000 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.573+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 msgr2=0x7efecc0afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.573+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7efec4009fa0 tx=0x7efec4009900 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 shutdown_connections 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7efeb8066f30 0x7efeb80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efecc15dfd0 0x7efecc0afb40 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efecc159550 0x7efecc151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 --2- 172.21.15.12:0/1407192429 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efecc159920 0x7efecc0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 >> 172.21.15.12:0/1407192429 conn(0x7efecc06ce80 msgr2=0x7efecc152d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:32.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 shutdown_connections 2023-10-08T17:25:32.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.574+0000 7efed099d700 1 -- 172.21.15.12:0/1407192429 wait complete. 2023-10-08T17:25:32.579 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:25:32.593 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:25:30.613714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458540,"kb_used_data":18796,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752516180,"statfs":{"total":773094113280,"available":770576568320,"internally_reserved":0,"allocated":19247104,"data_stored":10173220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.426722"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.219109+0000","last_change":"2023-10-08T17:25:28.219109+0000","last_active":"2023-10-08T17:25:28.219109+0000","last_peered":"2023-10-08T17:25:28.219109+0000","last_clean":"2023-10-08T17:25:28.219109+0000","last_became_active":"2023-10-08T17:25:28.218845+0000","last_became_peered":"2023-10-08T17:25:28.218845+0000","last_unstale":"2023-10-08T17:25:28.219109+0000","last_undegraded":"2023-10-08T17:25:28.219109+0000","last_fullsized":"2023-10-08T17:25:28.219109+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:51.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214277+0000","last_change":"2023-10-08T17:25:28.214277+0000","last_active":"2023-10-08T17:25:28.214277+0000","last_peered":"2023-10-08T17:25:28.214277+0000","last_clean":"2023-10-08T17:25:28.214277+0000","last_became_active":"2023-10-08T17:25:28.213992+0000","last_became_peered":"2023-10-08T17:25:28.213992+0000","last_unstale":"2023-10-08T17:25:28.214277+0000","last_undegraded":"2023-10-08T17:25:28.214277+0000","last_fullsized":"2023-10-08T17:25:28.214277+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:04.196918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226237+0000","last_change":"2023-10-08T17:25:28.226237+0000","last_active":"2023-10-08T17:25:28.226237+0000","last_peered":"2023-10-08T17:25:28.226237+0000","last_clean":"2023-10-08T17:25:28.226237+0000","last_became_active":"2023-10-08T17:25:28.225955+0000","last_became_peered":"2023-10-08T17:25:28.225955+0000","last_unstale":"2023-10-08T17:25:28.226237+0000","last_undegraded":"2023-10-08T17:25:28.226237+0000","last_fullsized":"2023-10-08T17:25:28.226237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:51.779744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231152+0000","last_change":"2023-10-08T17:25:28.228341+0000","last_active":"2023-10-08T17:25:28.231152+0000","last_peered":"2023-10-08T17:25:28.231152+0000","last_clean":"2023-10-08T17:25:28.231152+0000","last_became_active":"2023-10-08T17:25:28.227243+0000","last_became_peered":"2023-10-08T17:25:28.227243+0000","last_unstale":"2023-10-08T17:25:28.231152+0000","last_undegraded":"2023-10-08T17:25:28.231152+0000","last_fullsized":"2023-10-08T17:25:28.231152+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:08.669676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.222389+0000","last_change":"2023-10-08T17:25:28.219444+0000","last_active":"2023-10-08T17:25:28.222389+0000","last_peered":"2023-10-08T17:25:28.222389+0000","last_clean":"2023-10-08T17:25:28.222389+0000","last_became_active":"2023-10-08T17:25:28.219168+0000","last_became_peered":"2023-10-08T17:25:28.219168+0000","last_unstale":"2023-10-08T17:25:28.222389+0000","last_undegraded":"2023-10-08T17:25:28.222389+0000","last_fullsized":"2023-10-08T17:25:28.222389+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:49.388995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231449+0000","last_change":"2023-10-08T17:25:28.231449+0000","last_active":"2023-10-08T17:25:28.231449+0000","last_peered":"2023-10-08T17:25:28.231449+0000","last_clean":"2023-10-08T17:25:28.231449+0000","last_became_active":"2023-10-08T17:25:28.231121+0000","last_became_peered":"2023-10-08T17:25:28.231121+0000","last_unstale":"2023-10-08T17:25:28.231449+0000","last_undegraded":"2023-10-08T17:25:28.231449+0000","last_fullsized":"2023-10-08T17:25:28.231449+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:19.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234692+0000","last_change":"2023-10-08T17:25:28.229753+0000","last_active":"2023-10-08T17:25:28.234692+0000","last_peered":"2023-10-08T17:25:28.234692+0000","last_clean":"2023-10-08T17:25:28.234692+0000","last_became_active":"2023-10-08T17:25:28.229466+0000","last_became_peered":"2023-10-08T17:25:28.229466+0000","last_unstale":"2023-10-08T17:25:28.234692+0000","last_undegraded":"2023-10-08T17:25:28.234692+0000","last_fullsized":"2023-10-08T17:25:28.234692+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:27.936402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211553+0000","last_change":"2023-10-08T17:25:28.211553+0000","last_active":"2023-10-08T17:25:28.211553+0000","last_peered":"2023-10-08T17:25:28.211553+0000","last_clean":"2023-10-08T17:25:28.211553+0000","last_became_active":"2023-10-08T17:25:28.211281+0000","last_became_peered":"2023-10-08T17:25:28.211281+0000","last_unstale":"2023-10-08T17:25:28.211553+0000","last_undegraded":"2023-10-08T17:25:28.211553+0000","last_fullsized":"2023-10-08T17:25:28.211553+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:36.322361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216421+0000","last_change":"2023-10-08T17:25:28.216421+0000","last_active":"2023-10-08T17:25:28.216421+0000","last_peered":"2023-10-08T17:25:28.216421+0000","last_clean":"2023-10-08T17:25:28.216421+0000","last_became_active":"2023-10-08T17:25:28.216145+0000","last_became_peered":"2023-10-08T17:25:28.216145+0000","last_unstale":"2023-10-08T17:25:28.216421+0000","last_undegraded":"2023-10-08T17:25:28.216421+0000","last_fullsized":"2023-10-08T17:25:28.216421+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:50:32.366650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236338+0000","last_change":"2023-10-08T17:25:28.232646+0000","last_active":"2023-10-08T17:25:28.236338+0000","last_peered":"2023-10-08T17:25:28.236338+0000","last_clean":"2023-10-08T17:25:28.236338+0000","last_became_active":"2023-10-08T17:25:28.232374+0000","last_became_peered":"2023-10-08T17:25:28.232374+0000","last_unstale":"2023-10-08T17:25:28.236338+0000","last_undegraded":"2023-10-08T17:25:28.236338+0000","last_fullsized":"2023-10-08T17:25:28.236338+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:04.196918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216050+0000","last_change":"2023-10-08T17:25:28.216050+0000","last_active":"2023-10-08T17:25:28.216050+0000","last_peered":"2023-10-08T17:25:28.216050+0000","last_clean":"2023-10-08T17:25:28.216050+0000","last_became_active":"2023-10-08T17:25:28.215559+0000","last_became_peered":"2023-10-08T17:25:28.215559+0000","last_unstale":"2023-10-08T17:25:28.216050+0000","last_undegraded":"2023-10-08T17:25:28.216050+0000","last_fullsized":"2023-10-08T17:25:28.216050+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.997038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.220237+0000","last_change":"2023-10-08T17:25:28.217038+0000","last_active":"2023-10-08T17:25:28.220237+0000","last_peered":"2023-10-08T17:25:28.220237+0000","last_clean":"2023-10-08T17:25:28.220237+0000","last_became_active":"2023-10-08T17:25:28.216718+0000","last_became_peered":"2023-10-08T17:25:28.216718+0000","last_unstale":"2023-10-08T17:25:28.220237+0000","last_undegraded":"2023-10-08T17:25:28.220237+0000","last_fullsized":"2023-10-08T17:25:28.220237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:40.872628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221297+0000","last_change":"2023-10-08T17:25:28.218785+0000","last_active":"2023-10-08T17:25:28.221297+0000","last_peered":"2023-10-08T17:25:28.221297+0000","last_clean":"2023-10-08T17:25:28.221297+0000","last_became_active":"2023-10-08T17:25:28.218471+0000","last_became_peered":"2023-10-08T17:25:28.218471+0000","last_unstale":"2023-10-08T17:25:28.221297+0000","last_undegraded":"2023-10-08T17:25:28.221297+0000","last_fullsized":"2023-10-08T17:25:28.221297+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.997038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234072+0000","last_change":"2023-10-08T17:25:28.231682+0000","last_active":"2023-10-08T17:25:28.234072+0000","last_peered":"2023-10-08T17:25:28.234072+0000","last_clean":"2023-10-08T17:25:28.234072+0000","last_became_active":"2023-10-08T17:25:28.231358+0000","last_became_peered":"2023-10-08T17:25:28.231358+0000","last_unstale":"2023-10-08T17:25:28.234072+0000","last_undegraded":"2023-10-08T17:25:28.234072+0000","last_fullsized":"2023-10-08T17:25:28.234072+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:29.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.218061+0000","last_change":"2023-10-08T17:25:28.216823+0000","last_active":"2023-10-08T17:25:28.218061+0000","last_peered":"2023-10-08T17:25:28.218061+0000","last_clean":"2023-10-08T17:25:28.218061+0000","last_became_active":"2023-10-08T17:25:28.216486+0000","last_became_peered":"2023-10-08T17:25:28.216486+0000","last_unstale":"2023-10-08T17:25:28.218061+0000","last_undegraded":"2023-10-08T17:25:28.218061+0000","last_fullsized":"2023-10-08T17:25:28.218061+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:01.306196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.205524+0000","last_change":"2023-10-08T17:25:28.205524+0000","last_active":"2023-10-08T17:25:28.205524+0000","last_peered":"2023-10-08T17:25:28.205524+0000","last_clean":"2023-10-08T17:25:28.205524+0000","last_became_active":"2023-10-08T17:25:28.205267+0000","last_became_peered":"2023-10-08T17:25:28.205267+0000","last_unstale":"2023-10-08T17:25:28.205524+0000","last_undegraded":"2023-10-08T17:25:28.205524+0000","last_fullsized":"2023-10-08T17:25:28.205524+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:12.685538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.217476+0000","last_change":"2023-10-08T17:25:28.215089+0000","last_active":"2023-10-08T17:25:28.217476+0000","last_peered":"2023-10-08T17:25:28.217476+0000","last_clean":"2023-10-08T17:25:28.217476+0000","last_became_active":"2023-10-08T17:25:28.214776+0000","last_became_peered":"2023-10-08T17:25:28.214776+0000","last_unstale":"2023-10-08T17:25:28.217476+0000","last_undegraded":"2023-10-08T17:25:28.217476+0000","last_fullsized":"2023-10-08T17:25:28.217476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.828978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229251+0000","last_change":"2023-10-08T17:25:28.229251+0000","last_active":"2023-10-08T17:25:28.229251+0000","last_peered":"2023-10-08T17:25:28.229251+0000","last_clean":"2023-10-08T17:25:28.229251+0000","last_became_active":"2023-10-08T17:25:28.229005+0000","last_became_peered":"2023-10-08T17:25:28.229005+0000","last_unstale":"2023-10-08T17:25:28.229251+0000","last_undegraded":"2023-10-08T17:25:28.229251+0000","last_fullsized":"2023-10-08T17:25:28.229251+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:19.136213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208946+0000","last_change":"2023-10-08T17:25:28.208946+0000","last_active":"2023-10-08T17:25:28.208946+0000","last_peered":"2023-10-08T17:25:28.208946+0000","last_clean":"2023-10-08T17:25:28.208946+0000","last_became_active":"2023-10-08T17:25:28.208688+0000","last_became_peered":"2023-10-08T17:25:28.208688+0000","last_unstale":"2023-10-08T17:25:28.208946+0000","last_undegraded":"2023-10-08T17:25:28.208946+0000","last_fullsized":"2023-10-08T17:25:28.208946+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:57.941273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212403+0000","last_change":"2023-10-08T17:25:28.212403+0000","last_active":"2023-10-08T17:25:28.212403+0000","last_peered":"2023-10-08T17:25:28.212403+0000","last_clean":"2023-10-08T17:25:28.212403+0000","last_became_active":"2023-10-08T17:25:28.212136+0000","last_became_peered":"2023-10-08T17:25:28.212136+0000","last_unstale":"2023-10-08T17:25:28.212403+0000","last_undegraded":"2023-10-08T17:25:28.212403+0000","last_fullsized":"2023-10-08T17:25:28.212403+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:37.197238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236302+0000","last_change":"2023-10-08T17:25:28.233919+0000","last_active":"2023-10-08T17:25:28.236302+0000","last_peered":"2023-10-08T17:25:28.236302+0000","last_clean":"2023-10-08T17:25:28.236302+0000","last_became_active":"2023-10-08T17:25:28.233606+0000","last_became_peered":"2023-10-08T17:25:28.233606+0000","last_unstale":"2023-10-08T17:25:28.236302+0000","last_undegraded":"2023-10-08T17:25:28.236302+0000","last_fullsized":"2023-10-08T17:25:28.236302+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:35:20.620822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236921+0000","last_change":"2023-10-08T17:25:28.235210+0000","last_active":"2023-10-08T17:25:28.236921+0000","last_peered":"2023-10-08T17:25:28.236921+0000","last_clean":"2023-10-08T17:25:28.236921+0000","last_became_active":"2023-10-08T17:25:28.234873+0000","last_became_peered":"2023-10-08T17:25:28.234873+0000","last_unstale":"2023-10-08T17:25:28.236921+0000","last_undegraded":"2023-10-08T17:25:28.236921+0000","last_fullsized":"2023-10-08T17:25:28.236921+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:07.394612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230979+0000","last_change":"2023-10-08T17:25:28.220724+0000","last_active":"2023-10-08T17:25:28.230979+0000","last_peered":"2023-10-08T17:25:28.230979+0000","last_clean":"2023-10-08T17:25:28.230979+0000","last_became_active":"2023-10-08T17:25:28.220417+0000","last_became_peered":"2023-10-08T17:25:28.220417+0000","last_unstale":"2023-10-08T17:25:28.230979+0000","last_undegraded":"2023-10-08T17:25:28.230979+0000","last_fullsized":"2023-10-08T17:25:28.230979+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:51.531483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234609+0000","last_change":"2023-10-08T17:25:28.232521+0000","last_active":"2023-10-08T17:25:28.234609+0000","last_peered":"2023-10-08T17:25:28.234609+0000","last_clean":"2023-10-08T17:25:28.234609+0000","last_became_active":"2023-10-08T17:25:28.232229+0000","last_became_peered":"2023-10-08T17:25:28.232229+0000","last_unstale":"2023-10-08T17:25:28.234609+0000","last_undegraded":"2023-10-08T17:25:28.234609+0000","last_fullsized":"2023-10-08T17:25:28.234609+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:37.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.210523+0000","last_change":"2023-10-08T17:25:28.210523+0000","last_active":"2023-10-08T17:25:28.210523+0000","last_peered":"2023-10-08T17:25:28.210523+0000","last_clean":"2023-10-08T17:25:28.210523+0000","last_became_active":"2023-10-08T17:25:28.210270+0000","last_became_peered":"2023-10-08T17:25:28.210270+0000","last_unstale":"2023-10-08T17:25:28.210523+0000","last_undegraded":"2023-10-08T17:25:28.210523+0000","last_fullsized":"2023-10-08T17:25:28.210523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:09.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.209391+0000","last_change":"2023-10-08T17:25:28.209391+0000","last_active":"2023-10-08T17:25:28.209391+0000","last_peered":"2023-10-08T17:25:28.209391+0000","last_clean":"2023-10-08T17:25:28.209391+0000","last_became_active":"2023-10-08T17:25:28.209115+0000","last_became_peered":"2023-10-08T17:25:28.209115+0000","last_unstale":"2023-10-08T17:25:28.209391+0000","last_undegraded":"2023-10-08T17:25:28.209391+0000","last_fullsized":"2023-10-08T17:25:28.209391+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:53.462320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226717+0000","last_change":"2023-10-08T17:25:28.226717+0000","last_active":"2023-10-08T17:25:28.226717+0000","last_peered":"2023-10-08T17:25:28.226717+0000","last_clean":"2023-10-08T17:25:28.226717+0000","last_became_active":"2023-10-08T17:25:28.226457+0000","last_became_peered":"2023-10-08T17:25:28.226457+0000","last_unstale":"2023-10-08T17:25:28.226717+0000","last_undegraded":"2023-10-08T17:25:28.226717+0000","last_fullsized":"2023-10-08T17:25:28.226717+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:54.002512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.235152+0000","last_change":"2023-10-08T17:25:28.230586+0000","last_active":"2023-10-08T17:25:28.235152+0000","last_peered":"2023-10-08T17:25:28.235152+0000","last_clean":"2023-10-08T17:25:28.235152+0000","last_became_active":"2023-10-08T17:25:28.230314+0000","last_became_peered":"2023-10-08T17:25:28.230314+0000","last_unstale":"2023-10-08T17:25:28.235152+0000","last_undegraded":"2023-10-08T17:25:28.235152+0000","last_fullsized":"2023-10-08T17:25:28.235152+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:42.576153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223756+0000","last_change":"2023-10-08T17:25:28.223756+0000","last_active":"2023-10-08T17:25:28.223756+0000","last_peered":"2023-10-08T17:25:28.223756+0000","last_clean":"2023-10-08T17:25:28.223756+0000","last_became_active":"2023-10-08T17:25:28.223474+0000","last_became_peered":"2023-10-08T17:25:28.223474+0000","last_unstale":"2023-10-08T17:25:28.223756+0000","last_undegraded":"2023-10-08T17:25:28.223756+0000","last_fullsized":"2023-10-08T17:25:28.223756+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:11.490767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231077+0000","last_change":"2023-10-08T17:25:28.227311+0000","last_active":"2023-10-08T17:25:28.231077+0000","last_peered":"2023-10-08T17:25:28.231077+0000","last_clean":"2023-10-08T17:25:28.231077+0000","last_became_active":"2023-10-08T17:25:28.223265+0000","last_became_peered":"2023-10-08T17:25:28.223265+0000","last_unstale":"2023-10-08T17:25:28.231077+0000","last_undegraded":"2023-10-08T17:25:28.231077+0000","last_fullsized":"2023-10-08T17:25:28.231077+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:30.554356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231648+0000","last_change":"2023-10-08T17:25:28.231648+0000","last_active":"2023-10-08T17:25:28.231648+0000","last_peered":"2023-10-08T17:25:28.231648+0000","last_clean":"2023-10-08T17:25:28.231648+0000","last_became_active":"2023-10-08T17:25:28.231091+0000","last_became_peered":"2023-10-08T17:25:28.231091+0000","last_unstale":"2023-10-08T17:25:28.231648+0000","last_undegraded":"2023-10-08T17:25:28.231648+0000","last_fullsized":"2023-10-08T17:25:28.231648+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:01.306196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208719+0000","last_change":"2023-10-08T17:25:28.208719+0000","last_active":"2023-10-08T17:25:28.208719+0000","last_peered":"2023-10-08T17:25:28.208719+0000","last_clean":"2023-10-08T17:25:28.208719+0000","last_became_active":"2023-10-08T17:25:28.208453+0000","last_became_peered":"2023-10-08T17:25:28.208453+0000","last_unstale":"2023-10-08T17:25:28.208719+0000","last_undegraded":"2023-10-08T17:25:28.208719+0000","last_fullsized":"2023-10-08T17:25:28.208719+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:59:13.466146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.224439+0000","last_change":"2023-10-08T17:25:28.222051+0000","last_active":"2023-10-08T17:25:28.224439+0000","last_peered":"2023-10-08T17:25:28.224439+0000","last_clean":"2023-10-08T17:25:28.224439+0000","last_became_active":"2023-10-08T17:25:28.221771+0000","last_became_peered":"2023-10-08T17:25:28.221771+0000","last_unstale":"2023-10-08T17:25:28.224439+0000","last_undegraded":"2023-10-08T17:25:28.224439+0000","last_fullsized":"2023-10-08T17:25:28.224439+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:59.389388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"180'4","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233042+0000","last_change":"2023-10-08T17:25:27.210259+0000","last_active":"2023-10-08T17:25:28.233042+0000","last_peered":"2023-10-08T17:25:28.233042+0000","last_clean":"2023-10-08T17:25:28.233042+0000","last_became_active":"2023-10-08T17:25:27.209979+0000","last_became_peered":"2023-10-08T17:25:27.209979+0000","last_unstale":"2023-10-08T17:25:28.233042+0000","last_undegraded":"2023-10-08T17:25:28.233042+0000","last_fullsized":"2023-10-08T17:25:28.233042+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:26.928009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214431+0000","last_change":"2023-10-08T17:25:28.214431+0000","last_active":"2023-10-08T17:25:28.214431+0000","last_peered":"2023-10-08T17:25:28.214431+0000","last_clean":"2023-10-08T17:25:28.214431+0000","last_became_active":"2023-10-08T17:25:28.214159+0000","last_became_peered":"2023-10-08T17:25:28.214159+0000","last_unstale":"2023-10-08T17:25:28.214431+0000","last_undegraded":"2023-10-08T17:25:28.214431+0000","last_fullsized":"2023-10-08T17:25:28.214431+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:20.439301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.206656+0000","last_change":"2023-10-08T17:25:27.215158+0000","last_active":"2023-10-08T17:25:28.206656+0000","last_peered":"2023-10-08T17:25:28.206656+0000","last_clean":"2023-10-08T17:25:28.206656+0000","last_became_active":"2023-10-08T17:25:27.213114+0000","last_became_peered":"2023-10-08T17:25:27.213114+0000","last_unstale":"2023-10-08T17:25:28.206656+0000","last_undegraded":"2023-10-08T17:25:28.206656+0000","last_fullsized":"2023-10-08T17:25:28.206656+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:06.042409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212074+0000","last_change":"2023-10-08T17:25:28.212074+0000","last_active":"2023-10-08T17:25:28.212074+0000","last_peered":"2023-10-08T17:25:28.212074+0000","last_clean":"2023-10-08T17:25:28.212074+0000","last_became_active":"2023-10-08T17:25:28.211737+0000","last_became_peered":"2023-10-08T17:25:28.211737+0000","last_unstale":"2023-10-08T17:25:28.212074+0000","last_undegraded":"2023-10-08T17:25:28.212074+0000","last_fullsized":"2023-10-08T17:25:28.212074+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:50.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236110+0000","last_change":"2023-10-08T17:25:27.209713+0000","last_active":"2023-10-08T17:25:28.236110+0000","last_peered":"2023-10-08T17:25:28.236110+0000","last_clean":"2023-10-08T17:25:28.236110+0000","last_became_active":"2023-10-08T17:25:27.209431+0000","last_became_peered":"2023-10-08T17:25:27.209431+0000","last_unstale":"2023-10-08T17:25:28.236110+0000","last_undegraded":"2023-10-08T17:25:28.236110+0000","last_fullsized":"2023-10-08T17:25:28.236110+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:20.811467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231555+0000","last_change":"2023-10-08T17:25:28.226144+0000","last_active":"2023-10-08T17:25:28.231555+0000","last_peered":"2023-10-08T17:25:28.231555+0000","last_clean":"2023-10-08T17:25:28.231555+0000","last_became_active":"2023-10-08T17:25:28.225859+0000","last_became_peered":"2023-10-08T17:25:28.225859+0000","last_unstale":"2023-10-08T17:25:28.231555+0000","last_undegraded":"2023-10-08T17:25:28.231555+0000","last_fullsized":"2023-10-08T17:25:28.231555+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:18.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233194+0000","last_change":"2023-10-08T17:25:27.211817+0000","last_active":"2023-10-08T17:25:28.233194+0000","last_peered":"2023-10-08T17:25:28.233194+0000","last_clean":"2023-10-08T17:25:28.233194+0000","last_became_active":"2023-10-08T17:25:27.211530+0000","last_became_peered":"2023-10-08T17:25:27.211530+0000","last_unstale":"2023-10-08T17:25:28.233194+0000","last_undegraded":"2023-10-08T17:25:28.233194+0000","last_fullsized":"2023-10-08T17:25:28.233194+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:04.633973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226081+0000","last_change":"2023-10-08T17:25:28.226081+0000","last_active":"2023-10-08T17:25:28.226081+0000","last_peered":"2023-10-08T17:25:28.226081+0000","last_clean":"2023-10-08T17:25:28.226081+0000","last_became_active":"2023-10-08T17:25:28.225681+0000","last_became_peered":"2023-10-08T17:25:28.225681+0000","last_unstale":"2023-10-08T17:25:28.226081+0000","last_undegraded":"2023-10-08T17:25:28.226081+0000","last_fullsized":"2023-10-08T17:25:28.226081+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:40.872628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.198255+0000","last_change":"2023-10-08T17:25:27.213290+0000","last_active":"2023-10-08T17:25:28.198255+0000","last_peered":"2023-10-08T17:25:28.198255+0000","last_clean":"2023-10-08T17:25:28.198255+0000","last_became_active":"2023-10-08T17:25:27.211901+0000","last_became_peered":"2023-10-08T17:25:27.211901+0000","last_unstale":"2023-10-08T17:25:28.198255+0000","last_undegraded":"2023-10-08T17:25:28.198255+0000","last_fullsized":"2023-10-08T17:25:28.198255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:24.458486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231236+0000","last_change":"2023-10-08T17:25:28.224048+0000","last_active":"2023-10-08T17:25:28.231236+0000","last_peered":"2023-10-08T17:25:28.231236+0000","last_clean":"2023-10-08T17:25:28.231236+0000","last_became_active":"2023-10-08T17:25:28.223777+0000","last_became_peered":"2023-10-08T17:25:28.223777+0000","last_unstale":"2023-10-08T17:25:28.231236+0000","last_undegraded":"2023-10-08T17:25:28.231236+0000","last_fullsized":"2023-10-08T17:25:28.231236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:47.432027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221039+0000","last_change":"2023-10-08T17:25:27.215682+0000","last_active":"2023-10-08T17:25:28.221039+0000","last_peered":"2023-10-08T17:25:28.221039+0000","last_clean":"2023-10-08T17:25:28.221039+0000","last_became_active":"2023-10-08T17:25:27.215384+0000","last_became_peered":"2023-10-08T17:25:27.215384+0000","last_unstale":"2023-10-08T17:25:28.221039+0000","last_undegraded":"2023-10-08T17:25:28.221039+0000","last_fullsized":"2023-10-08T17:25:28.221039+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:02.485611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211769+0000","last_change":"2023-10-08T17:25:28.211769+0000","last_active":"2023-10-08T17:25:28.211769+0000","last_peered":"2023-10-08T17:25:28.211769+0000","last_clean":"2023-10-08T17:25:28.211769+0000","last_became_active":"2023-10-08T17:25:28.211466+0000","last_became_peered":"2023-10-08T17:25:28.211466+0000","last_unstale":"2023-10-08T17:25:28.211769+0000","last_undegraded":"2023-10-08T17:25:28.211769+0000","last_fullsized":"2023-10-08T17:25:28.211769+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:56.331719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217201+0000","last_change":"2023-10-08T17:25:27.213910+0000","last_active":"2023-10-08T17:25:27.217201+0000","last_peered":"2023-10-08T17:25:27.217201+0000","last_clean":"2023-10-08T17:25:27.217201+0000","last_became_active":"2023-10-08T17:25:27.213645+0000","last_became_peered":"2023-10-08T17:25:27.213645+0000","last_unstale":"2023-10-08T17:25:27.217201+0000","last_undegraded":"2023-10-08T17:25:27.217201+0000","last_fullsized":"2023-10-08T17:25:27.217201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:32.725537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221255+0000","last_change":"2023-10-08T17:25:28.218608+0000","last_active":"2023-10-08T17:25:28.221255+0000","last_peered":"2023-10-08T17:25:28.221255+0000","last_clean":"2023-10-08T17:25:28.221255+0000","last_became_active":"2023-10-08T17:25:28.217927+0000","last_became_peered":"2023-10-08T17:25:28.217927+0000","last_unstale":"2023-10-08T17:25:28.221255+0000","last_undegraded":"2023-10-08T17:25:28.221255+0000","last_fullsized":"2023-10-08T17:25:28.221255+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:07.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.200254+0000","last_change":"2023-10-08T17:25:27.208457+0000","last_active":"2023-10-08T17:25:28.200254+0000","last_peered":"2023-10-08T17:25:28.200254+0000","last_clean":"2023-10-08T17:25:28.200254+0000","last_became_active":"2023-10-08T17:25:27.208154+0000","last_became_peered":"2023-10-08T17:25:27.208154+0000","last_unstale":"2023-10-08T17:25:28.200254+0000","last_undegraded":"2023-10-08T17:25:28.200254+0000","last_fullsized":"2023-10-08T17:25:28.200254+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:54.804721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216920+0000","last_change":"2023-10-08T17:25:28.213051+0000","last_active":"2023-10-08T17:25:28.216920+0000","last_peered":"2023-10-08T17:25:28.216920+0000","last_clean":"2023-10-08T17:25:28.216920+0000","last_became_active":"2023-10-08T17:25:28.212751+0000","last_became_peered":"2023-10-08T17:25:28.212751+0000","last_unstale":"2023-10-08T17:25:28.216920+0000","last_undegraded":"2023-10-08T17:25:28.216920+0000","last_fullsized":"2023-10-08T17:25:28.216920+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.215502+0000","last_change":"2023-10-08T17:25:27.212319+0000","last_active":"2023-10-08T17:25:27.215502+0000","last_peered":"2023-10-08T17:25:27.215502+0000","last_clean":"2023-10-08T17:25:27.215502+0000","last_became_active":"2023-10-08T17:25:27.212052+0000","last_became_peered":"2023-10-08T17:25:27.212052+0000","last_unstale":"2023-10-08T17:25:27.215502+0000","last_undegraded":"2023-10-08T17:25:27.215502+0000","last_fullsized":"2023-10-08T17:25:27.215502+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:02.144216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.217507+0000","last_change":"2023-10-08T17:25:28.215751+0000","last_active":"2023-10-08T17:25:28.217507+0000","last_peered":"2023-10-08T17:25:28.217507+0000","last_clean":"2023-10-08T17:25:28.217507+0000","last_became_active":"2023-10-08T17:25:28.215477+0000","last_became_peered":"2023-10-08T17:25:28.215477+0000","last_unstale":"2023-10-08T17:25:28.217507+0000","last_undegraded":"2023-10-08T17:25:28.217507+0000","last_fullsized":"2023-10-08T17:25:28.217507+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:01:01.488390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.206427+0000","last_change":"2023-10-08T17:25:27.211866+0000","last_active":"2023-10-08T17:25:28.206427+0000","last_peered":"2023-10-08T17:25:28.206427+0000","last_clean":"2023-10-08T17:25:28.206427+0000","last_became_active":"2023-10-08T17:25:27.211479+0000","last_became_peered":"2023-10-08T17:25:27.211479+0000","last_unstale":"2023-10-08T17:25:28.206427+0000","last_undegraded":"2023-10-08T17:25:28.206427+0000","last_fullsized":"2023-10-08T17:25:28.206427+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:44.406589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212978+0000","last_change":"2023-10-08T17:25:28.212978+0000","last_active":"2023-10-08T17:25:28.212978+0000","last_peered":"2023-10-08T17:25:28.212978+0000","last_clean":"2023-10-08T17:25:28.212978+0000","last_became_active":"2023-10-08T17:25:28.212662+0000","last_became_peered":"2023-10-08T17:25:28.212662+0000","last_unstale":"2023-10-08T17:25:28.212978+0000","last_undegraded":"2023-10-08T17:25:28.212978+0000","last_fullsized":"2023-10-08T17:25:28.212978+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:32.371069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"180'6","reported_seq":16,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.237213+0000","last_change":"2023-10-08T17:25:27.209742+0000","last_active":"2023-10-08T17:25:28.237213+0000","last_peered":"2023-10-08T17:25:28.237213+0000","last_clean":"2023-10-08T17:25:28.237213+0000","last_became_active":"2023-10-08T17:25:27.209480+0000","last_became_peered":"2023-10-08T17:25:27.209480+0000","last_unstale":"2023-10-08T17:25:28.237213+0000","last_undegraded":"2023-10-08T17:25:28.237213+0000","last_fullsized":"2023-10-08T17:25:28.237213+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:46.423634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233043+0000","last_change":"2023-10-08T17:25:28.233043+0000","last_active":"2023-10-08T17:25:28.233043+0000","last_peered":"2023-10-08T17:25:28.233043+0000","last_clean":"2023-10-08T17:25:28.233043+0000","last_became_active":"2023-10-08T17:25:28.232747+0000","last_became_peered":"2023-10-08T17:25:28.232747+0000","last_unstale":"2023-10-08T17:25:28.233043+0000","last_undegraded":"2023-10-08T17:25:28.233043+0000","last_fullsized":"2023-10-08T17:25:28.233043+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:24.233983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"180'2","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234659+0000","last_change":"2023-10-08T17:25:27.219868+0000","last_active":"2023-10-08T17:25:28.234659+0000","last_peered":"2023-10-08T17:25:28.234659+0000","last_clean":"2023-10-08T17:25:28.234659+0000","last_became_active":"2023-10-08T17:25:27.219605+0000","last_became_peered":"2023-10-08T17:25:27.219605+0000","last_unstale":"2023-10-08T17:25:28.234659+0000","last_undegraded":"2023-10-08T17:25:28.234659+0000","last_fullsized":"2023-10-08T17:25:28.234659+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:31.362676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214552+0000","last_change":"2023-10-08T17:25:28.214552+0000","last_active":"2023-10-08T17:25:28.214552+0000","last_peered":"2023-10-08T17:25:28.214552+0000","last_clean":"2023-10-08T17:25:28.214552+0000","last_became_active":"2023-10-08T17:25:28.214232+0000","last_became_peered":"2023-10-08T17:25:28.214232+0000","last_unstale":"2023-10-08T17:25:28.214552+0000","last_undegraded":"2023-10-08T17:25:28.214552+0000","last_fullsized":"2023-10-08T17:25:28.214552+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:59.389388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.215114+0000","last_change":"2023-10-08T17:25:27.212880+0000","last_active":"2023-10-08T17:25:27.215114+0000","last_peered":"2023-10-08T17:25:27.215114+0000","last_clean":"2023-10-08T17:25:27.215114+0000","last_became_active":"2023-10-08T17:25:27.212526+0000","last_became_peered":"2023-10-08T17:25:27.212526+0000","last_unstale":"2023-10-08T17:25:27.215114+0000","last_undegraded":"2023-10-08T17:25:27.215114+0000","last_fullsized":"2023-10-08T17:25:27.215114+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:28.759762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223828+0000","last_change":"2023-10-08T17:25:28.220817+0000","last_active":"2023-10-08T17:25:28.223828+0000","last_peered":"2023-10-08T17:25:28.223828+0000","last_clean":"2023-10-08T17:25:28.223828+0000","last_became_active":"2023-10-08T17:25:28.220557+0000","last_became_peered":"2023-10-08T17:25:28.220557+0000","last_unstale":"2023-10-08T17:25:28.223828+0000","last_undegraded":"2023-10-08T17:25:28.223828+0000","last_fullsized":"2023-10-08T17:25:28.223828+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:08.281532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217730+0000","last_change":"2023-10-08T17:25:27.213549+0000","last_active":"2023-10-08T17:25:27.217730+0000","last_peered":"2023-10-08T17:25:27.217730+0000","last_clean":"2023-10-08T17:25:27.217730+0000","last_became_active":"2023-10-08T17:25:27.213301+0000","last_became_peered":"2023-10-08T17:25:27.213301+0000","last_unstale":"2023-10-08T17:25:27.217730+0000","last_undegraded":"2023-10-08T17:25:27.217730+0000","last_fullsized":"2023-10-08T17:25:27.217730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:02.758238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223311+0000","last_change":"2023-10-08T17:25:28.223311+0000","last_active":"2023-10-08T17:25:28.223311+0000","last_peered":"2023-10-08T17:25:28.223311+0000","last_clean":"2023-10-08T17:25:28.223311+0000","last_became_active":"2023-10-08T17:25:28.223021+0000","last_became_peered":"2023-10-08T17:25:28.223021+0000","last_unstale":"2023-10-08T17:25:28.223311+0000","last_undegraded":"2023-10-08T17:25:28.223311+0000","last_fullsized":"2023-10-08T17:25:28.223311+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:39.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"180'8","reported_seq":17,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.232019+0000","last_change":"2023-10-08T17:25:27.219958+0000","last_active":"2023-10-08T17:25:28.232019+0000","last_peered":"2023-10-08T17:25:28.232019+0000","last_clean":"2023-10-08T17:25:28.232019+0000","last_became_active":"2023-10-08T17:25:27.219626+0000","last_became_peered":"2023-10-08T17:25:27.219626+0000","last_unstale":"2023-10-08T17:25:28.232019+0000","last_undegraded":"2023-10-08T17:25:28.232019+0000","last_fullsized":"2023-10-08T17:25:28.232019+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:06:46.380579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223774+0000","last_change":"2023-10-08T17:25:28.220608+0000","last_active":"2023-10-08T17:25:28.223774+0000","last_peered":"2023-10-08T17:25:28.223774+0000","last_clean":"2023-10-08T17:25:28.223774+0000","last_became_active":"2023-10-08T17:25:28.220293+0000","last_became_peered":"2023-10-08T17:25:28.220293+0000","last_unstale":"2023-10-08T17:25:28.223774+0000","last_undegraded":"2023-10-08T17:25:28.223774+0000","last_fullsized":"2023-10-08T17:25:28.223774+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:20:40.684892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226913+0000","last_change":"2023-10-08T17:25:27.216000+0000","last_active":"2023-10-08T17:25:28.226913+0000","last_peered":"2023-10-08T17:25:28.226913+0000","last_clean":"2023-10-08T17:25:28.226913+0000","last_became_active":"2023-10-08T17:25:27.215740+0000","last_became_peered":"2023-10-08T17:25:27.215740+0000","last_unstale":"2023-10-08T17:25:28.226913+0000","last_undegraded":"2023-10-08T17:25:28.226913+0000","last_fullsized":"2023-10-08T17:25:28.226913+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:17.869170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216644+0000","last_change":"2023-10-08T17:25:28.216644+0000","last_active":"2023-10-08T17:25:28.216644+0000","last_peered":"2023-10-08T17:25:28.216644+0000","last_clean":"2023-10-08T17:25:28.216644+0000","last_became_active":"2023-10-08T17:25:28.216371+0000","last_became_peered":"2023-10-08T17:25:28.216371+0000","last_unstale":"2023-10-08T17:25:28.216644+0000","last_undegraded":"2023-10-08T17:25:28.216644+0000","last_fullsized":"2023-10-08T17:25:28.216644+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:29.768156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"180'2","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234593+0000","last_change":"2023-10-08T17:25:27.217839+0000","last_active":"2023-10-08T17:25:28.234593+0000","last_peered":"2023-10-08T17:25:28.234593+0000","last_clean":"2023-10-08T17:25:28.234593+0000","last_became_active":"2023-10-08T17:25:27.217472+0000","last_became_peered":"2023-10-08T17:25:27.217472+0000","last_unstale":"2023-10-08T17:25:28.234593+0000","last_undegraded":"2023-10-08T17:25:28.234593+0000","last_fullsized":"2023-10-08T17:25:28.234593+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:04.211399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.232920+0000","last_change":"2023-10-08T17:25:28.232920+0000","last_active":"2023-10-08T17:25:28.232920+0000","last_peered":"2023-10-08T17:25:28.232920+0000","last_clean":"2023-10-08T17:25:28.232920+0000","last_became_active":"2023-10-08T17:25:28.232626+0000","last_became_peered":"2023-10-08T17:25:28.232626+0000","last_unstale":"2023-10-08T17:25:28.232920+0000","last_undegraded":"2023-10-08T17:25:28.232920+0000","last_fullsized":"2023-10-08T17:25:28.232920+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:34.080545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.198734+0000","last_change":"2023-10-08T17:25:27.209410+0000","last_active":"2023-10-08T17:25:28.198734+0000","last_peered":"2023-10-08T17:25:28.198734+0000","last_clean":"2023-10-08T17:25:28.198734+0000","last_became_active":"2023-10-08T17:25:27.209126+0000","last_became_peered":"2023-10-08T17:25:27.209126+0000","last_unstale":"2023-10-08T17:25:28.198734+0000","last_undegraded":"2023-10-08T17:25:28.198734+0000","last_fullsized":"2023-10-08T17:25:28.198734+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:10.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231436+0000","last_change":"2023-10-08T17:25:28.231436+0000","last_active":"2023-10-08T17:25:28.231436+0000","last_peered":"2023-10-08T17:25:28.231436+0000","last_clean":"2023-10-08T17:25:28.231436+0000","last_became_active":"2023-10-08T17:25:28.231049+0000","last_became_peered":"2023-10-08T17:25:28.231049+0000","last_unstale":"2023-10-08T17:25:28.231436+0000","last_undegraded":"2023-10-08T17:25:28.231436+0000","last_fullsized":"2023-10-08T17:25:28.231436+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:42.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.209665+0000","last_change":"2023-10-08T17:25:27.206913+0000","last_active":"2023-10-08T17:25:27.209665+0000","last_peered":"2023-10-08T17:25:27.209665+0000","last_clean":"2023-10-08T17:25:27.209665+0000","last_became_active":"2023-10-08T17:25:27.206635+0000","last_became_peered":"2023-10-08T17:25:27.206635+0000","last_unstale":"2023-10-08T17:25:27.209665+0000","last_undegraded":"2023-10-08T17:25:27.209665+0000","last_fullsized":"2023-10-08T17:25:27.209665+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:43.302090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230884+0000","last_change":"2023-10-08T17:25:28.224344+0000","last_active":"2023-10-08T17:25:28.230884+0000","last_peered":"2023-10-08T17:25:28.230884+0000","last_clean":"2023-10-08T17:25:28.230884+0000","last_became_active":"2023-10-08T17:25:28.213830+0000","last_became_peered":"2023-10-08T17:25:28.213830+0000","last_unstale":"2023-10-08T17:25:28.230884+0000","last_undegraded":"2023-10-08T17:25:28.230884+0000","last_fullsized":"2023-10-08T17:25:28.230884+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:25.087453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230313+0000","last_change":"2023-10-08T17:25:27.220068+0000","last_active":"2023-10-08T17:25:28.230313+0000","last_peered":"2023-10-08T17:25:28.230313+0000","last_clean":"2023-10-08T17:25:28.230313+0000","last_became_active":"2023-10-08T17:25:27.219687+0000","last_became_peered":"2023-10-08T17:25:27.219687+0000","last_unstale":"2023-10-08T17:25:28.230313+0000","last_undegraded":"2023-10-08T17:25:28.230313+0000","last_fullsized":"2023-10-08T17:25:28.230313+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:29.545962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229150+0000","last_change":"2023-10-08T17:25:28.226046+0000","last_active":"2023-10-08T17:25:28.229150+0000","last_peered":"2023-10-08T17:25:28.229150+0000","last_clean":"2023-10-08T17:25:28.229150+0000","last_became_active":"2023-10-08T17:25:28.225681+0000","last_became_peered":"2023-10-08T17:25:28.225681+0000","last_unstale":"2023-10-08T17:25:28.229150+0000","last_undegraded":"2023-10-08T17:25:28.229150+0000","last_fullsized":"2023-10-08T17:25:28.229150+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:49.677059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203341+0000","last_change":"2023-10-08T17:25:27.215617+0000","last_active":"2023-10-08T17:25:28.203341+0000","last_peered":"2023-10-08T17:25:28.203341+0000","last_clean":"2023-10-08T17:25:28.203341+0000","last_became_active":"2023-10-08T17:25:27.215135+0000","last_became_peered":"2023-10-08T17:25:27.215135+0000","last_unstale":"2023-10-08T17:25:28.203341+0000","last_undegraded":"2023-10-08T17:25:28.203341+0000","last_fullsized":"2023-10-08T17:25:28.203341+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:48.668666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.228833+0000","last_change":"2023-10-08T17:25:28.211549+0000","last_active":"2023-10-08T17:25:28.228833+0000","last_peered":"2023-10-08T17:25:28.228833+0000","last_clean":"2023-10-08T17:25:28.228833+0000","last_became_active":"2023-10-08T17:25:28.211253+0000","last_became_peered":"2023-10-08T17:25:28.211253+0000","last_unstale":"2023-10-08T17:25:28.228833+0000","last_undegraded":"2023-10-08T17:25:28.228833+0000","last_fullsized":"2023-10-08T17:25:28.228833+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:26:30.781498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203995+0000","last_change":"2023-10-08T17:25:27.212553+0000","last_active":"2023-10-08T17:25:28.203995+0000","last_peered":"2023-10-08T17:25:28.203995+0000","last_clean":"2023-10-08T17:25:28.203995+0000","last_became_active":"2023-10-08T17:25:27.212254+0000","last_became_peered":"2023-10-08T17:25:27.212254+0000","last_unstale":"2023-10-08T17:25:28.203995+0000","last_undegraded":"2023-10-08T17:25:28.203995+0000","last_fullsized":"2023-10-08T17:25:28.203995+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:14.751684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234709+0000","last_change":"2023-10-08T17:25:28.229829+0000","last_active":"2023-10-08T17:25:28.234709+0000","last_peered":"2023-10-08T17:25:28.234709+0000","last_clean":"2023-10-08T17:25:28.234709+0000","last_became_active":"2023-10-08T17:25:28.229489+0000","last_became_peered":"2023-10-08T17:25:28.229489+0000","last_unstale":"2023-10-08T17:25:28.234709+0000","last_undegraded":"2023-10-08T17:25:28.234709+0000","last_fullsized":"2023-10-08T17:25:28.234709+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:15.760077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.218554+0000","last_change":"2023-10-08T17:25:27.216098+0000","last_active":"2023-10-08T17:25:27.218554+0000","last_peered":"2023-10-08T17:25:27.218554+0000","last_clean":"2023-10-08T17:25:27.218554+0000","last_became_active":"2023-10-08T17:25:27.215804+0000","last_became_peered":"2023-10-08T17:25:27.215804+0000","last_unstale":"2023-10-08T17:25:27.218554+0000","last_undegraded":"2023-10-08T17:25:27.218554+0000","last_fullsized":"2023-10-08T17:25:27.218554+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:59:12.457752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.222359+0000","last_change":"2023-10-08T17:25:28.220101+0000","last_active":"2023-10-08T17:25:28.222359+0000","last_peered":"2023-10-08T17:25:28.222359+0000","last_clean":"2023-10-08T17:25:28.222359+0000","last_became_active":"2023-10-08T17:25:28.219835+0000","last_became_peered":"2023-10-08T17:25:28.219835+0000","last_unstale":"2023-10-08T17:25:28.222359+0000","last_undegraded":"2023-10-08T17:25:28.222359+0000","last_fullsized":"2023-10-08T17:25:28.222359+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:36.322361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236518+0000","last_change":"2023-10-08T17:25:27.217045+0000","last_active":"2023-10-08T17:25:28.236518+0000","last_peered":"2023-10-08T17:25:28.236518+0000","last_clean":"2023-10-08T17:25:28.236518+0000","last_became_active":"2023-10-08T17:25:27.216068+0000","last_became_peered":"2023-10-08T17:25:27.216068+0000","last_unstale":"2023-10-08T17:25:28.236518+0000","last_undegraded":"2023-10-08T17:25:28.236518+0000","last_fullsized":"2023-10-08T17:25:28.236518+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:28.471954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233486+0000","last_change":"2023-10-08T17:25:28.233486+0000","last_active":"2023-10-08T17:25:28.233486+0000","last_peered":"2023-10-08T17:25:28.233486+0000","last_clean":"2023-10-08T17:25:28.233486+0000","last_became_active":"2023-10-08T17:25:28.233220+0000","last_became_peered":"2023-10-08T17:25:28.233220+0000","last_unstale":"2023-10-08T17:25:28.233486+0000","last_undegraded":"2023-10-08T17:25:28.233486+0000","last_fullsized":"2023-10-08T17:25:28.233486+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:22.534581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.218026+0000","last_change":"2023-10-08T17:25:27.215774+0000","last_active":"2023-10-08T17:25:27.218026+0000","last_peered":"2023-10-08T17:25:27.218026+0000","last_clean":"2023-10-08T17:25:27.218026+0000","last_became_active":"2023-10-08T17:25:27.215522+0000","last_became_peered":"2023-10-08T17:25:27.215522+0000","last_unstale":"2023-10-08T17:25:27.218026+0000","last_undegraded":"2023-10-08T17:25:27.218026+0000","last_fullsized":"2023-10-08T17:25:27.218026+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:31:36.204275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.237236+0000","last_change":"2023-10-08T17:25:28.237236+0000","last_active":"2023-10-08T17:25:28.237236+0000","last_peered":"2023-10-08T17:25:28.237236+0000","last_clean":"2023-10-08T17:25:28.237236+0000","last_became_active":"2023-10-08T17:25:28.236935+0000","last_became_peered":"2023-10-08T17:25:28.236935+0000","last_unstale":"2023-10-08T17:25:28.237236+0000","last_undegraded":"2023-10-08T17:25:28.237236+0000","last_fullsized":"2023-10-08T17:25:28.237236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:20:40.684892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.213362+0000","last_change":"2023-10-08T17:25:27.210379+0000","last_active":"2023-10-08T17:25:27.213362+0000","last_peered":"2023-10-08T17:25:27.213362+0000","last_clean":"2023-10-08T17:25:27.213362+0000","last_became_active":"2023-10-08T17:25:27.210050+0000","last_became_peered":"2023-10-08T17:25:27.210050+0000","last_unstale":"2023-10-08T17:25:27.213362+0000","last_undegraded":"2023-10-08T17:25:27.213362+0000","last_fullsized":"2023-10-08T17:25:27.213362+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.228359+0000","last_change":"2023-10-08T17:25:28.228359+0000","last_active":"2023-10-08T17:25:28.228359+0000","last_peered":"2023-10-08T17:25:28.228359+0000","last_clean":"2023-10-08T17:25:28.228359+0000","last_became_active":"2023-10-08T17:25:28.228044+0000","last_became_peered":"2023-10-08T17:25:28.228044+0000","last_unstale":"2023-10-08T17:25:28.228359+0000","last_undegraded":"2023-10-08T17:25:28.228359+0000","last_fullsized":"2023-10-08T17:25:28.228359+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:49.388995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.212539+0000","last_change":"2023-10-08T17:25:27.209692+0000","last_active":"2023-10-08T17:25:27.212539+0000","last_peered":"2023-10-08T17:25:27.212539+0000","last_clean":"2023-10-08T17:25:27.212539+0000","last_became_active":"2023-10-08T17:25:27.209392+0000","last_became_peered":"2023-10-08T17:25:27.209392+0000","last_unstale":"2023-10-08T17:25:27.212539+0000","last_undegraded":"2023-10-08T17:25:27.212539+0000","last_fullsized":"2023-10-08T17:25:27.212539+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:02.485611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208581+0000","last_change":"2023-10-08T17:25:28.208581+0000","last_active":"2023-10-08T17:25:28.208581+0000","last_peered":"2023-10-08T17:25:28.208581+0000","last_clean":"2023-10-08T17:25:28.208581+0000","last_became_active":"2023-10-08T17:25:28.208306+0000","last_became_peered":"2023-10-08T17:25:28.208306+0000","last_unstale":"2023-10-08T17:25:28.208581+0000","last_undegraded":"2023-10-08T17:25:28.208581+0000","last_fullsized":"2023-10-08T17:25:28.208581+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:12.683955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.204983+0000","last_change":"2023-10-08T17:25:27.208781+0000","last_active":"2023-10-08T17:25:28.204983+0000","last_peered":"2023-10-08T17:25:28.204983+0000","last_clean":"2023-10-08T17:25:28.204983+0000","last_became_active":"2023-10-08T17:25:27.208510+0000","last_became_peered":"2023-10-08T17:25:27.208510+0000","last_unstale":"2023-10-08T17:25:28.204983+0000","last_undegraded":"2023-10-08T17:25:28.204983+0000","last_fullsized":"2023-10-08T17:25:28.204983+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:24.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229570+0000","last_change":"2023-10-08T17:25:28.227926+0000","last_active":"2023-10-08T17:25:28.229570+0000","last_peered":"2023-10-08T17:25:28.229570+0000","last_clean":"2023-10-08T17:25:28.229570+0000","last_became_active":"2023-10-08T17:25:28.227594+0000","last_became_peered":"2023-10-08T17:25:28.227594+0000","last_unstale":"2023-10-08T17:25:28.229570+0000","last_undegraded":"2023-10-08T17:25:28.229570+0000","last_fullsized":"2023-10-08T17:25:28.229570+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:23.120947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203472+0000","last_change":"2023-10-08T17:25:27.215420+0000","last_active":"2023-10-08T17:25:28.203472+0000","last_peered":"2023-10-08T17:25:28.203472+0000","last_clean":"2023-10-08T17:25:28.203472+0000","last_became_active":"2023-10-08T17:25:27.214741+0000","last_became_peered":"2023-10-08T17:25:27.214741+0000","last_unstale":"2023-10-08T17:25:28.203472+0000","last_undegraded":"2023-10-08T17:25:28.203472+0000","last_fullsized":"2023-10-08T17:25:28.203472+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:03.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.227544+0000","last_change":"2023-10-08T17:25:28.223396+0000","last_active":"2023-10-08T17:25:28.227544+0000","last_peered":"2023-10-08T17:25:28.227544+0000","last_clean":"2023-10-08T17:25:28.227544+0000","last_became_active":"2023-10-08T17:25:28.222932+0000","last_became_peered":"2023-10-08T17:25:28.222932+0000","last_unstale":"2023-10-08T17:25:28.227544+0000","last_undegraded":"2023-10-08T17:25:28.227544+0000","last_fullsized":"2023-10-08T17:25:28.227544+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:20.439301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.220957+0000","last_change":"2023-10-08T17:25:27.220107+0000","last_active":"2023-10-08T17:25:27.220957+0000","last_peered":"2023-10-08T17:25:27.220957+0000","last_clean":"2023-10-08T17:25:27.220957+0000","last_became_active":"2023-10-08T17:25:27.219739+0000","last_became_peered":"2023-10-08T17:25:27.219739+0000","last_unstale":"2023-10-08T17:25:27.220957+0000","last_undegraded":"2023-10-08T17:25:27.220957+0000","last_fullsized":"2023-10-08T17:25:27.220957+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:36.188845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214209+0000","last_change":"2023-10-08T17:25:28.208252+0000","last_active":"2023-10-08T17:25:28.214209+0000","last_peered":"2023-10-08T17:25:28.214209+0000","last_clean":"2023-10-08T17:25:28.214209+0000","last_became_active":"2023-10-08T17:25:28.207937+0000","last_became_peered":"2023-10-08T17:25:28.207937+0000","last_unstale":"2023-10-08T17:25:28.214209+0000","last_undegraded":"2023-10-08T17:25:28.214209+0000","last_fullsized":"2023-10-08T17:25:28.214209+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:32:27.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217857+0000","last_change":"2023-10-08T17:25:27.213149+0000","last_active":"2023-10-08T17:25:27.217857+0000","last_peered":"2023-10-08T17:25:27.217857+0000","last_clean":"2023-10-08T17:25:27.217857+0000","last_became_active":"2023-10-08T17:25:27.212814+0000","last_became_peered":"2023-10-08T17:25:27.212814+0000","last_unstale":"2023-10-08T17:25:27.217857+0000","last_undegraded":"2023-10-08T17:25:27.217857+0000","last_fullsized":"2023-10-08T17:25:27.217857+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:10.194418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.224476+0000","last_change":"2023-10-08T17:25:28.219744+0000","last_active":"2023-10-08T17:25:28.224476+0000","last_peered":"2023-10-08T17:25:28.224476+0000","last_clean":"2023-10-08T17:25:28.224476+0000","last_became_active":"2023-10-08T17:25:28.219438+0000","last_became_peered":"2023-10-08T17:25:28.219438+0000","last_unstale":"2023-10-08T17:25:28.224476+0000","last_undegraded":"2023-10-08T17:25:28.224476+0000","last_fullsized":"2023-10-08T17:25:28.224476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:04.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"180'3","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229735+0000","last_change":"2023-10-08T17:25:27.214108+0000","last_active":"2023-10-08T17:25:28.229735+0000","last_peered":"2023-10-08T17:25:28.229735+0000","last_clean":"2023-10-08T17:25:28.229735+0000","last_became_active":"2023-10-08T17:25:27.213835+0000","last_became_peered":"2023-10-08T17:25:27.213835+0000","last_unstale":"2023-10-08T17:25:28.229735+0000","last_undegraded":"2023-10-08T17:25:28.229735+0000","last_fullsized":"2023-10-08T17:25:28.229735+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"171'293","reported_seq":933,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211283+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:25:28.211283+0000","last_peered":"2023-10-08T17:25:28.211283+0000","last_clean":"2023-10-08T17:25:28.211283+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:25:28.211283+0000","last_undegraded":"2023-10-08T17:25:28.211283+0000","last_fullsized":"2023-10-08T17:25:28.211283+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575752,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312368,"kb_used_data":2792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059472,"statfs":{"total":96636764160,"available":96316899328,"internally_reserved":0,"allocated":2859008,"data_stored":1718696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91500000000000004,"5min":1.024,"15min":1.1100000000000001},"last":0.44},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.73299999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":1.0880000000000001,"15min":1.1379999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.47899999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.628,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.432,"15min":0.36899999999999999},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.38800000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.79100000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.48199999999999998},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.44700000000000001},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575753,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299492,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072348,"statfs":{"total":96636764160,"available":96330084352,"internally_reserved":0,"allocated":2256896,"data_stored":1121098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34399999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.175},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.40400000000000003},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.44900000000000001},"max":{"1min":1.012,"5min":1.0860000000000001,"15min":1.1399999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0109999999999999,"5min":1.073,"15min":1.113},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0589999999999999,"5min":1.069,"15min":1.097},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":0.996,"15min":1.034},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.749,"15min":0.754},"min":{"1min":0.69199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.125},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.505,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.93700000000000006,"5min":1.202,"15min":1.202},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":1.1120000000000001,"15min":1.327},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.442},"max":{"1min":1.03,"5min":1.0469999999999999,"15min":1.1160000000000001},"last":0.93200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2248704,"data_stored":1121506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.69699999999999995,"15min":0.89300000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":0.879,"15min":0.879},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.0660000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.70599999999999996,"5min":0.94999999999999996,"15min":1.038},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.47299999999999998},"max":{"1min":0.79300000000000004,"5min":0.95799999999999996,"15min":1.032},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.625},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.51400000000000001},"max":{"1min":1.0860000000000001,"5min":1.276,"15min":1.276},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.44700000000000001},"max":{"1min":0.998,"5min":1.169,"15min":1.379},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.46200000000000002},"max":{"1min":1.0229999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.56299999999999994},"max":{"1min":1.075,"5min":1.242,"15min":1.242},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.85199999999999998},"min":{"1min":0.627,"5min":0.61799999999999999,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.55300000000000005},"max":{"1min":1.115,"5min":1.1599999999999999,"15min":1.3029999999999999},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88600000000000001,"15min":0.88100000000000001},"min":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.55700000000000005},"max":{"1min":1.0409999999999999,"5min":1.194,"15min":1.4199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88700000000000001,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.127,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575752,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308268,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063572,"statfs":{"total":96636764160,"available":96321097728,"internally_reserved":0,"allocated":2854912,"data_stored":1712890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.80900000000000005},"last":0.378},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69599999999999995,"5min":0.79400000000000004,"15min":0.92200000000000004},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.41199999999999998},"max":{"1min":0.83499999999999996,"5min":0.86799999999999999,"15min":0.93400000000000005},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.1970000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.028,"5min":1.0820000000000001,"15min":1.214},"last":0.88400000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.81999999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0780000000000001,"5min":1.161,"15min":1.3180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.3180000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1120000000000001,"5min":1.1359999999999999,"15min":1.25},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57199999999999995},"max":{"1min":1.087,"5min":1.169,"15min":1.3700000000000001},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.873,"15min":0.872},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.131,"5min":1.181,"15min":1.3520000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57099999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.3480000000000001},"last":0.90400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575753,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2260992,"data_stored":1122558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.42699999999999999},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.93999999999999995},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":3.5619999999999998,"5min":3.5619999999999998,"15min":3.5619999999999998},"last":0.376},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.97499999999999998},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80900000000000005,"15min":0.80200000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.51200000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.52400000000000002},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.85399999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.55700000000000005},"max":{"1min":1.123,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.55600000000000005,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.67800000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51000000000000001},"max":{"1min":1.2430000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.871,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.872,"15min":0.875},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.59799999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575753,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311772,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060068,"statfs":{"total":96636764160,"available":96317509632,"internally_reserved":0,"allocated":2248704,"data_stored":1121042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.378}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71599999999999997,"5min":0.86599999999999999,"15min":0.88400000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70799999999999996,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.96899999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.204},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":1.679,"15min":1.679},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.54600000000000004},"max":{"1min":1.143,"5min":1.893,"15min":1.893},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.498},"max":{"1min":1.0640000000000001,"5min":1.2290000000000001,"15min":1.347},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.218,"5min":1.258,"15min":1.258},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.59199999999999997,"15min":0.52600000000000002},"max":{"1min":1.1619999999999999,"5min":1.859,"15min":1.859},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575753,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307684,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064156,"statfs":{"total":96636764160,"available":96321695744,"internally_reserved":0,"allocated":2256896,"data_stored":1127704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0269999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.44},"max":{"1min":0.97799999999999998,"5min":1.079,"15min":1.1639999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80000000000000004,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.46700000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":0.93400000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.0469999999999999,"15min":1.0880000000000001},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98299999999999998,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":1.115,"15min":1.115},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1000000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.0609999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.99299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":1.1459999999999999,"15min":1.2909999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":1.177,"15min":1.177},"last":0.877},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.44},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2490000000000001},"last":0.79400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575752,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303592,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068248,"statfs":{"total":96636764160,"available":96325885952,"internally_reserved":0,"allocated":2260992,"data_stored":1127726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":0.98099999999999998,"15min":0.997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.39700000000000002},"max":{"1min":0.89300000000000002,"5min":1.0089999999999999,"15min":1.0289999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46400000000000002},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.054},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98099999999999998,"5min":1.073,"15min":1.1020000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79000000000000004,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.45800000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":0.95699999999999996,"15min":1.0089999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.75800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82899999999999996,"5min":0.97499999999999998,"15min":1.0680000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.99399999999999999,"15min":1.056},"last":0.95799999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.02,"5min":1.0269999999999999,"15min":1.107},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70399999999999996},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96799999999999997,"15min":1.0620000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.1100000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.107},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:25:32.601 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:25:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.819+0000 7f46ab59e700 1 Processor -- start 2023-10-08T17:25:32.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.820+0000 7f46ab59e700 1 -- start start 2023-10-08T17:25:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46ab59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac140e40 0x7f46ac0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46ab59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46ac06de50 0x7f46ac0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46ab59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0c6d50 con 0x7f46ac140a70 2023-10-08T17:25:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46ab59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0c7030 con 0x7f46ac06de50 2023-10-08T17:25:32.823 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46ab59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0c7310 con 0x7f46ac140e40 2023-10-08T17:25:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.821+0000 7f46aad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46ac06de50 0x7f46ac0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46a9d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac140e40 0x7f46ac0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f46ac06de50 0x7f46ac0aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:55346/0 (socket says 172.21.15.12:55346) 2023-10-08T17:25:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 -- 172.21.15.12:0/2428699407 learned_addr learned my addr 172.21.15.12:0/2428699407 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:32.825 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aa59c700 1 --1- 172.21.15.12:0/2428699407 >> v1:172.21.15.29:6789/0 conn(0x7f46ac140a70 0x7f46ac0c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40972/0 (socket says 172.21.15.12:40972) 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 -- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac140e40 msgr2=0x7f46ac0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 --2- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac140e40 0x7f46ac0c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 -- 172.21.15.12:0/2428699407 >> v1:172.21.15.29:6789/0 conn(0x7f46ac140a70 legacy=0x7f46ac0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 -- 172.21.15.12:0/2428699407 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0c75f0 con 0x7f46ac06de50 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.822+0000 7f46aad9d700 1 --2- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac06de50 0x7f46ac0aeef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009f20 tx=0x7f46a4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1b32e0e0e6878e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46a959a700 1 -- 172.21.15.12:0/2428699407 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a400e070 con 0x7f46ac06de50 2023-10-08T17:25:32.826 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46a959a700 1 -- 172.21.15.12:0/2428699407 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a400b9d0 con 0x7f46ac06de50 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46a959a700 1 -- 172.21.15.12:0/2428699407 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a40092e0 con 0x7f46ac06de50 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 -- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac06de50 msgr2=0x7f46ac0aeef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 --2- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac06de50 0x7f46ac0aeef0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009f20 tx=0x7f46a4009840 comp rx=0 tx=0).stop 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 -- 172.21.15.12:0/2428699407 shutdown_connections 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 --2- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac06de50 0x7f46ac0aeef0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 --2- 172.21.15.12:0/2428699407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac140e40 0x7f46ac0c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 -- 172.21.15.12:0/2428699407 >> 172.21.15.12:0/2428699407 conn(0x7f46ac06d170 msgr2=0x7f46ac0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:32.827 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 -- 172.21.15.12:0/2428699407 shutdown_connections 2023-10-08T17:25:32.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.823+0000 7f46ab59e700 1 -- 172.21.15.12:0/2428699407 wait complete. 2023-10-08T17:25:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.825+0000 7f46ab59e700 1 Processor -- start 2023-10-08T17:25:32.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.825+0000 7f46ab59e700 1 -- start start 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac06de50 0x7f46ac13dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac140a70 0x7f46ac1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac13e120 con 0x7f46ac140e40 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac158040 con 0x7f46ac140a70 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46ab59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0c4810 con 0x7f46ac06de50 2023-10-08T17:25:32.832 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46aad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46aa59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac06de50 0x7f46ac13dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46aad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47570/0 (socket says 172.21.15.12:47570) 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46aad9d700 1 -- 172.21.15.12:0/3070709414 learned_addr learned my addr 172.21.15.12:0/3070709414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.826+0000 7f46a9d9b700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac140a70 0x7f46ac1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 -- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac06de50 msgr2=0x7f46ac13dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac06de50 0x7f46ac13dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 -- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac140a70 msgr2=0x7f46ac1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:32.833 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac140a70 0x7f46ac1584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 -- 172.21.15.12:0/3070709414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009ae0 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46aad9d700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b610 tx=0x7f46a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4008ad0 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a4008c30 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4026460 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac1579f0 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.827+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac0c4af0 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.828+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac04c3c0 con 0x7f46ac140e40 2023-10-08T17:25:32.834 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.829+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46a4003040 con 0x7f46ac140e40 2023-10-08T17:25:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.831+0000 7f469a7fc700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.831+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f46a4086070 con 0x7f46ac140e40 2023-10-08T17:25:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.831+0000 7f46aa59c700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:32.835 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.832+0000 7f46aa59c700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0ae5f0 tx=0x7f469c007eb0 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:32.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:32.835+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46a4053070 con 0x7f46ac140e40 2023-10-08T17:25:33.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.031+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46ac0c78d0 con 0x7f468c066f30 2023-10-08T17:25:33.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.039+0000 7f469a7fc700 1 -- 172.21.15.12:0/3070709414 <== mgr.9024 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289159 (secure 0 0 0) 0x7f46ac0c78d0 con 0x7f468c066f30 2023-10-08T17:25:33.044 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.043+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 msgr2=0x7f468c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.043+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 0x7f468c0693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0ae5f0 tx=0x7f469c007eb0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.043+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 msgr2=0x7f46ac0c1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.043+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f46a400b610 tx=0x7f46a4018000 comp rx=0 tx=0).stop 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 shutdown_connections 2023-10-08T17:25:33.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f468c066f30 0x7f468c0693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f46ac140e40 0x7f46ac0c1900 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f46ac06de50 0x7f46ac13dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 --2- 172.21.15.12:0/3070709414 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f46ac140a70 0x7f46ac1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 >> 172.21.15.12:0/3070709414 conn(0x7f46ac06d170 msgr2=0x7f46ac0c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 shutdown_connections 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.044+0000 7f46ab59e700 1 -- 172.21.15.12:0/3070709414 wait complete. 2023-10-08T17:25:33.050 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:25:33.062 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T17:25:32.614293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":523,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":331,"ondisk_log_size":331,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2458540,"kb_used_data":18796,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752516180,"statfs":{"total":773094113280,"available":770576568320,"internally_reserved":0,"allocated":19247104,"data_stored":10173220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001159"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.219109+0000","last_change":"2023-10-08T17:25:28.219109+0000","last_active":"2023-10-08T17:25:28.219109+0000","last_peered":"2023-10-08T17:25:28.219109+0000","last_clean":"2023-10-08T17:25:28.219109+0000","last_became_active":"2023-10-08T17:25:28.218845+0000","last_became_peered":"2023-10-08T17:25:28.218845+0000","last_unstale":"2023-10-08T17:25:28.219109+0000","last_undegraded":"2023-10-08T17:25:28.219109+0000","last_fullsized":"2023-10-08T17:25:28.219109+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:48:51.121274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214277+0000","last_change":"2023-10-08T17:25:28.214277+0000","last_active":"2023-10-08T17:25:28.214277+0000","last_peered":"2023-10-08T17:25:28.214277+0000","last_clean":"2023-10-08T17:25:28.214277+0000","last_became_active":"2023-10-08T17:25:28.213992+0000","last_became_peered":"2023-10-08T17:25:28.213992+0000","last_unstale":"2023-10-08T17:25:28.214277+0000","last_undegraded":"2023-10-08T17:25:28.214277+0000","last_fullsized":"2023-10-08T17:25:28.214277+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:04.196918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226237+0000","last_change":"2023-10-08T17:25:28.226237+0000","last_active":"2023-10-08T17:25:28.226237+0000","last_peered":"2023-10-08T17:25:28.226237+0000","last_clean":"2023-10-08T17:25:28.226237+0000","last_became_active":"2023-10-08T17:25:28.225955+0000","last_became_peered":"2023-10-08T17:25:28.225955+0000","last_unstale":"2023-10-08T17:25:28.226237+0000","last_undegraded":"2023-10-08T17:25:28.226237+0000","last_fullsized":"2023-10-08T17:25:28.226237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:04:51.779744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231152+0000","last_change":"2023-10-08T17:25:28.228341+0000","last_active":"2023-10-08T17:25:28.231152+0000","last_peered":"2023-10-08T17:25:28.231152+0000","last_clean":"2023-10-08T17:25:28.231152+0000","last_became_active":"2023-10-08T17:25:28.227243+0000","last_became_peered":"2023-10-08T17:25:28.227243+0000","last_unstale":"2023-10-08T17:25:28.231152+0000","last_undegraded":"2023-10-08T17:25:28.231152+0000","last_fullsized":"2023-10-08T17:25:28.231152+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:08.669676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.222389+0000","last_change":"2023-10-08T17:25:28.219444+0000","last_active":"2023-10-08T17:25:28.222389+0000","last_peered":"2023-10-08T17:25:28.222389+0000","last_clean":"2023-10-08T17:25:28.222389+0000","last_became_active":"2023-10-08T17:25:28.219168+0000","last_became_peered":"2023-10-08T17:25:28.219168+0000","last_unstale":"2023-10-08T17:25:28.222389+0000","last_undegraded":"2023-10-08T17:25:28.222389+0000","last_fullsized":"2023-10-08T17:25:28.222389+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:49.388995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231449+0000","last_change":"2023-10-08T17:25:28.231449+0000","last_active":"2023-10-08T17:25:28.231449+0000","last_peered":"2023-10-08T17:25:28.231449+0000","last_clean":"2023-10-08T17:25:28.231449+0000","last_became_active":"2023-10-08T17:25:28.231121+0000","last_became_peered":"2023-10-08T17:25:28.231121+0000","last_unstale":"2023-10-08T17:25:28.231449+0000","last_undegraded":"2023-10-08T17:25:28.231449+0000","last_fullsized":"2023-10-08T17:25:28.231449+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:18:19.020343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234692+0000","last_change":"2023-10-08T17:25:28.229753+0000","last_active":"2023-10-08T17:25:28.234692+0000","last_peered":"2023-10-08T17:25:28.234692+0000","last_clean":"2023-10-08T17:25:28.234692+0000","last_became_active":"2023-10-08T17:25:28.229466+0000","last_became_peered":"2023-10-08T17:25:28.229466+0000","last_unstale":"2023-10-08T17:25:28.234692+0000","last_undegraded":"2023-10-08T17:25:28.234692+0000","last_fullsized":"2023-10-08T17:25:28.234692+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:27.936402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211553+0000","last_change":"2023-10-08T17:25:28.211553+0000","last_active":"2023-10-08T17:25:28.211553+0000","last_peered":"2023-10-08T17:25:28.211553+0000","last_clean":"2023-10-08T17:25:28.211553+0000","last_became_active":"2023-10-08T17:25:28.211281+0000","last_became_peered":"2023-10-08T17:25:28.211281+0000","last_unstale":"2023-10-08T17:25:28.211553+0000","last_undegraded":"2023-10-08T17:25:28.211553+0000","last_fullsized":"2023-10-08T17:25:28.211553+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:36.322361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216421+0000","last_change":"2023-10-08T17:25:28.216421+0000","last_active":"2023-10-08T17:25:28.216421+0000","last_peered":"2023-10-08T17:25:28.216421+0000","last_clean":"2023-10-08T17:25:28.216421+0000","last_became_active":"2023-10-08T17:25:28.216145+0000","last_became_peered":"2023-10-08T17:25:28.216145+0000","last_unstale":"2023-10-08T17:25:28.216421+0000","last_undegraded":"2023-10-08T17:25:28.216421+0000","last_fullsized":"2023-10-08T17:25:28.216421+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:50:32.366650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236338+0000","last_change":"2023-10-08T17:25:28.232646+0000","last_active":"2023-10-08T17:25:28.236338+0000","last_peered":"2023-10-08T17:25:28.236338+0000","last_clean":"2023-10-08T17:25:28.236338+0000","last_became_active":"2023-10-08T17:25:28.232374+0000","last_became_peered":"2023-10-08T17:25:28.232374+0000","last_unstale":"2023-10-08T17:25:28.236338+0000","last_undegraded":"2023-10-08T17:25:28.236338+0000","last_fullsized":"2023-10-08T17:25:28.236338+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:30:04.196918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216050+0000","last_change":"2023-10-08T17:25:28.216050+0000","last_active":"2023-10-08T17:25:28.216050+0000","last_peered":"2023-10-08T17:25:28.216050+0000","last_clean":"2023-10-08T17:25:28.216050+0000","last_became_active":"2023-10-08T17:25:28.215559+0000","last_became_peered":"2023-10-08T17:25:28.215559+0000","last_unstale":"2023-10-08T17:25:28.216050+0000","last_undegraded":"2023-10-08T17:25:28.216050+0000","last_fullsized":"2023-10-08T17:25:28.216050+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.997038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.220237+0000","last_change":"2023-10-08T17:25:28.217038+0000","last_active":"2023-10-08T17:25:28.220237+0000","last_peered":"2023-10-08T17:25:28.220237+0000","last_clean":"2023-10-08T17:25:28.220237+0000","last_became_active":"2023-10-08T17:25:28.216718+0000","last_became_peered":"2023-10-08T17:25:28.216718+0000","last_unstale":"2023-10-08T17:25:28.220237+0000","last_undegraded":"2023-10-08T17:25:28.220237+0000","last_fullsized":"2023-10-08T17:25:28.220237+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:40.872628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221297+0000","last_change":"2023-10-08T17:25:28.218785+0000","last_active":"2023-10-08T17:25:28.221297+0000","last_peered":"2023-10-08T17:25:28.221297+0000","last_clean":"2023-10-08T17:25:28.221297+0000","last_became_active":"2023-10-08T17:25:28.218471+0000","last_became_peered":"2023-10-08T17:25:28.218471+0000","last_unstale":"2023-10-08T17:25:28.221297+0000","last_undegraded":"2023-10-08T17:25:28.221297+0000","last_fullsized":"2023-10-08T17:25:28.221297+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:55:28.997038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234072+0000","last_change":"2023-10-08T17:25:28.231682+0000","last_active":"2023-10-08T17:25:28.234072+0000","last_peered":"2023-10-08T17:25:28.234072+0000","last_clean":"2023-10-08T17:25:28.234072+0000","last_became_active":"2023-10-08T17:25:28.231358+0000","last_became_peered":"2023-10-08T17:25:28.231358+0000","last_unstale":"2023-10-08T17:25:28.234072+0000","last_undegraded":"2023-10-08T17:25:28.234072+0000","last_fullsized":"2023-10-08T17:25:28.234072+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:29.020119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.218061+0000","last_change":"2023-10-08T17:25:28.216823+0000","last_active":"2023-10-08T17:25:28.218061+0000","last_peered":"2023-10-08T17:25:28.218061+0000","last_clean":"2023-10-08T17:25:28.218061+0000","last_became_active":"2023-10-08T17:25:28.216486+0000","last_became_peered":"2023-10-08T17:25:28.216486+0000","last_unstale":"2023-10-08T17:25:28.218061+0000","last_undegraded":"2023-10-08T17:25:28.218061+0000","last_fullsized":"2023-10-08T17:25:28.218061+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:01.306196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.205524+0000","last_change":"2023-10-08T17:25:28.205524+0000","last_active":"2023-10-08T17:25:28.205524+0000","last_peered":"2023-10-08T17:25:28.205524+0000","last_clean":"2023-10-08T17:25:28.205524+0000","last_became_active":"2023-10-08T17:25:28.205267+0000","last_became_peered":"2023-10-08T17:25:28.205267+0000","last_unstale":"2023-10-08T17:25:28.205524+0000","last_undegraded":"2023-10-08T17:25:28.205524+0000","last_fullsized":"2023-10-08T17:25:28.205524+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:12.685538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.217476+0000","last_change":"2023-10-08T17:25:28.215089+0000","last_active":"2023-10-08T17:25:28.217476+0000","last_peered":"2023-10-08T17:25:28.217476+0000","last_clean":"2023-10-08T17:25:28.217476+0000","last_became_active":"2023-10-08T17:25:28.214776+0000","last_became_peered":"2023-10-08T17:25:28.214776+0000","last_unstale":"2023-10-08T17:25:28.217476+0000","last_undegraded":"2023-10-08T17:25:28.217476+0000","last_fullsized":"2023-10-08T17:25:28.217476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:07:00.828978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229251+0000","last_change":"2023-10-08T17:25:28.229251+0000","last_active":"2023-10-08T17:25:28.229251+0000","last_peered":"2023-10-08T17:25:28.229251+0000","last_clean":"2023-10-08T17:25:28.229251+0000","last_became_active":"2023-10-08T17:25:28.229005+0000","last_became_peered":"2023-10-08T17:25:28.229005+0000","last_unstale":"2023-10-08T17:25:28.229251+0000","last_undegraded":"2023-10-08T17:25:28.229251+0000","last_fullsized":"2023-10-08T17:25:28.229251+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:06:19.136213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208946+0000","last_change":"2023-10-08T17:25:28.208946+0000","last_active":"2023-10-08T17:25:28.208946+0000","last_peered":"2023-10-08T17:25:28.208946+0000","last_clean":"2023-10-08T17:25:28.208946+0000","last_became_active":"2023-10-08T17:25:28.208688+0000","last_became_peered":"2023-10-08T17:25:28.208688+0000","last_unstale":"2023-10-08T17:25:28.208946+0000","last_undegraded":"2023-10-08T17:25:28.208946+0000","last_fullsized":"2023-10-08T17:25:28.208946+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:08:57.941273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212403+0000","last_change":"2023-10-08T17:25:28.212403+0000","last_active":"2023-10-08T17:25:28.212403+0000","last_peered":"2023-10-08T17:25:28.212403+0000","last_clean":"2023-10-08T17:25:28.212403+0000","last_became_active":"2023-10-08T17:25:28.212136+0000","last_became_peered":"2023-10-08T17:25:28.212136+0000","last_unstale":"2023-10-08T17:25:28.212403+0000","last_undegraded":"2023-10-08T17:25:28.212403+0000","last_fullsized":"2023-10-08T17:25:28.212403+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:37.197238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236302+0000","last_change":"2023-10-08T17:25:28.233919+0000","last_active":"2023-10-08T17:25:28.236302+0000","last_peered":"2023-10-08T17:25:28.236302+0000","last_clean":"2023-10-08T17:25:28.236302+0000","last_became_active":"2023-10-08T17:25:28.233606+0000","last_became_peered":"2023-10-08T17:25:28.233606+0000","last_unstale":"2023-10-08T17:25:28.236302+0000","last_undegraded":"2023-10-08T17:25:28.236302+0000","last_fullsized":"2023-10-08T17:25:28.236302+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:35:20.620822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236921+0000","last_change":"2023-10-08T17:25:28.235210+0000","last_active":"2023-10-08T17:25:28.236921+0000","last_peered":"2023-10-08T17:25:28.236921+0000","last_clean":"2023-10-08T17:25:28.236921+0000","last_became_active":"2023-10-08T17:25:28.234873+0000","last_became_peered":"2023-10-08T17:25:28.234873+0000","last_unstale":"2023-10-08T17:25:28.236921+0000","last_undegraded":"2023-10-08T17:25:28.236921+0000","last_fullsized":"2023-10-08T17:25:28.236921+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:57:07.394612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230979+0000","last_change":"2023-10-08T17:25:28.220724+0000","last_active":"2023-10-08T17:25:28.230979+0000","last_peered":"2023-10-08T17:25:28.230979+0000","last_clean":"2023-10-08T17:25:28.230979+0000","last_became_active":"2023-10-08T17:25:28.220417+0000","last_became_peered":"2023-10-08T17:25:28.220417+0000","last_unstale":"2023-10-08T17:25:28.230979+0000","last_undegraded":"2023-10-08T17:25:28.230979+0000","last_fullsized":"2023-10-08T17:25:28.230979+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:39:51.531483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234609+0000","last_change":"2023-10-08T17:25:28.232521+0000","last_active":"2023-10-08T17:25:28.234609+0000","last_peered":"2023-10-08T17:25:28.234609+0000","last_clean":"2023-10-08T17:25:28.234609+0000","last_became_active":"2023-10-08T17:25:28.232229+0000","last_became_peered":"2023-10-08T17:25:28.232229+0000","last_unstale":"2023-10-08T17:25:28.234609+0000","last_undegraded":"2023-10-08T17:25:28.234609+0000","last_fullsized":"2023-10-08T17:25:28.234609+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:37.143323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.210523+0000","last_change":"2023-10-08T17:25:28.210523+0000","last_active":"2023-10-08T17:25:28.210523+0000","last_peered":"2023-10-08T17:25:28.210523+0000","last_clean":"2023-10-08T17:25:28.210523+0000","last_became_active":"2023-10-08T17:25:28.210270+0000","last_became_peered":"2023-10-08T17:25:28.210270+0000","last_unstale":"2023-10-08T17:25:28.210523+0000","last_undegraded":"2023-10-08T17:25:28.210523+0000","last_fullsized":"2023-10-08T17:25:28.210523+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:27:09.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.209391+0000","last_change":"2023-10-08T17:25:28.209391+0000","last_active":"2023-10-08T17:25:28.209391+0000","last_peered":"2023-10-08T17:25:28.209391+0000","last_clean":"2023-10-08T17:25:28.209391+0000","last_became_active":"2023-10-08T17:25:28.209115+0000","last_became_peered":"2023-10-08T17:25:28.209115+0000","last_unstale":"2023-10-08T17:25:28.209391+0000","last_undegraded":"2023-10-08T17:25:28.209391+0000","last_fullsized":"2023-10-08T17:25:28.209391+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:11:53.462320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226717+0000","last_change":"2023-10-08T17:25:28.226717+0000","last_active":"2023-10-08T17:25:28.226717+0000","last_peered":"2023-10-08T17:25:28.226717+0000","last_clean":"2023-10-08T17:25:28.226717+0000","last_became_active":"2023-10-08T17:25:28.226457+0000","last_became_peered":"2023-10-08T17:25:28.226457+0000","last_unstale":"2023-10-08T17:25:28.226717+0000","last_undegraded":"2023-10-08T17:25:28.226717+0000","last_fullsized":"2023-10-08T17:25:28.226717+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:22:54.002512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.235152+0000","last_change":"2023-10-08T17:25:28.230586+0000","last_active":"2023-10-08T17:25:28.235152+0000","last_peered":"2023-10-08T17:25:28.235152+0000","last_clean":"2023-10-08T17:25:28.235152+0000","last_became_active":"2023-10-08T17:25:28.230314+0000","last_became_peered":"2023-10-08T17:25:28.230314+0000","last_unstale":"2023-10-08T17:25:28.235152+0000","last_undegraded":"2023-10-08T17:25:28.235152+0000","last_fullsized":"2023-10-08T17:25:28.235152+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:42.576153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223756+0000","last_change":"2023-10-08T17:25:28.223756+0000","last_active":"2023-10-08T17:25:28.223756+0000","last_peered":"2023-10-08T17:25:28.223756+0000","last_clean":"2023-10-08T17:25:28.223756+0000","last_became_active":"2023-10-08T17:25:28.223474+0000","last_became_peered":"2023-10-08T17:25:28.223474+0000","last_unstale":"2023-10-08T17:25:28.223756+0000","last_undegraded":"2023-10-08T17:25:28.223756+0000","last_fullsized":"2023-10-08T17:25:28.223756+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:11.490767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231077+0000","last_change":"2023-10-08T17:25:28.227311+0000","last_active":"2023-10-08T17:25:28.231077+0000","last_peered":"2023-10-08T17:25:28.231077+0000","last_clean":"2023-10-08T17:25:28.231077+0000","last_became_active":"2023-10-08T17:25:28.223265+0000","last_became_peered":"2023-10-08T17:25:28.223265+0000","last_unstale":"2023-10-08T17:25:28.231077+0000","last_undegraded":"2023-10-08T17:25:28.231077+0000","last_fullsized":"2023-10-08T17:25:28.231077+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:30.554356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231648+0000","last_change":"2023-10-08T17:25:28.231648+0000","last_active":"2023-10-08T17:25:28.231648+0000","last_peered":"2023-10-08T17:25:28.231648+0000","last_clean":"2023-10-08T17:25:28.231648+0000","last_became_active":"2023-10-08T17:25:28.231091+0000","last_became_peered":"2023-10-08T17:25:28.231091+0000","last_unstale":"2023-10-08T17:25:28.231648+0000","last_undegraded":"2023-10-08T17:25:28.231648+0000","last_fullsized":"2023-10-08T17:25:28.231648+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:37:01.306196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208719+0000","last_change":"2023-10-08T17:25:28.208719+0000","last_active":"2023-10-08T17:25:28.208719+0000","last_peered":"2023-10-08T17:25:28.208719+0000","last_clean":"2023-10-08T17:25:28.208719+0000","last_became_active":"2023-10-08T17:25:28.208453+0000","last_became_peered":"2023-10-08T17:25:28.208453+0000","last_unstale":"2023-10-08T17:25:28.208719+0000","last_undegraded":"2023-10-08T17:25:28.208719+0000","last_fullsized":"2023-10-08T17:25:28.208719+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:59:13.466146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.224439+0000","last_change":"2023-10-08T17:25:28.222051+0000","last_active":"2023-10-08T17:25:28.224439+0000","last_peered":"2023-10-08T17:25:28.224439+0000","last_clean":"2023-10-08T17:25:28.224439+0000","last_became_active":"2023-10-08T17:25:28.221771+0000","last_became_peered":"2023-10-08T17:25:28.221771+0000","last_unstale":"2023-10-08T17:25:28.224439+0000","last_undegraded":"2023-10-08T17:25:28.224439+0000","last_fullsized":"2023-10-08T17:25:28.224439+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:59.389388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"180'4","reported_seq":14,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233042+0000","last_change":"2023-10-08T17:25:27.210259+0000","last_active":"2023-10-08T17:25:28.233042+0000","last_peered":"2023-10-08T17:25:28.233042+0000","last_clean":"2023-10-08T17:25:28.233042+0000","last_became_active":"2023-10-08T17:25:27.209979+0000","last_became_peered":"2023-10-08T17:25:27.209979+0000","last_unstale":"2023-10-08T17:25:28.233042+0000","last_undegraded":"2023-10-08T17:25:28.233042+0000","last_fullsized":"2023-10-08T17:25:28.233042+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:05:26.928009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214431+0000","last_change":"2023-10-08T17:25:28.214431+0000","last_active":"2023-10-08T17:25:28.214431+0000","last_peered":"2023-10-08T17:25:28.214431+0000","last_clean":"2023-10-08T17:25:28.214431+0000","last_became_active":"2023-10-08T17:25:28.214159+0000","last_became_peered":"2023-10-08T17:25:28.214159+0000","last_unstale":"2023-10-08T17:25:28.214431+0000","last_undegraded":"2023-10-08T17:25:28.214431+0000","last_fullsized":"2023-10-08T17:25:28.214431+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:20.439301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.206656+0000","last_change":"2023-10-08T17:25:27.215158+0000","last_active":"2023-10-08T17:25:28.206656+0000","last_peered":"2023-10-08T17:25:28.206656+0000","last_clean":"2023-10-08T17:25:28.206656+0000","last_became_active":"2023-10-08T17:25:27.213114+0000","last_became_peered":"2023-10-08T17:25:27.213114+0000","last_unstale":"2023-10-08T17:25:28.206656+0000","last_undegraded":"2023-10-08T17:25:28.206656+0000","last_fullsized":"2023-10-08T17:25:28.206656+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:21:06.042409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212074+0000","last_change":"2023-10-08T17:25:28.212074+0000","last_active":"2023-10-08T17:25:28.212074+0000","last_peered":"2023-10-08T17:25:28.212074+0000","last_clean":"2023-10-08T17:25:28.212074+0000","last_became_active":"2023-10-08T17:25:28.211737+0000","last_became_peered":"2023-10-08T17:25:28.211737+0000","last_unstale":"2023-10-08T17:25:28.212074+0000","last_undegraded":"2023-10-08T17:25:28.212074+0000","last_fullsized":"2023-10-08T17:25:28.212074+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:50.509535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236110+0000","last_change":"2023-10-08T17:25:27.209713+0000","last_active":"2023-10-08T17:25:28.236110+0000","last_peered":"2023-10-08T17:25:28.236110+0000","last_clean":"2023-10-08T17:25:28.236110+0000","last_became_active":"2023-10-08T17:25:27.209431+0000","last_became_peered":"2023-10-08T17:25:27.209431+0000","last_unstale":"2023-10-08T17:25:28.236110+0000","last_undegraded":"2023-10-08T17:25:28.236110+0000","last_fullsized":"2023-10-08T17:25:28.236110+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:20.811467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231555+0000","last_change":"2023-10-08T17:25:28.226144+0000","last_active":"2023-10-08T17:25:28.231555+0000","last_peered":"2023-10-08T17:25:28.231555+0000","last_clean":"2023-10-08T17:25:28.231555+0000","last_became_active":"2023-10-08T17:25:28.225859+0000","last_became_peered":"2023-10-08T17:25:28.225859+0000","last_unstale":"2023-10-08T17:25:28.231555+0000","last_undegraded":"2023-10-08T17:25:28.231555+0000","last_fullsized":"2023-10-08T17:25:28.231555+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:47:18.605617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233194+0000","last_change":"2023-10-08T17:25:27.211817+0000","last_active":"2023-10-08T17:25:28.233194+0000","last_peered":"2023-10-08T17:25:28.233194+0000","last_clean":"2023-10-08T17:25:28.233194+0000","last_became_active":"2023-10-08T17:25:27.211530+0000","last_became_peered":"2023-10-08T17:25:27.211530+0000","last_unstale":"2023-10-08T17:25:28.233194+0000","last_undegraded":"2023-10-08T17:25:28.233194+0000","last_fullsized":"2023-10-08T17:25:28.233194+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:25:04.633973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226081+0000","last_change":"2023-10-08T17:25:28.226081+0000","last_active":"2023-10-08T17:25:28.226081+0000","last_peered":"2023-10-08T17:25:28.226081+0000","last_clean":"2023-10-08T17:25:28.226081+0000","last_became_active":"2023-10-08T17:25:28.225681+0000","last_became_peered":"2023-10-08T17:25:28.225681+0000","last_unstale":"2023-10-08T17:25:28.226081+0000","last_undegraded":"2023-10-08T17:25:28.226081+0000","last_fullsized":"2023-10-08T17:25:28.226081+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:40.872628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.198255+0000","last_change":"2023-10-08T17:25:27.213290+0000","last_active":"2023-10-08T17:25:28.198255+0000","last_peered":"2023-10-08T17:25:28.198255+0000","last_clean":"2023-10-08T17:25:28.198255+0000","last_became_active":"2023-10-08T17:25:27.211901+0000","last_became_peered":"2023-10-08T17:25:27.211901+0000","last_unstale":"2023-10-08T17:25:28.198255+0000","last_undegraded":"2023-10-08T17:25:28.198255+0000","last_fullsized":"2023-10-08T17:25:28.198255+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:14:24.458486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231236+0000","last_change":"2023-10-08T17:25:28.224048+0000","last_active":"2023-10-08T17:25:28.231236+0000","last_peered":"2023-10-08T17:25:28.231236+0000","last_clean":"2023-10-08T17:25:28.231236+0000","last_became_active":"2023-10-08T17:25:28.223777+0000","last_became_peered":"2023-10-08T17:25:28.223777+0000","last_unstale":"2023-10-08T17:25:28.231236+0000","last_undegraded":"2023-10-08T17:25:28.231236+0000","last_fullsized":"2023-10-08T17:25:28.231236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:47.432027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221039+0000","last_change":"2023-10-08T17:25:27.215682+0000","last_active":"2023-10-08T17:25:28.221039+0000","last_peered":"2023-10-08T17:25:28.221039+0000","last_clean":"2023-10-08T17:25:28.221039+0000","last_became_active":"2023-10-08T17:25:27.215384+0000","last_became_peered":"2023-10-08T17:25:27.215384+0000","last_unstale":"2023-10-08T17:25:28.221039+0000","last_undegraded":"2023-10-08T17:25:28.221039+0000","last_fullsized":"2023-10-08T17:25:28.221039+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:02.485611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211769+0000","last_change":"2023-10-08T17:25:28.211769+0000","last_active":"2023-10-08T17:25:28.211769+0000","last_peered":"2023-10-08T17:25:28.211769+0000","last_clean":"2023-10-08T17:25:28.211769+0000","last_became_active":"2023-10-08T17:25:28.211466+0000","last_became_peered":"2023-10-08T17:25:28.211466+0000","last_unstale":"2023-10-08T17:25:28.211769+0000","last_undegraded":"2023-10-08T17:25:28.211769+0000","last_fullsized":"2023-10-08T17:25:28.211769+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:05:56.331719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217201+0000","last_change":"2023-10-08T17:25:27.213910+0000","last_active":"2023-10-08T17:25:27.217201+0000","last_peered":"2023-10-08T17:25:27.217201+0000","last_clean":"2023-10-08T17:25:27.217201+0000","last_became_active":"2023-10-08T17:25:27.213645+0000","last_became_peered":"2023-10-08T17:25:27.213645+0000","last_unstale":"2023-10-08T17:25:27.217201+0000","last_undegraded":"2023-10-08T17:25:27.217201+0000","last_fullsized":"2023-10-08T17:25:27.217201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:03:32.725537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.221255+0000","last_change":"2023-10-08T17:25:28.218608+0000","last_active":"2023-10-08T17:25:28.221255+0000","last_peered":"2023-10-08T17:25:28.221255+0000","last_clean":"2023-10-08T17:25:28.221255+0000","last_became_active":"2023-10-08T17:25:28.217927+0000","last_became_peered":"2023-10-08T17:25:28.217927+0000","last_unstale":"2023-10-08T17:25:28.221255+0000","last_undegraded":"2023-10-08T17:25:28.221255+0000","last_fullsized":"2023-10-08T17:25:28.221255+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:34:07.126156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.200254+0000","last_change":"2023-10-08T17:25:27.208457+0000","last_active":"2023-10-08T17:25:28.200254+0000","last_peered":"2023-10-08T17:25:28.200254+0000","last_clean":"2023-10-08T17:25:28.200254+0000","last_became_active":"2023-10-08T17:25:27.208154+0000","last_became_peered":"2023-10-08T17:25:27.208154+0000","last_unstale":"2023-10-08T17:25:28.200254+0000","last_undegraded":"2023-10-08T17:25:28.200254+0000","last_fullsized":"2023-10-08T17:25:28.200254+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:52:54.804721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216920+0000","last_change":"2023-10-08T17:25:28.213051+0000","last_active":"2023-10-08T17:25:28.216920+0000","last_peered":"2023-10-08T17:25:28.216920+0000","last_clean":"2023-10-08T17:25:28.216920+0000","last_became_active":"2023-10-08T17:25:28.212751+0000","last_became_peered":"2023-10-08T17:25:28.212751+0000","last_unstale":"2023-10-08T17:25:28.216920+0000","last_undegraded":"2023-10-08T17:25:28.216920+0000","last_fullsized":"2023-10-08T17:25:28.216920+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:07.722802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.215502+0000","last_change":"2023-10-08T17:25:27.212319+0000","last_active":"2023-10-08T17:25:27.215502+0000","last_peered":"2023-10-08T17:25:27.215502+0000","last_clean":"2023-10-08T17:25:27.215502+0000","last_became_active":"2023-10-08T17:25:27.212052+0000","last_became_peered":"2023-10-08T17:25:27.212052+0000","last_unstale":"2023-10-08T17:25:27.215502+0000","last_undegraded":"2023-10-08T17:25:27.215502+0000","last_fullsized":"2023-10-08T17:25:27.215502+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:27:02.144216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.217507+0000","last_change":"2023-10-08T17:25:28.215751+0000","last_active":"2023-10-08T17:25:28.217507+0000","last_peered":"2023-10-08T17:25:28.217507+0000","last_clean":"2023-10-08T17:25:28.217507+0000","last_became_active":"2023-10-08T17:25:28.215477+0000","last_became_peered":"2023-10-08T17:25:28.215477+0000","last_unstale":"2023-10-08T17:25:28.217507+0000","last_undegraded":"2023-10-08T17:25:28.217507+0000","last_fullsized":"2023-10-08T17:25:28.217507+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:01:01.488390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.206427+0000","last_change":"2023-10-08T17:25:27.211866+0000","last_active":"2023-10-08T17:25:28.206427+0000","last_peered":"2023-10-08T17:25:28.206427+0000","last_clean":"2023-10-08T17:25:28.206427+0000","last_became_active":"2023-10-08T17:25:27.211479+0000","last_became_peered":"2023-10-08T17:25:27.211479+0000","last_unstale":"2023-10-08T17:25:28.206427+0000","last_undegraded":"2023-10-08T17:25:28.206427+0000","last_fullsized":"2023-10-08T17:25:28.206427+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:44.406589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.212978+0000","last_change":"2023-10-08T17:25:28.212978+0000","last_active":"2023-10-08T17:25:28.212978+0000","last_peered":"2023-10-08T17:25:28.212978+0000","last_clean":"2023-10-08T17:25:28.212978+0000","last_became_active":"2023-10-08T17:25:28.212662+0000","last_became_peered":"2023-10-08T17:25:28.212662+0000","last_unstale":"2023-10-08T17:25:28.212978+0000","last_undegraded":"2023-10-08T17:25:28.212978+0000","last_fullsized":"2023-10-08T17:25:28.212978+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:32.371069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"180'6","reported_seq":16,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.237213+0000","last_change":"2023-10-08T17:25:27.209742+0000","last_active":"2023-10-08T17:25:28.237213+0000","last_peered":"2023-10-08T17:25:28.237213+0000","last_clean":"2023-10-08T17:25:28.237213+0000","last_became_active":"2023-10-08T17:25:27.209480+0000","last_became_peered":"2023-10-08T17:25:27.209480+0000","last_unstale":"2023-10-08T17:25:28.237213+0000","last_undegraded":"2023-10-08T17:25:28.237213+0000","last_fullsized":"2023-10-08T17:25:28.237213+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:38:46.423634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233043+0000","last_change":"2023-10-08T17:25:28.233043+0000","last_active":"2023-10-08T17:25:28.233043+0000","last_peered":"2023-10-08T17:25:28.233043+0000","last_clean":"2023-10-08T17:25:28.233043+0000","last_became_active":"2023-10-08T17:25:28.232747+0000","last_became_peered":"2023-10-08T17:25:28.232747+0000","last_unstale":"2023-10-08T17:25:28.233043+0000","last_undegraded":"2023-10-08T17:25:28.233043+0000","last_fullsized":"2023-10-08T17:25:28.233043+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:24.233983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"180'2","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234659+0000","last_change":"2023-10-08T17:25:27.219868+0000","last_active":"2023-10-08T17:25:28.234659+0000","last_peered":"2023-10-08T17:25:28.234659+0000","last_clean":"2023-10-08T17:25:28.234659+0000","last_became_active":"2023-10-08T17:25:27.219605+0000","last_became_peered":"2023-10-08T17:25:27.219605+0000","last_unstale":"2023-10-08T17:25:28.234659+0000","last_undegraded":"2023-10-08T17:25:28.234659+0000","last_fullsized":"2023-10-08T17:25:28.234659+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:31.362676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214552+0000","last_change":"2023-10-08T17:25:28.214552+0000","last_active":"2023-10-08T17:25:28.214552+0000","last_peered":"2023-10-08T17:25:28.214552+0000","last_clean":"2023-10-08T17:25:28.214552+0000","last_became_active":"2023-10-08T17:25:28.214232+0000","last_became_peered":"2023-10-08T17:25:28.214232+0000","last_unstale":"2023-10-08T17:25:28.214552+0000","last_undegraded":"2023-10-08T17:25:28.214552+0000","last_fullsized":"2023-10-08T17:25:28.214552+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:41:59.389388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.215114+0000","last_change":"2023-10-08T17:25:27.212880+0000","last_active":"2023-10-08T17:25:27.215114+0000","last_peered":"2023-10-08T17:25:27.215114+0000","last_clean":"2023-10-08T17:25:27.215114+0000","last_became_active":"2023-10-08T17:25:27.212526+0000","last_became_peered":"2023-10-08T17:25:27.212526+0000","last_unstale":"2023-10-08T17:25:27.215114+0000","last_undegraded":"2023-10-08T17:25:27.215114+0000","last_fullsized":"2023-10-08T17:25:27.215114+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:28.759762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223828+0000","last_change":"2023-10-08T17:25:28.220817+0000","last_active":"2023-10-08T17:25:28.223828+0000","last_peered":"2023-10-08T17:25:28.223828+0000","last_clean":"2023-10-08T17:25:28.223828+0000","last_became_active":"2023-10-08T17:25:28.220557+0000","last_became_peered":"2023-10-08T17:25:28.220557+0000","last_unstale":"2023-10-08T17:25:28.223828+0000","last_undegraded":"2023-10-08T17:25:28.223828+0000","last_fullsized":"2023-10-08T17:25:28.223828+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:08.281532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217730+0000","last_change":"2023-10-08T17:25:27.213549+0000","last_active":"2023-10-08T17:25:27.217730+0000","last_peered":"2023-10-08T17:25:27.217730+0000","last_clean":"2023-10-08T17:25:27.217730+0000","last_became_active":"2023-10-08T17:25:27.213301+0000","last_became_peered":"2023-10-08T17:25:27.213301+0000","last_unstale":"2023-10-08T17:25:27.217730+0000","last_undegraded":"2023-10-08T17:25:27.217730+0000","last_fullsized":"2023-10-08T17:25:27.217730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:57:02.758238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223311+0000","last_change":"2023-10-08T17:25:28.223311+0000","last_active":"2023-10-08T17:25:28.223311+0000","last_peered":"2023-10-08T17:25:28.223311+0000","last_clean":"2023-10-08T17:25:28.223311+0000","last_became_active":"2023-10-08T17:25:28.223021+0000","last_became_peered":"2023-10-08T17:25:28.223021+0000","last_unstale":"2023-10-08T17:25:28.223311+0000","last_undegraded":"2023-10-08T17:25:28.223311+0000","last_fullsized":"2023-10-08T17:25:28.223311+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:13:39.929672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"180'8","reported_seq":17,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.232019+0000","last_change":"2023-10-08T17:25:27.219958+0000","last_active":"2023-10-08T17:25:28.232019+0000","last_peered":"2023-10-08T17:25:28.232019+0000","last_clean":"2023-10-08T17:25:28.232019+0000","last_became_active":"2023-10-08T17:25:27.219626+0000","last_became_peered":"2023-10-08T17:25:27.219626+0000","last_unstale":"2023-10-08T17:25:28.232019+0000","last_undegraded":"2023-10-08T17:25:28.232019+0000","last_fullsized":"2023-10-08T17:25:28.232019+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:06:46.380579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.223774+0000","last_change":"2023-10-08T17:25:28.220608+0000","last_active":"2023-10-08T17:25:28.223774+0000","last_peered":"2023-10-08T17:25:28.223774+0000","last_clean":"2023-10-08T17:25:28.223774+0000","last_became_active":"2023-10-08T17:25:28.220293+0000","last_became_peered":"2023-10-08T17:25:28.220293+0000","last_unstale":"2023-10-08T17:25:28.223774+0000","last_undegraded":"2023-10-08T17:25:28.223774+0000","last_fullsized":"2023-10-08T17:25:28.223774+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:20:40.684892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"180'1","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.226913+0000","last_change":"2023-10-08T17:25:27.216000+0000","last_active":"2023-10-08T17:25:28.226913+0000","last_peered":"2023-10-08T17:25:28.226913+0000","last_clean":"2023-10-08T17:25:28.226913+0000","last_became_active":"2023-10-08T17:25:27.215740+0000","last_became_peered":"2023-10-08T17:25:27.215740+0000","last_unstale":"2023-10-08T17:25:28.226913+0000","last_undegraded":"2023-10-08T17:25:28.226913+0000","last_fullsized":"2023-10-08T17:25:28.226913+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:17.869170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.216644+0000","last_change":"2023-10-08T17:25:28.216644+0000","last_active":"2023-10-08T17:25:28.216644+0000","last_peered":"2023-10-08T17:25:28.216644+0000","last_clean":"2023-10-08T17:25:28.216644+0000","last_became_active":"2023-10-08T17:25:28.216371+0000","last_became_peered":"2023-10-08T17:25:28.216371+0000","last_unstale":"2023-10-08T17:25:28.216644+0000","last_undegraded":"2023-10-08T17:25:28.216644+0000","last_fullsized":"2023-10-08T17:25:28.216644+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:18:29.768156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"180'2","reported_seq":11,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234593+0000","last_change":"2023-10-08T17:25:27.217839+0000","last_active":"2023-10-08T17:25:28.234593+0000","last_peered":"2023-10-08T17:25:28.234593+0000","last_clean":"2023-10-08T17:25:28.234593+0000","last_became_active":"2023-10-08T17:25:27.217472+0000","last_became_peered":"2023-10-08T17:25:27.217472+0000","last_unstale":"2023-10-08T17:25:28.234593+0000","last_undegraded":"2023-10-08T17:25:28.234593+0000","last_fullsized":"2023-10-08T17:25:28.234593+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:35:04.211399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.232920+0000","last_change":"2023-10-08T17:25:28.232920+0000","last_active":"2023-10-08T17:25:28.232920+0000","last_peered":"2023-10-08T17:25:28.232920+0000","last_clean":"2023-10-08T17:25:28.232920+0000","last_became_active":"2023-10-08T17:25:28.232626+0000","last_became_peered":"2023-10-08T17:25:28.232626+0000","last_unstale":"2023-10-08T17:25:28.232920+0000","last_undegraded":"2023-10-08T17:25:28.232920+0000","last_fullsized":"2023-10-08T17:25:28.232920+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:14:34.080545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"180'1","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.198734+0000","last_change":"2023-10-08T17:25:27.209410+0000","last_active":"2023-10-08T17:25:28.198734+0000","last_peered":"2023-10-08T17:25:28.198734+0000","last_clean":"2023-10-08T17:25:28.198734+0000","last_became_active":"2023-10-08T17:25:27.209126+0000","last_became_peered":"2023-10-08T17:25:27.209126+0000","last_unstale":"2023-10-08T17:25:28.198734+0000","last_undegraded":"2023-10-08T17:25:28.198734+0000","last_fullsized":"2023-10-08T17:25:28.198734+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:10.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.231436+0000","last_change":"2023-10-08T17:25:28.231436+0000","last_active":"2023-10-08T17:25:28.231436+0000","last_peered":"2023-10-08T17:25:28.231436+0000","last_clean":"2023-10-08T17:25:28.231436+0000","last_became_active":"2023-10-08T17:25:28.231049+0000","last_became_peered":"2023-10-08T17:25:28.231049+0000","last_unstale":"2023-10-08T17:25:28.231436+0000","last_undegraded":"2023-10-08T17:25:28.231436+0000","last_fullsized":"2023-10-08T17:25:28.231436+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:33:42.130768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.209665+0000","last_change":"2023-10-08T17:25:27.206913+0000","last_active":"2023-10-08T17:25:27.209665+0000","last_peered":"2023-10-08T17:25:27.209665+0000","last_clean":"2023-10-08T17:25:27.209665+0000","last_became_active":"2023-10-08T17:25:27.206635+0000","last_became_peered":"2023-10-08T17:25:27.206635+0000","last_unstale":"2023-10-08T17:25:27.209665+0000","last_undegraded":"2023-10-08T17:25:27.209665+0000","last_fullsized":"2023-10-08T17:25:27.209665+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:39:43.302090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230884+0000","last_change":"2023-10-08T17:25:28.224344+0000","last_active":"2023-10-08T17:25:28.230884+0000","last_peered":"2023-10-08T17:25:28.230884+0000","last_clean":"2023-10-08T17:25:28.230884+0000","last_became_active":"2023-10-08T17:25:28.213830+0000","last_became_peered":"2023-10-08T17:25:28.213830+0000","last_unstale":"2023-10-08T17:25:28.230884+0000","last_undegraded":"2023-10-08T17:25:28.230884+0000","last_fullsized":"2023-10-08T17:25:28.230884+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:25.087453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.230313+0000","last_change":"2023-10-08T17:25:27.220068+0000","last_active":"2023-10-08T17:25:28.230313+0000","last_peered":"2023-10-08T17:25:28.230313+0000","last_clean":"2023-10-08T17:25:28.230313+0000","last_became_active":"2023-10-08T17:25:27.219687+0000","last_became_peered":"2023-10-08T17:25:27.219687+0000","last_unstale":"2023-10-08T17:25:28.230313+0000","last_undegraded":"2023-10-08T17:25:28.230313+0000","last_fullsized":"2023-10-08T17:25:28.230313+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:48:29.545962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229150+0000","last_change":"2023-10-08T17:25:28.226046+0000","last_active":"2023-10-08T17:25:28.229150+0000","last_peered":"2023-10-08T17:25:28.229150+0000","last_clean":"2023-10-08T17:25:28.229150+0000","last_became_active":"2023-10-08T17:25:28.225681+0000","last_became_peered":"2023-10-08T17:25:28.225681+0000","last_unstale":"2023-10-08T17:25:28.229150+0000","last_undegraded":"2023-10-08T17:25:28.229150+0000","last_fullsized":"2023-10-08T17:25:28.229150+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:49.677059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203341+0000","last_change":"2023-10-08T17:25:27.215617+0000","last_active":"2023-10-08T17:25:28.203341+0000","last_peered":"2023-10-08T17:25:28.203341+0000","last_clean":"2023-10-08T17:25:28.203341+0000","last_became_active":"2023-10-08T17:25:27.215135+0000","last_became_peered":"2023-10-08T17:25:27.215135+0000","last_unstale":"2023-10-08T17:25:28.203341+0000","last_undegraded":"2023-10-08T17:25:28.203341+0000","last_fullsized":"2023-10-08T17:25:28.203341+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:30:48.668666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.228833+0000","last_change":"2023-10-08T17:25:28.211549+0000","last_active":"2023-10-08T17:25:28.228833+0000","last_peered":"2023-10-08T17:25:28.228833+0000","last_clean":"2023-10-08T17:25:28.228833+0000","last_became_active":"2023-10-08T17:25:28.211253+0000","last_became_peered":"2023-10-08T17:25:28.211253+0000","last_unstale":"2023-10-08T17:25:28.228833+0000","last_undegraded":"2023-10-08T17:25:28.228833+0000","last_fullsized":"2023-10-08T17:25:28.228833+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:26:30.781498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203995+0000","last_change":"2023-10-08T17:25:27.212553+0000","last_active":"2023-10-08T17:25:28.203995+0000","last_peered":"2023-10-08T17:25:28.203995+0000","last_clean":"2023-10-08T17:25:28.203995+0000","last_became_active":"2023-10-08T17:25:27.212254+0000","last_became_peered":"2023-10-08T17:25:27.212254+0000","last_unstale":"2023-10-08T17:25:28.203995+0000","last_undegraded":"2023-10-08T17:25:28.203995+0000","last_fullsized":"2023-10-08T17:25:28.203995+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:14.751684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.234709+0000","last_change":"2023-10-08T17:25:28.229829+0000","last_active":"2023-10-08T17:25:28.234709+0000","last_peered":"2023-10-08T17:25:28.234709+0000","last_clean":"2023-10-08T17:25:28.234709+0000","last_became_active":"2023-10-08T17:25:28.229489+0000","last_became_peered":"2023-10-08T17:25:28.229489+0000","last_unstale":"2023-10-08T17:25:28.234709+0000","last_undegraded":"2023-10-08T17:25:28.234709+0000","last_fullsized":"2023-10-08T17:25:28.234709+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:21:15.760077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.218554+0000","last_change":"2023-10-08T17:25:27.216098+0000","last_active":"2023-10-08T17:25:27.218554+0000","last_peered":"2023-10-08T17:25:27.218554+0000","last_clean":"2023-10-08T17:25:27.218554+0000","last_became_active":"2023-10-08T17:25:27.215804+0000","last_became_peered":"2023-10-08T17:25:27.215804+0000","last_unstale":"2023-10-08T17:25:27.218554+0000","last_undegraded":"2023-10-08T17:25:27.218554+0000","last_fullsized":"2023-10-08T17:25:27.218554+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:59:12.457752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.222359+0000","last_change":"2023-10-08T17:25:28.220101+0000","last_active":"2023-10-08T17:25:28.222359+0000","last_peered":"2023-10-08T17:25:28.222359+0000","last_clean":"2023-10-08T17:25:28.222359+0000","last_became_active":"2023-10-08T17:25:28.219835+0000","last_became_peered":"2023-10-08T17:25:28.219835+0000","last_unstale":"2023-10-08T17:25:28.222359+0000","last_undegraded":"2023-10-08T17:25:28.222359+0000","last_fullsized":"2023-10-08T17:25:28.222359+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:55:36.322361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"180'2","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.236518+0000","last_change":"2023-10-08T17:25:27.217045+0000","last_active":"2023-10-08T17:25:28.236518+0000","last_peered":"2023-10-08T17:25:28.236518+0000","last_clean":"2023-10-08T17:25:28.236518+0000","last_became_active":"2023-10-08T17:25:27.216068+0000","last_became_peered":"2023-10-08T17:25:27.216068+0000","last_unstale":"2023-10-08T17:25:28.236518+0000","last_undegraded":"2023-10-08T17:25:28.236518+0000","last_fullsized":"2023-10-08T17:25:28.236518+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:28.471954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.233486+0000","last_change":"2023-10-08T17:25:28.233486+0000","last_active":"2023-10-08T17:25:28.233486+0000","last_peered":"2023-10-08T17:25:28.233486+0000","last_clean":"2023-10-08T17:25:28.233486+0000","last_became_active":"2023-10-08T17:25:28.233220+0000","last_became_peered":"2023-10-08T17:25:28.233220+0000","last_unstale":"2023-10-08T17:25:28.233486+0000","last_undegraded":"2023-10-08T17:25:28.233486+0000","last_fullsized":"2023-10-08T17:25:28.233486+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:48:22.534581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.218026+0000","last_change":"2023-10-08T17:25:27.215774+0000","last_active":"2023-10-08T17:25:27.218026+0000","last_peered":"2023-10-08T17:25:27.218026+0000","last_clean":"2023-10-08T17:25:27.218026+0000","last_became_active":"2023-10-08T17:25:27.215522+0000","last_became_peered":"2023-10-08T17:25:27.215522+0000","last_unstale":"2023-10-08T17:25:27.218026+0000","last_undegraded":"2023-10-08T17:25:27.218026+0000","last_fullsized":"2023-10-08T17:25:27.218026+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:31:36.204275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.237236+0000","last_change":"2023-10-08T17:25:28.237236+0000","last_active":"2023-10-08T17:25:28.237236+0000","last_peered":"2023-10-08T17:25:28.237236+0000","last_clean":"2023-10-08T17:25:28.237236+0000","last_became_active":"2023-10-08T17:25:28.236935+0000","last_became_peered":"2023-10-08T17:25:28.236935+0000","last_unstale":"2023-10-08T17:25:28.237236+0000","last_undegraded":"2023-10-08T17:25:28.237236+0000","last_fullsized":"2023-10-08T17:25:28.237236+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:20:40.684892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.213362+0000","last_change":"2023-10-08T17:25:27.210379+0000","last_active":"2023-10-08T17:25:27.213362+0000","last_peered":"2023-10-08T17:25:27.213362+0000","last_clean":"2023-10-08T17:25:27.213362+0000","last_became_active":"2023-10-08T17:25:27.210050+0000","last_became_peered":"2023-10-08T17:25:27.210050+0000","last_unstale":"2023-10-08T17:25:27.213362+0000","last_undegraded":"2023-10-08T17:25:27.213362+0000","last_fullsized":"2023-10-08T17:25:27.213362+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:59:46.351329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.228359+0000","last_change":"2023-10-08T17:25:28.228359+0000","last_active":"2023-10-08T17:25:28.228359+0000","last_peered":"2023-10-08T17:25:28.228359+0000","last_clean":"2023-10-08T17:25:28.228359+0000","last_became_active":"2023-10-08T17:25:28.228044+0000","last_became_peered":"2023-10-08T17:25:28.228044+0000","last_unstale":"2023-10-08T17:25:28.228359+0000","last_undegraded":"2023-10-08T17:25:28.228359+0000","last_fullsized":"2023-10-08T17:25:28.228359+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:41:49.388995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.212539+0000","last_change":"2023-10-08T17:25:27.209692+0000","last_active":"2023-10-08T17:25:27.212539+0000","last_peered":"2023-10-08T17:25:27.212539+0000","last_clean":"2023-10-08T17:25:27.212539+0000","last_became_active":"2023-10-08T17:25:27.209392+0000","last_became_peered":"2023-10-08T17:25:27.209392+0000","last_unstale":"2023-10-08T17:25:27.212539+0000","last_undegraded":"2023-10-08T17:25:27.212539+0000","last_fullsized":"2023-10-08T17:25:27.212539+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:08:02.485611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":8,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.208581+0000","last_change":"2023-10-08T17:25:28.208581+0000","last_active":"2023-10-08T17:25:28.208581+0000","last_peered":"2023-10-08T17:25:28.208581+0000","last_clean":"2023-10-08T17:25:28.208581+0000","last_became_active":"2023-10-08T17:25:28.208306+0000","last_became_peered":"2023-10-08T17:25:28.208306+0000","last_unstale":"2023-10-08T17:25:28.208581+0000","last_undegraded":"2023-10-08T17:25:28.208581+0000","last_fullsized":"2023-10-08T17:25:28.208581+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:12.683955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.204983+0000","last_change":"2023-10-08T17:25:27.208781+0000","last_active":"2023-10-08T17:25:28.204983+0000","last_peered":"2023-10-08T17:25:28.204983+0000","last_clean":"2023-10-08T17:25:28.204983+0000","last_became_active":"2023-10-08T17:25:27.208510+0000","last_became_peered":"2023-10-08T17:25:27.208510+0000","last_unstale":"2023-10-08T17:25:28.204983+0000","last_undegraded":"2023-10-08T17:25:28.204983+0000","last_fullsized":"2023-10-08T17:25:28.204983+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:06:24.079060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229570+0000","last_change":"2023-10-08T17:25:28.227926+0000","last_active":"2023-10-08T17:25:28.229570+0000","last_peered":"2023-10-08T17:25:28.229570+0000","last_clean":"2023-10-08T17:25:28.229570+0000","last_became_active":"2023-10-08T17:25:28.227594+0000","last_became_peered":"2023-10-08T17:25:28.227594+0000","last_unstale":"2023-10-08T17:25:28.229570+0000","last_undegraded":"2023-10-08T17:25:28.229570+0000","last_fullsized":"2023-10-08T17:25:28.229570+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:23:23.120947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.203472+0000","last_change":"2023-10-08T17:25:27.215420+0000","last_active":"2023-10-08T17:25:28.203472+0000","last_peered":"2023-10-08T17:25:28.203472+0000","last_clean":"2023-10-08T17:25:28.203472+0000","last_became_active":"2023-10-08T17:25:27.214741+0000","last_became_peered":"2023-10-08T17:25:27.214741+0000","last_unstale":"2023-10-08T17:25:28.203472+0000","last_undegraded":"2023-10-08T17:25:28.203472+0000","last_fullsized":"2023-10-08T17:25:28.203472+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:03.171167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.227544+0000","last_change":"2023-10-08T17:25:28.223396+0000","last_active":"2023-10-08T17:25:28.227544+0000","last_peered":"2023-10-08T17:25:28.227544+0000","last_clean":"2023-10-08T17:25:28.227544+0000","last_became_active":"2023-10-08T17:25:28.222932+0000","last_became_peered":"2023-10-08T17:25:28.222932+0000","last_unstale":"2023-10-08T17:25:28.227544+0000","last_undegraded":"2023-10-08T17:25:28.227544+0000","last_fullsized":"2023-10-08T17:25:28.227544+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:07:20.439301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.220957+0000","last_change":"2023-10-08T17:25:27.220107+0000","last_active":"2023-10-08T17:25:27.220957+0000","last_peered":"2023-10-08T17:25:27.220957+0000","last_clean":"2023-10-08T17:25:27.220957+0000","last_became_active":"2023-10-08T17:25:27.219739+0000","last_became_peered":"2023-10-08T17:25:27.219739+0000","last_unstale":"2023-10-08T17:25:27.220957+0000","last_undegraded":"2023-10-08T17:25:27.220957+0000","last_fullsized":"2023-10-08T17:25:27.220957+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:06:36.188845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.214209+0000","last_change":"2023-10-08T17:25:28.208252+0000","last_active":"2023-10-08T17:25:28.214209+0000","last_peered":"2023-10-08T17:25:28.214209+0000","last_clean":"2023-10-08T17:25:28.214209+0000","last_became_active":"2023-10-08T17:25:28.207937+0000","last_became_peered":"2023-10-08T17:25:28.207937+0000","last_unstale":"2023-10-08T17:25:28.214209+0000","last_undegraded":"2023-10-08T17:25:28.214209+0000","last_fullsized":"2023-10-08T17:25:28.214209+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:32:27.184874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":179,"state":"active+clean","last_fresh":"2023-10-08T17:25:27.217857+0000","last_change":"2023-10-08T17:25:27.213149+0000","last_active":"2023-10-08T17:25:27.217857+0000","last_peered":"2023-10-08T17:25:27.217857+0000","last_clean":"2023-10-08T17:25:27.217857+0000","last_became_active":"2023-10-08T17:25:27.212814+0000","last_became_peered":"2023-10-08T17:25:27.212814+0000","last_unstale":"2023-10-08T17:25:27.217857+0000","last_undegraded":"2023-10-08T17:25:27.217857+0000","last_fullsized":"2023-10-08T17:25:27.217857+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:10.194418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.224476+0000","last_change":"2023-10-08T17:25:28.219744+0000","last_active":"2023-10-08T17:25:28.224476+0000","last_peered":"2023-10-08T17:25:28.224476+0000","last_clean":"2023-10-08T17:25:28.224476+0000","last_became_active":"2023-10-08T17:25:28.219438+0000","last_became_peered":"2023-10-08T17:25:28.219438+0000","last_unstale":"2023-10-08T17:25:28.224476+0000","last_undegraded":"2023-10-08T17:25:28.224476+0000","last_fullsized":"2023-10-08T17:25:28.224476+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:27.186436+0000","last_clean_scrub_stamp":"2023-10-08T17:25:27.186436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:52:04.179560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"180'3","reported_seq":12,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.229735+0000","last_change":"2023-10-08T17:25:27.214108+0000","last_active":"2023-10-08T17:25:28.229735+0000","last_peered":"2023-10-08T17:25:28.229735+0000","last_clean":"2023-10-08T17:25:28.229735+0000","last_became_active":"2023-10-08T17:25:27.213835+0000","last_became_peered":"2023-10-08T17:25:27.213835+0000","last_unstale":"2023-10-08T17:25:28.229735+0000","last_undegraded":"2023-10-08T17:25:28.229735+0000","last_fullsized":"2023-10-08T17:25:28.229735+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:25:26.178043+0000","last_clean_scrub_stamp":"2023-10-08T17:25:26.178043+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:11.677144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"171'293","reported_seq":933,"reported_epoch":180,"state":"active+clean","last_fresh":"2023-10-08T17:25:28.211283+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:25:28.211283+0000","last_peered":"2023-10-08T17:25:28.211283+0000","last_clean":"2023-10-08T17:25:28.211283+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:25:28.211283+0000","last_undegraded":"2023-10-08T17:25:28.211283+0000","last_fullsized":"2023-10-08T17:25:28.211283+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":293,"log_dups_size":0,"ondisk_log_size":293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1652,"num_read_kb":3396,"num_write":479,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":293,"ondisk_log_size":293,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575752,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312368,"kb_used_data":2792,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059472,"statfs":{"total":96636764160,"available":96316899328,"internally_reserved":0,"allocated":2859008,"data_stored":1718696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.74099999999999999,"15min":0.748},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91500000000000004,"5min":1.024,"15min":1.1100000000000001},"last":0.44},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.77100000000000002,"15min":0.748},"min":{"1min":0.47599999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":0.73299999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.47699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94599999999999995,"5min":1.0880000000000001,"15min":1.1379999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.66500000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.76,"5min":1.76,"15min":1.76},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.79900000000000004,"15min":0.78900000000000003},"min":{"1min":0.61899999999999999,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.9390000000000001,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":0.61899999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.77900000000000003,"15min":0.77500000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.47899999999999998},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.87,"5min":0.80700000000000005,"15min":0.79800000000000004},"min":{"1min":0.57299999999999995,"5min":0.53500000000000003,"15min":0.49299999999999999},"max":{"1min":2.0569999999999999,"5min":2.0569999999999999,"15min":2.0569999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.628,"15min":0.62},"min":{"1min":0.47899999999999998,"5min":0.432,"15min":0.36899999999999999},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.69899999999999995,"15min":0.66700000000000004},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.38800000000000001},"max":{"1min":3.4700000000000002,"5min":3.4700000000000002,"15min":3.4700000000000002},"last":0.63800000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68600000000000005},"min":{"1min":0.46899999999999997,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.1139999999999999,"5min":2.1139999999999999,"15min":2.1139999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.48999999999999999,"5min":0.443,"15min":0.443},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.80600000000000005,"15min":0.79100000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.48199999999999998},"max":{"1min":2.4820000000000002,"5min":2.4820000000000002,"15min":2.4820000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.79600000000000004,"15min":0.77300000000000002},"min":{"1min":0.48599999999999999,"5min":0.47599999999999998,"15min":0.44700000000000001},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":0.59399999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575753,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299492,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072348,"statfs":{"total":96636764160,"available":96330084352,"internally_reserved":0,"allocated":2256896,"data_stored":1121098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76000000000000001,"15min":0.745},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.34399999999999997},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.175},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76100000000000001,"15min":0.748},"min":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.40400000000000003},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.52000000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.77500000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.47199999999999998,"15min":0.46400000000000002},"max":{"1min":0.97999999999999998,"5min":1.107,"15min":1.107},"last":0.79500000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.44900000000000001},"max":{"1min":1.012,"5min":1.0860000000000001,"15min":1.1399999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.79200000000000004,"15min":0.79700000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.78600000000000003,"15min":0.78500000000000003},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0109999999999999,"5min":1.073,"15min":1.113},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76600000000000001,"15min":0.77900000000000003},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.0589999999999999,"5min":1.069,"15min":1.097},"last":0.81999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.53200000000000003,"5min":0.41799999999999998,"15min":0.41699999999999998},"max":{"1min":0.95299999999999996,"5min":0.996,"15min":1.034},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.749,"15min":0.754},"min":{"1min":0.69199999999999995,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.125},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64300000000000002,"15min":0.64400000000000002},"min":{"1min":0.505,"5min":0.40799999999999997,"15min":0.39800000000000002},"max":{"1min":0.93700000000000006,"5min":1.202,"15min":1.202},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.70599999999999996},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.91700000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:24:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69399999999999995,"15min":0.72499999999999998},"min":{"1min":0.56100000000000005,"5min":0.46200000000000002,"15min":0.40400000000000003},"max":{"1min":0.93999999999999995,"5min":1.1120000000000001,"15min":1.327},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.71999999999999997,"15min":0.72999999999999998},"min":{"1min":0.50900000000000001,"5min":0.46700000000000003,"15min":0.442},"max":{"1min":1.03,"5min":1.0469999999999999,"15min":1.1160000000000001},"last":0.93200000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575752,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303580,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068260,"statfs":{"total":96636764160,"available":96325898240,"internally_reserved":0,"allocated":2248704,"data_stored":1121506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60599999999999998,"5min":0.69699999999999995,"15min":0.89300000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.60899999999999999,"5min":0.879,"15min":0.879},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.746,"5min":0.76800000000000002,"15min":1.0660000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.41399999999999998},"max":{"1min":0.70599999999999996,"5min":0.94999999999999996,"15min":1.038},"last":0.52100000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.51500000000000001,"5min":0.50700000000000001,"15min":0.47299999999999998},"max":{"1min":0.79300000000000004,"5min":0.95799999999999996,"15min":1.032},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.622,"15min":0.625},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78000000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.82699999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.56299999999999994,"15min":0.51400000000000001},"max":{"1min":1.0860000000000001,"5min":1.276,"15min":1.276},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.505,"5min":0.505,"15min":0.44700000000000001},"max":{"1min":0.998,"5min":1.169,"15min":1.379},"last":0.50900000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.46200000000000002},"max":{"1min":1.0229999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83999999999999997,"15min":0.84199999999999997},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.56299999999999994},"max":{"1min":1.075,"5min":1.242,"15min":1.242},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83899999999999997,"15min":0.85199999999999998},"min":{"1min":0.627,"5min":0.61799999999999999,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.86399999999999999,"15min":0.86899999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.55300000000000005},"max":{"1min":1.115,"5min":1.1599999999999999,"15min":1.3029999999999999},"last":0.627}]},{"osd":7,"last update":"Sun Oct 8 17:24:50 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.88600000000000001,"15min":0.88100000000000001},"min":{"1min":0.66100000000000003,"5min":0.65400000000000003,"15min":0.55700000000000005},"max":{"1min":1.0409999999999999,"5min":1.194,"15min":1.4199999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.88700000000000001,"15min":0.89400000000000002},"min":{"1min":0.61199999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.127,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575752,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308268,"kb_used_data":2788,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063572,"statfs":{"total":96636764160,"available":96321097728,"internally_reserved":0,"allocated":2854912,"data_stored":1712890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48699999999999999,"15min":0.49199999999999999},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.66000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.70199999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.378,"5min":0.35999999999999999,"15min":0.34899999999999998},"max":{"1min":0.69399999999999995,"5min":0.77600000000000002,"15min":0.80900000000000005},"last":0.378},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.54400000000000004,"15min":0.53900000000000003},"min":{"1min":0.372,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69599999999999995,"5min":0.79400000000000004,"15min":0.92200000000000004},"last":0.50900000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.41199999999999998},"max":{"1min":0.83499999999999996,"5min":0.86799999999999999,"15min":0.93400000000000005},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79600000000000004,"15min":0.80400000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52800000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.1970000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.81599999999999995,"15min":0.81699999999999995},"min":{"1min":0.56499999999999995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.028,"5min":1.0820000000000001,"15min":1.214},"last":0.88400000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82799999999999996,"15min":0.81999999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0780000000000001,"5min":1.161,"15min":1.3180000000000001},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.82399999999999995,"15min":0.81999999999999995},"min":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.53500000000000003},"max":{"1min":1.25,"5min":1.25,"15min":1.3180000000000001},"last":0.96099999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.84799999999999998,"15min":0.84599999999999997},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.1120000000000001,"5min":1.1359999999999999,"15min":1.25},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.57199999999999995},"max":{"1min":1.087,"5min":1.169,"15min":1.3700000000000001},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:25:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.873,"15min":0.872},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.131,"5min":1.181,"15min":1.3520000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85399999999999998},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.57099999999999995},"max":{"1min":1.278,"5min":1.278,"15min":1.3480000000000001},"last":0.90400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575753,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311784,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060056,"statfs":{"total":96636764160,"available":96317497344,"internally_reserved":0,"allocated":2260992,"data_stored":1122558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.501},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46700000000000003,"5min":0.43099999999999999,"15min":0.42699999999999999},"max":{"1min":0.79200000000000004,"5min":0.81999999999999995,"15min":0.93999999999999995},"last":0.45900000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.41299999999999998,"5min":0.374,"15min":0.35699999999999998},"max":{"1min":3.5619999999999998,"5min":3.5619999999999998,"15min":3.5619999999999998},"last":0.376},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.55800000000000005},"min":{"1min":0.40400000000000003,"5min":0.38800000000000001,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.97499999999999998},"last":0.40699999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67200000000000004,"15min":0.66900000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.48399999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80900000000000005,"15min":0.80200000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.51200000000000001},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.52400000000000002},"max":{"1min":1.617,"5min":1.617,"15min":1.617},"last":0.68999999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.84499999999999997,"15min":0.85399999999999998},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.55700000000000005},"max":{"1min":1.123,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.84999999999999998,"15min":0.84699999999999998},"min":{"1min":0.55600000000000005,"5min":0.53200000000000003,"15min":0.45400000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.67800000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.82699999999999996,"15min":0.81499999999999995},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.51000000000000001},"max":{"1min":1.2430000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.628},{"interface":"front","average":{"1min":0.871,"5min":0.85599999999999998,"15min":0.84799999999999998},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.7809999999999999,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Sun Oct 8 17:24:58 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.872,"15min":0.875},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.89400000000000002,"15min":0.88600000000000001},"min":{"1min":0.63100000000000001,"5min":0.61199999999999999,"15min":0.59799999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575753,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311772,"kb_used_data":2196,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060068,"statfs":{"total":96636764160,"available":96317509632,"internally_reserved":0,"allocated":2248704,"data_stored":1121042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46400000000000002,"15min":0.46999999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.65000000000000002,"5min":0.73299999999999998,"15min":0.82799999999999996},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.52800000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.76100000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.378}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.34699999999999998,"15min":0.34200000000000003},"max":{"1min":0.71599999999999997,"5min":0.86599999999999999,"15min":0.88400000000000001},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.57299999999999995,"15min":0.56799999999999995},"min":{"1min":0.40100000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.70799999999999996,"5min":1.5860000000000001,"15min":1.5860000000000001},"last":0.34799999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.61899999999999999,"15min":0.624},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79400000000000004,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.68300000000000005,"15min":0.68100000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.83299999999999996,"5min":0.95799999999999996,"15min":0.96899999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.749,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.52400000000000002,"15min":0.44800000000000001},"max":{"1min":1.0189999999999999,"5min":1.113,"15min":1.204},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79300000000000004},"min":{"1min":0.58499999999999996,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.087,"5min":1.679,"15min":1.679},"last":0.80500000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.60199999999999998,"5min":0.58699999999999997,"15min":0.54600000000000004},"max":{"1min":1.143,"5min":1.893,"15min":1.893},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.60899999999999999,"5min":0.55300000000000005,"15min":0.54800000000000004},"max":{"1min":1.0469999999999999,"5min":1.7909999999999999,"15min":1.7909999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.498},"max":{"1min":1.0640000000000001,"5min":1.2290000000000001,"15min":1.347},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.86799999999999999,"15min":0.878},"min":{"1min":0.63800000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0700000000000001,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.63200000000000001}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86399999999999999,"15min":0.86799999999999999},"min":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.218,"5min":1.258,"15min":1.258},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.84799999999999998,"15min":0.85599999999999998},"min":{"1min":0.63100000000000001,"5min":0.59199999999999997,"15min":0.52600000000000002},"max":{"1min":1.1619999999999999,"5min":1.859,"15min":1.859},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575753,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307684,"kb_used_data":2204,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064156,"statfs":{"total":96636764160,"available":96321695744,"internally_reserved":0,"allocated":2256896,"data_stored":1127704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.46500000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91900000000000004,"5min":1.0049999999999999,"15min":1.0269999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.75900000000000001,"15min":0.75600000000000001},"min":{"1min":0.58299999999999996,"5min":0.46400000000000002,"15min":0.44},"max":{"1min":0.97799999999999998,"5min":1.079,"15min":1.1639999999999999},"last":0.72399999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.80000000000000004,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.46700000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.60799999999999998,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.77000000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76500000000000001,"15min":0.76700000000000002},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.41199999999999998},"max":{"1min":0.93400000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77700000000000002,"15min":0.77600000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.45300000000000001},"max":{"1min":0.92600000000000005,"5min":1.0469999999999999,"15min":1.0880000000000001},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.82899999999999996,"15min":0.82499999999999996},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.98299999999999998,"5min":1.246,"15min":1.246},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.76900000000000002,"15min":0.75900000000000001},"min":{"1min":0.63200000000000001,"5min":0.56100000000000005,"15min":0.50700000000000001},"max":{"1min":0.94499999999999995,"5min":1.115,"15min":1.115},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64100000000000001,"15min":0.63400000000000001},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88,"5min":1.0089999999999999,"15min":1.1000000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68600000000000005,"15min":0.68899999999999995},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.46300000000000002},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.0609999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63200000000000001,"15min":0.64500000000000002},"min":{"1min":0.48699999999999999,"5min":0.42299999999999999,"15min":0.41999999999999998},"max":{"1min":0.89700000000000002,"5min":0.96699999999999997,"15min":0.99299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.03,"5min":1.1459999999999999,"15min":1.2909999999999999},"last":0.96199999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:24:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.77100000000000002},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.45300000000000001},"max":{"1min":0.97199999999999998,"5min":1.177,"15min":1.177},"last":0.877},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.58299999999999996,"5min":0.501,"15min":0.44},"max":{"1min":0.98599999999999999,"5min":1.2050000000000001,"15min":1.2490000000000001},"last":0.79400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575752,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303592,"kb_used_data":2208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068248,"statfs":{"total":96636764160,"available":96325885952,"internally_reserved":0,"allocated":2260992,"data_stored":1127726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.72199999999999998,"15min":0.73299999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.879,"5min":0.98099999999999998,"15min":0.997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.48799999999999999,"15min":0.39700000000000002},"max":{"1min":0.89300000000000002,"5min":1.0089999999999999,"15min":1.0289999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76800000000000002},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.46400000000000002},"max":{"1min":0.96599999999999997,"5min":1.054,"15min":1.054},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.45400000000000001,"5min":0.442,"15min":0.442},"max":{"1min":0.98099999999999998,"5min":1.073,"15min":1.1020000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.79000000000000004,"15min":0.78100000000000003},"min":{"1min":0.5,"5min":0.5,"15min":0.45800000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73599999999999999,"15min":0.746},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":0.95699999999999996,"15min":1.0089999999999999},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77000000000000002,"15min":0.77600000000000002},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98799999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.499},"max":{"1min":0.98999999999999999,"5min":1.0329999999999999,"15min":1.0700000000000001},"last":0.75800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59899999999999998,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.82899999999999996,"5min":0.97499999999999998,"15min":1.0680000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.65900000000000003},"min":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.99399999999999999,"15min":1.056},"last":0.95799999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.69599999999999995,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.41399999999999998},"max":{"1min":1.02,"5min":1.0269999999999999,"15min":1.107},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.70399999999999996},"min":{"1min":0.45100000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96599999999999997,"5min":0.96799999999999997,"15min":1.0620000000000001},"last":0.89400000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:24:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75600000000000001,"15min":0.74099999999999999},"min":{"1min":0.51600000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0029999999999999,"5min":1.048,"15min":1.1100000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.78700000000000003,"15min":0.77800000000000002},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0249999999999999,"5min":1.077,"15min":1.107},"last":0.85699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:25:33.101 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T17:25:33.101 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T17:25:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.297+0000 7fd47ad9d700 1 Processor -- start 2023-10-08T17:25:33.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.297+0000 7fd47ad9d700 1 -- start start 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47ad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd47413fb20 0x7fd47415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47ad9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47415ae70 con 0x7fd47413fef0 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47ad9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47406af60 con 0x7fd47406aaa0 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47ad9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47406b240 con 0x7fd47413fb20 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47959a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd47413fef0 0x7fd4740c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41634/0 (socket says 172.21.15.12:41634) 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd47959a700 1 -- 172.21.15.12:0/136119898 learned_addr learned my addr 172.21.15.12:0/136119898 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:33.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd479d9b700 1 --2- 172.21.15.12:0/136119898 >> v2:172.21.15.29:3300/0 conn(0x7fd47413fb20 0x7fd47415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952432652 0 0) 0x7fd464001290 con 0x7fd47413fef0 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.299+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd460003570 con 0x7fd47413fef0 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548647819 0 0) 0x7fd47406af60 con 0x7fd47406aaa0 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd464001290 con 0x7fd47406aaa0 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd479d9b700 1 -- 172.21.15.12:0/136119898 >> v1:172.21.15.29:6789/0 conn(0x7fd47406aaa0 legacy=0x7fd4740c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd479d9b700 1 -- 172.21.15.12:0/136119898 >> v1:172.21.15.12:6789/0 conn(0x7fd47413fef0 legacy=0x7fd4740c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd479d9b700 1 -- 172.21.15.12:0/136119898 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47406b520 con 0x7fd47413fb20 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd479d9b700 1 --2- 172.21.15.12:0/136119898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fb20 0x7fd47415a930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd4700098e0 tx=0x7fd4700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=636cc394e58734a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470011630 con 0x7fd47413fb20 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470011790 con 0x7fd47413fb20 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.300+0000 7fd478d99700 1 -- 172.21.15.12:0/136119898 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470011b30 con 0x7fd47413fb20 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 -- 172.21.15.12:0/136119898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fb20 msgr2=0x7fd47415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/136119898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fb20 0x7fd47415a930 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd4700098e0 tx=0x7fd4700091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 -- 172.21.15.12:0/136119898 shutdown_connections 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/136119898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fb20 0x7fd47415a930 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 -- 172.21.15.12:0/136119898 >> 172.21.15.12:0/136119898 conn(0x7fd47406d170 msgr2=0x7fd4740cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 -- 172.21.15.12:0/136119898 shutdown_connections 2023-10-08T17:25:33.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.301+0000 7fd47ad9d700 1 -- 172.21.15.12:0/136119898 wait complete. 2023-10-08T17:25:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.303+0000 7fd47ad9d700 1 Processor -- start 2023-10-08T17:25:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.303+0000 7fd47ad9d700 1 -- start start 2023-10-08T17:25:33.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 0x7fd4741697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 0x7fd47416a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740ae2e0 con 0x7fd47413fb20 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47413bc40 con 0x7fd47413fef0 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47ad9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4740ab740 con 0x7fd47406aaa0 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47586/0 (socket says 172.21.15.12:47586) 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 -- 172.21.15.12:0/1256271842 learned_addr learned my addr 172.21.15.12:0/1256271842 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd479d9b700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 0x7fd4741697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47a59c700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 0x7fd47416a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 -- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 msgr2=0x7fd4741697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 0x7fd4741697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 -- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 msgr2=0x7fd47416a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 0x7fd47416a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47959a700 1 -- 172.21.15.12:0/1256271842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009420 con 0x7fd47413fb20 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd479d9b700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 0x7fd4741697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.304+0000 7fd47a59c700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 0x7fd47416a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:33.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd47959a700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd464001260 tx=0x7fd464007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464007300 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464007460 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd474169dc0 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640057f0 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.305+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47416a380 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.306+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47404c3c0 con 0x7fd47413fb20 2023-10-08T17:25:33.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.307+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd464005c20 con 0x7fd47413fb20 2023-10-08T17:25:33.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.308+0000 7fd469ffb700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.308+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fd464084230 con 0x7fd47413fb20 2023-10-08T17:25:33.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.308+0000 7fd479d9b700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.309+0000 7fd479d9b700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4700093f0 tx=0x7fd470017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.312+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4640512b0 con 0x7fd47413fb20 2023-10-08T17:25:33.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.590+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd47415ae70 con 0x7fd47413fb20 2023-10-08T17:25:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.594+0000 7fd469ffb700 1 -- 172.21.15.12:0/1256271842 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v41) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd47415ae70 con 0x7fd47413fb20 2023-10-08T17:25:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 msgr2=0x7fd4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 0x7fd4580693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4700093f0 tx=0x7fd470017000 comp rx=0 tx=0).stop 2023-10-08T17:25:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 msgr2=0x7fd47413b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7fd464001260 tx=0x7fd464007c80 comp rx=0 tx=0).stop 2023-10-08T17:25:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 shutdown_connections 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fd458066f30 0x7fd4580693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd47413fef0 0x7fd47416a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd47406aaa0 0x7fd4741697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 --2- 172.21.15.12:0/1256271842 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd47413fb20 0x7fd47413b4c0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 >> 172.21.15.12:0/1256271842 conn(0x7fd47406d170 msgr2=0x7fd47413d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 shutdown_connections 2023-10-08T17:25:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.597+0000 7fd47ad9d700 1 -- 172.21.15.12:0/1256271842 wait complete. 2023-10-08T17:25:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T17:25:33.615 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:25:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.801+0000 7f8118d9d700 1 Processor -- start 2023-10-08T17:25:33.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.801+0000 7f8118d9d700 1 -- start start 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8118d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8114142fd0 0x7f81140c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8118d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140ca480 con 0x7f81140c7dc0 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8118d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811415e240 con 0x7f8114142c00 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8118d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811406b350 con 0x7f8114142fd0 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8113fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f81140c7dc0 0x7f811406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41650/0 (socket says 172.21.15.12:41650) 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8113fff700 1 -- 172.21.15.12:0/2587826754 learned_addr learned my addr 172.21.15.12:0/2587826754 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:33.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f8112ffd700 1 --2- 172.21.15.12:0/2587826754 >> v2:172.21.15.29:3300/0 conn(0x7f8114142fd0 0x7f81140c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f81127fc700 1 -- 172.21.15.12:0/2587826754 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704513670 0 0) 0x7f81140ca480 con 0x7f81140c7dc0 2023-10-08T17:25:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.803+0000 7f81127fc700 1 -- 172.21.15.12:0/2587826754 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc003570 con 0x7f81140c7dc0 2023-10-08T17:25:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f8112ffd700 1 -- 172.21.15.12:0/2587826754 >> v1:172.21.15.29:6789/0 conn(0x7f8114142c00 legacy=0x7f811406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f8112ffd700 1 -- 172.21.15.12:0/2587826754 >> v1:172.21.15.12:6789/0 conn(0x7f81140c7dc0 legacy=0x7f811406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f8112ffd700 1 -- 172.21.15.12:0/2587826754 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140c81d0 con 0x7f8114142fd0 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f8112ffd700 1 --2- 172.21.15.12:0/2587826754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f81140c7880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f81080098e0 tx=0x7f81080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b566da42916de5fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f81127fc700 1 -- 172.21.15.12:0/2587826754 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800b640 con 0x7f8114142fd0 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f81127fc700 1 -- 172.21.15.12:0/2587826754 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810800b7a0 con 0x7f8114142fd0 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.804+0000 7f81127fc700 1 -- 172.21.15.12:0/2587826754 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800bb40 con 0x7f8114142fd0 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 -- 172.21.15.12:0/2587826754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 msgr2=0x7f81140c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2587826754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f81140c7880 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f81080098e0 tx=0x7f81080091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 -- 172.21.15.12:0/2587826754 shutdown_connections 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2587826754 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f81140c7880 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 -- 172.21.15.12:0/2587826754 >> 172.21.15.12:0/2587826754 conn(0x7f81140675a0 msgr2=0x7f81140679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:33.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 -- 172.21.15.12:0/2587826754 shutdown_connections 2023-10-08T17:25:33.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.805+0000 7f8118d9d700 1 -- 172.21.15.12:0/2587826754 wait complete. 2023-10-08T17:25:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.806+0000 7f8118d9d700 1 Processor -- start 2023-10-08T17:25:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 -- start start 2023-10-08T17:25:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 0x7f8114140da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f811415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141412e0 con 0x7f8114142c00 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c52c0 con 0x7f8114142fd0 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.807+0000 7f8118d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c6120 con 0x7f81140c7dc0 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47598/0 (socket says 172.21.15.12:47598) 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 -- 172.21.15.12:0/2515003808 learned_addr learned my addr 172.21.15.12:0/2515003808 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8113fff700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f811415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f81137fe700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 0x7f8114140da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 -- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 msgr2=0x7f8114140da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 0x7f8114140da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 -- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 msgr2=0x7f811415aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f811415aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 -- 172.21.15.12:0/2515003808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8108009420 con 0x7f8114142c00 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8113fff700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f811415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f81137fe700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 0x7f8114140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:33.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.808+0000 7f8112ffd700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f81080093f0 tx=0x7f8108017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.809+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810800bb20 con 0x7f8114142c00 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.809+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8108011420 con 0x7f8114142c00 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.809+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81080117e0 con 0x7f8114142c00 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.809+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140c5510 con 0x7f8114142c00 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.809+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140c5ad0 con 0x7f8114142c00 2023-10-08T17:25:33.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.810+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811404c3c0 con 0x7f8114142c00 2023-10-08T17:25:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.811+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8108011bd0 con 0x7f8114142c00 2023-10-08T17:25:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.812+0000 7f80fb7fe700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.812+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8108085ff0 con 0x7f8114142c00 2023-10-08T17:25:33.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.812+0000 7f81137fe700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:33.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.812+0000 7f81137fe700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 0x7f81000693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8104001840 tx=0x7f8104009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:33.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:33.816+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8108053050 con 0x7f8114142c00 2023-10-08T17:25:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.064+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81140c6260 con 0x7f8114142c00 2023-10-08T17:25:34.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.064+0000 7f80fb7fe700 1 -- 172.21.15.12:0/2515003808 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f8108056670 con 0x7f8114142c00 2023-10-08T17:25:34.065 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:25:34.066 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:25:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 msgr2=0x7f81000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 0x7f81000693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8104001840 tx=0x7f8104009040 comp rx=0 tx=0).stop 2023-10-08T17:25:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 msgr2=0x7f81140c65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:34.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f81080093f0 tx=0x7f8108017000 comp rx=0 tx=0).stop 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 shutdown_connections 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8100066f30 0x7f81000693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8114142fd0 0x7f811415aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81140c7dc0 0x7f8114140da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 --2- 172.21.15.12:0/2515003808 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8114142c00 0x7f81140c65b0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 >> 172.21.15.12:0/2515003808 conn(0x7f81140675a0 msgr2=0x7f8114141c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 shutdown_connections 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.067+0000 7f8118d9d700 1 -- 172.21.15.12:0/2515003808 wait complete. 2023-10-08T17:25:34.069 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:25:34.179 INFO:tasks.ceph.mds.d.smithi029.stderr:2023-10-08T17:25:34.179+0000 7f040f3f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:25:34.302 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:34.307 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:25:34.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 83, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T17:25:27.694243+0000', 'modified': '2023-10-08T17:25:31.221969+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9234}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9234': {'gid': 9234, 'name': 'd', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6834/2324207700', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 2324207700}, {'type': 'v1', 'addr': '172.21.15.29:6834', 'nonce': 2324207700}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T17:25:34.487 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T17:25:34.487 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-08T17:25:34.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.675+0000 7f025639d700 1 Processor -- start 2023-10-08T17:25:34.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.676+0000 7f025639d700 1 -- start start 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025639d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0250142c00 0x7f025006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 0x7f025006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025639d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02500ca480 con 0x7f025006bd20 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025639d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025015e240 con 0x7f0250142c00 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025006b350 con 0x7f02500c7f90 2023-10-08T17:25:34.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f025539b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0250142c00 0x7f025006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f0254b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f025006bd20 0x7f02500c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41662/0 (socket says 172.21.15.12:41662) 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.677+0000 7f0254b9a700 1 -- 172.21.15.12:0/3072079252 learned_addr learned my addr 172.21.15.12:0/3072079252 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0255b9c700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 0x7f025006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f025539b700 1 -- 172.21.15.12:0/3072079252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 msgr2=0x7f025006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f025539b700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 0x7f025006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f025539b700 1 -- 172.21.15.12:0/3072079252 >> v1:172.21.15.12:6789/0 conn(0x7f025006bd20 legacy=0x7f02500c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f025539b700 1 -- 172.21.15.12:0/3072079252 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025015df60 con 0x7f0250142c00 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0255b9c700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 0x7f025006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0247fff700 1 -- 172.21.15.12:0/3072079252 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653119362 0 0) 0x7f02500ca480 con 0x7f025006bd20 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f025539b700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0250142c00 0x7f025006b7e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098e0 tx=0x7f024c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fab0e67902e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0247fff700 1 -- 172.21.15.12:0/3072079252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c009e80 con 0x7f0250142c00 2023-10-08T17:25:34.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0247fff700 1 -- 172.21.15.12:0/3072079252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c00b860 con 0x7f0250142c00 2023-10-08T17:25:34.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.678+0000 7f0247fff700 1 -- 172.21.15.12:0/3072079252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c00bbe0 con 0x7f0250142c00 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 -- 172.21.15.12:0/3072079252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0250142c00 msgr2=0x7f025006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0250142c00 0x7f025006b7e0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f024c0098e0 tx=0x7f024c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 -- 172.21.15.12:0/3072079252 shutdown_connections 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f02500c7f90 0x7f025006c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 --2- 172.21.15.12:0/3072079252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0250142c00 0x7f025006b7e0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 -- 172.21.15.12:0/3072079252 >> 172.21.15.12:0/3072079252 conn(0x7f02500675a0 msgr2=0x7f02500679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 -- 172.21.15.12:0/3072079252 shutdown_connections 2023-10-08T17:25:34.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.679+0000 7f025639d700 1 -- 172.21.15.12:0/3072079252 wait complete. 2023-10-08T17:25:34.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.680+0000 7f025639d700 1 Processor -- start 2023-10-08T17:25:34.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.681+0000 7f025639d700 1 -- start start 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.681+0000 7f025639d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 0x7f0250139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025639d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025639d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0250142c00 0x7f025015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025639d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500b0440 con 0x7f02500c7f90 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025639d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02500b0620 con 0x7f025006bd20 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025639d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02500b0900 con 0x7f0250142c00 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47606/0 (socket says 172.21.15.12:47606) 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 -- 172.21.15.12:0/988021693 learned_addr learned my addr 172.21.15.12:0/988021693 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:34.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025539b700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 0x7f0250139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0255b9c700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0250142c00 0x7f025015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 -- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0250142c00 msgr2=0x7f025015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:35.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0250142c00 0x7f025015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 -- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 msgr2=0x7f0250139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 0x7f0250139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f0254b9a700 1 -- 172.21.15.12:0/988021693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009420 con 0x7f02500c7f90 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.682+0000 7f025539b700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 0x7f0250139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f0254b9a700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f024000c810 tx=0x7f0240007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f02457fa700 1 -- 172.21.15.12:0/988021693 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240005c00 con 0x7f02500c7f90 2023-10-08T17:25:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f02457fa700 1 -- 172.21.15.12:0/988021693 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0240005d60 con 0x7f02500c7f90 2023-10-08T17:25:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02500b0be0 con 0x7f02500c7f90 2023-10-08T17:25:35.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f02457fa700 1 -- 172.21.15.12:0/988021693 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240007320 con 0x7f02500c7f90 2023-10-08T17:25:35.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.683+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02500b11a0 con 0x7f02500c7f90 2023-10-08T17:25:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.685+0000 7f02457fa700 1 -- 172.21.15.12:0/988021693 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f024001b400 con 0x7f02500c7f90 2023-10-08T17:25:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.686+0000 7f02457fa700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 0x7f02340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.686+0000 7f02457fa700 1 -- 172.21.15.12:0/988021693 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0240084260 con 0x7f02500c7f90 2023-10-08T17:25:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.686+0000 7f025539b700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 0x7f02340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.687+0000 7f025539b700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 0x7f02340693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f024c0091e0 tx=0x7f024c017000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.688+0000 7f0265cd2b80 1 Processor -- start 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.688+0000 7f0265cd2b80 1 -- start start 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 0x56136a468850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a41dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a374a70 con 0x56136a468480 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a372270 con 0x56136a41b5f0 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x56136a36e060 con 0x56136a41db80 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47622/0 (socket says 172.21.15.12:47622) 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 -- 172.21.15.12:0/1408448409 learned_addr learned my addr 172.21.15.12:0/1408448409 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0254b9a700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 0x56136a468850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0255b9c700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a41dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 -- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 msgr2=0x56136a41dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a41dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 -- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 msgr2=0x56136a468850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 0x56136a468850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f025539b700 1 -- 172.21.15.12:0/1408448409 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56136a208270 con 0x56136a468480 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.689+0000 7f0254b9a700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 0x56136a468850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f025539b700 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f024c00bbf0 tx=0x7f024c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689f171626cea1eb server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f023a7fc700 1 -- 172.21.15.12:0/1408448409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c020070 con 0x56136a468480 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f023a7fc700 1 -- 172.21.15.12:0/1408448409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c032480 con 0x56136a468480 2023-10-08T17:25:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f023a7fc700 1 -- 172.21.15.12:0/1408448409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c032630 con 0x56136a468480 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1408448409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 msgr2=0x56136a4477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.690+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f024c00bbf0 tx=0x7f024c020000 comp rx=0 tx=0).stop 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1408448409 shutdown_connections 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a468480 0x56136a4477d0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a41dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1408448409 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a41b5f0 0x56136a468850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1408448409 >> 172.21.15.12:0/1408448409 conn(0x56136a41f0c0 msgr2=0x56136a41f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1408448409 shutdown_connections 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1408448409 wait complete. 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.691+0000 7f0265cd2b80 1 -- start start 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.692+0000 7f0265cd2b80 1 Processor -- start 2023-10-08T17:25:35.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a465330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a465870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a319890 con 0x56136a41b5f0 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a334ea0 con 0x56136a468480 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x56136a1f0e30 con 0x56136a41db80 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0265cd2b80 10 client.0 _ll_register_callbacks cb 0x56136a3e12c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47630/0 (socket says 172.21.15.12:47630) 2023-10-08T17:25:36.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 -- 172.21.15.12:0/1311491823 learned_addr learned my addr 172.21.15.12:0/1311491823 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0254b9a700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a465330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f0255b9c700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a465870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 -- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 msgr2=0x56136a465330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a465330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 -- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 msgr2=0x56136a465870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a465870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.693+0000 7f025539b700 1 -- 172.21.15.12:0/1311491823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025015df60 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f025539b700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f024c000e50 tx=0x7f024c02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50995f1b4801e9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f022f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c020050 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f024c038070 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56136a412cd0 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f024c0325f0 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f0265cd2b80 10 client.9372 fetch_fsmap learned FSMap version 83 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.694+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x56136a1aafe0 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56136a412cd0 con 0x56136a41b5f0 2023-10-08T17:25:36.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f024c029d20 con 0x56136a41b5f0 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 10 client.9372 fetch_fsmap finished waiting for FSMap version 83 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 10 client.9372 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 20 client.9372 populate_metadata read hostname 'smithi012' 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a467d40 0x56136a44ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 4 client.9372 mds_command: new command op to 9234 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 --> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56136a3efaa0 con 0x56136a467d40 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.695+0000 7f0254b9a700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a467d40 0x56136a44ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.696+0000 7f0254b9a700 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a467d40 0x56136a44ca30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abcf6c4d4e6372ae server_cookie=1c0f9d751a1702e7 in_seq=0 out_seq=0 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.696+0000 7f022f7fe700 10 client.9372 ms_handle_connect on v2:172.21.15.29:6832/2324207700 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f022f7fe700 1 -- 172.21.15.12:0/1311491823 <== mds.0 v2:172.21.15.29:6832/2324207700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56136a3efaa0 con 0x56136a467d40 2023-10-08T17:25:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f022f7fe700 10 client.9372 handle_command_reply: tid=0 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 client.9372 shutdown 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 msgr2=0x56136a440560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f024c000e50 tx=0x7f024c02b040 comp rx=0 tx=0).stop 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 shutdown_connections 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a440560 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a467d40 0x56136a44ca30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a465870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/1311491823 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a465330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f022f7fe700 0 client.9372 ms_handle_reset on v2:172.21.15.29:6832/2324207700 2023-10-08T17:25:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 >> 172.21.15.12:0/1311491823 conn(0x56136a41f0c0 msgr2=0x56136a41f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 shutdown_connections 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 1 -- 172.21.15.12:0/1311491823 wait complete. 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.697+0000 7f0265cd2b80 20 client.9372 trim_cache size 0 max 16384 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.715+0000 7f0265cd2b80 1 Processor -- start 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.715+0000 7f0265cd2b80 1 -- start start 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.715+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a4637a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a463ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a44abb0 con 0x56136a41b5f0 2023-10-08T17:25:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a4648a0 con 0x56136a468480 2023-10-08T17:25:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x56136a466c40 con 0x56136a41db80 2023-10-08T17:25:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47646/0 (socket says 172.21.15.12:47646) 2023-10-08T17:25:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 -- 172.21.15.12:0/2067717195 learned_addr learned my addr 172.21.15.12:0/2067717195 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0255b9c700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a463ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0254b9a700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a4637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 -- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 msgr2=0x56136a4637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a4637a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 -- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 msgr2=0x56136a463ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a463ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 -- 172.21.15.12:0/2067717195 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56136a44ad40 con 0x56136a41b5f0 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f0254b9a700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a4637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.716+0000 7f025539b700 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b0b0 tx=0x7f024c034070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19284bcd64706d5c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f023affd700 1 -- 172.21.15.12:0/2067717195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c020030 con 0x56136a41b5f0 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f023affd700 1 -- 172.21.15.12:0/2067717195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c036070 con 0x56136a41b5f0 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f023affd700 1 -- 172.21.15.12:0/2067717195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0325f0 con 0x56136a41b5f0 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 -- 172.21.15.12:0/2067717195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 msgr2=0x56136a467330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f024c00b0b0 tx=0x7f024c034070 comp rx=0 tx=0).stop 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 -- 172.21.15.12:0/2067717195 shutdown_connections 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a467330 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a463ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/2067717195 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a4637a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 -- 172.21.15.12:0/2067717195 >> 172.21.15.12:0/2067717195 conn(0x56136a41f0c0 msgr2=0x56136a4769f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 -- 172.21.15.12:0/2067717195 shutdown_connections 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.717+0000 7f0265cd2b80 1 -- 172.21.15.12:0/2067717195 wait complete. 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.718+0000 7f0265cd2b80 1 -- start start 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.718+0000 7f0265cd2b80 1 Processor -- start 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a446450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a446990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a463150 con 0x56136a41b5f0 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x56136a446ed0 con 0x56136a468480 2023-10-08T17:25:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x56136a44d580 con 0x56136a41db80 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f0265cd2b80 10 client.0 _ll_register_callbacks cb 0x56136a3e12c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f025539b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47650/0 (socket says 172.21.15.12:47650) 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.719+0000 7f025539b700 1 -- 172.21.15.12:0/4521567 learned_addr learned my addr 172.21.15.12:0/4521567 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f0254b9a700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a446450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f0255b9c700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a446990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 -- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 msgr2=0x56136a446450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a446450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 -- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 msgr2=0x56136a446990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a446990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 -- 172.21.15.12:0/4521567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56136a1aafe0 con 0x56136a41b5f0 2023-10-08T17:25:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f0254b9a700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a446450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f025539b700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f024c00bbf0 tx=0x7f024c027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5ece641707306f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f022f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c020040 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f024c038050 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.720+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0250141f50 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f024c03d480 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 10 client.9378 fetch_fsmap learned FSMap version 83 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=2+}) v3 -- 0x56136a33c780 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0250141f50 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 83) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f024c029d20 con 0x56136a41b5f0 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 10 client.9378 fetch_fsmap finished waiting for FSMap version 83 2023-10-08T17:25:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 10 client.9378 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 20 client.9378 populate_metadata read hostname 'smithi012' 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a4c9d50 0x56136a4ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 4 client.9378 mds_command: new command op to 9234 tid=0[{"prefix": "status"}] 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.721+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 --> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f024c032480 con 0x56136a4c9d50 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.722+0000 7f0254b9a700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a4c9d50 0x56136a4ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.722+0000 7f0254b9a700 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a4c9d50 0x56136a4ca120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf52586f1111c23c server_cookie=6f2442db2eb31e8d in_seq=0 out_seq=0 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.722+0000 7f022f7fe700 10 client.9378 ms_handle_connect on v2:172.21.15.29:6832/2324207700 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.722+0000 7f022f7fe700 1 -- 172.21.15.12:0/4521567 <== mds.0 v2:172.21.15.29:6832/2324207700 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7f024c032480 con 0x56136a4c9d50 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.722+0000 7f022f7fe700 10 client.9378 handle_command_reply: tid=0 2023-10-08T17:25:36.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 client.9378 shutdown 2023-10-08T17:25:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 msgr2=0x56136a4c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f024c00bbf0 tx=0x7f024c027000 comp rx=0 tx=0).stop 2023-10-08T17:25:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 shutdown_connections 2023-10-08T17:25:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x56136a41b5f0 0x56136a4c3b60 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:6832/2324207700,v1:172.21.15.29:6834/2324207700] conn(0x56136a4c9d50 0x56136a4ca120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x56136a468480 0x56136a446990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 --2- 172.21.15.12:0/4521567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x56136a41db80 0x56136a446450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 >> 172.21.15.12:0/4521567 conn(0x56136a41f0c0 msgr2=0x56136a475580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f022f7fe700 0 client.9378 ms_handle_reset on v2:172.21.15.29:6832/2324207700 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 shutdown_connections 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 1 -- 172.21.15.12:0/4521567 wait complete. 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f0265cd2b80 20 client.9378 trim_cache size 0 max 16384 2023-10-08T17:25:36.105 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 9234, 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.5278831369999999, 2023-10-08T17:25:36.106 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 83, 2023-10-08T17:25:36.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 181, 2023-10-08T17:25:36.107 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 181, 2023-10-08T17:25:36.107 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.24742212 2023-10-08T17:25:36.107 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:25:36.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 msgr2=0x7f02340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.723+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 0x7f02340693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f024c0091e0 tx=0x7f024c017000 comp rx=0 tx=0).stop 2023-10-08T17:25:36.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 msgr2=0x7f0250139eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f024000c810 tx=0x7f0240007db0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 shutdown_connections 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0234066f30 0x7f02340693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0250142c00 0x7f025015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025006bd20 0x7f0250139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 --2- 172.21.15.12:0/988021693 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f02500c7f90 0x7f0250139eb0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 >> 172.21.15.12:0/988021693 conn(0x7f02500675a0 msgr2=0x7f02501406d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 shutdown_connections 2023-10-08T17:25:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:34.724+0000 7f025639d700 1 -- 172.21.15.12:0/988021693 wait complete. 2023-10-08T17:25:36.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T17:25:36.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.313+0000 7f896759d700 1 Processor -- start 2023-10-08T17:25:36.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.313+0000 7f896759d700 1 -- start start 2023-10-08T17:25:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.314+0000 7f896759d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f89600accb0 0x7f89600aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.314+0000 7f896759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f896006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.314+0000 7f896759d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89600ad780 con 0x7f89600cbea0 2023-10-08T17:25:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.314+0000 7f896759d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89600cee60 con 0x7f89600accb0 2023-10-08T17:25:36.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.314+0000 7f896759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600cf140 con 0x7f89600cc340 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8965d9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f89600cbea0 0x7f896006e330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41666/0 (socket says 172.21.15.12:41666) 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8965d9a700 1 -- 172.21.15.12:0/956351300 learned_addr learned my addr 172.21.15.12:0/956351300 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f896659b700 1 --2- 172.21.15.12:0/956351300 >> v2:172.21.15.29:3300/0 conn(0x7f89600accb0 0x7f89600aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8966d9c700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f896006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393776706 0 0) 0x7f89600ad780 con 0x7f89600cbea0 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f894c003570 con 0x7f89600cbea0 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1277427686 0 0) 0x7f894c003570 con 0x7f89600cbea0 2023-10-08T17:25:36.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f896659b700 1 -- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 msgr2=0x7f896006ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f896659b700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f896006ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f896659b700 1 -- 172.21.15.12:0/956351300 >> v1:172.21.15.12:6789/0 conn(0x7f89600cbea0 legacy=0x7f896006e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.315+0000 7f896659b700 1 -- 172.21.15.12:0/956351300 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896006d850 con 0x7f89600accb0 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f896659b700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f89600aaed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f895c0098e0 tx=0x7f895c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b5775fba8a86c8b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950001470 con 0x7f89600accb0 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c011420 con 0x7f89600accb0 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f8965599700 1 -- 172.21.15.12:0/956351300 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c0117c0 con 0x7f89600accb0 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f896759d700 1 -- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 msgr2=0x7f89600aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.316+0000 7f896759d700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f89600aaed0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f895c0098e0 tx=0x7f895c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 -- 172.21.15.12:0/956351300 shutdown_connections 2023-10-08T17:25:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f896006ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 --2- 172.21.15.12:0/956351300 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f89600aaed0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 -- 172.21.15.12:0/956351300 >> 172.21.15.12:0/956351300 conn(0x7f896006ce80 msgr2=0x7f89600ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 -- 172.21.15.12:0/956351300 shutdown_connections 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.317+0000 7f896759d700 1 -- 172.21.15.12:0/956351300 wait complete. 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.318+0000 7f896759d700 1 Processor -- start 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.318+0000 7f896759d700 1 -- start start 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f896016ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f89600af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89600ae9d0 con 0x7f89600cbea0 2023-10-08T17:25:36.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f896016b150 con 0x7f89600accb0 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.319+0000 7f896759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89600c3740 con 0x7f89600cc340 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47658/0 (socket says 172.21.15.12:47658) 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 -- 172.21.15.12:0/3217435082 learned_addr learned my addr 172.21.15.12:0/3217435082 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f896659b700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f896016ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8966d9c700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f89600af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 -- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 msgr2=0x7f89600af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f89600af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 -- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 msgr2=0x7f896016ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f896016ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 -- 172.21.15.12:0/3217435082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009420 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.320+0000 7f8965d9a700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f895000cb90 tx=0x7f8950001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.321+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950001d40 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.321+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950007360 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.321+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950004830 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.321+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89600af530 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.321+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89600aec80 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.322+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89600af6c0 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.323+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8950004ba0 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.324+0000 7f89567fc700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 0x7f89440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.324+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f8950083eb0 con 0x7f89600cbea0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.324+0000 7f896659b700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 0x7f89440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:36.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.325+0000 7f896659b700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 0x7f89440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f895c0030c0 tx=0x7f895c016000 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:36.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.328+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8950050fd0 con 0x7f89600cbea0 2023-10-08T17:25:36.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.575+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f896006db30 con 0x7f89600cbea0 2023-10-08T17:25:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.576+0000 7f89567fc700 1 -- 172.21.15.12:0/3217435082 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v83) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8950018020 con 0x7f89600cbea0 2023-10-08T17:25:36.577 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 msgr2=0x7f89440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 0x7f89440693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f895c0030c0 tx=0x7f895c016000 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 msgr2=0x7f89600c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f895000cb90 tx=0x7f8950001ab0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 shutdown_connections 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f8944066f30 0x7f89440693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89600cc340 0x7f89600af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89600accb0 0x7f896016ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 --2- 172.21.15.12:0/3217435082 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89600cbea0 0x7f89600c2cc0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 >> 172.21.15.12:0/3217435082 conn(0x7f896006ce80 msgr2=0x7f89601593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 shutdown_connections 2023-10-08T17:25:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:36.578+0000 7f896759d700 1 -- 172.21.15.12:0/3217435082 wait complete. 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T17:25:36.597 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T17:25:36.598 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T17:25:36.598 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T17:25:36.598 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:25:36.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:36.598 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T17:25:36.636 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T17:25:36.636 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:25:36.637 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T17:25:36.638 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 37605sec preferred_lft 37605sec 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T17:25:36.639 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.640 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:25:36.641 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T17:25:36.641 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T17:25:36.641 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:25:36.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:36.641 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T17:25:36.737 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T17:25:36.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:36.741 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T17:25:36.779 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T17:25:36.779 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T17:25:36.780 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T17:25:36.780 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T17:25:36.780 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T17:25:36.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T17:25:36.781 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T17:25:36.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:36.980 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:25:37.017 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T17:25:37.018 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T17:25:37.018 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:25:37.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:37.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T17:25:37.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:25:37.121 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T17:25:37.157 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:25:37.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:25:37.158 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:25:37.234 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T17:25:37.234 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T17:25:37.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:25:37.366 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:25:37.366 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:25:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:25:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:25:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T17:25:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T17:25:37.395 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T17:25:37.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T17:25:37.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:25:37.399 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:25:37.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T17:25:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.649+0000 7fe637fff700 1 Processor -- start 2023-10-08T17:25:37.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.649+0000 7fe637fff700 1 -- start start 2023-10-08T17:25:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe637fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe638164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe637fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63815afd0 con 0x7fe638153c30 2023-10-08T17:25:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe637fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63815b2b0 con 0x7fe63815de50 2023-10-08T17:25:37.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe637fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63815b590 con 0x7fe6380cf110 2023-10-08T17:25:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe636ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe638153c30 0x7fe63815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41680/0 (socket says 172.21.15.12:41680) 2023-10-08T17:25:37.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.650+0000 7fe636ffd700 1 -- 172.21.15.12:0/1924528612 learned_addr learned my addr 172.21.15.12:0/1924528612 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe6377fe700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe638164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400350800 0 0) 0x7fe63815afd0 con 0x7fe638153c30 2023-10-08T17:25:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe620003570 con 0x7fe638153c30 2023-10-08T17:25:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813098223 0 0) 0x7fe63815b2b0 con 0x7fe63815de50 2023-10-08T17:25:37.657 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe63815afd0 con 0x7fe63815de50 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494890765 0 0) 0x7fe620003570 con 0x7fe638153c30 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 msgr2=0x7fe638164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe638164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 >> v1:172.21.15.29:6789/0 conn(0x7fe63815de50 legacy=0x7fe6380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63815b870 con 0x7fe638153c30 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fe628001470 con 0x7fe638153c30 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 >> v1:172.21.15.12:6789/0 conn(0x7fe638153c30 legacy=0x7fe63815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe620003c20 0x7fe620004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe620004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620004d50 0x7fe6200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63815b590 con 0x7fe620004d50 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bb70 con 0x7fe620003c20 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.651+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe62000bd30 con 0x7fe6380cf110 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620004d50 0x7fe6200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe636ffd700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe620003c20 0x7fe620004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6367fc700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe620004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 -- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 msgr2=0x7fe620004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe620004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 -- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe620003c20 msgr2=0x7fe620004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe620003c20 0x7fe620004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 -- 172.21.15.12:0/1924528612 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe620003570 con 0x7fe620004d50 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6367fc700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6380cf110 0x7fe620004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe6377fe700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620004d50 0x7fe6200051c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe63000e210 tx=0x7fe63000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f2cf380c3cebc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:37.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000eac0 con 0x7fe620004d50 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63000f040 con 0x7fe620004d50 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.652+0000 7fe635ffb700 1 -- 172.21.15.12:0/1924528612 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63000ee70 con 0x7fe620004d50 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 -- 172.21.15.12:0/1924528612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620004d50 msgr2=0x7fe6200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 --2- 172.21.15.12:0/1924528612 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe620004d50 0x7fe6200051c0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7fe63000e210 tx=0x7fe63000b040 comp rx=0 tx=0).stop 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe6377fe700 1 -- 172.21.15.12:0/1924528612 reap_dead start 2023-10-08T17:25:37.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 -- 172.21.15.12:0/1924528612 shutdown_connections 2023-10-08T17:25:37.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 -- 172.21.15.12:0/1924528612 >> 172.21.15.12:0/1924528612 conn(0x7fe6380703a0 msgr2=0x7fe6380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:37.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 -- 172.21.15.12:0/1924528612 shutdown_connections 2023-10-08T17:25:37.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.653+0000 7fe637fff700 1 -- 172.21.15.12:0/1924528612 wait complete. 2023-10-08T17:25:37.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.654+0000 7fe637fff700 1 Processor -- start 2023-10-08T17:25:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.655+0000 7fe637fff700 1 -- start start 2023-10-08T17:25:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.655+0000 7fe637fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6381470c0 0x7fe6380b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.655+0000 7fe637fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6380c9900 0x7fe6380c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe637fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe637fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380ca2b0 con 0x7fe638169de0 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe637fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63816ab80 con 0x7fe6380c9900 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe637fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6380b3370 con 0x7fe6381470c0 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47686/0 (socket says 172.21.15.12:47686) 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 -- 172.21.15.12:0/784573668 learned_addr learned my addr 172.21.15.12:0/784573668 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe636ffd700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6381470c0 0x7fe6380b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6367fc700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6380c9900 0x7fe6380c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 -- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6381470c0 msgr2=0x7fe6380b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6381470c0 0x7fe6380b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 -- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6380c9900 msgr2=0x7fe6380c9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6380c9900 0x7fe6380c9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 -- 172.21.15.12:0/784573668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380b3650 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.656+0000 7fe6377fe700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe62000bb40 tx=0x7fe63001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.657+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63001d630 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.657+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63001d7d0 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.657+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63001db90 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.657+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6380b3930 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.657+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6380b4670 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.658+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6380b3e50 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.659+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe630003050 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.660+0000 7fe61effd700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 0x7fe624069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.660+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe6300859b0 con 0x7fe638169de0 2023-10-08T17:25:37.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.660+0000 7fe636ffd700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 0x7fe624069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.661+0000 7fe636ffd700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 0x7fe624069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe628001200 tx=0x7fe628009040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:37.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.664+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6380b3e50 con 0x7fe638169de0 2023-10-08T17:25:37.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.894+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe6380b3e50 con 0x7fe624066f60 2023-10-08T17:25:37.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.895+0000 7fe61effd700 1 -- 172.21.15.12:0/784573668 <== mgr.9024 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe6380b3e50 con 0x7fe624066f60 2023-10-08T17:25:37.896 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:25:37.896 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:25:37.897 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T17:25:37.897 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:25:37.897 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.897+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 msgr2=0x7fe624069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.897+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 0x7fe624069410 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe628001200 tx=0x7fe628009040 comp rx=0 tx=0).stop 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.897+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 msgr2=0x7fe63816a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.897+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7fe62000bb40 tx=0x7fe63001a000 comp rx=0 tx=0).stop 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 shutdown_connections 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe624066f60 0x7fe624069410 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe638169de0 0x7fe63816a250 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6381470c0 0x7fe6380b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 --2- 172.21.15.12:0/784573668 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6380c9900 0x7fe6380c9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 >> 172.21.15.12:0/784573668 conn(0x7fe6380703a0 msgr2=0x7fe638152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 shutdown_connections 2023-10-08T17:25:37.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:37.898+0000 7fe637fff700 1 -- 172.21.15.12:0/784573668 wait complete. 2023-10-08T17:25:37.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T17:25:38.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.104+0000 7fe0a759d700 1 Processor -- start 2023-10-08T17:25:38.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.104+0000 7fe0a759d700 1 -- start start 2023-10-08T17:25:38.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a759d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe0a0142c00 0x7fe0a006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a759d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0a00c7f90 0x7fe0a006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a759d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a00ca480 con 0x7fe0a006bd20 2023-10-08T17:25:38.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a759d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a015e240 con 0x7fe0a00c7f90 2023-10-08T17:25:38.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a759d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006b350 con 0x7fe0a0142c00 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a6d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0a00c7f90 0x7fe0a006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a6d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe0a00c7f90 0x7fe0a006c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47692/0 (socket says 172.21.15.12:47692) 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.105+0000 7fe0a6d9c700 1 -- 172.21.15.12:0/26415079 learned_addr learned my addr 172.21.15.12:0/26415079 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a659b700 1 --2- 172.21.15.12:0/26415079 >> v2:172.21.15.29:3300/0 conn(0x7fe0a0142c00 0x7fe0a006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a6d9c700 1 -- 172.21.15.12:0/26415079 >> v2:172.21.15.29:3300/0 conn(0x7fe0a0142c00 msgr2=0x7fe0a006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a6d9c700 1 --2- 172.21.15.12:0/26415079 >> v2:172.21.15.29:3300/0 conn(0x7fe0a0142c00 0x7fe0a006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a6d9c700 1 -- 172.21.15.12:0/26415079 >> v1:172.21.15.29:6789/0 conn(0x7fe0a006bd20 legacy=0x7fe0a00c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:38.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a6d9c700 1 -- 172.21.15.12:0/26415079 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a015df60 con 0x7fe0a00c7f90 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a6d9c700 1 --2- 172.21.15.12:0/26415079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a006c6a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006f490 tx=0x7fe098009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b142219f9455199e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.106+0000 7fe0a5599700 1 -- 172.21.15.12:0/26415079 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09800e070 con 0x7fe0a00c7f90 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a5599700 1 -- 172.21.15.12:0/26415079 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09800ba50 con 0x7fe0a00c7f90 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a5599700 1 -- 172.21.15.12:0/26415079 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980092e0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 -- 172.21.15.12:0/26415079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 msgr2=0x7fe0a006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 --2- 172.21.15.12:0/26415079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a006c6a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fe0a006f490 tx=0x7fe098009840 comp rx=0 tx=0).stop 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 -- 172.21.15.12:0/26415079 shutdown_connections 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 --2- 172.21.15.12:0/26415079 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a006c6a0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 --2- 172.21.15.12:0/26415079 >> v2:172.21.15.29:3300/0 conn(0x7fe0a0142c00 0x7fe0a006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:38.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 -- 172.21.15.12:0/26415079 >> 172.21.15.12:0/26415079 conn(0x7fe0a00675a0 msgr2=0x7fe0a00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:38.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 -- 172.21.15.12:0/26415079 shutdown_connections 2023-10-08T17:25:38.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.107+0000 7fe0a759d700 1 -- 172.21.15.12:0/26415079 wait complete. 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.109+0000 7fe0a759d700 1 Processor -- start 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.109+0000 7fe0a759d700 1 -- start start 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a006bd20 0x7fe0a013d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0a0142c00 0x7fe0a00b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015d490 con 0x7fe0a00c7f90 2023-10-08T17:25:38.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015c3c0 con 0x7fe0a006bd20 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00b1880 con 0x7fe0a0142c00 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47694/0 (socket says 172.21.15.12:47694) 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 -- 172.21.15.12:0/3734216623 learned_addr learned my addr 172.21.15.12:0/3734216623 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a659b700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a006bd20 0x7fe0a013d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a6d9c700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0a0142c00 0x7fe0a00b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 -- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0a0142c00 msgr2=0x7fe0a00b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0a0142c00 0x7fe0a00b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 -- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a006bd20 msgr2=0x7fe0a013d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a006bd20 0x7fe0a013d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:38.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.110+0000 7fe0a5d9a700 1 -- 172.21.15.12:0/3734216623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe098009ae0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0a5d9a700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7c0 tx=0x7fe090007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011590 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0900116f0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090011ab0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a00b1b60 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.111+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a00b2120 con 0x7fe0a00c7f90 2023-10-08T17:25:38.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.112+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a004c3c0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.113+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 81) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe09001b3b0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.114+0000 7fe0967fc700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 0x7fe0840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:38.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.114+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7fe090083bc0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.114+0000 7fe0a659b700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 0x7fe0840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:38.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.115+0000 7fe0a659b700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 0x7fe0840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c008040 comp rx=0 tx=0).ready entity=mgr.9024 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:38.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.118+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe090050bc0 con 0x7fe0a00c7f90 2023-10-08T17:25:38.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:38.375+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe0a006ad00 con 0x7fe0a00c7f90 2023-10-08T17:25:39.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.051+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 82) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fe090050f90 con 0x7fe0a00c7f90 2023-10-08T17:25:39.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.053+0000 7fe0967fc700 1 -- 172.21.15.12:0/3734216623 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v82) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe090054650 con 0x7fe0a00c7f90 2023-10-08T17:25:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 msgr2=0x7fe0840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 0x7fe0840693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe09c006fd0 tx=0x7fe09c008040 comp rx=0 tx=0).stop 2023-10-08T17:25:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 msgr2=0x7fe0a00b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fe09000c7c0 tx=0x7fe090007f50 comp rx=0 tx=0).stop 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 shutdown_connections 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7fe084066f30 0x7fe0840693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe0a0142c00 0x7fe0a00b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe0a006bd20 0x7fe0a013d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 --2- 172.21.15.12:0/3734216623 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe0a00c7f90 0x7fe0a00b0d10 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 >> 172.21.15.12:0/3734216623 conn(0x7fe0a00675a0 msgr2=0x7fe0a00c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 shutdown_connections 2023-10-08T17:25:39.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.056+0000 7fe0a759d700 1 -- 172.21.15.12:0/3734216623 wait complete. 2023-10-08T17:25:39.080 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T17:25:39.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.277+0000 7f075e19d700 1 Processor -- start 2023-10-08T17:25:39.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.277+0000 7f075e19d700 1 -- start start 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 0x7f07580ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075e19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0758159920 0x7f07580ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075e19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07580acc00 con 0x7f075815dfd0 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075e19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07580abff0 con 0x7f0758159920 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580ac2d0 con 0x7f0758159550 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075c99a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f075815dfd0 0x7f07580aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41696/0 (socket says 172.21.15.12:41696) 2023-10-08T17:25:39.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075c99a700 1 -- 172.21.15.12:0/204882706 learned_addr learned my addr 172.21.15.12:0/204882706 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075d99c700 1 --2- 172.21.15.12:0/204882706 >> v2:172.21.15.29:3300/0 conn(0x7f0758159920 0x7f07580ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f075d19b700 1 --2- 172.21.15.12:0/204882706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 0x7f07580ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f074ffff700 1 -- 172.21.15.12:0/204882706 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511378470 0 0) 0x7f07580acc00 con 0x7f075815dfd0 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.279+0000 7f074ffff700 1 -- 172.21.15.12:0/204882706 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0744003570 con 0x7f075815dfd0 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f075d19b700 1 -- 172.21.15.12:0/204882706 >> v2:172.21.15.29:3300/0 conn(0x7f0758159920 msgr2=0x7f07580ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f075d19b700 1 --2- 172.21.15.12:0/204882706 >> v2:172.21.15.29:3300/0 conn(0x7f0758159920 0x7f07580ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f075d19b700 1 -- 172.21.15.12:0/204882706 >> v1:172.21.15.12:6789/0 conn(0x7f075815dfd0 legacy=0x7f07580aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f075d19b700 1 -- 172.21.15.12:0/204882706 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07580ac5b0 con 0x7f0758159550 2023-10-08T17:25:39.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f075d19b700 1 --2- 172.21.15.12:0/204882706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 0x7f07580ceac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07540098e0 tx=0x7f07540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6415fe682fb63db server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f074ffff700 1 -- 172.21.15.12:0/204882706 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011630 con 0x7f0758159550 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f074ffff700 1 -- 172.21.15.12:0/204882706 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0754011790 con 0x7f0758159550 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.280+0000 7f074ffff700 1 -- 172.21.15.12:0/204882706 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011b30 con 0x7f0758159550 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 -- 172.21.15.12:0/204882706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 msgr2=0x7f07580ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 --2- 172.21.15.12:0/204882706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 0x7f07580ceac0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07540098e0 tx=0x7f07540091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 -- 172.21.15.12:0/204882706 shutdown_connections 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 --2- 172.21.15.12:0/204882706 >> v2:172.21.15.29:3300/0 conn(0x7f0758159920 0x7f07580ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 --2- 172.21.15.12:0/204882706 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0758159550 0x7f07580ceac0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 -- 172.21.15.12:0/204882706 >> 172.21.15.12:0/204882706 conn(0x7f075806ce80 msgr2=0x7f07580ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:39.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 -- 172.21.15.12:0/204882706 shutdown_connections 2023-10-08T17:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.281+0000 7f075e19d700 1 -- 172.21.15.12:0/204882706 wait complete. 2023-10-08T17:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.283+0000 7f075e19d700 1 Processor -- start 2023-10-08T17:25:39.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.283+0000 7f075e19d700 1 -- start start 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0758159920 0x7f07581546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 0x7f0758154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075816d520 con 0x7f0758159550 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07580b40f0 con 0x7f0758159920 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07580b3b30 con 0x7f075815dfd0 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47724/0 (socket says 172.21.15.12:47724) 2023-10-08T17:25:39.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 -- 172.21.15.12:0/1171856781 learned_addr learned my addr 172.21.15.12:0/1171856781 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d99c700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 0x7f0758154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075c99a700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0758159920 0x7f07581546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 msgr2=0x7f0758154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 0x7f0758154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0758159920 msgr2=0x7f07581546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0758159920 0x7f07581546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d19b700 1 -- 172.21.15.12:0/1171856781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0754009420 con 0x7f0758159550 2023-10-08T17:25:39.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.284+0000 7f075d99c700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 0x7f0758154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f075d19b700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f07580ac410 tx=0x7f0754017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754011b10 con 0x7f0758159550 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540253f0 con 0x7f0758159550 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0754025790 con 0x7f0758159550 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07580b3e10 con 0x7f0758159550 2023-10-08T17:25:39.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.285+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07581541b0 con 0x7f0758159550 2023-10-08T17:25:39.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.286+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07581543d0 con 0x7f0758159550 2023-10-08T17:25:39.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.287+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 82) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f0754025b80 con 0x7f0758159550 2023-10-08T17:25:39.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.288+0000 7f074d7fa700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 0x7f073c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.288+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f0754085f60 con 0x7f0758159550 2023-10-08T17:25:39.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.288+0000 7f075c99a700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 msgr2=0x7f073c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:39.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.288+0000 7f075c99a700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 0x7f073c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:39.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.292+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0754053000 con 0x7f0758159550 2023-10-08T17:25:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.489+0000 7f075c99a700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 msgr2=0x7f073c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:39.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.489+0000 7f075c99a700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 0x7f073c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:39.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.497+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f075804c3c0 con 0x7f0758159550 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.503+0000 7f074d7fa700 1 -- 172.21.15.12:0/1171856781 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7f07540150d0 con 0x7f0758159550 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 msgr2=0x7f073c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 0x7f073c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 msgr2=0x7f07580c7560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f07580ac410 tx=0x7f0754017000 comp rx=0 tx=0).stop 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 shutdown_connections 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f073c066f80 0x7f073c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0758159550 0x7f07580c7560 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f075815dfd0 0x7f0758154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 --2- 172.21.15.12:0/1171856781 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0758159920 0x7f07581546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 >> 172.21.15.12:0/1171856781 conn(0x7f075806ce80 msgr2=0x7f0758067d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 shutdown_connections 2023-10-08T17:25:39.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.505+0000 7f075e19d700 1 -- 172.21.15.12:0/1171856781 wait complete. 2023-10-08T17:25:39.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T17:25:39.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.719+0000 7f2c8bfff700 1 Processor -- start 2023-10-08T17:25:39.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.719+0000 7f2c8bfff700 1 -- start start 2023-10-08T17:25:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 0x7f2c8c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c8c159920 0x7f2c8c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8c0acc00 con 0x7f2c8c159550 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c8c0abff0 con 0x7f2c8c159920 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c0ac2d0 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c8c159920 0x7f2c8c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c8c159920 0x7f2c8c0ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47738/0 (socket says 172.21.15.12:47738) 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3058705758 learned_addr learned my addr 172.21.15.12:0/3058705758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8affd700 1 --1- 172.21.15.12:0/3058705758 >> v1:172.21.15.12:6789/0 conn(0x7f2c8c159550 0x7f2c8c0ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41704/0 (socket says 172.21.15.12:41704) 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8a7fc700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 0x7f2c8c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3058705758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 msgr2=0x7f2c8c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 0x7f2c8c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.721+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3058705758 >> v1:172.21.15.12:6789/0 conn(0x7f2c8c159550 legacy=0x7f2c8c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3058705758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8c0ac5b0 con 0x7f2c8c159920 2023-10-08T17:25:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c8a7fc700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 0x7f2c8c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:39.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c89ffb700 1 -- 172.21.15.12:0/3058705758 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667028586 0 0) 0x7f2c8c0acc00 con 0x7f2c8c159550 2023-10-08T17:25:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c8b7fe700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c159920 0x7f2c8c0ad090 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2c840099b0 tx=0x7f2c84009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac00c6cf9df8641a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c89ffb700 1 -- 172.21.15.12:0/3058705758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c84009ea0 con 0x7f2c8c159920 2023-10-08T17:25:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c89ffb700 1 -- 172.21.15.12:0/3058705758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c8400b860 con 0x7f2c8c159920 2023-10-08T17:25:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.722+0000 7f2c89ffb700 1 -- 172.21.15.12:0/3058705758 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400bc00 con 0x7f2c8c159920 2023-10-08T17:25:39.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3058705758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c159920 msgr2=0x7f2c8c0ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c159920 0x7f2c8c0ad090 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f2c840099b0 tx=0x7f2c84009250 comp rx=0 tx=0).stop 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3058705758 shutdown_connections 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c159920 0x7f2c8c0ad090 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3058705758 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c15dfd0 0x7f2c8c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3058705758 >> 172.21.15.12:0/3058705758 conn(0x7f2c8c06ce80 msgr2=0x7f2c8c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3058705758 shutdown_connections 2023-10-08T17:25:39.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.723+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3058705758 wait complete. 2023-10-08T17:25:39.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.724+0000 7f2c8bfff700 1 Processor -- start 2023-10-08T17:25:39.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 -- start start 2023-10-08T17:25:39.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c8c159550 0x7f2c8c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c159920 0x7f2c8c06d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c16d720 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c150030 con 0x7f2c8c159550 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.725+0000 7f2c8bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8c16a640 con 0x7f2c8c159920 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47752/0 (socket says 172.21.15.12:47752) 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3235350264 learned_addr learned my addr 172.21.15.12:0/3235350264 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8a7fc700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c159920 0x7f2c8c06d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8affd700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c8c159550 0x7f2c8c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c159920 msgr2=0x7f2c8c06d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c159920 0x7f2c8c06d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c8c159550 msgr2=0x7f2c8c0c9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c8c159550 0x7f2c8c0c9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 -- 172.21.15.12:0/3235350264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009a20 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.726+0000 7f2c8b7fe700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2c84006fd0 tx=0x7f2c84017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.727+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400baa0 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.727+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c84025420 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.727+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c8400bc00 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.727+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c840094f0 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.727+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8c16d0d0 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.728+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c8c04c3c0 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.729+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 82) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f2c84023070 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.730+0000 7f2c82ffd700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 0x7f2c6c069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:39.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.730+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f2c84085e10 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.730+0000 7f2c8affd700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 msgr2=0x7f2c6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:39.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.730+0000 7f2c8affd700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 0x7f2c6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:39.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.734+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c84089030 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.931+0000 7f2c8affd700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 msgr2=0x7f2c6c069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:39.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.931+0000 7f2c8affd700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 0x7f2c6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:39.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.938+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f2c8c155780 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.944+0000 7f2c82ffd700 1 -- 172.21.15.12:0/3235350264 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2c84052e50 con 0x7f2c8c15dfd0 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 msgr2=0x7f2c6c069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 0x7f2c6c069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 msgr2=0x7f2c8c06dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f2c84006fd0 tx=0x7f2c84017000 comp rx=0 tx=0).stop 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 shutdown_connections 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f2c6c066f80 0x7f2c6c069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c8c15dfd0 0x7f2c8c06dcf0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c8c159550 0x7f2c8c0c9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 --2- 172.21.15.12:0/3235350264 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c8c159920 0x7f2c8c06d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:39.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 >> 172.21.15.12:0/3235350264 conn(0x7f2c8c06ce80 msgr2=0x7f2c8c154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:39.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 shutdown_connections 2023-10-08T17:25:39.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:39.947+0000 7f2c8bfff700 1 -- 172.21.15.12:0/3235350264 wait complete. 2023-10-08T17:25:39.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:25:39.966 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T17:25:40.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:25:40.010 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-10-08T17:25:40.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-08T17:25:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.331+0000 7f08effff700 1 Processor -- start 2023-10-08T17:25:40.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.331+0000 7f08effff700 1 -- start start 2023-10-08T17:25:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.332+0000 7f08effff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f08f00b24f0 0x7f08f00b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.332+0000 7f08effff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08f0159800 0x7f08f00b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.333 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.332+0000 7f08effff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00b0c80 con 0x7f08f00b1d40 2023-10-08T17:25:40.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.332+0000 7f08effff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00d10d0 con 0x7f08f0159800 2023-10-08T17:25:40.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.332+0000 7f08effff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b0f60 con 0x7f08f00b24f0 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ef7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f08f0159800 0x7f08f00b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08eeffd700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f08f00b24f0 0x7f08f00b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ee7fc700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f08f00b1d40 0x7f08f01590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:40994/0 (socket says 172.21.15.12:40994) 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ee7fc700 1 -- 172.21.15.12:0/676531315 learned_addr learned my addr 172.21.15.12:0/676531315 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ef7fe700 1 -- 172.21.15.12:0/676531315 >> v2:172.21.15.29:3300/0 conn(0x7f08f00b24f0 msgr2=0x7f08f00b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:40.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ef7fe700 1 --2- 172.21.15.12:0/676531315 >> v2:172.21.15.29:3300/0 conn(0x7f08f00b24f0 0x7f08f00b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ef7fe700 1 -- 172.21.15.12:0/676531315 >> v1:172.21.15.29:6789/0 conn(0x7f08f00b1d40 legacy=0x7f08f01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08edffb700 1 -- 172.21.15.12:0/676531315 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3837551945 0 0) 0x7f08f00b0c80 con 0x7f08f00b1d40 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.333+0000 7f08ef7fe700 1 -- 172.21.15.12:0/676531315 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00b1240 con 0x7f08f0159800 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08ef7fe700 1 --2- 172.21.15.12:0/676531315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f0159800 0x7f08f00b4ae0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f08f00d1230 tx=0x7f08e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7377da95b5ad89f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08edffb700 1 -- 172.21.15.12:0/676531315 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e800e070 con 0x7f08f0159800 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08edffb700 1 -- 172.21.15.12:0/676531315 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800bb60 con 0x7f08f0159800 2023-10-08T17:25:40.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08edffb700 1 -- 172.21.15.12:0/676531315 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e8012430 con 0x7f08f0159800 2023-10-08T17:25:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08effff700 1 -- 172.21.15.12:0/676531315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f0159800 msgr2=0x7f08f00b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.334+0000 7f08effff700 1 --2- 172.21.15.12:0/676531315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f0159800 0x7f08f00b4ae0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f08f00d1230 tx=0x7f08e8009780 comp rx=0 tx=0).stop 2023-10-08T17:25:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 -- 172.21.15.12:0/676531315 shutdown_connections 2023-10-08T17:25:40.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 --2- 172.21.15.12:0/676531315 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f0159800 0x7f08f00b4ae0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 --2- 172.21.15.12:0/676531315 >> v2:172.21.15.29:3300/0 conn(0x7f08f00b24f0 0x7f08f00b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 -- 172.21.15.12:0/676531315 >> 172.21.15.12:0/676531315 conn(0x7f08f00703a0 msgr2=0x7f08f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 -- 172.21.15.12:0/676531315 shutdown_connections 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.335+0000 7f08effff700 1 -- 172.21.15.12:0/676531315 wait complete. 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.336+0000 7f08effff700 1 Processor -- start 2023-10-08T17:25:40.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.336+0000 7f08effff700 1 -- start start 2023-10-08T17:25:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08f00b1d40 0x7f08f0169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f08f0159800 0x7f08f015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f016b660 con 0x7f08f00b24f0 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f016a520 con 0x7f08f00b1d40 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08effff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f016a770 con 0x7f08f0159800 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.337+0000 7f08ee7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:47772/0 (socket says 172.21.15.12:47772) 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 -- 172.21.15.12:0/2117421838 learned_addr learned my addr 172.21.15.12:0/2117421838 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08f00b1d40 0x7f08f0169fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ef7fe700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f08f0159800 0x7f08f015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f08f0159800 msgr2=0x7f08f015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f08f0159800 0x7f08f015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:40.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08f00b1d40 msgr2=0x7f08f0169fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08f00b1d40 0x7f08f0169fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8009a20 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08ee7fc700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c5b0 tx=0x7f08e4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.338+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4005b30 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.339+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e4005c90 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.339+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e4007300 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.339+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f016aa50 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.339+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f016b010 con 0x7f08f00b24f0 2023-10-08T17:25:40.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.340+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f016b7d0 con 0x7f08f00b24f0 2023-10-08T17:25:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.341+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 82) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f08e401b3b0 con 0x7f08f00b24f0 2023-10-08T17:25:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.342+0000 7f08d6ffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.342+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6169+0+0 (secure 0 0 0) 0x7f08e4083c30 con 0x7f08f00b24f0 2023-10-08T17:25:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.342+0000 7f08eeffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:40.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.342+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:25:40.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.345+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08e4050c30 con 0x7f08f00b24f0 2023-10-08T17:25:40.385 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:40.384+0000 7f393543c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:25:40.434 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:40.433+0000 7fa12d991180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:25:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.543+0000 7f08eeffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:40.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.543+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:25:40.556 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:40.555+0000 7f393543c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:40.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.579+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08f004c3c0 con 0x7f08dc066f80 2023-10-08T17:25:40.606 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:40.606+0000 7fa12d991180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:40.645 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:40.643+0000 7f393543c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:25:40.695 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:40.694+0000 7fa12d991180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:25:40.876 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:40.875+0000 7f393543c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:40.928 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:40.927+0000 7fa12d991180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.944+0000 7f08eeffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:40.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:40.944+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:25:41.061 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:41.059+0000 7f393543c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:25:41.115 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:41.114+0000 7fa12d991180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:25:41.157 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:41.155+0000 7f393543c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:25:41.211 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:41.210+0000 7fa12d991180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:25:41.324 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:41.322+0000 7f393543c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:41.378 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:41.377+0000 7fa12d991180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:25:41.428 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:41.427+0000 7f393543c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:41.497 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:41.482+0000 7fa12d991180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:25:41.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:41.745+0000 7f08eeffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:41.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:41.745+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T17:25:41.931 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:41.930+0000 7f393543c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:41.987 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:41.987+0000 7fa12d991180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:25:42.029 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:42.028+0000 7f393543c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:42.087 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:42.086+0000 7fa12d991180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:25:42.123 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:42.122+0000 7f393543c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:42.277 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:42.183+0000 7fa12d991180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:25:42.770 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:42.769+0000 7f393543c180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:42.838 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:42.837+0000 7fa12d991180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:25:42.949 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:42.948+0000 7f393543c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:43.019 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:43.017+0000 7fa12d991180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:25:43.049 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:43.048+0000 7f393543c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:43.119 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:43.118+0000 7fa12d991180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:25:43.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:43.347+0000 7f08eeffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/115415 2023-10-08T17:25:43.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:43.347+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T17:25:43.352 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:43.351+0000 7f393543c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:43.424 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:43.423+0000 7fa12d991180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:25:43.452 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:43.451+0000 7f393543c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:43.524 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:43.523+0000 7fa12d991180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:25:44.191 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:44.190+0000 7f393543c180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:44.274 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:44.273+0000 7fa12d991180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:25:44.486 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:44.485+0000 7f393543c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:44.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:44.566+0000 7fa12d991180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:25:44.583 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:44.581+0000 7f393543c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:44.665 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:44.664+0000 7fa12d991180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:25:44.744 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:44.743+0000 7f393543c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:44.828 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:44.827+0000 7fa12d991180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:25:44.853 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:44.852+0000 7f393543c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:44.937 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:44.936+0000 7fa12d991180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:25:45.053 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:45.050+0000 7f393543c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:45.137 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.136+0000 7fa12d991180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:25:45.148 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:45.147+0000 7f393543c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:45.235 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.234+0000 7fa12d991180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:25:45.245 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:45.243+0000 7f393543c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:45.332 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.331+0000 7fa12d991180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:25:45.343 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:25:45.342+0000 7f393543c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:45.403+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 83) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f08e4051000 con 0x7f08f00b24f0 2023-10-08T17:25:45.433 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.433+0000 7fa12d991180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:25:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:45.443+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 84) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f08e405b400 con 0x7f08f00b24f0 2023-10-08T17:25:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:45.443+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:25:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:45.443+0000 7f08d6ffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:45.565 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.564+0000 7fa09fcf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.566 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.564+0000 7fa09fcf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.566 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.564+0000 7fa09fcf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.566 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.564+0000 7fa09fcf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.566 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.564+0000 7fa09fcf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.565+0000 7fa0a2cf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.565+0000 7fa0a2cf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.565+0000 7fa0a2cf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.565+0000 7fa0a2cf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:45.567 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:25:45.565+0000 7fa0a2cf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:25:46.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.450+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mon.0 v2:172.21.15.12:3300/0 9 ==== mgrmap(e 85) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f08e40518d0 con 0x7f08f00b24f0 2023-10-08T17:25:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.450+0000 7f08d6ffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc0693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.450+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f08f004c3c0 con 0x7f08dc066f80 2023-10-08T17:25:46.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.452+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc0693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.455+0000 7f08eeffd700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc0693b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009810 tx=0x7f08e00091a0 comp rx=0 tx=0).ready entity=mgr.9408 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:46.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.519+0000 7f08d6ffd700 1 -- 172.21.15.12:0/2117421838 <== mgr.9408 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f08f004c3c0 con 0x7f08dc066f80 2023-10-08T17:25:46.520 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-10-08T17:25:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 msgr2=0x7f08dc0693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc0693b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f08e0009810 tx=0x7f08e00091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 msgr2=0x7f08f00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f08e400c5b0 tx=0x7f08e4001070 comp rx=0 tx=0).stop 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 shutdown_connections 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f08dc066f80 0x7f08dc0693b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.521+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f08f0159800 0x7f08f015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.522+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f08f00b1d40 0x7f08f0169fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.522+0000 7f08effff700 1 --2- 172.21.15.12:0/2117421838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f08f00b24f0 0x7f08f00cd120 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.522+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 >> 172.21.15.12:0/2117421838 conn(0x7f08f00703a0 msgr2=0x7f08f00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.522+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 shutdown_connections 2023-10-08T17:25:46.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.522+0000 7f08effff700 1 -- 172.21.15.12:0/2117421838 wait complete. 2023-10-08T17:25:46.542 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-10-08T17:25:46.543 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-08T17:25:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.735+0000 7f04aad9d700 1 Processor -- start 2023-10-08T17:25:46.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.735+0000 7f04aad9d700 1 -- start start 2023-10-08T17:25:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.736+0000 7f04aad9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f04a40c7870 0x7f04a406c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.736+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 0x7f04a40c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.736+0000 7f04aad9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a40c7d10 con 0x7f04a415cb90 2023-10-08T17:25:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.736+0000 7f04aad9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a40ccdf0 con 0x7f04a40c7870 2023-10-08T17:25:46.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.736+0000 7f04aad9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a40c9b20 con 0x7f04a406cbe0 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04a9d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f04a415cb90 0x7f04a415dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:36610/0 (socket says 172.21.15.12:36610) 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04a9d9b700 1 -- 172.21.15.12:0/1127094665 learned_addr learned my addr 172.21.15.12:0/1127094665 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04a959a700 1 --2- 172.21.15.12:0/1127094665 >> v2:172.21.15.29:3300/0 conn(0x7f04a40c7870 0x7f04a406c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04aa59c700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 0x7f04a40c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04a8d99700 1 -- 172.21.15.12:0/1127094665 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430927383 0 0) 0x7f04a0001110 con 0x7f04a415cb90 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.737+0000 7f04a8d99700 1 -- 172.21.15.12:0/1127094665 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0490003570 con 0x7f04a415cb90 2023-10-08T17:25:46.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a959a700 1 -- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 msgr2=0x7f04a40c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a959a700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 0x7f04a40c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a959a700 1 -- 172.21.15.12:0/1127094665 >> v1:172.21.15.12:6789/0 conn(0x7f04a415cb90 legacy=0x7f04a415dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a959a700 1 -- 172.21.15.12:0/1127094665 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40c2fa0 con 0x7f04a40c7870 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04aa59c700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 0x7f04a40c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a959a700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a40c7870 0x7f04a406c6a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f04940098e0 tx=0x7f04940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e7a2835d20a9d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a8d99700 1 -- 172.21.15.12:0/1127094665 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011630 con 0x7f04a40c7870 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a8d99700 1 -- 172.21.15.12:0/1127094665 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494011790 con 0x7f04a40c7870 2023-10-08T17:25:46.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.738+0000 7f04a8d99700 1 -- 172.21.15.12:0/1127094665 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011b30 con 0x7f04a40c7870 2023-10-08T17:25:46.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 -- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a40c7870 msgr2=0x7f04a406c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a40c7870 0x7f04a406c6a0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f04940098e0 tx=0x7f04940091a0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 -- 172.21.15.12:0/1127094665 shutdown_connections 2023-10-08T17:25:46.741 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a406cbe0 0x7f04a40c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1127094665 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a40c7870 0x7f04a406c6a0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 -- 172.21.15.12:0/1127094665 >> 172.21.15.12:0/1127094665 conn(0x7f04a40cd230 msgr2=0x7f04a40cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 -- 172.21.15.12:0/1127094665 shutdown_connections 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.739+0000 7f04aad9d700 1 -- 172.21.15.12:0/1127094665 wait complete. 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.740+0000 7f04aad9d700 1 Processor -- start 2023-10-08T17:25:46.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.741+0000 7f04aad9d700 1 -- start start 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.741+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.741+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a40c7870 0x7f04a40c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.741+0000 7f04aad9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 0x7f04a415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04aad9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a416a2b0 con 0x7f04a406cbe0 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04aad9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a416a590 con 0x7f04a415cb90 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04aad9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a416a870 con 0x7f04a40c7870 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43182/0 (socket says 172.21.15.12:43182) 2023-10-08T17:25:46.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 -- 172.21.15.12:0/1436148704 learned_addr learned my addr 172.21.15.12:0/1436148704 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 -- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a40c7870 msgr2=0x7f04a40c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a40c7870 0x7f04a40c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 -- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 msgr2=0x7f04a415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04aa59c700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 0x7f04a415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 0x7f04a415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 -- 172.21.15.12:0/1436148704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c009a20 con 0x7f04a406cbe0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04aa59c700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 0x7f04a415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f04a9d9b700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c7c0 tx=0x7f04a0007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.742+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0005b30 con 0x7f04a406cbe0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.743+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0005c90 con 0x7f04a406cbe0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.743+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0007340 con 0x7f04a406cbe0 2023-10-08T17:25:46.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.743+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0494009420 con 0x7f04a406cbe0 2023-10-08T17:25:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.743+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a4169e10 con 0x7f04a406cbe0 2023-10-08T17:25:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.744+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a416a060 con 0x7f04a406cbe0 2023-10-08T17:25:46.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.745+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 85) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f04a00076f0 con 0x7f04a406cbe0 2023-10-08T17:25:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.745+0000 7f0499ffb700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:25:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.745+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6427+0+0 (secure 0 0 0) 0x7f04a0083f30 con 0x7f04a406cbe0 2023-10-08T17:25:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.746+0000 7f04a959a700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:25:46.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.746+0000 7f04a959a700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04a413fc20 tx=0x7f0494017000 comp rx=0 tx=0).ready entity=mgr.9408 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:25:46.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.750+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04a0051130 con 0x7f04a406cbe0 2023-10-08T17:25:46.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:46.980+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f04a40c7d10 con 0x7f0488066dd0 2023-10-08T17:25:47.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.028+0000 7f0499ffb700 1 -- 172.21.15.12:0/1436148704 <== mgr.9408 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f04a40c7d10 con 0x7f0488066dd0 2023-10-08T17:25:47.029 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-10-08T17:25:47.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 msgr2=0x7f0488069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f04a413fc20 tx=0x7f0494017000 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 msgr2=0x7f04a40af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f04a000c7c0 tx=0x7f04a0007c70 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 shutdown_connections 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f0488066dd0 0x7f0488069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f04a406cbe0 0x7f04a40af1a0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f04a415cb90 0x7f04a415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 --2- 172.21.15.12:0/1436148704 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f04a40c7870 0x7f04a40c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 >> 172.21.15.12:0/1436148704 conn(0x7f04a40cd230 msgr2=0x7f04a40c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 shutdown_connections 2023-10-08T17:25:47.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:25:47.030+0000 7f04aad9d700 1 -- 172.21.15.12:0/1436148704 wait complete. 2023-10-08T17:25:47.049 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-10-08T17:26:00.042 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:26:00.041+0000 7fa091cd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:26:00.042 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:26:00.041+0000 7fa091cd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:26:00.042 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:26:00.041+0000 7fa091cd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:26:00.042 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:26:00.041+0000 7fa091cd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:26:00.043 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:26:00.041+0000 7fa091cd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:26:05.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:05.944 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:36.061 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:26:36.067 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:06.212 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:06.217 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:36.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:27:36.343 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:28:06.479 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:28:06.484 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:28:36.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:28:36.612 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:29:06.756 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:29:06.761 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:29:36.880 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:29:36.993 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:07.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:07.121 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:37.224 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:30:37.230 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:07.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:07.407 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:37.510 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:31:37.516 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:07.623 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:07.628 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:37.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:32:37.842 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:07.971 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:07.976 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:38.096 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:33:38.102 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:08.349 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:08.355 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:38.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:34:38.478 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:08.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:08.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:38.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:35:38.731 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:08.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:08.864 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:16.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:36:16.051 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-08T17:36:16.095 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_26_00_UTC 2023-10-08T17:36:16.095 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_27_00_UTC 2023-10-08T17:36:16.095 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_28_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_29_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_30_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_31_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_32_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_33_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_34_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_35_00_UTC 2023-10-08T17:36:16.096 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_36_00_UTC 2023-10-08T17:36:16.097 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-17_26_00_UTC', 'scheduled-2023-10-08-17_27_00_UTC', 'scheduled-2023-10-08-17_28_00_UTC', 'scheduled-2023-10-08-17_29_00_UTC', 'scheduled-2023-10-08-17_30_00_UTC', 'scheduled-2023-10-08-17_31_00_UTC', 'scheduled-2023-10-08-17_32_00_UTC', 'scheduled-2023-10-08-17_33_00_UTC', 'scheduled-2023-10-08-17_34_00_UTC', 'scheduled-2023-10-08-17_35_00_UTC', 'scheduled-2023-10-08-17_36_00_UTC'] 2023-10-08T17:36:16.097 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-08T17:36:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.337+0000 7f81e8f9d700 1 Processor -- start 2023-10-08T17:36:16.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.337+0000 7f81e8f9d700 1 -- start start 2023-10-08T17:36:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e8f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e4153660 0x7f81e40c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e40c9090 0x7f81e4156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e8f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e40c2200 con 0x7f81e4153a30 2023-10-08T17:36:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e8f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e4157250 con 0x7f81e4153660 2023-10-08T17:36:16.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40c15f0 con 0x7f81e40c9090 2023-10-08T17:36:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e4153660 0x7f81e40c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f81e4153a30 0x7f81e40c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49562/0 (socket says 172.21.15.12:49562) 2023-10-08T17:36:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e2ffd700 1 -- 172.21.15.12:0/3572089147 learned_addr learned my addr 172.21.15.12:0/3572089147 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:36:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81e4153660 0x7f81e40c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39156/0 (socket says 172.21.15.12:39156) 2023-10-08T17:36:16.341 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e3fff700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e40c9090 0x7f81e4156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.339+0000 7f81e27fc700 1 -- 172.21.15.12:0/3572089147 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463034535 0 0) 0x7f81e40c2200 con 0x7f81e4153a30 2023-10-08T17:36:16.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e37fe700 1 -- 172.21.15.12:0/3572089147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e40c9090 msgr2=0x7f81e4156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e37fe700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e40c9090 0x7f81e4156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e37fe700 1 -- 172.21.15.12:0/3572089147 >> v1:172.21.15.12:6789/0 conn(0x7f81e4153a30 legacy=0x7f81e40c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e37fe700 1 -- 172.21.15.12:0/3572089147 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40c18d0 con 0x7f81e4153660 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e37fe700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e4153660 0x7f81e40c0ef0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f81d40098e0 tx=0x7f81d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72d5321e4a7db09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e27fc700 1 -- 172.21.15.12:0/3572089147 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400b640 con 0x7f81e4153660 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e27fc700 1 -- 172.21.15.12:0/3572089147 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400b7a0 con 0x7f81e4153660 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.340+0000 7f81e27fc700 1 -- 172.21.15.12:0/3572089147 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400bb40 con 0x7f81e4153660 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 -- 172.21.15.12:0/3572089147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e4153660 msgr2=0x7f81e40c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e4153660 0x7f81e40c0ef0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f81d40098e0 tx=0x7f81d40091a0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 -- 172.21.15.12:0/3572089147 shutdown_connections 2023-10-08T17:36:16.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e40c9090 0x7f81e4156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/3572089147 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e4153660 0x7f81e40c0ef0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 -- 172.21.15.12:0/3572089147 >> 172.21.15.12:0/3572089147 conn(0x7f81e406c6a0 msgr2=0x7f81e406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:36:16.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 -- 172.21.15.12:0/3572089147 shutdown_connections 2023-10-08T17:36:16.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.341+0000 7f81e8f9d700 1 -- 172.21.15.12:0/3572089147 wait complete. 2023-10-08T17:36:16.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.342+0000 7f81e8f9d700 1 Processor -- start 2023-10-08T17:36:16.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.342+0000 7f81e8f9d700 1 -- start start 2023-10-08T17:36:16.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e4153660 0x7f81e40b0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4153a30 0x7f81e41599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40b10c0 con 0x7f81e40c9090 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4149be0 con 0x7f81e4153a30 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.343+0000 7f81e8f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40b12d0 con 0x7f81e4153660 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39172/0 (socket says 172.21.15.12:39172) 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 -- 172.21.15.12:0/1061364966 learned_addr learned my addr 172.21.15.12:0/1061364966 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 -- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e4153660 msgr2=0x7f81e40b0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e4153660 0x7f81e40b0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 -- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4153a30 msgr2=0x7f81e41599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4153a30 0x7f81e41599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 -- 172.21.15.12:0/1061364966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d4009420 con 0x7f81e40c9090 2023-10-08T17:36:16.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.344+0000 7f81e37fe700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f81d40093f0 tx=0x7f81d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.345+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400bb20 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.345+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d4011420 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.345+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d40117c0 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.345+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e4149590 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.345+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e4159ef0 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.346+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e41493f0 con 0x7f81e40c9090 2023-10-08T17:36:16.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.347+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 88) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f81d4011bf0 con 0x7f81e40c9090 2023-10-08T17:36:16.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.348+0000 7f81cb7fe700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 0x7f81d0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.348+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f81d40861f0 con 0x7f81e40c9090 2023-10-08T17:36:16.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.348+0000 7f81e2ffd700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 0x7f81d0069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.349+0000 7f81e2ffd700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 0x7f81d0069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f81e40c7410 tx=0x7f81d8007bd0 comp rx=0 tx=0).ready entity=mgr.9408 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.354 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.353+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81e41493f0 con 0x7f81e40c9090 2023-10-08T17:36:16.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.582+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 --> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81e4149d20 con 0x7f81d00670a0 2023-10-08T17:36:16.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.590+0000 7f81cb7fe700 1 -- 172.21.15.12:0/1061364966 <== mgr.9408 v2:172.21.15.12:6836/115415 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f81d80058a0 con 0x7f81d00670a0 2023-10-08T17:36:16.591 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:36:16.591 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T17:25:46", "first": "2023-10-08T17:26:00", "last": "2023-10-08T17:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-08T17:36:16.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 msgr2=0x7f81d0069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 0x7f81d0069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f81e40c7410 tx=0x7f81d8007bd0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 msgr2=0x7f81e414bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f81d40093f0 tx=0x7f81d4017000 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 shutdown_connections 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f81d00670a0 0x7f81d0069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81e40c9090 0x7f81e414bf10 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81e4153a30 0x7f81e41599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 --2- 172.21.15.12:0/1061364966 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81e4153660 0x7f81e40b0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 >> 172.21.15.12:0/1061364966 conn(0x7f81e406c6a0 msgr2=0x7f81e414c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:36:16.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 shutdown_connections 2023-10-08T17:36:16.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.592+0000 7f81e8f9d700 1 -- 172.21.15.12:0/1061364966 wait complete. 2023-10-08T17:36:16.611 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T17:25:46", "first": "2023-10-08T17:26:00", "last": "2023-10-08T17:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-10-08T17:36:16.611 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T17:25:46', 'first': '2023-10-08T17:26:00', 'last': '2023-10-08T17:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-10-08T17:36:16.611 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2023-10-08T17:36:16.611 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2023-10-08T17:36:16.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-08T17:36:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.798+0000 7f262ffff700 1 Processor -- start 2023-10-08T17:36:16.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.798+0000 7f262ffff700 1 -- start start 2023-10-08T17:36:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f263006d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26300ca7b0 0x7f26300cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263006d3e0 con 0x7f2630159aa0 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300cb120 con 0x7f26300ca7b0 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f263006c7d0 con 0x7f26301596d0 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26300ca7b0 0x7f26300cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26300ca7b0 0x7f26300cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39178/0 (socket says 172.21.15.12:39178) 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262f7fe700 1 -- 172.21.15.12:0/1123195035 learned_addr learned my addr 172.21.15.12:0/1123195035 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262e7fc700 1 --1- 172.21.15.12:0/1123195035 >> v1:172.21.15.12:6789/0 conn(0x7f2630159aa0 0x7f26300703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:49576/0 (socket says 172.21.15.12:49576) 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.799+0000 7f262effd700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f263006d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262f7fe700 1 -- 172.21.15.12:0/1123195035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 msgr2=0x7f263006d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262f7fe700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f263006d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262f7fe700 1 -- 172.21.15.12:0/1123195035 >> v1:172.21.15.12:6789/0 conn(0x7f2630159aa0 legacy=0x7f26300703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262f7fe700 1 -- 172.21.15.12:0/1123195035 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263006cab0 con 0x7f26300ca7b0 2023-10-08T17:36:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262dffb700 1 -- 172.21.15.12:0/1123195035 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761575965 0 0) 0x7f263006d3e0 con 0x7f2630159aa0 2023-10-08T17:36:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262f7fe700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300cabe0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2628009f20 tx=0x7f2628009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76dfe972f169c2c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262dffb700 1 -- 172.21.15.12:0/1123195035 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262800e070 con 0x7f26300ca7b0 2023-10-08T17:36:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262dffb700 1 -- 172.21.15.12:0/1123195035 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262800b9d0 con 0x7f26300ca7b0 2023-10-08T17:36:16.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.800+0000 7f262dffb700 1 -- 172.21.15.12:0/1123195035 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26280092e0 con 0x7f26300ca7b0 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 -- 172.21.15.12:0/1123195035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 msgr2=0x7f26300cabe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300cabe0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2628009f20 tx=0x7f2628009840 comp rx=0 tx=0).stop 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 -- 172.21.15.12:0/1123195035 shutdown_connections 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300cabe0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 --2- 172.21.15.12:0/1123195035 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f263006d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 -- 172.21.15.12:0/1123195035 >> 172.21.15.12:0/1123195035 conn(0x7f263006e720 msgr2=0x7f263006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:36:16.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 -- 172.21.15.12:0/1123195035 shutdown_connections 2023-10-08T17:36:16.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.801+0000 7f262ffff700 1 -- 172.21.15.12:0/1123195035 wait complete. 2023-10-08T17:36:16.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.802+0000 7f262ffff700 1 Processor -- start 2023-10-08T17:36:16.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 -- start start 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f2630169340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 0x7f26301585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263016a330 con 0x7f26300ca7b0 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630153230 con 0x7f2630159aa0 2023-10-08T17:36:16.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.803+0000 7f262ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2630169d70 con 0x7f26301596d0 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39192/0 (socket says 172.21.15.12:39192) 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 -- 172.21.15.12:0/1092185975 learned_addr learned my addr 172.21.15.12:0/1092185975 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262e7fc700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f2630169340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 -- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 msgr2=0x7f2630169340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262f7fe700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 0x7f26301585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f2630169340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 -- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 msgr2=0x7f26301585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 0x7f26301585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 -- 172.21.15.12:0/1092185975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2628009ae0 con 0x7f26300ca7b0 2023-10-08T17:36:16.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262e7fc700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f2630169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262f7fe700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 0x7f26301585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.804+0000 7f262effd700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f262000ec80 tx=0x7f26200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.805+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262000c9d0 con 0x7f26300ca7b0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.805+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000cb30 con 0x7f26300ca7b0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.805+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2620013470 con 0x7f26300ca7b0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.805+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f263016a050 con 0x7f26300ca7b0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.805+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26301570c0 con 0x7f26300ca7b0 2023-10-08T17:36:16.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.806+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630153510 con 0x7f26300ca7b0 2023-10-08T17:36:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.807+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 88) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f2620013820 con 0x7f26300ca7b0 2023-10-08T17:36:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.808+0000 7f2616ffd700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 0x7f261c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:36:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.808+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 6456+0+0 (secure 0 0 0) 0x7f2620084e90 con 0x7f26300ca7b0 2023-10-08T17:36:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.808+0000 7f262e7fc700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 0x7f261c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:36:16.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.809+0000 7f262e7fc700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 0x7f261c069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26301451b0 tx=0x7f2624009040 comp rx=0 tx=0).ready entity=mgr.9408 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:36:16.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:16.812+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2620051c60 con 0x7f26300ca7b0 2023-10-08T17:36:17.070 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.069+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2630152d20 con 0x7f26300ca7b0 2023-10-08T17:36:17.073 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.072+0000 7f2616ffd700 1 -- 172.21.15.12:0/1092185975 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v88) v1 ==== 74+0+163903 (secure 0 0 0) 0x7f2630152d20 con 0x7f26300ca7b0 2023-10-08T17:36:17.080 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:36:17.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 msgr2=0x7f261c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 0x7f261c069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f26301451b0 tx=0x7f2624009040 comp rx=0 tx=0).stop 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 msgr2=0x7f26300c3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f262000ec80 tx=0x7f26200091a0 comp rx=0 tx=0).stop 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 shutdown_connections 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:6836/115415,v1:172.21.15.12:6837/115415] conn(0x7f261c0670a0 0x7f261c069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26300ca7b0 0x7f26300c3cd0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2630159aa0 0x7f26301585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:17.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 --2- 172.21.15.12:0/1092185975 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26301596d0 0x7f2630169340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:36:17.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 >> 172.21.15.12:0/1092185975 conn(0x7f263006e720 msgr2=0x7f26300c21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:36:17.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 shutdown_connections 2023-10-08T17:36:17.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:36:17.076+0000 7f262ffff700 1 -- 172.21.15.12:0/1092185975 wait complete. 2023-10-08T17:36:17.094 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":88,"active_gid":9408,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6836","nonce":115415},{"type":"v1","addr":"172.21.15.12:6837","nonce":115415}]},"active_addr":"172.21.15.12:6837/115415","active_change":"2023-10-08T17:25:45.435760+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":8857,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":182,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3103985745}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2405396815}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":62325}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":681896466}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":2436623509}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1092834905}]}]} 2023-10-08T17:36:17.099 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: y 2023-10-08T17:36:17.099 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-08T17:36:17.099 INFO:tasks.ceph.mgr.y:Stopping old one... 2023-10-08T17:36:17.099 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T17:36:17.099 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:36:17.168 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T17:36:17.168 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-08T17:36:17.173 INFO:tasks.ceph.mgr.y:Started 2023-10-08T17:36:18.545 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:18.544+0000 7fee10d59180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:36:18.717 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:18.715+0000 7fee10d59180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:36:18.805 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:18.804+0000 7fee10d59180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:36:19.036 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:19.035+0000 7fee10d59180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:36:19.222 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:19.220+0000 7fee10d59180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:36:19.317 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:19.316+0000 7fee10d59180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:36:19.483 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:19.482+0000 7fee10d59180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:36:19.587 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:19.586+0000 7fee10d59180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:36:20.090 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:20.089+0000 7fee10d59180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:36:20.188 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:20.187+0000 7fee10d59180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:36:20.282 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:20.281+0000 7fee10d59180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:36:20.929 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:20.928+0000 7fee10d59180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:36:21.110 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:21.108+0000 7fee10d59180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:36:21.210 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:21.209+0000 7fee10d59180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:36:21.512 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:21.511+0000 7fee10d59180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:36:21.612 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:21.611+0000 7fee10d59180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:36:22.349 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:22.348+0000 7fee10d59180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:36:22.641 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:22.640+0000 7fee10d59180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:36:22.739 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:22.738+0000 7fee10d59180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:36:22.901 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:22.900+0000 7fee10d59180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:36:23.011 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.010+0000 7fee10d59180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:36:23.208 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.207+0000 7fee10d59180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:36:23.307 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.306+0000 7fee10d59180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:36:23.403 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.402+0000 7fee10d59180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:36:23.500 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.499+0000 7fee10d59180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:36:23.657 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.656+0000 7fed858b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.657 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.656+0000 7fed858b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.658 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.656+0000 7fed858b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.658 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.656+0000 7fed858b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.658 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.656+0000 7fed858b6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.659 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.657+0000 7fed820af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.659 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.657+0000 7fed820af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.659 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.657+0000 7fed820af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.659 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.657+0000 7fed820af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:23.659 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:36:23.657+0000 7fed820af700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:36:38.993 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:36:38.999 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:00.654 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:37:00.653+0000 7fed8d8c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:37:00.654 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:37:00.653+0000 7fed8d8c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:37:00.654 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:37:00.653+0000 7fed8d8c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:37:00.654 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:37:00.653+0000 7fed8d8c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:37:00.655 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:37:00.653+0000 7fed8d8c6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:37:09.119 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:09.124 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:39.229 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:37:39.238 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:38:09.338 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:38:09.344 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:38:39.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:38:39.455 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:39:09.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:39:09.607 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:39:39.714 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:39:39.721 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:09.827 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:09.832 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:39.944 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:40:39.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:10.060 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:10.065 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:17.174 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-08T17:41:17.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.379+0000 7f182f39d700 1 Processor -- start 2023-10-08T17:41:17.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.379+0000 7f182f39d700 1 -- start start 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182f39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18280c8200 0x7f18280c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182f39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18280c85d0 0x7f18280cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182f39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18281571b0 con 0x7f18280c2a90 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182f39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18281579b0 con 0x7f18280c85d0 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182f39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18280c1390 con 0x7f18280c8200 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18280c85d0 0x7f18280cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f18280c85d0 0x7f18280cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54140/0 (socket says 172.21.15.12:54140) 2023-10-08T17:41:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182e39b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f18280c8200 0x7f18280c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 -- 172.21.15.12:0/8972176 learned_addr learned my addr 172.21.15.12:0/8972176 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 -- 172.21.15.12:0/8972176 >> v2:172.21.15.29:3300/0 conn(0x7f18280c8200 msgr2=0x7f18280c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 --2- 172.21.15.12:0/8972176 >> v2:172.21.15.29:3300/0 conn(0x7f18280c8200 0x7f18280c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 -- 172.21.15.12:0/8972176 >> v1:172.21.15.29:6789/0 conn(0x7f18280c2a90 legacy=0x7f1828156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.381+0000 7f182eb9c700 1 -- 172.21.15.12:0/8972176 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18281573f0 con 0x7f18280c85d0 2023-10-08T17:41:17.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182eb9c700 1 --2- 172.21.15.12:0/8972176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c85d0 0x7f18280cc2f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f18280683d0 tx=0x7f1820009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11180d8c3fe3234d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182d399700 1 -- 172.21.15.12:0/8972176 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182000e070 con 0x7f18280c85d0 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182d399700 1 -- 172.21.15.12:0/8972176 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182000ba20 con 0x7f18280c85d0 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182d399700 1 -- 172.21.15.12:0/8972176 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18200092e0 con 0x7f18280c85d0 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182f39d700 1 -- 172.21.15.12:0/8972176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c85d0 msgr2=0x7f18280cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.382+0000 7f182f39d700 1 --2- 172.21.15.12:0/8972176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c85d0 0x7f18280cc2f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f18280683d0 tx=0x7f1820009840 comp rx=0 tx=0).stop 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 -- 172.21.15.12:0/8972176 shutdown_connections 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 --2- 172.21.15.12:0/8972176 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c85d0 0x7f18280cc2f0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 --2- 172.21.15.12:0/8972176 >> v2:172.21.15.29:3300/0 conn(0x7f18280c8200 0x7f18280c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 -- 172.21.15.12:0/8972176 >> 172.21.15.12:0/8972176 conn(0x7f182806c6a0 msgr2=0x7f182806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 -- 172.21.15.12:0/8972176 shutdown_connections 2023-10-08T17:41:17.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.383+0000 7f182f39d700 1 -- 172.21.15.12:0/8972176 wait complete. 2023-10-08T17:41:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.384+0000 7f182f39d700 1 Processor -- start 2023-10-08T17:41:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.384+0000 7f182f39d700 1 -- start start 2023-10-08T17:41:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18280c8200 0x7f182816b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18280c85d0 0x7f182814e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815c810 con 0x7f18280c2a90 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182815c380 con 0x7f18280c8200 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1828168920 con 0x7f18280c85d0 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.385+0000 7f182e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54144/0 (socket says 172.21.15.12:54144) 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 -- 172.21.15.12:0/494000924 learned_addr learned my addr 172.21.15.12:0/494000924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182db9a700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18280c8200 0x7f182816b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182eb9c700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18280c85d0 0x7f182814e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 -- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18280c85d0 msgr2=0x7f182814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18280c85d0 0x7f182814e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 -- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18280c8200 msgr2=0x7f182816b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18280c8200 0x7f182816b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 -- 172.21.15.12:0/494000924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009ae0 con 0x7f18280c2a90 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182e39b700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f182400ec80 tx=0x7f18240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400c9d0 con 0x7f18280c2a90 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182400cb30 con 0x7f18280c2a90 2023-10-08T17:41:17.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824013470 con 0x7f18280c2a90 2023-10-08T17:41:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.386+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182815b770 con 0x7f18280c2a90 2023-10-08T17:41:17.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.387+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182815bd30 con 0x7f18280c2a90 2023-10-08T17:41:17.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.388+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182804c3c0 con 0x7f18280c2a90 2023-10-08T17:41:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.388+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 93) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f18240137e0 con 0x7f18280c2a90 2023-10-08T17:41:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.389+0000 7f181e7fc700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 0x7f180c069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.389+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f1824084ed0 con 0x7f18280c2a90 2023-10-08T17:41:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.390+0000 7f182db9a700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 0x7f180c069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.390+0000 7f182db9a700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 0x7f180c069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18280ad4e0 tx=0x7f1818009040 comp rx=0 tx=0).ready entity=mgr.9507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.394+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1824051ba0 con 0x7f18280c2a90 2023-10-08T17:41:17.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.624+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f182815c4c0 con 0x7f180c0670a0 2023-10-08T17:41:17.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.679+0000 7f181e7fc700 1 -- 172.21.15.12:0/494000924 <== mgr.9507 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f1818003d00 con 0x7f180c0670a0 2023-10-08T17:41:17.681 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 msgr2=0x7f180c069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 0x7f180c069550 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f18280ad4e0 tx=0x7f1818009040 comp rx=0 tx=0).stop 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 msgr2=0x7f18281683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f182400ec80 tx=0x7f18240091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 shutdown_connections 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f180c0670a0 0x7f180c069550 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f18280c2a90 0x7f18281683e0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f18280c85d0 0x7f182814e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 --2- 172.21.15.12:0/494000924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f18280c8200 0x7f182816b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 >> 172.21.15.12:0/494000924 conn(0x7f182806c6a0 msgr2=0x7f182815a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 shutdown_connections 2023-10-08T17:41:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.682+0000 7f182f39d700 1 -- 172.21.15.12:0/494000924 wait complete. 2023-10-08T17:41:17.700 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-10-08T17:41:17.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:17.700 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-08T17:41:17.739 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_26_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_27_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_28_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_29_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_30_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_31_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_32_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_33_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_34_00_UTC 2023-10-08T17:41:17.740 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_35_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_36_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_37_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_38_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_39_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_40_00_UTC 2023-10-08T17:41:17.741 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_41_00_UTC 2023-10-08T17:41:17.742 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-10-08-17_26_00_UTC', 'scheduled-2023-10-08-17_27_00_UTC', 'scheduled-2023-10-08-17_28_00_UTC', 'scheduled-2023-10-08-17_29_00_UTC', 'scheduled-2023-10-08-17_30_00_UTC', 'scheduled-2023-10-08-17_31_00_UTC', 'scheduled-2023-10-08-17_32_00_UTC', 'scheduled-2023-10-08-17_33_00_UTC', 'scheduled-2023-10-08-17_34_00_UTC', 'scheduled-2023-10-08-17_35_00_UTC', 'scheduled-2023-10-08-17_36_00_UTC', 'scheduled-2023-10-08-17_37_00_UTC', 'scheduled-2023-10-08-17_38_00_UTC', 'scheduled-2023-10-08-17_39_00_UTC', 'scheduled-2023-10-08-17_40_00_UTC', 'scheduled-2023-10-08-17_41_00_UTC'] 2023-10-08T17:41:17.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-10-08T17:41:17.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.973+0000 7fd62af9d700 1 Processor -- start 2023-10-08T17:41:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.973+0000 7fd62af9d700 1 -- start start 2023-10-08T17:41:17.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd624153660 0x7fd6240c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 0x7fd624156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 0x7fd6240c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd624157250 con 0x7fd624153660 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6240c2200 con 0x7fd624153a30 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd62af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c15f0 con 0x7fd6240c8980 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd629f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd624153660 0x7fd6240c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd629f9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd624153660 0x7fd6240c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54152/0 (socket says 172.21.15.12:54152) 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.974+0000 7fd629f9b700 1 -- 172.21.15.12:0/2061035981 learned_addr learned my addr 172.21.15.12:0/2061035981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 -- 172.21.15.12:0/2061035981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 msgr2=0x7fd6240c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd62979a700 1 --2- 172.21.15.12:0/2061035981 >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 0x7fd624156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd62a79c700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 0x7fd6240c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 0x7fd6240c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 -- 172.21.15.12:0/2061035981 >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 msgr2=0x7fd624156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:17.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 --2- 172.21.15.12:0/2061035981 >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 0x7fd624156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 -- 172.21.15.12:0/2061035981 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6240c18d0 con 0x7fd624153660 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd62979a700 1 --2- 172.21.15.12:0/2061035981 >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 0x7fd624156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd62a79c700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 0x7fd6240c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd629f9b700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd624153660 0x7fd6240c0ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd6240c31b0 tx=0x7fd620009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8eda71eb13a48e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd628f99700 1 -- 172.21.15.12:0/2061035981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000b820 con 0x7fd624153660 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd628f99700 1 -- 172.21.15.12:0/2061035981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62000b980 con 0x7fd624153660 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.975+0000 7fd628f99700 1 -- 172.21.15.12:0/2061035981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62000bd20 con 0x7fd624153660 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 -- 172.21.15.12:0/2061035981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd624153660 msgr2=0x7fd6240c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd624153660 0x7fd6240c0ef0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd6240c31b0 tx=0x7fd620009250 comp rx=0 tx=0).stop 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 -- 172.21.15.12:0/2061035981 shutdown_connections 2023-10-08T17:41:17.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd6240c8980 0x7fd6240c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 --2- 172.21.15.12:0/2061035981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd624153660 0x7fd6240c0ef0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 --2- 172.21.15.12:0/2061035981 >> v2:172.21.15.29:3300/0 conn(0x7fd624153a30 0x7fd624156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 -- 172.21.15.12:0/2061035981 >> 172.21.15.12:0/2061035981 conn(0x7fd62406c6a0 msgr2=0x7fd62406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 -- 172.21.15.12:0/2061035981 shutdown_connections 2023-10-08T17:41:17.980 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.976+0000 7fd62af9d700 1 -- 172.21.15.12:0/2061035981 wait complete. 2023-10-08T17:41:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.977+0000 7fd62af9d700 1 Processor -- start 2023-10-08T17:41:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 -- start start 2023-10-08T17:41:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 0x7fd6240af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 0x7fd6240afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62416aa10 con 0x7fd6240c8980 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd624169d90 con 0x7fd624153a30 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.978+0000 7fd62af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd62416a070 con 0x7fd624153660 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54154/0 (socket says 172.21.15.12:54154) 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 -- 172.21.15.12:0/407644206 learned_addr learned my addr 172.21.15.12:0/407644206 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd62979a700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 0x7fd6240af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd62a79c700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 0x7fd6240afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 -- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 msgr2=0x7fd6240af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 0x7fd6240af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 -- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 msgr2=0x7fd6240afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 0x7fd6240afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 -- 172.21.15.12:0/407644206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6200094f0 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd62979a700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 0x7fd6240af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd62a79c700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 0x7fd6240afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.979+0000 7fd629f9b700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd6200094c0 tx=0x7fd620017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.980+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62001a420 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.980+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd62001a580 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.980+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd62001a940 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.980+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd62416a350 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.980+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd624151fe0 con 0x7fd6240c8980 2023-10-08T17:41:17.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.981+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62416ab50 con 0x7fd6240c8980 2023-10-08T17:41:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.982+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 93) v1 ==== 84871+0+0 (secure 0 0 0) 0x7fd62001ad30 con 0x7fd6240c8980 2023-10-08T17:41:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.983+0000 7fd619ffb700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 0x7fd608069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.983+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6714+0+0 (secure 0 0 0) 0x7fd620086620 con 0x7fd6240c8980 2023-10-08T17:41:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.983+0000 7fd62979a700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 0x7fd608069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:17.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.984+0000 7fd62979a700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 0x7fd608069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614008040 comp rx=0 tx=0).ready entity=mgr.9507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:17.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:17.987+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd62416ab50 con 0x7fd6240c8980 2023-10-08T17:41:18.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.214+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd62416ab50 con 0x7fd6080670a0 2023-10-08T17:41:18.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.221+0000 7fd619ffb700 1 -- 172.21.15.12:0/407644206 <== mgr.9507 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7fd62416ab50 con 0x7fd6080670a0 2023-10-08T17:41:18.222 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:18.222 INFO:teuthology.orchestra.run.smithi012.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T17:25:46", "first": "2023-10-08T17:26:00", "last": "2023-10-08T17:41:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.223+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 msgr2=0x7fd608069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.223+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 0x7fd608069550 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614008040 comp rx=0 tx=0).stop 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.223+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 msgr2=0x7fd624151aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.223+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fd6200094c0 tx=0x7fd620017000 comp rx=0 tx=0).stop 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 shutdown_connections 2023-10-08T17:41:18.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd6080670a0 0x7fd608069550 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd6240c8980 0x7fd624151aa0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd624153a30 0x7fd6240afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 --2- 172.21.15.12:0/407644206 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd624153660 0x7fd6240af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 >> 172.21.15.12:0/407644206 conn(0x7fd62406c6a0 msgr2=0x7fd6240b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 shutdown_connections 2023-10-08T17:41:18.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.224+0000 7fd62af9d700 1 -- 172.21.15.12:0/407644206 wait complete. 2023-10-08T17:41:18.243 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-10-08T00:00:00", "created": "2023-10-08T17:25:46", "first": "2023-10-08T17:26:00", "last": "2023-10-08T17:41:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-10-08T17:41:18.243 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-10-08T00:00:00', 'created': '2023-10-08T17:25:46', 'first': '2023-10-08T17:26:00', 'last': '2023-10-08T17:41:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-10-08T17:41:18.243 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 16 2023-10-08T17:41:18.243 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 16 2023-10-08T17:41:18.243 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-10-08T17:41:18.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.436+0000 7f8b0739d700 1 Processor -- start 2023-10-08T17:41:18.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.436+0000 7f8b0739d700 1 -- start start 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0739d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8b000c85d0 0x7f8b000cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0739d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b001571b0 con 0x7f8b000c2a90 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0739d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b001579b0 con 0x7f8b000c85d0 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000c1390 con 0x7f8b000c8200 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b05b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8b000c2a90 0x7f8b00156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:42674/0 (socket says 172.21.15.12:42674) 2023-10-08T17:41:18.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b05b9a700 1 -- 172.21.15.12:0/3081225101 learned_addr learned my addr 172.21.15.12:0/3081225101 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b06b9c700 1 --2- 172.21.15.12:0/3081225101 >> v2:172.21.15.12:3300/0 conn(0x7f8b000c85d0 0x7f8b000cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b0639b700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b05399700 1 -- 172.21.15.12:0/3081225101 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2908394761 0 0) 0x7f8af0001110 con 0x7f8b000c2a90 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.438+0000 7f8b05399700 1 -- 172.21.15.12:0/3081225101 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aec003570 con 0x7f8b000c2a90 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b06b9c700 1 -- 172.21.15.12:0/3081225101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 msgr2=0x7f8b000c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:18.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b06b9c700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b06b9c700 1 -- 172.21.15.12:0/3081225101 >> v1:172.21.15.12:6789/0 conn(0x7f8b000c2a90 legacy=0x7f8b00156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b06b9c700 1 -- 172.21.15.12:0/3081225101 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b001573f0 con 0x7f8b000c85d0 2023-10-08T17:41:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b0639b700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:18.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b06b9c700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c85d0 0x7f8b000cc2f0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009e60 tx=0x7f8af8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bcfe98b2eb543c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b05399700 1 -- 172.21.15.12:0/3081225101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af800e070 con 0x7f8b000c85d0 2023-10-08T17:41:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b05399700 1 -- 172.21.15.12:0/3081225101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af800bb60 con 0x7f8b000c85d0 2023-10-08T17:41:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.439+0000 7f8b05399700 1 -- 172.21.15.12:0/3081225101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8012430 con 0x7f8b000c85d0 2023-10-08T17:41:18.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 -- 172.21.15.12:0/3081225101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c85d0 msgr2=0x7f8b000cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c85d0 0x7f8b000cc2f0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f8af8009e60 tx=0x7f8af8009780 comp rx=0 tx=0).stop 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 -- 172.21.15.12:0/3081225101 shutdown_connections 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c85d0 0x7f8b000cc2f0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 --2- 172.21.15.12:0/3081225101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 -- 172.21.15.12:0/3081225101 >> 172.21.15.12:0/3081225101 conn(0x7f8b0006c6a0 msgr2=0x7f8b0006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 -- 172.21.15.12:0/3081225101 shutdown_connections 2023-10-08T17:41:18.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.440+0000 7f8b0739d700 1 -- 172.21.15.12:0/3081225101 wait complete. 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.441+0000 7f8b0739d700 1 Processor -- start 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.441+0000 7f8b0739d700 1 -- start start 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b000c85d0 0x7f8b000cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000b10d0 con 0x7f8b000c2a90 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000ab860 con 0x7f8b000c85d0 2023-10-08T17:41:18.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.442+0000 7f8b0739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000ac100 con 0x7f8b000c8200 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54176/0 (socket says 172.21.15.12:54176) 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 -- 172.21.15.12:0/1375410839 learned_addr learned my addr 172.21.15.12:0/1375410839 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b05b9a700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b06b9c700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b000c85d0 0x7f8b000cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 -- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 msgr2=0x7f8b000cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 -- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b000c85d0 msgr2=0x7f8b000cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b000c85d0 0x7f8b000cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 -- 172.21.15.12:0/1375410839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8009a20 con 0x7f8b000c2a90 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.443+0000 7f8b0639b700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00e900 tx=0x7f8afc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.444+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00eea0 con 0x7f8b000c2a90 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.444+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8afc00c5e0 con 0x7f8b000c2a90 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.444+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00c980 con 0x7f8b000c2a90 2023-10-08T17:41:18.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.444+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0013fcf0 con 0x7f8b000c2a90 2023-10-08T17:41:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.444+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b000abab0 con 0x7f8b000c2a90 2023-10-08T17:41:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.445+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000ac3e0 con 0x7f8b000c2a90 2023-10-08T17:41:18.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.446+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 93) v1 ==== 84871+0+0 (secure 0 0 0) 0x7f8afc00cd30 con 0x7f8b000c2a90 2023-10-08T17:41:18.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.447+0000 7f8af67fc700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 0x7f8ae4069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:18.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.447+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f8afc084b00 con 0x7f8b000c2a90 2023-10-08T17:41:18.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.447+0000 7f8b05b9a700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 0x7f8ae4069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:18.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.448+0000 7f8b05b9a700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 0x7f8ae4069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8b000ab810 tx=0x7f8af0009040 comp rx=0 tx=0).ready entity=mgr.9507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:18.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.451+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8afc086e60 con 0x7f8b000c2a90 2023-10-08T17:41:18.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.679+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b00150a90 con 0x7f8ae40670a0 2023-10-08T17:41:18.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.742+0000 7f8af67fc700 1 -- 172.21.15.12:0/1375410839 <== mgr.9507 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f8b00150a90 con 0x7f8ae40670a0 2023-10-08T17:41:18.743 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.744+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 msgr2=0x7f8ae4069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.744+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 0x7f8ae4069550 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8b000ab810 tx=0x7f8af0009040 comp rx=0 tx=0).stop 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.744+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 msgr2=0x7f8b000b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.744+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00e900 tx=0x7f8afc008040 comp rx=0 tx=0).stop 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.744+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 shutdown_connections 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8ae40670a0 0x7f8ae4069550 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8b000c2a90 0x7f8b000b0b90 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.746 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8b000c85d0 0x7f8b000cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 --2- 172.21.15.12:0/1375410839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8b000c8200 0x7f8b000cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:18.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 >> 172.21.15.12:0/1375410839 conn(0x7f8b0006c6a0 msgr2=0x7f8b00149cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:18.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 shutdown_connections 2023-10-08T17:41:18.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:18.745+0000 7f8b0739d700 1 -- 172.21.15.12:0/1375410839 wait complete. 2023-10-08T17:41:18.763 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-10-08T17:41:18.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:18.763 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_26_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_27_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_28_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_29_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_30_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_31_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_32_00_UTC 2023-10-08T17:41:18.802 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_33_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_34_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_35_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_36_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_37_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_38_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_39_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_40_00_UTC 2023-10-08T17:41:18.803 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_41_00_UTC 2023-10-08T17:41:18.804 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_26_00_UTC 2023-10-08T17:41:18.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:18.804 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_26_00_UTC) 2023-10-08T17:41:18.889 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_27_00_UTC 2023-10-08T17:41:18.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:18.890 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_27_00_UTC) 2023-10-08T17:41:18.974 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_28_00_UTC 2023-10-08T17:41:18.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:18.974 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_28_00_UTC) 2023-10-08T17:41:19.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_29_00_UTC 2023-10-08T17:41:19.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.058 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_29_00_UTC) 2023-10-08T17:41:19.141 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_30_00_UTC 2023-10-08T17:41:19.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.142 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_30_00_UTC) 2023-10-08T17:41:19.226 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_31_00_UTC 2023-10-08T17:41:19.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.226 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_31_00_UTC) 2023-10-08T17:41:19.312 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_32_00_UTC 2023-10-08T17:41:19.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.312 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_32_00_UTC) 2023-10-08T17:41:19.396 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_33_00_UTC 2023-10-08T17:41:19.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.396 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_33_00_UTC) 2023-10-08T17:41:19.479 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_34_00_UTC 2023-10-08T17:41:19.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.480 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_34_00_UTC) 2023-10-08T17:41:19.563 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_35_00_UTC 2023-10-08T17:41:19.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.564 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_35_00_UTC) 2023-10-08T17:41:19.649 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_36_00_UTC 2023-10-08T17:41:19.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.649 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_36_00_UTC) 2023-10-08T17:41:19.732 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_37_00_UTC 2023-10-08T17:41:19.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.733 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_37_00_UTC) 2023-10-08T17:41:19.816 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_38_00_UTC 2023-10-08T17:41:19.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.817 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_38_00_UTC) 2023-10-08T17:41:19.900 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_39_00_UTC 2023-10-08T17:41:19.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.900 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_39_00_UTC) 2023-10-08T17:41:19.984 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_40_00_UTC 2023-10-08T17:41:19.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:19.984 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_40_00_UTC) 2023-10-08T17:41:20.067 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_41_00_UTC 2023-10-08T17:41:20.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:20.067 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-10-08-17_41_00_UTC) 2023-10-08T17:41:20.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:20.151 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-10-08T17:41:20.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T17:41:20.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.462+0000 7ffa2179d700 1 Processor -- start 2023-10-08T17:41:20.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.462+0000 7ffa2179d700 1 -- start start 2023-10-08T17:41:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.463+0000 7ffa2179d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa1c153a00 0x7ffa1c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.463+0000 7ffa2179d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa1c15de50 0x7ffa1c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.463+0000 7ffa2179d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c15af60 con 0x7ffa1c0cea00 2023-10-08T17:41:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa2179d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c15d010 con 0x7ffa1c15de50 2023-10-08T17:41:20.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa2179d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c15b240 con 0x7ffa1c153a00 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa1c15de50 0x7ffa1c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa1c15de50 0x7ffa1c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54180/0 (socket says 172.21.15.12:54180) 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/619262941 learned_addr learned my addr 172.21.15.12:0/619262941 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1bfff700 1 --2- 172.21.15.12:0/619262941 >> v2:172.21.15.29:3300/0 conn(0x7ffa1c153a00 0x7ffa1c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/619262941 >> v2:172.21.15.29:3300/0 conn(0x7ffa1c153a00 msgr2=0x7ffa1c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 --2- 172.21.15.12:0/619262941 >> v2:172.21.15.29:3300/0 conn(0x7ffa1c153a00 0x7ffa1c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/619262941 >> v1:172.21.15.29:6789/0 conn(0x7ffa1c0cea00 legacy=0x7ffa1c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/619262941 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c15b520 con 0x7ffa1c15de50 2023-10-08T17:41:20.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.464+0000 7ffa1b7fe700 1 --2- 172.21.15.12:0/619262941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15a540 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cac20 tx=0x7ffa10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dbe10e6bb982c78 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:20.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa1affd700 1 -- 172.21.15.12:0/619262941 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000b820 con 0x7ffa1c15de50 2023-10-08T17:41:20.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa1affd700 1 -- 172.21.15.12:0/619262941 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1000b980 con 0x7ffa1c15de50 2023-10-08T17:41:20.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa1affd700 1 -- 172.21.15.12:0/619262941 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1000bd20 con 0x7ffa1c15de50 2023-10-08T17:41:20.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 -- 172.21.15.12:0/619262941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c15de50 msgr2=0x7ffa1c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:20.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 --2- 172.21.15.12:0/619262941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15a540 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0cac20 tx=0x7ffa10009250 comp rx=0 tx=0).stop 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 -- 172.21.15.12:0/619262941 shutdown_connections 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 --2- 172.21.15.12:0/619262941 >> v2:172.21.15.29:3300/0 conn(0x7ffa1c153a00 0x7ffa1c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 --2- 172.21.15.12:0/619262941 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15a540 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 -- 172.21.15.12:0/619262941 >> 172.21.15.12:0/619262941 conn(0x7ffa1c0703a0 msgr2=0x7ffa1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 -- 172.21.15.12:0/619262941 shutdown_connections 2023-10-08T17:41:20.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.465+0000 7ffa2179d700 1 -- 172.21.15.12:0/619262941 wait complete. 2023-10-08T17:41:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.467+0000 7ffa2179d700 1 Processor -- start 2023-10-08T17:41:20.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.467+0000 7ffa2179d700 1 -- start start 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa1c0cea00 0x7ffa1c145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0b3820 con 0x7ffa1c153a00 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c8e70 con 0x7ffa1c15de50 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa2179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c9150 con 0x7ffa1c0cea00 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa1b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa1b7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54184/0 (socket says 172.21.15.12:54184) 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/1173681872 learned_addr learned my addr 172.21.15.12:0/1173681872 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa1bfff700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa1c0cea00 0x7ffa1c145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.468+0000 7ffa20f9c700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa1c0cea00 msgr2=0x7ffa1c145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa1c0cea00 0x7ffa1c145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c15de50 msgr2=0x7ffa1c15c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:20.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 -- 172.21.15.12:0/1173681872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa100094f0 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa1b7fe700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ffa100030c0 tx=0x7ffa10016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10011e60 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10020070 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c0c9430 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1001b6a0 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.469+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c1463c0 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.470+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c0b3d00 con 0x7ffa1c153a00 2023-10-08T17:41:20.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.471+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 93) v1 ==== 84871+0+0 (secure 0 0 0) 0x7ffa10022030 con 0x7ffa1c153a00 2023-10-08T17:41:20.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.472+0000 7ffa03fff700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 0x7ffa08069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:20.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.472+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6714+0+0 (secure 0 0 0) 0x7ffa10086b50 con 0x7ffa1c153a00 2023-10-08T17:41:20.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.472+0000 7ffa1bfff700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 0x7ffa08069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:20.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.473+0000 7ffa1bfff700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 0x7ffa08069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c006fd0 tx=0x7ffa0c008040 comp rx=0 tx=0).ready entity=mgr.9507 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:20.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.476+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa1c0b3d00 con 0x7ffa1c153a00 2023-10-08T17:41:20.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:20.739+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7ffa1c0b3d00 con 0x7ffa1c153a00 2023-10-08T17:41:21.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.322+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7ffa10053bf0 con 0x7ffa1c153a00 2023-10-08T17:41:21.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.323+0000 7ffa03fff700 1 -- 172.21.15.12:0/1173681872 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v94) v1 ==== 93+0+0 (secure 0 0 0) 0x7ffa100572b0 con 0x7ffa1c153a00 2023-10-08T17:41:21.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 msgr2=0x7ffa08069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:21.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 0x7ffa08069550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c006fd0 tx=0x7ffa0c008040 comp rx=0 tx=0).stop 2023-10-08T17:41:21.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 msgr2=0x7ffa1c15bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ffa100030c0 tx=0x7ffa10016000 comp rx=0 tx=0).stop 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 shutdown_connections 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa080670a0 0x7ffa08069550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa1c15de50 0x7ffa1c15c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa1c0cea00 0x7ffa1c145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 --2- 172.21.15.12:0/1173681872 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa1c153a00 0x7ffa1c15bf00 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 >> 172.21.15.12:0/1173681872 conn(0x7ffa1c0703a0 msgr2=0x7ffa1c0d0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 shutdown_connections 2023-10-08T17:41:21.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:21.328+0000 7ffa2179d700 1 -- 172.21.15.12:0/1173681872 wait complete. 2023-10-08T17:41:21.348 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:41:21.348 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:41:21.434 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:41:21.513 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:41:22.390 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T17:41:22.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:22.390 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T17:41:22.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:41:22.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:22.814 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T17:41:22.815 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:22.669+0000 7f3cd90dd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:41:22.815 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:22.670+0000 7f1239ec8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:41:22.843 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:22.842+0000 7f1239ec8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:22.992 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:22.842+0000 7f3cd90dd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:22.992 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:22.931+0000 7f3cd90dd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:41:22.993 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:22.993 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:22.931+0000 7f1239ec8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:41:23.166 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:23.164+0000 7f3cd90dd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:23.167 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:23.167+0000 7f1239ec8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:23.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.222+0000 7f7e46d9d700 1 Processor -- start 2023-10-08T17:41:23.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.222+0000 7f7e46d9d700 1 -- start start 2023-10-08T17:41:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 0x7f7e4015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e46d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7e4013fef0 0x7f7e400c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e46d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4015ae70 con 0x7f7e4006aaa0 2023-10-08T17:41:23.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e46d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e4006af60 con 0x7f7e4013fef0 2023-10-08T17:41:23.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e46d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4006b240 con 0x7f7e4013fb20 2023-10-08T17:41:23.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e4659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7e4006aaa0 0x7f7e400c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59782/0 (socket says 172.21.15.12:59782) 2023-10-08T17:41:23.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e4659c700 1 -- 172.21.15.12:0/1605915114 learned_addr learned my addr 172.21.15.12:0/1605915114 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:23.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e45d9b700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 0x7f7e4015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.223+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1605915114 >> v2:172.21.15.29:3300/0 conn(0x7f7e4013fef0 0x7f7e400c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e44d99700 1 -- 172.21.15.12:0/1605915114 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 241933126 0 0) 0x7f7e38001490 con 0x7f7e4006aaa0 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e44d99700 1 -- 172.21.15.12:0/1605915114 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2c003570 con 0x7f7e4006aaa0 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e4559a700 1 -- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 msgr2=0x7f7e4015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 0x7f7e4015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e4559a700 1 -- 172.21.15.12:0/1605915114 >> v1:172.21.15.12:6789/0 conn(0x7f7e4006aaa0 legacy=0x7f7e400c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e4559a700 1 -- 172.21.15.12:0/1605915114 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4006b520 con 0x7f7e4013fef0 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e45d9b700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 0x7f7e4015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:23.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.224+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fef0 0x7f7e400c7990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098d0 tx=0x7f7e30009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9111fdfe242ec5c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e44d99700 1 -- 172.21.15.12:0/1605915114 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30005c10 con 0x7f7e4013fef0 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e44d99700 1 -- 172.21.15.12:0/1605915114 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e30005d70 con 0x7f7e4013fef0 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e44d99700 1 -- 172.21.15.12:0/1605915114 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e30006260 con 0x7f7e4013fef0 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fef0 msgr2=0x7f7e400c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fef0 0x7f7e400c7990 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f7e300098d0 tx=0x7f7e30009120 comp rx=0 tx=0).stop 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1605915114 shutdown_connections 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fb20 0x7f7e4015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1605915114 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fef0 0x7f7e400c7990 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1605915114 >> 172.21.15.12:0/1605915114 conn(0x7f7e4006d170 msgr2=0x7f7e400cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:23.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1605915114 shutdown_connections 2023-10-08T17:41:23.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.225+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1605915114 wait complete. 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.228+0000 7f7e46d9d700 1 Processor -- start 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.228+0000 7f7e46d9d700 1 -- start start 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fb20 0x7f7e40155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fef0 0x7f7e400b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400ad0f0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400c2ee0 con 0x7f7e4013fb20 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e400c8240 con 0x7f7e4013fef0 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51536/0 (socket says 172.21.15.12:51536) 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 -- 172.21.15.12:0/1713184476 learned_addr learned my addr 172.21.15.12:0/1713184476 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fb20 0x7f7e40155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e4659c700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fef0 0x7f7e400b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fef0 msgr2=0x7f7e400b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fef0 0x7f7e400b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fb20 msgr2=0x7f7e40155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fb20 0x7f7e40155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 -- 172.21.15.12:0/1713184476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c009420 con 0x7f7e4006aaa0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e45d9b700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ec80 tx=0x7f7e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00c920 con 0x7f7e4006aaa0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3c00ca80 con 0x7f7e4006aaa0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3c00ce00 con 0x7f7e4006aaa0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e300093c0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.229+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e400c1d70 con 0x7f7e4006aaa0 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.230+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e400c7ae0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.231+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f7e3c013680 con 0x7f7e4006aaa0 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.232+0000 7f7e35ffb700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 0x7f7e24069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.232+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 6714+0+0 (secure 0 0 0) 0x7f7e3c084f20 con 0x7f7e4006aaa0 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.232+0000 7f7e4559a700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 msgr2=0x7f7e24069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:23.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.233+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 0x7f7e24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:23.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.238+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e400c7ae0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.374 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:23.373+0000 7f3cd90dd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:41:23.385 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:23.384+0000 7f1239ec8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:41:23.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.434+0000 7f7e4559a700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 msgr2=0x7f7e24069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:23.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.434+0000 7f7e4559a700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 0x7f7e24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:23.488 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:23.488+0000 7f1239ec8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:41:23.498 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:23.497+0000 7f3cd90dd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:41:23.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.526+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e400c7ae0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.527+0000 7f7e35ffb700 1 -- 172.21.15.12:0/1713184476 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f7e400c7ae0 con 0x7f7e4006aaa0 2023-10-08T17:41:23.528 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:23.528 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:41:23.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 msgr2=0x7f7e24069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 0x7f7e24069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 msgr2=0x7f7e400c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f7e3c00ec80 tx=0x7f7e3c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 shutdown_connections 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e24067050 0x7f7e24069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e4006aaa0 0x7f7e400c29a0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e4013fef0 0x7f7e400b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 --2- 172.21.15.12:0/1713184476 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e4013fb20 0x7f7e40155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 >> 172.21.15.12:0/1713184476 conn(0x7f7e4006d170 msgr2=0x7f7e4013eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 shutdown_connections 2023-10-08T17:41:23.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.529+0000 7f7e46d9d700 1 -- 172.21.15.12:0/1713184476 wait complete. 2023-10-08T17:41:23.532 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:41:23.550 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:23.674 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:23.673+0000 7f1239ec8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:41:23.688 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:23.687+0000 7f3cd90dd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:41:23.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.787+0000 7fbf9239d700 1 Processor -- start 2023-10-08T17:41:23.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.787+0000 7fbf9239d700 1 -- start start 2023-10-08T17:41:23.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9239d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbf8c15de50 0x7fbf8c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbf8c0cef40 0x7fbf8c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9239d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0cf3c0 con 0x7fbf8c153c30 2023-10-08T17:41:23.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9239d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c15afd0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9239d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c15b2b0 con 0x7fbf8c15de50 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9139b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fbf8c153c30 0x7fbf8c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59794/0 (socket says 172.21.15.12:59794) 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf9139b700 1 -- 172.21.15.12:0/3816699207 learned_addr learned my addr 172.21.15.12:0/3816699207 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf91b9c700 1 --2- 172.21.15.12:0/3816699207 >> v2:172.21.15.12:3300/0 conn(0x7fbf8c0cef40 0x7fbf8c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf90b9a700 1 --2- 172.21.15.12:0/3816699207 >> v2:172.21.15.29:3300/0 conn(0x7fbf8c15de50 0x7fbf8c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf91b9c700 1 -- 172.21.15.12:0/3816699207 >> v2:172.21.15.29:3300/0 conn(0x7fbf8c15de50 msgr2=0x7fbf8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf91b9c700 1 --2- 172.21.15.12:0/3816699207 >> v2:172.21.15.29:3300/0 conn(0x7fbf8c15de50 0x7fbf8c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf91b9c700 1 -- 172.21.15.12:0/3816699207 >> v1:172.21.15.12:6789/0 conn(0x7fbf8c153c30 legacy=0x7fbf8c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.788+0000 7fbf91b9c700 1 -- 172.21.15.12:0/3816699207 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c15b590 con 0x7fbf8c0cef40 2023-10-08T17:41:23.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf91b9c700 1 --2- 172.21.15.12:0/3816699207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c15c070 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0713a0 tx=0x7fbf84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e54257833a5c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf83fff700 1 -- 172.21.15.12:0/3816699207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf8400e070 con 0x7fbf8c0cef40 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf83fff700 1 -- 172.21.15.12:0/3816699207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf8400bb60 con 0x7fbf8c0cef40 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf83fff700 1 -- 172.21.15.12:0/3816699207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84012430 con 0x7fbf8c0cef40 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf9239d700 1 -- 172.21.15.12:0/3816699207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 msgr2=0x7fbf8c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.790+0000 7fbf9239d700 1 --2- 172.21.15.12:0/3816699207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c15c070 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c0713a0 tx=0x7fbf84009780 comp rx=0 tx=0).stop 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 -- 172.21.15.12:0/3816699207 shutdown_connections 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 --2- 172.21.15.12:0/3816699207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c15c070 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 --2- 172.21.15.12:0/3816699207 >> v2:172.21.15.29:3300/0 conn(0x7fbf8c15de50 0x7fbf8c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 -- 172.21.15.12:0/3816699207 >> 172.21.15.12:0/3816699207 conn(0x7fbf8c0703a0 msgr2=0x7fbf8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 -- 172.21.15.12:0/3816699207 shutdown_connections 2023-10-08T17:41:23.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.791+0000 7fbf9239d700 1 -- 172.21.15.12:0/3816699207 wait complete. 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.792+0000 7fbf9239d700 1 Processor -- start 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.792+0000 7fbf9239d700 1 -- start start 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 0x7fbf8c0b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8c15de50 0x7fbf8c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0cbdc0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0cb1b0 con 0x7fbf8c15de50 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0cb490 con 0x7fbf8c153c30 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.793+0000 7fbf9139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51552/0 (socket says 172.21.15.12:51552) 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 -- 172.21.15.12:0/4207991957 learned_addr learned my addr 172.21.15.12:0/4207991957 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf90b9a700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 0x7fbf8c0b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf91b9c700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8c15de50 0x7fbf8c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 msgr2=0x7fbf8c0b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 0x7fbf8c0b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8c15de50 msgr2=0x7fbf8c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8c15de50 0x7fbf8c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 -- 172.21.15.12:0/4207991957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84009a20 con 0x7fbf8c0cef40 2023-10-08T17:41:23.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf90b9a700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 0x7fbf8c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.794+0000 7fbf9139b700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c560 tx=0x7fbf88001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.795+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88005b30 con 0x7fbf8c0cef40 2023-10-08T17:41:23.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.795+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf88005c90 con 0x7fbf8c0cef40 2023-10-08T17:41:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.795+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf88007320 con 0x7fbf8c0cef40 2023-10-08T17:41:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.795+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0cb770 con 0x7fbf8c0cef40 2023-10-08T17:41:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.795+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c1523f0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.796+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c04c3c0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.798+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fbf8801b3b0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.799+0000 7fbf817fa700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 0x7fbf70069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.799+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fbf88083f20 con 0x7fbf8c0cef40 2023-10-08T17:41:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.799+0000 7fbf90b9a700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 msgr2=0x7fbf70069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:23.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.799+0000 7fbf90b9a700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 0x7fbf70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:23.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:23.802+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf88050bb0 con 0x7fbf8c0cef40 2023-10-08T17:41:23.812 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:23.811+0000 7f1239ec8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:23.813 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:23.812+0000 7f3cd90dd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:24.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.000+0000 7fbf90b9a700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 msgr2=0x7fbf70069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:24.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.000+0000 7fbf90b9a700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 0x7fbf70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:24.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.051+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf8c0caef0 con 0x7fbf8c0cef40 2023-10-08T17:41:24.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.052+0000 7fbf817fa700 1 -- 172.21.15.12:0/4207991957 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17022 (secure 0 0 0) 0x7fbf88017090 con 0x7fbf8c0cef40 2023-10-08T17:41:24.052 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:24.052 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":186,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:23.327621+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":186,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2436623509":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/2405396815":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/681896466":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/1092834905":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/3103985745":"2023-10-09T17:36:23.502469+0000","172.21.15.12:6837/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2272258934":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/62325":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/680523626":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2149521500":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/1052084506":"2023-10-09T17:25:45.435602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 msgr2=0x7fbf70069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 0x7fbf70069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 msgr2=0x7fbf8c151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7fbf8800c560 tx=0x7fbf88001020 comp rx=0 tx=0).stop 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 shutdown_connections 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbf70067050 0x7fbf70069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbf8c0cef40 0x7fbf8c151eb0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbf8c15de50 0x7fbf8c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 --2- 172.21.15.12:0/4207991957 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbf8c153c30 0x7fbf8c0b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 >> 172.21.15.12:0/4207991957 conn(0x7fbf8c0703a0 msgr2=0x7fbf8c0c6720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 shutdown_connections 2023-10-08T17:41:24.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.054+0000 7fbf9239d700 1 -- 172.21.15.12:0/4207991957 wait complete. 2023-10-08T17:41:24.073 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T17:25:25.442868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '180', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T17:25:26.684792+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '186', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 33, 'snap_epoch': 186, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T17:41:24.073 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:41:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.269+0000 7f1ae559d700 1 Processor -- start 2023-10-08T17:41:24.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.269+0000 7f1ae559d700 1 -- start start 2023-10-08T17:41:24.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.270+0000 7f1ae559d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ae0153c90 0x7f1ae015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.270+0000 7f1ae559d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1ae006db20 0x7f1ae00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.270+0000 7f1ae559d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae015ada0 con 0x7f1ae0154060 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.270+0000 7f1ae559d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae006ca80 con 0x7f1ae0153c90 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.270+0000 7f1ae559d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae006cd60 con 0x7f1ae006db20 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ae0153c90 0x7f1ae015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1ae0153c90 0x7f1ae015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51568/0 (socket says 172.21.15.12:51568) 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 -- 172.21.15.12:0/1258007761 learned_addr learned my addr 172.21.15.12:0/1258007761 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adf7fe700 1 --2- 172.21.15.12:0/1258007761 >> v2:172.21.15.29:3300/0 conn(0x7f1ae006db20 0x7f1ae00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 -- 172.21.15.12:0/1258007761 >> v2:172.21.15.29:3300/0 conn(0x7f1ae006db20 msgr2=0x7f1ae00ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 --2- 172.21.15.12:0/1258007761 >> v2:172.21.15.29:3300/0 conn(0x7f1ae006db20 0x7f1ae00ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 -- 172.21.15.12:0/1258007761 >> v1:172.21.15.29:6789/0 conn(0x7f1ae0154060 legacy=0x7f1ae006a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 -- 172.21.15.12:0/1258007761 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae006d040 con 0x7f1ae0153c90 2023-10-08T17:41:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.271+0000 7f1adffff700 1 --2- 172.21.15.12:0/1258007761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae015a860 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00cc300 tx=0x7f1ad0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e0751fecd499ca server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1adeffd700 1 -- 172.21.15.12:0/1258007761 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000b860 con 0x7f1ae0153c90 2023-10-08T17:41:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1adeffd700 1 -- 172.21.15.12:0/1258007761 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad000b9c0 con 0x7f1ae0153c90 2023-10-08T17:41:24.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1adeffd700 1 -- 172.21.15.12:0/1258007761 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad000bd60 con 0x7f1ae0153c90 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 -- 172.21.15.12:0/1258007761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 msgr2=0x7f1ae015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 --2- 172.21.15.12:0/1258007761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae015a860 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1ae00cc300 tx=0x7f1ad0009250 comp rx=0 tx=0).stop 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 -- 172.21.15.12:0/1258007761 shutdown_connections 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 --2- 172.21.15.12:0/1258007761 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae015a860 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 --2- 172.21.15.12:0/1258007761 >> v2:172.21.15.29:3300/0 conn(0x7f1ae006db20 0x7f1ae00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 -- 172.21.15.12:0/1258007761 >> 172.21.15.12:0/1258007761 conn(0x7f1ae006e720 msgr2=0x7f1ae006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 -- 172.21.15.12:0/1258007761 shutdown_connections 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.272+0000 7f1ae559d700 1 -- 172.21.15.12:0/1258007761 wait complete. 2023-10-08T17:41:24.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.274+0000 7f1ae559d700 1 Processor -- start 2023-10-08T17:41:24.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.274+0000 7f1ae559d700 1 -- start start 2023-10-08T17:41:24.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae006db20 0x7f1ae014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae0154060 0x7f1ae0151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0169d90 con 0x7f1ae0153c90 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0169fa0 con 0x7f1ae006db20 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae559d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae016a240 con 0x7f1ae0154060 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1adf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1adffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae006db20 0x7f1ae014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1adf7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51574/0 (socket says 172.21.15.12:51574) 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1adf7fe700 1 -- 172.21.15.12:0/2711410314 learned_addr learned my addr 172.21.15.12:0/2711410314 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:24.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.275+0000 7f1ae4d9c700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae0154060 0x7f1ae0151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae0154060 msgr2=0x7f1ae0151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae0154060 0x7f1ae0151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae006db20 msgr2=0x7f1ae014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae006db20 0x7f1ae014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 -- 172.21.15.12:0/2711410314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad00094f0 con 0x7f1ae0153c90 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1adf7fe700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d890 tx=0x7f1ad4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4012630 con 0x7f1ae0153c90 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad4012790 con 0x7f1ae0153c90 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4012b30 con 0x7f1ae0153c90 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae016a520 con 0x7f1ae0153c90 2023-10-08T17:41:24.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.276+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae016aae0 con 0x7f1ae0153c90 2023-10-08T17:41:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.278+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae004c3c0 con 0x7f1ae0153c90 2023-10-08T17:41:24.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.279+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f1ad401d400 con 0x7f1ae0153c90 2023-10-08T17:41:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.280+0000 7f1ac7fff700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 0x7f1acc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.280+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f1ad4084ef0 con 0x7f1ae0153c90 2023-10-08T17:41:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.280+0000 7f1adffff700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 msgr2=0x7f1acc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:24.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.280+0000 7f1adffff700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 0x7f1acc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:24.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.284+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ad4055610 con 0x7f1ae0153c90 2023-10-08T17:41:24.338 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:24.337+0000 7f3cd90dd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:41:24.362 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:24.362+0000 7f1239ec8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:41:24.438 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:24.437+0000 7f3cd90dd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:41:24.462 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:24.463+0000 7f1239ec8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:41:24.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.481+0000 7f1adffff700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 msgr2=0x7f1acc069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:24.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.481+0000 7f1adffff700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 0x7f1acc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:24.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.490+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ae0159bc0 con 0x7f1ae0153c90 2023-10-08T17:41:24.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.490+0000 7f1ac7fff700 1 -- 172.21.15.12:0/2711410314 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v186) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ad40551a0 con 0x7f1ae0153c90 2023-10-08T17:41:24.490 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 msgr2=0x7f1acc069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 0x7f1acc069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 msgr2=0x7f1ae00c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f1ad400d890 tx=0x7f1ad4008040 comp rx=0 tx=0).stop 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 shutdown_connections 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1acc067050 0x7f1acc069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1ae0154060 0x7f1ae0151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1ae006db20 0x7f1ae014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 --2- 172.21.15.12:0/2711410314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1ae0153c90 0x7f1ae00c8210 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 >> 172.21.15.12:0/2711410314 conn(0x7f1ae006e720 msgr2=0x7f1ae00c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 shutdown_connections 2023-10-08T17:41:24.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.493+0000 7f1ae559d700 1 -- 172.21.15.12:0/2711410314 wait complete. 2023-10-08T17:41:24.511 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T17:41:24.532 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:24.530+0000 7f3cd90dd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:41:24.560 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:24.560+0000 7f1239ec8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:41:24.703 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.703+0000 7efee7fff700 1 Processor -- start 2023-10-08T17:41:24.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.703+0000 7efee7fff700 1 -- start start 2023-10-08T17:41:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7efee806de50 0x7efee80c7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee7fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee815b640 con 0x7efee8140a70 2023-10-08T17:41:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee7fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee815b920 con 0x7efee806a210 2023-10-08T17:41:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee7fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee80c6800 con 0x7efee806de50 2023-10-08T17:41:24.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7efee8140a70 0x7efee8069b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59802/0 (socket says 172.21.15.12:59802) 2023-10-08T17:41:24.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee6ffd700 1 -- 172.21.15.12:0/819927602 learned_addr learned my addr 172.21.15.12:0/819927602 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:24.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.705+0000 7efee77fe700 1 --2- 172.21.15.12:0/819927602 >> v2:172.21.15.29:3300/0 conn(0x7efee806de50 0x7efee80c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544024864 0 0) 0x7efee815b640 con 0x7efee8140a70 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed0003570 con 0x7efee8140a70 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217809954 0 0) 0x7efee815b920 con 0x7efee806a210 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efee815b640 con 0x7efee806a210 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee77fe700 1 -- 172.21.15.12:0/819927602 >> v1:172.21.15.29:6789/0 conn(0x7efee806a210 legacy=0x7efee80c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee77fe700 1 -- 172.21.15.12:0/819927602 >> v1:172.21.15.12:6789/0 conn(0x7efee8140a70 legacy=0x7efee8069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee77fe700 1 -- 172.21.15.12:0/819927602 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee815bc00 con 0x7efee806de50 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.706+0000 7efee77fe700 1 --2- 172.21.15.12:0/819927602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806de50 0x7efee80c7360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efee0009e60 tx=0x7efee0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94e6ceb9a6831266 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000e070 con 0x7efee806de50 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee000bab0 con 0x7efee806de50 2023-10-08T17:41:24.708 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee5ffb700 1 -- 172.21.15.12:0/819927602 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000be70 con 0x7efee806de50 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 -- 172.21.15.12:0/819927602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806de50 msgr2=0x7efee80c7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 --2- 172.21.15.12:0/819927602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806de50 0x7efee80c7360 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7efee0009e60 tx=0x7efee0009780 comp rx=0 tx=0).stop 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 -- 172.21.15.12:0/819927602 shutdown_connections 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 --2- 172.21.15.12:0/819927602 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806de50 0x7efee80c7360 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 -- 172.21.15.12:0/819927602 >> 172.21.15.12:0/819927602 conn(0x7efee806d110 msgr2=0x7efee80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 -- 172.21.15.12:0/819927602 shutdown_connections 2023-10-08T17:41:24.709 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.707+0000 7efee7fff700 1 -- 172.21.15.12:0/819927602 wait complete. 2023-10-08T17:41:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.709+0000 7efee7fff700 1 Processor -- start 2023-10-08T17:41:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.709+0000 7efee7fff700 1 -- start start 2023-10-08T17:41:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806a210 0x7efee80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efee8140a70 0x7efee8158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80cb8c0 con 0x7efee806de50 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80ca2e0 con 0x7efee806a210 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee7fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80ca5c0 con 0x7efee8140a70 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51578/0 (socket says 172.21.15.12:51578) 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 -- 172.21.15.12:0/135166449 learned_addr learned my addr 172.21.15.12:0/135166449 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee6ffd700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806a210 0x7efee80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee77fe700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efee8140a70 0x7efee8158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efee8140a70 msgr2=0x7efee8158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efee8140a70 0x7efee8158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806a210 msgr2=0x7efee80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.712 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.710+0000 7efee67fc700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806a210 0x7efee80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efee67fc700 1 -- 172.21.15.12:0/135166449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee0009a20 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efee67fc700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c7c0 tx=0x7efedc007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc010510 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc0106b0 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc010a70 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee80ca8a0 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.711+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee80cae60 con 0x7efee806de50 2023-10-08T17:41:24.713 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.713+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee80c65e0 con 0x7efee806de50 2023-10-08T17:41:24.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.713+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7efedc012440 con 0x7efee806de50 2023-10-08T17:41:24.714 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.714+0000 7efeceffd700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 0x7efed4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:24.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.715+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7efedc084220 con 0x7efee806de50 2023-10-08T17:41:24.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.715+0000 7efee6ffd700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 msgr2=0x7efed4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:24.715 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.715+0000 7efee6ffd700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 0x7efed4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:24.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.718+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efedc04b5a0 con 0x7efee806de50 2023-10-08T17:41:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.916+0000 7efee6ffd700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 msgr2=0x7efed4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:24.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.916+0000 7efee6ffd700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 0x7efed4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:24.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.921+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efee80cb080 con 0x7efee806de50 2023-10-08T17:41:24.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.921+0000 7efeceffd700 1 -- 172.21.15.12:0/135166449 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v186) v1 ==== 104+0+11 (secure 0 0 0) 0x7efedc017020 con 0x7efee806de50 2023-10-08T17:41:24.921 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T17:41:24.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 msgr2=0x7efed4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 0x7efed4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 msgr2=0x7efee80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7efedc00c7c0 tx=0x7efedc007de0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 shutdown_connections 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efed4067050 0x7efed4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efee8140a70 0x7efee8158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efee806a210 0x7efee80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 --2- 172.21.15.12:0/135166449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efee806de50 0x7efee80cb380 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 >> 172.21.15.12:0/135166449 conn(0x7efee806d110 msgr2=0x7efee813d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 shutdown_connections 2023-10-08T17:41:24.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:24.925+0000 7efee7fff700 1 -- 172.21.15.12:0/135166449 wait complete. 2023-10-08T17:41:24.951 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T17:41:25.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.174+0000 7f2ed6b9d700 1 Processor -- start 2023-10-08T17:41:25.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.174+0000 7f2ed6b9d700 1 -- start start 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed6b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 0x7f2ed00c84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed6b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed006a5d0 con 0x7f2ed0159620 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed6b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed00c89f0 con 0x7f2ed01599f0 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00cae10 con 0x7f2ed006e560 2023-10-08T17:41:25.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed5b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2ed0159620 0x7f2ed006de50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59804/0 (socket says 172.21.15.12:59804) 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed5b9b700 1 -- 172.21.15.12:0/2150806398 learned_addr learned my addr 172.21.15.12:0/2150806398 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed539a700 1 --2- 172.21.15.12:0/2150806398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.176+0000 7f2ed639c700 1 --2- 172.21.15.12:0/2150806398 >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 0x7f2ed00c84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed4b99700 1 -- 172.21.15.12:0/2150806398 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086579499 0 0) 0x7f2ed006a5d0 con 0x7f2ed0159620 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed4b99700 1 -- 172.21.15.12:0/2150806398 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc003570 con 0x7f2ed0159620 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed539a700 1 -- 172.21.15.12:0/2150806398 >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 msgr2=0x7f2ed00c84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed539a700 1 --2- 172.21.15.12:0/2150806398 >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 0x7f2ed00c84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed539a700 1 -- 172.21.15.12:0/2150806398 >> v1:172.21.15.12:6789/0 conn(0x7f2ed0159620 legacy=0x7f2ed006de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed539a700 1 -- 172.21.15.12:0/2150806398 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0069ca0 con 0x7f2ed006e560 2023-10-08T17:41:25.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed639c700 1 --2- 172.21.15.12:0/2150806398 >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 0x7f2ed00c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:25.179 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed539a700 1 --2- 172.21.15.12:0/2150806398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed00ca710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ed9b0a370589b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed4b99700 1 -- 172.21.15.12:0/2150806398 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0011630 con 0x7f2ed006e560 2023-10-08T17:41:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed4b99700 1 -- 172.21.15.12:0/2150806398 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0011790 con 0x7f2ed006e560 2023-10-08T17:41:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.177+0000 7f2ed4b99700 1 -- 172.21.15.12:0/2150806398 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0011b30 con 0x7f2ed006e560 2023-10-08T17:41:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/2150806398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 msgr2=0x7f2ed00ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.180 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/2150806398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed00ca710 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00098e0 tx=0x7f2ec00091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/2150806398 shutdown_connections 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/2150806398 >> v2:172.21.15.29:3300/0 conn(0x7f2ed01599f0 0x7f2ed00c84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/2150806398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed00ca710 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/2150806398 >> 172.21.15.12:0/2150806398 conn(0x7f2ed006d130 msgr2=0x7f2ed00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/2150806398 shutdown_connections 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.178+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/2150806398 wait complete. 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.180+0000 7f2ed6b9d700 1 Processor -- start 2023-10-08T17:41:25.181 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.180+0000 7f2ed6b9d700 1 -- start start 2023-10-08T17:41:25.183 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed0141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ed01599f0 0x7f2ed00b16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b0600 con 0x7f2ed01599f0 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b08e0 con 0x7f2ed0159620 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed6b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00b0bc0 con 0x7f2ed006e560 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed639c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ed01599f0 0x7f2ed00b16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed5b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed0141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35628/0 (socket says 172.21.15.12:35628) 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 -- 172.21.15.12:0/1731509490 learned_addr learned my addr 172.21.15.12:0/1731509490 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 msgr2=0x7f2ed0141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed0141520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.181+0000 7f2ed539a700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ed01599f0 msgr2=0x7f2ed00b16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ed539a700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ed01599f0 0x7f2ed00b16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ed539a700 1 -- 172.21.15.12:0/1731509490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8009a20 con 0x7f2ed0159620 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ed539a700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00caf50 tx=0x7f2ec0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0011b10 con 0x7f2ed0159620 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec00253f0 con 0x7f2ed0159620 2023-10-08T17:41:25.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00257b0 con 0x7f2ed0159620 2023-10-08T17:41:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec0009420 con 0x7f2ed0159620 2023-10-08T17:41:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.182+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed00b1180 con 0x7f2ed0159620 2023-10-08T17:41:25.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.184+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed00b13a0 con 0x7f2ed0159620 2023-10-08T17:41:25.186 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:25.183+0000 7f3cd90dd180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:41:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.185+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f2ec0025ba0 con 0x7f2ed0159620 2023-10-08T17:41:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.185+0000 7f2ec5ffb700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 0x7f2eb4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.185+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f2ec0086250 con 0x7f2ed0159620 2023-10-08T17:41:25.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.185+0000 7f2ed5b9b700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 msgr2=0x7f2eb4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:25.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.185+0000 7f2ed5b9b700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 0x7f2eb4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:25.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.190+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ec0053040 con 0x7f2ed0159620 2023-10-08T17:41:25.239 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:25.239+0000 7f1239ec8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:41:25.366 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:25.365+0000 7f3cd90dd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.386+0000 7f2ed5b9b700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 msgr2=0x7f2eb4069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:25.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.386+0000 7f2ed5b9b700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 0x7f2eb4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:25.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.392+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ed00b0a20 con 0x7f2ed0159620 2023-10-08T17:41:25.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.393+0000 7f2ec5ffb700 1 -- 172.21.15.12:0/1731509490 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v186) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ed00b0a20 con 0x7f2ed0159620 2023-10-08T17:41:25.393 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 msgr2=0x7f2eb4069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 0x7f2eb4069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 msgr2=0x7f2ed00afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00caf50 tx=0x7f2ec0017000 comp rx=0 tx=0).stop 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 shutdown_connections 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2eb4067050 0x7f2eb4069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2ed01599f0 0x7f2ed00b16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2ed006e560 0x7f2ed0141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 --2- 172.21.15.12:0/1731509490 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2ed0159620 0x7f2ed00afcb0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.395+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 >> 172.21.15.12:0/1731509490 conn(0x7f2ed006d130 msgr2=0x7f2ed00c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.396+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 shutdown_connections 2023-10-08T17:41:25.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.396+0000 7f2ed6b9d700 1 -- 172.21.15.12:0/1731509490 wait complete. 2023-10-08T17:41:25.414 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:25.426 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:25.426+0000 7f1239ec8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:25.467 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:25.466+0000 7f3cd90dd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:41:25.530 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:25.530+0000 7f1239ec8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:41:25.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.606+0000 7f6e75b9d700 1 Processor -- start 2023-10-08T17:41:25.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.606+0000 7f6e75b9d700 1 -- start start 2023-10-08T17:41:25.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.607+0000 7f6e75b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 0x7f6e700cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.607+0000 7f6e75b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.607+0000 7f6e75b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7015afd0 con 0x7f6e70153c30 2023-10-08T17:41:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.607+0000 7f6e75b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7015b2b0 con 0x7f6e700cef40 2023-10-08T17:41:25.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.607+0000 7f6e75b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7015b590 con 0x7f6e7015de50 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e7539c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 0x7f6e700cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e7539c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35644/0 (socket says 172.21.15.12:35644) 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e7539c700 1 -- 172.21.15.12:0/3953214546 learned_addr learned my addr 172.21.15.12:0/3953214546 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e74b9b700 1 --1- 172.21.15.12:0/3953214546 >> v1:172.21.15.29:6789/0 conn(0x7f6e70153c30 0x7f6e7015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:49964/0 (socket says 172.21.15.12:49964) 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6ffff700 1 -- 172.21.15.12:0/3953214546 >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 msgr2=0x7f6e7015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6ffff700 1 --2- 172.21.15.12:0/3953214546 >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6ffff700 1 -- 172.21.15.12:0/3953214546 >> v1:172.21.15.29:6789/0 conn(0x7f6e70153c30 legacy=0x7f6e7015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6f7fe700 1 -- 172.21.15.12:0/3953214546 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802270707 0 0) 0x7f6e7015afd0 con 0x7f6e70153c30 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e6ffff700 1 -- 172.21.15.12:0/3953214546 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7015b870 con 0x7f6e7015de50 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.608+0000 7f6e7539c700 1 --2- 172.21.15.12:0/3953214546 >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.609+0000 7f6e6ffff700 1 --2- 172.21.15.12:0/3953214546 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 0x7f6e700cea00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0098e0 tx=0x7f6e5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55750522957581ba server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.609+0000 7f6e6f7fe700 1 -- 172.21.15.12:0/3953214546 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00b640 con 0x7f6e7015de50 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.609+0000 7f6e6f7fe700 1 -- 172.21.15.12:0/3953214546 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c00b7a0 con 0x7f6e7015de50 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.609+0000 7f6e6f7fe700 1 -- 172.21.15.12:0/3953214546 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c00bb40 con 0x7f6e7015de50 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 -- 172.21.15.12:0/3953214546 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 msgr2=0x7f6e700cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/3953214546 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 0x7f6e700cea00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c0098e0 tx=0x7f6e5c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 -- 172.21.15.12:0/3953214546 shutdown_connections 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/3953214546 >> v2:172.21.15.29:3300/0 conn(0x7f6e700cef40 0x7f6e7015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/3953214546 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e7015de50 0x7f6e700cea00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 -- 172.21.15.12:0/3953214546 >> 172.21.15.12:0/3953214546 conn(0x7f6e700703a0 msgr2=0x7f6e700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 -- 172.21.15.12:0/3953214546 shutdown_connections 2023-10-08T17:41:25.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.610+0000 7f6e75b9d700 1 -- 172.21.15.12:0/3953214546 wait complete. 2023-10-08T17:41:25.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.611+0000 7f6e75b9d700 1 Processor -- start 2023-10-08T17:41:25.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.611+0000 7f6e75b9d700 1 -- start start 2023-10-08T17:41:25.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e70153c30 0x7f6e7016abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e7015de50 0x7f6e700cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7016cf60 con 0x7f6e700cef40 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70169fe0 con 0x7f6e7015de50 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e75b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7016a2c0 con 0x7f6e70153c30 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.612+0000 7f6e74b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51590/0 (socket says 172.21.15.12:51590) 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 -- 172.21.15.12:0/2486673306 learned_addr learned my addr 172.21.15.12:0/2486673306 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e7539c700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e7015de50 0x7f6e700cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e6ffff700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e70153c30 0x7f6e7016abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e70153c30 msgr2=0x7f6e7016abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e70153c30 0x7f6e7016abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e7015de50 msgr2=0x7f6e700cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e7015de50 0x7f6e700cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 -- 172.21.15.12:0/2486673306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e68009ae0 con 0x7f6e700cef40 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.613+0000 7f6e74b9b700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f6e640011e0 tx=0x7f6e64007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.614+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64005a70 con 0x7f6e700cef40 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.614+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64005bd0 con 0x7f6e700cef40 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.614+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c009420 con 0x7f6e700cef40 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.614+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640070d0 con 0x7f6e700cef40 2023-10-08T17:41:25.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.614+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7016a880 con 0x7f6e700cef40 2023-10-08T17:41:25.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.615+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7016d3c0 con 0x7f6e700cef40 2023-10-08T17:41:25.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.617+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7f6e64007480 con 0x7f6e700cef40 2023-10-08T17:41:25.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.618+0000 7f6e6cff9700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 0x7f6e54069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:25.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.618+0000 7f6e6ffff700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 msgr2=0x7f6e54069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:25.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.618+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7f6e64083ff0 con 0x7f6e700cef40 2023-10-08T17:41:25.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.618+0000 7f6e6ffff700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 0x7f6e54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:25.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.623+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e64050cc0 con 0x7f6e700cef40 2023-10-08T17:41:25.771 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:25.770+0000 7f3cd90dd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:41:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.819+0000 7f6e6ffff700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 msgr2=0x7f6e54069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:25.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.819+0000 7f6e6ffff700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 0x7f6e54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:25.838 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:25.838+0000 7f1239ec8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:41:25.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.871+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e7004c3c0 con 0x7f6e700cef40 2023-10-08T17:41:25.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.872+0000 7f6e6cff9700 1 -- 172.21.15.12:0/2486673306 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7f6e64017070 con 0x7f6e700cef40 2023-10-08T17:41:25.872 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:25.871+0000 7f3cd90dd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:41:25.872 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:25.872 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 msgr2=0x7f6e54069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 0x7f6e54069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 msgr2=0x7f6e7016ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f6e640011e0 tx=0x7f6e64007e10 comp rx=0 tx=0).stop 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 shutdown_connections 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6e54067050 0x7f6e54069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6e700cef40 0x7f6e7016ca20 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6e7015de50 0x7f6e700cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 --2- 172.21.15.12:0/2486673306 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6e70153c30 0x7f6e7016abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:25.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 >> 172.21.15.12:0/2486673306 conn(0x7f6e700703a0 msgr2=0x7f6e70070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:25.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.874+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 shutdown_connections 2023-10-08T17:41:25.876 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:25.875+0000 7f6e75b9d700 1 -- 172.21.15.12:0/2486673306 wait complete. 2023-10-08T17:41:25.876 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:41:25.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:25.939 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:25.940+0000 7f1239ec8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:41:26.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.123+0000 7fa50cfff700 1 Processor -- start 2023-10-08T17:41:26.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.123+0000 7fa50cfff700 1 -- start start 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.124+0000 7fa50cfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa5080b1b20 0x7fa50815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.124+0000 7fa50cfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 0x7fa508161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50cfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa508158210 con 0x7fa508157600 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50cfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080cb850 con 0x7fa5080b1b20 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50cfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080cb290 con 0x7fa5081579d0 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa508157600 0x7fa5080b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59818/0 (socket says 172.21.15.12:59818) 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50659c700 1 -- 172.21.15.12:0/715017115 learned_addr learned my addr 172.21.15.12:0/715017115 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:26.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa505d9b700 1 --2- 172.21.15.12:0/715017115 >> v2:172.21.15.12:3300/0 conn(0x7fa5080b1b20 0x7fa50815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa506d9d700 1 --2- 172.21.15.12:0/715017115 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 0x7fa508161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50559a700 1 -- 172.21.15.12:0/715017115 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2623709 0 0) 0x7fa508158210 con 0x7fa508157600 2023-10-08T17:41:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa50559a700 1 -- 172.21.15.12:0/715017115 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4f0003570 con 0x7fa508157600 2023-10-08T17:41:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa506d9d700 1 -- 172.21.15.12:0/715017115 >> v2:172.21.15.12:3300/0 conn(0x7fa5080b1b20 msgr2=0x7fa50815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:26.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa506d9d700 1 --2- 172.21.15.12:0/715017115 >> v2:172.21.15.12:3300/0 conn(0x7fa5080b1b20 0x7fa50815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa506d9d700 1 -- 172.21.15.12:0/715017115 >> v1:172.21.15.12:6789/0 conn(0x7fa508157600 legacy=0x7fa5080b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.125+0000 7fa506d9d700 1 -- 172.21.15.12:0/715017115 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080cb570 con 0x7fa5081579d0 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.126+0000 7fa506d9d700 1 --2- 172.21.15.12:0/715017115 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 0x7fa508161800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa500009e60 tx=0x7fa500009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8734c04b13e075f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.126+0000 7fa50559a700 1 -- 172.21.15.12:0/715017115 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000e070 con 0x7fa5081579d0 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.126+0000 7fa50559a700 1 -- 172.21.15.12:0/715017115 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000bab0 con 0x7fa5081579d0 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.126+0000 7fa50559a700 1 -- 172.21.15.12:0/715017115 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000be30 con 0x7fa5081579d0 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 -- 172.21.15.12:0/715017115 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 msgr2=0x7fa508161800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 --2- 172.21.15.12:0/715017115 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 0x7fa508161800 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa500009e60 tx=0x7fa500009780 comp rx=0 tx=0).stop 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 -- 172.21.15.12:0/715017115 shutdown_connections 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 --2- 172.21.15.12:0/715017115 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5081579d0 0x7fa508161800 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 --2- 172.21.15.12:0/715017115 >> v2:172.21.15.12:3300/0 conn(0x7fa5080b1b20 0x7fa50815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 -- 172.21.15.12:0/715017115 >> 172.21.15.12:0/715017115 conn(0x7fa50806d170 msgr2=0x7fa5080cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 -- 172.21.15.12:0/715017115 shutdown_connections 2023-10-08T17:41:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.127+0000 7fa50cfff700 1 -- 172.21.15.12:0/715017115 wait complete. 2023-10-08T17:41:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.129+0000 7fa50cfff700 1 Processor -- start 2023-10-08T17:41:26.129 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.129+0000 7fa50cfff700 1 -- start start 2023-10-08T17:41:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa508157600 0x7fa5081684d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5081579d0 0x7fa5080a9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080a7bd0 con 0x7fa5081579d0 2023-10-08T17:41:26.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080a6fc0 con 0x7fa508157600 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50cfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080a72a0 con 0x7fa5080b1b20 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa506d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5081579d0 0x7fa5080a9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa505d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa508157600 0x7fa5081684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44448/0 (socket says 172.21.15.12:44448) 2023-10-08T17:41:26.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.131+0000 7fa50659c700 1 -- 172.21.15.12:0/521579931 learned_addr learned my addr 172.21.15.12:0/521579931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa508157600 msgr2=0x7fa5081684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa508157600 0x7fa5081684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5081579d0 msgr2=0x7fa5080a9cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5081579d0 0x7fa5080a9cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 -- 172.21.15.12:0/521579931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009a20 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50659c700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80011e0 tx=0x7fa4f8007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8005b30 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8005c90 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080a7580 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007300 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.132+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5080aa230 con 0x7fa5080b1b20 2023-10-08T17:41:26.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.133+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50804c3c0 con 0x7fa5080b1b20 2023-10-08T17:41:26.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.134+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fa4f8007670 con 0x7fa5080b1b20 2023-10-08T17:41:26.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.136+0000 7fa4f67fc700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 0x7fa4e8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.136+0000 7fa505d9b700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 msgr2=0x7fa4e8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:26.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.136+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fa4f8083f90 con 0x7fa5080b1b20 2023-10-08T17:41:26.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.136+0000 7fa505d9b700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 0x7fa4e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:26.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.140+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4f8050c20 con 0x7fa5080b1b20 2023-10-08T17:41:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.338+0000 7fa505d9b700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 msgr2=0x7fa4e8069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:26.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.338+0000 7fa505d9b700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 0x7fa4e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:26.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.343+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5080a73e0 con 0x7fa5080b1b20 2023-10-08T17:41:26.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.344+0000 7fa4f67fc700 1 -- 172.21.15.12:0/521579931 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17022 (secure 0 0 0) 0x7fa5080a73e0 con 0x7fa5080b1b20 2023-10-08T17:41:26.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:26.344 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":186,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:23.327621+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":186,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2436623509":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/2405396815":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/681896466":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/1092834905":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/3103985745":"2023-10-09T17:36:23.502469+0000","172.21.15.12:6837/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2272258934":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/62325":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/680523626":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2149521500":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/1052084506":"2023-10-09T17:25:45.435602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 msgr2=0x7fa4e8069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 0x7fa4e8069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 msgr2=0x7fa50814df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4f80011e0 tx=0x7fa4f8007df0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 shutdown_connections 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa4e8067050 0x7fa4e8069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa5081579d0 0x7fa5080a9cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa5080b1b20 0x7fa50814df70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 --2- 172.21.15.12:0/521579931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa508157600 0x7fa5081684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 >> 172.21.15.12:0/521579931 conn(0x7fa50806d170 msgr2=0x7fa508156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 shutdown_connections 2023-10-08T17:41:26.348 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.346+0000 7fa50cfff700 1 -- 172.21.15.12:0/521579931 wait complete. 2023-10-08T17:41:26.368 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:41:26.368 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.599+0000 7feda8b9d700 1 Processor -- start 2023-10-08T17:41:26.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.599+0000 7feda8b9d700 1 -- start start 2023-10-08T17:41:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.600+0000 7feda8b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7feda4153c30 0x7feda415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.600+0000 7feda8b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda415afd0 con 0x7feda40cf110 2023-10-08T17:41:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.600+0000 7feda8b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda415b2b0 con 0x7feda415de50 2023-10-08T17:41:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.600+0000 7feda8b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda415b590 con 0x7feda4153c30 2023-10-08T17:41:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda3fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7feda40cf110 0x7feda415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59826/0 (socket says 172.21.15.12:59826) 2023-10-08T17:41:26.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda3fff700 1 -- 172.21.15.12:0/1631477592 learned_addr learned my addr 172.21.15.12:0/1631477592 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda37fe700 1 --2- 172.21.15.12:0/1631477592 >> v2:172.21.15.29:3300/0 conn(0x7feda4153c30 0x7feda415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda37fe700 1 -- 172.21.15.12:0/1631477592 >> v1:172.21.15.29:6789/0 conn(0x7feda415de50 legacy=0x7feda40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda37fe700 1 -- 172.21.15.12:0/1631477592 >> v1:172.21.15.12:6789/0 conn(0x7feda40cf110 legacy=0x7feda415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda37fe700 1 -- 172.21.15.12:0/1631477592 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda415b870 con 0x7feda4153c30 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.601+0000 7feda27fc700 1 -- 172.21.15.12:0/1631477592 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057699314 0 0) 0x7feda415afd0 con 0x7feda40cf110 2023-10-08T17:41:26.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda37fe700 1 --2- 172.21.15.12:0/1631477592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda4153c30 0x7feda415a5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fed940098e0 tx=0x7fed940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebd9c4cf1cac94e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda27fc700 1 -- 172.21.15.12:0/1631477592 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94009e80 con 0x7feda4153c30 2023-10-08T17:41:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda27fc700 1 -- 172.21.15.12:0/1631477592 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9400b860 con 0x7feda4153c30 2023-10-08T17:41:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda27fc700 1 -- 172.21.15.12:0/1631477592 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400bbe0 con 0x7feda4153c30 2023-10-08T17:41:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda8b9d700 1 -- 172.21.15.12:0/1631477592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda4153c30 msgr2=0x7feda415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.602+0000 7feda8b9d700 1 --2- 172.21.15.12:0/1631477592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda4153c30 0x7feda415a5e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fed940098e0 tx=0x7fed940091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.603+0000 7feda8b9d700 1 -- 172.21.15.12:0/1631477592 shutdown_connections 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.603+0000 7feda8b9d700 1 --2- 172.21.15.12:0/1631477592 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda4153c30 0x7feda415a5e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.603+0000 7feda8b9d700 1 -- 172.21.15.12:0/1631477592 >> 172.21.15.12:0/1631477592 conn(0x7feda40703a0 msgr2=0x7feda40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.603+0000 7feda8b9d700 1 -- 172.21.15.12:0/1631477592 shutdown_connections 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.603+0000 7feda8b9d700 1 -- 172.21.15.12:0/1631477592 wait complete. 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.604+0000 7feda8b9d700 1 Processor -- start 2023-10-08T17:41:26.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.604+0000 7feda8b9d700 1 -- start start 2023-10-08T17:41:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feda4153c30 0x7feda40cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda415de50 0x7feda40b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cc700 con 0x7feda415de50 2023-10-08T17:41:26.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda416ca10 con 0x7feda40cf110 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.605+0000 7feda8b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda40cbaf0 con 0x7feda4153c30 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda415de50 0x7feda40b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35670/0 (socket says 172.21.15.12:35670) 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 -- 172.21.15.12:0/527160899 learned_addr learned my addr 172.21.15.12:0/527160899 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda2ffd700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feda4153c30 0x7feda40cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feda4153c30 msgr2=0x7feda40cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feda4153c30 0x7feda40cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda415de50 msgr2=0x7feda40b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda415de50 0x7feda40b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 -- 172.21.15.12:0/527160899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94009420 con 0x7feda40cf110 2023-10-08T17:41:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.606+0000 7feda37fe700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feda406eb00 tx=0x7fed94017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.607+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9401f070 con 0x7feda40cf110 2023-10-08T17:41:26.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.607+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94000c90 con 0x7feda40cf110 2023-10-08T17:41:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.607+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94025420 con 0x7feda40cf110 2023-10-08T17:41:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.607+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda40cbdd0 con 0x7feda40cf110 2023-10-08T17:41:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.607+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda40cc390 con 0x7feda40cf110 2023-10-08T17:41:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.608+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda40cc9e0 con 0x7feda40cf110 2023-10-08T17:41:26.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.609+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fed94023070 con 0x7feda40cf110 2023-10-08T17:41:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.610+0000 7fed8b7fe700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 0x7fed90069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.610+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fed940862d0 con 0x7feda40cf110 2023-10-08T17:41:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.610+0000 7feda2ffd700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 msgr2=0x7fed90069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:26.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.610+0000 7feda2ffd700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 0x7fed90069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:26.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.618+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed94052fe0 con 0x7feda40cf110 2023-10-08T17:41:26.621 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:26.619+0000 7f3cd90dd180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:41:26.705 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:26.705+0000 7f1239ec8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:41:26.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.811+0000 7feda2ffd700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 msgr2=0x7fed90069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:26.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.811+0000 7feda2ffd700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 0x7fed90069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:26.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.864+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feda404c3c0 con 0x7feda40cf110 2023-10-08T17:41:26.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.865+0000 7fed8b7fe700 1 -- 172.21.15.12:0/527160899 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fed94056600 con 0x7feda40cf110 2023-10-08T17:41:26.865 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:26.865 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 msgr2=0x7fed90069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 0x7fed90069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 msgr2=0x7feda416c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7feda406eb00 tx=0x7fed94017000 comp rx=0 tx=0).stop 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 shutdown_connections 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fed90067050 0x7fed90069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7feda415de50 0x7feda40b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7feda40cf110 0x7feda416c4d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 --2- 172.21.15.12:0/527160899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7feda4153c30 0x7feda40cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 >> 172.21.15.12:0/527160899 conn(0x7feda40703a0 msgr2=0x7feda40c63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 shutdown_connections 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:26.868+0000 7feda8b9d700 1 -- 172.21.15.12:0/527160899 wait complete. 2023-10-08T17:41:26.869 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:41:26.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:26.914 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:26.913+0000 7f3cd90dd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:41:27.002 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.002+0000 7f1239ec8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:41:27.012 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.011+0000 7f3cd90dd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:41:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.077+0000 7fb8bf59e700 1 Processor -- start 2023-10-08T17:41:27.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.077+0000 7fb8bf59e700 1 -- start start 2023-10-08T17:41:27.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb8c006e0a0 0x7fb8c00c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006f3a0 0x7fb8c014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8c006e470 0x7fb8c01501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c006a490 con 0x7fb8c006e470 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00c7490 con 0x7fb8c006e0a0 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00c7770 con 0x7fb8c006f3a0 2023-10-08T17:41:27.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8c006e470 0x7fb8c01501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8c006e470 0x7fb8c01501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51620/0 (socket says 172.21.15.12:51620) 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bed9d700 1 -- 172.21.15.12:0/392527068 learned_addr learned my addr 172.21.15.12:0/392527068 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.078+0000 7fb8bdd9b700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006f3a0 0x7fb8c014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8be59c700 1 --2- 172.21.15.12:0/392527068 >> v2:172.21.15.29:3300/0 conn(0x7fb8c006e0a0 0x7fb8c00c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 -- 172.21.15.12:0/392527068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006f3a0 msgr2=0x7fb8c014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:27.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006f3a0 0x7fb8c014fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 -- 172.21.15.12:0/392527068 >> v2:172.21.15.29:3300/0 conn(0x7fb8c006e0a0 msgr2=0x7fb8c00c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 --2- 172.21.15.12:0/392527068 >> v2:172.21.15.29:3300/0 conn(0x7fb8c006e0a0 0x7fb8c00c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 -- 172.21.15.12:0/392527068 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00c7a50 con 0x7fb8c006e470 2023-10-08T17:41:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bed9d700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006e470 0x7fb8c01501b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0069230 tx=0x7fb8b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19746e8f703bbfbe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:27.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.079+0000 7fb8bd59a700 1 -- 172.21.15.12:0/392527068 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b800e070 con 0x7fb8c006e470 2023-10-08T17:41:27.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bd59a700 1 -- 172.21.15.12:0/392527068 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b800b970 con 0x7fb8c006e470 2023-10-08T17:41:27.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bd59a700 1 -- 172.21.15.12:0/392527068 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b80092e0 con 0x7fb8c006e470 2023-10-08T17:41:27.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 -- 172.21.15.12:0/392527068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006e470 msgr2=0x7fb8c01501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006e470 0x7fb8c01501b0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0069230 tx=0x7fb8b8009840 comp rx=0 tx=0).stop 2023-10-08T17:41:27.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 -- 172.21.15.12:0/392527068 shutdown_connections 2023-10-08T17:41:27.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006e470 0x7fb8c01501b0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/392527068 >> v2:172.21.15.29:3300/0 conn(0x7fb8c006e0a0 0x7fb8c00c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/392527068 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006f3a0 0x7fb8c014fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 -- 172.21.15.12:0/392527068 >> 172.21.15.12:0/392527068 conn(0x7fb8c006d170 msgr2=0x7fb8c00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 -- 172.21.15.12:0/392527068 shutdown_connections 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.080+0000 7fb8bf59e700 1 -- 172.21.15.12:0/392527068 wait complete. 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.082+0000 7fb8bf59e700 1 Processor -- start 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.082+0000 7fb8bf59e700 1 -- start start 2023-10-08T17:41:27.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 0x7fb8c0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006f3a0 0x7fb8c00b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00af2d0 con 0x7fb8c006f3a0 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00b16e0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c00b19c0 con 0x7fb8c006e470 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006f3a0 0x7fb8c00b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8be59c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35700/0 (socket says 172.21.15.12:35700) 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8be59c700 1 -- 172.21.15.12:0/2523725100 learned_addr learned my addr 172.21.15.12:0/2523725100 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.083+0000 7fb8bdd9b700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 0x7fb8c0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 msgr2=0x7fb8c0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 0x7fb8c0157350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006f3a0 msgr2=0x7fb8c00b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006f3a0 0x7fb8c00b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 -- 172.21.15.12:0/2523725100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b8009ae0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8bdd9b700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 0x7fb8c0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8be59c700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000ec80 tx=0x7fb8b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000c850 con 0x7fb8c006e0a0 2023-10-08T17:41:27.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b000c9b0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b000cd50 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c00b1ca0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.084+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c0155a50 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.086+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c004c3c0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.086+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fb8b0013680 con 0x7fb8c006e0a0 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.087+0000 7fb8ae7fc700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 0x7fb8a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.087+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fb8b0084da0 con 0x7fb8c006e0a0 2023-10-08T17:41:27.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.087+0000 7fb8bdd9b700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 msgr2=0x7fb8a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:27.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.088+0000 7fb8bdd9b700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 0x7fb8a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:27.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.095+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8b0051a30 con 0x7fb8c006e0a0 2023-10-08T17:41:27.104 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.104+0000 7f1239ec8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:41:27.181 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.177+0000 7f3cd90dd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:41:27.271 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.271+0000 7f1239ec8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:41:27.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.289+0000 7fb8bdd9b700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 msgr2=0x7fb8a0069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:27.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.289+0000 7fb8bdd9b700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 0x7fb8a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:27.290 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.289+0000 7f3cd90dd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:41:27.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.346+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8c00c7d30 con 0x7fb8c006e0a0 2023-10-08T17:41:27.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.347+0000 7fb8ae7fc700 1 -- 172.21.15.12:0/2523725100 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 83 v83) v1 ==== 94+0+4601 (secure 0 0 0) 0x7fb8b0055050 con 0x7fb8c006e0a0 2023-10-08T17:41:27.347 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:27.347 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":83,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[{"mdsmap":{"epoch":83,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:25:27.694243+0000","modified":"2023-10-08T17:25:31.221969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9234},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9234":{"gid":9234,"name":"d","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6834/2324207700","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2324207700},{"type":"v1","addr":"172.21.15.29:6834","nonce":2324207700}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-08T17:41:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 msgr2=0x7fb8a0069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 0x7fb8a0069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 msgr2=0x7fb8c01486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000ec80 tx=0x7fb8b00091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 shutdown_connections 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb8a0067050 0x7fb8a0069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8c006f3a0 0x7fb8c00b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8c006e0a0 0x7fb8c01486e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 --2- 172.21.15.12:0/2523725100 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8c006e470 0x7fb8c0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 >> 172.21.15.12:0/2523725100 conn(0x7fb8c006d170 msgr2=0x7fb8c014ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 shutdown_connections 2023-10-08T17:41:27.351 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.350+0000 7fb8bf59e700 1 -- 172.21.15.12:0/2523725100 wait complete. 2023-10-08T17:41:27.352 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 83 2023-10-08T17:41:27.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:27.392 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.392+0000 7f1239ec8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:41:27.493 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.492+0000 7f3cd90dd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:41:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.568+0000 7fe40e59d700 1 Processor -- start 2023-10-08T17:41:27.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.568+0000 7fe40e59d700 1 -- start start 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.570+0000 7fe40e59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 0x7fe40815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.570+0000 7fe40e59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40e59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe40815afd0 con 0x7fe4080cef40 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40e59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe40815b2b0 con 0x7fe408153c30 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40e59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe40815b590 con 0x7fe40815de50 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40cd9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.571 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40d59b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 0x7fe40815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40dd9c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fe4080cef40 0x7fe40806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:49988/0 (socket says 172.21.15.12:49988) 2023-10-08T17:41:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40cd9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44476/0 (socket says 172.21.15.12:44476) 2023-10-08T17:41:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40dd9c700 1 -- 172.21.15.12:0/1165240281 learned_addr learned my addr 172.21.15.12:0/1165240281 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:27.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40d59b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 0x7fe40815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35706/0 (socket says 172.21.15.12:35706) 2023-10-08T17:41:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40cd9a700 1 -- 172.21.15.12:0/1165240281 >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 msgr2=0x7fe40815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40cd9a700 1 --2- 172.21.15.12:0/1165240281 >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 0x7fe40815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.571+0000 7fe40cd9a700 1 -- 172.21.15.12:0/1165240281 >> v1:172.21.15.29:6789/0 conn(0x7fe4080cef40 legacy=0x7fe40806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.572+0000 7fe40cd9a700 1 -- 172.21.15.12:0/1165240281 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40815b870 con 0x7fe40815de50 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.572+0000 7fe40cd9a700 1 --2- 172.21.15.12:0/1165240281 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b2f503e31bea21c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.572+0000 7fe3fffff700 1 -- 172.21.15.12:0/1165240281 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800b640 con 0x7fe40815de50 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.572+0000 7fe3fffff700 1 -- 172.21.15.12:0/1165240281 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f800b7a0 con 0x7fe40815de50 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.572+0000 7fe3fffff700 1 -- 172.21.15.12:0/1165240281 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f800bb40 con 0x7fe40815de50 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 -- 172.21.15.12:0/1165240281 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 msgr2=0x7fe4080cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 --2- 172.21.15.12:0/1165240281 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe3f80098e0 tx=0x7fe3f80091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 -- 172.21.15.12:0/1165240281 shutdown_connections 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 --2- 172.21.15.12:0/1165240281 >> v2:172.21.15.29:3300/0 conn(0x7fe408153c30 0x7fe40815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 --2- 172.21.15.12:0/1165240281 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe40815de50 0x7fe4080cea00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 -- 172.21.15.12:0/1165240281 >> 172.21.15.12:0/1165240281 conn(0x7fe4080703a0 msgr2=0x7fe4080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:27.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 -- 172.21.15.12:0/1165240281 shutdown_connections 2023-10-08T17:41:27.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.573+0000 7fe40e59d700 1 -- 172.21.15.12:0/1165240281 wait complete. 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.574+0000 7fe40e59d700 1 Processor -- start 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.575+0000 7fe40e59d700 1 -- start start 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.575+0000 7fe40e59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.575+0000 7fe40e59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 0x7fe4081698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40e59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe40815de50 0x7fe4080b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40e59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4080c92f0 con 0x7fe40815de50 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40e59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4081454e0 con 0x7fe408153c30 2023-10-08T17:41:27.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40e59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe408169e30 con 0x7fe4080cef40 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40dd9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe40815de50 0x7fe4080b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40cd9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 0x7fe4081698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40cd9a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 0x7fe4081698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35716/0 (socket says 172.21.15.12:35716) 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40cd9a700 1 -- 172.21.15.12:0/914836898 learned_addr learned my addr 172.21.15.12:0/914836898 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:44486/0 (socket says 172.21.15.12:44486) 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 msgr2=0x7fe4081698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 0x7fe4081698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe40815de50 msgr2=0x7fe4080b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe40815de50 0x7fe4080b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.576+0000 7fe40d59b700 1 -- 172.21.15.12:0/914836898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8009420 con 0x7fe4080cef40 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe40d59b700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe40400ea80 tx=0x7fe4040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4040095d0 con 0x7fe4080cef40 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40400c7f0 con 0x7fe4080cef40 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4080c8720 con 0x7fe4080cef40 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400cbb0 con 0x7fe4080cef40 2023-10-08T17:41:27.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.577+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4080c8ca0 con 0x7fe4080cef40 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.578+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4080c95d0 con 0x7fe4080cef40 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.579+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 94) v1 ==== 84854+0+0 (secure 0 0 0) 0x7fe404013470 con 0x7fe4080cef40 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.580+0000 7fe3fd7fa700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 0x7fe3ec069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.580+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6770+0+0 (secure 0 0 0) 0x7fe404084c80 con 0x7fe4080cef40 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.580+0000 7fe40cd9a700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 msgr2=0x7fe3ec069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:27.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.580+0000 7fe40cd9a700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 0x7fe3ec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:27.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.584+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe404051910 con 0x7fe4080cef40 2023-10-08T17:41:27.591 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.590+0000 7f3cd90dd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:41:27.610 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.610+0000 7f1239ec8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:41:27.687 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.686+0000 7f3cd90dd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:41:27.718 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.718+0000 7f1239ec8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:41:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.781+0000 7fe40cd9a700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 msgr2=0x7fe3ec069500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:27.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.781+0000 7fe40cd9a700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 0x7fe3ec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:27.785 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:27.784+0000 7f3cd90dd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:41:27.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.815+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe40804c3c0 con 0x7fe4080cef40 2023-10-08T17:41:27.816 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.816+0000 7f1239ec8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:41:27.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.816+0000 7fe3fd7fa700 1 -- 172.21.15.12:0/914836898 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+17022 (secure 0 0 0) 0x7fe404054f30 con 0x7fe4080cef40 2023-10-08T17:41:27.817 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:27.817 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":186,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:23.327621+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:25:25.442868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-10-08T17:25:26.684792+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":186,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.29","mappings":[{"from":4,"to":3}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/2436623509":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/2405396815":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/681896466":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/1092834905":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/3103985745":"2023-10-09T17:36:23.502469+0000","172.21.15.12:6837/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:6836/115415":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2272258934":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/62325":"2023-10-09T17:36:23.502469+0000","172.21.15.12:0/680523626":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/2149521500":"2023-10-09T17:25:45.435602+0000","172.21.15.12:0/1052084506":"2023-10-09T17:25:45.435602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:27.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 msgr2=0x7fe3ec069500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:27.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 0x7fe3ec069500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 msgr2=0x7fe408144fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:27.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe40400ea80 tx=0x7fe4040091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 shutdown_connections 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe3ec067050 0x7fe3ec069500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe40815de50 0x7fe4080b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe4080cef40 0x7fe408144fa0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 --2- 172.21.15.12:0/914836898 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe408153c30 0x7fe4081698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 >> 172.21.15.12:0/914836898 conn(0x7fe4080703a0 msgr2=0x7fe4080c61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 shutdown_connections 2023-10-08T17:41:27.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:27.819+0000 7fe40e59d700 1 -- 172.21.15.12:0/914836898 wait complete. 2023-10-08T17:41:27.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T17:41:27.921 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:27.921+0000 7f1239ec8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:41:28.005 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.005+0000 7f11b7ac8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.006 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.005+0000 7f11b7ac8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.006 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.005+0000 7f11b7ac8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.006 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.005+0000 7f11b7ac8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.006 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.005+0000 7f11b7ac8700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.007 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.007+0000 7f11b52c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.007 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.007+0000 7f11b52c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.007 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.007+0000 7f11b52c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.007 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.007+0000 7f11b52c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.007 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:28.007+0000 7f11b52c3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:28.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.089+0000 7fe7e89fe700 1 Processor -- start 2023-10-08T17:41:28.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.090+0000 7fe7e89fe700 1 -- start start 2023-10-08T17:41:28.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.091+0000 7fe7e89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fb20 0x7fe7e415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.091+0000 7fe7e89fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7e413fef0 0x7fe7e40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.091+0000 7fe7e89fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e415ae70 con 0x7fe7e406aaa0 2023-10-08T17:41:28.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.091+0000 7fe7e89fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e406af60 con 0x7fe7e413fef0 2023-10-08T17:41:28.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.091+0000 7fe7e89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e406b240 con 0x7fe7e413fb20 2023-10-08T17:41:28.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7e413fef0 0x7fe7e40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e2d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fb20 0x7fe7e415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe7e413fef0 0x7fe7e40c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:35846/0 (socket says 172.21.15.12:35846) 2023-10-08T17:41:28.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 -- 172.21.15.12:0/4177794835 learned_addr learned my addr 172.21.15.12:0/4177794835 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:28.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e359e700 1 --1- 172.21.15.12:0/4177794835 >> v1:172.21.15.29:6789/0 conn(0x7fe7e406aaa0 0x7fe7e40c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:49990/0 (socket says 172.21.15.12:49990) 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 -- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fb20 msgr2=0x7fe7e415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 --2- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fb20 0x7fe7e415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 -- 172.21.15.12:0/4177794835 >> v1:172.21.15.29:6789/0 conn(0x7fe7e406aaa0 legacy=0x7fe7e40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 -- 172.21.15.12:0/4177794835 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e406b520 con 0x7fe7e413fef0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e1d9b700 1 -- 172.21.15.12:0/4177794835 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859421562 0 0) 0x7fe7dc001490 con 0x7fe7e406aaa0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e259c700 1 --2- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e413fef0 0x7fe7e40c7990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009990 tx=0x7fe7d8009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c54f1a3c834de5de server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.092+0000 7fe7e1d9b700 1 -- 172.21.15.12:0/4177794835 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8009e80 con 0x7fe7e413fef0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e1d9b700 1 -- 172.21.15.12:0/4177794835 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d8005c10 con 0x7fe7e413fef0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e1d9b700 1 -- 172.21.15.12:0/4177794835 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d800b650 con 0x7fe7e413fef0 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 -- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e413fef0 msgr2=0x7fe7e40c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e413fef0 0x7fe7e40c7990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009990 tx=0x7fe7d8009220 comp rx=0 tx=0).stop 2023-10-08T17:41:28.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 -- 172.21.15.12:0/4177794835 shutdown_connections 2023-10-08T17:41:28.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fb20 0x7fe7e415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/4177794835 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e413fef0 0x7fe7e40c7990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 -- 172.21.15.12:0/4177794835 >> 172.21.15.12:0/4177794835 conn(0x7fe7e406d170 msgr2=0x7fe7e40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:28.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 -- 172.21.15.12:0/4177794835 shutdown_connections 2023-10-08T17:41:28.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.093+0000 7fe7e89fe700 1 -- 172.21.15.12:0/4177794835 wait complete. 2023-10-08T17:41:28.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.094+0000 7fe7e89fe700 1 Processor -- start 2023-10-08T17:41:28.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.095+0000 7fe7e89fe700 1 -- start start 2023-10-08T17:41:28.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.095+0000 7fe7e89fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e406aaa0 0x7fe7e41593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.095+0000 7fe7e89fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fef0 0x7fe7e413d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e89fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e41580a0 con 0x7fe7e413fb20 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e89fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4158320 con 0x7fe7e406aaa0 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e4156680 con 0x7fe7e413fef0 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51762/0 (socket says 172.21.15.12:51762) 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 -- 172.21.15.12:0/210678276 learned_addr learned my addr 172.21.15.12:0/210678276 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fef0 0x7fe7e413d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e2d9d700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e406aaa0 0x7fe7e41593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 -- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fef0 msgr2=0x7fe7e413d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fef0 0x7fe7e413d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 -- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e406aaa0 msgr2=0x7fe7e41593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e406aaa0 0x7fe7e41593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.096+0000 7fe7e259c700 1 -- 172.21.15.12:0/210678276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d8009480 con 0x7fe7e413fb20 2023-10-08T17:41:28.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7e259c700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4071320 tx=0x7fe7d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d801db60 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d801dcc0 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e41585e0 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d801b6d0 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.097+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e4158ba0 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.098+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e404c3c0 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.099+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 95) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fe7d801ba80 con 0x7fe7e413fb20 2023-10-08T17:41:28.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.100+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 7086+0+0 (secure 0 0 0) 0x7fe7d8086560 con 0x7fe7e413fb20 2023-10-08T17:41:28.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.104+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7d80535c0 con 0x7fe7e413fb20 2023-10-08T17:41:28.355 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.355+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe7e40cb1f0 con 0x7fe7e413fb20 2023-10-08T17:41:28.355 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T17:41:28.356+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T17:41:28.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.364+0000 7fe7caffd700 1 -- 172.21.15.12:0/210678276 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v84) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe7d8056be0 con 0x7fe7e413fb20 2023-10-08T17:41:28.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 msgr2=0x7fe7e413d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fe7e4071320 tx=0x7fe7d8016000 comp rx=0 tx=0).stop 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 shutdown_connections 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe7e413fef0 0x7fe7e413d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe7e406aaa0 0x7fe7e41593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 --2- 172.21.15.12:0/210678276 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe7e413fb20 0x7fe7e413d1c0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 >> 172.21.15.12:0/210678276 conn(0x7fe7e406d170 msgr2=0x7fe7e40cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 shutdown_connections 2023-10-08T17:41:28.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.366+0000 7fe7e89fe700 1 -- 172.21.15.12:0/210678276 wait complete. 2023-10-08T17:41:28.368 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T17:41:28.384 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T17:41:28.423 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T17:41:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.613+0000 7fa7e6d9d700 1 Processor -- start 2023-10-08T17:41:28.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.614+0000 7fa7e6d9d700 1 -- start start 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e0153a00 0x7fa7e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa7e015de50 0x7fa7e015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7e00cea00 0x7fa7e00cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e015af60 con 0x7fa7e00cea00 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e015b240 con 0x7fa7e015de50 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e6d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e015b520 con 0x7fa7e0153a00 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7e00cea00 0x7fa7e00cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e659c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa7e00cea00 0x7fa7e00cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51778/0 (socket says 172.21.15.12:51778) 2023-10-08T17:41:28.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e659c700 1 -- 172.21.15.12:0/3831588219 learned_addr learned my addr 172.21.15.12:0/3831588219 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e559a700 1 --2- 172.21.15.12:0/3831588219 >> v2:172.21.15.29:3300/0 conn(0x7fa7e015de50 0x7fa7e015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.615+0000 7fa7e5d9b700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e0153a00 0x7fa7e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 -- 172.21.15.12:0/3831588219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e0153a00 msgr2=0x7fa7e0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e0153a00 0x7fa7e0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 -- 172.21.15.12:0/3831588219 >> v2:172.21.15.29:3300/0 conn(0x7fa7e015de50 msgr2=0x7fa7e015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3831588219 >> v2:172.21.15.29:3300/0 conn(0x7fa7e015de50 0x7fa7e015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 -- 172.21.15.12:0/3831588219 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e015b800 con 0x7fa7e00cea00 2023-10-08T17:41:28.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e00cea00 0x7fa7e00cee40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006e800 tx=0x7fa7d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f668519a9d2b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:28.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e4d99700 1 -- 172.21.15.12:0/3831588219 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d800e070 con 0x7fa7e00cea00 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e4d99700 1 -- 172.21.15.12:0/3831588219 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d800b970 con 0x7fa7e00cea00 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.616+0000 7fa7e4d99700 1 -- 172.21.15.12:0/3831588219 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80092e0 con 0x7fa7e00cea00 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3831588219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e00cea00 msgr2=0x7fa7e00cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e00cea00 0x7fa7e00cee40 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006e800 tx=0x7fa7d8009840 comp rx=0 tx=0).stop 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3831588219 shutdown_connections 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e00cea00 0x7fa7e00cee40 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3831588219 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e0153a00 0x7fa7e0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3831588219 >> v2:172.21.15.29:3300/0 conn(0x7fa7e015de50 0x7fa7e015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3831588219 >> 172.21.15.12:0/3831588219 conn(0x7fa7e00703a0 msgr2=0x7fa7e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:28.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3831588219 shutdown_connections 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.617+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3831588219 wait complete. 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.618+0000 7fa7e6d9d700 1 Processor -- start 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.619+0000 7fa7e6d9d700 1 -- start start 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.619+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e00cea00 0x7fa7e00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e0153a00 0x7fa7e013d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e6d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e6d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00c7b20 con 0x7fa7e015de50 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e6d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e00c9d30 con 0x7fa7e0153a00 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e6d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e013dde0 con 0x7fa7e00cea00 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51790/0 (socket says 172.21.15.12:51790) 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 -- 172.21.15.12:0/3680287145 learned_addr learned my addr 172.21.15.12:0/3680287145 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:28.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e559a700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e0153a00 0x7fa7e013d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e5d9b700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e00cea00 0x7fa7e00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 -- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e00cea00 msgr2=0x7fa7e00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e00cea00 0x7fa7e00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 -- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e0153a00 msgr2=0x7fa7e013d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e0153a00 0x7fa7e013d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.620+0000 7fa7e659c700 1 -- 172.21.15.12:0/3680287145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009ae0 con 0x7fa7e015de50 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7e659c700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006eb00 tx=0x7fa7d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8008ad0 con 0x7fa7e015de50 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d8008c50 con 0x7fa7e015de50 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e00c9140 con 0x7fa7e015de50 2023-10-08T17:41:28.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d8026460 con 0x7fa7e015de50 2023-10-08T17:41:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.621+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e00c96e0 con 0x7fa7e015de50 2023-10-08T17:41:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.622+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e00c9ea0 con 0x7fa7e015de50 2023-10-08T17:41:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.623+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 95) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fa7d8003040 con 0x7fa7e015de50 2023-10-08T17:41:28.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.624+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 7172+0+0 (secure 0 0 0) 0x7fa7d8086390 con 0x7fa7e015de50 2023-10-08T17:41:28.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.628+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7d80533c0 con 0x7fa7e015de50 2023-10-08T17:41:28.875 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.875+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa7e004c3c0 con 0x7fa7e015de50 2023-10-08T17:41:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.937+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 96) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fa7d8052e70 con 0x7fa7e015de50 2023-10-08T17:41:28.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.937+0000 7fa7d5ffb700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 0x7fa7c406f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:28.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.939+0000 7fa7e5d9b700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 0x7fa7c406f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:28.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:28.942+0000 7fa7e5d9b700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 0x7fa7c406f260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009db0 tx=0x7fa7dc0091a0 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:29.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.363+0000 7fa7d5ffb700 1 -- 172.21.15.12:0/3680287145 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v85) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa7d8069820 con 0x7fa7e015de50 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 msgr2=0x7fa7c406f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 0x7fa7c406f260 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009db0 tx=0x7fa7dc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 msgr2=0x7fa7e0158a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fa7e006eb00 tx=0x7fa7d8018000 comp rx=0 tx=0).stop 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 shutdown_connections 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa7c406ce80 0x7fa7c406f260 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa7e015de50 0x7fa7e0158a30 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa7e00cea00 0x7fa7e00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 --2- 172.21.15.12:0/3680287145 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa7e0153a00 0x7fa7e013d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.365+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 >> 172.21.15.12:0/3680287145 conn(0x7fa7e00703a0 msgr2=0x7fa7e00d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:29.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.366+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 shutdown_connections 2023-10-08T17:41:29.367 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.366+0000 7fa7e6d9d700 1 -- 172.21.15.12:0/3680287145 wait complete. 2023-10-08T17:41:29.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T17:41:29.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.579+0000 7f677b39d700 1 Processor -- start 2023-10-08T17:41:29.579 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.579+0000 7f677b39d700 1 -- start start 2023-10-08T17:41:29.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677b39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6774159770 0x7f677406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677b39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 0x7f67740ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677b39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f677406d740 con 0x7f677406a330 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677b39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6774159b40 con 0x7f6774159770 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677b39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677406cb30 con 0x7f677406c6a0 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677a39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6774159770 0x7f677406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677a39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6774159770 0x7f677406dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51792/0 (socket says 172.21.15.12:51792) 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.580+0000 7f677a39b700 1 -- 172.21.15.12:0/1101075922 learned_addr learned my addr 172.21.15.12:0/1101075922 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:29.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f6779b9a700 1 --2- 172.21.15.12:0/1101075922 >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 0x7f67740ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f677a39b700 1 -- 172.21.15.12:0/1101075922 >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 msgr2=0x7f67740ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f677a39b700 1 --2- 172.21.15.12:0/1101075922 >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 0x7f67740ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f677a39b700 1 -- 172.21.15.12:0/1101075922 >> v1:172.21.15.29:6789/0 conn(0x7f677406a330 legacy=0x7f67740c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f677a39b700 1 -- 172.21.15.12:0/1101075922 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f677406ce10 con 0x7f6774159770 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f6779b9a700 1 --2- 172.21.15.12:0/1101075922 >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 0x7f67740ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f677a39b700 1 --2- 172.21.15.12:0/1101075922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f677406dbd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc970 tx=0x7f6770009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2877577cc47d58a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.581+0000 7f6779399700 1 -- 172.21.15.12:0/1101075922 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000b860 con 0x7f6774159770 2023-10-08T17:41:29.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f6779399700 1 -- 172.21.15.12:0/1101075922 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f677000b9c0 con 0x7f6774159770 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f6779399700 1 -- 172.21.15.12:0/1101075922 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f677000bd60 con 0x7f6774159770 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 -- 172.21.15.12:0/1101075922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 msgr2=0x7f677406dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 --2- 172.21.15.12:0/1101075922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f677406dbd0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc970 tx=0x7f6770009250 comp rx=0 tx=0).stop 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 -- 172.21.15.12:0/1101075922 shutdown_connections 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 --2- 172.21.15.12:0/1101075922 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f677406dbd0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 --2- 172.21.15.12:0/1101075922 >> v2:172.21.15.29:3300/0 conn(0x7f677406c6a0 0x7f67740ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 -- 172.21.15.12:0/1101075922 >> 172.21.15.12:0/1101075922 conn(0x7f677406e790 msgr2=0x7f677406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 -- 172.21.15.12:0/1101075922 shutdown_connections 2023-10-08T17:41:29.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.582+0000 7f677b39d700 1 -- 172.21.15.12:0/1101075922 wait complete. 2023-10-08T17:41:29.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.584+0000 7f677b39d700 1 Processor -- start 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.584+0000 7f677b39d700 1 -- start start 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f677406a330 0x7f67740c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f677406c6a0 0x7f6774157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774169790 con 0x7f6774159770 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6774169a70 con 0x7f677406c6a0 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677b39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6774169d50 con 0x7f677406a330 2023-10-08T17:41:29.587 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677ab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677a39b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f677406a330 0x7f67740c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677ab9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51806/0 (socket says 172.21.15.12:51806) 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f677ab9c700 1 -- 172.21.15.12:0/3156636564 learned_addr learned my addr 172.21.15.12:0/3156636564 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.585+0000 7f6779b9a700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f677406c6a0 0x7f6774157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 -- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f677406a330 msgr2=0x7f67740c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f677406a330 0x7f67740c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.588 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 -- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f677406c6a0 msgr2=0x7f6774157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f677406c6a0 0x7f6774157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 -- 172.21.15.12:0/3156636564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67700094f0 con 0x7f6774159770 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677ab9c700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c8e0 tx=0x7f676c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c012630 con 0x7f6774159770 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c012790 con 0x7f6774159770 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c012b50 con 0x7f6774159770 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f677416a030 con 0x7f6774159770 2023-10-08T17:41:29.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.586+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67741693b0 con 0x7f6774159770 2023-10-08T17:41:29.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.587+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f677404c3c0 con 0x7f6774159770 2023-10-08T17:41:29.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.588+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 96) v1 ==== 84578+0+0 (secure 0 0 0) 0x7f676c01a3a0 con 0x7f6774159770 2023-10-08T17:41:29.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.589+0000 7f676a7fc700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 0x7f6758069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:29.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.589+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 7172+0+0 (secure 0 0 0) 0x7f676c0849e0 con 0x7f6774159770 2023-10-08T17:41:29.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.589+0000 7f677a39b700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 0x7f6758069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:29.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.590+0000 7f677a39b700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 0x7f6758069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc970 tx=0x7f6770017000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:29.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.594+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f676c051870 con 0x7f6774159770 2023-10-08T17:41:29.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:29.795+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f677406d0f0 con 0x7f6774159770 2023-10-08T17:41:30.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.369+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f676c051c40 con 0x7f6774159770 2023-10-08T17:41:30.374 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.374+0000 7f676a7fc700 1 -- 172.21.15.12:0/3156636564 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v189) v1 ==== 181+0+0 (secure 0 0 0) 0x7f676c055300 con 0x7f6774159770 2023-10-08T17:41:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 msgr2=0x7f6758069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 0x7f6758069230 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f67740cc970 tx=0x7f6770017000 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 msgr2=0x7f67740c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f676c00c8e0 tx=0x7f676c001710 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 shutdown_connections 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6758066d80 0x7f6758069230 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6774159770 0x7f67740c4ff0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f677406a330 0x7f67740c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 --2- 172.21.15.12:0/3156636564 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f677406c6a0 0x7f6774157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 >> 172.21.15.12:0/3156636564 conn(0x7f677406e790 msgr2=0x7f67740c2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 shutdown_connections 2023-10-08T17:41:30.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.377+0000 7f677b39d700 1 -- 172.21.15.12:0/3156636564 wait complete. 2023-10-08T17:41:30.379 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T17:41:30.397 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T17:41:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.600+0000 7f9c6ffff700 1 Processor -- start 2023-10-08T17:41:30.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.600+0000 7f9c6ffff700 1 -- start start 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c70156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6ffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c701579b0 con 0x7f9c700c85d0 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c700c1390 con 0x7f9c700c8200 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c701573f0 con 0x7f9c700c2a90 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9c700c85d0 0x7f9c700cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59838/0 (socket says 172.21.15.12:59838) 2023-10-08T17:41:30.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.601+0000 7f9c6f7fe700 1 -- 172.21.15.12:0/3935901224 learned_addr learned my addr 172.21.15.12:0/3935901224 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c70156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2199409090 0 0) 0x7f9c701579b0 con 0x7f9c700c85d0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c58003570 con 0x7f9c700c85d0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429496084 0 0) 0x7f9c58003570 con 0x7f9c700c85d0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 msgr2=0x7f9c70156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c70156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 >> v1:172.21.15.29:6789/0 conn(0x7f9c700c8200 legacy=0x7f9c700c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c701576d0 con 0x7f9c700c85d0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f9c680017f0 con 0x7f9c700c85d0 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 >> v1:172.21.15.12:6789/0 conn(0x7f9c700c85d0 legacy=0x7f9c700cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c58003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c58004d50 0x7f9c580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c701573f0 con 0x7f9c58003fd0 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800dd50 con 0x7f9c58004d50 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.602+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5800df10 con 0x7f9c700c2a90 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6effd700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c58003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6f7fe700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c58004d50 0x7f9c580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 -- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 msgr2=0x7f9c58003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c58003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 -- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c58004d50 msgr2=0x7f9c580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c58004d50 0x7f9c580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 -- 172.21.15.12:0/3935901224 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c58003570 con 0x7f9c58003fd0 2023-10-08T17:41:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6effd700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700c2a90 0x7f9c58003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:30.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c58004810 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009c00 tx=0x7f9c640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7cf071292807ac server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.603+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400e710 con 0x7f9c58003fd0 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400e870 con 0x7f9c58003fd0 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6dffb700 1 -- 172.21.15.12:0/3935901224 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400ec30 con 0x7f9c58003fd0 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 -- 172.21.15.12:0/3935901224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 msgr2=0x7f9c58004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/3935901224 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c58004810 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009c00 tx=0x7f9c640091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6f7fe700 1 -- 172.21.15.12:0/3935901224 reap_dead start 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 -- 172.21.15.12:0/3935901224 shutdown_connections 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 -- 172.21.15.12:0/3935901224 >> 172.21.15.12:0/3935901224 conn(0x7f9c7006c6a0 msgr2=0x7f9c7006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 -- 172.21.15.12:0/3935901224 shutdown_connections 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.604+0000 7f9c6ffff700 1 -- 172.21.15.12:0/3935901224 wait complete. 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.606+0000 7f9c6ffff700 1 Processor -- start 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.606+0000 7f9c6ffff700 1 -- start start 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700ab740 0x7f9c700b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7016d2d0 0x7f9c7016d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7016dc80 con 0x7f9c58003fd0 2023-10-08T17:41:30.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c700ae1e0 con 0x7f9c7016d2d0 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7015de50 con 0x7f9c700ab740 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51816/0 (socket says 172.21.15.12:51816) 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 -- 172.21.15.12:0/1817086573 learned_addr learned my addr 172.21.15.12:0/1817086573 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 -- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700ab740 msgr2=0x7f9c700b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700ab740 0x7f9c700b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 -- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7016d2d0 msgr2=0x7f9c7016d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7016d2d0 0x7f9c7016d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.607+0000 7f9c6effd700 1 -- 172.21.15.12:0/1817086573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7015e130 con 0x7f9c58003fd0 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c6effd700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000fc50 tx=0x7f9c60009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6000d9d0 con 0x7f9c58003fd0 2023-10-08T17:41:30.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000db50 con 0x7f9c58003fd0 2023-10-08T17:41:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c600133f0 con 0x7f9c58003fd0 2023-10-08T17:41:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c700ade70 con 0x7f9c58003fd0 2023-10-08T17:41:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.608+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c700abb90 con 0x7f9c58003fd0 2023-10-08T17:41:30.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.609+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7004c3c0 con 0x7f9c58003fd0 2023-10-08T17:41:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.610+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f9c600137a0 con 0x7f9c58003fd0 2023-10-08T17:41:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.611+0000 7f9c56ffd700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 0x7f9c5c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.611+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 6734+0+0 (secure 0 0 0) 0x7f9c60084f70 con 0x7f9c58003fd0 2023-10-08T17:41:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.611+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 0x7f9c5c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:30.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.612+0000 7f9c6e7fc700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 0x7f9c5c069530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c700b1220 tx=0x7f9c6401a000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:30.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.615+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c60051c30 con 0x7f9c58003fd0 2023-10-08T17:41:30.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:30.816+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9c70067f90 con 0x7f9c58003fd0 2023-10-08T17:41:31.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.377+0000 7f9c56ffd700 1 -- 172.21.15.12:0/1817086573 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v190) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9c60055250 con 0x7f9c58003fd0 2023-10-08T17:41:31.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 msgr2=0x7f9c5c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 0x7f9c5c069530 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9c700b1220 tx=0x7f9c6401a000 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 msgr2=0x7f9c700ae670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f9c6000fc50 tx=0x7f9c60009040 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 shutdown_connections 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9c5c067080 0x7f9c5c069530 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9c58003fd0 0x7f9c700ae670 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9c7016d2d0 0x7f9c7016d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 --2- 172.21.15.12:0/1817086573 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9c700ab740 0x7f9c700b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 >> 172.21.15.12:0/1817086573 conn(0x7f9c7006c6a0 msgr2=0x7f9c7015aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:31.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.381+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 shutdown_connections 2023-10-08T17:41:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.382+0000 7f9c6ffff700 1 -- 172.21.15.12:0/1817086573 wait complete. 2023-10-08T17:41:31.383 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T17:41:31.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T17:41:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.595+0000 7f5a3499d700 1 Processor -- start 2023-10-08T17:41:31.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.595+0000 7f5a3499d700 1 -- start start 2023-10-08T17:41:31.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.596+0000 7f5a3499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7be0 0x7f5a3006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.596+0000 7f5a3499d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a300c7fb0 0x7f5a3015a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.596+0000 7f5a3499d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a3015aed0 con 0x7f5a3013f780 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.596+0000 7f5a3499d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a3006bf10 con 0x7f5a300c7fb0 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.596+0000 7f5a3499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3006b290 con 0x7f5a300c7be0 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a300c7fb0 0x7f5a3015a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5a300c7fb0 0x7f5a3015a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51832/0 (socket says 172.21.15.12:51832) 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 -- 172.21.15.12:0/2649263983 learned_addr learned my addr 172.21.15.12:0/2649263983 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:31.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2ffff700 1 --1- 172.21.15.12:0/2649263983 >> v1:172.21.15.12:6789/0 conn(0x7f5a3013f780 0x7f5a300c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59854/0 (socket says 172.21.15.12:59854) 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7be0 0x7f5a3006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 -- 172.21.15.12:0/2649263983 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7be0 msgr2=0x7f5a3006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7be0 0x7f5a3006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 -- 172.21.15.12:0/2649263983 >> v1:172.21.15.12:6789/0 conn(0x7f5a3013f780 legacy=0x7f5a300c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 -- 172.21.15.12:0/2649263983 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a3006b570 con 0x7f5a300c7fb0 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.597+0000 7f5a2effd700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a300c7fb0 0x7f5a3015a990 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099b0 tx=0x7f5a24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965e09ff164ec67e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/2649263983 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400b860 con 0x7f5a300c7fb0 2023-10-08T17:41:31.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/2649263983 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a2400b9c0 con 0x7f5a300c7fb0 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a2e7fc700 1 -- 172.21.15.12:0/2649263983 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2400bd60 con 0x7f5a300c7fb0 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 -- 172.21.15.12:0/2649263983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a300c7fb0 msgr2=0x7f5a3015a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a300c7fb0 0x7f5a3015a990 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099b0 tx=0x7f5a24009250 comp rx=0 tx=0).stop 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 -- 172.21.15.12:0/2649263983 shutdown_connections 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7be0 0x7f5a3006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 --2- 172.21.15.12:0/2649263983 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a300c7fb0 0x7f5a3015a990 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 -- 172.21.15.12:0/2649263983 >> 172.21.15.12:0/2649263983 conn(0x7f5a3006d110 msgr2=0x7f5a300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 -- 172.21.15.12:0/2649263983 shutdown_connections 2023-10-08T17:41:31.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.598+0000 7f5a3499d700 1 -- 172.21.15.12:0/2649263983 wait complete. 2023-10-08T17:41:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.600+0000 7f5a3499d700 1 Processor -- start 2023-10-08T17:41:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.600+0000 7f5a3499d700 1 -- start start 2023-10-08T17:41:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 0x7f5a30157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 0x7f5a300b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b1340 con 0x7f5a3013f780 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300affa0 con 0x7f5a300c7be0 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a3499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b0730 con 0x7f5a300c7fb0 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a2ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51844/0 (socket says 172.21.15.12:51844) 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a2ffff700 1 -- 172.21.15.12:0/4076694505 learned_addr learned my addr 172.21.15.12:0/4076694505 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 0x7f5a30157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.601+0000 7f5a2effd700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 0x7f5a300b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 -- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 msgr2=0x7f5a300b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 0x7f5a300b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 -- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 msgr2=0x7f5a30157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 0x7f5a30157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 -- 172.21.15.12:0/4076694505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a240094f0 con 0x7f5a3013f780 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 0x7f5a30157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2effd700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 0x7f5a300b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a2ffff700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800cca0 tx=0x7f5a28001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a28004bb0 con 0x7f5a3013f780 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a28004d10 con 0x7f5a3013f780 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a2800ab50 con 0x7f5a3013f780 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300b0a10 con 0x7f5a3013f780 2023-10-08T17:41:31.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.602+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a300b0fd0 con 0x7f5a3013f780 2023-10-08T17:41:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.603+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a3004c3c0 con 0x7f5a3013f780 2023-10-08T17:41:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.604+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f5a28007300 con 0x7f5a3013f780 2023-10-08T17:41:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.605+0000 7f5a177fe700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 0x7f5a1c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.605+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f5a280846b0 con 0x7f5a3013f780 2023-10-08T17:41:31.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.605+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 0x7f5a1c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:31.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.606+0000 7f5a2f7fe700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 0x7f5a1c069500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a20006fd0 tx=0x7f5a20008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:31.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.609+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a280515a0 con 0x7f5a3013f780 2023-10-08T17:41:31.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.813+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f5a3006b850 con 0x7f5a3013f780 2023-10-08T17:41:31.818 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.818+0000 7f5a177fe700 1 -- 172.21.15.12:0/4076694505 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v61) v1 ==== 120+0+0 (secure 0 0 0) 0x7f5a28054bc0 con 0x7f5a3013f780 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 msgr2=0x7f5a1c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 0x7f5a1c069500 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5a20006fd0 tx=0x7f5a20008040 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 msgr2=0x7f5a30159240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f5a2800cca0 tx=0x7f5a28001a70 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 shutdown_connections 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5a1c067050 0x7f5a1c069500 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5a3013f780 0x7f5a30159240 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5a300c7be0 0x7f5a30157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 --2- 172.21.15.12:0/4076694505 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5a300c7fb0 0x7f5a300b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:31.821 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 >> 172.21.15.12:0/4076694505 conn(0x7f5a3006d110 msgr2=0x7f5a3006de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 shutdown_connections 2023-10-08T17:41:31.822 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:31.820+0000 7f5a3499d700 1 -- 172.21.15.12:0/4076694505 wait complete. 2023-10-08T17:41:31.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T17:41:32.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.027+0000 7f37b119d700 1 Processor -- start 2023-10-08T17:41:32.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.027+0000 7f37b119d700 1 -- start start 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.028+0000 7f37b119d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37ac06db20 0x7f37ac15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.028+0000 7f37b119d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac15ada0 con 0x7f37ac0caec0 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.028+0000 7f37b119d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac06ca80 con 0x7f37ac153c90 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.028+0000 7f37b119d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac06cd60 con 0x7f37ac06db20 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37ac06db20 0x7f37ac15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f37ac06db20 0x7f37ac15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51858/0 (socket says 172.21.15.12:51858) 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 -- 172.21.15.12:0/4289077688 learned_addr learned my addr 172.21.15.12:0/4289077688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:32.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37b099c700 1 --1- 172.21.15.12:0/4289077688 >> v1:172.21.15.12:6789/0 conn(0x7f37ac0caec0 0x7f37ac15afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:59860/0 (socket says 172.21.15.12:59860) 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 -- 172.21.15.12:0/4289077688 >> v1:172.21.15.29:6789/0 conn(0x7f37ac153c90 legacy=0x7f37ac0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 -- 172.21.15.12:0/4289077688 >> v1:172.21.15.12:6789/0 conn(0x7f37ac0caec0 legacy=0x7f37ac15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 -- 172.21.15.12:0/4289077688 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac06d040 con 0x7f37ac06db20 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37aaffd700 1 -- 172.21.15.12:0/4289077688 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222401958 0 0) 0x7f37ac06ca80 con 0x7f37ac153c90 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.029+0000 7f37ab7fe700 1 --2- 172.21.15.12:0/4289077688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac15a860 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f37a00099b0 tx=0x7f37a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191ca23269471582 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37aaffd700 1 -- 172.21.15.12:0/4289077688 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000b760 con 0x7f37ac06db20 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37aaffd700 1 -- 172.21.15.12:0/4289077688 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a000b8c0 con 0x7f37ac06db20 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37aaffd700 1 -- 172.21.15.12:0/4289077688 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000bc60 con 0x7f37ac06db20 2023-10-08T17:41:32.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 -- 172.21.15.12:0/4289077688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 msgr2=0x7f37ac15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 --2- 172.21.15.12:0/4289077688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac15a860 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f37a00099b0 tx=0x7f37a0009250 comp rx=0 tx=0).stop 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 -- 172.21.15.12:0/4289077688 shutdown_connections 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 --2- 172.21.15.12:0/4289077688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac15a860 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 -- 172.21.15.12:0/4289077688 >> 172.21.15.12:0/4289077688 conn(0x7f37ac06e720 msgr2=0x7f37ac06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 -- 172.21.15.12:0/4289077688 shutdown_connections 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.030+0000 7f37b119d700 1 -- 172.21.15.12:0/4289077688 wait complete. 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.032+0000 7f37b119d700 1 Processor -- start 2023-10-08T17:41:32.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.032+0000 7f37b119d700 1 -- start start 2023-10-08T17:41:32.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37ac0caec0 0x7f37ac169cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37ac153c90 0x7f37ac16c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0b1cd0 con 0x7f37ac06db20 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0c3ed0 con 0x7f37ac153c90 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac0c41b0 con 0x7f37ac0caec0 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37abfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37abfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51870/0 (socket says 172.21.15.12:51870) 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37abfff700 1 -- 172.21.15.12:0/2349244541 learned_addr learned my addr 172.21.15.12:0/2349244541 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37b099c700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37ac153c90 0x7f37ac16c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.033+0000 7f37ab7fe700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37ac0caec0 0x7f37ac169cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 -- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37ac0caec0 msgr2=0x7f37ac169cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37ac0caec0 0x7f37ac169cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 -- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37ac153c90 msgr2=0x7f37ac16c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37ac153c90 0x7f37ac16c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 -- 172.21.15.12:0/2349244541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a00094f0 con 0x7f37ac06db20 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37abfff700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c7e0 tx=0x7f379c007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c012630 con 0x7f37ac06db20 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379c0127b0 con 0x7f37ac06db20 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac0c4490 con 0x7f37ac06db20 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c012b70 con 0x7f37ac06db20 2023-10-08T17:41:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.034+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac0c4a50 con 0x7f37ac06db20 2023-10-08T17:41:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.035+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac0b1770 con 0x7f37ac06db20 2023-10-08T17:41:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.036+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f379c01b400 con 0x7f37ac06db20 2023-10-08T17:41:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.037+0000 7f3793fff700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 0x7f3798069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.037+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f379c084640 con 0x7f37ac06db20 2023-10-08T17:41:32.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.037+0000 7f37ab7fe700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 0x7f3798069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.038+0000 7f37ab7fe700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 0x7f3798069500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37ac069eb0 tx=0x7f37a0016000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.041+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f379c0514b0 con 0x7f37ac06db20 2023-10-08T17:41:32.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.253+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f37ac06f4f0 con 0x7f37ac06db20 2023-10-08T17:41:32.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.257+0000 7f3793fff700 1 -- 172.21.15.12:0/2349244541 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v62) v1 ==== 104+0+0 (secure 0 0 0) 0x7f379c054ad0 con 0x7f37ac06db20 2023-10-08T17:41:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 msgr2=0x7f3798069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 0x7f3798069500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f37ac069eb0 tx=0x7f37a0016000 comp rx=0 tx=0).stop 2023-10-08T17:41:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 msgr2=0x7f37ac0b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f379c00c7e0 tx=0x7f379c007e80 comp rx=0 tx=0).stop 2023-10-08T17:41:32.260 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 shutdown_connections 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3798067050 0x7f3798069500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f37ac06db20 0x7f37ac0b11d0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f37ac153c90 0x7f37ac16c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 --2- 172.21.15.12:0/2349244541 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f37ac0caec0 0x7f37ac169cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 >> 172.21.15.12:0/2349244541 conn(0x7f37ac06e720 msgr2=0x7f37ac15c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 shutdown_connections 2023-10-08T17:41:32.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.260+0000 7f37b119d700 1 -- 172.21.15.12:0/2349244541 wait complete. 2023-10-08T17:41:32.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T17:41:32.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.469+0000 7f15b3fff700 1 Processor -- start 2023-10-08T17:41:32.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.469+0000 7f15b3fff700 1 -- start start 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 0x7f15b406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b3fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f15b413f780 0x7f15b413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b3fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b4140120 con 0x7f15b40c7be0 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b3fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b406bf10 con 0x7f15b413f780 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b406b290 con 0x7f15b40c7fb0 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b2ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f15b40c7be0 0x7f15b415a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35376/0 (socket says 172.21.15.12:35376) 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b2ffd700 1 -- 172.21.15.12:0/4054145778 learned_addr learned my addr 172.21.15.12:0/4054145778 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b37fe700 1 --2- 172.21.15.12:0/4054145778 >> v2:172.21.15.29:3300/0 conn(0x7f15b413f780 0x7f15b413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b27fc700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 0x7f15b406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b1ffb700 1 -- 172.21.15.12:0/4054145778 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625009549 0 0) 0x7f15a4001110 con 0x7f15b40c7be0 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.471+0000 7f15b1ffb700 1 -- 172.21.15.12:0/4054145778 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f159c003570 con 0x7f15b40c7be0 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b37fe700 1 -- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 msgr2=0x7f15b406abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b37fe700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 0x7f15b406abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b37fe700 1 -- 172.21.15.12:0/4054145778 >> v1:172.21.15.12:6789/0 conn(0x7f15b40c7be0 legacy=0x7f15b415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b37fe700 1 -- 172.21.15.12:0/4054145778 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b406b570 con 0x7f15b413f780 2023-10-08T17:41:32.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b27fc700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 0x7f15b406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b37fe700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b413f780 0x7f15b413fbe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009e60 tx=0x7f15ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc3cad70f64dc3f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.472+0000 7f15b1ffb700 1 -- 172.21.15.12:0/4054145778 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00e070 con 0x7f15b413f780 2023-10-08T17:41:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b1ffb700 1 -- 172.21.15.12:0/4054145778 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac00bab0 con 0x7f15b413f780 2023-10-08T17:41:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b1ffb700 1 -- 172.21.15.12:0/4054145778 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00be70 con 0x7f15b413f780 2023-10-08T17:41:32.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 -- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b413f780 msgr2=0x7f15b413fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b413f780 0x7f15b413fbe0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009e60 tx=0x7f15ac009780 comp rx=0 tx=0).stop 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 -- 172.21.15.12:0/4054145778 shutdown_connections 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b413f780 0x7f15b413fbe0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 --2- 172.21.15.12:0/4054145778 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b40c7fb0 0x7f15b406abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 -- 172.21.15.12:0/4054145778 >> 172.21.15.12:0/4054145778 conn(0x7f15b406d110 msgr2=0x7f15b40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 -- 172.21.15.12:0/4054145778 shutdown_connections 2023-10-08T17:41:32.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.473+0000 7f15b3fff700 1 -- 172.21.15.12:0/4054145778 wait complete. 2023-10-08T17:41:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.475+0000 7f15b3fff700 1 Processor -- start 2023-10-08T17:41:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.475+0000 7f15b3fff700 1 -- start start 2023-10-08T17:41:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 0x7f15b416a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 0x7f15b416abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4169b40 con 0x7f15b40c7be0 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40a6180 con 0x7f15b40c7fb0 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b3fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4168ec0 con 0x7f15b413f780 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51128/0 (socket says 172.21.15.12:51128) 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 -- 172.21.15.12:0/2100241097 learned_addr learned my addr 172.21.15.12:0/2100241097 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b37fe700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 0x7f15b416abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b27fc700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 0x7f15b416a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 -- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 msgr2=0x7f15b416abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 0x7f15b416abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 -- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 msgr2=0x7f15b416a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 0x7f15b416a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b2ffd700 1 -- 172.21.15.12:0/2100241097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009420 con 0x7f15b40c7be0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b27fc700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 0x7f15b416a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.476+0000 7f15b37fe700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 0x7f15b416abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f15b2ffd700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c7c0 tx=0x7f15a4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4005b30 con 0x7f15b40c7be0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a4005c90 con 0x7f15b40c7be0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4007340 con 0x7f15b40c7be0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac009a20 con 0x7f15b40c7be0 2023-10-08T17:41:32.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.477+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4169480 con 0x7f15b40c7be0 2023-10-08T17:41:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.478+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4169db0 con 0x7f15b40c7be0 2023-10-08T17:41:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.479+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f15a40076f0 con 0x7f15b40c7be0 2023-10-08T17:41:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.480+0000 7f159affd700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 0x7f15a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.480+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f15a40842e0 con 0x7f15b40c7be0 2023-10-08T17:41:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.480+0000 7f15b27fc700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 0x7f15a0069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.481 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.481+0000 7f15b27fc700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 0x7f15a0069500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15a80093f0 tx=0x7f15a8008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.484+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15a40511d0 con 0x7f15b40c7be0 2023-10-08T17:41:32.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.684+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f15b4140120 con 0x7f15b40c7be0 2023-10-08T17:41:32.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.689+0000 7f159affd700 1 -- 172.21.15.12:0/2100241097 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v63) v1 ==== 115+0+0 (secure 0 0 0) 0x7f15b4140120 con 0x7f15b40c7be0 2023-10-08T17:41:32.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 msgr2=0x7f15a0069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 0x7f15a0069500 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f15a80093f0 tx=0x7f15a8008040 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 msgr2=0x7f15b4169f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f15a400c7c0 tx=0x7f15a4007c70 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 shutdown_connections 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f15a0067050 0x7f15a0069500 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f15b40c7be0 0x7f15b4169f60 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f15b413f780 0x7f15b416abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 --2- 172.21.15.12:0/2100241097 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f15b40c7fb0 0x7f15b416a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 >> 172.21.15.12:0/2100241097 conn(0x7f15b406d110 msgr2=0x7f15b40b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 shutdown_connections 2023-10-08T17:41:32.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.691+0000 7f15b3fff700 1 -- 172.21.15.12:0/2100241097 wait complete. 2023-10-08T17:41:32.710 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-10-08T17:41:32.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.898+0000 7f9fbdf9d700 1 Processor -- start 2023-10-08T17:41:32.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.899+0000 7f9fbdf9d700 1 -- start start 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbdf9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9fb8156860 0x7f9fb80ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbdf9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9fb80ae840 0x7f9fb806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbdf9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb80c8ce0 con 0x7f9fb8153d70 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbdf9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb8156d90 con 0x7f9fb80ae840 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbdf9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb8157070 con 0x7f9fb8156860 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbcf9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9fb8153d70 0x7f9fb80acba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35386/0 (socket says 172.21.15.12:35386) 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbcf9b700 1 -- 172.21.15.12:0/752867201 learned_addr learned my addr 172.21.15.12:0/752867201 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:32.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fbd79c700 1 --2- 172.21.15.12:0/752867201 >> v2:172.21.15.12:3300/0 conn(0x7f9fb80ae840 0x7f9fb806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.900+0000 7f9fb7fff700 1 --2- 172.21.15.12:0/752867201 >> v2:172.21.15.29:3300/0 conn(0x7f9fb8156860 0x7f9fb80ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fbd79c700 1 -- 172.21.15.12:0/752867201 >> v2:172.21.15.29:3300/0 conn(0x7f9fb8156860 msgr2=0x7f9fb80ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fbd79c700 1 --2- 172.21.15.12:0/752867201 >> v2:172.21.15.29:3300/0 conn(0x7f9fb8156860 0x7f9fb80ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fb77fe700 1 -- 172.21.15.12:0/752867201 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951010204 0 0) 0x7f9fb80c8ce0 con 0x7f9fb8153d70 2023-10-08T17:41:32.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fbd79c700 1 -- 172.21.15.12:0/752867201 >> v1:172.21.15.12:6789/0 conn(0x7f9fb8153d70 legacy=0x7f9fb80acba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fbd79c700 1 -- 172.21.15.12:0/752867201 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb8157350 con 0x7f9fb80ae840 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fbd79c700 1 --2- 172.21.15.12:0/752867201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb80ae840 0x7f9fb806ed40 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80683d0 tx=0x7f9fb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6485956fea16f015 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fb77fe700 1 -- 172.21.15.12:0/752867201 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000e070 con 0x7f9fb80ae840 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fb77fe700 1 -- 172.21.15.12:0/752867201 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000bcc0 con 0x7f9fb80ae840 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.901+0000 7f9fb77fe700 1 -- 172.21.15.12:0/752867201 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0012680 con 0x7f9fb80ae840 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/752867201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb80ae840 msgr2=0x7f9fb806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/752867201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb80ae840 0x7f9fb806ed40 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80683d0 tx=0x7f9fb0009780 comp rx=0 tx=0).stop 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/752867201 shutdown_connections 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/752867201 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb80ae840 0x7f9fb806ed40 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/752867201 >> v2:172.21.15.29:3300/0 conn(0x7f9fb8156860 0x7f9fb80ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/752867201 >> 172.21.15.12:0/752867201 conn(0x7f9fb806d170 msgr2=0x7f9fb80cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/752867201 shutdown_connections 2023-10-08T17:41:32.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.902+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/752867201 wait complete. 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.903+0000 7f9fbdf9d700 1 Processor -- start 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.903+0000 7f9fbdf9d700 1 -- start start 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9fb80ae840 0x7f9fb8149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 0x7f9fb814e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814f0e0 con 0x7f9fb8153d70 2023-10-08T17:41:32.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb8154a50 con 0x7f9fb8156860 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.904+0000 7f9fbdf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb814e840 con 0x7f9fb80ae840 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51156/0 (socket says 172.21.15.12:51156) 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 -- 172.21.15.12:0/485487045 learned_addr learned my addr 172.21.15.12:0/485487045 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fbd79c700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 0x7f9fb814e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fbcf9b700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9fb80ae840 0x7f9fb8149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 -- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9fb80ae840 msgr2=0x7f9fb8149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9fb80ae840 0x7f9fb8149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 -- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 msgr2=0x7f9fb814e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:32.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 0x7f9fb814e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 -- 172.21.15.12:0/485487045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb0009a20 con 0x7f9fb8153d70 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fbd79c700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 0x7f9fb814e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.905+0000 7f9fb7fff700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400d860 tx=0x7f9fa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.906+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa40125f0 con 0x7f9fb8153d70 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.906+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4012750 con 0x7f9fb8153d70 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.906+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4012af0 con 0x7f9fb8153d70 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.906+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb814eb20 con 0x7f9fb8153d70 2023-10-08T17:41:32.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.906+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb80c95b0 con 0x7f9fb8153d70 2023-10-08T17:41:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.907+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb80c9410 con 0x7f9fb8153d70 2023-10-08T17:41:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.908+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f9fa401e460 con 0x7f9fb8153d70 2023-10-08T17:41:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.909+0000 7f9fb4ff9700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 0x7f9f9c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.909+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f9fa4084f80 con 0x7f9fb8153d70 2023-10-08T17:41:32.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.909+0000 7f9fbcf9b700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 0x7f9f9c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:32.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.910+0000 7f9fbcf9b700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 0x7f9f9c069500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9fac007fd0 tx=0x7f9fac007d30 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:32.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:32.913+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fb80c9410 con 0x7f9fb8153d70 2023-10-08T17:41:33.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.195+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f9fb80c9410 con 0x7f9fb8153d70 2023-10-08T17:41:33.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.380+0000 7f9fb4ff9700 1 -- 172.21.15.12:0/485487045 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v2976) v1 ==== 165+0+0 (secure 0 0 0) 0x7f9fb80c9410 con 0x7f9fb8153d70 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 msgr2=0x7f9f9c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 0x7f9f9c069500 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9fac007fd0 tx=0x7f9fac007d30 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 msgr2=0x7f9fb814dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f9fa400d860 tx=0x7f9fa4008040 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 shutdown_connections 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9f9c067050 0x7f9f9c069500 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9fb8156860 0x7f9fb814e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9fb80ae840 0x7f9fb8149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 --2- 172.21.15.12:0/485487045 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9fb8153d70 0x7f9fb814dcd0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.383 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 >> 172.21.15.12:0/485487045 conn(0x7f9fb806d170 msgr2=0x7f9fb80af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.382+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 shutdown_connections 2023-10-08T17:41:33.384 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.383+0000 7f9fbdf9d700 1 -- 172.21.15.12:0/485487045 wait complete. 2023-10-08T17:41:33.400 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-10-08T17:41:33.401 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-10-08T17:41:33.401 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-10-08T17:41:33.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-08T17:41:33.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.588+0000 7ff093fff700 1 Processor -- start 2023-10-08T17:41:33.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.588+0000 7ff093fff700 1 -- start start 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff093fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff09406aaa0 0x7ff09415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff093fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09415ae70 con 0x7ff09413fb20 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff093fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09406af60 con 0x7ff09413fef0 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff093fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09406b240 con 0x7ff09406aaa0 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff092ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff09413fb20 0x7ff0940c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35402/0 (socket says 172.21.15.12:35402) 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff092ffd700 1 -- 172.21.15.12:0/1174693248 learned_addr learned my addr 172.21.15.12:0/1174693248 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:33.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff0937fe700 1 --2- 172.21.15.12:0/1174693248 >> v2:172.21.15.29:3300/0 conn(0x7ff09406aaa0 0x7ff09415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092686765 0 0) 0x7ff084001110 con 0x7ff09413fb20 2023-10-08T17:41:33.592 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.590+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff07c003570 con 0x7ff09413fb20 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141482879 0 0) 0x7ff09406af60 con 0x7ff09413fef0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff084001110 con 0x7ff09413fef0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1660609849 0 0) 0x7ff07c003570 con 0x7ff09413fb20 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff0937fe700 1 -- 172.21.15.12:0/1174693248 >> v1:172.21.15.29:6789/0 conn(0x7ff09413fef0 legacy=0x7ff0940c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff0937fe700 1 -- 172.21.15.12:0/1174693248 >> v1:172.21.15.12:6789/0 conn(0x7ff09413fb20 legacy=0x7ff0940c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff0937fe700 1 -- 172.21.15.12:0/1174693248 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09406b520 con 0x7ff09406aaa0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff0937fe700 1 --2- 172.21.15.12:0/1174693248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09406aaa0 0x7ff09415a930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e60 tx=0x7ff08c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85e4edaed9cf54d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00e070 con 0x7ff09406aaa0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00b7a0 con 0x7ff09406aaa0 2023-10-08T17:41:33.593 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.591+0000 7ff091ffb700 1 -- 172.21.15.12:0/1174693248 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084001600 con 0x7ff09406aaa0 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 -- 172.21.15.12:0/1174693248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09406aaa0 msgr2=0x7ff09415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 --2- 172.21.15.12:0/1174693248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09406aaa0 0x7ff09415a930 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff08c009e60 tx=0x7ff08c009780 comp rx=0 tx=0).stop 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 -- 172.21.15.12:0/1174693248 shutdown_connections 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 --2- 172.21.15.12:0/1174693248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09406aaa0 0x7ff09415a930 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 -- 172.21.15.12:0/1174693248 >> 172.21.15.12:0/1174693248 conn(0x7ff09406d170 msgr2=0x7ff0940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 -- 172.21.15.12:0/1174693248 shutdown_connections 2023-10-08T17:41:33.594 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.592+0000 7ff093fff700 1 -- 172.21.15.12:0/1174693248 wait complete. 2023-10-08T17:41:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.593+0000 7ff093fff700 1 Processor -- start 2023-10-08T17:41:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.593+0000 7ff093fff700 1 -- start start 2023-10-08T17:41:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff09413fb20 0x7ff0940af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:33.596 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 0x7ff094169770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940ab740 con 0x7ff09406aaa0 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940ac5a0 con 0x7ff09413fef0 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.594+0000 7ff093fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0940afe20 con 0x7ff09413fb20 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51168/0 (socket says 172.21.15.12:51168) 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 -- 172.21.15.12:0/1340372169 learned_addr learned my addr 172.21.15.12:0/1340372169 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff0937fe700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 0x7ff094169770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff0927fc700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff09413fb20 0x7ff0940af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 -- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff09413fb20 msgr2=0x7ff0940af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff09413fb20 0x7ff0940af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 -- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 msgr2=0x7ff094169770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 0x7ff094169770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 -- 172.21.15.12:0/1340372169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08c009a20 con 0x7ff09406aaa0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff0937fe700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 0x7ff094169770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.595+0000 7ff092ffd700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff08400cb70 tx=0x7ff084001c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.596+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084007360 con 0x7ff09406aaa0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.596+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0840074e0 con 0x7ff09406aaa0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.596+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084004830 con 0x7ff09406aaa0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.596+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0940ab990 con 0x7ff09406aaa0 2023-10-08T17:41:33.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.596+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0940abf50 con 0x7ff09406aaa0 2023-10-08T17:41:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.597+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09404c3c0 con 0x7ff09406aaa0 2023-10-08T17:41:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.598+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7ff084004c80 con 0x7ff09406aaa0 2023-10-08T17:41:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.599+0000 7ff07affd700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 0x7ff080069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.599+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7ff0840842b0 con 0x7ff09406aaa0 2023-10-08T17:41:33.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.599+0000 7ff0927fc700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 0x7ff080069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:33.600 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.600+0000 7ff0927fc700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 0x7ff080069500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff0940c3110 tx=0x7ff088009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:33.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.603+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff084051120 con 0x7ff09406aaa0 2023-10-08T17:41:33.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:33.882+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7ff09415ae70 con 0x7ff09406aaa0 2023-10-08T17:41:34.382 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.382+0000 7ff07affd700 1 -- 172.21.15.12:0/1340372169 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v2977) v1 ==== 166+0+0 (secure 0 0 0) 0x7ff09415ae70 con 0x7ff09406aaa0 2023-10-08T17:41:34.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 msgr2=0x7ff080069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.385 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 0x7ff080069500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff0940c3110 tx=0x7ff088009040 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 msgr2=0x7ff09413c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7ff08400cb70 tx=0x7ff084001c40 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 shutdown_connections 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff080067050 0x7ff080069500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff09406aaa0 0x7ff09413c4d0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff09413fef0 0x7ff094169770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 --2- 172.21.15.12:0/1340372169 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff09413fb20 0x7ff0940af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 >> 172.21.15.12:0/1340372169 conn(0x7ff09406d170 msgr2=0x7ff0940c16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:34.386 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 shutdown_connections 2023-10-08T17:41:34.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.385+0000 7ff093fff700 1 -- 172.21.15.12:0/1340372169 wait complete. 2023-10-08T17:41:34.403 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T17:41:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.595+0000 7f2f1119d700 1 Processor -- start 2023-10-08T17:41:34.595 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.595+0000 7f2f1119d700 1 -- start start 2023-10-08T17:41:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.597 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c155890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 0x7f2f0c06de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c06b790 con 0x7f2f0c0c7930 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c06a8e0 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f1119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c06ab80 con 0x7f2f0c0cc840 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f0bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f0bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51176/0 (socket says 172.21.15.12:51176) 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.596+0000 7f2f0bfff700 1 -- 172.21.15.12:0/2044301609 learned_addr learned my addr 172.21.15.12:0/2044301609 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f1099c700 1 --2- 172.21.15.12:0/2044301609 >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 0x7f2f0c06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0b7fe700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.598 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 -- 172.21.15.12:0/2044301609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 msgr2=0x7f2f0c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 -- 172.21.15.12:0/2044301609 >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 msgr2=0x7f2f0c06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/2044301609 >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 0x7f2f0c06de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 -- 172.21.15.12:0/2044301609 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c06ae60 con 0x7f2f0c0c7930 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f1099c700 1 --2- 172.21.15.12:0/2044301609 >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 0x7f2f0c06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0099b0 tx=0x7f2efc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=457aa249567f91f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0affd700 1 -- 172.21.15.12:0/2044301609 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00b820 con 0x7f2f0c0c7930 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0affd700 1 -- 172.21.15.12:0/2044301609 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00b980 con 0x7f2f0c0c7930 2023-10-08T17:41:34.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.597+0000 7f2f0affd700 1 -- 172.21.15.12:0/2044301609 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc00bd20 con 0x7f2f0c0c7930 2023-10-08T17:41:34.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 -- 172.21.15.12:0/2044301609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0c7930 msgr2=0x7f2f0c06a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0099b0 tx=0x7f2efc009250 comp rx=0 tx=0).stop 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 -- 172.21.15.12:0/2044301609 shutdown_connections 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 --2- 172.21.15.12:0/2044301609 >> v2:172.21.15.29:3300/0 conn(0x7f2f0c0cccb0 0x7f2f0c06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c06a3a0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 --2- 172.21.15.12:0/2044301609 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 -- 172.21.15.12:0/2044301609 >> 172.21.15.12:0/2044301609 conn(0x7f2f0c06d110 msgr2=0x7f2f0c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 -- 172.21.15.12:0/2044301609 shutdown_connections 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.598+0000 7f2f1119d700 1 -- 172.21.15.12:0/2044301609 wait complete. 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.600+0000 7f2f1119d700 1 Processor -- start 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.600+0000 7f2f1119d700 1 -- start start 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.603 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c1576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c155dd0 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c14b330 con 0x7f2f0c0c7930 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1119d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c14b610 con 0x7f2f0c0cc840 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51186/0 (socket says 172.21.15.12:51186) 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 -- 172.21.15.12:0/1429051310 learned_addr learned my addr 172.21.15.12:0/1429051310 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f0b7fe700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c1576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 -- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 msgr2=0x7f2f0c1576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c1576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 -- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 msgr2=0x7f2f0c155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f1099c700 1 -- 172.21.15.12:0/1429051310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2efc0094f0 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.601+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2f1099c700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d150 tx=0x7f2f04009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0400dd90 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0400f040 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0c14b8f0 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f04015650 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.602+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c1426f0 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.603+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0af170 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.604+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f2f04015a40 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.605+0000 7f2ef3fff700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 0x7f2ef8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:34.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.605+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f2f04085380 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.605+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 0x7f2ef8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:34.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.606+0000 7f2f0bfff700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 0x7f2ef8069500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0099b0 tx=0x7f2efc017000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:34.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.609+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f0c0af170 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.812 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.812+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2f0c0af170 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.816+0000 7f2ef3fff700 1 -- 172.21.15.12:0/1429051310 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2f0c0af170 con 0x7f2f0c0cccb0 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.818+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 msgr2=0x7f2ef8069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.818+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 0x7f2ef8069500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f2efc0099b0 tx=0x7f2efc017000 comp rx=0 tx=0).stop 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.818+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 msgr2=0x7f2f0c16ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.818+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f2f0400d150 tx=0x7f2f04009a50 comp rx=0 tx=0).stop 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 shutdown_connections 2023-10-08T17:41:34.819 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ef8067050 0x7f2ef8069500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2f0c0cccb0 0x7f2f0c16ae30 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2f0c0c7930 0x7f2f0c155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 --2- 172.21.15.12:0/1429051310 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2f0c0cc840 0x7f2f0c1576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 >> 172.21.15.12:0/1429051310 conn(0x7f2f0c06d110 msgr2=0x7f2f0c0c2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 shutdown_connections 2023-10-08T17:41:34.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:34.819+0000 7f2f1119d700 1 -- 172.21.15.12:0/1429051310 wait complete. 2023-10-08T17:41:34.836 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:41:34.836 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:41:34.919 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:41:35.002 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:41:35.002 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T17:41:35.002 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:35.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.190+0000 7f7cbd39d700 1 Processor -- start 2023-10-08T17:41:35.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.190+0000 7f7cbd39d700 1 -- start start 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cbd39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7cb8159640 0x7f7cb806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cbd39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb8159a10 0x7f7cb80ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cbd39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cb80c7420 con 0x7f7cb8070410 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cbd39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806d5a0 con 0x7f7cb8159a10 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cbd39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cb806d820 con 0x7f7cb8159640 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.191+0000 7f7cb77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb8159a10 0x7f7cb80ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cb8159a10 0x7f7cb80ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51200/0 (socket says 172.21.15.12:51200) 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 -- 172.21.15.12:0/2371110549 learned_addr learned my addr 172.21.15.12:0/2371110549 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cbcb9c700 1 --1- 172.21.15.12:0/2371110549 >> v1:172.21.15.12:6789/0 conn(0x7f7cb8070410 0x7f7cb806a2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35412/0 (socket says 172.21.15.12:35412) 2023-10-08T17:41:35.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb7fff700 1 --2- 172.21.15.12:0/2371110549 >> v2:172.21.15.29:3300/0 conn(0x7f7cb8159640 0x7f7cb806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 -- 172.21.15.12:0/2371110549 >> v2:172.21.15.29:3300/0 conn(0x7f7cb8159640 msgr2=0x7f7cb806d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:35.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 --2- 172.21.15.12:0/2371110549 >> v2:172.21.15.29:3300/0 conn(0x7f7cb8159640 0x7f7cb806d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 -- 172.21.15.12:0/2371110549 >> v1:172.21.15.12:6789/0 conn(0x7f7cb8070410 legacy=0x7f7cb806a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 -- 172.21.15.12:0/2371110549 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb806db00 con 0x7f7cb8159a10 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb6ffd700 1 -- 172.21.15.12:0/2371110549 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800655033 0 0) 0x7f7cb80c7420 con 0x7f7cb8070410 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.192+0000 7f7cb77fe700 1 --2- 172.21.15.12:0/2371110549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159a10 0x7f7cb80ca7b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8069dc0 tx=0x7f7cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d10fcedf859430a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cb6ffd700 1 -- 172.21.15.12:0/2371110549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac009e70 con 0x7f7cb8159a10 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cb6ffd700 1 -- 172.21.15.12:0/2371110549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b860 con 0x7f7cb8159a10 2023-10-08T17:41:35.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cb6ffd700 1 -- 172.21.15.12:0/2371110549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00bc00 con 0x7f7cb8159a10 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 -- 172.21.15.12:0/2371110549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159a10 msgr2=0x7f7cb80ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/2371110549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159a10 0x7f7cb80ca7b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8069dc0 tx=0x7f7cac009250 comp rx=0 tx=0).stop 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 -- 172.21.15.12:0/2371110549 shutdown_connections 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/2371110549 >> v2:172.21.15.29:3300/0 conn(0x7f7cb8159640 0x7f7cb806d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/2371110549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159a10 0x7f7cb80ca7b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 -- 172.21.15.12:0/2371110549 >> 172.21.15.12:0/2371110549 conn(0x7f7cb806e720 msgr2=0x7f7cb806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 -- 172.21.15.12:0/2371110549 shutdown_connections 2023-10-08T17:41:35.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.193+0000 7f7cbd39d700 1 -- 172.21.15.12:0/2371110549 wait complete. 2023-10-08T17:41:35.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.195+0000 7f7cbd39d700 1 Processor -- start 2023-10-08T17:41:35.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.195+0000 7f7cbd39d700 1 -- start start 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb8070410 0x7f7cb80b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 0x7f7cb81548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb80b24d0 con 0x7f7cb8159640 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816d470 con 0x7f7cb8159a10 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbd39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb816ade0 con 0x7f7cb8070410 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cb77fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51204/0 (socket says 172.21.15.12:51204) 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cb77fe700 1 -- 172.21.15.12:0/3921254637 learned_addr learned my addr 172.21.15.12:0/3921254637 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cbcb9c700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 0x7f7cb81548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.196+0000 7f7cb7fff700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb8070410 0x7f7cb80b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 -- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb8070410 msgr2=0x7f7cb80b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb8070410 0x7f7cb80b1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 -- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 msgr2=0x7f7cb81548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 0x7f7cb81548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 -- 172.21.15.12:0/3921254637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0094f0 con 0x7f7cb8159640 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cbcb9c700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 0x7f7cb81548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cb77fe700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0094c0 tx=0x7f7cac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00bbe0 con 0x7f7cb8159640 2023-10-08T17:41:35.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac011420 con 0x7f7cb8159640 2023-10-08T17:41:35.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011800 con 0x7f7cb8159640 2023-10-08T17:41:35.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cb80b26d0 con 0x7f7cb8159640 2023-10-08T17:41:35.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.197+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cb816da20 con 0x7f7cb8159640 2023-10-08T17:41:35.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.198+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cb804c3c0 con 0x7f7cb8159640 2023-10-08T17:41:35.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.199+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f7cac011bb0 con 0x7f7cb8159640 2023-10-08T17:41:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.200+0000 7f7c9ffff700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 0x7f7ca4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.201+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f7cac086150 con 0x7f7cb8159640 2023-10-08T17:41:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.201+0000 7f7cb7fff700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 0x7f7ca4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.201+0000 7f7cb7fff700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 0x7f7ca4069500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806b170 tx=0x7f7ca8008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.205+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cac052fc0 con 0x7f7cb8159640 2023-10-08T17:41:35.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.452+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cb80c7a50 con 0x7f7cb8159640 2023-10-08T17:41:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.453+0000 7f7c9ffff700 1 -- 172.21.15.12:0/3921254637 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f7cac015de0 con 0x7f7cb8159640 2023-10-08T17:41:35.453 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:35.453 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":85,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7655,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/3502595279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3502595279},{"type":"v1","addr":"172.21.15.29:6835","nonce":3502595279}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78},{"gid":7979,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2484780832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2484780832},{"type":"v1","addr":"172.21.15.29:6834","nonce":2484780832}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":9228,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/1775223968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":1775223968},{"type":"v1","addr":"172.21.15.12:6833","nonce":1775223968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":77},{"gid":9231,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/2531122757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":2531122757},{"type":"v1","addr":"172.21.15.12:6835","nonce":2531122757}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[]} 2023-10-08T17:41:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 msgr2=0x7f7ca4069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 0x7f7ca4069500 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7cb806b170 tx=0x7f7ca8008040 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 msgr2=0x7f7cb816a8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f7cac0094c0 tx=0x7f7cac017000 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 shutdown_connections 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ca4067050 0x7f7ca4069500 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cb8159a10 0x7f7cb81548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cb8070410 0x7f7cb80b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 --2- 172.21.15.12:0/3921254637 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cb8159640 0x7f7cb816a8a0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 >> 172.21.15.12:0/3921254637 conn(0x7f7cb806e720 msgr2=0x7f7cb8155e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 shutdown_connections 2023-10-08T17:41:35.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.455+0000 7f7cbd39d700 1 -- 172.21.15.12:0/3921254637 wait complete. 2023-10-08T17:41:35.457 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 85 2023-10-08T17:41:35.473 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T17:41:35.473 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T17:41:35.473 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T17:41:35.473 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:41:35.473 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T17:41:35.474 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T17:41:35.474 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T17:41:35.474 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:41:35.474 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T17:41:35.474 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T17:41:35.474 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T17:41:35.474 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:41:35.475 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T17:41:35.475 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T17:41:35.475 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T17:41:35.475 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:41:35.489 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T17:41:35.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T17:41:35.490 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T17:41:35.491 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T17:41:35.496 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T17:41:35.496 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T17:41:35.498 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T17:41:35.498 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T17:41:35.534 INFO:tasks.ceph.mds.a:Started 2023-10-08T17:41:35.535 DEBUG:teuthology.parallel:result is None 2023-10-08T17:41:35.537 INFO:tasks.ceph.mds.c:Started 2023-10-08T17:41:35.538 DEBUG:teuthology.parallel:result is None 2023-10-08T17:41:35.541 INFO:tasks.ceph.mds.d:Started 2023-10-08T17:41:35.541 DEBUG:teuthology.parallel:result is None 2023-10-08T17:41:35.544 INFO:tasks.ceph.mds.b:Started 2023-10-08T17:41:35.544 DEBUG:teuthology.parallel:result is None 2023-10-08T17:41:35.544 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T17:41:35.671 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T17:41:35.673 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:41:35.685 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T17:41:35.686 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T17:41:35.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.743+0000 7f850e19d700 1 Processor -- start 2023-10-08T17:41:35.743 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.743+0000 7f850e19d700 1 -- start start 2023-10-08T17:41:35.744 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.744+0000 7f850e19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f85080cf110 0x7f8508164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.744+0000 7f850e19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850815afd0 con 0x7f850815de50 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.744+0000 7f850e19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f850815b2b0 con 0x7f8508153c30 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.744+0000 7f850e19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f850815b590 con 0x7f85080cf110 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850c99a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f850815de50 0x7f85080cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35442/0 (socket says 172.21.15.12:35442) 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850c99a700 1 -- 172.21.15.12:0/4263816573 learned_addr learned my addr 172.21.15.12:0/4263816573 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850d99c700 1 --2- 172.21.15.12:0/4263816573 >> v2:172.21.15.29:3300/0 conn(0x7f85080cf110 0x7f8508164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142639471 0 0) 0x7f850815afd0 con 0x7f850815de50 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003570 con 0x7f850815de50 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677331212 0 0) 0x7f850815b2b0 con 0x7f8508153c30 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f850815afd0 con 0x7f8508153c30 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850d99c700 1 -- 172.21.15.12:0/4263816573 >> v1:172.21.15.29:6789/0 conn(0x7f8508153c30 legacy=0x7f850815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850d99c700 1 -- 172.21.15.12:0/4263816573 >> v1:172.21.15.12:6789/0 conn(0x7f850815de50 legacy=0x7f85080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850d99c700 1 -- 172.21.15.12:0/4263816573 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850815b870 con 0x7f85080cf110 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.745+0000 7f850d99c700 1 --2- 172.21.15.12:0/4263816573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508164600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8500009e60 tx=0x7f8500009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7535c4686547f4c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000e070 con 0x7f85080cf110 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850000bab0 con 0x7f85080cf110 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f84fffff700 1 -- 172.21.15.12:0/4263816573 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000be70 con 0x7f85080cf110 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 -- 172.21.15.12:0/4263816573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 msgr2=0x7f8508164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 --2- 172.21.15.12:0/4263816573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508164600 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8500009e60 tx=0x7f8500009780 comp rx=0 tx=0).stop 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 -- 172.21.15.12:0/4263816573 shutdown_connections 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 --2- 172.21.15.12:0/4263816573 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508164600 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 -- 172.21.15.12:0/4263816573 >> 172.21.15.12:0/4263816573 conn(0x7f85080703a0 msgr2=0x7f85080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 -- 172.21.15.12:0/4263816573 shutdown_connections 2023-10-08T17:41:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.746+0000 7f850e19d700 1 -- 172.21.15.12:0/4263816573 wait complete. 2023-10-08T17:41:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.748+0000 7f850e19d700 1 Processor -- start 2023-10-08T17:41:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.748+0000 7f850e19d700 1 -- start start 2023-10-08T17:41:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f850815de50 0x7f85080c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080c8940 con 0x7f8508153c30 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080b4900 con 0x7f85080cf110 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850e19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080b4be0 con 0x7f850815de50 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51230/0 (socket says 172.21.15.12:51230) 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850d19b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 -- 172.21.15.12:0/333657644 learned_addr learned my addr 172.21.15.12:0/333657644 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850d99c700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f850815de50 0x7f85080c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 -- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f850815de50 msgr2=0x7f85080c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f850815de50 0x7f85080c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 -- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 msgr2=0x7f8508169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.749+0000 7f850c99a700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f850c99a700 1 -- 172.21.15.12:0/333657644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8500009a20 con 0x7f8508153c30 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f850c99a700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c790 tx=0x7f84f8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8005b30 con 0x7f8508153c30 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f8005cd0 con 0x7f8508153c30 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f8007320 con 0x7f8508153c30 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85080b4ec0 con 0x7f8508153c30 2023-10-08T17:41:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.750+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080c8c20 con 0x7f8508153c30 2023-10-08T17:41:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.751+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85080b4760 con 0x7f8508153c30 2023-10-08T17:41:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.752+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f84f8012400 con 0x7f8508153c30 2023-10-08T17:41:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.753+0000 7f84fd7fa700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 0x7f84ec069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.753+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 6291+0+0 (secure 0 0 0) 0x7f84f8083cd0 con 0x7f8508153c30 2023-10-08T17:41:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.753+0000 7f850d19b700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 0x7f84ec069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:35.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.754+0000 7f850d19b700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 0x7f84ec069500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8504007fd0 tx=0x7f8504007d50 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.757+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84f804b5a0 con 0x7f8508153c30 2023-10-08T17:41:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:35.977+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f85080b5100 con 0x7f8508153c30 2023-10-08T17:41:36.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.396+0000 7f84fd7fa700 1 -- 172.21.15.12:0/333657644 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f85080b5100 con 0x7f8508153c30 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 msgr2=0x7f84ec069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 0x7f84ec069500 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8504007fd0 tx=0x7f8504007d50 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 msgr2=0x7f8508151eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f84f800c790 tx=0x7f84f8007e80 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 shutdown_connections 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f84ec067050 0x7f84ec069500 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f850815de50 0x7f85080c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f85080cf110 0x7f8508169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 --2- 172.21.15.12:0/333657644 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8508153c30 0x7f8508151eb0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 >> 172.21.15.12:0/333657644 conn(0x7f85080703a0 msgr2=0x7f85080ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 shutdown_connections 2023-10-08T17:41:36.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.399+0000 7f850e19d700 1 -- 172.21.15.12:0/333657644 wait complete. 2023-10-08T17:41:36.401 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T17:41:36.420 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T17:41:36.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.607+0000 7f2fcf59e700 1 Processor -- start 2023-10-08T17:41:36.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.607+0000 7f2fcf59e700 1 -- start start 2023-10-08T17:41:36.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcf59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2fd006aaa0 0x7f2fd00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd015ae70 con 0x7f2fd013fb20 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcf59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd006af60 con 0x7f2fd006aaa0 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006b240 con 0x7f2fd013fef0 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fce59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2fd013fb20 0x7f2fd00c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35452/0 (socket says 172.21.15.12:35452) 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fce59c700 1 -- 172.21.15.12:0/573229809 learned_addr learned my addr 172.21.15.12:0/573229809 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.608+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/573229809 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.609 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fced9d700 1 --2- 172.21.15.12:0/573229809 >> v2:172.21.15.29:3300/0 conn(0x7f2fd006aaa0 0x7f2fd00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcd59a700 1 -- 172.21.15.12:0/573229809 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240485613 0 0) 0x7f2fc0001110 con 0x7f2fd013fb20 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcd59a700 1 -- 172.21.15.12:0/573229809 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb8003570 con 0x7f2fd013fb20 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcdd9b700 1 -- 172.21.15.12:0/573229809 >> v2:172.21.15.29:3300/0 conn(0x7f2fd006aaa0 msgr2=0x7f2fd00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/573229809 >> v2:172.21.15.29:3300/0 conn(0x7f2fd006aaa0 0x7f2fd00c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcdd9b700 1 -- 172.21.15.12:0/573229809 >> v1:172.21.15.12:6789/0 conn(0x7f2fd013fb20 legacy=0x7f2fd00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcdd9b700 1 -- 172.21.15.12:0/573229809 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd006b520 con 0x7f2fd013fef0 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.609+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/573229809 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd015a930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098d0 tx=0x7f2fc4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74b3e74f4b604b6f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcd59a700 1 -- 172.21.15.12:0/573229809 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4005c10 con 0x7f2fd013fef0 2023-10-08T17:41:36.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcd59a700 1 -- 172.21.15.12:0/573229809 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc4005d70 con 0x7f2fd013fef0 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcd59a700 1 -- 172.21.15.12:0/573229809 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4006260 con 0x7f2fd013fef0 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 -- 172.21.15.12:0/573229809 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 msgr2=0x7f2fd015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/573229809 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd015a930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098d0 tx=0x7f2fc4009120 comp rx=0 tx=0).stop 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 -- 172.21.15.12:0/573229809 shutdown_connections 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/573229809 >> v2:172.21.15.29:3300/0 conn(0x7f2fd006aaa0 0x7f2fd00c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/573229809 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd015a930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 -- 172.21.15.12:0/573229809 >> 172.21.15.12:0/573229809 conn(0x7f2fd006d170 msgr2=0x7f2fd00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 -- 172.21.15.12:0/573229809 shutdown_connections 2023-10-08T17:41:36.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.610+0000 7f2fcf59e700 1 -- 172.21.15.12:0/573229809 wait complete. 2023-10-08T17:41:36.614 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.612+0000 7f2fcf59e700 1 Processor -- start 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.612+0000 7f2fcf59e700 1 -- start start 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd013fb20 0x7f2fd0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd00c1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0158210 con 0x7f2fd006aaa0 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0138410 con 0x7f2fd013fb20 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0157c30 con 0x7f2fd013fef0 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51232/0 (socket says 172.21.15.12:51232) 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 -- 172.21.15.12:0/2645710825 learned_addr learned my addr 172.21.15.12:0/2645710825 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:36.615 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd013fb20 0x7f2fd0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fced9d700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd00c1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 -- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 msgr2=0x7f2fd00c1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd00c1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 -- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd013fb20 msgr2=0x7f2fd0156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.613+0000 7f2fce59c700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd013fb20 0x7f2fd0156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fce59c700 1 -- 172.21.15.12:0/2645710825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc40093c0 con 0x7f2fd006aaa0 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fced9d700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd00c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fce59c700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c7f0 tx=0x7f2fc0007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0005b30 con 0x7f2fd006aaa0 2023-10-08T17:41:36.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc0005cb0 con 0x7f2fd006aaa0 2023-10-08T17:41:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd0157390 con 0x7f2fd006aaa0 2023-10-08T17:41:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0007320 con 0x7f2fd006aaa0 2023-10-08T17:41:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.614+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0157950 con 0x7f2fd006aaa0 2023-10-08T17:41:36.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.615+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd004c3c0 con 0x7f2fd006aaa0 2023-10-08T17:41:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.616+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f2fc001b3b0 con 0x7f2fd006aaa0 2023-10-08T17:41:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.617+0000 7f2fbe7fc700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 0x7f2fb0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.617+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f2fc00839f0 con 0x7f2fd006aaa0 2023-10-08T17:41:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.617+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 0x7f2fb0069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:36.618 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.618+0000 7f2fcdd9b700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 0x7f2fb0069500 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0069580 tx=0x7f2fc4016000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:36.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.621+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fc0050c10 con 0x7f2fd006aaa0 2023-10-08T17:41:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.902+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2fd015ae70 con 0x7f2fd006aaa0 2023-10-08T17:41:36.902 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.902+0000 7f2fbe7fc700 1 -- 172.21.15.12:0/2645710825 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v47) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2fd015ae70 con 0x7f2fd006aaa0 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.903 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T17:41:36.904 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.905 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.906 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.907 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.908 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.909 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T17:41:36.910 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.911 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.912 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.913 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T17:41:36.914 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T17:41:36.915 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.916 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:41:36.917 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.918 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T17:41:36.919 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 msgr2=0x7f2fb0069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 0x7f2fb0069500 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0069580 tx=0x7f2fc4016000 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 msgr2=0x7f2fd01561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000c7f0 tx=0x7f2fc0007c70 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 shutdown_connections 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2fb0067050 0x7f2fb0069500 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2fd006aaa0 0x7f2fd01561c0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2fd013fef0 0x7f2fd00c1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 --2- 172.21.15.12:0/2645710825 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2fd013fb20 0x7f2fd0156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 >> 172.21.15.12:0/2645710825 conn(0x7f2fd006d170 msgr2=0x7f2fd00ca560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:36.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 shutdown_connections 2023-10-08T17:41:36.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:36.905+0000 7f2fcf59e700 1 -- 172.21.15.12:0/2645710825 wait complete. 2023-10-08T17:41:36.923 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:37.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.110+0000 7f0ebd19d700 1 Processor -- start 2023-10-08T17:41:37.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.110+0000 7f0ebd19d700 1 -- start start 2023-10-08T17:41:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0ebd19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0eb8150380 0x7f0eb8160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0ebd19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb806a490 con 0x7f0eb806f3a0 2023-10-08T17:41:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0ebd19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80c7230 con 0x7f0eb806e0a0 2023-10-08T17:41:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0ebd19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb806b930 con 0x7f0eb8150380 2023-10-08T17:41:37.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0eb77fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0eb806f3a0 0x7f0eb814fc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35456/0 (socket says 172.21.15.12:35456) 2023-10-08T17:41:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0eb77fe700 1 -- 172.21.15.12:0/351132345 learned_addr learned my addr 172.21.15.12:0/351132345 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:37.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.112+0000 7f0ebc99c700 1 --2- 172.21.15.12:0/351132345 >> v2:172.21.15.29:3300/0 conn(0x7f0eb8150380 0x7f0eb8160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697317840 0 0) 0x7f0eb806a490 con 0x7f0eb806f3a0 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea0004680 con 0x7f0eb806f3a0 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0ebc99c700 1 -- 172.21.15.12:0/351132345 >> v1:172.21.15.29:6789/0 conn(0x7f0eb806e0a0 legacy=0x7f0eb80c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104848294 0 0) 0x7f0eb80c7230 con 0x7f0eb806e0a0 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0ebc99c700 1 -- 172.21.15.12:0/351132345 >> v1:172.21.15.12:6789/0 conn(0x7f0eb806f3a0 legacy=0x7f0eb814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0ebc99c700 1 -- 172.21.15.12:0/351132345 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80c7490 con 0x7f0eb8150380 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0ebc99c700 1 --2- 172.21.15.12:0/351132345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb8150380 0x7f0eb8160ae0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e60 tx=0x7f0eb0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dafa2eef527d360 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb000e070 con 0x7f0eb8150380 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb000bb60 con 0x7f0eb8150380 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.113+0000 7f0eb6ffd700 1 -- 172.21.15.12:0/351132345 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0012430 con 0x7f0eb8150380 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 -- 172.21.15.12:0/351132345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb8150380 msgr2=0x7f0eb8160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/351132345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb8150380 0x7f0eb8160ae0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009e60 tx=0x7f0eb0009780 comp rx=0 tx=0).stop 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 -- 172.21.15.12:0/351132345 shutdown_connections 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/351132345 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb8150380 0x7f0eb8160ae0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 -- 172.21.15.12:0/351132345 >> 172.21.15.12:0/351132345 conn(0x7f0eb806d170 msgr2=0x7f0eb80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 -- 172.21.15.12:0/351132345 shutdown_connections 2023-10-08T17:41:37.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.114+0000 7f0ebd19d700 1 -- 172.21.15.12:0/351132345 wait complete. 2023-10-08T17:41:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.116+0000 7f0ebd19d700 1 Processor -- start 2023-10-08T17:41:37.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.116+0000 7f0ebd19d700 1 -- start start 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0eb806e0a0 0x7f0eb816b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb806f3a0 0x7f0eb80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c6880 con 0x7f0eb8150380 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c6a90 con 0x7f0eb806f3a0 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebd19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c6d70 con 0x7f0eb806e0a0 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51248/0 (socket says 172.21.15.12:51248) 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 -- 172.21.15.12:0/259350198 learned_addr learned my addr 172.21.15.12:0/259350198 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:37.119 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0eb77fe700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb806f3a0 0x7f0eb80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0eb7fff700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0eb806e0a0 0x7f0eb816b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 -- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0eb806e0a0 msgr2=0x7f0eb816b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0eb806e0a0 0x7f0eb816b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 -- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb806f3a0 msgr2=0x7f0eb80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb806f3a0 0x7f0eb80cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.117+0000 7f0ebc99c700 1 -- 172.21.15.12:0/259350198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009a20 con 0x7f0eb8150380 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0ebc99c700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0013000 tx=0x7f0eb0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0026480 con 0x7f0eb8150380 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb0026640 con 0x7f0eb8150380 2023-10-08T17:41:37.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb80c7050 con 0x7f0eb8150380 2023-10-08T17:41:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb0026a00 con 0x7f0eb8150380 2023-10-08T17:41:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.118+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb816adc0 con 0x7f0eb8150380 2023-10-08T17:41:37.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.119+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb804c3c0 con 0x7f0eb8150380 2023-10-08T17:41:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.120+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f0eb001c400 con 0x7f0eb8150380 2023-10-08T17:41:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.121+0000 7f0e9ffff700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 0x7f0ea4069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.121+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f0eb00865f0 con 0x7f0eb8150380 2023-10-08T17:41:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.121+0000 7f0eb7fff700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 0x7f0ea4069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.122+0000 7f0eb7fff700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 0x7f0ea4069500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80011e0 tx=0x7f0ea8009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.125+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eb00537a0 con 0x7f0eb8150380 2023-10-08T17:41:37.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.330+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb80c7770 con 0x7f0eb8150380 2023-10-08T17:41:37.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.331+0000 7f0e9ffff700 1 -- 172.21.15.12:0/259350198 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v194) v1 ==== 74+0+12949 (secure 0 0 0) 0x7f0eb0056dc0 con 0x7f0eb8150380 2023-10-08T17:41:37.331 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:37.331 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":194,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:36.406562+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":183,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.333+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 msgr2=0x7f0ea4069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.333+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 0x7f0ea4069500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80011e0 tx=0x7f0ea8009040 comp rx=0 tx=0).stop 2023-10-08T17:41:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.333+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 msgr2=0x7f0eb8158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.333+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0013000 tx=0x7f0eb0019000 comp rx=0 tx=0).stop 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 shutdown_connections 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0ea4067050 0x7f0ea4069500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0eb8150380 0x7f0eb8158200 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0eb806e0a0 0x7f0eb816b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 --2- 172.21.15.12:0/259350198 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0eb806f3a0 0x7f0eb80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 >> 172.21.15.12:0/259350198 conn(0x7f0eb806d170 msgr2=0x7f0eb80b0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 shutdown_connections 2023-10-08T17:41:37.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.334+0000 7f0ebd19d700 1 -- 172.21.15.12:0/259350198 wait complete. 2023-10-08T17:41:37.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T17:41:37.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:41:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.545+0000 7fa44899d700 1 Processor -- start 2023-10-08T17:41:37.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.545+0000 7fa44899d700 1 -- start start 2023-10-08T17:41:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa44899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa44406db20 0x7fa44415a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa44899d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4440caec0 0x7fa44415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa44899d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44415ada0 con 0x7fa444153c90 2023-10-08T17:41:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa44899d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44406ca80 con 0x7fa4440caec0 2023-10-08T17:41:37.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa44899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa44406cd60 con 0x7fa44406db20 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.546+0000 7fa443fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa4440caec0 0x7fa44415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa4437fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa444153c90 0x7fa4440ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35462/0 (socket says 172.21.15.12:35462) 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa4437fe700 1 -- 172.21.15.12:0/1442368954 learned_addr learned my addr 172.21.15.12:0/1442368954 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa442ffd700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa44406db20 0x7fa44415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa443fff700 1 -- 172.21.15.12:0/1442368954 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa44406db20 msgr2=0x7fa44415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa443fff700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa44406db20 0x7fa44415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa443fff700 1 -- 172.21.15.12:0/1442368954 >> v1:172.21.15.12:6789/0 conn(0x7fa444153c90 legacy=0x7fa4440ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa443fff700 1 -- 172.21.15.12:0/1442368954 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44406d040 con 0x7fa4440caec0 2023-10-08T17:41:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa4427fc700 1 -- 172.21.15.12:0/1442368954 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141444017 0 0) 0x7fa434001110 con 0x7fa444153c90 2023-10-08T17:41:37.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.547+0000 7fa443fff700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4440caec0 0x7fa44415afb0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009e60 tx=0x7fa43c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ccf97988e968307 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa4427fc700 1 -- 172.21.15.12:0/1442368954 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00e070 con 0x7fa4440caec0 2023-10-08T17:41:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa4427fc700 1 -- 172.21.15.12:0/1442368954 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c00bc30 con 0x7fa4440caec0 2023-10-08T17:41:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa4427fc700 1 -- 172.21.15.12:0/1442368954 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c012430 con 0x7fa4440caec0 2023-10-08T17:41:37.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 -- 172.21.15.12:0/1442368954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4440caec0 msgr2=0x7fa44415afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4440caec0 0x7fa44415afb0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009e60 tx=0x7fa43c009780 comp rx=0 tx=0).stop 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 -- 172.21.15.12:0/1442368954 shutdown_connections 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa4440caec0 0x7fa44415afb0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 --2- 172.21.15.12:0/1442368954 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa44406db20 0x7fa44415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 -- 172.21.15.12:0/1442368954 >> 172.21.15.12:0/1442368954 conn(0x7fa44406e720 msgr2=0x7fa44406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 -- 172.21.15.12:0/1442368954 shutdown_connections 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.548+0000 7fa44899d700 1 -- 172.21.15.12:0/1442368954 wait complete. 2023-10-08T17:41:37.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.550+0000 7fa44899d700 1 Processor -- start 2023-10-08T17:41:37.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.550+0000 7fa44899d700 1 -- start start 2023-10-08T17:41:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa44406db20 0x7fa4440afb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4440caec0 0x7fa444152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c6d20 con 0x7fa444153c90 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c6150 con 0x7fa44406db20 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa44899d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440c63f0 con 0x7fa4440caec0 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa443fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa443fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51276/0 (socket says 172.21.15.12:51276) 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa443fff700 1 -- 172.21.15.12:0/4209393574 learned_addr learned my addr 172.21.15.12:0/4209393574 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa4437fe700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa44406db20 0x7fa4440afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa442ffd700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4440caec0 0x7fa444152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.551+0000 7fa443fff700 1 -- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4440caec0 msgr2=0x7fa444152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa443fff700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4440caec0 0x7fa444152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa443fff700 1 -- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa44406db20 msgr2=0x7fa4440afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa443fff700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa44406db20 0x7fa4440afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa443fff700 1 -- 172.21.15.12:0/4209393574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c009a20 con 0x7fa444153c90 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa443fff700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fa43c013000 tx=0x7fa43c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c027470 con 0x7fa444153c90 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c027610 con 0x7fa444153c90 2023-10-08T17:41:37.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4440c66d0 con 0x7fa444153c90 2023-10-08T17:41:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0279d0 con 0x7fa444153c90 2023-10-08T17:41:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.552+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4440b0090 con 0x7fa444153c90 2023-10-08T17:41:37.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.553+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa44404c3c0 con 0x7fa444153c90 2023-10-08T17:41:37.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.554+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fa43c024070 con 0x7fa444153c90 2023-10-08T17:41:37.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.555+0000 7fa42b7fe700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 0x7fa430069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.555+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fa43c086e00 con 0x7fa444153c90 2023-10-08T17:41:37.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.555+0000 7fa4437fe700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 0x7fa430069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.556+0000 7fa4437fe700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 0x7fa430069500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa434007160 tx=0x7fa434007f50 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.560+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa43c054020 con 0x7fa444153c90 2023-10-08T17:41:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.758+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa44406af50 con 0x7fa444153c90 2023-10-08T17:41:37.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.758+0000 7fa42b7fe700 1 -- 172.21.15.12:0/4209393574 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v194) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa43c057640 con 0x7fa444153c90 2023-10-08T17:41:37.758 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.760+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 msgr2=0x7fa430069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.760+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 0x7fa430069500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa434007160 tx=0x7fa434007f50 comp rx=0 tx=0).stop 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.760+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 msgr2=0x7fa444153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.760+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fa43c013000 tx=0x7fa43c019000 comp rx=0 tx=0).stop 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.760+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 shutdown_connections 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa430067050 0x7fa430069500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa444153c90 0x7fa444153280 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa44406db20 0x7fa4440afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 --2- 172.21.15.12:0/4209393574 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa4440caec0 0x7fa444152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 >> 172.21.15.12:0/4209393574 conn(0x7fa44406e720 msgr2=0x7fa444151d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 shutdown_connections 2023-10-08T17:41:37.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.761+0000 7fa44899d700 1 -- 172.21.15.12:0/4209393574 wait complete. 2023-10-08T17:41:37.778 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T17:41:37.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.965+0000 7fa14f59d700 1 Processor -- start 2023-10-08T17:41:37.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.966+0000 7fa14f59d700 1 -- start start 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 0x7fa14806d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa148159aa0 0x7fa1480703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480cac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1480cb170 con 0x7fa148159aa0 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa14806d3e0 con 0x7fa1481596d0 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14806c7d0 con 0x7fa1480ca7b0 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14dd9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa148159aa0 0x7fa1480703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14dd9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa148159aa0 0x7fa1480703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51280/0 (socket says 172.21.15.12:51280) 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14dd9a700 1 -- 172.21.15.12:0/718727017 learned_addr learned my addr 172.21.15.12:0/718727017 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:37.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.967+0000 7fa14e59b700 1 --2- 172.21.15.12:0/718727017 >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 0x7fa14806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14ed9c700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 -- 172.21.15.12:0/718727017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 msgr2=0x7fa1480cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480cac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 -- 172.21.15.12:0/718727017 >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 msgr2=0x7fa14806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/718727017 >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 0x7fa14806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 -- 172.21.15.12:0/718727017 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14806cab0 con 0x7fa148159aa0 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14e59b700 1 --2- 172.21.15.12:0/718727017 >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 0x7fa14806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:37.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa148159aa0 0x7fa1480703a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa148069eb0 tx=0x7fa138009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43b7ea92b0671a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14d599700 1 -- 172.21.15.12:0/718727017 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800b860 con 0x7fa148159aa0 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14d599700 1 -- 172.21.15.12:0/718727017 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13800b9c0 con 0x7fa148159aa0 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.968+0000 7fa14d599700 1 -- 172.21.15.12:0/718727017 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13800bd80 con 0x7fa148159aa0 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 -- 172.21.15.12:0/718727017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa148159aa0 msgr2=0x7fa1480703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa148159aa0 0x7fa1480703a0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7fa148069eb0 tx=0x7fa138009250 comp rx=0 tx=0).stop 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 -- 172.21.15.12:0/718727017 shutdown_connections 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480cac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 --2- 172.21.15.12:0/718727017 >> v2:172.21.15.29:3300/0 conn(0x7fa1481596d0 0x7fa14806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 --2- 172.21.15.12:0/718727017 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa148159aa0 0x7fa1480703a0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 -- 172.21.15.12:0/718727017 >> 172.21.15.12:0/718727017 conn(0x7fa14806e720 msgr2=0x7fa14806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:37.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 -- 172.21.15.12:0/718727017 shutdown_connections 2023-10-08T17:41:37.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.969+0000 7fa14f59d700 1 -- 172.21.15.12:0/718727017 wait complete. 2023-10-08T17:41:37.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.970+0000 7fa14f59d700 1 Processor -- start 2023-10-08T17:41:37.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.970+0000 7fa14f59d700 1 -- start start 2023-10-08T17:41:37.973 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 0x7fa148159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480b05d0 con 0x7fa1481596d0 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c57b0 con 0x7fa148159aa0 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.971+0000 7fa14f59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480c4e80 con 0x7fa1480ca7b0 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51290/0 (socket says 172.21.15.12:51290) 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 -- 172.21.15.12:0/3735224570 learned_addr learned my addr 172.21.15.12:0/3735224570 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14e59b700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.974 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14ed9c700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 0x7fa148159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 -- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 msgr2=0x7fa1480c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 -- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 msgr2=0x7fa148159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 0x7fa148159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 -- 172.21.15.12:0/3735224570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1380094f0 con 0x7fa1481596d0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14e59b700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14ed9c700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 0x7fa148159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.972+0000 7fa14dd9a700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa138006fd0 tx=0x7fa138017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.973+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138011e90 con 0x7fa1481596d0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.973+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138026450 con 0x7fa1481596d0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.973+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138026810 con 0x7fa1481596d0 2023-10-08T17:41:37.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.973+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1480c5160 con 0x7fa1481596d0 2023-10-08T17:41:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.973+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa14814ba20 con 0x7fa1481596d0 2023-10-08T17:41:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.974+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14804c3c0 con 0x7fa1481596d0 2023-10-08T17:41:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.975+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fa138026bc0 con 0x7fa1481596d0 2023-10-08T17:41:37.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.976+0000 7fa13e7fc700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 0x7fa12c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.976+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5345+0+0 (secure 0 0 0) 0x7fa138086090 con 0x7fa1481596d0 2023-10-08T17:41:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.976+0000 7fa14e59b700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 0x7fa12c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:37.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.976+0000 7fa14e59b700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 0x7fa12c069500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa144006f00 tx=0x7fa144008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:37.979 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:37.980+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa138053330 con 0x7fa1481596d0 2023-10-08T17:41:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.182+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa14806cd90 con 0x7fa1481596d0 2023-10-08T17:41:38.182 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.182+0000 7fa13e7fc700 1 -- 172.21.15.12:0/3735224570 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v194) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa13802b060 con 0x7fa1481596d0 2023-10-08T17:41:38.182 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:38.183 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 msgr2=0x7fa12c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 0x7fa12c069500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa144006f00 tx=0x7fa144008040 comp rx=0 tx=0).stop 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 msgr2=0x7fa14814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7fa138006fd0 tx=0x7fa138017000 comp rx=0 tx=0).stop 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 shutdown_connections 2023-10-08T17:41:38.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa12c067050 0x7fa12c069500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa148159aa0 0x7fa148159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa1480ca7b0 0x7fa1480c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 --2- 172.21.15.12:0/3735224570 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa1481596d0 0x7fa14814b4e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 >> 172.21.15.12:0/3735224570 conn(0x7fa14806e720 msgr2=0x7fa14815b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 shutdown_connections 2023-10-08T17:41:38.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.185+0000 7fa14f59d700 1 -- 172.21.15.12:0/3735224570 wait complete. 2023-10-08T17:41:38.202 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T17:41:38.203 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T17:41:38.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.392+0000 7f6a5939d700 1 Processor -- start 2023-10-08T17:41:38.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.393+0000 7f6a5939d700 1 -- start start 2023-10-08T17:41:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a5939d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6a540c85d0 0x7f6a540cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a5939d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a541571b0 con 0x7f6a540c2a90 2023-10-08T17:41:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a5939d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a541579b0 con 0x7f6a540c8200 2023-10-08T17:41:38.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a5939d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a540c1390 con 0x7f6a540c85d0 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a537fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6a540c2a90 0x7f6a54156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35472/0 (socket says 172.21.15.12:35472) 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a537fe700 1 -- 172.21.15.12:0/604315815 learned_addr learned my addr 172.21.15.12:0/604315815 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a58b9c700 1 --2- 172.21.15.12:0/604315815 >> v2:172.21.15.29:3300/0 conn(0x7f6a540c85d0 0x7f6a540cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.394+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201538279 0 0) 0x7f6a48001110 con 0x7f6a540c2a90 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a3c003570 con 0x7f6a540c2a90 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600079765 0 0) 0x7f6a3c003570 con 0x7f6a540c2a90 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 >> v2:172.21.15.29:3300/0 conn(0x7f6a540c85d0 msgr2=0x7f6a540cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 --2- 172.21.15.12:0/604315815 >> v2:172.21.15.29:3300/0 conn(0x7f6a540c85d0 0x7f6a540cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 >> v1:172.21.15.29:6789/0 conn(0x7f6a540c8200 legacy=0x7f6a540c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a541573f0 con 0x7f6a540c2a90 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f6a48001600 con 0x7f6a540c2a90 2023-10-08T17:41:38.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 >> v1:172.21.15.12:6789/0 conn(0x7f6a540c2a90 legacy=0x7f6a54156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3c003ab0 0x7f6a3c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a3c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a3c005210 0x7f6a3c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540c1390 con 0x7f6a3c004810 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c00e3c0 con 0x7f6a3c003ab0 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3c00e580 con 0x7f6a3c005210 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a58b9c700 1 --2- 172.21.15.12:0/604315815 >> v2:172.21.15.29:3300/0 conn(0x7f6a540c85d0 0x7f6a540cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a537fe700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a3c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.395+0000 7f6a53fff700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3c003ab0 0x7f6a3c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a58b9c700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a3c005210 0x7f6a3c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 -- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a3c005210 msgr2=0x7f6a3c00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a3c005210 0x7f6a3c00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 -- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3c003ab0 msgr2=0x7f6a3c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a3c003ab0 0x7f6a3c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 -- 172.21.15.12:0/604315815 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c003570 con 0x7f6a3c004810 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a58b9c700 1 -- 172.21.15.12:0/604315815 reap_dead start 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a537fe700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a3c004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c390 tx=0x7f6a480079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d045353a1e4176e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4800ccc0 con 0x7f6a3c004810 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4800ce40 con 0x7f6a3c004810 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.396+0000 7f6a52ffd700 1 -- 172.21.15.12:0/604315815 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a48005b70 con 0x7f6a3c004810 2023-10-08T17:41:38.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 -- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 msgr2=0x7f6a3c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a3c004c80 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f6a4800c390 tx=0x7f6a480079d0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 -- 172.21.15.12:0/604315815 shutdown_connections 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 --2- 172.21.15.12:0/604315815 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a3c004c80 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 -- 172.21.15.12:0/604315815 >> 172.21.15.12:0/604315815 conn(0x7f6a5406c6a0 msgr2=0x7f6a5406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 -- 172.21.15.12:0/604315815 shutdown_connections 2023-10-08T17:41:38.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.397+0000 7f6a5939d700 1 -- 172.21.15.12:0/604315815 wait complete. 2023-10-08T17:41:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.398+0000 7f6a5939d700 1 Processor -- start 2023-10-08T17:41:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 -- start start 2023-10-08T17:41:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a5416a880 0x7f6a54139270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a5416acf0 0x7f6a540ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540ca650 con 0x7f6a3c004810 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5416b2b0 con 0x7f6a5416a880 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.399+0000 7f6a5939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a540adec0 con 0x7f6a5416acf0 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51312/0 (socket says 172.21.15.12:51312) 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 -- 172.21.15.12:0/1169467786 learned_addr learned my addr 172.21.15.12:0/1169467786 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a537fe700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a5416a880 0x7f6a54139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a58b9c700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a5416acf0 0x7f6a540ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 -- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a5416acf0 msgr2=0x7f6a540ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a5416acf0 0x7f6a540ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 -- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a5416a880 msgr2=0x7f6a54139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:38.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a5416a880 0x7f6a54139270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.400+0000 7f6a53fff700 1 -- 172.21.15.12:0/1169467786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540ae1a0 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.401+0000 7f6a53fff700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6a44002a70 tx=0x7f6a44007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.402+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44002e50 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.402+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400f850 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.402+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a540ae480 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.402+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400fc10 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.402+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a541397b0 con 0x7f6a3c004810 2023-10-08T17:41:38.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.403+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a540c79d0 con 0x7f6a3c004810 2023-10-08T17:41:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.404+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f6a4401c400 con 0x7f6a3c004810 2023-10-08T17:41:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.405+0000 7f6a3bfff700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 0x7f6a40069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.405+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5345+0+0 (secure 0 0 0) 0x7f6a44084980 con 0x7f6a3c004810 2023-10-08T17:41:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.405+0000 7f6a537fe700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 0x7f6a40069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:38.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.406+0000 7f6a537fe700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 0x7f6a40069500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a5415bb10 tx=0x7f6a48015000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:38.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.410+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a44051c50 con 0x7f6a3c004810 2023-10-08T17:41:38.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:38.610+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6a5404c3c0 con 0x7f6a3c004810 2023-10-08T17:41:39.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.412+0000 7f6a3bfff700 1 -- 172.21.15.12:0/1169467786 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v195) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6a44055270 con 0x7f6a3c004810 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 msgr2=0x7f6a40069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 0x7f6a40069500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6a5415bb10 tx=0x7f6a48015000 comp rx=0 tx=0).stop 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 msgr2=0x7f6a540ad850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f6a44002a70 tx=0x7f6a44007d30 comp rx=0 tx=0).stop 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 shutdown_connections 2023-10-08T17:41:39.416 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6a40067050 0x7f6a40069500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6a3c004810 0x7f6a540ad850 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6a5416acf0 0x7f6a540ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 --2- 172.21.15.12:0/1169467786 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6a5416a880 0x7f6a54139270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 >> 172.21.15.12:0/1169467786 conn(0x7f6a5406c6a0 msgr2=0x7f6a5414ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.416+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 shutdown_connections 2023-10-08T17:41:39.417 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.417+0000 7f6a5939d700 1 -- 172.21.15.12:0/1169467786 wait complete. 2023-10-08T17:41:39.421 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T17:41:39.440 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T17:41:39.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.638+0000 7f92af59e700 1 Processor -- start 2023-10-08T17:41:39.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.638+0000 7f92af59e700 1 -- start start 2023-10-08T17:41:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.639+0000 7f92af59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f92b013fb20 0x7f92b015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.639+0000 7f92af59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92b006aaa0 0x7f92b00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.639+0000 7f92af59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b015ae70 con 0x7f92b013fef0 2023-10-08T17:41:39.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.639+0000 7f92af59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b006af60 con 0x7f92b006aaa0 2023-10-08T17:41:39.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.639+0000 7f92af59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b006b240 con 0x7f92b013fb20 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92b006aaa0 0x7f92b00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f92b006aaa0 0x7f92b00c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51326/0 (socket says 172.21.15.12:51326) 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 -- 172.21.15.12:0/1362211645 learned_addr learned my addr 172.21.15.12:0/1362211645 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92ae59c700 1 --2- 172.21.15.12:0/1362211645 >> v2:172.21.15.29:3300/0 conn(0x7f92b013fb20 0x7f92b015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 -- 172.21.15.12:0/1362211645 >> v2:172.21.15.29:3300/0 conn(0x7f92b013fb20 msgr2=0x7f92b015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 --2- 172.21.15.12:0/1362211645 >> v2:172.21.15.29:3300/0 conn(0x7f92b013fb20 0x7f92b015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 -- 172.21.15.12:0/1362211645 >> v1:172.21.15.29:6789/0 conn(0x7f92b013fef0 legacy=0x7f92b00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.640+0000 7f92aed9d700 1 -- 172.21.15.12:0/1362211645 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b006b520 con 0x7f92b006aaa0 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92aed9d700 1 --2- 172.21.15.12:0/1362211645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b006aaa0 0x7f92b00c9d00 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f92b00695b0 tx=0x7f92a800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff43df7f852a3c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:39.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92ad59a700 1 -- 172.21.15.12:0/1362211645 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8010070 con 0x7f92b006aaa0 2023-10-08T17:41:39.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92ad59a700 1 -- 172.21.15.12:0/1362211645 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800de90 con 0x7f92b006aaa0 2023-10-08T17:41:39.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92ad59a700 1 -- 172.21.15.12:0/1362211645 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800b320 con 0x7f92b006aaa0 2023-10-08T17:41:39.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92af59e700 1 -- 172.21.15.12:0/1362211645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b006aaa0 msgr2=0x7f92b00c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.641+0000 7f92af59e700 1 --2- 172.21.15.12:0/1362211645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b006aaa0 0x7f92b00c9d00 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f92b00695b0 tx=0x7f92a800ba50 comp rx=0 tx=0).stop 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 -- 172.21.15.12:0/1362211645 shutdown_connections 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 --2- 172.21.15.12:0/1362211645 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b006aaa0 0x7f92b00c9d00 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 --2- 172.21.15.12:0/1362211645 >> v2:172.21.15.29:3300/0 conn(0x7f92b013fb20 0x7f92b015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 -- 172.21.15.12:0/1362211645 >> 172.21.15.12:0/1362211645 conn(0x7f92b006d170 msgr2=0x7f92b00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 -- 172.21.15.12:0/1362211645 shutdown_connections 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.642+0000 7f92af59e700 1 -- 172.21.15.12:0/1362211645 wait complete. 2023-10-08T17:41:39.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.643+0000 7f92af59e700 1 Processor -- start 2023-10-08T17:41:39.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.643+0000 7f92af59e700 1 -- start start 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 0x7f92b00add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92b013fb20 0x7f92b012f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00a6090 con 0x7f92b013fef0 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b016ab90 con 0x7f92b013fb20 2023-10-08T17:41:39.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92af59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00ae270 con 0x7f92b006aaa0 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.644+0000 7f92aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51328/0 (socket says 172.21.15.12:51328) 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 -- 172.21.15.12:0/2973017793 learned_addr learned my addr 172.21.15.12:0/2973017793 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92ae59c700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 0x7f92b00add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92add9b700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92b013fb20 0x7f92b012f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 -- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 msgr2=0x7f92b00add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 0x7f92b00add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 -- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92b013fb20 msgr2=0x7f92b012f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92b013fb20 0x7f92b012f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 -- 172.21.15.12:0/2973017793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a800bcf0 con 0x7f92b013fef0 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92ae59c700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 0x7f92b00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:39.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f92aed9d700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f92a8014000 tx=0x7f92a801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.645+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800acc0 con 0x7f92b013fef0 2023-10-08T17:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.646+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800ae20 con 0x7f92b013fef0 2023-10-08T17:41:39.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.646+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b016d4d0 con 0x7f92b013fef0 2023-10-08T17:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.646+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a801e690 con 0x7f92b013fef0 2023-10-08T17:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.646+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b016da90 con 0x7f92b013fef0 2023-10-08T17:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.647+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b016ad00 con 0x7f92b013fef0 2023-10-08T17:41:39.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.648+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f92a8003040 con 0x7f92b013fef0 2023-10-08T17:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.649+0000 7f929e7fc700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 0x7f9290069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.649+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5715+0+0 (secure 0 0 0) 0x7f92a8086520 con 0x7f92b013fef0 2023-10-08T17:41:39.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.649+0000 7f92ae59c700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 0x7f9290069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:39.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.650+0000 7f92ae59c700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 0x7f9290069500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92a0006fd0 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:39.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.653+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92a8053540 con 0x7f92b013fef0 2023-10-08T17:41:39.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:39.859+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f92b016ad00 con 0x7f92b013fef0 2023-10-08T17:41:40.167 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:40.172 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:41:40.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.423+0000 7f929e7fc700 1 -- 172.21.15.12:0/2973017793 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v196) v1 ==== 170+0+0 (secure 0 0 0) 0x7f92b016ad00 con 0x7f92b013fef0 2023-10-08T17:41:40.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.431+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 msgr2=0x7f9290069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.431+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 0x7f9290069500 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f92a0006fd0 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2023-10-08T17:41:40.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.431+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 msgr2=0x7f92b00c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.431+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f92a8014000 tx=0x7f92a801a000 comp rx=0 tx=0).stop 2023-10-08T17:41:40.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 shutdown_connections 2023-10-08T17:41:40.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9290067050 0x7f9290069500 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92b013fef0 0x7f92b00c75f0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f92b006aaa0 0x7f92b00add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 --2- 172.21.15.12:0/2973017793 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f92b013fb20 0x7f92b012f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.433+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 >> 172.21.15.12:0/2973017793 conn(0x7f92b006d170 msgr2=0x7f92b00c26b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:40.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.434+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 shutdown_connections 2023-10-08T17:41:40.435 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.435+0000 7f92af59e700 1 -- 172.21.15.12:0/2973017793 wait complete. 2023-10-08T17:41:40.441 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T17:41:40.460 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T17:41:40.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.650+0000 7f00c739d700 1 Processor -- start 2023-10-08T17:41:40.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.650+0000 7f00c739d700 1 -- start start 2023-10-08T17:41:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c006de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c739d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c006b790 con 0x7f00c00cc840 2023-10-08T17:41:40.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c739d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c0155fa0 con 0x7f00c00c7930 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c006ab80 con 0x7f00c00ccce0 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f00c00cc840 0x7f00c0155890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35476/0 (socket says 172.21.15.12:35476) 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5b9a700 1 -- 172.21.15.12:0/62621973 learned_addr learned my addr 172.21.15.12:0/62621973 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c6b9c700 1 --2- 172.21.15.12:0/62621973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c006de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82599437 0 0) 0x7f00c006b790 con 0x7f00c00cc840 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac003570 con 0x7f00c00cc840 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549805557 0 0) 0x7f00c0155fa0 con 0x7f00c00c7930 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.652+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c006b790 con 0x7f00c00c7930 2023-10-08T17:41:40.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c6b9c700 1 -- 172.21.15.12:0/62621973 >> v1:172.21.15.29:6789/0 conn(0x7f00c00c7930 legacy=0x7f00c006a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c6b9c700 1 -- 172.21.15.12:0/62621973 >> v1:172.21.15.12:6789/0 conn(0x7f00c00cc840 legacy=0x7f00c0155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c6b9c700 1 -- 172.21.15.12:0/62621973 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c006ae60 con 0x7f00c00ccce0 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c6b9c700 1 --2- 172.21.15.12:0/62621973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c006de50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009e90 tx=0x7f00b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b2891f6bc6c0452 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800e070 con 0x7f00c00ccce0 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b800bb80 con 0x7f00c00ccce0 2023-10-08T17:41:40.655 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.653+0000 7f00c5399700 1 -- 172.21.15.12:0/62621973 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8012430 con 0x7f00c00ccce0 2023-10-08T17:41:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 -- 172.21.15.12:0/62621973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 msgr2=0x7f00c006de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 --2- 172.21.15.12:0/62621973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c006de50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009e90 tx=0x7f00b8009780 comp rx=0 tx=0).stop 2023-10-08T17:41:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 -- 172.21.15.12:0/62621973 shutdown_connections 2023-10-08T17:41:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 --2- 172.21.15.12:0/62621973 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c006de50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 -- 172.21.15.12:0/62621973 >> 172.21.15.12:0/62621973 conn(0x7f00c006d110 msgr2=0x7f00c00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 -- 172.21.15.12:0/62621973 shutdown_connections 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.654+0000 7f00c739d700 1 -- 172.21.15.12:0/62621973 wait complete. 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.655+0000 7f00c739d700 1 Processor -- start 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 -- start start 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 0x7f00c00adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c016d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c5100 con 0x7f00c00cc840 2023-10-08T17:41:40.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c47d0 con 0x7f00c00c7930 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.656+0000 7f00c739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c00c4ab0 con 0x7f00c00ccce0 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51334/0 (socket says 172.21.15.12:51334) 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 -- 172.21.15.12:0/3283718216 learned_addr learned my addr 172.21.15.12:0/3283718216 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c639b700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 0x7f00c00adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c6b9c700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c016d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 -- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 msgr2=0x7f00c016d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c016d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 -- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 msgr2=0x7f00c00adf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 0x7f00c00adf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:40.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 -- 172.21.15.12:0/3283718216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009a20 con 0x7f00c00cc840 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c639b700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 0x7f00c00adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.657+0000 7f00c5b9a700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c790 tx=0x7f00b0007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.658+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0005b30 con 0x7f00c00cc840 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.658+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b0005c90 con 0x7f00c00cc840 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.658+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0007300 con 0x7f00c00cc840 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.658+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c00c4d90 con 0x7f00c00cc840 2023-10-08T17:41:40.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.658+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c00c5590 con 0x7f00c00cc840 2023-10-08T17:41:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.659+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c00c4910 con 0x7f00c00cc840 2023-10-08T17:41:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.660+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f00b0025430 con 0x7f00c00cc840 2023-10-08T17:41:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.661+0000 7f00b67fc700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 0x7f00a4069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.661+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6097+0+0 (secure 0 0 0) 0x7f00b0084d40 con 0x7f00c00cc840 2023-10-08T17:41:40.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.661+0000 7f00c639b700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 0x7f00a4069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:40.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.662+0000 7f00c639b700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 0x7f00a4069580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f00bc003990 tx=0x7f00bc009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:40.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.665+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b00558b0 con 0x7f00c00cc840 2023-10-08T17:41:40.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:40.910+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f00c00c4910 con 0x7f00c00cc840 2023-10-08T17:41:41.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.423+0000 7f00b67fc700 1 -- 172.21.15.12:0/3283718216 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v88) v1 ==== 174+0+0 (secure 0 0 0) 0x7f00c00c4910 con 0x7f00c00cc840 2023-10-08T17:41:41.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.437+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 msgr2=0x7f00a4069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.437+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 0x7f00a4069580 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f00bc003990 tx=0x7f00bc009040 comp rx=0 tx=0).stop 2023-10-08T17:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.437+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 msgr2=0x7f00c016cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.437+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c790 tx=0x7f00b0007ea0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 shutdown_connections 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00a40670d0 0x7f00a4069580 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f00bc003990 tx=0x7f00bc009040 comp rx=0 tx=0).stop 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f00c00ccce0 0x7f00c016d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f00c00c7930 0x7f00c00adf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 --2- 172.21.15.12:0/3283718216 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f00c00cc840 0x7f00c016cf30 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.438+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 >> 172.21.15.12:0/3283718216 conn(0x7f00c006d110 msgr2=0x7f00c00b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.440+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 shutdown_connections 2023-10-08T17:41:41.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.440+0000 7f00c739d700 1 -- 172.21.15.12:0/3283718216 wait complete. 2023-10-08T17:41:41.446 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 22 and data pool 23 2023-10-08T17:41:41.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.659+0000 7f83d7bff700 1 Processor -- start 2023-10-08T17:41:41.660 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.660+0000 7f83d7bff700 1 -- start start 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d7bff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f83d0157600 0x7f83d00b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d7bff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83d00ccba0 0x7f83d00b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d7bff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d0158210 con 0x7f83d01579d0 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d7bff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00cb850 con 0x7f83d00ccba0 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d7bff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d00cb290 con 0x7f83d0157600 2023-10-08T17:41:41.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83d00ccba0 0x7f83d00b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f83d00ccba0 0x7f83d00b1950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51348/0 (socket says 172.21.15.12:51348) 2023-10-08T17:41:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d619c700 1 -- 172.21.15.12:0/4283466997 learned_addr learned my addr 172.21.15.12:0/4283466997 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d519a700 1 --1- 172.21.15.12:0/4283466997 >> v1:172.21.15.12:6789/0 conn(0x7f83d01579d0 0x7f83d01586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:35480/0 (socket says 172.21.15.12:35480) 2023-10-08T17:41:41.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.661+0000 7f83d599b700 1 --2- 172.21.15.12:0/4283466997 >> v2:172.21.15.29:3300/0 conn(0x7f83d0157600 0x7f83d00b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d619c700 1 -- 172.21.15.12:0/4283466997 >> v2:172.21.15.29:3300/0 conn(0x7f83d0157600 msgr2=0x7f83d00b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d619c700 1 --2- 172.21.15.12:0/4283466997 >> v2:172.21.15.29:3300/0 conn(0x7f83d0157600 0x7f83d00b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d619c700 1 -- 172.21.15.12:0/4283466997 >> v1:172.21.15.12:6789/0 conn(0x7f83d01579d0 legacy=0x7f83d01586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d619c700 1 -- 172.21.15.12:0/4283466997 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d00cb570 con 0x7f83d00ccba0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d4999700 1 -- 172.21.15.12:0/4283466997 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2395894627 0 0) 0x7f83d0158210 con 0x7f83d01579d0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d619c700 1 --2- 172.21.15.12:0/4283466997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d00ccba0 0x7f83d00b1950 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f83d00650d0 tx=0x7f83c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff4bf4cfaa622e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d4999700 1 -- 172.21.15.12:0/4283466997 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c800e070 con 0x7f83d00ccba0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d4999700 1 -- 172.21.15.12:0/4283466997 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c800ba20 con 0x7f83d00ccba0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.662+0000 7f83d4999700 1 -- 172.21.15.12:0/4283466997 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c80092e0 con 0x7f83d00ccba0 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 -- 172.21.15.12:0/4283466997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d00ccba0 msgr2=0x7f83d00b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 --2- 172.21.15.12:0/4283466997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d00ccba0 0x7f83d00b1950 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f83d00650d0 tx=0x7f83c8009840 comp rx=0 tx=0).stop 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 -- 172.21.15.12:0/4283466997 shutdown_connections 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 --2- 172.21.15.12:0/4283466997 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d00ccba0 0x7f83d00b1950 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 --2- 172.21.15.12:0/4283466997 >> v2:172.21.15.29:3300/0 conn(0x7f83d0157600 0x7f83d00b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 -- 172.21.15.12:0/4283466997 >> 172.21.15.12:0/4283466997 conn(0x7f83d006d170 msgr2=0x7f83d00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 -- 172.21.15.12:0/4283466997 shutdown_connections 2023-10-08T17:41:41.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.663+0000 7f83d7bff700 1 -- 172.21.15.12:0/4283466997 wait complete. 2023-10-08T17:41:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.664+0000 7f83d7bff700 1 Processor -- start 2023-10-08T17:41:41.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.664+0000 7f83d7bff700 1 -- start start 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83d00ccba0 0x7f83d00ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 0x7f83d00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c7770 con 0x7f83d01579d0 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00ad3a0 con 0x7f83d00ccba0 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.665+0000 7f83d7bff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d00c6b60 con 0x7f83d0157600 2023-10-08T17:41:41.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51354/0 (socket says 172.21.15.12:51354) 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 -- 172.21.15.12:0/3602298458 learned_addr learned my addr 172.21.15.12:0/3602298458 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d599b700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83d00ccba0 0x7f83d00ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d519a700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 0x7f83d00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 -- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 msgr2=0x7f83d00c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 0x7f83d00c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 -- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83d00ccba0 msgr2=0x7f83d00ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83d00ccba0 0x7f83d00ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 -- 172.21.15.12:0/3602298458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8009ae0 con 0x7f83d01579d0 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d519a700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 0x7f83d00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.666+0000 7f83d619c700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009ab0 tx=0x7f83c8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:41.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.667+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c8008b30 con 0x7f83d01579d0 2023-10-08T17:41:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.667+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83c8008c90 con 0x7f83d01579d0 2023-10-08T17:41:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.667+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d00c6e40 con 0x7f83d01579d0 2023-10-08T17:41:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.667+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83c80256b0 con 0x7f83d01579d0 2023-10-08T17:41:41.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.667+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d00c7400 con 0x7f83d01579d0 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.668+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d00c78e0 con 0x7f83d01579d0 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.669+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f83c8003040 con 0x7f83d01579d0 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.669+0000 7f83c5ffb700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 0x7f83b4069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.670+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f83c8086610 con 0x7f83d01579d0 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.670+0000 7f83d599b700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 0x7f83b4069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:41.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.670+0000 7f83d599b700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 0x7f83b4069530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d10 tx=0x7f83cc0091a0 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:41.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.674+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83c80533d0 con 0x7f83d01579d0 2023-10-08T17:41:41.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.878+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83d004c3c0 con 0x7f83d01579d0 2023-10-08T17:41:41.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.879+0000 7f83c5ffb700 1 -- 172.21.15.12:0/3602298458 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16182 (secure 0 0 0) 0x7f83c80569f0 con 0x7f83d01579d0 2023-10-08T17:41:41.880 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:41.880 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":197,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:40.910972+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.881+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 msgr2=0x7f83b4069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.881+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 0x7f83b4069530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d10 tx=0x7f83cc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 msgr2=0x7f83d006ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009ab0 tx=0x7f83c8018000 comp rx=0 tx=0).stop 2023-10-08T17:41:41.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 shutdown_connections 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f83b4067080 0x7f83b4069530 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f83d01579d0 0x7f83d006ab00 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f83d00ccba0 0x7f83d00ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 --2- 172.21.15.12:0/3602298458 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f83d0157600 0x7f83d00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 >> 172.21.15.12:0/3602298458 conn(0x7f83d006d170 msgr2=0x7f83d0069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 shutdown_connections 2023-10-08T17:41:41.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:41.882+0000 7f83d7bff700 1 -- 172.21.15.12:0/3602298458 wait complete. 2023-10-08T17:41:41.900 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.086+0000 7fe314d9d700 1 Processor -- start 2023-10-08T17:41:42.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.087+0000 7fe314d9d700 1 -- start start 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe31013fb20 0x7fe31015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31013fef0 0x7fe3100c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe31006aaa0 0x7fe3100c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100c8410 con 0x7fe31013fb20 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31015ae70 con 0x7fe31006aaa0 2023-10-08T17:41:42.089 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe314d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31006af60 con 0x7fe31013fef0 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe30f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe31013fb20 0x7fe31015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe30f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe31013fb20 0x7fe31015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:51368/0 (socket says 172.21.15.12:51368) 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe30f7fe700 1 -- 172.21.15.12:0/1208021051 learned_addr learned my addr 172.21.15.12:0/1208021051 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe30effd700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31013fef0 0x7fe3100c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.088+0000 7fe30ffff700 1 --2- 172.21.15.12:0/1208021051 >> v2:172.21.15.29:3300/0 conn(0x7fe31006aaa0 0x7fe3100c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 -- 172.21.15.12:0/1208021051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31013fef0 msgr2=0x7fe3100c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31013fef0 0x7fe3100c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 -- 172.21.15.12:0/1208021051 >> v2:172.21.15.29:3300/0 conn(0x7fe31006aaa0 msgr2=0x7fe3100c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 --2- 172.21.15.12:0/1208021051 >> v2:172.21.15.29:3300/0 conn(0x7fe31006aaa0 0x7fe3100c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 -- 172.21.15.12:0/1208021051 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31006b240 con 0x7fe31013fb20 2023-10-08T17:41:42.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30f7fe700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe31015a930 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fe310156920 tx=0x7fe30000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b9b75e1087e95c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30e7fc700 1 -- 172.21.15.12:0/1208021051 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30000dc50 con 0x7fe31013fb20 2023-10-08T17:41:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30e7fc700 1 -- 172.21.15.12:0/1208021051 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30000ddb0 con 0x7fe31013fb20 2023-10-08T17:41:42.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.089+0000 7fe30e7fc700 1 -- 172.21.15.12:0/1208021051 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000196d0 con 0x7fe31013fb20 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 -- 172.21.15.12:0/1208021051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 msgr2=0x7fe31015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe31015a930 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fe310156920 tx=0x7fe30000b4f0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 -- 172.21.15.12:0/1208021051 shutdown_connections 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 --2- 172.21.15.12:0/1208021051 >> v2:172.21.15.29:3300/0 conn(0x7fe31006aaa0 0x7fe3100c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe31015a930 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 --2- 172.21.15.12:0/1208021051 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31013fef0 0x7fe3100c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 -- 172.21.15.12:0/1208021051 >> 172.21.15.12:0/1208021051 conn(0x7fe31006d170 msgr2=0x7fe3100cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:42.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 -- 172.21.15.12:0/1208021051 shutdown_connections 2023-10-08T17:41:42.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.090+0000 7fe314d9d700 1 -- 172.21.15.12:0/1208021051 wait complete. 2023-10-08T17:41:42.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.091+0000 7fe314d9d700 1 Processor -- start 2023-10-08T17:41:42.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 -- start start 2023-10-08T17:41:42.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31006aaa0 0x7fe310154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.094 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31013fef0 0x7fe3100ac150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100afd20 con 0x7fe31013fb20 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3100b0830 con 0x7fe31013fef0 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.092+0000 7fe314d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe310155430 con 0x7fe31006aaa0 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48854/0 (socket says 172.21.15.12:48854) 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 -- 172.21.15.12:0/4183356188 learned_addr learned my addr 172.21.15.12:0/4183356188 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 -- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31006aaa0 msgr2=0x7fe310154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31006aaa0 0x7fe310154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 -- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31013fef0 msgr2=0x7fe3100ac150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31013fef0 0x7fe3100ac150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 -- 172.21.15.12:0/4183356188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30000b790 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.093+0000 7fe30effd700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fe30400d860 tx=0x7fe304008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.094+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304018070 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.094+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304005a00 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.094+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304005da0 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.094+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3100aff00 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.094+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3100b04c0 con 0x7fe31013fb20 2023-10-08T17:41:42.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.095+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31004c3c0 con 0x7fe31013fb20 2023-10-08T17:41:42.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.096+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fe304012840 con 0x7fe31013fb20 2023-10-08T17:41:42.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.097+0000 7fe2f77fe700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 0x7fe2fc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.097+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fe304084ac0 con 0x7fe31013fb20 2023-10-08T17:41:42.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.097+0000 7fe30f7fe700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 0x7fe2fc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.098+0000 7fe30f7fe700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 0x7fe2fc069500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe310156920 tx=0x7fe30001b000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.101+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe304051990 con 0x7fe31013fb20 2023-10-08T17:41:42.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.309+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3100b09a0 con 0x7fe31013fb20 2023-10-08T17:41:42.310 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.310+0000 7fe2f77fe700 1 -- 172.21.15.12:0/4183356188 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16182 (secure 0 0 0) 0x7fe304084030 con 0x7fe31013fb20 2023-10-08T17:41:42.310 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:42.310 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":197,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:40.910972+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 msgr2=0x7fe2fc069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 0x7fe2fc069500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe310156920 tx=0x7fe30001b000 comp rx=0 tx=0).stop 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 msgr2=0x7fe3100c75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fe30400d860 tx=0x7fe304008040 comp rx=0 tx=0).stop 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 shutdown_connections 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe2fc067050 0x7fe2fc069500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.313 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe31013fef0 0x7fe3100ac150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe31006aaa0 0x7fe310154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 --2- 172.21.15.12:0/4183356188 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe31013fb20 0x7fe3100c75f0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.312+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 >> 172.21.15.12:0/4183356188 conn(0x7fe31006d170 msgr2=0x7fe31013c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:42.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.313+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 shutdown_connections 2023-10-08T17:41:42.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.313+0000 7fe314d9d700 1 -- 172.21.15.12:0/4183356188 wait complete. 2023-10-08T17:41:42.330 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T17:41:42.404 INFO:tasks.ceph.mds.c.smithi012.stderr:2023-10-08T17:41:42.405+0000 7fc1ddbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:41:42.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.522+0000 7fdeac99d700 1 Processor -- start 2023-10-08T17:41:42.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.522+0000 7fdeac99d700 1 -- start start 2023-10-08T17:41:42.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdeac99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdea813fe90 0x7fdea806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdeac99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea806b290 con 0x7fdea80c7fb0 2023-10-08T17:41:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdeac99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea806b570 con 0x7fdea80c7be0 2023-10-08T17:41:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdeac99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea806bf10 con 0x7fdea813fe90 2023-10-08T17:41:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdea6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdea80c7fb0 0x7fdea813f780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54308/0 (socket says 172.21.15.12:54308) 2023-10-08T17:41:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdea6ffd700 1 -- 172.21.15.12:0/3646725444 learned_addr learned my addr 172.21.15.12:0/3646725444 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:42.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdea7fff700 1 --2- 172.21.15.12:0/3646725444 >> v2:172.21.15.29:3300/0 conn(0x7fdea813fe90 0x7fdea806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.524+0000 7fdea67fc700 1 -- 172.21.15.12:0/3646725444 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435720791 0 0) 0x7fdea806b290 con 0x7fdea80c7fb0 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea67fc700 1 -- 172.21.15.12:0/3646725444 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde90003570 con 0x7fdea80c7fb0 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea7fff700 1 -- 172.21.15.12:0/3646725444 >> v1:172.21.15.29:6789/0 conn(0x7fdea80c7be0 legacy=0x7fdea815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea7fff700 1 -- 172.21.15.12:0/3646725444 >> v1:172.21.15.12:6789/0 conn(0x7fdea80c7fb0 legacy=0x7fdea813f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea7fff700 1 -- 172.21.15.12:0/3646725444 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea806b850 con 0x7fdea813fe90 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea7fff700 1 --2- 172.21.15.12:0/3646725444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea806abd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009e60 tx=0x7fdea0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f58e7e98e602973 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea67fc700 1 -- 172.21.15.12:0/3646725444 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea000e070 con 0x7fdea813fe90 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea67fc700 1 -- 172.21.15.12:0/3646725444 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea000bb60 con 0x7fdea813fe90 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.525+0000 7fdea67fc700 1 -- 172.21.15.12:0/3646725444 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea0012430 con 0x7fdea813fe90 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 -- 172.21.15.12:0/3646725444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 msgr2=0x7fdea806abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3646725444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea806abd0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdea0009e60 tx=0x7fdea0009780 comp rx=0 tx=0).stop 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 -- 172.21.15.12:0/3646725444 shutdown_connections 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3646725444 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea806abd0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 -- 172.21.15.12:0/3646725444 >> 172.21.15.12:0/3646725444 conn(0x7fdea806d110 msgr2=0x7fdea80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 -- 172.21.15.12:0/3646725444 shutdown_connections 2023-10-08T17:41:42.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.526+0000 7fdeac99d700 1 -- 172.21.15.12:0/3646725444 wait complete. 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.527+0000 7fdeac99d700 1 Processor -- start 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.528+0000 7fdeac99d700 1 -- start start 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdea80c7be0 0x7fdea8165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea80ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8166100 con 0x7fdea80c7fb0 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea813a420 con 0x7fdea813fe90 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdeac99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea8157870 con 0x7fdea80c7be0 2023-10-08T17:41:42.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48862/0 (socket says 172.21.15.12:48862) 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 -- 172.21.15.12:0/3252132870 learned_addr learned my addr 172.21.15.12:0/3252132870 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea7fff700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea80ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea77fe700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdea80c7be0 0x7fdea8165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 -- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdea80c7be0 msgr2=0x7fdea8165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdea80c7be0 0x7fdea8165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 -- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 msgr2=0x7fdea80ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea80ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.529+0000 7fdea6ffd700 1 -- 172.21.15.12:0/3252132870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea0009a20 con 0x7fdea80c7fb0 2023-10-08T17:41:42.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fdea6ffd700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c7c0 tx=0x7fde9c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c005b30 con 0x7fdea80c7fb0 2023-10-08T17:41:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c005c90 con 0x7fdea80c7fb0 2023-10-08T17:41:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c007320 con 0x7fdea80c7fb0 2023-10-08T17:41:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea8156e30 con 0x7fdea80c7fb0 2023-10-08T17:41:42.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.530+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea80c3390 con 0x7fdea80c7fb0 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.531+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea80c3580 con 0x7fdea80c7fb0 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.532+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fde9c01b3b0 con 0x7fdea80c7fb0 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.533+0000 7fde8f7fe700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 0x7fde94069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.533+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fde9c083d80 con 0x7fdea80c7fb0 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.534+0000 7fdea77fe700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 0x7fde94069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:42.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.534+0000 7fdea77fe700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 0x7fde94069500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdea813a770 tx=0x7fde98009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:42.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.538+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde9c050c50 con 0x7fdea80c7fb0 2023-10-08T17:41:42.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:42.784+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdea804c3c0 con 0x7fdea80c7fb0 2023-10-08T17:41:43.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.444+0000 7fde8f7fe700 1 -- 172.21.15.12:0/3252132870 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v90) v1 ==== 118+0+0 (secure 0 0 0) 0x7fde9c017020 con 0x7fdea80c7fb0 2023-10-08T17:41:43.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 msgr2=0x7fde94069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 0x7fde94069500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fdea813a770 tx=0x7fde98009040 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 msgr2=0x7fdea80c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fde9c00c7c0 tx=0x7fde9c007e00 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 shutdown_connections 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fde94067050 0x7fde94069500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdea813fe90 0x7fdea80ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdea80c7be0 0x7fdea8165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 --2- 172.21.15.12:0/3252132870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdea80c7fb0 0x7fdea80c9eb0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 >> 172.21.15.12:0/3252132870 conn(0x7fdea806d110 msgr2=0x7fdea80cb030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 shutdown_connections 2023-10-08T17:41:43.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.447+0000 7fdeac99d700 1 -- 172.21.15.12:0/3252132870 wait complete. 2023-10-08T17:41:43.467 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T17:41:43.658 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.658+0000 7fe375b9d700 1 Processor -- start 2023-10-08T17:41:43.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.658+0000 7fe375b9d700 1 -- start start 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe375b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe3700c7fb0 0x7fe37006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe375b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe37013f780 0x7fe37013fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe375b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3701400e0 con 0x7fe3700c7be0 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe375b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37006bf10 con 0x7fe37013f780 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe375b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37006b290 con 0x7fe3700c7fb0 2023-10-08T17:41:43.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe374b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fe3700c7be0 0x7fe37015a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54318/0 (socket says 172.21.15.12:54318) 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe374b9b700 1 -- 172.21.15.12:0/2275932916 learned_addr learned my addr 172.21.15.12:0/2275932916 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe37539c700 1 --2- 172.21.15.12:0/2275932916 >> v2:172.21.15.12:3300/0 conn(0x7fe37013f780 0x7fe37013fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe36ffff700 1 --2- 172.21.15.12:0/2275932916 >> v2:172.21.15.29:3300/0 conn(0x7fe3700c7fb0 0x7fe37006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe36f7fe700 1 -- 172.21.15.12:0/2275932916 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457834677 0 0) 0x7fe3701400e0 con 0x7fe3700c7be0 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe36f7fe700 1 -- 172.21.15.12:0/2275932916 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe360003570 con 0x7fe3700c7be0 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe37539c700 1 -- 172.21.15.12:0/2275932916 >> v2:172.21.15.29:3300/0 conn(0x7fe3700c7fb0 msgr2=0x7fe37006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.660+0000 7fe37539c700 1 --2- 172.21.15.12:0/2275932916 >> v2:172.21.15.29:3300/0 conn(0x7fe3700c7fb0 0x7fe37006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe37539c700 1 -- 172.21.15.12:0/2275932916 >> v1:172.21.15.12:6789/0 conn(0x7fe3700c7be0 legacy=0x7fe37015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe37539c700 1 -- 172.21.15.12:0/2275932916 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37006b570 con 0x7fe37013f780 2023-10-08T17:41:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe37539c700 1 --2- 172.21.15.12:0/2275932916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013f780 0x7fe37013fba0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fe3700695b0 tx=0x7fe368009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17561c534f63443a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe36f7fe700 1 -- 172.21.15.12:0/2275932916 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36800e070 con 0x7fe37013f780 2023-10-08T17:41:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe36f7fe700 1 -- 172.21.15.12:0/2275932916 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36800bb60 con 0x7fe37013f780 2023-10-08T17:41:43.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.661+0000 7fe36f7fe700 1 -- 172.21.15.12:0/2275932916 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe368012430 con 0x7fe37013f780 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 -- 172.21.15.12:0/2275932916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013f780 msgr2=0x7fe37013fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 --2- 172.21.15.12:0/2275932916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013f780 0x7fe37013fba0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fe3700695b0 tx=0x7fe368009780 comp rx=0 tx=0).stop 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 -- 172.21.15.12:0/2275932916 shutdown_connections 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 --2- 172.21.15.12:0/2275932916 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe37013f780 0x7fe37013fba0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 --2- 172.21.15.12:0/2275932916 >> v2:172.21.15.29:3300/0 conn(0x7fe3700c7fb0 0x7fe37006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 -- 172.21.15.12:0/2275932916 >> 172.21.15.12:0/2275932916 conn(0x7fe37006d110 msgr2=0x7fe3700cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:43.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 -- 172.21.15.12:0/2275932916 shutdown_connections 2023-10-08T17:41:43.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.662+0000 7fe375b9d700 1 -- 172.21.15.12:0/2275932916 wait complete. 2023-10-08T17:41:43.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.663+0000 7fe375b9d700 1 Processor -- start 2023-10-08T17:41:43.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.663+0000 7fe375b9d700 1 -- start start 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3700c7be0 0x7fe370159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013f780 0x7fe3700c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370156ac0 con 0x7fe3700c7fb0 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe370157320 con 0x7fe37013f780 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.664+0000 7fe375b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370159760 con 0x7fe3700c7be0 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48890/0 (socket says 172.21.15.12:48890) 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 -- 172.21.15.12:0/3768467791 learned_addr learned my addr 172.21.15.12:0/3768467791 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe37539c700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013f780 0x7fe3700c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe374b9b700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3700c7be0 0x7fe370159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 -- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3700c7be0 msgr2=0x7fe370159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3700c7be0 0x7fe370159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 -- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013f780 msgr2=0x7fe3700c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013f780 0x7fe3700c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 -- 172.21.15.12:0/3768467791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe368009a20 con 0x7fe3700c7fb0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36ffff700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00d890 tx=0x7fe35c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.665+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00b600 con 0x7fe3700c7fb0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.666+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe35c00b760 con 0x7fe3700c7fb0 2023-10-08T17:41:43.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.666+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c00bae0 con 0x7fe3700c7fb0 2023-10-08T17:41:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.666+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370156cd0 con 0x7fe3700c7fb0 2023-10-08T17:41:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.666+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe370155a60 con 0x7fe3700c7fb0 2023-10-08T17:41:43.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.667+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37006a830 con 0x7fe3700c7fb0 2023-10-08T17:41:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.668+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fe35c01e460 con 0x7fe3700c7fb0 2023-10-08T17:41:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.668+0000 7fe36cff9700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 0x7fe354069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.669+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fe35c084f70 con 0x7fe3700c7fb0 2023-10-08T17:41:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.669+0000 7fe374b9b700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 0x7fe354069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:43.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.669+0000 7fe374b9b700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 0x7fe354069500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3640058d0 tx=0x7fe364009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:43.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.673+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe35c051ee0 con 0x7fe3700c7fb0 2023-10-08T17:41:43.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:43.924+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe37004c3c0 con 0x7fe3700c7fb0 2023-10-08T17:41:44.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.450+0000 7fe36cff9700 1 -- 172.21.15.12:0/3768467791 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v91) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe35c055500 con 0x7fe3700c7fb0 2023-10-08T17:41:44.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 msgr2=0x7fe354069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 0x7fe354069500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe3640058d0 tx=0x7fe364009040 comp rx=0 tx=0).stop 2023-10-08T17:41:44.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 msgr2=0x7fe370155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00d890 tx=0x7fe35c008040 comp rx=0 tx=0).stop 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 shutdown_connections 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe354067050 0x7fe354069500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe37013f780 0x7fe3700c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe3700c7be0 0x7fe370159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 --2- 172.21.15.12:0/3768467791 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe3700c7fb0 0x7fe370155520 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 >> 172.21.15.12:0/3768467791 conn(0x7fe37006d110 msgr2=0x7fe37013ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 shutdown_connections 2023-10-08T17:41:44.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.453+0000 7fe375b9d700 1 -- 172.21.15.12:0/3768467791 wait complete. 2023-10-08T17:41:44.472 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.659+0000 7f830b19d700 1 Processor -- start 2023-10-08T17:41:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.659+0000 7f830b19d700 1 -- start start 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.660+0000 7f830b19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f830413fb20 0x7f830415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.660+0000 7f830b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 0x7f83040c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830b19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f830415ae70 con 0x7f830413fef0 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830b19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f830406af60 con 0x7f830413fb20 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f830406b240 con 0x7f830406aaa0 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f830413fb20 0x7f830415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f830413fb20 0x7f830415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48894/0 (socket says 172.21.15.12:48894) 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 -- 172.21.15.12:0/753314308 learned_addr learned my addr 172.21.15.12:0/753314308 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a99c700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 0x7f83040c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 -- 172.21.15.12:0/753314308 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 msgr2=0x7f83040c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 0x7f83040c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 -- 172.21.15.12:0/753314308 >> v1:172.21.15.29:6789/0 conn(0x7f830413fef0 legacy=0x7f83040c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a19b700 1 -- 172.21.15.12:0/753314308 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830406b520 con 0x7f830413fb20 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.661+0000 7f830a99c700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 0x7f83040c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830a19b700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f830415a930 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f83000099b0 tx=0x7f8300009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240cf1200b21bb87 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f8309199700 1 -- 172.21.15.12:0/753314308 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000b820 con 0x7f830413fb20 2023-10-08T17:41:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f8309199700 1 -- 172.21.15.12:0/753314308 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f830000b980 con 0x7f830413fb20 2023-10-08T17:41:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f8309199700 1 -- 172.21.15.12:0/753314308 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f830000bd20 con 0x7f830413fb20 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 -- 172.21.15.12:0/753314308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 msgr2=0x7f830415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f830415a930 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f83000099b0 tx=0x7f8300009250 comp rx=0 tx=0).stop 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 -- 172.21.15.12:0/753314308 shutdown_connections 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830406aaa0 0x7f83040c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 --2- 172.21.15.12:0/753314308 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f830415a930 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.662+0000 7f830b19d700 1 -- 172.21.15.12:0/753314308 >> 172.21.15.12:0/753314308 conn(0x7f830406d170 msgr2=0x7f83040cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.663+0000 7f830b19d700 1 -- 172.21.15.12:0/753314308 shutdown_connections 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.663+0000 7f830b19d700 1 -- 172.21.15.12:0/753314308 wait complete. 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.664+0000 7f830b19d700 1 Processor -- start 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.664+0000 7f830b19d700 1 -- start start 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 0x7f83040ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 0x7f83040b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83040acfa0 con 0x7f830413fb20 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8304157d70 con 0x7f830406aaa0 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83040ac100 con 0x7f830413fef0 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830999a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48906/0 (socket says 172.21.15.12:48906) 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.665+0000 7f830999a700 1 -- 172.21.15.12:0/3934177134 learned_addr learned my addr 172.21.15.12:0/3934177134 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830a19b700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 0x7f83040ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830a99c700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 0x7f83040b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 -- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 msgr2=0x7f83040b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 0x7f83040b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 -- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 msgr2=0x7f83040ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 0x7f83040ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 -- 172.21.15.12:0/3934177134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83000094f0 con 0x7f830413fb20 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830a99c700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 0x7f83040b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830a19b700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 0x7f83040ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830999a700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f82f400b530 tx=0x7f82f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400f510 con 0x7f830413fb20 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f400f670 con 0x7f830413fb20 2023-10-08T17:41:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f400fa10 con 0x7f830413fb20 2023-10-08T17:41:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83040ac3e0 con 0x7f830413fb20 2023-10-08T17:41:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.666+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83040ac9a0 con 0x7f830413fb20 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.667+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f830404c3c0 con 0x7f830413fb20 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.668+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f82f401a400 con 0x7f830413fb20 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.669+0000 7f82fa7fc700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 0x7f82e8069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.669+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f82f40843b0 con 0x7f830413fb20 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.669+0000 7f830a19b700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 0x7f82e8069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.670+0000 7f830a19b700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 0x7f82e8069500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83000099b0 tx=0x7f8300016000 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.673+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82f4051300 con 0x7f830413fb20 2023-10-08T17:41:44.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.918+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f830415d520 con 0x7f830413fb20 2023-10-08T17:41:44.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.919+0000 7f82fa7fc700 1 -- 172.21.15.12:0/3934177134 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f82f4054920 con 0x7f830413fb20 2023-10-08T17:41:44.919 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:44.919 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:41:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 msgr2=0x7f82e8069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 0x7f82e8069500 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83000099b0 tx=0x7f8300016000 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 msgr2=0x7f8304154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f82f400b530 tx=0x7f82f40090f0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 shutdown_connections 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f82e8067050 0x7f82e8069500 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f830413fef0 0x7f83040b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f830406aaa0 0x7f83040ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 --2- 172.21.15.12:0/3934177134 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f830413fb20 0x7f8304154ff0 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 >> 172.21.15.12:0/3934177134 conn(0x7f830406d170 msgr2=0x7f83040638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 shutdown_connections 2023-10-08T17:41:44.922 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:44.921+0000 7f830b19d700 1 -- 172.21.15.12:0/3934177134 wait complete. 2023-10-08T17:41:44.923 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:41:44.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:41:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.127+0000 7ffa4759d700 1 Processor -- start 2023-10-08T17:41:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.127+0000 7ffa4759d700 1 -- start start 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa40159550 0x7ffa400ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa4015dfd0 0x7ffa400aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159920 0x7ffa400ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa400acc00 con 0x7ffa4015dfd0 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa400abff0 con 0x7ffa40159550 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.128+0000 7ffa4759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400ac2d0 con 0x7ffa40159920 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa4015dfd0 0x7ffa400aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffa4015dfd0 0x7ffa400aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48918/0 (socket says 172.21.15.12:48918) 2023-10-08T17:41:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1473061819 learned_addr learned my addr 172.21.15.12:0/1473061819 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa4659b700 1 --2- 172.21.15.12:0/1473061819 >> v2:172.21.15.29:3300/0 conn(0x7ffa40159550 0x7ffa400ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa46d9c700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159920 0x7ffa400ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1473061819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159920 msgr2=0x7ffa400ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159920 0x7ffa400ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1473061819 >> v2:172.21.15.29:3300/0 conn(0x7ffa40159550 msgr2=0x7ffa400ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1473061819 >> v2:172.21.15.29:3300/0 conn(0x7ffa40159550 0x7ffa400ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1473061819 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa400ac5b0 con 0x7ffa4015dfd0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.129+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa4015dfd0 0x7ffa400aedb0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7ffa40064270 tx=0x7ffa30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e150368d2d55cf server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa45599700 1 -- 172.21.15.12:0/1473061819 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000b640 con 0x7ffa4015dfd0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa45599700 1 -- 172.21.15.12:0/1473061819 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000b7a0 con 0x7ffa4015dfd0 2023-10-08T17:41:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa45599700 1 -- 172.21.15.12:0/1473061819 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000bb60 con 0x7ffa4015dfd0 2023-10-08T17:41:45.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 -- 172.21.15.12:0/1473061819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa4015dfd0 msgr2=0x7ffa400aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa4015dfd0 0x7ffa400aedb0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7ffa40064270 tx=0x7ffa30009250 comp rx=0 tx=0).stop 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 -- 172.21.15.12:0/1473061819 shutdown_connections 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159920 0x7ffa400ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1473061819 >> v2:172.21.15.29:3300/0 conn(0x7ffa40159550 0x7ffa400ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1473061819 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa4015dfd0 0x7ffa400aedb0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.130+0000 7ffa4759d700 1 -- 172.21.15.12:0/1473061819 >> 172.21.15.12:0/1473061819 conn(0x7ffa4006ce80 msgr2=0x7ffa400ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.131+0000 7ffa4759d700 1 -- 172.21.15.12:0/1473061819 shutdown_connections 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.131+0000 7ffa4759d700 1 -- 172.21.15.12:0/1473061819 wait complete. 2023-10-08T17:41:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.132+0000 7ffa4759d700 1 Processor -- start 2023-10-08T17:41:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.132+0000 7ffa4759d700 1 -- start start 2023-10-08T17:41:45.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159550 0x7ffa401551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa4015dfd0 0x7ffa40156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa40157f00 con 0x7ffa40159920 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa401588d0 con 0x7ffa4015dfd0 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa401572f0 con 0x7ffa40159550 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa45d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa45d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48920/0 (socket says 172.21.15.12:48920) 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1675514447 learned_addr learned my addr 172.21.15.12:0/1675514447 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.133+0000 7ffa4659b700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159550 0x7ffa401551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa46d9c700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa4015dfd0 0x7ffa40156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159550 msgr2=0x7ffa401551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159550 0x7ffa401551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa4015dfd0 msgr2=0x7ffa40156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa4015dfd0 0x7ffa40156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 -- 172.21.15.12:0/1675514447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa300094f0 con 0x7ffa40159920 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa45d9a700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ffa4006ad70 tx=0x7ffa30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000b910 con 0x7ffa40159920 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000ba70 con 0x7ffa40159920 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa401575d0 con 0x7ffa40159920 2023-10-08T17:41:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.134+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa30011630 con 0x7ffa40159920 2023-10-08T17:41:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.135+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa40157b90 con 0x7ffa40159920 2023-10-08T17:41:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.135+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa40158070 con 0x7ffa40159920 2023-10-08T17:41:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.136+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7ffa300119a0 con 0x7ffa40159920 2023-10-08T17:41:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.137+0000 7ffa367fc700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 0x7ffa24069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.137+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7ffa30085fe0 con 0x7ffa40159920 2023-10-08T17:41:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.137+0000 7ffa4659b700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 0x7ffa24069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.138+0000 7ffa4659b700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 0x7ffa24069500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009d10 tx=0x7ffa3c0091a0 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.141+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa30052ed0 con 0x7ffa40159920 2023-10-08T17:41:45.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.343+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa4004c3c0 con 0x7ffa40159920 2023-10-08T17:41:45.343 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.344+0000 7ffa367fc700 1 -- 172.21.15.12:0/1675514447 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+16169 (secure 0 0 0) 0x7ffa300564f0 con 0x7ffa40159920 2023-10-08T17:41:45.344 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:45.344 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":198,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:42.430117+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:41:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 msgr2=0x7ffa24069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 0x7ffa24069500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009d10 tx=0x7ffa3c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 msgr2=0x7ffa40158390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7ffa4006ad70 tx=0x7ffa30017000 comp rx=0 tx=0).stop 2023-10-08T17:41:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 shutdown_connections 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa24067050 0x7ffa24069500 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa4015dfd0 0x7ffa40156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa40159550 0x7ffa401551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 --2- 172.21.15.12:0/1675514447 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa40159920 0x7ffa40158390 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 >> 172.21.15.12:0/1675514447 conn(0x7ffa4006ce80 msgr2=0x7ffa400b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 shutdown_connections 2023-10-08T17:41:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.346+0000 7ffa4759d700 1 -- 172.21.15.12:0/1675514447 wait complete. 2023-10-08T17:41:45.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T17:41:45.364 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:41:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.552+0000 7f14a519d700 1 Processor -- start 2023-10-08T17:41:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.552+0000 7f14a519d700 1 -- start start 2023-10-08T17:41:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.553+0000 7f14a519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.553+0000 7f14a519d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14a006aaa0 0x7f14a00c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.553+0000 7f14a519d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a015ae70 con 0x7f14a013fef0 2023-10-08T17:41:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.553+0000 7f14a519d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a006af60 con 0x7f14a006aaa0 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.553+0000 7f14a519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a006b240 con 0x7f14a013fb20 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14a006aaa0 0x7f14a00c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f14a006aaa0 0x7f14a00c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48924/0 (socket says 172.21.15.12:48924) 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 -- 172.21.15.12:0/3251131986 learned_addr learned my addr 172.21.15.12:0/3251131986 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f149f7fe700 1 --1- 172.21.15.12:0/3251131986 >> v1:172.21.15.29:6789/0 conn(0x7f14a013fef0 0x7f14a00c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:53348/0 (socket says 172.21.15.12:53348) 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f149ffff700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 -- 172.21.15.12:0/3251131986 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 msgr2=0x7f14a015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 -- 172.21.15.12:0/3251131986 >> v1:172.21.15.29:6789/0 conn(0x7f14a013fef0 legacy=0x7f14a00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 -- 172.21.15.12:0/3251131986 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a006b520 con 0x7f14a006aaa0 2023-10-08T17:41:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.554+0000 7f14a499c700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c9d00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f1498009f20 tx=0x7f1498009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcf6b6715ebc72c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f149effd700 1 -- 172.21.15.12:0/3251131986 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149800e070 con 0x7f14a006aaa0 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f149effd700 1 -- 172.21.15.12:0/3251131986 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149800b9d0 con 0x7f14a006aaa0 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f149effd700 1 -- 172.21.15.12:0/3251131986 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14980092e0 con 0x7f14a006aaa0 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 -- 172.21.15.12:0/3251131986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 msgr2=0x7f14a00c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c9d00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f1498009f20 tx=0x7f1498009840 comp rx=0 tx=0).stop 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 -- 172.21.15.12:0/3251131986 shutdown_connections 2023-10-08T17:41:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c9d00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 --2- 172.21.15.12:0/3251131986 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 -- 172.21.15.12:0/3251131986 >> 172.21.15.12:0/3251131986 conn(0x7f14a006d170 msgr2=0x7f14a00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 -- 172.21.15.12:0/3251131986 shutdown_connections 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.555+0000 7f14a519d700 1 -- 172.21.15.12:0/3251131986 wait complete. 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.557+0000 7f14a519d700 1 Processor -- start 2023-10-08T17:41:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.557+0000 7f14a519d700 1 -- start start 2023-10-08T17:41:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a0168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a013fef0 0x7f14a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c2e50 con 0x7f14a006aaa0 2023-10-08T17:41:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0169150 con 0x7f14a013fef0 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c14b0 con 0x7f14a013fb20 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f149ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f149ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48938/0 (socket says 172.21.15.12:48938) 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f149ffff700 1 -- 172.21.15.12:0/2676787524 learned_addr learned my addr 172.21.15.12:0/2676787524 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f149f7fe700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a0168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.558+0000 7f14a499c700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a013fef0 0x7f14a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 -- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 msgr2=0x7f14a0168c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a0168c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 -- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a013fef0 msgr2=0x7f14a006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a013fef0 0x7f14a006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 -- 172.21.15.12:0/2676787524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1498009ae0 con 0x7f14a006aaa0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f149ffff700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f149000ec80 tx=0x7f14900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000c850 con 0x7f14a006aaa0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000c9b0 con 0x7f14a006aaa0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149000cd50 con 0x7f14a006aaa0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a00c1790 con 0x7f14a006aaa0 2023-10-08T17:41:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.559+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a00c1d50 con 0x7f14a006aaa0 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.560+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a004c3c0 con 0x7f14a006aaa0 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.561+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f1490013680 con 0x7f14a006aaa0 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.563+0000 7f1487fff700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 0x7f148c069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.563+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f1490084ac0 con 0x7f14a006aaa0 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.563+0000 7f149f7fe700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 0x7f148c069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.564+0000 7f149f7fe700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 0x7f148c069500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f14a00c93e0 tx=0x7f1494007f00 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.567+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1490051a30 con 0x7f14a006aaa0 2023-10-08T17:41:45.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.762+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14a00ad070 con 0x7f148c067050 2023-10-08T17:41:45.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.774+0000 7f1487fff700 1 -- 172.21.15.12:0/2676787524 <== mgr.9597 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289774 (secure 0 0 0) 0x7f14a00ad070 con 0x7f148c067050 2023-10-08T17:41:45.778 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 msgr2=0x7f148c069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 0x7f148c069500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f14a00c93e0 tx=0x7f1494007f00 comp rx=0 tx=0).stop 2023-10-08T17:41:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 msgr2=0x7f14a00c0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f149000ec80 tx=0x7f14900091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 shutdown_connections 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f148c067050 0x7f148c069500 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a006aaa0 0x7f14a00c0ed0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a013fef0 0x7f14a006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 --2- 172.21.15.12:0/2676787524 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a013fb20 0x7f14a0168c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 >> 172.21.15.12:0/2676787524 conn(0x7f14a006d170 msgr2=0x7f14a013dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 shutdown_connections 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:45.778+0000 7f14a519d700 1 -- 172.21.15.12:0/2676787524 wait complete. 2023-10-08T17:41:45.781 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:41:45.795 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:41:43.946842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2452104,"kb_used_data":20552,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752522616,"statfs":{"total":773094113280,"available":770583158784,"internally_reserved":0,"allocated":21045248,"data_stored":11128244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.535548"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448455+0000","last_change":"2023-10-08T17:41:41.429646+0000","last_active":"2023-10-08T17:41:41.448455+0000","last_peered":"2023-10-08T17:41:41.448455+0000","last_clean":"2023-10-08T17:41:41.448455+0000","last_became_active":"2023-10-08T17:41:41.429317+0000","last_became_peered":"2023-10-08T17:41:41.429317+0000","last_unstale":"2023-10-08T17:41:41.448455+0000","last_undegraded":"2023-10-08T17:41:41.448455+0000","last_fullsized":"2023-10-08T17:41:41.448455+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:47.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457629+0000","last_change":"2023-10-08T17:41:41.456675+0000","last_active":"2023-10-08T17:41:41.457629+0000","last_peered":"2023-10-08T17:41:41.457629+0000","last_clean":"2023-10-08T17:41:41.457629+0000","last_became_active":"2023-10-08T17:41:41.456404+0000","last_became_peered":"2023-10-08T17:41:41.456404+0000","last_unstale":"2023-10-08T17:41:41.457629+0000","last_undegraded":"2023-10-08T17:41:41.457629+0000","last_fullsized":"2023-10-08T17:41:41.457629+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:34.300832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451001+0000","last_change":"2023-10-08T17:41:41.448361+0000","last_active":"2023-10-08T17:41:41.451001+0000","last_peered":"2023-10-08T17:41:41.451001+0000","last_clean":"2023-10-08T17:41:41.451001+0000","last_became_active":"2023-10-08T17:41:41.448104+0000","last_became_peered":"2023-10-08T17:41:41.448104+0000","last_unstale":"2023-10-08T17:41:41.451001+0000","last_undegraded":"2023-10-08T17:41:41.451001+0000","last_fullsized":"2023-10-08T17:41:41.451001+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:44:26.626383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456414+0000","last_change":"2023-10-08T17:41:41.452082+0000","last_active":"2023-10-08T17:41:41.456414+0000","last_peered":"2023-10-08T17:41:41.456414+0000","last_clean":"2023-10-08T17:41:41.456414+0000","last_became_active":"2023-10-08T17:41:41.451399+0000","last_became_peered":"2023-10-08T17:41:41.451399+0000","last_unstale":"2023-10-08T17:41:41.456414+0000","last_undegraded":"2023-10-08T17:41:41.456414+0000","last_fullsized":"2023-10-08T17:41:41.456414+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:01.204479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452616+0000","last_change":"2023-10-08T17:41:41.448307+0000","last_active":"2023-10-08T17:41:41.452616+0000","last_peered":"2023-10-08T17:41:41.452616+0000","last_clean":"2023-10-08T17:41:41.452616+0000","last_became_active":"2023-10-08T17:41:41.447965+0000","last_became_peered":"2023-10-08T17:41:41.447965+0000","last_unstale":"2023-10-08T17:41:41.452616+0000","last_undegraded":"2023-10-08T17:41:41.452616+0000","last_fullsized":"2023-10-08T17:41:41.452616+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:40.037112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445529+0000","last_change":"2023-10-08T17:41:41.442980+0000","last_active":"2023-10-08T17:41:41.445529+0000","last_peered":"2023-10-08T17:41:41.445529+0000","last_clean":"2023-10-08T17:41:41.445529+0000","last_became_active":"2023-10-08T17:41:41.442701+0000","last_became_peered":"2023-10-08T17:41:41.442701+0000","last_unstale":"2023-10-08T17:41:41.445529+0000","last_undegraded":"2023-10-08T17:41:41.445529+0000","last_fullsized":"2023-10-08T17:41:41.445529+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:07.886666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452116+0000","last_change":"2023-10-08T17:41:41.444819+0000","last_active":"2023-10-08T17:41:41.452116+0000","last_peered":"2023-10-08T17:41:41.452116+0000","last_clean":"2023-10-08T17:41:41.452116+0000","last_became_active":"2023-10-08T17:41:41.443601+0000","last_became_peered":"2023-10-08T17:41:41.443601+0000","last_unstale":"2023-10-08T17:41:41.452116+0000","last_undegraded":"2023-10-08T17:41:41.452116+0000","last_fullsized":"2023-10-08T17:41:41.452116+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:16.610421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449480+0000","last_change":"2023-10-08T17:41:41.447917+0000","last_active":"2023-10-08T17:41:41.449480+0000","last_peered":"2023-10-08T17:41:41.449480+0000","last_clean":"2023-10-08T17:41:41.449480+0000","last_became_active":"2023-10-08T17:41:41.447650+0000","last_became_peered":"2023-10-08T17:41:41.447650+0000","last_unstale":"2023-10-08T17:41:41.449480+0000","last_undegraded":"2023-10-08T17:41:41.449480+0000","last_fullsized":"2023-10-08T17:41:41.449480+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:15.247542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456699+0000","last_change":"2023-10-08T17:41:41.456038+0000","last_active":"2023-10-08T17:41:41.456699+0000","last_peered":"2023-10-08T17:41:41.456699+0000","last_clean":"2023-10-08T17:41:41.456699+0000","last_became_active":"2023-10-08T17:41:41.455763+0000","last_became_peered":"2023-10-08T17:41:41.455763+0000","last_unstale":"2023-10-08T17:41:41.456699+0000","last_undegraded":"2023-10-08T17:41:41.456699+0000","last_fullsized":"2023-10-08T17:41:41.456699+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:54.572745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454956+0000","last_change":"2023-10-08T17:41:41.453959+0000","last_active":"2023-10-08T17:41:41.454956+0000","last_peered":"2023-10-08T17:41:41.454956+0000","last_clean":"2023-10-08T17:41:41.454956+0000","last_became_active":"2023-10-08T17:41:41.453697+0000","last_became_peered":"2023-10-08T17:41:41.453697+0000","last_unstale":"2023-10-08T17:41:41.454956+0000","last_undegraded":"2023-10-08T17:41:41.454956+0000","last_fullsized":"2023-10-08T17:41:41.454956+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:15.365803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449430+0000","last_change":"2023-10-08T17:41:41.447208+0000","last_active":"2023-10-08T17:41:41.449430+0000","last_peered":"2023-10-08T17:41:41.449430+0000","last_clean":"2023-10-08T17:41:41.449430+0000","last_became_active":"2023-10-08T17:41:41.446944+0000","last_became_peered":"2023-10-08T17:41:41.446944+0000","last_unstale":"2023-10-08T17:41:41.449430+0000","last_undegraded":"2023-10-08T17:41:41.449430+0000","last_fullsized":"2023-10-08T17:41:41.449430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:46.778370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456281+0000","last_change":"2023-10-08T17:41:41.455673+0000","last_active":"2023-10-08T17:41:41.456281+0000","last_peered":"2023-10-08T17:41:41.456281+0000","last_clean":"2023-10-08T17:41:41.456281+0000","last_became_active":"2023-10-08T17:41:41.455356+0000","last_became_peered":"2023-10-08T17:41:41.455356+0000","last_unstale":"2023-10-08T17:41:41.456281+0000","last_undegraded":"2023-10-08T17:41:41.456281+0000","last_fullsized":"2023-10-08T17:41:41.456281+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:12.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.442413+0000","last_change":"2023-10-08T17:41:41.440253+0000","last_active":"2023-10-08T17:41:41.442413+0000","last_peered":"2023-10-08T17:41:41.442413+0000","last_clean":"2023-10-08T17:41:41.442413+0000","last_became_active":"2023-10-08T17:41:41.439989+0000","last_became_peered":"2023-10-08T17:41:41.439989+0000","last_unstale":"2023-10-08T17:41:41.442413+0000","last_undegraded":"2023-10-08T17:41:41.442413+0000","last_fullsized":"2023-10-08T17:41:41.442413+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:47.348541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.430815+0000","last_change":"2023-10-08T17:41:41.428741+0000","last_active":"2023-10-08T17:41:41.430815+0000","last_peered":"2023-10-08T17:41:41.430815+0000","last_clean":"2023-10-08T17:41:41.430815+0000","last_became_active":"2023-10-08T17:41:41.428358+0000","last_became_peered":"2023-10-08T17:41:41.428358+0000","last_unstale":"2023-10-08T17:41:41.430815+0000","last_undegraded":"2023-10-08T17:41:41.430815+0000","last_fullsized":"2023-10-08T17:41:41.430815+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:58.448294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450941+0000","last_change":"2023-10-08T17:41:41.442183+0000","last_active":"2023-10-08T17:41:41.450941+0000","last_peered":"2023-10-08T17:41:41.450941+0000","last_clean":"2023-10-08T17:41:41.450941+0000","last_became_active":"2023-10-08T17:41:41.441911+0000","last_became_peered":"2023-10-08T17:41:41.441911+0000","last_unstale":"2023-10-08T17:41:41.450941+0000","last_undegraded":"2023-10-08T17:41:41.450941+0000","last_fullsized":"2023-10-08T17:41:41.450941+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:22.190361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456563+0000","last_change":"2023-10-08T17:41:41.452748+0000","last_active":"2023-10-08T17:41:41.456563+0000","last_peered":"2023-10-08T17:41:41.456563+0000","last_clean":"2023-10-08T17:41:41.456563+0000","last_became_active":"2023-10-08T17:41:41.452481+0000","last_became_peered":"2023-10-08T17:41:41.452481+0000","last_unstale":"2023-10-08T17:41:41.456563+0000","last_undegraded":"2023-10-08T17:41:41.456563+0000","last_fullsized":"2023-10-08T17:41:41.456563+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:20.314970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453310+0000","last_change":"2023-10-08T17:41:41.446436+0000","last_active":"2023-10-08T17:41:41.453310+0000","last_peered":"2023-10-08T17:41:41.453310+0000","last_clean":"2023-10-08T17:41:41.453310+0000","last_became_active":"2023-10-08T17:41:41.446159+0000","last_became_peered":"2023-10-08T17:41:41.446159+0000","last_unstale":"2023-10-08T17:41:41.453310+0000","last_undegraded":"2023-10-08T17:41:41.453310+0000","last_fullsized":"2023-10-08T17:41:41.453310+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:20.532691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448567+0000","last_change":"2023-10-08T17:41:41.445064+0000","last_active":"2023-10-08T17:41:41.448567+0000","last_peered":"2023-10-08T17:41:41.448567+0000","last_clean":"2023-10-08T17:41:41.448567+0000","last_became_active":"2023-10-08T17:41:41.444823+0000","last_became_peered":"2023-10-08T17:41:41.444823+0000","last_unstale":"2023-10-08T17:41:41.448567+0000","last_undegraded":"2023-10-08T17:41:41.448567+0000","last_fullsized":"2023-10-08T17:41:41.448567+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:56.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449562+0000","last_change":"2023-10-08T17:41:41.444984+0000","last_active":"2023-10-08T17:41:41.449562+0000","last_peered":"2023-10-08T17:41:41.449562+0000","last_clean":"2023-10-08T17:41:41.449562+0000","last_became_active":"2023-10-08T17:41:41.444723+0000","last_became_peered":"2023-10-08T17:41:41.444723+0000","last_unstale":"2023-10-08T17:41:41.449562+0000","last_undegraded":"2023-10-08T17:41:41.449562+0000","last_fullsized":"2023-10-08T17:41:41.449562+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.746976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434315+0000","last_change":"2023-10-08T17:41:41.429129+0000","last_active":"2023-10-08T17:41:41.434315+0000","last_peered":"2023-10-08T17:41:41.434315+0000","last_clean":"2023-10-08T17:41:41.434315+0000","last_became_active":"2023-10-08T17:41:41.428423+0000","last_became_peered":"2023-10-08T17:41:41.428423+0000","last_unstale":"2023-10-08T17:41:41.434315+0000","last_undegraded":"2023-10-08T17:41:41.434315+0000","last_fullsized":"2023-10-08T17:41:41.434315+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:57.110404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.442603+0000","last_change":"2023-10-08T17:41:41.439901+0000","last_active":"2023-10-08T17:41:41.442603+0000","last_peered":"2023-10-08T17:41:41.442603+0000","last_clean":"2023-10-08T17:41:41.442603+0000","last_became_active":"2023-10-08T17:41:41.439620+0000","last_became_peered":"2023-10-08T17:41:41.439620+0000","last_unstale":"2023-10-08T17:41:41.442603+0000","last_undegraded":"2023-10-08T17:41:41.442603+0000","last_fullsized":"2023-10-08T17:41:41.442603+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:21.671704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454985+0000","last_change":"2023-10-08T17:41:41.454118+0000","last_active":"2023-10-08T17:41:41.454985+0000","last_peered":"2023-10-08T17:41:41.454985+0000","last_clean":"2023-10-08T17:41:41.454985+0000","last_became_active":"2023-10-08T17:41:41.453173+0000","last_became_peered":"2023-10-08T17:41:41.453173+0000","last_unstale":"2023-10-08T17:41:41.454985+0000","last_undegraded":"2023-10-08T17:41:41.454985+0000","last_fullsized":"2023-10-08T17:41:41.454985+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:06.153595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445655+0000","last_change":"2023-10-08T17:41:41.444079+0000","last_active":"2023-10-08T17:41:41.445655+0000","last_peered":"2023-10-08T17:41:41.445655+0000","last_clean":"2023-10-08T17:41:41.445655+0000","last_became_active":"2023-10-08T17:41:41.443686+0000","last_became_peered":"2023-10-08T17:41:41.443686+0000","last_unstale":"2023-10-08T17:41:41.445655+0000","last_undegraded":"2023-10-08T17:41:41.445655+0000","last_fullsized":"2023-10-08T17:41:41.445655+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:55:30.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.444398+0000","last_change":"2023-10-08T17:41:41.442148+0000","last_active":"2023-10-08T17:41:41.444398+0000","last_peered":"2023-10-08T17:41:41.444398+0000","last_clean":"2023-10-08T17:41:41.444398+0000","last_became_active":"2023-10-08T17:41:41.441852+0000","last_became_peered":"2023-10-08T17:41:41.441852+0000","last_unstale":"2023-10-08T17:41:41.444398+0000","last_undegraded":"2023-10-08T17:41:41.444398+0000","last_fullsized":"2023-10-08T17:41:41.444398+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.044196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453019+0000","last_change":"2023-10-08T17:41:41.451794+0000","last_active":"2023-10-08T17:41:41.453019+0000","last_peered":"2023-10-08T17:41:41.453019+0000","last_clean":"2023-10-08T17:41:41.453019+0000","last_became_active":"2023-10-08T17:41:41.451287+0000","last_became_peered":"2023-10-08T17:41:41.451287+0000","last_unstale":"2023-10-08T17:41:41.453019+0000","last_undegraded":"2023-10-08T17:41:41.453019+0000","last_fullsized":"2023-10-08T17:41:41.453019+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.285181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456601+0000","last_change":"2023-10-08T17:41:41.450513+0000","last_active":"2023-10-08T17:41:41.456601+0000","last_peered":"2023-10-08T17:41:41.456601+0000","last_clean":"2023-10-08T17:41:41.456601+0000","last_became_active":"2023-10-08T17:41:41.450208+0000","last_became_peered":"2023-10-08T17:41:41.450208+0000","last_unstale":"2023-10-08T17:41:41.456601+0000","last_undegraded":"2023-10-08T17:41:41.456601+0000","last_fullsized":"2023-10-08T17:41:41.456601+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:22.398786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451223+0000","last_change":"2023-10-08T17:41:41.450141+0000","last_active":"2023-10-08T17:41:41.451223+0000","last_peered":"2023-10-08T17:41:41.451223+0000","last_clean":"2023-10-08T17:41:41.451223+0000","last_became_active":"2023-10-08T17:41:41.449882+0000","last_became_peered":"2023-10-08T17:41:41.449882+0000","last_unstale":"2023-10-08T17:41:41.451223+0000","last_undegraded":"2023-10-08T17:41:41.451223+0000","last_fullsized":"2023-10-08T17:41:41.451223+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:31.759196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456395+0000","last_change":"2023-10-08T17:41:41.451919+0000","last_active":"2023-10-08T17:41:41.456395+0000","last_peered":"2023-10-08T17:41:41.456395+0000","last_clean":"2023-10-08T17:41:41.456395+0000","last_became_active":"2023-10-08T17:41:41.451080+0000","last_became_peered":"2023-10-08T17:41:41.451080+0000","last_unstale":"2023-10-08T17:41:41.456395+0000","last_undegraded":"2023-10-08T17:41:41.456395+0000","last_fullsized":"2023-10-08T17:41:41.456395+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:17.689949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452103+0000","last_change":"2023-10-08T17:41:41.450875+0000","last_active":"2023-10-08T17:41:41.452103+0000","last_peered":"2023-10-08T17:41:41.452103+0000","last_clean":"2023-10-08T17:41:41.452103+0000","last_became_active":"2023-10-08T17:41:41.450329+0000","last_became_peered":"2023-10-08T17:41:41.450329+0000","last_unstale":"2023-10-08T17:41:41.452103+0000","last_undegraded":"2023-10-08T17:41:41.452103+0000","last_fullsized":"2023-10-08T17:41:41.452103+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:15.361006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443019+0000","last_change":"2023-10-08T17:41:41.430986+0000","last_active":"2023-10-08T17:41:41.443019+0000","last_peered":"2023-10-08T17:41:41.443019+0000","last_clean":"2023-10-08T17:41:41.443019+0000","last_became_active":"2023-10-08T17:41:41.430715+0000","last_became_peered":"2023-10-08T17:41:41.430715+0000","last_unstale":"2023-10-08T17:41:41.443019+0000","last_undegraded":"2023-10-08T17:41:41.443019+0000","last_fullsized":"2023-10-08T17:41:41.443019+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:54.572745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445256+0000","last_change":"2023-10-08T17:41:41.433351+0000","last_active":"2023-10-08T17:41:41.445256+0000","last_peered":"2023-10-08T17:41:41.445256+0000","last_clean":"2023-10-08T17:41:41.445256+0000","last_became_active":"2023-10-08T17:41:41.433063+0000","last_became_peered":"2023-10-08T17:41:41.433063+0000","last_unstale":"2023-10-08T17:41:41.445256+0000","last_undegraded":"2023-10-08T17:41:41.445256+0000","last_fullsized":"2023-10-08T17:41:41.445256+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:15.247542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443525+0000","last_change":"2023-10-08T17:41:41.441145+0000","last_active":"2023-10-08T17:41:41.443525+0000","last_peered":"2023-10-08T17:41:41.443525+0000","last_clean":"2023-10-08T17:41:41.443525+0000","last_became_active":"2023-10-08T17:41:41.440854+0000","last_became_peered":"2023-10-08T17:41:41.440854+0000","last_unstale":"2023-10-08T17:41:41.443525+0000","last_undegraded":"2023-10-08T17:41:41.443525+0000","last_fullsized":"2023-10-08T17:41:41.443525+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:36.835909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455560+0000","last_change":"2023-10-08T17:41:41.449747+0000","last_active":"2023-10-08T17:41:41.455560+0000","last_peered":"2023-10-08T17:41:41.455560+0000","last_clean":"2023-10-08T17:41:41.455560+0000","last_became_active":"2023-10-08T17:41:41.449490+0000","last_became_peered":"2023-10-08T17:41:41.449490+0000","last_unstale":"2023-10-08T17:41:41.455560+0000","last_undegraded":"2023-10-08T17:41:41.455560+0000","last_fullsized":"2023-10-08T17:41:41.455560+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:37.725619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"197'4","reported_seq":14,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451348+0000","last_change":"2023-10-08T17:41:40.432619+0000","last_active":"2023-10-08T17:41:41.451348+0000","last_peered":"2023-10-08T17:41:41.451348+0000","last_clean":"2023-10-08T17:41:41.451348+0000","last_became_active":"2023-10-08T17:41:40.432317+0000","last_became_peered":"2023-10-08T17:41:40.432317+0000","last_unstale":"2023-10-08T17:41:41.451348+0000","last_undegraded":"2023-10-08T17:41:41.451348+0000","last_fullsized":"2023-10-08T17:41:41.451348+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.832729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448793+0000","last_change":"2023-10-08T17:41:41.445859+0000","last_active":"2023-10-08T17:41:41.448793+0000","last_peered":"2023-10-08T17:41:41.448793+0000","last_clean":"2023-10-08T17:41:41.448793+0000","last_became_active":"2023-10-08T17:41:41.445568+0000","last_became_peered":"2023-10-08T17:41:41.445568+0000","last_unstale":"2023-10-08T17:41:41.448793+0000","last_undegraded":"2023-10-08T17:41:41.448793+0000","last_fullsized":"2023-10-08T17:41:41.448793+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:12.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.446071+0000","last_change":"2023-10-08T17:41:40.440825+0000","last_active":"2023-10-08T17:41:41.446071+0000","last_peered":"2023-10-08T17:41:41.446071+0000","last_clean":"2023-10-08T17:41:41.446071+0000","last_became_active":"2023-10-08T17:41:40.440561+0000","last_became_peered":"2023-10-08T17:41:40.440561+0000","last_unstale":"2023-10-08T17:41:41.446071+0000","last_undegraded":"2023-10-08T17:41:41.446071+0000","last_fullsized":"2023-10-08T17:41:41.446071+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:20.101941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454627+0000","last_change":"2023-10-08T17:41:41.451848+0000","last_active":"2023-10-08T17:41:41.454627+0000","last_peered":"2023-10-08T17:41:41.454627+0000","last_clean":"2023-10-08T17:41:41.454627+0000","last_became_active":"2023-10-08T17:41:41.451555+0000","last_became_peered":"2023-10-08T17:41:41.451555+0000","last_unstale":"2023-10-08T17:41:41.454627+0000","last_undegraded":"2023-10-08T17:41:41.454627+0000","last_fullsized":"2023-10-08T17:41:41.454627+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:38.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457564+0000","last_change":"2023-10-08T17:41:40.443482+0000","last_active":"2023-10-08T17:41:41.457564+0000","last_peered":"2023-10-08T17:41:41.457564+0000","last_clean":"2023-10-08T17:41:41.457564+0000","last_became_active":"2023-10-08T17:41:40.443136+0000","last_became_peered":"2023-10-08T17:41:40.443136+0000","last_unstale":"2023-10-08T17:41:41.457564+0000","last_undegraded":"2023-10-08T17:41:41.457564+0000","last_fullsized":"2023-10-08T17:41:41.457564+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:14.354030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.440991+0000","last_change":"2023-10-08T17:41:41.439561+0000","last_active":"2023-10-08T17:41:41.440991+0000","last_peered":"2023-10-08T17:41:41.440991+0000","last_clean":"2023-10-08T17:41:41.440991+0000","last_became_active":"2023-10-08T17:41:41.439283+0000","last_became_peered":"2023-10-08T17:41:41.439283+0000","last_unstale":"2023-10-08T17:41:41.440991+0000","last_undegraded":"2023-10-08T17:41:41.440991+0000","last_fullsized":"2023-10-08T17:41:41.440991+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:44.597044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457265+0000","last_change":"2023-10-08T17:41:40.436768+0000","last_active":"2023-10-08T17:41:41.457265+0000","last_peered":"2023-10-08T17:41:41.457265+0000","last_clean":"2023-10-08T17:41:41.457265+0000","last_became_active":"2023-10-08T17:41:40.436519+0000","last_became_peered":"2023-10-08T17:41:40.436519+0000","last_unstale":"2023-10-08T17:41:41.457265+0000","last_undegraded":"2023-10-08T17:41:41.457265+0000","last_fullsized":"2023-10-08T17:41:41.457265+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:30.752220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452146+0000","last_change":"2023-10-08T17:41:41.440098+0000","last_active":"2023-10-08T17:41:41.452146+0000","last_peered":"2023-10-08T17:41:41.452146+0000","last_clean":"2023-10-08T17:41:41.452146+0000","last_became_active":"2023-10-08T17:41:41.439851+0000","last_became_peered":"2023-10-08T17:41:41.439851+0000","last_unstale":"2023-10-08T17:41:41.452146+0000","last_undegraded":"2023-10-08T17:41:41.452146+0000","last_fullsized":"2023-10-08T17:41:41.452146+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:40.390044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455323+0000","last_change":"2023-10-08T17:41:40.438148+0000","last_active":"2023-10-08T17:41:41.455323+0000","last_peered":"2023-10-08T17:41:41.455323+0000","last_clean":"2023-10-08T17:41:41.455323+0000","last_became_active":"2023-10-08T17:41:40.437771+0000","last_became_peered":"2023-10-08T17:41:40.437771+0000","last_unstale":"2023-10-08T17:41:41.455323+0000","last_undegraded":"2023-10-08T17:41:41.455323+0000","last_fullsized":"2023-10-08T17:41:41.455323+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:20.713702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456832+0000","last_change":"2023-10-08T17:41:41.452832+0000","last_active":"2023-10-08T17:41:41.456832+0000","last_peered":"2023-10-08T17:41:41.456832+0000","last_clean":"2023-10-08T17:41:41.456832+0000","last_became_active":"2023-10-08T17:41:41.452586+0000","last_became_peered":"2023-10-08T17:41:41.452586+0000","last_unstale":"2023-10-08T17:41:41.456832+0000","last_undegraded":"2023-10-08T17:41:41.456832+0000","last_fullsized":"2023-10-08T17:41:41.456832+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:08.558658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455838+0000","last_change":"2023-10-08T17:41:40.440621+0000","last_active":"2023-10-08T17:41:41.455838+0000","last_peered":"2023-10-08T17:41:41.455838+0000","last_clean":"2023-10-08T17:41:41.455838+0000","last_became_active":"2023-10-08T17:41:40.439887+0000","last_became_peered":"2023-10-08T17:41:40.439887+0000","last_unstale":"2023-10-08T17:41:41.455838+0000","last_undegraded":"2023-10-08T17:41:41.455838+0000","last_fullsized":"2023-10-08T17:41:41.455838+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:26.533591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.459392+0000","last_change":"2023-10-08T17:41:41.457277+0000","last_active":"2023-10-08T17:41:41.459392+0000","last_peered":"2023-10-08T17:41:41.459392+0000","last_clean":"2023-10-08T17:41:41.459392+0000","last_became_active":"2023-10-08T17:41:41.456995+0000","last_became_peered":"2023-10-08T17:41:41.456995+0000","last_unstale":"2023-10-08T17:41:41.459392+0000","last_undegraded":"2023-10-08T17:41:41.459392+0000","last_fullsized":"2023-10-08T17:41:41.459392+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:19:34.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.437138+0000","last_change":"2023-10-08T17:41:40.444470+0000","last_active":"2023-10-08T17:41:41.437138+0000","last_peered":"2023-10-08T17:41:41.437138+0000","last_clean":"2023-10-08T17:41:41.437138+0000","last_became_active":"2023-10-08T17:41:40.444177+0000","last_became_peered":"2023-10-08T17:41:40.444177+0000","last_unstale":"2023-10-08T17:41:41.437138+0000","last_undegraded":"2023-10-08T17:41:41.437138+0000","last_fullsized":"2023-10-08T17:41:41.437138+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:33:28.910424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445100+0000","last_change":"2023-10-08T17:41:41.440630+0000","last_active":"2023-10-08T17:41:41.445100+0000","last_peered":"2023-10-08T17:41:41.445100+0000","last_clean":"2023-10-08T17:41:41.445100+0000","last_became_active":"2023-10-08T17:41:41.440363+0000","last_became_peered":"2023-10-08T17:41:41.440363+0000","last_unstale":"2023-10-08T17:41:41.445100+0000","last_undegraded":"2023-10-08T17:41:41.445100+0000","last_fullsized":"2023-10-08T17:41:41.445100+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:17.689949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.427112+0000","last_change":"2023-10-08T17:41:40.432724+0000","last_active":"2023-10-08T17:41:41.427112+0000","last_peered":"2023-10-08T17:41:41.427112+0000","last_clean":"2023-10-08T17:41:41.427112+0000","last_became_active":"2023-10-08T17:41:40.432458+0000","last_became_peered":"2023-10-08T17:41:40.432458+0000","last_unstale":"2023-10-08T17:41:41.427112+0000","last_undegraded":"2023-10-08T17:41:41.427112+0000","last_fullsized":"2023-10-08T17:41:41.427112+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:27.032554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450565+0000","last_change":"2023-10-08T17:41:41.447524+0000","last_active":"2023-10-08T17:41:41.450565+0000","last_peered":"2023-10-08T17:41:41.450565+0000","last_clean":"2023-10-08T17:41:41.450565+0000","last_became_active":"2023-10-08T17:41:41.446594+0000","last_became_peered":"2023-10-08T17:41:41.446594+0000","last_unstale":"2023-10-08T17:41:41.450565+0000","last_undegraded":"2023-10-08T17:41:41.450565+0000","last_fullsized":"2023-10-08T17:41:41.450565+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:03.486409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.425811+0000","last_change":"2023-10-08T17:41:40.430709+0000","last_active":"2023-10-08T17:41:41.425811+0000","last_peered":"2023-10-08T17:41:41.425811+0000","last_clean":"2023-10-08T17:41:41.425811+0000","last_became_active":"2023-10-08T17:41:40.430419+0000","last_became_peered":"2023-10-08T17:41:40.430419+0000","last_unstale":"2023-10-08T17:41:41.425811+0000","last_undegraded":"2023-10-08T17:41:41.425811+0000","last_fullsized":"2023-10-08T17:41:41.425811+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:27.406843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455233+0000","last_change":"2023-10-08T17:41:41.453111+0000","last_active":"2023-10-08T17:41:41.455233+0000","last_peered":"2023-10-08T17:41:41.455233+0000","last_clean":"2023-10-08T17:41:41.455233+0000","last_became_active":"2023-10-08T17:41:41.452868+0000","last_became_peered":"2023-10-08T17:41:41.452868+0000","last_unstale":"2023-10-08T17:41:41.455233+0000","last_undegraded":"2023-10-08T17:41:41.455233+0000","last_fullsized":"2023-10-08T17:41:41.455233+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.711241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"197'3","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453686+0000","last_change":"2023-10-08T17:41:40.439646+0000","last_active":"2023-10-08T17:41:41.453686+0000","last_peered":"2023-10-08T17:41:41.453686+0000","last_clean":"2023-10-08T17:41:41.453686+0000","last_became_active":"2023-10-08T17:41:40.439402+0000","last_became_peered":"2023-10-08T17:41:40.439402+0000","last_unstale":"2023-10-08T17:41:41.453686+0000","last_undegraded":"2023-10-08T17:41:41.453686+0000","last_fullsized":"2023-10-08T17:41:41.453686+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:01.186045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443025+0000","last_change":"2023-10-08T17:41:41.433214+0000","last_active":"2023-10-08T17:41:41.443025+0000","last_peered":"2023-10-08T17:41:41.443025+0000","last_clean":"2023-10-08T17:41:41.443025+0000","last_became_active":"2023-10-08T17:41:41.432915+0000","last_became_peered":"2023-10-08T17:41:41.432915+0000","last_unstale":"2023-10-08T17:41:41.443025+0000","last_undegraded":"2023-10-08T17:41:41.443025+0000","last_fullsized":"2023-10-08T17:41:41.443025+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:06.153595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"197'6","reported_seq":16,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.459448+0000","last_change":"2023-10-08T17:41:40.430366+0000","last_active":"2023-10-08T17:41:41.459448+0000","last_peered":"2023-10-08T17:41:41.459448+0000","last_clean":"2023-10-08T17:41:41.459448+0000","last_became_active":"2023-10-08T17:41:40.429895+0000","last_became_peered":"2023-10-08T17:41:40.429895+0000","last_unstale":"2023-10-08T17:41:41.459448+0000","last_undegraded":"2023-10-08T17:41:41.459448+0000","last_fullsized":"2023-10-08T17:41:41.459448+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:56.957095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448190+0000","last_change":"2023-10-08T17:41:41.444447+0000","last_active":"2023-10-08T17:41:41.448190+0000","last_peered":"2023-10-08T17:41:41.448190+0000","last_clean":"2023-10-08T17:41:41.448190+0000","last_became_active":"2023-10-08T17:41:41.444188+0000","last_became_peered":"2023-10-08T17:41:41.444188+0000","last_unstale":"2023-10-08T17:41:41.448190+0000","last_undegraded":"2023-10-08T17:41:41.448190+0000","last_fullsized":"2023-10-08T17:41:41.448190+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:40.806654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455385+0000","last_change":"2023-10-08T17:41:40.441732+0000","last_active":"2023-10-08T17:41:41.455385+0000","last_peered":"2023-10-08T17:41:41.455385+0000","last_clean":"2023-10-08T17:41:41.455385+0000","last_became_active":"2023-10-08T17:41:40.441407+0000","last_became_peered":"2023-10-08T17:41:40.441407+0000","last_unstale":"2023-10-08T17:41:41.455385+0000","last_undegraded":"2023-10-08T17:41:41.455385+0000","last_fullsized":"2023-10-08T17:41:41.455385+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450012+0000","last_change":"2023-10-08T17:41:41.438971+0000","last_active":"2023-10-08T17:41:41.450012+0000","last_peered":"2023-10-08T17:41:41.450012+0000","last_clean":"2023-10-08T17:41:41.450012+0000","last_became_active":"2023-10-08T17:41:41.437988+0000","last_became_peered":"2023-10-08T17:41:41.437988+0000","last_unstale":"2023-10-08T17:41:41.450012+0000","last_undegraded":"2023-10-08T17:41:41.450012+0000","last_fullsized":"2023-10-08T17:41:41.450012+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:32.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.433016+0000","last_change":"2023-10-08T17:41:40.429327+0000","last_active":"2023-10-08T17:41:41.433016+0000","last_peered":"2023-10-08T17:41:41.433016+0000","last_clean":"2023-10-08T17:41:41.433016+0000","last_became_active":"2023-10-08T17:41:40.429053+0000","last_became_peered":"2023-10-08T17:41:40.429053+0000","last_unstale":"2023-10-08T17:41:41.433016+0000","last_undegraded":"2023-10-08T17:41:41.433016+0000","last_fullsized":"2023-10-08T17:41:41.433016+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:34.273130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449616+0000","last_change":"2023-10-08T17:41:41.440200+0000","last_active":"2023-10-08T17:41:41.449616+0000","last_peered":"2023-10-08T17:41:41.449616+0000","last_clean":"2023-10-08T17:41:41.449616+0000","last_became_active":"2023-10-08T17:41:41.439940+0000","last_became_peered":"2023-10-08T17:41:41.439940+0000","last_unstale":"2023-10-08T17:41:41.449616+0000","last_undegraded":"2023-10-08T17:41:41.449616+0000","last_fullsized":"2023-10-08T17:41:41.449616+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:38:28.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.435332+0000","last_change":"2023-10-08T17:41:40.442516+0000","last_active":"2023-10-08T17:41:41.435332+0000","last_peered":"2023-10-08T17:41:41.435332+0000","last_clean":"2023-10-08T17:41:41.435332+0000","last_became_active":"2023-10-08T17:41:40.442273+0000","last_became_peered":"2023-10-08T17:41:40.442273+0000","last_unstale":"2023-10-08T17:41:41.435332+0000","last_undegraded":"2023-10-08T17:41:41.435332+0000","last_fullsized":"2023-10-08T17:41:41.435332+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:16.078996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.438590+0000","last_change":"2023-10-08T17:41:41.435398+0000","last_active":"2023-10-08T17:41:41.438590+0000","last_peered":"2023-10-08T17:41:41.438590+0000","last_clean":"2023-10-08T17:41:41.438590+0000","last_became_active":"2023-10-08T17:41:41.434325+0000","last_became_peered":"2023-10-08T17:41:41.434325+0000","last_unstale":"2023-10-08T17:41:41.438590+0000","last_undegraded":"2023-10-08T17:41:41.438590+0000","last_fullsized":"2023-10-08T17:41:41.438590+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:58.865832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"197'8","reported_seq":18,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456306+0000","last_change":"2023-10-08T17:41:40.429976+0000","last_active":"2023-10-08T17:41:41.456306+0000","last_peered":"2023-10-08T17:41:41.456306+0000","last_clean":"2023-10-08T17:41:41.456306+0000","last_became_active":"2023-10-08T17:41:40.429724+0000","last_became_peered":"2023-10-08T17:41:40.429724+0000","last_unstale":"2023-10-08T17:41:41.456306+0000","last_undegraded":"2023-10-08T17:41:41.456306+0000","last_fullsized":"2023-10-08T17:41:41.456306+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:00.543738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454464+0000","last_change":"2023-10-08T17:41:41.446246+0000","last_active":"2023-10-08T17:41:41.454464+0000","last_peered":"2023-10-08T17:41:41.454464+0000","last_clean":"2023-10-08T17:41:41.454464+0000","last_became_active":"2023-10-08T17:41:41.445684+0000","last_became_peered":"2023-10-08T17:41:41.445684+0000","last_unstale":"2023-10-08T17:41:41.454464+0000","last_undegraded":"2023-10-08T17:41:41.454464+0000","last_fullsized":"2023-10-08T17:41:41.454464+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:09.925208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453273+0000","last_change":"2023-10-08T17:41:40.439873+0000","last_active":"2023-10-08T17:41:41.453273+0000","last_peered":"2023-10-08T17:41:41.453273+0000","last_clean":"2023-10-08T17:41:41.453273+0000","last_became_active":"2023-10-08T17:41:40.439609+0000","last_became_peered":"2023-10-08T17:41:40.439609+0000","last_unstale":"2023-10-08T17:41:41.453273+0000","last_undegraded":"2023-10-08T17:41:41.453273+0000","last_fullsized":"2023-10-08T17:41:41.453273+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:21.994916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451369+0000","last_change":"2023-10-08T17:41:41.447688+0000","last_active":"2023-10-08T17:41:41.451369+0000","last_peered":"2023-10-08T17:41:41.451369+0000","last_clean":"2023-10-08T17:41:41.451369+0000","last_became_active":"2023-10-08T17:41:41.446964+0000","last_became_peered":"2023-10-08T17:41:41.446964+0000","last_unstale":"2023-10-08T17:41:41.451369+0000","last_undegraded":"2023-10-08T17:41:41.451369+0000","last_fullsized":"2023-10-08T17:41:41.451369+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:39.939721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453198+0000","last_change":"2023-10-08T17:41:40.433549+0000","last_active":"2023-10-08T17:41:41.453198+0000","last_peered":"2023-10-08T17:41:41.453198+0000","last_clean":"2023-10-08T17:41:41.453198+0000","last_became_active":"2023-10-08T17:41:40.433246+0000","last_became_peered":"2023-10-08T17:41:40.433246+0000","last_unstale":"2023-10-08T17:41:41.453198+0000","last_undegraded":"2023-10-08T17:41:41.453198+0000","last_fullsized":"2023-10-08T17:41:41.453198+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:57.390778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456374+0000","last_change":"2023-10-08T17:41:41.451747+0000","last_active":"2023-10-08T17:41:41.456374+0000","last_peered":"2023-10-08T17:41:41.456374+0000","last_clean":"2023-10-08T17:41:41.456374+0000","last_became_active":"2023-10-08T17:41:41.450801+0000","last_became_peered":"2023-10-08T17:41:41.450801+0000","last_unstale":"2023-10-08T17:41:41.456374+0000","last_undegraded":"2023-10-08T17:41:41.456374+0000","last_fullsized":"2023-10-08T17:41:41.456374+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:19.736583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450783+0000","last_change":"2023-10-08T17:41:40.437939+0000","last_active":"2023-10-08T17:41:41.450783+0000","last_peered":"2023-10-08T17:41:41.450783+0000","last_clean":"2023-10-08T17:41:41.450783+0000","last_became_active":"2023-10-08T17:41:40.437643+0000","last_became_peered":"2023-10-08T17:41:40.437643+0000","last_unstale":"2023-10-08T17:41:41.450783+0000","last_undegraded":"2023-10-08T17:41:41.450783+0000","last_fullsized":"2023-10-08T17:41:41.450783+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:33.727647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455578+0000","last_change":"2023-10-08T17:41:41.449237+0000","last_active":"2023-10-08T17:41:41.455578+0000","last_peered":"2023-10-08T17:41:41.455578+0000","last_clean":"2023-10-08T17:41:41.455578+0000","last_became_active":"2023-10-08T17:41:41.448972+0000","last_became_peered":"2023-10-08T17:41:41.448972+0000","last_unstale":"2023-10-08T17:41:41.455578+0000","last_undegraded":"2023-10-08T17:41:41.455578+0000","last_fullsized":"2023-10-08T17:41:41.455578+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:11.579401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422949+0000","last_change":"2023-10-08T17:41:40.440104+0000","last_active":"2023-10-08T17:41:41.422949+0000","last_peered":"2023-10-08T17:41:41.422949+0000","last_clean":"2023-10-08T17:41:41.422949+0000","last_became_active":"2023-10-08T17:41:40.439845+0000","last_became_peered":"2023-10-08T17:41:40.439845+0000","last_unstale":"2023-10-08T17:41:41.422949+0000","last_undegraded":"2023-10-08T17:41:41.422949+0000","last_fullsized":"2023-10-08T17:41:41.422949+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:19.307994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443031+0000","last_change":"2023-10-08T17:41:41.440884+0000","last_active":"2023-10-08T17:41:41.443031+0000","last_peered":"2023-10-08T17:41:41.443031+0000","last_clean":"2023-10-08T17:41:41.443031+0000","last_became_active":"2023-10-08T17:41:41.440627+0000","last_became_peered":"2023-10-08T17:41:41.440627+0000","last_unstale":"2023-10-08T17:41:41.443031+0000","last_undegraded":"2023-10-08T17:41:41.443031+0000","last_fullsized":"2023-10-08T17:41:41.443031+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:09.231606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457830+0000","last_change":"2023-10-08T17:41:40.441870+0000","last_active":"2023-10-08T17:41:41.457830+0000","last_peered":"2023-10-08T17:41:41.457830+0000","last_clean":"2023-10-08T17:41:41.457830+0000","last_became_active":"2023-10-08T17:41:40.441186+0000","last_became_peered":"2023-10-08T17:41:40.441186+0000","last_unstale":"2023-10-08T17:41:41.457830+0000","last_undegraded":"2023-10-08T17:41:41.457830+0000","last_fullsized":"2023-10-08T17:41:41.457830+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:30.595961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455646+0000","last_change":"2023-10-08T17:41:41.449918+0000","last_active":"2023-10-08T17:41:41.455646+0000","last_peered":"2023-10-08T17:41:41.455646+0000","last_clean":"2023-10-08T17:41:41.455646+0000","last_became_active":"2023-10-08T17:41:41.449064+0000","last_became_peered":"2023-10-08T17:41:41.449064+0000","last_unstale":"2023-10-08T17:41:41.455646+0000","last_undegraded":"2023-10-08T17:41:41.455646+0000","last_fullsized":"2023-10-08T17:41:41.455646+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:54.613333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422580+0000","last_change":"2023-10-08T17:41:40.441792+0000","last_active":"2023-10-08T17:41:41.422580+0000","last_peered":"2023-10-08T17:41:41.422580+0000","last_clean":"2023-10-08T17:41:41.422580+0000","last_became_active":"2023-10-08T17:41:40.441220+0000","last_became_peered":"2023-10-08T17:41:40.441220+0000","last_unstale":"2023-10-08T17:41:41.422580+0000","last_undegraded":"2023-10-08T17:41:41.422580+0000","last_fullsized":"2023-10-08T17:41:41.422580+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:53.606357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451482+0000","last_change":"2023-10-08T17:41:41.439259+0000","last_active":"2023-10-08T17:41:41.451482+0000","last_peered":"2023-10-08T17:41:41.451482+0000","last_clean":"2023-10-08T17:41:41.451482+0000","last_became_active":"2023-10-08T17:41:41.438969+0000","last_became_peered":"2023-10-08T17:41:41.438969+0000","last_unstale":"2023-10-08T17:41:41.451482+0000","last_undegraded":"2023-10-08T17:41:41.451482+0000","last_fullsized":"2023-10-08T17:41:41.451482+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:03.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.435442+0000","last_change":"2023-10-08T17:41:40.435508+0000","last_active":"2023-10-08T17:41:41.435442+0000","last_peered":"2023-10-08T17:41:41.435442+0000","last_clean":"2023-10-08T17:41:41.435442+0000","last_became_active":"2023-10-08T17:41:40.435256+0000","last_became_peered":"2023-10-08T17:41:40.435256+0000","last_unstale":"2023-10-08T17:41:41.435442+0000","last_undegraded":"2023-10-08T17:41:41.435442+0000","last_fullsized":"2023-10-08T17:41:41.435442+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:46.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445635+0000","last_change":"2023-10-08T17:41:41.443915+0000","last_active":"2023-10-08T17:41:41.445635+0000","last_peered":"2023-10-08T17:41:41.445635+0000","last_clean":"2023-10-08T17:41:41.445635+0000","last_became_active":"2023-10-08T17:41:41.443351+0000","last_became_peered":"2023-10-08T17:41:41.443351+0000","last_unstale":"2023-10-08T17:41:41.445635+0000","last_undegraded":"2023-10-08T17:41:41.445635+0000","last_fullsized":"2023-10-08T17:41:41.445635+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:15.069894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422606+0000","last_change":"2023-10-08T17:41:40.437937+0000","last_active":"2023-10-08T17:41:41.422606+0000","last_peered":"2023-10-08T17:41:41.422606+0000","last_clean":"2023-10-08T17:41:41.422606+0000","last_became_active":"2023-10-08T17:41:40.437630+0000","last_became_peered":"2023-10-08T17:41:40.437630+0000","last_unstale":"2023-10-08T17:41:41.422606+0000","last_undegraded":"2023-10-08T17:41:41.422606+0000","last_fullsized":"2023-10-08T17:41:41.422606+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:32:48.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450654+0000","last_change":"2023-10-08T17:41:41.447179+0000","last_active":"2023-10-08T17:41:41.450654+0000","last_peered":"2023-10-08T17:41:41.450654+0000","last_clean":"2023-10-08T17:41:41.450654+0000","last_became_active":"2023-10-08T17:41:41.446882+0000","last_became_peered":"2023-10-08T17:41:41.446882+0000","last_unstale":"2023-10-08T17:41:41.450654+0000","last_undegraded":"2023-10-08T17:41:41.450654+0000","last_fullsized":"2023-10-08T17:41:41.450654+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:50:37.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450508+0000","last_change":"2023-10-08T17:41:40.440770+0000","last_active":"2023-10-08T17:41:41.450508+0000","last_peered":"2023-10-08T17:41:41.450508+0000","last_clean":"2023-10-08T17:41:41.450508+0000","last_became_active":"2023-10-08T17:41:40.440475+0000","last_became_peered":"2023-10-08T17:41:40.440475+0000","last_unstale":"2023-10-08T17:41:41.450508+0000","last_undegraded":"2023-10-08T17:41:41.450508+0000","last_fullsized":"2023-10-08T17:41:41.450508+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:03.719259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452009+0000","last_change":"2023-10-08T17:41:41.443226+0000","last_active":"2023-10-08T17:41:41.452009+0000","last_peered":"2023-10-08T17:41:41.452009+0000","last_clean":"2023-10-08T17:41:41.452009+0000","last_became_active":"2023-10-08T17:41:41.442450+0000","last_became_peered":"2023-10-08T17:41:41.442450+0000","last_unstale":"2023-10-08T17:41:41.452009+0000","last_undegraded":"2023-10-08T17:41:41.452009+0000","last_fullsized":"2023-10-08T17:41:41.452009+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:47.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.429862+0000","last_change":"2023-10-08T17:41:40.436315+0000","last_active":"2023-10-08T17:41:41.429862+0000","last_peered":"2023-10-08T17:41:41.429862+0000","last_clean":"2023-10-08T17:41:41.429862+0000","last_became_active":"2023-10-08T17:41:40.436042+0000","last_became_peered":"2023-10-08T17:41:40.436042+0000","last_unstale":"2023-10-08T17:41:41.429862+0000","last_undegraded":"2023-10-08T17:41:41.429862+0000","last_fullsized":"2023-10-08T17:41:41.429862+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:47:25.068063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456276+0000","last_change":"2023-10-08T17:41:41.452757+0000","last_active":"2023-10-08T17:41:41.456276+0000","last_peered":"2023-10-08T17:41:41.456276+0000","last_clean":"2023-10-08T17:41:41.456276+0000","last_became_active":"2023-10-08T17:41:41.452479+0000","last_became_peered":"2023-10-08T17:41:41.452479+0000","last_unstale":"2023-10-08T17:41:41.456276+0000","last_undegraded":"2023-10-08T17:41:41.456276+0000","last_fullsized":"2023-10-08T17:41:41.456276+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:11:36.706872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.440187+0000","last_change":"2023-10-08T17:41:40.443934+0000","last_active":"2023-10-08T17:41:41.440187+0000","last_peered":"2023-10-08T17:41:41.440187+0000","last_clean":"2023-10-08T17:41:41.440187+0000","last_became_active":"2023-10-08T17:41:40.443395+0000","last_became_peered":"2023-10-08T17:41:40.443395+0000","last_unstale":"2023-10-08T17:41:41.440187+0000","last_undegraded":"2023-10-08T17:41:41.440187+0000","last_fullsized":"2023-10-08T17:41:41.440187+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:11:35.699896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455258+0000","last_change":"2023-10-08T17:41:41.453877+0000","last_active":"2023-10-08T17:41:41.455258+0000","last_peered":"2023-10-08T17:41:41.455258+0000","last_clean":"2023-10-08T17:41:41.455258+0000","last_became_active":"2023-10-08T17:41:41.453622+0000","last_became_peered":"2023-10-08T17:41:41.453622+0000","last_unstale":"2023-10-08T17:41:41.455258+0000","last_undegraded":"2023-10-08T17:41:41.455258+0000","last_fullsized":"2023-10-08T17:41:41.455258+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:56.042291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434318+0000","last_change":"2023-10-08T17:41:40.431629+0000","last_active":"2023-10-08T17:41:41.434318+0000","last_peered":"2023-10-08T17:41:41.434318+0000","last_clean":"2023-10-08T17:41:41.434318+0000","last_became_active":"2023-10-08T17:41:40.431384+0000","last_became_peered":"2023-10-08T17:41:40.431384+0000","last_unstale":"2023-10-08T17:41:41.434318+0000","last_undegraded":"2023-10-08T17:41:41.434318+0000","last_fullsized":"2023-10-08T17:41:41.434318+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:01.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.439628+0000","last_change":"2023-10-08T17:41:41.438096+0000","last_active":"2023-10-08T17:41:41.439628+0000","last_peered":"2023-10-08T17:41:41.439628+0000","last_clean":"2023-10-08T17:41:41.439628+0000","last_became_active":"2023-10-08T17:41:41.437837+0000","last_became_peered":"2023-10-08T17:41:41.437837+0000","last_unstale":"2023-10-08T17:41:41.439628+0000","last_undegraded":"2023-10-08T17:41:41.439628+0000","last_fullsized":"2023-10-08T17:41:41.439628+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:27.511417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.426805+0000","last_change":"2023-10-08T17:41:40.431607+0000","last_active":"2023-10-08T17:41:41.426805+0000","last_peered":"2023-10-08T17:41:41.426805+0000","last_clean":"2023-10-08T17:41:41.426805+0000","last_became_active":"2023-10-08T17:41:40.431322+0000","last_became_peered":"2023-10-08T17:41:40.431322+0000","last_unstale":"2023-10-08T17:41:41.426805+0000","last_undegraded":"2023-10-08T17:41:41.426805+0000","last_fullsized":"2023-10-08T17:41:41.426805+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.649501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445724+0000","last_change":"2023-10-08T17:41:41.441982+0000","last_active":"2023-10-08T17:41:41.445724+0000","last_peered":"2023-10-08T17:41:41.445724+0000","last_clean":"2023-10-08T17:41:41.445724+0000","last_became_active":"2023-10-08T17:41:41.441697+0000","last_became_peered":"2023-10-08T17:41:41.441697+0000","last_unstale":"2023-10-08T17:41:41.445724+0000","last_undegraded":"2023-10-08T17:41:41.445724+0000","last_fullsized":"2023-10-08T17:41:41.445724+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.044196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434898+0000","last_change":"2023-10-08T17:41:40.438734+0000","last_active":"2023-10-08T17:41:41.434898+0000","last_peered":"2023-10-08T17:41:41.434898+0000","last_clean":"2023-10-08T17:41:41.434898+0000","last_became_active":"2023-10-08T17:41:40.438477+0000","last_became_peered":"2023-10-08T17:41:40.438477+0000","last_unstale":"2023-10-08T17:41:41.434898+0000","last_undegraded":"2023-10-08T17:41:41.434898+0000","last_fullsized":"2023-10-08T17:41:41.434898+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:08.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.439355+0000","last_change":"2023-10-08T17:41:41.432856+0000","last_active":"2023-10-08T17:41:41.439355+0000","last_peered":"2023-10-08T17:41:41.439355+0000","last_clean":"2023-10-08T17:41:41.439355+0000","last_became_active":"2023-10-08T17:41:41.432543+0000","last_became_peered":"2023-10-08T17:41:41.432543+0000","last_unstale":"2023-10-08T17:41:41.439355+0000","last_undegraded":"2023-10-08T17:41:41.439355+0000","last_fullsized":"2023-10-08T17:41:41.439355+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:52.839705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.437259+0000","last_change":"2023-10-08T17:41:40.443676+0000","last_active":"2023-10-08T17:41:41.437259+0000","last_peered":"2023-10-08T17:41:41.437259+0000","last_clean":"2023-10-08T17:41:41.437259+0000","last_became_active":"2023-10-08T17:41:40.443321+0000","last_became_peered":"2023-10-08T17:41:40.443321+0000","last_unstale":"2023-10-08T17:41:41.437259+0000","last_undegraded":"2023-10-08T17:41:41.437259+0000","last_fullsized":"2023-10-08T17:41:41.437259+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:36.740000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.438611+0000","last_change":"2023-10-08T17:41:41.435613+0000","last_active":"2023-10-08T17:41:41.438611+0000","last_peered":"2023-10-08T17:41:41.438611+0000","last_clean":"2023-10-08T17:41:41.438611+0000","last_became_active":"2023-10-08T17:41:41.435344+0000","last_became_peered":"2023-10-08T17:41:41.435344+0000","last_unstale":"2023-10-08T17:41:41.438611+0000","last_undegraded":"2023-10-08T17:41:41.438611+0000","last_fullsized":"2023-10-08T17:41:41.438611+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:44.393155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.425849+0000","last_change":"2023-10-08T17:41:40.428335+0000","last_active":"2023-10-08T17:41:41.425849+0000","last_peered":"2023-10-08T17:41:41.425849+0000","last_clean":"2023-10-08T17:41:41.425849+0000","last_became_active":"2023-10-08T17:41:40.427757+0000","last_became_peered":"2023-10-08T17:41:40.427757+0000","last_unstale":"2023-10-08T17:41:41.425849+0000","last_undegraded":"2023-10-08T17:41:41.425849+0000","last_fullsized":"2023-10-08T17:41:41.425849+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:23.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452044+0000","last_change":"2023-10-08T17:41:41.451136+0000","last_active":"2023-10-08T17:41:41.452044+0000","last_peered":"2023-10-08T17:41:41.452044+0000","last_clean":"2023-10-08T17:41:41.452044+0000","last_became_active":"2023-10-08T17:41:41.450862+0000","last_became_peered":"2023-10-08T17:41:41.450862+0000","last_unstale":"2023-10-08T17:41:41.452044+0000","last_undegraded":"2023-10-08T17:41:41.452044+0000","last_fullsized":"2023-10-08T17:41:41.452044+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:59.520810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.426709+0000","last_change":"2023-10-08T17:41:40.433915+0000","last_active":"2023-10-08T17:41:41.426709+0000","last_peered":"2023-10-08T17:41:41.426709+0000","last_clean":"2023-10-08T17:41:41.426709+0000","last_became_active":"2023-10-08T17:41:40.433646+0000","last_became_peered":"2023-10-08T17:41:40.433646+0000","last_unstale":"2023-10-08T17:41:41.426709+0000","last_undegraded":"2023-10-08T17:41:41.426709+0000","last_fullsized":"2023-10-08T17:41:41.426709+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:34.185200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"187'326","reported_seq":1065,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422696+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:41:41.422696+0000","last_peered":"2023-10-08T17:41:41.422696+0000","last_clean":"2023-10-08T17:41:41.422696+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:41:41.422696+0000","last_undegraded":"2023-10-08T17:41:41.422696+0000","last_fullsized":"2023-10-08T17:41:41.422696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300308,"kb_used_data":3020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071532,"statfs":{"total":96636764160,"available":96329248768,"internally_reserved":0,"allocated":3092480,"data_stored":1835480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.624},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.46400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.165},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":1.0209999999999999,"15min":1.1080000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.64200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.034,"5min":1.073,"15min":1.1100000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.99199999999999999,"15min":1.1319999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.49199999999999999},"max":{"1min":0.97199999999999998,"5min":0.97799999999999998,"15min":1.0920000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.46600000000000003},"max":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":1.5009999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.5720000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66700000000000004},"min":{"1min":0.499,"5min":0.443,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.98399999999999999,"15min":1.597},"last":0.64300000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.0229999999999999,"15min":1.7549999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.44400000000000001},"max":{"1min":0.84599999999999997,"5min":1.032,"15min":1.6299999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98399999999999999,"5min":1.0840000000000001,"15min":1.681},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.502,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":1.0369999999999999,"15min":1.4570000000000001},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299708,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072132,"statfs":{"total":96636764160,"available":96329863168,"internally_reserved":0,"allocated":2478080,"data_stored":1242884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.39000000000000001},"max":{"1min":1.012,"5min":1.016,"15min":1.0649999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.45700000000000002,"15min":0.41799999999999998},"max":{"1min":0.91600000000000004,"5min":0.95499999999999996,"15min":1.034},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.40100000000000002},"max":{"1min":0.999,"5min":1.0820000000000001,"15min":1.099},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80500000000000005},"min":{"1min":0.60499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.054,"15min":1.796},"last":0.628}]},{"osd":3,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.49199999999999999},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":1.119,"5min":1.143,"15min":1.143},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68200000000000005},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.998,"15min":1.1299999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.59499999999999997,"5min":0.47999999999999998,"15min":0.41799999999999998},"max":{"1min":0.95799999999999996,"5min":1.0029999999999999,"15min":1.1200000000000001},"last":0.87}]},{"osd":5,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.96799999999999997,"15min":1.179},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":1.0660000000000001,"15min":1.1950000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":1.0489999999999999,"5min":1.054,"15min":1.1379999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.73},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575944,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2478080,"data_stored":1242896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.31},"max":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.91400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.89500000000000002,"15min":1.0649999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.85599999999999998,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83899999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0369999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82699999999999996},"min":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.216,"15min":1.2370000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0469999999999999,"5min":1.1859999999999999,"15min":1.196},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.54000000000000004},"max":{"1min":1.0089999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.874,"15min":0.877},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.56000000000000005},"max":{"1min":1.1180000000000001,"5min":1.28,"15min":1.304},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85399999999999998,"15min":0.86599999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.61499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86799999999999999,"15min":0.88700000000000001},"min":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.25},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.62},"max":{"1min":1.1319999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.89000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308476,"kb_used_data":2996,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063364,"statfs":{"total":96636764160,"available":96320884736,"internally_reserved":0,"allocated":3067904,"data_stored":1833230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65200000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.434}]},{"osd":2,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.39500000000000002,"5min":0.33000000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.85599999999999998,"15min":0.85899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71799999999999997,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.54800000000000004,"5min":0.47599999999999998,"15min":0.45600000000000002},"max":{"1min":0.82399999999999995,"5min":0.87,"15min":0.88700000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95699999999999996,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.755},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0600000000000001,"5min":1.151,"15min":1.151},"last":0.86199999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.995,"5min":1.131,"15min":1.1779999999999999},"last":0.877},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.2589999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84599999999999997,"15min":0.84899999999999998},"min":{"1min":0.65600000000000003,"5min":0.57099999999999995,"15min":0.55100000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.2809999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.046,"5min":1.204,"15min":1.204},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83999999999999997,"15min":0.86499999999999999},"min":{"1min":0.60699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0780000000000001,"5min":1.204,"15min":1.222},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84199999999999997,"15min":0.85299999999999998},"min":{"1min":0.67400000000000004,"5min":0.52800000000000002,"15min":0.50700000000000001},"max":{"1min":1.0149999999999999,"5min":1.091,"15min":1.292},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2478080,"data_stored":1242952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":0.89500000000000002,"15min":1.032},"last":0.309},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42699999999999999},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36799999999999999},"max":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66700000000000004,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.65800000000000003,"5min":1.0880000000000001,"15min":1.327},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79200000000000004,"5min":1.4339999999999999,"15min":1.5009999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57899999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88700000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.81399999999999995},"min":{"1min":0.73799999999999999,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":0.92300000000000004,"5min":1.151,"15min":1.2749999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.873,"15min":0.875},"min":{"1min":0.67200000000000004,"5min":0.60899999999999999,"15min":0.442},"max":{"1min":1.0509999999999999,"5min":1.296,"15min":1.3440000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.60699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0309999999999999,"5min":1.2849999999999999,"15min":1.375},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94399999999999995,"5min":1.3759999999999999,"15min":1.4319999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":0.94499999999999995,"5min":1.3819999999999999,"15min":1.5429999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89600000000000002,"15min":0.89100000000000001},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":0.98399999999999999,"5min":1.4039999999999999,"15min":1.476},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.90400000000000003,"15min":0.90100000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96499999999999997,"5min":1.2410000000000001,"15min":1.431},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2478080,"data_stored":1242896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.315},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.2070000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.83599999999999997,"15min":0.91200000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.59599999999999997},"min":{"1min":0.46200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69599999999999995,"5min":0.82799999999999996,"15min":0.97899999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":1,"15min":1.175},"last":0.502},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.147},"last":0.60099999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57599999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91600000000000004,"5min":1.095,"15min":1.292},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.67400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.044,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0660000000000001,"5min":1.248,"15min":1.3560000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.2130000000000001,"15min":1.3129999999999999},"last":0.95899999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.61799999999999999,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.1759999999999999,"15min":1.4319999999999999},"last":1.175},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.73999999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.095,"5min":1.3779999999999999,"15min":1.4179999999999999},"last":1.165}]},{"osd":7,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.71999999999999997,"5min":0.627,"15min":0.627},"max":{"1min":0.97099999999999997,"5min":1.222,"15min":1.4530000000000001},"last":1.018},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.89500000000000002},"min":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307912,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063928,"statfs":{"total":96636764160,"available":96321462272,"internally_reserved":0,"allocated":2490368,"data_stored":1244468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.75600000000000001},"min":{"1min":0.60499999999999998,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.0900000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.65700000000000003,"5min":0.56200000000000006,"15min":0.443},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":1.0880000000000001}]},{"osd":1,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.169,"15min":1.169},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79500000000000004,"15min":0.77800000000000002},"min":{"1min":0.61499999999999999,"5min":0.51500000000000001,"15min":0.47699999999999998},"max":{"1min":1.028,"5min":1.0509999999999999,"15min":1.079},"last":0.81699999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98399999999999999,"5min":1.0089999999999999,"15min":1.081},"last":1.109},{"interface":"front","average":{"1min":0.88,"5min":0.83399999999999996,"15min":0.80400000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.04,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.874,"15min":0.84299999999999997},"min":{"1min":0.71199999999999997,"5min":0.58099999999999996,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.097,"15min":1.1759999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79100000000000004,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.65100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96699999999999997,"5min":1.137,"15min":1.137},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0169999999999999,"5min":1.0649999999999999,"15min":1.1759999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96299999999999997,"5min":1.1000000000000001,"15min":1.121},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.47599999999999998},"max":{"1min":1.0629999999999999,"5min":1.113,"15min":1.1180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77600000000000002,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.498,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.095,"15min":1.155},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1243438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.51700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.0589999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.64900000000000002,"5min":0.46700000000000003,"15min":0.41199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.151,"15min":1.151},"last":0.86399999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.131,"15min":1.131},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.47199999999999998},"max":{"1min":0.92900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.68000000000000005,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":0.92900000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.84199999999999997,"5min":1.097,"15min":1.097},"last":0.83999999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":0.88300000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77400000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":0.89500000000000002,"5min":1.125,"15min":1.125},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.91400000000000003,"5min":1.258,"15min":1.258},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:41:45.803 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:41:46.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.023+0000 7fdbd319d700 1 Processor -- start 2023-10-08T17:41:46.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.024+0000 7fdbd319d700 1 -- start start 2023-10-08T17:41:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd319d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 0x7fdbcc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd319d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbcc13fef0 0x7fdbcc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd319d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbcc15ae70 con 0x7fdbcc06aaa0 2023-10-08T17:41:46.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd319d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc06af60 con 0x7fdbcc13fef0 2023-10-08T17:41:46.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd319d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbcc06b240 con 0x7fdbcc13fb20 2023-10-08T17:41:46.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd199a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fdbcc13fef0 0x7fdbcc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd299c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdbcc06aaa0 0x7fdbcc0c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54324/0 (socket says 172.21.15.12:54324) 2023-10-08T17:41:46.026 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.025+0000 7fdbd299c700 1 -- 172.21.15.12:0/1794527881 learned_addr learned my addr 172.21.15.12:0/1794527881 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:46.027 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd219b700 1 --2- 172.21.15.12:0/1794527881 >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 0x7fdbcc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd199a700 1 -- 172.21.15.12:0/1794527881 >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 msgr2=0x7fdbcc15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd199a700 1 --2- 172.21.15.12:0/1794527881 >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 0x7fdbcc15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd199a700 1 -- 172.21.15.12:0/1794527881 >> v1:172.21.15.12:6789/0 conn(0x7fdbcc06aaa0 legacy=0x7fdbcc0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd199a700 1 -- 172.21.15.12:0/1794527881 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbcc06b520 con 0x7fdbcc13fef0 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd219b700 1 --2- 172.21.15.12:0/1794527881 >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 0x7fdbcc15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd1199700 1 -- 172.21.15.12:0/1794527881 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811271832 0 0) 0x7fdbc4001490 con 0x7fdbcc06aaa0 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd199a700 1 --2- 172.21.15.12:0/1794527881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc0c7990 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0695b0 tx=0x7fdbbc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff563f94717b3679 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd1199700 1 -- 172.21.15.12:0/1794527881 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc005c10 con 0x7fdbcc13fef0 2023-10-08T17:41:46.028 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd1199700 1 -- 172.21.15.12:0/1794527881 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc005d70 con 0x7fdbcc13fef0 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.026+0000 7fdbd1199700 1 -- 172.21.15.12:0/1794527881 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc006260 con 0x7fdbcc13fef0 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 -- 172.21.15.12:0/1794527881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fef0 msgr2=0x7fdbcc0c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1794527881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc0c7990 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc0695b0 tx=0x7fdbbc009120 comp rx=0 tx=0).stop 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 -- 172.21.15.12:0/1794527881 shutdown_connections 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1794527881 >> v2:172.21.15.29:3300/0 conn(0x7fdbcc13fb20 0x7fdbcc15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1794527881 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc0c7990 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 -- 172.21.15.12:0/1794527881 >> 172.21.15.12:0/1794527881 conn(0x7fdbcc06d170 msgr2=0x7fdbcc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 -- 172.21.15.12:0/1794527881 shutdown_connections 2023-10-08T17:41:46.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.027+0000 7fdbd319d700 1 -- 172.21.15.12:0/1794527881 wait complete. 2023-10-08T17:41:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.028+0000 7fdbd319d700 1 Processor -- start 2023-10-08T17:41:46.031 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.029+0000 7fdbd319d700 1 -- start start 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbcc06aaa0 0x7fdbcc16cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc158e30 con 0x7fdbcc13fb20 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc157ed0 con 0x7fdbcc13fef0 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbcc1581b0 con 0x7fdbcc06aaa0 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48954/0 (socket says 172.21.15.12:48954) 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 -- 172.21.15.12:0/1955342596 learned_addr learned my addr 172.21.15.12:0/1955342596 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd299c700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.032 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 -- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbcc06aaa0 msgr2=0x7fdbcc16cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbcc06aaa0 0x7fdbcc16cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 -- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbcc13fef0 msgr2=0x7fdbcc155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 -- 172.21.15.12:0/1955342596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc0093c0 con 0x7fdbcc13fb20 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.030+0000 7fdbd199a700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc012000 tx=0x7fdbbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.033 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.031+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc00bdc0 con 0x7fdbcc13fb20 2023-10-08T17:41:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.031+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc01a420 con 0x7fdbcc13fb20 2023-10-08T17:41:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.031+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc01a7e0 con 0x7fdbcc13fb20 2023-10-08T17:41:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.031+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbcc158490 con 0x7fdbcc13fb20 2023-10-08T17:41:46.034 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.031+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbcc158a50 con 0x7fdbcc13fb20 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.032+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbcc158c70 con 0x7fdbcc13fb20 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.033+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fdbbc01ab50 con 0x7fdbcc13fb20 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.034+0000 7fdbc27fc700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 0x7fdbb0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.034+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fdbbc086550 con 0x7fdbcc13fb20 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.034+0000 7fdbd219b700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 0x7fdbb0069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.034+0000 7fdbd219b700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 0x7fdbb0069500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007aa0 tx=0x7fdbc8008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.038 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.038+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbbc053420 con 0x7fdbcc13fb20 2023-10-08T17:41:46.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.234+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbcc04c3c0 con 0x7fdbb0067050 2023-10-08T17:41:46.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.243+0000 7fdbc27fc700 1 -- 172.21.15.12:0/1955342596 <== mgr.9597 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289774 (secure 0 0 0) 0x7fdbcc04c3c0 con 0x7fdbb0067050 2023-10-08T17:41:46.247 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 msgr2=0x7fdbb0069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 0x7fdbb0069500 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8007aa0 tx=0x7fdbc8008040 comp rx=0 tx=0).stop 2023-10-08T17:41:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 msgr2=0x7fdbcc0ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc012000 tx=0x7fdbbc016000 comp rx=0 tx=0).stop 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 shutdown_connections 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdbb0067050 0x7fdbb0069500 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdbcc13fef0 0x7fdbcc155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdbcc06aaa0 0x7fdbcc16cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 --2- 172.21.15.12:0/1955342596 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdbcc13fb20 0x7fdbcc0ac170 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 >> 172.21.15.12:0/1955342596 conn(0x7fdbcc06d170 msgr2=0x7fdbcc13e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 shutdown_connections 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.248+0000 7fdbd319d700 1 -- 172.21.15.12:0/1955342596 wait complete. 2023-10-08T17:41:46.250 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:41:46.266 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T17:41:45.947254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":583,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":364,"ondisk_log_size":364,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2452104,"kb_used_data":20552,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752522616,"statfs":{"total":773094113280,"available":770583158784,"internally_reserved":0,"allocated":21045248,"data_stored":11128244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001007"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448455+0000","last_change":"2023-10-08T17:41:41.429646+0000","last_active":"2023-10-08T17:41:41.448455+0000","last_peered":"2023-10-08T17:41:41.448455+0000","last_clean":"2023-10-08T17:41:41.448455+0000","last_became_active":"2023-10-08T17:41:41.429317+0000","last_became_peered":"2023-10-08T17:41:41.429317+0000","last_unstale":"2023-10-08T17:41:41.448455+0000","last_undegraded":"2023-10-08T17:41:41.448455+0000","last_fullsized":"2023-10-08T17:41:41.448455+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:47.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457629+0000","last_change":"2023-10-08T17:41:41.456675+0000","last_active":"2023-10-08T17:41:41.457629+0000","last_peered":"2023-10-08T17:41:41.457629+0000","last_clean":"2023-10-08T17:41:41.457629+0000","last_became_active":"2023-10-08T17:41:41.456404+0000","last_became_peered":"2023-10-08T17:41:41.456404+0000","last_unstale":"2023-10-08T17:41:41.457629+0000","last_undegraded":"2023-10-08T17:41:41.457629+0000","last_fullsized":"2023-10-08T17:41:41.457629+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:49:34.300832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451001+0000","last_change":"2023-10-08T17:41:41.448361+0000","last_active":"2023-10-08T17:41:41.451001+0000","last_peered":"2023-10-08T17:41:41.451001+0000","last_clean":"2023-10-08T17:41:41.451001+0000","last_became_active":"2023-10-08T17:41:41.448104+0000","last_became_peered":"2023-10-08T17:41:41.448104+0000","last_unstale":"2023-10-08T17:41:41.451001+0000","last_undegraded":"2023-10-08T17:41:41.451001+0000","last_fullsized":"2023-10-08T17:41:41.451001+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:44:26.626383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456414+0000","last_change":"2023-10-08T17:41:41.452082+0000","last_active":"2023-10-08T17:41:41.456414+0000","last_peered":"2023-10-08T17:41:41.456414+0000","last_clean":"2023-10-08T17:41:41.456414+0000","last_became_active":"2023-10-08T17:41:41.451399+0000","last_became_peered":"2023-10-08T17:41:41.451399+0000","last_unstale":"2023-10-08T17:41:41.456414+0000","last_undegraded":"2023-10-08T17:41:41.456414+0000","last_fullsized":"2023-10-08T17:41:41.456414+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:47:01.204479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452616+0000","last_change":"2023-10-08T17:41:41.448307+0000","last_active":"2023-10-08T17:41:41.452616+0000","last_peered":"2023-10-08T17:41:41.452616+0000","last_clean":"2023-10-08T17:41:41.452616+0000","last_became_active":"2023-10-08T17:41:41.447965+0000","last_became_peered":"2023-10-08T17:41:41.447965+0000","last_unstale":"2023-10-08T17:41:41.452616+0000","last_undegraded":"2023-10-08T17:41:41.452616+0000","last_fullsized":"2023-10-08T17:41:41.452616+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:06:40.037112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445529+0000","last_change":"2023-10-08T17:41:41.442980+0000","last_active":"2023-10-08T17:41:41.445529+0000","last_peered":"2023-10-08T17:41:41.445529+0000","last_clean":"2023-10-08T17:41:41.445529+0000","last_became_active":"2023-10-08T17:41:41.442701+0000","last_became_peered":"2023-10-08T17:41:41.442701+0000","last_unstale":"2023-10-08T17:41:41.445529+0000","last_undegraded":"2023-10-08T17:41:41.445529+0000","last_fullsized":"2023-10-08T17:41:41.445529+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:31:07.886666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452116+0000","last_change":"2023-10-08T17:41:41.444819+0000","last_active":"2023-10-08T17:41:41.452116+0000","last_peered":"2023-10-08T17:41:41.452116+0000","last_clean":"2023-10-08T17:41:41.452116+0000","last_became_active":"2023-10-08T17:41:41.443601+0000","last_became_peered":"2023-10-08T17:41:41.443601+0000","last_unstale":"2023-10-08T17:41:41.452116+0000","last_undegraded":"2023-10-08T17:41:41.452116+0000","last_fullsized":"2023-10-08T17:41:41.452116+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:16.610421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449480+0000","last_change":"2023-10-08T17:41:41.447917+0000","last_active":"2023-10-08T17:41:41.449480+0000","last_peered":"2023-10-08T17:41:41.449480+0000","last_clean":"2023-10-08T17:41:41.449480+0000","last_became_active":"2023-10-08T17:41:41.447650+0000","last_became_peered":"2023-10-08T17:41:41.447650+0000","last_unstale":"2023-10-08T17:41:41.449480+0000","last_undegraded":"2023-10-08T17:41:41.449480+0000","last_fullsized":"2023-10-08T17:41:41.449480+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:15.247542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456699+0000","last_change":"2023-10-08T17:41:41.456038+0000","last_active":"2023-10-08T17:41:41.456699+0000","last_peered":"2023-10-08T17:41:41.456699+0000","last_clean":"2023-10-08T17:41:41.456699+0000","last_became_active":"2023-10-08T17:41:41.455763+0000","last_became_peered":"2023-10-08T17:41:41.455763+0000","last_unstale":"2023-10-08T17:41:41.456699+0000","last_undegraded":"2023-10-08T17:41:41.456699+0000","last_fullsized":"2023-10-08T17:41:41.456699+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:54.572745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454956+0000","last_change":"2023-10-08T17:41:41.453959+0000","last_active":"2023-10-08T17:41:41.454956+0000","last_peered":"2023-10-08T17:41:41.454956+0000","last_clean":"2023-10-08T17:41:41.454956+0000","last_became_active":"2023-10-08T17:41:41.453697+0000","last_became_peered":"2023-10-08T17:41:41.453697+0000","last_unstale":"2023-10-08T17:41:41.454956+0000","last_undegraded":"2023-10-08T17:41:41.454956+0000","last_fullsized":"2023-10-08T17:41:41.454956+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:40:15.365803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449430+0000","last_change":"2023-10-08T17:41:41.447208+0000","last_active":"2023-10-08T17:41:41.449430+0000","last_peered":"2023-10-08T17:41:41.449430+0000","last_clean":"2023-10-08T17:41:41.449430+0000","last_became_active":"2023-10-08T17:41:41.446944+0000","last_became_peered":"2023-10-08T17:41:41.446944+0000","last_unstale":"2023-10-08T17:41:41.449430+0000","last_undegraded":"2023-10-08T17:41:41.449430+0000","last_fullsized":"2023-10-08T17:41:41.449430+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:37:46.778370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456281+0000","last_change":"2023-10-08T17:41:41.455673+0000","last_active":"2023-10-08T17:41:41.456281+0000","last_peered":"2023-10-08T17:41:41.456281+0000","last_clean":"2023-10-08T17:41:41.456281+0000","last_became_active":"2023-10-08T17:41:41.455356+0000","last_became_peered":"2023-10-08T17:41:41.455356+0000","last_unstale":"2023-10-08T17:41:41.456281+0000","last_undegraded":"2023-10-08T17:41:41.456281+0000","last_fullsized":"2023-10-08T17:41:41.456281+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:12.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.442413+0000","last_change":"2023-10-08T17:41:41.440253+0000","last_active":"2023-10-08T17:41:41.442413+0000","last_peered":"2023-10-08T17:41:41.442413+0000","last_clean":"2023-10-08T17:41:41.442413+0000","last_became_active":"2023-10-08T17:41:41.439989+0000","last_became_peered":"2023-10-08T17:41:41.439989+0000","last_unstale":"2023-10-08T17:41:41.442413+0000","last_undegraded":"2023-10-08T17:41:41.442413+0000","last_fullsized":"2023-10-08T17:41:41.442413+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:47.348541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.430815+0000","last_change":"2023-10-08T17:41:41.428741+0000","last_active":"2023-10-08T17:41:41.430815+0000","last_peered":"2023-10-08T17:41:41.430815+0000","last_clean":"2023-10-08T17:41:41.430815+0000","last_became_active":"2023-10-08T17:41:41.428358+0000","last_became_peered":"2023-10-08T17:41:41.428358+0000","last_unstale":"2023-10-08T17:41:41.430815+0000","last_undegraded":"2023-10-08T17:41:41.430815+0000","last_fullsized":"2023-10-08T17:41:41.430815+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:23:58.448294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450941+0000","last_change":"2023-10-08T17:41:41.442183+0000","last_active":"2023-10-08T17:41:41.450941+0000","last_peered":"2023-10-08T17:41:41.450941+0000","last_clean":"2023-10-08T17:41:41.450941+0000","last_became_active":"2023-10-08T17:41:41.441911+0000","last_became_peered":"2023-10-08T17:41:41.441911+0000","last_unstale":"2023-10-08T17:41:41.450941+0000","last_undegraded":"2023-10-08T17:41:41.450941+0000","last_fullsized":"2023-10-08T17:41:41.450941+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:28:22.190361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456563+0000","last_change":"2023-10-08T17:41:41.452748+0000","last_active":"2023-10-08T17:41:41.456563+0000","last_peered":"2023-10-08T17:41:41.456563+0000","last_clean":"2023-10-08T17:41:41.456563+0000","last_became_active":"2023-10-08T17:41:41.452481+0000","last_became_peered":"2023-10-08T17:41:41.452481+0000","last_unstale":"2023-10-08T17:41:41.456563+0000","last_undegraded":"2023-10-08T17:41:41.456563+0000","last_fullsized":"2023-10-08T17:41:41.456563+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:20.314970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453310+0000","last_change":"2023-10-08T17:41:41.446436+0000","last_active":"2023-10-08T17:41:41.453310+0000","last_peered":"2023-10-08T17:41:41.453310+0000","last_clean":"2023-10-08T17:41:41.453310+0000","last_became_active":"2023-10-08T17:41:41.446159+0000","last_became_peered":"2023-10-08T17:41:41.446159+0000","last_unstale":"2023-10-08T17:41:41.453310+0000","last_undegraded":"2023-10-08T17:41:41.453310+0000","last_fullsized":"2023-10-08T17:41:41.453310+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:44:20.532691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448567+0000","last_change":"2023-10-08T17:41:41.445064+0000","last_active":"2023-10-08T17:41:41.448567+0000","last_peered":"2023-10-08T17:41:41.448567+0000","last_clean":"2023-10-08T17:41:41.448567+0000","last_became_active":"2023-10-08T17:41:41.444823+0000","last_became_peered":"2023-10-08T17:41:41.444823+0000","last_unstale":"2023-10-08T17:41:41.448567+0000","last_undegraded":"2023-10-08T17:41:41.448567+0000","last_fullsized":"2023-10-08T17:41:41.448567+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:56.109420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449562+0000","last_change":"2023-10-08T17:41:41.444984+0000","last_active":"2023-10-08T17:41:41.449562+0000","last_peered":"2023-10-08T17:41:41.449562+0000","last_clean":"2023-10-08T17:41:41.449562+0000","last_became_active":"2023-10-08T17:41:41.444723+0000","last_became_peered":"2023-10-08T17:41:41.444723+0000","last_unstale":"2023-10-08T17:41:41.449562+0000","last_undegraded":"2023-10-08T17:41:41.449562+0000","last_fullsized":"2023-10-08T17:41:41.449562+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:37.746976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434315+0000","last_change":"2023-10-08T17:41:41.429129+0000","last_active":"2023-10-08T17:41:41.434315+0000","last_peered":"2023-10-08T17:41:41.434315+0000","last_clean":"2023-10-08T17:41:41.434315+0000","last_became_active":"2023-10-08T17:41:41.428423+0000","last_became_peered":"2023-10-08T17:41:41.428423+0000","last_unstale":"2023-10-08T17:41:41.434315+0000","last_undegraded":"2023-10-08T17:41:41.434315+0000","last_fullsized":"2023-10-08T17:41:41.434315+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:09:57.110404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.442603+0000","last_change":"2023-10-08T17:41:41.439901+0000","last_active":"2023-10-08T17:41:41.442603+0000","last_peered":"2023-10-08T17:41:41.442603+0000","last_clean":"2023-10-08T17:41:41.442603+0000","last_became_active":"2023-10-08T17:41:41.439620+0000","last_became_peered":"2023-10-08T17:41:41.439620+0000","last_unstale":"2023-10-08T17:41:41.442603+0000","last_undegraded":"2023-10-08T17:41:41.442603+0000","last_fullsized":"2023-10-08T17:41:41.442603+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:28:21.671704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454985+0000","last_change":"2023-10-08T17:41:41.454118+0000","last_active":"2023-10-08T17:41:41.454985+0000","last_peered":"2023-10-08T17:41:41.454985+0000","last_clean":"2023-10-08T17:41:41.454985+0000","last_became_active":"2023-10-08T17:41:41.453173+0000","last_became_peered":"2023-10-08T17:41:41.453173+0000","last_unstale":"2023-10-08T17:41:41.454985+0000","last_undegraded":"2023-10-08T17:41:41.454985+0000","last_fullsized":"2023-10-08T17:41:41.454985+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:06.153595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445655+0000","last_change":"2023-10-08T17:41:41.444079+0000","last_active":"2023-10-08T17:41:41.445655+0000","last_peered":"2023-10-08T17:41:41.445655+0000","last_clean":"2023-10-08T17:41:41.445655+0000","last_became_active":"2023-10-08T17:41:41.443686+0000","last_became_peered":"2023-10-08T17:41:41.443686+0000","last_unstale":"2023-10-08T17:41:41.445655+0000","last_undegraded":"2023-10-08T17:41:41.445655+0000","last_fullsized":"2023-10-08T17:41:41.445655+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:55:30.809836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.444398+0000","last_change":"2023-10-08T17:41:41.442148+0000","last_active":"2023-10-08T17:41:41.444398+0000","last_peered":"2023-10-08T17:41:41.444398+0000","last_clean":"2023-10-08T17:41:41.444398+0000","last_became_active":"2023-10-08T17:41:41.441852+0000","last_became_peered":"2023-10-08T17:41:41.441852+0000","last_unstale":"2023-10-08T17:41:41.444398+0000","last_undegraded":"2023-10-08T17:41:41.444398+0000","last_fullsized":"2023-10-08T17:41:41.444398+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.044196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453019+0000","last_change":"2023-10-08T17:41:41.451794+0000","last_active":"2023-10-08T17:41:41.453019+0000","last_peered":"2023-10-08T17:41:41.453019+0000","last_clean":"2023-10-08T17:41:41.453019+0000","last_became_active":"2023-10-08T17:41:41.451287+0000","last_became_peered":"2023-10-08T17:41:41.451287+0000","last_unstale":"2023-10-08T17:41:41.453019+0000","last_undegraded":"2023-10-08T17:41:41.453019+0000","last_fullsized":"2023-10-08T17:41:41.453019+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:31:41.285181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456601+0000","last_change":"2023-10-08T17:41:41.450513+0000","last_active":"2023-10-08T17:41:41.456601+0000","last_peered":"2023-10-08T17:41:41.456601+0000","last_clean":"2023-10-08T17:41:41.456601+0000","last_became_active":"2023-10-08T17:41:41.450208+0000","last_became_peered":"2023-10-08T17:41:41.450208+0000","last_unstale":"2023-10-08T17:41:41.456601+0000","last_undegraded":"2023-10-08T17:41:41.456601+0000","last_fullsized":"2023-10-08T17:41:41.456601+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:32:22.398786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451223+0000","last_change":"2023-10-08T17:41:41.450141+0000","last_active":"2023-10-08T17:41:41.451223+0000","last_peered":"2023-10-08T17:41:41.451223+0000","last_clean":"2023-10-08T17:41:41.451223+0000","last_became_active":"2023-10-08T17:41:41.449882+0000","last_became_peered":"2023-10-08T17:41:41.449882+0000","last_unstale":"2023-10-08T17:41:41.451223+0000","last_undegraded":"2023-10-08T17:41:41.451223+0000","last_fullsized":"2023-10-08T17:41:41.451223+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:31.759196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456395+0000","last_change":"2023-10-08T17:41:41.451919+0000","last_active":"2023-10-08T17:41:41.456395+0000","last_peered":"2023-10-08T17:41:41.456395+0000","last_clean":"2023-10-08T17:41:41.456395+0000","last_became_active":"2023-10-08T17:41:41.451080+0000","last_became_peered":"2023-10-08T17:41:41.451080+0000","last_unstale":"2023-10-08T17:41:41.456395+0000","last_undegraded":"2023-10-08T17:41:41.456395+0000","last_fullsized":"2023-10-08T17:41:41.456395+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:17.689949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452103+0000","last_change":"2023-10-08T17:41:41.450875+0000","last_active":"2023-10-08T17:41:41.452103+0000","last_peered":"2023-10-08T17:41:41.452103+0000","last_clean":"2023-10-08T17:41:41.452103+0000","last_became_active":"2023-10-08T17:41:41.450329+0000","last_became_peered":"2023-10-08T17:41:41.450329+0000","last_unstale":"2023-10-08T17:41:41.452103+0000","last_undegraded":"2023-10-08T17:41:41.452103+0000","last_fullsized":"2023-10-08T17:41:41.452103+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:15.361006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443019+0000","last_change":"2023-10-08T17:41:41.430986+0000","last_active":"2023-10-08T17:41:41.443019+0000","last_peered":"2023-10-08T17:41:41.443019+0000","last_clean":"2023-10-08T17:41:41.443019+0000","last_became_active":"2023-10-08T17:41:41.430715+0000","last_became_peered":"2023-10-08T17:41:41.430715+0000","last_unstale":"2023-10-08T17:41:41.443019+0000","last_undegraded":"2023-10-08T17:41:41.443019+0000","last_fullsized":"2023-10-08T17:41:41.443019+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:54.572745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445256+0000","last_change":"2023-10-08T17:41:41.433351+0000","last_active":"2023-10-08T17:41:41.445256+0000","last_peered":"2023-10-08T17:41:41.445256+0000","last_clean":"2023-10-08T17:41:41.445256+0000","last_became_active":"2023-10-08T17:41:41.433063+0000","last_became_peered":"2023-10-08T17:41:41.433063+0000","last_unstale":"2023-10-08T17:41:41.445256+0000","last_undegraded":"2023-10-08T17:41:41.445256+0000","last_fullsized":"2023-10-08T17:41:41.445256+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:15.247542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443525+0000","last_change":"2023-10-08T17:41:41.441145+0000","last_active":"2023-10-08T17:41:41.443525+0000","last_peered":"2023-10-08T17:41:41.443525+0000","last_clean":"2023-10-08T17:41:41.443525+0000","last_became_active":"2023-10-08T17:41:41.440854+0000","last_became_peered":"2023-10-08T17:41:41.440854+0000","last_unstale":"2023-10-08T17:41:41.443525+0000","last_undegraded":"2023-10-08T17:41:41.443525+0000","last_fullsized":"2023-10-08T17:41:41.443525+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:07:36.835909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455560+0000","last_change":"2023-10-08T17:41:41.449747+0000","last_active":"2023-10-08T17:41:41.455560+0000","last_peered":"2023-10-08T17:41:41.455560+0000","last_clean":"2023-10-08T17:41:41.455560+0000","last_became_active":"2023-10-08T17:41:41.449490+0000","last_became_peered":"2023-10-08T17:41:41.449490+0000","last_unstale":"2023-10-08T17:41:41.455560+0000","last_undegraded":"2023-10-08T17:41:41.455560+0000","last_fullsized":"2023-10-08T17:41:41.455560+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:24:37.725619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"197'4","reported_seq":14,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451348+0000","last_change":"2023-10-08T17:41:40.432619+0000","last_active":"2023-10-08T17:41:41.451348+0000","last_peered":"2023-10-08T17:41:41.451348+0000","last_clean":"2023-10-08T17:41:41.451348+0000","last_became_active":"2023-10-08T17:41:40.432317+0000","last_became_peered":"2023-10-08T17:41:40.432317+0000","last_unstale":"2023-10-08T17:41:41.451348+0000","last_undegraded":"2023-10-08T17:41:41.451348+0000","last_fullsized":"2023-10-08T17:41:41.451348+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:51.832729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448793+0000","last_change":"2023-10-08T17:41:41.445859+0000","last_active":"2023-10-08T17:41:41.448793+0000","last_peered":"2023-10-08T17:41:41.448793+0000","last_clean":"2023-10-08T17:41:41.448793+0000","last_became_active":"2023-10-08T17:41:41.445568+0000","last_became_peered":"2023-10-08T17:41:41.445568+0000","last_unstale":"2023-10-08T17:41:41.448793+0000","last_undegraded":"2023-10-08T17:41:41.448793+0000","last_fullsized":"2023-10-08T17:41:41.448793+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:36:12.119877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.446071+0000","last_change":"2023-10-08T17:41:40.440825+0000","last_active":"2023-10-08T17:41:41.446071+0000","last_peered":"2023-10-08T17:41:41.446071+0000","last_clean":"2023-10-08T17:41:41.446071+0000","last_became_active":"2023-10-08T17:41:40.440561+0000","last_became_peered":"2023-10-08T17:41:40.440561+0000","last_unstale":"2023-10-08T17:41:41.446071+0000","last_undegraded":"2023-10-08T17:41:41.446071+0000","last_fullsized":"2023-10-08T17:41:41.446071+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:43:20.101941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454627+0000","last_change":"2023-10-08T17:41:41.451848+0000","last_active":"2023-10-08T17:41:41.454627+0000","last_peered":"2023-10-08T17:41:41.454627+0000","last_clean":"2023-10-08T17:41:41.454627+0000","last_became_active":"2023-10-08T17:41:41.451555+0000","last_became_peered":"2023-10-08T17:41:41.451555+0000","last_unstale":"2023-10-08T17:41:41.454627+0000","last_undegraded":"2023-10-08T17:41:41.454627+0000","last_fullsized":"2023-10-08T17:41:41.454627+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:26:38.569604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457564+0000","last_change":"2023-10-08T17:41:40.443482+0000","last_active":"2023-10-08T17:41:41.457564+0000","last_peered":"2023-10-08T17:41:41.457564+0000","last_clean":"2023-10-08T17:41:41.457564+0000","last_became_active":"2023-10-08T17:41:40.443136+0000","last_became_peered":"2023-10-08T17:41:40.443136+0000","last_unstale":"2023-10-08T17:41:41.457564+0000","last_undegraded":"2023-10-08T17:41:41.457564+0000","last_fullsized":"2023-10-08T17:41:41.457564+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:01:14.354030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.440991+0000","last_change":"2023-10-08T17:41:41.439561+0000","last_active":"2023-10-08T17:41:41.440991+0000","last_peered":"2023-10-08T17:41:41.440991+0000","last_clean":"2023-10-08T17:41:41.440991+0000","last_became_active":"2023-10-08T17:41:41.439283+0000","last_became_peered":"2023-10-08T17:41:41.439283+0000","last_unstale":"2023-10-08T17:41:41.440991+0000","last_undegraded":"2023-10-08T17:41:41.440991+0000","last_fullsized":"2023-10-08T17:41:41.440991+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:17:44.597044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457265+0000","last_change":"2023-10-08T17:41:40.436768+0000","last_active":"2023-10-08T17:41:41.457265+0000","last_peered":"2023-10-08T17:41:41.457265+0000","last_clean":"2023-10-08T17:41:41.457265+0000","last_became_active":"2023-10-08T17:41:40.436519+0000","last_became_peered":"2023-10-08T17:41:40.436519+0000","last_unstale":"2023-10-08T17:41:41.457265+0000","last_undegraded":"2023-10-08T17:41:41.457265+0000","last_fullsized":"2023-10-08T17:41:41.457265+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:48:30.752220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452146+0000","last_change":"2023-10-08T17:41:41.440098+0000","last_active":"2023-10-08T17:41:41.452146+0000","last_peered":"2023-10-08T17:41:41.452146+0000","last_clean":"2023-10-08T17:41:41.452146+0000","last_became_active":"2023-10-08T17:41:41.439851+0000","last_became_peered":"2023-10-08T17:41:41.439851+0000","last_unstale":"2023-10-08T17:41:41.452146+0000","last_undegraded":"2023-10-08T17:41:41.452146+0000","last_fullsized":"2023-10-08T17:41:41.452146+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:46:40.390044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455323+0000","last_change":"2023-10-08T17:41:40.438148+0000","last_active":"2023-10-08T17:41:41.455323+0000","last_peered":"2023-10-08T17:41:41.455323+0000","last_clean":"2023-10-08T17:41:41.455323+0000","last_became_active":"2023-10-08T17:41:40.437771+0000","last_became_peered":"2023-10-08T17:41:40.437771+0000","last_unstale":"2023-10-08T17:41:41.455323+0000","last_undegraded":"2023-10-08T17:41:41.455323+0000","last_fullsized":"2023-10-08T17:41:41.455323+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:50:20.713702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456832+0000","last_change":"2023-10-08T17:41:41.452832+0000","last_active":"2023-10-08T17:41:41.456832+0000","last_peered":"2023-10-08T17:41:41.456832+0000","last_clean":"2023-10-08T17:41:41.456832+0000","last_became_active":"2023-10-08T17:41:41.452586+0000","last_became_peered":"2023-10-08T17:41:41.452586+0000","last_unstale":"2023-10-08T17:41:41.456832+0000","last_undegraded":"2023-10-08T17:41:41.456832+0000","last_fullsized":"2023-10-08T17:41:41.456832+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:57:08.558658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455838+0000","last_change":"2023-10-08T17:41:40.440621+0000","last_active":"2023-10-08T17:41:41.455838+0000","last_peered":"2023-10-08T17:41:41.455838+0000","last_clean":"2023-10-08T17:41:41.455838+0000","last_became_active":"2023-10-08T17:41:40.439887+0000","last_became_peered":"2023-10-08T17:41:40.439887+0000","last_unstale":"2023-10-08T17:41:41.455838+0000","last_undegraded":"2023-10-08T17:41:41.455838+0000","last_fullsized":"2023-10-08T17:41:41.455838+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:07:26.533591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.459392+0000","last_change":"2023-10-08T17:41:41.457277+0000","last_active":"2023-10-08T17:41:41.459392+0000","last_peered":"2023-10-08T17:41:41.459392+0000","last_clean":"2023-10-08T17:41:41.459392+0000","last_became_active":"2023-10-08T17:41:41.456995+0000","last_became_peered":"2023-10-08T17:41:41.456995+0000","last_unstale":"2023-10-08T17:41:41.459392+0000","last_undegraded":"2023-10-08T17:41:41.459392+0000","last_fullsized":"2023-10-08T17:41:41.459392+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:19:34.487101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.437138+0000","last_change":"2023-10-08T17:41:40.444470+0000","last_active":"2023-10-08T17:41:41.437138+0000","last_peered":"2023-10-08T17:41:41.437138+0000","last_clean":"2023-10-08T17:41:41.437138+0000","last_became_active":"2023-10-08T17:41:40.444177+0000","last_became_peered":"2023-10-08T17:41:40.444177+0000","last_unstale":"2023-10-08T17:41:41.437138+0000","last_undegraded":"2023-10-08T17:41:41.437138+0000","last_fullsized":"2023-10-08T17:41:41.437138+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:33:28.910424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445100+0000","last_change":"2023-10-08T17:41:41.440630+0000","last_active":"2023-10-08T17:41:41.445100+0000","last_peered":"2023-10-08T17:41:41.445100+0000","last_clean":"2023-10-08T17:41:41.445100+0000","last_became_active":"2023-10-08T17:41:41.440363+0000","last_became_peered":"2023-10-08T17:41:41.440363+0000","last_unstale":"2023-10-08T17:41:41.445100+0000","last_undegraded":"2023-10-08T17:41:41.445100+0000","last_fullsized":"2023-10-08T17:41:41.445100+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:46:17.689949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.427112+0000","last_change":"2023-10-08T17:41:40.432724+0000","last_active":"2023-10-08T17:41:41.427112+0000","last_peered":"2023-10-08T17:41:41.427112+0000","last_clean":"2023-10-08T17:41:41.427112+0000","last_became_active":"2023-10-08T17:41:40.432458+0000","last_became_peered":"2023-10-08T17:41:40.432458+0000","last_unstale":"2023-10-08T17:41:41.427112+0000","last_undegraded":"2023-10-08T17:41:41.427112+0000","last_fullsized":"2023-10-08T17:41:41.427112+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:27.032554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450565+0000","last_change":"2023-10-08T17:41:41.447524+0000","last_active":"2023-10-08T17:41:41.450565+0000","last_peered":"2023-10-08T17:41:41.450565+0000","last_clean":"2023-10-08T17:41:41.450565+0000","last_became_active":"2023-10-08T17:41:41.446594+0000","last_became_peered":"2023-10-08T17:41:41.446594+0000","last_unstale":"2023-10-08T17:41:41.450565+0000","last_undegraded":"2023-10-08T17:41:41.450565+0000","last_fullsized":"2023-10-08T17:41:41.450565+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:04:03.486409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.425811+0000","last_change":"2023-10-08T17:41:40.430709+0000","last_active":"2023-10-08T17:41:41.425811+0000","last_peered":"2023-10-08T17:41:41.425811+0000","last_clean":"2023-10-08T17:41:41.425811+0000","last_became_active":"2023-10-08T17:41:40.430419+0000","last_became_peered":"2023-10-08T17:41:40.430419+0000","last_unstale":"2023-10-08T17:41:41.425811+0000","last_undegraded":"2023-10-08T17:41:41.425811+0000","last_fullsized":"2023-10-08T17:41:41.425811+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:45:27.406843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455233+0000","last_change":"2023-10-08T17:41:41.453111+0000","last_active":"2023-10-08T17:41:41.455233+0000","last_peered":"2023-10-08T17:41:41.455233+0000","last_clean":"2023-10-08T17:41:41.455233+0000","last_became_active":"2023-10-08T17:41:41.452868+0000","last_became_peered":"2023-10-08T17:41:41.452868+0000","last_unstale":"2023-10-08T17:41:41.455233+0000","last_undegraded":"2023-10-08T17:41:41.455233+0000","last_fullsized":"2023-10-08T17:41:41.455233+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:45:05.711241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"197'3","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453686+0000","last_change":"2023-10-08T17:41:40.439646+0000","last_active":"2023-10-08T17:41:41.453686+0000","last_peered":"2023-10-08T17:41:41.453686+0000","last_clean":"2023-10-08T17:41:41.453686+0000","last_became_active":"2023-10-08T17:41:40.439402+0000","last_became_peered":"2023-10-08T17:41:40.439402+0000","last_unstale":"2023-10-08T17:41:41.453686+0000","last_undegraded":"2023-10-08T17:41:41.453686+0000","last_fullsized":"2023-10-08T17:41:41.453686+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:01.186045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443025+0000","last_change":"2023-10-08T17:41:41.433214+0000","last_active":"2023-10-08T17:41:41.443025+0000","last_peered":"2023-10-08T17:41:41.443025+0000","last_clean":"2023-10-08T17:41:41.443025+0000","last_became_active":"2023-10-08T17:41:41.432915+0000","last_became_peered":"2023-10-08T17:41:41.432915+0000","last_unstale":"2023-10-08T17:41:41.443025+0000","last_undegraded":"2023-10-08T17:41:41.443025+0000","last_fullsized":"2023-10-08T17:41:41.443025+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:34:06.153595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"197'6","reported_seq":16,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.459448+0000","last_change":"2023-10-08T17:41:40.430366+0000","last_active":"2023-10-08T17:41:41.459448+0000","last_peered":"2023-10-08T17:41:41.459448+0000","last_clean":"2023-10-08T17:41:41.459448+0000","last_became_active":"2023-10-08T17:41:40.429895+0000","last_became_peered":"2023-10-08T17:41:40.429895+0000","last_unstale":"2023-10-08T17:41:41.459448+0000","last_undegraded":"2023-10-08T17:41:41.459448+0000","last_fullsized":"2023-10-08T17:41:41.459448+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:58:56.957095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.448190+0000","last_change":"2023-10-08T17:41:41.444447+0000","last_active":"2023-10-08T17:41:41.448190+0000","last_peered":"2023-10-08T17:41:41.448190+0000","last_clean":"2023-10-08T17:41:41.448190+0000","last_became_active":"2023-10-08T17:41:41.444188+0000","last_became_peered":"2023-10-08T17:41:41.444188+0000","last_unstale":"2023-10-08T17:41:41.448190+0000","last_undegraded":"2023-10-08T17:41:41.448190+0000","last_fullsized":"2023-10-08T17:41:41.448190+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:40.806654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455385+0000","last_change":"2023-10-08T17:41:40.441732+0000","last_active":"2023-10-08T17:41:41.455385+0000","last_peered":"2023-10-08T17:41:41.455385+0000","last_clean":"2023-10-08T17:41:41.455385+0000","last_became_active":"2023-10-08T17:41:40.441407+0000","last_became_peered":"2023-10-08T17:41:40.441407+0000","last_unstale":"2023-10-08T17:41:41.455385+0000","last_undegraded":"2023-10-08T17:41:41.455385+0000","last_fullsized":"2023-10-08T17:41:41.455385+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:25:02.940123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450012+0000","last_change":"2023-10-08T17:41:41.438971+0000","last_active":"2023-10-08T17:41:41.450012+0000","last_peered":"2023-10-08T17:41:41.450012+0000","last_clean":"2023-10-08T17:41:41.450012+0000","last_became_active":"2023-10-08T17:41:41.437988+0000","last_became_peered":"2023-10-08T17:41:41.437988+0000","last_unstale":"2023-10-08T17:41:41.450012+0000","last_undegraded":"2023-10-08T17:41:41.450012+0000","last_fullsized":"2023-10-08T17:41:41.450012+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:40:32.892807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.433016+0000","last_change":"2023-10-08T17:41:40.429327+0000","last_active":"2023-10-08T17:41:41.433016+0000","last_peered":"2023-10-08T17:41:41.433016+0000","last_clean":"2023-10-08T17:41:41.433016+0000","last_became_active":"2023-10-08T17:41:40.429053+0000","last_became_peered":"2023-10-08T17:41:40.429053+0000","last_unstale":"2023-10-08T17:41:41.433016+0000","last_undegraded":"2023-10-08T17:41:41.433016+0000","last_fullsized":"2023-10-08T17:41:41.433016+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:28:34.273130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.449616+0000","last_change":"2023-10-08T17:41:41.440200+0000","last_active":"2023-10-08T17:41:41.449616+0000","last_peered":"2023-10-08T17:41:41.449616+0000","last_clean":"2023-10-08T17:41:41.449616+0000","last_became_active":"2023-10-08T17:41:41.439940+0000","last_became_peered":"2023-10-08T17:41:41.439940+0000","last_unstale":"2023-10-08T17:41:41.449616+0000","last_undegraded":"2023-10-08T17:41:41.449616+0000","last_fullsized":"2023-10-08T17:41:41.449616+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:38:28.571737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.435332+0000","last_change":"2023-10-08T17:41:40.442516+0000","last_active":"2023-10-08T17:41:41.435332+0000","last_peered":"2023-10-08T17:41:41.435332+0000","last_clean":"2023-10-08T17:41:41.435332+0000","last_became_active":"2023-10-08T17:41:40.442273+0000","last_became_peered":"2023-10-08T17:41:40.442273+0000","last_unstale":"2023-10-08T17:41:41.435332+0000","last_undegraded":"2023-10-08T17:41:41.435332+0000","last_fullsized":"2023-10-08T17:41:41.435332+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:43:16.078996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.438590+0000","last_change":"2023-10-08T17:41:41.435398+0000","last_active":"2023-10-08T17:41:41.438590+0000","last_peered":"2023-10-08T17:41:41.438590+0000","last_clean":"2023-10-08T17:41:41.438590+0000","last_became_active":"2023-10-08T17:41:41.434325+0000","last_became_peered":"2023-10-08T17:41:41.434325+0000","last_unstale":"2023-10-08T17:41:41.438590+0000","last_undegraded":"2023-10-08T17:41:41.438590+0000","last_fullsized":"2023-10-08T17:41:41.438590+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:48:58.865832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"197'8","reported_seq":18,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456306+0000","last_change":"2023-10-08T17:41:40.429976+0000","last_active":"2023-10-08T17:41:41.456306+0000","last_peered":"2023-10-08T17:41:41.456306+0000","last_clean":"2023-10-08T17:41:41.456306+0000","last_became_active":"2023-10-08T17:41:40.429724+0000","last_became_peered":"2023-10-08T17:41:40.429724+0000","last_unstale":"2023-10-08T17:41:41.456306+0000","last_undegraded":"2023-10-08T17:41:41.456306+0000","last_fullsized":"2023-10-08T17:41:41.456306+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:47:00.543738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.454464+0000","last_change":"2023-10-08T17:41:41.446246+0000","last_active":"2023-10-08T17:41:41.454464+0000","last_peered":"2023-10-08T17:41:41.454464+0000","last_clean":"2023-10-08T17:41:41.454464+0000","last_became_active":"2023-10-08T17:41:41.445684+0000","last_became_peered":"2023-10-08T17:41:41.445684+0000","last_unstale":"2023-10-08T17:41:41.454464+0000","last_undegraded":"2023-10-08T17:41:41.454464+0000","last_fullsized":"2023-10-08T17:41:41.454464+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:51:09.925208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453273+0000","last_change":"2023-10-08T17:41:40.439873+0000","last_active":"2023-10-08T17:41:41.453273+0000","last_peered":"2023-10-08T17:41:41.453273+0000","last_clean":"2023-10-08T17:41:41.453273+0000","last_became_active":"2023-10-08T17:41:40.439609+0000","last_became_peered":"2023-10-08T17:41:40.439609+0000","last_unstale":"2023-10-08T17:41:41.453273+0000","last_undegraded":"2023-10-08T17:41:41.453273+0000","last_fullsized":"2023-10-08T17:41:41.453273+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:21.994916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451369+0000","last_change":"2023-10-08T17:41:41.447688+0000","last_active":"2023-10-08T17:41:41.451369+0000","last_peered":"2023-10-08T17:41:41.451369+0000","last_clean":"2023-10-08T17:41:41.451369+0000","last_became_active":"2023-10-08T17:41:41.446964+0000","last_became_peered":"2023-10-08T17:41:41.446964+0000","last_unstale":"2023-10-08T17:41:41.451369+0000","last_undegraded":"2023-10-08T17:41:41.451369+0000","last_fullsized":"2023-10-08T17:41:41.451369+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:48:39.939721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.453198+0000","last_change":"2023-10-08T17:41:40.433549+0000","last_active":"2023-10-08T17:41:41.453198+0000","last_peered":"2023-10-08T17:41:41.453198+0000","last_clean":"2023-10-08T17:41:41.453198+0000","last_became_active":"2023-10-08T17:41:40.433246+0000","last_became_peered":"2023-10-08T17:41:40.433246+0000","last_unstale":"2023-10-08T17:41:41.453198+0000","last_undegraded":"2023-10-08T17:41:41.453198+0000","last_fullsized":"2023-10-08T17:41:41.453198+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:41:57.390778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456374+0000","last_change":"2023-10-08T17:41:41.451747+0000","last_active":"2023-10-08T17:41:41.456374+0000","last_peered":"2023-10-08T17:41:41.456374+0000","last_clean":"2023-10-08T17:41:41.456374+0000","last_became_active":"2023-10-08T17:41:41.450801+0000","last_became_peered":"2023-10-08T17:41:41.450801+0000","last_unstale":"2023-10-08T17:41:41.456374+0000","last_undegraded":"2023-10-08T17:41:41.456374+0000","last_fullsized":"2023-10-08T17:41:41.456374+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:50:19.736583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"197'1","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450783+0000","last_change":"2023-10-08T17:41:40.437939+0000","last_active":"2023-10-08T17:41:41.450783+0000","last_peered":"2023-10-08T17:41:41.450783+0000","last_clean":"2023-10-08T17:41:41.450783+0000","last_became_active":"2023-10-08T17:41:40.437643+0000","last_became_peered":"2023-10-08T17:41:40.437643+0000","last_unstale":"2023-10-08T17:41:41.450783+0000","last_undegraded":"2023-10-08T17:41:41.450783+0000","last_fullsized":"2023-10-08T17:41:41.450783+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:33.727647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455578+0000","last_change":"2023-10-08T17:41:41.449237+0000","last_active":"2023-10-08T17:41:41.455578+0000","last_peered":"2023-10-08T17:41:41.455578+0000","last_clean":"2023-10-08T17:41:41.455578+0000","last_became_active":"2023-10-08T17:41:41.448972+0000","last_became_peered":"2023-10-08T17:41:41.448972+0000","last_unstale":"2023-10-08T17:41:41.455578+0000","last_undegraded":"2023-10-08T17:41:41.455578+0000","last_fullsized":"2023-10-08T17:41:41.455578+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:54:11.579401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422949+0000","last_change":"2023-10-08T17:41:40.440104+0000","last_active":"2023-10-08T17:41:41.422949+0000","last_peered":"2023-10-08T17:41:41.422949+0000","last_clean":"2023-10-08T17:41:41.422949+0000","last_became_active":"2023-10-08T17:41:40.439845+0000","last_became_peered":"2023-10-08T17:41:40.439845+0000","last_unstale":"2023-10-08T17:41:41.422949+0000","last_undegraded":"2023-10-08T17:41:41.422949+0000","last_fullsized":"2023-10-08T17:41:41.422949+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:30:19.307994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.443031+0000","last_change":"2023-10-08T17:41:41.440884+0000","last_active":"2023-10-08T17:41:41.443031+0000","last_peered":"2023-10-08T17:41:41.443031+0000","last_clean":"2023-10-08T17:41:41.443031+0000","last_became_active":"2023-10-08T17:41:41.440627+0000","last_became_peered":"2023-10-08T17:41:41.440627+0000","last_unstale":"2023-10-08T17:41:41.443031+0000","last_undegraded":"2023-10-08T17:41:41.443031+0000","last_fullsized":"2023-10-08T17:41:41.443031+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:09.231606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.457830+0000","last_change":"2023-10-08T17:41:40.441870+0000","last_active":"2023-10-08T17:41:41.457830+0000","last_peered":"2023-10-08T17:41:41.457830+0000","last_clean":"2023-10-08T17:41:41.457830+0000","last_became_active":"2023-10-08T17:41:40.441186+0000","last_became_peered":"2023-10-08T17:41:40.441186+0000","last_unstale":"2023-10-08T17:41:41.457830+0000","last_undegraded":"2023-10-08T17:41:41.457830+0000","last_fullsized":"2023-10-08T17:41:41.457830+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:51:30.595961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455646+0000","last_change":"2023-10-08T17:41:41.449918+0000","last_active":"2023-10-08T17:41:41.455646+0000","last_peered":"2023-10-08T17:41:41.455646+0000","last_clean":"2023-10-08T17:41:41.455646+0000","last_became_active":"2023-10-08T17:41:41.449064+0000","last_became_peered":"2023-10-08T17:41:41.449064+0000","last_unstale":"2023-10-08T17:41:41.455646+0000","last_undegraded":"2023-10-08T17:41:41.455646+0000","last_fullsized":"2023-10-08T17:41:41.455646+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:54.613333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422580+0000","last_change":"2023-10-08T17:41:40.441792+0000","last_active":"2023-10-08T17:41:41.422580+0000","last_peered":"2023-10-08T17:41:41.422580+0000","last_clean":"2023-10-08T17:41:41.422580+0000","last_became_active":"2023-10-08T17:41:40.441220+0000","last_became_peered":"2023-10-08T17:41:40.441220+0000","last_unstale":"2023-10-08T17:41:41.422580+0000","last_undegraded":"2023-10-08T17:41:41.422580+0000","last_fullsized":"2023-10-08T17:41:41.422580+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:53.606357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.451482+0000","last_change":"2023-10-08T17:41:41.439259+0000","last_active":"2023-10-08T17:41:41.451482+0000","last_peered":"2023-10-08T17:41:41.451482+0000","last_clean":"2023-10-08T17:41:41.451482+0000","last_became_active":"2023-10-08T17:41:41.438969+0000","last_became_peered":"2023-10-08T17:41:41.438969+0000","last_unstale":"2023-10-08T17:41:41.451482+0000","last_undegraded":"2023-10-08T17:41:41.451482+0000","last_fullsized":"2023-10-08T17:41:41.451482+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:34:03.096302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.435442+0000","last_change":"2023-10-08T17:41:40.435508+0000","last_active":"2023-10-08T17:41:41.435442+0000","last_peered":"2023-10-08T17:41:41.435442+0000","last_clean":"2023-10-08T17:41:41.435442+0000","last_became_active":"2023-10-08T17:41:40.435256+0000","last_became_peered":"2023-10-08T17:41:40.435256+0000","last_unstale":"2023-10-08T17:41:41.435442+0000","last_undegraded":"2023-10-08T17:41:41.435442+0000","last_fullsized":"2023-10-08T17:41:41.435442+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:05:46.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445635+0000","last_change":"2023-10-08T17:41:41.443915+0000","last_active":"2023-10-08T17:41:41.445635+0000","last_peered":"2023-10-08T17:41:41.445635+0000","last_clean":"2023-10-08T17:41:41.445635+0000","last_became_active":"2023-10-08T17:41:41.443351+0000","last_became_peered":"2023-10-08T17:41:41.443351+0000","last_unstale":"2023-10-08T17:41:41.445635+0000","last_undegraded":"2023-10-08T17:41:41.445635+0000","last_fullsized":"2023-10-08T17:41:41.445635+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:43:15.069894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422606+0000","last_change":"2023-10-08T17:41:40.437937+0000","last_active":"2023-10-08T17:41:41.422606+0000","last_peered":"2023-10-08T17:41:41.422606+0000","last_clean":"2023-10-08T17:41:41.422606+0000","last_became_active":"2023-10-08T17:41:40.437630+0000","last_became_peered":"2023-10-08T17:41:40.437630+0000","last_unstale":"2023-10-08T17:41:41.422606+0000","last_undegraded":"2023-10-08T17:41:41.422606+0000","last_fullsized":"2023-10-08T17:41:41.422606+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:32:48.984653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450654+0000","last_change":"2023-10-08T17:41:41.447179+0000","last_active":"2023-10-08T17:41:41.450654+0000","last_peered":"2023-10-08T17:41:41.450654+0000","last_clean":"2023-10-08T17:41:41.450654+0000","last_became_active":"2023-10-08T17:41:41.446882+0000","last_became_peered":"2023-10-08T17:41:41.446882+0000","last_unstale":"2023-10-08T17:41:41.450654+0000","last_undegraded":"2023-10-08T17:41:41.450654+0000","last_fullsized":"2023-10-08T17:41:41.450654+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:50:37.888381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"197'2","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.450508+0000","last_change":"2023-10-08T17:41:40.440770+0000","last_active":"2023-10-08T17:41:41.450508+0000","last_peered":"2023-10-08T17:41:41.450508+0000","last_clean":"2023-10-08T17:41:41.450508+0000","last_became_active":"2023-10-08T17:41:40.440475+0000","last_became_peered":"2023-10-08T17:41:40.440475+0000","last_unstale":"2023-10-08T17:41:41.450508+0000","last_undegraded":"2023-10-08T17:41:41.450508+0000","last_fullsized":"2023-10-08T17:41:41.450508+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:01:03.719259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452009+0000","last_change":"2023-10-08T17:41:41.443226+0000","last_active":"2023-10-08T17:41:41.452009+0000","last_peered":"2023-10-08T17:41:41.452009+0000","last_clean":"2023-10-08T17:41:41.452009+0000","last_became_active":"2023-10-08T17:41:41.442450+0000","last_became_peered":"2023-10-08T17:41:41.442450+0000","last_unstale":"2023-10-08T17:41:41.452009+0000","last_undegraded":"2023-10-08T17:41:41.452009+0000","last_fullsized":"2023-10-08T17:41:41.452009+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:49:47.855498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.429862+0000","last_change":"2023-10-08T17:41:40.436315+0000","last_active":"2023-10-08T17:41:41.429862+0000","last_peered":"2023-10-08T17:41:41.429862+0000","last_clean":"2023-10-08T17:41:41.429862+0000","last_became_active":"2023-10-08T17:41:40.436042+0000","last_became_peered":"2023-10-08T17:41:40.436042+0000","last_unstale":"2023-10-08T17:41:41.429862+0000","last_undegraded":"2023-10-08T17:41:41.429862+0000","last_fullsized":"2023-10-08T17:41:41.429862+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:47:25.068063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.456276+0000","last_change":"2023-10-08T17:41:41.452757+0000","last_active":"2023-10-08T17:41:41.456276+0000","last_peered":"2023-10-08T17:41:41.456276+0000","last_clean":"2023-10-08T17:41:41.456276+0000","last_became_active":"2023-10-08T17:41:41.452479+0000","last_became_peered":"2023-10-08T17:41:41.452479+0000","last_unstale":"2023-10-08T17:41:41.456276+0000","last_undegraded":"2023-10-08T17:41:41.456276+0000","last_fullsized":"2023-10-08T17:41:41.456276+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:11:36.706872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.440187+0000","last_change":"2023-10-08T17:41:40.443934+0000","last_active":"2023-10-08T17:41:41.440187+0000","last_peered":"2023-10-08T17:41:41.440187+0000","last_clean":"2023-10-08T17:41:41.440187+0000","last_became_active":"2023-10-08T17:41:40.443395+0000","last_became_peered":"2023-10-08T17:41:40.443395+0000","last_unstale":"2023-10-08T17:41:41.440187+0000","last_undegraded":"2023-10-08T17:41:41.440187+0000","last_fullsized":"2023-10-08T17:41:41.440187+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:11:35.699896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.455258+0000","last_change":"2023-10-08T17:41:41.453877+0000","last_active":"2023-10-08T17:41:41.455258+0000","last_peered":"2023-10-08T17:41:41.455258+0000","last_clean":"2023-10-08T17:41:41.455258+0000","last_became_active":"2023-10-08T17:41:41.453622+0000","last_became_peered":"2023-10-08T17:41:41.453622+0000","last_unstale":"2023-10-08T17:41:41.455258+0000","last_undegraded":"2023-10-08T17:41:41.455258+0000","last_fullsized":"2023-10-08T17:41:41.455258+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:55:56.042291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434318+0000","last_change":"2023-10-08T17:41:40.431629+0000","last_active":"2023-10-08T17:41:41.434318+0000","last_peered":"2023-10-08T17:41:41.434318+0000","last_clean":"2023-10-08T17:41:41.434318+0000","last_became_active":"2023-10-08T17:41:40.431384+0000","last_became_peered":"2023-10-08T17:41:40.431384+0000","last_unstale":"2023-10-08T17:41:41.434318+0000","last_undegraded":"2023-10-08T17:41:41.434318+0000","last_fullsized":"2023-10-08T17:41:41.434318+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:29:01.447009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.439628+0000","last_change":"2023-10-08T17:41:41.438096+0000","last_active":"2023-10-08T17:41:41.439628+0000","last_peered":"2023-10-08T17:41:41.439628+0000","last_clean":"2023-10-08T17:41:41.439628+0000","last_became_active":"2023-10-08T17:41:41.437837+0000","last_became_peered":"2023-10-08T17:41:41.437837+0000","last_unstale":"2023-10-08T17:41:41.439628+0000","last_undegraded":"2023-10-08T17:41:41.439628+0000","last_fullsized":"2023-10-08T17:41:41.439628+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:49:27.511417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.426805+0000","last_change":"2023-10-08T17:41:40.431607+0000","last_active":"2023-10-08T17:41:41.426805+0000","last_peered":"2023-10-08T17:41:41.426805+0000","last_clean":"2023-10-08T17:41:41.426805+0000","last_became_active":"2023-10-08T17:41:40.431322+0000","last_became_peered":"2023-10-08T17:41:40.431322+0000","last_unstale":"2023-10-08T17:41:41.426805+0000","last_undegraded":"2023-10-08T17:41:41.426805+0000","last_fullsized":"2023-10-08T17:41:41.426805+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:31:10.649501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.445724+0000","last_change":"2023-10-08T17:41:41.441982+0000","last_active":"2023-10-08T17:41:41.445724+0000","last_peered":"2023-10-08T17:41:41.445724+0000","last_clean":"2023-10-08T17:41:41.445724+0000","last_became_active":"2023-10-08T17:41:41.441697+0000","last_became_peered":"2023-10-08T17:41:41.441697+0000","last_unstale":"2023-10-08T17:41:41.445724+0000","last_undegraded":"2023-10-08T17:41:41.445724+0000","last_fullsized":"2023-10-08T17:41:41.445724+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:58:18.044196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.434898+0000","last_change":"2023-10-08T17:41:40.438734+0000","last_active":"2023-10-08T17:41:41.434898+0000","last_peered":"2023-10-08T17:41:41.434898+0000","last_clean":"2023-10-08T17:41:41.434898+0000","last_became_active":"2023-10-08T17:41:40.438477+0000","last_became_peered":"2023-10-08T17:41:40.438477+0000","last_unstale":"2023-10-08T17:41:41.434898+0000","last_undegraded":"2023-10-08T17:41:41.434898+0000","last_fullsized":"2023-10-08T17:41:41.434898+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:22:08.224630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.439355+0000","last_change":"2023-10-08T17:41:41.432856+0000","last_active":"2023-10-08T17:41:41.439355+0000","last_peered":"2023-10-08T17:41:41.439355+0000","last_clean":"2023-10-08T17:41:41.439355+0000","last_became_active":"2023-10-08T17:41:41.432543+0000","last_became_peered":"2023-10-08T17:41:41.432543+0000","last_unstale":"2023-10-08T17:41:41.439355+0000","last_undegraded":"2023-10-08T17:41:41.439355+0000","last_fullsized":"2023-10-08T17:41:41.439355+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:40:52.839705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.437259+0000","last_change":"2023-10-08T17:41:40.443676+0000","last_active":"2023-10-08T17:41:41.437259+0000","last_peered":"2023-10-08T17:41:41.437259+0000","last_clean":"2023-10-08T17:41:41.437259+0000","last_became_active":"2023-10-08T17:41:40.443321+0000","last_became_peered":"2023-10-08T17:41:40.443321+0000","last_unstale":"2023-10-08T17:41:41.437259+0000","last_undegraded":"2023-10-08T17:41:41.437259+0000","last_fullsized":"2023-10-08T17:41:41.437259+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:19:36.740000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.438611+0000","last_change":"2023-10-08T17:41:41.435613+0000","last_active":"2023-10-08T17:41:41.438611+0000","last_peered":"2023-10-08T17:41:41.438611+0000","last_clean":"2023-10-08T17:41:41.438611+0000","last_became_active":"2023-10-08T17:41:41.435344+0000","last_became_peered":"2023-10-08T17:41:41.435344+0000","last_unstale":"2023-10-08T17:41:41.438611+0000","last_undegraded":"2023-10-08T17:41:41.438611+0000","last_fullsized":"2023-10-08T17:41:41.438611+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:23:44.393155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.425849+0000","last_change":"2023-10-08T17:41:40.428335+0000","last_active":"2023-10-08T17:41:41.425849+0000","last_peered":"2023-10-08T17:41:41.425849+0000","last_clean":"2023-10-08T17:41:41.425849+0000","last_became_active":"2023-10-08T17:41:40.427757+0000","last_became_peered":"2023-10-08T17:41:40.427757+0000","last_unstale":"2023-10-08T17:41:41.425849+0000","last_undegraded":"2023-10-08T17:41:41.425849+0000","last_fullsized":"2023-10-08T17:41:41.425849+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:45:23.869166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.452044+0000","last_change":"2023-10-08T17:41:41.451136+0000","last_active":"2023-10-08T17:41:41.452044+0000","last_peered":"2023-10-08T17:41:41.452044+0000","last_clean":"2023-10-08T17:41:41.452044+0000","last_became_active":"2023-10-08T17:41:41.450862+0000","last_became_peered":"2023-10-08T17:41:41.450862+0000","last_unstale":"2023-10-08T17:41:41.452044+0000","last_undegraded":"2023-10-08T17:41:41.452044+0000","last_fullsized":"2023-10-08T17:41:41.452044+0000","mapping_epoch":196,"log_start":"0'0","ondisk_log_start":"0'0","created":196,"last_epoch_clean":197,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:40.411401+0000","last_clean_scrub_stamp":"2023-10-08T17:41:40.411401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:59:59.520810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.426709+0000","last_change":"2023-10-08T17:41:40.433915+0000","last_active":"2023-10-08T17:41:41.426709+0000","last_peered":"2023-10-08T17:41:41.426709+0000","last_clean":"2023-10-08T17:41:41.426709+0000","last_became_active":"2023-10-08T17:41:40.433646+0000","last_became_peered":"2023-10-08T17:41:40.433646+0000","last_unstale":"2023-10-08T17:41:41.426709+0000","last_undegraded":"2023-10-08T17:41:41.426709+0000","last_fullsized":"2023-10-08T17:41:41.426709+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:41:39.404425+0000","last_clean_scrub_stamp":"2023-10-08T17:41:39.404425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:14:34.185200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"187'326","reported_seq":1065,"reported_epoch":197,"state":"active+clean","last_fresh":"2023-10-08T17:41:41.422696+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:41:41.422696+0000","last_peered":"2023-10-08T17:41:41.422696+0000","last_clean":"2023-10-08T17:41:41.422696+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:41:41.422696+0000","last_undegraded":"2023-10-08T17:41:41.422696+0000","last_fullsized":"2023-10-08T17:41:41.422696+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575944,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300308,"kb_used_data":3020,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071532,"statfs":{"total":96636764160,"available":96329248768,"internally_reserved":0,"allocated":3092480,"data_stored":1835480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.439,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90500000000000003,"5min":1.0449999999999999,"15min":1.0569999999999999},"last":0.624},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73899999999999999,"15min":0.748},"min":{"1min":0.46400000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.165},"last":0.72699999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76400000000000001,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.94899999999999995,"5min":1.0209999999999999,"15min":1.1080000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81599999999999995,"15min":0.81499999999999995},"min":{"1min":0.64200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.034,"5min":1.073,"15min":1.1100000000000001},"last":0.59599999999999997}]},{"osd":2,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.52300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93799999999999994,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.75600000000000001,"15min":0.77100000000000002},"min":{"1min":0.55400000000000005,"5min":0.53400000000000003,"15min":0.48299999999999998},"max":{"1min":0.93500000000000005,"5min":0.99199999999999999,"15min":1.1319999999999999},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.754,"15min":0.76100000000000001},"min":{"1min":0.57299999999999995,"5min":0.52500000000000002,"15min":0.49199999999999999},"max":{"1min":0.97199999999999998,"5min":0.97799999999999998,"15min":1.0920000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77800000000000002,"15min":0.78500000000000003},"min":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.46600000000000003},"max":{"1min":0.92600000000000005,"5min":0.96699999999999997,"15min":1.5009999999999999},"last":0.66700000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.64000000000000001,"15min":0.63100000000000001},"min":{"1min":0.435,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92000000000000004,"5min":0.98199999999999998,"15min":1.5720000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.64800000000000002,"15min":0.66700000000000004},"min":{"1min":0.499,"5min":0.443,"15min":0.42399999999999999},"max":{"1min":0.76900000000000002,"5min":0.98399999999999999,"15min":1.597},"last":0.64300000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65000000000000002,"15min":0.67200000000000004},"min":{"1min":0.442,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":1.0229999999999999,"15min":1.7549999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.44400000000000001},"max":{"1min":0.84599999999999997,"5min":1.032,"15min":1.6299999999999999},"last":0.68100000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:40:59 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.59999999999999998,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.98399999999999999,"5min":1.0840000000000001,"15min":1.681},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.502,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91200000000000003,"5min":1.0369999999999999,"15min":1.4570000000000001},"last":0.71199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575945,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299708,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072132,"statfs":{"total":96636764160,"available":96329863168,"internally_reserved":0,"allocated":2478080,"data_stored":1242884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.75900000000000001,"15min":0.752},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.39000000000000001},"max":{"1min":1.012,"5min":1.016,"15min":1.0649999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76200000000000001,"15min":0.76100000000000001},"min":{"1min":0.57099999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.54600000000000004,"5min":0.45700000000000002,"15min":0.41799999999999998},"max":{"1min":0.91600000000000004,"5min":0.95499999999999996,"15min":1.034},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.41999999999999998},"max":{"1min":0.95199999999999996,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.76200000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.59599999999999997,"5min":0.51000000000000001,"15min":0.40100000000000002},"max":{"1min":0.999,"5min":1.0820000000000001,"15min":1.099},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80500000000000005},"min":{"1min":0.60499999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97799999999999998,"5min":1.054,"15min":1.796},"last":0.628}]},{"osd":3,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77700000000000002,"15min":0.77800000000000002},"min":{"1min":0.58999999999999997,"5min":0.50600000000000001,"15min":0.49199999999999999},"max":{"1min":0.97499999999999998,"5min":1.159,"15min":1.159},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80000000000000004,"15min":0.79400000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":1.119,"5min":1.143,"15min":1.143},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68200000000000005},"min":{"1min":0.45900000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":0.88800000000000001,"5min":0.998,"15min":1.1299999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78400000000000003,"15min":0.78600000000000003},"min":{"1min":0.59499999999999997,"5min":0.47999999999999998,"15min":0.41799999999999998},"max":{"1min":0.95799999999999996,"5min":1.0029999999999999,"15min":1.1200000000000001},"last":0.87}]},{"osd":5,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.66700000000000004},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.38800000000000001},"max":{"1min":0.85099999999999998,"5min":0.96799999999999997,"15min":1.179},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73699999999999999,"15min":0.73099999999999998},"min":{"1min":0.53500000000000003,"5min":0.48599999999999999,"15min":0.45600000000000002},"max":{"1min":0.91400000000000003,"5min":1.0660000000000001,"15min":1.1950000000000001},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun Oct 8 17:41:10 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.752,"15min":0.74099999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.47299999999999998},"max":{"1min":1.0489999999999999,"5min":1.054,"15min":1.1379999999999999},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.75900000000000001,"15min":0.748},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.46700000000000003},"max":{"1min":0.97999999999999998,"5min":1.022,"15min":1.73},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575944,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307900,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063940,"statfs":{"total":96636764160,"available":96321474560,"internally_reserved":0,"allocated":2478080,"data_stored":1242896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.33400000000000002,"5min":0.33200000000000002,"15min":0.31},"max":{"1min":0.68899999999999995,"5min":0.78300000000000003,"15min":0.91400000000000003},"last":0.5},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.53700000000000003},"min":{"1min":0.35299999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.66600000000000004,"5min":0.89500000000000002,"15min":1.0649999999999999},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51700000000000002,"15min":0.51900000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.72799999999999998,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.61799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51600000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61199999999999999,"15min":0.625},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.85599999999999998,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.53900000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.83899999999999997},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0369999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.82199999999999995,"15min":0.82699999999999996},"min":{"1min":0.58499999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0800000000000001,"5min":1.216,"15min":1.2370000000000001},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.83099999999999996,"15min":0.84099999999999997},"min":{"1min":0.60099999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.0469999999999999,"5min":1.1859999999999999,"15min":1.196},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.84499999999999997,"15min":0.85699999999999998},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.54000000000000004},"max":{"1min":1.0089999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.97199999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.874,"15min":0.877},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.56000000000000005},"max":{"1min":1.1180000000000001,"5min":1.28,"15min":1.304},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85399999999999998,"15min":0.86599999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.61499999999999999},"max":{"1min":1.0900000000000001,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.77900000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:41:27 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.86799999999999999,"15min":0.88700000000000001},"min":{"1min":0.59499999999999997,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.0980000000000001,"5min":1.1200000000000001,"15min":1.25},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.89100000000000001,"15min":0.90100000000000002},"min":{"1min":0.624,"5min":0.624,"15min":0.62},"max":{"1min":1.1319999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.89000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575944,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308476,"kb_used_data":2996,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063364,"statfs":{"total":96636764160,"available":96320884736,"internally_reserved":0,"allocated":3067904,"data_stored":1833230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.48099999999999998,"15min":0.497},"min":{"1min":0.36499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.65200000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57899999999999996,"15min":0.58399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72099999999999997,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.434}]},{"osd":2,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52500000000000002,"15min":0.53200000000000003},"min":{"1min":0.39500000000000002,"5min":0.33000000000000002,"15min":0.32800000000000001},"max":{"1min":0.77000000000000002,"5min":0.85599999999999998,"15min":0.85899999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54000000000000004,"15min":0.54900000000000004},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71799999999999997,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.34100000000000003},"max":{"1min":0.83399999999999996,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64800000000000002},"min":{"1min":0.54800000000000004,"5min":0.47599999999999998,"15min":0.45600000000000002},"max":{"1min":0.82399999999999995,"5min":0.87,"15min":0.88700000000000001},"last":0.59599999999999997}]},{"osd":4,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95699999999999996,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.755},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0600000000000001,"5min":1.151,"15min":1.151},"last":0.86199999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.82699999999999996,"15min":0.83199999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.995,"5min":1.131,"15min":1.1779999999999999},"last":0.877},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.622,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.2589999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.84599999999999997,"15min":0.84899999999999998},"min":{"1min":0.65600000000000003,"5min":0.57099999999999995,"15min":0.55100000000000005},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.2809999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84899999999999998,"15min":0.84299999999999997},"min":{"1min":0.58299999999999996,"5min":0.499,"15min":0.499},"max":{"1min":1.046,"5min":1.204,"15min":1.204},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:40:56 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83999999999999997,"15min":0.86499999999999999},"min":{"1min":0.60699999999999998,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0780000000000001,"5min":1.204,"15min":1.222},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84199999999999997,"15min":0.85299999999999998},"min":{"1min":0.67400000000000004,"5min":0.52800000000000002,"15min":0.50700000000000001},"max":{"1min":1.0149999999999999,"5min":1.091,"15min":1.292},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575945,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2478080,"data_stored":1242952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70399999999999996,"5min":0.89500000000000002,"15min":1.032},"last":0.309},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42699999999999999},"max":{"1min":0.71599999999999997,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.36799999999999999},"max":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.66700000000000004,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.58199999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.55600000000000005,"15min":0.56999999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.65800000000000003,"5min":1.0880000000000001,"15min":1.327},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.67200000000000004,"15min":0.68100000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.79200000000000004,"5min":1.4339999999999999,"15min":1.5009999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.82299999999999995,"15min":0.81599999999999995},"min":{"1min":0.57899999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88700000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.81399999999999995},"min":{"1min":0.73799999999999999,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":0.92300000000000004,"5min":1.151,"15min":1.2749999999999999},"last":0.65300000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.873,"15min":0.875},"min":{"1min":0.67200000000000004,"5min":0.60899999999999999,"15min":0.442},"max":{"1min":1.0509999999999999,"5min":1.296,"15min":1.3440000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.60699999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0309999999999999,"5min":1.2849999999999999,"15min":1.375},"last":0.72799999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.82799999999999996,"15min":0.82699999999999996},"min":{"1min":0.59699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":0.94399999999999995,"5min":1.3759999999999999,"15min":1.4319999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.86699999999999999,"15min":0.86299999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":0.94499999999999995,"5min":1.3819999999999999,"15min":1.5429999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Sun Oct 8 17:41:36 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.89600000000000002,"15min":0.89100000000000001},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":0.98399999999999999,"5min":1.4039999999999999,"15min":1.476},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.90400000000000003,"15min":0.90100000000000002},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.96499999999999997,"5min":1.2410000000000001,"15min":1.431},"last":0.67200000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575945,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311996,"kb_used_data":2420,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059844,"statfs":{"total":96636764160,"available":96317280256,"internally_reserved":0,"allocated":2478080,"data_stored":1242896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.48899999999999999,"15min":0.49099999999999999},"min":{"1min":0.34899999999999998,"5min":0.32800000000000001,"15min":0.315},"max":{"1min":0.66300000000000003,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.38300000000000001,"5min":0.34699999999999998,"15min":0.315},"max":{"1min":0.68000000000000005,"5min":0.93400000000000005,"15min":1.2070000000000001},"last":0.48099999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.51500000000000001},"min":{"1min":0.38600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67500000000000004,"5min":0.83599999999999997,"15min":0.91200000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57899999999999996,"15min":0.59599999999999997},"min":{"1min":0.46200000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.69599999999999995,"5min":0.82799999999999996,"15min":0.97899999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.64700000000000002},"min":{"1min":0.48499999999999999,"5min":0.42299999999999999,"15min":0.38300000000000001},"max":{"1min":0.79200000000000004,"5min":1,"15min":1.175},"last":0.502},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.69599999999999995,"15min":0.71199999999999997},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.38800000000000001},"max":{"1min":0.80300000000000005,"5min":1.002,"15min":1.147},"last":0.60099999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57599999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.91600000000000004,"5min":1.095,"15min":1.292},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.82599999999999996,"15min":0.82699999999999996},"min":{"1min":0.67400000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.044,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.90400000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.60399999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.0660000000000001,"5min":1.248,"15min":1.3560000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82599999999999996,"15min":0.83199999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.0249999999999999,"5min":1.2130000000000001,"15min":1.3129999999999999},"last":0.95899999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.61799999999999999,"5min":0.52100000000000002,"15min":0.47099999999999997},"max":{"1min":1.0489999999999999,"5min":1.1759999999999999,"15min":1.4319999999999999},"last":1.175},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.90800000000000003,"15min":0.90900000000000003},"min":{"1min":0.73999999999999999,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.095,"5min":1.3779999999999999,"15min":1.4179999999999999},"last":1.165}]},{"osd":7,"last update":"Sun Oct 8 17:41:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.89100000000000001,"15min":0.89900000000000002},"min":{"1min":0.71999999999999997,"5min":0.627,"15min":0.627},"max":{"1min":0.97099999999999997,"5min":1.222,"15min":1.4530000000000001},"last":1.018},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.88900000000000001,"15min":0.89500000000000002},"min":{"1min":0.66800000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.94499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575945,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307912,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063928,"statfs":{"total":96636764160,"available":96321462272,"internally_reserved":0,"allocated":2490368,"data_stored":1244468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.75600000000000001},"min":{"1min":0.60499999999999998,"5min":0.50800000000000001,"15min":0.46300000000000002},"max":{"1min":1.089,"5min":1.089,"15min":1.0900000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.77600000000000002,"15min":0.77100000000000002},"min":{"1min":0.65700000000000003,"5min":0.56200000000000006,"15min":0.443},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":1.0880000000000001}]},{"osd":1,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.82299999999999995,"15min":0.79300000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.46500000000000002},"max":{"1min":0.99199999999999999,"5min":1.169,"15min":1.169},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.79500000000000004,"15min":0.77800000000000002},"min":{"1min":0.61499999999999999,"5min":0.51500000000000001,"15min":0.47699999999999998},"max":{"1min":1.028,"5min":1.0509999999999999,"15min":1.079},"last":0.81699999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.78000000000000003,"15min":0.77500000000000002},"min":{"1min":0.63700000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.98399999999999999,"5min":1.0089999999999999,"15min":1.081},"last":1.109},{"interface":"front","average":{"1min":0.88,"5min":0.83399999999999996,"15min":0.80400000000000005},"min":{"1min":0.68999999999999995,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.04,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.98499999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.874,"15min":0.84299999999999997},"min":{"1min":0.71199999999999997,"5min":0.58099999999999996,"15min":0.50800000000000001},"max":{"1min":1.069,"5min":1.097,"15min":1.1759999999999999},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.79100000000000004,"15min":0.77900000000000003},"min":{"1min":0.59399999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97699999999999998,"5min":1.012,"15min":1.0209999999999999},"last":0.88200000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67500000000000004,"15min":0.65100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96699999999999997,"5min":1.137,"15min":1.137},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.73999999999999999,"15min":0.70699999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0169999999999999,"5min":1.0649999999999999,"15min":1.1759999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.436},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.96599999999999997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76400000000000001,"15min":0.745},"min":{"1min":0.59699999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96299999999999997,"5min":1.1000000000000001,"15min":1.121},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:41:16 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80000000000000004,"15min":0.78400000000000003},"min":{"1min":0.56899999999999995,"5min":0.53300000000000003,"15min":0.47599999999999998},"max":{"1min":1.0629999999999999,"5min":1.113,"15min":1.1180000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77600000000000002,"15min":0.75},"min":{"1min":0.54500000000000004,"5min":0.498,"15min":0.46400000000000002},"max":{"1min":0.91500000000000004,"5min":1.095,"15min":1.155},"last":0.73099999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575944,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303808,"kb_used_data":2424,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068032,"statfs":{"total":96636764160,"available":96325664768,"internally_reserved":0,"allocated":2482176,"data_stored":1243438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.73899999999999999,"15min":0.73699999999999999},"min":{"1min":0.51700000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.96199999999999997,"5min":1.036,"15min":1.0589999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.75800000000000001,"15min":0.76700000000000002},"min":{"1min":0.64900000000000002,"5min":0.46700000000000003,"15min":0.41199999999999998},"max":{"1min":0.95899999999999996,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.64900000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77200000000000002,"15min":0.77000000000000002},"min":{"1min":0.52000000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94599999999999995,"5min":1.206,"15min":1.206},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.76800000000000002,"15min":0.77000000000000002},"min":{"1min":0.60899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":1.151,"15min":1.151},"last":0.86399999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.54000000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.002,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.76500000000000001,"15min":0.75800000000000001},"min":{"1min":0.49399999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.98199999999999998,"5min":1.131,"15min":1.131},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.79000000000000004,"15min":0.78200000000000003},"min":{"1min":0.56299999999999994,"5min":0.51400000000000001,"15min":0.47199999999999998},"max":{"1min":0.92900000000000005,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79800000000000004,"15min":0.78800000000000003},"min":{"1min":0.68000000000000005,"5min":0.54400000000000004,"15min":0.48799999999999999},"max":{"1min":0.92900000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.89900000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":0.85699999999999998,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.68700000000000006,"15min":0.67700000000000005},"min":{"1min":0.48699999999999999,"5min":0.435,"15min":0.40200000000000002},"max":{"1min":0.84199999999999997,"5min":1.097,"15min":1.097},"last":0.83999999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.50700000000000001,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":0.88300000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72999999999999998,"15min":0.71999999999999997},"min":{"1min":0.48299999999999998,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:41:15 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.77400000000000002,"15min":0.75700000000000001},"min":{"1min":0.55200000000000005,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":0.89500000000000002,"5min":1.125,"15min":1.125},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.79800000000000004,"15min":0.78900000000000003},"min":{"1min":0.56000000000000005,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":0.91400000000000003,"5min":1.258,"15min":1.258},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:41:46.273 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T17:41:46.273 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T17:41:46.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.501+0000 7fd0b959d700 1 Processor -- start 2023-10-08T17:41:46.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.501+0000 7fd0b959d700 1 -- start start 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b959d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd0b4140a70 0x7fd0b40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 0x7fd0b40c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b959d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b40c6d50 con 0x7fd0b40c8330 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b959d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b40c7030 con 0x7fd0b4140a70 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40c7310 con 0x7fd0b4140e40 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b8d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd0b40c8330 0x7fd0b40aeef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54336/0 (socket says 172.21.15.12:54336) 2023-10-08T17:41:46.503 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b8d9c700 1 -- 172.21.15.12:0/2815570387 learned_addr learned my addr 172.21.15.12:0/2815570387 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:46.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2815570387 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 0x7fd0b40c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b3fff700 1 --2- 172.21.15.12:0/2815570387 >> v2:172.21.15.29:3300/0 conn(0x7fd0b4140a70 0x7fd0b40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.503+0000 7fd0b2ffd700 1 -- 172.21.15.12:0/2815570387 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314627989 0 0) 0x7fd0b40c6d50 con 0x7fd0b40c8330 2023-10-08T17:41:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b2ffd700 1 -- 172.21.15.12:0/2815570387 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd09c003570 con 0x7fd0b40c8330 2023-10-08T17:41:46.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2815570387 >> v2:172.21.15.29:3300/0 conn(0x7fd0b4140a70 msgr2=0x7fd0b40c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2815570387 >> v2:172.21.15.29:3300/0 conn(0x7fd0b4140a70 0x7fd0b40c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2815570387 >> v1:172.21.15.12:6789/0 conn(0x7fd0b40c8330 legacy=0x7fd0b40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2815570387 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b40c75f0 con 0x7fd0b4140e40 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2815570387 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 0x7fd0b40c7df0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80098d0 tx=0x7fd0a8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9edca7715579e9ce server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b2ffd700 1 -- 172.21.15.12:0/2815570387 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8005c10 con 0x7fd0b4140e40 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b2ffd700 1 -- 172.21.15.12:0/2815570387 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8005d70 con 0x7fd0b4140e40 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.504+0000 7fd0b2ffd700 1 -- 172.21.15.12:0/2815570387 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8006260 con 0x7fd0b4140e40 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 -- 172.21.15.12:0/2815570387 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 msgr2=0x7fd0b40c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2815570387 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 0x7fd0b40c7df0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd0a80098d0 tx=0x7fd0a8009120 comp rx=0 tx=0).stop 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 -- 172.21.15.12:0/2815570387 shutdown_connections 2023-10-08T17:41:46.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2815570387 >> v2:172.21.15.29:3300/0 conn(0x7fd0b4140a70 0x7fd0b40c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2815570387 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b4140e40 0x7fd0b40c7df0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 -- 172.21.15.12:0/2815570387 >> 172.21.15.12:0/2815570387 conn(0x7fd0b406d170 msgr2=0x7fd0b40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:46.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 -- 172.21.15.12:0/2815570387 shutdown_connections 2023-10-08T17:41:46.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.505+0000 7fd0b959d700 1 -- 172.21.15.12:0/2815570387 wait complete. 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.507+0000 7fd0b959d700 1 Processor -- start 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.507+0000 7fd0b959d700 1 -- start start 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b40c8330 0x7fd0b4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 0x7fd0b40c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40c57f0 con 0x7fd0b4140a70 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b41586e0 con 0x7fd0b4140e40 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b40c5a20 con 0x7fd0b40c8330 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48958/0 (socket says 172.21.15.12:48958) 2023-10-08T17:41:46.509 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2502062041 learned_addr learned my addr 172.21.15.12:0/2502062041 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b3fff700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b40c8330 0x7fd0b4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b8d9c700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 0x7fd0b40c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b40c8330 msgr2=0x7fd0b4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b40c8330 0x7fd0b4156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 msgr2=0x7fd0b40c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 0x7fd0b40c3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b37fe700 1 -- 172.21.15.12:0/2502062041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a80093c0 con 0x7fd0b4140a70 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.508+0000 7fd0b8d9c700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 0x7fd0b40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:46.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd0b37fe700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c7450 tx=0x7fd0a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801d930 con 0x7fd0b4140a70 2023-10-08T17:41:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a801dab0 con 0x7fd0b4140a70 2023-10-08T17:41:46.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a801de70 con 0x7fd0b4140a70 2023-10-08T17:41:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b40c5cc0 con 0x7fd0b4140a70 2023-10-08T17:41:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.509+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b40c6280 con 0x7fd0b4140a70 2023-10-08T17:41:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.510+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b404c3c0 con 0x7fd0b4140a70 2023-10-08T17:41:46.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.511+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7fd0a801b690 con 0x7fd0b4140a70 2023-10-08T17:41:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.512+0000 7fd09bfff700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 0x7fd0a0069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.512+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fd0a8086650 con 0x7fd0b4140a70 2023-10-08T17:41:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.512+0000 7fd0b3fff700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 0x7fd0a0069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:46.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.513+0000 7fd0b3fff700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 0x7fd0a0069500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009db0 tx=0x7fd0a40091a0 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:46.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.516+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0a8053520 con 0x7fd0b4140a70 2023-10-08T17:41:46.801 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.800+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd0b40c78d0 con 0x7fd0b4140a70 2023-10-08T17:41:46.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.805+0000 7fd09bfff700 1 -- 172.21.15.12:0/2502062041 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v48) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd0a805c070 con 0x7fd0b4140a70 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 msgr2=0x7fd0a0069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 0x7fd0a0069500 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009db0 tx=0x7fd0a40091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 msgr2=0x7fd0b4158c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7fd0b40c7450 tx=0x7fd0a8016000 comp rx=0 tx=0).stop 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 shutdown_connections 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd0a0067050 0x7fd0a0069500 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd0b4140e40 0x7fd0b40c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd0b40c8330 0x7fd0b4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 --2- 172.21.15.12:0/2502062041 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd0b4140a70 0x7fd0b4158c40 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.807+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 >> 172.21.15.12:0/2502062041 conn(0x7fd0b406d170 msgr2=0x7fd0b413e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.808+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 shutdown_connections 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:46.808+0000 7fd0b959d700 1 -- 172.21.15.12:0/2502062041 wait complete. 2023-10-08T17:41:46.809 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T17:41:46.825 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:41:47.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.011+0000 7ff49f59e700 1 Processor -- start 2023-10-08T17:41:47.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.011+0000 7ff49f59e700 1 -- start start 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.012+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.012+0000 7ff49f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff4a00c7dc0 0x7ff4a006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.012+0000 7ff49f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a00ca480 con 0x7ff4a0142c00 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.012+0000 7ff49f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a00c8240 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a015e240 con 0x7ff4a0142fd0 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff4a0142c00 0x7ff4a006b7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54338/0 (socket says 172.21.15.12:54338) 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49e59c700 1 -- 172.21.15.12:0/1293829325 learned_addr learned my addr 172.21.15.12:0/1293829325 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:47.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49ed9d700 1 --2- 172.21.15.12:0/1293829325 >> v2:172.21.15.12:3300/0 conn(0x7ff4a00c7dc0 0x7ff4a006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49dd9b700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49d59a700 1 -- 172.21.15.12:0/1293829325 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2524826583 0 0) 0x7ff4a00ca480 con 0x7ff4a0142c00 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49d59a700 1 -- 172.21.15.12:0/1293829325 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff488003570 con 0x7ff4a0142c00 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49ed9d700 1 -- 172.21.15.12:0/1293829325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 msgr2=0x7ff4a00c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49ed9d700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a00c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49ed9d700 1 -- 172.21.15.12:0/1293829325 >> v1:172.21.15.12:6789/0 conn(0x7ff4a0142c00 legacy=0x7ff4a006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.013+0000 7ff49ed9d700 1 -- 172.21.15.12:0/1293829325 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a006b350 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49ed9d700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a006c6a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff498009e60 tx=0x7ff498009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285c03e0c095ad17 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49d59a700 1 -- 172.21.15.12:0/1293829325 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800e070 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49d59a700 1 -- 172.21.15.12:0/1293829325 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49800bab0 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49d59a700 1 -- 172.21.15.12:0/1293829325 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49800be70 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49f59e700 1 -- 172.21.15.12:0/1293829325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 msgr2=0x7ff4a006c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.014+0000 7ff49f59e700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a006c6a0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff498009e60 tx=0x7ff498009780 comp rx=0 tx=0).stop 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 -- 172.21.15.12:0/1293829325 shutdown_connections 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a006c6a0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 --2- 172.21.15.12:0/1293829325 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a00c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 -- 172.21.15.12:0/1293829325 >> 172.21.15.12:0/1293829325 conn(0x7ff4a00675a0 msgr2=0x7ff4a00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 -- 172.21.15.12:0/1293829325 shutdown_connections 2023-10-08T17:41:47.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.015+0000 7ff49f59e700 1 -- 172.21.15.12:0/1293829325 wait complete. 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.016+0000 7ff49f59e700 1 Processor -- start 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.016+0000 7ff49f59e700 1 -- start start 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4a0142c00 0x7ff4a0158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a016a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a016abe0 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a0158c40 con 0x7ff4a0142c00 2023-10-08T17:41:47.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a00b20a0 con 0x7ff4a0142fd0 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48968/0 (socket says 172.21.15.12:48968) 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.017+0000 7ff49e59c700 1 -- 172.21.15.12:0/2585528981 learned_addr learned my addr 172.21.15.12:0/2585528981 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49ed9d700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a016a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49dd9b700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4a0142c00 0x7ff4a0158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 -- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 msgr2=0x7ff4a016a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a016a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 -- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4a0142c00 msgr2=0x7ff4a0158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4a0142c00 0x7ff4a0158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 -- 172.21.15.12:0/2585528981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff498009a20 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49e59c700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c7c0 tx=0x7ff490007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490005b30 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff490005c90 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff490007340 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.018+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a00b2380 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.019+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a016ae30 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.019+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a004c3c0 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.020+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7ff49001b400 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.021+0000 7ff48e7fc700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 0x7ff480069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.022+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7ff490084480 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.022+0000 7ff49dd9b700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 0x7ff480069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.022+0000 7ff49dd9b700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 0x7ff480069500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00ce1b0 tx=0x7ff494008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.025+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4900513d0 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.272+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4a015df60 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.273+0000 7ff48e7fc700 1 -- 172.21.15.12:0/2585528981 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7ff4900549f0 con 0x7ff4a00c7dc0 2023-10-08T17:41:47.273 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:47.273 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 msgr2=0x7ff480069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 0x7ff480069500 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff4a00ce1b0 tx=0x7ff494008040 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 msgr2=0x7ff4a0139a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c7c0 tx=0x7ff490007e00 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 shutdown_connections 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff480067050 0x7ff480069500 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff4a00c7dc0 0x7ff4a0139a30 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff4a0142fd0 0x7ff4a016a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 --2- 172.21.15.12:0/2585528981 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff4a0142c00 0x7ff4a0158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.275+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 >> 172.21.15.12:0/2585528981 conn(0x7ff4a00675a0 msgr2=0x7ff4a00c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.276+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 shutdown_connections 2023-10-08T17:41:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.276+0000 7ff49f59e700 1 -- 172.21.15.12:0/2585528981 wait complete. 2023-10-08T17:41:47.277 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:41:47.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T17:41:40.911321+0000', 'modified': '2023-10-08T17:41:44.443963+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9789}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9789': {'gid': 9789, 'name': 'c', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.12:6835/184729302', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.12:6834', 'nonce': 184729302}, {'type': 'v1', 'addr': '172.21.15.12:6835', 'nonce': 184729302}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T17:41:47.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T17:41:47.696 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-08T17:41:47.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.887+0000 7f955939d700 1 Processor -- start 2023-10-08T17:41:47.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.887+0000 7f955939d700 1 -- start start 2023-10-08T17:41:47.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f955939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f955415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f955939d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955415ae70 con 0x7f955406aaa0 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f955939d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955406af60 con 0x7f955413fb20 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f955939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f955406b240 con 0x7f955413fef0 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f9558b9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f955406aaa0 0x7f95540c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54350/0 (socket says 172.21.15.12:54350) 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f9558b9c700 1 -- 172.21.15.12:0/3103064876 learned_addr learned my addr 172.21.15.12:0/3103064876 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.888+0000 7f95537fe700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f955415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711277743 0 0) 0x7f954c001490 con 0x7f955406aaa0 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f953c003570 con 0x7f955406aaa0 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1153004354 0 0) 0x7f955406af60 con 0x7f955413fb20 2023-10-08T17:41:47.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f954c001490 con 0x7f955413fb20 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 858876961 0 0) 0x7f953c003570 con 0x7f955406aaa0 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 msgr2=0x7f955415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f955415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 >> v1:172.21.15.29:6789/0 conn(0x7f955413fb20 legacy=0x7f95540c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f955406b520 con 0x7f955406aaa0 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f954c001980 con 0x7f955406aaa0 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 >> v1:172.21.15.12:6789/0 conn(0x7f955406aaa0 legacy=0x7f95540c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f953c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f953c0041d0 0x7f953c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f953c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955406b240 con 0x7f953c004d50 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f953c00bbf0 con 0x7f953c0041d0 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.889+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f953c00bdb0 con 0x7f955413fef0 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f953c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f95537fe700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f953c0041d0 0x7f953c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9553fff700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f953c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 -- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 msgr2=0x7f953c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f955413fef0 0x7f953c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 -- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f953c0041d0 msgr2=0x7f953c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f953c0041d0 0x7f953c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 -- 172.21.15.12:0/3103064876 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c003570 con 0x7f953c004d50 2023-10-08T17:41:47.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.890+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f953c0051c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f955406ae90 tx=0x7f954c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db004c0074fdaac6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0070f0 con 0x7f953c004d50 2023-10-08T17:41:47.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c007270 con 0x7f953c004d50 2023-10-08T17:41:47.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f9552ffd700 1 -- 172.21.15.12:0/3103064876 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c007630 con 0x7f953c004d50 2023-10-08T17:41:47.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 -- 172.21.15.12:0/3103064876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 msgr2=0x7f953c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 --2- 172.21.15.12:0/3103064876 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f953c0051c0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f955406ae90 tx=0x7f954c00a060 comp rx=0 tx=0).stop 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f9558b9c700 1 -- 172.21.15.12:0/3103064876 reap_dead start 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 -- 172.21.15.12:0/3103064876 shutdown_connections 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 -- 172.21.15.12:0/3103064876 >> 172.21.15.12:0/3103064876 conn(0x7f955406d170 msgr2=0x7f95540cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 -- 172.21.15.12:0/3103064876 shutdown_connections 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.891+0000 7f955939d700 1 -- 172.21.15.12:0/3103064876 wait complete. 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.893+0000 7f955939d700 1 Processor -- start 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.893+0000 7f955939d700 1 -- start start 2023-10-08T17:41:47.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95540afb70 0x7f955416a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95540c75f0 0x7f95540c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c7fd0 con 0x7f953c004d50 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f955416ab20 con 0x7f95540afb70 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f955939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9554157bb0 con 0x7f95540c75f0 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48994/0 (socket says 172.21.15.12:48994) 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 -- 172.21.15.12:0/1907908013 learned_addr learned my addr 172.21.15.12:0/1907908013 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f95537fe700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95540afb70 0x7f955416a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9558b9c700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95540c75f0 0x7f95540c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 -- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95540c75f0 msgr2=0x7f95540c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95540c75f0 0x7f95540c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 -- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95540afb70 msgr2=0x7f955416a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95540afb70 0x7f955416a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.894+0000 7f9553fff700 1 -- 172.21.15.12:0/1907908013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95540b0130 con 0x7f953c004d50 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f9553fff700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f9544002b80 tx=0x7f9544007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f953bfff700 1 -- 172.21.15.12:0/1907908013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954400fa00 con 0x7f953c004d50 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f953bfff700 1 -- 172.21.15.12:0/1907908013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954400fb80 con 0x7f953c004d50 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f953bfff700 1 -- 172.21.15.12:0/1907908013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544006820 con 0x7f953c004d50 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95540b0410 con 0x7f953c004d50 2023-10-08T17:41:47.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.895+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540b09d0 con 0x7f953c004d50 2023-10-08T17:41:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.897+0000 7f953bfff700 1 -- 172.21.15.12:0/1907908013 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f9544006b90 con 0x7f953c004d50 2023-10-08T17:41:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.898+0000 7f953bfff700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 0x7f9540069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.898+0000 7f953bfff700 1 -- 172.21.15.12:0/1907908013 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f9544084d80 con 0x7f953c004d50 2023-10-08T17:41:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.898+0000 7f95537fe700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 0x7f9540069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.899+0000 7f95537fe700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 0x7f9540069500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f955406f850 tx=0x7f9548008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.900+0000 7f9568c1db80 1 Processor -- start 2023-10-08T17:41:47.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.900+0000 7f9568c1db80 1 -- start start 2023-10-08T17:41:47.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd457d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 0x55565dd1bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dc72a70 con 0x55565dd195f0 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dc70270 con 0x55565dd1bb80 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55565dc6c060 con 0x55565dd66480 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f95537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f95537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:48996/0 (socket says 172.21.15.12:48996) 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f95537fe700 1 -- 172.21.15.12:0/1929337516 learned_addr learned my addr 172.21.15.12:0/1929337516 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9558b9c700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 0x55565dd1bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.901+0000 7f9553fff700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 -- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 msgr2=0x55565dd457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 -- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 msgr2=0x55565dd1bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 0x55565dd1bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 -- 172.21.15.12:0/1929337516 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55565db06270 con 0x55565dd195f0 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f9558b9c700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 0x55565dd1bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95537fe700 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9548014e30 tx=0x7f954801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9f87e452a7e7a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95397fa700 1 -- 172.21.15.12:0/1929337516 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548009a70 con 0x55565dd195f0 2023-10-08T17:41:47.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95397fa700 1 -- 172.21.15.12:0/1929337516 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548016db0 con 0x55565dd195f0 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.902+0000 7f95397fa700 1 -- 172.21.15.12:0/1929337516 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548023660 con 0x55565dd195f0 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 -- 172.21.15.12:0/1929337516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 msgr2=0x55565dd66850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9548014e30 tx=0x7f954801b000 comp rx=0 tx=0).stop 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 -- 172.21.15.12:0/1929337516 shutdown_connections 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd1bb80 0x55565dd1bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 --2- 172.21.15.12:0/1929337516 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd66850 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 -- 172.21.15.12:0/1929337516 >> 172.21.15.12:0/1929337516 conn(0x55565dd1d0c0 msgr2=0x55565dd1d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 -- 172.21.15.12:0/1929337516 shutdown_connections 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.903+0000 7f9568c1db80 1 -- 172.21.15.12:0/1929337516 wait complete. 2023-10-08T17:41:47.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.904+0000 7f9568c1db80 1 -- start start 2023-10-08T17:41:47.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.904+0000 7f9568c1db80 1 Processor -- start 2023-10-08T17:41:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd46890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd66480 0x55565dd657e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dc17890 con 0x55565dd195f0 2023-10-08T17:41:47.910 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dc32ea0 con 0x55565dd66480 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55565daeee30 con 0x55565dd1bb80 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9568c1db80 10 client.0 _ll_register_callbacks cb 0x55565dcdf2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9553fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9553fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49012/0 (socket says 172.21.15.12:49012) 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9553fff700 1 -- 172.21.15.12:0/607224080 learned_addr learned my addr 172.21.15.12:0/607224080 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f9558b9c700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd66480 0x55565dd657e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.905+0000 7f95537fe700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd46890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 -- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 msgr2=0x55565dd46890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd46890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 -- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd66480 msgr2=0x55565dd657e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd66480 0x55565dd657e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 -- 172.21.15.12:0/607224080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f953c003570 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95537fe700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd46890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9553fff700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f954400f4b0 tx=0x7f954401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a1c65fd74678665 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954405c930 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f9544052020 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55565dd10cd0 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95440521e0 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9568c1db80 10 client.9939 fetch_fsmap learned FSMap version 91 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x7f9548014ab0 con 0x55565dd195f0 2023-10-08T17:41:47.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55565dd10cd0 con 0x55565dd195f0 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.906+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9544054e00 con 0x55565dd195f0 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 10 client.9939 fetch_fsmap finished waiting for FSMap version 91 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 10 client.9939 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 20 client.9939 populate_metadata read hostname 'smithi012' 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565dd62b10 0x55565dd62ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 4 client.9939 mds_command: new command op to 9789 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 --> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55565dcedaa0 con 0x55565dd62b10 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f95537fe700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565dd62b10 0x55565dd62ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f95537fe700 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565dd62b10 0x55565dd62ee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=731001227336b9be server_cookie=51b5bdc41ea58111 in_seq=0 out_seq=0 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.907+0000 7f95327fc700 10 client.9939 ms_handle_connect on v2:172.21.15.12:6834/184729302 2023-10-08T17:41:47.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f95327fc700 1 -- 172.21.15.12:0/607224080 <== mds.0 v2:172.21.15.12:6834/184729302 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55565dcedaa0 con 0x55565dd62b10 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f95327fc700 10 client.9939 handle_command_reply: tid=0 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f9568c1db80 1 client.9939 shutdown 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 msgr2=0x55565dd75fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f954400f4b0 tx=0x7f954401e040 comp rx=0 tx=0).stop 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.908+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 shutdown_connections 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565dd62b10 0x55565dd62ee0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd195f0 0x55565dd75fd0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd66480 0x55565dd657e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 --2- 172.21.15.12:0/607224080 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd46890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 >> 172.21.15.12:0/607224080 conn(0x55565dd1d0c0 msgr2=0x55565dd41950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f95327fc700 0 client.9939 ms_handle_reset on v2:172.21.15.12:6834/184729302 2023-10-08T17:41:47.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 shutdown_connections 2023-10-08T17:41:47.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 1 -- 172.21.15.12:0/607224080 wait complete. 2023-10-08T17:41:47.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.909+0000 7f9568c1db80 20 client.9939 trim_cache size 0 max 16384 2023-10-08T17:41:47.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.927+0000 7f9568c1db80 1 Processor -- start 2023-10-08T17:41:47.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.927+0000 7f9568c1db80 1 -- start start 2023-10-08T17:41:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565dd47320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.928 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd63da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dd44bb0 con 0x55565dd1bb80 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dd65330 con 0x55565dd195f0 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55565dd19470 con 0x55565dd66480 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49024/0 (socket says 172.21.15.12:49024) 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 -- 172.21.15.12:0/567093883 learned_addr learned my addr 172.21.15.12:0/567093883 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9553fff700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565dd47320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 -- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 msgr2=0x55565dd63da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9558b9c700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd63da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd63da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 -- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 msgr2=0x55565dd47320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565dd47320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f95537fe700 1 -- 172.21.15.12:0/567093883 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55565daa8fe0 con 0x55565dd1bb80 2023-10-08T17:41:47.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.928+0000 7f9553fff700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565dd47320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:47.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.929+0000 7f95537fe700 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9548014dd0 tx=0x7f9548024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18a108bf864365d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.929+0000 7f9539ffb700 1 -- 172.21.15.12:0/567093883 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954803a0f0 con 0x55565dd1bb80 2023-10-08T17:41:47.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.929+0000 7f9539ffb700 1 -- 172.21.15.12:0/567093883 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9548033040 con 0x55565dd1bb80 2023-10-08T17:41:47.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.929+0000 7f9539ffb700 1 -- 172.21.15.12:0/567093883 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9548016a20 con 0x55565dd1bb80 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- 172.21.15.12:0/567093883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 msgr2=0x55565dd63860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f9548014dd0 tx=0x7f9548024000 comp rx=0 tx=0).stop 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- 172.21.15.12:0/567093883 shutdown_connections 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd66480 0x55565dd63da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565dd47320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 --2- 172.21.15.12:0/567093883 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd1bb80 0x55565dd63860 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- 172.21.15.12:0/567093883 >> 172.21.15.12:0/567093883 conn(0x55565dd1d0c0 msgr2=0x55565dd18a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- 172.21.15.12:0/567093883 shutdown_connections 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- 172.21.15.12:0/567093883 wait complete. 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.930+0000 7f9568c1db80 1 -- start start 2023-10-08T17:41:47.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 Processor -- start 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565ddc24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd71290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565dd470f0 con 0x55565dd66480 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55565ddc9300 con 0x55565dd195f0 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.931+0000 7f9568c1db80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55565dd75260 con 0x55565dd1bb80 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9568c1db80 10 client.0 _ll_register_callbacks cb 0x55565dcdf2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49032/0 (socket says 172.21.15.12:49032) 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 -- 172.21.15.12:0/3163835760 learned_addr learned my addr 172.21.15.12:0/3163835760 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9553fff700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565ddc24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 -- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 msgr2=0x55565dd71290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f95537fe700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd71290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd71290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 -- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 msgr2=0x55565ddc24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565ddc24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9558b9c700 1 -- 172.21.15.12:0/3163835760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55565db06270 con 0x55565dd66480 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f9553fff700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565ddc24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.932+0000 7f95537fe700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd71290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9558b9c700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f954c012000 tx=0x7f954c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8730142c2e3aaeee server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c023070 con 0x55565dd66480 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f954405c930 con 0x55565dd66480 2023-10-08T17:41:47.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f954c0011c0 con 0x55565dd66480 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f954c0075f0 con 0x55565dd66480 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 10 client.9945 fetch_fsmap learned FSMap version 91 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x55565dc3a780 con 0x55565dd66480 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954405c930 con 0x55565dd66480 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 91) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f954c00a970 con 0x55565dd66480 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 10 client.9945 fetch_fsmap finished waiting for FSMap version 91 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 10 client.9945 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 20 client.9945 populate_metadata read hostname 'smithi012' 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565ddc8830 0x55565ddc8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 4 client.9945 mds_command: new command op to 9789 tid=0[{"prefix": "status"}] 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.933+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 --> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f9548016db0 con 0x55565ddc8830 2023-10-08T17:41:47.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f9553fff700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565ddc8830 0x55565ddc8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f9553fff700 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565ddc8830 0x55565ddc8c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bab8cf888ba1a3ad server_cookie=c4d67350a302e12a in_seq=0 out_seq=0 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f95327fc700 10 client.9945 ms_handle_connect on v2:172.21.15.12:6834/184729302 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f95327fc700 1 -- 172.21.15.12:0/3163835760 <== mds.0 v2:172.21.15.12:6834/184729302 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x7f9548016db0 con 0x55565ddc8830 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f95327fc700 10 client.9945 handle_command_reply: tid=0 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f9568c1db80 1 client.9945 shutdown 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 msgr2=0x55565dd717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.934+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f954c012000 tx=0x7f954c016000 comp rx=0 tx=0).stop 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 shutdown_connections 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:6834/184729302,v1:172.21.15.12:6835/184729302] conn(0x55565ddc8830 0x55565ddc8c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55565dd66480 0x55565dd717d0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55565dd195f0 0x55565ddc24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f95327fc700 0 client.9945 ms_handle_reset on v2:172.21.15.12:6834/184729302 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 --2- 172.21.15.12:0/3163835760 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55565dd1bb80 0x55565dd71290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 >> 172.21.15.12:0/3163835760 conn(0x55565dd1d0c0 msgr2=0x55565dd63de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 shutdown_connections 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 1 -- 172.21.15.12:0/3163835760 wait complete. 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f9568c1db80 20 client.9945 trim_cache size 0 max 16384 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T17:41:47.942 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 9789, 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 6.5148665550000002, 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 91, 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 198, 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 198, 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 12.254959516 2023-10-08T17:41:47.943 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:41:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 msgr2=0x7f9540069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 0x7f9540069500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f955406f850 tx=0x7f9548008040 comp rx=0 tx=0).stop 2023-10-08T17:41:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 msgr2=0x7f9554169610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.935+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f9544002b80 tx=0x7f9544007d30 comp rx=0 tx=0).stop 2023-10-08T17:41:47.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 shutdown_connections 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9540067050 0x7f9540069500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f953c004d50 0x7f9554169610 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f95540c75f0 0x7f95540c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 --2- 172.21.15.12:0/1907908013 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f95540afb70 0x7f955416a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 >> 172.21.15.12:0/1907908013 conn(0x7f955406d170 msgr2=0x7f95540c1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 shutdown_connections 2023-10-08T17:41:47.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:47.936+0000 7f955939d700 1 -- 172.21.15.12:0/1907908013 wait complete. 2023-10-08T17:41:47.953 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T17:41:48.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.140+0000 7f4a5299d700 1 Processor -- start 2023-10-08T17:41:48.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.140+0000 7f4a5299d700 1 -- start start 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.141+0000 7f4a5299d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4a4c153c30 0x7f4a4c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.141+0000 7f4a5299d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a4c0cf110 0x7f4a4c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.141+0000 7f4a5299d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a4c15afd0 con 0x7f4a4c15de50 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.141+0000 7f4a5299d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c15b2b0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.141+0000 7f4a5299d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4c15b590 con 0x7f4a4c153c30 2023-10-08T17:41:48.142 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a4c0cf110 0x7f4a4c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4a4c0cf110 0x7f4a4c15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49042/0 (socket says 172.21.15.12:49042) 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 -- 172.21.15.12:0/468812207 learned_addr learned my addr 172.21.15.12:0/468812207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5199b700 1 --2- 172.21.15.12:0/468812207 >> v2:172.21.15.29:3300/0 conn(0x7f4a4c153c30 0x7f4a4c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 -- 172.21.15.12:0/468812207 >> v2:172.21.15.29:3300/0 conn(0x7f4a4c153c30 msgr2=0x7f4a4c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 --2- 172.21.15.12:0/468812207 >> v2:172.21.15.29:3300/0 conn(0x7f4a4c153c30 0x7f4a4c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 -- 172.21.15.12:0/468812207 >> v1:172.21.15.29:6789/0 conn(0x7f4a4c15de50 legacy=0x7f4a4c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 -- 172.21.15.12:0/468812207 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c15b870 con 0x7f4a4c0cf110 2023-10-08T17:41:48.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.142+0000 7f4a5219c700 1 --2- 172.21.15.12:0/468812207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c15c070 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c06ead0 tx=0x7f4a44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577dbb83a14ddeda server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a50999700 1 -- 172.21.15.12:0/468812207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400e070 con 0x7f4a4c0cf110 2023-10-08T17:41:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a50999700 1 -- 172.21.15.12:0/468812207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4400ba50 con 0x7f4a4c0cf110 2023-10-08T17:41:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a50999700 1 -- 172.21.15.12:0/468812207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440092e0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 -- 172.21.15.12:0/468812207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 msgr2=0x7f4a4c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:48.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 --2- 172.21.15.12:0/468812207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c15c070 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c06ead0 tx=0x7f4a44009840 comp rx=0 tx=0).stop 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 -- 172.21.15.12:0/468812207 shutdown_connections 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 --2- 172.21.15.12:0/468812207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c15c070 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 --2- 172.21.15.12:0/468812207 >> v2:172.21.15.29:3300/0 conn(0x7f4a4c153c30 0x7f4a4c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 -- 172.21.15.12:0/468812207 >> 172.21.15.12:0/468812207 conn(0x7f4a4c0703a0 msgr2=0x7f4a4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 -- 172.21.15.12:0/468812207 shutdown_connections 2023-10-08T17:41:48.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.143+0000 7f4a5299d700 1 -- 172.21.15.12:0/468812207 wait complete. 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.145+0000 7f4a5299d700 1 Processor -- start 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.145+0000 7f4a5299d700 1 -- start start 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 0x7f4a4c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a4c15de50 0x7f4a4c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.147 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0c9530 con 0x7f4a4c0cf110 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0b5e30 con 0x7f4a4c15de50 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5299d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4c0c8920 con 0x7f4a4c153c30 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49054/0 (socket says 172.21.15.12:49054) 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 -- 172.21.15.12:0/827038428 learned_addr learned my addr 172.21.15.12:0/827038428 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5219c700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a4c15de50 0x7f4a4c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5119a700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 0x7f4a4c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 -- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 msgr2=0x7f4a4c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 0x7f4a4c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 -- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a4c15de50 msgr2=0x7f4a4c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:48.148 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a4c15de50 0x7f4a4c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5199b700 1 -- 172.21.15.12:0/827038428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44009ae0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.146+0000 7f4a5119a700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 0x7f4a4c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a5199b700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800d8c0 tx=0x7f4a48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a480125f0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a48012750 con 0x7f4a4c0cf110 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a4c0c8c00 con 0x7f4a4c0cf110 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a48012af0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.149 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.147+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4c0c91c0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.148+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4c0c9810 con 0x7f4a4c0cf110 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.149+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f4a4801e460 con 0x7f4a4c0cf110 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.150+0000 7f4a41ffb700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 0x7f4a30069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.150+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f4a48084f40 con 0x7f4a4c0cf110 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.150+0000 7f4a5119a700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 0x7f4a30069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:48.151 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.151+0000 7f4a5119a700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 0x7f4a30069500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:48.154 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.154+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a48051e10 con 0x7f4a4c0cf110 2023-10-08T17:41:48.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.399+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4a4c04c3c0 con 0x7f4a4c0cf110 2023-10-08T17:41:48.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.400+0000 7f4a41ffb700 1 -- 172.21.15.12:0/827038428 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4a48055430 con 0x7f4a4c0cf110 2023-10-08T17:41:48.400 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T17:41:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 msgr2=0x7f4a30069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 0x7f4a30069500 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4a3c007fd0 tx=0x7f4a3c009040 comp rx=0 tx=0).stop 2023-10-08T17:41:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 msgr2=0x7f4a4c158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:48.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800d8c0 tx=0x7f4a48008040 comp rx=0 tx=0).stop 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 shutdown_connections 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4a30067050 0x7f4a30069500 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4a4c0cf110 0x7f4a4c158f00 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4a4c15de50 0x7f4a4c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 --2- 172.21.15.12:0/827038428 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4a4c153c30 0x7f4a4c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 >> 172.21.15.12:0/827038428 conn(0x7f4a4c0703a0 msgr2=0x7f4a4c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 shutdown_connections 2023-10-08T17:41:48.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:48.402+0000 7f4a5299d700 1 -- 172.21.15.12:0/827038428 wait complete. 2023-10-08T17:41:48.419 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T17:41:48.420 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:41:48.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.421 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T17:41:48.461 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 36633sec preferred_lft 36633sec 2023-10-08T17:41:48.462 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T17:41:48.463 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T17:41:48.464 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:41:48.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.465 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T17:41:48.562 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T17:41:48.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.565 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T17:41:48.604 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T17:41:48.604 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T17:41:48.604 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T17:41:48.604 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T17:41:48.605 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T17:41:48.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T17:41:48.606 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T17:41:48.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.805 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:41:48.842 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T17:41:48.842 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T17:41:48.842 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:41:48.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:48.842 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T17:41:48.945 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:41:48.945 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T17:41:48.982 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:41:48.982 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:41:48.982 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:41:49.058 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T17:41:49.058 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T17:41:49.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:41:49.193 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:41:49.193 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:41:49.221 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:41:49.221 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:41:49.221 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T17:41:49.222 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T17:41:49.222 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T17:41:49.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T17:41:49.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:41:49.228 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:41:49.291 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T17:41:49.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.483+0000 7efdf519d700 1 Processor -- start 2023-10-08T17:41:49.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.483+0000 7efdf519d700 1 -- start start 2023-10-08T17:41:49.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf519d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdf0153c30 0x7efdf015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf00cf110 0x7efdf015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf519d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdf015afd0 con 0x7efdf015de50 2023-10-08T17:41:49.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf519d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdf015b2b0 con 0x7efdf0153c30 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf015b590 con 0x7efdf00cf110 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdeffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdf0153c30 0x7efdf015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdeffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efdf0153c30 0x7efdf015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49070/0 (socket says 172.21.15.12:49070) 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdeffff700 1 -- 172.21.15.12:0/3400143980 learned_addr learned my addr 172.21.15.12:0/3400143980 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdef7fe700 1 --1- 172.21.15.12:0/3400143980 >> v1:172.21.15.12:6789/0 conn(0x7efdf015de50 0x7efdf00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54364/0 (socket says 172.21.15.12:54364) 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.484+0000 7efdf499c700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf00cf110 0x7efdf015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeffff700 1 -- 172.21.15.12:0/3400143980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf00cf110 msgr2=0x7efdf015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeffff700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf00cf110 0x7efdf015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeffff700 1 -- 172.21.15.12:0/3400143980 >> v1:172.21.15.12:6789/0 conn(0x7efdf015de50 legacy=0x7efdf00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeffff700 1 -- 172.21.15.12:0/3400143980 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf015b870 con 0x7efdf0153c30 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeffff700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0153c30 0x7efdf015a5e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7efde00099b0 tx=0x7efde0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e94817755300140 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeeffd700 1 -- 172.21.15.12:0/3400143980 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000b860 con 0x7efdf0153c30 2023-10-08T17:41:49.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeeffd700 1 -- 172.21.15.12:0/3400143980 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde000b9c0 con 0x7efdf0153c30 2023-10-08T17:41:49.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.485+0000 7efdeeffd700 1 -- 172.21.15.12:0/3400143980 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde000bd60 con 0x7efdf0153c30 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 -- 172.21.15.12:0/3400143980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0153c30 msgr2=0x7efdf015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0153c30 0x7efdf015a5e0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7efde00099b0 tx=0x7efde0009250 comp rx=0 tx=0).stop 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 -- 172.21.15.12:0/3400143980 shutdown_connections 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf00cf110 0x7efdf015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 --2- 172.21.15.12:0/3400143980 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf0153c30 0x7efdf015a5e0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 -- 172.21.15.12:0/3400143980 >> 172.21.15.12:0/3400143980 conn(0x7efdf00703a0 msgr2=0x7efdf00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 -- 172.21.15.12:0/3400143980 shutdown_connections 2023-10-08T17:41:49.488 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.486+0000 7efdf519d700 1 -- 172.21.15.12:0/3400143980 wait complete. 2023-10-08T17:41:49.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.487+0000 7efdf519d700 1 Processor -- start 2023-10-08T17:41:49.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.488+0000 7efdf519d700 1 -- start start 2023-10-08T17:41:49.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 0x7efdf01470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf015de50 0x7efdf00b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00b3c80 con 0x7efdf00cf110 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00b5b30 con 0x7efdf0153c30 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdf00b60b0 con 0x7efdf015de50 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49086/0 (socket says 172.21.15.12:49086) 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 -- 172.21.15.12:0/4260115110 learned_addr learned my addr 172.21.15.12:0/4260115110 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdf499c700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf015de50 0x7efdf00b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdef7fe700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 0x7efdf01470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 -- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf015de50 msgr2=0x7efdf00b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf015de50 0x7efdf00b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 -- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 msgr2=0x7efdf01470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 0x7efdf01470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 -- 172.21.15.12:0/4260115110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde00094f0 con 0x7efdf00cf110 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdef7fe700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 0x7efdf01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.489+0000 7efdeffff700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7efdf00cf5c0 tx=0x7efde0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.490+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0024440 con 0x7efdf00cf110 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.490+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efde00245c0 con 0x7efdf00cf110 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.490+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efde0024980 con 0x7efdf00cf110 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.490+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdf00b5dd0 con 0x7efdf00cf110 2023-10-08T17:41:49.492 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.490+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdf00b3910 con 0x7efdf00cf110 2023-10-08T17:41:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.491+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdf004c3c0 con 0x7efdf00cf110 2023-10-08T17:41:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.492+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7efde001a420 con 0x7efdf00cf110 2023-10-08T17:41:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.493+0000 7efdd7fff700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 0x7efddc069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.493+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7efde0086720 con 0x7efdf00cf110 2023-10-08T17:41:49.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.493+0000 7efdef7fe700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 0x7efddc069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.493+0000 7efdef7fe700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 0x7efddc069500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdf00ca5e0 tx=0x7efde4009040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.497+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efde00535f0 con 0x7efdf00cf110 2023-10-08T17:41:49.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.726+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efdf00b3dc0 con 0x7efddc067050 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.728+0000 7efdd7fff700 1 -- 172.21.15.12:0/4260115110 <== mgr.9597 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7efde4004830 con 0x7efddc067050 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:41:49.728 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 msgr2=0x7efddc069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 0x7efddc069500 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7efdf00ca5e0 tx=0x7efde4009040 comp rx=0 tx=0).stop 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 msgr2=0x7efdf016d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7efdf00cf5c0 tx=0x7efde0017000 comp rx=0 tx=0).stop 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 shutdown_connections 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efddc067050 0x7efddc069500 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efdf00cf110 0x7efdf016d8e0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efdf015de50 0x7efdf00b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 --2- 172.21.15.12:0/4260115110 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efdf0153c30 0x7efdf01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 >> 172.21.15.12:0/4260115110 conn(0x7efdf00703a0 msgr2=0x7efdf0153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 shutdown_connections 2023-10-08T17:41:49.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.730+0000 7efdf519d700 1 -- 172.21.15.12:0/4260115110 wait complete. 2023-10-08T17:41:49.748 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T17:41:49.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.936+0000 7f290ed9d700 1 Processor -- start 2023-10-08T17:41:49.937 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.936+0000 7f290ed9d700 1 -- start start 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f290806a210 0x7f29080c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290ed9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f290806de50 0x7f29080c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290ed9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f290815b640 con 0x7f2908140a70 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290ed9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29080c6800 con 0x7f290806de50 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290ed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f290815b920 con 0x7f290806a210 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f290806de50 0x7f29080c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290dd9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f2908140a70 0x7f2908069b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54376/0 (socket says 172.21.15.12:54376) 2023-10-08T17:41:49.938 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290dd9b700 1 -- 172.21.15.12:0/1250266048 learned_addr learned my addr 172.21.15.12:0/1250266048 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:49.939 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290d59a700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f290806a210 0x7f29080c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290e59c700 1 -- 172.21.15.12:0/1250266048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f290806a210 msgr2=0x7f29080c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290e59c700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f290806a210 0x7f29080c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290e59c700 1 -- 172.21.15.12:0/1250266048 >> v1:172.21.15.12:6789/0 conn(0x7f2908140a70 legacy=0x7f2908069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.940 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290e59c700 1 -- 172.21.15.12:0/1250266048 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f290815bc00 con 0x7f290806de50 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.938+0000 7f290cd99700 1 -- 172.21.15.12:0/1250266048 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267236500 0 0) 0x7f290815b640 con 0x7f2908140a70 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290e59c700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806de50 0x7f29080c7190 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2900009e60 tx=0x7f2900009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6637230b42e07345 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290cd99700 1 -- 172.21.15.12:0/1250266048 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290000e070 con 0x7f290806de50 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290cd99700 1 -- 172.21.15.12:0/1250266048 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290000bb60 con 0x7f290806de50 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290cd99700 1 -- 172.21.15.12:0/1250266048 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2900012430 con 0x7f290806de50 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290ed9d700 1 -- 172.21.15.12:0/1250266048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806de50 msgr2=0x7f29080c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.939+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806de50 0x7f29080c7190 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f2900009e60 tx=0x7f2900009780 comp rx=0 tx=0).stop 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 -- 172.21.15.12:0/1250266048 shutdown_connections 2023-10-08T17:41:49.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806de50 0x7f29080c7190 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1250266048 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f290806a210 0x7f29080c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 -- 172.21.15.12:0/1250266048 >> 172.21.15.12:0/1250266048 conn(0x7f290806d110 msgr2=0x7f29080cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 -- 172.21.15.12:0/1250266048 shutdown_connections 2023-10-08T17:41:49.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.940+0000 7f290ed9d700 1 -- 172.21.15.12:0/1250266048 wait complete. 2023-10-08T17:41:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.941+0000 7f290ed9d700 1 Processor -- start 2023-10-08T17:41:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.941+0000 7f290ed9d700 1 -- start start 2023-10-08T17:41:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f290806de50 0x7f290813db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 0x7f29080c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f290813e040 con 0x7f290806a210 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29080af290 con 0x7f290806de50 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290ed9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29080af570 con 0x7f2908140a70 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49114/0 (socket says 172.21.15.12:49114) 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.942+0000 7f290dd9b700 1 -- 172.21.15.12:0/1489966896 learned_addr learned my addr 172.21.15.12:0/1489966896 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290d59a700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f290806de50 0x7f290813db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290e59c700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 0x7f29080c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 -- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 msgr2=0x7f29080c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 0x7f29080c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 -- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f290806de50 msgr2=0x7f290813db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f290806de50 0x7f290813db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 -- 172.21.15.12:0/1489966896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2900009a20 con 0x7f290806a210 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290e59c700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 0x7f29080c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290dd9b700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f290400c5b0 tx=0x7f2904001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904005b30 con 0x7f290806a210 2023-10-08T17:41:49.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2904005c90 con 0x7f290806a210 2023-10-08T17:41:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2904007300 con 0x7f290806a210 2023-10-08T17:41:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29080af850 con 0x7f290806a210 2023-10-08T17:41:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.943+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29080afe10 con 0x7f290806a210 2023-10-08T17:41:49.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.944+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29080b0030 con 0x7f290806a210 2023-10-08T17:41:49.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.945+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 97) v1 ==== 84842+0+0 (secure 0 0 0) 0x7f290401b3b0 con 0x7f290806a210 2023-10-08T17:41:49.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.946+0000 7f28fdffb700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 0x7f28ec069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:49.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.946+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f2904083e60 con 0x7f290806a210 2023-10-08T17:41:49.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.946+0000 7f290d59a700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 0x7f28ec069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:49.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.947+0000 7f290d59a700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 0x7f28ec069500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29080c46d0 tx=0x7f28f8008040 comp rx=0 tx=0).ready entity=mgr.9597 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:49.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:49.950+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2904050d30 con 0x7f290806a210 2023-10-08T17:41:50.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:50.206+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f290804c3c0 con 0x7f290806a210 2023-10-08T17:41:51.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.019+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 98) v1 ==== 84859+0+0 (secure 0 0 0) 0x7f2904051100 con 0x7f290806a210 2023-10-08T17:41:51.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.021+0000 7f28fdffb700 1 -- 172.21.15.12:0/1489966896 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v98) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2904050d30 con 0x7f290806a210 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 msgr2=0x7f28ec069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 0x7f28ec069500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29080c46d0 tx=0x7f28f8008040 comp rx=0 tx=0).stop 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 msgr2=0x7f29080b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f290400c5b0 tx=0x7f2904001070 comp rx=0 tx=0).stop 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 shutdown_connections 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28ec067050 0x7f28ec069500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f290806a210 0x7f29080b0330 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2908140a70 0x7f29080c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 --2- 172.21.15.12:0/1489966896 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f290806de50 0x7f290813db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 >> 172.21.15.12:0/1489966896 conn(0x7f290806d110 msgr2=0x7f290813ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 shutdown_connections 2023-10-08T17:41:51.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.024+0000 7f290ed9d700 1 -- 172.21.15.12:0/1489966896 wait complete. 2023-10-08T17:41:51.045 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T17:41:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.245+0000 7fb89eb9d700 1 Processor -- start 2023-10-08T17:41:51.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.245+0000 7fb89eb9d700 1 -- start start 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.246+0000 7fb89eb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb898153a00 0x7fb898153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.246+0000 7fb89eb9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 0x7fb89815a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.246+0000 7fb89eb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89815af60 con 0x7fb8980cea00 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89eb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89815d010 con 0x7fb898153a00 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89eb9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb89815b240 con 0x7fb89815de50 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb898153a00 0x7fb898153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb898153a00 0x7fb898153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49130/0 (socket says 172.21.15.12:49130) 2023-10-08T17:41:51.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 -- 172.21.15.12:0/3184256913 learned_addr learned my addr 172.21.15.12:0/3184256913 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:51.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89d39a700 1 --2- 172.21.15.12:0/3184256913 >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 0x7fb89815a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 -- 172.21.15.12:0/3184256913 >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 msgr2=0x7fb89815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 --2- 172.21.15.12:0/3184256913 >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 0x7fb89815a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 -- 172.21.15.12:0/3184256913 >> v1:172.21.15.12:6789/0 conn(0x7fb8980cea00 legacy=0x7fb8980cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89db9b700 1 -- 172.21.15.12:0/3184256913 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89815b520 con 0x7fb898153a00 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.247+0000 7fb89d39a700 1 --2- 172.21.15.12:0/3184256913 >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 0x7fb89815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:51.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89db9b700 1 --2- 172.21.15.12:0/3184256913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb898153dd0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb8980b3070 tx=0x7fb894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17815a23fcb2bb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89cb99700 1 -- 172.21.15.12:0/3184256913 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400b860 con 0x7fb898153a00 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89cb99700 1 -- 172.21.15.12:0/3184256913 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89400b9c0 con 0x7fb898153a00 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89cb99700 1 -- 172.21.15.12:0/3184256913 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89400bd60 con 0x7fb898153a00 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3184256913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 msgr2=0x7fb898153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.248+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3184256913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb898153dd0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb8980b3070 tx=0x7fb894009250 comp rx=0 tx=0).stop 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3184256913 shutdown_connections 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3184256913 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb898153dd0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3184256913 >> v2:172.21.15.29:3300/0 conn(0x7fb89815de50 0x7fb89815a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3184256913 >> 172.21.15.12:0/3184256913 conn(0x7fb8980703a0 msgr2=0x7fb8980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3184256913 shutdown_connections 2023-10-08T17:41:51.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.249+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3184256913 wait complete. 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.250+0000 7fb89eb9d700 1 Processor -- start 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.250+0000 7fb89eb9d700 1 -- start start 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8980cea00 0x7fb898150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb89815de50 0x7fb8980c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb898151270 con 0x7fb898153a00 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980c8190 con 0x7fb89815de50 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89eb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8980c8470 con 0x7fb8980cea00 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89d39a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49144/0 (socket says 172.21.15.12:49144) 2023-10-08T17:41:51.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89d39a700 1 -- 172.21.15.12:0/3600697870 learned_addr learned my addr 172.21.15.12:0/3600697870 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.251+0000 7fb89db9b700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8980cea00 0x7fb898150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89e39c700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb89815de50 0x7fb8980c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8980cea00 msgr2=0x7fb898150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8980cea00 0x7fb898150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb89815de50 msgr2=0x7fb8980c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb89815de50 0x7fb8980c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 -- 172.21.15.12:0/3600697870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940094f0 con 0x7fb898153a00 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89d39a700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fb88800e8d0 tx=0x7fb888008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888013410 con 0x7fb898153a00 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888013570 con 0x7fb898153a00 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8980c8750 con 0x7fb898153a00 2023-10-08T17:41:51.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888013910 con 0x7fb898153a00 2023-10-08T17:41:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.252+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8980b44c0 con 0x7fb898153a00 2023-10-08T17:41:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.254+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8980c7400 con 0x7fb898153a00 2023-10-08T17:41:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.255+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 98) v1 ==== 84859+0+0 (secure 0 0 0) 0x7fb888013d00 con 0x7fb898153a00 2023-10-08T17:41:51.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.255+0000 7fb88dffb700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 0x7fb87c069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.255+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fb888084810 con 0x7fb898153a00 2023-10-08T17:41:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.255+0000 7fb89db9b700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 msgr2=0x7fb87c069580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:51.256 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.256+0000 7fb89db9b700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 0x7fb87c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:51.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.263+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8880515d0 con 0x7fb898153a00 2023-10-08T17:41:51.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.457+0000 7fb89db9b700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 msgr2=0x7fb87c069580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:51.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.457+0000 7fb89db9b700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 0x7fb87c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:51.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.468+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb89804c3c0 con 0x7fb898153a00 2023-10-08T17:41:51.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.474+0000 7fb88dffb700 1 -- 172.21.15.12:0/3600697870 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb888054bf0 con 0x7fb898153a00 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 msgr2=0x7fb87c069580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 0x7fb87c069580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 msgr2=0x7fb8980c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fb88800e8d0 tx=0x7fb888008040 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 shutdown_connections 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb87c0670d0 0x7fb87c069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb89815de50 0x7fb8980c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8980cea00 0x7fb898150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 --2- 172.21.15.12:0/3600697870 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb898153a00 0x7fb8980c8db0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.476+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 >> 172.21.15.12:0/3600697870 conn(0x7fb8980703a0 msgr2=0x7fb898158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:51.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.477+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 shutdown_connections 2023-10-08T17:41:51.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.477+0000 7fb89eb9d700 1 -- 172.21.15.12:0/3600697870 wait complete. 2023-10-08T17:41:51.495 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T17:41:51.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.686+0000 7fa26759d700 1 Processor -- start 2023-10-08T17:41:51.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.686+0000 7fa26759d700 1 -- start start 2023-10-08T17:41:51.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.687+0000 7fa26759d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa2600caec0 0x7fa26015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.687+0000 7fa26759d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26015ada0 con 0x7fa260153c90 2023-10-08T17:41:51.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.687+0000 7fa26759d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26006ca80 con 0x7fa26006db20 2023-10-08T17:41:51.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.687+0000 7fa26759d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006cd60 con 0x7fa2600caec0 2023-10-08T17:41:51.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.687+0000 7fa26659b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fa260153c90 0x7fa2600ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54406/0 (socket says 172.21.15.12:54406) 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa26659b700 1 -- 172.21.15.12:0/1131477961 learned_addr learned my addr 172.21.15.12:0/1131477961 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa266d9c700 1 --2- 172.21.15.12:0/1131477961 >> v2:172.21.15.29:3300/0 conn(0x7fa2600caec0 0x7fa26015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56569243 0 0) 0x7fa25c001110 con 0x7fa260153c90 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa24c003570 con 0x7fa260153c90 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505098758 0 0) 0x7fa26006ca80 con 0x7fa26006db20 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa25c001110 con 0x7fa26006db20 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa266d9c700 1 -- 172.21.15.12:0/1131477961 >> v1:172.21.15.29:6789/0 conn(0x7fa26006db20 legacy=0x7fa26015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa266d9c700 1 -- 172.21.15.12:0/1131477961 >> v1:172.21.15.12:6789/0 conn(0x7fa260153c90 legacy=0x7fa2600ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa266d9c700 1 -- 172.21.15.12:0/1131477961 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26006d040 con 0x7fa2600caec0 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.688+0000 7fa266d9c700 1 --2- 172.21.15.12:0/1131477961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2600caec0 0x7fa26015a860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa258009e60 tx=0x7fa258009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc6108623b59f475 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:51.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800e070 con 0x7fa2600caec0 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25800bab0 con 0x7fa2600caec0 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa265599700 1 -- 172.21.15.12:0/1131477961 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25800be70 con 0x7fa2600caec0 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 -- 172.21.15.12:0/1131477961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2600caec0 msgr2=0x7fa26015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 --2- 172.21.15.12:0/1131477961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2600caec0 0x7fa26015a860 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa258009e60 tx=0x7fa258009780 comp rx=0 tx=0).stop 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 -- 172.21.15.12:0/1131477961 shutdown_connections 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 --2- 172.21.15.12:0/1131477961 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa2600caec0 0x7fa26015a860 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 -- 172.21.15.12:0/1131477961 >> 172.21.15.12:0/1131477961 conn(0x7fa26006e720 msgr2=0x7fa26006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 -- 172.21.15.12:0/1131477961 shutdown_connections 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.689+0000 7fa26759d700 1 -- 172.21.15.12:0/1131477961 wait complete. 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.691+0000 7fa26759d700 1 Processor -- start 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.691+0000 7fa26759d700 1 -- start start 2023-10-08T17:41:51.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 0x7fa260149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa260153c90 0x7fa2600b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26016a2f0 con 0x7fa2600caec0 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601503a0 con 0x7fa260153c90 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa260150680 con 0x7fa26006db20 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa265d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa26659b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 0x7fa260149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa265d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:49148/0 (socket says 172.21.15.12:49148) 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa265d9a700 1 -- 172.21.15.12:0/1121800193 learned_addr learned my addr 172.21.15.12:0/1121800193 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.692+0000 7fa266d9c700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa260153c90 0x7fa2600b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 msgr2=0x7fa260149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 0x7fa260149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa260153c90 msgr2=0x7fa2600b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa260153c90 0x7fa2600b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 -- 172.21.15.12:0/1121800193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009a20 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa26659b700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 0x7fa260149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa265d9a700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c5c0 tx=0x7fa250007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250010510 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa250010690 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250010a50 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.693+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2600c8b30 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.694+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2600c90f0 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.695+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2600c9680 con 0x7fa2600caec0 2023-10-08T17:41:51.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.695+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 98) v1 ==== 84859+0+0 (secure 0 0 0) 0x7fa25001b400 con 0x7fa2600caec0 2023-10-08T17:41:51.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.696+0000 7fa2567fc700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 0x7fa244069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:51.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.696+0000 7fa26659b700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 msgr2=0x7fa244069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:51.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.696+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7fa2500844a0 con 0x7fa2600caec0 2023-10-08T17:41:51.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.696+0000 7fa26659b700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 0x7fa244069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:51.774 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.700+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa250051370 con 0x7fa2600caec0 2023-10-08T17:41:51.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.897+0000 7fa26659b700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 msgr2=0x7fa244069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:51.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.897+0000 7fa26659b700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 0x7fa244069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:51.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.923+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fa2601495a0 con 0x7fa2600caec0 2023-10-08T17:41:51.929 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.928+0000 7fa2567fc700 1 -- 172.21.15.12:0/1121800193 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa250054990 con 0x7fa2600caec0 2023-10-08T17:41:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 msgr2=0x7fa244069550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 0x7fa244069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 msgr2=0x7fa2600b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fa25000c5c0 tx=0x7fa250007db0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 shutdown_connections 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa2440670a0 0x7fa244069550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa260153c90 0x7fa2600b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa26006db20 0x7fa260149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 --2- 172.21.15.12:0/1121800193 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa2600caec0 0x7fa2600b0d10 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 >> 172.21.15.12:0/1121800193 conn(0x7fa26006e720 msgr2=0x7fa2600c2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 shutdown_connections 2023-10-08T17:41:51.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:51.931+0000 7fa26759d700 1 -- 172.21.15.12:0/1121800193 wait complete. 2023-10-08T17:41:51.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:51.951 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T17:41:51.992 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-08T17:41:52.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.227+0000 7f89d1b9d700 1 Processor -- start 2023-10-08T17:41:52.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.227+0000 7f89d1b9d700 1 -- start start 2023-10-08T17:41:52.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.228+0000 7f89d1b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f89cc0b24f0 0x7f89cc0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.228+0000 7f89d1b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89cc159800 0x7f89cc0b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.228+0000 7f89d1b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0b0c80 con 0x7f89cc0b1d40 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.228+0000 7f89d1b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0d10d0 con 0x7f89cc159800 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.228+0000 7f89d1b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0b0f60 con 0x7f89cc0b24f0 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89cc159800 0x7f89cc0b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d0b9b700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f89cc0b24f0 0x7f89cc0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f89cc159800 0x7f89cc0b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33208/0 (socket says 172.21.15.12:33208) 2023-10-08T17:41:52.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 -- 172.21.15.12:0/810999538 learned_addr learned my addr 172.21.15.12:0/810999538 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 -- 172.21.15.12:0/810999538 >> v2:172.21.15.29:3300/0 conn(0x7f89cc0b24f0 msgr2=0x7f89cc0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 --2- 172.21.15.12:0/810999538 >> v2:172.21.15.29:3300/0 conn(0x7f89cc0b24f0 0x7f89cc0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 -- 172.21.15.12:0/810999538 >> v1:172.21.15.29:6789/0 conn(0x7f89cc0b1d40 legacy=0x7f89cc1590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 -- 172.21.15.12:0/810999538 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0b1240 con 0x7f89cc159800 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.229+0000 7f89d139c700 1 --2- 172.21.15.12:0/810999538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc159800 0x7f89cc0b4ae0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0d1230 tx=0x7f89c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b015e6211b1a2a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89cb7fe700 1 -- 172.21.15.12:0/810999538 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c400e070 con 0x7f89cc159800 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89cb7fe700 1 -- 172.21.15.12:0/810999538 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c400ba20 con 0x7f89cc159800 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89cb7fe700 1 -- 172.21.15.12:0/810999538 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c40092e0 con 0x7f89cc159800 2023-10-08T17:41:52.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 -- 172.21.15.12:0/810999538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc159800 msgr2=0x7f89cc0b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/810999538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc159800 0x7f89cc0b4ae0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0d1230 tx=0x7f89c4009840 comp rx=0 tx=0).stop 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 -- 172.21.15.12:0/810999538 shutdown_connections 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/810999538 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc159800 0x7f89cc0b4ae0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/810999538 >> v2:172.21.15.29:3300/0 conn(0x7f89cc0b24f0 0x7f89cc0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.230+0000 7f89d1b9d700 1 -- 172.21.15.12:0/810999538 >> 172.21.15.12:0/810999538 conn(0x7f89cc0703a0 msgr2=0x7f89cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.231+0000 7f89d1b9d700 1 -- 172.21.15.12:0/810999538 shutdown_connections 2023-10-08T17:41:52.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.231+0000 7f89d1b9d700 1 -- 172.21.15.12:0/810999538 wait complete. 2023-10-08T17:41:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.233+0000 7f89d1b9d700 1 Processor -- start 2023-10-08T17:41:52.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.233+0000 7f89d1b9d700 1 -- start start 2023-10-08T17:41:52.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89cc0b24f0 0x7f89cc0c7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89cc159800 0x7f89cc0c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc154a20 con 0x7f89cc0b1d40 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c59e0 con 0x7f89cc0b24f0 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c5cc0 con 0x7f89cc159800 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33214/0 (socket says 172.21.15.12:33214) 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 -- 172.21.15.12:0/4125908459 learned_addr learned my addr 172.21.15.12:0/4125908459 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d139c700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89cc159800 0x7f89cc0c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89cc0b24f0 0x7f89cc0c7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:52.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89cc159800 msgr2=0x7f89cc0c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89cc159800 0x7f89cc0c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89cc0b24f0 msgr2=0x7f89cc0c7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89cc0b24f0 0x7f89cc0c7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.235+0000 7f89d0b9b700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c4009ae0 con 0x7f89cc0b1d40 2023-10-08T17:41:52.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89d0b9b700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f89c000ec80 tx=0x7f89c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000c850 con 0x7f89cc0b1d40 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c000c9b0 con 0x7f89cc0b1d40 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc0c5fa0 con 0x7f89cc0b1d40 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c000cd50 con 0x7f89cc0b1d40 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.236+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc0c6560 con 0x7f89cc0b1d40 2023-10-08T17:41:52.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.237+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc04c3c0 con 0x7f89cc0b1d40 2023-10-08T17:41:52.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.239+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 98) v1 ==== 84859+0+0 (secure 0 0 0) 0x7f89c0013680 con 0x7f89cc0b1d40 2023-10-08T17:41:52.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.240+0000 7f89c8ff9700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:52.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.240+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6197+0+0 (secure 0 0 0) 0x7f89c0084b90 con 0x7f89cc0b1d40 2023-10-08T17:41:52.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.240+0000 7f89cbfff700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:52.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.240+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:41:52.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.244+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89c0051a60 con 0x7f89cc0b1d40 2023-10-08T17:41:52.351 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:52.351+0000 7f083aaa9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:41:52.409 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:52.408+0000 7f9c21cb4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:41:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.441+0000 7f89cbfff700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:52.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.441+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:41:52.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.476+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89cc0aff80 con 0x7f89b00670a0 2023-10-08T17:41:52.522 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:52.522+0000 7f083aaa9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:52.580 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:52.579+0000 7f9c21cb4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:52.611 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:52.611+0000 7f083aaa9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:41:52.669 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:52.668+0000 7f9c21cb4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:41:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.842+0000 7f89cbfff700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:52.843 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:52.842+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:41:52.843 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:52.843+0000 7f083aaa9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:52.900 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:52.899+0000 7f9c21cb4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:53.029 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.029+0000 7f083aaa9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:41:53.085 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:53.084+0000 7f9c21cb4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:41:53.125 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.125+0000 7f083aaa9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:41:53.180 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:53.179+0000 7f9c21cb4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:41:53.292 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.292+0000 7f083aaa9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:41:53.346 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:53.345+0000 7f9c21cb4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:41:53.398 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.397+0000 7f083aaa9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:53.451 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:53.450+0000 7f9c21cb4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:41:53.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:53.643+0000 7f89cbfff700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:53.644 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:53.643+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T17:41:53.901 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.901+0000 7f083aaa9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:41:53.953 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:53.952+0000 7f9c21cb4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:41:53.999 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:53.998+0000 7f083aaa9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:41:54.051 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:54.050+0000 7f9c21cb4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:41:54.092 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:54.092+0000 7f083aaa9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:41:54.146 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:54.145+0000 7f9c21cb4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:41:54.738 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:54.738+0000 7f083aaa9180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:41:54.797 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:54.796+0000 7f9c21cb4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:41:54.916 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:54.916+0000 7f083aaa9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:54.977 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:54.976+0000 7f9c21cb4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:41:55.015 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:55.015+0000 7f083aaa9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:41:55.077 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:55.076+0000 7f9c21cb4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:41:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:55.245+0000 7f89cbfff700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:41:55.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:55.245+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T17:41:55.318 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:55.317+0000 7f083aaa9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:41:55.380 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:55.379+0000 7f9c21cb4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:41:55.418 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:55.417+0000 7f083aaa9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:41:55.480 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:55.479+0000 7f9c21cb4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:41:56.157 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:56.157+0000 7f083aaa9180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:41:56.217 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:56.216+0000 7f9c21cb4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:41:56.451 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:56.451+0000 7f083aaa9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:41:56.509 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:56.508+0000 7f9c21cb4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:41:56.548 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:56.547+0000 7f083aaa9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:41:56.606 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:56.605+0000 7f9c21cb4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:41:56.708 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:56.707+0000 7f083aaa9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:41:56.768 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:56.767+0000 7f9c21cb4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:41:56.817 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:56.817+0000 7f083aaa9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:41:56.877 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:56.876+0000 7f9c21cb4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:41:57.013 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:57.013+0000 7f083aaa9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:41:57.075 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.074+0000 7f9c21cb4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:41:57.109 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:57.109+0000 7f083aaa9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:41:57.173 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.172+0000 7f9c21cb4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:41:57.205 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:57.205+0000 7f083aaa9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:41:57.270 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.269+0000 7f9c21cb4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:41:57.304 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:41:57.303+0000 7f083aaa9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:41:57.370 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.369+0000 7f9c21cb4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:41:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:57.380+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 99) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f89c0051e30 con 0x7f89cc0b1d40 2023-10-08T17:41:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:57.380+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b0069550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:41:57.381 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:57.380+0000 7f89c8ff9700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b0069550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:57.510 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.507+0000 7f9b937f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.510 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.507+0000 7f9b937f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.510 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.507+0000 7f9b937f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.507+0000 7f9b937f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.507+0000 7f9b937f0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.508+0000 7f9b957f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.508+0000 7f9b957f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.508+0000 7f9b957f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.511 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.508+0000 7f9b957f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:57.512 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:41:57.508+0000 7f9b957f4700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:41:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.386+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mgrmap(e 100) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f89c005c230 con 0x7f89cc0b1d40 2023-10-08T17:41:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.386+0000 7f89c8ff9700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b00694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.387+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89cc0aff80 con 0x7f89b00670a0 2023-10-08T17:41:58.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.388+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b00694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.396+0000 7f89cbfff700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b00694d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0b28e0 tx=0x7f89b8007ec0 comp rx=0 tx=0).ready entity=mgr.8150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:58.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.463+0000 7f89c8ff9700 1 -- 172.21.15.12:0/4125908459 <== mgr.8150 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f89cc0aff80 con 0x7f89b00670a0 2023-10-08T17:41:58.464 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 msgr2=0x7f89b00694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b00694d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f89cc0b28e0 tx=0x7f89b8007ec0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 msgr2=0x7f89cc0c5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f89c000ec80 tx=0x7f89c00091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 shutdown_connections 2023-10-08T17:41:58.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f89b00670a0 0x7f89b00694d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f89cc0b1d40 0x7f89cc0c5300 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f89cc159800 0x7f89cc0c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 --2- 172.21.15.12:0/4125908459 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f89cc0b24f0 0x7f89cc0c7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 >> 172.21.15.12:0/4125908459 conn(0x7f89cc0703a0 msgr2=0x7f89cc156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 shutdown_connections 2023-10-08T17:41:58.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.466+0000 7f89d1b9d700 1 -- 172.21.15.12:0/4125908459 wait complete. 2023-10-08T17:41:58.488 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T17:41:58.488 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-08T17:41:58.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.683+0000 7f891a99d700 1 Processor -- start 2023-10-08T17:41:58.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.683+0000 7f891a99d700 1 -- start start 2023-10-08T17:41:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.684+0000 7f891a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f891414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.684+0000 7f891a99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f891406e470 0x7f89141501b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.684+0000 7f891a99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891406a490 con 0x7f891406e0a0 2023-10-08T17:41:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.684+0000 7f891a99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89140c7230 con 0x7f891406e470 2023-10-08T17:41:58.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.684+0000 7f891a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c7490 con 0x7f891406f3a0 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f891406e470 0x7f89141501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f891406e470 0x7f89141501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33398/0 (socket says 172.21.15.12:33398) 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 -- 172.21.15.12:0/1883317838 learned_addr learned my addr 172.21.15.12:0/1883317838 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891919a700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f891414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 -- 172.21.15.12:0/1883317838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 msgr2=0x7f891414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f891414fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 -- 172.21.15.12:0/1883317838 >> v1:172.21.15.29:6789/0 conn(0x7f891406e0a0 legacy=0x7f89140c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 -- 172.21.15.12:0/1883317838 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89140c7770 con 0x7f891406e470 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891919a700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f891414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:58.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.685+0000 7f891a19c700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e470 0x7f89141501b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f890c009f20 tx=0x7f890c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e734a262c6b672 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f8918999700 1 -- 172.21.15.12:0/1883317838 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c00e070 con 0x7f891406e470 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f8918999700 1 -- 172.21.15.12:0/1883317838 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c00ba80 con 0x7f891406e470 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f8918999700 1 -- 172.21.15.12:0/1883317838 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c0092e0 con 0x7f891406e470 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 -- 172.21.15.12:0/1883317838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e470 msgr2=0x7f89141501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e470 0x7f89141501b0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f890c009f20 tx=0x7f890c009840 comp rx=0 tx=0).stop 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 -- 172.21.15.12:0/1883317838 shutdown_connections 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e470 0x7f89141501b0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 --2- 172.21.15.12:0/1883317838 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f891414fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.689 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 -- 172.21.15.12:0/1883317838 >> 172.21.15.12:0/1883317838 conn(0x7f891406d170 msgr2=0x7f89140cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 -- 172.21.15.12:0/1883317838 shutdown_connections 2023-10-08T17:41:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.686+0000 7f891a99d700 1 -- 172.21.15.12:0/1883317838 wait complete. 2023-10-08T17:41:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.688+0000 7f891a99d700 1 Processor -- start 2023-10-08T17:41:58.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.688+0000 7f891a99d700 1 -- start start 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f891406e470 0x7f8914154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f8914147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c1470 con 0x7f891406e0a0 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c1750 con 0x7f891406e470 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89140c1a30 con 0x7f891406f3a0 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33400/0 (socket says 172.21.15.12:33400) 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891999b700 1 -- 172.21.15.12:0/1096993549 learned_addr learned my addr 172.21.15.12:0/1096993549 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891919a700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f891406e470 0x7f8914154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.689+0000 7f891a19c700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f8914147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 -- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 msgr2=0x7f8914147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f8914147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 -- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f891406e470 msgr2=0x7f8914154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f891406e470 0x7f8914154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 -- 172.21.15.12:0/1096993549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009ae0 con 0x7f891406e0a0 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891999b700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f891000c590 tx=0x7f891000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910011590 con 0x7f891406e0a0 2023-10-08T17:41:58.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8910011710 con 0x7f891406e0a0 2023-10-08T17:41:58.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89140c1d10 con 0x7f891406e0a0 2023-10-08T17:41:58.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8910011ad0 con 0x7f891406e0a0 2023-10-08T17:41:58.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.690+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8914158f00 con 0x7f891406e0a0 2023-10-08T17:41:58.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.691+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f891404c3c0 con 0x7f891406e0a0 2023-10-08T17:41:58.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.692+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 100) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f891001b3b0 con 0x7f891406e0a0 2023-10-08T17:41:58.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.693+0000 7f8909ffb700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 0x7f88f8069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:58.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.694+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f8910083a10 con 0x7f891406e0a0 2023-10-08T17:41:58.695 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.694+0000 7f891919a700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 0x7f88f8069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:58.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.694+0000 7f891919a700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 0x7f88f8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89140c8360 tx=0x7f8904008040 comp rx=0 tx=0).ready entity=mgr.8150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:58.699 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.698+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8910050bf0 con 0x7f891406e0a0 2023-10-08T17:41:58.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.932+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f89140c18c0 con 0x7f88f8066dd0 2023-10-08T17:41:58.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.995+0000 7f8909ffb700 1 -- 172.21.15.12:0/1096993549 <== mgr.8150 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f89140c18c0 con 0x7f88f8066dd0 2023-10-08T17:41:58.996 INFO:teuthology.orchestra.run.smithi012.stdout:Retention added to path snap_test_dir1 2023-10-08T17:41:58.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 msgr2=0x7f88f8069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 0x7f88f8069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f89140c8360 tx=0x7f8904008040 comp rx=0 tx=0).stop 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 msgr2=0x7f89141589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f891000c590 tx=0x7f891000c8a0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 shutdown_connections 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f88f8066dd0 0x7f88f8069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f891406e0a0 0x7f89141589c0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f891406f3a0 0x7f8914147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:58.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 --2- 172.21.15.12:0/1096993549 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f891406e470 0x7f8914154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 >> 172.21.15.12:0/1096993549 conn(0x7f891406d170 msgr2=0x7f89140cc5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:59.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 shutdown_connections 2023-10-08T17:41:59.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:58.997+0000 7f891a99d700 1 -- 172.21.15.12:0/1096993549 wait complete. 2023-10-08T17:41:59.016 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-08T17:41:59.016 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-08-17_42_00 in ~1s... 2023-10-08T17:41:59.017 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-08T17:41:59.017 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-08T17:41:59.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.208+0000 7f4d749fe700 1 Processor -- start 2023-10-08T17:41:59.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.208+0000 7f4d749fe700 1 -- start start 2023-10-08T17:41:59.210 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.209+0000 7f4d749fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d700c2a90 0x7f4d70156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.209+0000 7f4d749fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f4d700c85d0 0x7f4d700cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.209+0000 7f4d749fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d701579b0 con 0x7f4d700c8200 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.209+0000 7f4d749fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700c1390 con 0x7f4d700c2a90 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.209+0000 7f4d749fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d701573f0 con 0x7f4d700c85d0 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d700c2a90 0x7f4d70156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4d700c8200 0x7f4d700c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:43072/0 (socket says 172.21.15.12:43072) 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6ed9d700 1 -- 172.21.15.12:0/243744338 learned_addr learned my addr 172.21.15.12:0/243744338 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:41:59.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4d700c2a90 0x7f4d70156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33414/0 (socket says 172.21.15.12:33414) 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 -- 172.21.15.12:0/243744338 >> v2:172.21.15.29:3300/0 conn(0x7f4d700c85d0 msgr2=0x7f4d700cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 --2- 172.21.15.12:0/243744338 >> v2:172.21.15.29:3300/0 conn(0x7f4d700c85d0 0x7f4d700cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 -- 172.21.15.12:0/243744338 >> v1:172.21.15.12:6789/0 conn(0x7f4d700c8200 legacy=0x7f4d700c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 -- 172.21.15.12:0/243744338 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d701576d0 con 0x7f4d700c2a90 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6dd9b700 1 -- 172.21.15.12:0/243744338 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566319693 0 0) 0x7f4d701579b0 con 0x7f4d700c8200 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.210+0000 7f4d6e59c700 1 --2- 172.21.15.12:0/243744338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c2a90 0x7f4d70156aa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c1300 tx=0x7f4d640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fbf555f560a57b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d6dd9b700 1 -- 172.21.15.12:0/243744338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400b6b0 con 0x7f4d700c2a90 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d6dd9b700 1 -- 172.21.15.12:0/243744338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6400b810 con 0x7f4d700c2a90 2023-10-08T17:41:59.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d6dd9b700 1 -- 172.21.15.12:0/243744338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6400bbb0 con 0x7f4d700c2a90 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 -- 172.21.15.12:0/243744338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c2a90 msgr2=0x7f4d70156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 --2- 172.21.15.12:0/243744338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c2a90 0x7f4d70156aa0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4d700c1300 tx=0x7f4d640091a0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 -- 172.21.15.12:0/243744338 shutdown_connections 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 --2- 172.21.15.12:0/243744338 >> v2:172.21.15.29:3300/0 conn(0x7f4d700c85d0 0x7f4d700cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 --2- 172.21.15.12:0/243744338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c2a90 0x7f4d70156aa0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 -- 172.21.15.12:0/243744338 >> 172.21.15.12:0/243744338 conn(0x7f4d7006c6a0 msgr2=0x7f4d7006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 -- 172.21.15.12:0/243744338 shutdown_connections 2023-10-08T17:41:59.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.211+0000 7f4d749fe700 1 -- 172.21.15.12:0/243744338 wait complete. 2023-10-08T17:41:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.213+0000 7f4d749fe700 1 Processor -- start 2023-10-08T17:41:59.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.213+0000 7f4d749fe700 1 -- start start 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 0x7f4d700adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 0x7f4d700b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70147bd0 con 0x7f4d700c8200 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70148a10 con 0x7f4d700c85d0 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d749fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d70147e00 con 0x7f4d700c2a90 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:33424/0 (socket says 172.21.15.12:33424) 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 -- 172.21.15.12:0/3575869374 learned_addr learned my addr 172.21.15.12:0/3575869374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6ed9d700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 0x7f4d700adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6f59e700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 0x7f4d700b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 -- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 msgr2=0x7f4d700adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 0x7f4d700adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 -- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 msgr2=0x7f4d700b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 0x7f4d700b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6e59c700 1 -- 172.21.15.12:0/3575869374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d64009420 con 0x7f4d700c8200 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6ed9d700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 0x7f4d700adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.214+0000 7f4d6f59e700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 0x7f4d700b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d6e59c700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4d640093f0 tx=0x7f4d64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011420 con 0x7f4d700c8200 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d64011580 con 0x7f4d700c8200 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d701480e0 con 0x7f4d700c8200 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d64011940 con 0x7f4d700c8200 2023-10-08T17:41:59.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.215+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d701486a0 con 0x7f4d700c8200 2023-10-08T17:41:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.216+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7004c3c0 con 0x7f4d700c8200 2023-10-08T17:41:59.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.217+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 100) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f4d64011cf0 con 0x7f4d700c8200 2023-10-08T17:41:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.219+0000 7f4d56ffd700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 0x7f4d5c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:41:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.219+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f4d64085f50 con 0x7f4d700c8200 2023-10-08T17:41:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.219+0000 7f4d6ed9d700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 0x7f4d5c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:41:59.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.219+0000 7f4d6ed9d700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 0x7f4d5c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d7006ba00 tx=0x7f4d60009040 comp rx=0 tx=0).ready entity=mgr.8150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:41:59.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.223+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d64053130 con 0x7f4d700c8200 2023-10-08T17:41:59.394 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.393+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 101) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4d64053500 con 0x7f4d700c8200 2023-10-08T17:41:59.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.459+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d700aeac0 con 0x7f4d5c066dd0 2023-10-08T17:41:59.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.467+0000 7f4d56ffd700 1 -- 172.21.15.12:0/3575869374 <== mgr.8150 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f4d700aeac0 con 0x7f4d5c066dd0 2023-10-08T17:41:59.468 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:41:59.469 INFO:teuthology.orchestra.run.smithi012.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-08T17:41:59.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 msgr2=0x7f4d5c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 0x7f4d5c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d7006ba00 tx=0x7f4d60009040 comp rx=0 tx=0).stop 2023-10-08T17:41:59.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 msgr2=0x7f4d70147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:41:59.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4d640093f0 tx=0x7f4d64017000 comp rx=0 tx=0).stop 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 shutdown_connections 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4d5c066dd0 0x7f4d5c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4d700c85d0 0x7f4d700b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4d700c2a90 0x7f4d700adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 --2- 172.21.15.12:0/3575869374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4d700c8200 0x7f4d70147690 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 >> 172.21.15.12:0/3575869374 conn(0x7f4d7006c6a0 msgr2=0x7f4d700c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 shutdown_connections 2023-10-08T17:41:59.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:41:59.470+0000 7f4d749fe700 1 -- 172.21.15.12:0/3575869374 wait complete. 2023-10-08T17:41:59.489 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-08T17:41:59.489 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-08T17:41:59.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:41:59.490 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:41:59.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T17:41:59.529 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:41:59.529 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:00.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:00.530 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:00.574 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-10-08T17:42:00.574 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:00.574 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:01.009 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:42:01.007+0000 7f9b85fd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:42:01.009 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:42:01.007+0000 7f9b85fd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:42:01.009 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:42:01.007+0000 7f9b85fd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:42:01.009 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:42:01.007+0000 7f9b85fd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:42:01.009 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:42:01.007+0000 7f9b85fd5700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:42:01.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:01.576 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:01.618 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:01.619 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:01.619 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:01.619 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:01.620 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-10-08-17_42_01_UTC'] 2023-10-08T17:42:01.620 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696786919.0168405, now = 1696786921.620113, timo = 1 2023-10-08T17:42:02.621 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-10-08-17_42_00 in ~61s... 2023-10-08T17:42:02.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:02.621 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:02.664 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:02.665 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:02.665 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:02.665 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:03.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:03.666 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:03.708 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:03.709 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:03.709 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:03.709 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:04.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:04.711 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:04.753 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:04.754 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:04.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:04.755 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:05.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:05.755 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:05.798 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:05.798 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:05.799 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:05.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:06.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:06.799 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:06.842 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:06.843 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:06.843 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:06.843 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:07.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:07.844 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:07.887 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:07.889 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:07.889 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:07.889 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:08.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:08.890 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:08.933 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:08.934 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:08.934 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:08.934 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:09.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:09.935 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:09.977 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:09.979 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:09.979 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:09.979 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:10.277 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:10.283 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:10.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:10.980 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:11.022 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:11.023 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:11.023 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:11.023 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:12.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:12.024 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:12.071 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:12.071 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:12.071 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:12.071 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:13.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:13.073 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:13.116 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:13.117 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:13.117 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:13.117 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:14.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:14.118 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:14.161 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:14.163 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:14.163 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:14.164 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:15.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:15.164 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:15.206 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:15.207 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:15.208 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:15.208 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:16.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:16.209 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:16.251 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:16.253 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:16.253 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:16.253 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:17.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:17.254 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:17.297 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:17.298 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:17.298 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:17.298 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:18.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:18.299 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:18.340 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:18.341 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:18.341 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:18.341 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:19.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:19.342 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:19.385 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:19.387 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:19.387 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:19.387 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:20.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:20.388 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:20.430 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:20.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:20.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:20.432 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:21.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:21.433 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:21.479 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:21.480 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:21.480 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:21.480 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:22.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:22.481 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:22.524 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:22.525 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:22.525 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:22.525 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:23.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:23.526 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:23.569 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:23.570 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:23.570 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:23.570 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:24.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:24.571 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:24.613 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:24.614 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:24.615 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:24.615 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:25.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:25.616 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:25.659 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:25.660 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:25.660 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:25.660 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:26.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:26.661 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:26.703 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:26.704 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:26.705 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:26.705 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:27.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:27.706 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:27.748 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:27.749 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:27.749 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:27.749 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:28.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:28.750 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:28.792 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:28.793 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:28.793 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:28.793 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:29.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:29.795 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:29.837 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:29.838 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:29.838 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:29.839 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:30.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:30.839 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:30.882 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:30.883 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:30.883 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:30.883 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:31.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:31.884 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:31.927 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:31.928 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:31.928 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:31.928 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:32.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:32.930 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:32.972 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:32.973 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:32.973 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:32.973 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:33.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:33.975 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:34.017 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:34.018 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:34.018 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:34.018 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:35.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:35.019 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:35.061 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:35.063 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:35.063 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:35.063 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:36.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:36.064 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:36.107 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:36.108 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:36.109 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:36.109 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:37.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:37.110 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:37.153 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:37.154 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:37.154 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:37.154 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:38.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:38.155 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:38.197 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:38.198 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:38.198 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:38.198 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:39.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:39.200 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:39.242 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:39.243 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:39.244 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:39.244 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:40.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:40.244 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:40.287 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:40.288 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:40.288 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:40.288 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:40.385 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:40.391 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:42:41.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:41.289 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:41.331 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:41.332 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:41.332 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:41.332 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:42.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:42.334 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:42.376 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:42.377 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:42.378 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:42.378 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:43.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:43.379 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:43.422 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:43.423 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:43.423 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:43.423 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:44.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:44.425 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:44.469 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:44.470 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:44.470 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:44.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:45.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:45.471 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:45.513 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:45.514 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:45.514 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:45.514 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:46.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:46.516 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:46.558 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:46.559 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:46.559 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:46.559 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:47.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:47.560 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:47.603 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:47.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:47.604 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:47.604 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:48.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:48.605 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:48.647 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:48.648 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:48.648 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:48.649 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:49.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:49.650 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:49.692 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:49.693 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:49.693 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:49.694 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:50.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:50.695 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:50.737 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:50.738 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:50.738 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:50.738 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:51.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:51.739 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:51.782 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:51.783 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:51.783 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:51.783 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:52.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:52.784 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:52.826 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:52.827 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:52.827 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:52.827 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:53.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:53.828 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:53.870 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:53.871 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:53.871 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:53.871 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:54.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:55.204 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:55.246 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:55.529 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:55.530 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:55.530 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:56.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:56.530 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:56.570 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:56.571 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:56.571 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:56.572 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:57.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:57.573 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:57.615 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:57.616 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:57.617 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:57.617 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:58.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:58.618 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:58.660 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:58.662 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:58.662 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:58.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:42:59.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:42:59.664 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:42:59.706 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_42_01_UTC 2023-10-08T17:42:59.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:42:59.707 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-10-08T17:42:59.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-10-08T17:43:00.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:00.708 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:43:00.751 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_43_00_UTC 2023-10-08T17:43:00.752 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-10-08-17_43_00_UTC'} 2023-10-08T17:43:00.752 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-10-08-17_43_00_UTC'} 2023-10-08T17:43:00.752 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-10-08-17_42_01_UTC'} 2023-10-08T17:43:00.752 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-10-08-17_42_01_UTC'] 2023-10-08T17:43:00.752 DEBUG:tasks.cephfs.test_snap_schedules:exec=1696786919.0168405, now = 1696786980.7528036, timo = 61 2023-10-08T17:43:01.753 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-08T17:43:01.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.955+0000 7f3b30b9d700 1 Processor -- start 2023-10-08T17:43:01.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.955+0000 7f3b30b9d700 1 -- start start 2023-10-08T17:43:01.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b30b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b2c0c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b30b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f3b2c0c9090 0x7f3b2c156d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b30b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0c2200 con 0x7f3b2c153660 2023-10-08T17:43:01.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b30b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c157250 con 0x7f3b2c0c9090 2023-10-08T17:43:01.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b30b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c15f0 con 0x7f3b2c153a30 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f3b2c153660 0x7f3b2c0c8980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:54748/0 (socket says 172.21.15.12:54748) 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2b7fe700 1 -- 172.21.15.12:0/2112729352 learned_addr learned my addr 172.21.15.12:0/2112729352 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2bfff700 1 --2- 172.21.15.12:0/2112729352 >> v2:172.21.15.29:3300/0 conn(0x7f3b2c0c9090 0x7f3b2c156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2affd700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b2c0c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498319804 0 0) 0x7f3b2c0c2200 con 0x7f3b2c153660 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.957+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b14003570 con 0x7f3b2c153660 2023-10-08T17:43:01.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1118268792 0 0) 0x7f3b14003570 con 0x7f3b2c153660 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 msgr2=0x7f3b2c0c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b2c0c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 >> v2:172.21.15.29:3300/0 conn(0x7f3b2c0c9090 msgr2=0x7f3b2c156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 --2- 172.21.15.12:0/2112729352 >> v2:172.21.15.29:3300/0 conn(0x7f3b2c0c9090 0x7f3b2c156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0c18d0 con 0x7f3b2c153660 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f3b1c001470 con 0x7f3b2c153660 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 >> v1:172.21.15.12:6789/0 conn(0x7f3b2c153660 legacy=0x7f3b2c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:01.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b14003ae0 0x7f3b14003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b14004810 0x7f3b14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c157250 con 0x7f3b14003ae0 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0c15f0 con 0x7f3b14004810 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1400bb40 con 0x7f3b2c153a30 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b14003ae0 0x7f3b14003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2affd700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b14004810 0x7f3b14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.958+0000 7f3b2bfff700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 -- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 msgr2=0x7f3b140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b2c153a30 0x7f3b140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 -- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b14004810 msgr2=0x7f3b14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:01.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b14004810 0x7f3b14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 -- 172.21.15.12:0/2112729352 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b14003570 con 0x7f3b14003ae0 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2affd700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b14004810 0x7f3b14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b14003ae0 0x7f3b14003ef0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c2d0 tx=0x7f3b1c001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5920d92c12a1acbd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c00cba0 con 0x7f3b14003ae0 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00cd00 con 0x7f3b14003ae0 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.959+0000 7f3b2a7fc700 1 -- 172.21.15.12:0/2112729352 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c005b70 con 0x7f3b14003ae0 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2112729352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b14003ae0 msgr2=0x7f3b14003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2112729352 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b14003ae0 0x7f3b14003ef0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c2d0 tx=0x7f3b1c001dc0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b2bfff700 1 -- 172.21.15.12:0/2112729352 reap_dead start 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2112729352 shutdown_connections 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2112729352 >> 172.21.15.12:0/2112729352 conn(0x7f3b2c06c6a0 msgr2=0x7f3b2c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:01.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2112729352 shutdown_connections 2023-10-08T17:43:01.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.960+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2112729352 wait complete. 2023-10-08T17:43:01.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.961+0000 7f3b30b9d700 1 Processor -- start 2023-10-08T17:43:01.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.961+0000 7f3b30b9d700 1 -- start start 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b14003ae0 0x7f3b2c0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c159460 0x7f3b2c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c157880 con 0x7f3b2c153e70 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c157b20 con 0x7f3b2c159460 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b30b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c157e00 con 0x7f3b14003ae0 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.962+0000 7f3b2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50890/0 (socket says 172.21.15.12:50890) 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 -- 172.21.15.12:0/2566740826 learned_addr learned my addr 172.21.15.12:0/2566740826 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b14003ae0 0x7f3b2c0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2affd700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c159460 0x7f3b2c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 -- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b14003ae0 msgr2=0x7f3b2c0b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b14003ae0 0x7f3b2c0b13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 -- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c159460 msgr2=0x7f3b2c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c159460 0x7f3b2c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 -- 172.21.15.12:0/2566740826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c1580e0 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b2bfff700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0c9560 tx=0x7f3b2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400e040 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400f040 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c1583c0 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.963+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400fe20 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.964+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c159e10 con 0x7f3b2c153e70 2023-10-08T17:43:01.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.964+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c1585b0 con 0x7f3b2c153e70 2023-10-08T17:43:01.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.965+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 102) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f3b24015640 con 0x7f3b2c153e70 2023-10-08T17:43:01.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.966+0000 7f3b137fe700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 0x7f3b18069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:01.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.966+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f3b24085710 con 0x7f3b2c153e70 2023-10-08T17:43:01.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.967+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 0x7f3b18069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:01.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.967+0000 7f3b2b7fe700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 0x7f3b18069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c015040 tx=0x7f3b1c012000 comp rx=0 tx=0).ready entity=mgr.8150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:01.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:01.971+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b24052200 con 0x7f3b2c153e70 2023-10-08T17:43:02.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.199+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b2c157c90 con 0x7f3b180671c0 2023-10-08T17:43:02.274 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.273+0000 7f3b137fe700 1 -- 172.21.15.12:0/2566740826 <== mgr.8150 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f3b2c157c90 con 0x7f3b180671c0 2023-10-08T17:43:02.274 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path snap_test_dir1 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.275+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 msgr2=0x7f3b18069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.275+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 0x7f3b18069670 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c015040 tx=0x7f3b1c012000 comp rx=0 tx=0).stop 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.275+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 msgr2=0x7f3b2c1542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.275+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0c9560 tx=0x7f3b2400b040 comp rx=0 tx=0).stop 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 shutdown_connections 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3b180671c0 0x7f3b18069670 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f3b2c153e70 0x7f3b2c1542c0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f3b14003ae0 0x7f3b2c0b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 --2- 172.21.15.12:0/2566740826 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f3b2c159460 0x7f3b2c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 >> 172.21.15.12:0/2566740826 conn(0x7f3b2c06c6a0 msgr2=0x7f3b2c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 shutdown_connections 2023-10-08T17:43:02.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.276+0000 7f3b30b9d700 1 -- 172.21.15.12:0/2566740826 wait complete. 2023-10-08T17:43:02.294 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-08T17:43:02.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:02.295 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:43:02.334 INFO:teuthology.orchestra.run.smithi012.stdout:scheduled-2023-10-08-17_43_00_UTC 2023-10-08T17:43:02.335 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-10-08-17_43_00_UTC 2023-10-08T17:43:02.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:02.335 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-10-08-17_43_00_UTC) 2023-10-08T17:43:02.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:02.418 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T17:43:02.499 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T17:43:02.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.727+0000 7f010499d700 1 Processor -- start 2023-10-08T17:43:02.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.727+0000 7f010499d700 1 -- start start 2023-10-08T17:43:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0100155890 0x7f01000c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0100155c60 0x7f010006a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f010006de50 0x7f010006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01000c7e70 con 0x7f0100155c60 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010006e7f0 con 0x7f0100155890 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.728+0000 7f010499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010006b790 con 0x7f010006de50 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0100155c60 0x7f010006a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0100155c60 0x7f010006a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:43998/0 (socket says 172.21.15.12:43998) 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 -- 172.21.15.12:0/1135186552 learned_addr learned my addr 172.21.15.12:0/1135186552 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00ff7fe700 1 --2- 172.21.15.12:0/1135186552 >> v2:172.21.15.29:3300/0 conn(0x7f0100155890 0x7f01000c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00fffff700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f010006de50 0x7f010006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 -- 172.21.15.12:0/1135186552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f010006de50 msgr2=0x7f010006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f010006de50 0x7f010006e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 -- 172.21.15.12:0/1135186552 >> v2:172.21.15.29:3300/0 conn(0x7f0100155890 msgr2=0x7f01000c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 --2- 172.21.15.12:0/1135186552 >> v2:172.21.15.29:3300/0 conn(0x7f0100155890 0x7f01000c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.729+0000 7f00feffd700 1 -- 172.21.15.12:0/1135186552 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010006a8e0 con 0x7f0100155c60 2023-10-08T17:43:02.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f00feffd700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0100155c60 0x7f010006a3a0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f01000c9be0 tx=0x7f00f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54442ee53fe2b91 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f00fe7fc700 1 -- 172.21.15.12:0/1135186552 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400b640 con 0x7f0100155c60 2023-10-08T17:43:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f00fe7fc700 1 -- 172.21.15.12:0/1135186552 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f400b7a0 con 0x7f0100155c60 2023-10-08T17:43:02.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f00fe7fc700 1 -- 172.21.15.12:0/1135186552 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f400bb60 con 0x7f0100155c60 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 -- 172.21.15.12:0/1135186552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0100155c60 msgr2=0x7f010006a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0100155c60 0x7f010006a3a0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f01000c9be0 tx=0x7f00f4009250 comp rx=0 tx=0).stop 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 -- 172.21.15.12:0/1135186552 shutdown_connections 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f010006de50 0x7f010006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 --2- 172.21.15.12:0/1135186552 >> v2:172.21.15.29:3300/0 conn(0x7f0100155890 0x7f01000c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 --2- 172.21.15.12:0/1135186552 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0100155c60 0x7f010006a3a0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.730+0000 7f010499d700 1 -- 172.21.15.12:0/1135186552 >> 172.21.15.12:0/1135186552 conn(0x7f010006d110 msgr2=0x7f01000cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.731+0000 7f010499d700 1 -- 172.21.15.12:0/1135186552 shutdown_connections 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.731+0000 7f010499d700 1 -- 172.21.15.12:0/1135186552 wait complete. 2023-10-08T17:43:02.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.732+0000 7f010499d700 1 Processor -- start 2023-10-08T17:43:02.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.732+0000 7f010499d700 1 -- start start 2023-10-08T17:43:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 0x7f01000c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0100155c60 0x7f01000aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.736 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01000b0ef0 con 0x7f010006de50 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001547d0 con 0x7f0100155c60 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f010499d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01000c4320 con 0x7f0100155890 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f00ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f00ff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44008/0 (socket says 172.21.15.12:44008) 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f00ff7fe700 1 -- 172.21.15.12:0/1331060884 learned_addr learned my addr 172.21.15.12:0/1331060884 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f00fffff700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0100155c60 0x7f01000aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.733+0000 7f00feffd700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 0x7f01000c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 -- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 msgr2=0x7f01000c4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:02.737 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 0x7f01000c4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 -- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0100155c60 msgr2=0x7f01000aefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0100155c60 0x7f01000aefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 -- 172.21.15.12:0/1331060884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40094f0 con 0x7f010006de50 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00feffd700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 0x7f01000c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00ff7fe700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f00f000ec80 tx=0x7f00f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000c880 con 0x7f010006de50 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f000c9e0 con 0x7f010006de50 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01000c3710 con 0x7f010006de50 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f000cd80 con 0x7f010006de50 2023-10-08T17:43:02.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.734+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01000c3cd0 con 0x7f010006de50 2023-10-08T17:43:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.735+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010004c3c0 con 0x7f010006de50 2023-10-08T17:43:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.736+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 102) v1 ==== 84973+0+0 (secure 0 0 0) 0x7f00f0013680 con 0x7f010006de50 2023-10-08T17:43:02.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.737+0000 7f00e77fe700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 0x7f00ec069670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.737+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f00f0084ff0 con 0x7f010006de50 2023-10-08T17:43:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.737+0000 7f00feffd700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 0x7f00ec069670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:02.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.738+0000 7f00feffd700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 0x7f00ec069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01000c9be0 tx=0x7f00f4017000 comp rx=0 tx=0).ready entity=mgr.8150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:02.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.741+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00f0051bf0 con 0x7f010006de50 2023-10-08T17:43:03.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:02.999+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f01000ae9c0 con 0x7f010006de50 2023-10-08T17:43:03.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.477+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f00f0051fc0 con 0x7f010006de50 2023-10-08T17:43:03.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.478+0000 7f00e77fe700 1 -- 172.21.15.12:0/1331060884 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v103) v1 ==== 93+0+0 (secure 0 0 0) 0x7f00f0070690 con 0x7f010006de50 2023-10-08T17:43:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 msgr2=0x7f00ec069670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:03.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 0x7f00ec069670 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f01000c9be0 tx=0x7f00f4017000 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 msgr2=0x7f01000c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f00f000ec80 tx=0x7f00f00091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 shutdown_connections 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f00ec0671c0 0x7f00ec069670 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f010006de50 0x7f01000c47e0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0100155c60 0x7f01000aefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 --2- 172.21.15.12:0/1331060884 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0100155890 0x7f01000c4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 >> 172.21.15.12:0/1331060884 conn(0x7f010006d110 msgr2=0x7f01000cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 shutdown_connections 2023-10-08T17:43:03.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:03.481+0000 7f010499d700 1 -- 172.21.15.12:0/1331060884 wait complete. 2023-10-08T17:43:03.501 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:43:03.501 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:03.590 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:03.670 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:43:03.670 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T17:43:03.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:03.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:03.761 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:43:03.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:03.761 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T17:43:03.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:04.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.034+0000 7f032359d700 1 Processor -- start 2023-10-08T17:43:04.035 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.034+0000 7f032359d700 1 -- start start 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.035+0000 7f032359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 0x7f031c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.035+0000 7f032359d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c15ae70 con 0x7f031c06aaa0 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.035+0000 7f032359d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031c06af60 con 0x7f031c13fb20 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.035+0000 7f032359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c06b240 con 0x7f031c13fef0 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0322d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f031c06aaa0 0x7f031c0c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41946/0 (socket says 172.21.15.12:41946) 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0322d9c700 1 -- 172.21.15.12:0/3892878266 learned_addr learned my addr 172.21.15.12:0/3892878266 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:04.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321d9a700 1 --2- 172.21.15.12:0/3892878266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 0x7f031c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503335224 0 0) 0x7f0314001490 con 0x7f031c06aaa0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0308003570 con 0x7f031c06aaa0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3466946512 0 0) 0x7f031c06af60 con 0x7f031c13fb20 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321d9a700 1 -- 172.21.15.12:0/3892878266 >> v1:172.21.15.29:6789/0 conn(0x7f031c13fb20 legacy=0x7f031c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321d9a700 1 -- 172.21.15.12:0/3892878266 >> v1:172.21.15.12:6789/0 conn(0x7f031c06aaa0 legacy=0x7f031c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.036+0000 7f0321d9a700 1 -- 172.21.15.12:0/3892878266 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f031c06b520 con 0x7f031c13fef0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f0321d9a700 1 --2- 172.21.15.12:0/3892878266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 0x7f031c15a930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f030c009900 tx=0x7f030c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9693bbe5201407a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c005c10 con 0x7f031c13fef0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c005d70 con 0x7f031c13fef0 2023-10-08T17:43:04.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f0321599700 1 -- 172.21.15.12:0/3892878266 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c006260 con 0x7f031c13fef0 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f032359d700 1 -- 172.21.15.12:0/3892878266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 msgr2=0x7f031c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.037+0000 7f032359d700 1 --2- 172.21.15.12:0/3892878266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 0x7f031c15a930 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f030c009900 tx=0x7f030c009120 comp rx=0 tx=0).stop 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.038+0000 7f032359d700 1 -- 172.21.15.12:0/3892878266 shutdown_connections 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.038+0000 7f032359d700 1 --2- 172.21.15.12:0/3892878266 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c13fef0 0x7f031c15a930 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.038+0000 7f032359d700 1 -- 172.21.15.12:0/3892878266 >> 172.21.15.12:0/3892878266 conn(0x7f031c06d170 msgr2=0x7f031c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.038+0000 7f032359d700 1 -- 172.21.15.12:0/3892878266 shutdown_connections 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.038+0000 7f032359d700 1 -- 172.21.15.12:0/3892878266 wait complete. 2023-10-08T17:43:04.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.039+0000 7f032359d700 1 Processor -- start 2023-10-08T17:43:04.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.039+0000 7f032359d700 1 -- start start 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c06aaa0 0x7f031c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f031c13fb20 0x7f031c156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c0ac4a0 con 0x7f031c13fef0 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031c0ac780 con 0x7f031c13fb20 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.040+0000 7f032359d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031c0aca60 con 0x7f031c06aaa0 2023-10-08T17:43:04.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f032259b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c06aaa0 0x7f031c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44032/0 (socket says 172.21.15.12:44032) 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 -- 172.21.15.12:0/3780417185 learned_addr learned my addr 172.21.15.12:0/3780417185 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0321d9a700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f031c13fb20 0x7f031c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c06aaa0 msgr2=0x7f031c159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c06aaa0 0x7f031c159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f031c13fb20 msgr2=0x7f031c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f031c13fb20 0x7f031c156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 -- 172.21.15.12:0/3780417185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c0093c0 con 0x7f031c13fef0 2023-10-08T17:43:04.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.041+0000 7f0322d9c700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f03140015f0 tx=0x7f0314001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.042+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400a8b0 con 0x7f031c13fef0 2023-10-08T17:43:04.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.042+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031400aa10 con 0x7f031c13fef0 2023-10-08T17:43:04.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.042+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c0af880 con 0x7f031c13fef0 2023-10-08T17:43:04.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.042+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031400ad90 con 0x7f031c13fef0 2023-10-08T17:43:04.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.042+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031c0ac0e0 con 0x7f031c13fef0 2023-10-08T17:43:04.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.043+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031c04c3c0 con 0x7f031c13fef0 2023-10-08T17:43:04.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.044+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f0314007300 con 0x7f031c13fef0 2023-10-08T17:43:04.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.044+0000 7f03127fc700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 0x7f0300069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.045+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f0314084e30 con 0x7f031c13fef0 2023-10-08T17:43:04.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.045+0000 7f032259b700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 msgr2=0x7f0300069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:04.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.045+0000 7f032259b700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 0x7f0300069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:04.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.049+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0314051ab0 con 0x7f031c13fef0 2023-10-08T17:43:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.246+0000 7f032259b700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 msgr2=0x7f0300069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:04.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.246+0000 7f032259b700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 0x7f0300069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.298+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f031c15ae70 con 0x7f031c13fef0 2023-10-08T17:43:04.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.298+0000 7f03127fc700 1 -- 172.21.15.12:0/3780417185 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f031c15ae70 con 0x7f031c13fef0 2023-10-08T17:43:04.299 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:04.299 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:43:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 msgr2=0x7f0300069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 0x7f0300069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 msgr2=0x7f031c0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f03140015f0 tx=0x7f0314001a10 comp rx=0 tx=0).stop 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 shutdown_connections 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0300067170 0x7f0300069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f031c13fef0 0x7f031c0c7620 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f031c06aaa0 0x7f031c159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 --2- 172.21.15.12:0/3780417185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f031c13fb20 0x7f031c156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 >> 172.21.15.12:0/3780417185 conn(0x7f031c06d170 msgr2=0x7f031c0c2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 shutdown_connections 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.301+0000 7f032359d700 1 -- 172.21.15.12:0/3780417185 wait complete. 2023-10-08T17:43:04.303 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:43:04.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.514+0000 7f926d39d700 1 Processor -- start 2023-10-08T17:43:04.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.515+0000 7f926d39d700 1 -- start start 2023-10-08T17:43:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f926d39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 0x7f926815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f926d39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926815afd0 con 0x7f926815de50 2023-10-08T17:43:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f926d39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926815b2b0 con 0x7f92680cf110 2023-10-08T17:43:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f926d39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926815b590 con 0x7f9268153c30 2023-10-08T17:43:04.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f92677fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f926815de50 0x7f92680cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41948/0 (socket says 172.21.15.12:41948) 2023-10-08T17:43:04.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f92677fe700 1 -- 172.21.15.12:0/1758959363 learned_addr learned my addr 172.21.15.12:0/1758959363 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:04.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.516+0000 7f9267fff700 1 --2- 172.21.15.12:0/1758959363 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 0x7f926815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847893447 0 0) 0x7f926815afd0 con 0x7f926815de50 2023-10-08T17:43:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9250003570 con 0x7f926815de50 2023-10-08T17:43:04.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3712097412 0 0) 0x7f926815b2b0 con 0x7f92680cf110 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9267fff700 1 -- 172.21.15.12:0/1758959363 >> v1:172.21.15.29:6789/0 conn(0x7f92680cf110 legacy=0x7f926815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9267fff700 1 -- 172.21.15.12:0/1758959363 >> v1:172.21.15.12:6789/0 conn(0x7f926815de50 legacy=0x7f92680cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9267fff700 1 -- 172.21.15.12:0/1758959363 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926815b870 con 0x7f9268153c30 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9267fff700 1 --2- 172.21.15.12:0/1758959363 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 0x7f926815a5e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9258009910 tx=0x7f92580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85946c77106a93f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800b680 con 0x7f9268153c30 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800b7e0 con 0x7f9268153c30 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.517+0000 7f9266ffd700 1 -- 172.21.15.12:0/1758959363 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800bba0 con 0x7f9268153c30 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 -- 172.21.15.12:0/1758959363 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 msgr2=0x7f926815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 --2- 172.21.15.12:0/1758959363 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 0x7f926815a5e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9258009910 tx=0x7f92580091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 -- 172.21.15.12:0/1758959363 shutdown_connections 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 --2- 172.21.15.12:0/1758959363 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9268153c30 0x7f926815a5e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 -- 172.21.15.12:0/1758959363 >> 172.21.15.12:0/1758959363 conn(0x7f92680703a0 msgr2=0x7f92680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 -- 172.21.15.12:0/1758959363 shutdown_connections 2023-10-08T17:43:04.521 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.518+0000 7f926d39d700 1 -- 172.21.15.12:0/1758959363 wait complete. 2023-10-08T17:43:04.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.520+0000 7f926d39d700 1 Processor -- start 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.520+0000 7f926d39d700 1 -- start start 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 0x7f92680b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926815de50 0x7f92680b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680c84b0 con 0x7f92680cf110 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92680cc520 con 0x7f9268153c30 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926d39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92680cc800 con 0x7f926815de50 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f9267fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 0x7f92680b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f9267fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44044/0 (socket says 172.21.15.12:44044) 2023-10-08T17:43:04.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f9267fff700 1 -- 172.21.15.12:0/3546638372 learned_addr learned my addr 172.21.15.12:0/3546638372 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f926cb9c700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926815de50 0x7f92680b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926815de50 msgr2=0x7f92680b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926815de50 0x7f92680b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 msgr2=0x7f92680cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f92677fe700 1 -- 172.21.15.12:0/3546638372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9258009420 con 0x7f9268153c30 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.521+0000 7f9267fff700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:04.524 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f92677fe700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 0x7f92680b5bb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f925c0058d0 tx=0x7f925c007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c00ce30 con 0x7f9268153c30 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c005b30 con 0x7f9268153c30 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c0070d0 con 0x7f9268153c30 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92680ccae0 con 0x7f9268153c30 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.522+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92680b60f0 con 0x7f9268153c30 2023-10-08T17:43:04.525 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.523+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92680c8660 con 0x7f9268153c30 2023-10-08T17:43:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.524+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f925c007440 con 0x7f9268153c30 2023-10-08T17:43:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.525+0000 7f924ffff700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 0x7f9254069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.525+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f925c083dd0 con 0x7f9268153c30 2023-10-08T17:43:04.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.525+0000 7f9267fff700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 msgr2=0x7f9254069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:04.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.525+0000 7f9267fff700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 0x7f9254069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:04.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.530+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f925c04b5a0 con 0x7f9268153c30 2023-10-08T17:43:04.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.726+0000 7f9267fff700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 msgr2=0x7f9254069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:04.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.726+0000 7f9267fff700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 0x7f9254069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:04.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.734+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926804c3c0 con 0x7f9268153c30 2023-10-08T17:43:04.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.735+0000 7f924ffff700 1 -- 172.21.15.12:0/3546638372 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+16661 (secure 0 0 0) 0x7f925c017020 con 0x7f9268153c30 2023-10-08T17:43:04.736 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:04.736 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":199,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:41:57.373697+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"198","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3918380727":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1078921898":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/950766230":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1980873617":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6837/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/2635857507":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6836/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1058352909":"2023-10-09T17:41:57.373646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:04.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 msgr2=0x7f9254069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 0x7f9254069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 msgr2=0x7f92680b5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 0x7f92680b5bb0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f925c0058d0 tx=0x7f925c007d10 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 shutdown_connections 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9254067170 0x7f9254069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f92680cf110 0x7f92680cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f926815de50 0x7f92680b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 --2- 172.21.15.12:0/3546638372 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9268153c30 0x7f92680b5bb0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.739 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 >> 172.21.15.12:0/3546638372 conn(0x7f92680703a0 msgr2=0x7f926815bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:04.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 shutdown_connections 2023-10-08T17:43:04.740 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.737+0000 7f926d39d700 1 -- 172.21.15.12:0/3546638372 wait complete. 2023-10-08T17:43:04.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T17:41:38.653774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '197', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T17:41:39.901789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '198', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T17:43:04.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:43:04.817 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:04.817+0000 7f096ed61180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:04.854 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:04.853+0000 7f192bf79180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.953+0000 7f09ba39d700 1 Processor -- start 2023-10-08T17:43:04.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.953+0000 7f09ba39d700 1 -- start start 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.954+0000 7f09ba39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.954+0000 7f09ba39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09b415de50 0x7f09b415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.954+0000 7f09ba39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b415af60 con 0x7f09b40cea00 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.954+0000 7f09ba39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b415d010 con 0x7f09b415de50 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.954+0000 7f09ba39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b415b240 con 0x7f09b4153a00 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b8b9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f09b415de50 0x7f09b415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36768/0 (socket says 172.21.15.12:36768) 2023-10-08T17:43:04.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 -- 172.21.15.12:0/2338396265 learned_addr learned my addr 172.21.15.12:0/2338396265 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:04.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b9b9c700 1 --1- 172.21.15.12:0/2338396265 >> v1:172.21.15.29:6789/0 conn(0x7f09b40cea00 0x7f09b40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52814/0 (socket says 172.21.15.12:52814) 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 -- 172.21.15.12:0/2338396265 >> v2:172.21.15.29:3300/0 conn(0x7f09b415de50 msgr2=0x7f09b415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 --2- 172.21.15.12:0/2338396265 >> v2:172.21.15.29:3300/0 conn(0x7f09b415de50 0x7f09b415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 -- 172.21.15.12:0/2338396265 >> v1:172.21.15.29:6789/0 conn(0x7f09b40cea00 legacy=0x7f09b40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09b939b700 1 -- 172.21.15.12:0/2338396265 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b415b520 con 0x7f09b4153a00 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.955+0000 7f09abfff700 1 -- 172.21.15.12:0/2338396265 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2382574786 0 0) 0x7f09b415af60 con 0x7f09b40cea00 2023-10-08T17:43:04.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09b939b700 1 --2- 172.21.15.12:0/2338396265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09b00099b0 tx=0x7f09b0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a7f23c0580d8ca1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09abfff700 1 -- 172.21.15.12:0/2338396265 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0009ea0 con 0x7f09b4153a00 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09abfff700 1 -- 172.21.15.12:0/2338396265 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000b860 con 0x7f09b4153a00 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09abfff700 1 -- 172.21.15.12:0/2338396265 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b000bc00 con 0x7f09b4153a00 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 -- 172.21.15.12:0/2338396265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 msgr2=0x7f09b4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2338396265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f09b00099b0 tx=0x7f09b0009250 comp rx=0 tx=0).stop 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 -- 172.21.15.12:0/2338396265 shutdown_connections 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2338396265 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b4153dd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2338396265 >> v2:172.21.15.29:3300/0 conn(0x7f09b415de50 0x7f09b415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.956+0000 7f09ba39d700 1 -- 172.21.15.12:0/2338396265 >> 172.21.15.12:0/2338396265 conn(0x7f09b40703a0 msgr2=0x7f09b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:04.959 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.957+0000 7f09ba39d700 1 -- 172.21.15.12:0/2338396265 shutdown_connections 2023-10-08T17:43:04.960 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.957+0000 7f09ba39d700 1 -- 172.21.15.12:0/2338396265 wait complete. 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.958+0000 7f09ba39d700 1 Processor -- start 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.958+0000 7f09ba39d700 1 -- start start 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b41576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b415de50 0x7f09b4157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40c8120 con 0x7f09b40cea00 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40b2600 con 0x7f09b415de50 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09ba39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b40b19f0 con 0x7f09b4153a00 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09b939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09b939b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44050/0 (socket says 172.21.15.12:44050) 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09b939b700 1 -- 172.21.15.12:0/2079132108 learned_addr learned my addr 172.21.15.12:0/2079132108 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09b8b9a700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b41576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.959+0000 7f09b9b9c700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b415de50 0x7f09b4157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 msgr2=0x7f09b41576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b41576f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b415de50 msgr2=0x7f09b4157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b415de50 0x7f09b4157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 -- 172.21.15.12:0/2079132108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b00094f0 con 0x7f09b40cea00 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09b939b700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f09b415b380 tx=0x7f09b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:04.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0000d10 con 0x7f09b40cea00 2023-10-08T17:43:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b000bbe0 con 0x7f09b40cea00 2023-10-08T17:43:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b0011690 con 0x7f09b40cea00 2023-10-08T17:43:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b40b1cd0 con 0x7f09b40cea00 2023-10-08T17:43:04.965 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.960+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b40b2290 con 0x7f09b40cea00 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.962+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b404c3c0 con 0x7f09b40cea00 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.962+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f09b0011ac0 con 0x7f09b40cea00 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.963+0000 7f09a97fa700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 0x7f0998069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.963+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f09b0086500 con 0x7f09b40cea00 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.963+0000 7f09b8b9a700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 msgr2=0x7f0998069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:04.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.963+0000 7f09b8b9a700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 0x7f0998069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:04.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:04.968+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09b0053100 con 0x7f09b40cea00 2023-10-08T17:43:04.990 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:04.990+0000 7f096ed61180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:05.043 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.042+0000 7f192bf79180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:05.079 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.078+0000 7f096ed61180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:05.132 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.131+0000 7f192bf79180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:05.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.164+0000 7f09b8b9a700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 msgr2=0x7f0998069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:05.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.164+0000 7f09b8b9a700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 0x7f0998069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.189+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09b415b800 con 0x7f09b40cea00 2023-10-08T17:43:05.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.189+0000 7f09a97fa700 1 -- 172.21.15.12:0/2079132108 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v199) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09b0056720 con 0x7f09b40cea00 2023-10-08T17:43:05.191 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:43:05.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 msgr2=0x7f0998069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 0x7f0998069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 msgr2=0x7f09b4150950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f09b415b380 tx=0x7f09b0017000 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 shutdown_connections 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0998067170 0x7f0998069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f09b40cea00 0x7f09b4150950 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f09b415de50 0x7f09b4157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 --2- 172.21.15.12:0/2079132108 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f09b4153a00 0x7f09b41576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 >> 172.21.15.12:0/2079132108 conn(0x7f09b40703a0 msgr2=0x7f09b4158a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:05.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 shutdown_connections 2023-10-08T17:43:05.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.192+0000 7f09ba39d700 1 -- 172.21.15.12:0/2079132108 wait complete. 2023-10-08T17:43:05.213 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T17:43:05.311 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.311+0000 7f096ed61180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:05.369 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.368+0000 7f192bf79180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:05.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.403+0000 7f14ab59d700 1 Processor -- start 2023-10-08T17:43:05.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.403+0000 7f14ab59d700 1 -- start start 2023-10-08T17:43:05.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14ab59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14a4153dd0 0x7f14a415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14ab59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 0x7f14a40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14ab59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a415ac50 con 0x7f14a4153a00 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14ab59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a415d010 con 0x7f14a4153dd0 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14ab59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40cf3e0 con 0x7f14a40cea00 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14a9d9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14a4153dd0 0x7f14a415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14aad9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 0x7f14a40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14aad9c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 0x7f14a40ceea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36778/0 (socket says 172.21.15.12:36778) 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14a9d9a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f14a4153dd0 0x7f14a415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46116/0 (socket says 172.21.15.12:46116) 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14aad9c700 1 -- 172.21.15.12:0/2576503915 learned_addr learned my addr 172.21.15.12:0/2576503915 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14a9d9a700 1 -- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 msgr2=0x7f14a40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.405+0000 7f14a9d9a700 1 --2- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 0x7f14a40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9d9a700 1 -- 172.21.15.12:0/2576503915 >> v1:172.21.15.29:6789/0 conn(0x7f14a4153a00 legacy=0x7f14a415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9d9a700 1 -- 172.21.15.12:0/2576503915 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a415af60 con 0x7f14a4153dd0 2023-10-08T17:43:05.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9d9a700 1 --2- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a4153dd0 0x7f14a415de50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f14940098e0 tx=0x7f14940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c56cd33dc190e346 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9599700 1 -- 172.21.15.12:0/2576503915 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400b640 con 0x7f14a4153dd0 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9599700 1 -- 172.21.15.12:0/2576503915 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149400b7a0 con 0x7f14a4153dd0 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.406+0000 7f14a9599700 1 -- 172.21.15.12:0/2576503915 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149400bb40 con 0x7f14a4153dd0 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 -- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a4153dd0 msgr2=0x7f14a415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 --2- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a4153dd0 0x7f14a415de50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f14940098e0 tx=0x7f14940091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 -- 172.21.15.12:0/2576503915 shutdown_connections 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 --2- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a40cea00 0x7f14a40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 --2- 172.21.15.12:0/2576503915 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a4153dd0 0x7f14a415de50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 -- 172.21.15.12:0/2576503915 >> 172.21.15.12:0/2576503915 conn(0x7f14a40703a0 msgr2=0x7f14a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 -- 172.21.15.12:0/2576503915 shutdown_connections 2023-10-08T17:43:05.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.407+0000 7f14ab59d700 1 -- 172.21.15.12:0/2576503915 wait complete. 2023-10-08T17:43:05.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.408+0000 7f14ab59d700 1 Processor -- start 2023-10-08T17:43:05.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 -- start start 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a4153a00 0x7f14a40c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a4153dd0 0x7f14a4152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a4146580 con 0x7f14a4153dd0 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40c9650 con 0x7f14a40cea00 2023-10-08T17:43:05.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.409+0000 7f14ab59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a40c8a40 con 0x7f14a4153a00 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aad9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a4153dd0 0x7f14a4152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46126/0 (socket says 172.21.15.12:46126) 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 -- 172.21.15.12:0/3357641242 learned_addr learned my addr 172.21.15.12:0/3357641242 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14a9d9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a4153a00 0x7f14a40c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a4153a00 msgr2=0x7f14a40c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a4153a00 0x7f14a40c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a4153dd0 msgr2=0x7f14a4152ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a4153dd0 0x7f14a4152ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 -- 172.21.15.12:0/3357641242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1494009420 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.410+0000 7f14aa59b700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c590 tx=0x7f14a000c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.411+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011590 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.411+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0011710 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.411+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a40c8d20 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.411+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0011ad0 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.411+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a40c92e0 con 0x7f14a40cea00 2023-10-08T17:43:05.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.412+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a404c3c0 con 0x7f14a40cea00 2023-10-08T17:43:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.413+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f14a001b3b0 con 0x7f14a40cea00 2023-10-08T17:43:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.414+0000 7f149a7fc700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 0x7f1488069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.414+0000 7f14a9d9a700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 msgr2=0x7f1488069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.414+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7f14a0084100 con 0x7f14a40cea00 2023-10-08T17:43:05.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.414+0000 7f14a9d9a700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 0x7f1488069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:05.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.418+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a0050d00 con 0x7f14a40cea00 2023-10-08T17:43:05.498 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.498+0000 7f096ed61180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:05.558 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.557+0000 7f192bf79180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:05.594 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.593+0000 7f096ed61180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:05.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.615+0000 7f14a9d9a700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 msgr2=0x7f1488069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:05.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.615+0000 7f14a9d9a700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 0x7f1488069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.620+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f14a415b240 con 0x7f14a40cea00 2023-10-08T17:43:05.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.621+0000 7f149a7fc700 1 -- 172.21.15.12:0/3357641242 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v199) v1 ==== 104+0+11 (secure 0 0 0) 0x7f14a00170a0 con 0x7f14a40cea00 2023-10-08T17:43:05.622 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T17:43:05.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 msgr2=0x7f1488069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 0x7f1488069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 msgr2=0x7f14a4146040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f14a000c590 tx=0x7f14a000c8a0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 shutdown_connections 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1488067170 0x7f1488069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f14a4153dd0 0x7f14a4152ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f14a40cea00 0x7f14a4146040 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 --2- 172.21.15.12:0/3357641242 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f14a4153a00 0x7f14a40c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 >> 172.21.15.12:0/3357641242 conn(0x7f14a40703a0 msgr2=0x7f14a41520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 shutdown_connections 2023-10-08T17:43:05.625 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.623+0000 7f14ab59d700 1 -- 172.21.15.12:0/3357641242 wait complete. 2023-10-08T17:43:05.642 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T17:43:05.656 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.655+0000 7f192bf79180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:05.761 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.761+0000 7f096ed61180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:05.826 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.825+0000 7f192bf79180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:05.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.836+0000 7fb4a4d9d700 1 Processor -- start 2023-10-08T17:43:05.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.836+0000 7fb4a4d9d700 1 -- start start 2023-10-08T17:43:05.838 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb4a4d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4a006a210 0x7fb4a00c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb4a4d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006de50 0x7fb4a00c7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb4a4d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a015b640 con 0x7fb4a0140a70 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb4a4d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00c6800 con 0x7fb4a006a210 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb4a4d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015b920 con 0x7fb4a006de50 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb49effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4a006a210 0x7fb4a00c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb49effd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb4a006a210 0x7fb4a00c6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44060/0 (socket says 172.21.15.12:44060) 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb49f7fe700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fb4a0140a70 0x7fb4a0069b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52840/0 (socket says 172.21.15.12:52840) 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49f7fe700 1 -- 172.21.15.12:0/2872427171 learned_addr learned my addr 172.21.15.12:0/2872427171 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:05.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.837+0000 7fb49ffff700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006de50 0x7fb4a00c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49effd700 1 -- 172.21.15.12:0/2872427171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006de50 msgr2=0x7fb4a00c7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49effd700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006de50 0x7fb4a00c7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49effd700 1 -- 172.21.15.12:0/2872427171 >> v1:172.21.15.29:6789/0 conn(0x7fb4a0140a70 legacy=0x7fb4a0069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49e7fc700 1 -- 172.21.15.12:0/2872427171 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112159707 0 0) 0x7fb4a015b640 con 0x7fb4a0140a70 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49effd700 1 -- 172.21.15.12:0/2872427171 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a015bc00 con 0x7fb4a006a210 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.838+0000 7fb49effd700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006a210 0x7fb4a00c6c50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb4940098e0 tx=0x7fb4940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27be5a55e540caed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb49e7fc700 1 -- 172.21.15.12:0/2872427171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400b640 con 0x7fb4a006a210 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb49e7fc700 1 -- 172.21.15.12:0/2872427171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49400b7a0 con 0x7fb4a006a210 2023-10-08T17:43:05.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb49e7fc700 1 -- 172.21.15.12:0/2872427171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400bb40 con 0x7fb4a006a210 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/2872427171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006a210 msgr2=0x7fb4a00c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006a210 0x7fb4a00c6c50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fb4940098e0 tx=0x7fb4940091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/2872427171 shutdown_connections 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006de50 0x7fb4a00c7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/2872427171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006a210 0x7fb4a00c6c50 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/2872427171 >> 172.21.15.12:0/2872427171 conn(0x7fb4a006d110 msgr2=0x7fb4a00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/2872427171 shutdown_connections 2023-10-08T17:43:05.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.839+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/2872427171 wait complete. 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.841+0000 7fb4a4d9d700 1 Processor -- start 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.841+0000 7fb4a4d9d700 1 -- start start 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006a210 0x7fb4a016c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4a0140a70 0x7fb4a013f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00b1230 con 0x7fb4a006de50 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00c32f0 con 0x7fb4a0140a70 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb4a4d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00c35d0 con 0x7fb4a006a210 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb49effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb49effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44066/0 (socket says 172.21.15.12:44066) 2023-10-08T17:43:05.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb49effd700 1 -- 172.21.15.12:0/3106868311 learned_addr learned my addr 172.21.15.12:0/3106868311 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb49f7fe700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006a210 0x7fb4a016c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.842+0000 7fb49ffff700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4a0140a70 0x7fb4a013f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006a210 msgr2=0x7fb4a016c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006a210 0x7fb4a016c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4a0140a70 msgr2=0x7fb4a013f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4a0140a70 0x7fb4a013f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:05.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 -- 172.21.15.12:0/3106868311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb494009420 con 0x7fb4a006de50 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb49effd700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fb494013000 tx=0x7fb494017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49400bb20 con 0x7fb4a006de50 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494000c90 con 0x7fb4a006de50 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494011630 con 0x7fb4a006de50 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.843+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a00c38b0 con 0x7fb4a006de50 2023-10-08T17:43:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.844+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a016a510 con 0x7fb4a006de50 2023-10-08T17:43:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.845+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a004c3c0 con 0x7fb4a006de50 2023-10-08T17:43:05.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.846+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fb4940119a0 con 0x7fb4a006de50 2023-10-08T17:43:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.847+0000 7fb4877fe700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 0x7fb48c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.847+0000 7fb49f7fe700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 msgr2=0x7fb48c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.847+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7fb494085e70 con 0x7fb4a006de50 2023-10-08T17:43:05.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.847+0000 7fb49f7fe700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 0x7fb48c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:05.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:05.851+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb494052a70 con 0x7fb4a006de50 2023-10-08T17:43:05.867 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:05.867+0000 7f096ed61180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:05.934 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:05.933+0000 7f192bf79180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.048+0000 7fb49f7fe700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 msgr2=0x7fb48c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:06.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.048+0000 7fb49f7fe700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 0x7fb48c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:06.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.054+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4a015bee0 con 0x7fb4a006de50 2023-10-08T17:43:06.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.055+0000 7fb4877fe700 1 -- 172.21.15.12:0/3106868311 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v199) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb494015020 con 0x7fb4a006de50 2023-10-08T17:43:06.056 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 msgr2=0x7fb48c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 0x7fb48c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 msgr2=0x7fb4a00b0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fb494013000 tx=0x7fb494017000 comp rx=0 tx=0).stop 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 shutdown_connections 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb48c067170 0x7fb48c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb4a0140a70 0x7fb4a013f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb4a006a210 0x7fb4a016c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.059 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 --2- 172.21.15.12:0/3106868311 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb4a006de50 0x7fb4a00b0770 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 >> 172.21.15.12:0/3106868311 conn(0x7fb4a006d110 msgr2=0x7fb4a00c0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:06.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 shutdown_connections 2023-10-08T17:43:06.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.057+0000 7fb4a4d9d700 1 -- 172.21.15.12:0/3106868311 wait complete. 2023-10-08T17:43:06.077 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:06.315 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.314+0000 7fe6d099d700 1 Processor -- start 2023-10-08T17:43:06.316 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.314+0000 7fe6d099d700 1 -- start start 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6cc13fef0 0x7fe6cc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fe6cc06aaa0 0x7fe6cc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc0c8410 con 0x7fe6cc13fef0 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6cc15ae70 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6d099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc06af60 con 0x7fe6cc13fb20 2023-10-08T17:43:06.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6caffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6cc13fef0 0x7fe6cc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6caffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fe6cc13fef0 0x7fe6cc0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44082/0 (socket says 172.21.15.12:44082) 2023-10-08T17:43:06.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6caffd700 1 -- 172.21.15.12:0/823819153 learned_addr learned my addr 172.21.15.12:0/823819153 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:06.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6cb7fe700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.316+0000 7fe6cbfff700 1 --2- 172.21.15.12:0/823819153 >> v2:172.21.15.29:3300/0 conn(0x7fe6cc06aaa0 0x7fe6cc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 -- 172.21.15.12:0/823819153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 msgr2=0x7fe6cc15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 -- 172.21.15.12:0/823819153 >> v2:172.21.15.29:3300/0 conn(0x7fe6cc06aaa0 msgr2=0x7fe6cc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 --2- 172.21.15.12:0/823819153 >> v2:172.21.15.29:3300/0 conn(0x7fe6cc06aaa0 0x7fe6cc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 -- 172.21.15.12:0/823819153 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6cc06b240 con 0x7fe6cc13fef0 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6caffd700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0c7990 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc156920 tx=0x7fe6c0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c69d0da3c7741fe server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6ca7fc700 1 -- 172.21.15.12:0/823819153 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0005c10 con 0x7fe6cc13fef0 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6ca7fc700 1 -- 172.21.15.12:0/823819153 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c0005d70 con 0x7fe6cc13fef0 2023-10-08T17:43:06.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.317+0000 7fe6ca7fc700 1 -- 172.21.15.12:0/823819153 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c0006260 con 0x7fe6cc13fef0 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 -- 172.21.15.12:0/823819153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc13fef0 msgr2=0x7fe6cc0c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0c7990 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc156920 tx=0x7fe6c0009220 comp rx=0 tx=0).stop 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 -- 172.21.15.12:0/823819153 shutdown_connections 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 --2- 172.21.15.12:0/823819153 >> v2:172.21.15.29:3300/0 conn(0x7fe6cc06aaa0 0x7fe6cc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 --2- 172.21.15.12:0/823819153 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0c7990 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 -- 172.21.15.12:0/823819153 >> 172.21.15.12:0/823819153 conn(0x7fe6cc06d170 msgr2=0x7fe6cc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 -- 172.21.15.12:0/823819153 shutdown_connections 2023-10-08T17:43:06.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.318+0000 7fe6d099d700 1 -- 172.21.15.12:0/823819153 wait complete. 2023-10-08T17:43:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.319+0000 7fe6d099d700 1 Processor -- start 2023-10-08T17:43:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.319+0000 7fe6d099d700 1 -- start start 2023-10-08T17:43:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc0ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc16a0d0 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc158320 con 0x7fe6cc13fef0 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.320+0000 7fe6d099d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6cc0ae2d0 con 0x7fe6cc13fb20 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44092/0 (socket says 172.21.15.12:44092) 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 -- 172.21.15.12:0/2049837277 learned_addr learned my addr 172.21.15.12:0/2049837277 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6caffd700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc0ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cbfff700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 msgr2=0x7fe6cc0ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc0ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6cc13fef0 msgr2=0x7fe6cc0adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0adc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 -- 172.21.15.12:0/2049837277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c0009480 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6cb7fe700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00ec80 tx=0x7fe6bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.321+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00c850 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.322+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6bc00c9d0 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.322+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6bc00cd90 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.322+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6cc0ae5b0 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.322+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6cc157f80 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.323+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6cc0aeab0 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.324+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fe6bc013680 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.325+0000 7fe6b37fe700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 0x7fe6b8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.325+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6541+0+0 (secure 0 0 0) 0x7fe6bc085750 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.325+0000 7fe6caffd700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 msgr2=0x7fe6b8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:06.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.325+0000 7fe6caffd700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 0x7fe6b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:06.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.331+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6bc052300 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.373 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:06.373+0000 7f096ed61180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:06.451 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:06.450+0000 7f192bf79180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:06.472 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:06.471+0000 7f096ed61180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.526+0000 7fe6caffd700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 msgr2=0x7fe6b8069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:06.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.526+0000 7fe6caffd700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 0x7fe6b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:06.555 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:06.554+0000 7f192bf79180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:06.573 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:06.572+0000 7f096ed61180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:06.585 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.584+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6cc0cb000 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.585+0000 7fe6b37fe700 1 -- 172.21.15.12:0/2049837277 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7fe6bc055920 con 0x7fe6cc06aaa0 2023-10-08T17:43:06.586 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:06.586 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 msgr2=0x7fe6b8069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 0x7fe6b8069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 msgr2=0x7fe6cc155df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fe6bc00ec80 tx=0x7fe6bc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 shutdown_connections 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fe6b8067170 0x7fe6b8069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fe6cc06aaa0 0x7fe6cc155df0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fe6cc13fef0 0x7fe6cc0adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.589 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 --2- 172.21.15.12:0/2049837277 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fe6cc13fb20 0x7fe6cc0ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.587+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 >> 172.21.15.12:0/2049837277 conn(0x7fe6cc06d170 msgr2=0x7fe6cc0c1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:06.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.588+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 shutdown_connections 2023-10-08T17:43:06.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.588+0000 7fe6d099d700 1 -- 172.21.15.12:0/2049837277 wait complete. 2023-10-08T17:43:06.590 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:43:06.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:06.660 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:06.658+0000 7f192bf79180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:06.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.804+0000 7f994719d700 1 Processor -- start 2023-10-08T17:43:06.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.804+0000 7f994719d700 1 -- start start 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.805+0000 7f994719d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9940153c30 0x7f994015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.805+0000 7f994719d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994015afd0 con 0x7f994015de50 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.805+0000 7f994719d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994015b2b0 con 0x7f99400cf110 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.805+0000 7f994719d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f994015b590 con 0x7f9940153c30 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9940153c30 0x7f994015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994599a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f994015de50 0x7f99400cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41958/0 (socket says 172.21.15.12:41958) 2023-10-08T17:43:06.807 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994599a700 1 -- 172.21.15.12:0/514755975 learned_addr learned my addr 172.21.15.12:0/514755975 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9940153c30 0x7f994015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44094/0 (socket says 172.21.15.12:44094) 2023-10-08T17:43:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 -- 172.21.15.12:0/514755975 >> v1:172.21.15.29:6789/0 conn(0x7f99400cf110 legacy=0x7f994015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 -- 172.21.15.12:0/514755975 >> v1:172.21.15.12:6789/0 conn(0x7f994015de50 legacy=0x7f99400cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f9945199700 1 -- 172.21.15.12:0/514755975 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2612358806 0 0) 0x7f994015afd0 con 0x7f994015de50 2023-10-08T17:43:06.808 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 -- 172.21.15.12:0/514755975 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994015b870 con 0x7f9940153c30 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.806+0000 7f994619b700 1 --2- 172.21.15.12:0/514755975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9940153c30 0x7f994015a5e0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4812b513e812e44f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f9945199700 1 -- 172.21.15.12:0/514755975 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c009e80 con 0x7f9940153c30 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f9945199700 1 -- 172.21.15.12:0/514755975 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c00b860 con 0x7f9940153c30 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f9945199700 1 -- 172.21.15.12:0/514755975 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c00bbe0 con 0x7f9940153c30 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 -- 172.21.15.12:0/514755975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9940153c30 msgr2=0x7f994015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 --2- 172.21.15.12:0/514755975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9940153c30 0x7f994015a5e0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f993c0098e0 tx=0x7f993c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 -- 172.21.15.12:0/514755975 shutdown_connections 2023-10-08T17:43:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 --2- 172.21.15.12:0/514755975 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9940153c30 0x7f994015a5e0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 -- 172.21.15.12:0/514755975 >> 172.21.15.12:0/514755975 conn(0x7f99400703a0 msgr2=0x7f99400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 -- 172.21.15.12:0/514755975 shutdown_connections 2023-10-08T17:43:06.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.807+0000 7f994719d700 1 -- 172.21.15.12:0/514755975 wait complete. 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.809+0000 7f994719d700 1 Processor -- start 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.809+0000 7f994719d700 1 -- start start 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 0x7f99400c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f994015de50 0x7f99400c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.813 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400c8d60 con 0x7f99400cf110 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9940152850 con 0x7f994015de50 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994719d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400b3570 con 0x7f9940153c30 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994619b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44098/0 (socket says 172.21.15.12:44098) 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994619b700 1 -- 172.21.15.12:0/3357949019 learned_addr learned my addr 172.21.15.12:0/3357949019 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994699c700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f994015de50 0x7f99400c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994599a700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 0x7f99400c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994619b700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 msgr2=0x7f99400c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.810+0000 7f994619b700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 0x7f99400c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.814 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994619b700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f994015de50 msgr2=0x7f99400c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994619b700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f994015de50 0x7f99400c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994619b700 1 -- 172.21.15.12:0/3357949019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c009420 con 0x7f99400cf110 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994599a700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 0x7f99400c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994619b700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f994006eb00 tx=0x7f993c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c01f070 con 0x7f99400cf110 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c000c90 con 0x7f99400cf110 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400c8150 con 0x7f99400cf110 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c025420 con 0x7f99400cf110 2023-10-08T17:43:06.815 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.811+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400c8710 con 0x7f99400cf110 2023-10-08T17:43:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.812+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f994004c3c0 con 0x7f99400cf110 2023-10-08T17:43:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.813+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f993c023070 con 0x7f99400cf110 2023-10-08T17:43:06.816 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.815+0000 7f99367fc700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 0x7f9924069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.815+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f993c086250 con 0x7f99400cf110 2023-10-08T17:43:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.815+0000 7f994599a700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 msgr2=0x7f9924069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:06.817 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.815+0000 7f994599a700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 0x7f9924069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:06.820 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:06.819+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f993c052e10 con 0x7f99400cf110 2023-10-08T17:43:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.016+0000 7f994599a700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 msgr2=0x7f9924069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:07.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.016+0000 7f994599a700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 0x7f9924069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:07.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.035+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f994015bb50 con 0x7f99400cf110 2023-10-08T17:43:07.037 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.036+0000 7f99367fc700 1 -- 172.21.15.12:0/3357949019 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+16773 (secure 0 0 0) 0x7f993c056430 con 0x7f99400cf110 2023-10-08T17:43:07.038 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:07.038 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":200,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:06.475092+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":200,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3918380727":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1078921898":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/950766230":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1980873617":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6837/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/2635857507":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6836/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1058352909":"2023-10-09T17:41:57.373646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 msgr2=0x7f9924069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 0x7f9924069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 msgr2=0x7f9940152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f994006eb00 tx=0x7f993c017000 comp rx=0 tx=0).stop 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 shutdown_connections 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9924067170 0x7f9924069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f99400cf110 0x7f9940152310 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f994015de50 0x7f99400c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 --2- 172.21.15.12:0/3357949019 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9940153c30 0x7f99400c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 >> 172.21.15.12:0/3357949019 conn(0x7f99400703a0 msgr2=0x7f9940153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:07.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 shutdown_connections 2023-10-08T17:43:07.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.039+0000 7f994719d700 1 -- 172.21.15.12:0/3357949019 wait complete. 2023-10-08T17:43:07.059 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:43:07.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:07.234 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:07.233+0000 7f096ed61180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:07.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.277+0000 7f7db359e700 1 Processor -- start 2023-10-08T17:43:07.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.277+0000 7f7db359e700 1 -- start start 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db359e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7db4159550 0x7f7db40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 0x7f7db40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db40acc00 con 0x7f7db4159920 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db359e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7db40abff0 con 0x7f7db4159550 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40ac2d0 con 0x7f7db415dfd0 2023-10-08T17:43:07.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7db4159550 0x7f7db40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 0x7f7db40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db259c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7db4159550 0x7f7db40ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46170/0 (socket says 172.21.15.12:46170) 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db259c700 1 -- 172.21.15.12:0/3420262839 learned_addr learned my addr 172.21.15.12:0/3420262839 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.279+0000 7f7db2d9d700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f7db4159920 0x7f7db40ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52858/0 (socket says 172.21.15.12:52858) 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db259c700 1 -- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 msgr2=0x7f7db40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db259c700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 0x7f7db40aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db259c700 1 -- 172.21.15.12:0/3420262839 >> v1:172.21.15.29:6789/0 conn(0x7f7db4159920 legacy=0x7f7db40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db259c700 1 -- 172.21.15.12:0/3420262839 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db40ac5b0 con 0x7f7db4159550 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db1d9b700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 0x7f7db40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db259c700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159550 0x7f7db40ceac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7da40099b0 tx=0x7f7da4009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4fc71385eeb189c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:07.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db159a700 1 -- 172.21.15.12:0/3420262839 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da4009ea0 con 0x7f7db4159550 2023-10-08T17:43:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db159a700 1 -- 172.21.15.12:0/3420262839 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da400b860 con 0x7f7db4159550 2023-10-08T17:43:07.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.280+0000 7f7db159a700 1 -- 172.21.15.12:0/3420262839 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da400bc00 con 0x7f7db4159550 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 -- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159550 msgr2=0x7f7db40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159550 0x7f7db40ceac0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f7da40099b0 tx=0x7f7da4009250 comp rx=0 tx=0).stop 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 -- 172.21.15.12:0/3420262839 shutdown_connections 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159550 0x7f7db40ceac0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 --2- 172.21.15.12:0/3420262839 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db415dfd0 0x7f7db40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 -- 172.21.15.12:0/3420262839 >> 172.21.15.12:0/3420262839 conn(0x7f7db406ce80 msgr2=0x7f7db40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:07.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 -- 172.21.15.12:0/3420262839 shutdown_connections 2023-10-08T17:43:07.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.281+0000 7f7db359e700 1 -- 172.21.15.12:0/3420262839 wait complete. 2023-10-08T17:43:07.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.282+0000 7f7db359e700 1 Processor -- start 2023-10-08T17:43:07.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.283+0000 7f7db359e700 1 -- start start 2023-10-08T17:43:07.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.283+0000 7f7db359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 0x7f7db413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.283+0000 7f7db359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7db415dfd0 0x7f7db4068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db413f6b0 con 0x7f7db415dfd0 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db41451c0 con 0x7f7db4159920 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db40cbab0 con 0x7f7db4159550 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 0x7f7db413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db259c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 0x7f7db413f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:36832/0 (socket says 172.21.15.12:36832) 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:46184/0 (socket says 172.21.15.12:46184) 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db259c700 1 -- 172.21.15.12:0/402606140 learned_addr learned my addr 172.21.15.12:0/402606140 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db2d9d700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7db415dfd0 0x7f7db4068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 msgr2=0x7f7db413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.288 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 0x7f7db413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7db415dfd0 msgr2=0x7f7db4068700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7db415dfd0 0x7f7db4068700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.284+0000 7f7db1d9b700 1 -- 172.21.15.12:0/402606140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8009420 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7db1d9b700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7da800ea00 tx=0x7f7da80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800c7f0 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800c950 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7db359e700 1 -- 172.21.15.12:0/402606140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da40094f0 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da800cd10 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.285+0000 7f7db359e700 1 -- 172.21.15.12:0/402606140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db40cb180 con 0x7f7db4159920 2023-10-08T17:43:07.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.286+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c0052b0 con 0x7f7db4159920 2023-10-08T17:43:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.287+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7da8013680 con 0x7f7db4159920 2023-10-08T17:43:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.288+0000 7f7da27fc700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 0x7f7d94069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.288+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f7da8084d30 con 0x7f7db4159920 2023-10-08T17:43:07.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.288+0000 7f7db259c700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 msgr2=0x7f7d94069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:07.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.288+0000 7f7db259c700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 0x7f7d94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:07.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.293+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7da8051820 con 0x7f7db4159920 2023-10-08T17:43:07.333 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:07.332+0000 7f192bf79180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:07.417 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:07.416+0000 7f096ed61180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:07.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.489+0000 7f7db259c700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 msgr2=0x7f7d94069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:07.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.489+0000 7f7db259c700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 0x7f7d94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:07.515 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:07.514+0000 7f192bf79180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:07.519 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:07.518+0000 7f096ed61180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:07.542 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.541+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d8c005560 con 0x7f7db4159920 2023-10-08T17:43:07.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.542+0000 7f7da27fc700 1 -- 172.21.15.12:0/402606140 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f7da8017090 con 0x7f7db4159920 2023-10-08T17:43:07.543 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:07.543 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.544+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 msgr2=0x7f7d94069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.544+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 0x7f7d94069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.544+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 msgr2=0x7f7db40681c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.544+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7da800ea00 tx=0x7f7da80091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.544+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 shutdown_connections 2023-10-08T17:43:07.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7d94067170 0x7f7d94069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7db415dfd0 0x7f7db4068700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7db4159550 0x7f7db413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 --2- 172.21.15.12:0/402606140 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7db4159920 0x7f7db40681c0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 >> 172.21.15.12:0/402606140 conn(0x7f7db406ce80 msgr2=0x7f7db40b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 shutdown_connections 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.545+0000 7f7d93fff700 1 -- 172.21.15.12:0/402606140 wait complete. 2023-10-08T17:43:07.547 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:43:07.563 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:07.620 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:07.619+0000 7f192bf79180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:07.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.755+0000 7f1d57fff700 1 Processor -- start 2023-10-08T17:43:07.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.755+0000 7f1d57fff700 1 -- start start 2023-10-08T17:43:07.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d58153c30 0x7f1d5815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d57fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d5815de50 0x7f1d580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d57fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5815afd0 con 0x7f1d580cef40 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d57fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5815b2b0 con 0x7f1d5815de50 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d57fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5815b590 con 0x7f1d58153c30 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d567fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d5815de50 0x7f1d580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d577fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f1d580cef40 0x7f1d5806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41960/0 (socket says 172.21.15.12:41960) 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d577fe700 1 -- 172.21.15.12:0/1234781857 learned_addr learned my addr 172.21.15.12:0/1234781857 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d567fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1d5815de50 0x7f1d580cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44122/0 (socket says 172.21.15.12:44122) 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d56ffd700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d58153c30 0x7f1d5815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d567fc700 1 -- 172.21.15.12:0/1234781857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d58153c30 msgr2=0x7f1d5815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:07.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d567fc700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d58153c30 0x7f1d5815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d567fc700 1 -- 172.21.15.12:0/1234781857 >> v1:172.21.15.12:6789/0 conn(0x7f1d580cef40 legacy=0x7f1d5806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.758+0000 7f1d567fc700 1 -- 172.21.15.12:0/1234781857 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5815b870 con 0x7f1d5815de50 2023-10-08T17:43:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.757+0000 7f1d55ffb700 1 -- 172.21.15.12:0/1234781857 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557506624 0 0) 0x7f1d5815afd0 con 0x7f1d580cef40 2023-10-08T17:43:07.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.758+0000 7f1d567fc700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d5815de50 0x7f1d580cea00 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098e0 tx=0x7f1d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d4cb3c678467bd server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.758+0000 7f1d55ffb700 1 -- 172.21.15.12:0/1234781857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00b640 con 0x7f1d5815de50 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.758+0000 7f1d55ffb700 1 -- 172.21.15.12:0/1234781857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4c00b7a0 con 0x7f1d5815de50 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.758+0000 7f1d55ffb700 1 -- 172.21.15.12:0/1234781857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4c00bb40 con 0x7f1d5815de50 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 -- 172.21.15.12:0/1234781857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d5815de50 msgr2=0x7f1d580cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d5815de50 0x7f1d580cea00 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098e0 tx=0x7f1d4c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 -- 172.21.15.12:0/1234781857 shutdown_connections 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d58153c30 0x7f1d5815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 --2- 172.21.15.12:0/1234781857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d5815de50 0x7f1d580cea00 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 -- 172.21.15.12:0/1234781857 >> 172.21.15.12:0/1234781857 conn(0x7f1d580703a0 msgr2=0x7f1d580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 -- 172.21.15.12:0/1234781857 shutdown_connections 2023-10-08T17:43:07.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.759+0000 7f1d57fff700 1 -- 172.21.15.12:0/1234781857 wait complete. 2023-10-08T17:43:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.761+0000 7f1d57fff700 1 Processor -- start 2023-10-08T17:43:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.761+0000 7f1d57fff700 1 -- start start 2023-10-08T17:43:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d58153c30 0x7f1d580b4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d5815de50 0x7f1d580b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580b54c0 con 0x7f1d580cef40 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d580c7680 con 0x7f1d58153c30 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d57fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5813e9d0 con 0x7f1d5815de50 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44136/0 (socket says 172.21.15.12:44136) 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 -- 172.21.15.12:0/736615292 learned_addr learned my addr 172.21.15.12:0/736615292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d567fc700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d58153c30 0x7f1d580b4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d577fe700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d5815de50 0x7f1d580b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d5815de50 msgr2=0x7f1d580b4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d5815de50 0x7f1d580b4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d58153c30 msgr2=0x7f1d580b4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d58153c30 0x7f1d580b4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.762+0000 7f1d56ffd700 1 -- 172.21.15.12:0/736615292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c009420 con 0x7f1d580cef40 2023-10-08T17:43:07.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d56ffd700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800ec80 tx=0x7f1d480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800c8e0 con 0x7f1d580cef40 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d4800ca40 con 0x7f1d580cef40 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d580c78f0 con 0x7f1d580cef40 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d4800cde0 con 0x7f1d580cef40 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.763+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d580c7eb0 con 0x7f1d580cef40 2023-10-08T17:43:07.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.764+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d580c80a0 con 0x7f1d580cef40 2023-10-08T17:43:07.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.766+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f1d48013680 con 0x7f1d580cef40 2023-10-08T17:43:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.767+0000 7f1d3effd700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 0x7f1d44069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.767+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f1d48084f70 con 0x7f1d580cef40 2023-10-08T17:43:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.767+0000 7f1d567fc700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 msgr2=0x7f1d44069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:07.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.767+0000 7f1d567fc700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 0x7f1d44069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:07.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.771+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d48051b30 con 0x7f1d580cef40 2023-10-08T17:43:07.822 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:07.821+0000 7f096ed61180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:07.923 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:07.921+0000 7f096ed61180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:07.928 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:07.927+0000 7f192bf79180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:07.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.968+0000 7f1d567fc700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 msgr2=0x7f1d44069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:07.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:07.968+0000 7f1d567fc700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 0x7f1d44069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:08.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.017+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d5804c3c0 con 0x7f1d580cef40 2023-10-08T17:43:08.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.018+0000 7f1d3effd700 1 -- 172.21.15.12:0/736615292 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4595 (secure 0 0 0) 0x7f1d48055150 con 0x7f1d580cef40 2023-10-08T17:43:08.019 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:08.019 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":91,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:41:40.911321+0000","modified":"2023-10-08T17:41:44.443963+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9789},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9789":{"gid":9789,"name":"c","rank":0,"incarnation":88,"state":"up:active","state_seq":3,"addr":"172.21.15.12:6835/184729302","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":184729302},{"type":"v1","addr":"172.21.15.12:6835","nonce":184729302}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 msgr2=0x7f1d44069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 0x7f1d44069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 msgr2=0x7f1d5813e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800ec80 tx=0x7f1d480091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 shutdown_connections 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1d44067170 0x7f1d44069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1d580cef40 0x7f1d5813e490 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1d5815de50 0x7f1d580b4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 --2- 172.21.15.12:0/736615292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1d58153c30 0x7f1d580b4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 >> 172.21.15.12:0/736615292 conn(0x7f1d580703a0 msgr2=0x7f1d580c60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 shutdown_connections 2023-10-08T17:43:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.020+0000 7f1d57fff700 1 -- 172.21.15.12:0/736615292 wait complete. 2023-10-08T17:43:08.023 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 91 2023-10-08T17:43:08.029 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:08.028+0000 7f192bf79180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:08.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:08.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.229+0000 7fb06179d700 1 Processor -- start 2023-10-08T17:43:08.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.229+0000 7fb06179d700 1 -- start start 2023-10-08T17:43:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.230+0000 7fb06179d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb05c1596d0 0x7fb05c06d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb06179d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06d3e0 con 0x7fb05c159aa0 2023-10-08T17:43:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb06179d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c06c7d0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb06179d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c06cab0 con 0x7fb05c1596d0 2023-10-08T17:43:08.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb05c1596d0 0x7fb05c06d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb05c1596d0 0x7fb05c06d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44150/0 (socket says 172.21.15.12:44150) 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 -- 172.21.15.12:0/3516530230 learned_addr learned my addr 172.21.15.12:0/3516530230 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05b7fe700 1 --1- 172.21.15.12:0/3516530230 >> v1:172.21.15.12:6789/0 conn(0x7fb05c159aa0 0x7fb05c0703a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41976/0 (socket says 172.21.15.12:41976) 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 -- 172.21.15.12:0/3516530230 >> v1:172.21.15.29:6789/0 conn(0x7fb05c0ca7b0 legacy=0x7fb05c15b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 -- 172.21.15.12:0/3516530230 >> v1:172.21.15.12:6789/0 conn(0x7fb05c159aa0 legacy=0x7fb05c0703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.231+0000 7fb05bfff700 1 -- 172.21.15.12:0/3516530230 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c06cd90 con 0x7fb05c1596d0 2023-10-08T17:43:08.234 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb05bfff700 1 --2- 172.21.15.12:0/3516530230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c1596d0 0x7fb05c06d870 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0099b0 tx=0x7fb04c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cdcf9fbcbfaf01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb05affd700 1 -- 172.21.15.12:0/3516530230 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00b860 con 0x7fb05c1596d0 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb05affd700 1 -- 172.21.15.12:0/3516530230 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c00b9c0 con 0x7fb05c1596d0 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb05affd700 1 -- 172.21.15.12:0/3516530230 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c00bd80 con 0x7fb05c1596d0 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb06179d700 1 -- 172.21.15.12:0/3516530230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c1596d0 msgr2=0x7fb05c06d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.232+0000 7fb06179d700 1 --2- 172.21.15.12:0/3516530230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c1596d0 0x7fb05c06d870 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0099b0 tx=0x7fb04c009250 comp rx=0 tx=0).stop 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.233+0000 7fb06179d700 1 -- 172.21.15.12:0/3516530230 shutdown_connections 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.233+0000 7fb06179d700 1 --2- 172.21.15.12:0/3516530230 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c1596d0 0x7fb05c06d870 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.233+0000 7fb06179d700 1 -- 172.21.15.12:0/3516530230 >> 172.21.15.12:0/3516530230 conn(0x7fb05c06e720 msgr2=0x7fb05c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.233+0000 7fb06179d700 1 -- 172.21.15.12:0/3516530230 shutdown_connections 2023-10-08T17:43:08.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.233+0000 7fb06179d700 1 -- 172.21.15.12:0/3516530230 wait complete. 2023-10-08T17:43:08.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.234+0000 7fb06179d700 1 Processor -- start 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.234+0000 7fb06179d700 1 -- start start 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb05c1596d0 0x7fb05c0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb05c159aa0 0x7fb05c1545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0af860 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0c5670 con 0x7fb05c159aa0 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb06179d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0c5950 con 0x7fb05c1596d0 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb05bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44156/0 (socket says 172.21.15.12:44156) 2023-10-08T17:43:08.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb05bfff700 1 -- 172.21.15.12:0/2391533286 learned_addr learned my addr 172.21.15.12:0/2391533286 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb05b7fe700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb05c1596d0 0x7fb05c0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.235+0000 7fb060f9c700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb05c159aa0 0x7fb05c1545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb05c1596d0 msgr2=0x7fb05c0c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb05c1596d0 0x7fb05c0c4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb05c159aa0 msgr2=0x7fb05c1545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb05c159aa0 0x7fb05c1545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 -- 172.21.15.12:0/2391533286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0094f0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb05bfff700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0c3820 tx=0x7fb04c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c01f070 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c006a90 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c0c5c30 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.236+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c025420 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.237+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c0c5240 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.237+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05c04c3c0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.239+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7fb04c023070 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.239+0000 7fb043fff700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 0x7fb048069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.239+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6597+0+0 (secure 0 0 0) 0x7fb04c086040 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.240+0000 7fb05b7fe700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 msgr2=0x7fb048069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:08.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.240+0000 7fb05b7fe700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 0x7fb048069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:08.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.244+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb04c052ca0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.441+0000 7fb05b7fe700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 msgr2=0x7fb048069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:08.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.441+0000 7fb05b7fe700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 0x7fb048069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:08.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.450+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb05c0c1af0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.451+0000 7fb043fff700 1 -- 172.21.15.12:0/2391533286 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+16773 (secure 0 0 0) 0x7fb04c0562c0 con 0x7fb05c0ca7b0 2023-10-08T17:43:08.452 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:08.453 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":200,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:06.475092+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:41:38.653774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-10-08T17:41:39.901789+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":200,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3918380727":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1078921898":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/950766230":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1980873617":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6837/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/2635857507":"2023-10-09T17:41:57.373646+0000","172.21.15.12:6836/163464":"2023-10-09T17:41:57.373646+0000","172.21.15.12:0/1058352909":"2023-10-09T17:41:57.373646+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 msgr2=0x7fb048069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 0x7fb048069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 msgr2=0x7fb05c14c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0c3820 tx=0x7fb04c017000 comp rx=0 tx=0).stop 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 shutdown_connections 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb048067170 0x7fb048069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb05c0ca7b0 0x7fb05c14c090 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb05c159aa0 0x7fb05c1545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 --2- 172.21.15.12:0/2391533286 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb05c1596d0 0x7fb05c0c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 >> 172.21.15.12:0/2391533286 conn(0x7fb05c06e720 msgr2=0x7fb05c15aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 shutdown_connections 2023-10-08T17:43:08.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.453+0000 7fb06179d700 1 -- 172.21.15.12:0/2391533286 wait complete. 2023-10-08T17:43:08.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T17:43:08.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.664+0000 7f645959d700 1 Processor -- start 2023-10-08T17:43:08.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.664+0000 7f645959d700 1 -- start start 2023-10-08T17:43:08.666 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:08.665+0000 7f096ed61180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.665+0000 7f645959d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f645415dfd0 0x7f64540aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.665+0000 7f645959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f64540ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.665+0000 7f645959d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540acc00 con 0x7f6454159550 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.665+0000 7f645959d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540abff0 con 0x7f645415dfd0 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.665+0000 7f645959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540ac2d0 con 0x7f6454159920 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f645415dfd0 0x7f64540aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.668 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f645415dfd0 0x7f64540aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44172/0 (socket says 172.21.15.12:44172) 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 -- 172.21.15.12:0/1772091578 learned_addr learned my addr 172.21.15.12:0/1772091578 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f6458d9c700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f64540ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 -- 172.21.15.12:0/1772091578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 msgr2=0x7f64540ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f64540ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 -- 172.21.15.12:0/1772091578 >> v1:172.21.15.29:6789/0 conn(0x7f6454159550 legacy=0x7f64540ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 -- 172.21.15.12:0/1772091578 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540ac5b0 con 0x7f645415dfd0 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f6452ffd700 1 -- 172.21.15.12:0/1772091578 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257427752 0 0) 0x7f64540acc00 con 0x7f6454159550 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.666+0000 7f64537fe700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f645415dfd0 0x7f64540aedb0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f64480099b0 tx=0x7f6448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cb6a072e10e2e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f6452ffd700 1 -- 172.21.15.12:0/1772091578 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6448009ea0 con 0x7f645415dfd0 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f6452ffd700 1 -- 172.21.15.12:0/1772091578 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644800b860 con 0x7f645415dfd0 2023-10-08T17:43:08.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f6452ffd700 1 -- 172.21.15.12:0/1772091578 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f644800bc00 con 0x7f645415dfd0 2023-10-08T17:43:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f645959d700 1 -- 172.21.15.12:0/1772091578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f645415dfd0 msgr2=0x7f64540aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f645959d700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f645415dfd0 0x7f64540aedb0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f64480099b0 tx=0x7f6448009250 comp rx=0 tx=0).stop 2023-10-08T17:43:08.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.667+0000 7f645959d700 1 -- 172.21.15.12:0/1772091578 shutdown_connections 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.668+0000 7f645959d700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f64540ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.668+0000 7f645959d700 1 --2- 172.21.15.12:0/1772091578 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f645415dfd0 0x7f64540aedb0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.668+0000 7f645959d700 1 -- 172.21.15.12:0/1772091578 >> 172.21.15.12:0/1772091578 conn(0x7f645406ce80 msgr2=0x7f64540ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.668+0000 7f645959d700 1 -- 172.21.15.12:0/1772091578 shutdown_connections 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.668+0000 7f645959d700 1 -- 172.21.15.12:0/1772091578 wait complete. 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.670+0000 7f645959d700 1 Processor -- start 2023-10-08T17:43:08.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.670+0000 7f645959d700 1 -- start start 2023-10-08T17:43:08.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f6454169740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f645415dfd0 0x7f64540c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454158cd0 con 0x7f6454159550 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64540cc8e0 con 0x7f645415dfd0 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f645959d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64540ccbc0 con 0x7f6454159920 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.671+0000 7f6453fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44188/0 (socket says 172.21.15.12:44188) 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 -- 172.21.15.12:0/3096964157 learned_addr learned my addr 172.21.15.12:0/3096964157 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f64537fe700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f6454169740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6458d9c700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f645415dfd0 0x7f64540c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:08.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 msgr2=0x7f6454169740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f6454169740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f645415dfd0 msgr2=0x7f64540c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f645415dfd0 0x7f64540c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 -- 172.21.15.12:0/3096964157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480094f0 con 0x7f6454159550 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f6453fff700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f644400c7e0 tx=0x7f6444007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.672+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440105c0 con 0x7f6454159550 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.673+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6444010740 con 0x7f6454159550 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.673+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64540ccea0 con 0x7f6454159550 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.673+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444010b00 con 0x7f6454159550 2023-10-08T17:43:08.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.673+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64540ceab0 con 0x7f6454159550 2023-10-08T17:43:08.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.674+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64540caca0 con 0x7f6454159550 2023-10-08T17:43:08.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.675+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f644401b3b0 con 0x7f6454159550 2023-10-08T17:43:08.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.676+0000 7f643bfff700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 0x7f6440069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:08.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.676+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6597+0+0 (secure 0 0 0) 0x7f6444084640 con 0x7f6454159550 2023-10-08T17:43:08.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.676+0000 7f64537fe700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 msgr2=0x7f6440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:08.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.676+0000 7f64537fe700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 0x7f6440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:08.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.680+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6444051280 con 0x7f6454159550 2023-10-08T17:43:08.789 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:08.788+0000 7f192bf79180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.877+0000 7f64537fe700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 msgr2=0x7f6440069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:08.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.877+0000 7f64537fe700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 0x7f6440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:08.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.932+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f645404c3c0 con 0x7f6454159550 2023-10-08T17:43:08.933 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T17:43:08.932+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T17:43:08.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.941+0000 7f643bfff700 1 -- 172.21.15.12:0/3096964157 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6444017090 con 0x7f6454159550 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.943+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 msgr2=0x7f6440069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.943+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 0x7f6440069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.943+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 msgr2=0x7f6454158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.943+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f644400c7e0 tx=0x7f6444007df0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 shutdown_connections 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6440067170 0x7f6440069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6454159550 0x7f6454158790 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f645415dfd0 0x7f64540c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 --2- 172.21.15.12:0/3096964157 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6454159920 0x7f6454169740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 >> 172.21.15.12:0/3096964157 conn(0x7f645406ce80 msgr2=0x7f64541528e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 shutdown_connections 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:08.944+0000 7f645959d700 1 -- 172.21.15.12:0/3096964157 wait complete. 2023-10-08T17:43:08.946 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T17:43:08.961 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:08.960+0000 7f096ed61180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:08.966 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T17:43:09.004 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:43:09.060 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.059+0000 7f096ed61180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:09.094 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.093+0000 7f192bf79180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:09.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.161+0000 7f7e869ff700 1 Processor -- start 2023-10-08T17:43:09.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.161+0000 7f7e869ff700 1 -- start start 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.162+0000 7f7e869ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 0x7f7e800c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e869ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800adbc0 con 0x7f7e800c8bd0 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e869ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800c9d30 con 0x7f7e800b1150 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e869ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800acfb0 con 0x7f7e800c8800 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7e800c8bd0 0x7f7e800b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41988/0 (socket says 172.21.15.12:41988) 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7f7fe700 1 -- 172.21.15.12:0/547595188 learned_addr learned my addr 172.21.15.12:0/547595188 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:09.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/547595188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 0x7f7e800c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3047785398 0 0) 0x7f7e800adbc0 con 0x7f7e800c8bd0 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e68003570 con 0x7f7e800c8bd0 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219798861 0 0) 0x7f7e800c9d30 con 0x7f7e800b1150 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.163+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e800adbc0 con 0x7f7e800b1150 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7ffff700 1 -- 172.21.15.12:0/547595188 >> v1:172.21.15.29:6789/0 conn(0x7f7e800b1150 legacy=0x7f7e800ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7ffff700 1 -- 172.21.15.12:0/547595188 >> v1:172.21.15.12:6789/0 conn(0x7f7e800c8bd0 legacy=0x7f7e800b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7ffff700 1 -- 172.21.15.12:0/547595188 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800ad290 con 0x7f7e800c8800 2023-10-08T17:43:09.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/547595188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 0x7f7e800c94e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009910 tx=0x7f7e700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681ae0455889d5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:09.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011630 con 0x7f7e800c8800 2023-10-08T17:43:09.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70011790 con 0x7f7e800c8800 2023-10-08T17:43:09.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.164+0000 7f7e7effd700 1 -- 172.21.15.12:0/547595188 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011b30 con 0x7f7e800c8800 2023-10-08T17:43:09.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 -- 172.21.15.12:0/547595188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 msgr2=0x7f7e800c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 --2- 172.21.15.12:0/547595188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 0x7f7e800c94e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009910 tx=0x7f7e700091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 -- 172.21.15.12:0/547595188 shutdown_connections 2023-10-08T17:43:09.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 --2- 172.21.15.12:0/547595188 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8800 0x7f7e800c94e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 -- 172.21.15.12:0/547595188 >> 172.21.15.12:0/547595188 conn(0x7f7e8006d170 msgr2=0x7f7e800cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:09.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 -- 172.21.15.12:0/547595188 shutdown_connections 2023-10-08T17:43:09.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.165+0000 7f7e869ff700 1 -- 172.21.15.12:0/547595188 wait complete. 2023-10-08T17:43:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.167+0000 7f7e869ff700 1 Processor -- start 2023-10-08T17:43:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.167+0000 7f7e869ff700 1 -- start start 2023-10-08T17:43:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 0x7f7e8016db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:09.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8bd0 0x7f7e8014e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8016e0c0 con 0x7f7e800b1150 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80152060 con 0x7f7e800c8800 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e869ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80151bd0 con 0x7f7e800c8bd0 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44208/0 (socket says 172.21.15.12:44208) 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e7ffff700 1 -- 172.21.15.12:0/3566416069 learned_addr learned my addr 172.21.15.12:0/3566416069 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e7f7fe700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 0x7f7e8016db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:09.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.168+0000 7f7e84f9c700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8bd0 0x7f7e8014e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8bd0 msgr2=0x7f7e8014e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8bd0 0x7f7e8014e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 msgr2=0x7f7e80150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 -- 172.21.15.12:0/3566416069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70009420 con 0x7f7e800c8800 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e7f7fe700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 0x7f7e8016db80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c580 tx=0x7f7e74007d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74005b30 con 0x7f7e800c8800 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e74005c90 con 0x7f7e800c8800 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e74007320 con 0x7f7e800c8800 2023-10-08T17:43:09.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e80150fc0 con 0x7f7e800c8800 2023-10-08T17:43:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.169+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80151580 con 0x7f7e800c8800 2023-10-08T17:43:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.170+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e80067fb0 con 0x7f7e800c8800 2023-10-08T17:43:09.173 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.172+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 103) v1 ==== 84956+0+0 (secure 0 0 0) 0x7f7e7401b3b0 con 0x7f7e800c8800 2023-10-08T17:43:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.173+0000 7f7e67fff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.173+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6655+0+0 (secure 0 0 0) 0x7f7e74084140 con 0x7f7e800c8800 2023-10-08T17:43:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.173+0000 7f7e7ffff700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 msgr2=0x7f7e6c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:09.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.173+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:09.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.177+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e74050cd0 con 0x7f7e800c8800 2023-10-08T17:43:09.204 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.203+0000 7f192bf79180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:09.228 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.226+0000 7f096ed61180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:09.338 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.336+0000 7f096ed61180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:09.374 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.373+0000 7f192bf79180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:09.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.374+0000 7f7e7ffff700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 msgr2=0x7f7e6c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:09.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.374+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:09.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.453+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e8004c3c0 con 0x7f7e800c8800 2023-10-08T17:43:09.486 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.485+0000 7f192bf79180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:09.540 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.539+0000 7f096ed61180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:09.638 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.637+0000 7f096ed61180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:09.686 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.685+0000 7f192bf79180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:09.735 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.733+0000 7f096ed61180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:09.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.775+0000 7f7e7ffff700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 msgr2=0x7f7e6c069620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:09.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.775+0000 7f7e7ffff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:43:09.783 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.782+0000 7f192bf79180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:09.833 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:09.832+0000 7f096ed61180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:09.879 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.878+0000 7f192bf79180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:09.941 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.940+0000 7f7e67fff700 1 -- 172.21.15.12:0/3566416069 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7e740542f0 con 0x7f7e800c8800 2023-10-08T17:43:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 msgr2=0x7f7e6c069620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 msgr2=0x7f7e8016db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:09.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 0x7f7e8016db80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400c580 tx=0x7f7e74007d70 comp rx=0 tx=0).stop 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 shutdown_connections 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7e6c067170 0x7f7e6c069620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7e800b1150 0x7f7e80150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7e800c8bd0 0x7f7e8014e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 --2- 172.21.15.12:0/3566416069 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7e800c8800 0x7f7e8016db80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 >> 172.21.15.12:0/3566416069 conn(0x7f7e8006d170 msgr2=0x7f7e80150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 shutdown_connections 2023-10-08T17:43:09.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:09.943+0000 7f7e869ff700 1 -- 172.21.15.12:0/3566416069 wait complete. 2023-10-08T17:43:09.963 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T17:43:09.977 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:09.976+0000 7f192bf79180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.186+0000 7fb82979d700 1 Processor -- start 2023-10-08T17:43:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.186+0000 7fb82979d700 1 -- start start 2023-10-08T17:43:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.187+0000 7fb82979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb824142ca0 0x7fb82415dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.187+0000 7fb82979d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82415d8d0 con 0x7fb824143070 2023-10-08T17:43:10.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.187+0000 7fb82979d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82415d2f0 con 0x7fb8240cb450 2023-10-08T17:43:10.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.187+0000 7fb82979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240cc630 con 0x7fb824142ca0 2023-10-08T17:43:10.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb8237fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb824143070 0x7fb8240cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:41990/0 (socket says 172.21.15.12:41990) 2023-10-08T17:43:10.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb8237fe700 1 -- 172.21.15.12:0/1509487468 learned_addr learned my addr 172.21.15.12:0/1509487468 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb823fff700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb824142ca0 0x7fb82415dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480637339 0 0) 0x7fb82415d8d0 con 0x7fb824143070 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb80c003570 con 0x7fb824143070 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3389523748 0 0) 0x7fb80c003570 con 0x7fb824143070 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb824142ca0 msgr2=0x7fb82415dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb824142ca0 0x7fb82415dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 >> v1:172.21.15.29:6789/0 conn(0x7fb8240cb450 legacy=0x7fb82406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82415d560 con 0x7fb824143070 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fb818001470 con 0x7fb824143070 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 >> v1:172.21.15.12:6789/0 conn(0x7fb824143070 legacy=0x7fb8240cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb80c003a90 0x7fb80c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.188+0000 7fb822ffd700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb80c0043e0 0x7fb80c0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb822ffd700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80c0050b0 0x7fb80c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240cc630 con 0x7fb80c0043e0 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c00bfa0 con 0x7fb80c0050b0 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80c00c160 con 0x7fb80c003a90 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb80c0043e0 0x7fb80c0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb823fff700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb80c003a90 0x7fb80c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb828f9c700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80c0050b0 0x7fb80c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 -- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb80c003a90 msgr2=0x7fb80c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb80c003a90 0x7fb80c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 -- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80c0050b0 msgr2=0x7fb80c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb80c0050b0 0x7fb80c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 -- 172.21.15.12:0/1509487468 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c003570 con 0x7fb80c0043e0 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.189+0000 7fb8237fe700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb80c0043e0 0x7fb80c0048b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c2d0 tx=0x7fb82415d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1213845136c1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81800cc00 con 0x7fb80c0043e0 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81800cd60 con 0x7fb80c0043e0 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb822ffd700 1 -- 172.21.15.12:0/1509487468 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb818005b70 con 0x7fb80c0043e0 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 -- 172.21.15.12:0/1509487468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb80c0043e0 msgr2=0x7fb80c0048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 --2- 172.21.15.12:0/1509487468 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb80c0043e0 0x7fb80c0048b0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fb81800c2d0 tx=0x7fb82415d840 comp rx=0 tx=0).stop 2023-10-08T17:43:10.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb828f9c700 1 -- 172.21.15.12:0/1509487468 reap_dead start 2023-10-08T17:43:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 -- 172.21.15.12:0/1509487468 shutdown_connections 2023-10-08T17:43:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 -- 172.21.15.12:0/1509487468 >> 172.21.15.12:0/1509487468 conn(0x7fb824067c80 msgr2=0x7fb824068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 -- 172.21.15.12:0/1509487468 shutdown_connections 2023-10-08T17:43:10.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.190+0000 7fb82979d700 1 -- 172.21.15.12:0/1509487468 wait complete. 2023-10-08T17:43:10.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.192+0000 7fb82979d700 1 Processor -- start 2023-10-08T17:43:10.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.192+0000 7fb82979d700 1 -- start start 2023-10-08T17:43:10.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 0x7fb8240afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8240a98e0 0x7fb8240a9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240aa290 con 0x7fb82413f270 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240aeb00 con 0x7fb8240b1960 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb82979d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82416aa60 con 0x7fb8240a98e0 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44318/0 (socket says 172.21.15.12:44318) 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 -- 172.21.15.12:0/2209825965 learned_addr learned my addr 172.21.15.12:0/2209825965 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb828f9c700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8240a98e0 0x7fb8240a9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb8237fe700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 0x7fb8240afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 -- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8240a98e0 msgr2=0x7fb8240a9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8240a98e0 0x7fb8240a9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 -- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 msgr2=0x7fb8240afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 0x7fb8240afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb823fff700 1 -- 172.21.15.12:0/2209825965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240aed50 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.193+0000 7fb8237fe700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 0x7fb8240afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb823fff700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fb814011ac0 tx=0x7fb8140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81400fa10 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81400fb70 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240af030 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814014440 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.194+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8240af5f0 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.195+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240afc40 con 0x7fb82413f270 2023-10-08T17:43:10.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.196+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 104) v1 ==== 84451+0+0 (secure 0 0 0) 0x7fb8140147f0 con 0x7fb82413f270 2023-10-08T17:43:10.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.197+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 6999+0+0 (secure 0 0 0) 0x7fb814018030 con 0x7fb82413f270 2023-10-08T17:43:10.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.201+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb814052160 con 0x7fb82413f270 2023-10-08T17:43:10.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.405+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb82404c3c0 con 0x7fb82413f270 2023-10-08T17:43:10.496 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:43:10.502 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:43:10.991 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.990+0000 7fb80bfff700 1 -- 172.21.15.12:0/2209825965 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v203) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb8140220d0 con 0x7fb82413f270 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 msgr2=0x7fb82416a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7fb814011ac0 tx=0x7fb8140091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 shutdown_connections 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb82413f270 0x7fb82416a520 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8240a98e0 0x7fb8240a9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 --2- 172.21.15.12:0/2209825965 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8240b1960 0x7fb8240afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.992+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 >> 172.21.15.12:0/2209825965 conn(0x7fb824067c80 msgr2=0x7fb82415ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.993+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 shutdown_connections 2023-10-08T17:43:10.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:10.993+0000 7fb82979d700 1 -- 172.21.15.12:0/2209825965 wait complete. 2023-10-08T17:43:10.995 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T17:43:11.019 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T17:43:11.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.210+0000 7fc562d9d700 1 Processor -- start 2023-10-08T17:43:11.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.210+0000 7fc562d9d700 1 -- start start 2023-10-08T17:43:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.212+0000 7fc562d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc55c157380 0x7fc55c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.212+0000 7fc562d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c0c8680 con 0x7fc55c15b1a0 2023-10-08T17:43:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.212+0000 7fc562d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55c158b30 con 0x7fc55c157750 2023-10-08T17:43:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.212+0000 7fc562d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc55c06a7f0 con 0x7fc55c157380 2023-10-08T17:43:11.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.214+0000 7fc56259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7fc55c157750 0x7fc55c0ae080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:52912/0 (socket says 172.21.15.12:52912) 2023-10-08T17:43:11.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.214+0000 7fc56259c700 1 -- 172.21.15.12:0/3059963195 learned_addr learned my addr 172.21.15.12:0/3059963195 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:11.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.216+0000 7fc560d99700 1 -- 172.21.15.12:0/3059963195 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410065859 0 0) 0x7fc55c158b30 con 0x7fc55c157750 2023-10-08T17:43:11.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.216+0000 7fc560d99700 1 -- 172.21.15.12:0/3059963195 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc548003570 con 0x7fc55c157750 2023-10-08T17:43:11.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.217+0000 7fc561d9b700 1 --2- 172.21.15.12:0/3059963195 >> v2:172.21.15.12:3300/0 conn(0x7fc55c157380 0x7fc55c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.220+0000 7fc561d9b700 1 -- 172.21.15.12:0/3059963195 >> v1:172.21.15.29:6789/0 conn(0x7fc55c157750 legacy=0x7fc55c0ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.220+0000 7fc561d9b700 1 -- 172.21.15.12:0/3059963195 >> v1:172.21.15.12:6789/0 conn(0x7fc55c15b1a0 legacy=0x7fc55c0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:11.221 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.220+0000 7fc561d9b700 1 -- 172.21.15.12:0/3059963195 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c15b6a0 con 0x7fc55c157380 2023-10-08T17:43:11.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.221+0000 7fc561d9b700 1 --2- 172.21.15.12:0/3059963195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c1585f0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098e0 tx=0x7fc5580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7013fcd2a41335 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:11.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.222+0000 7fc560d99700 1 -- 172.21.15.12:0/3059963195 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011630 con 0x7fc55c157380 2023-10-08T17:43:11.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.222+0000 7fc560d99700 1 -- 172.21.15.12:0/3059963195 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558011790 con 0x7fc55c157380 2023-10-08T17:43:11.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.222+0000 7fc560d99700 1 -- 172.21.15.12:0/3059963195 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011b10 con 0x7fc55c157380 2023-10-08T17:43:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 -- 172.21.15.12:0/3059963195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 msgr2=0x7fc55c1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 --2- 172.21.15.12:0/3059963195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c1585f0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fc5580098e0 tx=0x7fc5580091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 -- 172.21.15.12:0/3059963195 shutdown_connections 2023-10-08T17:43:11.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 --2- 172.21.15.12:0/3059963195 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c1585f0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 -- 172.21.15.12:0/3059963195 >> 172.21.15.12:0/3059963195 conn(0x7fc55c06c6a0 msgr2=0x7fc55c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 -- 172.21.15.12:0/3059963195 shutdown_connections 2023-10-08T17:43:11.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.223+0000 7fc562d9d700 1 -- 172.21.15.12:0/3059963195 wait complete. 2023-10-08T17:43:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.225+0000 7fc562d9d700 1 Processor -- start 2023-10-08T17:43:11.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.225+0000 7fc562d9d700 1 -- start start 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc55c157750 0x7fc55c0c16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 0x7fc55c169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c2bf0 con 0x7fc55c157380 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c1fe0 con 0x7fc55c15b1a0 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc562d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc55c0c22c0 con 0x7fc55c157750 2023-10-08T17:43:11.228 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc561d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc561d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:44336/0 (socket says 172.21.15.12:44336) 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.226+0000 7fc561d9b700 1 -- 172.21.15.12:0/610838361 learned_addr learned my addr 172.21.15.12:0/610838361 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc56259c700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 0x7fc55c169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc56159a700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc55c157750 0x7fc55c0c16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 -- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc55c157750 msgr2=0x7fc55c0c16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc55c157750 0x7fc55c0c16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 -- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 msgr2=0x7fc55c169b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 0x7fc55c169b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 -- 172.21.15.12:0/610838361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558009420 con 0x7fc55c157380 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc56259c700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 0x7fc55c169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:11.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc561d9b700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc55c069680 tx=0x7fc558016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558011b10 con 0x7fc55c157380 2023-10-08T17:43:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55801a460 con 0x7fc55c157380 2023-10-08T17:43:11.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55801a820 con 0x7fc55c157380 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.227+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc55c0c25a0 con 0x7fc55c157380 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.228+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc55c0c1c20 con 0x7fc55c157380 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.229+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55c04c3c0 con 0x7fc55c157380 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.230+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 105) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fc55801ac50 con 0x7fc55c157380 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.230+0000 7fc551ffb700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 0x7fc540069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:11.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.230+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 6561+0+0 (secure 0 0 0) 0x7fc5580861a0 con 0x7fc55c157380 2023-10-08T17:43:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.231+0000 7fc56159a700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 0x7fc540069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:11.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.231+0000 7fc56159a700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 0x7fc540069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc54c006fd0 tx=0x7fc54c008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:11.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.235+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc558053340 con 0x7fc55c157380 2023-10-08T17:43:11.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:11.435+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc55c0c2ed0 con 0x7fc55c157380 2023-10-08T17:43:12.006 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.005+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc558053710 con 0x7fc55c157380 2023-10-08T17:43:12.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.013+0000 7fc551ffb700 1 -- 172.21.15.12:0/610838361 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v204) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc558056dd0 con 0x7fc55c157380 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.016+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 msgr2=0x7fc540069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.016+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 0x7fc540069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc54c006fd0 tx=0x7fc54c008040 comp rx=0 tx=0).stop 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.016+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 msgr2=0x7fc55c0cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.016+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc55c069680 tx=0x7fc558016000 comp rx=0 tx=0).stop 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 shutdown_connections 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc540066d80 0x7fc540069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc55c157380 0x7fc55c0cb6d0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc55c15b1a0 0x7fc55c169b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 --2- 172.21.15.12:0/610838361 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc55c157750 0x7fc55c0c16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 >> 172.21.15.12:0/610838361 conn(0x7fc55c06c6a0 msgr2=0x7fc55c06ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 shutdown_connections 2023-10-08T17:43:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.017+0000 7fc562d9d700 1 -- 172.21.15.12:0/610838361 wait complete. 2023-10-08T17:43:12.019 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T17:43:12.036 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T17:43:12.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.238+0000 7f8037fff700 1 Processor -- start 2023-10-08T17:43:12.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.238+0000 7f8037fff700 1 -- start start 2023-10-08T17:43:12.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80380accb0 0x7f80380aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 0x7f80380cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f803806e330 0x7f803806e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380cc850 con 0x7f803806e330 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80380ad780 con 0x7f80380cbea0 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f8037fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380cee60 con 0x7f80380accb0 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.239+0000 7f80377fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f803806e330 0x7f803806e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f803806e330 0x7f803806e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40506/0 (socket says 172.21.15.12:40506) 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 -- 172.21.15.12:0/546280141 learned_addr learned my addr 172.21.15.12:0/546280141 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:12.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80367fc700 1 --2- 172.21.15.12:0/546280141 >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 0x7f80380cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f8036ffd700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80380accb0 0x7f80380aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 -- 172.21.15.12:0/546280141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80380accb0 msgr2=0x7f80380aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80380accb0 0x7f80380aaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 -- 172.21.15.12:0/546280141 >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 msgr2=0x7f80380cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 --2- 172.21.15.12:0/546280141 >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 0x7f80380cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 -- 172.21.15.12:0/546280141 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80380cf140 con 0x7f803806e330 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80367fc700 1 --2- 172.21.15.12:0/546280141 >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 0x7f80380cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f80377fe700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f803806e330 0x7f803806e7b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f80380648a0 tx=0x7f8030009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e942dbb0a66066 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.240+0000 7f8035ffb700 1 -- 172.21.15.12:0/546280141 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803000e070 con 0x7f803806e330 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8035ffb700 1 -- 172.21.15.12:0/546280141 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803000ba50 con 0x7f803806e330 2023-10-08T17:43:12.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8035ffb700 1 -- 172.21.15.12:0/546280141 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80300092e0 con 0x7f803806e330 2023-10-08T17:43:12.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 -- 172.21.15.12:0/546280141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f803806e330 msgr2=0x7f803806e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f803806e330 0x7f803806e7b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f80380648a0 tx=0x7f8030009840 comp rx=0 tx=0).stop 2023-10-08T17:43:12.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 -- 172.21.15.12:0/546280141 shutdown_connections 2023-10-08T17:43:12.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f803806e330 0x7f803806e7b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 --2- 172.21.15.12:0/546280141 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f80380accb0 0x7f80380aaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 --2- 172.21.15.12:0/546280141 >> v2:172.21.15.29:3300/0 conn(0x7f80380cbea0 0x7f80380cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 -- 172.21.15.12:0/546280141 >> 172.21.15.12:0/546280141 conn(0x7f803806ce80 msgr2=0x7f80380ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 -- 172.21.15.12:0/546280141 shutdown_connections 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.241+0000 7f8037fff700 1 -- 172.21.15.12:0/546280141 wait complete. 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.242+0000 7f8037fff700 1 Processor -- start 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.243+0000 7f8037fff700 1 -- start start 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f803806e330 0x7f8038148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 0x7f80380c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b2040 con 0x7f80380accb0 2023-10-08T17:43:12.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b2b90 con 0x7f80380cbea0 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8037fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80380b3710 con 0x7f803806e330 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40514/0 (socket says 172.21.15.12:40514) 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 -- 172.21.15.12:0/528340904 learned_addr learned my addr 172.21.15.12:0/528340904 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f8036ffd700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f803806e330 0x7f8038148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80377fe700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 0x7f80380c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 -- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f803806e330 msgr2=0x7f8038148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f803806e330 0x7f8038148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 -- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 msgr2=0x7f80380c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 0x7f80380c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80367fc700 1 -- 172.21.15.12:0/528340904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8030009ae0 con 0x7f80380accb0 2023-10-08T17:43:12.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.244+0000 7f80377fe700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 0x7f80380c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f80367fc700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d890 tx=0x7f802c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c0125f0 con 0x7f80380accb0 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802c012750 con 0x7f80380accb0 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802c012af0 con 0x7f80380accb0 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80380b2de0 con 0x7f80380accb0 2023-10-08T17:43:12.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.245+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80380b33a0 con 0x7f80380accb0 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.246+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f803804c3c0 con 0x7f80380accb0 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.247+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f802c014430 con 0x7f80380accb0 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.248+0000 7f801effd700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 0x7f80240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.248+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f802c084b50 con 0x7f80380accb0 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.248+0000 7f8036ffd700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 0x7f80240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.249+0000 7f8036ffd700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 0x7f80240693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8028006fd0 tx=0x7f8028008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.252+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f802c051b60 con 0x7f80380accb0 2023-10-08T17:43:12.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.455+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f803806d850 con 0x7f80380accb0 2023-10-08T17:43:12.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.461+0000 7f801effd700 1 -- 172.21.15.12:0/528340904 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v67) v1 ==== 120+0+0 (secure 0 0 0) 0x7f802c055180 con 0x7f80380accb0 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 msgr2=0x7f80240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 0x7f80240693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8028006fd0 tx=0x7f8028008040 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 msgr2=0x7f80380c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d890 tx=0x7f802c008040 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 shutdown_connections 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8024066f30 0x7f80240693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f80380cbea0 0x7f80380c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f803806e330 0x7f8038148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 --2- 172.21.15.12:0/528340904 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f80380accb0 0x7f80380c78a0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.463+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 >> 172.21.15.12:0/528340904 conn(0x7f803806ce80 msgr2=0x7f80381596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:12.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.464+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 shutdown_connections 2023-10-08T17:43:12.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.464+0000 7f8037fff700 1 -- 172.21.15.12:0/528340904 wait complete. 2023-10-08T17:43:12.483 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T17:43:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.672+0000 7f6c4ab9d700 1 Processor -- start 2023-10-08T17:43:12.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.672+0000 7f6c4ab9d700 1 -- start start 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.673+0000 7f6c4ab9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f6c440c7fb0 0x7f6c4406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.673+0000 7f6c4ab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c4413f780 0x7f6c4413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4ab9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c44140120 con 0x7f6c440c7be0 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4ab9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4406bf10 con 0x7f6c440c7fb0 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4ab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4406b290 con 0x7f6c4413f780 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c49b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6c440c7be0 0x7f6c4415a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48270/0 (socket says 172.21.15.12:48270) 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c49b9b700 1 -- 172.21.15.12:0/3082745548 learned_addr learned my addr 172.21.15.12:0/3082745548 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4939a700 1 --2- 172.21.15.12:0/3082745548 >> v2:172.21.15.12:3300/0 conn(0x7f6c440c7fb0 0x7f6c4406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4a39c700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c4413f780 0x7f6c4413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c48b99700 1 -- 172.21.15.12:0/3082745548 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2391378477 0 0) 0x7f6c40001110 con 0x7f6c440c7be0 2023-10-08T17:43:12.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c48b99700 1 -- 172.21.15.12:0/3082745548 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c30003570 con 0x7f6c440c7be0 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4939a700 1 -- 172.21.15.12:0/3082745548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c4413f780 msgr2=0x7f6c4413fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4939a700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c4413f780 0x7f6c4413fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4939a700 1 -- 172.21.15.12:0/3082745548 >> v1:172.21.15.12:6789/0 conn(0x7f6c440c7be0 legacy=0x7f6c4415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.674+0000 7f6c4939a700 1 -- 172.21.15.12:0/3082745548 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4406b570 con 0x7f6c440c7fb0 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c4939a700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c440c7fb0 0x7f6c4406abd0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6c340098e0 tx=0x7f6c340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a58e9323d2c526 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c48b99700 1 -- 172.21.15.12:0/3082745548 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400b640 con 0x7f6c440c7fb0 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c48b99700 1 -- 172.21.15.12:0/3082745548 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3400b7a0 con 0x7f6c440c7fb0 2023-10-08T17:43:12.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c48b99700 1 -- 172.21.15.12:0/3082745548 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400bb40 con 0x7f6c440c7fb0 2023-10-08T17:43:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/3082745548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c440c7fb0 msgr2=0x7f6c4406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.675+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c440c7fb0 0x7f6c4406abd0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f6c340098e0 tx=0x7f6c340091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/3082745548 shutdown_connections 2023-10-08T17:43:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c4413f780 0x7f6c4413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/3082745548 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c440c7fb0 0x7f6c4406abd0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/3082745548 >> 172.21.15.12:0/3082745548 conn(0x7f6c4406d110 msgr2=0x7f6c440cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/3082745548 shutdown_connections 2023-10-08T17:43:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.676+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/3082745548 wait complete. 2023-10-08T17:43:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.677+0000 7f6c4ab9d700 1 Processor -- start 2023-10-08T17:43:12.679 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.677+0000 7f6c4ab9d700 1 -- start start 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c440c7be0 0x7f6c441568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c440c7fb0 0x7f6c4413bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44157970 con 0x7f6c4413f780 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44165cb0 con 0x7f6c440c7be0 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4ab9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c44157690 con 0x7f6c440c7fb0 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4a39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4a39c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40532/0 (socket says 172.21.15.12:40532) 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4a39c700 1 -- 172.21.15.12:0/4192229780 learned_addr learned my addr 172.21.15.12:0/4192229780 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.678+0000 7f6c4939a700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c440c7fb0 0x7f6c4413bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c49b9b700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c440c7be0 0x7f6c441568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 -- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c440c7fb0 msgr2=0x7f6c4413bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c440c7fb0 0x7f6c4413bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 -- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c440c7be0 msgr2=0x7f6c441568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c440c7be0 0x7f6c441568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 -- 172.21.15.12:0/4192229780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34009420 con 0x7f6c4413f780 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4a39c700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007f20 tx=0x7f6c3c009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00eb90 con 0x7f6c4413f780 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c00ed10 con 0x7f6c4413f780 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c014670 con 0x7f6c4413f780 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.679+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c44165660 con 0x7f6c4413f780 2023-10-08T17:43:12.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.680+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c44165360 con 0x7f6c4413f780 2023-10-08T17:43:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.680+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c44165e20 con 0x7f6c4413f780 2023-10-08T17:43:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.681+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c3c0149e0 con 0x7f6c4413f780 2023-10-08T17:43:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.682+0000 7f6c39ffb700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 0x7f6c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:12.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.682+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f6c3c084d90 con 0x7f6c4413f780 2023-10-08T17:43:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.683+0000 7f6c49b9b700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 0x7f6c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:12.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.683+0000 7f6c49b9b700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 0x7f6c280693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c40001270 tx=0x7f6c40007bf0 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:12.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.687+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c3c051da0 con 0x7f6c4413f780 2023-10-08T17:43:12.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.888+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6c4404c3f0 con 0x7f6c4413f780 2023-10-08T17:43:12.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.894+0000 7f6c39ffb700 1 -- 172.21.15.12:0/4192229780 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v68) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6c3c0553c0 con 0x7f6c4413f780 2023-10-08T17:43:12.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 msgr2=0x7f6c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 0x7f6c280693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6c40001270 tx=0x7f6c40007bf0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 msgr2=0x7f6c4406e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c007f20 tx=0x7f6c3c009860 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 shutdown_connections 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6c28066f30 0x7f6c280693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6c4413f780 0x7f6c4406e3a0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6c440c7be0 0x7f6c441568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 --2- 172.21.15.12:0/4192229780 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6c440c7fb0 0x7f6c4413bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 >> 172.21.15.12:0/4192229780 conn(0x7f6c4406d110 msgr2=0x7f6c440c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 shutdown_connections 2023-10-08T17:43:12.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:12.896+0000 7f6c4ab9d700 1 -- 172.21.15.12:0/4192229780 wait complete. 2023-10-08T17:43:12.915 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T17:43:13.107 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.106+0000 7f69f759d700 1 Processor -- start 2023-10-08T17:43:13.108 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.106+0000 7f69f759d700 1 -- start start 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f759d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69f0155890 0x7f69f00c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f759d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f00c7e70 con 0x7f69f006de50 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f759d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69f006b790 con 0x7f69f0155c60 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f759d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f006ab80 con 0x7f69f0155890 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f659b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f69f0155890 0x7f69f00c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f6d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f69f006de50 0x7f69f00c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48284/0 (socket says 172.21.15.12:48284) 2023-10-08T17:43:13.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.108+0000 7f69f6d9c700 1 -- 172.21.15.12:0/420807539 learned_addr learned my addr 172.21.15.12:0/420807539 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f5599700 1 -- 172.21.15.12:0/420807539 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412968541 0 0) 0x7f69f00c7e70 con 0x7f69f006de50 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f659b700 1 -- 172.21.15.12:0/420807539 >> v1:172.21.15.29:6789/0 conn(0x7f69f0155c60 legacy=0x7f69f006a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f659b700 1 -- 172.21.15.12:0/420807539 >> v1:172.21.15.12:6789/0 conn(0x7f69f006de50 legacy=0x7f69f00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f659b700 1 -- 172.21.15.12:0/420807539 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f006ae60 con 0x7f69f0155890 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f659b700 1 --2- 172.21.15.12:0/420807539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f00c7930 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bbc0 tx=0x7f69ec00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866e05d228ca7a23 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f5599700 1 -- 172.21.15.12:0/420807539 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec00db90 con 0x7f69f0155890 2023-10-08T17:43:13.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f5599700 1 -- 172.21.15.12:0/420807539 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ec00dcf0 con 0x7f69f0155890 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.109+0000 7f69f5599700 1 -- 172.21.15.12:0/420807539 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ec0196b0 con 0x7f69f0155890 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 -- 172.21.15.12:0/420807539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 msgr2=0x7f69f00c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 --2- 172.21.15.12:0/420807539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f00c7930 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bbc0 tx=0x7f69ec00b430 comp rx=0 tx=0).stop 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 -- 172.21.15.12:0/420807539 shutdown_connections 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 --2- 172.21.15.12:0/420807539 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f00c7930 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 -- 172.21.15.12:0/420807539 >> 172.21.15.12:0/420807539 conn(0x7f69f006d110 msgr2=0x7f69f00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 -- 172.21.15.12:0/420807539 shutdown_connections 2023-10-08T17:43:13.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.110+0000 7f69f759d700 1 -- 172.21.15.12:0/420807539 wait complete. 2023-10-08T17:43:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.111+0000 7f69f759d700 1 Processor -- start 2023-10-08T17:43:13.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.111+0000 7f69f759d700 1 -- start start 2023-10-08T17:43:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69f006de50 0x7f69f00c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f69f0155c60 0x7f69f0166b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f01663d0 con 0x7f69f0155890 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0165e10 con 0x7f69f006de50 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.112+0000 7f69f759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f01660f0 con 0x7f69f0155c60 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40542/0 (socket says 172.21.15.12:40542) 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 -- 172.21.15.12:0/666079433 learned_addr learned my addr 172.21.15.12:0/666079433 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f659b700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69f006de50 0x7f69f00c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f6d9c700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f69f0155c60 0x7f69f0166b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 -- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f69f0155c60 msgr2=0x7f69f0166b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f69f0155c60 0x7f69f0166b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 -- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69f006de50 msgr2=0x7f69f00c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69f006de50 0x7f69f00c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 -- 172.21.15.12:0/666079433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69ec00b6d0 con 0x7f69f0155890 2023-10-08T17:43:13.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.113+0000 7f69f5d9a700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c590 tx=0x7f69e0007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.114+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0011590 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.114+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0011710 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.114+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f00c5530 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.114+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e0011ad0 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.114+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f0158500 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.115+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f00c5390 con 0x7f69f0155890 2023-10-08T17:43:13.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.116+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f69e001a360 con 0x7f69f0155890 2023-10-08T17:43:13.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.117+0000 7f69e67fc700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 0x7f69d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.117+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f69e0083690 con 0x7f69f0155890 2023-10-08T17:43:13.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.117+0000 7f69f659b700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 0x7f69d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.118+0000 7f69f659b700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 0x7f69d40693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bb90 tx=0x7f69ec01b000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.121+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69f00c5390 con 0x7f69f0155890 2023-10-08T17:43:13.323 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.322+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f69f00c5390 con 0x7f69f0155890 2023-10-08T17:43:13.327 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.326+0000 7f69e67fc700 1 -- 172.21.15.12:0/666079433 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v69) v1 ==== 115+0+0 (secure 0 0 0) 0x7f69f00c5390 con 0x7f69f0155890 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.328+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 msgr2=0x7f69d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.328+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 0x7f69d40693e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f69ec00bb90 tx=0x7f69ec01b000 comp rx=0 tx=0).stop 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.328+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 msgr2=0x7f69f0166620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.328+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f69e000c590 tx=0x7f69e0007f50 comp rx=0 tx=0).stop 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 shutdown_connections 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f69d4066f30 0x7f69d40693e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f69f0155c60 0x7f69f0166b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f69f006de50 0x7f69f00c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 --2- 172.21.15.12:0/666079433 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f69f0155890 0x7f69f0166620 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 >> 172.21.15.12:0/666079433 conn(0x7f69f006d110 msgr2=0x7f69f00c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 shutdown_connections 2023-10-08T17:43:13.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.329+0000 7f69f759d700 1 -- 172.21.15.12:0/666079433 wait complete. 2023-10-08T17:43:13.347 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-10-08T17:43:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.534+0000 7fef4759d700 1 Processor -- start 2023-10-08T17:43:13.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.534+0000 7fef4759d700 1 -- start start 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.535+0000 7fef4759d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef4006e0a0 0x7fef400c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4759d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4006a490 con 0x7fef4006f3a0 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4759d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef400c7490 con 0x7fef40150380 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4759d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400c7770 con 0x7fef4006e0a0 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef4006e0a0 0x7fef400c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fef4006e0a0 0x7fef400c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40548/0 (socket says 172.21.15.12:40548) 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 -- 172.21.15.12:0/4244463449 learned_addr learned my addr 172.21.15.12:0/4244463449 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 -- 172.21.15.12:0/4244463449 >> v1:172.21.15.29:6789/0 conn(0x7fef40150380 legacy=0x7fef4006a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 -- 172.21.15.12:0/4244463449 >> v1:172.21.15.12:6789/0 conn(0x7fef4006f3a0 legacy=0x7fef4014fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef4659b700 1 -- 172.21.15.12:0/4244463449 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400c7a50 con 0x7fef4006e0a0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.536+0000 7fef45599700 1 -- 172.21.15.12:0/4244463449 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238519201 0 0) 0x7fef4006a490 con 0x7fef4006f3a0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4659b700 1 --2- 172.21.15.12:0/4244463449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006e0a0 0x7fef400c6b20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0099b0 tx=0x7fef3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62be6073f665b01 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef45599700 1 -- 172.21.15.12:0/4244463449 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00b820 con 0x7fef4006e0a0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef45599700 1 -- 172.21.15.12:0/4244463449 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3c00b980 con 0x7fef4006e0a0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef45599700 1 -- 172.21.15.12:0/4244463449 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3c00bd20 con 0x7fef4006e0a0 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 -- 172.21.15.12:0/4244463449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006e0a0 msgr2=0x7fef400c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 --2- 172.21.15.12:0/4244463449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006e0a0 0x7fef400c6b20 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0099b0 tx=0x7fef3c009250 comp rx=0 tx=0).stop 2023-10-08T17:43:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 -- 172.21.15.12:0/4244463449 shutdown_connections 2023-10-08T17:43:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 --2- 172.21.15.12:0/4244463449 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006e0a0 0x7fef400c6b20 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 -- 172.21.15.12:0/4244463449 >> 172.21.15.12:0/4244463449 conn(0x7fef4006d170 msgr2=0x7fef400cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.537+0000 7fef4759d700 1 -- 172.21.15.12:0/4244463449 shutdown_connections 2023-10-08T17:43:13.541 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.538+0000 7fef4759d700 1 -- 172.21.15.12:0/4244463449 wait complete. 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.539+0000 7fef4759d700 1 Processor -- start 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.539+0000 7fef4759d700 1 -- start start 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4006e0a0 0x7fef40138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef40150380 0x7fef400c5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef400c5a60 con 0x7fef4006f3a0 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef400af480 con 0x7fef4006e0a0 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef4759d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400af6f0 con 0x7fef40150380 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef45d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef45d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40554/0 (socket says 172.21.15.12:40554) 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.540+0000 7fef45d9a700 1 -- 172.21.15.12:0/1368912874 learned_addr learned my addr 172.21.15.12:0/1368912874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef4659b700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4006e0a0 0x7fef40138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 -- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef40150380 msgr2=0x7fef400c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef40150380 0x7fef400c5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 -- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4006e0a0 msgr2=0x7fef40138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4006e0a0 0x7fef40138490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 -- 172.21.15.12:0/1368912874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c0094f0 con 0x7fef4006f3a0 2023-10-08T17:43:13.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef45d9a700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c810 tx=0x7fef30007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30010510 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef30010690 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef30010a50 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef400af9d0 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.541+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef401389d0 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.542+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef400afef0 con 0x7fef4006f3a0 2023-10-08T17:43:13.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.543+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fef3001b400 con 0x7fef4006f3a0 2023-10-08T17:43:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.544+0000 7fef367fc700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.544+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7fef30084370 con 0x7fef4006f3a0 2023-10-08T17:43:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.544+0000 7fef4659b700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:13.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.545+0000 7fef4659b700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 0x7fef240693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0099b0 tx=0x7fef3c016000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:13.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.548+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef400afef0 con 0x7fef4006f3a0 2023-10-08T17:43:13.828 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:13.827+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fef400afef0 con 0x7fef4006f3a0 2023-10-08T17:43:14.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.017+0000 7fef367fc700 1 -- 172.21.15.12:0/1368912874 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v3038) v1 ==== 163+0+0 (secure 0 0 0) 0x7fef400afef0 con 0x7fef4006f3a0 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 msgr2=0x7fef240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 0x7fef240693e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0099b0 tx=0x7fef3c016000 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 msgr2=0x7fef400c4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fef3000c810 tx=0x7fef30007d60 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 shutdown_connections 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fef24066f30 0x7fef240693e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fef40150380 0x7fef400c5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fef4006e0a0 0x7fef40138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 --2- 172.21.15.12:0/1368912874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fef4006f3a0 0x7fef400c4fe0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 >> 172.21.15.12:0/1368912874 conn(0x7fef4006d170 msgr2=0x7fef401596d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:14.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 shutdown_connections 2023-10-08T17:43:14.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.019+0000 7fef4759d700 1 -- 172.21.15.12:0/1368912874 wait complete. 2023-10-08T17:43:14.038 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-10-08T17:43:14.038 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-10-08T17:43:14.038 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-10-08T17:43:14.039 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-08T17:43:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.226+0000 7f9ccc9ff700 1 Processor -- start 2023-10-08T17:43:14.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.226+0000 7f9ccc9ff700 1 -- start start 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9cc80cce90 0x7f9cc80cc150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9cc80cc690 0x7f9cc80c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80c4c70 0x7f9cc80b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80c3690 con 0x7f9cc80cc690 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc80c3970 con 0x7f9cc80cce90 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9ccc9ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc80c3c50 con 0x7f9cc80c4c70 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.227+0000 7f9cc5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9cc80cc690 0x7f9cc80c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:14.229 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f9cc80cc690 0x7f9cc80c4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40560/0 (socket says 172.21.15.12:40560) 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 -- 172.21.15.12:0/3124024189 learned_addr learned my addr 172.21.15.12:0/3124024189 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc6d9d700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80c4c70 0x7f9cc80b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc659c700 1 --2- 172.21.15.12:0/3124024189 >> v2:172.21.15.29:3300/0 conn(0x7f9cc80cce90 0x7f9cc80cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 -- 172.21.15.12:0/3124024189 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80c4c70 msgr2=0x7f9cc80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80c4c70 0x7f9cc80b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 -- 172.21.15.12:0/3124024189 >> v2:172.21.15.29:3300/0 conn(0x7f9cc80cce90 msgr2=0x7f9cc80cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 --2- 172.21.15.12:0/3124024189 >> v2:172.21.15.29:3300/0 conn(0x7f9cc80cce90 0x7f9cc80cc150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 -- 172.21.15.12:0/3124024189 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80c3f30 con 0x7f9cc80cc690 2023-10-08T17:43:14.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc5d9b700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80cc690 0x7f9cc80c4730 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8064ed0 tx=0x7f9cbc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61e3d2e860c95bb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:14.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc559a700 1 -- 172.21.15.12:0/3124024189 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00b860 con 0x7f9cc80cc690 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc559a700 1 -- 172.21.15.12:0/3124024189 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cbc00b9c0 con 0x7f9cc80cc690 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.228+0000 7f9cc559a700 1 -- 172.21.15.12:0/3124024189 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cbc00bd60 con 0x7f9cc80cc690 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3124024189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80cc690 msgr2=0x7f9cc80c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80cc690 0x7f9cc80c4730 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8064ed0 tx=0x7f9cbc009250 comp rx=0 tx=0).stop 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3124024189 shutdown_connections 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80c4c70 0x7f9cc80b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3124024189 >> v2:172.21.15.29:3300/0 conn(0x7f9cc80cce90 0x7f9cc80cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3124024189 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80cc690 0x7f9cc80c4730 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3124024189 >> 172.21.15.12:0/3124024189 conn(0x7f9cc806ce80 msgr2=0x7f9cc80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3124024189 shutdown_connections 2023-10-08T17:43:14.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.229+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3124024189 wait complete. 2023-10-08T17:43:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.231+0000 7f9ccc9ff700 1 Processor -- start 2023-10-08T17:43:14.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.231+0000 7f9ccc9ff700 1 -- start start 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cc80cc690 0x7f9cc814df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80cce90 0x7f9cc806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc806ec80 con 0x7f9cc80c4c70 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc806e070 con 0x7f9cc80cc690 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9ccc9ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc806e350 con 0x7f9cc80cce90 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40572/0 (socket says 172.21.15.12:40572) 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 -- 172.21.15.12:0/3452308494 learned_addr learned my addr 172.21.15.12:0/3452308494 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 -- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80cce90 msgr2=0x7f9cc806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80cce90 0x7f9cc806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.235 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 -- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cc80cc690 msgr2=0x7f9cc814df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cc80cc690 0x7f9cc814df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 -- 172.21.15.12:0/3452308494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cbc0094f0 con 0x7f9cc80c4c70 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.232+0000 7f9cc659c700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800d840 tx=0x7f9cb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.233+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8014620 con 0x7f9cc80c4c70 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.233+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb8014780 con 0x7f9cc80c4c70 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.233+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc806e630 con 0x7f9cc80c4c70 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.233+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb8014b40 con 0x7f9cc80c4c70 2023-10-08T17:43:14.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.233+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc814e4d0 con 0x7f9cc80c4c70 2023-10-08T17:43:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.234+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc804c3c0 con 0x7f9cc80c4c70 2023-10-08T17:43:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.235+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cb801d400 con 0x7f9cc80c4c70 2023-10-08T17:43:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.236+0000 7f9cb67fc700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.236+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f9cb8084ff0 con 0x7f9cc80c4c70 2023-10-08T17:43:14.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.236+0000 7f9cc5d9b700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:14.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.237+0000 7f9cc5d9b700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 0x7f9ca80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8064ed0 tx=0x7f9cbc017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:14.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.240+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cb8052040 con 0x7f9cc80c4c70 2023-10-08T17:43:14.523 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:14.522+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f9cc81599c0 con 0x7f9cc80c4c70 2023-10-08T17:43:15.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.018+0000 7f9cb67fc700 1 -- 172.21.15.12:0/3452308494 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3039) v1 ==== 158+0+0 (secure 0 0 0) 0x7f9cb8055660 con 0x7f9cc80c4c70 2023-10-08T17:43:15.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 msgr2=0x7f9ca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 0x7f9ca80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8064ed0 tx=0x7f9cbc017000 comp rx=0 tx=0).stop 2023-10-08T17:43:15.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 msgr2=0x7f9cc80c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800d840 tx=0x7f9cb8008040 comp rx=0 tx=0).stop 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 shutdown_connections 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9ca8066f30 0x7f9ca80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9cc80c4c70 0x7f9cc80c6540 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9cc80cce90 0x7f9cc806d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 --2- 172.21.15.12:0/3452308494 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9cc80cc690 0x7f9cc814df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 >> 172.21.15.12:0/3452308494 conn(0x7f9cc806ce80 msgr2=0x7f9cc80ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 shutdown_connections 2023-10-08T17:43:15.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.021+0000 7f9ccc9ff700 1 -- 172.21.15.12:0/3452308494 wait complete. 2023-10-08T17:43:15.041 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-08T17:43:15.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.230+0000 7f6d98d9d700 1 Processor -- start 2023-10-08T17:43:15.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.230+0000 7f6d98d9d700 1 -- start start 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d98d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d94155c60 0x7f6d940c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d98d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d940c7e70 con 0x7f6d9406de50 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d98d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9406b790 con 0x7f6d94155890 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d98d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9406ab80 con 0x7f6d94155c60 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d93fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6d9406de50 0x7f6d940c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48290/0 (socket says 172.21.15.12:48290) 2023-10-08T17:43:15.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d93fff700 1 -- 172.21.15.12:0/194982467 learned_addr learned my addr 172.21.15.12:0/194982467 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:15.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d94155c60 0x7f6d940c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356937658 0 0) 0x7f6d940c7e70 con 0x7f6d9406de50 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.232+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d7c003570 con 0x7f6d9406de50 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517361882 0 0) 0x7f6d9406b790 con 0x7f6d94155890 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d940c7e70 con 0x7f6d94155890 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 99058996 0 0) 0x7f6d7c003570 con 0x7f6d9406de50 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d94155c60 msgr2=0x7f6d940c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d94155c60 0x7f6d940c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 >> v1:172.21.15.29:6789/0 conn(0x7f6d94155890 legacy=0x7f6d9406a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9406ae60 con 0x7f6d9406de50 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f6d8c0017f0 con 0x7f6d9406de50 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 >> v1:172.21.15.12:6789/0 conn(0x7f6d9406de50 legacy=0x7f6d940c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d7c004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d7c004810 0x7f6d7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d7c0051c0 0x7f6d7c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9406ab80 con 0x7f6d7c003c20 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c00e230 con 0x7f6d7c004810 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c00e3f0 con 0x7f6d7c0051c0 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d94155c60 0x7f6d940c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d937fe700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d7c004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.233+0000 7f6d93fff700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d7c0051c0 0x7f6d7c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d7c004810 0x7f6d7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 -- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d7c0051c0 msgr2=0x7f6d7c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:15.238 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d7c0051c0 0x7f6d7c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 -- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d7c004810 msgr2=0x7f6d7c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d7c004810 0x7f6d7c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 -- 172.21.15.12:0/194982467 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c003570 con 0x7f6d7c003c20 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d937fe700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d7c004010 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f6d84001a10 tx=0x7f6d84007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7188005ce9816e95 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400c5d0 con 0x7f6d7c003c20 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400c730 con 0x7f6d7c003c20 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.234+0000 7f6d927fc700 1 -- 172.21.15.12:0/194982467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400caf0 con 0x7f6d7c003c20 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 -- 172.21.15.12:0/194982467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 msgr2=0x7f6d7c004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/194982467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d7c004010 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f6d84001a10 tx=0x7f6d84007d10 comp rx=0 tx=0).stop 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d93fff700 1 -- 172.21.15.12:0/194982467 reap_dead start 2023-10-08T17:43:15.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 -- 172.21.15.12:0/194982467 shutdown_connections 2023-10-08T17:43:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 -- 172.21.15.12:0/194982467 >> 172.21.15.12:0/194982467 conn(0x7f6d9406d110 msgr2=0x7f6d940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 -- 172.21.15.12:0/194982467 shutdown_connections 2023-10-08T17:43:15.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.235+0000 7f6d98d9d700 1 -- 172.21.15.12:0/194982467 wait complete. 2023-10-08T17:43:15.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.236+0000 7f6d98d9d700 1 Processor -- start 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 -- start start 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d940b0120 0x7f6d940b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 0x7f6d940c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c35b0 con 0x7f6d7c003c20 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940c6090 con 0x7f6d940c56e0 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.237+0000 7f6d98d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d940afc90 con 0x7f6d940b0120 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40602/0 (socket says 172.21.15.12:40602) 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 -- 172.21.15.12:0/1000378632 learned_addr learned my addr 172.21.15.12:0/1000378632 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d93fff700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 0x7f6d940c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d940b0120 0x7f6d940b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 -- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d940b0120 msgr2=0x7f6d940b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d940b0120 0x7f6d940b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 -- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 msgr2=0x7f6d940c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 0x7f6d940c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 -- 172.21.15.12:0/1000378632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94152920 con 0x7f6d7c003c20 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d93fff700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 0x7f6d940c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.238+0000 7f6d937fe700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6d84012f40 tx=0x7f6d84015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.239+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d840013b0 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.239+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400ce60 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.239+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400cad0 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.239+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940af080 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.239+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d940af640 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.240+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9404c3c0 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.240+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d84019030 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.241+0000 7f6d7b7fe700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 0x7f6d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.241+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f6d84085d20 con 0x7f6d7c003c20 2023-10-08T17:43:15.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.242+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 0x7f6d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.242+0000 7f6d92ffd700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 0x7f6d800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d88008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.246+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d8408c080 con 0x7f6d7c003c20 2023-10-08T17:43:15.448 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.447+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6d9406f170 con 0x7f6d7c003c20 2023-10-08T17:43:15.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.452+0000 7f6d7b7fe700 1 -- 172.21.15.12:0/1000378632 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v70)=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6d8402b0c0 con 0x7f6d7c003c20 2023-10-08T17:43:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 msgr2=0x7f6d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 0x7f6d800693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d88008040 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 msgr2=0x7f6d941523e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f6d84012f40 tx=0x7f6d84015000 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 shutdown_connections 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6d80066f30 0x7f6d800693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6d7c003c20 0x7f6d941523e0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6d940c56e0 0x7f6d940c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 --2- 172.21.15.12:0/1000378632 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6d940b0120 0x7f6d940b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 >> 172.21.15.12:0/1000378632 conn(0x7f6d9406d110 msgr2=0x7f6d940c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 shutdown_connections 2023-10-08T17:43:15.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.454+0000 7f6d98d9d700 1 -- 172.21.15.12:0/1000378632 wait complete. 2023-10-08T17:43:15.472 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:43:15.473 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:15.553 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:15.650 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:43:15.650 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-08T17:43:15.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.836+0000 7f87b759e700 1 Processor -- start 2023-10-08T17:43:15.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.836+0000 7f87b759e700 1 -- start start 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f87b806f450 0x7f87b80aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b80b1f10 con 0x7f87b80cbbe0 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b8157ad0 con 0x7f87b8156030 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b8156570 con 0x7f87b806f450 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f87b80cbbe0 0x7f87b806ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48306/0 (socket says 172.21.15.12:48306) 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b659c700 1 -- 172.21.15.12:0/148596177 learned_addr learned my addr 172.21.15.12:0/148596177 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:15.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87affff700 1 --2- 172.21.15.12:0/148596177 >> v2:172.21.15.29:3300/0 conn(0x7f87b806f450 0x7f87b80aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b5d9b700 1 -- 172.21.15.12:0/148596177 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240797530 0 0) 0x7f87b80b1f10 con 0x7f87b80cbbe0 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87b5d9b700 1 -- 172.21.15.12:0/148596177 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a4003570 con 0x7f87b80cbbe0 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87affff700 1 -- 172.21.15.12:0/148596177 >> v1:172.21.15.29:6789/0 conn(0x7f87b8156030 legacy=0x7f87b80adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.838+0000 7f87affff700 1 -- 172.21.15.12:0/148596177 >> v1:172.21.15.12:6789/0 conn(0x7f87b80cbbe0 legacy=0x7f87b806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87affff700 1 -- 172.21.15.12:0/148596177 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8156850 con 0x7f87b806f450 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87affff700 1 --2- 172.21.15.12:0/148596177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b806f450 0x7f87b80aee90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f87a00098e0 tx=0x7f87a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45284569992a5a88 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87b5d9b700 1 -- 172.21.15.12:0/148596177 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000b640 con 0x7f87b806f450 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87b5d9b700 1 -- 172.21.15.12:0/148596177 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a000b7a0 con 0x7f87b806f450 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87b5d9b700 1 -- 172.21.15.12:0/148596177 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a000bb40 con 0x7f87b806f450 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87b759e700 1 -- 172.21.15.12:0/148596177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b806f450 msgr2=0x7f87b80aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.839+0000 7f87b759e700 1 --2- 172.21.15.12:0/148596177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b806f450 0x7f87b80aee90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f87a00098e0 tx=0x7f87a00091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.840+0000 7f87b759e700 1 -- 172.21.15.12:0/148596177 shutdown_connections 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.840+0000 7f87b759e700 1 --2- 172.21.15.12:0/148596177 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b806f450 0x7f87b80aee90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.840+0000 7f87b759e700 1 -- 172.21.15.12:0/148596177 >> 172.21.15.12:0/148596177 conn(0x7f87b806d170 msgr2=0x7f87b80cc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.840+0000 7f87b759e700 1 -- 172.21.15.12:0/148596177 shutdown_connections 2023-10-08T17:43:15.842 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.840+0000 7f87b759e700 1 -- 172.21.15.12:0/148596177 wait complete. 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.841+0000 7f87b759e700 1 Processor -- start 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.841+0000 7f87b759e700 1 -- start start 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b806f450 0x7f87b81366e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 0x7f87b8154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8150c10 con 0x7f87b80cbbe0 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8150e60 con 0x7f87b8156030 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87b759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b8151140 con 0x7f87b806f450 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.844 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40606/0 (socket says 172.21.15.12:40606) 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.842+0000 7f87affff700 1 -- 172.21.15.12:0/2001925531 learned_addr learned my addr 172.21.15.12:0/2001925531 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87b659c700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b806f450 0x7f87b81366e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87b6d9d700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 0x7f87b8154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 -- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b806f450 msgr2=0x7f87b81366e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b806f450 0x7f87b81366e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 -- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 msgr2=0x7f87b8154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 0x7f87b8154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 -- 172.21.15.12:0/2001925531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a0009420 con 0x7f87b80cbbe0 2023-10-08T17:43:15.845 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87b6d9d700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 0x7f87b8154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:15.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87affff700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f87a00093f0 tx=0x7f87a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.846 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0000bc0 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a000b910 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0025670 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.843+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b8151420 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.844+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b80aa040 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.845+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b804c3c0 con 0x7f87b80cbbe0 2023-10-08T17:43:15.847 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.845+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87a0023070 con 0x7f87b80cbbe0 2023-10-08T17:43:15.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.846+0000 7f87ae7fc700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:15.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.846+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7f87a00858f0 con 0x7f87b80cbbe0 2023-10-08T17:43:15.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.847+0000 7f87b659c700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:15.848 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.847+0000 7f87b659c700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 0x7f87980693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87a8007fd0 tx=0x7f87a8009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:15.852 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:15.851+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87a00529a0 con 0x7f87b80cbbe0 2023-10-08T17:43:16.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.097+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87b80acff0 con 0x7f87b80cbbe0 2023-10-08T17:43:16.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.098+0000 7f87ae7fc700 1 -- 172.21.15.12:0/2001925531 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f87a0015020 con 0x7f87b80cbbe0 2023-10-08T17:43:16.099 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:16.099 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8042,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/1556121173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":1556121173},{"type":"v1","addr":"172.21.15.29:6835","nonce":1556121173}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9193,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/2728706732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2728706732},{"type":"v1","addr":"172.21.15.29:6834","nonce":2728706732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":9514,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/1763618589","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":1763618589},{"type":"v1","addr":"172.21.15.12:6835","nonce":1763618589}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":9786,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/570654130","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":570654130},{"type":"v1","addr":"172.21.15.12:6833","nonce":570654130}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[]} 2023-10-08T17:43:16.101 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 msgr2=0x7f87980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 0x7f87980693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f87a8007fd0 tx=0x7f87a8009040 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 msgr2=0x7f87b80a9b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f87a00093f0 tx=0x7f87a0017000 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 shutdown_connections 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8798066f30 0x7f87980693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f87b8156030 0x7f87b8154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f87b806f450 0x7f87b81366e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 --2- 172.21.15.12:0/2001925531 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f87b80cbbe0 0x7f87b80a9b00 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 >> 172.21.15.12:0/2001925531 conn(0x7f87b806d170 msgr2=0x7f87b814f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 shutdown_connections 2023-10-08T17:43:16.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.100+0000 7f87b759e700 1 -- 172.21.15.12:0/2001925531 wait complete. 2023-10-08T17:43:16.103 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 93 2023-10-08T17:43:16.119 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-08T17:43:16.119 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-08T17:43:16.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T17:43:16.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:43:16.120 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-08T17:43:16.120 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-08T17:43:16.120 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T17:43:16.120 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:43:16.120 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-08T17:43:16.120 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-08T17:43:16.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T17:43:16.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:43:16.121 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-08T17:43:16.121 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-08T17:43:16.121 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T17:43:16.121 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:43:16.133 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T17:43:16.133 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-08T17:43:16.134 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T17:43:16.134 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-08T17:43:16.141 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T17:43:16.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-08T17:43:16.142 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T17:43:16.142 DEBUG:teuthology.orchestra.run.smithi029:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-08T17:43:16.178 INFO:tasks.ceph.mds.c:Started 2023-10-08T17:43:16.179 DEBUG:teuthology.parallel:result is None 2023-10-08T17:43:16.181 INFO:tasks.ceph.mds.a:Started 2023-10-08T17:43:16.181 DEBUG:teuthology.parallel:result is None 2023-10-08T17:43:16.187 INFO:tasks.ceph.mds.d:Started 2023-10-08T17:43:16.187 DEBUG:teuthology.parallel:result is None 2023-10-08T17:43:16.190 INFO:tasks.ceph.mds.b:Started 2023-10-08T17:43:16.190 DEBUG:teuthology.parallel:result is None 2023-10-08T17:43:16.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-08T17:43:16.315 INFO:tasks.ceph.mds.c.smithi012.stdout:starting mds.c at 2023-10-08T17:43:16.320 INFO:tasks.ceph.mds.a.smithi012.stdout:starting mds.a at 2023-10-08T17:43:16.331 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T17:43:16.332 INFO:tasks.ceph.mds.d.smithi029.stdout:starting mds.d at 2023-10-08T17:43:16.333 INFO:tasks.ceph.mds.d.smithi029.stderr:2023-10-08T17:43:16.332+0000 7fcb2c7fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-08T17:43:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.391+0000 7fb9bb59d700 1 Processor -- start 2023-10-08T17:43:16.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.391+0000 7fb9bb59d700 1 -- start start 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.392+0000 7fb9bb59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb9b415dfd0 0x7fb9b40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.392+0000 7fb9bb59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 0x7fb9b40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.392+0000 7fb9bb59d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b40acc00 con 0x7fb9b4159550 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.392+0000 7fb9bb59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40abff0 con 0x7fb9b4159920 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.392+0000 7fb9bb59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b40ac2d0 con 0x7fb9b415dfd0 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9ba59b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb9b4159550 0x7fb9b40ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48342/0 (socket says 172.21.15.12:48342) 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9ba59b700 1 -- 172.21.15.12:0/521245860 learned_addr learned my addr 172.21.15.12:0/521245860 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:16.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9bad9c700 1 --2- 172.21.15.12:0/521245860 >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 0x7fb9b40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/521245860 >> v2:172.21.15.29:3300/0 conn(0x7fb9b415dfd0 0x7fb9b40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9599700 1 -- 172.21.15.12:0/521245860 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2180876117 0 0) 0x7fb9b40acc00 con 0x7fb9b4159550 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9599700 1 -- 172.21.15.12:0/521245860 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003570 con 0x7fb9b4159550 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9d9a700 1 -- 172.21.15.12:0/521245860 >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 msgr2=0x7fb9b40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/521245860 >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 0x7fb9b40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9d9a700 1 -- 172.21.15.12:0/521245860 >> v1:172.21.15.12:6789/0 conn(0x7fb9b4159550 legacy=0x7fb9b40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9b9d9a700 1 -- 172.21.15.12:0/521245860 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b40ac5b0 con 0x7fb9b415dfd0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.393+0000 7fb9bad9c700 1 --2- 172.21.15.12:0/521245860 >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 0x7fb9b40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/521245860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40aedb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406c180 tx=0x7fb9a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c07c7ac756e51f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9b9599700 1 -- 172.21.15.12:0/521245860 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4011630 con 0x7fb9b415dfd0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9b9599700 1 -- 172.21.15.12:0/521245860 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a40117b0 con 0x7fb9b415dfd0 2023-10-08T17:43:16.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9b9599700 1 -- 172.21.15.12:0/521245860 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a4011b70 con 0x7fb9b415dfd0 2023-10-08T17:43:16.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 -- 172.21.15.12:0/521245860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 msgr2=0x7fb9b40aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/521245860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40aedb0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406c180 tx=0x7fb9a40091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 -- 172.21.15.12:0/521245860 shutdown_connections 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/521245860 >> v2:172.21.15.12:3300/0 conn(0x7fb9b4159920 0x7fb9b40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/521245860 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40aedb0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.394+0000 7fb9bb59d700 1 -- 172.21.15.12:0/521245860 >> 172.21.15.12:0/521245860 conn(0x7fb9b406ce80 msgr2=0x7fb9b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.395+0000 7fb9bb59d700 1 -- 172.21.15.12:0/521245860 shutdown_connections 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.395+0000 7fb9bb59d700 1 -- 172.21.15.12:0/521245860 wait complete. 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.396+0000 7fb9bb59d700 1 Processor -- start 2023-10-08T17:43:16.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.396+0000 7fb9bb59d700 1 -- start start 2023-10-08T17:43:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb9b4159920 0x7fb9b40c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b414d570 con 0x7fb9b4159550 2023-10-08T17:43:16.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b4151600 con 0x7fb9b415dfd0 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9bb59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b40c8af0 con 0x7fb9b4159920 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9ba59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9ba59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40654/0 (socket says 172.21.15.12:40654) 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.397+0000 7fb9ba59b700 1 -- 172.21.15.12:0/927871773 learned_addr learned my addr 172.21.15.12:0/927871773 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9bad9c700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb9b4159920 0x7fb9b40c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 -- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb9b4159920 msgr2=0x7fb9b40c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb9b4159920 0x7fb9b40c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 -- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 msgr2=0x7fb9b40b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:16.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 -- 172.21.15.12:0/927871773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac009a20 con 0x7fb9b4159550 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9bad9c700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9ba59b700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c7c0 tx=0x7fb9b0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0005b30 con 0x7fb9b4159550 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0005c90 con 0x7fb9b4159550 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007340 con 0x7fb9b4159550 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a4009420 con 0x7fb9b4159550 2023-10-08T17:43:16.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.398+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b4151850 con 0x7fb9b4159550 2023-10-08T17:43:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.400+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b404c3c0 con 0x7fb9b4159550 2023-10-08T17:43:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.400+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9b001b400 con 0x7fb9b4159550 2023-10-08T17:43:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.401+0000 7fb9aa7fc700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 0x7fb9980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.401+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 6147+0+0 (secure 0 0 0) 0x7fb9b00842a0 con 0x7fb9b4159550 2023-10-08T17:43:16.403 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.401+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 0x7fb9980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:16.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.402+0000 7fb9b9d9a700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 0x7fb9980693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406c180 tx=0x7fb9a4017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:16.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.405+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9b0051330 con 0x7fb9b4159550 2023-10-08T17:43:16.632 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:16.630+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb9b406e7c0 con 0x7fb9b4159550 2023-10-08T17:43:17.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.465+0000 7fb9aa7fc700 1 -- 172.21.15.12:0/927871773 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v209) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb9b0054950 con 0x7fb9b4159550 2023-10-08T17:43:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 msgr2=0x7fb9980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 0x7fb9980693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb9b406c180 tx=0x7fb9a4017000 comp rx=0 tx=0).stop 2023-10-08T17:43:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 msgr2=0x7fb9b414d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c7c0 tx=0x7fb9b0007e00 comp rx=0 tx=0).stop 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 shutdown_connections 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb998066f30 0x7fb9980693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb9b4159550 0x7fb9b414d030 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb9b415dfd0 0x7fb9b40b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 --2- 172.21.15.12:0/927871773 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb9b4159920 0x7fb9b40c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.468+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 >> 172.21.15.12:0/927871773 conn(0x7fb9b406ce80 msgr2=0x7fb9b40b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.469+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 shutdown_connections 2023-10-08T17:43:17.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.469+0000 7fb9bb59d700 1 -- 172.21.15.12:0/927871773 wait complete. 2023-10-08T17:43:17.472 INFO:teuthology.orchestra.run.smithi012.stderr: removed all blocklist entries 2023-10-08T17:43:17.490 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-08T17:43:17.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.681+0000 7fb933fff700 1 Processor -- start 2023-10-08T17:43:17.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.681+0000 7fb933fff700 1 -- start start 2023-10-08T17:43:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.682+0000 7fb933fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb93413fb20 0x7fb93415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.682+0000 7fb933fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb93413fef0 0x7fb9340c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.684 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.682+0000 7fb933fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93415ae70 con 0x7fb93406aaa0 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.682+0000 7fb933fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93406af60 con 0x7fb93413fef0 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.682+0000 7fb933fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93406b240 con 0x7fb93413fb20 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb93413fef0 0x7fb9340c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9337fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb93406aaa0 0x7fb9340c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48346/0 (socket says 172.21.15.12:48346) 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9337fe700 1 -- 172.21.15.12:0/2539598221 learned_addr learned my addr 172.21.15.12:0/2539598221 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb932ffd700 1 --2- 172.21.15.12:0/2539598221 >> v2:172.21.15.29:3300/0 conn(0x7fb93413fb20 0x7fb93415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 -- 172.21.15.12:0/2539598221 >> v2:172.21.15.29:3300/0 conn(0x7fb93413fb20 msgr2=0x7fb93415a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 --2- 172.21.15.12:0/2539598221 >> v2:172.21.15.29:3300/0 conn(0x7fb93413fb20 0x7fb93415a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 -- 172.21.15.12:0/2539598221 >> v1:172.21.15.12:6789/0 conn(0x7fb93406aaa0 legacy=0x7fb9340c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 -- 172.21.15.12:0/2539598221 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93406b520 con 0x7fb93413fef0 2023-10-08T17:43:17.685 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb931ffb700 1 -- 172.21.15.12:0/2539598221 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3782811686 0 0) 0x7fb92c001490 con 0x7fb93406aaa0 2023-10-08T17:43:17.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.683+0000 7fb9327fc700 1 --2- 172.21.15.12:0/2539598221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fef0 0x7fb9340c7990 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fb9340695b0 tx=0x7fb928009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ac9a9cbf067827 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb931ffb700 1 -- 172.21.15.12:0/2539598221 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928005c10 con 0x7fb93413fef0 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb931ffb700 1 -- 172.21.15.12:0/2539598221 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb928005d70 con 0x7fb93413fef0 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb931ffb700 1 -- 172.21.15.12:0/2539598221 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb928006260 con 0x7fb93413fef0 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 -- 172.21.15.12:0/2539598221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fef0 msgr2=0x7fb9340c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 --2- 172.21.15.12:0/2539598221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fef0 0x7fb9340c7990 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fb9340695b0 tx=0x7fb928009120 comp rx=0 tx=0).stop 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 -- 172.21.15.12:0/2539598221 shutdown_connections 2023-10-08T17:43:17.687 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 --2- 172.21.15.12:0/2539598221 >> v2:172.21.15.29:3300/0 conn(0x7fb93413fb20 0x7fb93415a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 --2- 172.21.15.12:0/2539598221 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fef0 0x7fb9340c7990 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 -- 172.21.15.12:0/2539598221 >> 172.21.15.12:0/2539598221 conn(0x7fb93406d170 msgr2=0x7fb9340cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 -- 172.21.15.12:0/2539598221 shutdown_connections 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.684+0000 7fb933fff700 1 -- 172.21.15.12:0/2539598221 wait complete. 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.686+0000 7fb933fff700 1 Processor -- start 2023-10-08T17:43:17.688 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.686+0000 7fb933fff700 1 -- start start 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb93406aaa0 0x7fb93416ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb93413fef0 0x7fb93415e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934156e90 con 0x7fb93413fb20 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341570a0 con 0x7fb93406aaa0 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb933fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb934157380 con 0x7fb93413fef0 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb9327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb9327fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40672/0 (socket says 172.21.15.12:40672) 2023-10-08T17:43:17.690 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb9327fc700 1 -- 172.21.15.12:0/1054427937 learned_addr learned my addr 172.21.15.12:0/1054427937 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb932ffd700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb93406aaa0 0x7fb93416ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.687+0000 7fb9337fe700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb93413fef0 0x7fb93415e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 -- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb93413fef0 msgr2=0x7fb93415e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb93413fef0 0x7fb93415e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 -- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb93406aaa0 msgr2=0x7fb93416ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb93406aaa0 0x7fb93416ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 -- 172.21.15.12:0/1054427937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9280093c0 con 0x7fb93413fb20 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb9327fc700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fb928012000 tx=0x7fb928016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92800bcf0 con 0x7fb93413fb20 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92800be50 con 0x7fb93413fb20 2023-10-08T17:43:17.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934157660 con 0x7fb93413fb20 2023-10-08T17:43:17.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92801b6d0 con 0x7fb93413fb20 2023-10-08T17:43:17.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.688+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb934157c20 con 0x7fb93413fb20 2023-10-08T17:43:17.692 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.689+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb934157e40 con 0x7fb93413fb20 2023-10-08T17:43:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.690+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb92801bac0 con 0x7fb93413fb20 2023-10-08T17:43:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.691+0000 7fb91affd700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.691+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fb928086930 con 0x7fb93413fb20 2023-10-08T17:43:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.691+0000 7fb932ffd700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:17.693 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.692+0000 7fb932ffd700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 0x7fb9200693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb924006fd0 tx=0x7fb924008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:17.696 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.695+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb928053c50 con 0x7fb93413fb20 2023-10-08T17:43:17.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.974+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb93404c3c0 con 0x7fb93413fb20 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.975+0000 7fb91affd700 1 -- 172.21.15.12:0/1054427937 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v48) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb928057270 con 0x7fb93413fb20 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: "auth_dump": [ 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.a", 2023-10-08T17:43:17.976 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJldtSxDBAAZnz9LODkoUN+f9I5uNPDPw==", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.b", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlV4/VIhAARcoPPqjrMZJO5DdJs9A+uA==", 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.977 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.c", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlM3K0FxAALkUOqUNUpMkcTiKlLYSU2w==", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:43:17.978 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mds.d", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlUATkLRAA9vYeyJNehhQy2EkvJfnQdw==", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.979 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.0", 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD00yJlOckAGBAA/lEbLv/vTAV7XGDvymcRBw==", 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.980 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.1", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD30yJlEF5zHBAAsTLJ8acPkLiKZ36OFIFU7Q==", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.2", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD60yJlFeMmIRAA6tA5SURDO88L7jNyf9VBkw==", 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.981 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.3", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQD90yJl2ISHJhAAbjbed1u7TlWhvLmgoKP1qA==", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.982 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.4", 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAC1CJlDQmIAxAAxi+FNg/58SbPfA9RRMgYJg==", 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.983 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.5", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAF1CJlItB3CRAAMQ9y7ZcFFNi2kwVA2+dhGg==", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.6", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAI1CJlWq2RDRAA7JTRmsbQK2QWWpG1ulTx+w==", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.984 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "osd.7", 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQAL1CJlu5hKEhAAFpSM8e6YQyTY1kUFcYlBWw==", 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow profile osd", 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile osd", 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.985 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.0", 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJl3ZrlNhAANvfb//qV/n6if7zOYlkmmw==", 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow r", 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.1", 2023-10-08T17:43:17.986 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlV9/JCRAA05nUjIl6cVyTbFIwtYLAyA==", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.2", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJlZyjEAhAA2G0uKBq2ExzHncUanwWBvg==", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.987 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.3", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDw0yJl9S+kEBAAQx0z2AaHjUuinPM97FKVFQ==", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow r", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow rw", 2023-10-08T17:43:17.988 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow rwx" 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "client.admin", 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlHFq/ExAAMzJ1pq8Rb2HxM3zmM7+ZKQ==", 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "mgr": "allow *", 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow *", 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.989 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.x", 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDv0yJlZ4s7BRAAAQPZuQC+ZzCyj0zrCdNrVA==", 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: }, 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "entity": "mgr.y", 2023-10-08T17:43:17.990 INFO:teuthology.orchestra.run.smithi012.stdout: "key": "AQDu0yJlOO+jOBAATzgXD5zhw0wKz1OZkk08dg==", 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: "caps": { 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: "mds": "allow *", 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: "mon": "allow profile mgr", 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: "osd": "allow *" 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout: ] 2023-10-08T17:43:17.991 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 msgr2=0x7fb9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 0x7fb9200693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb924006fd0 tx=0x7fb924008040 comp rx=0 tx=0).stop 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 msgr2=0x7fb934156950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7fb928012000 tx=0x7fb928016000 comp rx=0 tx=0).stop 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 shutdown_connections 2023-10-08T17:43:17.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb920066f30 0x7fb9200693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb93413fef0 0x7fb93415e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb93406aaa0 0x7fb93416ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 --2- 172.21.15.12:0/1054427937 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb93413fb20 0x7fb934156950 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 >> 172.21.15.12:0/1054427937 conn(0x7fb93406d170 msgr2=0x7fb9340cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 shutdown_connections 2023-10-08T17:43:17.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:17.977+0000 7fb933fff700 1 -- 172.21.15.12:0/1054427937 wait complete. 2023-10-08T17:43:17.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.182+0000 7f02777ff700 1 Processor -- start 2023-10-08T17:43:18.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.183+0000 7f02777ff700 1 -- start start 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f02777ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f02700b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f02777ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0270158210 con 0x7f02700ccba0 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f02777ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02700cb290 con 0x7f02701579d0 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f02777ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02700cb850 con 0x7f0270157600 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f0275d9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f02700ccba0 0x7f0270158db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48362/0 (socket says 172.21.15.12:48362) 2023-10-08T17:43:18.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.184+0000 7f0275d9c700 1 -- 172.21.15.12:0/1774573302 learned_addr learned my addr 172.21.15.12:0/1774573302 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f027559b700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f02700b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3182591665 0 0) 0x7f0270158210 con 0x7f02700ccba0 2023-10-08T17:43:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f025c003570 con 0x7f02700ccba0 2023-10-08T17:43:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1256745856 0 0) 0x7f025c003570 con 0x7f02700ccba0 2023-10-08T17:43:18.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 msgr2=0x7f02700b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f02700b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 >> v1:172.21.15.29:6789/0 conn(0x7f02701579d0 legacy=0x7f02701586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700cb570 con 0x7f02700ccba0 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f02680017f0 con 0x7f02700ccba0 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 >> v1:172.21.15.12:6789/0 conn(0x7f02700ccba0 legacy=0x7f0270158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025c003a90 0x7f025c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f025c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f025c004d50 0x7f025c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02700cb850 con 0x7f025c004d50 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c00bb40 con 0x7f025c003a90 2023-10-08T17:43:18.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.185+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c00bd00 con 0x7f0270157600 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f025c004d50 0x7f025c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f027559b700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025c003a90 0x7f025c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0274d9a700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f025c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 -- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 msgr2=0x7f025c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0270157600 0x7f025c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 -- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025c003a90 msgr2=0x7f025c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f025c003a90 0x7f025c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 -- 172.21.15.12:0/1774573302 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c003570 con 0x7f025c004d50 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0275d9c700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f025c004d50 0x7f025c0051c0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f026800a880 tx=0x7f0268002120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6c81cbddc999d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02680070f0 con 0x7f025c004d50 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0268007250 con 0x7f025c004d50 2023-10-08T17:43:18.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.186+0000 7f0267fff700 1 -- 172.21.15.12:0/1774573302 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268007610 con 0x7f025c004d50 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 -- 172.21.15.12:0/1774573302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f025c004d50 msgr2=0x7f025c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 --2- 172.21.15.12:0/1774573302 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f025c004d50 0x7f025c0051c0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f026800a880 tx=0x7f0268002120 comp rx=0 tx=0).stop 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f0275d9c700 1 -- 172.21.15.12:0/1774573302 reap_dead start 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 -- 172.21.15.12:0/1774573302 shutdown_connections 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 -- 172.21.15.12:0/1774573302 >> 172.21.15.12:0/1774573302 conn(0x7f027006d170 msgr2=0x7f02700cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 -- 172.21.15.12:0/1774573302 shutdown_connections 2023-10-08T17:43:18.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.187+0000 7f02777ff700 1 -- 172.21.15.12:0/1774573302 wait complete. 2023-10-08T17:43:18.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.189+0000 7f02777ff700 1 Processor -- start 2023-10-08T17:43:18.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.189+0000 7f02777ff700 1 -- start start 2023-10-08T17:43:18.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f025c004d50 0x7f0270143b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02700af8e0 0x7f02700afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027015d710 con 0x7f0270159ca0 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027015a940 con 0x7f02700af8e0 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f02777ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0270159500 con 0x7f025c004d50 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40690/0 (socket says 172.21.15.12:40690) 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 -- 172.21.15.12:0/702606714 learned_addr learned my addr 172.21.15.12:0/702606714 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 -- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f025c004d50 msgr2=0x7f0270143b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f027559b700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f025c004d50 0x7f0270143b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f025c004d50 0x7f0270143b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 -- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02700af8e0 msgr2=0x7f02700afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02700af8e0 0x7f02700afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 -- 172.21.15.12:0/702606714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700b0290 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.190+0000 7f0275d9c700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f0268012000 tx=0x7f0268016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.191+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0268002120 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.191+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0268023070 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.191+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02680012d0 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.191+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027015a680 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.191+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0270158a20 con 0x7f0270159ca0 2023-10-08T17:43:18.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.192+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027004c3c0 con 0x7f0270159ca0 2023-10-08T17:43:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.193+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02680073c0 con 0x7f0270159ca0 2023-10-08T17:43:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.193+0000 7f02657fa700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.194+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f0268086cc0 con 0x7f0270159ca0 2023-10-08T17:43:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.194+0000 7f027559b700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.194+0000 7f027559b700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 0x7f02540693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f026c006f00 tx=0x7f026c008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.198+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f026808d080 con 0x7f0270159ca0 2023-10-08T17:43:18.406 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.405+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f027006abe0 con 0x7f0270159ca0 2023-10-08T17:43:18.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.406+0000 7f02657fa700 1 -- 172.21.15.12:0/702606714 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v209) v1 ==== 74+0+12994 (secure 0 0 0) 0x7f0268053fe0 con 0x7f0270159ca0 2023-10-08T17:43:18.407 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:18.408 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":209,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:17.462472+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":196,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:18.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 msgr2=0x7f02540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 0x7f02540693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f026c006f00 tx=0x7f026c008040 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 msgr2=0x7f027015a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f0268012000 tx=0x7f0268016000 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 shutdown_connections 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0254066f30 0x7f02540693e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0270159ca0 0x7f027015a140 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f025c004d50 0x7f0270143b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 --2- 172.21.15.12:0/702606714 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f02700af8e0 0x7f02700afd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 >> 172.21.15.12:0/702606714 conn(0x7f027006d170 msgr2=0x7f02700b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 shutdown_connections 2023-10-08T17:43:18.411 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.409+0000 7f02777ff700 1 -- 172.21.15.12:0/702606714 wait complete. 2023-10-08T17:43:18.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-08T17:43:18.428 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:43:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.618+0000 7f71b4b9d700 1 Processor -- start 2023-10-08T17:43:18.619 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.618+0000 7f71b4b9d700 1 -- start start 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71b4b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f71b0153dd0 0x7f71b015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71b4b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f71b00cea00 0x7f71b00ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71b4b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b015ac50 con 0x7f71b0153a00 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71b4b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b015d010 con 0x7f71b00cea00 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71b4b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00cf3e0 con 0x7f71b0153dd0 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71af7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f71b0153a00 0x7f71b015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48370/0 (socket says 172.21.15.12:48370) 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71af7fe700 1 -- 172.21.15.12:0/3148128231 learned_addr learned my addr 172.21.15.12:0/3148128231 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.619+0000 7f71affff700 1 --2- 172.21.15.12:0/3148128231 >> v2:172.21.15.12:3300/0 conn(0x7f71b00cea00 0x7f71b00ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71aeffd700 1 --2- 172.21.15.12:0/3148128231 >> v2:172.21.15.29:3300/0 conn(0x7f71b0153dd0 0x7f71b015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71ae7fc700 1 -- 172.21.15.12:0/3148128231 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896256776 0 0) 0x7f71b015ac50 con 0x7f71b0153a00 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71ae7fc700 1 -- 172.21.15.12:0/3148128231 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7198003570 con 0x7f71b0153a00 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71affff700 1 -- 172.21.15.12:0/3148128231 >> v2:172.21.15.29:3300/0 conn(0x7f71b0153dd0 msgr2=0x7f71b015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71affff700 1 --2- 172.21.15.12:0/3148128231 >> v2:172.21.15.29:3300/0 conn(0x7f71b0153dd0 0x7f71b015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71affff700 1 -- 172.21.15.12:0/3148128231 >> v1:172.21.15.12:6789/0 conn(0x7f71b0153a00 legacy=0x7f71b015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71affff700 1 -- 172.21.15.12:0/3148128231 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b015af60 con 0x7f71b00cea00 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.620+0000 7f71affff700 1 --2- 172.21.15.12:0/3148128231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b00cea00 0x7f71b00ceea0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f71b00b3070 tx=0x7f71a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196a0108972c01ad server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71ae7fc700 1 -- 172.21.15.12:0/3148128231 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800e070 con 0x7f71b00cea00 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71ae7fc700 1 -- 172.21.15.12:0/3148128231 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a800bab0 con 0x7f71b00cea00 2023-10-08T17:43:18.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71ae7fc700 1 -- 172.21.15.12:0/3148128231 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a800be70 con 0x7f71b00cea00 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 -- 172.21.15.12:0/3148128231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b00cea00 msgr2=0x7f71b00ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/3148128231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b00cea00 0x7f71b00ceea0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f71b00b3070 tx=0x7f71a8009780 comp rx=0 tx=0).stop 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 -- 172.21.15.12:0/3148128231 shutdown_connections 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/3148128231 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b00cea00 0x7f71b00ceea0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/3148128231 >> v2:172.21.15.29:3300/0 conn(0x7f71b0153dd0 0x7f71b015de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 -- 172.21.15.12:0/3148128231 >> 172.21.15.12:0/3148128231 conn(0x7f71b00703a0 msgr2=0x7f71b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:18.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 -- 172.21.15.12:0/3148128231 shutdown_connections 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.621+0000 7f71b4b9d700 1 -- 172.21.15.12:0/3148128231 wait complete. 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.623+0000 7f71b4b9d700 1 Processor -- start 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.623+0000 7f71b4b9d700 1 -- start start 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71b00cea00 0x7f71b00ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 0x7f71b0151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00ca3e0 con 0x7f71b0153dd0 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00c9f50 con 0x7f71b0153a00 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71b4b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0152290 con 0x7f71b00cea00 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40702/0 (socket says 172.21.15.12:40702) 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 -- 172.21.15.12:0/62747386 learned_addr learned my addr 172.21.15.12:0/62747386 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71aeffd700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 0x7f71b0151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71af7fe700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71b00cea00 0x7f71b00ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 -- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71b00cea00 msgr2=0x7f71b00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71b00cea00 0x7f71b00ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 -- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 msgr2=0x7f71b0151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 0x7f71b0151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71affff700 1 -- 172.21.15.12:0/62747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009a20 con 0x7f71b0153dd0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.624+0000 7f71aeffd700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 0x7f71b0151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71affff700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f71b006eb00 tx=0x7f71a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8012e60 con 0x7f71b0153dd0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a8027470 con 0x7f71b0153dd0 2023-10-08T17:43:18.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a8027810 con 0x7f71b0153dd0 2023-10-08T17:43:18.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0156a20 con 0x7f71b0153dd0 2023-10-08T17:43:18.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.625+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b0156fe0 con 0x7f71b0153dd0 2023-10-08T17:43:18.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.626+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b004c3c0 con 0x7f71b0153dd0 2023-10-08T17:43:18.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.627+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71a8024070 con 0x7f71b0153dd0 2023-10-08T17:43:18.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.628+0000 7f71977fe700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 0x7f719c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:18.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.628+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f71a80862e0 con 0x7f71b0153dd0 2023-10-08T17:43:18.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.628+0000 7f71af7fe700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 0x7f719c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:18.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.629+0000 7f71af7fe700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 0x7f719c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71a00058d0 tx=0x7f71a0009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:18.633 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.632+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a8053600 con 0x7f71b0153dd0 2023-10-08T17:43:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.836+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71b00ca090 con 0x7f71b0153dd0 2023-10-08T17:43:18.837 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.836+0000 7f71977fe700 1 -- 172.21.15.12:0/62747386 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v209) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71a8056c20 con 0x7f71b0153dd0 2023-10-08T17:43:18.837 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 msgr2=0x7f719c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 0x7f719c069410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f71a00058d0 tx=0x7f71a0009040 comp rx=0 tx=0).stop 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 msgr2=0x7f71b00c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f71b006eb00 tx=0x7f71a8019000 comp rx=0 tx=0).stop 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 shutdown_connections 2023-10-08T17:43:18.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f719c066f60 0x7f719c069410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f71b0153dd0 0x7f71b00c75e0 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f71b00cea00 0x7f71b00ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 --2- 172.21.15.12:0/62747386 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f71b0153a00 0x7f71b0151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 >> 172.21.15.12:0/62747386 conn(0x7f71b00703a0 msgr2=0x7f71b00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 shutdown_connections 2023-10-08T17:43:18.841 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:18.839+0000 7f71b4b9d700 1 -- 172.21.15.12:0/62747386 wait complete. 2023-10-08T17:43:18.858 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-08T17:43:19.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.045+0000 7fc32999d700 1 Processor -- start 2023-10-08T17:43:19.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.045+0000 7fc32999d700 1 -- start start 2023-10-08T17:43:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.046+0000 7fc32999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc32413fb20 0x7fc32415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32999d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc32406aaa0 0x7fc3240c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32999d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32415ae70 con 0x7fc32413fef0 2023-10-08T17:43:19.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32406af60 con 0x7fc32413fb20 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32999d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc32406b240 con 0x7fc32406aaa0 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fc32413fb20 0x7fc32415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc323fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fc32413fef0 0x7fc3240c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48382/0 (socket says 172.21.15.12:48382) 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc323fff700 1 -- 172.21.15.12:0/2010215030 learned_addr learned my addr 172.21.15.12:0/2010215030 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32899b700 1 -- 172.21.15.12:0/2010215030 >> v2:172.21.15.29:3300/0 conn(0x7fc32406aaa0 msgr2=0x7fc3240c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32899b700 1 --2- 172.21.15.12:0/2010215030 >> v2:172.21.15.29:3300/0 conn(0x7fc32406aaa0 0x7fc3240c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32899b700 1 -- 172.21.15.12:0/2010215030 >> v1:172.21.15.12:6789/0 conn(0x7fc32413fef0 legacy=0x7fc3240c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc32899b700 1 -- 172.21.15.12:0/2010215030 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32406b520 con 0x7fc32413fb20 2023-10-08T17:43:19.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.047+0000 7fc3237fe700 1 -- 172.21.15.12:0/2010215030 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815089123 0 0) 0x7fc310001290 con 0x7fc32413fef0 2023-10-08T17:43:19.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32899b700 1 --2- 172.21.15.12:0/2010215030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32413fb20 0x7fc32415a930 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fc324069d40 tx=0x7fc3180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af0a3eecd7bb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc3237fe700 1 -- 172.21.15.12:0/2010215030 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800b6b0 con 0x7fc32413fb20 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc3237fe700 1 -- 172.21.15.12:0/2010215030 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31800b810 con 0x7fc32413fb20 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc3237fe700 1 -- 172.21.15.12:0/2010215030 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31800bbb0 con 0x7fc32413fb20 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 -- 172.21.15.12:0/2010215030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32413fb20 msgr2=0x7fc32415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 --2- 172.21.15.12:0/2010215030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32413fb20 0x7fc32415a930 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fc324069d40 tx=0x7fc3180091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 -- 172.21.15.12:0/2010215030 shutdown_connections 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 --2- 172.21.15.12:0/2010215030 >> v2:172.21.15.29:3300/0 conn(0x7fc32406aaa0 0x7fc3240c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 --2- 172.21.15.12:0/2010215030 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32413fb20 0x7fc32415a930 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.048+0000 7fc32999d700 1 -- 172.21.15.12:0/2010215030 >> 172.21.15.12:0/2010215030 conn(0x7fc32406d170 msgr2=0x7fc3240cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:19.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.049+0000 7fc32999d700 1 -- 172.21.15.12:0/2010215030 shutdown_connections 2023-10-08T17:43:19.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.049+0000 7fc32999d700 1 -- 172.21.15.12:0/2010215030 wait complete. 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.050+0000 7fc32999d700 1 Processor -- start 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.050+0000 7fc32999d700 1 -- start start 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 0x7fc324167720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 0x7fc324157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324158910 con 0x7fc32406aaa0 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240ac630 con 0x7fc32413fb20 2023-10-08T17:43:19.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241562b0 con 0x7fc32413fef0 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32899b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40724/0 (socket says 172.21.15.12:40724) 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.051+0000 7fc32899b700 1 -- 172.21.15.12:0/4168088487 learned_addr learned my addr 172.21.15.12:0/4168088487 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc323fff700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 0x7fc324167720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 -- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 msgr2=0x7fc324157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32919c700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 0x7fc324157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 0x7fc324157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 -- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 msgr2=0x7fc324167720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 0x7fc324167720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 -- 172.21.15.12:0/4168088487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009420 con 0x7fc32406aaa0 2023-10-08T17:43:19.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc323fff700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 0x7fc324167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32919c700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 0x7fc324157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32899b700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b0e0 tx=0x7fc318017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801f070 con 0x7fc32406aaa0 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc318000d10 con 0x7fc32406aaa0 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3240ab740 con 0x7fc32406aaa0 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.052+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318011650 con 0x7fc32406aaa0 2023-10-08T17:43:19.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.053+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3240abd00 con 0x7fc32406aaa0 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.054+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc32404c3c0 con 0x7fc32406aaa0 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.054+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc318011a80 con 0x7fc32406aaa0 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.055+0000 7fc320ff9700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.055+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5373+0+0 (secure 0 0 0) 0x7fc3180858c0 con 0x7fc32406aaa0 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.056+0000 7fc323fff700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.056+0000 7fc323fff700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 0x7fc3080693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3240ae730 tx=0x7fc310009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.060+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc318052c80 con 0x7fc32406aaa0 2023-10-08T17:43:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.262+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc32406b800 con 0x7fc32406aaa0 2023-10-08T17:43:19.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.262+0000 7fc320ff9700 1 -- 172.21.15.12:0/4168088487 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v209) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc318028020 con 0x7fc32406aaa0 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: "poolnum": 1, 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: "poolname": ".mgr" 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:19.264 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:43:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.264+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 msgr2=0x7fc3080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.264+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 0x7fc3080693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3240ae730 tx=0x7fc310009040 comp rx=0 tx=0).stop 2023-10-08T17:43:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.264+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 msgr2=0x7fc324155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.264+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fc31800b0e0 tx=0x7fc318017000 comp rx=0 tx=0).stop 2023-10-08T17:43:19.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 shutdown_connections 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc308066f30 0x7fc3080693e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc32406aaa0 0x7fc324155d70 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc32413fef0 0x7fc324157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 --2- 172.21.15.12:0/4168088487 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc32413fb20 0x7fc324167720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 >> 172.21.15.12:0/4168088487 conn(0x7fc32406d170 msgr2=0x7fc3240cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 shutdown_connections 2023-10-08T17:43:19.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.265+0000 7fc32999d700 1 -- 172.21.15.12:0/4168088487 wait complete. 2023-10-08T17:43:19.283 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-08T17:43:19.283 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-08T17:43:19.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.474+0000 7f526f59e700 1 Processor -- start 2023-10-08T17:43:19.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.474+0000 7f526f59e700 1 -- start start 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f52700c8200 0x7f52700c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526f59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52700c2a90 0x7f5270156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52701579b0 con 0x7f52700c85d0 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526f59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52700c1390 con 0x7f52700c2a90 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52701573f0 con 0x7f52700c8200 2023-10-08T17:43:19.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52700c2a90 0x7f5270156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52700c2a90 0x7f5270156aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40736/0 (socket says 172.21.15.12:40736) 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526ed9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f52700c85d0 0x7f52700cc2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48396/0 (socket says 172.21.15.12:48396) 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 -- 172.21.15.12:0/895159160 learned_addr learned my addr 172.21.15.12:0/895159160 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526e59c700 1 --2- 172.21.15.12:0/895159160 >> v2:172.21.15.29:3300/0 conn(0x7f52700c8200 0x7f52700c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 -- 172.21.15.12:0/895159160 >> v2:172.21.15.29:3300/0 conn(0x7f52700c8200 msgr2=0x7f52700c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 --2- 172.21.15.12:0/895159160 >> v2:172.21.15.29:3300/0 conn(0x7f52700c8200 0x7f52700c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 -- 172.21.15.12:0/895159160 >> v1:172.21.15.12:6789/0 conn(0x7f52700c85d0 legacy=0x7f52700cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526dd9b700 1 -- 172.21.15.12:0/895159160 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52701576d0 con 0x7f52700c2a90 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.476+0000 7f526d59a700 1 -- 172.21.15.12:0/895159160 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2019364850 0 0) 0x7f52701579b0 con 0x7f52700c85d0 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526dd9b700 1 --2- 172.21.15.12:0/895159160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f5270156aa0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f52700683d0 tx=0x7f5264009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e21c6903e601a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526d59a700 1 -- 172.21.15.12:0/895159160 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5264009e70 con 0x7f52700c2a90 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526d59a700 1 -- 172.21.15.12:0/895159160 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526400b860 con 0x7f52700c2a90 2023-10-08T17:43:19.480 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526d59a700 1 -- 172.21.15.12:0/895159160 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526400bc00 con 0x7f52700c2a90 2023-10-08T17:43:19.482 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526f59e700 1 -- 172.21.15.12:0/895159160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 msgr2=0x7f5270156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.477+0000 7f526f59e700 1 --2- 172.21.15.12:0/895159160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f5270156aa0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f52700683d0 tx=0x7f5264009250 comp rx=0 tx=0).stop 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 -- 172.21.15.12:0/895159160 shutdown_connections 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 --2- 172.21.15.12:0/895159160 >> v2:172.21.15.29:3300/0 conn(0x7f52700c8200 0x7f52700c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 --2- 172.21.15.12:0/895159160 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f5270156aa0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 -- 172.21.15.12:0/895159160 >> 172.21.15.12:0/895159160 conn(0x7f527006c6a0 msgr2=0x7f527006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 -- 172.21.15.12:0/895159160 shutdown_connections 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.478+0000 7f526f59e700 1 -- 172.21.15.12:0/895159160 wait complete. 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.479+0000 7f526f59e700 1 Processor -- start 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.479+0000 7f526f59e700 1 -- start start 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.483 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52700c8200 0x7f52700adf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52700c85d0 0x7f5270145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52700b0cf0 con 0x7f52700c2a90 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52701450b0 con 0x7f52700c85d0 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52700b1550 con 0x7f52700c8200 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526e59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40750/0 (socket says 172.21.15.12:40750) 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.480+0000 7f526e59c700 1 -- 172.21.15.12:0/3714306383 learned_addr learned my addr 172.21.15.12:0/3714306383 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526ed9d700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52700c85d0 0x7f5270145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526dd9b700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52700c8200 0x7f52700adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 -- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52700c8200 msgr2=0x7f52700adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.484 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52700c8200 0x7f52700adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 -- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52700c85d0 msgr2=0x7f5270145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52700c85d0 0x7f5270145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 -- 172.21.15.12:0/3714306383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640094f0 con 0x7f52700c2a90 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526e59c700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f526000ec80 tx=0x7f52600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526000c9d0 con 0x7f52700c2a90 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526000cb30 con 0x7f52700c2a90 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260013470 con 0x7f52700c2a90 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.481+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52700b1f20 con 0x7f52700c2a90 2023-10-08T17:43:19.485 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.482+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52700b0f00 con 0x7f52700c2a90 2023-10-08T17:43:19.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.483+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527004c3c0 con 0x7f52700c2a90 2023-10-08T17:43:19.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.484+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5260013820 con 0x7f52700c2a90 2023-10-08T17:43:19.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.485+0000 7f525e7fc700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 0x7f52500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:19.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.485+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(209..209 src has 1..209) v4 ==== 5373+0+0 (secure 0 0 0) 0x7f5260084810 con 0x7f52700c2a90 2023-10-08T17:43:19.486 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.485+0000 7f526dd9b700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 0x7f52500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:19.487 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.486+0000 7f526dd9b700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 0x7f52500693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52700683d0 tx=0x7f5264019000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:19.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.489+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5260051b30 con 0x7f52700c2a90 2023-10-08T17:43:19.694 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:19.693+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f52700b1830 con 0x7f52700c2a90 2023-10-08T17:43:20.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.035+0000 7f525e7fc700 1 -- 172.21.15.12:0/3714306383 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v210) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5260055150 con 0x7f52700c2a90 2023-10-08T17:43:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.040+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 msgr2=0x7f52500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.040+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 0x7f52500693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52700683d0 tx=0x7f5264019000 comp rx=0 tx=0).stop 2023-10-08T17:43:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.040+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 msgr2=0x7f52700b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.040+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f526000ec80 tx=0x7f52600091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 shutdown_connections 2023-10-08T17:43:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5250066f30 0x7f52500693e0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f52700683d0 tx=0x7f5264019000 comp rx=0 tx=0).stop 2023-10-08T17:43:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52700c2a90 0x7f52700b19e0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52700c85d0 0x7f5270145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 --2- 172.21.15.12:0/3714306383 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52700c8200 0x7f52700adf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.041+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 >> 172.21.15.12:0/3714306383 conn(0x7f527006c6a0 msgr2=0x7f52700cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:20.043 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.042+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 shutdown_connections 2023-10-08T17:43:20.044 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.043+0000 7f526f59e700 1 -- 172.21.15.12:0/3714306383 wait complete. 2023-10-08T17:43:20.046 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' created 2023-10-08T17:43:20.063 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-08T17:43:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.256+0000 7f9ab239d700 1 Processor -- start 2023-10-08T17:43:20.257 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.256+0000 7f9ab239d700 1 -- start start 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab239d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f9aac0c7f90 0x7f9aac06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab239d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac0ca480 con 0x7f9aac142fd0 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab239d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aac15e240 con 0x7f9aac142c00 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab239d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aac06b350 con 0x7f9aac0c7f90 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab0b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9aac142fd0 0x7f9aac0c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:48412/0 (socket says 172.21.15.12:48412) 2023-10-08T17:43:20.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab0b9a700 1 -- 172.21.15.12:0/1808147314 learned_addr learned my addr 172.21.15.12:0/1808147314 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3036379431 0 0) 0x7f9aac0ca480 con 0x7f9aac142fd0 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9ab1b9c700 1 --2- 172.21.15.12:0/1808147314 >> v2:172.21.15.29:3300/0 conn(0x7f9aac0c7f90 0x7f9aac06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.258+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a98003570 con 0x7f9aac142fd0 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2829366342 0 0) 0x7f9a98003570 con 0x7f9aac142fd0 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 >> v2:172.21.15.29:3300/0 conn(0x7f9aac0c7f90 msgr2=0x7f9aac06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 --2- 172.21.15.12:0/1808147314 >> v2:172.21.15.29:3300/0 conn(0x7f9aac0c7f90 0x7f9aac06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.262 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 >> v1:172.21.15.29:6789/0 conn(0x7f9aac142c00 legacy=0x7f9aac06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac15df60 con 0x7f9aac142fd0 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f9a9c001470 con 0x7f9aac142fd0 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 >> v1:172.21.15.12:6789/0 conn(0x7f9aac142fd0 legacy=0x7f9aac0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9a98003ab0 0x7f9a98003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9a98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a98005210 0x7f9a9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac06b350 con 0x7f9a98004810 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9800c1b0 con 0x7f9a98005210 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9800c370 con 0x7f9a98003ab0 2023-10-08T17:43:20.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9a98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9ab1b9c700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a98005210 0x7f9a9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.259+0000 7f9ab139b700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9a98003ab0 0x7f9a98003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 -- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9a98003ab0 msgr2=0x7f9a98003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9a98003ab0 0x7f9a98003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 -- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a98005210 msgr2=0x7f9a9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9a98005210 0x7f9a9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 -- 172.21.15.12:0/1808147314 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98003570 con 0x7f9a98004810 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab1b9c700 1 -- 172.21.15.12:0/1808147314 reap_dead start 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9a98004c80 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c2a0 tx=0x7f9aac06b490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08700de1c7ba307 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c00cb70 con 0x7f9a98004810 2023-10-08T17:43:20.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9c00ccd0 con 0x7f9a98004810 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.260+0000 7f9aa3fff700 1 -- 172.21.15.12:0/1808147314 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9c005b70 con 0x7f9a98004810 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 -- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 msgr2=0x7f9a98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9a98004c80 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c00c2a0 tx=0x7f9aac06b490 comp rx=0 tx=0).stop 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 -- 172.21.15.12:0/1808147314 shutdown_connections 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 --2- 172.21.15.12:0/1808147314 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9a98004c80 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 -- 172.21.15.12:0/1808147314 >> 172.21.15.12:0/1808147314 conn(0x7f9aac0675a0 msgr2=0x7f9aac0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 -- 172.21.15.12:0/1808147314 shutdown_connections 2023-10-08T17:43:20.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.261+0000 7f9ab239d700 1 -- 172.21.15.12:0/1808147314 wait complete. 2023-10-08T17:43:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.262+0000 7f9ab239d700 1 Processor -- start 2023-10-08T17:43:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.263+0000 7f9ab239d700 1 -- start start 2023-10-08T17:43:20.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.263+0000 7f9ab239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.263+0000 7f9ab239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9aac0b0280 0x7f9aac169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9aac159040 0x7f9aac159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0c50f0 con 0x7f9a98004810 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac0b13e0 con 0x7f9aac159040 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aac16a3e0 con 0x7f9aac0b0280 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40764/0 (socket says 172.21.15.12:40764) 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 -- 172.21.15.12:0/2609194124 learned_addr learned my addr 172.21.15.12:0/2609194124 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab1b9c700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9aac159040 0x7f9aac159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9aac0b0280 0x7f9aac169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 -- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9aac0b0280 msgr2=0x7f9aac169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9aac0b0280 0x7f9aac169ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 -- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9aac159040 msgr2=0x7f9aac159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9aac159040 0x7f9aac159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 -- 172.21.15.12:0/2609194124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0b07d0 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.264+0000 7f9ab139b700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80078a0 tx=0x7f9aa8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.265+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8012590 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.265+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa80126f0 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.265+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aac0b0ab0 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.265+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa8012ab0 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.265+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aac0b1070 con 0x7f9a98004810 2023-10-08T17:43:20.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.266+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aac04c3c0 con 0x7f9a98004810 2023-10-08T17:43:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.267+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aa801d460 con 0x7f9a98004810 2023-10-08T17:43:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.268+0000 7f9aa17fa700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.269+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(210..210 src has 1..210) v4 ==== 5743+0+0 (secure 0 0 0) 0x7f9aa8085160 con 0x7f9a98004810 2023-10-08T17:43:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.269+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:20.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.269+0000 7f9ab0b9a700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c007c00 tx=0x7f9a9c015000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:20.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.272+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aa8052390 con 0x7f9a98004810 2023-10-08T17:43:20.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:20.477+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9aac06ad00 con 0x7f9a98004810 2023-10-08T17:43:21.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.040+0000 7f9aa17fa700 1 -- 172.21.15.12:0/2609194124 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v211) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9aa80559b0 con 0x7f9a98004810 2023-10-08T17:43:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.050+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 msgr2=0x7f9a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.050+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 0x7f9a900693e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c007c00 tx=0x7f9a9c015000 comp rx=0 tx=0).stop 2023-10-08T17:43:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.050+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 msgr2=0x7f9aac0b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.051 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.050+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f9aa80078a0 tx=0x7f9aa8009040 comp rx=0 tx=0).stop 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 shutdown_connections 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9a90066f30 0x7f9a900693e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9a98004810 0x7f9aac0b1870 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9aac159040 0x7f9aac159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 --2- 172.21.15.12:0/2609194124 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9aac0b0280 0x7f9aac169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.054+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 >> 172.21.15.12:0/2609194124 conn(0x7f9aac0675a0 msgr2=0x7f9aac06b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.056+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 shutdown_connections 2023-10-08T17:43:21.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.056+0000 7f9ab239d700 1 -- 172.21.15.12:0/2609194124 wait complete. 2023-10-08T17:43:21.061 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' created 2023-10-08T17:43:21.081 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-08T17:43:21.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.272+0000 7ff33b19d700 1 Processor -- start 2023-10-08T17:43:21.273 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.272+0000 7ff33b19d700 1 -- start start 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33b19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff334153a00 0x7ff334153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33b19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff33415de50 0x7ff33415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33b19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33415af60 con 0x7ff3340cea00 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33b19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33415d010 con 0x7ff334153a00 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33b19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff33415b240 con 0x7ff33415de50 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.273+0000 7ff33a19b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff334153a00 0x7ff334153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff334153a00 0x7ff334153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40768/0 (socket says 172.21.15.12:40768) 2023-10-08T17:43:21.275 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 -- 172.21.15.12:0/3827449950 learned_addr learned my addr 172.21.15.12:0/3827449950 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:21.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33999a700 1 --2- 172.21.15.12:0/3827449950 >> v2:172.21.15.29:3300/0 conn(0x7ff33415de50 0x7ff33415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 -- 172.21.15.12:0/3827449950 >> v2:172.21.15.29:3300/0 conn(0x7ff33415de50 msgr2=0x7ff33415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:21.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 --2- 172.21.15.12:0/3827449950 >> v2:172.21.15.29:3300/0 conn(0x7ff33415de50 0x7ff33415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 -- 172.21.15.12:0/3827449950 >> v1:172.21.15.29:6789/0 conn(0x7ff3340cea00 legacy=0x7ff3340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 -- 172.21.15.12:0/3827449950 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33415b520 con 0x7ff334153a00 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.274+0000 7ff33a19b700 1 --2- 172.21.15.12:0/3827449950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334153a00 0x7ff334153dd0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff3340b3070 tx=0x7ff330009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bd6a08b803381af server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff339199700 1 -- 172.21.15.12:0/3827449950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000b860 con 0x7ff334153a00 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff339199700 1 -- 172.21.15.12:0/3827449950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33000b9c0 con 0x7ff334153a00 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff339199700 1 -- 172.21.15.12:0/3827449950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33000bd60 con 0x7ff334153a00 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 -- 172.21.15.12:0/3827449950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334153a00 msgr2=0x7ff334153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 --2- 172.21.15.12:0/3827449950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334153a00 0x7ff334153dd0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7ff3340b3070 tx=0x7ff330009250 comp rx=0 tx=0).stop 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 -- 172.21.15.12:0/3827449950 shutdown_connections 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 --2- 172.21.15.12:0/3827449950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff334153a00 0x7ff334153dd0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 --2- 172.21.15.12:0/3827449950 >> v2:172.21.15.29:3300/0 conn(0x7ff33415de50 0x7ff33415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 -- 172.21.15.12:0/3827449950 >> 172.21.15.12:0/3827449950 conn(0x7ff3340703a0 msgr2=0x7ff3340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 -- 172.21.15.12:0/3827449950 shutdown_connections 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.275+0000 7ff33b19d700 1 -- 172.21.15.12:0/3827449950 wait complete. 2023-10-08T17:43:21.278 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.277+0000 7ff33b19d700 1 Processor -- start 2023-10-08T17:43:21.279 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.277+0000 7ff33b19d700 1 -- start start 2023-10-08T17:43:21.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff334153a00 0x7ff3340c9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff33415de50 0x7ff3340c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340c5950 con 0x7ff3340cea00 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340c5370 con 0x7ff334153a00 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33b19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340ca080 con 0x7ff33415de50 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33a19b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:40776/0 (socket says 172.21.15.12:40776) 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33a19b700 1 -- 172.21.15.12:0/2933197591 learned_addr learned my addr 172.21.15.12:0/2933197591 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33999a700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff334153a00 0x7ff3340c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.278+0000 7ff33a99c700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff33415de50 0x7ff3340c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 -- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff33415de50 msgr2=0x7ff3340c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff33415de50 0x7ff3340c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.281 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 -- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff334153a00 msgr2=0x7ff3340c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff334153a00 0x7ff3340c9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 -- 172.21.15.12:0/2933197591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3300094f0 con 0x7ff3340cea00 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33a19b700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7ff330006fd0 tx=0x7ff330017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330024440 con 0x7ff3340cea00 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3300245a0 con 0x7ff3340cea00 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff330024960 con 0x7ff3340cea00 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3340c55e0 con 0x7ff3340cea00 2023-10-08T17:43:21.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.279+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3340b5ee0 con 0x7ff3340cea00 2023-10-08T17:43:21.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.280+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff334159aa0 con 0x7ff3340cea00 2023-10-08T17:43:21.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.282+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff330024d50 con 0x7ff3340cea00 2023-10-08T17:43:21.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.282+0000 7ff32a7fc700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:21.283 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.283+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(211..211 src has 1..211) v4 ==== 6125+0+0 (secure 0 0 0) 0x7ff3300868b0 con 0x7ff3340cea00 2023-10-08T17:43:21.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.283+0000 7ff33999a700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:21.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.283+0000 7ff33999a700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff324006fd0 tx=0x7ff324008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:21.287 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.286+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3300539e0 con 0x7ff3340cea00 2023-10-08T17:43:21.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:21.537+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff33404c3c0 con 0x7ff3340cea00 2023-10-08T17:43:22.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.067+0000 7ff32a7fc700 1 -- 172.21.15.12:0/2933197591 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v95) v1 ==== 174+0+0 (secure 0 0 0) 0x7ff33002b340 con 0x7ff3340cea00 2023-10-08T17:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.074+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 msgr2=0x7ff3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.076 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.075+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 0x7ff3180693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff324006fd0 tx=0x7ff324008040 comp rx=0 tx=0).stop 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.075+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 msgr2=0x7ff3340b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.075+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7ff330006fd0 tx=0x7ff330017000 comp rx=0 tx=0).stop 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 shutdown_connections 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff318066f30 0x7ff3180693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff3340cea00 0x7ff3340b59a0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff33415de50 0x7ff3340c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 --2- 172.21.15.12:0/2933197591 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff334153a00 0x7ff3340c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.077+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 >> 172.21.15.12:0/2933197591 conn(0x7ff3340703a0 msgr2=0x7ff334153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.078+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 shutdown_connections 2023-10-08T17:43:22.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.078+0000 7ff33b19d700 1 -- 172.21.15.12:0/2933197591 wait complete. 2023-10-08T17:43:22.082 INFO:teuthology.orchestra.run.smithi012.stderr:new fs with metadata pool 24 and data pool 25 2023-10-08T17:43:22.104 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.292+0000 7ff837fff700 1 Processor -- start 2023-10-08T17:43:22.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.292+0000 7ff837fff700 1 -- start start 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.293+0000 7ff837fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff838159550 0x7ff8380ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.293+0000 7ff837fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff83815dfd0 0x7ff8380aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.293+0000 7ff837fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff8380ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.293+0000 7ff837fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380acc00 con 0x7ff83815dfd0 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff837fff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8380abff0 con 0x7ff838159550 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff837fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8380ac2d0 con 0x7ff838159920 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff83815dfd0 0x7ff8380aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.295 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff83815dfd0 0x7ff8380aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50614/0 (socket says 172.21.15.12:50614) 2023-10-08T17:43:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 -- 172.21.15.12:0/2453455894 learned_addr learned my addr 172.21.15.12:0/2453455894 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8377fe700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff8380ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff836ffd700 1 --2- 172.21.15.12:0/2453455894 >> v2:172.21.15.29:3300/0 conn(0x7ff838159550 0x7ff8380ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 -- 172.21.15.12:0/2453455894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 msgr2=0x7ff8380ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff8380ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 -- 172.21.15.12:0/2453455894 >> v2:172.21.15.29:3300/0 conn(0x7ff838159550 msgr2=0x7ff8380ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:22.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 --2- 172.21.15.12:0/2453455894 >> v2:172.21.15.29:3300/0 conn(0x7ff838159550 0x7ff8380ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.294+0000 7ff8367fc700 1 -- 172.21.15.12:0/2453455894 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8380ac5b0 con 0x7ff83815dfd0 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff8367fc700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff8380aedb0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff838064270 tx=0x7ff82c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b265a61b97027e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff835ffb700 1 -- 172.21.15.12:0/2453455894 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00b640 con 0x7ff83815dfd0 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff835ffb700 1 -- 172.21.15.12:0/2453455894 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82c00b7a0 con 0x7ff83815dfd0 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff835ffb700 1 -- 172.21.15.12:0/2453455894 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82c00bb60 con 0x7ff83815dfd0 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff837fff700 1 -- 172.21.15.12:0/2453455894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 msgr2=0x7ff8380aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.295+0000 7ff837fff700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff8380aedb0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7ff838064270 tx=0x7ff82c009250 comp rx=0 tx=0).stop 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 -- 172.21.15.12:0/2453455894 shutdown_connections 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff8380ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 --2- 172.21.15.12:0/2453455894 >> v2:172.21.15.29:3300/0 conn(0x7ff838159550 0x7ff8380ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 --2- 172.21.15.12:0/2453455894 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff8380aedb0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 -- 172.21.15.12:0/2453455894 >> 172.21.15.12:0/2453455894 conn(0x7ff83806ce80 msgr2=0x7ff8380ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:22.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 -- 172.21.15.12:0/2453455894 shutdown_connections 2023-10-08T17:43:22.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.296+0000 7ff837fff700 1 -- 172.21.15.12:0/2453455894 wait complete. 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.297+0000 7ff837fff700 1 Processor -- start 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.297+0000 7ff837fff700 1 -- start start 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838159550 0x7ff8381551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff838158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff838157f00 con 0x7ff83815dfd0 2023-10-08T17:43:22.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8381588d0 con 0x7ff838159550 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff837fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8381572f0 con 0x7ff838159920 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff8377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff8377fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50624/0 (socket says 172.21.15.12:50624) 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.298+0000 7ff8377fe700 1 -- 172.21.15.12:0/1644892260 learned_addr learned my addr 172.21.15.12:0/1644892260 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8367fc700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff838158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff836ffd700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838159550 0x7ff8381551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 -- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 msgr2=0x7ff838158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff838158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 -- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838159550 msgr2=0x7ff8381551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838159550 0x7ff8381551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.302 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 -- 172.21.15.12:0/1644892260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c0094f0 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff8377fe700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e90 tx=0x7ff83000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83000cb70 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83000f040 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff830014480 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.299+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8381575d0 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.300+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff838157b90 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.300+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff838158070 con 0x7ff83815dfd0 2023-10-08T17:43:22.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.303+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff830014830 con 0x7ff83815dfd0 2023-10-08T17:43:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.305+0000 7ff81effd700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.305+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ff830085920 con 0x7ff83815dfd0 2023-10-08T17:43:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.305+0000 7ff836ffd700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.305+0000 7ff836ffd700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 0x7ff8240693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d10 tx=0x7ff8280091a0 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.309 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.308+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff830052960 con 0x7ff83815dfd0 2023-10-08T17:43:22.515 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.514+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff83804c3c0 con 0x7ff83815dfd0 2023-10-08T17:43:22.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.515+0000 7ff81effd700 1 -- 172.21.15.12:0/1644892260 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+16227 (secure 0 0 0) 0x7ff830055f80 con 0x7ff83815dfd0 2023-10-08T17:43:22.516 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:22.516 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":212,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:21.539454+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.517+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 msgr2=0x7ff8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.517+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 0x7ff8240693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff828009d10 tx=0x7ff8280091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.517+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 msgr2=0x7ff838156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.517+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7ff830009e90 tx=0x7ff83000b040 comp rx=0 tx=0).stop 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 shutdown_connections 2023-10-08T17:43:22.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff824066f30 0x7ff8240693e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff83815dfd0 0x7ff838156a50 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff838159550 0x7ff8381551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 --2- 172.21.15.12:0/1644892260 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff838159920 0x7ff838158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 >> 172.21.15.12:0/1644892260 conn(0x7ff83806ce80 msgr2=0x7ff8380b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 shutdown_connections 2023-10-08T17:43:22.520 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.518+0000 7ff837fff700 1 -- 172.21.15.12:0/1644892260 wait complete. 2023-10-08T17:43:22.537 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:22.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.723+0000 7fa469f9d700 1 Processor -- start 2023-10-08T17:43:22.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.723+0000 7fa469f9d700 1 -- start start 2023-10-08T17:43:22.726 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa469f9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 0x7fa4640c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa469f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa464150380 0x7fa46406a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa469f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46406a490 con 0x7fa46406f3a0 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa469f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4640c7490 con 0x7fa464150380 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa469f9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4640c7770 con 0x7fa46406e0a0 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa464150380 0x7fa46406a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa464150380 0x7fa46406a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50632/0 (socket says 172.21.15.12:50632) 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 -- 172.21.15.12:0/3124401419 learned_addr learned my addr 172.21.15.12:0/3124401419 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa468f9b700 1 --2- 172.21.15.12:0/3124401419 >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 0x7fa4640c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 -- 172.21.15.12:0/3124401419 >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 msgr2=0x7fa4640c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 --2- 172.21.15.12:0/3124401419 >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 0x7fa4640c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.727 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.725+0000 7fa46979c700 1 -- 172.21.15.12:0/3124401419 >> v1:172.21.15.29:6789/0 conn(0x7fa46406f3a0 legacy=0x7fa46414fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa46979c700 1 -- 172.21.15.12:0/3124401419 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4640c7a50 con 0x7fa464150380 2023-10-08T17:43:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa468f9b700 1 --2- 172.21.15.12:0/3124401419 >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 0x7fa4640c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:22.728 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa46979c700 1 --2- 172.21.15.12:0/3124401419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa464150380 0x7fa46406a920 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa464069230 tx=0x7fa45c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd37589b0459bd15 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa4637fe700 1 -- 172.21.15.12:0/3124401419 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00ca60 con 0x7fa464150380 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa4637fe700 1 -- 172.21.15.12:0/3124401419 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00cbc0 con 0x7fa464150380 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.726+0000 7fa4637fe700 1 -- 172.21.15.12:0/3124401419 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c011400 con 0x7fa464150380 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 -- 172.21.15.12:0/3124401419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa464150380 msgr2=0x7fa46406a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3124401419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa464150380 0x7fa46406a920 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fa464069230 tx=0x7fa45c009840 comp rx=0 tx=0).stop 2023-10-08T17:43:22.729 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 -- 172.21.15.12:0/3124401419 shutdown_connections 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3124401419 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa464150380 0x7fa46406a920 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3124401419 >> v2:172.21.15.29:3300/0 conn(0x7fa46406e0a0 0x7fa4640c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 -- 172.21.15.12:0/3124401419 >> 172.21.15.12:0/3124401419 conn(0x7fa46406d170 msgr2=0x7fa4640cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 -- 172.21.15.12:0/3124401419 shutdown_connections 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.727+0000 7fa469f9d700 1 -- 172.21.15.12:0/3124401419 wait complete. 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.728+0000 7fa469f9d700 1 Processor -- start 2023-10-08T17:43:22.730 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.728+0000 7fa469f9d700 1 -- start start 2023-10-08T17:43:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 0x7fa464167660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa464150380 0x7fa46406ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.732 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464157d50 con 0x7fa46406e0a0 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa464167f90 con 0x7fa464150380 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.729+0000 7fa469f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa464168270 con 0x7fa46406f3a0 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50636/0 (socket says 172.21.15.12:50636) 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 -- 172.21.15.12:0/3823441857 learned_addr learned my addr 172.21.15.12:0/3823441857 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa46979c700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa464150380 0x7fa46406ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa463fff700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 0x7fa464167660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 -- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 msgr2=0x7fa464167660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 0x7fa464167660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 -- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa464150380 msgr2=0x7fa46406ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.733 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa464150380 0x7fa46406ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 -- 172.21.15.12:0/3823441857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c00d040 con 0x7fa46406e0a0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa463fff700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 0x7fa464167660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.730+0000 7fa468f9b700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e8d0 tx=0x7fa458008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.731+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800ee70 con 0x7fa46406e0a0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.731+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45800c5e0 con 0x7fa46406e0a0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.731+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45800c980 con 0x7fa46406e0a0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.731+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa464168550 con 0x7fa46406e0a0 2023-10-08T17:43:22.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.731+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa464147580 con 0x7fa46406e0a0 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.732+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46404c3c0 con 0x7fa46406e0a0 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.733+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa458013410 con 0x7fa46406e0a0 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.733+0000 7fa460ff9700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.734+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(212..212 src has 1..212) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fa4580845d0 con 0x7fa46406e0a0 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.734+0000 7fa463fff700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:22.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.734+0000 7fa463fff700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 0x7fa4480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46406b8a0 tx=0x7fa450009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:22.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.737+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa458051590 con 0x7fa46406e0a0 2023-10-08T17:43:22.942 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.941+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa464158030 con 0x7fa46406e0a0 2023-10-08T17:43:22.943 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.942+0000 7fa460ff9700 1 -- 172.21.15.12:0/3823441857 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v212) v1 ==== 74+0+16227 (secure 0 0 0) 0x7fa458054bb0 con 0x7fa46406e0a0 2023-10-08T17:43:22.944 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:22.944 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":212,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:21.539454+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 msgr2=0x7fa4480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 0x7fa4480693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa46406b8a0 tx=0x7fa450009040 comp rx=0 tx=0).stop 2023-10-08T17:43:22.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 msgr2=0x7fa464147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fa45800e8d0 tx=0x7fa458008040 comp rx=0 tx=0).stop 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 shutdown_connections 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa46406e0a0 0x7fa464147040 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa464150380 0x7fa46406ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 --2- 172.21.15.12:0/3823441857 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa46406f3a0 0x7fa464167660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 >> 172.21.15.12:0/3823441857 conn(0x7fa46406d170 msgr2=0x7fa46414e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 shutdown_connections 2023-10-08T17:43:22.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:22.945+0000 7fa469f9d700 1 -- 172.21.15.12:0/3823441857 wait complete. 2023-10-08T17:43:22.964 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-08T17:43:23.159 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.155+0000 7fb96279d700 1 Processor -- start 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.155+0000 7fb96279d700 1 -- start start 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c7be0 0x7fb95c06abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 0x7fb95c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 0x7fb95c13fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c06bf10 con 0x7fb95c0c7be0 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb95c1400e0 con 0x7fb95c0c7fb0 2023-10-08T17:43:23.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96279d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c15aed0 con 0x7fb95c13f780 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96179b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c7be0 0x7fb95c06abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96179b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb95c0c7be0 0x7fb95c06abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50646/0 (socket says 172.21.15.12:50646) 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.156+0000 7fb96179b700 1 -- 172.21.15.12:0/922731696 learned_addr learned my addr 172.21.15.12:0/922731696 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb960f9a700 1 --2- 172.21.15.12:0/922731696 >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 0x7fb95c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 -- 172.21.15.12:0/922731696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 msgr2=0x7fb95c13fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb961f9c700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 0x7fb95c13fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 0x7fb95c13fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 -- 172.21.15.12:0/922731696 >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 msgr2=0x7fb95c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 --2- 172.21.15.12:0/922731696 >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 0x7fb95c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.161 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 -- 172.21.15.12:0/922731696 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb95c06b290 con 0x7fb95c0c7be0 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb960f9a700 1 --2- 172.21.15.12:0/922731696 >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 0x7fb95c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb961f9c700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 0x7fb95c13fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb96179b700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c7be0 0x7fb95c06abd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0aec50 tx=0x7fb958009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661d694c116404f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb953fff700 1 -- 172.21.15.12:0/922731696 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800b860 con 0x7fb95c0c7be0 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb953fff700 1 -- 172.21.15.12:0/922731696 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800b9c0 con 0x7fb95c0c7be0 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.157+0000 7fb953fff700 1 -- 172.21.15.12:0/922731696 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800bd60 con 0x7fb95c0c7be0 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 -- 172.21.15.12:0/922731696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c7be0 msgr2=0x7fb95c06abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c7be0 0x7fb95c06abd0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0aec50 tx=0x7fb958009250 comp rx=0 tx=0).stop 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 -- 172.21.15.12:0/922731696 shutdown_connections 2023-10-08T17:43:23.162 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c13f780 0x7fb95c13fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 --2- 172.21.15.12:0/922731696 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c0c7be0 0x7fb95c06abd0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 --2- 172.21.15.12:0/922731696 >> v2:172.21.15.29:3300/0 conn(0x7fb95c0c7fb0 0x7fb95c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 -- 172.21.15.12:0/922731696 >> 172.21.15.12:0/922731696 conn(0x7fb95c06d110 msgr2=0x7fb95c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 -- 172.21.15.12:0/922731696 shutdown_connections 2023-10-08T17:43:23.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.158+0000 7fb96279d700 1 -- 172.21.15.12:0/922731696 wait complete. 2023-10-08T17:43:23.165 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.160+0000 7fb96279d700 1 Processor -- start 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.160+0000 7fb96279d700 1 -- start start 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 0x7fb95c1685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 0x7fb95c167390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c169c60 con 0x7fb95c13f780 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c168d70 con 0x7fb95c0c7fb0 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96279d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb95c169050 con 0x7fb95c0c7be0 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.166 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50650/0 (socket says 172.21.15.12:50650) 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 -- 172.21.15.12:0/1482034191 learned_addr learned my addr 172.21.15.12:0/1482034191 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb960f9a700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 0x7fb95c167390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96179b700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 0x7fb95c1685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 -- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 msgr2=0x7fb95c1685d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 0x7fb95c1685d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 -- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 msgr2=0x7fb95c167390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 0x7fb95c167390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb961f9c700 1 -- 172.21.15.12:0/1482034191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9580094f0 con 0x7fb95c13f780 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb960f9a700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 0x7fb95c167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:23.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.161+0000 7fb96179b700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 0x7fb95c1685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb961f9c700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fb95400cef0 tx=0x7fb954007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400ae00 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb954016420 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c169330 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9540167e0 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.162+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95c1698f0 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.163+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb95c13e420 con 0x7fb95c13f780 2023-10-08T17:43:23.168 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.164+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb954016bd0 con 0x7fb95c13f780 2023-10-08T17:43:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.165+0000 7fb9517fa700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 0x7fb9400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.165+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fb954012070 con 0x7fb95c13f780 2023-10-08T17:43:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.165+0000 7fb96179b700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 0x7fb9400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:23.169 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.166+0000 7fb96179b700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 0x7fb9400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0aec50 tx=0x7fb958017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:23.170 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.169+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb95404e5a0 con 0x7fb95c13f780 2023-10-08T17:43:23.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:23.419+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb95c0648e0 con 0x7fb95c13f780 2023-10-08T17:43:24.074 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.073+0000 7fb9517fa700 1 -- 172.21.15.12:0/1482034191 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v97) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb95c0648e0 con 0x7fb95c13f780 2023-10-08T17:43:24.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 msgr2=0x7fb9400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 0x7fb9400693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0aec50 tx=0x7fb958017000 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 msgr2=0x7fb95c13e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fb95400cef0 tx=0x7fb954007860 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 shutdown_connections 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb940066f30 0x7fb9400693e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb95c13f780 0x7fb95c13e600 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb95c0c7be0 0x7fb95c1685d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 --2- 172.21.15.12:0/1482034191 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb95c0c7fb0 0x7fb95c167390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 >> 172.21.15.12:0/1482034191 conn(0x7fb95c06d110 msgr2=0x7fb95c0c1450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:24.078 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 shutdown_connections 2023-10-08T17:43:24.079 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.076+0000 7fb96279d700 1 -- 172.21.15.12:0/1482034191 wait complete. 2023-10-08T17:43:24.098 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-08T17:43:24.292 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.291+0000 7f6ccf59e700 1 Processor -- start 2023-10-08T17:43:24.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.291+0000 7f6ccf59e700 1 -- start start 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.292+0000 7f6ccf59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f6cd00c7fb0 0x7f6cd006abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.292+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cd013fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccf59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cd0140120 con 0x7f6cd00c7be0 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccf59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cd006bf10 con 0x7f6cd00c7fb0 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd006b290 con 0x7f6cd013f780 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6cce59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f6cd00c7be0 0x7f6cd015a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44618/0 (socket says 172.21.15.12:44618) 2023-10-08T17:43:24.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6cce59c700 1 -- 172.21.15.12:0/699500472 learned_addr learned my addr 172.21.15.12:0/699500472 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/699500472 >> v2:172.21.15.29:3300/0 conn(0x7f6cd00c7fb0 0x7f6cd006abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6cced9d700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cd013fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141579844 0 0) 0x7f6cc0001110 con 0x7f6cd00c7be0 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.293+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cb8003570 con 0x7f6cd00c7be0 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4117845408 0 0) 0x7f6cb8003570 con 0x7f6cd00c7be0 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 msgr2=0x7f6cd013fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cd013fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 >> v2:172.21.15.29:3300/0 conn(0x7f6cd00c7fb0 msgr2=0x7f6cd006abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:24.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 --2- 172.21.15.12:0/699500472 >> v2:172.21.15.29:3300/0 conn(0x7f6cd00c7fb0 0x7f6cd006abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd006b570 con 0x7f6cd00c7be0 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f6cc0001600 con 0x7f6cd00c7be0 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 >> v1:172.21.15.12:6789/0 conn(0x7f6cd00c7be0 legacy=0x7f6cd015a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cb8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cb8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb8004d50 0x7f6cb80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd006bf10 con 0x7f6cb8003a60 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd006b290 con 0x7f6cb8004d50 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cb800ba60 con 0x7f6cd013f780 2023-10-08T17:43:24.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/699500472 >> v2:172.21.15.29:3300/0 conn(0x7f6cd00c7fb0 0x7f6cd006abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6cce59c700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cb8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6cced9d700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb8004d50 0x7f6cb80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cb8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6cce59c700 1 -- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 msgr2=0x7f6cb8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.294+0000 7f6cce59c700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd013f780 0x7f6cb8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6cce59c700 1 -- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb8004d50 msgr2=0x7f6cb80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6cce59c700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cb8004d50 0x7f6cb80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6cce59c700 1 -- 172.21.15.12:0/699500472 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb8003570 con 0x7f6cb8003a60 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6cce59c700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cb8003e70 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c5f0 tx=0x7f6cd0156a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4defc9593b5a1544 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:24.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc000cd90 con 0x7f6cb8003a60 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0005920 con 0x7f6cb8003a60 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6ccd59a700 1 -- 172.21.15.12:0/699500472 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0005ce0 con 0x7f6cb8003a60 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6ccf59e700 1 -- 172.21.15.12:0/699500472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 msgr2=0x7f6cb8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/699500472 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cb8003e70 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f6cc000c5f0 tx=0x7f6cd0156a50 comp rx=0 tx=0).stop 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.295+0000 7f6cced9d700 1 -- 172.21.15.12:0/699500472 reap_dead start 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.296+0000 7f6ccf59e700 1 -- 172.21.15.12:0/699500472 shutdown_connections 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.296+0000 7f6ccf59e700 1 -- 172.21.15.12:0/699500472 >> 172.21.15.12:0/699500472 conn(0x7f6cd006d110 msgr2=0x7f6cd00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.296+0000 7f6ccf59e700 1 -- 172.21.15.12:0/699500472 shutdown_connections 2023-10-08T17:43:24.301 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.296+0000 7f6ccf59e700 1 -- 172.21.15.12:0/699500472 wait complete. 2023-10-08T17:43:24.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.297+0000 7f6ccf59e700 1 Processor -- start 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.297+0000 7f6ccf59e700 1 -- start start 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0138840 0x7f6cd0137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd014fcc0 0x7f6cd0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd01561d0 con 0x7f6cb8003a60 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0138cb0 con 0x7f6cd0138840 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6ccf59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd0150640 con 0x7f6cd014fcc0 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6cce59c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50658/0 (socket says 172.21.15.12:50658) 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.298+0000 7f6cce59c700 1 -- 172.21.15.12:0/2168802102 learned_addr learned my addr 172.21.15.12:0/2168802102 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cced9d700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd014fcc0 0x7f6cd0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0138840 0x7f6cd0137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 -- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd014fcc0 msgr2=0x7f6cd0150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd014fcc0 0x7f6cd0150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 -- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0138840 msgr2=0x7f6cd0137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0138840 0x7f6cd0137fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 -- 172.21.15.12:0/2168802102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0138ed0 con 0x7f6cb8003a60 2023-10-08T17:43:24.305 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cce59c700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0000e40 tx=0x7f6cc0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0005ca0 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cc0005e00 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cd01391b0 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.299+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cc0007530 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.300+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cd0139770 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.301+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cd004c3c0 con 0x7f6cb8003a60 2023-10-08T17:43:24.306 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.301+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cc0019030 con 0x7f6cb8003a60 2023-10-08T17:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.303+0000 7f6cbe7fc700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.303+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f6cc00859e0 con 0x7f6cb8003a60 2023-10-08T17:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.304+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:24.307 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.304+0000 7f6ccdd9b700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006da0 tx=0x7f6cc4008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:24.308 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.307+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cc00529a0 con 0x7f6cb8003a60 2023-10-08T17:43:24.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:24.554+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6cd0140120 con 0x7f6cb8003a60 2023-10-08T17:43:25.077 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.076+0000 7f6cbe7fc700 1 -- 172.21.15.12:0/2168802102 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v98) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6cd0140120 con 0x7f6cb8003a60 2023-10-08T17:43:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 msgr2=0x7f6cb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 0x7f6cb00693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6cc4006da0 tx=0x7f6cc4008040 comp rx=0 tx=0).stop 2023-10-08T17:43:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 msgr2=0x7f6cd00b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.080 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0000e40 tx=0x7f6cc0015000 comp rx=0 tx=0).stop 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 shutdown_connections 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f6cb0066f30 0x7f6cb00693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f6cb8003a60 0x7f6cd00b19f0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f6cd014fcc0 0x7f6cd0150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 --2- 172.21.15.12:0/2168802102 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f6cd0138840 0x7f6cd0137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.081 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 >> 172.21.15.12:0/2168802102 conn(0x7f6cd006d110 msgr2=0x7f6cd00c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 shutdown_connections 2023-10-08T17:43:25.082 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.079+0000 7f6ccf59e700 1 -- 172.21.15.12:0/2168802102 wait complete. 2023-10-08T17:43:25.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.288+0000 7f9de1b9d700 1 Processor -- start 2023-10-08T17:43:25.289 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.288+0000 7f9de1b9d700 1 -- start start 2023-10-08T17:43:25.290 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.289+0000 7f9de1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 0x7f9ddc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.289+0000 7f9de1b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc15afd0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.289+0000 7f9de1b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ddc15b2b0 con 0x7f9ddc15de50 2023-10-08T17:43:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.289+0000 7f9de1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc15b590 con 0x7f9ddc153c30 2023-10-08T17:43:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de139c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f9ddc0cf110 0x7f9ddc15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44632/0 (socket says 172.21.15.12:44632) 2023-10-08T17:43:25.291 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de139c700 1 -- 172.21.15.12:0/4262647607 learned_addr learned my addr 172.21.15.12:0/4262647607 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de0b9b700 1 --2- 172.21.15.12:0/4262647607 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 0x7f9ddc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559434090 0 0) 0x7f9ddc15afd0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc003570 con 0x7f9ddc0cf110 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983748 0 0) 0x7f9ddc15b2b0 con 0x7f9ddc15de50 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ddc15afd0 con 0x7f9ddc15de50 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de0b9b700 1 -- 172.21.15.12:0/4262647607 >> v1:172.21.15.29:6789/0 conn(0x7f9ddc15de50 legacy=0x7f9ddc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de0b9b700 1 -- 172.21.15.12:0/4262647607 >> v1:172.21.15.12:6789/0 conn(0x7f9ddc0cf110 legacy=0x7f9ddc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.290+0000 7f9de0b9b700 1 -- 172.21.15.12:0/4262647607 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc15b870 con 0x7f9ddc153c30 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.291+0000 7f9de0b9b700 1 --2- 172.21.15.12:0/4262647607 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 0x7f9ddc15a5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009910 tx=0x7f9dd00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4338724cd0cf7b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.293 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.291+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011630 con 0x7f9ddc153c30 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.291+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011790 con 0x7f9ddc153c30 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.291+0000 7f9ddb7fe700 1 -- 172.21.15.12:0/4262647607 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0011b30 con 0x7f9ddc153c30 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 -- 172.21.15.12:0/4262647607 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 msgr2=0x7f9ddc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/4262647607 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 0x7f9ddc15a5e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009910 tx=0x7f9dd00091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 -- 172.21.15.12:0/4262647607 shutdown_connections 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/4262647607 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc153c30 0x7f9ddc15a5e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 -- 172.21.15.12:0/4262647607 >> 172.21.15.12:0/4262647607 conn(0x7f9ddc0703a0 msgr2=0x7f9ddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 -- 172.21.15.12:0/4262647607 shutdown_connections 2023-10-08T17:43:25.294 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.292+0000 7f9de1b9d700 1 -- 172.21.15.12:0/4262647607 wait complete. 2023-10-08T17:43:25.296 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.293+0000 7f9de1b9d700 1 Processor -- start 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.293+0000 7f9de1b9d700 1 -- start start 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 0x7f9ddc169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc15de50 0x7f9ddc0b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc152750 con 0x7f9ddc0cf110 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c8150 con 0x7f9ddc153c30 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ddc0c8430 con 0x7f9ddc15de50 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de0b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50672/0 (socket says 172.21.15.12:50672) 2023-10-08T17:43:25.297 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.294+0000 7f9de0b9b700 1 -- 172.21.15.12:0/95954493 learned_addr learned my addr 172.21.15.12:0/95954493 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9ddbfff700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 0x7f9ddc169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de139c700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc15de50 0x7f9ddc0b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 -- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc15de50 msgr2=0x7f9ddc0b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc15de50 0x7f9ddc0b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 -- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 msgr2=0x7f9ddc169780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 0x7f9ddc169780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 -- 172.21.15.12:0/95954493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd0009420 con 0x7f9ddc0cf110 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9ddbfff700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 0x7f9ddc169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de0b9b700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00091e0 tx=0x7f9dd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd001f070 con 0x7f9ddc0cf110 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0011900 con 0x7f9ddc0cf110 2023-10-08T17:43:25.298 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.295+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ddc0b3470 con 0x7f9ddc0cf110 2023-10-08T17:43:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.296+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0023410 con 0x7f9ddc0cf110 2023-10-08T17:43:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.296+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ddc0c9610 con 0x7f9ddc0cf110 2023-10-08T17:43:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.297+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ddc0b32d0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.299 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.297+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dd00193b0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.299+0000 7f9dd8ff9700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.299+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f9dd00859f0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.299+0000 7f9ddbfff700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.300+0000 7f9ddbfff700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 0x7f9dc00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0ca5e0 tx=0x7f9dc8009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.303+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ddc0b32d0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.549+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ddc0b32d0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.550+0000 7f9dd8ff9700 1 -- 172.21.15.12:0/95954493 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f9ddc0b32d0 con 0x7f9ddc0cf110 2023-10-08T17:43:25.551 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:25.551 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 msgr2=0x7f9dc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 0x7f9dc00693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc0ca5e0 tx=0x7f9dc8009040 comp rx=0 tx=0).stop 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 msgr2=0x7f9ddc152210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00091e0 tx=0x7f9dd0017000 comp rx=0 tx=0).stop 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 shutdown_connections 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9dc0066f30 0x7f9dc00693e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f9ddc0cf110 0x7f9ddc152210 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.552+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f9ddc15de50 0x7f9ddc0b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.553+0000 7f9de1b9d700 1 --2- 172.21.15.12:0/95954493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f9ddc153c30 0x7f9ddc169780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.553+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 >> 172.21.15.12:0/95954493 conn(0x7f9ddc0703a0 msgr2=0x7f9ddc070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.553+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 shutdown_connections 2023-10-08T17:43:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.553+0000 7f9de1b9d700 1 -- 172.21.15.12:0/95954493 wait complete. 2023-10-08T17:43:25.555 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:25.571 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:25.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.758+0000 7ffa74d9d700 1 Processor -- start 2023-10-08T17:43:25.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.758+0000 7ffa74d9d700 1 -- start start 2023-10-08T17:43:25.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.759+0000 7ffa74d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa700cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.760 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.759+0000 7ffa74d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffa700cef40 0x7ffa7015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.759+0000 7ffa74d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7015afd0 con 0x7ffa70153c30 2023-10-08T17:43:25.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.759+0000 7ffa74d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7015b2b0 con 0x7ffa700cef40 2023-10-08T17:43:25.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.759+0000 7ffa74d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7015b590 con 0x7ffa7015de50 2023-10-08T17:43:25.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6f7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffa70153c30 0x7ffa7015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44638/0 (socket says 172.21.15.12:44638) 2023-10-08T17:43:25.761 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6f7fe700 1 -- 172.21.15.12:0/1139689352 learned_addr learned my addr 172.21.15.12:0/1139689352 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6effd700 1 --2- 172.21.15.12:0/1139689352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa700cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6ffff700 1 --2- 172.21.15.12:0/1139689352 >> v2:172.21.15.29:3300/0 conn(0x7ffa700cef40 0x7ffa7015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365808957 0 0) 0x7ffa7015afd0 con 0x7ffa70153c30 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa58003570 con 0x7ffa70153c30 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6effd700 1 -- 172.21.15.12:0/1139689352 >> v2:172.21.15.29:3300/0 conn(0x7ffa700cef40 msgr2=0x7ffa7015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6effd700 1 --2- 172.21.15.12:0/1139689352 >> v2:172.21.15.29:3300/0 conn(0x7ffa700cef40 0x7ffa7015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6effd700 1 -- 172.21.15.12:0/1139689352 >> v1:172.21.15.12:6789/0 conn(0x7ffa70153c30 legacy=0x7ffa7015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3744532879 0 0) 0x7ffa58003570 con 0x7ffa70153c30 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.760+0000 7ffa6effd700 1 -- 172.21.15.12:0/1139689352 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7015b870 con 0x7ffa7015de50 2023-10-08T17:43:25.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa6effd700 1 --2- 172.21.15.12:0/1139689352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa700cea00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e39aba5df81bb4c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa60001470 con 0x7ffa7015de50 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64011420 con 0x7ffa7015de50 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa6e7fc700 1 -- 172.21.15.12:0/1139689352 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640117c0 con 0x7ffa7015de50 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa74d9d700 1 -- 172.21.15.12:0/1139689352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 msgr2=0x7ffa700cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.761+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/1139689352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa700cea00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ffa640098e0 tx=0x7ffa640091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 -- 172.21.15.12:0/1139689352 shutdown_connections 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/1139689352 >> v2:172.21.15.29:3300/0 conn(0x7ffa700cef40 0x7ffa7015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/1139689352 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa700cea00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 -- 172.21.15.12:0/1139689352 >> 172.21.15.12:0/1139689352 conn(0x7ffa700703a0 msgr2=0x7ffa700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 -- 172.21.15.12:0/1139689352 shutdown_connections 2023-10-08T17:43:25.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.762+0000 7ffa74d9d700 1 -- 172.21.15.12:0/1139689352 wait complete. 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.763+0000 7ffa74d9d700 1 Processor -- start 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.763+0000 7ffa74d9d700 1 -- start start 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa700cef40 0x7ffa700b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa70169f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b6400 con 0x7ffa70153c30 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b5960 con 0x7ffa700cef40 2023-10-08T17:43:25.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa74d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa70150850 con 0x7ffa7015de50 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50674/0 (socket says 172.21.15.12:50674) 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.764+0000 7ffa6effd700 1 -- 172.21.15.12:0/3096100469 learned_addr learned my addr 172.21.15.12:0/3096100469 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6f7fe700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa700cef40 0x7ffa700b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6ffff700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa70169f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 -- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 msgr2=0x7ffa70169f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa70169f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 -- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa700cef40 msgr2=0x7ffa700b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa700cef40 0x7ffa700b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 -- 172.21.15.12:0/3096100469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009420 con 0x7ffa70153c30 2023-10-08T17:43:25.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa6effd700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ffa640030c0 tx=0x7ffa64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6401cb30 con 0x7ffa70153c30 2023-10-08T17:43:25.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6401cc90 con 0x7ffa70153c30 2023-10-08T17:43:25.768 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64025680 con 0x7ffa70153c30 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.765+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa700b5b60 con 0x7ffa70153c30 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.766+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa700b6120 con 0x7ffa70153c30 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.767+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa70150620 con 0x7ffa70153c30 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.767+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa640193f0 con 0x7ffa70153c30 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.768+0000 7ffa577fe700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 0x7ffa5c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:25.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.768+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ffa64085980 con 0x7ffa70153c30 2023-10-08T17:43:25.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.768+0000 7ffa6f7fe700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 0x7ffa5c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:25.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.769+0000 7ffa6f7fe700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 0x7ffa5c069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa60001ed0 tx=0x7ffa600019d0 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:25.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.773+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa640529c0 con 0x7ffa70153c30 2023-10-08T17:43:25.977 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.976+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa7004c3c0 con 0x7ffa70153c30 2023-10-08T17:43:25.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.977+0000 7ffa577fe700 1 -- 172.21.15.12:0/3096100469 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v213) v1 ==== 74+0+16214 (secure 0 0 0) 0x7ffa64055fe0 con 0x7ffa70153c30 2023-10-08T17:43:25.978 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:25.981 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":213,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:23.048795+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 msgr2=0x7ffa5c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 0x7ffa5c069410 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffa60001ed0 tx=0x7ffa600019d0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 msgr2=0x7ffa70169a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7ffa640030c0 tx=0x7ffa64016000 comp rx=0 tx=0).stop 2023-10-08T17:43:25.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 shutdown_connections 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffa5c066f60 0x7ffa5c069410 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffa7015de50 0x7ffa70169f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffa700cef40 0x7ffa700b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 --2- 172.21.15.12:0/3096100469 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffa70153c30 0x7ffa70169a50 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.979+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 >> 172.21.15.12:0/3096100469 conn(0x7ffa700703a0 msgr2=0x7ffa70153100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.980+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 shutdown_connections 2023-10-08T17:43:25.983 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:25.980+0000 7ffa74d9d700 1 -- 172.21.15.12:0/3096100469 wait complete. 2023-10-08T17:43:25.999 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-08T17:43:25.999 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.187+0000 7fa54699d700 1 Processor -- start 2023-10-08T17:43:26.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.187+0000 7fa54699d700 1 -- start start 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 0x7fa54015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54699d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa54006aaa0 0x7fa5400c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54699d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa54015ae70 con 0x7fa54013fb20 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54699d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa54006af60 con 0x7fa54006aaa0 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54006b240 con 0x7fa54013fef0 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa54006aaa0 0x7fa5400c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fa54006aaa0 0x7fa5400c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50682/0 (socket says 172.21.15.12:50682) 2023-10-08T17:43:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 -- 172.21.15.12:0/3581347437 learned_addr learned my addr 172.21.15.12:0/3581347437 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:26.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54519a700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 0x7fa54015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 -- 172.21.15.12:0/3581347437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 msgr2=0x7fa54015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 0x7fa54015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 -- 172.21.15.12:0/3581347437 >> v1:172.21.15.29:6789/0 conn(0x7fa54013fb20 legacy=0x7fa5400c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54619c700 1 -- 172.21.15.12:0/3581347437 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54006b520 con 0x7fa54006aaa0 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa544999700 1 -- 172.21.15.12:0/3581347437 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390743892 0 0) 0x7fa53c001110 con 0x7fa54013fb20 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.189+0000 7fa54519a700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 0x7fa54015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa54619c700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54006aaa0 0x7fa5400c9d00 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fa538009f20 tx=0x7fa538009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95aba7d01aaaa73 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa544999700 1 -- 172.21.15.12:0/3581347437 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53800e070 con 0x7fa54006aaa0 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa544999700 1 -- 172.21.15.12:0/3581347437 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa53800ba80 con 0x7fa54006aaa0 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa544999700 1 -- 172.21.15.12:0/3581347437 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5380092e0 con 0x7fa54006aaa0 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa54699d700 1 -- 172.21.15.12:0/3581347437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54006aaa0 msgr2=0x7fa5400c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.190+0000 7fa54699d700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54006aaa0 0x7fa5400c9d00 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fa538009f20 tx=0x7fa538009840 comp rx=0 tx=0).stop 2023-10-08T17:43:26.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 -- 172.21.15.12:0/3581347437 shutdown_connections 2023-10-08T17:43:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54006aaa0 0x7fa5400c9d00 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 --2- 172.21.15.12:0/3581347437 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54013fef0 0x7fa54015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 -- 172.21.15.12:0/3581347437 >> 172.21.15.12:0/3581347437 conn(0x7fa54006d170 msgr2=0x7fa5400cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 -- 172.21.15.12:0/3581347437 shutdown_connections 2023-10-08T17:43:26.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.191+0000 7fa54699d700 1 -- 172.21.15.12:0/3581347437 wait complete. 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.192+0000 7fa54699d700 1 Processor -- start 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.192+0000 7fa54699d700 1 -- start start 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54006aaa0 0x7fa540138b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 0x7fa540158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400ad140 con 0x7fa54013fb20 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5400ac2a0 con 0x7fa54013fef0 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5401390d0 con 0x7fa54006aaa0 2023-10-08T17:43:26.196 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54519a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54519a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50698/0 (socket says 172.21.15.12:50698) 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.193+0000 7fa54519a700 1 -- 172.21.15.12:0/1583778227 learned_addr learned my addr 172.21.15.12:0/1583778227 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54619c700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 0x7fa540158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54599b700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54006aaa0 0x7fa540138b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 -- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54006aaa0 msgr2=0x7fa540138b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54006aaa0 0x7fa540138b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 -- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 msgr2=0x7fa540158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 0x7fa540158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 -- 172.21.15.12:0/1583778227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa538009ae0 con 0x7fa54013fb20 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54619c700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 0x7fa540158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54519a700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e8f0 tx=0x7fa530008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa53000ee90 con 0x7fa54013fb20 2023-10-08T17:43:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa530005a00 con 0x7fa54013fb20 2023-10-08T17:43:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa530005d80 con 0x7fa54013fb20 2023-10-08T17:43:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5400ac530 con 0x7fa54013fb20 2023-10-08T17:43:26.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.194+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5400acaf0 con 0x7fa54013fb20 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.196+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5400ad2b0 con 0x7fa54013fb20 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.196+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa530006230 con 0x7fa54013fb20 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.198+0000 7fa535ffb700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 0x7fa5240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.198+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fa5300849f0 con 0x7fa54013fb20 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.198+0000 7fa54599b700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 0x7fa5240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.198+0000 7fa54599b700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 0x7fa5240693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa54015fc30 tx=0x7fa53c009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.202+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5300519b0 con 0x7fa54013fb20 2023-10-08T17:43:26.402 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.401+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa54004c3c0 con 0x7fa524066f30 2023-10-08T17:43:26.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.412+0000 7fa535ffb700 1 -- 172.21.15.12:0/1583778227 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278544 (secure 0 0 0) 0x7fa54004c3c0 con 0x7fa524066f30 2023-10-08T17:43:26.417 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:26.419 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 msgr2=0x7fa5240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 0x7fa5240693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa54015fc30 tx=0x7fa53c009040 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 msgr2=0x7fa5400adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7fa53000e8f0 tx=0x7fa530008040 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 shutdown_connections 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa524066f30 0x7fa5240693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa54013fef0 0x7fa540158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa54006aaa0 0x7fa540138b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 --2- 172.21.15.12:0/1583778227 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa54013fb20 0x7fa5400adeb0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 >> 172.21.15.12:0/1583778227 conn(0x7fa54006d170 msgr2=0x7fa5400c1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 shutdown_connections 2023-10-08T17:43:26.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.416+0000 7fa54699d700 1 -- 172.21.15.12:0/1583778227 wait complete. 2023-10-08T17:43:26.421 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:26.435 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:43:26.003386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2457352,"kb_used_data":21704,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752517368,"statfs":{"total":773094113280,"available":770577784832,"internally_reserved":0,"allocated":22224896,"data_stored":11769032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.968724"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042339+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:43.694298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037985+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:27.627123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040589+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:35.694527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042008+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:45.347257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040480+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:26.082795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043504+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:33.969821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042239+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:57.109375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037732+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:12.346194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040235+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:45.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040281+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:58.220918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040998+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.748798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040944+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038074+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:23.601419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043575+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:21.457599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041669+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:44.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040134+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:55:10.042765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044051+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:57.935550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041280+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:29.256805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037755+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:30.322638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040949+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:33.576276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040197+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040518+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:50.593979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038216+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:42.170608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041087+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:04:17.227383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:54.008282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044304+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:11.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037822+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:17.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037733+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:08.207013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042082+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:46.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040499+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:00.275784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041012+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"202'348","reported_seq":1153,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-08T17:43:18.731711+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:18.731711+0000","last_peered":"2023-10-08T17:43:18.731711+0000","last_clean":"2023-10-08T17:43:18.731711+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:18.731711+0000","last_undegraded":"2023-10-08T17:43:18.731711+0000","last_fullsized":"2023-10-08T17:43:18.731711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304532,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067308,"statfs":{"total":96636764160,"available":96324923392,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.71199999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68400000000000005,"5min":0.71399999999999997,"15min":0.91400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":1.0649999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63600000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.84099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.76000000000000001,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80600000000000005,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95599999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":1.141,"15min":1.2370000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.196},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":1.056,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.008,"5min":1.28,"15min":1.304},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.995,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.075,"5min":1.1200000000000001,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.878,"15min":0.89900000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.62},"max":{"1min":1.0349999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.998}]}]},{"osd":0,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308628,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063212,"statfs":{"total":96636764160,"available":96320729088,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.70499999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.751},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65300000000000002,"5min":0.89500000000000002,"15min":1.032},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.751,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.379},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.85299999999999998,"15min":1.327},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79000000000000004,"5min":0.93799999999999994,"15min":1.5009999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0620000000000001,"5min":1.157,"15min":1.3520000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.149,"15min":1.2749999999999999},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.442},"max":{"1min":1.038,"5min":1.25,"15min":1.3440000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0109999999999999,"5min":1.1859999999999999,"15min":1.375},"last":1.071}]},{"osd":6,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0369999999999999,"5min":1.117,"15min":1.4319999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":1.069,"5min":1.2010000000000001,"15min":1.5429999999999999},"last":1.089}]},{"osd":7,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.873,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.476},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.89800000000000002},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.125,"15min":1.431},"last":1.1100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.72099999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.88200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.755},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0069999999999999,"5min":1.089,"15min":1.0900000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48299999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.169},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96799999999999997,"5min":1.0509999999999999,"15min":1.079},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0349999999999999,"5min":1.085,"15min":1.1759999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":0.98999999999999999,"15min":1.0209999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":1.137,"15min":1.137},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88300000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0820000000000001,"5min":1.1000000000000001,"15min":1.121},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":1.0960000000000001,"5min":1.113,"15min":1.1180000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.496,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.155},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303952,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067888,"statfs":{"total":96636764160,"available":96325517312,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71899999999999997,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.1659999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.206},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.016,"15min":1.151},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.032,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.49199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0449999999999999,"5min":1.131,"15min":1.131},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48799999999999999},"max":{"1min":0.996,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":1.018,"5min":1.0429999999999999,"15min":1.2749999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":0.97899999999999998,"5min":1.01,"15min":1.3049999999999999},"last":0.999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.3480000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.47799999999999998},"max":{"1min":1.048,"5min":1.0620000000000001,"15min":1.125},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79600000000000004,"15min":0.79000000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.258},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:26.442 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:26.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.660+0000 7f1c6939d700 1 Processor -- start 2023-10-08T17:43:26.662 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.660+0000 7f1c6939d700 1 -- start start 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.661+0000 7f1c6939d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c64153c30 0x7f1c6415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.661+0000 7f1c6939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 0x7f1c6415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.661+0000 7f1c6939d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6415afd0 con 0x7f1c6415de50 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.661+0000 7f1c6939d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6415b2b0 con 0x7f1c64153c30 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.661+0000 7f1c6939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6415b590 con 0x7f1c640cf110 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c64153c30 0x7f1c6415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1c64153c30 0x7f1c6415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50700/0 (socket says 172.21.15.12:50700) 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 -- 172.21.15.12:0/3279095396 learned_addr learned my addr 172.21.15.12:0/3279095396 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c68b9c700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 0x7f1c6415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.664 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 -- 172.21.15.12:0/3279095396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 msgr2=0x7f1c6415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 0x7f1c6415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 -- 172.21.15.12:0/3279095396 >> v1:172.21.15.29:6789/0 conn(0x7f1c6415de50 legacy=0x7f1c640cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 -- 172.21.15.12:0/3279095396 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6415b870 con 0x7f1c64153c30 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c68b9c700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 0x7f1c6415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.662+0000 7f1c63fff700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c64153c30 0x7f1c6415a5e0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f0289f04352527b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c62ffd700 1 -- 172.21.15.12:0/3279095396 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400b860 con 0x7f1c64153c30 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c62ffd700 1 -- 172.21.15.12:0/3279095396 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5400b9c0 con 0x7f1c64153c30 2023-10-08T17:43:26.665 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c62ffd700 1 -- 172.21.15.12:0/3279095396 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5400bd60 con 0x7f1c64153c30 2023-10-08T17:43:26.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 -- 172.21.15.12:0/3279095396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c64153c30 msgr2=0x7f1c6415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c64153c30 0x7f1c6415a5e0 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54009250 comp rx=0 tx=0).stop 2023-10-08T17:43:26.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 -- 172.21.15.12:0/3279095396 shutdown_connections 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c640cf110 0x7f1c6415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 --2- 172.21.15.12:0/3279095396 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c64153c30 0x7f1c6415a5e0 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 -- 172.21.15.12:0/3279095396 >> 172.21.15.12:0/3279095396 conn(0x7f1c640703a0 msgr2=0x7f1c640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 -- 172.21.15.12:0/3279095396 shutdown_connections 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.663+0000 7f1c6939d700 1 -- 172.21.15.12:0/3279095396 wait complete. 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.665+0000 7f1c6939d700 1 Processor -- start 2023-10-08T17:43:26.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.665+0000 7f1c6939d700 1 -- start start 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c640cf110 0x7f1c6414f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 0x7f1c64152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64152460 con 0x7f1c6415de50 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64152e50 con 0x7f1c640cf110 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c6939d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640ca430 con 0x7f1c64153c30 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c68b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c68b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50708/0 (socket says 172.21.15.12:50708) 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c68b9c700 1 -- 172.21.15.12:0/4061259927 learned_addr learned my addr 172.21.15.12:0/4061259927 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c63fff700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c640cf110 0x7f1c6414f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.666+0000 7f1c637fe700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 0x7f1c64152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 -- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 msgr2=0x7f1c64152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 0x7f1c64152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 -- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c640cf110 msgr2=0x7f1c6414f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c640cf110 0x7f1c6414f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 -- 172.21.15.12:0/4061259927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c540094f0 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c637fe700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 0x7f1c64152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c68b9c700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00a380 tx=0x7f1c5c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c015440 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0155a0 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c640b5950 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c015960 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.667+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640b5ef0 con 0x7f1c6415de50 2023-10-08T17:43:26.671 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.668+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6404c3c0 con 0x7f1c6415de50 2023-10-08T17:43:26.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.669+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c5c00d440 con 0x7f1c6415de50 2023-10-08T17:43:26.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.670+0000 7f1c4bfff700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 0x7f1c500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:26.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.670+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f1c5c085370 con 0x7f1c6415de50 2023-10-08T17:43:26.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.671+0000 7f1c63fff700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 0x7f1c500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:26.673 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.671+0000 7f1c63fff700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 0x7f1c500693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:26.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.674+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c5c052330 con 0x7f1c6415de50 2023-10-08T17:43:26.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.870+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c6415bb80 con 0x7f1c50066f30 2023-10-08T17:43:26.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.879+0000 7f1c4bfff700 1 -- 172.21.15.12:0/4061259927 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278544 (secure 0 0 0) 0x7f1c6415bb80 con 0x7f1c50066f30 2023-10-08T17:43:26.883 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 msgr2=0x7f1c500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 0x7f1c500693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1c540099b0 tx=0x7f1c54017000 comp rx=0 tx=0).stop 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 msgr2=0x7f1c640c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00a380 tx=0x7f1c5c007900 comp rx=0 tx=0).stop 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 shutdown_connections 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1c50066f30 0x7f1c500693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1c6415de50 0x7f1c640c8140 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1c640cf110 0x7f1c6414f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 --2- 172.21.15.12:0/4061259927 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1c64153c30 0x7f1c64152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 >> 172.21.15.12:0/4061259927 conn(0x7f1c640703a0 msgr2=0x7f1c640c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 shutdown_connections 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:26.883+0000 7f1c6939d700 1 -- 172.21.15.12:0/4061259927 wait complete. 2023-10-08T17:43:26.887 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:26.901 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:43:26.003386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2457352,"kb_used_data":21704,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752517368,"statfs":{"total":773094113280,"available":770577784832,"internally_reserved":0,"allocated":22224896,"data_stored":11769032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.968724"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042339+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:43.694298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037985+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:27.627123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040589+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:35.694527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042008+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:45.347257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040480+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:26.082795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043504+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:33.969821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042239+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:57.109375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037732+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:12.346194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040235+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:45.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040281+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:58.220918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040998+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.748798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040944+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038074+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:23.601419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043575+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:21.457599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041669+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:44.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040134+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:55:10.042765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044051+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:57.935550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041280+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:29.256805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037755+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:30.322638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040949+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:33.576276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040197+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040518+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:50.593979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038216+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:42.170608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041087+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:04:17.227383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:54.008282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044304+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:11.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037822+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:17.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037733+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:08.207013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042082+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:46.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040499+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:00.275784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041012+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"202'348","reported_seq":1153,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-08T17:43:18.731711+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:18.731711+0000","last_peered":"2023-10-08T17:43:18.731711+0000","last_clean":"2023-10-08T17:43:18.731711+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:18.731711+0000","last_undegraded":"2023-10-08T17:43:18.731711+0000","last_fullsized":"2023-10-08T17:43:18.731711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304532,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067308,"statfs":{"total":96636764160,"available":96324923392,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.71199999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68400000000000005,"5min":0.71399999999999997,"15min":0.91400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":1.0649999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63600000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.84099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.76000000000000001,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80600000000000005,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95599999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":1.141,"15min":1.2370000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.196},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":1.056,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.008,"5min":1.28,"15min":1.304},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.995,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.075,"5min":1.1200000000000001,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.878,"15min":0.89900000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.62},"max":{"1min":1.0349999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.998}]}]},{"osd":0,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308628,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063212,"statfs":{"total":96636764160,"available":96320729088,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.70499999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.751},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65300000000000002,"5min":0.89500000000000002,"15min":1.032},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.751,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.379},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.85299999999999998,"15min":1.327},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79000000000000004,"5min":0.93799999999999994,"15min":1.5009999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0620000000000001,"5min":1.157,"15min":1.3520000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.149,"15min":1.2749999999999999},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.442},"max":{"1min":1.038,"5min":1.25,"15min":1.3440000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0109999999999999,"5min":1.1859999999999999,"15min":1.375},"last":1.071}]},{"osd":6,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0369999999999999,"5min":1.117,"15min":1.4319999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":1.069,"5min":1.2010000000000001,"15min":1.5429999999999999},"last":1.089}]},{"osd":7,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.873,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.476},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.89800000000000002},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.125,"15min":1.431},"last":1.1100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.72099999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.88200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.755},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0069999999999999,"5min":1.089,"15min":1.0900000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48299999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.169},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96799999999999997,"5min":1.0509999999999999,"15min":1.079},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0349999999999999,"5min":1.085,"15min":1.1759999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":0.98999999999999999,"15min":1.0209999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":1.137,"15min":1.137},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88300000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0820000000000001,"5min":1.1000000000000001,"15min":1.121},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":1.0960000000000001,"5min":1.113,"15min":1.1180000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.496,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.155},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303952,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067888,"statfs":{"total":96636764160,"available":96325517312,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71899999999999997,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.1659999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.206},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.016,"15min":1.151},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.032,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.49199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0449999999999999,"5min":1.131,"15min":1.131},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48799999999999999},"max":{"1min":0.996,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":1.018,"5min":1.0429999999999999,"15min":1.2749999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":0.97899999999999998,"5min":1.01,"15min":1.3049999999999999},"last":0.999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.3480000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.47799999999999998},"max":{"1min":1.048,"5min":1.0620000000000001,"15min":1.125},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79600000000000004,"15min":0.79000000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.258},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:26.908 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:27.030 INFO:tasks.ceph.mds.b.smithi029.stderr:2023-10-08T17:43:27.028+0000 7fe94a1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:43:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.129+0000 7fbb011ff700 1 Processor -- start 2023-10-08T17:43:27.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.129+0000 7fbb011ff700 1 -- start start 2023-10-08T17:43:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbb011ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fbafc159c20 0x7fbafc0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbb011ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbafc0b0e70 0x7fbafc0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbb011ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbafc0adb20 con 0x7fbafc159850 2023-10-08T17:43:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbb011ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc0ccdc0 con 0x7fbafc0b0e70 2023-10-08T17:43:27.131 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbb011ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc0b12b0 con 0x7fbafc159c20 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.130+0000 7fbafb59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbafc0b0e70 0x7fbafc0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fbafc0b0e70 0x7fbafc0c93e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50710/0 (socket says 172.21.15.12:50710) 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 -- 172.21.15.12:0/3184632849 learned_addr learned my addr 172.21.15.12:0/3184632849 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafa59c700 1 --2- 172.21.15.12:0/3184632849 >> v2:172.21.15.29:3300/0 conn(0x7fbafc159c20 0x7fbafc0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 -- 172.21.15.12:0/3184632849 >> v2:172.21.15.29:3300/0 conn(0x7fbafc159c20 msgr2=0x7fbafc0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 --2- 172.21.15.12:0/3184632849 >> v2:172.21.15.29:3300/0 conn(0x7fbafc159c20 0x7fbafc0b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 -- 172.21.15.12:0/3184632849 >> v1:172.21.15.29:6789/0 conn(0x7fbafc159850 legacy=0x7fbafc0adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 -- 172.21.15.12:0/3184632849 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc0acf10 con 0x7fbafc0b0e70 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbafb59e700 1 --2- 172.21.15.12:0/3184632849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc0b0e70 0x7fbafc0c93e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06c0c0 tx=0x7fbaf4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac52947991dbd592 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.131+0000 7fbaf9d9b700 1 -- 172.21.15.12:0/3184632849 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400e070 con 0x7fbafc0b0e70 2023-10-08T17:43:27.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbaf9d9b700 1 -- 172.21.15.12:0/3184632849 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400ba50 con 0x7fbafc0b0e70 2023-10-08T17:43:27.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbaf9d9b700 1 -- 172.21.15.12:0/3184632849 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40092e0 con 0x7fbafc0b0e70 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 -- 172.21.15.12:0/3184632849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc0b0e70 msgr2=0x7fbafc0c93e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 --2- 172.21.15.12:0/3184632849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc0b0e70 0x7fbafc0c93e0 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06c0c0 tx=0x7fbaf4009840 comp rx=0 tx=0).stop 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 -- 172.21.15.12:0/3184632849 shutdown_connections 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 --2- 172.21.15.12:0/3184632849 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc0b0e70 0x7fbafc0c93e0 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 --2- 172.21.15.12:0/3184632849 >> v2:172.21.15.29:3300/0 conn(0x7fbafc159c20 0x7fbafc0b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 -- 172.21.15.12:0/3184632849 >> 172.21.15.12:0/3184632849 conn(0x7fbafc06d170 msgr2=0x7fbafc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 -- 172.21.15.12:0/3184632849 shutdown_connections 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.132+0000 7fbb011ff700 1 -- 172.21.15.12:0/3184632849 wait complete. 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.134+0000 7fbb011ff700 1 Processor -- start 2023-10-08T17:43:27.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.134+0000 7fbb011ff700 1 -- start start 2023-10-08T17:43:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 0x7fbafc1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbafc159850 0x7fbafc0a6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.137 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0a6230 con 0x7fbafc159c20 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc153800 con 0x7fbafc159850 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbb011ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0a5f50 con 0x7fbafc0b0e70 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50722/0 (socket says 172.21.15.12:50722) 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 -- 172.21.15.12:0/2975292171 learned_addr learned my addr 172.21.15.12:0/2975292171 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafa59c700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbafc159850 0x7fbafc0a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 -- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 msgr2=0x7fbafc1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafad9d700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 0x7fbafc1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 0x7fbafc1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 -- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbafc159850 msgr2=0x7fbafc0a6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbafc159850 0x7fbafc0a6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafb59e700 1 -- 172.21.15.12:0/2975292171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4009ae0 con 0x7fbafc159c20 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.135+0000 7fbafad9d700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 0x7fbafc1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbafb59e700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06d610 tx=0x7fbaf4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4008e40 con 0x7fbafc159c20 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400be60 con 0x7fbafc159c20 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf40256b0 con 0x7fbafc159c20 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc0a81f0 con 0x7fbafc159c20 2023-10-08T17:43:27.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.136+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc0a87b0 con 0x7fbafc159c20 2023-10-08T17:43:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.137+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbafc0a89f0 con 0x7fbafc159c20 2023-10-08T17:43:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.138+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaf4003040 con 0x7fbafc159c20 2023-10-08T17:43:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.139+0000 7fbae2ffd700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 0x7fbae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.139+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fbaf40864d0 con 0x7fbafc159c20 2023-10-08T17:43:27.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.139+0000 7fbafad9d700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 0x7fbae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.141 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.140+0000 7fbafad9d700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 0x7fbae80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001840 tx=0x7fbaec009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.143+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbafc0a89f0 con 0x7fbafc159c20 2023-10-08T17:43:27.342 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.341+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbafc0a89f0 con 0x7fbae8066f30 2023-10-08T17:43:27.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.349+0000 7fbae2ffd700 1 -- 172.21.15.12:0/2975292171 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278544 (secure 0 0 0) 0x7fbafc0a89f0 con 0x7fbae8066f30 2023-10-08T17:43:27.354 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:27.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.353+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 msgr2=0x7fbae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.353+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 0x7fbae80693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001840 tx=0x7fbaec009040 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.353+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 msgr2=0x7fbafc0a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.353+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7fbafc06d610 tx=0x7fbaf4018000 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 shutdown_connections 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fbae8066f30 0x7fbae80693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fbafc159c20 0x7fbafc0a6990 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fbafc0b0e70 0x7fbafc1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 --2- 172.21.15.12:0/2975292171 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fbafc159850 0x7fbafc0a6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 >> 172.21.15.12:0/2975292171 conn(0x7fbafc06d170 msgr2=0x7fbafc069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:27.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 shutdown_connections 2023-10-08T17:43:27.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.354+0000 7fbb011ff700 1 -- 172.21.15.12:0/2975292171 wait complete. 2023-10-08T17:43:27.358 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:27.372 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:43:26.003386+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2457352,"kb_used_data":21704,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752517368,"statfs":{"total":773094113280,"available":770577784832,"internally_reserved":0,"allocated":22224896,"data_stored":11769032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.968724"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042339+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:43.694298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037985+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:25:27.627123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040589+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:35.694527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042008+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:29:45.347257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040480+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:50:26.082795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043504+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:03:33.969821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042239+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:57.109375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037732+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:12.346194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040235+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:47:45.874167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040281+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:20:58.220918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040998+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:48.748798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040944+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038074+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:23.601419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.043575+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:59:21.457599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041669+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:44.452518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040134+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:55:10.042765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044051+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:02:57.935550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041280+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:29.256805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037755+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:30.322638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040949+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:33.576276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040197+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:52:09.569158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040518+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:50.593979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.038216+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:54:42.170608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041087+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:04:17.227383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037666+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:54.008282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.044304+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:46:11.050317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037822+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:07:17.849030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.037733+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:09:08.207013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.042082+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:11:46.918770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.040499+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:11:00.275784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-08T17:43:21.034240+0000","last_change":"2023-10-08T17:43:21.034240+0000","last_active":"2023-10-08T17:43:21.034240+0000","last_peered":"2023-10-08T17:43:21.034240+0000","last_clean":"2023-10-08T17:43:21.034240+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:21.034240+0000","last_undegraded":"2023-10-08T17:43:21.034240+0000","last_fullsized":"2023-10-08T17:43:21.034240+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-08T17:43:20.028879+0000","last_change":"2023-10-08T17:43:20.041012+0000","last_active":"2023-10-08T17:43:20.028879+0000","last_peered":"2023-10-08T17:43:20.028879+0000","last_clean":"2023-10-08T17:43:20.028879+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-08T17:43:20.028879+0000","last_undegraded":"2023-10-08T17:43:20.028879+0000","last_fullsized":"2023-10-08T17:43:20.028879+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"202'348","reported_seq":1153,"reported_epoch":209,"state":"active+clean","last_fresh":"2023-10-08T17:43:18.731711+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:18.731711+0000","last_peered":"2023-10-08T17:43:18.731711+0000","last_clean":"2023-10-08T17:43:18.731711+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:18.731711+0000","last_undegraded":"2023-10-08T17:43:18.731711+0000","last_fullsized":"2023-10-08T17:43:18.731711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304532,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067308,"statfs":{"total":96636764160,"available":96324923392,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.56999999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.71099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299856,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071984,"statfs":{"total":96636764160,"available":96329711616,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.71199999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.67100000000000004}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.69799999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575962,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68400000000000005,"5min":0.71399999999999997,"15min":0.91400000000000003},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":1.0649999999999999},"last":0.49399999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63600000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.84099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.76000000000000001,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.442},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.56299999999999994}]},{"osd":4,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80600000000000005,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95599999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":1.141,"15min":1.2370000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.196},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":1.056,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.65800000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.008,"5min":1.28,"15min":1.304},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.995,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.61699999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.075,"5min":1.1200000000000001,"15min":1.25},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.878,"15min":0.89900000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.62},"max":{"1min":1.0349999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.998}]}]},{"osd":0,"up_from":13,"seq":55834575962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308628,"kb_used_data":3148,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063212,"statfs":{"total":96636764160,"available":96320729088,"internally_reserved":0,"allocated":3223552,"data_stored":1913905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.60899999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.56999999999999995}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.70499999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.83499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.751},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.76500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575963,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65300000000000002,"5min":0.89500000000000002,"15min":1.032},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.751,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.379},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.45600000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.85299999999999998,"15min":1.327},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79000000000000004,"5min":0.93799999999999994,"15min":1.5009999999999999},"last":0.441}]},{"osd":4,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0620000000000001,"5min":1.157,"15min":1.3520000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.149,"15min":1.2749999999999999},"last":0.95699999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.442},"max":{"1min":1.038,"5min":1.25,"15min":1.3440000000000001},"last":1.0149999999999999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0109999999999999,"5min":1.1859999999999999,"15min":1.375},"last":1.071}]},{"osd":6,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0369999999999999,"5min":1.117,"15min":1.4319999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":1.069,"5min":1.2010000000000001,"15min":1.5429999999999999},"last":1.089}]},{"osd":7,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.873,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.476},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.89800000000000002},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.125,"15min":1.431},"last":1.1100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312144,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059696,"statfs":{"total":96636764160,"available":96317128704,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.39000000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.50800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.70199999999999996}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.72099999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.90200000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.88200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308048,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063792,"statfs":{"total":96636764160,"available":96321323008,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.754,"15min":0.755},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0069999999999999,"5min":1.089,"15min":1.0900000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.443},"max":{"1min":1.0880000000000001,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.46300000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.80800000000000005,"15min":0.79400000000000004},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48299999999999998},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.169},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.96799999999999997,"5min":1.0509999999999999,"15min":1.079},"last":0.436}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77300000000000002},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.81399999999999995,"15min":0.80300000000000005},"min":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":0.98699999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.86199999999999999,"15min":0.84299999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0349999999999999,"5min":1.085,"15min":1.1759999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77100000000000002,"15min":0.77500000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92800000000000005,"5min":0.98999999999999999,"15min":1.0209999999999999},"last":0.623}]},{"osd":5,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.65500000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83899999999999997,"5min":1.137,"15min":1.137},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.71299999999999997},"min":{"1min":0.50900000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.77400000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.68100000000000005,"15min":0.67500000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88300000000000001,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.504,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0820000000000001,"5min":1.1000000000000001,"15min":1.121},"last":0.64400000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.78700000000000003,"15min":0.78900000000000003},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":1.0960000000000001,"5min":1.113,"15min":1.1180000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76100000000000001,"15min":0.751},"min":{"1min":0.496,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.96299999999999997,"5min":1.095,"15min":1.155},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303952,"kb_used_data":2568,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067888,"statfs":{"total":96636764160,"available":96325517312,"internally_reserved":0,"allocated":2629632,"data_stored":1323537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.71899999999999997,"15min":0.73199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.76400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.434},"max":{"1min":0.92600000000000005,"5min":1.03,"15min":1.1659999999999999},"last":0.74099999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.75800000000000001,"15min":0.76800000000000002},"min":{"1min":0.52100000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.206},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.745,"15min":0.76500000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.0149999999999999,"5min":1.016,"15min":1.151},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.78300000000000003},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.032,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.747,"15min":0.75600000000000001},"min":{"1min":0.49199999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0449999999999999,"5min":1.131,"15min":1.131},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.62},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.78400000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48799999999999999},"max":{"1min":0.996,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.92800000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.64200000000000002,"15min":0.63},"min":{"1min":0.40899999999999997,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":1.018,"5min":1.0429999999999999,"15min":1.2749999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.40200000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.83899999999999997}]},{"osd":6,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.46200000000000002},"max":{"1min":0.97899999999999998,"5min":1.01,"15min":1.3049999999999999},"last":0.999},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73799999999999999,"15min":0.71999999999999997},"min":{"1min":0.47999999999999998,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.3480000000000001},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:42:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.76300000000000001,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.53000000000000003,"15min":0.47799999999999998},"max":{"1min":1.048,"5min":1.0620000000000001,"15min":1.125},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.79600000000000004,"15min":0.79000000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.52300000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.258},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:27.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-10-08T17:43:27.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-10-08T17:43:27.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-10-08T17:43:27.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-10-08T17:43:27.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-10-08T17:43:27.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-10-08T17:43:27.384 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-10-08T17:43:27.385 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-10-08T17:43:27.386 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.042339+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:11:43.694298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037985+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:25:27.627123+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040589+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:44:35.694527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T17:43:27.387 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.042008+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:29:45.347257+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040480+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:50:26.082795+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-10-08T17:43:27.388 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.043504+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:03:33.969821+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.042239+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:25:57.109375+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.389 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037732+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:45:12.346194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040235+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:47:45.874167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.390 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040281+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:20:58.220918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040998+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:26:48.748798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-10-08T17:43:27.391 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040944+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.038074+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:17:23.601419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-10-08T17:43:27.392 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.043575+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:59:21.457599+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.041669+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:54:44.452518+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040134+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:55:10.042765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.393 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.044051+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T04:02:57.935550+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.041280+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T18:53:29.256805+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-10-08T17:43:27.394 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037755+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:42:30.322638+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040949+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:38:33.576276+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-10-08T17:43:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040197+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T17:52:09.569158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040518+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T00:01:50.593979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.396 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.038216+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T20:54:42.170608+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.041087+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-10-08T17:43:27.397 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037666+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T05:04:17.227383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037666+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:00:54.008282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.044304+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:46:11.050317+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-08T17:43:27.398 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037822+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T02:07:17.849030+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.037733+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T19:09:08.207013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-10-08T17:43:27.399 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.042082+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T22:11:46.918770+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.040499+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T21:11:00.275784+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-08T17:43:21.034240+0000', 'last_change': '2023-10-08T17:43:21.034240+0000', 'last_active': '2023-10-08T17:43:21.034240+0000', 'last_peered': '2023-10-08T17:43:21.034240+0000', 'last_clean': '2023-10-08T17:43:21.034240+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:21.034240+0000', 'last_undegraded': '2023-10-08T17:43:21.034240+0000', 'last_fullsized': '2023-10-08T17:43:21.034240+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:21.034240+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-08T17:43:27.400 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-10-08T17:43:27.401 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-08T17:43:20.028879+0000', 'last_change': '2023-10-08T17:43:20.041012+0000', 'last_active': '2023-10-08T17:43:20.028879+0000', 'last_peered': '2023-10-08T17:43:20.028879+0000', 'last_clean': '2023-10-08T17:43:20.028879+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-08T17:43:20.028879+0000', 'last_undegraded': '2023-10-08T17:43:20.028879+0000', 'last_fullsized': '2023-10-08T17:43:20.028879+0000', 'mapping_epoch': 210, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 210, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'last_clean_scrub_stamp': '2023-10-08T17:43:20.028879+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-08T17:43:27.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-08T17:43:27.601 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.600+0000 7ff96bfff700 1 Processor -- start 2023-10-08T17:43:27.602 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.600+0000 7ff96bfff700 1 -- start start 2023-10-08T17:43:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 0x7ff96c069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96bfff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff96c06de50 0x7ff96c06a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96c15b640 con 0x7ff96c15b0a0 2023-10-08T17:43:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96bfff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c0c6800 con 0x7ff96c06de50 2023-10-08T17:43:27.604 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff96c15b920 con 0x7ff96c140a70 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff96c06de50 0x7ff96c06a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96a7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff96c06de50 0x7ff96c06a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50732/0 (socket says 172.21.15.12:50732) 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96b7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff96c15b0a0 0x7ff96c157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44644/0 (socket says 172.21.15.12:44644) 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96a7fc700 1 -- 172.21.15.12:0/1926427368 learned_addr learned my addr 172.21.15.12:0/1926427368 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.602+0000 7ff96affd700 1 --2- 172.21.15.12:0/1926427368 >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 0x7ff96c069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96a7fc700 1 -- 172.21.15.12:0/1926427368 >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 msgr2=0x7ff96c069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96a7fc700 1 --2- 172.21.15.12:0/1926427368 >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 0x7ff96c069b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96a7fc700 1 -- 172.21.15.12:0/1926427368 >> v1:172.21.15.12:6789/0 conn(0x7ff96c15b0a0 legacy=0x7ff96c157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96a7fc700 1 -- 172.21.15.12:0/1926427368 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff96c15bc00 con 0x7ff96c06de50 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96affd700 1 --2- 172.21.15.12:0/1926427368 >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 0x7ff96c069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:27.605 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff969ffb700 1 -- 172.21.15.12:0/1926427368 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138257829 0 0) 0x7ff96c15b640 con 0x7ff96c15b0a0 2023-10-08T17:43:27.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff96a7fc700 1 --2- 172.21.15.12:0/1926427368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c06a040 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f940 tx=0x7ff960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9526f0958a607040 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff969ffb700 1 -- 172.21.15.12:0/1926427368 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000b860 con 0x7ff96c06de50 2023-10-08T17:43:27.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff969ffb700 1 -- 172.21.15.12:0/1926427368 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000b9c0 con 0x7ff96c06de50 2023-10-08T17:43:27.606 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.603+0000 7ff969ffb700 1 -- 172.21.15.12:0/1926427368 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000bd60 con 0x7ff96c06de50 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 -- 172.21.15.12:0/1926427368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 msgr2=0x7ff96c06a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 --2- 172.21.15.12:0/1926427368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c06a040 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f940 tx=0x7ff960009250 comp rx=0 tx=0).stop 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 -- 172.21.15.12:0/1926427368 shutdown_connections 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 --2- 172.21.15.12:0/1926427368 >> v2:172.21.15.29:3300/0 conn(0x7ff96c140a70 0x7ff96c069b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 --2- 172.21.15.12:0/1926427368 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c06a040 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 -- 172.21.15.12:0/1926427368 >> 172.21.15.12:0/1926427368 conn(0x7ff96c06d110 msgr2=0x7ff96c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:27.607 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 -- 172.21.15.12:0/1926427368 shutdown_connections 2023-10-08T17:43:27.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.604+0000 7ff96bfff700 1 -- 172.21.15.12:0/1926427368 wait complete. 2023-10-08T17:43:27.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.605+0000 7ff96bfff700 1 Processor -- start 2023-10-08T17:43:27.608 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.605+0000 7ff96bfff700 1 -- start start 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff96c140a70 0x7ff96c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff96c15b0a0 0x7ff96c15da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15c740 con 0x7ff96c06de50 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15d580 con 0x7ff96c140a70 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.606+0000 7ff96bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff96c15df50 con 0x7ff96c15b0a0 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.610 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50744/0 (socket says 172.21.15.12:50744) 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 -- 172.21.15.12:0/3852011401 learned_addr learned my addr 172.21.15.12:0/3852011401 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96a7fc700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff96c140a70 0x7ff96c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96b7fe700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff96c15b0a0 0x7ff96c15da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 -- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff96c15b0a0 msgr2=0x7ff96c15da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff96c15b0a0 0x7ff96c15da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 -- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff96c140a70 msgr2=0x7ff96c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff96c140a70 0x7ff96c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 -- 172.21.15.12:0/3852011401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600094f0 con 0x7ff96c06de50 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.607+0000 7ff96affd700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e8d0 tx=0x7ff95c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.608+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00ee70 con 0x7ff96c06de50 2023-10-08T17:43:27.611 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.608+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c00c5e0 con 0x7ff96c06de50 2023-10-08T17:43:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.608+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96c15c970 con 0x7ff96c06de50 2023-10-08T17:43:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.608+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00c980 con 0x7ff96c06de50 2023-10-08T17:43:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.608+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96c15cf30 con 0x7ff96c06de50 2023-10-08T17:43:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.609+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96c15d860 con 0x7ff96c06de50 2023-10-08T17:43:27.612 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.610+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff95c013410 con 0x7ff96c06de50 2023-10-08T17:43:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.611+0000 7ff952ffd700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.611+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ff95c084530 con 0x7ff96c06de50 2023-10-08T17:43:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.611+0000 7ff96a7fc700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:27.613 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.611+0000 7ff96a7fc700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 0x7ff9580693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f940 tx=0x7ff960017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:27.616 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.615+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff95c051590 con 0x7ff96c06de50 2023-10-08T17:43:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.899+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff96c04c3c0 con 0x7ff96c06de50 2023-10-08T17:43:27.900 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.899+0000 7ff952ffd700 1 -- 172.21.15.12:0/3852011401 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1117 (secure 0 0 0) 0x7ff95c054bb0 con 0x7ff96c06de50 2023-10-08T17:43:27.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:27.901 INFO:teuthology.orchestra.run.smithi012.stdout:{"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":5671,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":213,"num_osds":8,"num_up_osds":8,"osd_up_since":1696781348,"num_in_osds":8,"osd_in_since":1696781339,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2516328448,"bytes_avail":770577784832,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":98,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"b","status":"up:active","gid":10278}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-10-08T17:42:59.407973+0000","services":{}},"progress_events":{}} 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 msgr2=0x7ff9580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 0x7ff9580693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff96c06f940 tx=0x7ff960017000 comp rx=0 tx=0).stop 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 msgr2=0x7ff96c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00e8d0 tx=0x7ff95c008040 comp rx=0 tx=0).stop 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 shutdown_connections 2023-10-08T17:43:27.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff958066f30 0x7ff9580693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff96c06de50 0x7ff96c0b0740 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff96c15b0a0 0x7ff96c15da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 --2- 172.21.15.12:0/3852011401 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff96c140a70 0x7ff96c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 >> 172.21.15.12:0/3852011401 conn(0x7ff96c06d110 msgr2=0x7ff96c13d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 shutdown_connections 2023-10-08T17:43:27.904 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:27.902+0000 7ff96bfff700 1 -- 172.21.15.12:0/3852011401 wait complete. 2023-10-08T17:43:27.920 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-08T17:43:27.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:28.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.107+0000 7f015db9d700 1 Processor -- start 2023-10-08T17:43:28.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.108+0000 7f015db9d700 1 -- start start 2023-10-08T17:43:28.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f015db9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f015813fb20 0x7f015815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:28.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f015db9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015815ae70 con 0x7f015813fef0 2023-10-08T17:43:28.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f015db9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f015806af60 con 0x7f015806aaa0 2023-10-08T17:43:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f015db9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f015806b240 con 0x7f015813fb20 2023-10-08T17:43:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f0157fff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f015813fef0 0x7f01580c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44646/0 (socket says 172.21.15.12:44646) 2023-10-08T17:43:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f0157fff700 1 -- 172.21.15.12:0/2649228615 learned_addr learned my addr 172.21.15.12:0/2649228615 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.109+0000 7f015cb9b700 1 --2- 172.21.15.12:0/2649228615 >> v2:172.21.15.29:3300/0 conn(0x7f015813fb20 0x7f015815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:28.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f01577fe700 1 -- 172.21.15.12:0/2649228615 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605580029 0 0) 0x7f0144001290 con 0x7f015813fef0 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f01577fe700 1 -- 172.21.15.12:0/2649228615 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0148003570 con 0x7f015813fef0 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f015cb9b700 1 -- 172.21.15.12:0/2649228615 >> v1:172.21.15.29:6789/0 conn(0x7f015806aaa0 legacy=0x7f01580c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f015cb9b700 1 -- 172.21.15.12:0/2649228615 >> v1:172.21.15.12:6789/0 conn(0x7f015813fef0 legacy=0x7f01580c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f015cb9b700 1 -- 172.21.15.12:0/2649228615 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015806b520 con 0x7f015813fb20 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.110+0000 7f015cb9b700 1 --2- 172.21.15.12:0/2649228615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f015815a930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f014c0098e0 tx=0x7f014c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9085536e803e093a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:28.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f01577fe700 1 -- 172.21.15.12:0/2649228615 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00b640 con 0x7f015813fb20 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f01577fe700 1 -- 172.21.15.12:0/2649228615 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c00b7a0 con 0x7f015813fb20 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f01577fe700 1 -- 172.21.15.12:0/2649228615 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00bb40 con 0x7f015813fb20 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 -- 172.21.15.12:0/2649228615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 msgr2=0x7f015815a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 --2- 172.21.15.12:0/2649228615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f015815a930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f014c0098e0 tx=0x7f014c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 -- 172.21.15.12:0/2649228615 shutdown_connections 2023-10-08T17:43:28.116 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 --2- 172.21.15.12:0/2649228615 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f015815a930 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 -- 172.21.15.12:0/2649228615 >> 172.21.15.12:0/2649228615 conn(0x7f015806d170 msgr2=0x7f01580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 -- 172.21.15.12:0/2649228615 shutdown_connections 2023-10-08T17:43:28.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.111+0000 7f015db9d700 1 -- 172.21.15.12:0/2649228615 wait complete. 2023-10-08T17:43:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.113+0000 7f015db9d700 1 Processor -- start 2023-10-08T17:43:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.113+0000 7f015db9d700 1 -- start start 2023-10-08T17:43:28.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f0158132ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f015813fef0 0x7f01581333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01580ac4c0 con 0x7f015806aaa0 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0158157920 con 0x7f015813fb20 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015db9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0158135da0 con 0x7f015813fef0 2023-10-08T17:43:28.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50758/0 (socket says 172.21.15.12:50758) 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 -- 172.21.15.12:0/1967394342 learned_addr learned my addr 172.21.15.12:0/1967394342 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f0157fff700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f0158132ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015d39c700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f015813fef0 0x7f01581333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 -- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f015813fef0 msgr2=0x7f01581333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f015813fef0 0x7f01581333e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 -- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 msgr2=0x7f0158132ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f0158132ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.114+0000 7f015cb9b700 1 -- 172.21.15.12:0/1967394342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c009420 con 0x7f015806aaa0 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f015cb9b700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f014c0093f0 tx=0x7f014c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c00bb20 con 0x7f015806aaa0 2023-10-08T17:43:28.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014c011420 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014c0117e0 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0158136080 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.115+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01580ac150 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.116+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f015806eab0 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.117+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f014c011c10 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.118+0000 7f0154ff9700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.118+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f014c085f90 con 0x7f015806aaa0 2023-10-08T17:43:28.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.118+0000 7f0157fff700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.119+0000 7f0157fff700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 0x7f013c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01580cb900 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:28.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.122+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f014c052fd0 con 0x7f015806aaa0 2023-10-08T17:43:28.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.320+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01580ac600 con 0x7f013c066f30 2023-10-08T17:43:28.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.329+0000 7f0154ff9700 1 -- 172.21.15.12:0/1967394342 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289312 (secure 0 0 0) 0x7f0144002d20 con 0x7f013c066f30 2023-10-08T17:43:28.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:28.338 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 msgr2=0x7f013c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 0x7f013c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01580cb900 tx=0x7f0144009040 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 msgr2=0x7f0158156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f014c0093f0 tx=0x7f014c017000 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 shutdown_connections 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f013c066f30 0x7f013c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f015806aaa0 0x7f0158156020 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f015813fef0 0x7f01581333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 --2- 172.21.15.12:0/1967394342 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f015813fb20 0x7f0158132ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 >> 172.21.15.12:0/1967394342 conn(0x7f015806d170 msgr2=0x7f0158159f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 shutdown_connections 2023-10-08T17:43:28.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:28.333+0000 7f015db9d700 1 -- 172.21.15.12:0/1967394342 wait complete. 2023-10-08T17:43:28.340 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:28.352 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-08T17:43:28.003701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461800,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512920,"statfs":{"total":773094113280,"available":770573230080,"internally_reserved":0,"allocated":22585344,"data_stored":11940636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.965563"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083243+0000","last_change":"2023-10-08T17:43:22.078252+0000","last_active":"2023-10-08T17:43:22.083243+0000","last_peered":"2023-10-08T17:43:22.083243+0000","last_clean":"2023-10-08T17:43:22.083243+0000","last_became_active":"2023-10-08T17:43:22.077986+0000","last_became_peered":"2023-10-08T17:43:22.077986+0000","last_unstale":"2023-10-08T17:43:22.083243+0000","last_undegraded":"2023-10-08T17:43:22.083243+0000","last_fullsized":"2023-10-08T17:43:22.083243+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:45.048739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072180+0000","last_change":"2023-10-08T17:43:22.069022+0000","last_active":"2023-10-08T17:43:22.072180+0000","last_peered":"2023-10-08T17:43:22.072180+0000","last_clean":"2023-10-08T17:43:22.072180+0000","last_became_active":"2023-10-08T17:43:22.068467+0000","last_became_peered":"2023-10-08T17:43:22.068467+0000","last_unstale":"2023-10-08T17:43:22.072180+0000","last_undegraded":"2023-10-08T17:43:22.072180+0000","last_fullsized":"2023-10-08T17:43:22.072180+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:30.262166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077770+0000","last_change":"2023-10-08T17:43:22.074050+0000","last_active":"2023-10-08T17:43:22.077770+0000","last_peered":"2023-10-08T17:43:22.077770+0000","last_clean":"2023-10-08T17:43:22.077770+0000","last_became_active":"2023-10-08T17:43:22.073775+0000","last_became_peered":"2023-10-08T17:43:22.073775+0000","last_unstale":"2023-10-08T17:43:22.077770+0000","last_undegraded":"2023-10-08T17:43:22.077770+0000","last_fullsized":"2023-10-08T17:43:22.077770+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:47.273419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072360+0000","last_change":"2023-10-08T17:43:22.067894+0000","last_active":"2023-10-08T17:43:22.072360+0000","last_peered":"2023-10-08T17:43:22.072360+0000","last_clean":"2023-10-08T17:43:22.072360+0000","last_became_active":"2023-10-08T17:43:22.067617+0000","last_became_peered":"2023-10-08T17:43:22.067617+0000","last_unstale":"2023-10-08T17:43:22.072360+0000","last_undegraded":"2023-10-08T17:43:22.072360+0000","last_fullsized":"2023-10-08T17:43:22.072360+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:58.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085670+0000","last_change":"2023-10-08T17:43:22.080557+0000","last_active":"2023-10-08T17:43:22.085670+0000","last_peered":"2023-10-08T17:43:22.085670+0000","last_clean":"2023-10-08T17:43:22.085670+0000","last_became_active":"2023-10-08T17:43:22.080067+0000","last_became_peered":"2023-10-08T17:43:22.080067+0000","last_unstale":"2023-10-08T17:43:22.085670+0000","last_undegraded":"2023-10-08T17:43:22.085670+0000","last_fullsized":"2023-10-08T17:43:22.085670+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:35.096095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.064637+0000","last_change":"2023-10-08T17:43:22.062061+0000","last_active":"2023-10-08T17:43:22.064637+0000","last_peered":"2023-10-08T17:43:22.064637+0000","last_clean":"2023-10-08T17:43:22.064637+0000","last_became_active":"2023-10-08T17:43:22.061793+0000","last_became_peered":"2023-10-08T17:43:22.061793+0000","last_unstale":"2023-10-08T17:43:22.064637+0000","last_undegraded":"2023-10-08T17:43:22.064637+0000","last_fullsized":"2023-10-08T17:43:22.064637+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:28.205459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.070385+0000","last_change":"2023-10-08T17:43:22.063419+0000","last_active":"2023-10-08T17:43:22.070385+0000","last_peered":"2023-10-08T17:43:22.070385+0000","last_clean":"2023-10-08T17:43:22.070385+0000","last_became_active":"2023-10-08T17:43:22.063124+0000","last_became_peered":"2023-10-08T17:43:22.063124+0000","last_unstale":"2023-10-08T17:43:22.070385+0000","last_undegraded":"2023-10-08T17:43:22.070385+0000","last_fullsized":"2023-10-08T17:43:22.070385+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:58.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077791+0000","last_change":"2023-10-08T17:43:22.074046+0000","last_active":"2023-10-08T17:43:22.077791+0000","last_peered":"2023-10-08T17:43:22.077791+0000","last_clean":"2023-10-08T17:43:22.077791+0000","last_became_active":"2023-10-08T17:43:22.073747+0000","last_became_peered":"2023-10-08T17:43:22.073747+0000","last_unstale":"2023-10-08T17:43:22.077791+0000","last_undegraded":"2023-10-08T17:43:22.077791+0000","last_fullsized":"2023-10-08T17:43:22.077791+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:58.329404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078860+0000","last_change":"2023-10-08T17:43:22.077433+0000","last_active":"2023-10-08T17:43:22.078860+0000","last_peered":"2023-10-08T17:43:22.078860+0000","last_clean":"2023-10-08T17:43:22.078860+0000","last_became_active":"2023-10-08T17:43:22.077128+0000","last_became_peered":"2023-10-08T17:43:22.077128+0000","last_unstale":"2023-10-08T17:43:22.078860+0000","last_undegraded":"2023-10-08T17:43:22.078860+0000","last_fullsized":"2023-10-08T17:43:22.078860+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.754159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.075410+0000","last_change":"2023-10-08T17:43:22.061333+0000","last_active":"2023-10-08T17:43:22.075410+0000","last_peered":"2023-10-08T17:43:22.075410+0000","last_clean":"2023-10-08T17:43:22.075410+0000","last_became_active":"2023-10-08T17:43:22.060960+0000","last_became_peered":"2023-10-08T17:43:22.060960+0000","last_unstale":"2023-10-08T17:43:22.075410+0000","last_undegraded":"2023-10-08T17:43:22.075410+0000","last_fullsized":"2023-10-08T17:43:22.075410+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:37.048582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072705+0000","last_change":"2023-10-08T17:43:22.064486+0000","last_active":"2023-10-08T17:43:22.072705+0000","last_peered":"2023-10-08T17:43:22.072705+0000","last_clean":"2023-10-08T17:43:22.072705+0000","last_became_active":"2023-10-08T17:43:22.064216+0000","last_became_peered":"2023-10-08T17:43:22.064216+0000","last_unstale":"2023-10-08T17:43:22.072705+0000","last_undegraded":"2023-10-08T17:43:22.072705+0000","last_fullsized":"2023-10-08T17:43:22.072705+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:22.226133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072324+0000","last_change":"2023-10-08T17:43:22.064774+0000","last_active":"2023-10-08T17:43:22.072324+0000","last_peered":"2023-10-08T17:43:22.072324+0000","last_clean":"2023-10-08T17:43:22.072324+0000","last_became_active":"2023-10-08T17:43:22.064521+0000","last_became_peered":"2023-10-08T17:43:22.064521+0000","last_unstale":"2023-10-08T17:43:22.072324+0000","last_undegraded":"2023-10-08T17:43:22.072324+0000","last_fullsized":"2023-10-08T17:43:22.072324+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:57.065279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.067994+0000","last_change":"2023-10-08T17:43:22.060652+0000","last_active":"2023-10-08T17:43:22.067994+0000","last_peered":"2023-10-08T17:43:22.067994+0000","last_clean":"2023-10-08T17:43:22.067994+0000","last_became_active":"2023-10-08T17:43:22.059994+0000","last_became_peered":"2023-10-08T17:43:22.059994+0000","last_unstale":"2023-10-08T17:43:22.067994+0000","last_undegraded":"2023-10-08T17:43:22.067994+0000","last_fullsized":"2023-10-08T17:43:22.067994+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:55.013643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083412+0000","last_change":"2023-10-08T17:43:22.082255+0000","last_active":"2023-10-08T17:43:22.083412+0000","last_peered":"2023-10-08T17:43:22.083412+0000","last_clean":"2023-10-08T17:43:22.083412+0000","last_became_active":"2023-10-08T17:43:22.081987+0000","last_became_peered":"2023-10-08T17:43:22.081987+0000","last_unstale":"2023-10-08T17:43:22.083412+0000","last_undegraded":"2023-10-08T17:43:22.083412+0000","last_fullsized":"2023-10-08T17:43:22.083412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:13.208840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.067845+0000","last_change":"2023-10-08T17:43:22.059287+0000","last_active":"2023-10-08T17:43:22.067845+0000","last_peered":"2023-10-08T17:43:22.067845+0000","last_clean":"2023-10-08T17:43:22.067845+0000","last_became_active":"2023-10-08T17:43:22.059028+0000","last_became_peered":"2023-10-08T17:43:22.059028+0000","last_unstale":"2023-10-08T17:43:22.067845+0000","last_undegraded":"2023-10-08T17:43:22.067845+0000","last_fullsized":"2023-10-08T17:43:22.067845+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:24.606780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088054+0000","last_change":"2023-10-08T17:43:22.084411+0000","last_active":"2023-10-08T17:43:22.088054+0000","last_peered":"2023-10-08T17:43:22.088054+0000","last_clean":"2023-10-08T17:43:22.088054+0000","last_became_active":"2023-10-08T17:43:22.084141+0000","last_became_peered":"2023-10-08T17:43:22.084141+0000","last_unstale":"2023-10-08T17:43:22.088054+0000","last_undegraded":"2023-10-08T17:43:22.088054+0000","last_fullsized":"2023-10-08T17:43:22.088054+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:09.104637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077531+0000","last_change":"2023-10-08T17:43:22.071275+0000","last_active":"2023-10-08T17:43:22.077531+0000","last_peered":"2023-10-08T17:43:22.077531+0000","last_clean":"2023-10-08T17:43:22.077531+0000","last_became_active":"2023-10-08T17:43:22.070867+0000","last_became_peered":"2023-10-08T17:43:22.070867+0000","last_unstale":"2023-10-08T17:43:22.077531+0000","last_undegraded":"2023-10-08T17:43:22.077531+0000","last_fullsized":"2023-10-08T17:43:22.077531+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083127+0000","last_change":"2023-10-08T17:43:22.075626+0000","last_active":"2023-10-08T17:43:22.083127+0000","last_peered":"2023-10-08T17:43:22.083127+0000","last_clean":"2023-10-08T17:43:22.083127+0000","last_became_active":"2023-10-08T17:43:22.075343+0000","last_became_peered":"2023-10-08T17:43:22.075343+0000","last_unstale":"2023-10-08T17:43:22.083127+0000","last_undegraded":"2023-10-08T17:43:22.083127+0000","last_fullsized":"2023-10-08T17:43:22.083127+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:04.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078573+0000","last_change":"2023-10-08T17:43:22.075500+0000","last_active":"2023-10-08T17:43:22.078573+0000","last_peered":"2023-10-08T17:43:22.078573+0000","last_clean":"2023-10-08T17:43:22.078573+0000","last_became_active":"2023-10-08T17:43:22.075245+0000","last_became_peered":"2023-10-08T17:43:22.075245+0000","last_unstale":"2023-10-08T17:43:22.078573+0000","last_undegraded":"2023-10-08T17:43:22.078573+0000","last_fullsized":"2023-10-08T17:43:22.078573+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:45.048739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078934+0000","last_change":"2023-10-08T17:43:22.074451+0000","last_active":"2023-10-08T17:43:22.078934+0000","last_peered":"2023-10-08T17:43:22.078934+0000","last_clean":"2023-10-08T17:43:22.078934+0000","last_became_active":"2023-10-08T17:43:22.074084+0000","last_became_peered":"2023-10-08T17:43:22.074084+0000","last_unstale":"2023-10-08T17:43:22.078934+0000","last_undegraded":"2023-10-08T17:43:22.078934+0000","last_fullsized":"2023-10-08T17:43:22.078934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:07.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085651+0000","last_change":"2023-10-08T17:43:22.080313+0000","last_active":"2023-10-08T17:43:22.085651+0000","last_peered":"2023-10-08T17:43:22.085651+0000","last_clean":"2023-10-08T17:43:22.085651+0000","last_became_active":"2023-10-08T17:43:22.079755+0000","last_became_peered":"2023-10-08T17:43:22.079755+0000","last_unstale":"2023-10-08T17:43:22.085651+0000","last_undegraded":"2023-10-08T17:43:22.085651+0000","last_fullsized":"2023-10-08T17:43:22.085651+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:31:53.791357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080191+0000","last_change":"2023-10-08T17:43:22.067719+0000","last_active":"2023-10-08T17:43:22.080191+0000","last_peered":"2023-10-08T17:43:22.080191+0000","last_clean":"2023-10-08T17:43:22.080191+0000","last_became_active":"2023-10-08T17:43:22.067468+0000","last_became_peered":"2023-10-08T17:43:22.067468+0000","last_unstale":"2023-10-08T17:43:22.080191+0000","last_undegraded":"2023-10-08T17:43:22.080191+0000","last_fullsized":"2023-10-08T17:43:22.080191+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:53:15.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.075141+0000","last_change":"2023-10-08T17:43:22.072322+0000","last_active":"2023-10-08T17:43:22.075141+0000","last_peered":"2023-10-08T17:43:22.075141+0000","last_clean":"2023-10-08T17:43:22.075141+0000","last_became_active":"2023-10-08T17:43:22.071981+0000","last_became_peered":"2023-10-08T17:43:22.071981+0000","last_unstale":"2023-10-08T17:43:22.075141+0000","last_undegraded":"2023-10-08T17:43:22.075141+0000","last_fullsized":"2023-10-08T17:43:22.075141+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:22.083718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073927+0000","last_change":"2023-10-08T17:43:22.070207+0000","last_active":"2023-10-08T17:43:22.073927+0000","last_peered":"2023-10-08T17:43:22.073927+0000","last_clean":"2023-10-08T17:43:22.073927+0000","last_became_active":"2023-10-08T17:43:22.069909+0000","last_became_peered":"2023-10-08T17:43:22.069909+0000","last_unstale":"2023-10-08T17:43:22.073927+0000","last_undegraded":"2023-10-08T17:43:22.073927+0000","last_fullsized":"2023-10-08T17:43:22.073927+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:14.778578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072412+0000","last_change":"2023-10-08T17:43:22.064182+0000","last_active":"2023-10-08T17:43:22.072412+0000","last_peered":"2023-10-08T17:43:22.072412+0000","last_clean":"2023-10-08T17:43:22.072412+0000","last_became_active":"2023-10-08T17:43:22.063912+0000","last_became_peered":"2023-10-08T17:43:22.063912+0000","last_unstale":"2023-10-08T17:43:22.072412+0000","last_undegraded":"2023-10-08T17:43:22.072412+0000","last_fullsized":"2023-10-08T17:43:22.072412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.433384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062408+0000","last_change":"2023-10-08T17:43:22.060871+0000","last_active":"2023-10-08T17:43:22.062408+0000","last_peered":"2023-10-08T17:43:22.062408+0000","last_clean":"2023-10-08T17:43:22.062408+0000","last_became_active":"2023-10-08T17:43:22.060276+0000","last_became_peered":"2023-10-08T17:43:22.060276+0000","last_unstale":"2023-10-08T17:43:22.062408+0000","last_undegraded":"2023-10-08T17:43:22.062408+0000","last_fullsized":"2023-10-08T17:43:22.062408+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:30.262166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.064620+0000","last_change":"2023-10-08T17:43:22.062906+0000","last_active":"2023-10-08T17:43:22.064620+0000","last_peered":"2023-10-08T17:43:22.064620+0000","last_clean":"2023-10-08T17:43:22.064620+0000","last_became_active":"2023-10-08T17:43:22.062651+0000","last_became_peered":"2023-10-08T17:43:22.062651+0000","last_unstale":"2023-10-08T17:43:22.064620+0000","last_undegraded":"2023-10-08T17:43:22.064620+0000","last_fullsized":"2023-10-08T17:43:22.064620+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:39:53.492759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.082143+0000","last_change":"2023-10-08T17:43:22.078710+0000","last_active":"2023-10-08T17:43:22.082143+0000","last_peered":"2023-10-08T17:43:22.082143+0000","last_clean":"2023-10-08T17:43:22.082143+0000","last_became_active":"2023-10-08T17:43:22.078462+0000","last_became_peered":"2023-10-08T17:43:22.078462+0000","last_unstale":"2023-10-08T17:43:22.082143+0000","last_undegraded":"2023-10-08T17:43:22.082143+0000","last_fullsized":"2023-10-08T17:43:22.082143+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:15.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.068015+0000","last_change":"2023-10-08T17:43:22.060821+0000","last_active":"2023-10-08T17:43:22.068015+0000","last_peered":"2023-10-08T17:43:22.068015+0000","last_clean":"2023-10-08T17:43:22.068015+0000","last_became_active":"2023-10-08T17:43:22.060379+0000","last_became_peered":"2023-10-08T17:43:22.060379+0000","last_unstale":"2023-10-08T17:43:22.068015+0000","last_undegraded":"2023-10-08T17:43:22.068015+0000","last_fullsized":"2023-10-08T17:43:22.068015+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:04.023007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084754+0000","last_change":"2023-10-08T17:43:22.083753+0000","last_active":"2023-10-08T17:43:22.084754+0000","last_peered":"2023-10-08T17:43:22.084754+0000","last_clean":"2023-10-08T17:43:22.084754+0000","last_became_active":"2023-10-08T17:43:22.083390+0000","last_became_peered":"2023-10-08T17:43:22.083390+0000","last_unstale":"2023-10-08T17:43:22.084754+0000","last_undegraded":"2023-10-08T17:43:22.084754+0000","last_fullsized":"2023-10-08T17:43:22.084754+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:26.991538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.079676+0000","last_change":"2023-10-08T17:43:22.075325+0000","last_active":"2023-10-08T17:43:22.079676+0000","last_peered":"2023-10-08T17:43:22.079676+0000","last_clean":"2023-10-08T17:43:22.079676+0000","last_became_active":"2023-10-08T17:43:22.074725+0000","last_became_peered":"2023-10-08T17:43:22.074725+0000","last_unstale":"2023-10-08T17:43:22.079676+0000","last_undegraded":"2023-10-08T17:43:22.079676+0000","last_fullsized":"2023-10-08T17:43:22.079676+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:48.246731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081858+0000","last_change":"2023-10-08T17:43:22.075935+0000","last_active":"2023-10-08T17:43:22.081858+0000","last_peered":"2023-10-08T17:43:22.081858+0000","last_clean":"2023-10-08T17:43:22.081858+0000","last_became_active":"2023-10-08T17:43:22.075660+0000","last_became_peered":"2023-10-08T17:43:22.075660+0000","last_unstale":"2023-10-08T17:43:22.081858+0000","last_undegraded":"2023-10-08T17:43:22.081858+0000","last_fullsized":"2023-10-08T17:43:22.081858+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:13.351555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.090982+0000","last_change":"2023-10-08T17:43:22.087475+0000","last_active":"2023-10-08T17:43:22.090982+0000","last_peered":"2023-10-08T17:43:22.090982+0000","last_clean":"2023-10-08T17:43:22.090982+0000","last_became_active":"2023-10-08T17:43:22.087194+0000","last_became_peered":"2023-10-08T17:43:22.087194+0000","last_unstale":"2023-10-08T17:43:22.090982+0000","last_undegraded":"2023-10-08T17:43:22.090982+0000","last_fullsized":"2023-10-08T17:43:22.090982+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:31.677556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"212'4","reported_seq":14,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085477+0000","last_change":"2023-10-08T17:43:21.055887+0000","last_active":"2023-10-08T17:43:22.085477+0000","last_peered":"2023-10-08T17:43:22.085477+0000","last_clean":"2023-10-08T17:43:22.085477+0000","last_became_active":"2023-10-08T17:43:21.055585+0000","last_became_peered":"2023-10-08T17:43:21.055585+0000","last_unstale":"2023-10-08T17:43:22.085477+0000","last_undegraded":"2023-10-08T17:43:22.085477+0000","last_fullsized":"2023-10-08T17:43:22.085477+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:46.268058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078364+0000","last_change":"2023-10-08T17:43:22.070067+0000","last_active":"2023-10-08T17:43:22.078364+0000","last_peered":"2023-10-08T17:43:22.078364+0000","last_clean":"2023-10-08T17:43:22.078364+0000","last_became_active":"2023-10-08T17:43:22.069777+0000","last_became_peered":"2023-10-08T17:43:22.069777+0000","last_unstale":"2023-10-08T17:43:22.078364+0000","last_undegraded":"2023-10-08T17:43:22.078364+0000","last_fullsized":"2023-10-08T17:43:22.078364+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:33.047803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084782+0000","last_change":"2023-10-08T17:43:21.057453+0000","last_active":"2023-10-08T17:43:22.084782+0000","last_peered":"2023-10-08T17:43:22.084782+0000","last_clean":"2023-10-08T17:43:22.084782+0000","last_became_active":"2023-10-08T17:43:21.057187+0000","last_became_peered":"2023-10-08T17:43:21.057187+0000","last_unstale":"2023-10-08T17:43:22.084782+0000","last_undegraded":"2023-10-08T17:43:22.084782+0000","last_fullsized":"2023-10-08T17:43:22.084782+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.477775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073162+0000","last_change":"2023-10-08T17:43:22.070972+0000","last_active":"2023-10-08T17:43:22.073162+0000","last_peered":"2023-10-08T17:43:22.073162+0000","last_clean":"2023-10-08T17:43:22.073162+0000","last_became_active":"2023-10-08T17:43:22.070683+0000","last_became_peered":"2023-10-08T17:43:22.070683+0000","last_unstale":"2023-10-08T17:43:22.073162+0000","last_undegraded":"2023-10-08T17:43:22.073162+0000","last_fullsized":"2023-10-08T17:43:22.073162+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:45.457879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.089013+0000","last_change":"2023-10-08T17:43:21.058270+0000","last_active":"2023-10-08T17:43:22.089013+0000","last_peered":"2023-10-08T17:43:22.089013+0000","last_clean":"2023-10-08T17:43:22.089013+0000","last_became_active":"2023-10-08T17:43:21.058013+0000","last_became_peered":"2023-10-08T17:43:21.058013+0000","last_unstale":"2023-10-08T17:43:22.089013+0000","last_undegraded":"2023-10-08T17:43:22.089013+0000","last_fullsized":"2023-10-08T17:43:22.089013+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:12.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.079953+0000","last_change":"2023-10-08T17:43:22.079337+0000","last_active":"2023-10-08T17:43:22.079953+0000","last_peered":"2023-10-08T17:43:22.079953+0000","last_clean":"2023-10-08T17:43:22.079953+0000","last_became_active":"2023-10-08T17:43:22.078986+0000","last_became_peered":"2023-10-08T17:43:22.078986+0000","last_unstale":"2023-10-08T17:43:22.079953+0000","last_undegraded":"2023-10-08T17:43:22.079953+0000","last_fullsized":"2023-10-08T17:43:22.079953+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:51.599340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084048+0000","last_change":"2023-10-08T17:43:21.053546+0000","last_active":"2023-10-08T17:43:22.084048+0000","last_peered":"2023-10-08T17:43:22.084048+0000","last_clean":"2023-10-08T17:43:22.084048+0000","last_became_active":"2023-10-08T17:43:21.052996+0000","last_became_peered":"2023-10-08T17:43:21.052996+0000","last_unstale":"2023-10-08T17:43:22.084048+0000","last_undegraded":"2023-10-08T17:43:22.084048+0000","last_fullsized":"2023-10-08T17:43:22.084048+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:14.067176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080212+0000","last_change":"2023-10-08T17:43:22.073843+0000","last_active":"2023-10-08T17:43:22.080212+0000","last_peered":"2023-10-08T17:43:22.080212+0000","last_clean":"2023-10-08T17:43:22.080212+0000","last_became_active":"2023-10-08T17:43:22.072964+0000","last_became_peered":"2023-10-08T17:43:22.072964+0000","last_unstale":"2023-10-08T17:43:22.080212+0000","last_undegraded":"2023-10-08T17:43:22.080212+0000","last_fullsized":"2023-10-08T17:43:22.080212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:14.041318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085119+0000","last_change":"2023-10-08T17:43:21.052583+0000","last_active":"2023-10-08T17:43:22.085119+0000","last_peered":"2023-10-08T17:43:22.085119+0000","last_clean":"2023-10-08T17:43:22.085119+0000","last_became_active":"2023-10-08T17:43:21.052333+0000","last_became_peered":"2023-10-08T17:43:21.052333+0000","last_unstale":"2023-10-08T17:43:22.085119+0000","last_undegraded":"2023-10-08T17:43:22.085119+0000","last_fullsized":"2023-10-08T17:43:22.085119+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:31.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088143+0000","last_change":"2023-10-08T17:43:22.085189+0000","last_active":"2023-10-08T17:43:22.088143+0000","last_peered":"2023-10-08T17:43:22.088143+0000","last_clean":"2023-10-08T17:43:22.088143+0000","last_became_active":"2023-10-08T17:43:22.084949+0000","last_became_peered":"2023-10-08T17:43:22.084949+0000","last_unstale":"2023-10-08T17:43:22.088143+0000","last_undegraded":"2023-10-08T17:43:22.088143+0000","last_fullsized":"2023-10-08T17:43:22.088143+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:17:30.792920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091007+0000","last_change":"2023-10-08T17:43:21.059463+0000","last_active":"2023-10-08T17:43:22.091007+0000","last_peered":"2023-10-08T17:43:22.091007+0000","last_clean":"2023-10-08T17:43:22.091007+0000","last_became_active":"2023-10-08T17:43:21.058494+0000","last_became_peered":"2023-10-08T17:43:21.058494+0000","last_unstale":"2023-10-08T17:43:22.091007+0000","last_undegraded":"2023-10-08T17:43:22.091007+0000","last_fullsized":"2023-10-08T17:43:22.091007+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:04.798027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072780+0000","last_change":"2023-10-08T17:43:22.064525+0000","last_active":"2023-10-08T17:43:22.072780+0000","last_peered":"2023-10-08T17:43:22.072780+0000","last_clean":"2023-10-08T17:43:22.072780+0000","last_became_active":"2023-10-08T17:43:22.064206+0000","last_became_peered":"2023-10-08T17:43:22.064206+0000","last_unstale":"2023-10-08T17:43:22.072780+0000","last_undegraded":"2023-10-08T17:43:22.072780+0000","last_fullsized":"2023-10-08T17:43:22.072780+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:04.023007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.059523+0000","last_change":"2023-10-08T17:43:21.056558+0000","last_active":"2023-10-08T17:43:22.059523+0000","last_peered":"2023-10-08T17:43:22.059523+0000","last_clean":"2023-10-08T17:43:22.059523+0000","last_became_active":"2023-10-08T17:43:21.056173+0000","last_became_peered":"2023-10-08T17:43:21.056173+0000","last_unstale":"2023-10-08T17:43:22.059523+0000","last_undegraded":"2023-10-08T17:43:22.059523+0000","last_fullsized":"2023-10-08T17:43:22.059523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:46.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.070502+0000","last_change":"2023-10-08T17:43:22.067163+0000","last_active":"2023-10-08T17:43:22.070502+0000","last_peered":"2023-10-08T17:43:22.070502+0000","last_clean":"2023-10-08T17:43:22.070502+0000","last_became_active":"2023-10-08T17:43:22.066828+0000","last_became_peered":"2023-10-08T17:43:22.066828+0000","last_unstale":"2023-10-08T17:43:22.070502+0000","last_undegraded":"2023-10-08T17:43:22.070502+0000","last_fullsized":"2023-10-08T17:43:22.070502+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:06.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054699+0000","last_change":"2023-10-08T17:43:21.058359+0000","last_active":"2023-10-08T17:43:22.054699+0000","last_peered":"2023-10-08T17:43:22.054699+0000","last_clean":"2023-10-08T17:43:22.054699+0000","last_became_active":"2023-10-08T17:43:21.058098+0000","last_became_peered":"2023-10-08T17:43:21.058098+0000","last_unstale":"2023-10-08T17:43:22.054699+0000","last_undegraded":"2023-10-08T17:43:22.054699+0000","last_fullsized":"2023-10-08T17:43:22.054699+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:51:47.930688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083857+0000","last_change":"2023-10-08T17:43:22.081462+0000","last_active":"2023-10-08T17:43:22.083857+0000","last_peered":"2023-10-08T17:43:22.083857+0000","last_clean":"2023-10-08T17:43:22.083857+0000","last_became_active":"2023-10-08T17:43:22.081173+0000","last_became_peered":"2023-10-08T17:43:22.081173+0000","last_unstale":"2023-10-08T17:43:22.083857+0000","last_undegraded":"2023-10-08T17:43:22.083857+0000","last_fullsized":"2023-10-08T17:43:22.083857+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:19.664013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.063197+0000","last_change":"2023-10-08T17:43:21.055424+0000","last_active":"2023-10-08T17:43:22.063197+0000","last_peered":"2023-10-08T17:43:22.063197+0000","last_clean":"2023-10-08T17:43:22.063197+0000","last_became_active":"2023-10-08T17:43:21.055155+0000","last_became_peered":"2023-10-08T17:43:21.055155+0000","last_unstale":"2023-10-08T17:43:22.063197+0000","last_undegraded":"2023-10-08T17:43:22.063197+0000","last_fullsized":"2023-10-08T17:43:22.063197+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:05.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081946+0000","last_change":"2023-10-08T17:43:22.080480+0000","last_active":"2023-10-08T17:43:22.081946+0000","last_peered":"2023-10-08T17:43:22.081946+0000","last_clean":"2023-10-08T17:43:22.081946+0000","last_became_active":"2023-10-08T17:43:22.079933+0000","last_became_peered":"2023-10-08T17:43:22.079933+0000","last_unstale":"2023-10-08T17:43:22.081946+0000","last_undegraded":"2023-10-08T17:43:22.081946+0000","last_fullsized":"2023-10-08T17:43:22.081946+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.433384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"212'3","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085584+0000","last_change":"2023-10-08T17:43:21.063163+0000","last_active":"2023-10-08T17:43:22.085584+0000","last_peered":"2023-10-08T17:43:22.085584+0000","last_clean":"2023-10-08T17:43:22.085584+0000","last_became_active":"2023-10-08T17:43:21.062907+0000","last_became_peered":"2023-10-08T17:43:21.062907+0000","last_unstale":"2023-10-08T17:43:22.085584+0000","last_undegraded":"2023-10-08T17:43:22.085584+0000","last_fullsized":"2023-10-08T17:43:22.085584+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:43.260605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078274+0000","last_change":"2023-10-08T17:43:22.074913+0000","last_active":"2023-10-08T17:43:22.078274+0000","last_peered":"2023-10-08T17:43:22.078274+0000","last_clean":"2023-10-08T17:43:22.078274+0000","last_became_active":"2023-10-08T17:43:22.074654+0000","last_became_peered":"2023-10-08T17:43:22.074654+0000","last_unstale":"2023-10-08T17:43:22.078274+0000","last_undegraded":"2023-10-08T17:43:22.078274+0000","last_fullsized":"2023-10-08T17:43:22.078274+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.389657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"212'6","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.093033+0000","last_change":"2023-10-08T17:43:21.056551+0000","last_active":"2023-10-08T17:43:22.093033+0000","last_peered":"2023-10-08T17:43:22.093033+0000","last_clean":"2023-10-08T17:43:22.093033+0000","last_became_active":"2023-10-08T17:43:21.056287+0000","last_became_peered":"2023-10-08T17:43:21.056287+0000","last_unstale":"2023-10-08T17:43:22.093033+0000","last_undegraded":"2023-10-08T17:43:22.093033+0000","last_fullsized":"2023-10-08T17:43:22.093033+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:17.743040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073428+0000","last_change":"2023-10-08T17:43:22.068646+0000","last_active":"2023-10-08T17:43:22.073428+0000","last_peered":"2023-10-08T17:43:22.073428+0000","last_clean":"2023-10-08T17:43:22.073428+0000","last_became_active":"2023-10-08T17:43:22.068399+0000","last_became_peered":"2023-10-08T17:43:22.068399+0000","last_unstale":"2023-10-08T17:43:22.073428+0000","last_undegraded":"2023-10-08T17:43:22.073428+0000","last_fullsized":"2023-10-08T17:43:22.073428+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:44.265965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091205+0000","last_change":"2023-10-08T17:43:21.061644+0000","last_active":"2023-10-08T17:43:22.091205+0000","last_peered":"2023-10-08T17:43:22.091205+0000","last_clean":"2023-10-08T17:43:22.091205+0000","last_became_active":"2023-10-08T17:43:21.061356+0000","last_became_peered":"2023-10-08T17:43:21.061356+0000","last_unstale":"2023-10-08T17:43:22.091205+0000","last_undegraded":"2023-10-08T17:43:22.091205+0000","last_fullsized":"2023-10-08T17:43:22.091205+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:16.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062566+0000","last_change":"2023-10-08T17:43:22.060380+0000","last_active":"2023-10-08T17:43:22.062566+0000","last_peered":"2023-10-08T17:43:22.062566+0000","last_clean":"2023-10-08T17:43:22.062566+0000","last_became_active":"2023-10-08T17:43:22.060088+0000","last_became_peered":"2023-10-08T17:43:22.060088+0000","last_unstale":"2023-10-08T17:43:22.062566+0000","last_undegraded":"2023-10-08T17:43:22.062566+0000","last_fullsized":"2023-10-08T17:43:22.062566+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:57.065279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055296+0000","last_change":"2023-10-08T17:43:21.055859+0000","last_active":"2023-10-08T17:43:22.055296+0000","last_peered":"2023-10-08T17:43:22.055296+0000","last_clean":"2023-10-08T17:43:22.055296+0000","last_became_active":"2023-10-08T17:43:21.055541+0000","last_became_peered":"2023-10-08T17:43:21.055541+0000","last_unstale":"2023-10-08T17:43:22.055296+0000","last_undegraded":"2023-10-08T17:43:22.055296+0000","last_fullsized":"2023-10-08T17:43:22.055296+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078893+0000","last_change":"2023-10-08T17:43:22.078066+0000","last_active":"2023-10-08T17:43:22.078893+0000","last_peered":"2023-10-08T17:43:22.078893+0000","last_clean":"2023-10-08T17:43:22.078893+0000","last_became_active":"2023-10-08T17:43:22.077805+0000","last_became_peered":"2023-10-08T17:43:22.077805+0000","last_unstale":"2023-10-08T17:43:22.078893+0000","last_undegraded":"2023-10-08T17:43:22.078893+0000","last_fullsized":"2023-10-08T17:43:22.078893+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:36.699888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061525+0000","last_change":"2023-10-08T17:43:21.062303+0000","last_active":"2023-10-08T17:43:22.061525+0000","last_peered":"2023-10-08T17:43:22.061525+0000","last_clean":"2023-10-08T17:43:22.061525+0000","last_became_active":"2023-10-08T17:43:21.062014+0000","last_became_peered":"2023-10-08T17:43:21.062014+0000","last_unstale":"2023-10-08T17:43:22.061525+0000","last_undegraded":"2023-10-08T17:43:22.061525+0000","last_fullsized":"2023-10-08T17:43:22.061525+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:21.627199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.066326+0000","last_change":"2023-10-08T17:43:22.060371+0000","last_active":"2023-10-08T17:43:22.066326+0000","last_peered":"2023-10-08T17:43:22.066326+0000","last_clean":"2023-10-08T17:43:22.066326+0000","last_became_active":"2023-10-08T17:43:22.060108+0000","last_became_peered":"2023-10-08T17:43:22.060108+0000","last_unstale":"2023-10-08T17:43:22.066326+0000","last_undegraded":"2023-10-08T17:43:22.066326+0000","last_fullsized":"2023-10-08T17:43:22.066326+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:04.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"212'8","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091205+0000","last_change":"2023-10-08T17:43:21.061979+0000","last_active":"2023-10-08T17:43:22.091205+0000","last_peered":"2023-10-08T17:43:22.091205+0000","last_clean":"2023-10-08T17:43:22.091205+0000","last_became_active":"2023-10-08T17:43:21.061344+0000","last_became_peered":"2023-10-08T17:43:21.061344+0000","last_unstale":"2023-10-08T17:43:22.091205+0000","last_undegraded":"2023-10-08T17:43:22.091205+0000","last_fullsized":"2023-10-08T17:43:22.091205+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:04.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.066512+0000","last_change":"2023-10-08T17:43:22.059558+0000","last_active":"2023-10-08T17:43:22.066512+0000","last_peered":"2023-10-08T17:43:22.066512+0000","last_clean":"2023-10-08T17:43:22.066512+0000","last_became_active":"2023-10-08T17:43:22.059207+0000","last_became_peered":"2023-10-08T17:43:22.059207+0000","last_unstale":"2023-10-08T17:43:22.066512+0000","last_undegraded":"2023-10-08T17:43:22.066512+0000","last_fullsized":"2023-10-08T17:43:22.066512+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:01.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083894+0000","last_change":"2023-10-08T17:43:21.061147+0000","last_active":"2023-10-08T17:43:22.083894+0000","last_peered":"2023-10-08T17:43:22.083894+0000","last_clean":"2023-10-08T17:43:22.083894+0000","last_became_active":"2023-10-08T17:43:21.060894+0000","last_became_peered":"2023-10-08T17:43:21.060894+0000","last_unstale":"2023-10-08T17:43:22.083894+0000","last_undegraded":"2023-10-08T17:43:22.083894+0000","last_fullsized":"2023-10-08T17:43:22.083894+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:47.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083741+0000","last_change":"2023-10-08T17:43:22.082365+0000","last_active":"2023-10-08T17:43:22.083741+0000","last_peered":"2023-10-08T17:43:22.083741+0000","last_clean":"2023-10-08T17:43:22.083741+0000","last_became_active":"2023-10-08T17:43:22.081943+0000","last_became_peered":"2023-10-08T17:43:22.081943+0000","last_unstale":"2023-10-08T17:43:22.083741+0000","last_undegraded":"2023-10-08T17:43:22.083741+0000","last_fullsized":"2023-10-08T17:43:22.083741+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:34.581636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081902+0000","last_change":"2023-10-08T17:43:21.057032+0000","last_active":"2023-10-08T17:43:22.081902+0000","last_peered":"2023-10-08T17:43:22.081902+0000","last_clean":"2023-10-08T17:43:22.081902+0000","last_became_active":"2023-10-08T17:43:21.056768+0000","last_became_peered":"2023-10-08T17:43:21.056768+0000","last_unstale":"2023-10-08T17:43:22.081902+0000","last_undegraded":"2023-10-08T17:43:22.081902+0000","last_fullsized":"2023-10-08T17:43:22.081902+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:38:37.856763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085108+0000","last_change":"2023-10-08T17:43:22.084282+0000","last_active":"2023-10-08T17:43:22.085108+0000","last_peered":"2023-10-08T17:43:22.085108+0000","last_clean":"2023-10-08T17:43:22.085108+0000","last_became_active":"2023-10-08T17:43:22.083774+0000","last_became_peered":"2023-10-08T17:43:22.083774+0000","last_unstale":"2023-10-08T17:43:22.085108+0000","last_undegraded":"2023-10-08T17:43:22.085108+0000","last_fullsized":"2023-10-08T17:43:22.085108+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:46.461684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091194+0000","last_change":"2023-10-08T17:43:21.062348+0000","last_active":"2023-10-08T17:43:22.091194+0000","last_peered":"2023-10-08T17:43:22.091194+0000","last_clean":"2023-10-08T17:43:22.091194+0000","last_became_active":"2023-10-08T17:43:21.062083+0000","last_became_peered":"2023-10-08T17:43:21.062083+0000","last_unstale":"2023-10-08T17:43:22.091194+0000","last_undegraded":"2023-10-08T17:43:22.091194+0000","last_fullsized":"2023-10-08T17:43:22.091194+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:38.473827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088812+0000","last_change":"2023-10-08T17:43:22.087560+0000","last_active":"2023-10-08T17:43:22.088812+0000","last_peered":"2023-10-08T17:43:22.088812+0000","last_clean":"2023-10-08T17:43:22.088812+0000","last_became_active":"2023-10-08T17:43:22.087239+0000","last_became_peered":"2023-10-08T17:43:22.087239+0000","last_unstale":"2023-10-08T17:43:22.088812+0000","last_undegraded":"2023-10-08T17:43:22.088812+0000","last_fullsized":"2023-10-08T17:43:22.088812+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:45.457879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054401+0000","last_change":"2023-10-08T17:43:21.054128+0000","last_active":"2023-10-08T17:43:22.054401+0000","last_peered":"2023-10-08T17:43:22.054401+0000","last_clean":"2023-10-08T17:43:22.054401+0000","last_became_active":"2023-10-08T17:43:21.053816+0000","last_became_peered":"2023-10-08T17:43:21.053816+0000","last_unstale":"2023-10-08T17:43:22.054401+0000","last_undegraded":"2023-10-08T17:43:22.054401+0000","last_fullsized":"2023-10-08T17:43:22.054401+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:06.241775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080241+0000","last_change":"2023-10-08T17:43:22.074001+0000","last_active":"2023-10-08T17:43:22.080241+0000","last_peered":"2023-10-08T17:43:22.080241+0000","last_clean":"2023-10-08T17:43:22.080241+0000","last_became_active":"2023-10-08T17:43:22.073580+0000","last_became_peered":"2023-10-08T17:43:22.073580+0000","last_unstale":"2023-10-08T17:43:22.080241+0000","last_undegraded":"2023-10-08T17:43:22.080241+0000","last_fullsized":"2023-10-08T17:43:22.080241+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:38.764570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091510+0000","last_change":"2023-10-08T17:43:21.053602+0000","last_active":"2023-10-08T17:43:22.091510+0000","last_peered":"2023-10-08T17:43:22.091510+0000","last_clean":"2023-10-08T17:43:22.091510+0000","last_became_active":"2023-10-08T17:43:21.053292+0000","last_became_peered":"2023-10-08T17:43:21.053292+0000","last_unstale":"2023-10-08T17:43:22.091510+0000","last_undegraded":"2023-10-08T17:43:22.091510+0000","last_fullsized":"2023-10-08T17:43:22.091510+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:55.613353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073270+0000","last_change":"2023-10-08T17:43:22.066748+0000","last_active":"2023-10-08T17:43:22.073270+0000","last_peered":"2023-10-08T17:43:22.073270+0000","last_clean":"2023-10-08T17:43:22.073270+0000","last_became_active":"2023-10-08T17:43:22.066438+0000","last_became_peered":"2023-10-08T17:43:22.066438+0000","last_unstale":"2023-10-08T17:43:22.073270+0000","last_undegraded":"2023-10-08T17:43:22.073270+0000","last_fullsized":"2023-10-08T17:43:22.073270+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:24.606780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.065415+0000","last_change":"2023-10-08T17:43:21.055960+0000","last_active":"2023-10-08T17:43:22.065415+0000","last_peered":"2023-10-08T17:43:22.065415+0000","last_clean":"2023-10-08T17:43:22.065415+0000","last_became_active":"2023-10-08T17:43:21.055694+0000","last_became_peered":"2023-10-08T17:43:21.055694+0000","last_unstale":"2023-10-08T17:43:22.065415+0000","last_undegraded":"2023-10-08T17:43:22.065415+0000","last_fullsized":"2023-10-08T17:43:22.065415+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:39:52.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.068048+0000","last_change":"2023-10-08T17:43:22.063559+0000","last_active":"2023-10-08T17:43:22.068048+0000","last_peered":"2023-10-08T17:43:22.068048+0000","last_clean":"2023-10-08T17:43:22.068048+0000","last_became_active":"2023-10-08T17:43:22.062930+0000","last_became_peered":"2023-10-08T17:43:22.062930+0000","last_unstale":"2023-10-08T17:43:22.068048+0000","last_undegraded":"2023-10-08T17:43:22.068048+0000","last_fullsized":"2023-10-08T17:43:22.068048+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:22.226133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058329+0000","last_change":"2023-10-08T17:43:21.057532+0000","last_active":"2023-10-08T17:43:22.058329+0000","last_peered":"2023-10-08T17:43:22.058329+0000","last_clean":"2023-10-08T17:43:22.058329+0000","last_became_active":"2023-10-08T17:43:21.057275+0000","last_became_peered":"2023-10-08T17:43:21.057275+0000","last_unstale":"2023-10-08T17:43:22.058329+0000","last_undegraded":"2023-10-08T17:43:22.058329+0000","last_fullsized":"2023-10-08T17:43:22.058329+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:25.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.082085+0000","last_change":"2023-10-08T17:43:22.077652+0000","last_active":"2023-10-08T17:43:22.082085+0000","last_peered":"2023-10-08T17:43:22.082085+0000","last_clean":"2023-10-08T17:43:22.082085+0000","last_became_active":"2023-10-08T17:43:22.077367+0000","last_became_peered":"2023-10-08T17:43:22.077367+0000","last_unstale":"2023-10-08T17:43:22.082085+0000","last_undegraded":"2023-10-08T17:43:22.082085+0000","last_fullsized":"2023-10-08T17:43:22.082085+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:50.026820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061545+0000","last_change":"2023-10-08T17:43:21.059947+0000","last_active":"2023-10-08T17:43:22.061545+0000","last_peered":"2023-10-08T17:43:22.061545+0000","last_clean":"2023-10-08T17:43:22.061545+0000","last_became_active":"2023-10-08T17:43:21.059614+0000","last_became_peered":"2023-10-08T17:43:21.059614+0000","last_unstale":"2023-10-08T17:43:22.061545+0000","last_undegraded":"2023-10-08T17:43:22.061545+0000","last_fullsized":"2023-10-08T17:43:22.061545+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:16.048114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.076815+0000","last_change":"2023-10-08T17:43:22.071372+0000","last_active":"2023-10-08T17:43:22.076815+0000","last_peered":"2023-10-08T17:43:22.076815+0000","last_clean":"2023-10-08T17:43:22.076815+0000","last_became_active":"2023-10-08T17:43:22.071092+0000","last_became_peered":"2023-10-08T17:43:22.071092+0000","last_unstale":"2023-10-08T17:43:22.076815+0000","last_undegraded":"2023-10-08T17:43:22.076815+0000","last_fullsized":"2023-10-08T17:43:22.076815+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:29.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.086226+0000","last_change":"2023-10-08T17:43:21.062814+0000","last_active":"2023-10-08T17:43:22.086226+0000","last_peered":"2023-10-08T17:43:22.086226+0000","last_clean":"2023-10-08T17:43:22.086226+0000","last_became_active":"2023-10-08T17:43:21.062511+0000","last_became_peered":"2023-10-08T17:43:21.062511+0000","last_unstale":"2023-10-08T17:43:22.086226+0000","last_undegraded":"2023-10-08T17:43:22.086226+0000","last_fullsized":"2023-10-08T17:43:22.086226+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:43.720549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078336+0000","last_change":"2023-10-08T17:43:22.066505+0000","last_active":"2023-10-08T17:43:22.078336+0000","last_peered":"2023-10-08T17:43:22.078336+0000","last_clean":"2023-10-08T17:43:22.078336+0000","last_became_active":"2023-10-08T17:43:22.066190+0000","last_became_peered":"2023-10-08T17:43:22.066190+0000","last_unstale":"2023-10-08T17:43:22.078336+0000","last_undegraded":"2023-10-08T17:43:22.078336+0000","last_fullsized":"2023-10-08T17:43:22.078336+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:05.958188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055001+0000","last_change":"2023-10-08T17:43:21.065383+0000","last_active":"2023-10-08T17:43:22.055001+0000","last_peered":"2023-10-08T17:43:22.055001+0000","last_clean":"2023-10-08T17:43:22.055001+0000","last_became_active":"2023-10-08T17:43:21.064787+0000","last_became_peered":"2023-10-08T17:43:21.064787+0000","last_unstale":"2023-10-08T17:43:22.055001+0000","last_undegraded":"2023-10-08T17:43:22.055001+0000","last_fullsized":"2023-10-08T17:43:22.055001+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.074168+0000","last_change":"2023-10-08T17:43:22.069185+0000","last_active":"2023-10-08T17:43:22.074168+0000","last_peered":"2023-10-08T17:43:22.074168+0000","last_clean":"2023-10-08T17:43:22.074168+0000","last_became_active":"2023-10-08T17:43:22.068886+0000","last_became_peered":"2023-10-08T17:43:22.068886+0000","last_unstale":"2023-10-08T17:43:22.074168+0000","last_undegraded":"2023-10-08T17:43:22.074168+0000","last_fullsized":"2023-10-08T17:43:22.074168+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:26.656935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055505+0000","last_change":"2023-10-08T17:43:21.063921+0000","last_active":"2023-10-08T17:43:22.055505+0000","last_peered":"2023-10-08T17:43:22.055505+0000","last_clean":"2023-10-08T17:43:22.055505+0000","last_became_active":"2023-10-08T17:43:21.063628+0000","last_became_peered":"2023-10-08T17:43:21.063628+0000","last_unstale":"2023-10-08T17:43:22.055505+0000","last_undegraded":"2023-10-08T17:43:22.055505+0000","last_fullsized":"2023-10-08T17:43:22.055505+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.090946+0000","last_change":"2023-10-08T17:43:22.086575+0000","last_active":"2023-10-08T17:43:22.090946+0000","last_peered":"2023-10-08T17:43:22.090946+0000","last_clean":"2023-10-08T17:43:22.090946+0000","last_became_active":"2023-10-08T17:43:22.086098+0000","last_became_peered":"2023-10-08T17:43:22.086098+0000","last_unstale":"2023-10-08T17:43:22.090946+0000","last_undegraded":"2023-10-08T17:43:22.090946+0000","last_fullsized":"2023-10-08T17:43:22.090946+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:52.759665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062190+0000","last_change":"2023-10-08T17:43:21.057667+0000","last_active":"2023-10-08T17:43:22.062190+0000","last_peered":"2023-10-08T17:43:22.062190+0000","last_clean":"2023-10-08T17:43:22.062190+0000","last_became_active":"2023-10-08T17:43:21.057388+0000","last_became_peered":"2023-10-08T17:43:21.057388+0000","last_unstale":"2023-10-08T17:43:22.062190+0000","last_undegraded":"2023-10-08T17:43:22.062190+0000","last_fullsized":"2023-10-08T17:43:22.062190+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:55.974264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083044+0000","last_change":"2023-10-08T17:43:22.073397+0000","last_active":"2023-10-08T17:43:22.083044+0000","last_peered":"2023-10-08T17:43:22.083044+0000","last_clean":"2023-10-08T17:43:22.083044+0000","last_became_active":"2023-10-08T17:43:22.073069+0000","last_became_peered":"2023-10-08T17:43:22.073069+0000","last_unstale":"2023-10-08T17:43:22.083044+0000","last_undegraded":"2023-10-08T17:43:22.083044+0000","last_fullsized":"2023-10-08T17:43:22.083044+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:53.394749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061214+0000","last_change":"2023-10-08T17:43:21.062610+0000","last_active":"2023-10-08T17:43:22.061214+0000","last_peered":"2023-10-08T17:43:22.061214+0000","last_clean":"2023-10-08T17:43:22.061214+0000","last_became_active":"2023-10-08T17:43:21.062335+0000","last_became_peered":"2023-10-08T17:43:21.062335+0000","last_unstale":"2023-10-08T17:43:22.061214+0000","last_undegraded":"2023-10-08T17:43:22.061214+0000","last_fullsized":"2023-10-08T17:43:22.061214+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:32:35.559363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081267+0000","last_change":"2023-10-08T17:43:22.065027+0000","last_active":"2023-10-08T17:43:22.081267+0000","last_peered":"2023-10-08T17:43:22.081267+0000","last_clean":"2023-10-08T17:43:22.081267+0000","last_became_active":"2023-10-08T17:43:22.064767+0000","last_became_peered":"2023-10-08T17:43:22.064767+0000","last_unstale":"2023-10-08T17:43:22.081267+0000","last_undegraded":"2023-10-08T17:43:22.081267+0000","last_fullsized":"2023-10-08T17:43:22.081267+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.389657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062098+0000","last_change":"2023-10-08T17:43:21.061583+0000","last_active":"2023-10-08T17:43:22.062098+0000","last_peered":"2023-10-08T17:43:22.062098+0000","last_clean":"2023-10-08T17:43:22.062098+0000","last_became_active":"2023-10-08T17:43:21.061281+0000","last_became_peered":"2023-10-08T17:43:21.061281+0000","last_unstale":"2023-10-08T17:43:22.062098+0000","last_undegraded":"2023-10-08T17:43:22.062098+0000","last_fullsized":"2023-10-08T17:43:22.062098+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:11:28.821980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072533+0000","last_change":"2023-10-08T17:43:22.063759+0000","last_active":"2023-10-08T17:43:22.072533+0000","last_peered":"2023-10-08T17:43:22.072533+0000","last_clean":"2023-10-08T17:43:22.072533+0000","last_became_active":"2023-10-08T17:43:22.063294+0000","last_became_peered":"2023-10-08T17:43:22.063294+0000","last_unstale":"2023-10-08T17:43:22.072533+0000","last_undegraded":"2023-10-08T17:43:22.072533+0000","last_fullsized":"2023-10-08T17:43:22.072533+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:40.040705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054197+0000","last_change":"2023-10-08T17:43:21.058202+0000","last_active":"2023-10-08T17:43:22.054197+0000","last_peered":"2023-10-08T17:43:22.054197+0000","last_clean":"2023-10-08T17:43:22.054197+0000","last_became_active":"2023-10-08T17:43:21.057945+0000","last_became_peered":"2023-10-08T17:43:21.057945+0000","last_unstale":"2023-10-08T17:43:22.054197+0000","last_undegraded":"2023-10-08T17:43:22.054197+0000","last_fullsized":"2023-10-08T17:43:22.054197+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:24.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078901+0000","last_change":"2023-10-08T17:43:22.073358+0000","last_active":"2023-10-08T17:43:22.078901+0000","last_peered":"2023-10-08T17:43:22.078901+0000","last_clean":"2023-10-08T17:43:22.078901+0000","last_became_active":"2023-10-08T17:43:22.073060+0000","last_became_peered":"2023-10-08T17:43:22.073060+0000","last_unstale":"2023-10-08T17:43:22.078901+0000","last_undegraded":"2023-10-08T17:43:22.078901+0000","last_fullsized":"2023-10-08T17:43:22.078901+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:51:48.936049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058071+0000","last_change":"2023-10-08T17:43:21.053571+0000","last_active":"2023-10-08T17:43:22.058071+0000","last_peered":"2023-10-08T17:43:22.058071+0000","last_clean":"2023-10-08T17:43:22.058071+0000","last_became_active":"2023-10-08T17:43:21.053280+0000","last_became_peered":"2023-10-08T17:43:21.053280+0000","last_unstale":"2023-10-08T17:43:22.058071+0000","last_undegraded":"2023-10-08T17:43:22.058071+0000","last_fullsized":"2023-10-08T17:43:22.058071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:45.456323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078109+0000","last_change":"2023-10-08T17:43:22.068746+0000","last_active":"2023-10-08T17:43:22.078109+0000","last_peered":"2023-10-08T17:43:22.078109+0000","last_clean":"2023-10-08T17:43:22.078109+0000","last_became_active":"2023-10-08T17:43:22.068419+0000","last_became_peered":"2023-10-08T17:43:22.068419+0000","last_unstale":"2023-10-08T17:43:22.078109+0000","last_undegraded":"2023-10-08T17:43:22.078109+0000","last_fullsized":"2023-10-08T17:43:22.078109+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:53.394749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058837+0000","last_change":"2023-10-08T17:43:21.055306+0000","last_active":"2023-10-08T17:43:22.058837+0000","last_peered":"2023-10-08T17:43:22.058837+0000","last_clean":"2023-10-08T17:43:22.058837+0000","last_became_active":"2023-10-08T17:43:21.054997+0000","last_became_peered":"2023-10-08T17:43:21.054997+0000","last_unstale":"2023-10-08T17:43:22.058837+0000","last_undegraded":"2023-10-08T17:43:22.058837+0000","last_fullsized":"2023-10-08T17:43:22.058837+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:36.428023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"202'348","reported_seq":1156,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058760+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:22.058760+0000","last_peered":"2023-10-08T17:43:22.058760+0000","last_clean":"2023-10-08T17:43:22.058760+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:22.058760+0000","last_undegraded":"2023-10-08T17:43:22.058760+0000","last_fullsized":"2023-10-08T17:43:22.058760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304576,"kb_used_data":3192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067264,"statfs":{"total":96636764160,"available":96324878336,"internally_reserved":0,"allocated":3268608,"data_stored":1934883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.98399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.624},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.53900000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303988,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067852,"statfs":{"total":96636764160,"available":96325480448,"internally_reserved":0,"allocated":2666496,"data_stored":1344411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.84799999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.76900000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.878},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.621},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.748}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575963,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308096,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063744,"statfs":{"total":96636764160,"available":96321273856,"internally_reserved":0,"allocated":2678784,"data_stored":1345947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68400000000000005,"5min":0.71399999999999997,"15min":0.91400000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":1.0649999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63600000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.84099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433}]},{"osd":3,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.76000000000000001,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80600000000000005,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95599999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":1.141,"15min":1.2370000000000001},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.196},"last":1.04},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":1.056,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.008,"5min":1.28,"15min":1.304},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.995,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.075,"5min":1.1200000000000001,"15min":1.25},"last":1.056},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.878,"15min":0.89900000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.62},"max":{"1min":1.0349999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.89700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308668,"kb_used_data":3188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063172,"statfs":{"total":96636764160,"available":96320688128,"internally_reserved":0,"allocated":3264512,"data_stored":1934801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1345077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65300000000000002,"5min":0.89500000000000002,"15min":1.032},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.751,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.434}]},{"osd":3,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.85299999999999998,"15min":1.327},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79000000000000004,"5min":0.93799999999999994,"15min":1.5009999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0620000000000001,"5min":1.157,"15min":1.3520000000000001},"last":0.62},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.149,"15min":1.2749999999999999},"last":0.753}]},{"osd":5,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.442},"max":{"1min":1.038,"5min":1.25,"15min":1.3440000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0109999999999999,"5min":1.1859999999999999,"15min":1.375},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0369999999999999,"5min":1.117,"15min":1.4319999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":1.069,"5min":1.2010000000000001,"15min":1.5429999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.873,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.476},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.89800000000000002},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.125,"15min":1.431},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575964,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1344605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.433}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.75}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308100,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063740,"statfs":{"total":96636764160,"available":96321269760,"internally_reserved":0,"allocated":2682880,"data_stored":1346501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.747}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.68899999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":0.80400000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":0.77900000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":0.88600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303988,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067852,"statfs":{"total":96636764160,"available":96325480448,"internally_reserved":0,"allocated":2666496,"data_stored":1344411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.752},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.48899999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.877}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.80600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:31.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:31.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.559+0000 7f8e2519d700 1 Processor -- start 2023-10-08T17:43:31.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.559+0000 7f8e2519d700 1 -- start start 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e2519d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8e20142c00 0x7f8e2006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e2519d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2006bd20 0x7f8e200c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e2519d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200ca480 con 0x7f8e20142fd0 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e2519d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2015e240 con 0x7f8e2006bd20 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e2519d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2006b350 con 0x7f8e20142c00 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2006bd20 0x7f8e200c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e1f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f8e2006bd20 0x7f8e200c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50762/0 (socket says 172.21.15.12:50762) 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.560+0000 7f8e1f7fe700 1 -- 172.21.15.12:0/3333895329 learned_addr learned my addr 172.21.15.12:0/3333895329 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1ffff700 1 --2- 172.21.15.12:0/3333895329 >> v2:172.21.15.29:3300/0 conn(0x7f8e20142c00 0x7f8e2006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:31.561 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1f7fe700 1 -- 172.21.15.12:0/3333895329 >> v2:172.21.15.29:3300/0 conn(0x7f8e20142c00 msgr2=0x7f8e2006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:31.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1f7fe700 1 --2- 172.21.15.12:0/3333895329 >> v2:172.21.15.29:3300/0 conn(0x7f8e20142c00 0x7f8e2006b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1f7fe700 1 -- 172.21.15.12:0/3333895329 >> v1:172.21.15.29:6789/0 conn(0x7f8e20142fd0 legacy=0x7f8e2006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:31.562 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1f7fe700 1 -- 172.21.15.12:0/3333895329 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2015df60 con 0x7f8e2006bd20 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1f7fe700 1 --2- 172.21.15.12:0/3333895329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e200c7880 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006f490 tx=0x7f8e14009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264e34981785a687 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.561+0000 7f8e1effd700 1 -- 172.21.15.12:0/3333895329 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400b860 con 0x7f8e2006bd20 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e1effd700 1 -- 172.21.15.12:0/3333895329 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400b9c0 con 0x7f8e2006bd20 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e1effd700 1 -- 172.21.15.12:0/3333895329 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400bd60 con 0x7f8e2006bd20 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 -- 172.21.15.12:0/3333895329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 msgr2=0x7f8e200c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 --2- 172.21.15.12:0/3333895329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e200c7880 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006f490 tx=0x7f8e14009250 comp rx=0 tx=0).stop 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 -- 172.21.15.12:0/3333895329 shutdown_connections 2023-10-08T17:43:31.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 --2- 172.21.15.12:0/3333895329 >> v2:172.21.15.29:3300/0 conn(0x7f8e20142c00 0x7f8e2006b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 --2- 172.21.15.12:0/3333895329 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e200c7880 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 -- 172.21.15.12:0/3333895329 >> 172.21.15.12:0/3333895329 conn(0x7f8e200675a0 msgr2=0x7f8e200679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 -- 172.21.15.12:0/3333895329 shutdown_connections 2023-10-08T17:43:31.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.562+0000 7f8e2519d700 1 -- 172.21.15.12:0/3333895329 wait complete. 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.564+0000 7f8e2519d700 1 Processor -- start 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.564+0000 7f8e2519d700 1 -- start start 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e20142c00 0x7f8e200b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e20142fd0 0x7f8e201401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20169ae0 con 0x7f8e2006bd20 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2013ee00 con 0x7f8e20142c00 2023-10-08T17:43:31.566 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e2519d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200c4660 con 0x7f8e20142fd0 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50774/0 (socket says 172.21.15.12:50774) 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 -- 172.21.15.12:0/4175404101 learned_addr learned my addr 172.21.15.12:0/4175404101 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 -- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e20142fd0 msgr2=0x7f8e201401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e20142fd0 0x7f8e201401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 -- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e20142c00 msgr2=0x7f8e200b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1f7fe700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e20142c00 0x7f8e200b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e20142c00 0x7f8e200b18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.565+0000 7f8e1ffff700 1 -- 172.21.15.12:0/4175404101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e140094f0 con 0x7f8e2006bd20 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e1ffff700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000d890 tx=0x7f8e10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:31.567 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100125f0 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10012770 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10012b30 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e200c4940 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.566+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e200c4f00 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.567+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2004c3c0 con 0x7f8e2006bd20 2023-10-08T17:43:31.568 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.568+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e1001e460 con 0x7f8e2006bd20 2023-10-08T17:43:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.569+0000 7f8e07fff700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 0x7f8e0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.569+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f8e10084f00 con 0x7f8e2006bd20 2023-10-08T17:43:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.569+0000 7f8e1f7fe700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 0x7f8e0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:31.569 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.570+0000 7f8e1f7fe700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 0x7f8e0c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006f490 tx=0x7f8e14017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:31.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.573+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e10051ec0 con 0x7f8e2006bd20 2023-10-08T17:43:31.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.770+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e2006ad00 con 0x7f8e0c066f30 2023-10-08T17:43:31.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.779+0000 7f8e07fff700 1 -- 172.21.15.12:0/4175404101 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289312 (secure 0 0 0) 0x7f8e2006ad00 con 0x7f8e0c066f30 2023-10-08T17:43:31.783 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.783+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 msgr2=0x7f8e0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.783+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 0x7f8e0c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e2006f490 tx=0x7f8e14017000 comp rx=0 tx=0).stop 2023-10-08T17:43:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.783+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 msgr2=0x7f8e2013e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:31.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.783+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f8e1000d890 tx=0x7f8e10008040 comp rx=0 tx=0).stop 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 shutdown_connections 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8e0c066f30 0x7f8e0c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8e2006bd20 0x7f8e2013e8c0 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8e20142fd0 0x7f8e201401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 --2- 172.21.15.12:0/4175404101 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8e20142c00 0x7f8e200b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 >> 172.21.15.12:0/4175404101 conn(0x7f8e200675a0 msgr2=0x7f8e200c2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 shutdown_connections 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:31.784+0000 7f8e2519d700 1 -- 172.21.15.12:0/4175404101 wait complete. 2023-10-08T17:43:31.786 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:31.801 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-10-08T17:43:30.004284+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":623,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":386,"ondisk_log_size":386,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461800,"kb_used_data":22056,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512920,"statfs":{"total":773094113280,"available":770573230080,"internally_reserved":0,"allocated":22585344,"data_stored":11940636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001686"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083243+0000","last_change":"2023-10-08T17:43:22.078252+0000","last_active":"2023-10-08T17:43:22.083243+0000","last_peered":"2023-10-08T17:43:22.083243+0000","last_clean":"2023-10-08T17:43:22.083243+0000","last_became_active":"2023-10-08T17:43:22.077986+0000","last_became_peered":"2023-10-08T17:43:22.077986+0000","last_unstale":"2023-10-08T17:43:22.083243+0000","last_undegraded":"2023-10-08T17:43:22.083243+0000","last_fullsized":"2023-10-08T17:43:22.083243+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:45.048739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072180+0000","last_change":"2023-10-08T17:43:22.069022+0000","last_active":"2023-10-08T17:43:22.072180+0000","last_peered":"2023-10-08T17:43:22.072180+0000","last_clean":"2023-10-08T17:43:22.072180+0000","last_became_active":"2023-10-08T17:43:22.068467+0000","last_became_peered":"2023-10-08T17:43:22.068467+0000","last_unstale":"2023-10-08T17:43:22.072180+0000","last_undegraded":"2023-10-08T17:43:22.072180+0000","last_fullsized":"2023-10-08T17:43:22.072180+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:30.262166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077770+0000","last_change":"2023-10-08T17:43:22.074050+0000","last_active":"2023-10-08T17:43:22.077770+0000","last_peered":"2023-10-08T17:43:22.077770+0000","last_clean":"2023-10-08T17:43:22.077770+0000","last_became_active":"2023-10-08T17:43:22.073775+0000","last_became_peered":"2023-10-08T17:43:22.073775+0000","last_unstale":"2023-10-08T17:43:22.077770+0000","last_undegraded":"2023-10-08T17:43:22.077770+0000","last_fullsized":"2023-10-08T17:43:22.077770+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:47.273419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072360+0000","last_change":"2023-10-08T17:43:22.067894+0000","last_active":"2023-10-08T17:43:22.072360+0000","last_peered":"2023-10-08T17:43:22.072360+0000","last_clean":"2023-10-08T17:43:22.072360+0000","last_became_active":"2023-10-08T17:43:22.067617+0000","last_became_peered":"2023-10-08T17:43:22.067617+0000","last_unstale":"2023-10-08T17:43:22.072360+0000","last_undegraded":"2023-10-08T17:43:22.072360+0000","last_fullsized":"2023-10-08T17:43:22.072360+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:58.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085670+0000","last_change":"2023-10-08T17:43:22.080557+0000","last_active":"2023-10-08T17:43:22.085670+0000","last_peered":"2023-10-08T17:43:22.085670+0000","last_clean":"2023-10-08T17:43:22.085670+0000","last_became_active":"2023-10-08T17:43:22.080067+0000","last_became_peered":"2023-10-08T17:43:22.080067+0000","last_unstale":"2023-10-08T17:43:22.085670+0000","last_undegraded":"2023-10-08T17:43:22.085670+0000","last_fullsized":"2023-10-08T17:43:22.085670+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:35.096095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.064637+0000","last_change":"2023-10-08T17:43:22.062061+0000","last_active":"2023-10-08T17:43:22.064637+0000","last_peered":"2023-10-08T17:43:22.064637+0000","last_clean":"2023-10-08T17:43:22.064637+0000","last_became_active":"2023-10-08T17:43:22.061793+0000","last_became_peered":"2023-10-08T17:43:22.061793+0000","last_unstale":"2023-10-08T17:43:22.064637+0000","last_undegraded":"2023-10-08T17:43:22.064637+0000","last_fullsized":"2023-10-08T17:43:22.064637+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:12:28.205459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.070385+0000","last_change":"2023-10-08T17:43:22.063419+0000","last_active":"2023-10-08T17:43:22.070385+0000","last_peered":"2023-10-08T17:43:22.070385+0000","last_clean":"2023-10-08T17:43:22.070385+0000","last_became_active":"2023-10-08T17:43:22.063124+0000","last_became_peered":"2023-10-08T17:43:22.063124+0000","last_unstale":"2023-10-08T17:43:22.070385+0000","last_undegraded":"2023-10-08T17:43:22.070385+0000","last_fullsized":"2023-10-08T17:43:22.070385+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:25:58.114736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077791+0000","last_change":"2023-10-08T17:43:22.074046+0000","last_active":"2023-10-08T17:43:22.077791+0000","last_peered":"2023-10-08T17:43:22.077791+0000","last_clean":"2023-10-08T17:43:22.077791+0000","last_became_active":"2023-10-08T17:43:22.073747+0000","last_became_peered":"2023-10-08T17:43:22.073747+0000","last_unstale":"2023-10-08T17:43:22.077791+0000","last_undegraded":"2023-10-08T17:43:22.077791+0000","last_fullsized":"2023-10-08T17:43:22.077791+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:48:58.329404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078860+0000","last_change":"2023-10-08T17:43:22.077433+0000","last_active":"2023-10-08T17:43:22.078860+0000","last_peered":"2023-10-08T17:43:22.078860+0000","last_clean":"2023-10-08T17:43:22.078860+0000","last_became_active":"2023-10-08T17:43:22.077128+0000","last_became_peered":"2023-10-08T17:43:22.077128+0000","last_unstale":"2023-10-08T17:43:22.078860+0000","last_undegraded":"2023-10-08T17:43:22.078860+0000","last_fullsized":"2023-10-08T17:43:22.078860+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:49.754159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.075410+0000","last_change":"2023-10-08T17:43:22.061333+0000","last_active":"2023-10-08T17:43:22.075410+0000","last_peered":"2023-10-08T17:43:22.075410+0000","last_clean":"2023-10-08T17:43:22.075410+0000","last_became_active":"2023-10-08T17:43:22.060960+0000","last_became_peered":"2023-10-08T17:43:22.060960+0000","last_unstale":"2023-10-08T17:43:22.075410+0000","last_undegraded":"2023-10-08T17:43:22.075410+0000","last_fullsized":"2023-10-08T17:43:22.075410+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:09:37.048582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072705+0000","last_change":"2023-10-08T17:43:22.064486+0000","last_active":"2023-10-08T17:43:22.072705+0000","last_peered":"2023-10-08T17:43:22.072705+0000","last_clean":"2023-10-08T17:43:22.072705+0000","last_became_active":"2023-10-08T17:43:22.064216+0000","last_became_peered":"2023-10-08T17:43:22.064216+0000","last_unstale":"2023-10-08T17:43:22.072705+0000","last_undegraded":"2023-10-08T17:43:22.072705+0000","last_fullsized":"2023-10-08T17:43:22.072705+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:22.226133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072324+0000","last_change":"2023-10-08T17:43:22.064774+0000","last_active":"2023-10-08T17:43:22.072324+0000","last_peered":"2023-10-08T17:43:22.072324+0000","last_clean":"2023-10-08T17:43:22.072324+0000","last_became_active":"2023-10-08T17:43:22.064521+0000","last_became_peered":"2023-10-08T17:43:22.064521+0000","last_unstale":"2023-10-08T17:43:22.072324+0000","last_undegraded":"2023-10-08T17:43:22.072324+0000","last_fullsized":"2023-10-08T17:43:22.072324+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:57.065279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.067994+0000","last_change":"2023-10-08T17:43:22.060652+0000","last_active":"2023-10-08T17:43:22.067994+0000","last_peered":"2023-10-08T17:43:22.067994+0000","last_clean":"2023-10-08T17:43:22.067994+0000","last_became_active":"2023-10-08T17:43:22.059994+0000","last_became_peered":"2023-10-08T17:43:22.059994+0000","last_unstale":"2023-10-08T17:43:22.067994+0000","last_undegraded":"2023-10-08T17:43:22.067994+0000","last_fullsized":"2023-10-08T17:43:22.067994+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:00:55.013643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083412+0000","last_change":"2023-10-08T17:43:22.082255+0000","last_active":"2023-10-08T17:43:22.083412+0000","last_peered":"2023-10-08T17:43:22.083412+0000","last_clean":"2023-10-08T17:43:22.083412+0000","last_became_active":"2023-10-08T17:43:22.081987+0000","last_became_peered":"2023-10-08T17:43:22.081987+0000","last_unstale":"2023-10-08T17:43:22.083412+0000","last_undegraded":"2023-10-08T17:43:22.083412+0000","last_fullsized":"2023-10-08T17:43:22.083412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:13.208840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.067845+0000","last_change":"2023-10-08T17:43:22.059287+0000","last_active":"2023-10-08T17:43:22.067845+0000","last_peered":"2023-10-08T17:43:22.067845+0000","last_clean":"2023-10-08T17:43:22.067845+0000","last_became_active":"2023-10-08T17:43:22.059028+0000","last_became_peered":"2023-10-08T17:43:22.059028+0000","last_unstale":"2023-10-08T17:43:22.067845+0000","last_undegraded":"2023-10-08T17:43:22.067845+0000","last_fullsized":"2023-10-08T17:43:22.067845+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:24.606780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088054+0000","last_change":"2023-10-08T17:43:22.084411+0000","last_active":"2023-10-08T17:43:22.088054+0000","last_peered":"2023-10-08T17:43:22.088054+0000","last_clean":"2023-10-08T17:43:22.088054+0000","last_became_active":"2023-10-08T17:43:22.084141+0000","last_became_peered":"2023-10-08T17:43:22.084141+0000","last_unstale":"2023-10-08T17:43:22.088054+0000","last_undegraded":"2023-10-08T17:43:22.088054+0000","last_fullsized":"2023-10-08T17:43:22.088054+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:41:09.104637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.077531+0000","last_change":"2023-10-08T17:43:22.071275+0000","last_active":"2023-10-08T17:43:22.077531+0000","last_peered":"2023-10-08T17:43:22.077531+0000","last_clean":"2023-10-08T17:43:22.077531+0000","last_became_active":"2023-10-08T17:43:22.070867+0000","last_became_peered":"2023-10-08T17:43:22.070867+0000","last_unstale":"2023-10-08T17:43:22.077531+0000","last_undegraded":"2023-10-08T17:43:22.077531+0000","last_fullsized":"2023-10-08T17:43:22.077531+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:31.327999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083127+0000","last_change":"2023-10-08T17:43:22.075626+0000","last_active":"2023-10-08T17:43:22.083127+0000","last_peered":"2023-10-08T17:43:22.083127+0000","last_clean":"2023-10-08T17:43:22.083127+0000","last_became_active":"2023-10-08T17:43:22.075343+0000","last_became_peered":"2023-10-08T17:43:22.075343+0000","last_unstale":"2023-10-08T17:43:22.083127+0000","last_undegraded":"2023-10-08T17:43:22.083127+0000","last_fullsized":"2023-10-08T17:43:22.083127+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:04.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078573+0000","last_change":"2023-10-08T17:43:22.075500+0000","last_active":"2023-10-08T17:43:22.078573+0000","last_peered":"2023-10-08T17:43:22.078573+0000","last_clean":"2023-10-08T17:43:22.078573+0000","last_became_active":"2023-10-08T17:43:22.075245+0000","last_became_peered":"2023-10-08T17:43:22.075245+0000","last_unstale":"2023-10-08T17:43:22.078573+0000","last_undegraded":"2023-10-08T17:43:22.078573+0000","last_fullsized":"2023-10-08T17:43:22.078573+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:32:45.048739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078934+0000","last_change":"2023-10-08T17:43:22.074451+0000","last_active":"2023-10-08T17:43:22.078934+0000","last_peered":"2023-10-08T17:43:22.078934+0000","last_clean":"2023-10-08T17:43:22.078934+0000","last_became_active":"2023-10-08T17:43:22.074084+0000","last_became_peered":"2023-10-08T17:43:22.074084+0000","last_unstale":"2023-10-08T17:43:22.078934+0000","last_undegraded":"2023-10-08T17:43:22.078934+0000","last_fullsized":"2023-10-08T17:43:22.078934+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:07.247136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085651+0000","last_change":"2023-10-08T17:43:22.080313+0000","last_active":"2023-10-08T17:43:22.085651+0000","last_peered":"2023-10-08T17:43:22.085651+0000","last_clean":"2023-10-08T17:43:22.085651+0000","last_became_active":"2023-10-08T17:43:22.079755+0000","last_became_peered":"2023-10-08T17:43:22.079755+0000","last_unstale":"2023-10-08T17:43:22.085651+0000","last_undegraded":"2023-10-08T17:43:22.085651+0000","last_fullsized":"2023-10-08T17:43:22.085651+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:31:53.791357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080191+0000","last_change":"2023-10-08T17:43:22.067719+0000","last_active":"2023-10-08T17:43:22.080191+0000","last_peered":"2023-10-08T17:43:22.080191+0000","last_clean":"2023-10-08T17:43:22.080191+0000","last_became_active":"2023-10-08T17:43:22.067468+0000","last_became_peered":"2023-10-08T17:43:22.067468+0000","last_unstale":"2023-10-08T17:43:22.080191+0000","last_undegraded":"2023-10-08T17:43:22.080191+0000","last_fullsized":"2023-10-08T17:43:22.080191+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:53:15.464522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.075141+0000","last_change":"2023-10-08T17:43:22.072322+0000","last_active":"2023-10-08T17:43:22.075141+0000","last_peered":"2023-10-08T17:43:22.075141+0000","last_clean":"2023-10-08T17:43:22.075141+0000","last_became_active":"2023-10-08T17:43:22.071981+0000","last_became_peered":"2023-10-08T17:43:22.071981+0000","last_unstale":"2023-10-08T17:43:22.075141+0000","last_undegraded":"2023-10-08T17:43:22.075141+0000","last_fullsized":"2023-10-08T17:43:22.075141+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:55:22.083718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073927+0000","last_change":"2023-10-08T17:43:22.070207+0000","last_active":"2023-10-08T17:43:22.073927+0000","last_peered":"2023-10-08T17:43:22.073927+0000","last_clean":"2023-10-08T17:43:22.073927+0000","last_became_active":"2023-10-08T17:43:22.069909+0000","last_became_peered":"2023-10-08T17:43:22.069909+0000","last_unstale":"2023-10-08T17:43:22.073927+0000","last_undegraded":"2023-10-08T17:43:22.073927+0000","last_fullsized":"2023-10-08T17:43:22.073927+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:51:14.778578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072412+0000","last_change":"2023-10-08T17:43:22.064182+0000","last_active":"2023-10-08T17:43:22.072412+0000","last_peered":"2023-10-08T17:43:22.072412+0000","last_clean":"2023-10-08T17:43:22.072412+0000","last_became_active":"2023-10-08T17:43:22.063912+0000","last_became_peered":"2023-10-08T17:43:22.063912+0000","last_unstale":"2023-10-08T17:43:22.072412+0000","last_undegraded":"2023-10-08T17:43:22.072412+0000","last_fullsized":"2023-10-08T17:43:22.072412+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.433384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062408+0000","last_change":"2023-10-08T17:43:22.060871+0000","last_active":"2023-10-08T17:43:22.062408+0000","last_peered":"2023-10-08T17:43:22.062408+0000","last_clean":"2023-10-08T17:43:22.062408+0000","last_became_active":"2023-10-08T17:43:22.060276+0000","last_became_peered":"2023-10-08T17:43:22.060276+0000","last_unstale":"2023-10-08T17:43:22.062408+0000","last_undegraded":"2023-10-08T17:43:22.062408+0000","last_fullsized":"2023-10-08T17:43:22.062408+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:53:30.262166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.064620+0000","last_change":"2023-10-08T17:43:22.062906+0000","last_active":"2023-10-08T17:43:22.064620+0000","last_peered":"2023-10-08T17:43:22.064620+0000","last_clean":"2023-10-08T17:43:22.064620+0000","last_became_active":"2023-10-08T17:43:22.062651+0000","last_became_peered":"2023-10-08T17:43:22.062651+0000","last_unstale":"2023-10-08T17:43:22.064620+0000","last_undegraded":"2023-10-08T17:43:22.064620+0000","last_fullsized":"2023-10-08T17:43:22.064620+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:39:53.492759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.082143+0000","last_change":"2023-10-08T17:43:22.078710+0000","last_active":"2023-10-08T17:43:22.082143+0000","last_peered":"2023-10-08T17:43:22.082143+0000","last_clean":"2023-10-08T17:43:22.082143+0000","last_became_active":"2023-10-08T17:43:22.078462+0000","last_became_peered":"2023-10-08T17:43:22.078462+0000","last_unstale":"2023-10-08T17:43:22.082143+0000","last_undegraded":"2023-10-08T17:43:22.082143+0000","last_fullsized":"2023-10-08T17:43:22.082143+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:15.072537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.068015+0000","last_change":"2023-10-08T17:43:22.060821+0000","last_active":"2023-10-08T17:43:22.068015+0000","last_peered":"2023-10-08T17:43:22.068015+0000","last_clean":"2023-10-08T17:43:22.068015+0000","last_became_active":"2023-10-08T17:43:22.060379+0000","last_became_peered":"2023-10-08T17:43:22.060379+0000","last_unstale":"2023-10-08T17:43:22.068015+0000","last_undegraded":"2023-10-08T17:43:22.068015+0000","last_fullsized":"2023-10-08T17:43:22.068015+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:04.023007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084754+0000","last_change":"2023-10-08T17:43:22.083753+0000","last_active":"2023-10-08T17:43:22.084754+0000","last_peered":"2023-10-08T17:43:22.084754+0000","last_clean":"2023-10-08T17:43:22.084754+0000","last_became_active":"2023-10-08T17:43:22.083390+0000","last_became_peered":"2023-10-08T17:43:22.083390+0000","last_unstale":"2023-10-08T17:43:22.084754+0000","last_undegraded":"2023-10-08T17:43:22.084754+0000","last_fullsized":"2023-10-08T17:43:22.084754+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:26.991538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.079676+0000","last_change":"2023-10-08T17:43:22.075325+0000","last_active":"2023-10-08T17:43:22.079676+0000","last_peered":"2023-10-08T17:43:22.079676+0000","last_clean":"2023-10-08T17:43:22.079676+0000","last_became_active":"2023-10-08T17:43:22.074725+0000","last_became_peered":"2023-10-08T17:43:22.074725+0000","last_unstale":"2023-10-08T17:43:22.079676+0000","last_undegraded":"2023-10-08T17:43:22.079676+0000","last_fullsized":"2023-10-08T17:43:22.079676+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:48.246731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081858+0000","last_change":"2023-10-08T17:43:22.075935+0000","last_active":"2023-10-08T17:43:22.081858+0000","last_peered":"2023-10-08T17:43:22.081858+0000","last_clean":"2023-10-08T17:43:22.081858+0000","last_became_active":"2023-10-08T17:43:22.075660+0000","last_became_peered":"2023-10-08T17:43:22.075660+0000","last_unstale":"2023-10-08T17:43:22.081858+0000","last_undegraded":"2023-10-08T17:43:22.081858+0000","last_fullsized":"2023-10-08T17:43:22.081858+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T17:45:13.351555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.090982+0000","last_change":"2023-10-08T17:43:22.087475+0000","last_active":"2023-10-08T17:43:22.090982+0000","last_peered":"2023-10-08T17:43:22.090982+0000","last_clean":"2023-10-08T17:43:22.090982+0000","last_became_active":"2023-10-08T17:43:22.087194+0000","last_became_peered":"2023-10-08T17:43:22.087194+0000","last_unstale":"2023-10-08T17:43:22.090982+0000","last_undegraded":"2023-10-08T17:43:22.090982+0000","last_fullsized":"2023-10-08T17:43:22.090982+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:17:31.677556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"212'4","reported_seq":14,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085477+0000","last_change":"2023-10-08T17:43:21.055887+0000","last_active":"2023-10-08T17:43:22.085477+0000","last_peered":"2023-10-08T17:43:22.085477+0000","last_clean":"2023-10-08T17:43:22.085477+0000","last_became_active":"2023-10-08T17:43:21.055585+0000","last_became_peered":"2023-10-08T17:43:21.055585+0000","last_unstale":"2023-10-08T17:43:22.085477+0000","last_undegraded":"2023-10-08T17:43:22.085477+0000","last_fullsized":"2023-10-08T17:43:22.085477+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:12:46.268058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078364+0000","last_change":"2023-10-08T17:43:22.070067+0000","last_active":"2023-10-08T17:43:22.078364+0000","last_peered":"2023-10-08T17:43:22.078364+0000","last_clean":"2023-10-08T17:43:22.078364+0000","last_became_active":"2023-10-08T17:43:22.069777+0000","last_became_peered":"2023-10-08T17:43:22.069777+0000","last_unstale":"2023-10-08T17:43:22.078364+0000","last_undegraded":"2023-10-08T17:43:22.078364+0000","last_fullsized":"2023-10-08T17:43:22.078364+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:47:33.047803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084782+0000","last_change":"2023-10-08T17:43:21.057453+0000","last_active":"2023-10-08T17:43:22.084782+0000","last_peered":"2023-10-08T17:43:22.084782+0000","last_clean":"2023-10-08T17:43:22.084782+0000","last_became_active":"2023-10-08T17:43:21.057187+0000","last_became_peered":"2023-10-08T17:43:21.057187+0000","last_unstale":"2023-10-08T17:43:22.084782+0000","last_undegraded":"2023-10-08T17:43:22.084782+0000","last_fullsized":"2023-10-08T17:43:22.084782+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:53:00.477775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073162+0000","last_change":"2023-10-08T17:43:22.070972+0000","last_active":"2023-10-08T17:43:22.073162+0000","last_peered":"2023-10-08T17:43:22.073162+0000","last_clean":"2023-10-08T17:43:22.073162+0000","last_became_active":"2023-10-08T17:43:22.070683+0000","last_became_peered":"2023-10-08T17:43:22.070683+0000","last_unstale":"2023-10-08T17:43:22.073162+0000","last_undegraded":"2023-10-08T17:43:22.073162+0000","last_fullsized":"2023-10-08T17:43:22.073162+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:45.457879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.089013+0000","last_change":"2023-10-08T17:43:21.058270+0000","last_active":"2023-10-08T17:43:22.089013+0000","last_peered":"2023-10-08T17:43:22.089013+0000","last_clean":"2023-10-08T17:43:22.089013+0000","last_became_active":"2023-10-08T17:43:21.058013+0000","last_became_peered":"2023-10-08T17:43:21.058013+0000","last_unstale":"2023-10-08T17:43:22.089013+0000","last_undegraded":"2023-10-08T17:43:22.089013+0000","last_fullsized":"2023-10-08T17:43:22.089013+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:55:12.203479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.079953+0000","last_change":"2023-10-08T17:43:22.079337+0000","last_active":"2023-10-08T17:43:22.079953+0000","last_peered":"2023-10-08T17:43:22.079953+0000","last_clean":"2023-10-08T17:43:22.079953+0000","last_became_active":"2023-10-08T17:43:22.078986+0000","last_became_peered":"2023-10-08T17:43:22.078986+0000","last_unstale":"2023-10-08T17:43:22.079953+0000","last_undegraded":"2023-10-08T17:43:22.079953+0000","last_fullsized":"2023-10-08T17:43:22.079953+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:01:51.599340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.084048+0000","last_change":"2023-10-08T17:43:21.053546+0000","last_active":"2023-10-08T17:43:22.084048+0000","last_peered":"2023-10-08T17:43:22.084048+0000","last_clean":"2023-10-08T17:43:22.084048+0000","last_became_active":"2023-10-08T17:43:21.052996+0000","last_became_peered":"2023-10-08T17:43:21.052996+0000","last_unstale":"2023-10-08T17:43:22.084048+0000","last_undegraded":"2023-10-08T17:43:22.084048+0000","last_fullsized":"2023-10-08T17:43:22.084048+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:13:14.067176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080212+0000","last_change":"2023-10-08T17:43:22.073843+0000","last_active":"2023-10-08T17:43:22.080212+0000","last_peered":"2023-10-08T17:43:22.080212+0000","last_clean":"2023-10-08T17:43:22.080212+0000","last_became_active":"2023-10-08T17:43:22.072964+0000","last_became_peered":"2023-10-08T17:43:22.072964+0000","last_unstale":"2023-10-08T17:43:22.080212+0000","last_undegraded":"2023-10-08T17:43:22.080212+0000","last_fullsized":"2023-10-08T17:43:22.080212+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:04:14.041318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085119+0000","last_change":"2023-10-08T17:43:21.052583+0000","last_active":"2023-10-08T17:43:22.085119+0000","last_peered":"2023-10-08T17:43:22.085119+0000","last_clean":"2023-10-08T17:43:22.085119+0000","last_became_active":"2023-10-08T17:43:21.052333+0000","last_became_peered":"2023-10-08T17:43:21.052333+0000","last_unstale":"2023-10-08T17:43:22.085119+0000","last_undegraded":"2023-10-08T17:43:22.085119+0000","last_fullsized":"2023-10-08T17:43:22.085119+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:03:31.710887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088143+0000","last_change":"2023-10-08T17:43:22.085189+0000","last_active":"2023-10-08T17:43:22.088143+0000","last_peered":"2023-10-08T17:43:22.088143+0000","last_clean":"2023-10-08T17:43:22.088143+0000","last_became_active":"2023-10-08T17:43:22.084949+0000","last_became_peered":"2023-10-08T17:43:22.084949+0000","last_unstale":"2023-10-08T17:43:22.088143+0000","last_undegraded":"2023-10-08T17:43:22.088143+0000","last_fullsized":"2023-10-08T17:43:22.088143+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:17:30.792920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091007+0000","last_change":"2023-10-08T17:43:21.059463+0000","last_active":"2023-10-08T17:43:22.091007+0000","last_peered":"2023-10-08T17:43:22.091007+0000","last_clean":"2023-10-08T17:43:22.091007+0000","last_became_active":"2023-10-08T17:43:21.058494+0000","last_became_peered":"2023-10-08T17:43:21.058494+0000","last_unstale":"2023-10-08T17:43:22.091007+0000","last_undegraded":"2023-10-08T17:43:22.091007+0000","last_fullsized":"2023-10-08T17:43:22.091007+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:13:04.798027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072780+0000","last_change":"2023-10-08T17:43:22.064525+0000","last_active":"2023-10-08T17:43:22.072780+0000","last_peered":"2023-10-08T17:43:22.072780+0000","last_clean":"2023-10-08T17:43:22.072780+0000","last_became_active":"2023-10-08T17:43:22.064206+0000","last_became_peered":"2023-10-08T17:43:22.064206+0000","last_unstale":"2023-10-08T17:43:22.072780+0000","last_undegraded":"2023-10-08T17:43:22.072780+0000","last_fullsized":"2023-10-08T17:43:22.072780+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:04.023007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.059523+0000","last_change":"2023-10-08T17:43:21.056558+0000","last_active":"2023-10-08T17:43:22.059523+0000","last_peered":"2023-10-08T17:43:22.059523+0000","last_clean":"2023-10-08T17:43:22.059523+0000","last_became_active":"2023-10-08T17:43:21.056173+0000","last_became_peered":"2023-10-08T17:43:21.056173+0000","last_unstale":"2023-10-08T17:43:22.059523+0000","last_undegraded":"2023-10-08T17:43:22.059523+0000","last_fullsized":"2023-10-08T17:43:22.059523+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:17:46.970164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.070502+0000","last_change":"2023-10-08T17:43:22.067163+0000","last_active":"2023-10-08T17:43:22.070502+0000","last_peered":"2023-10-08T17:43:22.070502+0000","last_clean":"2023-10-08T17:43:22.070502+0000","last_became_active":"2023-10-08T17:43:22.066828+0000","last_became_peered":"2023-10-08T17:43:22.066828+0000","last_unstale":"2023-10-08T17:43:22.070502+0000","last_undegraded":"2023-10-08T17:43:22.070502+0000","last_fullsized":"2023-10-08T17:43:22.070502+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:06.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054699+0000","last_change":"2023-10-08T17:43:21.058359+0000","last_active":"2023-10-08T17:43:22.054699+0000","last_peered":"2023-10-08T17:43:22.054699+0000","last_clean":"2023-10-08T17:43:22.054699+0000","last_became_active":"2023-10-08T17:43:21.058098+0000","last_became_peered":"2023-10-08T17:43:21.058098+0000","last_unstale":"2023-10-08T17:43:22.054699+0000","last_undegraded":"2023-10-08T17:43:22.054699+0000","last_fullsized":"2023-10-08T17:43:22.054699+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:51:47.930688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083857+0000","last_change":"2023-10-08T17:43:22.081462+0000","last_active":"2023-10-08T17:43:22.083857+0000","last_peered":"2023-10-08T17:43:22.083857+0000","last_clean":"2023-10-08T17:43:22.083857+0000","last_became_active":"2023-10-08T17:43:22.081173+0000","last_became_peered":"2023-10-08T17:43:22.081173+0000","last_unstale":"2023-10-08T17:43:22.083857+0000","last_undegraded":"2023-10-08T17:43:22.083857+0000","last_fullsized":"2023-10-08T17:43:22.083857+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:19.664013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.063197+0000","last_change":"2023-10-08T17:43:21.055424+0000","last_active":"2023-10-08T17:43:22.063197+0000","last_peered":"2023-10-08T17:43:22.063197+0000","last_clean":"2023-10-08T17:43:22.063197+0000","last_became_active":"2023-10-08T17:43:21.055155+0000","last_became_peered":"2023-10-08T17:43:21.055155+0000","last_unstale":"2023-10-08T17:43:22.063197+0000","last_undegraded":"2023-10-08T17:43:22.063197+0000","last_fullsized":"2023-10-08T17:43:22.063197+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:03:05.819142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081946+0000","last_change":"2023-10-08T17:43:22.080480+0000","last_active":"2023-10-08T17:43:22.081946+0000","last_peered":"2023-10-08T17:43:22.081946+0000","last_clean":"2023-10-08T17:43:22.081946+0000","last_became_active":"2023-10-08T17:43:22.079933+0000","last_became_peered":"2023-10-08T17:43:22.079933+0000","last_unstale":"2023-10-08T17:43:22.081946+0000","last_undegraded":"2023-10-08T17:43:22.081946+0000","last_fullsized":"2023-10-08T17:43:22.081946+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:37.433384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"212'3","reported_seq":13,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085584+0000","last_change":"2023-10-08T17:43:21.063163+0000","last_active":"2023-10-08T17:43:22.085584+0000","last_peered":"2023-10-08T17:43:22.085584+0000","last_clean":"2023-10-08T17:43:22.085584+0000","last_became_active":"2023-10-08T17:43:21.062907+0000","last_became_peered":"2023-10-08T17:43:21.062907+0000","last_unstale":"2023-10-08T17:43:22.085584+0000","last_undegraded":"2023-10-08T17:43:22.085584+0000","last_fullsized":"2023-10-08T17:43:22.085584+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:43.260605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078274+0000","last_change":"2023-10-08T17:43:22.074913+0000","last_active":"2023-10-08T17:43:22.078274+0000","last_peered":"2023-10-08T17:43:22.078274+0000","last_clean":"2023-10-08T17:43:22.078274+0000","last_became_active":"2023-10-08T17:43:22.074654+0000","last_became_peered":"2023-10-08T17:43:22.074654+0000","last_unstale":"2023-10-08T17:43:22.078274+0000","last_undegraded":"2023-10-08T17:43:22.078274+0000","last_fullsized":"2023-10-08T17:43:22.078274+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.389657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"212'6","reported_seq":16,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.093033+0000","last_change":"2023-10-08T17:43:21.056551+0000","last_active":"2023-10-08T17:43:22.093033+0000","last_peered":"2023-10-08T17:43:22.093033+0000","last_clean":"2023-10-08T17:43:22.093033+0000","last_became_active":"2023-10-08T17:43:21.056287+0000","last_became_peered":"2023-10-08T17:43:21.056287+0000","last_unstale":"2023-10-08T17:43:22.093033+0000","last_undegraded":"2023-10-08T17:43:22.093033+0000","last_fullsized":"2023-10-08T17:43:22.093033+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:38:17.743040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073428+0000","last_change":"2023-10-08T17:43:22.068646+0000","last_active":"2023-10-08T17:43:22.073428+0000","last_peered":"2023-10-08T17:43:22.073428+0000","last_clean":"2023-10-08T17:43:22.073428+0000","last_became_active":"2023-10-08T17:43:22.068399+0000","last_became_peered":"2023-10-08T17:43:22.068399+0000","last_unstale":"2023-10-08T17:43:22.073428+0000","last_undegraded":"2023-10-08T17:43:22.073428+0000","last_fullsized":"2023-10-08T17:43:22.073428+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:27:44.265965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091205+0000","last_change":"2023-10-08T17:43:21.061644+0000","last_active":"2023-10-08T17:43:22.091205+0000","last_peered":"2023-10-08T17:43:22.091205+0000","last_clean":"2023-10-08T17:43:22.091205+0000","last_became_active":"2023-10-08T17:43:21.061356+0000","last_became_peered":"2023-10-08T17:43:21.061356+0000","last_unstale":"2023-10-08T17:43:22.091205+0000","last_undegraded":"2023-10-08T17:43:22.091205+0000","last_fullsized":"2023-10-08T17:43:22.091205+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:42:16.177090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062566+0000","last_change":"2023-10-08T17:43:22.060380+0000","last_active":"2023-10-08T17:43:22.062566+0000","last_peered":"2023-10-08T17:43:22.062566+0000","last_clean":"2023-10-08T17:43:22.062566+0000","last_became_active":"2023-10-08T17:43:22.060088+0000","last_became_peered":"2023-10-08T17:43:22.060088+0000","last_unstale":"2023-10-08T17:43:22.062566+0000","last_undegraded":"2023-10-08T17:43:22.062566+0000","last_fullsized":"2023-10-08T17:43:22.062566+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:57.065279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055296+0000","last_change":"2023-10-08T17:43:21.055859+0000","last_active":"2023-10-08T17:43:22.055296+0000","last_peered":"2023-10-08T17:43:22.055296+0000","last_clean":"2023-10-08T17:43:22.055296+0000","last_became_active":"2023-10-08T17:43:21.055541+0000","last_became_peered":"2023-10-08T17:43:21.055541+0000","last_unstale":"2023-10-08T17:43:22.055296+0000","last_undegraded":"2023-10-08T17:43:22.055296+0000","last_fullsized":"2023-10-08T17:43:22.055296+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:24:03.017646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078893+0000","last_change":"2023-10-08T17:43:22.078066+0000","last_active":"2023-10-08T17:43:22.078893+0000","last_peered":"2023-10-08T17:43:22.078893+0000","last_clean":"2023-10-08T17:43:22.078893+0000","last_became_active":"2023-10-08T17:43:22.077805+0000","last_became_peered":"2023-10-08T17:43:22.077805+0000","last_unstale":"2023-10-08T17:43:22.078893+0000","last_undegraded":"2023-10-08T17:43:22.078893+0000","last_fullsized":"2023-10-08T17:43:22.078893+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:44:36.699888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061525+0000","last_change":"2023-10-08T17:43:21.062303+0000","last_active":"2023-10-08T17:43:22.061525+0000","last_peered":"2023-10-08T17:43:22.061525+0000","last_clean":"2023-10-08T17:43:22.061525+0000","last_became_active":"2023-10-08T17:43:21.062014+0000","last_became_peered":"2023-10-08T17:43:21.062014+0000","last_unstale":"2023-10-08T17:43:22.061525+0000","last_undegraded":"2023-10-08T17:43:22.061525+0000","last_fullsized":"2023-10-08T17:43:22.061525+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:26:21.627199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.066326+0000","last_change":"2023-10-08T17:43:22.060371+0000","last_active":"2023-10-08T17:43:22.066326+0000","last_peered":"2023-10-08T17:43:22.066326+0000","last_clean":"2023-10-08T17:43:22.066326+0000","last_became_active":"2023-10-08T17:43:22.060108+0000","last_became_peered":"2023-10-08T17:43:22.060108+0000","last_unstale":"2023-10-08T17:43:22.066326+0000","last_undegraded":"2023-10-08T17:43:22.066326+0000","last_fullsized":"2023-10-08T17:43:22.066326+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:21:04.291465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"212'8","reported_seq":18,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091205+0000","last_change":"2023-10-08T17:43:21.061979+0000","last_active":"2023-10-08T17:43:22.091205+0000","last_peered":"2023-10-08T17:43:22.091205+0000","last_clean":"2023-10-08T17:43:22.091205+0000","last_became_active":"2023-10-08T17:43:21.061344+0000","last_became_peered":"2023-10-08T17:43:21.061344+0000","last_unstale":"2023-10-08T17:43:22.091205+0000","last_undegraded":"2023-10-08T17:43:22.091205+0000","last_fullsized":"2023-10-08T17:43:22.091205+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:04.952827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.066512+0000","last_change":"2023-10-08T17:43:22.059558+0000","last_active":"2023-10-08T17:43:22.066512+0000","last_peered":"2023-10-08T17:43:22.066512+0000","last_clean":"2023-10-08T17:43:22.066512+0000","last_became_active":"2023-10-08T17:43:22.059207+0000","last_became_peered":"2023-10-08T17:43:22.059207+0000","last_unstale":"2023-10-08T17:43:22.066512+0000","last_undegraded":"2023-10-08T17:43:22.066512+0000","last_fullsized":"2023-10-08T17:43:22.066512+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:01.402668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083894+0000","last_change":"2023-10-08T17:43:21.061147+0000","last_active":"2023-10-08T17:43:22.083894+0000","last_peered":"2023-10-08T17:43:22.083894+0000","last_clean":"2023-10-08T17:43:22.083894+0000","last_became_active":"2023-10-08T17:43:21.060894+0000","last_became_peered":"2023-10-08T17:43:21.060894+0000","last_unstale":"2023-10-08T17:43:22.083894+0000","last_undegraded":"2023-10-08T17:43:22.083894+0000","last_fullsized":"2023-10-08T17:43:22.083894+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:52:47.241370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083741+0000","last_change":"2023-10-08T17:43:22.082365+0000","last_active":"2023-10-08T17:43:22.083741+0000","last_peered":"2023-10-08T17:43:22.083741+0000","last_clean":"2023-10-08T17:43:22.083741+0000","last_became_active":"2023-10-08T17:43:22.081943+0000","last_became_peered":"2023-10-08T17:43:22.081943+0000","last_unstale":"2023-10-08T17:43:22.083741+0000","last_undegraded":"2023-10-08T17:43:22.083741+0000","last_fullsized":"2023-10-08T17:43:22.083741+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:38:34.581636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081902+0000","last_change":"2023-10-08T17:43:21.057032+0000","last_active":"2023-10-08T17:43:22.081902+0000","last_peered":"2023-10-08T17:43:22.081902+0000","last_clean":"2023-10-08T17:43:22.081902+0000","last_became_active":"2023-10-08T17:43:21.056768+0000","last_became_peered":"2023-10-08T17:43:21.056768+0000","last_unstale":"2023-10-08T17:43:22.081902+0000","last_undegraded":"2023-10-08T17:43:22.081902+0000","last_fullsized":"2023-10-08T17:43:22.081902+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:38:37.856763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.085108+0000","last_change":"2023-10-08T17:43:22.084282+0000","last_active":"2023-10-08T17:43:22.085108+0000","last_peered":"2023-10-08T17:43:22.085108+0000","last_clean":"2023-10-08T17:43:22.085108+0000","last_became_active":"2023-10-08T17:43:22.083774+0000","last_became_peered":"2023-10-08T17:43:22.083774+0000","last_unstale":"2023-10-08T17:43:22.085108+0000","last_undegraded":"2023-10-08T17:43:22.085108+0000","last_fullsized":"2023-10-08T17:43:22.085108+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:46.461684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"212'1","reported_seq":11,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091194+0000","last_change":"2023-10-08T17:43:21.062348+0000","last_active":"2023-10-08T17:43:22.091194+0000","last_peered":"2023-10-08T17:43:22.091194+0000","last_clean":"2023-10-08T17:43:22.091194+0000","last_became_active":"2023-10-08T17:43:21.062083+0000","last_became_peered":"2023-10-08T17:43:21.062083+0000","last_unstale":"2023-10-08T17:43:22.091194+0000","last_undegraded":"2023-10-08T17:43:22.091194+0000","last_fullsized":"2023-10-08T17:43:22.091194+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:34:38.473827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.088812+0000","last_change":"2023-10-08T17:43:22.087560+0000","last_active":"2023-10-08T17:43:22.088812+0000","last_peered":"2023-10-08T17:43:22.088812+0000","last_clean":"2023-10-08T17:43:22.088812+0000","last_became_active":"2023-10-08T17:43:22.087239+0000","last_became_peered":"2023-10-08T17:43:22.087239+0000","last_unstale":"2023-10-08T17:43:22.088812+0000","last_undegraded":"2023-10-08T17:43:22.088812+0000","last_fullsized":"2023-10-08T17:43:22.088812+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:54:45.457879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054401+0000","last_change":"2023-10-08T17:43:21.054128+0000","last_active":"2023-10-08T17:43:22.054401+0000","last_peered":"2023-10-08T17:43:22.054401+0000","last_clean":"2023-10-08T17:43:22.054401+0000","last_became_active":"2023-10-08T17:43:21.053816+0000","last_became_peered":"2023-10-08T17:43:21.053816+0000","last_unstale":"2023-10-08T17:43:22.054401+0000","last_undegraded":"2023-10-08T17:43:22.054401+0000","last_fullsized":"2023-10-08T17:43:22.054401+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:25:06.241775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.080241+0000","last_change":"2023-10-08T17:43:22.074001+0000","last_active":"2023-10-08T17:43:22.080241+0000","last_peered":"2023-10-08T17:43:22.080241+0000","last_clean":"2023-10-08T17:43:22.080241+0000","last_became_active":"2023-10-08T17:43:22.073580+0000","last_became_peered":"2023-10-08T17:43:22.073580+0000","last_unstale":"2023-10-08T17:43:22.080241+0000","last_undegraded":"2023-10-08T17:43:22.080241+0000","last_fullsized":"2023-10-08T17:43:22.080241+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T00:40:38.764570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.091510+0000","last_change":"2023-10-08T17:43:21.053602+0000","last_active":"2023-10-08T17:43:22.091510+0000","last_peered":"2023-10-08T17:43:22.091510+0000","last_clean":"2023-10-08T17:43:22.091510+0000","last_became_active":"2023-10-08T17:43:21.053292+0000","last_became_peered":"2023-10-08T17:43:21.053292+0000","last_unstale":"2023-10-08T17:43:22.091510+0000","last_undegraded":"2023-10-08T17:43:22.091510+0000","last_fullsized":"2023-10-08T17:43:22.091510+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:49:55.613353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.073270+0000","last_change":"2023-10-08T17:43:22.066748+0000","last_active":"2023-10-08T17:43:22.073270+0000","last_peered":"2023-10-08T17:43:22.073270+0000","last_clean":"2023-10-08T17:43:22.073270+0000","last_became_active":"2023-10-08T17:43:22.066438+0000","last_became_peered":"2023-10-08T17:43:22.066438+0000","last_unstale":"2023-10-08T17:43:22.073270+0000","last_undegraded":"2023-10-08T17:43:22.073270+0000","last_fullsized":"2023-10-08T17:43:22.073270+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:17:24.606780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.065415+0000","last_change":"2023-10-08T17:43:21.055960+0000","last_active":"2023-10-08T17:43:22.065415+0000","last_peered":"2023-10-08T17:43:22.065415+0000","last_clean":"2023-10-08T17:43:22.065415+0000","last_became_active":"2023-10-08T17:43:21.055694+0000","last_became_peered":"2023-10-08T17:43:21.055694+0000","last_unstale":"2023-10-08T17:43:22.065415+0000","last_undegraded":"2023-10-08T17:43:22.065415+0000","last_fullsized":"2023-10-08T17:43:22.065415+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T05:39:52.487398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.068048+0000","last_change":"2023-10-08T17:43:22.063559+0000","last_active":"2023-10-08T17:43:22.068048+0000","last_peered":"2023-10-08T17:43:22.068048+0000","last_clean":"2023-10-08T17:43:22.068048+0000","last_became_active":"2023-10-08T17:43:22.062930+0000","last_became_peered":"2023-10-08T17:43:22.062930+0000","last_unstale":"2023-10-08T17:43:22.068048+0000","last_undegraded":"2023-10-08T17:43:22.068048+0000","last_fullsized":"2023-10-08T17:43:22.068048+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:22.226133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058329+0000","last_change":"2023-10-08T17:43:21.057532+0000","last_active":"2023-10-08T17:43:22.058329+0000","last_peered":"2023-10-08T17:43:22.058329+0000","last_clean":"2023-10-08T17:43:22.058329+0000","last_became_active":"2023-10-08T17:43:21.057275+0000","last_became_peered":"2023-10-08T17:43:21.057275+0000","last_unstale":"2023-10-08T17:43:22.058329+0000","last_undegraded":"2023-10-08T17:43:22.058329+0000","last_fullsized":"2023-10-08T17:43:22.058329+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:24:25.986177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.082085+0000","last_change":"2023-10-08T17:43:22.077652+0000","last_active":"2023-10-08T17:43:22.082085+0000","last_peered":"2023-10-08T17:43:22.082085+0000","last_clean":"2023-10-08T17:43:22.082085+0000","last_became_active":"2023-10-08T17:43:22.077367+0000","last_became_peered":"2023-10-08T17:43:22.077367+0000","last_unstale":"2023-10-08T17:43:22.082085+0000","last_undegraded":"2023-10-08T17:43:22.082085+0000","last_fullsized":"2023-10-08T17:43:22.082085+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:14:50.026820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061545+0000","last_change":"2023-10-08T17:43:21.059947+0000","last_active":"2023-10-08T17:43:22.061545+0000","last_peered":"2023-10-08T17:43:22.061545+0000","last_clean":"2023-10-08T17:43:22.061545+0000","last_became_active":"2023-10-08T17:43:21.059614+0000","last_became_peered":"2023-10-08T17:43:21.059614+0000","last_unstale":"2023-10-08T17:43:22.061545+0000","last_undegraded":"2023-10-08T17:43:22.061545+0000","last_fullsized":"2023-10-08T17:43:22.061545+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T21:18:16.048114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.076815+0000","last_change":"2023-10-08T17:43:22.071372+0000","last_active":"2023-10-08T17:43:22.076815+0000","last_peered":"2023-10-08T17:43:22.076815+0000","last_clean":"2023-10-08T17:43:22.076815+0000","last_became_active":"2023-10-08T17:43:22.071092+0000","last_became_peered":"2023-10-08T17:43:22.071092+0000","last_unstale":"2023-10-08T17:43:22.076815+0000","last_undegraded":"2023-10-08T17:43:22.076815+0000","last_fullsized":"2023-10-08T17:43:22.076815+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:37:29.042159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"212'2","reported_seq":12,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.086226+0000","last_change":"2023-10-08T17:43:21.062814+0000","last_active":"2023-10-08T17:43:22.086226+0000","last_peered":"2023-10-08T17:43:22.086226+0000","last_clean":"2023-10-08T17:43:22.086226+0000","last_became_active":"2023-10-08T17:43:21.062511+0000","last_became_peered":"2023-10-08T17:43:21.062511+0000","last_unstale":"2023-10-08T17:43:22.086226+0000","last_undegraded":"2023-10-08T17:43:22.086226+0000","last_fullsized":"2023-10-08T17:43:22.086226+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:06:43.720549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078336+0000","last_change":"2023-10-08T17:43:22.066505+0000","last_active":"2023-10-08T17:43:22.078336+0000","last_peered":"2023-10-08T17:43:22.078336+0000","last_clean":"2023-10-08T17:43:22.078336+0000","last_became_active":"2023-10-08T17:43:22.066190+0000","last_became_peered":"2023-10-08T17:43:22.066190+0000","last_unstale":"2023-10-08T17:43:22.078336+0000","last_undegraded":"2023-10-08T17:43:22.078336+0000","last_fullsized":"2023-10-08T17:43:22.078336+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:15:05.958188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055001+0000","last_change":"2023-10-08T17:43:21.065383+0000","last_active":"2023-10-08T17:43:22.055001+0000","last_peered":"2023-10-08T17:43:22.055001+0000","last_clean":"2023-10-08T17:43:22.055001+0000","last_became_active":"2023-10-08T17:43:21.064787+0000","last_became_peered":"2023-10-08T17:43:21.064787+0000","last_unstale":"2023-10-08T17:43:22.055001+0000","last_undegraded":"2023-10-08T17:43:22.055001+0000","last_fullsized":"2023-10-08T17:43:22.055001+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:10:21.220772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.074168+0000","last_change":"2023-10-08T17:43:22.069185+0000","last_active":"2023-10-08T17:43:22.074168+0000","last_peered":"2023-10-08T17:43:22.074168+0000","last_clean":"2023-10-08T17:43:22.074168+0000","last_became_active":"2023-10-08T17:43:22.068886+0000","last_became_peered":"2023-10-08T17:43:22.068886+0000","last_unstale":"2023-10-08T17:43:22.074168+0000","last_undegraded":"2023-10-08T17:43:22.074168+0000","last_fullsized":"2023-10-08T17:43:22.074168+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:52:26.656935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.055505+0000","last_change":"2023-10-08T17:43:21.063921+0000","last_active":"2023-10-08T17:43:22.055505+0000","last_peered":"2023-10-08T17:43:22.055505+0000","last_clean":"2023-10-08T17:43:22.055505+0000","last_became_active":"2023-10-08T17:43:21.063628+0000","last_became_peered":"2023-10-08T17:43:21.063628+0000","last_unstale":"2023-10-08T17:43:22.055505+0000","last_undegraded":"2023-10-08T17:43:22.055505+0000","last_fullsized":"2023-10-08T17:43:22.055505+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:13:56.059918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.090946+0000","last_change":"2023-10-08T17:43:22.086575+0000","last_active":"2023-10-08T17:43:22.090946+0000","last_peered":"2023-10-08T17:43:22.090946+0000","last_clean":"2023-10-08T17:43:22.090946+0000","last_became_active":"2023-10-08T17:43:22.086098+0000","last_became_peered":"2023-10-08T17:43:22.086098+0000","last_unstale":"2023-10-08T17:43:22.090946+0000","last_undegraded":"2023-10-08T17:43:22.090946+0000","last_fullsized":"2023-10-08T17:43:22.090946+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:58:52.759665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062190+0000","last_change":"2023-10-08T17:43:21.057667+0000","last_active":"2023-10-08T17:43:22.062190+0000","last_peered":"2023-10-08T17:43:22.062190+0000","last_clean":"2023-10-08T17:43:22.062190+0000","last_became_active":"2023-10-08T17:43:21.057388+0000","last_became_peered":"2023-10-08T17:43:21.057388+0000","last_unstale":"2023-10-08T17:43:22.062190+0000","last_undegraded":"2023-10-08T17:43:22.062190+0000","last_fullsized":"2023-10-08T17:43:22.062190+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:17:55.974264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.083044+0000","last_change":"2023-10-08T17:43:22.073397+0000","last_active":"2023-10-08T17:43:22.083044+0000","last_peered":"2023-10-08T17:43:22.083044+0000","last_clean":"2023-10-08T17:43:22.083044+0000","last_became_active":"2023-10-08T17:43:22.073069+0000","last_became_peered":"2023-10-08T17:43:22.073069+0000","last_unstale":"2023-10-08T17:43:22.083044+0000","last_undegraded":"2023-10-08T17:43:22.083044+0000","last_fullsized":"2023-10-08T17:43:22.083044+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:53.394749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.061214+0000","last_change":"2023-10-08T17:43:21.062610+0000","last_active":"2023-10-08T17:43:22.061214+0000","last_peered":"2023-10-08T17:43:22.061214+0000","last_clean":"2023-10-08T17:43:22.061214+0000","last_became_active":"2023-10-08T17:43:21.062335+0000","last_became_peered":"2023-10-08T17:43:21.062335+0000","last_unstale":"2023-10-08T17:43:22.061214+0000","last_undegraded":"2023-10-08T17:43:22.061214+0000","last_fullsized":"2023-10-08T17:43:22.061214+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:32:35.559363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.081267+0000","last_change":"2023-10-08T17:43:22.065027+0000","last_active":"2023-10-08T17:43:22.081267+0000","last_peered":"2023-10-08T17:43:22.081267+0000","last_clean":"2023-10-08T17:43:22.081267+0000","last_became_active":"2023-10-08T17:43:22.064767+0000","last_became_peered":"2023-10-08T17:43:22.064767+0000","last_unstale":"2023-10-08T17:43:22.081267+0000","last_undegraded":"2023-10-08T17:43:22.081267+0000","last_fullsized":"2023-10-08T17:43:22.081267+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T18:12:36.389657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.062098+0000","last_change":"2023-10-08T17:43:21.061583+0000","last_active":"2023-10-08T17:43:22.062098+0000","last_peered":"2023-10-08T17:43:22.062098+0000","last_clean":"2023-10-08T17:43:22.062098+0000","last_became_active":"2023-10-08T17:43:21.061281+0000","last_became_peered":"2023-10-08T17:43:21.061281+0000","last_unstale":"2023-10-08T17:43:22.062098+0000","last_undegraded":"2023-10-08T17:43:22.062098+0000","last_fullsized":"2023-10-08T17:43:22.062098+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T02:11:28.821980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.072533+0000","last_change":"2023-10-08T17:43:22.063759+0000","last_active":"2023-10-08T17:43:22.072533+0000","last_peered":"2023-10-08T17:43:22.072533+0000","last_clean":"2023-10-08T17:43:22.072533+0000","last_became_active":"2023-10-08T17:43:22.063294+0000","last_became_peered":"2023-10-08T17:43:22.063294+0000","last_unstale":"2023-10-08T17:43:22.072533+0000","last_undegraded":"2023-10-08T17:43:22.072533+0000","last_fullsized":"2023-10-08T17:43:22.072533+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T23:26:40.040705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.054197+0000","last_change":"2023-10-08T17:43:21.058202+0000","last_active":"2023-10-08T17:43:22.054197+0000","last_peered":"2023-10-08T17:43:22.054197+0000","last_clean":"2023-10-08T17:43:22.054197+0000","last_became_active":"2023-10-08T17:43:21.057945+0000","last_became_peered":"2023-10-08T17:43:21.057945+0000","last_unstale":"2023-10-08T17:43:22.054197+0000","last_undegraded":"2023-10-08T17:43:22.054197+0000","last_fullsized":"2023-10-08T17:43:22.054197+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T20:01:24.365321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078901+0000","last_change":"2023-10-08T17:43:22.073358+0000","last_active":"2023-10-08T17:43:22.078901+0000","last_peered":"2023-10-08T17:43:22.078901+0000","last_clean":"2023-10-08T17:43:22.078901+0000","last_became_active":"2023-10-08T17:43:22.073060+0000","last_became_peered":"2023-10-08T17:43:22.073060+0000","last_unstale":"2023-10-08T17:43:22.078901+0000","last_undegraded":"2023-10-08T17:43:22.078901+0000","last_fullsized":"2023-10-08T17:43:22.078901+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T19:51:48.936049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058071+0000","last_change":"2023-10-08T17:43:21.053571+0000","last_active":"2023-10-08T17:43:22.058071+0000","last_peered":"2023-10-08T17:43:22.058071+0000","last_clean":"2023-10-08T17:43:22.058071+0000","last_became_active":"2023-10-08T17:43:21.053280+0000","last_became_peered":"2023-10-08T17:43:21.053280+0000","last_unstale":"2023-10-08T17:43:22.058071+0000","last_undegraded":"2023-10-08T17:43:22.058071+0000","last_fullsized":"2023-10-08T17:43:22.058071+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T01:16:45.456323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.078109+0000","last_change":"2023-10-08T17:43:22.068746+0000","last_active":"2023-10-08T17:43:22.078109+0000","last_peered":"2023-10-08T17:43:22.078109+0000","last_clean":"2023-10-08T17:43:22.078109+0000","last_became_active":"2023-10-08T17:43:22.068419+0000","last_became_peered":"2023-10-08T17:43:22.068419+0000","last_unstale":"2023-10-08T17:43:22.078109+0000","last_undegraded":"2023-10-08T17:43:22.078109+0000","last_fullsized":"2023-10-08T17:43:22.078109+0000","mapping_epoch":211,"log_start":"0'0","ondisk_log_start":"0'0","created":211,"last_epoch_clean":212,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:21.034240+0000","last_clean_scrub_stamp":"2023-10-08T17:43:21.034240+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T22:57:53.394749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058837+0000","last_change":"2023-10-08T17:43:21.055306+0000","last_active":"2023-10-08T17:43:22.058837+0000","last_peered":"2023-10-08T17:43:22.058837+0000","last_clean":"2023-10-08T17:43:22.058837+0000","last_became_active":"2023-10-08T17:43:21.054997+0000","last_became_peered":"2023-10-08T17:43:21.054997+0000","last_unstale":"2023-10-08T17:43:22.058837+0000","last_undegraded":"2023-10-08T17:43:22.058837+0000","last_fullsized":"2023-10-08T17:43:22.058837+0000","mapping_epoch":210,"log_start":"0'0","ondisk_log_start":"0'0","created":210,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T17:43:20.028879+0000","last_clean_scrub_stamp":"2023-10-08T17:43:20.028879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T03:22:36.428023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"202'348","reported_seq":1156,"reported_epoch":212,"state":"active+clean","last_fresh":"2023-10-08T17:43:22.058760+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:22.058760+0000","last_peered":"2023-10-08T17:43:22.058760+0000","last_clean":"2023-10-08T17:43:22.058760+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:22.058760+0000","last_undegraded":"2023-10-08T17:43:22.058760+0000","last_fullsized":"2023-10-08T17:43:22.058760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304576,"kb_used_data":3192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067264,"statfs":{"total":96636764160,"available":96324878336,"internally_reserved":0,"allocated":3268608,"data_stored":1934883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.98399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.94199999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.66100000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.624},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.53900000000000003}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.75600000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.68999999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303988,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067852,"statfs":{"total":96636764160,"available":96325480448,"internally_reserved":0,"allocated":2666496,"data_stored":1344411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.71999999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.84799999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.76900000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.878},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.56499999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.621},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.748}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.77900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575963,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308096,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063744,"statfs":{"total":96636764160,"available":96321273856,"internally_reserved":0,"allocated":2678784,"data_stored":1345947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.46500000000000002,"15min":0.47199999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.68400000000000005,"5min":0.71399999999999997,"15min":0.91400000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.51900000000000002,"15min":0.53500000000000003},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":0.78500000000000003,"15min":1.0649999999999999},"last":0.48999999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51700000000000002,"15min":0.52000000000000002},"min":{"1min":0.36799999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63600000000000001,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61199999999999999,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.44800000000000001,"15min":0.41099999999999998},"max":{"1min":0.84099999999999997,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.433}]},{"osd":3,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.76000000000000001,"5min":0.83799999999999997,"15min":0.98699999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.61199999999999999,"15min":0.624},"min":{"1min":0.46200000000000002,"5min":0.40300000000000002,"15min":0.40200000000000002},"max":{"1min":0.73599999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80600000000000005,"15min":0.83499999999999996},"min":{"1min":0.57899999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95599999999999996,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80400000000000005,"15min":0.82499999999999996},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":1.141,"15min":1.2370000000000001},"last":0.88700000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.81200000000000006,"15min":0.83799999999999997},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0009999999999999,"5min":1.079,"15min":1.196},"last":1.04},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.83799999999999997,"15min":0.85299999999999998},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.54000000000000004},"max":{"1min":1.056,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.86199999999999999,"15min":0.877},"min":{"1min":0.65100000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.008,"5min":1.28,"15min":1.304},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.84299999999999997,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.995,"5min":1.2210000000000001,"15min":1.2450000000000001},"last":0.91900000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:42:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.86199999999999999,"15min":0.88400000000000001},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.075,"5min":1.1200000000000001,"15min":1.25},"last":1.056},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.878,"15min":0.89900000000000002},"min":{"1min":0.621,"5min":0.621,"15min":0.62},"max":{"1min":1.0349999999999999,"5min":1.2390000000000001,"15min":1.339},"last":0.89700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575963,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308668,"kb_used_data":3188,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063172,"statfs":{"total":96636764160,"available":96320688128,"internally_reserved":0,"allocated":3264512,"data_stored":1934801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.435}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.59299999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.70899999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.53700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575964,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1345077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.309,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65300000000000002,"5min":0.89500000000000002,"15min":1.032},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.58699999999999997,"15min":0.59699999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67900000000000005,"5min":0.79000000000000004,"15min":1.0449999999999999},"last":0.48799999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.54500000000000004,"15min":0.55200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.36799999999999999},"max":{"1min":0.751,"5min":0.84599999999999997,"15min":1.4319999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56999999999999995},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.77400000000000002,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.434}]},{"osd":3,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54300000000000004,"15min":0.56599999999999995},"min":{"1min":0.38200000000000001,"5min":0.36099999999999999,"15min":0.35399999999999998},"max":{"1min":0.70199999999999996,"5min":0.85299999999999998,"15min":1.327},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.65100000000000002,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.79000000000000004,"5min":0.93799999999999994,"15min":1.5009999999999999},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.80000000000000004,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0620000000000001,"5min":1.157,"15min":1.3520000000000001},"last":0.62},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.56899999999999995,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0149999999999999,"5min":1.149,"15min":1.2749999999999999},"last":0.753}]},{"osd":5,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.85199999999999998,"15min":0.872},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.442},"max":{"1min":1.038,"5min":1.25,"15min":1.3440000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.84799999999999998,"15min":0.86699999999999999},"min":{"1min":0.57599999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.0109999999999999,"5min":1.1859999999999999,"15min":1.375},"last":0.68999999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.81000000000000005,"15min":0.82599999999999996},"min":{"1min":0.60699999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0369999999999999,"5min":1.117,"15min":1.4319999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.67100000000000004,"5min":0.63300000000000001,"15min":0.58399999999999996},"max":{"1min":1.069,"5min":1.2010000000000001,"15min":1.5429999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:42:37 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.873,"15min":0.88900000000000001},"min":{"1min":0.68200000000000005,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.044,"5min":1.2110000000000001,"15min":1.476},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.89800000000000002},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.085,"5min":1.125,"15min":1.431},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575964,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312192,"kb_used_data":2616,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059648,"statfs":{"total":96636764160,"available":96317079552,"internally_reserved":0,"allocated":2678784,"data_stored":1344605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.52900000000000003}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.433}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.64900000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.75}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.80800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575964,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308100,"kb_used_data":2620,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063740,"statfs":{"total":96636764160,"available":96321269760,"internally_reserved":0,"allocated":2682880,"data_stored":1346501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.5},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.747}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.68899999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.90700000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":0.80400000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":0.77900000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":0.88600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575963,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303988,"kb_used_data":2604,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067852,"statfs":{"total":96636764160,"available":96325480448,"internally_reserved":0,"allocated":2666496,"data_stored":1344411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.752},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.48899999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.68999999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.63800000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.877}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.80600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:31.808 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-08T17:43:31.808 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-08T17:43:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.036+0000 7f49da1ff700 1 Processor -- start 2023-10-08T17:43:32.036 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.036+0000 7f49da1ff700 1 -- start start 2023-10-08T17:43:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.037+0000 7f49da1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40c8800 0x7f49d40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.037+0000 7f49da1ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49d40b1150 0x7f49d40ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.037+0000 7f49da1ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d40adbc0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.037+0000 7f49da1ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d40c9d30 con 0x7f49d40b1150 2023-10-08T17:43:32.039 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.037+0000 7f49da1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d40acfb0 con 0x7f49d40c8800 2023-10-08T17:43:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49d40b1150 0x7f49d40ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f49d40b1150 0x7f49d40ae050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50778/0 (socket says 172.21.15.12:50778) 2023-10-08T17:43:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 -- 172.21.15.12:0/3038563440 learned_addr learned my addr 172.21.15.12:0/3038563440 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:32.040 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d2ffd700 1 --1- 172.21.15.12:0/3038563440 >> v1:172.21.15.12:6789/0 conn(0x7f49d40c8bd0 0x7f49d40b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44650/0 (socket says 172.21.15.12:44650) 2023-10-08T17:43:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d37fe700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40c8800 0x7f49d40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 -- 172.21.15.12:0/3038563440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40c8800 msgr2=0x7f49d40c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40c8800 0x7f49d40c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 -- 172.21.15.12:0/3038563440 >> v1:172.21.15.12:6789/0 conn(0x7f49d40c8bd0 legacy=0x7f49d40b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.041 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d3fff700 1 -- 172.21.15.12:0/3038563440 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d40ad290 con 0x7f49d40b1150 2023-10-08T17:43:32.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.038+0000 7f49d27fc700 1 -- 172.21.15.12:0/3038563440 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169138871 0 0) 0x7f49d40adbc0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49d3fff700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40b1150 0x7f49d40ae050 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009f20 tx=0x7f49cc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29b8e849ae8ba61 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49d27fc700 1 -- 172.21.15.12:0/3038563440 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00e070 con 0x7f49d40b1150 2023-10-08T17:43:32.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49d27fc700 1 -- 172.21.15.12:0/3038563440 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00ba80 con 0x7f49d40b1150 2023-10-08T17:43:32.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49d27fc700 1 -- 172.21.15.12:0/3038563440 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0092e0 con 0x7f49d40b1150 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 -- 172.21.15.12:0/3038563440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40b1150 msgr2=0x7f49d40ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40b1150 0x7f49d40ae050 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009f20 tx=0x7f49cc009840 comp rx=0 tx=0).stop 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 -- 172.21.15.12:0/3038563440 shutdown_connections 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40b1150 0x7f49d40ae050 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 --2- 172.21.15.12:0/3038563440 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40c8800 0x7f49d40c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.045 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.039+0000 7f49da1ff700 1 -- 172.21.15.12:0/3038563440 >> 172.21.15.12:0/3038563440 conn(0x7f49d406d170 msgr2=0x7f49d40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.040+0000 7f49da1ff700 1 -- 172.21.15.12:0/3038563440 shutdown_connections 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.040+0000 7f49da1ff700 1 -- 172.21.15.12:0/3038563440 wait complete. 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.041+0000 7f49da1ff700 1 Processor -- start 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.041+0000 7f49da1ff700 1 -- start start 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40b1150 0x7f49d4158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49d40c8800 0x7f49d4155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4158e60 con 0x7f49d40c8bd0 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d415ccf0 con 0x7f49d40c8800 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49da1ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d4169ce0 con 0x7f49d40b1150 2023-10-08T17:43:32.046 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49d3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:50786/0 (socket says 172.21.15.12:50786) 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.042+0000 7f49d3fff700 1 -- 172.21.15.12:0/1101173788 learned_addr learned my addr 172.21.15.12:0/1101173788 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d37fe700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40b1150 0x7f49d4158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d2ffd700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49d40c8800 0x7f49d4155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 -- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40b1150 msgr2=0x7f49d4158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40b1150 0x7f49d4158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 -- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49d40c8800 msgr2=0x7f49d4155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49d40c8800 0x7f49d4155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 -- 172.21.15.12:0/1101173788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49cc009ae0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49d3fff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f49cc012000 tx=0x7f49cc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.047 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc0032f0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc025460 con 0x7f49d40c8bd0 2023-10-08T17:43:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc025800 con 0x7f49d40c8bd0 2023-10-08T17:43:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.043+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d4159090 con 0x7f49d40c8bd0 2023-10-08T17:43:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.044+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d4159650 con 0x7f49d40c8bd0 2023-10-08T17:43:32.048 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.045+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d40cbd90 con 0x7f49d40c8bd0 2023-10-08T17:43:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.045+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49cc003040 con 0x7f49d40c8bd0 2023-10-08T17:43:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.046+0000 7f49bb7fe700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 0x7f49c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.046+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f49cc086620 con 0x7f49d40c8bd0 2023-10-08T17:43:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.047+0000 7f49d37fe700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 0x7f49c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.049 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.047+0000 7f49d37fe700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 0x7f49c00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006fd0 tx=0x7f49c4008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.050 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.051+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49cc0535e0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.332+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f49d404c3c0 con 0x7f49d40c8bd0 2023-10-08T17:43:32.337 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.337+0000 7f49bb7fe700 1 -- 172.21.15.12:0/1101173788 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v49) v1 ==== 190+0+0 (secure 0 0 0) 0x7f49cc056c00 con 0x7f49d40c8bd0 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 msgr2=0x7f49c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 0x7f49c00693e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f49c4006fd0 tx=0x7f49c4008040 comp rx=0 tx=0).stop 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 msgr2=0x7f49d415f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f49cc012000 tx=0x7f49cc018000 comp rx=0 tx=0).stop 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 shutdown_connections 2023-10-08T17:43:32.339 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f49c0066f30 0x7f49c00693e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f49d40c8bd0 0x7f49d415f720 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f49d40b1150 0x7f49d4158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 --2- 172.21.15.12:0/1101173788 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f49d40c8800 0x7f49d4155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 >> 172.21.15.12:0/1101173788 conn(0x7f49d406d170 msgr2=0x7f49d40af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 shutdown_connections 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.339+0000 7f49da1ff700 1 -- 172.21.15.12:0/1101173788 wait complete. 2023-10-08T17:43:32.340 INFO:teuthology.orchestra.run.smithi012.stderr:updated caps for client.0 2023-10-08T17:43:32.356 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:32.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.545+0000 7f326319d700 1 Processor -- start 2023-10-08T17:43:32.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.545+0000 7f326319d700 1 -- start start 2023-10-08T17:43:32.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c142c00 0x7f325c06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326319d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f325c0c7f90 0x7f325c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326319d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325c0ca480 con 0x7f325c06bd20 2023-10-08T17:43:32.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326319d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f325c15e240 con 0x7f325c0c7f90 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c06b350 con 0x7f325c142c00 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326299c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f325c0c7f90 0x7f325c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326299c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f325c0c7f90 0x7f325c06c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39174/0 (socket says 172.21.15.12:39174) 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.546+0000 7f326299c700 1 -- 172.21.15.12:0/583423098 learned_addr learned my addr 172.21.15.12:0/583423098 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326219b700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c142c00 0x7f325c06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326299c700 1 -- 172.21.15.12:0/583423098 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c142c00 msgr2=0x7f325c06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326299c700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c142c00 0x7f325c06b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326299c700 1 -- 172.21.15.12:0/583423098 >> v1:172.21.15.29:6789/0 conn(0x7f325c06bd20 legacy=0x7f325c0c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326299c700 1 -- 172.21.15.12:0/583423098 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f325c15df60 con 0x7f325c0c7f90 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f326299c700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c0c7f90 0x7f325c06c6a0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f3254009f50 tx=0x7f3254009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45baade02ef130df server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f3261199700 1 -- 172.21.15.12:0/583423098 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400e070 con 0x7f325c0c7f90 2023-10-08T17:43:32.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f3261199700 1 -- 172.21.15.12:0/583423098 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400ba70 con 0x7f325c0c7f90 2023-10-08T17:43:32.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.547+0000 7f3261199700 1 -- 172.21.15.12:0/583423098 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32540092e0 con 0x7f325c0c7f90 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 -- 172.21.15.12:0/583423098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c0c7f90 msgr2=0x7f325c06c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c0c7f90 0x7f325c06c6a0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f3254009f50 tx=0x7f3254009840 comp rx=0 tx=0).stop 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 -- 172.21.15.12:0/583423098 shutdown_connections 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c0c7f90 0x7f325c06c6a0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 --2- 172.21.15.12:0/583423098 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c142c00 0x7f325c06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 -- 172.21.15.12:0/583423098 >> 172.21.15.12:0/583423098 conn(0x7f325c0675a0 msgr2=0x7f325c0679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 -- 172.21.15.12:0/583423098 shutdown_connections 2023-10-08T17:43:32.550 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.548+0000 7f326319d700 1 -- 172.21.15.12:0/583423098 wait complete. 2023-10-08T17:43:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.549+0000 7f326319d700 1 Processor -- start 2023-10-08T17:43:32.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 -- start start 2023-10-08T17:43:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 0x7f325c13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 0x7f325c13d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c0c4700 con 0x7f325c06bd20 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325c159520 con 0x7f325c142c00 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.550+0000 7f326319d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f325c13f3c0 con 0x7f325c0c7f90 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39182/0 (socket says 172.21.15.12:39182) 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 -- 172.21.15.12:0/2447844783 learned_addr learned my addr 172.21.15.12:0/2447844783 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326299c700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 0x7f325c13d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326199a700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 0x7f325c13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 -- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 msgr2=0x7f325c13eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 0x7f325c13eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 -- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 msgr2=0x7f325c13d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 0x7f325c13d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 -- 172.21.15.12:0/2447844783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3254009ae0 con 0x7f325c06bd20 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326299c700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 0x7f325c13d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326199a700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 0x7f325c13eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.551+0000 7f326219b700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f325800d860 tx=0x7f3258008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.552+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258009610 con 0x7f325c06bd20 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.552+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3258009770 con 0x7f325c06bd20 2023-10-08T17:43:32.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.552+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3258009b30 con 0x7f325c06bd20 2023-10-08T17:43:32.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.552+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325c13f6a0 con 0x7f325c06bd20 2023-10-08T17:43:32.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.552+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325c0c4390 con 0x7f325c06bd20 2023-10-08T17:43:32.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.553+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325c141b50 con 0x7f325c06bd20 2023-10-08T17:43:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.554+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f325801e460 con 0x7f325c06bd20 2023-10-08T17:43:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.555+0000 7f32527fc700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.555+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f3258084e00 con 0x7f325c06bd20 2023-10-08T17:43:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.555+0000 7f326199a700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:32.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.556+0000 7f326199a700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f324c007fd0 tx=0x7f324c009040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:32.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.559+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3258051dc0 con 0x7f325c06bd20 2023-10-08T17:43:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.805+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f325c04c3c0 con 0x7f325c06bd20 2023-10-08T17:43:32.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.805+0000 7f32527fc700 1 -- 172.21.15.12:0/2447844783 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f32580553e0 con 0x7f325c06bd20 2023-10-08T17:43:32.805 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:32.806 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 msgr2=0x7f32400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f324c007fd0 tx=0x7f324c009040 comp rx=0 tx=0).stop 2023-10-08T17:43:32.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 msgr2=0x7f325c158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f325800d860 tx=0x7f3258008040 comp rx=0 tx=0).stop 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 shutdown_connections 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f325c06bd20 0x7f325c158fe0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f325c142c00 0x7f325c13d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 --2- 172.21.15.12:0/2447844783 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f325c0c7f90 0x7f325c13eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 >> 172.21.15.12:0/2447844783 conn(0x7f325c0675a0 msgr2=0x7f325c0c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:32.810 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.807+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 shutdown_connections 2023-10-08T17:43:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:32.808+0000 7f326319d700 1 -- 172.21.15.12:0/2447844783 wait complete. 2023-10-08T17:43:32.811 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:33.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 98, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-08T17:43:21.539783+0000', 'modified': '2023-10-08T17:43:25.072474+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10278': {'gid': 10278, 'name': 'b', 'rank': 0, 'incarnation': 95, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.29:6835/4272081005', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.29:6832', 'nonce': 4272081005}, {'type': 'v1', 'addr': '172.21.15.29:6835', 'nonce': 4272081005}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-08T17:43:33.227 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-08T17:43:33.227 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-08T17:43:33.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.420+0000 7f2b0239d700 1 Processor -- start 2023-10-08T17:43:33.420 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.420+0000 7f2b0239d700 1 -- start start 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2afc13fb20 0x7f2afc15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f2afc06aaa0 0x7f2afc0c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0c8410 con 0x7f2afc13fb20 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc15ae70 con 0x7f2afc06aaa0 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc06af60 con 0x7f2afc13fef0 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2afc13fb20 0x7f2afc15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.428 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2afc13fb20 0x7f2afc15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39192/0 (socket says 172.21.15.12:39192) 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 -- 172.21.15.12:0/1026856414 learned_addr learned my addr 172.21.15.12:0/1026856414 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1026856414 >> v2:172.21.15.29:3300/0 conn(0x7f2afc06aaa0 0x7f2afc0c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 -- 172.21.15.12:0/1026856414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 msgr2=0x7f2afc0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 -- 172.21.15.12:0/1026856414 >> v2:172.21.15.29:3300/0 conn(0x7f2afc06aaa0 msgr2=0x7f2afc0c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1026856414 >> v2:172.21.15.29:3300/0 conn(0x7f2afc06aaa0 0x7f2afc0c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b0139b700 1 -- 172.21.15.12:0/1026856414 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc06b240 con 0x7f2afc13fb20 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.422+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc13fb20 0x7f2afc15a930 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2afc156920 tx=0x7f2af8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0750ff6e905cb2f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2af3fff700 1 -- 172.21.15.12:0/1026856414 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800b860 con 0x7f2afc13fb20 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2af3fff700 1 -- 172.21.15.12:0/1026856414 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af800b9c0 con 0x7f2afc13fb20 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2af3fff700 1 -- 172.21.15.12:0/1026856414 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af800bd60 con 0x7f2afc13fb20 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 -- 172.21.15.12:0/1026856414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc13fb20 msgr2=0x7f2afc15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc13fb20 0x7f2afc15a930 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2afc156920 tx=0x7f2af8009250 comp rx=0 tx=0).stop 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 -- 172.21.15.12:0/1026856414 shutdown_connections 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 --2- 172.21.15.12:0/1026856414 >> v2:172.21.15.29:3300/0 conn(0x7f2afc06aaa0 0x7f2afc0c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc13fb20 0x7f2afc15a930 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 --2- 172.21.15.12:0/1026856414 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.423+0000 7f2b0239d700 1 -- 172.21.15.12:0/1026856414 >> 172.21.15.12:0/1026856414 conn(0x7f2afc06d170 msgr2=0x7f2afc0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.424+0000 7f2b0239d700 1 -- 172.21.15.12:0/1026856414 shutdown_connections 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.424+0000 7f2b0239d700 1 -- 172.21.15.12:0/1026856414 wait complete. 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.425+0000 7f2b0239d700 1 Processor -- start 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.425+0000 7f2b0239d700 1 -- start start 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 0x7f2afc1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc159240 con 0x7f2afc06aaa0 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0c69a0 con 0x7f2afc13fb20 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0c6c40 con 0x7f2afc13fef0 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39204/0 (socket says 172.21.15.12:39204) 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b0139b700 1 -- 172.21.15.12:0/3753927107 learned_addr learned my addr 172.21.15.12:0/3753927107 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.426+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 0x7f2afc1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 -- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 msgr2=0x7f2afc155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 -- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 msgr2=0x7f2afc1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 0x7f2afc1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 -- 172.21.15.12:0/3753927107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af80094f0 con 0x7f2afc06aaa0 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 0x7f2afc1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0139b700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009290 tx=0x7f2af8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2af17fa700 1 -- 172.21.15.12:0/3753927107 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8024440 con 0x7f2afc06aaa0 2023-10-08T17:43:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2af17fa700 1 -- 172.21.15.12:0/3753927107 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af80245a0 con 0x7f2afc06aaa0 2023-10-08T17:43:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2af17fa700 1 -- 172.21.15.12:0/3753927107 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8024960 con 0x7f2afc06aaa0 2023-10-08T17:43:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc0c6ee0 con 0x7f2afc06aaa0 2023-10-08T17:43:33.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.427+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc0c7270 con 0x7f2afc06aaa0 2023-10-08T17:43:33.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.429+0000 7f2af17fa700 1 -- 172.21.15.12:0/3753927107 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2af801a420 con 0x7f2afc06aaa0 2023-10-08T17:43:33.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.430+0000 7f2af17fa700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.430+0000 7f2af17fa700 1 -- 172.21.15.12:0/3753927107 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f2af8086670 con 0x7f2afc06aaa0 2023-10-08T17:43:33.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.430+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.431+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 0x7f2ae00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2afc13d0d0 tx=0x7f2aec008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.432+0000 7f2b11c60b80 1 Processor -- start 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 -- start start 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 0x55d985b407d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 0x55d985b61850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985a6da70 con 0x55d985b16b80 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985a6b270 con 0x55d985b61480 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.433+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d985a67060 con 0x55d985b145f0 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39214/0 (socket says 172.21.15.12:39214) 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 -- 172.21.15.12:0/1328727543 learned_addr learned my addr 172.21.15.12:0/1328727543 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 0x55d985b407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 0x55d985b61850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 -- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 msgr2=0x55d985b61850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 0x55d985b61850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 -- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 msgr2=0x55d985b407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 0x55d985b407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 -- 172.21.15.12:0/1328727543 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d985901270 con 0x55d985b16b80 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 0x55d985b61850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 0x55d985b407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.434+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009f60 tx=0x7f2af40097b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adcbc5c1833e093 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2ae67fc700 1 -- 172.21.15.12:0/1328727543 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4015420 con 0x55d985b16b80 2023-10-08T17:43:33.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2ae67fc700 1 -- 172.21.15.12:0/1328727543 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af4015580 con 0x55d985b16b80 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2ae67fc700 1 -- 172.21.15.12:0/1328727543 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af4015900 con 0x55d985b16b80 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1328727543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 msgr2=0x55d985b16ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f2af4009f60 tx=0x7f2af40097b0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1328727543 shutdown_connections 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b16ff0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b61480 0x55d985b407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1328727543 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b145f0 0x55d985b61850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1328727543 >> 172.21.15.12:0/1328727543 conn(0x55d985b180c0 msgr2=0x55d985b188f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1328727543 shutdown_connections 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.435+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1328727543 wait complete. 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.436+0000 7f2b11c60b80 1 -- start start 2023-10-08T17:43:33.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.436+0000 7f2b11c60b80 1 Processor -- start 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b0d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b0db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985a12890 con 0x55d985b145f0 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985a2dea0 con 0x55d985b16b80 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9858e9e30 con 0x55d985b61480 2023-10-08T17:43:33.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.437+0000 7f2b11c60b80 10 client.0 _ll_register_callbacks cb 0x55d985ada2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39218/0 (socket says 172.21.15.12:39218) 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 -- 172.21.15.12:0/1464318950 learned_addr learned my addr 172.21.15.12:0/1464318950 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b0db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 -- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 msgr2=0x55d985b0db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b0db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 -- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 msgr2=0x55d985b0d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b0d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 -- 172.21.15.12:0/1464318950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af4011040 con 0x55d985b145f0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f2af800b3c0 tx=0x7f2af8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9769accdd7fbc467 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2adb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af805a5c0 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f2af805e310 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.438+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d985b0bcd0 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2af802b550 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 10 client.10443 fetch_fsmap learned FSMap version 98 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x55d9858a3fe0 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d985b0bcd0 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2af80575d0 con 0x55d985b145f0 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 10 client.10443 fetch_fsmap finished waiting for FSMap version 98 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 10 client.10443 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 20 client.10443 populate_metadata read hostname 'smithi012' 2023-10-08T17:43:33.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b60720 0x55d985b60af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 4 client.10443 mds_command: new command op to 10278 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 --> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d985ae8aa0 con 0x55d985b60720 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.439+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b60720 0x55d985b60af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.440+0000 7f2adb7fe700 10 client.10443 ms_handle_connect on v2:172.21.15.29:6832/4272081005 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.440+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b60720 0x55d985b60af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aac910bdc1b28ba6 server_cookie=5e754ce1d44146d1 in_seq=0 out_seq=0 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1464318950 <== mds.0 v2:172.21.15.29:6832/4272081005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d985ae8aa0 con 0x55d985b60720 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2adb7fe700 10 client.10443 handle_command_reply: tid=0 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 client.10443 shutdown 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 msgr2=0x55d985b5d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f2af800b3c0 tx=0x7f2af8086040 comp rx=0 tx=0).stop 2023-10-08T17:43:33.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 shutdown_connections 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b5d320 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b60720 0x55d985b60af0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b0db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.441+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1464318950 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b0d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.442+0000 7f2adb7fe700 0 client.10443 ms_handle_reset on v2:172.21.15.29:6832/4272081005 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.442+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 >> 172.21.15.12:0/1464318950 conn(0x55d985b180c0 msgr2=0x55d985b1a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.442+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 shutdown_connections 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.442+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1464318950 wait complete. 2023-10-08T17:43:33.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.442+0000 7f2b11c60b80 20 client.10443 trim_cache size 0 max 16384 2023-10-08T17:43:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.459+0000 7f2b11c60b80 1 Processor -- start 2023-10-08T17:43:33.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.459+0000 7f2b11c60b80 1 -- start start 2023-10-08T17:43:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b6c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b6c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985b44030 con 0x55d985b145f0 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985b14b90 con 0x55d985b16b80 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.460+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d985b5fd10 con 0x55d985b61480 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39224/0 (socket says 172.21.15.12:39224) 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 -- 172.21.15.12:0/1025231924 learned_addr learned my addr 172.21.15.12:0/1025231924 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b6c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b6c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 -- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 msgr2=0x55d985b6c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b6c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 -- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 msgr2=0x55d985b6c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b6c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 -- 172.21.15.12:0/1025231924 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d985a35780 con 0x55d985b145f0 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b6c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2af8057530 tx=0x7f2af806b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11e4454efbaa690 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2ae6ffd700 1 -- 172.21.15.12:0/1025231924 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af802b550 con 0x55d985b145f0 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2ae6ffd700 1 -- 172.21.15.12:0/1025231924 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af805e310 con 0x55d985b145f0 2023-10-08T17:43:33.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.461+0000 7f2ae6ffd700 1 -- 172.21.15.12:0/1025231924 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af805a5c0 con 0x55d985b145f0 2023-10-08T17:43:33.466 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1025231924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 msgr2=0x55d985b0d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2af8057530 tx=0x7f2af806b000 comp rx=0 tx=0).stop 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1025231924 shutdown_connections 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b145f0 0x55d985b0d820 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b6c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1025231924 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b16b80 0x55d985b6c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1025231924 >> 172.21.15.12:0/1025231924 conn(0x55d985b180c0 msgr2=0x55d985b13a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1025231924 shutdown_connections 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.462+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1025231924 wait complete. 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.463+0000 7f2b11c60b80 1 -- start start 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.463+0000 7f2b11c60b80 1 Processor -- start 2023-10-08T17:43:33.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 0x55d985b6f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b3b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985bc4d10 con 0x55d985b16b80 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d985b3f690 con 0x55d985b145f0 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d985b3f950 con 0x55d985b61480 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b11c60b80 10 client.0 _ll_register_callbacks cb 0x55d985ada2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b00b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b00b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39228/0 (socket says 172.21.15.12:39228) 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b00b9a700 1 -- 172.21.15.12:0/1080288435 learned_addr learned my addr 172.21.15.12:0/1080288435 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b01b9c700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b3b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 0x55d985b6f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.464+0000 7f2b00b9a700 1 -- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 msgr2=0x55d985b3b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b3b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b00b9a700 1 -- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 msgr2=0x55d985b6f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 0x55d985b6f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b00b9a700 1 -- 172.21.15.12:0/1080288435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9858a3fe0 con 0x55d985b16b80 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 0x55d985b6f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b00b9a700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x55d985b15d50 tx=0x7f2aec016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d947ff25a663a25a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2adb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.12:3300/0 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec006040 con 0x55d985b16b80 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mon.0 v2:172.21.15.12:3300/0 2 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f2aec02fd10 con 0x55d985b16b80 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2afc06ea60 con 0x55d985b16b80 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aec0063b0 con 0x55d985b16b80 2023-10-08T17:43:33.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b11c60b80 10 client.10449 fetch_fsmap learned FSMap version 98 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.465+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=2+}) v3 -- 0x55d985a1c470 con 0x55d985b16b80 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mon.0 v2:172.21.15.12:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc06ea60 con 0x55d985b16b80 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mon.0 v2:172.21.15.12:3300/0 5 ==== fsmap(e 98) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2aec021030 con 0x55d985b16b80 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 10 client.10449 fetch_fsmap finished waiting for FSMap version 98 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 10 client.10449 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 20 client.10449 populate_metadata read hostname 'smithi012' 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b3b8b0 0x55d985b3bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 4 client.10449 mds_command: new command op to 10278 tid=0[{"prefix": "status"}] 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 --> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f2af4015580 con 0x55d985b3b8b0 2023-10-08T17:43:33.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.466+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b3b8b0 0x55d985b3bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b0139b700 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b3b8b0 0x55d985b3bc80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ed2f34d7b91ffb server_cookie=5f72e22e60f49572 in_seq=0 out_seq=0 2023-10-08T17:43:33.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2adb7fe700 10 client.10449 ms_handle_connect on v2:172.21.15.29:6832/4272081005 2023-10-08T17:43:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2adb7fe700 1 -- 172.21.15.12:0/1080288435 <== mds.0 v2:172.21.15.29:6832/4272081005 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x7f2af4015580 con 0x55d985b3b8b0 2023-10-08T17:43:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2adb7fe700 10 client.10449 handle_command_reply: tid=0 2023-10-08T17:43:33.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 client.10449 shutdown 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 msgr2=0x55d985b6f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x55d985b15d50 tx=0x7f2aec016000 comp rx=0 tx=0).stop 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 shutdown_connections 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:6832/4272081005,v1:172.21.15.29:6835/4272081005] conn(0x55d985b3b8b0 0x55d985b3bc80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x55d985b61480 0x55d985b3b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x55d985b145f0 0x55d985b6f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2adb7fe700 0 client.10449 ms_handle_reset on v2:172.21.15.29:6832/4272081005 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 --2- 172.21.15.12:0/1080288435 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d985b16b80 0x55d985b6f690 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 >> 172.21.15.12:0/1080288435 conn(0x55d985b180c0 msgr2=0x55d985b188d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 shutdown_connections 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.467+0000 7f2b11c60b80 1 -- 172.21.15.12:0/1080288435 wait complete. 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b11c60b80 20 client.10449 trim_cache size 0 max 16384 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "cluster_fsid": "0ae45396-6d03-47bf-984b-756ce4c92578", 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "whoami": 0, 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "id": 10278, 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "want_state": "up:active", 2023-10-08T17:43:33.474 INFO:teuthology.orchestra.run.smithi012.stdout: "state": "up:active", 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "fs_name": "cephfs", 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "rank_uptime": 11.405691790000001, 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "mdsmap_epoch": 98, 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch": 213, 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "osdmap_epoch_barrier": 213, 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout: "uptime": 17.131520662 2023-10-08T17:43:33.475 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 msgr2=0x7f2ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 0x7f2ae00693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2afc13d0d0 tx=0x7f2aec008040 comp rx=0 tx=0).stop 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 msgr2=0x7f2afc168350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009290 tx=0x7f2af8017000 comp rx=0 tx=0).stop 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 shutdown_connections 2023-10-08T17:43:33.476 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2afc06aaa0 0x7f2afc168350 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2afc13fef0 0x7f2afc155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 --2- 172.21.15.12:0/3753927107 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2afc13fb20 0x7f2afc1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 >> 172.21.15.12:0/3753927107 conn(0x7f2afc06d170 msgr2=0x7f2afc0cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 shutdown_connections 2023-10-08T17:43:33.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.468+0000 7f2b0239d700 1 -- 172.21.15.12:0/3753927107 wait complete. 2023-10-08T17:43:33.485 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-08T17:43:33.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.671+0000 7fae46b9d700 1 Processor -- start 2023-10-08T17:43:33.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.672+0000 7fae46b9d700 1 -- start start 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae46b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 0x7fae4015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae46b9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fae4006aaa0 0x7fae400c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae46b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4015ae70 con 0x7fae4013fb20 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae46b9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4006af60 con 0x7fae4006aaa0 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae46b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4006b240 con 0x7fae4013fef0 2023-10-08T17:43:33.674 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae45b9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fae4013fb20 0x7fae400c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44526/0 (socket says 172.21.15.12:44526) 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae45b9b700 1 -- 172.21.15.12:0/618551430 learned_addr learned my addr 172.21.15.12:0/618551430 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.673+0000 7fae4539a700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 0x7fae4015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 --2- 172.21.15.12:0/618551430 >> v2:172.21.15.29:3300/0 conn(0x7fae4006aaa0 0x7fae400c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae44b99700 1 -- 172.21.15.12:0/618551430 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109896031 0 0) 0x7fae3c001110 con 0x7fae4013fb20 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae44b99700 1 -- 172.21.15.12:0/618551430 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae2c003570 con 0x7fae4013fb20 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 -- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 msgr2=0x7fae4015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 0x7fae4015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 -- 172.21.15.12:0/618551430 >> v1:172.21.15.12:6789/0 conn(0x7fae4013fb20 legacy=0x7fae400c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 -- 172.21.15.12:0/618551430 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4006b520 con 0x7fae4006aaa0 2023-10-08T17:43:33.675 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4539a700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 0x7fae4015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:33.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.674+0000 7fae4639c700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4006aaa0 0x7fae400c9d00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fae38009e60 tx=0x7fae38009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5652ae864336a586 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae44b99700 1 -- 172.21.15.12:0/618551430 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800e070 con 0x7fae4006aaa0 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae44b99700 1 -- 172.21.15.12:0/618551430 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3800bab0 con 0x7fae4006aaa0 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae44b99700 1 -- 172.21.15.12:0/618551430 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800be70 con 0x7fae4006aaa0 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 -- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4006aaa0 msgr2=0x7fae400c9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4006aaa0 0x7fae400c9d00 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fae38009e60 tx=0x7fae38009780 comp rx=0 tx=0).stop 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 -- 172.21.15.12:0/618551430 shutdown_connections 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4006aaa0 0x7fae400c9d00 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 --2- 172.21.15.12:0/618551430 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fef0 0x7fae4015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.677 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 -- 172.21.15.12:0/618551430 >> 172.21.15.12:0/618551430 conn(0x7fae4006d170 msgr2=0x7fae400cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 -- 172.21.15.12:0/618551430 shutdown_connections 2023-10-08T17:43:33.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.675+0000 7fae46b9d700 1 -- 172.21.15.12:0/618551430 wait complete. 2023-10-08T17:43:33.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.677+0000 7fae46b9d700 1 Processor -- start 2023-10-08T17:43:33.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.677+0000 7fae46b9d700 1 -- start start 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 0x7fae40155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 0x7fae40158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400ad820 con 0x7fae4006aaa0 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400adb00 con 0x7fae4013fef0 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae46b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400adde0 con 0x7fae4013fb20 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39236/0 (socket says 172.21.15.12:39236) 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 -- 172.21.15.12:0/628208931 learned_addr learned my addr 172.21.15.12:0/628208931 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:33.680 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae4639c700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 0x7fae40158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae4539a700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 0x7fae40155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 -- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 msgr2=0x7fae40155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 0x7fae40155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 -- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 msgr2=0x7fae40158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 0x7fae40158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae45b9b700 1 -- 172.21.15.12:0/628208931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300093c0 con 0x7fae4006aaa0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae4639c700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 0x7fae40158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.678+0000 7fae4539a700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 0x7fae40155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae45b9b700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c7c0 tx=0x7fae3c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c005b30 con 0x7fae4006aaa0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c005c90 con 0x7fae4006aaa0 2023-10-08T17:43:33.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3c007320 con 0x7fae4006aaa0 2023-10-08T17:43:33.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae38009a20 con 0x7fae4006aaa0 2023-10-08T17:43:33.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.679+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae40159370 con 0x7fae4006aaa0 2023-10-08T17:43:33.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.680+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4004c3c0 con 0x7fae4006aaa0 2023-10-08T17:43:33.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.681+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae3c01b400 con 0x7fae4006aaa0 2023-10-08T17:43:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.682+0000 7fae35ffb700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 0x7fae240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.682+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fae3c084060 con 0x7fae4006aaa0 2023-10-08T17:43:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.682+0000 7fae4539a700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 0x7fae240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:33.683 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.683+0000 7fae4539a700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 0x7fae240693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae30009390 tx=0x7fae30008040 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:33.686 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.686+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae3c0510a0 con 0x7fae4006aaa0 2023-10-08T17:43:33.932 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.932+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fae4015b350 con 0x7fae4006aaa0 2023-10-08T17:43:33.933 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.932+0000 7fae35ffb700 1 -- 172.21.15.12:0/628208931 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v98) v1 ==== 53+0+73 (secure 0 0 0) 0x7fae3c0546c0 con 0x7fae4006aaa0 2023-10-08T17:43:33.933 INFO:teuthology.orchestra.run.smithi012.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-08T17:43:33.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 msgr2=0x7fae240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 0x7fae240693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae30009390 tx=0x7fae30008040 comp rx=0 tx=0).stop 2023-10-08T17:43:33.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 msgr2=0x7fae40158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:33.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fae3c00c7c0 tx=0x7fae3c007c70 comp rx=0 tx=0).stop 2023-10-08T17:43:33.935 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 shutdown_connections 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fae24066f30 0x7fae240693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fae4006aaa0 0x7fae40158e30 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fae4013fef0 0x7fae40158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 --2- 172.21.15.12:0/628208931 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fae4013fb20 0x7fae40155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 >> 172.21.15.12:0/628208931 conn(0x7fae4006d170 msgr2=0x7fae400c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 shutdown_connections 2023-10-08T17:43:33.936 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:33.935+0000 7fae46b9d700 1 -- 172.21.15.12:0/628208931 wait complete. 2023-10-08T17:43:33.952 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi012.front.sepia.ceph.com 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-08T17:43:33.953 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:43:33.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:33.953 DEBUG:teuthology.orchestra.run.smithi012:> ip addr 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: inet 127.0.0.1/8 scope host lo 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 ::1/128 scope host 2023-10-08T17:43:33.991 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a4 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f0 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:ea brd ff:ff:ff:ff:ff:ff 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f0 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: inet 172.21.15.12/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft 36528sec preferred_lft 36528sec 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ae1f:6bff:fef8:25ea/64 scope link noprefixroute 2023-10-08T17:43:33.992 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 0c:c4:7a:6b:fd:a5 brd ff:ff:ff:ff:ff:ff 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp7s0f1 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ac:1f:6b:f8:25:eb brd ff:ff:ff:ff:ff:ff 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: altname enp1s0f1 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-08T17:43:33.993 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::a88f:9aff:fe27:f0d3/64 scope link 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether ee:19:fd:51:44:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::ec19:fdff:fe51:44e1/64 scope link 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: link/ether 3a:99:62:04:d5:3e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: inet6 fe80::3899:62ff:fe04:d53e/64 scope link 2023-10-08T17:43:33.994 INFO:teuthology.orchestra.run.smithi012.stdout: valid_lft forever preferred_lft forever 2023-10-08T17:43:33.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:33.995 DEBUG:teuthology.orchestra.run.smithi012:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-08T17:43:34.091 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-10-08T17:43:34.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:34.095 DEBUG:teuthology.orchestra.run.smithi012:> route 2023-10-08T17:43:34.133 INFO:teuthology.orchestra.run.smithi012.stdout:Kernel IP routing table 2023-10-08T17:43:34.134 INFO:teuthology.orchestra.run.smithi012.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-08T17:43:34.134 INFO:teuthology.orchestra.run.smithi012.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-08T17:43:34.134 INFO:teuthology.orchestra.run.smithi012.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-08T17:43:34.134 INFO:teuthology.orchestra.run.smithi012.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-08T17:43:34.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:34.135 DEBUG:teuthology.orchestra.run.smithi012:> (cd / && exec bash -c ' 2023-10-08T17:43:34.135 DEBUG:teuthology.orchestra.run.smithi012:> set -e 2023-10-08T17:43:34.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-08T17:43:34.135 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-08T17:43:34.136 DEBUG:teuthology.orchestra.run.smithi012:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-08T17:43:34.136 DEBUG:teuthology.orchestra.run.smithi012:> ') 2023-10-08T17:43:34.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:34.337 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:43:34.373 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T17:43:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T17:43:34.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:43:34.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:34.374 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link set brx.0 up 2023-10-08T17:43:34.477 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:43:34.477 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:34.514 INFO:teuthology.orchestra.run.smithi012.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-08T17:43:34.514 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-08T17:43:34.514 DEBUG:teuthology.orchestra.run.smithi012:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:34.590 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-08T17:43:34.590 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-08T17:43:34.590 DEBUG:teuthology.orchestra.run.smithi012:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:43:34.722 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:43:34.722 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:43:34.752 INFO:teuthology.orchestra.run.smithi012.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-08T17:43:34.752 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-08T17:43:34.752 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: resolved to: "172.21.15.12:3300,172.21.15.29:3300,172.21.15.29:3301" 2023-10-08T17:43:34.752 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: trying mount with new device syntax: 0@0ae45396-6d03-47bf-984b-756ce4c92578.cephfs=/ 2023-10-08T17:43:34.752 INFO:teuthology.orchestra.run.smithi012.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.12:3300/172.21.15.29:3300/172.21.15.29:3301" will pass to kernel 2023-10-08T17:43:34.757 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-08T17:43:34.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:34.757 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:34.821 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-08T17:43:35.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.008+0000 7ffbc4b9d700 1 Processor -- start 2023-10-08T17:43:35.008 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.008+0000 7ffbc4b9d700 1 -- start start 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.009+0000 7ffbc4b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 0x7ffbc015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbc4b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc015ae70 con 0x7ffbc013fef0 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbc4b9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc006af60 con 0x7ffbc006aaa0 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbc4b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc006b240 con 0x7ffbc013fb20 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbeffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ffbc013fef0 0x7ffbc00c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44528/0 (socket says 172.21.15.12:44528) 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbeffd700 1 -- 172.21.15.12:0/276322022 learned_addr learned my addr 172.21.15.12:0/276322022 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:35.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/276322022 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 0x7ffbc015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125219448 0 0) 0x7ffbb4001290 con 0x7ffbc013fef0 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba8003570 con 0x7ffbc013fef0 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715350250 0 0) 0x7ffbc006af60 con 0x7ffbc006aaa0 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb4001290 con 0x7ffbc006aaa0 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbf7fe700 1 -- 172.21.15.12:0/276322022 >> v1:172.21.15.29:6789/0 conn(0x7ffbc006aaa0 legacy=0x7ffbc00c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.010+0000 7ffbbf7fe700 1 -- 172.21.15.12:0/276322022 >> v1:172.21.15.12:6789/0 conn(0x7ffbc013fef0 legacy=0x7ffbc00c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.011+0000 7ffbbf7fe700 1 -- 172.21.15.12:0/276322022 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc006b520 con 0x7ffbc013fb20 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.011+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/276322022 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 0x7ffbc015a930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009910 tx=0x7ffbb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600cae76c0f2bc85 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.011+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0011630 con 0x7ffbc013fb20 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.011+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb0011790 con 0x7ffbc013fb20 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.011+0000 7ffbbe7fc700 1 -- 172.21.15.12:0/276322022 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0011b10 con 0x7ffbc013fb20 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/276322022 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 msgr2=0x7ffbc015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/276322022 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 0x7ffbc015a930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009910 tx=0x7ffbb00091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/276322022 shutdown_connections 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/276322022 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc013fb20 0x7ffbc015a930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/276322022 >> 172.21.15.12:0/276322022 conn(0x7ffbc006d170 msgr2=0x7ffbc00cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/276322022 shutdown_connections 2023-10-08T17:43:35.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.012+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/276322022 wait complete. 2023-10-08T17:43:35.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.013+0000 7ffbc4b9d700 1 Processor -- start 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.013+0000 7ffbc4b9d700 1 -- start start 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 0x7ffbc0155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 0x7ffbc00cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc016a8f0 con 0x7ffbc013fb20 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0169d20 con 0x7ffbc013fef0 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.014+0000 7ffbc4b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc0169fc0 con 0x7ffbc006aaa0 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39246/0 (socket says 172.21.15.12:39246) 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 -- 172.21.15.12:0/1899274374 learned_addr learned my addr 172.21.15.12:0/1899274374 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:35.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 0x7ffbc0155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbffff700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 0x7ffbc00cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 -- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 msgr2=0x7ffbc0155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 0x7ffbc0155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 -- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 msgr2=0x7ffbc00cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 0x7ffbc00cadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 -- 172.21.15.12:0/1899274374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb0009420 con 0x7ffbc013fb20 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbffff700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 0x7ffbc00cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 0x7ffbc0155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.015+0000 7ffbbeffd700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400c7f0 tx=0x7ffbb4007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.016+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4007300 con 0x7ffbc013fb20 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.016+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb4007460 con 0x7ffbc013fb20 2023-10-08T17:43:35.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.016+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40057f0 con 0x7ffbc013fb20 2023-10-08T17:43:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.016+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc016a2a0 con 0x7ffbc013fb20 2023-10-08T17:43:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.016+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc0158c70 con 0x7ffbc013fb20 2023-10-08T17:43:35.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.017+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbc016aa60 con 0x7ffbc013fb20 2023-10-08T17:43:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.018+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbb4005c20 con 0x7ffbc013fb20 2023-10-08T17:43:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.018+0000 7ffba77fe700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 0x7ffbac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.019+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ffbb4084380 con 0x7ffbc013fb20 2023-10-08T17:43:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.019+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 0x7ffbac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.020+0000 7ffbbf7fe700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 0x7ffbac0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00ad130 tx=0x7ffbb0017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.023+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffbb40513c0 con 0x7ffbc013fb20 2023-10-08T17:43:35.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.253+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7ffbc015ae70 con 0x7ffbac066f30 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.255+0000 7ffba77fe700 1 -- 172.21.15.12:0/1899274374 <== mgr.9436 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ffbc015ae70 con 0x7ffbac066f30 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stdout:[ 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: { 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: "name": "cephfs" 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stdout: } 2023-10-08T17:43:35.255 INFO:teuthology.orchestra.run.smithi012.stdout:] 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 msgr2=0x7ffbac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 0x7ffbac0693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00ad130 tx=0x7ffbb0017000 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 msgr2=0x7ffbc00ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7ffbb400c7f0 tx=0x7ffbb4007ce0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 shutdown_connections 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffbac066f30 0x7ffbac0693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffbc013fef0 0x7ffbc00cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffbc006aaa0 0x7ffbc0155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 --2- 172.21.15.12:0/1899274374 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffbc013fb20 0x7ffbc00ca880 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.257+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 >> 172.21.15.12:0/1899274374 conn(0x7ffbc006d170 msgr2=0x7ffbc013e810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.258+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 shutdown_connections 2023-10-08T17:43:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.258+0000 7ffbc4b9d700 1 -- 172.21.15.12:0/1899274374 wait complete. 2023-10-08T17:43:35.275 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-10-08T17:43:35.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.465+0000 7fb7ec99d700 1 Processor -- start 2023-10-08T17:43:35.465 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.465+0000 7fb7ec99d700 1 -- start start 2023-10-08T17:43:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.466+0000 7fb7ec99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7e8159580 0x7fb7e80b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.466+0000 7fb7ec99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 0x7fb7e80b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.468 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.466+0000 7fb7ec99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e815bc40 con 0x7fb7e80cb1e0 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.466+0000 7fb7ec99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e815b070 con 0x7fb7e8159580 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.466+0000 7fb7ec99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e815b310 con 0x7fb7e806ded0 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7e8159580 0x7fb7e80b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7e8159580 0x7fb7e80b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39256/0 (socket says 172.21.15.12:39256) 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e6ffd700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb7e80cb1e0 0x7fb7e806d7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44530/0 (socket says 172.21.15.12:44530) 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 -- 172.21.15.12:0/1739458681 learned_addr learned my addr 172.21.15.12:0/1739458681 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e7fff700 1 --2- 172.21.15.12:0/1739458681 >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 0x7fb7e80b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 -- 172.21.15.12:0/1739458681 >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 msgr2=0x7fb7e80b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 --2- 172.21.15.12:0/1739458681 >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 0x7fb7e80b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 -- 172.21.15.12:0/1739458681 >> v1:172.21.15.12:6789/0 conn(0x7fb7e80cb1e0 legacy=0x7fb7e806d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 -- 172.21.15.12:0/1739458681 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e815b5f0 con 0x7fb7e8159580 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e7fff700 1 --2- 172.21.15.12:0/1739458681 >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 0x7fb7e80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:35.469 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.467+0000 7fb7e77fe700 1 --2- 172.21.15.12:0/1739458681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80b23f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80b13e0 tx=0x7fb7d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545478a21a2721ed server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7e67fc700 1 -- 172.21.15.12:0/1739458681 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800b860 con 0x7fb7e8159580 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7e67fc700 1 -- 172.21.15.12:0/1739458681 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d800b9c0 con 0x7fb7e8159580 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7e67fc700 1 -- 172.21.15.12:0/1739458681 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d800bd60 con 0x7fb7e8159580 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 -- 172.21.15.12:0/1739458681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 msgr2=0x7fb7e80b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/1739458681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80b23f0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80b13e0 tx=0x7fb7d8009250 comp rx=0 tx=0).stop 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 -- 172.21.15.12:0/1739458681 shutdown_connections 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/1739458681 >> v2:172.21.15.29:3300/0 conn(0x7fb7e806ded0 0x7fb7e80b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.470 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/1739458681 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80b23f0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 -- 172.21.15.12:0/1739458681 >> 172.21.15.12:0/1739458681 conn(0x7fb7e80703a0 msgr2=0x7fb7e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 -- 172.21.15.12:0/1739458681 shutdown_connections 2023-10-08T17:43:35.471 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.468+0000 7fb7ec99d700 1 -- 172.21.15.12:0/1739458681 wait complete. 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.470+0000 7fb7ec99d700 1 Processor -- start 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.470+0000 7fb7ec99d700 1 -- start start 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7e806ded0 0x7fb7e814d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 0x7fb7e80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c95d0 con 0x7fb7e8159580 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c9140 con 0x7fb7e806ded0 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7ec99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e814de60 con 0x7fb7e80cb1e0 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39264/0 (socket says 172.21.15.12:39264) 2023-10-08T17:43:35.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7e7fff700 1 -- 172.21.15.12:0/3416092184 learned_addr learned my addr 172.21.15.12:0/3416092184 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7e77fe700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7e806ded0 0x7fb7e814d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.471+0000 7fb7e6ffd700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 0x7fb7e80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 -- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 msgr2=0x7fb7e80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 0x7fb7e80cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 -- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7e806ded0 msgr2=0x7fb7e814d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7e806ded0 0x7fb7e814d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 -- 172.21.15.12:0/3416092184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80094f0 con 0x7fb7e8159580 2023-10-08T17:43:35.474 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e6ffd700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 0x7fb7e80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7e7fff700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000cf90 tx=0x7fb7e00078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0015440 con 0x7fb7e8159580 2023-10-08T17:43:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e00155a0 con 0x7fb7e8159580 2023-10-08T17:43:35.477 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e80c8530 con 0x7fb7e8159580 2023-10-08T17:43:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0015960 con 0x7fb7e8159580 2023-10-08T17:43:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.472+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e80c8af0 con 0x7fb7e8159580 2023-10-08T17:43:35.478 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.473+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8088b50 con 0x7fb7e8159580 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.474+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 106) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7e0015d50 con 0x7fb7e8159580 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.475+0000 7fb7cf7fe700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 0x7fb7d4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.475+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7fb7e0084c20 con 0x7fb7e8159580 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.475+0000 7fb7e77fe700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 0x7fb7d4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.476+0000 7fb7e77fe700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 0x7fb7d4069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80b13e0 tx=0x7fb7d8017000 comp rx=0 tx=0).ready entity=mgr.9436 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:35.479 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.479+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7e0051be0 con 0x7fb7e8159580 2023-10-08T17:43:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:35.735+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fb7e80c9280 con 0x7fb7e8159580 2023-10-08T17:43:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.343+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 107) v1 ==== 84757+0+0 (secure 0 0 0) 0x7fb7e0051fb0 con 0x7fb7e8159580 2023-10-08T17:43:36.344 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.345+0000 7fb7cf7fe700 1 -- 172.21.15.12:0/3416092184 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v107) v1 ==== 92+0+0 (secure 0 0 0) 0x7fb7e0055670 con 0x7fb7e8159580 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 msgr2=0x7fb7d4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 0x7fb7d4069410 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80b13e0 tx=0x7fb7d8017000 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 msgr2=0x7fb7e80ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000cf90 tx=0x7fb7e00078a0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 shutdown_connections 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7d4066f60 0x7fb7d4069410 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7e8159580 0x7fb7e80ce520 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7e806ded0 0x7fb7e814d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 --2- 172.21.15.12:0/3416092184 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7e80cb1e0 0x7fb7e80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.348+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 >> 172.21.15.12:0/3416092184 conn(0x7fb7e80703a0 msgr2=0x7fb7e80b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:36.349 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.349+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 shutdown_connections 2023-10-08T17:43:36.350 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.349+0000 7fb7ec99d700 1 -- 172.21.15.12:0/3416092184 wait complete. 2023-10-08T17:43:36.377 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-10-08T17:43:36.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.572+0000 7ff8c89fe700 1 Processor -- start 2023-10-08T17:43:36.573 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.573+0000 7ff8c89fe700 1 -- start start 2023-10-08T17:43:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c89fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8c40c7be0 0x7ff8c406abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c413f780 0x7ff8c413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c89fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8c4140120 con 0x7ff8c40c7fb0 2023-10-08T17:43:36.574 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c89fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8c406bf10 con 0x7ff8c40c7be0 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c406b290 con 0x7ff8c413f780 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8c40c7be0 0x7ff8c406abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c259c700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7ff8c40c7fb0 0x7ff8c415a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:44270/0 (socket says 172.21.15.12:44270) 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c413f780 0x7ff8c413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c2d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff8c40c7be0 0x7ff8c406abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39288/0 (socket says 172.21.15.12:39288) 2023-10-08T17:43:36.575 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.574+0000 7ff8c259c700 1 -- 172.21.15.12:0/3438398655 learned_addr learned my addr 172.21.15.12:0/3438398655 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:36.576 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c2d9d700 1 -- 172.21.15.12:0/3438398655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c413f780 msgr2=0x7ff8c413fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c1d9b700 1 -- 172.21.15.12:0/3438398655 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281798182 0 0) 0x7ff8b8001110 con 0x7ff8c40c7fb0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/3438398655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c413f780 0x7ff8c413fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c2d9d700 1 -- 172.21.15.12:0/3438398655 >> v1:172.21.15.29:6789/0 conn(0x7ff8c40c7fb0 legacy=0x7ff8c415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c2d9d700 1 -- 172.21.15.12:0/3438398655 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c406b570 con 0x7ff8c40c7be0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/3438398655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c40c7be0 0x7ff8c406abd0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400bb90 tx=0x7ff8b400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfad15a93a21756c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c1d9b700 1 -- 172.21.15.12:0/3438398655 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b400db40 con 0x7ff8c40c7be0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c1d9b700 1 -- 172.21.15.12:0/3438398655 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b400dca0 con 0x7ff8c40c7be0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.575+0000 7ff8c1d9b700 1 -- 172.21.15.12:0/3438398655 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b40196b0 con 0x7ff8c40c7be0 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 -- 172.21.15.12:0/3438398655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c40c7be0 msgr2=0x7ff8c406abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/3438398655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c40c7be0 0x7ff8c406abd0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7ff8b400bb90 tx=0x7ff8b400b430 comp rx=0 tx=0).stop 2023-10-08T17:43:36.577 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 -- 172.21.15.12:0/3438398655 shutdown_connections 2023-10-08T17:43:36.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/3438398655 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c413f780 0x7ff8c413fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/3438398655 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c40c7be0 0x7ff8c406abd0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 -- 172.21.15.12:0/3438398655 >> 172.21.15.12:0/3438398655 conn(0x7ff8c406d110 msgr2=0x7ff8c40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:36.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 -- 172.21.15.12:0/3438398655 shutdown_connections 2023-10-08T17:43:36.578 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.576+0000 7ff8c89fe700 1 -- 172.21.15.12:0/3438398655 wait complete. 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.578+0000 7ff8c89fe700 1 Processor -- start 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.578+0000 7ff8c89fe700 1 -- start start 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 0x7ff8c413a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c40c7fb0 0x7ff8c40c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.580 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c413acc0 con 0x7ff8c413f780 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c416d130 con 0x7ff8c40c7be0 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c89fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8c416d9d0 con 0x7ff8c40c7fb0 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39296/0 (socket says 172.21.15.12:39296) 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 -- 172.21.15.12:0/600066923 learned_addr learned my addr 172.21.15.12:0/600066923 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 0x7ff8c413a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c259c700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c40c7fb0 0x7ff8c40c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c40c7fb0 msgr2=0x7ff8c40c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c40c7fb0 0x7ff8c40c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 msgr2=0x7ff8c413a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 0x7ff8c413a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c359e700 1 -- 172.21.15.12:0/600066923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b400b6d0 con 0x7ff8c413f780 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.579+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 0x7ff8c413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8c359e700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e20 tx=0x7ff8bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00caa0 con 0x7ff8c413f780 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00f040 con 0x7ff8c413f780 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00ce70 con 0x7ff8c413f780 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8c40c5b40 con 0x7ff8c413f780 2023-10-08T17:43:36.582 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.580+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c416d660 con 0x7ff8c413f780 2023-10-08T17:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.581+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8c404c3c0 con 0x7ff8c413f780 2023-10-08T17:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.582+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 107) v1 ==== 84757+0+0 (secure 0 0 0) 0x7ff8bc014690 con 0x7ff8c413f780 2023-10-08T17:43:36.583 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.583+0000 7ff8aaffd700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 0x7ff8b0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.583+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7ff8bc0850c0 con 0x7ff8c413f780 2023-10-08T17:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.583+0000 7ff8c2d9d700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 msgr2=0x7ff8b0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.583+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 0x7ff8b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:36.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.591+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8bc055b10 con 0x7ff8c413f780 2023-10-08T17:43:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.784+0000 7ff8c2d9d700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 msgr2=0x7ff8b0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:36.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.784+0000 7ff8c2d9d700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 0x7ff8b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:36.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.795+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff8c416db10 con 0x7ff8c413f780 2023-10-08T17:43:36.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.799+0000 7ff8aaffd700 1 -- 172.21.15.12:0/600066923 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v71)=0 v71) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff8bc0556a0 con 0x7ff8c413f780 2023-10-08T17:43:36.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 msgr2=0x7ff8b0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:36.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 0x7ff8b0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 msgr2=0x7ff8c40c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:36.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc009e20 tx=0x7ff8bc00b040 comp rx=0 tx=0).stop 2023-10-08T17:43:36.802 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 shutdown_connections 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff8b0066f80 0x7ff8b0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff8c413f780 0x7ff8c40c8df0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff8c40c7be0 0x7ff8c413a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 --2- 172.21.15.12:0/600066923 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff8c40c7fb0 0x7ff8c40c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 >> 172.21.15.12:0/600066923 conn(0x7ff8c406d110 msgr2=0x7ff8c40cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 shutdown_connections 2023-10-08T17:43:36.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:36.802+0000 7ff8c89fe700 1 -- 172.21.15.12:0/600066923 wait complete. 2023-10-08T17:43:36.820 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-10-08T17:43:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.013+0000 7f7d0239d700 1 Processor -- start 2023-10-08T17:43:37.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.014+0000 7f7d0239d700 1 -- start start 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0239d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cfc153c90 0x7f7cfc15a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0239d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f7cfc0caec0 0x7f7cfc15afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0239d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cfc15ada0 con 0x7f7cfc06db20 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0239d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc06ca80 con 0x7f7cfc153c90 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0239d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc06cd60 con 0x7f7cfc0caec0 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cfc153c90 0x7f7cfc15a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0139b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f7cfc153c90 0x7f7cfc15a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39304/0 (socket says 172.21.15.12:39304) 2023-10-08T17:43:37.016 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d00b9a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f7cfc06db20 0x7f7cfc0ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:44552/0 (socket says 172.21.15.12:44552) 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d0139b700 1 -- 172.21.15.12:0/2189797949 learned_addr learned my addr 172.21.15.12:0/2189797949 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.015+0000 7f7d01b9c700 1 --2- 172.21.15.12:0/2189797949 >> v2:172.21.15.29:3300/0 conn(0x7f7cfc0caec0 0x7f7cfc15afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7d0139b700 1 -- 172.21.15.12:0/2189797949 >> v2:172.21.15.29:3300/0 conn(0x7f7cfc0caec0 msgr2=0x7f7cfc15afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7d0139b700 1 --2- 172.21.15.12:0/2189797949 >> v2:172.21.15.29:3300/0 conn(0x7f7cfc0caec0 0x7f7cfc15afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7d0139b700 1 -- 172.21.15.12:0/2189797949 >> v1:172.21.15.12:6789/0 conn(0x7f7cfc06db20 legacy=0x7f7cfc0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7d0139b700 1 -- 172.21.15.12:0/2189797949 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc06d040 con 0x7f7cfc153c90 2023-10-08T17:43:37.017 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7d0139b700 1 --2- 172.21.15.12:0/2189797949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc15a860 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0cba60 tx=0x7f7cf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d739481a868da09 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7cf3fff700 1 -- 172.21.15.12:0/2189797949 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8009e70 con 0x7f7cfc153c90 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7cf3fff700 1 -- 172.21.15.12:0/2189797949 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf800b860 con 0x7f7cfc153c90 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.016+0000 7f7cf3fff700 1 -- 172.21.15.12:0/2189797949 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800bc00 con 0x7f7cfc153c90 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 -- 172.21.15.12:0/2189797949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 msgr2=0x7f7cfc15a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2189797949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc15a860 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0cba60 tx=0x7f7cf8009250 comp rx=0 tx=0).stop 2023-10-08T17:43:37.018 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 -- 172.21.15.12:0/2189797949 shutdown_connections 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2189797949 >> v2:172.21.15.29:3300/0 conn(0x7f7cfc0caec0 0x7f7cfc15afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2189797949 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc15a860 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 -- 172.21.15.12:0/2189797949 >> 172.21.15.12:0/2189797949 conn(0x7f7cfc06e720 msgr2=0x7f7cfc06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 -- 172.21.15.12:0/2189797949 shutdown_connections 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.017+0000 7f7d0239d700 1 -- 172.21.15.12:0/2189797949 wait complete. 2023-10-08T17:43:37.019 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.019+0000 7f7d0239d700 1 Processor -- start 2023-10-08T17:43:37.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.019+0000 7f7d0239d700 1 -- start start 2023-10-08T17:43:37.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.020 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cfc0caec0 0x7f7cfc0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc0c4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.021 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0afce0 con 0x7f7cfc153c90 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc16a7c0 con 0x7f7cfc0caec0 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0239d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc16b470 con 0x7f7cfc06db20 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0139b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0139b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:48414/0 (socket says 172.21.15.12:48414) 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d0139b700 1 -- 172.21.15.12:0/2614976727 learned_addr learned my addr 172.21.15.12:0/2614976727 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d01b9c700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc0c4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.020+0000 7f7d00b9a700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cfc0caec0 0x7f7cfc0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cfc0caec0 msgr2=0x7f7cfc0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cfc0caec0 0x7f7cfc0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 msgr2=0x7f7cfc0c4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:37.022 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc0c4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 -- 172.21.15.12:0/2614976727 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80094f0 con 0x7f7cfc06db20 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0139b700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0c3820 tx=0x7f7cf8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf800bbe0 con 0x7f7cfc06db20 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf8011420 con 0x7f7cfc06db20 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80117c0 con 0x7f7cfc06db20 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.021+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc0c55c0 con 0x7f7cfc06db20 2023-10-08T17:43:37.023 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.022+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc0af970 con 0x7f7cfc06db20 2023-10-08T17:43:37.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.023+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc0c9110 con 0x7f7cfc06db20 2023-10-08T17:43:37.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.023+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 107) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f7cf8011bb0 con 0x7f7cfc06db20 2023-10-08T17:43:37.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.024+0000 7f7cf17fa700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 0x7f7ce0069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:37.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.024+0000 7f7d00b9a700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 msgr2=0x7f7ce0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:37.024 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.024+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f7cf8085c80 con 0x7f7cfc06db20 2023-10-08T17:43:37.025 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.024+0000 7f7d00b9a700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 0x7f7ce0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:37.029 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.029+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cf8052c40 con 0x7f7cfc06db20 2023-10-08T17:43:37.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.225+0000 7f7d00b9a700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 msgr2=0x7f7ce0069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:37.794 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.225+0000 7f7d00b9a700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 0x7f7ce0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:37.796 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:37.677+0000 7f63a625e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:37.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.234+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f7cfc04c3c0 con 0x7f7cfc06db20 2023-10-08T17:43:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.239+0000 7f7cf17fa700 1 -- 172.21.15.12:0/2614976727 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v72)=0 v72) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7cf8011e60 con 0x7f7cfc06db20 2023-10-08T17:43:37.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 msgr2=0x7f7ce0069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 0x7f7ce0069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 msgr2=0x7f7cfc16af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:37.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0c3820 tx=0x7f7cf8017000 comp rx=0 tx=0).stop 2023-10-08T17:43:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 shutdown_connections 2023-10-08T17:43:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f7ce0066f80 0x7f7ce0069430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f7cfc153c90 0x7f7cfc0c4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f7cfc06db20 0x7f7cfc16af30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 --2- 172.21.15.12:0/2614976727 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f7cfc0caec0 0x7f7cfc0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 >> 172.21.15.12:0/2614976727 conn(0x7f7cfc06e720 msgr2=0x7f7cfc0c8a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 shutdown_connections 2023-10-08T17:43:37.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:37.241+0000 7f7d0239d700 1 -- 172.21.15.12:0/2614976727 wait complete. 2023-10-08T17:43:37.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:37.950 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-10-08T17:43:37.951 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:37.709+0000 7f1b3b8b2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:37.951 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:37.879+0000 7f1b3b8b2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:37.953 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:37.849+0000 7f63a625e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:37.953 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:37.938+0000 7f63a625e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:37.966 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:37.967+0000 7f1b3b8b2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:37.994 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-10-08T17:43:38.177 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:38.176+0000 7f63a625e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:38.213 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:38.213+0000 7f1b3b8b2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:38.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.239+0000 7f144739d700 1 Processor -- start 2023-10-08T17:43:38.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.239+0000 7f144739d700 1 -- start start 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.240+0000 7f144739d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f1440142ca0 0x7f144015dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.240+0000 7f144739d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1440143070 0x7f14400cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.240+0000 7f144739d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144015d8d0 con 0x7f144015a6f0 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.240+0000 7f144739d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f144015d2f0 con 0x7f1440143070 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.240+0000 7f144739d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400cc630 con 0x7f1440142ca0 2023-10-08T17:43:38.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1440143070 0x7f14400cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f1440143070 0x7f14400cbf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39318/0 (socket says 172.21.15.12:39318) 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 -- 172.21.15.12:0/2387015970 learned_addr learned my addr 172.21.15.12:0/2387015970 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f144639b700 1 --2- 172.21.15.12:0/2387015970 >> v2:172.21.15.29:3300/0 conn(0x7f1440142ca0 0x7f144015dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 -- 172.21.15.12:0/2387015970 >> v2:172.21.15.29:3300/0 conn(0x7f1440142ca0 msgr2=0x7f144015dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 --2- 172.21.15.12:0/2387015970 >> v2:172.21.15.29:3300/0 conn(0x7f1440142ca0 0x7f144015dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 -- 172.21.15.12:0/2387015970 >> v1:172.21.15.29:6789/0 conn(0x7f144015a6f0 legacy=0x7f14400cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:38.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 -- 172.21.15.12:0/2387015970 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144015d560 con 0x7f1440143070 2023-10-08T17:43:38.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.241+0000 7f1445b9a700 1 --2- 172.21.15.12:0/2387015970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1440143070 0x7f14400cbf30 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f144006fd50 tx=0x7f1430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93871e6ac9f9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:38.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f1445399700 1 -- 172.21.15.12:0/2387015970 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430009e70 con 0x7f1440143070 2023-10-08T17:43:38.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f1445399700 1 -- 172.21.15.12:0/2387015970 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b860 con 0x7f1440143070 2023-10-08T17:43:38.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f1445399700 1 -- 172.21.15.12:0/2387015970 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000bc00 con 0x7f1440143070 2023-10-08T17:43:38.243 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 -- 172.21.15.12:0/2387015970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1440143070 msgr2=0x7f14400cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 --2- 172.21.15.12:0/2387015970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1440143070 0x7f14400cbf30 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f144006fd50 tx=0x7f1430009250 comp rx=0 tx=0).stop 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 -- 172.21.15.12:0/2387015970 shutdown_connections 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 --2- 172.21.15.12:0/2387015970 >> v2:172.21.15.29:3300/0 conn(0x7f1440142ca0 0x7f144015dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 --2- 172.21.15.12:0/2387015970 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f1440143070 0x7f14400cbf30 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.242+0000 7f144739d700 1 -- 172.21.15.12:0/2387015970 >> 172.21.15.12:0/2387015970 conn(0x7f1440067c80 msgr2=0x7f1440068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.243+0000 7f144739d700 1 -- 172.21.15.12:0/2387015970 shutdown_connections 2023-10-08T17:43:38.244 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.243+0000 7f144739d700 1 -- 172.21.15.12:0/2387015970 wait complete. 2023-10-08T17:43:38.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.244+0000 7f144739d700 1 Processor -- start 2023-10-08T17:43:38.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.244+0000 7f144739d700 1 -- start start 2023-10-08T17:43:38.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440143070 0x7f144015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 0x7f1440158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144015faa0 con 0x7f144015a6f0 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144015ee90 con 0x7f1440142ca0 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144739d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144015f170 con 0x7f1440143070 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144639b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f1445b9a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440143070 0x7f144015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144639b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:57248/0 (socket says 172.21.15.12:57248) 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f144639b700 1 -- 172.21.15.12:0/3833003248 learned_addr learned my addr 172.21.15.12:0/3833003248 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.245+0000 7f1446b9c700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 0x7f1440158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:38.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440143070 msgr2=0x7f144015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440143070 0x7f144015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 msgr2=0x7f1440158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 0x7f1440158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300094f0 con 0x7f1440142ca0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f1446b9c700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 0x7f1440158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144639b700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e930 tx=0x7f143c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c013680 con 0x7f1440142ca0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c0137e0 con 0x7f1440142ca0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c013b80 con 0x7f1440142ca0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f144015f450 con 0x7f1440142ca0 2023-10-08T17:43:38.248 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.246+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1440159500 con 0x7f1440142ca0 2023-10-08T17:43:38.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.247+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144004c3c0 con 0x7f1440142ca0 2023-10-08T17:43:38.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.248+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 107) v1 ==== 84757+0+0 (secure 0 0 0) 0x7f143c00c460 con 0x7f1440142ca0 2023-10-08T17:43:38.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.249+0000 7f14367fc700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:38.249 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.249+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(213..213 src has 1..213) v4 ==== 6225+0+0 (secure 0 0 0) 0x7f143c084a20 con 0x7f1440142ca0 2023-10-08T17:43:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.249+0000 7f1445b9a700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:38.250 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.249+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:38.254 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.254+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f143c0519e0 con 0x7f1440142ca0 2023-10-08T17:43:38.363 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:38.363+0000 7f63a625e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:38.401 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:38.401+0000 7f1b3b8b2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.450+0000 7f1445b9a700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:38.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.450+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:38.459 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:38.459+0000 7f63a625e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:38.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.489+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f144006b870 con 0x7f1424066f80 2023-10-08T17:43:38.497 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:38.497+0000 7f1b3b8b2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:38.626 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:38.626+0000 7f63a625e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:38.664 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:38.664+0000 7f1b3b8b2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:38.732 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:38.732+0000 7f63a625e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:38.768 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:38.768+0000 7f1b3b8b2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.851+0000 7f1445b9a700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:38.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:38.851+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:43:39.235 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:39.234+0000 7f63a625e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:39.270 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:39.270+0000 7f1b3b8b2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:39.333 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:39.332+0000 7f63a625e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:39.368 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:39.368+0000 7f1b3b8b2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:39.427 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:39.427+0000 7f63a625e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:39.462 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:39.462+0000 7f1b3b8b2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:39.652+0000 7f1445b9a700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:39.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:39.652+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-10-08T17:43:40.077 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:40.076+0000 7f63a625e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:40.108 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:40.108+0000 7f1b3b8b2180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:40.256 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:40.255+0000 7f63a625e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:40.287 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:40.287+0000 7f1b3b8b2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:40.356 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:40.356+0000 7f63a625e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:40.387 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:40.387+0000 7f1b3b8b2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:40.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:43:40.605 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:43:40.661 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:40.660+0000 7f63a625e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:40.697 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:40.697+0000 7f1b3b8b2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:40.762 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:40.762+0000 7f63a625e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:40.797 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:40.797+0000 7f1b3b8b2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:41.253+0000 7f1445b9a700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:41.253 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:41.253+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-10-08T17:43:41.502 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:41.501+0000 7f63a625e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:41.532 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:41.531+0000 7f1b3b8b2180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:41.794 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:41.794+0000 7f63a625e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:41.824 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:41.824+0000 7f1b3b8b2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:41.891 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:41.891+0000 7f63a625e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:41.920 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:41.920+0000 7f1b3b8b2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:42.053 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.052+0000 7f63a625e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:42.081 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.081+0000 7f1b3b8b2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:42.163 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.163+0000 7f63a625e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:42.189 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.189+0000 7f1b3b8b2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:42.361 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.361+0000 7f63a625e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:42.386 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.386+0000 7f1b3b8b2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:42.458 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.457+0000 7f63a625e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:42.484 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.484+0000 7f1b3b8b2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:42.553 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.553+0000 7f63a625e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:42.580 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.580+0000 7f1b3b8b2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:42.651 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:42.651+0000 7f63a625e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:42.679 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.679+0000 7f1b3b8b2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:42.691+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mgrmap(e 108) v1 ==== 84468+0+0 (secure 0 0 0) 0x7f143c051db0 con 0x7f1440142ca0 2023-10-08T17:43:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:42.691+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:42.691 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:42.691+0000 7f14367fc700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:42.811 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.811+0000 7f1aadbf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.811 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.811+0000 7f1aadbf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.811 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.811+0000 7f1aadbf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.811 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.811+0000 7f1aadbf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.812 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.811+0000 7f1aadbf1700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.812 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.812+0000 7f1ab0bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.813 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.812+0000 7f1ab0bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.813 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.812+0000 7f1ab0bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.813 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.812+0000 7f1ab0bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:42.813 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:42.812+0000 7f1ab0bf7700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-08T17:43:43.700 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.700+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mon.1 v2:172.21.15.29:3300/0 8 ==== mgrmap(e 109) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f143c055900 con 0x7f1440142ca0 2023-10-08T17:43:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.701+0000 7f14367fc700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.701+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f144006b870 con 0x7f1424066f80 2023-10-08T17:43:43.701 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.702+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.705 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.705+0000 7f1445b9a700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f144006fd50 tx=0x7f1430017000 comp rx=0 tx=0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:43.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.767+0000 7f14367fc700 1 -- 172.21.15.12:0/3833003248 <== mgr.9772 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f144006b870 con 0x7f1424066f80 2023-10-08T17:43:43.768 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule set for path snap_test_dir1 2023-10-08T17:43:43.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 msgr2=0x7f1424069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f144006fd50 tx=0x7f1430017000 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 msgr2=0x7f144013ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f143c00e930 tx=0x7f143c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 shutdown_connections 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f1424066f80 0x7f1424069430 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f144015a6f0 0x7f1440158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f1440142ca0 0x7f144013ff30 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 --2- 172.21.15.12:0/3833003248 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f1440143070 0x7f144015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 >> 172.21.15.12:0/3833003248 conn(0x7f1440067c80 msgr2=0x7f14400cbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 shutdown_connections 2023-10-08T17:43:43.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.770+0000 7f144739d700 1 -- 172.21.15.12:0/3833003248 wait complete. 2023-10-08T17:43:43.789 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-10-08T17:43:43.789 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-10-08T17:43:43.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.984+0000 7fb8a759e700 1 Processor -- start 2023-10-08T17:43:43.984 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.984+0000 7fb8a759e700 1 -- start start 2023-10-08T17:43:43.985 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a80c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a759e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8a80c7090 0x7fb8a815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a759e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a80ca6b0 con 0x7fb8a80ca240 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a759e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a80cb4f0 con 0x7fb8a80c7090 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a815e390 con 0x7fb8a815b5d0 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a6d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb8a80c7090 0x7fb8a815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.985+0000 7fb8a5d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fb8a80ca240 0x7fb8a80c6980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52472/0 (socket says 172.21.15.12:52472) 2023-10-08T17:43:43.986 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a5d9b700 1 -- 172.21.15.12:0/3084669454 learned_addr learned my addr 172.21.15.12:0/3084669454 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:43.987 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a659c700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a80c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a6d9d700 1 -- 172.21.15.12:0/3084669454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 msgr2=0x7fb8a80c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a6d9d700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a80c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a6d9d700 1 -- 172.21.15.12:0/3084669454 >> v1:172.21.15.12:6789/0 conn(0x7fb8a80ca240 legacy=0x7fb8a80c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a6d9d700 1 -- 172.21.15.12:0/3084669454 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a80ca8e0 con 0x7fb8a80c7090 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a559a700 1 -- 172.21.15.12:0/3084669454 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600773674 0 0) 0x7fb8a80ca6b0 con 0x7fb8a80ca240 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.986+0000 7fb8a6d9d700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80c7090 0x7fb8a815f1d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e60 tx=0x7fb8a0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a164b9eb33ac40 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a559a700 1 -- 172.21.15.12:0/3084669454 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a000e070 con 0x7fb8a80c7090 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a559a700 1 -- 172.21.15.12:0/3084669454 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a000bb60 con 0x7fb8a80c7090 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a559a700 1 -- 172.21.15.12:0/3084669454 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a0012430 con 0x7fb8a80c7090 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 -- 172.21.15.12:0/3084669454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80c7090 msgr2=0x7fb8a815f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80c7090 0x7fb8a815f1d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009e60 tx=0x7fb8a0009780 comp rx=0 tx=0).stop 2023-10-08T17:43:43.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 -- 172.21.15.12:0/3084669454 shutdown_connections 2023-10-08T17:43:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80c7090 0x7fb8a815f1d0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 --2- 172.21.15.12:0/3084669454 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a80c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 -- 172.21.15.12:0/3084669454 >> 172.21.15.12:0/3084669454 conn(0x7fb8a806d170 msgr2=0x7fb8a80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 -- 172.21.15.12:0/3084669454 shutdown_connections 2023-10-08T17:43:43.990 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.987+0000 7fb8a759e700 1 -- 172.21.15.12:0/3084669454 wait complete. 2023-10-08T17:43:43.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.989+0000 7fb8a759e700 1 Processor -- start 2023-10-08T17:43:43.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.989+0000 7fb8a759e700 1 -- start start 2023-10-08T17:43:43.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8a80c7090 0x7fb8a8162b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a81626f0 con 0x7fb8a80ca240 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8161ae0 con 0x7fb8a80c7090 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8161dc0 con 0x7fb8a815b5d0 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a5d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39176/0 (socket says 172.21.15.12:39176) 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a5d9b700 1 -- 172.21.15.12:0/1886656901 learned_addr learned my addr 172.21.15.12:0/1886656901 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a659c700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8a80c7090 0x7fb8a8162b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.990+0000 7fb8a6d9d700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 -- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 msgr2=0x7fb8a815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 -- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8a80c7090 msgr2=0x7fb8a8162b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8a80c7090 0x7fb8a8162b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 -- 172.21.15.12:0/1886656901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a0009a20 con 0x7fb8a80ca240 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a5d9b700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c7e0 tx=0x7fb89c007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0072e0 con 0x7fb8a80ca240 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c007460 con 0x7fb8a80ca240 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a81620a0 con 0x7fb8a80ca240 2023-10-08T17:43:43.994 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c0057f0 con 0x7fb8a80ca240 2023-10-08T17:43:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.991+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a81630c0 con 0x7fb8a80ca240 2023-10-08T17:43:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.992+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a8162860 con 0x7fb8a80ca240 2023-10-08T17:43:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.993+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 109) v1 ==== 84595+0+0 (secure 0 0 0) 0x7fb89c005b60 con 0x7fb8a80ca240 2023-10-08T17:43:43.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.994+0000 7fb8967fc700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 0x7fb888069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.994+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb89c001e40 con 0x7fb8a80ca240 2023-10-08T17:43:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.995+0000 7fb8a659c700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 0x7fb888069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:43.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.995+0000 7fb8a659c700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 0x7fb888069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb898009d10 tx=0x7fb8980091a0 comp rx=0 tx=0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:43.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:43.998+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb89c04b5a0 con 0x7fb8a80ca240 2023-10-08T17:43:44.231 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.231+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8a804c3c0 con 0x7fb888066dd0 2023-10-08T17:43:44.282 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.282+0000 7fb8967fc700 1 -- 172.21.15.12:0/1886656901 <== mgr.9772 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fb8a804c3c0 con 0x7fb888066dd0 2023-10-08T17:43:44.282 INFO:teuthology.orchestra.run.smithi012.stdout:Retention added to path snap_test_dir1 2023-10-08T17:43:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 msgr2=0x7fb888069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.284 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 0x7fb888069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb898009d10 tx=0x7fb8980091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 msgr2=0x7fb8a815cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00c7e0 tx=0x7fb89c007c80 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 shutdown_connections 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb888066dd0 0x7fb888069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb8a815b5d0 0x7fb8a815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb8a80c7090 0x7fb8a8162b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 --2- 172.21.15.12:0/1886656901 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb8a80ca240 0x7fb8a815cc30 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 >> 172.21.15.12:0/1886656901 conn(0x7fb8a806d170 msgr2=0x7fb8a80c2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 shutdown_connections 2023-10-08T17:43:44.285 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.284+0000 7fb8a759e700 1 -- 172.21.15.12:0/1886656901 wait complete. 2023-10-08T17:43:44.302 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-10-08T17:43:44.306 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-10-08-17_44_00 in ~16s... 2023-10-08T17:43:44.306 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-10-08T17:43:44.306 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-10-08T17:43:44.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.496+0000 7f31949fe700 1 Processor -- start 2023-10-08T17:43:44.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.496+0000 7f31949fe700 1 -- start start 2023-10-08T17:43:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f31949fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 0x7f31900c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f31949fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31900c85d0 0x7f31900cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f31949fe700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31901571b0 con 0x7f31900c2a90 2023-10-08T17:43:44.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f31949fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31901579b0 con 0x7f31900c85d0 2023-10-08T17:43:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f31949fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c1390 con 0x7f31900c8200 2023-10-08T17:43:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f318f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f31900c85d0 0x7f31900cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f318ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 0x7f31900c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f318ed9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 0x7f31900c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:55844/0 (socket says 172.21.15.12:55844) 2023-10-08T17:43:44.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.498+0000 7f318ed9d700 1 -- 172.21.15.12:0/1050029940 learned_addr learned my addr 172.21.15.12:0/1050029940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318dd9b700 1 -- 172.21.15.12:0/1050029940 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68314686 0 0) 0x7f3184001110 con 0x7f31900c2a90 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318dd9b700 1 -- 172.21.15.12:0/1050029940 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3178003570 con 0x7f31900c2a90 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318f59e700 1 -- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 msgr2=0x7f31900c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318f59e700 1 --2- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 0x7f31900c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318f59e700 1 -- 172.21.15.12:0/1050029940 >> v1:172.21.15.29:6789/0 conn(0x7f31900c2a90 legacy=0x7f3190156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318f59e700 1 -- 172.21.15.12:0/1050029940 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31901573f0 con 0x7f31900c85d0 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318f59e700 1 --2- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c85d0 0x7f31900cc2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e60 tx=0x7f3188009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6f96c9706ae781e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318dd9b700 1 -- 172.21.15.12:0/1050029940 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800e070 con 0x7f31900c85d0 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318dd9b700 1 -- 172.21.15.12:0/1050029940 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800bab0 con 0x7f31900c85d0 2023-10-08T17:43:44.501 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.499+0000 7f318dd9b700 1 -- 172.21.15.12:0/1050029940 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800be70 con 0x7f31900c85d0 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 -- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c85d0 msgr2=0x7f31900cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 --2- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c85d0 0x7f31900cc2f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f3188009e60 tx=0x7f3188009780 comp rx=0 tx=0).stop 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 -- 172.21.15.12:0/1050029940 shutdown_connections 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 --2- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c85d0 0x7f31900cc2f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 --2- 172.21.15.12:0/1050029940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c8200 0x7f31900c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 -- 172.21.15.12:0/1050029940 >> 172.21.15.12:0/1050029940 conn(0x7f319006c6a0 msgr2=0x7f319006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 -- 172.21.15.12:0/1050029940 shutdown_connections 2023-10-08T17:43:44.502 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.500+0000 7f31949fe700 1 -- 172.21.15.12:0/1050029940 wait complete. 2023-10-08T17:43:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.502+0000 7f31949fe700 1 Processor -- start 2023-10-08T17:43:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.502+0000 7f31949fe700 1 -- start start 2023-10-08T17:43:44.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c8200 0x7f31900cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c85d0 0x7f3190169350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31900ab740 con 0x7f31900c2a90 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190169df0 con 0x7f31900c8200 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f31949fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319016a0d0 con 0x7f31900c85d0 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39184/0 (socket says 172.21.15.12:39184) 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 -- 172.21.15.12:0/3376012207 learned_addr learned my addr 172.21.15.12:0/3376012207 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318e59c700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c8200 0x7f31900cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318f59e700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c85d0 0x7f3190169350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 -- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c85d0 msgr2=0x7f3190169350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.505 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c85d0 0x7f3190169350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 -- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c8200 msgr2=0x7f31900cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c8200 0x7f31900cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.503+0000 7f318ed9d700 1 -- 172.21.15.12:0/3376012207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188009a20 con 0x7f31900c2a90 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f318ed9d700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f318000ec00 tx=0x7f318000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318000dc30 con 0x7f31900c2a90 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318000dd90 con 0x7f31900c2a90 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3180010650 con 0x7f31900c2a90 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31900ab990 con 0x7f31900c2a90 2023-10-08T17:43:44.506 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.504+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901503e0 con 0x7f31900c2a90 2023-10-08T17:43:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.505+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31900abfe0 con 0x7f31900c2a90 2023-10-08T17:43:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.506+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 109) v1 ==== 84595+0+0 (secure 0 0 0) 0x7f3180010a00 con 0x7f31900c2a90 2023-10-08T17:43:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.507+0000 7f3176ffd700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 0x7f317c069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.507 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.507+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f3180084980 con 0x7f31900c2a90 2023-10-08T17:43:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.508+0000 7f318e59c700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 0x7f317c069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.508+0000 7f318e59c700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 0x7f317c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31900c7310 tx=0x7f3184009040 comp rx=0 tx=0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.511+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3180051ac0 con 0x7f31900c2a90 2023-10-08T17:43:44.704 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.704+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 110) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f3180051e90 con 0x7f31900c2a90 2023-10-08T17:43:44.742 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.742+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f319004c3c0 con 0x7f317c066dd0 2023-10-08T17:43:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.750+0000 7f3176ffd700 1 -- 172.21.15.12:0/3376012207 <== mgr.9772 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f319004c3c0 con 0x7f317c066dd0 2023-10-08T17:43:44.750 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:44.750 INFO:teuthology.orchestra.run.smithi012.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-08T17:43:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 msgr2=0x7f317c069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 0x7f317c069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f31900c7310 tx=0x7f3184009040 comp rx=0 tx=0).stop 2023-10-08T17:43:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 msgr2=0x7f31900b00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f318000ec00 tx=0x7f318000b4f0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 shutdown_connections 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f317c066dd0 0x7f317c069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f31900c2a90 0x7f31900b00e0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f31900c85d0 0x7f3190169350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 --2- 172.21.15.12:0/3376012207 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f31900c8200 0x7f31900cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 >> 172.21.15.12:0/3376012207 conn(0x7f319006c6a0 msgr2=0x7f3190158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 shutdown_connections 2023-10-08T17:43:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.752+0000 7f31949fe700 1 -- 172.21.15.12:0/3376012207 wait complete. 2023-10-08T17:43:44.769 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-10-08T17:43:44.769 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-10-08T17:43:44.769 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-10-08T17:43:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.961+0000 7f484df9d700 1 Processor -- start 2023-10-08T17:43:44.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.961+0000 7f484df9d700 1 -- start start 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484df9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4848142ca0 0x7f484815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484df9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 0x7f48480cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484df9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484815d8d0 con 0x7f484815a6f0 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484df9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484815d2f0 con 0x7f4848142ca0 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484df9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48480cc630 con 0x7f4848143070 2023-10-08T17:43:44.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.962+0000 7f484cf9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4848142ca0 0x7f484815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4848142ca0 0x7f484815dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39190/0 (socket says 172.21.15.12:39190) 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 -- 172.21.15.12:0/3583650989 learned_addr learned my addr 172.21.15.12:0/3583650989 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f4847fff700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 0x7f48480cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 -- 172.21.15.12:0/3583650989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 msgr2=0x7f48480cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 0x7f48480cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 -- 172.21.15.12:0/3583650989 >> v1:172.21.15.29:6789/0 conn(0x7f484815a6f0 legacy=0x7f48480cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 -- 172.21.15.12:0/3583650989 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484815d560 con 0x7f4848142ca0 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f4847fff700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 0x7f48480cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:44.964 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f484cf9b700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848142ca0 0x7f484815dd60 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f483c0099b0 tx=0x7f483c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2edbf3ca1a84a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.963+0000 7f48477fe700 1 -- 172.21.15.12:0/3583650989 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00b860 con 0x7f4848142ca0 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f48477fe700 1 -- 172.21.15.12:0/3583650989 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00b9c0 con 0x7f4848142ca0 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f48477fe700 1 -- 172.21.15.12:0/3583650989 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00bd60 con 0x7f4848142ca0 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 -- 172.21.15.12:0/3583650989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848142ca0 msgr2=0x7f484815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848142ca0 0x7f484815dd60 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f483c0099b0 tx=0x7f483c009250 comp rx=0 tx=0).stop 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 -- 172.21.15.12:0/3583650989 shutdown_connections 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848142ca0 0x7f484815dd60 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 --2- 172.21.15.12:0/3583650989 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4848143070 0x7f48480cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 -- 172.21.15.12:0/3583650989 >> 172.21.15.12:0/3583650989 conn(0x7f4848067c80 msgr2=0x7f4848068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 -- 172.21.15.12:0/3583650989 shutdown_connections 2023-10-08T17:43:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.964+0000 7f484df9d700 1 -- 172.21.15.12:0/3583650989 wait complete. 2023-10-08T17:43:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.966+0000 7f484df9d700 1 Processor -- start 2023-10-08T17:43:44.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.966+0000 7f484df9d700 1 -- start start 2023-10-08T17:43:44.968 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4848142ca0 0x7f48480b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f484815a6f0 0x7f48480a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480ac040 con 0x7f4848143070 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48480ab750 con 0x7f4848142ca0 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484df9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484816db70 con 0x7f484815a6f0 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39206/0 (socket says 172.21.15.12:39206) 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 -- 172.21.15.12:0/1908376851 learned_addr learned my addr 172.21.15.12:0/1908376851 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484cf9b700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4848142ca0 0x7f48480b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f484d79c700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f484815a6f0 0x7f48480a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.969 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 -- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f484815a6f0 msgr2=0x7f48480a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f484815a6f0 0x7f48480a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 -- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4848142ca0 msgr2=0x7f48480b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4848142ca0 0x7f48480b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.967+0000 7f4847fff700 1 -- 172.21.15.12:0/1908376851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f483c0094f0 con 0x7f4848143070 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f4847fff700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f483400e8d0 tx=0x7f4834008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834013410 con 0x7f4848143070 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834013570 con 0x7f4848143070 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48480ab9f0 con 0x7f4848143070 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834013910 con 0x7f4848143070 2023-10-08T17:43:44.970 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.968+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48480b1d10 con 0x7f4848143070 2023-10-08T17:43:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.969+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48480ac1b0 con 0x7f4848143070 2023-10-08T17:43:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.970+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 110) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f4834013d00 con 0x7f4848143070 2023-10-08T17:43:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.971+0000 7f4844ff9700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 0x7f482c0695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:44.971 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.971+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f4834084a40 con 0x7f4848143070 2023-10-08T17:43:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.972+0000 7f484cf9b700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 0x7f482c0695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:44.972 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.972+0000 7f484cf9b700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 0x7f482c0695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f483c0099b0 tx=0x7f483c017000 comp rx=0 tx=0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:44.975 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:44.975+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4834086e60 con 0x7f4848143070 2023-10-08T17:43:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.209+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f484804c3c0 con 0x7f482c067130 2023-10-08T17:43:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.267+0000 7f4844ff9700 1 -- 172.21.15.12:0/1908376851 <== mgr.9772 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f484804c3c0 con 0x7f482c067130 2023-10-08T17:43:45.268 INFO:teuthology.orchestra.run.smithi012.stdout:Schedule removed for path snap_test_dir1 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.269+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 msgr2=0x7f482c0695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.269+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 0x7f482c0695e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f483c0099b0 tx=0x7f483c017000 comp rx=0 tx=0).stop 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.269+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 msgr2=0x7f4848159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.269+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f483400e8d0 tx=0x7f4834008040 comp rx=0 tx=0).stop 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 shutdown_connections 2023-10-08T17:43:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f482c067130 0x7f482c0695e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f484815a6f0 0x7f48480a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4848142ca0 0x7f48480b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 --2- 172.21.15.12:0/1908376851 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4848143070 0x7f4848159620 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 >> 172.21.15.12:0/1908376851 conn(0x7f4848067c80 msgr2=0x7f48480c4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 shutdown_connections 2023-10-08T17:43:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.270+0000 7f484df9d700 1 -- 172.21.15.12:0/1908376851 wait complete. 2023-10-08T17:43:45.290 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-10-08T17:43:45.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:45.290 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-10-08T17:43:45.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:45.329 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-10-08T17:43:45.409 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-10-08T17:43:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.638+0000 7f0f5619d700 1 Processor -- start 2023-10-08T17:43:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.638+0000 7f0f5619d700 1 -- start start 2023-10-08T17:43:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5619d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f50142c00 0x7f0f5006b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5619d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f500ca480 con 0x7f0f5006bd20 2023-10-08T17:43:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5619d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5015e240 con 0x7f0f500c7f90 2023-10-08T17:43:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5619d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5006b350 con 0x7f0f50142c00 2023-10-08T17:43:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5519b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0f50142c00 0x7f0f5006b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5499a700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0f5006bd20 0x7f0f500c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52488/0 (socket says 172.21.15.12:52488) 2023-10-08T17:43:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.639+0000 7f0f5499a700 1 -- 172.21.15.12:0/1469891982 learned_addr learned my addr 172.21.15.12:0/1469891982 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f5519b700 1 -- 172.21.15.12:0/1469891982 >> v1:172.21.15.29:6789/0 conn(0x7f0f500c7f90 legacy=0x7f0f5006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f5519b700 1 -- 172.21.15.12:0/1469891982 >> v1:172.21.15.12:6789/0 conn(0x7f0f5006bd20 legacy=0x7f0f500c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f5519b700 1 -- 172.21.15.12:0/1469891982 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5015df60 con 0x7f0f50142c00 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f5519b700 1 --2- 172.21.15.12:0/1469891982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f50142c00 0x7f0f5006b7e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098e0 tx=0x7f0f4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4590016dcc5cc01a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f47fff700 1 -- 172.21.15.12:0/1469891982 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c009e80 con 0x7f0f50142c00 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f47fff700 1 -- 172.21.15.12:0/1469891982 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00b820 con 0x7f0f50142c00 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.640+0000 7f0f47fff700 1 -- 172.21.15.12:0/1469891982 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00bba0 con 0x7f0f50142c00 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 -- 172.21.15.12:0/1469891982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f50142c00 msgr2=0x7f0f5006b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 --2- 172.21.15.12:0/1469891982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f50142c00 0x7f0f5006b7e0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0098e0 tx=0x7f0f4c0091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 -- 172.21.15.12:0/1469891982 shutdown_connections 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 --2- 172.21.15.12:0/1469891982 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f50142c00 0x7f0f5006b7e0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 -- 172.21.15.12:0/1469891982 >> 172.21.15.12:0/1469891982 conn(0x7f0f500675a0 msgr2=0x7f0f500679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 -- 172.21.15.12:0/1469891982 shutdown_connections 2023-10-08T17:43:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.641+0000 7f0f5619d700 1 -- 172.21.15.12:0/1469891982 wait complete. 2023-10-08T17:43:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.643+0000 7f0f5619d700 1 Processor -- start 2023-10-08T17:43:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.643+0000 7f0f5619d700 1 -- start start 2023-10-08T17:43:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5006bd20 0x7f0f50159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f50142c00 0x7f0f5016a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500b2940 con 0x7f0f500c7f90 2023-10-08T17:43:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500b1d30 con 0x7f0f50142c00 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5619d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500b2010 con 0x7f0f5006bd20 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5499a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39230/0 (socket says 172.21.15.12:39230) 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5499a700 1 -- 172.21.15.12:0/203909499 learned_addr learned my addr 172.21.15.12:0/203909499 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5519b700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5006bd20 0x7f0f50159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.644+0000 7f0f5599c700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f50142c00 0x7f0f5016a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 -- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5006bd20 msgr2=0x7f0f50159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5006bd20 0x7f0f50159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 -- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f50142c00 msgr2=0x7f0f5016a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f50142c00 0x7f0f5016a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 -- 172.21.15.12:0/203909499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009420 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5499a700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c790 tx=0x7f0f40007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005b30 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f40005cb0 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f500b22f0 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40004a80 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.645+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f500b19c0 con 0x7f0f500c7f90 2023-10-08T17:43:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.646+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5004c3c0 con 0x7f0f500c7f90 2023-10-08T17:43:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.647+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 110) v1 ==== 84916+0+0 (secure 0 0 0) 0x7f0f400070d0 con 0x7f0f500c7f90 2023-10-08T17:43:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.648+0000 7f0f457fa700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 0x7f0f340695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.649+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0f40083e80 con 0x7f0f500c7f90 2023-10-08T17:43:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.649+0000 7f0f5519b700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 0x7f0f340695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.649+0000 7f0f5519b700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 0x7f0f340695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0030c0 tx=0x7f0f4c016000 comp rx=0 tx=0).ready entity=mgr.9772 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.653+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f4004b5a0 con 0x7f0f500c7f90 2023-10-08T17:43:45.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:45.912+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0f5006ad00 con 0x7f0f500c7f90 2023-10-08T17:43:46.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.718+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0f40050e90 con 0x7f0f500c7f90 2023-10-08T17:43:46.721 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.719+0000 7f0f457fa700 1 -- 172.21.15.12:0/203909499 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v111) v1 ==== 93+0+0 (secure 0 0 0) 0x7f0f40054550 con 0x7f0f500c7f90 2023-10-08T17:43:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 msgr2=0x7f0f340695e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:46.722 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 0x7f0f340695e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c0030c0 tx=0x7f0f4c016000 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 msgr2=0x7f0f50169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c790 tx=0x7f0f40007f40 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 shutdown_connections 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0f34067130 0x7f0f340695e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0f50142c00 0x7f0f5016a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0f5006bd20 0x7f0f50159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 --2- 172.21.15.12:0/203909499 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0f500c7f90 0x7f0f50169ea0 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 >> 172.21.15.12:0/203909499 conn(0x7f0f500675a0 msgr2=0x7f0f500cd010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 shutdown_connections 2023-10-08T17:43:46.723 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:46.722+0000 7f0f5619d700 1 -- 172.21.15.12:0/203909499 wait complete. 2023-10-08T17:43:46.741 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-08T17:43:46.742 DEBUG:teuthology.orchestra.run.smithi012:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:46.828 DEBUG:teuthology.orchestra.run.smithi029:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-08T17:43:46.905 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-08T17:43:46.905 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-08T17:43:46.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-08T17:43:46.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-08T17:43:46.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:43:46.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:46.991 DEBUG:teuthology.orchestra.run.smithi012:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-08T17:43:47.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:47.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.261+0000 7f51ba99d700 1 Processor -- start 2023-10-08T17:43:47.261 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.261+0000 7f51ba99d700 1 -- start start 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 0x7f51b40ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f51b4159920 0x7f51b40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba99d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40acc00 con 0x7f51b415dfd0 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40abff0 con 0x7f51b4159920 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40ac2d0 con 0x7f51b4159550 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51b999b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 0x7f51b40ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51b919a700 1 --1- >> v1:172.21.15.29:6789/0 conn(0x7f51b415dfd0 0x7f51b40aedb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:55012/0 (socket says 172.21.15.12:55012) 2023-10-08T17:43:47.263 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51b919a700 1 -- 172.21.15.12:0/1420951448 learned_addr learned my addr 172.21.15.12:0/1420951448 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.262+0000 7f51ba19c700 1 --2- 172.21.15.12:0/1420951448 >> v2:172.21.15.12:3300/0 conn(0x7f51b4159920 0x7f51b40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b999b700 1 -- 172.21.15.12:0/1420951448 >> v2:172.21.15.12:3300/0 conn(0x7f51b4159920 msgr2=0x7f51b40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b999b700 1 --2- 172.21.15.12:0/1420951448 >> v2:172.21.15.12:3300/0 conn(0x7f51b4159920 0x7f51b40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b999b700 1 -- 172.21.15.12:0/1420951448 >> v1:172.21.15.29:6789/0 conn(0x7f51b415dfd0 legacy=0x7f51b40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b999b700 1 -- 172.21.15.12:0/1420951448 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40ac5b0 con 0x7f51b4159550 2023-10-08T17:43:47.264 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b8999700 1 -- 172.21.15.12:0/1420951448 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818110089 0 0) 0x7f51b40acc00 con 0x7f51b415dfd0 2023-10-08T17:43:47.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.263+0000 7f51b999b700 1 --2- 172.21.15.12:0/1420951448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 0x7f51b40ceac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f51b00098e0 tx=0x7f51b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ba3395fa3a5cfa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:47.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51b8999700 1 -- 172.21.15.12:0/1420951448 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000b640 con 0x7f51b4159550 2023-10-08T17:43:47.265 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51b8999700 1 -- 172.21.15.12:0/1420951448 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b000b7a0 con 0x7f51b4159550 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51b8999700 1 -- 172.21.15.12:0/1420951448 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b000bb40 con 0x7f51b4159550 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 -- 172.21.15.12:0/1420951448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 msgr2=0x7f51b40ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 --2- 172.21.15.12:0/1420951448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 0x7f51b40ceac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f51b00098e0 tx=0x7f51b00091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 -- 172.21.15.12:0/1420951448 shutdown_connections 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 --2- 172.21.15.12:0/1420951448 >> v2:172.21.15.12:3300/0 conn(0x7f51b4159920 0x7f51b40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 --2- 172.21.15.12:0/1420951448 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159550 0x7f51b40ceac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 -- 172.21.15.12:0/1420951448 >> 172.21.15.12:0/1420951448 conn(0x7f51b406ce80 msgr2=0x7f51b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 -- 172.21.15.12:0/1420951448 shutdown_connections 2023-10-08T17:43:47.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.264+0000 7f51ba99d700 1 -- 172.21.15.12:0/1420951448 wait complete. 2023-10-08T17:43:47.268 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.266+0000 7f51ba99d700 1 Processor -- start 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.266+0000 7f51ba99d700 1 -- start start 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 0x7f51b40cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 0x7f51b4155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b415dfd0 0x7f51b4169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40cb2f0 con 0x7f51b415dfd0 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c86e0 con 0x7f51b4159550 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40c89c0 con 0x7f51b4159920 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51b999b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 0x7f51b40cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.269 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51ba19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b415dfd0 0x7f51b4169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51b919a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 0x7f51b4155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51b999b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 0x7f51b40cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38350/0 (socket says 172.21.15.12:38350) 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.267+0000 7f51b999b700 1 -- 172.21.15.12:0/2910826404 learned_addr learned my addr 172.21.15.12:0/2910826404 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 msgr2=0x7f51b40cadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 0x7f51b40cadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b415dfd0 msgr2=0x7f51b4169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b415dfd0 0x7f51b4169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 -- 172.21.15.12:0/2910826404 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b0009420 con 0x7f51b4159920 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51b919a700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 0x7f51b4155370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f51a40011e0 tx=0x7f51a4007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:47.270 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4005b30 con 0x7f51b4159920 2023-10-08T17:43:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a4005c90 con 0x7f51b4159920 2023-10-08T17:43:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a4007300 con 0x7f51b4159920 2023-10-08T17:43:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b40c8ca0 con 0x7f51b4159920 2023-10-08T17:43:47.271 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.268+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b40c9260 con 0x7f51b4159920 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.269+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b404c3c0 con 0x7f51b4159920 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.270+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f51a401b3b0 con 0x7f51b4159920 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.271+0000 7f51a9ffb700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 0x7f5198069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.271+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f51a4083ff0 con 0x7f51b4159920 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.271+0000 7f51b999b700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 msgr2=0x7f5198069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:47.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.271+0000 7f51b999b700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 0x7f5198069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:47.280 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.280+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51a4050c70 con 0x7f51b4159920 2023-10-08T17:43:47.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.472+0000 7f51b999b700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 msgr2=0x7f5198069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:47.472 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.472+0000 7f51b999b700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 0x7f5198069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:47.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.529+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b40c8b00 con 0x7f51b4159920 2023-10-08T17:43:47.529 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.530+0000 7f51a9ffb700 1 -- 172.21.15.12:0/2910826404 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f51b40c8b00 con 0x7f51b4159920 2023-10-08T17:43:47.530 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:47.530 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:47.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 msgr2=0x7f5198069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 0x7f5198069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 msgr2=0x7f51b4155370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 0x7f51b4155370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f51a40011e0 tx=0x7f51a4007d30 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 shutdown_connections 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f51980670e0 0x7f5198069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f51b415dfd0 0x7f51b4169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f51b4159550 0x7f51b40cadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 --2- 172.21.15.12:0/2910826404 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f51b4159920 0x7f51b4155370 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 >> 172.21.15.12:0/2910826404 conn(0x7f51b406ce80 msgr2=0x7f51b40af9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:47.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 shutdown_connections 2023-10-08T17:43:47.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.532+0000 7f51ba99d700 1 -- 172.21.15.12:0/2910826404 wait complete. 2023-10-08T17:43:47.534 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:47.552 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.744+0000 7fb7c259d700 1 Processor -- start 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.745+0000 7fb7c259d700 1 -- start start 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb7bc15dfd0 0x7fb7bc0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7bc159920 0x7fb7bc0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0acc00 con 0x7fb7bc159920 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7bc0abff0 con 0x7fb7bc15dfd0 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0ac2d0 con 0x7fb7bc159550 2023-10-08T17:43:47.747 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c1d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7bc159920 0x7fb7bc0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c1d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fb7bc159920 0x7fb7bc0ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39262/0 (socket says 172.21.15.12:39262) 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c1d9c700 1 -- 172.21.15.12:0/2864180362 learned_addr learned my addr 172.21.15.12:0/2864180362 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c159b700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.746+0000 7fb7c0d9a700 1 --2- 172.21.15.12:0/2864180362 >> v2:172.21.15.29:3300/0 conn(0x7fb7bc15dfd0 0x7fb7bc0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 -- 172.21.15.12:0/2864180362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 msgr2=0x7fb7bc0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc0ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 -- 172.21.15.12:0/2864180362 >> v2:172.21.15.29:3300/0 conn(0x7fb7bc15dfd0 msgr2=0x7fb7bc0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 --2- 172.21.15.12:0/2864180362 >> v2:172.21.15.29:3300/0 conn(0x7fb7bc15dfd0 0x7fb7bc0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 -- 172.21.15.12:0/2864180362 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc0ac5b0 con 0x7fb7bc159920 2023-10-08T17:43:47.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c159b700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:47.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7c1d9c700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc0ad090 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc06b120 tx=0x7fb7b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58059ceb50ed3f76 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:47.749 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7b3fff700 1 -- 172.21.15.12:0/2864180362 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400e070 con 0x7fb7bc159920 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7b3fff700 1 -- 172.21.15.12:0/2864180362 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b400b970 con 0x7fb7bc159920 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.747+0000 7fb7b3fff700 1 -- 172.21.15.12:0/2864180362 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b40092e0 con 0x7fb7bc159920 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 -- 172.21.15.12:0/2864180362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 msgr2=0x7fb7bc0ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc0ad090 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc06b120 tx=0x7fb7b4009840 comp rx=0 tx=0).stop 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 -- 172.21.15.12:0/2864180362 shutdown_connections 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc0ad090 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2864180362 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2864180362 >> v2:172.21.15.29:3300/0 conn(0x7fb7bc15dfd0 0x7fb7bc0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 -- 172.21.15.12:0/2864180362 >> 172.21.15.12:0/2864180362 conn(0x7fb7bc06ce80 msgr2=0x7fb7bc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 -- 172.21.15.12:0/2864180362 shutdown_connections 2023-10-08T17:43:47.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.748+0000 7fb7c259d700 1 -- 172.21.15.12:0/2864180362 wait complete. 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.750+0000 7fb7c259d700 1 Processor -- start 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.750+0000 7fb7c259d700 1 -- start start 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc14e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 0x7fb7bc14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc0c8790 con 0x7fb7bc159920 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc150350 con 0x7fb7bc15dfd0 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c259d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc14e970 con 0x7fb7bc159550 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c0d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc14e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c1d9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 0x7fb7bc14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c1d9c700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 0x7fb7bc14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38372/0 (socket says 172.21.15.12:38372) 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c1d9c700 1 -- 172.21.15.12:0/2119310688 learned_addr learned my addr 172.21.15.12:0/2119310688 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.751+0000 7fb7c159b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:55920/0 (socket says 172.21.15.12:55920) 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 msgr2=0x7fb7bc14cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 0x7fb7bc14cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 msgr2=0x7fb7bc14e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc14e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 -- 172.21.15.12:0/2119310688 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009420 con 0x7fb7bc159550 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c159b700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800ec80 tx=0x7fb7b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800c850 con 0x7fb7bc159550 2023-10-08T17:43:47.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800c9b0 con 0x7fb7bc159550 2023-10-08T17:43:47.755 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800cd70 con 0x7fb7bc159550 2023-10-08T17:43:47.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7b4009ae0 con 0x7fb7bc159550 2023-10-08T17:43:47.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.752+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7bc1508f0 con 0x7fb7bc159550 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.753+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7bc150b10 con 0x7fb7bc159550 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.754+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fb7b8013680 con 0x7fb7bc159550 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.755+0000 7fb7b17fa700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 0x7fb7a0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.755+0000 7fb7c0d9a700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 msgr2=0x7fb7a0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.755+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fb7b8084e20 con 0x7fb7bc159550 2023-10-08T17:43:47.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.755+0000 7fb7c0d9a700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 0x7fb7a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:47.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.759+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b8051a60 con 0x7fb7bc159550 2023-10-08T17:43:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.956+0000 7fb7c0d9a700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 msgr2=0x7fb7a0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:47.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.956+0000 7fb7c0d9a700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 0x7fb7a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:47.962 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.962+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7bc04c3c0 con 0x7fb7bc159550 2023-10-08T17:43:47.963 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.963+0000 7fb7b17fa700 1 -- 172.21.15.12:0/2119310688 <== mon.2 v2:172.21.15.29:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+16581 (secure 0 0 0) 0x7fb7b8055080 con 0x7fb7bc159550 2023-10-08T17:43:47.964 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:47.964 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":214,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:42.681627+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:6836/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/3541952869":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/2981918803":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/843450174":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/790125058":"2023-10-09T17:43:42.681590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.965+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 msgr2=0x7fb7a0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.965+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 0x7fb7a0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.965+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 msgr2=0x7fb7bc14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.965+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800ec80 tx=0x7fb7b80091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 shutdown_connections 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb7a00670e0 0x7fb7a0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb7bc15dfd0 0x7fb7bc14cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb7bc159550 0x7fb7bc14fe10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.966 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 --2- 172.21.15.12:0/2119310688 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb7bc159920 0x7fb7bc14e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:47.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 >> 172.21.15.12:0/2119310688 conn(0x7fb7bc06ce80 msgr2=0x7fb7bc153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:47.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 shutdown_connections 2023-10-08T17:43:47.967 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:47.966+0000 7fb7c259d700 1 -- 172.21.15.12:0/2119310688 wait complete. 2023-10-08T17:43:47.984 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-08T16:09:09.966197+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-08T17:43:19.737284+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '212', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 25, 'pool_name': 'cephfs_data', 'create_time': '2023-10-08T17:43:20.521518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '213', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-08T17:43:47.985 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-08T17:43:48.053 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.052+0000 7eff37ba4180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:48.095 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.095+0000 7f732f68e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-08T17:43:48.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.184+0000 7ffb5af9d700 1 Processor -- start 2023-10-08T17:43:48.184 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.184+0000 7ffb5af9d700 1 -- start start 2023-10-08T17:43:48.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb54153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb5415de50 0x7ffb5415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.185 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7ffb540cea00 0x7ffb540cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5415af60 con 0x7ffb5415de50 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5415b240 con 0x7ffb540cea00 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5415b520 con 0x7ffb54153a00 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5979a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb5415de50 0x7ffb5415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5979a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ffb5415de50 0x7ffb5415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39276/0 (socket says 172.21.15.12:39276) 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5979a700 1 -- 172.21.15.12:0/208364740 learned_addr learned my addr 172.21.15.12:0/208364740 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb59f9b700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb54153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.186 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.185+0000 7ffb5a79c700 1 --2- 172.21.15.12:0/208364740 >> v2:172.21.15.29:3300/0 conn(0x7ffb540cea00 0x7ffb540cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 -- 172.21.15.12:0/208364740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 msgr2=0x7ffb54153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb54153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 -- 172.21.15.12:0/208364740 >> v2:172.21.15.29:3300/0 conn(0x7ffb540cea00 msgr2=0x7ffb540cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 --2- 172.21.15.12:0/208364740 >> v2:172.21.15.29:3300/0 conn(0x7ffb540cea00 0x7ffb540cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 -- 172.21.15.12:0/208364740 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5415b800 con 0x7ffb5415de50 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb5979a700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415a540 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7ffb54159c60 tx=0x7ffb44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d4233c935a52f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb58f99700 1 -- 172.21.15.12:0/208364740 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400b640 con 0x7ffb5415de50 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb58f99700 1 -- 172.21.15.12:0/208364740 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4400b7a0 con 0x7ffb5415de50 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.186+0000 7ffb58f99700 1 -- 172.21.15.12:0/208364740 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4400bb60 con 0x7ffb5415de50 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 -- 172.21.15.12:0/208364740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 msgr2=0x7ffb5415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.188 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415a540 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7ffb54159c60 tx=0x7ffb44009250 comp rx=0 tx=0).stop 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 -- 172.21.15.12:0/208364740 shutdown_connections 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/208364740 >> v2:172.21.15.29:3300/0 conn(0x7ffb540cea00 0x7ffb540cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb54153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/208364740 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415a540 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 -- 172.21.15.12:0/208364740 >> 172.21.15.12:0/208364740 conn(0x7ffb540703a0 msgr2=0x7ffb540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 -- 172.21.15.12:0/208364740 shutdown_connections 2023-10-08T17:43:48.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.187+0000 7ffb5af9d700 1 -- 172.21.15.12:0/208364740 wait complete. 2023-10-08T17:43:48.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.188+0000 7ffb5af9d700 1 Processor -- start 2023-10-08T17:43:48.191 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.189+0000 7ffb5af9d700 1 -- start start 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb540c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c7fc0 con 0x7ffb5415de50 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c82a0 con 0x7ffb540cea00 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5af9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540c8580 con 0x7ffb54153a00 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5979a700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb540c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5a79c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39284/0 (socket says 172.21.15.12:39284) 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb5a79c700 1 -- 172.21.15.12:0/3749890874 learned_addr learned my addr 172.21.15.12:0/3749890874 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:48.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38392/0 (socket says 172.21.15.12:38392) 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 msgr2=0x7ffb540c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb540c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 msgr2=0x7ffb5415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.190+0000 7ffb59f9b700 1 -- 172.21.15.12:0/3749890874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb440094f0 con 0x7ffb540cea00 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb59f9b700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e9d0 tx=0x7ffb500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50013680 con 0x7ffb540cea00 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb50013800 con 0x7ffb540cea00 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb540c8860 con 0x7ffb540cea00 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb50013bc0 con 0x7ffb540cea00 2023-10-08T17:43:48.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.191+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb540c9060 con 0x7ffb540cea00 2023-10-08T17:43:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.192+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb540c8d80 con 0x7ffb540cea00 2023-10-08T17:43:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.193+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7ffb5000c490 con 0x7ffb540cea00 2023-10-08T17:43:48.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.194+0000 7ffb49ffb700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 0x7ffb38069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.194+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7ffb50084b50 con 0x7ffb540cea00 2023-10-08T17:43:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.194+0000 7ffb5979a700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 msgr2=0x7ffb38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:48.195 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.194+0000 7ffb5979a700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 0x7ffb38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:48.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.199+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb50051790 con 0x7ffb540cea00 2023-10-08T17:43:48.225 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.225+0000 7eff37ba4180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:48.272 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.272+0000 7f732f68e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:48.313 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.313+0000 7eff37ba4180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:48.361 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.361+0000 7f732f68e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-08T17:43:48.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.395+0000 7ffb5979a700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 msgr2=0x7ffb38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:48.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.395+0000 7ffb5979a700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 0x7ffb38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:48.400 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.401+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb540c83e0 con 0x7ffb540cea00 2023-10-08T17:43:48.401 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.401+0000 7ffb49ffb700 1 -- 172.21.15.12:0/3749890874 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v214) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb540c83e0 con 0x7ffb540cea00 2023-10-08T17:43:48.401 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 1 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 msgr2=0x7ffb38069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 0x7ffb38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 msgr2=0x7ffb54142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000e9d0 tx=0x7ffb500091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 shutdown_connections 2023-10-08T17:43:48.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ffb380670e0 0x7ffb38069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ffb5415de50 0x7ffb5415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ffb540cea00 0x7ffb54142110 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 --2- 172.21.15.12:0/3749890874 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ffb54153a00 0x7ffb540c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 >> 172.21.15.12:0/3749890874 conn(0x7ffb540703a0 msgr2=0x7ffb540b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 shutdown_connections 2023-10-08T17:43:48.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.404+0000 7ffb5af9d700 1 -- 172.21.15.12:0/3749890874 wait complete. 2023-10-08T17:43:48.424 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-08T17:43:48.545 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.545+0000 7eff37ba4180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:48.599 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.598+0000 7f732f68e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:48.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.617+0000 7f539a19d700 1 Processor -- start 2023-10-08T17:43:48.617 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.617+0000 7f539a19d700 1 -- start start 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5394153a00 0x7f5394153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 0x7f539415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53940cea00 0x7f53940cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539415af60 con 0x7f53940cea00 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539415b240 con 0x7f539415de50 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539a19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539415b520 con 0x7f5394153a00 2023-10-08T17:43:48.620 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539999c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53940cea00 0x7f53940cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539899a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 0x7f539415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539919b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5394153a00 0x7f5394153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539999c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53940cea00 0x7f53940cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39286/0 (socket says 172.21.15.12:39286) 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539899a700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 0x7f539415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38402/0 (socket says 172.21.15.12:38402) 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.619+0000 7f539999c700 1 -- 172.21.15.12:0/569616373 learned_addr learned my addr 172.21.15.12:0/569616373 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 -- 172.21.15.12:0/569616373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5394153a00 msgr2=0x7f5394153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 --2- 172.21.15.12:0/569616373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5394153a00 0x7f5394153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 -- 172.21.15.12:0/569616373 >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 msgr2=0x7f539415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 --2- 172.21.15.12:0/569616373 >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 0x7f539415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.621 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 -- 172.21.15.12:0/569616373 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539415b800 con 0x7f53940cea00 2023-10-08T17:43:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f539999c700 1 --2- 172.21.15.12:0/569616373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53940cea00 0x7f53940cee40 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f539406e800 tx=0x7f538c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d018e53ee4aadc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f538bfff700 1 -- 172.21.15.12:0/569616373 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c00e070 con 0x7f53940cea00 2023-10-08T17:43:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f538bfff700 1 -- 172.21.15.12:0/569616373 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c00b970 con 0x7f53940cea00 2023-10-08T17:43:48.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.620+0000 7f538bfff700 1 -- 172.21.15.12:0/569616373 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c0092e0 con 0x7f53940cea00 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 -- 172.21.15.12:0/569616373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53940cea00 msgr2=0x7f53940cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 --2- 172.21.15.12:0/569616373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53940cea00 0x7f53940cee40 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f539406e800 tx=0x7f538c009840 comp rx=0 tx=0).stop 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 -- 172.21.15.12:0/569616373 shutdown_connections 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 --2- 172.21.15.12:0/569616373 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53940cea00 0x7f53940cee40 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 --2- 172.21.15.12:0/569616373 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5394153a00 0x7f5394153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 --2- 172.21.15.12:0/569616373 >> v2:172.21.15.29:3300/0 conn(0x7f539415de50 0x7f539415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 -- 172.21.15.12:0/569616373 >> 172.21.15.12:0/569616373 conn(0x7f53940703a0 msgr2=0x7f53940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 -- 172.21.15.12:0/569616373 shutdown_connections 2023-10-08T17:43:48.623 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.621+0000 7f539a19d700 1 -- 172.21.15.12:0/569616373 wait complete. 2023-10-08T17:43:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.623+0000 7f539a19d700 1 Processor -- start 2023-10-08T17:43:48.624 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.624+0000 7f539a19d700 1 -- start start 2023-10-08T17:43:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 0x7f53940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 0x7f53940cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.626 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940cdca0 con 0x7f539415de50 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53940cd2d0 con 0x7f5394153a00 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.625+0000 7f539a19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53940cc3f0 con 0x7f53940cea00 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 0x7f53940cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539919b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539899a700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 0x7f53940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539919b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:55964/0 (socket says 172.21.15.12:55964) 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539919b700 1 -- 172.21.15.12:0/3506936579 learned_addr learned my addr 172.21.15.12:0/3506936579 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539899a700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 0x7f53940cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:38410/0 (socket says 172.21.15.12:38410) 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 msgr2=0x7f53940cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.627 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 msgr2=0x7f53940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 0x7f53940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 -- 172.21.15.12:0/3506936579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009ae0 con 0x7f539415de50 2023-10-08T17:43:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539919b700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:48.628 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.626+0000 7f539999c700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 0x7f53940cbeb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f5394159c60 tx=0x7f538c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.627+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c008ad0 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.627+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c008c50 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.627+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c026460 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.627+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53940cc6c0 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.627+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53940ccc80 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.628+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539404c3c0 con 0x7f539415de50 2023-10-08T17:43:48.629 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.629+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f538c003040 con 0x7f539415de50 2023-10-08T17:43:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.630+0000 7f53897fa700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 0x7f5378069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.630+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f538c086900 con 0x7f539415de50 2023-10-08T17:43:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.630+0000 7f539919b700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 msgr2=0x7f5378069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:48.630 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.630+0000 7f539919b700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 0x7f5378069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:48.634 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.634+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f538c053580 con 0x7f539415de50 2023-10-08T17:43:48.733 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.732+0000 7eff37ba4180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:48.790 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.789+0000 7f732f68e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-08T17:43:48.828 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.828+0000 7eff37ba4180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:48.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.831+0000 7f539919b700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 msgr2=0x7f5378069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:48.831 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.831+0000 7f539919b700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 0x7f5378069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:48.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.836+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f539415bae0 con 0x7f539415de50 2023-10-08T17:43:48.836 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.836+0000 7f53897fa700 1 -- 172.21.15.12:0/3506936579 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v214) v1 ==== 104+0+11 (secure 0 0 0) 0x7f538c056ba0 con 0x7f539415de50 2023-10-08T17:43:48.836 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 32 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 msgr2=0x7f5378069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 0x7f5378069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 msgr2=0x7f53940cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 0x7f53940cbeb0 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7f5394159c60 tx=0x7f538c018000 comp rx=0 tx=0).stop 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 shutdown_connections 2023-10-08T17:43:48.839 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f53780670e0 0x7f5378069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f539415de50 0x7f53940cbeb0 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53940cea00 0x7f53940cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 --2- 172.21.15.12:0/3506936579 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5394153a00 0x7f53940cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 >> 172.21.15.12:0/3506936579 conn(0x7f53940703a0 msgr2=0x7f53940b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 shutdown_connections 2023-10-08T17:43:48.840 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:48.839+0000 7f539a19d700 1 -- 172.21.15.12:0/3506936579 wait complete. 2023-10-08T17:43:48.857 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-08T17:43:48.888 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:48.888+0000 7f732f68e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-08T17:43:48.994 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:48.994+0000 7eff37ba4180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:49.052 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.052+0000 7f35b359e700 1 Processor -- start 2023-10-08T17:43:49.053 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.052+0000 7f35b359e700 1 -- start start 2023-10-08T17:43:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.053+0000 7f35b359e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35b4153a00 0x7f35b4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b359e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b415ac50 con 0x7f35b415de50 2023-10-08T17:43:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b359e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b415d010 con 0x7f35b40cea00 2023-10-08T17:43:49.054 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b359e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b415af60 con 0x7f35b4153a00 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35b4153a00 0x7f35b4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f35b4153a00 0x7f35b4153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39302/0 (socket says 172.21.15.12:39302) 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b1d9b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f35b415de50 0x7f35b415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52508/0 (socket says 172.21.15.12:52508) 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 -- 172.21.15.12:0/2240674200 learned_addr learned my addr 172.21.15.12:0/2240674200 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 -- 172.21.15.12:0/2240674200 >> v1:172.21.15.29:6789/0 conn(0x7f35b40cea00 legacy=0x7f35b40cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 -- 172.21.15.12:0/2240674200 >> v1:172.21.15.12:6789/0 conn(0x7f35b415de50 legacy=0x7f35b415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.055 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.054+0000 7f35b259c700 1 -- 172.21.15.12:0/2240674200 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b415b240 con 0x7f35b4153a00 2023-10-08T17:43:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.055+0000 7f35b259c700 1 --2- 172.21.15.12:0/2240674200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b4153dd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f35a40099b0 tx=0x7f35a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57cd29335d9d506 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:49.056 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.055+0000 7f35b159a700 1 -- 172.21.15.12:0/2240674200 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400b860 con 0x7f35b4153a00 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.055+0000 7f35b159a700 1 -- 172.21.15.12:0/2240674200 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400b9c0 con 0x7f35b4153a00 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.055+0000 7f35b159a700 1 -- 172.21.15.12:0/2240674200 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400bd60 con 0x7f35b4153a00 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 -- 172.21.15.12:0/2240674200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 msgr2=0x7f35b4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 --2- 172.21.15.12:0/2240674200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b4153dd0 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f35a40099b0 tx=0x7f35a4009250 comp rx=0 tx=0).stop 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 -- 172.21.15.12:0/2240674200 shutdown_connections 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 --2- 172.21.15.12:0/2240674200 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b4153dd0 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 -- 172.21.15.12:0/2240674200 >> 172.21.15.12:0/2240674200 conn(0x7f35b40703a0 msgr2=0x7f35b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 -- 172.21.15.12:0/2240674200 shutdown_connections 2023-10-08T17:43:49.057 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.056+0000 7f35b359e700 1 -- 172.21.15.12:0/2240674200 wait complete. 2023-10-08T17:43:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.057+0000 7f35b359e700 1 Processor -- start 2023-10-08T17:43:49.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.057+0000 7f35b359e700 1 -- start start 2023-10-08T17:43:49.058 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:49.057+0000 7f732f68e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-08T17:43:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b40cea00 0x7f35b40c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35b415de50 0x7f35b4151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.060 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40ca2f0 con 0x7f35b4153a00 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c7b20 con 0x7f35b40cea00 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.058+0000 7f35b359e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b40c8940 con 0x7f35b415de50 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39306/0 (socket says 172.21.15.12:39306) 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 -- 172.21.15.12:0/3026207897 learned_addr learned my addr 172.21.15.12:0/3026207897 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b259c700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b40cea00 0x7f35b40c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b2d9d700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35b415de50 0x7f35b4151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35b415de50 msgr2=0x7f35b4151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35b415de50 0x7f35b4151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b40cea00 msgr2=0x7f35b40c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b40cea00 0x7f35b40c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 -- 172.21.15.12:0/3026207897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40094f0 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.059+0000 7f35b1d9b700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c5b0 tx=0x7f35a8007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.060+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8005a70 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.060+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a8005bd0 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.060+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b4151940 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.060+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80070d0 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.060+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b40c8010 con 0x7f35b4153a00 2023-10-08T17:43:49.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.061+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b404c3c0 con 0x7f35b4153a00 2023-10-08T17:43:49.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.063+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f35a8007480 con 0x7f35b4153a00 2023-10-08T17:43:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.065+0000 7f35a27fc700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 0x7f3594069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.065+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f35a8083fe0 con 0x7f35b4153a00 2023-10-08T17:43:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.065+0000 7f35b259c700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 msgr2=0x7f3594069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:49.065 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.065+0000 7f35b259c700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 0x7f3594069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:49.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.069+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35a8050c20 con 0x7f35b4153a00 2023-10-08T17:43:49.099 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:49.099+0000 7eff37ba4180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:49.166 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:49.166+0000 7f732f68e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-08T17:43:49.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.266+0000 7f35b259c700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 msgr2=0x7f3594069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:49.266 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.266+0000 7f35b259c700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 0x7f3594069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.272+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35b40caef0 con 0x7f35b4153a00 2023-10-08T17:43:49.272 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.273+0000 7f35a27fc700 1 -- 172.21.15.12:0/3026207897 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v214) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35a8017020 con 0x7f35b4153a00 2023-10-08T17:43:49.273 INFO:teuthology.orchestra.run.smithi012.stdout:pg_num: 64 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 msgr2=0x7f3594069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 0x7f3594069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 msgr2=0x7f35b40c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c5b0 tx=0x7f35a8007f70 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 shutdown_connections 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f35940670e0 0x7f3594069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f35b415de50 0x7f35b4151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f35b40cea00 0x7f35b40c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 --2- 172.21.15.12:0/3026207897 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f35b4153a00 0x7f35b40c75e0 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 >> 172.21.15.12:0/3026207897 conn(0x7f35b40703a0 msgr2=0x7f35b41521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:49.276 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 shutdown_connections 2023-10-08T17:43:49.277 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.275+0000 7f35b359e700 1 -- 172.21.15.12:0/3026207897 wait complete. 2023-10-08T17:43:49.294 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.526+0000 7f0e91d9d700 1 Processor -- start 2023-10-08T17:43:49.526 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.526+0000 7f0e91d9d700 1 -- start start 2023-10-08T17:43:49.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e91d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e8c153c30 0x7f0e8c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e91d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f0e8c15de50 0x7f0e8c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e91d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e8c0cf3c0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e91d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c15afd0 con 0x7f0e8c153c30 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e91d9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c15b2b0 con 0x7f0e8c15de50 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.527+0000 7f0e90d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e8c153c30 0x7f0e8c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0e8c153c30 0x7f0e8c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39312/0 (socket says 172.21.15.12:39312) 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 -- 172.21.15.12:0/1259728088 learned_addr learned my addr 172.21.15.12:0/1259728088 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:49.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e8bfff700 1 --2- 172.21.15.12:0/1259728088 >> v2:172.21.15.29:3300/0 conn(0x7f0e8c15de50 0x7f0e8c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 -- 172.21.15.12:0/1259728088 >> v2:172.21.15.29:3300/0 conn(0x7f0e8c15de50 msgr2=0x7f0e8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 --2- 172.21.15.12:0/1259728088 >> v2:172.21.15.29:3300/0 conn(0x7f0e8c15de50 0x7f0e8c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 -- 172.21.15.12:0/1259728088 >> v1:172.21.15.29:6789/0 conn(0x7f0e8c0cef40 legacy=0x7f0e8c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 -- 172.21.15.12:0/1259728088 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c15b590 con 0x7f0e8c153c30 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e8b7fe700 1 -- 172.21.15.12:0/1259728088 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153850987 0 0) 0x7f0e8c0cf3c0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e90d9b700 1 --2- 172.21.15.12:0/1259728088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c15a5e0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0713a0 tx=0x7f0e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2f5bb1ff9f68c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.528+0000 7f0e8b7fe700 1 -- 172.21.15.12:0/1259728088 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e80009e70 con 0x7f0e8c153c30 2023-10-08T17:43:49.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e8b7fe700 1 -- 172.21.15.12:0/1259728088 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8000b860 con 0x7f0e8c153c30 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e8b7fe700 1 -- 172.21.15.12:0/1259728088 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000bc00 con 0x7f0e8c153c30 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 -- 172.21.15.12:0/1259728088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 msgr2=0x7f0e8c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/1259728088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c15a5e0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0713a0 tx=0x7f0e80009250 comp rx=0 tx=0).stop 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 -- 172.21.15.12:0/1259728088 shutdown_connections 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/1259728088 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c15a5e0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/1259728088 >> v2:172.21.15.29:3300/0 conn(0x7f0e8c15de50 0x7f0e8c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 -- 172.21.15.12:0/1259728088 >> 172.21.15.12:0/1259728088 conn(0x7f0e8c0703a0 msgr2=0x7f0e8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 -- 172.21.15.12:0/1259728088 shutdown_connections 2023-10-08T17:43:49.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.529+0000 7f0e91d9d700 1 -- 172.21.15.12:0/1259728088 wait complete. 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.531+0000 7f0e91d9d700 1 Processor -- start 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.531+0000 7f0e91d9d700 1 -- start start 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 0x7f0e8c152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e8c15de50 0x7f0e8c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0b6260 con 0x7f0e8c153c30 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0b38c0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e91d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0b5ca0 con 0x7f0e8c15de50 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e90d9b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 0x7f0e8c152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39316/0 (socket says 172.21.15.12:39316) 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e8bfff700 1 -- 172.21.15.12:0/596444775 learned_addr learned my addr 172.21.15.12:0/596444775 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e9159c700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e8c15de50 0x7f0e8c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e90d9b700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e8c15de50 msgr2=0x7f0e8c0b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.532+0000 7f0e90d9b700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e8c15de50 0x7f0e8c0b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e90d9b700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 msgr2=0x7f0e8c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.534 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e90d9b700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e90d9b700 1 -- 172.21.15.12:0/596444775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800094f0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e90d9b700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 0x7f0e8c152550 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0cdab0 tx=0x7f0e80017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8000bbe0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.533+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e80011420 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.534+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e800117e0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.534+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c0b5f80 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.534+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c0ca300 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.535+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c04c3c0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.536+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0e80011b90 con 0x7f0e8c0cef40 2023-10-08T17:43:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.536+0000 7f0e88ff9700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 0x7f0e70069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.537+0000 7f0e8bfff700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 msgr2=0x7f0e70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.537+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0e800864e0 con 0x7f0e8c0cef40 2023-10-08T17:43:49.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.537+0000 7f0e8bfff700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 0x7f0e70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:49.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.541+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e80053120 con 0x7f0e8c0cef40 2023-10-08T17:43:49.602 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:49.602+0000 7eff37ba4180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:49.681 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:49.681+0000 7f732f68e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-08T17:43:49.700 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:49.699+0000 7eff37ba4180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.738+0000 7f0e8bfff700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 msgr2=0x7f0e70069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:49.738 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.738+0000 7f0e8bfff700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 0x7f0e70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:49.782 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:49.781+0000 7f732f68e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-08T17:43:49.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.788+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e8c15d680 con 0x7f0e8c0cef40 2023-10-08T17:43:49.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.789+0000 7f0e88ff9700 1 -- 172.21.15.12:0/596444775 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7f0e80056740 con 0x7f0e8c0cef40 2023-10-08T17:43:49.789 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:49.789 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.791+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 msgr2=0x7f0e70069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.791+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 0x7f0e70069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.791+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 msgr2=0x7f0e8c152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.791+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 0x7f0e8c152550 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0cdab0 tx=0x7f0e80017000 comp rx=0 tx=0).stop 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 shutdown_connections 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0e700670e0 0x7f0e70069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0e8c15de50 0x7f0e8c0b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0e8c0cef40 0x7f0e8c152550 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 --2- 172.21.15.12:0/596444775 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0e8c153c30 0x7f0e8c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 >> 172.21.15.12:0/596444775 conn(0x7f0e8c0703a0 msgr2=0x7f0e8c153060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 shutdown_connections 2023-10-08T17:43:49.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.792+0000 7f0e91d9d700 1 -- 172.21.15.12:0/596444775 wait complete. 2023-10-08T17:43:49.794 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:49.795 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:49.795+0000 7eff37ba4180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:49.810 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:49.880 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:49.880+0000 7f732f68e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-08T17:43:49.998 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.998+0000 7f52dcb9d700 1 Processor -- start 2023-10-08T17:43:49.999 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:49.999+0000 7f52dcb9d700 1 -- start start 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52dcb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52dcb9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d815de50 0x7f52d80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52dcb9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d815afd0 con 0x7f52d80cef40 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52dcb9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d815b2b0 con 0x7f52d815de50 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52dcb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815b590 con 0x7f52d8153c30 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52d6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d815de50 0x7f52d80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52d6ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f52d815de50 0x7f52d80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39328/0 (socket says 172.21.15.12:39328) 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52d6ffd700 1 -- 172.21.15.12:0/2918249744 learned_addr learned my addr 172.21.15.12:0/2918249744 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:50.001 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52d7fff700 1 --1- 172.21.15.12:0/2918249744 >> v1:172.21.15.12:6789/0 conn(0x7f52d80cef40 0x7f52d806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52524/0 (socket says 172.21.15.12:52524) 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.000+0000 7f52d77fe700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d6ffd700 1 -- 172.21.15.12:0/2918249744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 msgr2=0x7f52d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d6ffd700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d6ffd700 1 -- 172.21.15.12:0/2918249744 >> v1:172.21.15.12:6789/0 conn(0x7f52d80cef40 legacy=0x7f52d806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d6ffd700 1 -- 172.21.15.12:0/2918249744 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d815b870 con 0x7f52d815de50 2023-10-08T17:43:50.002 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d6ffd700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80cea00 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0099b0 tx=0x7f52cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2edc190e2c9eba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d67fc700 1 -- 172.21.15.12:0/2918249744 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc009ea0 con 0x7f52d815de50 2023-10-08T17:43:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d67fc700 1 -- 172.21.15.12:0/2918249744 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc00b860 con 0x7f52d815de50 2023-10-08T17:43:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.001+0000 7f52d67fc700 1 -- 172.21.15.12:0/2918249744 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00bc00 con 0x7f52d815de50 2023-10-08T17:43:50.004 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 -- 172.21.15.12:0/2918249744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 msgr2=0x7f52d80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80cea00 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f52cc0099b0 tx=0x7f52cc009250 comp rx=0 tx=0).stop 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 -- 172.21.15.12:0/2918249744 shutdown_connections 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/2918249744 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80cea00 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 -- 172.21.15.12:0/2918249744 >> 172.21.15.12:0/2918249744 conn(0x7f52d80703a0 msgr2=0x7f52d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 -- 172.21.15.12:0/2918249744 shutdown_connections 2023-10-08T17:43:50.005 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.002+0000 7f52dcb9d700 1 -- 172.21.15.12:0/2918249744 wait complete. 2023-10-08T17:43:50.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.005+0000 7f52dcb9d700 1 Processor -- start 2023-10-08T17:43:50.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.005+0000 7f52dcb9d700 1 -- start start 2023-10-08T17:43:50.009 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cef40 0x7f52d8153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d81536c0 con 0x7f52d815de50 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d8169ba0 con 0x7f52d80cef40 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.006+0000 7f52dcb9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80b4060 con 0x7f52d8153c30 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.010 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39340/0 (socket says 172.21.15.12:39340) 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 -- 172.21.15.12:0/1083706179 learned_addr learned my addr 172.21.15.12:0/1083706179 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d77fe700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cef40 0x7f52d8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d6ffd700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 msgr2=0x7f52d80c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d80c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.011 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cef40 msgr2=0x7f52d8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cef40 0x7f52d8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 -- 172.21.15.12:0/1083706179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0094f0 con 0x7f52d815de50 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.007+0000 7f52d7fff700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f52d000cc70 tx=0x7f52d0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.008+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d0005df0 con 0x7f52d815de50 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.008+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d000a5b0 con 0x7f52d815de50 2023-10-08T17:43:50.012 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.008+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80b4340 con 0x7f52d815de50 2023-10-08T17:43:50.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.008+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d000a930 con 0x7f52d815de50 2023-10-08T17:43:50.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.008+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80b4900 con 0x7f52d815de50 2023-10-08T17:43:50.013 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.009+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d8169d10 con 0x7f52d815de50 2023-10-08T17:43:50.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.010+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f52d000ace0 con 0x7f52d815de50 2023-10-08T17:43:50.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.011+0000 7f52bf7fe700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 0x7f52c4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.011+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f52d0084b50 con 0x7f52d815de50 2023-10-08T17:43:50.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.011+0000 7f52d77fe700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 msgr2=0x7f52c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:50.014 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.011+0000 7f52d77fe700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 0x7f52c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:50.015 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.015+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52d0051810 con 0x7f52d815de50 2023-10-08T17:43:50.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.212+0000 7f52d77fe700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 msgr2=0x7f52c4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:50.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.212+0000 7f52d77fe700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 0x7f52c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.218+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d804c3c0 con 0x7f52d815de50 2023-10-08T17:43:50.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.219+0000 7f52bf7fe700 1 -- 172.21.15.12:0/1083706179 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f52d0054e30 con 0x7f52d815de50 2023-10-08T17:43:50.220 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:50.220 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":214,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:42.681627+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:6836/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/3541952869":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/2981918803":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/843450174":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/790125058":"2023-10-09T17:43:42.681590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 msgr2=0x7f52c4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:50.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 0x7f52c4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 msgr2=0x7f52d80c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f52d000cc70 tx=0x7f52d0001a70 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 shutdown_connections 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f52c40670e0 0x7f52c4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f52d815de50 0x7f52d80c9c10 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f52d80cef40 0x7f52d8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 --2- 172.21.15.12:0/1083706179 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f52d8153c30 0x7f52d80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 >> 172.21.15.12:0/1083706179 conn(0x7f52d80703a0 msgr2=0x7f52d80c53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 shutdown_connections 2023-10-08T17:43:50.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.222+0000 7f52dcb9d700 1 -- 172.21.15.12:0/1083706179 wait complete. 2023-10-08T17:43:50.241 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:43:50.241 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:50.444 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:50.443+0000 7eff37ba4180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.449+0000 7fad67fff700 1 Processor -- start 2023-10-08T17:43:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.449+0000 7fad67fff700 1 -- start start 2023-10-08T17:43:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.451+0000 7fad67fff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad68147390 0x7fad680cb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.451+0000 7fad67fff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad680cb280 con 0x7fad680c6980 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.451+0000 7fad67fff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad680ca410 con 0x7fad6806dee0 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.451+0000 7fad67fff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad680ca670 con 0x7fad68147390 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad68147390 0x7fad680cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fad68147390 0x7fad680cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39348/0 (socket says 172.21.15.12:39348) 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 -- 172.21.15.12:0/2403151758 learned_addr learned my addr 172.21.15.12:0/2403151758 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 -- 172.21.15.12:0/2403151758 >> v1:172.21.15.29:6789/0 conn(0x7fad6806dee0 legacy=0x7fad680c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 -- 172.21.15.12:0/2403151758 >> v1:172.21.15.12:6789/0 conn(0x7fad680c6980 legacy=0x7fad68069b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.452+0000 7fad66ffd700 1 -- 172.21.15.12:0/2403151758 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680ca950 con 0x7fad68147390 2023-10-08T17:43:50.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.453+0000 7fad66ffd700 1 --2- 172.21.15.12:0/2403151758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad68147390 0x7fad680cb710 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fad60009990 tx=0x7fad60009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d52de4a41d898 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.453+0000 7fad65ffb700 1 -- 172.21.15.12:0/2403151758 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60005c10 con 0x7fad68147390 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.453+0000 7fad65ffb700 1 -- 172.21.15.12:0/2403151758 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60005d70 con 0x7fad68147390 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.454+0000 7fad67fff700 1 -- 172.21.15.12:0/2403151758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad68147390 msgr2=0x7fad680cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.454+0000 7fad67fff700 1 --2- 172.21.15.12:0/2403151758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad68147390 0x7fad680cb710 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7fad60009990 tx=0x7fad60009220 comp rx=0 tx=0).stop 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.454+0000 7fad67fff700 1 -- 172.21.15.12:0/2403151758 shutdown_connections 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.454+0000 7fad67fff700 1 --2- 172.21.15.12:0/2403151758 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad68147390 0x7fad680cb710 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.454+0000 7fad67fff700 1 -- 172.21.15.12:0/2403151758 >> 172.21.15.12:0/2403151758 conn(0x7fad6806d130 msgr2=0x7fad680cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.455+0000 7fad67fff700 1 -- 172.21.15.12:0/2403151758 shutdown_connections 2023-10-08T17:43:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.455+0000 7fad67fff700 1 -- 172.21.15.12:0/2403151758 wait complete. 2023-10-08T17:43:50.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.457+0000 7fad67fff700 1 Processor -- start 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.458+0000 7fad67fff700 1 -- start start 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad680c6980 0x7fad680afea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 0x7fad680b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad68132410 con 0x7fad6806dee0 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad680c58c0 con 0x7fad680c6290 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.459+0000 7fad67fff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6815d680 con 0x7fad680c6980 2023-10-08T17:43:50.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad66ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad66ffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39358/0 (socket says 172.21.15.12:39358) 2023-10-08T17:43:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad66ffd700 1 -- 172.21.15.12:0/1784767864 learned_addr learned my addr 172.21.15.12:0/1784767864 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:50.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad667fc700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad680c6980 0x7fad680afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad677fe700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 0x7fad680b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.460+0000 7fad66ffd700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad680c6980 msgr2=0x7fad680afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.461+0000 7fad66ffd700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad680c6980 0x7fad680afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.461+0000 7fad66ffd700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 msgr2=0x7fad680b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.461+0000 7fad66ffd700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 0x7fad680b03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.461+0000 7fad66ffd700 1 -- 172.21.15.12:0/1784767864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60009480 con 0x7fad6806dee0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.461+0000 7fad677fe700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 0x7fad680b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.462+0000 7fad66ffd700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fad68068610 tx=0x7fad60015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.462+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad60022070 con 0x7fad6806dee0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.462+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad60011e60 con 0x7fad6806dee0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.462+0000 7fad67fff700 1 -- 172.21.15.12:0/1784767864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad680c4f90 con 0x7fad6806dee0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.462+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6001d660 con 0x7fad6806dee0 2023-10-08T17:43:50.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.463+0000 7fad67fff700 1 -- 172.21.15.12:0/1784767864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad680c5550 con 0x7fad6806dee0 2023-10-08T17:43:50.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.464+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad400052b0 con 0x7fad6806dee0 2023-10-08T17:43:50.473 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.473+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fad6001da90 con 0x7fad6806dee0 2023-10-08T17:43:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.474+0000 7fad5effd700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 0x7fad48069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.475+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fad60087030 con 0x7fad6806dee0 2023-10-08T17:43:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.475+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad60087540 con 0x7fad6806dee0 2023-10-08T17:43:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.475+0000 7fad667fc700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 msgr2=0x7fad48069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:50.475 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.475+0000 7fad667fc700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 0x7fad48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:50.550 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:50.550+0000 7f732f68e180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-08T17:43:50.624 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:50.623+0000 7eff37ba4180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.676+0000 7fad667fc700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 msgr2=0x7fad48069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:50.676 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.676+0000 7fad667fc700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 0x7fad48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:50.723 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:50.723+0000 7eff37ba4180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.731+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad40005830 con 0x7fad6806dee0 2023-10-08T17:43:50.731 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.732+0000 7fad5effd700 1 -- 172.21.15.12:0/1784767864 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fad60053dd0 con 0x7fad6806dee0 2023-10-08T17:43:50.732 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:50.732 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:50.733 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:50.733+0000 7f732f68e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-08T17:43:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 msgr2=0x7fad48069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 0x7fad48069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.734 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 msgr2=0x7fad680c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7fad68068610 tx=0x7fad60015000 comp rx=0 tx=0).stop 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 shutdown_connections 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fad480670e0 0x7fad48069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fad6806dee0 0x7fad680c5d50 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fad680c6290 0x7fad680b03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 --2- 172.21.15.12:0/1784767864 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fad680c6980 0x7fad680afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 >> 172.21.15.12:0/1784767864 conn(0x7fad6806d130 msgr2=0x7fad6806a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 shutdown_connections 2023-10-08T17:43:50.735 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.734+0000 7fad5cff9700 1 -- 172.21.15.12:0/1784767864 wait complete. 2023-10-08T17:43:50.736 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:50.754 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:43:50.839 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:50.839+0000 7f732f68e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-08T17:43:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.943+0000 7fedcc9fe700 1 Processor -- start 2023-10-08T17:43:50.944 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.944+0000 7fedcc9fe700 1 -- start start 2023-10-08T17:43:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedcc9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc8153c30 0x7fedc815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedcc9fe700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fedc80cf110 0x7fedc815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.945 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedcc9fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc815afd0 con 0x7fedc815de50 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedcc9fe700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc815b2b0 con 0x7fedc80cf110 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedcc9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc815b590 con 0x7fedc8153c30 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedc659c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fedc815de50 0x7fedc80cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52530/0 (socket says 172.21.15.12:52530) 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedc659c700 1 -- 172.21.15.12:0/900586407 learned_addr learned my addr 172.21.15.12:0/900586407 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedc6d9d700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc8153c30 0x7fedc815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.945+0000 7fedc759e700 1 --2- 172.21.15.12:0/900586407 >> v2:172.21.15.29:3300/0 conn(0x7fedc80cf110 0x7fedc815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc5d9b700 1 -- 172.21.15.12:0/900586407 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680119739 0 0) 0x7fedc815afd0 con 0x7fedc815de50 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc5d9b700 1 -- 172.21.15.12:0/900586407 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0003570 con 0x7fedc815de50 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc759e700 1 -- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc8153c30 msgr2=0x7fedc815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc759e700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc8153c30 0x7fedc815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc759e700 1 -- 172.21.15.12:0/900586407 >> v1:172.21.15.12:6789/0 conn(0x7fedc815de50 legacy=0x7fedc80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc759e700 1 -- 172.21.15.12:0/900586407 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc815b870 con 0x7fedc80cf110 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc759e700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc815c070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009e60 tx=0x7fedc0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf427939cd428a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc5d9b700 1 -- 172.21.15.12:0/900586407 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000e070 con 0x7fedc80cf110 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc5d9b700 1 -- 172.21.15.12:0/900586407 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc000bab0 con 0x7fedc80cf110 2023-10-08T17:43:50.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.946+0000 7fedc5d9b700 1 -- 172.21.15.12:0/900586407 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc000be70 con 0x7fedc80cf110 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 -- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 msgr2=0x7fedc815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc815c070 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009e60 tx=0x7fedc0009780 comp rx=0 tx=0).stop 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 -- 172.21.15.12:0/900586407 shutdown_connections 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc815c070 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/900586407 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc8153c30 0x7fedc815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 -- 172.21.15.12:0/900586407 >> 172.21.15.12:0/900586407 conn(0x7fedc80703a0 msgr2=0x7fedc80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 -- 172.21.15.12:0/900586407 shutdown_connections 2023-10-08T17:43:50.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.947+0000 7fedcc9fe700 1 -- 172.21.15.12:0/900586407 wait complete. 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.949+0000 7fedcc9fe700 1 Processor -- start 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.949+0000 7fedcc9fe700 1 -- start start 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc8146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 0x7fedc80c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc815de50 0x7fedc80b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80b59a0 con 0x7fedc8153c30 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc8146560 con 0x7fedc80cf110 2023-10-08T17:43:50.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedcc9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc816d350 con 0x7fedc815de50 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 0x7fedc80c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedc6d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedc659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 0x7fedc80c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39362/0 (socket says 172.21.15.12:39362) 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedc659c700 1 -- 172.21.15.12:0/913226940 learned_addr learned my addr 172.21.15.12:0/913226940 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.950+0000 7fedc759e700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc815de50 0x7fedc80b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc815de50 msgr2=0x7fedc80b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc815de50 0x7fedc80b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 msgr2=0x7fedc80c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 0x7fedc80c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:50.953 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 -- 172.21.15.12:0/913226940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc0009a20 con 0x7fedc80cf110 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedc6d9d700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc8146020 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fedb800ea80 tx=0x7fedb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800ee60 con 0x7fedc80cf110 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb800c7f0 con 0x7fedc80cf110 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc816a200 con 0x7fedc80cf110 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.951+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb800cb90 con 0x7fedc80cf110 2023-10-08T17:43:50.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.952+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc816a7c0 con 0x7fedc80cf110 2023-10-08T17:43:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.952+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc815dab0 con 0x7fedc80cf110 2023-10-08T17:43:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.954+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fedb8013470 con 0x7fedc80cf110 2023-10-08T17:43:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.954+0000 7fedaeffd700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 0x7fedb4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:50.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.954+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7fedb8084cf0 con 0x7fedc80cf110 2023-10-08T17:43:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.955+0000 7fedc659c700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 msgr2=0x7fedb4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:50.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.955+0000 7fedc659c700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 0x7fedb4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:50.958 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:50.959+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedb8051930 con 0x7fedc80cf110 2023-10-08T17:43:51.026 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:51.025+0000 7eff37ba4180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:51.125 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:51.125+0000 7eff37ba4180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:51.146 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:51.146+0000 7f732f68e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-08T17:43:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.156+0000 7fedc659c700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 msgr2=0x7fedb4069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:51.156 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.156+0000 7fedc659c700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 0x7fedb4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:51.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.212+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedc80cfbe0 con 0x7fedc80cf110 2023-10-08T17:43:51.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.213+0000 7fedaeffd700 1 -- 172.21.15.12:0/913226940 <== mon.1 v2:172.21.15.29:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 98 v98) v1 ==== 94+0+4602 (secure 0 0 0) 0x7fedb8054f50 con 0x7fedc80cf110 2023-10-08T17:43:51.213 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:51.213 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":98,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":98,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-08T17:43:21.539783+0000","modified":"2023-10-08T17:43:25.072474+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10278":{"gid":10278,"name":"b","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.29:6835/4272081005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":4272081005},{"type":"v1","addr":"172.21.15.29:6835","nonce":4272081005}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.215+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 msgr2=0x7fedb4069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.215+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 0x7fedb4069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 msgr2=0x7fedc8146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc8146020 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fedb800ea80 tx=0x7fedb80091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 shutdown_connections 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fedb40670e0 0x7fedb4069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fedc815de50 0x7fedc80b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fedc80cf110 0x7fedc8146020 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 --2- 172.21.15.12:0/913226940 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fedc8153c30 0x7fedc80c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 >> 172.21.15.12:0/913226940 conn(0x7fedc80703a0 msgr2=0x7fedc8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 shutdown_connections 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.216+0000 7fedcc9fe700 1 -- 172.21.15.12:0/913226940 wait complete. 2023-10-08T17:43:51.217 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 98 2023-10-08T17:43:51.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:51.250 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:51.250+0000 7f732f68e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-08T17:43:51.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.427+0000 7f77035ff700 1 Processor -- start 2023-10-08T17:43:51.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.427+0000 7f77035ff700 1 -- start start 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f77035ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f76fc1579d0 0x7f76fc1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f77035ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc158210 con 0x7f76fc157600 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f77035ff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76fc0cb290 con 0x7f76fc0b1b20 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f77035ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76fc0cb850 con 0x7f76fc1579d0 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f770139b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f76fc157600 0x7f76fc0b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52542/0 (socket says 172.21.15.12:52542) 2023-10-08T17:43:51.429 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f770139b700 1 -- 172.21.15.12:0/3803404005 learned_addr learned my addr 172.21.15.12:0/3803404005 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:51.430 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f7701b9c700 1 --2- 172.21.15.12:0/3803404005 >> v2:172.21.15.29:3300/0 conn(0x7f76fc1579d0 0x7f76fc1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1729936290 0 0) 0x7f76fc0cb290 con 0x7f76fc0b1b20 2023-10-08T17:43:51.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e8003570 con 0x7f76fc0b1b20 2023-10-08T17:43:51.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494905070 0 0) 0x7f76fc158210 con 0x7f76fc157600 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f7701b9c700 1 -- 172.21.15.12:0/3803404005 >> v1:172.21.15.29:6789/0 conn(0x7f76fc0b1b20 legacy=0x7f76fc15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f7701b9c700 1 -- 172.21.15.12:0/3803404005 >> v1:172.21.15.12:6789/0 conn(0x7f76fc157600 legacy=0x7f76fc0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.429+0000 7f7701b9c700 1 -- 172.21.15.12:0/3803404005 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76fc0cb570 con 0x7f76fc1579d0 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.430+0000 7f7701b9c700 1 --2- 172.21.15.12:0/3803404005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc1579d0 0x7f76fc1629e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009e60 tx=0x7f76f4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5ecd16f85a404a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.430+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f400e070 con 0x7f76fc1579d0 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.430+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f400bb60 con 0x7f76fc1579d0 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.430+0000 7f76f3fff700 1 -- 172.21.15.12:0/3803404005 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f4012430 con 0x7f76fc1579d0 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 -- 172.21.15.12:0/3803404005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc1579d0 msgr2=0x7f76fc1629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 --2- 172.21.15.12:0/3803404005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc1579d0 0x7f76fc1629e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009e60 tx=0x7f76f4009780 comp rx=0 tx=0).stop 2023-10-08T17:43:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 -- 172.21.15.12:0/3803404005 shutdown_connections 2023-10-08T17:43:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 --2- 172.21.15.12:0/3803404005 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc1579d0 0x7f76fc1629e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 -- 172.21.15.12:0/3803404005 >> 172.21.15.12:0/3803404005 conn(0x7f76fc06d170 msgr2=0x7f76fc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 -- 172.21.15.12:0/3803404005 shutdown_connections 2023-10-08T17:43:51.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.431+0000 7f77035ff700 1 -- 172.21.15.12:0/3803404005 wait complete. 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.432+0000 7f77035ff700 1 Processor -- start 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 -- start start 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc0b1b20 0x7f76fc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76fc1579d0 0x7f76fc0acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc14c6f0 con 0x7f76fc157600 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0b11f0 con 0x7f76fc0b1b20 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.433+0000 7f77035ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76fc0c6f30 con 0x7f76fc1579d0 2023-10-08T17:43:51.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39364/0 (socket says 172.21.15.12:39364) 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 -- 172.21.15.12:0/2843797123 learned_addr learned my addr 172.21.15.12:0/2843797123 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7701b9c700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76fc1579d0 0x7f76fc0acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f770139b700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc0b1b20 0x7f76fc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76fc1579d0 msgr2=0x7f76fc0acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76fc1579d0 0x7f76fc0acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc0b1b20 msgr2=0x7f76fc0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc0b1b20 0x7f76fc0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.434+0000 7f7700b9a700 1 -- 172.21.15.12:0/2843797123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4009a20 con 0x7f76fc157600 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f7700b9a700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c7c0 tx=0x7f76ec007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:51.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec011590 con 0x7f76fc157600 2023-10-08T17:43:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ec011710 con 0x7f76fc157600 2023-10-08T17:43:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ec011ad0 con 0x7f76fc157600 2023-10-08T17:43:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76fc0c7210 con 0x7f76fc157600 2023-10-08T17:43:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.435+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76fc0c77d0 con 0x7f76fc157600 2023-10-08T17:43:51.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.436+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76fc04c3c0 con 0x7f76fc157600 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.437+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f76ec012420 con 0x7f76fc157600 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.438+0000 7f76f17fa700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 0x7f76e0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.438+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f76ec084680 con 0x7f76fc157600 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.438+0000 7f770139b700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 msgr2=0x7f76e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.438+0000 7f770139b700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 0x7f76e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:51.442 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.442+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76ec0512c0 con 0x7f76fc157600 2023-10-08T17:43:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.639+0000 7f770139b700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 msgr2=0x7f76e0069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:51.639 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.639+0000 7f770139b700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 0x7f76e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:51.645 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.645+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76fc0cbb30 con 0x7f76fc157600 2023-10-08T17:43:51.646 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.646+0000 7f76f17fa700 1 -- 172.21.15.12:0/2843797123 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v214) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f76ec0548e0 con 0x7f76fc157600 2023-10-08T17:43:51.647 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:51.647 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":214,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:42.681627+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-08T17:43:19.737284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"212","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-08T17:43:20.521518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"213","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:6837/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:6836/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/3541952869":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/2981918803":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/843450174":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/790125058":"2023-10-09T17:43:42.681590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.648+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 msgr2=0x7f76e0069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.648+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 0x7f76e0069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.648+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 msgr2=0x7f76fc0b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.648+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f76ec00c7c0 tx=0x7f76ec007ea0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 shutdown_connections 2023-10-08T17:43:51.649 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f76e00670e0 0x7f76e0069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f76fc1579d0 0x7f76fc0acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f76fc0b1b20 0x7f76fc0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 --2- 172.21.15.12:0/2843797123 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f76fc157600 0x7f76fc0b0cb0 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 >> 172.21.15.12:0/2843797123 conn(0x7f76fc06d170 msgr2=0x7f76fc156e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 shutdown_connections 2023-10-08T17:43:51.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.649+0000 7f77035ff700 1 -- 172.21.15.12:0/2843797123 wait complete. 2023-10-08T17:43:51.667 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-08T17:43:51.862 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:51.861+0000 7eff37ba4180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.903+0000 7f0d5b3ff700 1 Processor -- start 2023-10-08T17:43:51.903 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.903+0000 7f0d5b3ff700 1 -- start start 2023-10-08T17:43:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.904+0000 7f0d5b3ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.904+0000 7f0d5b3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 0x7f0d54159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.904+0000 7f0d5b3ff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d5415ae40 con 0x7f0d540cde50 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.904+0000 7f0d5b3ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d540d13f0 con 0x7f0d540cb5a0 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.904+0000 7f0d5b3ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5415ab60 con 0x7f0d540cd9e0 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5919b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5999c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f0d540cde50 0x7f0d54156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:52544/0 (socket says 172.21.15.12:52544) 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5999c700 1 -- 172.21.15.12:0/2599487563 learned_addr learned my addr 172.21.15.12:0/2599487563 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5919b700 1 --2- 172.21.15.12:0/2599487563 >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39366/0 (socket says 172.21.15.12:39366) 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5899a700 1 --2- 172.21.15.12:0/2599487563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 0x7f0d54159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d4bfff700 1 -- 172.21.15.12:0/2599487563 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3385887408 0 0) 0x7f0d5415ae40 con 0x7f0d540cde50 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d4bfff700 1 -- 172.21.15.12:0/2599487563 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d40003570 con 0x7f0d540cde50 2023-10-08T17:43:51.906 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5899a700 1 -- 172.21.15.12:0/2599487563 >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 msgr2=0x7f0d540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:51.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5899a700 1 --2- 172.21.15.12:0/2599487563 >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5899a700 1 -- 172.21.15.12:0/2599487563 >> v1:172.21.15.12:6789/0 conn(0x7f0d540cde50 legacy=0x7f0d54156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5899a700 1 -- 172.21.15.12:0/2599487563 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d540ccf00 con 0x7f0d540cd9e0 2023-10-08T17:43:51.907 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.905+0000 7f0d5919b700 1 --2- 172.21.15.12:0/2599487563 >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.906+0000 7f0d5899a700 1 --2- 172.21.15.12:0/2599487563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 0x7f0d54159ec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce6869c31850bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.906+0000 7f0d4bfff700 1 -- 172.21.15.12:0/2599487563 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011630 con 0x7f0d540cd9e0 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.906+0000 7f0d4bfff700 1 -- 172.21.15.12:0/2599487563 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d44011790 con 0x7f0d540cd9e0 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.906+0000 7f0d4bfff700 1 -- 172.21.15.12:0/2599487563 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d44011b50 con 0x7f0d540cd9e0 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/2599487563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 msgr2=0x7f0d54159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/2599487563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 0x7f0d54159ec0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098e0 tx=0x7f0d440091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/2599487563 shutdown_connections 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/2599487563 >> v2:172.21.15.12:3300/0 conn(0x7f0d540cb5a0 0x7f0d540cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/2599487563 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cd9e0 0x7f0d54159ec0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/2599487563 >> 172.21.15.12:0/2599487563 conn(0x7f0d54070e30 msgr2=0x7f0d540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:51.911 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/2599487563 shutdown_connections 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.907+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/2599487563 wait complete. 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.908+0000 7f0d5b3ff700 1 Processor -- start 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.908+0000 7f0d5b3ff700 1 -- start start 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cb5a0 0x7f0d540b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540cd9e0 0x7f0d5415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5415cee0 con 0x7f0d5415ca80 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d54155440 con 0x7f0d540cd9e0 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.909+0000 7f0d5b3ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5415d0c0 con 0x7f0d540cb5a0 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.912 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:39372/0 (socket says 172.21.15.12:39372) 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 -- 172.21.15.12:0/533685984 learned_addr learned my addr 172.21.15.12:0/533685984 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5919b700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cb5a0 0x7f0d540b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5899a700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540cd9e0 0x7f0d5415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cb5a0 msgr2=0x7f0d540b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cb5a0 0x7f0d540b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540cd9e0 msgr2=0x7f0d5415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540cd9e0 0x7f0d5415c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 -- 172.21.15.12:0/533685984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50009420 con 0x7f0d5415ca80 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d5999c700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001460 tx=0x7f0d4c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.910+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00a870 con 0x7f0d5415ca80 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.911+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d4c00a9d0 con 0x7f0d5415ca80 2023-10-08T17:43:51.913 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.911+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d44009420 con 0x7f0d5415ca80 2023-10-08T17:43:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.911+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c00ad50 con 0x7f0d5415ca80 2023-10-08T17:43:51.914 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.911+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5415d960 con 0x7f0d5415ca80 2023-10-08T17:43:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.912+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5415d4c0 con 0x7f0d5415ca80 2023-10-08T17:43:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.913+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7f0d4c007300 con 0x7f0d5415ca80 2023-10-08T17:43:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.913+0000 7f0d497fa700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 0x7f0d38069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.914+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(214..214 src has 1..214) v4 ==== 6483+0+0 (secure 0 0 0) 0x7f0d4c084fa0 con 0x7f0d5415ca80 2023-10-08T17:43:51.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.914+0000 7f0d5919b700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 msgr2=0x7f0d38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:51.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.914+0000 7f0d5919b700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 0x7f0d38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:51.918 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:51.917+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d4c051c00 con 0x7f0d5415ca80 2023-10-08T17:43:52.020 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.020+0000 7f732f68e180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-08T17:43:52.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.115+0000 7f0d5919b700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 msgr2=0x7f0d38069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:52.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.115+0000 7f0d5919b700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 0x7f0d38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:52.154 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.154+0000 7eff37ba4180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:52.167 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.167+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0d5404c3c0 con 0x7f0d5415ca80 2023-10-08T17:43:52.167 INFO:tasks.ceph.mon.a.smithi012.stderr:2023-10-08T17:43:52.167+0000 7f16079f1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-08T17:43:52.172 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.172+0000 7f0d497fa700 1 -- 172.21.15.12:0/533685984 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v99) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0d4c055220 con 0x7f0d5415ca80 2023-10-08T17:43:52.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 msgr2=0x7f0d38069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 0x7f0d38069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 msgr2=0x7f0d5416cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c001460 tx=0x7f0d4c001a40 comp rx=0 tx=0).stop 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 shutdown_connections 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f0d380670e0 0x7f0d38069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f0d5415ca80 0x7f0d5416cc30 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f0d540cb5a0 0x7f0d540b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 --2- 172.21.15.12:0/533685984 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f0d540cd9e0 0x7f0d5415c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 >> 172.21.15.12:0/533685984 conn(0x7f0d54070e30 msgr2=0x7f0d540b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 shutdown_connections 2023-10-08T17:43:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.175+0000 7f0d5b3ff700 1 -- 172.21.15.12:0/533685984 wait complete. 2023-10-08T17:43:52.177 INFO:teuthology.orchestra.run.smithi012.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-08T17:43:52.178 INFO:tasks.ceph.mds.b.smithi029.stderr: -2532> 2023-10-08T17:43:27.028+0000 7fe94a1f1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-08T17:43:52.194 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-08T17:43:52.219 INFO:tasks.ceph.mds.b.smithi029.stdout:starting mds.b at 2023-10-08T17:43:52.259 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.258+0000 7eff37ba4180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:52.320 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.320+0000 7f732f68e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-08T17:43:52.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.387+0000 7fc83b59d700 1 Processor -- start 2023-10-08T17:43:52.387 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.387+0000 7fc83b59d700 1 -- start start 2023-10-08T17:43:52.388 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83b59d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 0x7fc8340cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83b59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83415ac50 con 0x7fc83415de50 2023-10-08T17:43:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83b59d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83415d010 con 0x7fc8340cea00 2023-10-08T17:43:52.389 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83415af60 con 0x7fc834153a00 2023-10-08T17:43:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83a59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:52.390 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83a59b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:59836/0 (socket says 172.21.15.12:59836) 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83a59b700 1 -- 172.21.15.12:0/4234856665 learned_addr learned my addr 172.21.15.12:0/4234856665 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.389+0000 7fc83ad9c700 1 --2- 172.21.15.12:0/4234856665 >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 0x7fc8340cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83a59b700 1 -- 172.21.15.12:0/4234856665 >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 msgr2=0x7fc8340cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83a59b700 1 --2- 172.21.15.12:0/4234856665 >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 0x7fc8340cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83a59b700 1 -- 172.21.15.12:0/4234856665 >> v1:172.21.15.29:6789/0 conn(0x7fc83415de50 legacy=0x7fc83415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83a59b700 1 -- 172.21.15.12:0/4234856665 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83415b240 con 0x7fc834153a00 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83ad9c700 1 --2- 172.21.15.12:0/4234856665 >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 0x7fc8340cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc839599700 1 -- 172.21.15.12:0/4234856665 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359383652 0 0) 0x7fc83415ac50 con 0x7fc83415de50 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc83a59b700 1 --2- 172.21.15.12:0/4234856665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ffefdd13bd3b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc839599700 1 -- 172.21.15.12:0/4234856665 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830009ea0 con 0x7fc834153a00 2023-10-08T17:43:52.391 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc839599700 1 -- 172.21.15.12:0/4234856665 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000b860 con 0x7fc834153a00 2023-10-08T17:43:52.392 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.390+0000 7fc839599700 1 -- 172.21.15.12:0/4234856665 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000bc00 con 0x7fc834153a00 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 -- 172.21.15.12:0/4234856665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 msgr2=0x7fc834153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 --2- 172.21.15.12:0/4234856665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830009250 comp rx=0 tx=0).stop 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 -- 172.21.15.12:0/4234856665 shutdown_connections 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 --2- 172.21.15.12:0/4234856665 >> v2:172.21.15.29:3300/0 conn(0x7fc8340cea00 0x7fc8340cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 --2- 172.21.15.12:0/4234856665 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc834153dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 -- 172.21.15.12:0/4234856665 >> 172.21.15.12:0/4234856665 conn(0x7fc8340703a0 msgr2=0x7fc8340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 -- 172.21.15.12:0/4234856665 shutdown_connections 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.391+0000 7fc83b59d700 1 -- 172.21.15.12:0/4234856665 wait complete. 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.393+0000 7fc83b59d700 1 Processor -- start 2023-10-08T17:43:52.393 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.393+0000 7fc83b59d700 1 -- start start 2023-10-08T17:43:52.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.395 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc83414ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc83415de50 0x7fc8340b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83416a920 con 0x7fc8340cea00 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340b0d70 con 0x7fc83415de50 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83b59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340b0440 con 0x7fc834153a00 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83a59b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38498/0 (socket says 172.21.15.12:38498) 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83a59b700 1 -- 172.21.15.12:0/1685103803 learned_addr learned my addr 172.21.15.12:0/1685103803 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc83ad9c700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc83415de50 0x7fc8340b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.394+0000 7fc839d9a700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc83414ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 msgr2=0x7fc83414ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:52.396 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc83414ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc83415de50 msgr2=0x7fc8340b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc83415de50 0x7fc8340b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 -- 172.21.15.12:0/1685103803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82c009a20 con 0x7fc8340cea00 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83a59b700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fc830006fd0 tx=0x7fc830017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000bbe0 con 0x7fc8340cea00 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc830011420 con 0x7fc8340cea00 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8300094f0 con 0x7fc8340cea00 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300117c0 con 0x7fc8340cea00 2023-10-08T17:43:52.397 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.395+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340b0a00 con 0x7fc8340cea00 2023-10-08T17:43:52.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.396+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8340b1050 con 0x7fc8340cea00 2023-10-08T17:43:52.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.397+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 111) v1 ==== 84899+0+0 (secure 0 0 0) 0x7fc830011bb0 con 0x7fc8340cea00 2023-10-08T17:43:52.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.398+0000 7fc82a7fc700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:52.398 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.398+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(215..215 src has 1..215) v4 ==== 6569+0+0 (secure 0 0 0) 0x7fc830085ff0 con 0x7fc8340cea00 2023-10-08T17:43:52.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.398+0000 7fc839d9a700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 msgr2=0x7fc818069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:52.399 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.398+0000 7fc839d9a700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-08T17:43:52.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.404+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc830052d80 con 0x7fc8340cea00 2023-10-08T17:43:52.422 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.422+0000 7f732f68e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-08T17:43:52.422 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.422+0000 7eff37ba4180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:52.532 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.531+0000 7eff37ba4180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:52.588 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.588+0000 7f732f68e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-08T17:43:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.599+0000 7fc839d9a700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 msgr2=0x7fc818069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:52.599 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.599+0000 7fc839d9a700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-10-08T17:43:52.651 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:52.651+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc83404c3c0 con 0x7fc8340cea00 2023-10-08T17:43:52.700 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.700+0000 7f732f68e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-08T17:43:52.730 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.730+0000 7eff37ba4180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:52.826 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.826+0000 7eff37ba4180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:52.901 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.901+0000 7f732f68e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-08T17:43:52.922 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:52.922+0000 7eff37ba4180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:53.000 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:52.999+0000 7f732f68e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-08T17:43:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.000+0000 7fc839d9a700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 msgr2=0x7fc818069590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.12:6836/163464 2023-10-08T17:43:53.000 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.000+0000 7fc839d9a700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-10-08T17:43:53.020 INFO:tasks.ceph.mgr.x.smithi029.stderr:2023-10-08T17:43:53.020+0000 7eff37ba4180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:53.099 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:53.099+0000 7f732f68e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-08T17:43:53.174 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.174+0000 7fc82a7fc700 1 -- 172.21.15.12:0/1685103803 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v100) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc830011e60 con 0x7fc8340cea00 2023-10-08T17:43:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 msgr2=0x7fc818069590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-08T17:43:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 msgr2=0x7fc8340b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7fc830006fd0 tx=0x7fc830017000 comp rx=0 tx=0).stop 2023-10-08T17:43:53.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 shutdown_connections 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fc8180670e0 0x7fc818069590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fc8340cea00 0x7fc8340b23b0 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fc83415de50 0x7fc8340b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 --2- 172.21.15.12:0/1685103803 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fc834153a00 0x7fc83414ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 >> 172.21.15.12:0/1685103803 conn(0x7fc8340703a0 msgr2=0x7fc834159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 shutdown_connections 2023-10-08T17:43:53.178 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.177+0000 7fc83b59d700 1 -- 172.21.15.12:0/1685103803 wait complete. 2023-10-08T17:43:53.196 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-08T17:43:53.201 INFO:tasks.ceph.mgr.y.smithi012.stderr:2023-10-08T17:43:53.199+0000 7f732f68e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-08T17:43:53.404 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.404+0000 7f26f699d700 1 Processor -- start 2023-10-08T17:43:53.405 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.404+0000 7f26f699d700 1 -- start start 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f699d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26f00c8200 0x7f26f00c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c85d0 0x7f26f00cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f699d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f01571b0 con 0x7f26f00c2a90 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f699d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f01579b0 con 0x7f26f00c8200 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00c1390 con 0x7f26f00c85d0 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26f00c8200 0x7f26f00c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f26f00c8200 0x7f26f00c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38602/0 (socket says 172.21.15.12:38602) 2023-10-08T17:43:53.407 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 -- 172.21.15.12:0/1590252515 learned_addr learned my addr 172.21.15.12:0/1590252515 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f619c700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c85d0 0x7f26f00cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 -- 172.21.15.12:0/1590252515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c85d0 msgr2=0x7f26f00cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c85d0 0x7f26f00cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 -- 172.21.15.12:0/1590252515 >> v1:172.21.15.29:6789/0 conn(0x7f26f00c2a90 legacy=0x7f26f0156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.406+0000 7f26f599b700 1 -- 172.21.15.12:0/1590252515 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f01573f0 con 0x7f26f00c8200 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f599b700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c8200 0x7f26f00c1820 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0099b0 tx=0x7f26ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f85754107a95fc server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f4999700 1 -- 172.21.15.12:0/1590252515 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00b860 con 0x7f26f00c8200 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f4999700 1 -- 172.21.15.12:0/1590252515 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec00b9c0 con 0x7f26f00c8200 2023-10-08T17:43:53.408 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f4999700 1 -- 172.21.15.12:0/1590252515 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00bd60 con 0x7f26f00c8200 2023-10-08T17:43:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f699d700 1 -- 172.21.15.12:0/1590252515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c8200 msgr2=0x7f26f00c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.407+0000 7f26f699d700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c8200 0x7f26f00c1820 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f26ec0099b0 tx=0x7f26ec009250 comp rx=0 tx=0).stop 2023-10-08T17:43:53.409 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 -- 172.21.15.12:0/1590252515 shutdown_connections 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c85d0 0x7f26f00cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 --2- 172.21.15.12:0/1590252515 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c8200 0x7f26f00c1820 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 -- 172.21.15.12:0/1590252515 >> 172.21.15.12:0/1590252515 conn(0x7f26f006c6a0 msgr2=0x7f26f006caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 -- 172.21.15.12:0/1590252515 shutdown_connections 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.408+0000 7f26f699d700 1 -- 172.21.15.12:0/1590252515 wait complete. 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.409+0000 7f26f699d700 1 Processor -- start 2023-10-08T17:43:53.410 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.409+0000 7f26f699d700 1 -- start start 2023-10-08T17:43:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26f00c2a90 0x7f26f00b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c8200 0x7f26f00ab740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:53.412 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f00ac780 con 0x7f26f00c85d0 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f01679e0 con 0x7f26f00c2a90 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f699d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f01676f0 con 0x7f26f00c8200 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f619c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f619c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38606/0 (socket says 172.21.15.12:38606) 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f619c700 1 -- 172.21.15.12:0/3032211895 learned_addr learned my addr 172.21.15.12:0/3032211895 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f599b700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26f00c2a90 0x7f26f00b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.410+0000 7f26f519a700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c8200 0x7f26f00ab740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 -- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c8200 msgr2=0x7f26f00ab740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c8200 0x7f26f00ab740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 -- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26f00c2a90 msgr2=0x7f26f00b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:53.413 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26f00c2a90 0x7f26f00b12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 -- 172.21.15.12:0/3032211895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26ec0094f0 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f619c700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009fa0 tx=0x7f26e8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e800ebc0 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e800ed20 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e8014670 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f00abc80 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.411+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f00abee0 con 0x7f26f00c85d0 2023-10-08T17:43:53.414 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.412+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f0167b70 con 0x7f26f00c85d0 2023-10-08T17:43:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.413+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 112) v1 ==== 84451+0+0 (secure 0 0 0) 0x7f26e80149e0 con 0x7f26f00c85d0 2023-10-08T17:43:53.415 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.414+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(216..216 src has 1..216) v4 ==== 6870+0+0 (secure 0 0 0) 0x7f26e8084c70 con 0x7f26f00c85d0 2023-10-08T17:43:53.418 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.418+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26e8051d20 con 0x7f26f00c85d0 2023-10-08T17:43:53.622 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:53.622+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26f004c3c0 con 0x7f26f00c85d0 2023-10-08T17:43:54.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.214+0000 7f26e5ffb700 1 -- 172.21.15.12:0/3032211895 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v217) v1 ==== 181+0+0 (secure 0 0 0) 0x7f26e8055340 con 0x7f26f00c85d0 2023-10-08T17:43:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.218+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 msgr2=0x7f26f014ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:54.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.218+0000 7f26f699d700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 secure :-1 s=READY pgs=2022 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009fa0 tx=0x7f26e8009900 comp rx=0 tx=0).stop 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 shutdown_connections 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f26f00c85d0 0x7f26f014ce20 unknown :-1 s=CLOSED pgs=2022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f26f00c2a90 0x7f26f00b12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 --2- 172.21.15.12:0/3032211895 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f26f00c8200 0x7f26f00ab740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 >> 172.21.15.12:0/3032211895 conn(0x7f26f006c6a0 msgr2=0x7f26f015a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:54.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 shutdown_connections 2023-10-08T17:43:54.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.219+0000 7f26f699d700 1 -- 172.21.15.12:0/3032211895 wait complete. 2023-10-08T17:43:54.221 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_metadata' removed 2023-10-08T17:43:54.253 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-08T17:43:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.445+0000 7fa3aaf9d700 1 Processor -- start 2023-10-08T17:43:54.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.446+0000 7fa3aaf9d700 1 -- start start 2023-10-08T17:43:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aaf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aaf9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aaf9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3a40c8680 con 0x7fa3a4157380 2023-10-08T17:43:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aaf9d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a406a7f0 con 0x7fa3a4157750 2023-10-08T17:43:54.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aaf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a415b6a0 con 0x7fa3a415b1a0 2023-10-08T17:43:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aa79c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aa79c700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47902/0 (socket says 172.21.15.12:47902) 2023-10-08T17:43:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3aa79c700 1 -- 172.21.15.12:0/3861495636 learned_addr learned my addr 172.21.15.12:0/3861495636 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.447+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3861495636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a8f99700 1 -- 172.21.15.12:0/3861495636 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999505942 0 0) 0x7fa3a40c8680 con 0x7fa3a4157380 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a8f99700 1 -- 172.21.15.12:0/3861495636 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa390003570 con 0x7fa3a4157380 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a979a700 1 -- 172.21.15.12:0/3861495636 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 msgr2=0x7fa3a40ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3861495636 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a979a700 1 -- 172.21.15.12:0/3861495636 >> v1:172.21.15.29:6789/0 conn(0x7fa3a4157380 legacy=0x7fa3a41585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a979a700 1 -- 172.21.15.12:0/3861495636 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a415b980 con 0x7fa3a415b1a0 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3aa79c700 1 --2- 172.21.15.12:0/3861495636 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3861495636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c6b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3940098e0 tx=0x7fa3940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1578813fdef9742d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a8f99700 1 -- 172.21.15.12:0/3861495636 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394011630 con 0x7fa3a415b1a0 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a8f99700 1 -- 172.21.15.12:0/3861495636 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa394011790 con 0x7fa3a415b1a0 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.448+0000 7fa3a8f99700 1 -- 172.21.15.12:0/3861495636 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa394011b10 con 0x7fa3a415b1a0 2023-10-08T17:43:54.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3861495636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 msgr2=0x7fa3a40c6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3861495636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c6b60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa3940098e0 tx=0x7fa3940091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3861495636 shutdown_connections 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3861495636 >> v2:172.21.15.29:3300/0 conn(0x7fa3a4157750 0x7fa3a40ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3861495636 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c6b60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3861495636 >> 172.21.15.12:0/3861495636 conn(0x7fa3a406c6a0 msgr2=0x7fa3a406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3861495636 shutdown_connections 2023-10-08T17:43:54.451 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.449+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3861495636 wait complete. 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.450+0000 7fa3aaf9d700 1 Processor -- start 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.451+0000 7fa3aaf9d700 1 -- start start 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.451+0000 7fa3aaf9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aaf9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4157750 0x7fa3a4167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aaf9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aaf9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40cbb20 con 0x7fa3a4157380 2023-10-08T17:43:54.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aaf9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40cbe00 con 0x7fa3a4157750 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aaf9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a40cc0e0 con 0x7fa3a415b1a0 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38610/0 (socket says 172.21.15.12:38610) 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 -- 172.21.15.12:0/3028870567 learned_addr learned my addr 172.21.15.12:0/3028870567 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4157750 0x7fa3a4167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3aa79c700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 -- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 msgr2=0x7fa3a40c5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 -- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4157750 msgr2=0x7fa3a4167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4157750 0x7fa3a4167fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.452+0000 7fa3a9f9b700 1 -- 172.21.15.12:0/3028870567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009ae0 con 0x7fa3a4157380 2023-10-08T17:43:54.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa3a9f9b700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c580 tx=0x7fa3a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0010510 con 0x7fa3a4157380 2023-10-08T17:43:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0010670 con 0x7fa3a4157380 2023-10-08T17:43:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0010a30 con 0x7fa3a4157380 2023-10-08T17:43:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa394009420 con 0x7fa3a4157380 2023-10-08T17:43:54.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.453+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a40cc6a0 con 0x7fa3a4157380 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.454+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a404c3c0 con 0x7fa3a4157380 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.455+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 113) v1 ==== 84578+0+0 (secure 0 0 0) 0x7fa3a001b400 con 0x7fa3a4157380 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.456+0000 7fa399ffb700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 0x7fa388069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.456+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(217..217 src has 1..217) v4 ==== 6432+0+0 (secure 0 0 0) 0x7fa3a0083fe0 con 0x7fa3a4157380 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.456+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 0x7fa388069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:54.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.457+0000 7fa3a979a700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 0x7fa388069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3a415b5d0 tx=0x7fa394017000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:54.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.460+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3a0051230 con 0x7fa3a4157380 2023-10-08T17:43:54.661 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:54.661+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3a40c7ac0 con 0x7fa3a4157380 2023-10-08T17:43:55.236 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.236+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3a0051600 con 0x7fa3a4157380 2023-10-08T17:43:55.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.237+0000 7fa399ffb700 1 -- 172.21.15.12:0/3028870567 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v218) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa3a0054cc0 con 0x7fa3a4157380 2023-10-08T17:43:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 msgr2=0x7fa388069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 0x7fa388069230 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa3a415b5d0 tx=0x7fa394017000 comp rx=0 tx=0).stop 2023-10-08T17:43:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 msgr2=0x7fa3a40ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c580 tx=0x7fa3a0007e10 comp rx=0 tx=0).stop 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 shutdown_connections 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fa388066d80 0x7fa388069230 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fa3a4157380 0x7fa3a40ccbc0 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fa3a415b1a0 0x7fa3a40c5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 --2- 172.21.15.12:0/3028870567 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fa3a4157750 0x7fa3a4167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 >> 172.21.15.12:0/3028870567 conn(0x7fa3a406c6a0 msgr2=0x7fa3a4150710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 shutdown_connections 2023-10-08T17:43:55.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.240+0000 7fa3aaf9d700 1 -- 172.21.15.12:0/3028870567 wait complete. 2023-10-08T17:43:55.242 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cephfs_data' removed 2023-10-08T17:43:55.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-10-08T17:43:55.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.452+0000 7f28fb39d700 1 Processor -- start 2023-10-08T17:43:55.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.452+0000 7f28fb39d700 1 -- start start 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fb39d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f4140a70 0x7f28f4069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fb39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f415b640 con 0x7f28f406de50 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fb39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f415b920 con 0x7f28f40c7c60 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fb39d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40c6800 con 0x7f28f4140a70 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f4140a70 0x7f28f4069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f28f4140a70 0x7f28f4069b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38616/0 (socket says 172.21.15.12:38616) 2023-10-08T17:43:55.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 -- 172.21.15.12:0/583683800 learned_addr learned my addr 172.21.15.12:0/583683800 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28f9b9a700 1 --1- 172.21.15.12:0/583683800 >> v1:172.21.15.12:6789/0 conn(0x7f28f406de50 0x7f28f4157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37784/0 (socket says 172.21.15.12:37784) 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 -- 172.21.15.12:0/583683800 >> v1:172.21.15.29:6789/0 conn(0x7f28f40c7c60 legacy=0x7f28f4158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 -- 172.21.15.12:0/583683800 >> v1:172.21.15.12:6789/0 conn(0x7f28f406de50 legacy=0x7f28f4157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28fa39b700 1 -- 172.21.15.12:0/583683800 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f415bc00 con 0x7f28f4140a70 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.454+0000 7f28f9399700 1 -- 172.21.15.12:0/583683800 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485718149 0 0) 0x7f28f415b640 con 0x7f28f406de50 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28fa39b700 1 --2- 172.21.15.12:0/583683800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f4140a70 0x7f28f4069b00 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f28f00099b0 tx=0x7f28f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bda09d28016d5e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28f9399700 1 -- 172.21.15.12:0/583683800 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000b820 con 0x7f28f4140a70 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28f9399700 1 -- 172.21.15.12:0/583683800 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f000b980 con 0x7f28f4140a70 2023-10-08T17:43:55.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28f9399700 1 -- 172.21.15.12:0/583683800 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bd20 con 0x7f28f4140a70 2023-10-08T17:43:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28fb39d700 1 -- 172.21.15.12:0/583683800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f4140a70 msgr2=0x7f28f4069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.455+0000 7f28fb39d700 1 --2- 172.21.15.12:0/583683800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f4140a70 0x7f28f4069b00 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7f28f00099b0 tx=0x7f28f0009250 comp rx=0 tx=0).stop 2023-10-08T17:43:55.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.456+0000 7f28fb39d700 1 -- 172.21.15.12:0/583683800 shutdown_connections 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.456+0000 7f28fb39d700 1 --2- 172.21.15.12:0/583683800 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f4140a70 0x7f28f4069b00 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.456+0000 7f28fb39d700 1 -- 172.21.15.12:0/583683800 >> 172.21.15.12:0/583683800 conn(0x7f28f406d110 msgr2=0x7f28f40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.456+0000 7f28fb39d700 1 -- 172.21.15.12:0/583683800 shutdown_connections 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.456+0000 7f28fb39d700 1 -- 172.21.15.12:0/583683800 wait complete. 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.457+0000 7f28fb39d700 1 Processor -- start 2023-10-08T17:43:55.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.457+0000 7f28fb39d700 1 -- start start 2023-10-08T17:43:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 0x7f28f40b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28f4140a70 0x7f28f40c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b1240 con 0x7f28f406de50 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b0630 con 0x7f28f40c7c60 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.458+0000 7f28fb39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b0910 con 0x7f28f4140a70 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38626/0 (socket says 172.21.15.12:38626) 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 -- 172.21.15.12:0/2010371436 learned_addr learned my addr 172.21.15.12:0/2010371436 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28f9b9a700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 0x7f28f40b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fab9c700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28f4140a70 0x7f28f40c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 -- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28f4140a70 msgr2=0x7f28f40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28f4140a70 0x7f28f40c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.461 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 -- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 msgr2=0x7f28f40b16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 0x7f28f40b16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 -- 172.21.15.12:0/2010371436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00094f0 con 0x7f28f406de50 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28f9b9a700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 0x7f28f40b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.459+0000 7f28fa39b700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f28f0003080 tx=0x7f28f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.460+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f000bcc0 con 0x7f28f406de50 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.460+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0020070 con 0x7f28f406de50 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.460+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f001b6a0 con 0x7f28f406de50 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.460+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40b0bf0 con 0x7f28f406de50 2023-10-08T17:43:55.462 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.460+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f40c9920 con 0x7f28f406de50 2023-10-08T17:43:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.461+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f404c3c0 con 0x7f28f406de50 2023-10-08T17:43:55.463 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.462+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28f0022030 con 0x7f28f406de50 2023-10-08T17:43:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.463+0000 7f28ea7fc700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.463+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f28f0086610 con 0x7f28f406de50 2023-10-08T17:43:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.463+0000 7f28f9b9a700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.464+0000 7f28f9b9a700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 0x7f28d80693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f28f416d300 tx=0x7f28e4007c90 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.467 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.467+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28f00536a0 con 0x7f28f406de50 2023-10-08T17:43:55.672 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.672+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f28f404c3c0 con 0x7f28f406de50 2023-10-08T17:43:55.678 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.678+0000 7f28ea7fc700 1 -- 172.21.15.12:0/2010371436 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v73) v1 ==== 120+0+0 (secure 0 0 0) 0x7f28f0056cc0 con 0x7f28f406de50 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.680+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 msgr2=0x7f28d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.680+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 0x7f28d80693e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f28f416d300 tx=0x7f28e4007c90 comp rx=0 tx=0).stop 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.680+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 msgr2=0x7f28f40b0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.680+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f28f0003080 tx=0x7f28f0016000 comp rx=0 tx=0).stop 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 shutdown_connections 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f28d8066f30 0x7f28d80693e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f28f406de50 0x7f28f40b0050 unknown :-1 s=CLOSED pgs=2026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.681 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f28f4140a70 0x7f28f40c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 --2- 172.21.15.12:0/2010371436 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f28f40c7c60 0x7f28f40b16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 >> 172.21.15.12:0/2010371436 conn(0x7f28f406d110 msgr2=0x7f28f413fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:55.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 shutdown_connections 2023-10-08T17:43:55.682 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.681+0000 7f28fb39d700 1 -- 172.21.15.12:0/2010371436 wait complete. 2023-10-08T17:43:55.699 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-08T17:43:55.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.887+0000 7f561759e700 1 Processor -- start 2023-10-08T17:43:55.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.887+0000 7f561759e700 1 -- start start 2023-10-08T17:43:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.888+0000 7f561759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 0x7f5618069b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.888+0000 7f561759e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.888+0000 7f561759e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561815b640 con 0x7f561806de50 2023-10-08T17:43:55.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.888+0000 7f561759e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56180c6800 con 0x7f56180c7c60 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.888+0000 7f561759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561815b920 con 0x7f5618140a70 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f5616d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f561659c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 0x7f5618069b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f5616d9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:47922/0 (socket says 172.21.15.12:47922) 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f5616d9d700 1 -- 172.21.15.12:0/1002487103 learned_addr learned my addr 172.21.15.12:0/1002487103 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f5615d9b700 1 --1- 172.21.15.12:0/1002487103 >> v1:172.21.15.29:6789/0 conn(0x7f561806de50 0x7f5618157a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:47954/0 (socket says 172.21.15.12:47954) 2023-10-08T17:43:55.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f561659c700 1 -- 172.21.15.12:0/1002487103 >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 msgr2=0x7f561806a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f561659c700 1 --2- 172.21.15.12:0/1002487103 >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f561659c700 1 -- 172.21.15.12:0/1002487103 >> v1:172.21.15.29:6789/0 conn(0x7f561806de50 legacy=0x7f5618157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f561659c700 1 -- 172.21.15.12:0/1002487103 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561815bc00 con 0x7f5618140a70 2023-10-08T17:43:55.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.889+0000 7f5616d9d700 1 --2- 172.21.15.12:0/1002487103 >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:43:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561659c700 1 --2- 172.21.15.12:0/1002487103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 0x7f5618069b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56080098e0 tx=0x7f56080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9194e005c3ae349c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561559a700 1 -- 172.21.15.12:0/1002487103 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800b640 con 0x7f5618140a70 2023-10-08T17:43:55.892 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561559a700 1 -- 172.21.15.12:0/1002487103 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560800b7a0 con 0x7f5618140a70 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561559a700 1 -- 172.21.15.12:0/1002487103 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560800bb40 con 0x7f5618140a70 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561759e700 1 -- 172.21.15.12:0/1002487103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 msgr2=0x7f5618069b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.890+0000 7f561759e700 1 --2- 172.21.15.12:0/1002487103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 0x7f5618069b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f56080098e0 tx=0x7f56080091a0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 -- 172.21.15.12:0/1002487103 shutdown_connections 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 --2- 172.21.15.12:0/1002487103 >> v2:172.21.15.29:3300/0 conn(0x7f56180c7c60 0x7f561806a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 --2- 172.21.15.12:0/1002487103 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5618140a70 0x7f5618069b00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 -- 172.21.15.12:0/1002487103 >> 172.21.15.12:0/1002487103 conn(0x7f561806d110 msgr2=0x7f56180cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 -- 172.21.15.12:0/1002487103 shutdown_connections 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.891+0000 7f561759e700 1 -- 172.21.15.12:0/1002487103 wait complete. 2023-10-08T17:43:55.893 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.892+0000 7f561759e700 1 Processor -- start 2023-10-08T17:43:55.894 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.892+0000 7f561759e700 1 -- start start 2023-10-08T17:43:55.895 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 0x7f5618157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5618140a70 0x7f561813d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5618168790 con 0x7f561806de50 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56181689f0 con 0x7f5618140a70 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561759e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5618168cd0 con 0x7f56180c7c60 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561659c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38630/0 (socket says 172.21.15.12:38630) 2023-10-08T17:43:55.896 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f561659c700 1 -- 172.21.15.12:0/4134010244 learned_addr learned my addr 172.21.15.12:0/4134010244 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f5615d9b700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 0x7f5618157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.893+0000 7f5616d9d700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5618140a70 0x7f561813d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 -- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 msgr2=0x7f5618157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 0x7f5618157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 -- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5618140a70 msgr2=0x7f561813d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5618140a70 0x7f561813d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 -- 172.21.15.12:0/4134010244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610009ae0 con 0x7f561806de50 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f5615d9b700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 0x7f5618157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:43:55.897 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561659c700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f560800a010 tx=0x7f5608017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560801bd70 con 0x7f561806de50 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608011420 con 0x7f561806de50 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080117e0 con 0x7f561806de50 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608009420 con 0x7f561806de50 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.894+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5618169290 con 0x7f561806de50 2023-10-08T17:43:55.898 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.895+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561804c3c0 con 0x7f561806de50 2023-10-08T17:43:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.896+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5608011bd0 con 0x7f561806de50 2023-10-08T17:43:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.897+0000 7f56067fc700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 0x7f55f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.897+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f5608085eb0 con 0x7f561806de50 2023-10-08T17:43:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.897+0000 7f5615d9b700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 0x7f55f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:55.899 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.898+0000 7f5615d9b700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 0x7f55f80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f560c007fd0 tx=0x7f560c007e10 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:55.901 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:55.901+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5608052f40 con 0x7f561806de50 2023-10-08T17:43:56.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.104+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f56181587b0 con 0x7f561806de50 2023-10-08T17:43:56.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.110+0000 7f56067fc700 1 -- 172.21.15.12:0/4134010244 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v74) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5608056560 con 0x7f561806de50 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 msgr2=0x7f55f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 0x7f55f80693e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f560c007fd0 tx=0x7f560c007e10 comp rx=0 tx=0).stop 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 msgr2=0x7f5618168250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f560800a010 tx=0x7f5608017000 comp rx=0 tx=0).stop 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 shutdown_connections 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f55f8066f30 0x7f55f80693e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f561806de50 0x7f5618168250 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.113 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5618140a70 0x7f561813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 --2- 172.21.15.12:0/4134010244 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f56180c7c60 0x7f5618157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.112+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 >> 172.21.15.12:0/4134010244 conn(0x7f561806d110 msgr2=0x7f561813cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.113+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 shutdown_connections 2023-10-08T17:43:56.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.113+0000 7f561759e700 1 -- 172.21.15.12:0/4134010244 wait complete. 2023-10-08T17:43:56.130 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-10-08T17:43:56.320 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.320+0000 7f536a99d700 1 Processor -- start 2023-10-08T17:43:56.321 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.320+0000 7f536a99d700 1 -- start start 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 0x7f536406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f536406bd20 0x7f53640c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142fd0 0x7f53640c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640ca480 con 0x7f536406bd20 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f536415e240 con 0x7f5364142c00 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536406b350 con 0x7f5364142fd0 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f536406bd20 0x7f53640c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f536406bd20 0x7f53640c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38644/0 (socket says 172.21.15.12:38644) 2023-10-08T17:43:56.324 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 -- 172.21.15.12:0/3205847961 learned_addr learned my addr 172.21.15.12:0/3205847961 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536999b700 1 --2- 172.21.15.12:0/3205847961 >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 0x7f536406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 -- 172.21.15.12:0/3205847961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142fd0 msgr2=0x7f53640c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536a19c700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142fd0 0x7f53640c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142fd0 0x7f53640c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 -- 172.21.15.12:0/3205847961 >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 msgr2=0x7f536406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 --2- 172.21.15.12:0/3205847961 >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 0x7f536406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536919a700 1 -- 172.21.15.12:0/3205847961 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536415df60 con 0x7f536406bd20 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.322+0000 7f536999b700 1 --2- 172.21.15.12:0/3205847961 >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 0x7f536406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f536919a700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f536406bd20 0x7f53640c7880 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f536406f490 tx=0x7f5354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d91e97016f010 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f5368999700 1 -- 172.21.15.12:0/3205847961 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400b860 con 0x7f536406bd20 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f5368999700 1 -- 172.21.15.12:0/3205847961 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400b9c0 con 0x7f536406bd20 2023-10-08T17:43:56.325 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f5368999700 1 -- 172.21.15.12:0/3205847961 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400bd60 con 0x7f536406bd20 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f536a99d700 1 -- 172.21.15.12:0/3205847961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f536406bd20 msgr2=0x7f53640c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.323+0000 7f536a99d700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f536406bd20 0x7f53640c7880 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7f536406f490 tx=0x7f5354009250 comp rx=0 tx=0).stop 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 -- 172.21.15.12:0/3205847961 shutdown_connections 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142fd0 0x7f53640c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 --2- 172.21.15.12:0/3205847961 >> v2:172.21.15.29:3300/0 conn(0x7f5364142c00 0x7f536406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 --2- 172.21.15.12:0/3205847961 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f536406bd20 0x7f53640c7880 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 -- 172.21.15.12:0/3205847961 >> 172.21.15.12:0/3205847961 conn(0x7f53640675a0 msgr2=0x7f53640679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 -- 172.21.15.12:0/3205847961 shutdown_connections 2023-10-08T17:43:56.326 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.324+0000 7f536a99d700 1 -- 172.21.15.12:0/3205847961 wait complete. 2023-10-08T17:43:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.325+0000 7f536a99d700 1 Processor -- start 2023-10-08T17:43:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.325+0000 7f536a99d700 1 -- start start 2023-10-08T17:43:56.328 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536406bd20 0x7f53640c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142c00 0x7f53641395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640b1370 con 0x7f5364142fd0 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c5ea0 con 0x7f536406bd20 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640c6180 con 0x7f5364142c00 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.326+0000 7f536a19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38652/0 (socket says 172.21.15.12:38652) 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536999b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536406bd20 0x7f53640c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 -- 172.21.15.12:0/2985024096 learned_addr learned my addr 172.21.15.12:0/2985024096 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536919a700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142c00 0x7f53641395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.329 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 -- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142c00 msgr2=0x7f53641395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142c00 0x7f53641395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 -- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536406bd20 msgr2=0x7f53640c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536406bd20 0x7f53640c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 -- 172.21.15.12:0/2985024096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540094f0 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f536a19c700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f535c00cdb0 tx=0x7f535c0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00aa60 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.327+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00abc0 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.328+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53640c6460 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.328+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c017430 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.328+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640c6a20 con 0x7f5364142fd0 2023-10-08T17:43:56.330 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.328+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536404c3c0 con 0x7f5364142fd0 2023-10-08T17:43:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.329+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f535c003020 con 0x7f5364142fd0 2023-10-08T17:43:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.330+0000 7f5359ffb700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 0x7f5348069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.330+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f535c013070 con 0x7f5364142fd0 2023-10-08T17:43:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.331+0000 7f536999b700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 0x7f5348069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.331 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.331+0000 7f536999b700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 0x7f5348069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f536000adc0 tx=0x7f5360006f90 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.334 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.334+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f535c051b40 con 0x7f5364142fd0 2023-10-08T17:43:56.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.536+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f536406ad00 con 0x7f5364142fd0 2023-10-08T17:43:56.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.540+0000 7f5359ffb700 1 -- 172.21.15.12:0/2985024096 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v75) v1 ==== 115+0+0 (secure 0 0 0) 0x7f535c055160 con 0x7f5364142fd0 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.542+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 msgr2=0x7f5348069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.542+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 0x7f5348069410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f536000adc0 tx=0x7f5360006f90 comp rx=0 tx=0).stop 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.542+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 msgr2=0x7f536413ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.542+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f535c00cdb0 tx=0x7f535c0077d0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 shutdown_connections 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f60 0x7f5348069410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5364142fd0 0x7f536413ff00 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f536406bd20 0x7f53640c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 --2- 172.21.15.12:0/2985024096 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5364142c00 0x7f53641395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 >> 172.21.15.12:0/2985024096 conn(0x7f53640675a0 msgr2=0x7f53640c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:56.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 shutdown_connections 2023-10-08T17:43:56.544 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.543+0000 7f536a99d700 1 -- 172.21.15.12:0/2985024096 wait complete. 2023-10-08T17:43:56.561 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-10-08T17:43:56.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.748+0000 7f65909ff700 1 Processor -- start 2023-10-08T17:43:56.748 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.748+0000 7f65909ff700 1 -- start start 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f658c159850 0x7f658c0adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c0ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f658c0b0930 0x7f658c0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0ccdc0 con 0x7f658c159850 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c0b12f0 con 0x7f658c0b0930 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f65909ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0adb20 con 0x7f658c159c20 2023-10-08T17:43:56.750 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f658a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f658c159850 0x7f658c0adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f658a59c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f658c159850 0x7f658c0adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38656/0 (socket says 172.21.15.12:38656) 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.749+0000 7f658a59c700 1 -- 172.21.15.12:0/198928467 learned_addr learned my addr 172.21.15.12:0/198928467 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658ad9d700 1 --2- 172.21.15.12:0/198928467 >> v2:172.21.15.29:3300/0 conn(0x7f658c0b0930 0x7f658c0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f6589d9b700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c0ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 -- 172.21.15.12:0/198928467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 msgr2=0x7f658c0ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c0ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 -- 172.21.15.12:0/198928467 >> v2:172.21.15.29:3300/0 conn(0x7f658c0b0930 msgr2=0x7f658c0b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 --2- 172.21.15.12:0/198928467 >> v2:172.21.15.29:3300/0 conn(0x7f658c0b0930 0x7f658c0b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 -- 172.21.15.12:0/198928467 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0acf10 con 0x7f658c159850 2023-10-08T17:43:56.751 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658a59c700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c0adfb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f658c0cd360 tx=0x7f657c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1303765044c08d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658959a700 1 -- 172.21.15.12:0/198928467 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00b820 con 0x7f658c159850 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658959a700 1 -- 172.21.15.12:0/198928467 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00b980 con 0x7f658c159850 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.750+0000 7f658959a700 1 -- 172.21.15.12:0/198928467 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00bd20 con 0x7f658c159850 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 -- 172.21.15.12:0/198928467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 msgr2=0x7f658c0adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c0adfb0 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f658c0cd360 tx=0x7f657c009250 comp rx=0 tx=0).stop 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 -- 172.21.15.12:0/198928467 shutdown_connections 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 --2- 172.21.15.12:0/198928467 >> v2:172.21.15.29:3300/0 conn(0x7f658c0b0930 0x7f658c0b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c0adfb0 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.753 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 --2- 172.21.15.12:0/198928467 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c0ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 -- 172.21.15.12:0/198928467 >> 172.21.15.12:0/198928467 conn(0x7f658c06d170 msgr2=0x7f658c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:56.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 -- 172.21.15.12:0/198928467 shutdown_connections 2023-10-08T17:43:56.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.751+0000 7f65909ff700 1 -- 172.21.15.12:0/198928467 wait complete. 2023-10-08T17:43:56.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.753+0000 7f65909ff700 1 Processor -- start 2023-10-08T17:43:56.754 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.753+0000 7f65909ff700 1 -- start start 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f658c0b0930 0x7f658c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c169660 con 0x7f658c159850 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c169940 con 0x7f658c0b0930 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f65909ff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c1573a0 con 0x7f658c159c20 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38660/0 (socket says 172.21.15.12:38660) 2023-10-08T17:43:56.756 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 -- 172.21.15.12:0/2893705326 learned_addr learned my addr 172.21.15.12:0/2893705326 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f658a59c700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f658c0b0930 0x7f658c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f658ad9d700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 -- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 msgr2=0x7f658c1579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c1579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 -- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f658c0b0930 msgr2=0x7f658c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f658c0b0930 0x7f658c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f6589d9b700 1 -- 172.21.15.12:0/2893705326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0094f0 con 0x7f658c159850 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.754+0000 7f658ad9d700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f6589d9b700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f658000d890 tx=0x7f6580008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580009610 con 0x7f658c159850 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6580009770 con 0x7f658c159850 2023-10-08T17:43:56.757 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580009b30 con 0x7f658c159850 2023-10-08T17:43:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c15d170 con 0x7f658c159850 2023-10-08T17:43:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.755+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c15d730 con 0x7f658c159850 2023-10-08T17:43:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.756+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c169af0 con 0x7f658c159850 2023-10-08T17:43:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.757+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f658001e460 con 0x7f658c159850 2023-10-08T17:43:56.758 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.758+0000 7f657a7fc700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 0x7f656c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.758+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f6580084ca0 con 0x7f658c159850 2023-10-08T17:43:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.758+0000 7f658a59c700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 0x7f656c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:56.759 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.759+0000 7f658a59c700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 0x7f656c0694b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f658c0cd360 tx=0x7f657c017000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:56.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:56.762+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f658c169af0 con 0x7f658c159850 2023-10-08T17:43:57.042 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.042+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f658c169af0 con 0x7f658c159850 2023-10-08T17:43:57.237 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.237+0000 7f657a7fc700 1 -- 172.21.15.12:0/2893705326 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v3073) v1 ==== 155+0+0 (secure 0 0 0) 0x7f658c169af0 con 0x7f658c159850 2023-10-08T17:43:57.239 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 msgr2=0x7f656c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 0x7f656c0694b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f658c0cd360 tx=0x7f657c017000 comp rx=0 tx=0).stop 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 msgr2=0x7f658c15c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 secure :-1 s=READY pgs=2031 cs=0 l=1 rev1=1 crypto rx=0x7f658000d890 tx=0x7f6580008040 comp rx=0 tx=0).stop 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 shutdown_connections 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f656c067000 0x7f656c0694b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f658c159c20 0x7f658c1579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f658c0b0930 0x7f658c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:57.240 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 --2- 172.21.15.12:0/2893705326 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f658c159850 0x7f658c15c6b0 unknown :-1 s=CLOSED pgs=2031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 >> 172.21.15.12:0/2893705326 conn(0x7f658c06d170 msgr2=0x7f658c06ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 shutdown_connections 2023-10-08T17:43:57.241 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:57.239+0000 7f65909ff700 1 -- 172.21.15.12:0/2893705326 wait complete. 2023-10-08T17:43:57.256 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-10-08T17:43:57.257 INFO:tasks.cephfs_test_runner: 2023-10-08T17:43:57.257 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-08T17:43:57.257 INFO:tasks.cephfs_test_runner:Ran 11 tests in 5634.646s 2023-10-08T17:43:57.257 INFO:tasks.cephfs_test_runner: 2023-10-08T17:43:57.257 INFO:tasks.cephfs_test_runner:OK 2023-10-08T17:43:57.257 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-08T17:43:57.266 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-08T17:43:57.314 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-08T17:43:57.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.314 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:43:57.351 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-08T17:43:57.351 INFO:teuthology.orchestra.run.smithi012.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-08T17:43:57.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-08T17:43:57.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-08T17:43:57.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.525 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-08T17:43:57.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.645 DEBUG:teuthology.orchestra.run.smithi012:> ip netns list 2023-10-08T17:43:57.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo ip link delete ceph-brx 2023-10-08T17:43:57.794 INFO:teuthology.orchestra.run.smithi012.stderr:Cannot find device "ceph-brx" 2023-10-08T17:43:57.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:43:57.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.799 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T17:43:57.841 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-08T17:43:57.841 INFO:teuthology.orchestra.run.smithi029.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-08T17:43:57.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.842 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-08T17:43:57.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:57.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-08T17:43:58.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:58.023 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T17:43:58.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:58.138 DEBUG:teuthology.orchestra.run.smithi029:> ip netns list 2023-10-08T17:43:58.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-08T17:43:58.177 DEBUG:teuthology.orchestra.run.smithi029:> sudo ip link delete ceph-brx 2023-10-08T17:43:58.286 INFO:teuthology.orchestra.run.smithi029.stderr:Cannot find device "ceph-brx" 2023-10-08T17:43:58.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:43:58.289 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-08T17:43:58.299 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-08T17:43:58.300 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:43:58.489 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.488+0000 7f61f0f9d700 1 Processor -- start 2023-10-08T17:43:58.490 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.489+0000 7f61f0f9d700 1 -- start start 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61f0f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f61ec13fef0 0x7f61ec15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61f0f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec15ae70 con 0x7f61ec13fb20 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61f0f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec06af60 con 0x7f61ec06aaa0 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61f0f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec06b240 con 0x7f61ec13fef0 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61eaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f61ec13fef0 0x7f61ec15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61eb7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f61ec13fb20 0x7f61ec0c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37800/0 (socket says 172.21.15.12:37800) 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61eb7fe700 1 -- 172.21.15.12:0/2171280357 learned_addr learned my addr 172.21.15.12:0/2171280357 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:58.491 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61eaffd700 1 --2- 172.21.15.12:0/2171280357 >> v2:172.21.15.12:3300/0 conn(0x7f61ec13fef0 0x7f61ec15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38666/0 (socket says 172.21.15.12:38666) 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.490+0000 7f61eaffd700 1 -- 172.21.15.12:0/2171280357 >> v1:172.21.15.29:6789/0 conn(0x7f61ec06aaa0 legacy=0x7f61ec0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61eaffd700 1 -- 172.21.15.12:0/2171280357 >> v1:172.21.15.12:6789/0 conn(0x7f61ec13fb20 legacy=0x7f61ec0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61eaffd700 1 -- 172.21.15.12:0/2171280357 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec06b520 con 0x7f61ec13fef0 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61ea7fc700 1 -- 172.21.15.12:0/2171280357 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894929707 0 0) 0x7f61dc001110 con 0x7f61ec13fb20 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61eaffd700 1 --2- 172.21.15.12:0/2171280357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec13fef0 0x7f61ec15a930 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f61e000bb70 tx=0x7f61e000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d591baed509438 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61ea7fc700 1 -- 172.21.15.12:0/2171280357 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0005c10 con 0x7f61ec13fef0 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61ea7fc700 1 -- 172.21.15.12:0/2171280357 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0005d70 con 0x7f61ec13fef0 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.491+0000 7f61ea7fc700 1 -- 172.21.15.12:0/2171280357 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e000dbe0 con 0x7f61ec13fef0 2023-10-08T17:43:58.493 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2171280357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec13fef0 msgr2=0x7f61ec15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2171280357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec13fef0 0x7f61ec15a930 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7f61e000bb70 tx=0x7f61e000b3e0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2171280357 shutdown_connections 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2171280357 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec13fef0 0x7f61ec15a930 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2171280357 >> 172.21.15.12:0/2171280357 conn(0x7f61ec06d170 msgr2=0x7f61ec0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2171280357 shutdown_connections 2023-10-08T17:43:58.494 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.492+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2171280357 wait complete. 2023-10-08T17:43:58.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.493+0000 7f61f0f9d700 1 Processor -- start 2023-10-08T17:43:58.495 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.493+0000 7f61f0f9d700 1 -- start start 2023-10-08T17:43:58.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61ec13fb20 0x7f61ec1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.496 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f61ec13fef0 0x7f61ec0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec1593e0 con 0x7f61ec06aaa0 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec158e20 con 0x7f61ec13fb20 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61f0f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec159100 con 0x7f61ec13fef0 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61eb7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38674/0 (socket says 172.21.15.12:38674) 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.494+0000 7f61eb7fe700 1 -- 172.21.15.12:0/2562162393 learned_addr learned my addr 172.21.15.12:0/2562162393 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 -- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f61ec13fef0 msgr2=0x7f61ec0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f61ec13fef0 0x7f61ec0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 -- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61ec13fb20 msgr2=0x7f61ec1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61ec13fb20 0x7f61ec1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 -- 172.21.15.12:0/2562162393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e000b660 con 0x7f61ec06aaa0 2023-10-08T17:43:58.497 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61eb7fe700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c810 tx=0x7f61dc007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc005b30 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61dc005cb0 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61dc007340 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec169e60 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.495+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec13ea90 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.496+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec169cc0 con 0x7f61ec06aaa0 2023-10-08T17:43:58.498 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.498+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61dc01b400 con 0x7f61ec06aaa0 2023-10-08T17:43:58.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.498+0000 7f61d37fe700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 0x7f61d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.499 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.499+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f61dc084070 con 0x7f61ec06aaa0 2023-10-08T17:43:58.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.499+0000 7f61eaffd700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 0x7f61d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.500 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.499+0000 7f61eaffd700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 0x7f61d80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61e000bb70 tx=0x7f61e001a000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.504 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.503+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61ec169cc0 con 0x7f61ec06aaa0 2023-10-08T17:43:58.706 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.705+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61ec15ae70 con 0x7f61ec06aaa0 2023-10-08T17:43:58.707 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.706+0000 7f61d37fe700 1 -- 172.21.15.12:0/2562162393 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+13924 (secure 0 0 0) 0x7f61ec15ae70 con 0x7f61ec06aaa0 2023-10-08T17:43:58.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:58.707 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":218,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:55.223750+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3758436552":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1972033471":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1213418889":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1774143054":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/607056971":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/2856495157":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/2880705844":"2023-10-09T17:43:53.201713+0000","172.21.15.29:6835/4272081005":"2023-10-09T17:43:52.167818+0000","172.21.15.29:6832/4272081005":"2023-10-09T17:43:52.167818+0000","172.21.15.12:6837/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:6836/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/3541952869":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/2981918803":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/843450174":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/790125058":"2023-10-09T17:43:42.681590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 msgr2=0x7f61d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 0x7f61d80693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f61e000bb70 tx=0x7f61e001a000 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 msgr2=0x7f61ec13e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 secure :-1 s=READY pgs=2034 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00c810 tx=0x7f61dc007c10 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 shutdown_connections 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f61d8066f30 0x7f61d80693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f61ec06aaa0 0x7f61ec13e550 unknown :-1 s=CLOSED pgs=2034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f61ec13fef0 0x7f61ec0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 --2- 172.21.15.12:0/2562162393 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f61ec13fb20 0x7f61ec1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 >> 172.21.15.12:0/2562162393 conn(0x7f61ec06d170 msgr2=0x7f61ec0b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:58.710 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 shutdown_connections 2023-10-08T17:43:58.711 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.708+0000 7f61f0f9d700 1 -- 172.21.15.12:0/2562162393 wait complete. 2023-10-08T17:43:58.727 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-08T17:43:58.727 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:58.915 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.914+0000 7f917bfff700 1 Processor -- start 2023-10-08T17:43:58.916 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.914+0000 7f917bfff700 1 -- start start 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f917c06aaa0 0x7f917c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c15ae70 con 0x7f917c13fef0 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917bfff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917c06af60 con 0x7f917c13fb20 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917c06b240 con 0x7f917c06aaa0 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f917c13fef0 0x7f917c0c9d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37814/0 (socket says 172.21.15.12:37814) 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917a7fc700 1 -- 172.21.15.12:0/1985197062 learned_addr learned my addr 172.21.15.12:0/1985197062 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:43:58.917 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f917b7fe700 1 --2- 172.21.15.12:0/1985197062 >> v2:172.21.15.29:3300/0 conn(0x7f917c06aaa0 0x7f917c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256408567 0 0) 0x7f9170001290 con 0x7f917c13fef0 2023-10-08T17:43:58.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9164003570 con 0x7f917c13fef0 2023-10-08T17:43:58.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.916+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446313138 0 0) 0x7f917c06af60 con 0x7f917c13fb20 2023-10-08T17:43:58.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9170001290 con 0x7f917c13fb20 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f917b7fe700 1 -- 172.21.15.12:0/1985197062 >> v1:172.21.15.29:6789/0 conn(0x7f917c13fb20 legacy=0x7f917c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f917b7fe700 1 -- 172.21.15.12:0/1985197062 >> v1:172.21.15.12:6789/0 conn(0x7f917c13fef0 legacy=0x7f917c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f917b7fe700 1 -- 172.21.15.12:0/1985197062 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c06b520 con 0x7f917c06aaa0 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f917b7fe700 1 --2- 172.21.15.12:0/1985197062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c15a930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9174009e60 tx=0x7f9174009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6c9a0b5c389036b server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400e070 con 0x7f917c06aaa0 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917400bab0 con 0x7f917c06aaa0 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.917+0000 7f9179ffb700 1 -- 172.21.15.12:0/1985197062 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400be70 con 0x7f917c06aaa0 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 -- 172.21.15.12:0/1985197062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 msgr2=0x7f917c15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 --2- 172.21.15.12:0/1985197062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c15a930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f9174009e60 tx=0x7f9174009780 comp rx=0 tx=0).stop 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 -- 172.21.15.12:0/1985197062 shutdown_connections 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 --2- 172.21.15.12:0/1985197062 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c15a930 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.920 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 -- 172.21.15.12:0/1985197062 >> 172.21.15.12:0/1985197062 conn(0x7f917c06d170 msgr2=0x7f917c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 -- 172.21.15.12:0/1985197062 shutdown_connections 2023-10-08T17:43:58.921 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.918+0000 7f917bfff700 1 -- 172.21.15.12:0/1985197062 wait complete. 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.919+0000 7f917bfff700 1 Processor -- start 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.919+0000 7f917bfff700 1 -- start start 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 0x7f917c0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.923 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c156460 con 0x7f917c13fb20 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f917c15bda0 con 0x7f917c06aaa0 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.920+0000 7f917bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f917c15b190 con 0x7f917c13fef0 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38676/0 (socket says 172.21.15.12:38676) 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 -- 172.21.15.12:0/685183699 learned_addr learned my addr 172.21.15.12:0/685183699 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917affd700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917b7fe700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 0x7f917c0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 -- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 msgr2=0x7f917c0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 0x7f917c0c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 -- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 msgr2=0x7f917c155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:58.924 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 -- 172.21.15.12:0/685183699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9174009a20 con 0x7f917c13fb20 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917affd700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917b7fe700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 0x7f917c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f917a7fc700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f9170001260 tx=0x7f9170007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9170007300 con 0x7f917c13fb20 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.921+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9170007460 con 0x7f917c13fb20 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.922+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f917c15b470 con 0x7f917c13fb20 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.922+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91700057f0 con 0x7f917c13fb20 2023-10-08T17:43:58.925 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.922+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917c15ba30 con 0x7f917c13fb20 2023-10-08T17:43:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.923+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f917c04c3c0 con 0x7f917c13fb20 2023-10-08T17:43:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.923+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9170005be0 con 0x7f917c13fb20 2023-10-08T17:43:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.925+0000 7f9162ffd700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:43:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.925+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f9170084240 con 0x7f917c13fb20 2023-10-08T17:43:58.926 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.925+0000 7f917affd700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:43:58.927 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.926+0000 7f917affd700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f916c007fd0 tx=0x7f916c009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:43:58.930 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:58.929+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9170051360 con 0x7f917c13fb20 2023-10-08T17:43:59.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.126+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f917c15bee0 con 0x7f9168066f30 2023-10-08T17:43:59.130 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.129+0000 7f9162ffd700 1 -- 172.21.15.12:0/685183699 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50360 (secure 0 0 0) 0x7f917c15bee0 con 0x7f9168066f30 2023-10-08T17:43:59.131 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.131+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 msgr2=0x7f91680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.131+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 0x7f91680693e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f916c007fd0 tx=0x7f916c009040 comp rx=0 tx=0).stop 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.131+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 msgr2=0x7f917c169390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.131+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f9170001260 tx=0x7f9170007c80 comp rx=0 tx=0).stop 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 shutdown_connections 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f9168066f30 0x7f91680693e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f917c13fef0 0x7f917c0c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:59.133 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f917c06aaa0 0x7f917c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:59.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 --2- 172.21.15.12:0/685183699 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f917c13fb20 0x7f917c169390 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:43:59.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 >> 172.21.15.12:0/685183699 conn(0x7f917c06d170 msgr2=0x7f917c0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:43:59.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 shutdown_connections 2023-10-08T17:43:59.134 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.132+0000 7f917bfff700 1 -- 172.21.15.12:0/685183699 wait complete. 2023-10-08T17:43:59.134 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:43:59.150 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":7,"stamp":"2023-10-08T17:43:57.223366+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2463388,"kb_used_data":23644,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752511332,"statfs":{"total":773094113280,"available":770571603968,"internally_reserved":0,"allocated":24211456,"data_stored":13435917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.975268"},"pg_stats":[{"pgid":"1.0","version":"216'370","reported_seq":1238,"reported_epoch":216,"state":"active+clean","last_fresh":"2023-10-08T17:43:53.295349+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:53.295349+0000","last_peered":"2023-10-08T17:43:53.295349+0000","last_clean":"2023-10-08T17:43:53.295349+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:53.295349+0000","last_undegraded":"2023-10-08T17:43:53.295349+0000","last_fullsized":"2023-10-08T17:43:53.295349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304936,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94066904,"statfs":{"total":96636764160,"available":96324509696,"internally_reserved":0,"allocated":3637248,"data_stored":2284344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.438},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.64400000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.505},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.377}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.41999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.79500000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.92100000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308448,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063392,"statfs":{"total":96636764160,"available":96320913408,"internally_reserved":0,"allocated":3039232,"data_stored":1697843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.91400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":1.0649999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.92400000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.498}]},{"osd":4,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.81999999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.2370000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.83599999999999997},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.84699999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83499999999999996,"15min":0.86099999999999999},"min":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.25},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.871,"15min":0.89200000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.208,"5min":1.2390000000000001,"15min":1.339},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309024,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062816,"statfs":{"total":96636764160,"available":96320323584,"internally_reserved":0,"allocated":3629056,"data_stored":2283710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312228,"kb_used_data":2652,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059612,"statfs":{"total":96636764160,"available":96317042688,"internally_reserved":0,"allocated":2715648,"data_stored":1366306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.71699999999999997,"15min":1.032},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68200000000000005,"5min":0.79000000000000004,"15min":0.88600000000000001},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.98099999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.85299999999999998,"15min":1.327},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76800000000000002,"5min":0.93799999999999994,"15min":1.4339999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.58299999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.999,"5min":1.157,"15min":1.3520000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0009999999999999,"5min":1.149,"15min":1.274},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.442},"max":{"1min":1.093,"5min":1.093,"15min":1.296},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3680000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.117,"15min":1.4319999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.84899999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.3819999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.177,"15min":1.4039999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.63200000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.409},"last":0.92600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312552,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059288,"statfs":{"total":96636764160,"available":96316710912,"internally_reserved":0,"allocated":3047424,"data_stored":1694066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.373},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.47999999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308144,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063696,"statfs":{"total":96636764160,"available":96321224704,"internally_reserved":0,"allocated":2727936,"data_stored":1378166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":1.119},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":1.3109999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":1.544}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":1.633}]}]},{"osd":5,"up_from":13,"seq":55834575967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:43:59.566 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:43:59.919 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.918+0000 7f510bfff700 1 Processor -- start 2023-10-08T17:44:00.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.918+0000 7f510bfff700 1 -- start start 2023-10-08T17:44:00.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.919+0000 7f510bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.919+0000 7f510bfff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f510c06de50 0x7f510c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.919+0000 7f510bfff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f510c0c6d50 con 0x7f510c140e40 2023-10-08T17:44:00.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.919+0000 7f510bfff700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510c0c7030 con 0x7f510c06de50 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.919+0000 7f510bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c0c7310 con 0x7f510c140a70 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510a7fc700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f510c140e40 0x7f510c0c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37828/0 (socket says 172.21.15.12:37828) 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510a7fc700 1 -- 172.21.15.12:0/669984967 learned_addr learned my addr 172.21.15.12:0/669984967 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510affd700 1 --2- 172.21.15.12:0/669984967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510b7fe700 1 --2- 172.21.15.12:0/669984967 >> v2:172.21.15.29:3300/0 conn(0x7f510c06de50 0x7f510c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f5109ffb700 1 -- 172.21.15.12:0/669984967 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824340933 0 0) 0x7f510c0c6d50 con 0x7f510c140e40 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f5109ffb700 1 -- 172.21.15.12:0/669984967 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50f4003570 con 0x7f510c140e40 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510affd700 1 -- 172.21.15.12:0/669984967 >> v2:172.21.15.29:3300/0 conn(0x7f510c06de50 msgr2=0x7f510c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510affd700 1 --2- 172.21.15.12:0/669984967 >> v2:172.21.15.29:3300/0 conn(0x7f510c06de50 0x7f510c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510affd700 1 -- 172.21.15.12:0/669984967 >> v1:172.21.15.12:6789/0 conn(0x7f510c140e40 legacy=0x7f510c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.920+0000 7f510affd700 1 -- 172.21.15.12:0/669984967 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510c0c75f0 con 0x7f510c140a70 2023-10-08T17:44:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f510affd700 1 --2- 172.21.15.12:0/669984967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0c6770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098e0 tx=0x7f50fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ef4c869f551f71c server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f5109ffb700 1 -- 172.21.15.12:0/669984967 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011630 con 0x7f510c140a70 2023-10-08T17:44:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f5109ffb700 1 -- 172.21.15.12:0/669984967 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc011790 con 0x7f510c140a70 2023-10-08T17:44:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f5109ffb700 1 -- 172.21.15.12:0/669984967 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011b30 con 0x7f510c140a70 2023-10-08T17:44:00.123 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f510bfff700 1 -- 172.21.15.12:0/669984967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 msgr2=0x7f510c0c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.921+0000 7f510bfff700 1 --2- 172.21.15.12:0/669984967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0c6770 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f50fc0098e0 tx=0x7f50fc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 -- 172.21.15.12:0/669984967 shutdown_connections 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 --2- 172.21.15.12:0/669984967 >> v2:172.21.15.29:3300/0 conn(0x7f510c06de50 0x7f510c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 --2- 172.21.15.12:0/669984967 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0c6770 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 -- 172.21.15.12:0/669984967 >> 172.21.15.12:0/669984967 conn(0x7f510c06d170 msgr2=0x7f510c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.124 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 -- 172.21.15.12:0/669984967 shutdown_connections 2023-10-08T17:44:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.922+0000 7f510bfff700 1 -- 172.21.15.12:0/669984967 wait complete. 2023-10-08T17:44:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.923+0000 7f510bfff700 1 Processor -- start 2023-10-08T17:44:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.923+0000 7f510bfff700 1 -- start start 2023-10-08T17:44:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f510c140e40 0x7f510c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15c140 con 0x7f510c06de50 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15c420 con 0x7f510c140e40 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510bfff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510c15c700 con 0x7f510c140a70 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510affd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38692/0 (socket says 172.21.15.12:38692) 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510affd700 1 -- 172.21.15.12:0/2791321770 learned_addr learned my addr 172.21.15.12:0/2791321770 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510a7fc700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.126 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.924+0000 7f510b7fe700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f510c140e40 0x7f510c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 -- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 msgr2=0x7f510c0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 -- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f510c140e40 msgr2=0x7f510c0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f510c140e40 0x7f510c0c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 -- 172.21.15.12:0/2791321770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50fc009420 con 0x7f510c06de50 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510a7fc700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510affd700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f510c0c7450 tx=0x7f50fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc011b10 con 0x7f510c06de50 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50fc0253f0 con 0x7f510c06de50 2023-10-08T17:44:00.127 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50fc0257b0 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.925+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510c15c9e0 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.926+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f510c131e60 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.927+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f510c0cc940 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.927+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50fc025ba0 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.928+0000 7f50f2ffd700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 0x7f50f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.929+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f50fc085ee0 con 0x7f510c06de50 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.929+0000 7f510a7fc700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 0x7f50f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.929+0000 7f510a7fc700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 0x7f50f80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f510c157590 tx=0x7f5100009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.128 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:43:59.932+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50fc053010 con 0x7f510c06de50 2023-10-08T17:44:00.132 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.131+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f510c15c590 con 0x7f50f8066f30 2023-10-08T17:44:00.135 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.134+0000 7f50f2ffd700 1 -- 172.21.15.12:0/2791321770 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50360 (secure 0 0 0) 0x7f510c15c590 con 0x7f50f8066f30 2023-10-08T17:44:00.137 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:00.138 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 msgr2=0x7f50f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 0x7f50f80693e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f510c157590 tx=0x7f5100009040 comp rx=0 tx=0).stop 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 msgr2=0x7f510c131920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f510c0c7450 tx=0x7f50fc017000 comp rx=0 tx=0).stop 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 shutdown_connections 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f50f8066f30 0x7f50f80693e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f510c06de50 0x7f510c131920 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.139 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f510c140e40 0x7f510c0c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 --2- 172.21.15.12:0/2791321770 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f510c140a70 0x7f510c0af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 >> 172.21.15.12:0/2791321770 conn(0x7f510c06d170 msgr2=0x7f510c13fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 shutdown_connections 2023-10-08T17:44:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.136+0000 7f510bfff700 1 -- 172.21.15.12:0/2791321770 wait complete. 2023-10-08T17:44:00.140 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:44:00.155 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-08T17:43:59.223706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2463388,"kb_used_data":23644,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752511332,"statfs":{"total":773094113280,"available":770571603968,"internally_reserved":0,"allocated":24211456,"data_stored":13435917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.975607"},"pg_stats":[{"pgid":"1.0","version":"216'370","reported_seq":1238,"reported_epoch":216,"state":"active+clean","last_fresh":"2023-10-08T17:43:53.295349+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:53.295349+0000","last_peered":"2023-10-08T17:43:53.295349+0000","last_clean":"2023-10-08T17:43:53.295349+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:53.295349+0000","last_undegraded":"2023-10-08T17:43:53.295349+0000","last_fullsized":"2023-10-08T17:43:53.295349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304936,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94066904,"statfs":{"total":96636764160,"available":96324509696,"internally_reserved":0,"allocated":3637248,"data_stored":2284344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.438},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.64400000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.505},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.377}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.41999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.79500000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.92100000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308448,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063392,"statfs":{"total":96636764160,"available":96320913408,"internally_reserved":0,"allocated":3039232,"data_stored":1697843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.91400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":1.0649999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.92400000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.498}]},{"osd":4,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.81999999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.2370000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.83599999999999997},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.84699999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83499999999999996,"15min":0.86099999999999999},"min":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.25},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.871,"15min":0.89200000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.208,"5min":1.2390000000000001,"15min":1.339},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309024,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062816,"statfs":{"total":96636764160,"available":96320323584,"internally_reserved":0,"allocated":3629056,"data_stored":2283710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312228,"kb_used_data":2652,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059612,"statfs":{"total":96636764160,"available":96317042688,"internally_reserved":0,"allocated":2715648,"data_stored":1366306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.71699999999999997,"15min":1.032},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68200000000000005,"5min":0.79000000000000004,"15min":0.88600000000000001},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.98099999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.85299999999999998,"15min":1.327},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76800000000000002,"5min":0.93799999999999994,"15min":1.4339999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.58299999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.999,"5min":1.157,"15min":1.3520000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0009999999999999,"5min":1.149,"15min":1.274},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.442},"max":{"1min":1.093,"5min":1.093,"15min":1.296},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3680000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.117,"15min":1.4319999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.84899999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.3819999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.177,"15min":1.4039999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.63200000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.409},"last":0.92600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312552,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059288,"statfs":{"total":96636764160,"available":96316710912,"internally_reserved":0,"allocated":3047424,"data_stored":1694066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.373},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.47999999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308144,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063696,"statfs":{"total":96636764160,"available":96321224704,"internally_reserved":0,"allocated":2727936,"data_stored":1378166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":1.119},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":1.3109999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":1.544}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":1.633}]}]},{"osd":5,"up_from":13,"seq":55834575967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:44:00.157 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-08T17:44:00.157 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:44:00.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.344+0000 7fd35f39d700 1 Processor -- start 2023-10-08T17:44:00.345 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.344+0000 7fd35f39d700 1 -- start start 2023-10-08T17:44:00.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.345+0000 7fd35f39d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fd35806e0a0 0x7fd3580c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.345+0000 7fd35f39d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35806a490 con 0x7fd358150380 2023-10-08T17:44:00.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.345+0000 7fd35f39d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580c7490 con 0x7fd35806f3a0 2023-10-08T17:44:00.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.345+0000 7fd35f39d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580c7770 con 0x7fd35806e0a0 2023-10-08T17:44:00.356 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35eb9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd358150380 0x7fd35806a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37832/0 (socket says 172.21.15.12:37832) 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35eb9c700 1 -- 172.21.15.12:0/3779924002 learned_addr learned my addr 172.21.15.12:0/3779924002 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35e39b700 1 --2- 172.21.15.12:0/3779924002 >> v2:172.21.15.29:3300/0 conn(0x7fd35806e0a0 0x7fd3580c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876696577 0 0) 0x7fd35806a490 con 0x7fd358150380 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd344004680 con 0x7fd358150380 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637968234 0 0) 0x7fd3580c7490 con 0x7fd35806f3a0 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd35806a490 con 0x7fd35806f3a0 2023-10-08T17:44:00.357 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4242019055 0 0) 0x7fd344004680 con 0x7fd358150380 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 >> v2:172.21.15.29:3300/0 conn(0x7fd35806e0a0 msgr2=0x7fd3580c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 --2- 172.21.15.12:0/3779924002 >> v2:172.21.15.29:3300/0 conn(0x7fd35806e0a0 0x7fd3580c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 >> v1:172.21.15.29:6789/0 conn(0x7fd35806f3a0 legacy=0x7fd35814fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580c7a50 con 0x7fd358150380 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.346+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fd3500017f0 con 0x7fd358150380 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 >> v1:172.21.15.12:6789/0 conn(0x7fd358150380 legacy=0x7fd35806a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.358 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd344004d00 0x7fd3440050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd344005920 0x7fd344005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 0x7fd34400cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580c7770 con 0x7fd3440062d0 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34400d1c0 con 0x7fd344004d00 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34400d380 con 0x7fd344005920 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 0x7fd34400cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.359 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35e39b700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd344004d00 0x7fd3440050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35db9a700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd344005920 0x7fd344005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 -- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd344005920 msgr2=0x7fd344005d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd344005920 0x7fd344005d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 -- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd344004d00 msgr2=0x7fd3440050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd344004d00 0x7fd3440050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 -- 172.21.15.12:0/3779924002 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd344004680 con 0x7fd3440062d0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35db9a700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd344005920 0x7fd344005d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.347+0000 7fd35eb9c700 1 -- 172.21.15.12:0/3779924002 reap_dead start 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35eb9c700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 0x7fd34400cb70 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fd35000a8c0 tx=0x7fd350002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f852c2e521ab97b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500070d0 con 0x7fd3440062d0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd350007230 con 0x7fd3440062d0 2023-10-08T17:44:00.360 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35d399700 1 -- 172.21.15.12:0/3779924002 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500075f0 con 0x7fd3440062d0 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35f39d700 1 -- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 msgr2=0x7fd34400cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35f39d700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 0x7fd34400cb70 secure :-1 s=READY pgs=2040 cs=0 l=1 rev1=1 crypto rx=0x7fd35000a8c0 tx=0x7fd350002190 comp rx=0 tx=0).stop 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35f39d700 1 -- 172.21.15.12:0/3779924002 shutdown_connections 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35f39d700 1 --2- 172.21.15.12:0/3779924002 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd3440062d0 0x7fd34400cb70 unknown :-1 s=CLOSED pgs=2040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.348+0000 7fd35f39d700 1 -- 172.21.15.12:0/3779924002 >> 172.21.15.12:0/3779924002 conn(0x7fd35806d170 msgr2=0x7fd3580cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.349+0000 7fd35f39d700 1 -- 172.21.15.12:0/3779924002 shutdown_connections 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.349+0000 7fd35f39d700 1 -- 172.21.15.12:0/3779924002 wait complete. 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.350+0000 7fd35f39d700 1 Processor -- start 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.350+0000 7fd35f39d700 1 -- start start 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3440062d0 0x7fd3581468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd358157040 0x7fd3581574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.361 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3581589c0 con 0x7fd35814dab0 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd358146e10 con 0x7fd3440062d0 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35f39d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35814e460 con 0x7fd358157040 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35db9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38704/0 (socket says 172.21.15.12:38704) 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35db9a700 1 -- 172.21.15.12:0/723026723 learned_addr learned my addr 172.21.15.12:0/723026723 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35e39b700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3440062d0 0x7fd3581468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.351+0000 7fd35eb9c700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd358157040 0x7fd3581574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 -- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd358157040 msgr2=0x7fd3581574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd358157040 0x7fd3581574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 -- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3440062d0 msgr2=0x7fd3581468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.362 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3440062d0 0x7fd3581468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 -- 172.21.15.12:0/723026723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35813a6c0 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35db9a700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fd34800e780 tx=0x7fd348009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348001560 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd348010040 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd358157db0 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd348001950 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.352+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd358158370 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.353+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35804c3c0 con 0x7fd35814dab0 2023-10-08T17:44:00.363 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.354+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd34801d400 con 0x7fd35814dab0 2023-10-08T17:44:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.356+0000 7fd34e7fc700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 0x7fd33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.356+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd3480843b0 con 0x7fd35814dab0 2023-10-08T17:44:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.356+0000 7fd35e39b700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 0x7fd33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.356+0000 7fd35e39b700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 0x7fd33c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd35814ab10 tx=0x7fd3540091a0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.364 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.360+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd348051440 con 0x7fd35814dab0 2023-10-08T17:44:00.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.556+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd3580c7d30 con 0x7fd33c066f30 2023-10-08T17:44:00.559 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.559+0000 7fd34e7fc700 1 -- 172.21.15.12:0/723026723 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50360 (secure 0 0 0) 0x7fd3580c7d30 con 0x7fd33c066f30 2023-10-08T17:44:00.561 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:00.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 msgr2=0x7fd33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 0x7fd33c0693e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd35814ab10 tx=0x7fd3540091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 msgr2=0x7fd35814df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7fd34800e780 tx=0x7fd348009040 comp rx=0 tx=0).stop 2023-10-08T17:44:00.563 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 shutdown_connections 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd33c066f30 0x7fd33c0693e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd358157040 0x7fd3581574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd3440062d0 0x7fd3581468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 --2- 172.21.15.12:0/723026723 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd35814dab0 0x7fd35814df20 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 >> 172.21.15.12:0/723026723 conn(0x7fd35806d170 msgr2=0x7fd3580c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 shutdown_connections 2023-10-08T17:44:00.564 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.561+0000 7fd35f39d700 1 -- 172.21.15.12:0/723026723 wait complete. 2023-10-08T17:44:00.565 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:44:00.580 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2023-10-08T17:43:59.223706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2463388,"kb_used_data":23644,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752511332,"statfs":{"total":773094113280,"available":770571603968,"internally_reserved":0,"allocated":24211456,"data_stored":13435917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.975607"},"pg_stats":[{"pgid":"1.0","version":"216'370","reported_seq":1238,"reported_epoch":216,"state":"active+clean","last_fresh":"2023-10-08T17:43:53.295349+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:53.295349+0000","last_peered":"2023-10-08T17:43:53.295349+0000","last_clean":"2023-10-08T17:43:53.295349+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:53.295349+0000","last_undegraded":"2023-10-08T17:43:53.295349+0000","last_fullsized":"2023-10-08T17:43:53.295349+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575967,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304936,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94066904,"statfs":{"total":96636764160,"available":96324509696,"internally_reserved":0,"allocated":3637248,"data_stored":2284344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.438},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.64400000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.54300000000000004}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.505},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.377}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.48899999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.41999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.61399999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.73299999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.79500000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.92100000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575967,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308448,"kb_used_data":2968,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063392,"statfs":{"total":96636764160,"available":96320913408,"internally_reserved":0,"allocated":3039232,"data_stored":1697843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.91400000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":1.0649999999999999},"last":0.39200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61399999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.92400000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.498}]},{"osd":4,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.81999999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.2370000000000001},"last":0.59599999999999997}]},{"osd":5,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.83599999999999997},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.84699999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83499999999999996,"15min":0.86099999999999999},"min":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.67900000000000005}]},{"osd":7,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.25},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.871,"15min":0.89200000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.208,"5min":1.2390000000000001,"15min":1.339},"last":0.65800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309024,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94062816,"statfs":{"total":96636764160,"available":96320323584,"internally_reserved":0,"allocated":3629056,"data_stored":2283710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.49399999999999999,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.31900000000000001,"15min":0.23699999999999999},"max":{"1min":0.67400000000000004,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.57899999999999996,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.45800000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53200000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.70499999999999996,"5min":0.81699999999999995,"15min":0.95499999999999996},"last":0.40899999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53800000000000003,"15min":0.53700000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80400000000000005,"5min":0.90700000000000003,"15min":0.93600000000000005},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.64700000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.60999999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.0109999999999999,"5min":1.1439999999999999,"15min":1.2430000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0129999999999999,"5min":1.151,"15min":1.151},"last":0.68100000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.81799999999999995,"15min":0.82799999999999996},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.04,"5min":1.131,"15min":1.1779999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.60599999999999998,"5min":0.57199999999999995,"15min":0.48699999999999999},"max":{"1min":1.056,"5min":1.101,"15min":1.2589999999999999},"last":0.53100000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82999999999999996,"15min":0.84499999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.499},"max":{"1min":1.1379999999999999,"5min":1.204,"15min":1.204},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.84299999999999997,"15min":0.85899999999999999},"min":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":1.177,"5min":1.204,"15min":1.222},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83599999999999997,"15min":0.84899999999999998},"min":{"1min":0.67600000000000005,"5min":0.60399999999999998,"15min":0.52800000000000002},"max":{"1min":1.0589999999999999,"5min":1.085,"15min":1.292},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575968,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312228,"kb_used_data":2652,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059612,"statfs":{"total":96636764160,"available":96317042688,"internally_reserved":0,"allocated":2715648,"data_stored":1366306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.71699999999999997,"15min":1.032},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68200000000000005,"5min":0.79000000000000004,"15min":0.88600000000000001},"last":0.58599999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.98099999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.63500000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.85299999999999998,"15min":1.327},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76800000000000002,"5min":0.93799999999999994,"15min":1.4339999999999999},"last":0.74199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.58299999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.999,"5min":1.157,"15min":1.3520000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0009999999999999,"5min":1.149,"15min":1.274},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.442},"max":{"1min":1.093,"5min":1.093,"15min":1.296},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3680000000000001},"last":0.68899999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.117,"15min":1.4319999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.84899999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.3819999999999999},"last":0.69799999999999995}]},{"osd":7,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.177,"15min":1.4039999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.63200000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.409},"last":0.92600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834575968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312552,"kb_used_data":2976,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059288,"statfs":{"total":96636764160,"available":96316710912,"internally_reserved":0,"allocated":3047424,"data_stored":1694066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.373},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.40200000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.442},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.47999999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.56399999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575968,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308144,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063696,"statfs":{"total":96636764160,"available":96321224704,"internally_reserved":0,"allocated":2727936,"data_stored":1378166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":1.119},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.83299999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.69699999999999995}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":1.1930000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":1.3109999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":1.6040000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.97499999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":1.3640000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":1.544}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":1.2689999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":1.633}]}]},{"osd":5,"up_from":13,"seq":55834575967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1365741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.70299999999999996}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.78900000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.81100000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.68799999999999994}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:44:00.582 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-08T17:44:00.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.768+0000 7f8a9a79d700 1 Processor -- start 2023-10-08T17:44:00.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.768+0000 7f8a9a79d700 1 -- start start 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9a79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f8a94140e40 0x7f8a940c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9a79d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940c6d50 con 0x7f8a94140a70 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9a79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a940c7030 con 0x7f8a9406de50 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9a79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a940c7310 con 0x7f8a94140e40 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9979b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f8a94140a70 0x7f8a940c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:37840/0 (socket says 172.21.15.12:37840) 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.769+0000 7f8a9979b700 1 -- 172.21.15.12:0/1369811278 learned_addr learned my addr 172.21.15.12:0/1369811278 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:00.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/1369811278 >> v2:172.21.15.29:3300/0 conn(0x7f8a94140e40 0x7f8a940c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571225864 0 0) 0x7f8a940c6d50 con 0x7f8a94140a70 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a80003570 con 0x7f8a94140a70 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296859105 0 0) 0x7f8a940c7030 con 0x7f8a9406de50 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a940c6d50 con 0x7f8a9406de50 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1110525215 0 0) 0x7f8a80003570 con 0x7f8a94140a70 2023-10-08T17:44:00.782 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 >> v2:172.21.15.29:3300/0 conn(0x7f8a94140e40 msgr2=0x7f8a940c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 --2- 172.21.15.12:0/1369811278 >> v2:172.21.15.29:3300/0 conn(0x7f8a94140e40 0x7f8a940c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 >> v1:172.21.15.29:6789/0 conn(0x7f8a9406de50 legacy=0x7f8a940aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a940c75f0 con 0x7f8a94140a70 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7f8a90001470 con 0x7f8a94140a70 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 >> v1:172.21.15.12:6789/0 conn(0x7f8a94140a70 legacy=0x7f8a940c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.783 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a80003c40 0x7f8a80004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80004810 0x7f8a80004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a8000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c7310 con 0x7f8a80005210 2023-10-08T17:44:00.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000c130 con 0x7f8a80004810 2023-10-08T17:44:00.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.770+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8000c2c0 con 0x7f8a80003c40 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a8000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80004810 0x7f8a80004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a9979b700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a80003c40 0x7f8a80004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 -- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a80003c40 msgr2=0x7f8a80004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a80003c40 0x7f8a80004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 -- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80004810 msgr2=0x7f8a80004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a80004810 0x7f8a80004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 -- 172.21.15.12:0/1369811278 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80003570 con 0x7f8a80005210 2023-10-08T17:44:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 -- 172.21.15.12:0/1369811278 reap_dead start 2023-10-08T17:44:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a8000ba60 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c002150 tx=0x7f8a8c0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba6d2ff5c321a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.771+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00c940 con 0x7f8a80005210 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8c00caa0 con 0x7f8a80005210 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a8bfff700 1 -- 172.21.15.12:0/1369811278 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c00cc10 con 0x7f8a80005210 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 -- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 msgr2=0x7f8a8000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a8000ba60 secure :-1 s=READY pgs=2043 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c002150 tx=0x7f8a8c0017a0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 -- 172.21.15.12:0/1369811278 shutdown_connections 2023-10-08T17:44:00.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/1369811278 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a8000ba60 unknown :-1 s=CLOSED pgs=2043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 -- 172.21.15.12:0/1369811278 >> 172.21.15.12:0/1369811278 conn(0x7f8a9406d170 msgr2=0x7f8a940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 -- 172.21.15.12:0/1369811278 shutdown_connections 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.772+0000 7f8a9a79d700 1 -- 172.21.15.12:0/1369811278 wait complete. 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.774+0000 7f8a9a79d700 1 Processor -- start 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.774+0000 7f8a9a79d700 1 -- start start 2023-10-08T17:44:00.788 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 0x7f8a94167e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 0x7f8a94168820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a940c61c0 con 0x7f8a80005210 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9413d710 con 0x7f8a941683a0 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9a79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a94168d60 con 0x7f8a94158720 2023-10-08T17:44:00.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:38726/0 (socket says 172.21.15.12:38726) 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 -- 172.21.15.12:0/3753633253 learned_addr learned my addr 172.21.15.12:0/3753633253 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 0x7f8a94167e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 -- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 msgr2=0x7f8a94167e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 0x7f8a94168820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 0x7f8a94167e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 -- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 msgr2=0x7f8a94168820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.790 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 0x7f8a94168820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a9979b700 1 -- 172.21.15.12:0/3753633253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a94158e50 con 0x7f8a80005210 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 0x7f8a94167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.775+0000 7f8a99f9c700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 0x7f8a94168820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a9979b700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007fd0 tx=0x7f8a90001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90011590 con 0x7f8a80005210 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a90011710 con 0x7f8a80005210 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a90011ad0 con 0x7f8a80005210 2023-10-08T17:44:00.791 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a94159130 con 0x7f8a80005210 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.776+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a941596f0 con 0x7f8a80005210 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.777+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9404c3c0 con 0x7f8a80005210 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.778+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a9001d3b0 con 0x7f8a80005210 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.778+0000 7f8a897fa700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.779+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8a90084430 con 0x7f8a80005210 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.779+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:00.792 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.779+0000 7f8a98f9a700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 0x7f8a780693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006ea0 tx=0x7f8a84008040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:00.793 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.783+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a90051560 con 0x7f8a80005210 2023-10-08T17:44:00.988 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.987+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a940c78d0 con 0x7f8a80005210 2023-10-08T17:44:00.989 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.988+0000 7f8a897fa700 1 -- 172.21.15.12:0/3753633253 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v218) v1 ==== 74+0+13924 (secure 0 0 0) 0x7f8a90019090 con 0x7f8a80005210 2023-10-08T17:44:00.989 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:00.989 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":218,"fsid":"0ae45396-6d03-47bf-984b-756ce4c92578","created":"2023-10-08T16:08:56.125368+0000","modified":"2023-10-08T17:43:55.223750+0000","last_up_change":"2023-10-08T16:09:08.627523+0000","last_in_change":"2023-10-08T16:08:59.761551+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-08T16:09:09.966197+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"b3f88c40-0762-47e9-b476-591d845036b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6815","nonce":115685},{"type":"v1","addr":"172.21.15.12:6818","nonce":115685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6821","nonce":115685},{"type":"v1","addr":"172.21.15.12:6823","nonce":115685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6829","nonce":115685},{"type":"v1","addr":"172.21.15.12:6831","nonce":115685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6825","nonce":115685},{"type":"v1","addr":"172.21.15.12:6827","nonce":115685}]},"public_addr":"172.21.15.12:6818/115685","cluster_addr":"172.21.15.12:6823/115685","heartbeat_back_addr":"172.21.15.12:6831/115685","heartbeat_front_addr":"172.21.15.12:6827/115685","state":["exists","up"]},{"osd":1,"uuid":"52b48da5-8abc-4fa2-9966-fab8ecd6cdb7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":115687},{"type":"v1","addr":"172.21.15.12:6817","nonce":115687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":115687},{"type":"v1","addr":"172.21.15.12:6822","nonce":115687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6828","nonce":115687},{"type":"v1","addr":"172.21.15.12:6830","nonce":115687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":115687},{"type":"v1","addr":"172.21.15.12:6826","nonce":115687}]},"public_addr":"172.21.15.12:6817/115687","cluster_addr":"172.21.15.12:6822/115687","heartbeat_back_addr":"172.21.15.12:6830/115687","heartbeat_front_addr":"172.21.15.12:6826/115687","state":["exists","up"]},{"osd":2,"uuid":"b09982ef-2211-4f91-9baf-3aac0f1c92ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":115686},{"type":"v1","addr":"172.21.15.12:6801","nonce":115686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":115686},{"type":"v1","addr":"172.21.15.12:6803","nonce":115686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":115686},{"type":"v1","addr":"172.21.15.12:6807","nonce":115686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":115686},{"type":"v1","addr":"172.21.15.12:6805","nonce":115686}]},"public_addr":"172.21.15.12:6801/115686","cluster_addr":"172.21.15.12:6803/115686","heartbeat_back_addr":"172.21.15.12:6807/115686","heartbeat_front_addr":"172.21.15.12:6805/115686","state":["exists","up"]},{"osd":3,"uuid":"6fc5ba17-37ee-493a-8505-36897a935766","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":115684},{"type":"v1","addr":"172.21.15.12:6809","nonce":115684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":115684},{"type":"v1","addr":"172.21.15.12:6811","nonce":115684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":115684},{"type":"v1","addr":"172.21.15.12:6819","nonce":115684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":115684},{"type":"v1","addr":"172.21.15.12:6813","nonce":115684}]},"public_addr":"172.21.15.12:6809/115684","cluster_addr":"172.21.15.12:6811/115684","heartbeat_back_addr":"172.21.15.12:6819/115684","heartbeat_front_addr":"172.21.15.12:6813/115684","state":["exists","up"]},{"osd":4,"uuid":"8bb8e057-6efe-4ad6-b188-441da397f8a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6801","nonce":114126},{"type":"v1","addr":"172.21.15.29:6803","nonce":114126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6805","nonce":114126},{"type":"v1","addr":"172.21.15.29:6807","nonce":114126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6813","nonce":114126},{"type":"v1","addr":"172.21.15.29:6815","nonce":114126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6809","nonce":114126},{"type":"v1","addr":"172.21.15.29:6811","nonce":114126}]},"public_addr":"172.21.15.29:6803/114126","cluster_addr":"172.21.15.29:6807/114126","heartbeat_back_addr":"172.21.15.29:6815/114126","heartbeat_front_addr":"172.21.15.29:6811/114126","state":["exists","up"]},{"osd":5,"uuid":"8a4c2509-6d27-49b8-878f-36ac07816e18","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6816","nonce":114133},{"type":"v1","addr":"172.21.15.29:6817","nonce":114133}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6818","nonce":114133},{"type":"v1","addr":"172.21.15.29:6819","nonce":114133}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6822","nonce":114133},{"type":"v1","addr":"172.21.15.29:6823","nonce":114133}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6820","nonce":114133},{"type":"v1","addr":"172.21.15.29:6821","nonce":114133}]},"public_addr":"172.21.15.29:6817/114133","cluster_addr":"172.21.15.29:6819/114133","heartbeat_back_addr":"172.21.15.29:6823/114133","heartbeat_front_addr":"172.21.15.29:6821/114133","state":["exists","up"]},{"osd":6,"uuid":"35731bb8-abf5-4baf-a7d8-c1d376952af9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6824","nonce":114138},{"type":"v1","addr":"172.21.15.29:6825","nonce":114138}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6826","nonce":114138},{"type":"v1","addr":"172.21.15.29:6827","nonce":114138}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6830","nonce":114138},{"type":"v1","addr":"172.21.15.29:6831","nonce":114138}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6828","nonce":114138},{"type":"v1","addr":"172.21.15.29:6829","nonce":114138}]},"public_addr":"172.21.15.29:6825/114138","cluster_addr":"172.21.15.29:6827/114138","heartbeat_back_addr":"172.21.15.29:6831/114138","heartbeat_front_addr":"172.21.15.29:6829/114138","state":["exists","up"]},{"osd":7,"uuid":"f1671df4-437c-41c9-8b0d-10a0e2d1dbfa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":211,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6800","nonce":114128},{"type":"v1","addr":"172.21.15.29:6802","nonce":114128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6804","nonce":114128},{"type":"v1","addr":"172.21.15.29:6806","nonce":114128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6812","nonce":114128},{"type":"v1","addr":"172.21.15.29:6814","nonce":114128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6808","nonce":114128},{"type":"v1","addr":"172.21.15.29:6810","nonce":114128}]},"public_addr":"172.21.15.29:6802/114128","cluster_addr":"172.21.15.29:6806/114128","heartbeat_back_addr":"172.21.15.29:6814/114128","heartbeat_front_addr":"172.21.15.29:6810/114128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.080395+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.105438+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.324163+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.131567+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.353186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.343726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.402480+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-08T16:09:05.110102+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.12:0/3758436552":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1972033471":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1213418889":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/1774143054":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/607056971":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/2856495157":"2023-10-09T17:43:53.201713+0000","172.21.15.12:0/2880705844":"2023-10-09T17:43:53.201713+0000","172.21.15.29:6835/4272081005":"2023-10-09T17:43:52.167818+0000","172.21.15.29:6832/4272081005":"2023-10-09T17:43:52.167818+0000","172.21.15.12:6837/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:6836/163464":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/3541952869":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/2981918803":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/843450174":"2023-10-09T17:43:42.681590+0000","172.21.15.12:0/790125058":"2023-10-09T17:43:42.681590+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":5,"snaps":[{"begin":3,"length":1},{"begin":7,"length":1},{"begin":15,"length":1},{"begin":20,"length":1},{"begin":26,"length":1},{"begin":31,"length":1},{"begin":36,"length":1},{"begin":41,"length":2},{"begin":47,"length":1},{"begin":53,"length":1},{"begin":58,"length":1},{"begin":64,"length":1},{"begin":69,"length":1},{"begin":75,"length":1},{"begin":80,"length":1},{"begin":85,"length":2},{"begin":91,"length":1},{"begin":95,"length":2},{"begin":101,"length":1},{"begin":105,"length":2},{"begin":111,"length":1},{"begin":197,"length":25}]},{"pool":7,"snaps":[{"begin":2,"length":4}]},{"pool":15,"snaps":[{"begin":2,"length":2}]},{"pool":17,"snaps":[{"begin":3,"length":55},{"begin":59,"length":55}]},{"pool":21,"snaps":[{"begin":2,"length":32}]},{"pool":23,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 msgr2=0x7f8a780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 0x7f8a780693e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8a84006ea0 tx=0x7f8a84008040 comp rx=0 tx=0).stop 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 msgr2=0x7f8a940c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f8a90007fd0 tx=0x7f8a90001d20 comp rx=0 tx=0).stop 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 shutdown_connections 2023-10-08T17:44:00.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8a78066f30 0x7f8a780693e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f8a80005210 0x7f8a940c5c80 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f8a941683a0 0x7f8a94168820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 --2- 172.21.15.12:0/3753633253 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f8a94158720 0x7f8a94167e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 >> 172.21.15.12:0/3753633253 conn(0x7f8a9406d170 msgr2=0x7f8a94069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 shutdown_connections 2023-10-08T17:44:00.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:00.991+0000 7f8a9a79d700 1 -- 172.21.15.12:0/3753633253 wait complete. 2023-10-08T17:44:02.011 INFO:tasks.ceph:Scrubbing osd.0 2023-10-08T17:44:02.011 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:02.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.213+0000 7f536999d700 1 Processor -- start 2023-10-08T17:44:02.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.214+0000 7f536999d700 1 -- start start 2023-10-08T17:44:02.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536999d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53640c8200 0x7f53640c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c2a90 0x7f5364156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536999d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53641579b0 con 0x7f53640c85d0 2023-10-08T17:44:02.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536999d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640c1390 con 0x7f53640c8200 2023-10-08T17:44:02.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53641573f0 con 0x7f53640c2a90 2023-10-08T17:44:02.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53640c8200 0x7f53640c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536899b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f53640c8200 0x7f53640c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54606/0 (socket says 172.21.15.12:54606) 2023-10-08T17:44:02.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f536899b700 1 -- 172.21.15.12:0/3021073341 learned_addr learned my addr 172.21.15.12:0/3021073341 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.215+0000 7f5363fff700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c2a90 0x7f5364156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.218 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f53637fe700 1 -- 172.21.15.12:0/3021073341 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876247877 0 0) 0x7f53641579b0 con 0x7f53640c85d0 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f536899b700 1 -- 172.21.15.12:0/3021073341 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c2a90 msgr2=0x7f5364156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f536899b700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c2a90 0x7f5364156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f536899b700 1 -- 172.21.15.12:0/3021073341 >> v1:172.21.15.29:6789/0 conn(0x7f53640c85d0 legacy=0x7f53640cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f536899b700 1 -- 172.21.15.12:0/3021073341 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53641576d0 con 0x7f53640c8200 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f536899b700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c8200 0x7f53640c1820 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f53580099b0 tx=0x7f5358009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ceb74bf58cf23c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f53637fe700 1 -- 172.21.15.12:0/3021073341 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5358009ea0 con 0x7f53640c8200 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f53637fe700 1 -- 172.21.15.12:0/3021073341 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800b860 con 0x7f53640c8200 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.216+0000 7f53637fe700 1 -- 172.21.15.12:0/3021073341 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800bc00 con 0x7f53640c8200 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 -- 172.21.15.12:0/3021073341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c8200 msgr2=0x7f53640c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c8200 0x7f53640c1820 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f53580099b0 tx=0x7f5358009250 comp rx=0 tx=0).stop 2023-10-08T17:44:02.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 -- 172.21.15.12:0/3021073341 shutdown_connections 2023-10-08T17:44:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c8200 0x7f53640c1820 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 --2- 172.21.15.12:0/3021073341 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c2a90 0x7f5364156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 -- 172.21.15.12:0/3021073341 >> 172.21.15.12:0/3021073341 conn(0x7f536406c6a0 msgr2=0x7f536406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 -- 172.21.15.12:0/3021073341 shutdown_connections 2023-10-08T17:44:02.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.217+0000 7f536999d700 1 -- 172.21.15.12:0/3021073341 wait complete. 2023-10-08T17:44:02.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.218+0000 7f536999d700 1 Processor -- start 2023-10-08T17:44:02.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 -- start start 2023-10-08T17:44:02.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53640c2a90 0x7f53640aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c8200 0x7f536414f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.222 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 0x7f53640b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f536414fab0 con 0x7f53640c85d0 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640af580 con 0x7f53640c2a90 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.219+0000 7f536999d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640af860 con 0x7f53640c8200 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 0x7f53640b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536899b700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53640c2a90 0x7f53640aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 0x7f53640b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54618/0 (socket says 172.21.15.12:54618) 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 -- 172.21.15.12:0/3484627185 learned_addr learned my addr 172.21.15.12:0/3484627185 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f5363fff700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c8200 0x7f536414f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 -- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c8200 msgr2=0x7f536414f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f53640c8200 0x7f536414f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 -- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53640c2a90 msgr2=0x7f53640aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.223 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53640c2a90 0x7f53640aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53580094f0 con 0x7f53640c85d0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536899b700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f53640c2a90 0x7f53640aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.220+0000 7f536919c700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 0x7f53640b0620 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c890 tx=0x7f535c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c012630 con 0x7f53640c85d0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c0127b0 con 0x7f53640c85d0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53640afb40 con 0x7f53640c85d0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c012b70 con 0x7f53640c85d0 2023-10-08T17:44:02.224 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640afed0 con 0x7f53640c85d0 2023-10-08T17:44:02.225 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.221+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f536404c3c0 con 0x7f53640c85d0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.223+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f535c003030 con 0x7f53640c85d0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5360ff9700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f30 0x7f53480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f535c084d90 con 0x7f53640c85d0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f536899b700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f30 0x7f53480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5360ff9700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f534806d6d0 0x7f534806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5348070170 con 0x7f534806d6d0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f535c085080 con 0x7f53640c85d0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.224+0000 7f5363fff700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f534806d6d0 0x7f534806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.226 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.225+0000 7f536899b700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f30 0x7f53480693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53580099b0 tx=0x7f5358017000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.225+0000 7f5363fff700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f534806d6d0 0x7f534806fb40 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.227 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.226+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== osd.0 v2:172.21.15.12:6815/115685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5348070170 con 0x7f534806d6d0 2023-10-08T17:44:02.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.240+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 --> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f536414d020 con 0x7f534806d6d0 2023-10-08T17:44:02.242 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f5360ff9700 1 -- 172.21.15.12:0/3484627185 <== osd.0 v2:172.21.15.12:6815/115685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f536414d020 con 0x7f534806d6d0 2023-10-08T17:44:02.243 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:02.243 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:02.243 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:02.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f534806d6d0 msgr2=0x7f534806fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6815/115685,v1:172.21.15.12:6818/115685] conn(0x7f534806d6d0 0x7f534806fb40 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.245 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f30 msgr2=0x7f53480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5348066f30 0x7f53480693e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f53580099b0 tx=0x7f5358017000 comp rx=0 tx=0).stop 2023-10-08T17:44:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 msgr2=0x7f53640b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 --2- 172.21.15.12:0/3484627185 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f53640c85d0 0x7f53640b0620 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7f535c00c890 tx=0x7f535c001630 comp rx=0 tx=0).stop 2023-10-08T17:44:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536919c700 1 -- 172.21.15.12:0/3484627185 reap_dead start 2023-10-08T17:44:02.246 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 shutdown_connections 2023-10-08T17:44:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 >> 172.21.15.12:0/3484627185 conn(0x7f536406c6a0 msgr2=0x7f53640c8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 shutdown_connections 2023-10-08T17:44:02.247 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.241+0000 7f536999d700 1 -- 172.21.15.12:0/3484627185 wait complete. 2023-10-08T17:44:02.260 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-08T17:44:02.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.448+0000 7ff76a19d700 1 Processor -- start 2023-10-08T17:44:02.449 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.448+0000 7ff76a19d700 1 -- start start 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.449+0000 7ff76a19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff764153c30 0x7ff76415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.449+0000 7ff76a19d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76415afd0 con 0x7ff76415de50 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.449+0000 7ff76a19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76415b2b0 con 0x7ff7640cf110 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.449+0000 7ff76a19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff76415b590 con 0x7ff764153c30 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff764153c30 0x7ff76415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff764153c30 0x7ff76415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54626/0 (socket says 172.21.15.12:54626) 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 -- 172.21.15.12:0/3004319252 learned_addr learned my addr 172.21.15.12:0/3004319252 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76899a700 1 --1- 172.21.15.12:0/3004319252 >> v1:172.21.15.12:6789/0 conn(0x7ff76415de50 0x7ff7640cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50744/0 (socket says 172.21.15.12:50744) 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 -- 172.21.15.12:0/3004319252 >> v1:172.21.15.29:6789/0 conn(0x7ff7640cf110 legacy=0x7ff76415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.452 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 -- 172.21.15.12:0/3004319252 >> v1:172.21.15.12:6789/0 conn(0x7ff76415de50 legacy=0x7ff7640cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff76919b700 1 -- 172.21.15.12:0/3004319252 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76415b870 con 0x7ff764153c30 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.450+0000 7ff75bfff700 1 -- 172.21.15.12:0/3004319252 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663996986 0 0) 0x7ff76415b2b0 con 0x7ff7640cf110 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76919b700 1 --2- 172.21.15.12:0/3004319252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff764153c30 0x7ff76415a5e0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9817ecc436f79 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff75bfff700 1 -- 172.21.15.12:0/3004319252 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000b760 con 0x7ff764153c30 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff75bfff700 1 -- 172.21.15.12:0/3004319252 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000b8c0 con 0x7ff764153c30 2023-10-08T17:44:02.453 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff75bfff700 1 -- 172.21.15.12:0/3004319252 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000bc60 con 0x7ff764153c30 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 -- 172.21.15.12:0/3004319252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff764153c30 msgr2=0x7ff76415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 --2- 172.21.15.12:0/3004319252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff764153c30 0x7ff76415a5e0 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7ff7600099b0 tx=0x7ff760009250 comp rx=0 tx=0).stop 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 -- 172.21.15.12:0/3004319252 shutdown_connections 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 --2- 172.21.15.12:0/3004319252 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff764153c30 0x7ff76415a5e0 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 -- 172.21.15.12:0/3004319252 >> 172.21.15.12:0/3004319252 conn(0x7ff7640703a0 msgr2=0x7ff7640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.454 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.451+0000 7ff76a19d700 1 -- 172.21.15.12:0/3004319252 shutdown_connections 2023-10-08T17:44:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.452+0000 7ff76a19d700 1 -- 172.21.15.12:0/3004319252 wait complete. 2023-10-08T17:44:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.453+0000 7ff76a19d700 1 Processor -- start 2023-10-08T17:44:02.455 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.453+0000 7ff76a19d700 1 -- start start 2023-10-08T17:44:02.456 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff764153c30 0x7ff7640c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff76415de50 0x7ff76415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c89f0 con 0x7ff7640cf110 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c7e20 con 0x7ff764153c30 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76a19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640c80c0 con 0x7ff76415de50 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76919b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54640/0 (socket says 172.21.15.12:54640) 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76919b700 1 -- 172.21.15.12:0/4144851222 learned_addr learned my addr 172.21.15.12:0/4144851222 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76899a700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff764153c30 0x7ff7640c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.454+0000 7ff76999c700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff76415de50 0x7ff76415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.457 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 -- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff76415de50 msgr2=0x7ff76415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff76415de50 0x7ff76415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 -- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff764153c30 msgr2=0x7ff7640c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff764153c30 0x7ff7640c8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 -- 172.21.15.12:0/4144851222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7600094f0 con 0x7ff7640cf110 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76919b700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7ff76406eb00 tx=0x7ff760016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760006bc0 con 0x7ff7640cf110 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76000bc40 con 0x7ff7640cf110 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76001c6d0 con 0x7ff7640cf110 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7640c83a0 con 0x7ff7640cf110 2023-10-08T17:44:02.458 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.455+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7641535d0 con 0x7ff7640cf110 2023-10-08T17:44:02.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.456+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff76404c3c0 con 0x7ff7640cf110 2023-10-08T17:44:02.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.457+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff76001ca40 con 0x7ff7640cf110 2023-10-08T17:44:02.459 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.458+0000 7ff7597fa700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 0x7ff7480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.459+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ff760086b10 con 0x7ff7640cf110 2023-10-08T17:44:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.459+0000 7ff76899a700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 0x7ff7480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.460 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.459+0000 7ff76899a700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 0x7ff7480693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff764070fb0 tx=0x7ff754007e90 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.464 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.463+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff760053ba0 con 0x7ff7640cf110 2023-10-08T17:44:02.666 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.665+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7640c8b30 con 0x7ff748066f30 2023-10-08T17:44:02.667 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.666+0000 7ff7597fa700 1 -- 172.21.15.12:0/4144851222 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff754004c80 con 0x7ff748066f30 2023-10-08T17:44:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 msgr2=0x7ff7480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 0x7ff7480693e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff764070fb0 tx=0x7ff754007e90 comp rx=0 tx=0).stop 2023-10-08T17:44:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 msgr2=0x7ff764153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.669 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7ff76406eb00 tx=0x7ff760016000 comp rx=0 tx=0).stop 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 shutdown_connections 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff748066f30 0x7ff7480693e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff7640cf110 0x7ff764153090 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff76415de50 0x7ff76415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 --2- 172.21.15.12:0/4144851222 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff764153c30 0x7ff7640c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 >> 172.21.15.12:0/4144851222 conn(0x7ff7640703a0 msgr2=0x7ff76415d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 shutdown_connections 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.668+0000 7ff76a19d700 1 -- 172.21.15.12:0/4144851222 wait complete. 2023-10-08T17:44:02.670 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 0 to deep-scrub 2023-10-08T17:44:02.686 INFO:tasks.ceph:Scrubbing osd.1 2023-10-08T17:44:02.686 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:02.878 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.877+0000 7f670d79d700 1 Processor -- start 2023-10-08T17:44:02.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.877+0000 7f670d79d700 1 -- start start 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c2a90 0x7f6708156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670d79d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67080c85d0 0x7f67080cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670d79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67081579b0 con 0x7f67080c8200 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670d79d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67080c1390 con 0x7f67080c85d0 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67081573f0 con 0x7f67080c2a90 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67080c85d0 0x7f67080cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f67080c85d0 0x7f67080cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54646/0 (socket says 172.21.15.12:54646) 2023-10-08T17:44:02.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 -- 172.21.15.12:0/1616325062 learned_addr learned my addr 172.21.15.12:0/1616325062 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.881 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f67077fe700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c2a90 0x7f6708156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 -- 172.21.15.12:0/1616325062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c2a90 msgr2=0x7f6708156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:02.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c2a90 0x7f6708156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 -- 172.21.15.12:0/1616325062 >> v1:172.21.15.29:6789/0 conn(0x7f67080c8200 legacy=0x7f67080c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:02.882 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.879+0000 7f670cf9c700 1 -- 172.21.15.12:0/1616325062 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67081576d0 con 0x7f67080c85d0 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.880+0000 7f670cf9c700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cc2f0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f6700009f20 tx=0x7f6700009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37df996d1225dd1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.880+0000 7f6706ffd700 1 -- 172.21.15.12:0/1616325062 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000e070 con 0x7f67080c85d0 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.880+0000 7f6706ffd700 1 -- 172.21.15.12:0/1616325062 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670000b990 con 0x7f67080c85d0 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.880+0000 7f6706ffd700 1 -- 172.21.15.12:0/1616325062 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67000092e0 con 0x7f67080c85d0 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.880+0000 7f670d79d700 1 -- 172.21.15.12:0/1616325062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 msgr2=0x7f67080cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cc2f0 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f6700009f20 tx=0x7f6700009840 comp rx=0 tx=0).stop 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 -- 172.21.15.12:0/1616325062 shutdown_connections 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cc2f0 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 --2- 172.21.15.12:0/1616325062 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c2a90 0x7f6708156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 -- 172.21.15.12:0/1616325062 >> 172.21.15.12:0/1616325062 conn(0x7f670806c6a0 msgr2=0x7f670806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.883 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 -- 172.21.15.12:0/1616325062 shutdown_connections 2023-10-08T17:44:02.884 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.881+0000 7f670d79d700 1 -- 172.21.15.12:0/1616325062 wait complete. 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.882+0000 7f670d79d700 1 Processor -- start 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.882+0000 7f670d79d700 1 -- start start 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67080c2a90 0x7f67080b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c8200 0x7f67080cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670814fc40 con 0x7f67080c85d0 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670816d930 con 0x7f67080c2a90 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670d79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670814aa90 con 0x7f67080c8200 2023-10-08T17:44:02.885 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f670cf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.883+0000 7f6707fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67080c2a90 0x7f67080b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c8200 0x7f67080cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f6707fff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67080c2a90 0x7f67080b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54278/0 (socket says 172.21.15.12:54278) 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f670cf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54662/0 (socket says 172.21.15.12:54662) 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f6707fff700 1 -- 172.21.15.12:0/2003083664 learned_addr learned my addr 172.21.15.12:0/2003083664 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 -- 172.21.15.12:0/2003083664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67080c2a90 msgr2=0x7f67080b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f67080c2a90 0x7f67080b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 -- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 msgr2=0x7f67080cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f67080c85d0 0x7f67080cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.886 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009ae0 con 0x7f67080c8200 2023-10-08T17:44:02.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f67077fe700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c8200 0x7f67080cb620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00ea00 tx=0x7f66fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.884+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc013680 con 0x7f67080c8200 2023-10-08T17:44:02.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.885+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66fc013800 con 0x7f67080c8200 2023-10-08T17:44:02.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.885+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66fc013bc0 con 0x7f67080c8200 2023-10-08T17:44:02.887 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.885+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670816d000 con 0x7f67080c8200 2023-10-08T17:44:02.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.885+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670816d5c0 con 0x7f67080c8200 2023-10-08T17:44:02.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.885+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f670804c3c0 con 0x7f67080c8200 2023-10-08T17:44:02.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.887+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66fc00c490 con 0x7f67080c8200 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f66effff700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f66f4066f60 0x7f66f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f66fc084a70 con 0x7f67080c8200 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f66effff700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f66f406d700 0x7f66f406fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66f40701a0 con 0x7f66f406d700 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== mon.2 v2:172.21.15.29:3301/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66fc084d60 con 0x7f67080c8200 2023-10-08T17:44:02.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f6707fff700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f66f4066f60 0x7f66f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.888+0000 7f670cf9c700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f66f406d700 0x7f66f406fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:02.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.889+0000 7f6707fff700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f66f4066f60 0x7f66f4069410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009b80 tx=0x7f66f80091a0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.889+0000 7f670cf9c700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f66f406d700 0x7f66f406fb70 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:02.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.890+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== osd.1 v2:172.21.15.12:6814/115687 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f66f40701a0 con 0x7f66f406d700 2023-10-08T17:44:02.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.904+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 --> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f67080c2280 con 0x7f66f406d700 2023-10-08T17:44:02.905 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.904+0000 7f66effff700 1 -- 172.21.15.12:0/2003083664 <== osd.1 v2:172.21.15.12:6814/115687 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f67080c2280 con 0x7f66f406d700 2023-10-08T17:44:02.906 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:02.906 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:02.906 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f66f406d700 msgr2=0x7f66f406fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6814/115687,v1:172.21.15.12:6817/115687] conn(0x7f66f406d700 0x7f66f406fb70 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f66f4066f60 msgr2=0x7f66f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f66f4066f60 0x7f66f4069410 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f66f8009b80 tx=0x7f66f80091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c8200 msgr2=0x7f67080cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:02.908 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 --2- 172.21.15.12:0/2003083664 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f67080c8200 0x7f67080cb620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00ea00 tx=0x7f66fc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670cf9c700 1 -- 172.21.15.12:0/2003083664 reap_dead start 2023-10-08T17:44:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 shutdown_connections 2023-10-08T17:44:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 >> 172.21.15.12:0/2003083664 conn(0x7f670806c6a0 msgr2=0x7f67081595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 shutdown_connections 2023-10-08T17:44:02.909 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:02.905+0000 7f670d79d700 1 -- 172.21.15.12:0/2003083664 wait complete. 2023-10-08T17:44:02.922 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-08T17:44:03.110 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.109+0000 7f842f59e700 1 Processor -- start 2023-10-08T17:44:03.111 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.109+0000 7f842f59e700 1 -- start start 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 0x7f843015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842f59e700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843015ae70 con 0x7f843013fb20 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843006af60 con 0x7f843006aaa0 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843006b240 con 0x7f843013fef0 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842e59c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f843013fb20 0x7f84300c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50760/0 (socket says 172.21.15.12:50760) 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842e59c700 1 -- 172.21.15.12:0/3297329949 learned_addr learned my addr 172.21.15.12:0/3297329949 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:03.112 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842dd9b700 1 --2- 172.21.15.12:0/3297329949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 0x7f843015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2139924616 0 0) 0x7f8420001110 con 0x7f843013fb20 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8418003570 con 0x7f843013fb20 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174845049 0 0) 0x7f843006af60 con 0x7f843006aaa0 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.111+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8420001110 con 0x7f843006aaa0 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842dd9b700 1 -- 172.21.15.12:0/3297329949 >> v1:172.21.15.29:6789/0 conn(0x7f843006aaa0 legacy=0x7f84300c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842dd9b700 1 -- 172.21.15.12:0/3297329949 >> v1:172.21.15.12:6789/0 conn(0x7f843013fb20 legacy=0x7f84300c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.114 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842dd9b700 1 -- 172.21.15.12:0/3297329949 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843006b520 con 0x7f843013fef0 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842dd9b700 1 --2- 172.21.15.12:0/3297329949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 0x7f843015a930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8424009900 tx=0x7f8424009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ca5f0d03258a0d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424005c10 con 0x7f843013fef0 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8424005d70 con 0x7f843013fef0 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.112+0000 7f842d59a700 1 -- 172.21.15.12:0/3297329949 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424006260 con 0x7f843013fef0 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 -- 172.21.15.12:0/3297329949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 msgr2=0x7f843015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 --2- 172.21.15.12:0/3297329949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 0x7f843015a930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8424009900 tx=0x7f8424009120 comp rx=0 tx=0).stop 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 -- 172.21.15.12:0/3297329949 shutdown_connections 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 --2- 172.21.15.12:0/3297329949 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843013fef0 0x7f843015a930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 -- 172.21.15.12:0/3297329949 >> 172.21.15.12:0/3297329949 conn(0x7f843006d170 msgr2=0x7f84300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 -- 172.21.15.12:0/3297329949 shutdown_connections 2023-10-08T17:44:03.115 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.113+0000 7f842f59e700 1 -- 172.21.15.12:0/3297329949 wait complete. 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.114+0000 7f842f59e700 1 Processor -- start 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.114+0000 7f842f59e700 1 -- start start 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843006aaa0 0x7f843016a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f843013fef0 0x7f8430156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84300acb20 con 0x7f843013fb20 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843013cce0 con 0x7f843013fef0 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84301571e0 con 0x7f843006aaa0 2023-10-08T17:44:03.117 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.115+0000 7f842dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54668/0 (socket says 172.21.15.12:54668) 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 -- 172.21.15.12:0/76811557 learned_addr learned my addr 172.21.15.12:0/76811557 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842e59c700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843006aaa0 0x7f843016a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842ed9d700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f843013fef0 0x7f8430156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 -- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843006aaa0 msgr2=0x7f843016a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843006aaa0 0x7f843016a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 -- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f843013fef0 msgr2=0x7f8430156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f843013fef0 0x7f8430156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.118 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 -- 172.21.15.12:0/76811557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84240093c0 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f842dd9b700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f8424009160 tx=0x7f8424016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842401d780 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842401d8e0 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.116+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842401dca0 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.117+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84301574c0 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.117+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84300ac7b0 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.118+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84300aea80 con 0x7f843013fb20 2023-10-08T17:44:03.120 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.119+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f842401b690 con 0x7f843013fb20 2023-10-08T17:44:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.120+0000 7f841e7fc700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.120+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8424085ff0 con 0x7f843013fb20 2023-10-08T17:44:03.121 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.121+0000 7f842e59c700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.122 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.121+0000 7f842e59c700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 0x7f84100693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8420007fd0 tx=0x7f8420009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.125 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.125+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84240530e0 con 0x7f843013fb20 2023-10-08T17:44:03.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.331+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f843004c3c0 con 0x7f8410066f30 2023-10-08T17:44:03.332 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.331+0000 7f841e7fc700 1 -- 172.21.15.12:0/76811557 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f843004c3c0 con 0x7f8410066f30 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 msgr2=0x7f84100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 0x7f84100693e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f8420007fd0 tx=0x7f8420009040 comp rx=0 tx=0).stop 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 msgr2=0x7f843013c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7f8424009160 tx=0x7f8424016000 comp rx=0 tx=0).stop 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 shutdown_connections 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8410066f30 0x7f84100693e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f843013fef0 0x7f8430156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f843006aaa0 0x7f843016a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.335 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 --2- 172.21.15.12:0/76811557 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f843013fb20 0x7f843013c7a0 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.333+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 >> 172.21.15.12:0/76811557 conn(0x7f843006d170 msgr2=0x7f84300cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.334+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 shutdown_connections 2023-10-08T17:44:03.336 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.334+0000 7f842f59e700 1 -- 172.21.15.12:0/76811557 wait complete. 2023-10-08T17:44:03.336 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 1 to deep-scrub 2023-10-08T17:44:03.352 INFO:tasks.ceph:Scrubbing osd.2 2023-10-08T17:44:03.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:03.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.542+0000 7effd1b9d700 1 Processor -- start 2023-10-08T17:44:03.543 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.542+0000 7effd1b9d700 1 -- start start 2023-10-08T17:44:03.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.543+0000 7effd1b9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0c8200 0x7effcc0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.543+0000 7effd1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c85d0 0x7effcc0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.543+0000 7effd1b9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc1571b0 con 0x7effcc0c2a90 2023-10-08T17:44:03.545 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.543+0000 7effd1b9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc1579b0 con 0x7effcc0c8200 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.543+0000 7effd1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0c1390 con 0x7effcc0c85d0 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0c8200 0x7effcc0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effcbfff700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7effcc0c2a90 0x7effcc156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50766/0 (socket says 172.21.15.12:50766) 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effcbfff700 1 -- 172.21.15.12:0/892922229 learned_addr learned my addr 172.21.15.12:0/892922229 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7effcc0c8200 0x7effcc0c1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54672/0 (socket says 172.21.15.12:54672) 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd139c700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c85d0 0x7effcc0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 -- 172.21.15.12:0/892922229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c85d0 msgr2=0x7effcc0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c85d0 0x7effcc0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 -- 172.21.15.12:0/892922229 >> v1:172.21.15.12:6789/0 conn(0x7effcc0c2a90 legacy=0x7effcc156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effcb7fe700 1 -- 172.21.15.12:0/892922229 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 656340762 0 0) 0x7effb8001110 con 0x7effcc0c2a90 2023-10-08T17:44:03.546 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.544+0000 7effd0b9b700 1 -- 172.21.15.12:0/892922229 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc1573f0 con 0x7effcc0c8200 2023-10-08T17:44:03.547 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd0b9b700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c8200 0x7effcc0c1820 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7effc00098e0 tx=0x7effc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7766fccc37553b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effcb7fe700 1 -- 172.21.15.12:0/892922229 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000b640 con 0x7effcc0c8200 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effcb7fe700 1 -- 172.21.15.12:0/892922229 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc000b7a0 con 0x7effcc0c8200 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effcb7fe700 1 -- 172.21.15.12:0/892922229 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc000bb40 con 0x7effcc0c8200 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 -- 172.21.15.12:0/892922229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c8200 msgr2=0x7effcc0c1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c8200 0x7effcc0c1820 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7effc00098e0 tx=0x7effc00091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 -- 172.21.15.12:0/892922229 shutdown_connections 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c85d0 0x7effcc0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 --2- 172.21.15.12:0/892922229 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c8200 0x7effcc0c1820 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 -- 172.21.15.12:0/892922229 >> 172.21.15.12:0/892922229 conn(0x7effcc06c6a0 msgr2=0x7effcc06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.545+0000 7effd1b9d700 1 -- 172.21.15.12:0/892922229 shutdown_connections 2023-10-08T17:44:03.548 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.546+0000 7effd1b9d700 1 -- 172.21.15.12:0/892922229 wait complete. 2023-10-08T17:44:03.549 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.547+0000 7effd1b9d700 1 Processor -- start 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.547+0000 7effd1b9d700 1 -- start start 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 0x7effcc145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effcc0c8200 0x7effcc0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c85d0 0x7effcc149ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0b0110 con 0x7effcc0c85d0 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0b03b0 con 0x7effcc0c8200 2023-10-08T17:44:03.551 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd1b9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0b0690 con 0x7effcc0c2a90 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd139c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c85d0 0x7effcc149ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd0b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 0x7effcc145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd0b9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 0x7effcc145db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:58962/0 (socket says 172.21.15.12:58962) 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effcbfff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effcc0c8200 0x7effcc0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.548+0000 7effd0b9b700 1 -- 172.21.15.12:0/2110115338 learned_addr learned my addr 172.21.15.12:0/2110115338 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 -- 172.21.15.12:0/2110115338 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 msgr2=0x7effcc145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 0x7effcc145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 -- 172.21.15.12:0/2110115338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effcc0c8200 msgr2=0x7effcc0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7effcc0c8200 0x7effcc0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0009420 con 0x7effcc0c85d0 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd0b9b700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7effcc0c2a90 0x7effcc145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd139c700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c85d0 0x7effcc149ec0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7effc400ecc0 tx=0x7effc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.552 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400c8c0 con 0x7effcc0c85d0 2023-10-08T17:44:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc400f040 con 0x7effcc0c85d0 2023-10-08T17:44:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc0b0970 con 0x7effcc0c85d0 2023-10-08T17:44:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400cc90 con 0x7effcc0c85d0 2023-10-08T17:44:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.549+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc14a960 con 0x7effcc0c85d0 2023-10-08T17:44:03.553 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.550+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7effcc04c3c0 con 0x7effcc0c85d0 2023-10-08T17:44:03.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.551+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effc4014690 con 0x7effcc0c85d0 2023-10-08T17:44:03.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effc8ff9700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7effb0066f30 0x7effb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7effc4085a90 con 0x7effcc0c85d0 2023-10-08T17:44:03.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effc8ff9700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7effb006d6d0 0x7effb006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effb0070170 con 0x7effb006d6d0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7effc4085d80 con 0x7effcc0c85d0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.552+0000 7effd0b9b700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7effb0066f30 0x7effb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.553+0000 7effcbfff700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7effb006d6d0 0x7effb006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.553+0000 7effd0b9b700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7effb0066f30 0x7effb00693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effc0006d80 tx=0x7effc0017000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.553+0000 7effcbfff700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7effb006d6d0 0x7effb006fb40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.554+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== osd.2 v2:172.21.15.12:6800/115686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7effb0070170 con 0x7effb006d6d0 2023-10-08T17:44:03.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 --> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7effcc0c2280 con 0x7effb006d6d0 2023-10-08T17:44:03.570 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effc8ff9700 1 -- 172.21.15.12:0/2110115338 <== osd.2 v2:172.21.15.12:6800/115686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7effcc0c2280 con 0x7effb006d6d0 2023-10-08T17:44:03.570 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:03.571 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:03.571 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7effb006d6d0 msgr2=0x7effb006fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6800/115686,v1:172.21.15.12:6801/115686] conn(0x7effb006d6d0 0x7effb006fb40 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7effb0066f30 msgr2=0x7effb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7effb0066f30 0x7effb00693e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effc0006d80 tx=0x7effc0017000 comp rx=0 tx=0).stop 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c85d0 msgr2=0x7effcc149ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd1b9d700 1 --2- 172.21.15.12:0/2110115338 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7effcc0c85d0 0x7effcc149ec0 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7effc400ecc0 tx=0x7effc400b040 comp rx=0 tx=0).stop 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.569+0000 7effd139c700 1 -- 172.21.15.12:0/2110115338 reap_dead start 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.570+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 shutdown_connections 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.570+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 >> 172.21.15.12:0/2110115338 conn(0x7effcc06c6a0 msgr2=0x7effcc14fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.570+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 shutdown_connections 2023-10-08T17:44:03.572 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.570+0000 7effd1b9d700 1 -- 172.21.15.12:0/2110115338 wait complete. 2023-10-08T17:44:03.587 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-08T17:44:03.775 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.774+0000 7ff42e99d700 1 Processor -- start 2023-10-08T17:44:03.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.775+0000 7ff42e99d700 1 -- start start 2023-10-08T17:44:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fb20 0x7ff42815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff42813fef0 0x7ff4280c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff42815ae70 con 0x7ff42806aaa0 2023-10-08T17:44:03.778 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42806af60 con 0x7ff42813fef0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff42806b240 con 0x7ff42813fb20 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42d19a700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff42813fef0 0x7ff4280c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e19c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7ff42806aaa0 0x7ff4280c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50768/0 (socket says 172.21.15.12:50768) 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42e19c700 1 -- 172.21.15.12:0/1285780409 learned_addr learned my addr 172.21.15.12:0/1285780409 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.776+0000 7ff42d99b700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fb20 0x7ff42815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42d19a700 1 -- 172.21.15.12:0/1285780409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fb20 msgr2=0x7ff42815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42d19a700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fb20 0x7ff42815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42d19a700 1 -- 172.21.15.12:0/1285780409 >> v1:172.21.15.12:6789/0 conn(0x7ff42806aaa0 legacy=0x7ff4280c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42d19a700 1 -- 172.21.15.12:0/1285780409 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42806b520 con 0x7ff42813fef0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42c999700 1 -- 172.21.15.12:0/1285780409 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262519554 0 0) 0x7ff420001490 con 0x7ff42806aaa0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42d19a700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42813fef0 0x7ff4280c7990 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098d0 tx=0x7ff4180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883e77755931be1d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.779 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42c999700 1 -- 172.21.15.12:0/1285780409 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800b640 con 0x7ff42813fef0 2023-10-08T17:44:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42c999700 1 -- 172.21.15.12:0/1285780409 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41800b7a0 con 0x7ff42813fef0 2023-10-08T17:44:03.780 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.777+0000 7ff42c999700 1 -- 172.21.15.12:0/1285780409 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41800bb60 con 0x7ff42813fef0 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 -- 172.21.15.12:0/1285780409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42813fef0 msgr2=0x7ff4280c7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42813fef0 0x7ff4280c7990 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7ff4180098d0 tx=0x7ff4180091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 -- 172.21.15.12:0/1285780409 shutdown_connections 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fb20 0x7ff42815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 --2- 172.21.15.12:0/1285780409 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42813fef0 0x7ff4280c7990 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 -- 172.21.15.12:0/1285780409 >> 172.21.15.12:0/1285780409 conn(0x7ff42806d170 msgr2=0x7ff4280cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 -- 172.21.15.12:0/1285780409 shutdown_connections 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.778+0000 7ff42e99d700 1 -- 172.21.15.12:0/1285780409 wait complete. 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.779+0000 7ff42e99d700 1 Processor -- start 2023-10-08T17:44:03.781 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.780+0000 7ff42e99d700 1 -- start start 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42813fb20 0x7ff4280ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fef0 0x7ff4280ad720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280b0fb0 con 0x7ff42806aaa0 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428137600 con 0x7ff42813fb20 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280ae4b0 con 0x7ff42813fef0 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54700/0 (socket says 172.21.15.12:54700) 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 -- 172.21.15.12:0/3561501514 learned_addr learned my addr 172.21.15.12:0/3561501514 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:03.784 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42e19c700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fef0 0x7ff4280ad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d19a700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42813fb20 0x7ff4280ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 -- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fef0 msgr2=0x7ff4280ad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fef0 0x7ff4280ad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 -- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42813fb20 msgr2=0x7ff4280ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42813fb20 0x7ff4280ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 -- 172.21.15.12:0/3561501514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180093c0 con 0x7ff42806aaa0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.781+0000 7ff42d99b700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7ff42400ec80 tx=0x7ff4240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.782+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42400c9d0 con 0x7ff42806aaa0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.782+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42400cb30 con 0x7ff42806aaa0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.782+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff424013470 con 0x7ff42806aaa0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.782+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4280ac1f0 con 0x7ff42806aaa0 2023-10-08T17:44:03.785 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.782+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280ac7b0 con 0x7ff42806aaa0 2023-10-08T17:44:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.783+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42804c3c0 con 0x7ff42806aaa0 2023-10-08T17:44:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.784+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff424013820 con 0x7ff42806aaa0 2023-10-08T17:44:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.785+0000 7ff41dffb700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:03.786 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.785+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ff424084a00 con 0x7ff42806aaa0 2023-10-08T17:44:03.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.785+0000 7ff42d19a700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:03.787 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.785+0000 7ff42d19a700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4180091e0 tx=0x7ff418017000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:03.789 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.789+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff424051b30 con 0x7ff42806aaa0 2023-10-08T17:44:03.992 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.991+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4280aea20 con 0x7ff40c066f30 2023-10-08T17:44:03.993 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.992+0000 7ff41dffb700 1 -- 172.21.15.12:0/3561501514 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff4280aea20 con 0x7ff40c066f30 2023-10-08T17:44:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 msgr2=0x7ff40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 0x7ff40c0693e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff4180091e0 tx=0x7ff418017000 comp rx=0 tx=0).stop 2023-10-08T17:44:03.995 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 msgr2=0x7ff4280b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 secure :-1 s=READY pgs=2058 cs=0 l=1 rev1=1 crypto rx=0x7ff42400ec80 tx=0x7ff4240091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 shutdown_connections 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff40c066f30 0x7ff40c0693e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff42806aaa0 0x7ff4280b0a70 unknown :-1 s=CLOSED pgs=2058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff42813fef0 0x7ff4280ad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 --2- 172.21.15.12:0/3561501514 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff42813fb20 0x7ff4280ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 >> 172.21.15.12:0/3561501514 conn(0x7ff42806d170 msgr2=0x7ff4280cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 shutdown_connections 2023-10-08T17:44:03.996 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:03.994+0000 7ff42e99d700 1 -- 172.21.15.12:0/3561501514 wait complete. 2023-10-08T17:44:03.997 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2023-10-08T17:44:04.012 INFO:tasks.ceph:Scrubbing osd.3 2023-10-08T17:44:04.012 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:04.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.202+0000 7fd95c9fe700 1 Processor -- start 2023-10-08T17:44:04.204 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.202+0000 7fd95c9fe700 1 -- start start 2023-10-08T17:44:04.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95c9fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7fd9580c2a90 0x7fd958156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.205 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c85d0 0x7fd9580cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95c9fe700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9581579b0 con 0x7fd9580c8200 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95c9fe700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9580c1390 con 0x7fd9580c2a90 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9581573f0 con 0x7fd9580c85d0 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd956d9d700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd9580c8200 0x7fd9580c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50770/0 (socket says 172.21.15.12:50770) 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd956d9d700 1 -- 172.21.15.12:0/3823695598 learned_addr learned my addr 172.21.15.12:0/3823695598 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95659c700 1 --2- 172.21.15.12:0/3823695598 >> v2:172.21.15.12:3300/0 conn(0x7fd9580c2a90 0x7fd958156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95759e700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c85d0 0x7fd9580cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd955d9b700 1 -- 172.21.15.12:0/3823695598 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602088491 0 0) 0x7fd9581579b0 con 0x7fd9580c8200 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd955d9b700 1 -- 172.21.15.12:0/3823695598 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd940003570 con 0x7fd9580c8200 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95659c700 1 -- 172.21.15.12:0/3823695598 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c85d0 msgr2=0x7fd9580cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:04.206 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95659c700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c85d0 0x7fd9580cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.204+0000 7fd95659c700 1 -- 172.21.15.12:0/3823695598 >> v1:172.21.15.12:6789/0 conn(0x7fd9580c8200 legacy=0x7fd9580c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.207 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd95659c700 1 -- 172.21.15.12:0/3823695598 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9581576d0 con 0x7fd9580c2a90 2023-10-08T17:44:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd95659c700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c2a90 0x7fd958156aa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00bb90 tx=0x7fd94c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afaa91730fd5ba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd955d9b700 1 -- 172.21.15.12:0/3823695598 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00da70 con 0x7fd9580c2a90 2023-10-08T17:44:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd955d9b700 1 -- 172.21.15.12:0/3823695598 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94c00dbd0 con 0x7fd9580c2a90 2023-10-08T17:44:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd955d9b700 1 -- 172.21.15.12:0/3823695598 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94c019480 con 0x7fd9580c2a90 2023-10-08T17:44:04.208 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.205+0000 7fd95c9fe700 1 -- 172.21.15.12:0/3823695598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c2a90 msgr2=0x7fd958156aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c2a90 0x7fd958156aa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00bb90 tx=0x7fd94c00b430 comp rx=0 tx=0).stop 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 -- 172.21.15.12:0/3823695598 shutdown_connections 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c85d0 0x7fd9580cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/3823695598 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c2a90 0x7fd958156aa0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 -- 172.21.15.12:0/3823695598 >> 172.21.15.12:0/3823695598 conn(0x7fd95806c6a0 msgr2=0x7fd95806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 -- 172.21.15.12:0/3823695598 shutdown_connections 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.206+0000 7fd95c9fe700 1 -- 172.21.15.12:0/3823695598 wait complete. 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.207+0000 7fd95c9fe700 1 Processor -- start 2023-10-08T17:44:04.209 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.207+0000 7fd95c9fe700 1 -- start start 2023-10-08T17:44:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c2a90 0x7fd958138c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9580c8200 0x7fd9580b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 0x7fd95814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.211 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580ab740 con 0x7fd9580c85d0 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580b13b0 con 0x7fd9580c8200 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95c9fe700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9580b1690 con 0x7fd9580c2a90 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 0x7fd95814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95759e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 0x7fd95814d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54708/0 (socket says 172.21.15.12:54708) 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.208+0000 7fd95759e700 1 -- 172.21.15.12:0/2224158010 learned_addr learned my addr 172.21.15.12:0/2224158010 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd956d9d700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c2a90 0x7fd958138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95659c700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9580c8200 0x7fd9580b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 -- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c2a90 msgr2=0x7fd958138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd9580c2a90 0x7fd958138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 -- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9580c8200 msgr2=0x7fd9580b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd9580c8200 0x7fd9580b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.212 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c00b6d0 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd95759e700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 0x7fd95814d210 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fd950009df0 tx=0x7fd95000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000caa0 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.209+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd95000f040 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.210+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9580b1970 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.210+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000ce70 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.210+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9581453d0 con 0x7fd9580c85d0 2023-10-08T17:44:04.213 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.210+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9580b1e90 con 0x7fd9580c85d0 2023-10-08T17:44:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.212+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd950014690 con 0x7fd9580c85d0 2023-10-08T17:44:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.212+0000 7fd93effd700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd9500856c0 con 0x7fd9580c85d0 2023-10-08T17:44:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd956d9d700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd944066f30 0x7fd9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.214 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd93effd700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fd94406d6d0 0x7fd94406fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd944070170 con 0x7fd94406d6d0 2023-10-08T17:44:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9500859b0 con 0x7fd9580c85d0 2023-10-08T17:44:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd95659c700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fd94406d6d0 0x7fd94406fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.213+0000 7fd956d9d700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd948007fd0 tx=0x7fd948009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.215 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.214+0000 7fd95659c700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fd94406d6d0 0x7fd94406fb40 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.216 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.214+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== osd.3 v2:172.21.15.12:6808/115684 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd944070170 con 0x7fd94406d6d0 2023-10-08T17:44:04.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.229+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 --> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd95804c3c0 con 0x7fd94406d6d0 2023-10-08T17:44:04.230 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.229+0000 7fd93effd700 1 -- 172.21.15.12:0/2224158010 <== osd.3 v2:172.21.15.12:6808/115684 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd95804c3c0 con 0x7fd94406d6d0 2023-10-08T17:44:04.231 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:04.231 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:04.231 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fd94406d6d0 msgr2=0x7fd94406fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6808/115684,v1:172.21.15.12:6809/115684] conn(0x7fd94406d6d0 0x7fd94406fb40 crc :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd944066f30 msgr2=0x7fd9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd944066f30 0x7fd9440693e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd948007fd0 tx=0x7fd948009040 comp rx=0 tx=0).stop 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 msgr2=0x7fd95814d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 --2- 172.21.15.12:0/2224158010 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd9580c85d0 0x7fd95814d210 secure :-1 s=READY pgs=2061 cs=0 l=1 rev1=1 crypto rx=0x7fd950009df0 tx=0x7fd95000b040 comp rx=0 tx=0).stop 2023-10-08T17:44:04.232 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95759e700 1 -- 172.21.15.12:0/2224158010 reap_dead start 2023-10-08T17:44:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 shutdown_connections 2023-10-08T17:44:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 >> 172.21.15.12:0/2224158010 conn(0x7fd95806c6a0 msgr2=0x7fd95814fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 shutdown_connections 2023-10-08T17:44:04.233 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.230+0000 7fd95c9fe700 1 -- 172.21.15.12:0/2224158010 wait complete. 2023-10-08T17:44:04.248 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-08T17:44:04.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.434+0000 7f8194d9d700 1 Processor -- start 2023-10-08T17:44:04.436 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.435+0000 7f8194d9d700 1 -- start start 2023-10-08T17:44:04.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f8194d9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f819013fb20 0x7f819015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f8194d9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819015ae70 con 0x7f819013fef0 2023-10-08T17:44:04.437 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f8194d9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819006af60 con 0x7f819006aaa0 2023-10-08T17:44:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f8194d9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819006b240 con 0x7f819013fb20 2023-10-08T17:44:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f818f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f819013fb20 0x7f819015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f818f7fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f819013fb20 0x7f819015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54720/0 (socket says 172.21.15.12:54720) 2023-10-08T17:44:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f818f7fe700 1 -- 172.21.15.12:0/1593797403 learned_addr learned my addr 172.21.15.12:0/1593797403 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:04.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.436+0000 7f818effd700 1 --1- 172.21.15.12:0/1593797403 >> v1:172.21.15.12:6789/0 conn(0x7f819013fef0 0x7f81900c7990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50778/0 (socket says 172.21.15.12:50778) 2023-10-08T17:44:04.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818f7fe700 1 -- 172.21.15.12:0/1593797403 >> v1:172.21.15.29:6789/0 conn(0x7f819006aaa0 legacy=0x7f81900c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.439 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818f7fe700 1 -- 172.21.15.12:0/1593797403 >> v1:172.21.15.12:6789/0 conn(0x7f819013fef0 legacy=0x7f81900c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818f7fe700 1 -- 172.21.15.12:0/1593797403 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819006b520 con 0x7f819013fb20 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818f7fe700 1 --2- 172.21.15.12:0/1593797403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819013fb20 0x7f819015a930 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f818000bc50 tx=0x7f818000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec6ffcaba6c397f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818e7fc700 1 -- 172.21.15.12:0/1593797403 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818000be60 con 0x7f819013fb20 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818e7fc700 1 -- 172.21.15.12:0/1593797403 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818000de00 con 0x7f819013fb20 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.437+0000 7f818e7fc700 1 -- 172.21.15.12:0/1593797403 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800196b0 con 0x7f819013fb20 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 -- 172.21.15.12:0/1593797403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819013fb20 msgr2=0x7f819015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 --2- 172.21.15.12:0/1593797403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819013fb20 0x7f819015a930 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f818000bc50 tx=0x7f818000b4f0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 -- 172.21.15.12:0/1593797403 shutdown_connections 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 --2- 172.21.15.12:0/1593797403 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819013fb20 0x7f819015a930 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 -- 172.21.15.12:0/1593797403 >> 172.21.15.12:0/1593797403 conn(0x7f819006d170 msgr2=0x7f81900cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.440 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 -- 172.21.15.12:0/1593797403 shutdown_connections 2023-10-08T17:44:04.441 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.438+0000 7f8194d9d700 1 -- 172.21.15.12:0/1593797403 wait complete. 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.439+0000 7f8194d9d700 1 Processor -- start 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.439+0000 7f8194d9d700 1 -- start start 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 0x7f8190158f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f819013fef0 0x7f81901594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81900afb70 con 0x7f819006aaa0 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81900afe50 con 0x7f819013fef0 2023-10-08T17:44:04.443 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.440+0000 7f8194d9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81900b0130 con 0x7f819013fb20 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54724/0 (socket says 172.21.15.12:54724) 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 -- 172.21.15.12:0/3498138576 learned_addr learned my addr 172.21.15.12:0/3498138576 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818ffff700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f819013fef0 0x7f81901594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818effd700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 0x7f8190158f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 -- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 msgr2=0x7f8190158f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 0x7f8190158f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 -- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f819013fef0 msgr2=0x7f81901594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f819013fef0 0x7f81901594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 -- 172.21.15.12:0/3498138576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818000b790 con 0x7f819006aaa0 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818effd700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 0x7f8190158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:44:04.444 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f818f7fe700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f8190071320 tx=0x7f818001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81800108d0 con 0x7f819006aaa0 2023-10-08T17:44:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.441+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8180010a50 con 0x7f819006aaa0 2023-10-08T17:44:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.442+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81900b0410 con 0x7f819006aaa0 2023-10-08T17:44:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.442+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8180010e10 con 0x7f819006aaa0 2023-10-08T17:44:04.445 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.442+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819016ad40 con 0x7f819006aaa0 2023-10-08T17:44:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.443+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819004c3c0 con 0x7f819006aaa0 2023-10-08T17:44:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.444+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81800183e0 con 0x7f819006aaa0 2023-10-08T17:44:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.444+0000 7f81777fe700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.445+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8180014070 con 0x7f819006aaa0 2023-10-08T17:44:04.446 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.445+0000 7f818effd700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.447 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.445+0000 7f818effd700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 0x7f817c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f81900b0c30 tx=0x7f8184009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.450 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.449+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8180053290 con 0x7f819006aaa0 2023-10-08T17:44:04.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.648+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f819006b800 con 0x7f817c066f30 2023-10-08T17:44:04.650 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.649+0000 7f81777fe700 1 -- 172.21.15.12:0/3498138576 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f819006b800 con 0x7f817c066f30 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 msgr2=0x7f817c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 0x7f817c0693e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f81900b0c30 tx=0x7f8184009040 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 msgr2=0x7f819016a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 secure :-1 s=READY pgs=2064 cs=0 l=1 rev1=1 crypto rx=0x7f8190071320 tx=0x7f818001b000 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 shutdown_connections 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f817c066f30 0x7f817c0693e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f819006aaa0 0x7f819016a800 unknown :-1 s=CLOSED pgs=2064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f819013fef0 0x7f81901594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 --2- 172.21.15.12:0/3498138576 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f819013fb20 0x7f8190158f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.653 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 >> 172.21.15.12:0/3498138576 conn(0x7f819006d170 msgr2=0x7f819013eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.651+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 shutdown_connections 2023-10-08T17:44:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.652+0000 7f8194d9d700 1 -- 172.21.15.12:0/3498138576 wait complete. 2023-10-08T17:44:04.654 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 3 to deep-scrub 2023-10-08T17:44:04.670 INFO:tasks.ceph:Scrubbing osd.4 2023-10-08T17:44:04.670 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:04.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.860+0000 7f812a99d700 1 Processor -- start 2023-10-08T17:44:04.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.861+0000 7f812a99d700 1 -- start start 2023-10-08T17:44:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c2a90 0x7f8124156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a99d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f81240c85d0 0x7f81240cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a99d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81241579b0 con 0x7f81240c8200 2023-10-08T17:44:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a99d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240c1390 con 0x7f81240c85d0 2023-10-08T17:44:04.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81241573f0 con 0x7f81240c2a90 2023-10-08T17:44:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812999b700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f81240c8200 0x7f81240c1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50794/0 (socket says 172.21.15.12:50794) 2023-10-08T17:44:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812999b700 1 -- 172.21.15.12:0/1948811650 learned_addr learned my addr 172.21.15.12:0/1948811650 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:04.864 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.862+0000 7f812a19c700 1 --2- 172.21.15.12:0/1948811650 >> v2:172.21.15.12:3300/0 conn(0x7f81240c85d0 0x7f81240cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812919a700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c2a90 0x7f8124156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f8128999700 1 -- 172.21.15.12:0/1948811650 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640718946 0 0) 0x7f81241579b0 con 0x7f81240c8200 2023-10-08T17:44:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f8128999700 1 -- 172.21.15.12:0/1948811650 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8110003570 con 0x7f81240c8200 2023-10-08T17:44:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812a19c700 1 -- 172.21.15.12:0/1948811650 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c2a90 msgr2=0x7f8124156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:04.865 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812a19c700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c2a90 0x7f8124156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812a19c700 1 -- 172.21.15.12:0/1948811650 >> v1:172.21.15.12:6789/0 conn(0x7f81240c8200 legacy=0x7f81240c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812a19c700 1 -- 172.21.15.12:0/1948811650 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81241576d0 con 0x7f81240c85d0 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f812a19c700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c85d0 0x7f81240cc2f0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e60 tx=0x7f811c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=791b05f055db8d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f8128999700 1 -- 172.21.15.12:0/1948811650 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00e070 con 0x7f81240c85d0 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f8128999700 1 -- 172.21.15.12:0/1948811650 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00bb60 con 0x7f81240c85d0 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.863+0000 7f8128999700 1 -- 172.21.15.12:0/1948811650 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c012430 con 0x7f81240c85d0 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 -- 172.21.15.12:0/1948811650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c85d0 msgr2=0x7f81240cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c85d0 0x7f81240cc2f0 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f811c009e60 tx=0x7f811c009780 comp rx=0 tx=0).stop 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 -- 172.21.15.12:0/1948811650 shutdown_connections 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c85d0 0x7f81240cc2f0 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 --2- 172.21.15.12:0/1948811650 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c2a90 0x7f8124156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.866 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 -- 172.21.15.12:0/1948811650 >> 172.21.15.12:0/1948811650 conn(0x7f812406c6a0 msgr2=0x7f812406caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 -- 172.21.15.12:0/1948811650 shutdown_connections 2023-10-08T17:44:04.867 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.864+0000 7f812a99d700 1 -- 172.21.15.12:0/1948811650 wait complete. 2023-10-08T17:44:04.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.865+0000 7f812a99d700 1 Processor -- start 2023-10-08T17:44:04.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.866+0000 7f812a99d700 1 -- start start 2023-10-08T17:44:04.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.866+0000 7f812a99d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 0x7f81240ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.868 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.866+0000 7f812a99d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c8200 0x7f81240abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.866+0000 7f812a99d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81240c85d0 0x7f812413b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812a99d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240ad830 con 0x7f81240c2a90 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812a99d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240acc20 con 0x7f81240c85d0 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812a99d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240acf00 con 0x7f81240c8200 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 0x7f81240ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 0x7f81240ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54746/0 (socket says 172.21.15.12:54746) 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 -- 172.21.15.12:0/3606653378 learned_addr learned my addr 172.21.15.12:0/3606653378 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812919a700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c8200 0x7f81240abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812a19c700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81240c85d0 0x7f812413b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 -- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c8200 msgr2=0x7f81240abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f81240c8200 0x7f81240abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.869 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 -- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81240c85d0 msgr2=0x7f812413b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f81240c85d0 0x7f812413b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c009a20 con 0x7f81240c2a90 2023-10-08T17:44:04.870 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.867+0000 7f812999b700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 0x7f81240ac640 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f812000c7c0 tx=0x7f8120007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.868+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120005b30 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.868+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120005cb0 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.868+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120007320 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.868+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81240ad1e0 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.868+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81240ac350 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.869+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f812404c3c0 con 0x7f81240c2a90 2023-10-08T17:44:04.871 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.870+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f812001b3b0 con 0x7f81240c2a90 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f8119ffb700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8108066fb0 0x7f8108069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8120083c10 con 0x7f81240c2a90 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f812919a700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8108066fb0 0x7f8108069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f8119ffb700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f810806d750 0x7f810806fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f81080701f0 con 0x7f810806d750 2023-10-08T17:44:04.872 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81200881a0 con 0x7f81240c2a90 2023-10-08T17:44:04.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f812a19c700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f810806d750 0x7f810806fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:04.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.871+0000 7f812919a700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8108066fb0 0x7f8108069460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81240c4fa0 tx=0x7f8114008040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.873 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.872+0000 7f812a19c700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f810806d750 0x7f810806fbc0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:04.874 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.873+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== osd.4 v2:172.21.15.29:6801/114126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f81080701f0 con 0x7f810806d750 2023-10-08T17:44:04.888 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.887+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 --> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81240c2280 con 0x7f810806d750 2023-10-08T17:44:04.889 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f8119ffb700 1 -- 172.21.15.12:0/3606653378 <== osd.4 v2:172.21.15.29:6801/114126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f81240c2280 con 0x7f810806d750 2023-10-08T17:44:04.889 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:04.889 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:04.889 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f810806d750 msgr2=0x7f810806fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.29:6801/114126,v1:172.21.15.29:6803/114126] conn(0x7f810806d750 0x7f810806fbc0 crc :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8108066fb0 msgr2=0x7f8108069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8108066fb0 0x7f8108069460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f81240c4fa0 tx=0x7f8114008040 comp rx=0 tx=0).stop 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 msgr2=0x7f81240ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:04.890 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 --2- 172.21.15.12:0/3606653378 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f81240c2a90 0x7f81240ac640 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f812000c7c0 tx=0x7f8120007e00 comp rx=0 tx=0).stop 2023-10-08T17:44:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a19c700 1 -- 172.21.15.12:0/3606653378 reap_dead start 2023-10-08T17:44:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 shutdown_connections 2023-10-08T17:44:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.888+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 >> 172.21.15.12:0/3606653378 conn(0x7f812406c6a0 msgr2=0x7f81240c8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.889+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 shutdown_connections 2023-10-08T17:44:04.891 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:04.889+0000 7f812a99d700 1 -- 172.21.15.12:0/3606653378 wait complete. 2023-10-08T17:44:04.906 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-08T17:44:05.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.094+0000 7efc7ffff700 1 Processor -- start 2023-10-08T17:44:05.095 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.094+0000 7efc7ffff700 1 -- start start 2023-10-08T17:44:05.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc80153c30 0x7efc8015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.096 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7ffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc8015de50 0x7efc800cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7ffff700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015afd0 con 0x7efc800cef40 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7ffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8015b2b0 con 0x7efc8015de50 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015b590 con 0x7efc80153c30 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.095+0000 7efc7e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc8015de50 0x7efc800cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7efc8015de50 0x7efc800cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54754/0 (socket says 172.21.15.12:54754) 2023-10-08T17:44:05.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 -- 172.21.15.12:0/4115460536 learned_addr learned my addr 172.21.15.12:0/4115460536 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7effd700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc80153c30 0x7efc8015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.098 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 -- 172.21.15.12:0/4115460536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc80153c30 msgr2=0x7efc8015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc80153c30 0x7efc8015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 -- 172.21.15.12:0/4115460536 >> v1:172.21.15.29:6789/0 conn(0x7efc800cef40 legacy=0x7efc8006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 -- 172.21.15.12:0/4115460536 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015b870 con 0x7efc8015de50 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.096+0000 7efc7e7fc700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc800cea00 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7efc740099b0 tx=0x7efc74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e20afa48f6bba1 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7dffb700 1 -- 172.21.15.12:0/4115460536 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400b820 con 0x7efc8015de50 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7dffb700 1 -- 172.21.15.12:0/4115460536 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400b980 con 0x7efc8015de50 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7dffb700 1 -- 172.21.15.12:0/4115460536 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400bd20 con 0x7efc8015de50 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 -- 172.21.15.12:0/4115460536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 msgr2=0x7efc800cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc800cea00 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7efc740099b0 tx=0x7efc74009250 comp rx=0 tx=0).stop 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 -- 172.21.15.12:0/4115460536 shutdown_connections 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc80153c30 0x7efc8015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.099 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 --2- 172.21.15.12:0/4115460536 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc800cea00 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 -- 172.21.15.12:0/4115460536 >> 172.21.15.12:0/4115460536 conn(0x7efc800703a0 msgr2=0x7efc800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 -- 172.21.15.12:0/4115460536 shutdown_connections 2023-10-08T17:44:05.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.097+0000 7efc7ffff700 1 -- 172.21.15.12:0/4115460536 wait complete. 2023-10-08T17:44:05.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.099+0000 7efc7ffff700 1 Processor -- start 2023-10-08T17:44:05.100 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.099+0000 7efc7ffff700 1 -- start start 2023-10-08T17:44:05.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc800cef40 0x7efc800c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 0x7efc800c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.102 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800b4430 con 0x7efc8015de50 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015e9e0 con 0x7efc80153c30 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7ffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800ca400 con 0x7efc800cef40 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7f7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54768/0 (socket says 172.21.15.12:54768) 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7f7fe700 1 -- 172.21.15.12:0/2090716203 learned_addr learned my addr 172.21.15.12:0/2090716203 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7e7fc700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 0x7efc800c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.100+0000 7efc7effd700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc800cef40 0x7efc800c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 -- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc800cef40 msgr2=0x7efc800c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc800cef40 0x7efc800c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 -- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 msgr2=0x7efc800c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 0x7efc800c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.103 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 -- 172.21.15.12:0/2090716203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740094f0 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7e7fc700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 0x7efc800c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7f7fe700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7efc7800bc30 tx=0x7efc78009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800c900 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7800caa0 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7800ce60 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800b3820 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.101+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800b3de0 con 0x7efc8015de50 2023-10-08T17:44:05.104 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.102+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800b45a0 con 0x7efc8015de50 2023-10-08T17:44:05.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.103+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc78014620 con 0x7efc8015de50 2023-10-08T17:44:05.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.104+0000 7efc66ffd700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 0x7efc6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.105 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.104+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7efc78084710 con 0x7efc8015de50 2023-10-08T17:44:05.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.105+0000 7efc7effd700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 0x7efc6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.106 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.105+0000 7efc7effd700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 0x7efc6c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc70006fd0 tx=0x7efc70008040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.109 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.108+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc780517a0 con 0x7efc8015de50 2023-10-08T17:44:05.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.313+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7efc8004c3c0 con 0x7efc6c066f30 2023-10-08T17:44:05.314 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.313+0000 7efc66ffd700 1 -- 172.21.15.12:0/2090716203 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efc8004c3c0 con 0x7efc6c066f30 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 msgr2=0x7efc6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 0x7efc6c0693e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc70006fd0 tx=0x7efc70008040 comp rx=0 tx=0).stop 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 msgr2=0x7efc8014fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 secure :-1 s=READY pgs=2069 cs=0 l=1 rev1=1 crypto rx=0x7efc7800bc30 tx=0x7efc78009820 comp rx=0 tx=0).stop 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 shutdown_connections 2023-10-08T17:44:05.317 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7efc6c066f30 0x7efc6c0693e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7efc8015de50 0x7efc8014fc40 unknown :-1 s=CLOSED pgs=2069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7efc800cef40 0x7efc800c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 --2- 172.21.15.12:0/2090716203 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7efc80153c30 0x7efc800c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 >> 172.21.15.12:0/2090716203 conn(0x7efc800703a0 msgr2=0x7efc800c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 shutdown_connections 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.316+0000 7efc7ffff700 1 -- 172.21.15.12:0/2090716203 wait complete. 2023-10-08T17:44:05.318 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 4 to deep-scrub 2023-10-08T17:44:05.335 INFO:tasks.ceph:Scrubbing osd.5 2023-10-08T17:44:05.335 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.526+0000 7fb0bd79d700 1 Processor -- start 2023-10-08T17:44:05.527 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.526+0000 7fb0bd79d700 1 -- start start 2023-10-08T17:44:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.527+0000 7fb0bd79d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0b80b24f0 0x7fb0b80b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.527+0000 7fb0bd79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.527+0000 7fb0bd79d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80b0c80 con 0x7fb0b80b28c0 2023-10-08T17:44:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.527+0000 7fb0bd79d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b80d10d0 con 0x7fb0b80b24f0 2023-10-08T17:44:05.528 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.527+0000 7fb0bd79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80b0f60 con 0x7fb0b80b1d40 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b77fe700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0b80b24f0 0x7fb0b80b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7fb0b80b24f0 0x7fb0b80b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54346/0 (socket says 172.21.15.12:54346) 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 -- 172.21.15.12:0/3734487692 learned_addr learned my addr 172.21.15.12:0/3734487692 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b77fe700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:59050/0 (socket says 172.21.15.12:59050) 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0bcf9c700 1 --1- 172.21.15.12:0/3734487692 >> v1:172.21.15.29:6789/0 conn(0x7fb0b80b28c0 0x7fb0b815d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.29:6789/0 says I am v1:172.21.15.12:53806/0 (socket says 172.21.15.12:53806) 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 -- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 msgr2=0x7fb0b81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.530 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 -- 172.21.15.12:0/3734487692 >> v1:172.21.15.29:6789/0 conn(0x7fb0b80b28c0 legacy=0x7fb0b815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b7fff700 1 -- 172.21.15.12:0/3734487692 --> v2:172.21.15.29:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b80b1240 con 0x7fb0b80b24f0 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b6ffd700 1 -- 172.21.15.12:0/3734487692 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915101426 0 0) 0x7fb0b80b0c80 con 0x7fb0b80b28c0 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.528+0000 7fb0b77fe700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b24f0 0x7fb0b80b0580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80099b0 tx=0x7fb0a8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c77925fca93b1e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0b6ffd700 1 -- 172.21.15.12:0/3734487692 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8009ea0 con 0x7fb0b80b24f0 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0b6ffd700 1 -- 172.21.15.12:0/3734487692 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800b860 con 0x7fb0b80b24f0 2023-10-08T17:44:05.531 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0b6ffd700 1 -- 172.21.15.12:0/3734487692 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800bc00 con 0x7fb0b80b24f0 2023-10-08T17:44:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0bd79d700 1 -- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b24f0 msgr2=0x7fb0b80b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.529+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b24f0 0x7fb0b80b0580 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fb0a80099b0 tx=0x7fb0a8009250 comp rx=0 tx=0).stop 2023-10-08T17:44:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 -- 172.21.15.12:0/3734487692 shutdown_connections 2023-10-08T17:44:05.532 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b24f0 0x7fb0b80b0580 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/3734487692 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b1d40 0x7fb0b81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 -- 172.21.15.12:0/3734487692 >> 172.21.15.12:0/3734487692 conn(0x7fb0b80703a0 msgr2=0x7fb0b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 -- 172.21.15.12:0/3734487692 shutdown_connections 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.530+0000 7fb0bd79d700 1 -- 172.21.15.12:0/3734487692 wait complete. 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.531+0000 7fb0bd79d700 1 Processor -- start 2023-10-08T17:44:05.533 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.531+0000 7fb0bd79d700 1 -- start start 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b1d40 0x7fb0b81540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b24f0 0x7fb0b80c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 0x7fb0b80cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80c87f0 con 0x7fb0b80b28c0 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80c8360 con 0x7fb0b80b1d40 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.532+0000 7fb0bd79d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b80c7750 con 0x7fb0b80b24f0 2023-10-08T17:44:05.535 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0bcf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 0x7fb0b80cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0bcf9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 0x7fb0b80cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54778/0 (socket says 172.21.15.12:54778) 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0bcf9c700 1 -- 172.21.15.12:0/1190672292 learned_addr learned my addr 172.21.15.12:0/1190672292 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b1d40 0x7fb0b81540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b77fe700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b24f0 0x7fb0b80c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 -- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b24f0 msgr2=0x7fb0b80c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fb0b80b24f0 0x7fb0b80c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 -- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 msgr2=0x7fb0b80cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 0x7fb0b80cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac009420 con 0x7fb0b80b1d40 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0bcf9c700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fb0b80b28c0 0x7fb0b80cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-08T17:44:05.536 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.533+0000 7fb0b7fff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b1d40 0x7fb0b81540a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8071090 tx=0x7fb0a8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.534+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8000d10 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.534+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800bbe0 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.534+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8011630 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.534+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a80094f0 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.534+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b80c7d10 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.535+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0b804c3c0 con 0x7fb0b80b1d40 2023-10-08T17:44:05.537 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.536+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0a8011a60 con 0x7fb0b80b1d40 2023-10-08T17:44:05.538 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb09ffff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb0a4066f30 0x7fb0a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fb0a8086700 con 0x7fb0b80b1d40 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb0b77fe700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb0a4066f30 0x7fb0a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb09ffff700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7fb0a406d560 0x7fb0a406f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0a4070000 con 0x7fb0a406d560 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== mon.1 v2:172.21.15.29:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0a80869f0 con 0x7fb0b80b1d40 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.537+0000 7fb0bcf9c700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7fb0a406d560 0x7fb0a406f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.539 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.538+0000 7fb0b77fe700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb0a4066f30 0x7fb0a40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80b3070 tx=0x7fb0ac0091a0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.538+0000 7fb0bcf9c700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7fb0a406d560 0x7fb0a406f9d0 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.540 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.539+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== osd.5 v2:172.21.15.29:6816/114133 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb0a4070000 con 0x7fb0a406d560 2023-10-08T17:44:05.554 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.554+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 --> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0b80aff80 con 0x7fb0a406d560 2023-10-08T17:44:05.555 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.554+0000 7fb09ffff700 1 -- 172.21.15.12:0/1190672292 <== osd.5 v2:172.21.15.29:6816/114133 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0b80aff80 con 0x7fb0a406d560 2023-10-08T17:44:05.555 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:05.556 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:05.556 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:05.556 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7fb0a406d560 msgr2=0x7fb0a406f9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:6816/114133,v1:172.21.15.29:6817/114133] conn(0x7fb0a406d560 0x7fb0a406f9d0 crc :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb0a4066f30 msgr2=0x7fb0a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fb0a4066f30 0x7fb0a40693e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb0b80b3070 tx=0x7fb0ac0091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b1d40 msgr2=0x7fb0b81540a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 --2- 172.21.15.12:0/1190672292 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fb0b80b1d40 0x7fb0b81540a0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8071090 tx=0x7fb0a8017000 comp rx=0 tx=0).stop 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bcf9c700 1 -- 172.21.15.12:0/1190672292 reap_dead start 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 shutdown_connections 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 >> 172.21.15.12:0/1190672292 conn(0x7fb0b80703a0 msgr2=0x7fb0b815b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 shutdown_connections 2023-10-08T17:44:05.557 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.555+0000 7fb0bd79d700 1 -- 172.21.15.12:0/1190672292 wait complete. 2023-10-08T17:44:05.573 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-08T17:44:05.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.760+0000 7f822f59e700 1 Processor -- start 2023-10-08T17:44:05.762 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.761+0000 7f822f59e700 1 -- start start 2023-10-08T17:44:05.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822f59e700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 0x7f82300c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822f59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823015ae70 con 0x7f823013fb20 2023-10-08T17:44:05.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822f59e700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823006af60 con 0x7f823006aaa0 2023-10-08T17:44:05.763 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823006b240 con 0x7f823013fef0 2023-10-08T17:44:05.764 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822dd9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822ed9d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 0x7f82300c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822dd9b700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3301/0 says I am v2:172.21.15.12:59070/0 (socket says 172.21.15.12:59070) 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822dd9b700 1 -- 172.21.15.12:0/1929668037 learned_addr learned my addr 172.21.15.12:0/1929668037 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.762+0000 7f822ed9d700 1 --2- 172.21.15.12:0/1929668037 >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 0x7f82300c9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.29:3300/0 says I am v2:172.21.15.12:54368/0 (socket says 172.21.15.12:54368) 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822dd9b700 1 -- 172.21.15.12:0/1929668037 >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 msgr2=0x7f82300c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822dd9b700 1 --2- 172.21.15.12:0/1929668037 >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 0x7f82300c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822dd9b700 1 -- 172.21.15.12:0/1929668037 >> v1:172.21.15.29:6789/0 conn(0x7f823013fb20 legacy=0x7f82300c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822dd9b700 1 -- 172.21.15.12:0/1929668037 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823006b520 con 0x7f823013fef0 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822dd9b700 1 --2- 172.21.15.12:0/1929668037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8224009990 tx=0x7f8224009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc1a943df9b8770 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822d59a700 1 -- 172.21.15.12:0/1929668037 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224009e80 con 0x7f823013fef0 2023-10-08T17:44:05.765 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822d59a700 1 -- 172.21.15.12:0/1929668037 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224005c10 con 0x7f823013fef0 2023-10-08T17:44:05.766 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.763+0000 7f822d59a700 1 -- 172.21.15.12:0/1929668037 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400b650 con 0x7f823013fef0 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 -- 172.21.15.12:0/1929668037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 msgr2=0x7f823015a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 --2- 172.21.15.12:0/1929668037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8224009990 tx=0x7f8224009220 comp rx=0 tx=0).stop 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 -- 172.21.15.12:0/1929668037 shutdown_connections 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 --2- 172.21.15.12:0/1929668037 >> v2:172.21.15.29:3300/0 conn(0x7f823006aaa0 0x7f82300c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 --2- 172.21.15.12:0/1929668037 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823013fef0 0x7f823015a930 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 -- 172.21.15.12:0/1929668037 >> 172.21.15.12:0/1929668037 conn(0x7f823006d170 msgr2=0x7f82300cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 -- 172.21.15.12:0/1929668037 shutdown_connections 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.764+0000 7f822f59e700 1 -- 172.21.15.12:0/1929668037 wait complete. 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.766+0000 7f822f59e700 1 Processor -- start 2023-10-08T17:44:05.767 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.766+0000 7f822f59e700 1 -- start start 2023-10-08T17:44:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823006aaa0 0x7f82300c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.769 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 0x7f82301699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823016cc60 con 0x7f823013fb20 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823016d1e0 con 0x7f823013fef0 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822f59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823013c2d0 con 0x7f823006aaa0 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54780/0 (socket says 172.21.15.12:54780) 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 -- 172.21.15.12:0/3205682987 learned_addr learned my addr 172.21.15.12:0/3205682987 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822e59c700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823006aaa0 0x7f82300c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822ed9d700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 0x7f82301699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 -- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823006aaa0 msgr2=0x7f82300c7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823006aaa0 0x7f82300c7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.770 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 -- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 msgr2=0x7f82301699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 0x7f82301699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822dd9b700 1 -- 172.21.15.12:0/3205682987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224009480 con 0x7f823013fb20 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.767+0000 7f822ed9d700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 0x7f82301699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f822dd9b700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f823006b380 tx=0x7f8224016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240062d0 con 0x7f823013fb20 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224020070 con 0x7f823013fb20 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224006660 con 0x7f823013fb20 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823013c5b0 con 0x7f823013fb20 2023-10-08T17:44:05.771 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.768+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823016ce70 con 0x7f823013fb20 2023-10-08T17:44:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.769+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823016d370 con 0x7f823013fb20 2023-10-08T17:44:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.770+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8224022030 con 0x7f823013fb20 2023-10-08T17:44:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.771+0000 7f821e7fc700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.771+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f8224086350 con 0x7f823013fb20 2023-10-08T17:44:05.772 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.771+0000 7f822e59c700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:05.773 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.772+0000 7f822e59c700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 0x7f82100693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82200039f0 tx=0x7f8220007ec0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:05.776 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.775+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82240533e0 con 0x7f823013fb20 2023-10-08T17:44:05.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.976+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f823004c3c0 con 0x7f8210066f30 2023-10-08T17:44:05.978 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.977+0000 7f821e7fc700 1 -- 172.21.15.12:0/3205682987 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f823004c3c0 con 0x7f8210066f30 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 msgr2=0x7f82100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 0x7f82100693e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f82200039f0 tx=0x7f8220007ec0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 msgr2=0x7f82300c7bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f823006b380 tx=0x7f8224016000 comp rx=0 tx=0).stop 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 shutdown_connections 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f823013fef0 0x7f82301699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f823006aaa0 0x7f82300c7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.981 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 --2- 172.21.15.12:0/3205682987 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f823013fb20 0x7f82300c7bb0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 >> 172.21.15.12:0/3205682987 conn(0x7f823006d170 msgr2=0x7f823013dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.979+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 shutdown_connections 2023-10-08T17:44:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:05.980+0000 7f822f59e700 1 -- 172.21.15.12:0/3205682987 wait complete. 2023-10-08T17:44:05.982 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 5 to deep-scrub 2023-10-08T17:44:05.998 INFO:tasks.ceph:Scrubbing osd.6 2023-10-08T17:44:05.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:06.189 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.188+0000 7f4dfffff700 1 Processor -- start 2023-10-08T17:44:06.190 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.188+0000 7f4dfffff700 1 -- start start 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.189+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e00159770 0x7f4e0006dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.189+0000 7f4dfffff700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e0006c6a0 0x7f4e000ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfffff700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0006d740 con 0x7f4e0006a330 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfffff700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e00159b40 con 0x7f4e0006c6a0 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0006cb30 con 0x7f4e00159770 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e0006c6a0 0x7f4e000ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.192 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dff7fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7f4e0006a330 0x7f4e000c7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50806/0 (socket says 172.21.15.12:50806) 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dff7fe700 1 -- 172.21.15.12:0/2111395013 learned_addr learned my addr 172.21.15.12:0/2111395013 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4e0006c6a0 0x7f4e000ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54788/0 (socket says 172.21.15.12:54788) 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfeffd700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e00159770 0x7f4e0006dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 -- 172.21.15.12:0/2111395013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e00159770 msgr2=0x7f4e0006dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e00159770 0x7f4e0006dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 -- 172.21.15.12:0/2111395013 >> v1:172.21.15.12:6789/0 conn(0x7f4e0006a330 legacy=0x7f4e000c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfe7fc700 1 -- 172.21.15.12:0/2111395013 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0006ce10 con 0x7f4e0006c6a0 2023-10-08T17:44:06.193 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.190+0000 7f4dfdffb700 1 -- 172.21.15.12:0/2111395013 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711834701 0 0) 0x7f4e0006d740 con 0x7f4e0006a330 2023-10-08T17:44:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfe7fc700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0006c6a0 0x7f4e000ca5a0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f4df40098e0 tx=0x7f4df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba5ee2026d44491 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfdffb700 1 -- 172.21.15.12:0/2111395013 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df4009e80 con 0x7f4e0006c6a0 2023-10-08T17:44:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfdffb700 1 -- 172.21.15.12:0/2111395013 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df400b860 con 0x7f4e0006c6a0 2023-10-08T17:44:06.194 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfdffb700 1 -- 172.21.15.12:0/2111395013 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df400bbe0 con 0x7f4e0006c6a0 2023-10-08T17:44:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 -- 172.21.15.12:0/2111395013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0006c6a0 msgr2=0x7f4e000ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0006c6a0 0x7f4e000ca5a0 secure :-1 s=READY pgs=2072 cs=0 l=1 rev1=1 crypto rx=0x7f4df40098e0 tx=0x7f4df40091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 -- 172.21.15.12:0/2111395013 shutdown_connections 2023-10-08T17:44:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e00159770 0x7f4e0006dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.197 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 --2- 172.21.15.12:0/2111395013 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e0006c6a0 0x7f4e000ca5a0 unknown :-1 s=CLOSED pgs=2072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.191+0000 7f4dfffff700 1 -- 172.21.15.12:0/2111395013 >> 172.21.15.12:0/2111395013 conn(0x7f4e0006e790 msgr2=0x7f4e0006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.192+0000 7f4dfffff700 1 -- 172.21.15.12:0/2111395013 shutdown_connections 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.192+0000 7f4dfffff700 1 -- 172.21.15.12:0/2111395013 wait complete. 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.193+0000 7f4dfffff700 1 Processor -- start 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.193+0000 7f4dfffff700 1 -- start start 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e0006a330 0x7f4e0014ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e0006c6a0 0x7f4e0015b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 0x7f4e0015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e00150dc0 con 0x7f4e00159770 2023-10-08T17:44:06.198 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0015d610 con 0x7f4e0006c6a0 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfffff700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0014f180 con 0x7f4e0006a330 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 0x7f4e0015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dff7fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 0x7f4e0015bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54794/0 (socket says 172.21.15.12:54794) 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dff7fe700 1 -- 172.21.15.12:0/1695683398 learned_addr learned my addr 172.21.15.12:0/1695683398 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfeffd700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e0006a330 0x7f4e0014ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.194+0000 7f4dfe7fc700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e0006c6a0 0x7f4e0015b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 -- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e0006a330 msgr2=0x7f4e0014ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4e0006a330 0x7f4e0014ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.199 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 -- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e0006c6a0 msgr2=0x7f4e0015b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4e0006c6a0 0x7f4e0015b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df4009420 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dff7fe700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 0x7f4e0015bec0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f4df800cc10 tx=0x7f4df8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800a850 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800a9d0 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800ad90 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0015cce0 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.195+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0015d2a0 con 0x7f4e00159770 2023-10-08T17:44:06.200 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.196+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e0004c3c0 con 0x7f4e00159770 2023-10-08T17:44:06.201 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.197+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df8007300 con 0x7f4e00159770 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.198+0000 7f4de6ffd700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f4df8084940 con 0x7f4e00159770 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4dfeffd700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4dec066f30 0x7f4dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4de6ffd700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7f4dec06d6d0 0x7f4dec06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4dec070170 con 0x7f4dec06d6d0 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df8089220 con 0x7f4e00159770 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.199+0000 7f4dfe7fc700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7f4dec06d6d0 0x7f4dec06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.200+0000 7f4dfeffd700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006fd0 tx=0x7f4df0008040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.202 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.200+0000 7f4dfe7fc700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7f4dec06d6d0 0x7f4dec06fb40 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.203 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.201+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== osd.6 v2:172.21.15.29:6824/114138 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4dec070170 con 0x7f4dec06d6d0 2023-10-08T17:44:06.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.216+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 --> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4e000c23d0 con 0x7f4dec06d6d0 2023-10-08T17:44:06.217 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4de6ffd700 1 -- 172.21.15.12:0/1695683398 <== osd.6 v2:172.21.15.29:6824/114138 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4e000c23d0 con 0x7f4dec06d6d0 2023-10-08T17:44:06.218 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:06.218 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:06.218 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:06.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7f4dec06d6d0 msgr2=0x7f4dec06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.29:6824/114138,v1:172.21.15.29:6825/114138] conn(0x7f4dec06d6d0 0x7f4dec06fb40 crc :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4dec066f30 msgr2=0x7f4dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4dec066f30 0x7f4dec0693e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4df0006fd0 tx=0x7f4df0008040 comp rx=0 tx=0).stop 2023-10-08T17:44:06.219 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 msgr2=0x7f4e0015bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 --2- 172.21.15.12:0/1695683398 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4e00159770 0x7f4e0015bec0 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f4df800cc10 tx=0x7f4df8001970 comp rx=0 tx=0).stop 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dff7fe700 1 -- 172.21.15.12:0/1695683398 reap_dead start 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 shutdown_connections 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 >> 172.21.15.12:0/1695683398 conn(0x7f4e0006e790 msgr2=0x7f4e000b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 shutdown_connections 2023-10-08T17:44:06.220 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.217+0000 7f4dfffff700 1 -- 172.21.15.12:0/1695683398 wait complete. 2023-10-08T17:44:06.235 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-08T17:44:06.422 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.421+0000 7f4dc0f9d700 1 Processor -- start 2023-10-08T17:44:06.423 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.421+0000 7f4dc0f9d700 1 -- start start 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dc0f9d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dbc159910 0x7f4dbc0677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dc0f9d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc068250 con 0x7f4dbc067cf0 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dc0f9d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc068530 con 0x7f4dbc159540 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dc0f9d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc068810 con 0x7f4dbc159910 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dbaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dbc159910 0x7f4dbc0677b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dbaffd700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f4dbc159910 0x7f4dbc0677b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54800/0 (socket says 172.21.15.12:54800) 2023-10-08T17:44:06.424 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dbaffd700 1 -- 172.21.15.12:0/2800970043 learned_addr learned my addr 172.21.15.12:0/2800970043 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:06.425 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dbbfff700 1 --1- 172.21.15.12:0/2800970043 >> v1:172.21.15.12:6789/0 conn(0x7f4dbc067cf0 0x7f4dbc0c6be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50818/0 (socket says 172.21.15.12:50818) 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dba7fc700 1 -- 172.21.15.12:0/2800970043 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195156435 0 0) 0x7f4dbc068250 con 0x7f4dbc067cf0 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.423+0000 7f4dbaffd700 1 -- 172.21.15.12:0/2800970043 >> v1:172.21.15.29:6789/0 conn(0x7f4dbc159540 legacy=0x7f4dbc0c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dbaffd700 1 -- 172.21.15.12:0/2800970043 >> v1:172.21.15.12:6789/0 conn(0x7f4dbc067cf0 legacy=0x7f4dbc0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dbaffd700 1 -- 172.21.15.12:0/2800970043 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc0a9ca0 con 0x7f4dbc159910 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dbaffd700 1 --2- 172.21.15.12:0/2800970043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159910 0x7f4dbc0677b0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009930 tx=0x7f4db0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ef9b5935c19aa9f server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dba7fc700 1 -- 172.21.15.12:0/2800970043 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000b7e0 con 0x7f4dbc159910 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dba7fc700 1 -- 172.21.15.12:0/2800970043 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000b940 con 0x7f4dbc159910 2023-10-08T17:44:06.426 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.424+0000 7f4dba7fc700 1 -- 172.21.15.12:0/2800970043 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000bce0 con 0x7f4dbc159910 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/2800970043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159910 msgr2=0x7f4dbc0677b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/2800970043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159910 0x7f4dbc0677b0 secure :-1 s=READY pgs=2075 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009930 tx=0x7f4db0009250 comp rx=0 tx=0).stop 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/2800970043 shutdown_connections 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/2800970043 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159910 0x7f4dbc0677b0 unknown :-1 s=CLOSED pgs=2075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/2800970043 >> 172.21.15.12:0/2800970043 conn(0x7f4dbc06f310 msgr2=0x7f4dbc0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/2800970043 shutdown_connections 2023-10-08T17:44:06.427 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.425+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/2800970043 wait complete. 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.426+0000 7f4dc0f9d700 1 Processor -- start 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.426+0000 7f4dc0f9d700 1 -- start start 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc067cf0 0x7f4dbc14d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dbc159910 0x7f4dbc169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc14ca90 con 0x7f4dbc159540 2023-10-08T17:44:06.431 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc14d050 con 0x7f4dbc067cf0 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dc0f9d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc14da20 con 0x7f4dbc159910 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.427+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54816/0 (socket says 172.21.15.12:54816) 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 -- 172.21.15.12:0/4062708929 learned_addr learned my addr 172.21.15.12:0/4062708929 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbb7fe700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc067cf0 0x7f4dbc14d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbbfff700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dbc159910 0x7f4dbc169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 -- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dbc159910 msgr2=0x7f4dbc169ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dbc159910 0x7f4dbc169ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 -- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc067cf0 msgr2=0x7f4dbc14d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc067cf0 0x7f4dbc14d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.432 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 -- 172.21.15.12:0/4062708929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00094f0 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.428+0000 7f4dbaffd700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009290 tx=0x7f4db0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.429+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db0011e20 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.429+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db001c460 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.429+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc16a960 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.429+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db001c820 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.429+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc14cce0 con 0x7f4dbc159540 2023-10-08T17:44:06.433 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.430+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc14d1c0 con 0x7f4dbc159540 2023-10-08T17:44:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.431+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4db001cc50 con 0x7f4dbc159540 2023-10-08T17:44:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.431+0000 7f4da37fe700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.432+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f4db0086ae0 con 0x7f4dbc159540 2023-10-08T17:44:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.432+0000 7f4dbb7fe700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.434 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.432+0000 7f4dbb7fe700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 0x7f4da80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc064650 tx=0x7f4dac009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.438 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.436+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4db0053b70 con 0x7f4dbc159540 2023-10-08T17:44:06.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.636+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4dbc14d1c0 con 0x7f4da8066f30 2023-10-08T17:44:06.637 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.636+0000 7f4da37fe700 1 -- 172.21.15.12:0/4062708929 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4dbc14d1c0 con 0x7f4da8066f30 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 msgr2=0x7f4da80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 0x7f4da80693e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc064650 tx=0x7f4dac009040 comp rx=0 tx=0).stop 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 msgr2=0x7f4dbc158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009290 tx=0x7f4db0016000 comp rx=0 tx=0).stop 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 shutdown_connections 2023-10-08T17:44:06.640 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f4da8066f30 0x7f4da80693e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f4dbc159910 0x7f4dbc169ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f4dbc067cf0 0x7f4dbc14d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 --2- 172.21.15.12:0/4062708929 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f4dbc159540 0x7f4dbc158580 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 >> 172.21.15.12:0/4062708929 conn(0x7f4dbc06f310 msgr2=0x7f4dbc0ca530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 shutdown_connections 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.639+0000 7f4dc0f9d700 1 -- 172.21.15.12:0/4062708929 wait complete. 2023-10-08T17:44:06.641 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 6 to deep-scrub 2023-10-08T17:44:06.657 INFO:tasks.ceph:Scrubbing osd.7 2023-10-08T17:44:06.658 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-08T17:44:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.848+0000 7fd7b579d700 1 Processor -- start 2023-10-08T17:44:06.849 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.848+0000 7fd7b579d700 1 -- start start 2023-10-08T17:44:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd7b00b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.850 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b579d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00b0c80 con 0x7fd7b00b1d40 2023-10-08T17:44:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b579d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b00b0f60 con 0x7fd7b00b24f0 2023-10-08T17:44:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00d10d0 con 0x7fd7b0159800 2023-10-08T17:44:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b4f9c700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fd7b00b1d40 0x7fd7b00b4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:50822/0 (socket says 172.21.15.12:50822) 2023-10-08T17:44:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.849+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/962397375 learned_addr learned my addr 172.21.15.12:0/962397375 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7af7fe700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd7b00b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565776804 0 0) 0x7fd7b00b0c80 con 0x7fd7b00b1d40 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd798003570 con 0x7fd7b00b1d40 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v1:172.21.15.12:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4203397186 0 0) 0x7fd798003570 con 0x7fd7b00b1d40 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 msgr2=0x7fd7b00b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd7b00b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 >> v1:172.21.15.29:6789/0 conn(0x7fd7b00b24f0 legacy=0x7fd7b01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 --> v1:172.21.15.12:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00b1240 con 0x7fd7b00b1d40 2023-10-08T17:44:06.854 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v1:172.21.15.12:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3406493599 0 0) 0x7fd7a80017f0 con 0x7fd7b00b1d40 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 >> v1:172.21.15.12:6789/0 conn(0x7fd7b00b1d40 legacy=0x7fd7b00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd798003a90 0x7fd798003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd798004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798004d50 0x7fd7980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00d10d0 con 0x7fd798003a90 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd79800bb40 con 0x7fd798004d50 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.850+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd79800bd00 con 0x7fd7b0159800 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd798003a90 0x7fd798003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7af7fe700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd798004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7b4f9c700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798004d50 0x7fd7980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.855 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 -- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 msgr2=0x7fd798004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b0159800 0x7fd798004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 -- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798004d50 msgr2=0x7fd7980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798004d50 0x7fd7980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.851+0000 7fd7affff700 1 -- 172.21.15.12:0/962397375 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798003570 con 0x7fd798003a90 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7affff700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd798003a90 0x7fd798003e60 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00019a0 tx=0x7fd7a0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564b1db161ec17d server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000c5d0 con 0x7fd798003a90 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a000c730 con 0x7fd798003a90 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7aeffd700 1 -- 172.21.15.12:0/962397375 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a000cad0 con 0x7fd798003a90 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 -- 172.21.15.12:0/962397375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd798003a90 msgr2=0x7fd798003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 --2- 172.21.15.12:0/962397375 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd798003a90 0x7fd798003e60 secure :-1 s=READY pgs=2078 cs=0 l=1 rev1=1 crypto rx=0x7fd7a00019a0 tx=0x7fd7a0007d10 comp rx=0 tx=0).stop 2023-10-08T17:44:06.856 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/962397375 reap_dead start 2023-10-08T17:44:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 -- 172.21.15.12:0/962397375 shutdown_connections 2023-10-08T17:44:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 -- 172.21.15.12:0/962397375 >> 172.21.15.12:0/962397375 conn(0x7fd7b00703a0 msgr2=0x7fd7b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 -- 172.21.15.12:0/962397375 shutdown_connections 2023-10-08T17:44:06.857 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.852+0000 7fd7b579d700 1 -- 172.21.15.12:0/962397375 wait complete. 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.854+0000 7fd7b579d700 1 Processor -- start 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.854+0000 7fd7b579d700 1 -- start start 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798003a90 0x7fd7b015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b015fce0 0x7fd7b0154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 0x7fd7b00c7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.859 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00c7690 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00c5e90 con 0x7fd798003a90 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b579d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b00c6170 con 0x7fd7b015fce0 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 0x7fd7b00c7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b4f9c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 0x7fd7b00c7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54834/0 (socket says 172.21.15.12:54834) 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/2277354861 learned_addr learned my addr 172.21.15.12:0/2277354861 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7affff700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798003a90 0x7fd7b015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.855+0000 7fd7af7fe700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b015fce0 0x7fd7b0154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b015fce0 msgr2=0x7fd7b0154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fd7b015fce0 0x7fd7b0154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798003a90 msgr2=0x7fd7b015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.860 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fd798003a90 0x7fd7b015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b00c6450 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b4f9c700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 0x7fd7b00c7150 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8000f80 tx=0x7fd7a80021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8001d90 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a800aaa0 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a800ae60 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b0160150 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.856+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b0155210 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.857+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7b004c3c0 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.861 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.858+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd7a8013600 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd797fff700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd79c066f30 0x7fd79c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.862 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fd7a8084f60 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd7affff700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd79c066f30 0x7fd79c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd797fff700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7fd79c06d6d0 0x7fd79c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd79c070170 con 0x7fd79c06d6d0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.859+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_get_version_reply(handle=1 version=218) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7a80874c0 con 0x7fd7b00c6cb0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.860+0000 7fd7affff700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd79c066f30 0x7fd79c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0008fd0 tx=0x7fd7a0015000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.860+0000 7fd7af7fe700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7fd79c06d6d0 0x7fd79c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.860+0000 7fd7af7fe700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7fd79c06d6d0 0x7fd79c06fb40 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:06.863 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.861+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== osd.7 v2:172.21.15.29:6800/114128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd79c070170 con 0x7fd79c06d6d0 2023-10-08T17:44:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.876+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 --> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7b0155210 con 0x7fd79c06d6d0 2023-10-08T17:44:06.877 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.876+0000 7fd797fff700 1 -- 172.21.15.12:0/2277354861 <== osd.7 v2:172.21.15.29:6800/114128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd7b0155210 con 0x7fd79c06d6d0 2023-10-08T17:44:06.878 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-10-08T17:44:06.878 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-08T17:44:06.878 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7fd79c06d6d0 msgr2=0x7fd79c06fb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.29:6800/114128,v1:172.21.15.29:6802/114128] conn(0x7fd79c06d6d0 0x7fd79c06fb40 crc :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd79c066f30 msgr2=0x7fd79c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fd79c066f30 0x7fd79c0693e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd7a0008fd0 tx=0x7fd7a0015000 comp rx=0 tx=0).stop 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 msgr2=0x7fd7b00c7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 --2- 172.21.15.12:0/2277354861 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fd7b00c6cb0 0x7fd7b00c7150 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7fd7a8000f80 tx=0x7fd7a80021f0 comp rx=0 tx=0).stop 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b4f9c700 1 -- 172.21.15.12:0/2277354861 reap_dead start 2023-10-08T17:44:06.879 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 shutdown_connections 2023-10-08T17:44:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 >> 172.21.15.12:0/2277354861 conn(0x7fd7b00703a0 msgr2=0x7fd7b00cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 shutdown_connections 2023-10-08T17:44:06.880 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:06.877+0000 7fd7b579d700 1 -- 172.21.15.12:0/2277354861 wait complete. 2023-10-08T17:44:06.894 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-08T17:44:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.082+0000 7f60fa59d700 1 Processor -- start 2023-10-08T17:44:07.083 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.082+0000 7f60fa59d700 1 -- start start 2023-10-08T17:44:07.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.083+0000 7f60fa59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.084 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.083+0000 7f60fa59d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60f4159920 0x7f60f40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.083+0000 7f60fa59d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40acc00 con 0x7f60f4159550 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.083+0000 7f60fa59d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40abff0 con 0x7f60f4159920 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.083+0000 7f60fa59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40ac2d0 con 0x7f60f415dfd0 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60f4159920 0x7f60f40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f60f4159920 0x7f60f40ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54836/0 (socket says 172.21.15.12:54836) 2023-10-08T17:44:07.085 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 -- 172.21.15.12:0/4130160249 learned_addr learned my addr 172.21.15.12:0/4130160249 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:07.086 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f8d9a700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 -- 172.21.15.12:0/4130160249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 msgr2=0x7f60f40aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 -- 172.21.15.12:0/4130160249 >> v1:172.21.15.29:6789/0 conn(0x7f60f4159550 legacy=0x7f60f40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 -- 172.21.15.12:0/4130160249 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40ac5b0 con 0x7f60f4159920 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f8d9a700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60f9d9c700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40ad090 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009f20 tx=0x7f60ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf5cdbe935965a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.084+0000 7f60ebfff700 1 -- 172.21.15.12:0/4130160249 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec00e070 con 0x7f60f4159920 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60ebfff700 1 -- 172.21.15.12:0/4130160249 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ec00ba80 con 0x7f60f4159920 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60ebfff700 1 -- 172.21.15.12:0/4130160249 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ec0092e0 con 0x7f60f4159920 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 -- 172.21.15.12:0/4130160249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 msgr2=0x7f60f40ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.087 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40ad090 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009f20 tx=0x7f60ec009840 comp rx=0 tx=0).stop 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 -- 172.21.15.12:0/4130160249 shutdown_connections 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40ad090 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 --2- 172.21.15.12:0/4130160249 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 -- 172.21.15.12:0/4130160249 >> 172.21.15.12:0/4130160249 conn(0x7f60f406ce80 msgr2=0x7f60f40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 -- 172.21.15.12:0/4130160249 shutdown_connections 2023-10-08T17:44:07.088 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.085+0000 7f60fa59d700 1 -- 172.21.15.12:0/4130160249 wait complete. 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.087+0000 7f60fa59d700 1 Processor -- start 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.087+0000 7f60fa59d700 1 -- start start 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4159550 0x7f60f414c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.090 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4158580 con 0x7f60f4159920 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4157970 con 0x7f60f4159550 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60fa59d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4157c50 con 0x7f60f415dfd0 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54850/0 (socket says 172.21.15.12:54850) 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 -- 172.21.15.12:0/2949625500 learned_addr learned my addr 172.21.15.12:0/2949625500 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f959b700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4159550 0x7f60f414c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f9d9c700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 -- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 msgr2=0x7f60f40c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 -- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4159550 msgr2=0x7f60f414c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4159550 0x7f60f414c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.091 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.088+0000 7f60f8d9a700 1 -- 172.21.15.12:0/2949625500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec009ae0 con 0x7f60f4159920 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60f8d9a700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f60e400d860 tx=0x7f60e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e40125f0 con 0x7f60f4159920 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4012750 con 0x7f60f4159920 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4012ad0 con 0x7f60f4159920 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f4157f30 con 0x7f60f4159920 2023-10-08T17:44:07.092 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.089+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f414c830 con 0x7f60f4159920 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.090+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f404c3c0 con 0x7f60f4159920 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.091+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60e4014430 con 0x7f60f4159920 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.092+0000 7f60e97fa700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.092+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f60e4084b60 con 0x7f60f4159920 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.092+0000 7f60f959b700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.093 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.093+0000 7f60f959b700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 0x7f60d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60f0003860 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.097 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.096+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60e4051bf0 con 0x7f60f4159920 2023-10-08T17:44:07.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.299+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f60f406e7c0 con 0x7f60d8066f30 2023-10-08T17:44:07.300 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.299+0000 7f60e97fa700 1 -- 172.21.15.12:0/2949625500 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f60f406e7c0 con 0x7f60d8066f30 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 msgr2=0x7f60d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 0x7f60d80693e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60f0003860 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 msgr2=0x7f60f40c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f60e400d860 tx=0x7f60e4008040 comp rx=0 tx=0).stop 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 shutdown_connections 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f60d8066f30 0x7f60d80693e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f60f415dfd0 0x7f60f40c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f60f4159550 0x7f60f414c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.303 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 --2- 172.21.15.12:0/2949625500 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f60f4159920 0x7f60f40c79f0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 >> 172.21.15.12:0/2949625500 conn(0x7f60f406ce80 msgr2=0x7f60f414d130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.301+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 shutdown_connections 2023-10-08T17:44:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.302+0000 7f60fa59d700 1 -- 172.21.15.12:0/2949625500 wait complete. 2023-10-08T17:44:07.304 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 7 to deep-scrub 2023-10-08T17:44:07.321 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:44:07.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.507+0000 7ff68d19d700 1 Processor -- start 2023-10-08T17:44:07.508 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.507+0000 7ff68d19d700 1 -- start start 2023-10-08T17:44:07.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff68d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff688153c30 0x7ff68815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.510 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff68d19d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff68815de50 0x7ff6880cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff68d19d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff68815afd0 con 0x7ff6880cef40 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff68d19d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff68815b2b0 con 0x7ff68815de50 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff68d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff68815b590 con 0x7ff688153c30 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff68815de50 0x7ff6880cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7ff68815de50 0x7ff6880cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54856/0 (socket says 172.21.15.12:54856) 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 -- 172.21.15.12:0/2850915733 learned_addr learned my addr 172.21.15.12:0/2850915733 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff687fff700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff688153c30 0x7ff68815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 -- 172.21.15.12:0/2850915733 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff688153c30 msgr2=0x7ff68815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff688153c30 0x7ff68815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 -- 172.21.15.12:0/2850915733 >> v1:172.21.15.29:6789/0 conn(0x7ff6880cef40 legacy=0x7ff68806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.511 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.509+0000 7ff6877fe700 1 -- 172.21.15.12:0/2850915733 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68815b870 con 0x7ff68815de50 2023-10-08T17:44:07.512 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff6877fe700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68815de50 0x7ff6880cea00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0099b0 tx=0x7ff67c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42ba5b7ca6d8321 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff686ffd700 1 -- 172.21.15.12:0/2850915733 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00b860 con 0x7ff68815de50 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff686ffd700 1 -- 172.21.15.12:0/2850915733 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c00b9c0 con 0x7ff68815de50 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff686ffd700 1 -- 172.21.15.12:0/2850915733 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c00bd60 con 0x7ff68815de50 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff68d19d700 1 -- 172.21.15.12:0/2850915733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68815de50 msgr2=0x7ff6880cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.510+0000 7ff68d19d700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68815de50 0x7ff6880cea00 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0099b0 tx=0x7ff67c009250 comp rx=0 tx=0).stop 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 -- 172.21.15.12:0/2850915733 shutdown_connections 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff688153c30 0x7ff68815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 --2- 172.21.15.12:0/2850915733 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff68815de50 0x7ff6880cea00 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.513 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 -- 172.21.15.12:0/2850915733 >> 172.21.15.12:0/2850915733 conn(0x7ff6880703a0 msgr2=0x7ff6880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:07.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 -- 172.21.15.12:0/2850915733 shutdown_connections 2023-10-08T17:44:07.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.511+0000 7ff68d19d700 1 -- 172.21.15.12:0/2850915733 wait complete. 2023-10-08T17:44:07.514 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.512+0000 7ff68d19d700 1 Processor -- start 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.512+0000 7ff68d19d700 1 -- start start 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 0x7ff6880b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815de50 0x7ff6880b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff688140eb0 con 0x7ff688153c30 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880b52f0 con 0x7ff68815de50 2023-10-08T17:44:07.516 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68d19d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6880b4250 con 0x7ff6880cef40 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff6877fe700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:54862/0 (socket says 172.21.15.12:54862) 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff6877fe700 1 -- 172.21.15.12:0/3543937493 learned_addr learned my addr 172.21.15.12:0/3543937493 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.513+0000 7ff68c99c700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815de50 0x7ff6880b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff687fff700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 0x7ff6880b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 -- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 msgr2=0x7ff6880b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 0x7ff6880b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 -- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815de50 msgr2=0x7ff6880b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815de50 0x7ff6880b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 -- 172.21.15.12:0/3543937493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0094f0 con 0x7ff688153c30 2023-10-08T17:44:07.517 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff687fff700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 0x7ff6880b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff6877fe700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7ff68806eb00 tx=0x7ff67c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c01a450 con 0x7ff688153c30 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67c01a5d0 con 0x7ff688153c30 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67c01a990 con 0x7ff688153c30 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.514+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6880b4530 con 0x7ff688153c30 2023-10-08T17:44:07.518 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.515+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6880b4af0 con 0x7ff688153c30 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.515+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff68804c3c0 con 0x7ff688153c30 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.516+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff67c01ad40 con 0x7ff688153c30 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.517+0000 7ff66ffff700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 0x7ff6740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.517+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ff67c086380 con 0x7ff688153c30 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.517+0000 7ff687fff700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 0x7ff6740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:07.519 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.518+0000 7ff687fff700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 0x7ff6740693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff678006fd0 tx=0x7ff678008040 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:07.522 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.522+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff67c053410 con 0x7ff688153c30 2023-10-08T17:44:07.718 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.717+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6880caef0 con 0x7ff674066f30 2023-10-08T17:44:07.720 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.720+0000 7ff66ffff700 1 -- 172.21.15.12:0/3543937493 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50287 (secure 0 0 0) 0x7ff6880caef0 con 0x7ff674066f30 2023-10-08T17:44:07.721 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 msgr2=0x7ff6740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 0x7ff6740693e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff678006fd0 tx=0x7ff678008040 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 msgr2=0x7ff6880b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7ff68806eb00 tx=0x7ff67c017000 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 shutdown_connections 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7ff674066f30 0x7ff6740693e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7ff68815de50 0x7ff6880b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7ff6880cef40 0x7ff6880b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 --2- 172.21.15.12:0/3543937493 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7ff688153c30 0x7ff6880b18d0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:07.724 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 >> 172.21.15.12:0/3543937493 conn(0x7ff6880703a0 msgr2=0x7ff688152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:07.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 shutdown_connections 2023-10-08T17:44:07.725 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:07.722+0000 7ff68d19d700 1 -- 172.21.15.12:0/3543937493 wait complete. 2023-10-08T17:44:07.725 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:44:07.741 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-10-08T17:44:07.225037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2462280,"kb_used_data":22536,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512440,"statfs":{"total":773094113280,"available":770572738560,"internally_reserved":0,"allocated":23076864,"data_stored":12215472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.993781"},"pg_stats":[{"pgid":"1.0","version":"216'370","reported_seq":1239,"reported_epoch":217,"state":"active+clean","last_fresh":"2023-10-08T17:43:54.222036+0000","last_change":"2023-10-08T16:09:11.986287+0000","last_active":"2023-10-08T17:43:54.222036+0000","last_peered":"2023-10-08T17:43:54.222036+0000","last_clean":"2023-10-08T17:43:54.222036+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:43:54.222036+0000","last_undegraded":"2023-10-08T17:43:54.222036+0000","last_fullsized":"2023-10-08T17:43:54.222036+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-08T16:09:10.632700+0000","last_clean_scrub_stamp":"2023-10-08T16:09:10.632700+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-09T16:28:55.523899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":370,"ondisk_log_size":370,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304636,"kb_used_data":3252,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067204,"statfs":{"total":96636764160,"available":96324816896,"internally_reserved":0,"allocated":3330048,"data_stored":1969710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.46999999999999997,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":0.92500000000000004,"5min":1.014,"15min":1.0569999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.57799999999999996,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":1.165},"last":0.51900000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.79100000000000004},"min":{"1min":0.55100000000000005,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.78900000000000003,"15min":0.80900000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.96599999999999997,"5min":1.073,"15min":1.0940000000000001},"last":0.75900000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72499999999999998,"15min":0.73799999999999999},"min":{"1min":0.55700000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93999999999999995,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.621},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.999,"5min":1,"15min":1.1319999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.505,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.94199999999999995,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.76600000000000001,"15min":0.78100000000000003},"min":{"1min":0.65800000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1,"5min":1,"15min":1.5009999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61099999999999999,"15min":0.625},"min":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.5720000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63900000000000001,"15min":0.66100000000000003},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.01,"5min":1.01,"15min":1.597},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65000000000000002,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.42599999999999999,"15min":0.41699999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.7549999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68500000000000005,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.81100000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:43:05 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.75600000000000001,"15min":0.77700000000000002},"min":{"1min":0.52500000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.681},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.72699999999999998,"15min":0.74399999999999999},"min":{"1min":0.53000000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.4570000000000001},"last":0.72399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067784,"statfs":{"total":96636764160,"available":96325410816,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75,"15min":0.748},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.748,"15min":0.753},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.996,"5min":1.083,"15min":1.083},"last":0.57199999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.435,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.879,"5min":0.95499999999999996,"15min":1.0229999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.75600000000000001,"15min":0.76700000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.59399999999999997}]},{"osd":2,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78000000000000003,"15min":0.79700000000000004},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.40100000000000002},"max":{"1min":0.91700000000000004,"5min":1.079,"15min":1.099},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.51900000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.94799999999999995,"5min":0.99099999999999999,"15min":1.796},"last":0.61599999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0189999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":0.79100000000000004},"min":{"1min":0.52200000000000002,"5min":0.499,"15min":0.48599999999999999},"max":{"1min":0.91800000000000004,"5min":1.119,"15min":1.143},"last":0.76500000000000001}]},{"osd":4,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.39600000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.495},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.58199999999999996,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":1.028,"5min":1.028,"15min":1.1200000000000001},"last":0.80400000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67800000000000005,"15min":0.66700000000000004},"min":{"1min":0.503,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.89800000000000002,"5min":0.96799999999999997,"15min":1.179},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.73599999999999999,"15min":0.73199999999999998},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.69299999999999995}]},{"osd":7,"last update":"Sun Oct 8 17:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.748,"15min":0.73899999999999999},"min":{"1min":0.51700000000000002,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.60099999999999998,"5min":0.53000000000000003,"15min":0.47399999999999998},"max":{"1min":0.97499999999999998,"5min":1.022,"15min":1.73},"last":0.76000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063688,"statfs":{"total":96636764160,"available":96321216512,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.91400000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":1.0649999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.92400000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.81999999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.2370000000000001},"last":0.56599999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.83599999999999997},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.69599999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.495},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83499999999999996,"15min":0.86099999999999999},"min":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.60299999999999998}]},{"osd":7,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.25},"last":0.755},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.871,"15min":0.89200000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.208,"5min":1.2390000000000001,"15min":1.339},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575969,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308732,"kb_used_data":3252,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063108,"statfs":{"total":96636764160,"available":96320622592,"internally_reserved":0,"allocated":3330048,"data_stored":1969710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.23699999999999999},"max":{"1min":0.63500000000000001,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.69599999999999995,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.95499999999999996},"last":0.53600000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.83399999999999996,"15min":0.93600000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73899999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.65600000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78700000000000003,"15min":0.80600000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.95699999999999996,"5min":1.0429999999999999,"15min":1.2430000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.56699999999999995,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95199999999999996,"5min":1.151,"15min":1.151},"last":0.61699999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.008,"5min":1.0669999999999999,"15min":1.1779999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48699999999999999},"max":{"1min":0.89600000000000002,"5min":1.101,"15min":1.2589999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80300000000000005,"15min":0.83599999999999997},"min":{"1min":0.59699999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93799999999999994,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.499},"max":{"1min":1.016,"5min":1.1379999999999999,"15min":1.204},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":0.96999999999999997,"5min":1.177,"15min":1.222},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.747,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.292},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312248,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059592,"statfs":{"total":96636764160,"available":96317022208,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.71699999999999997,"15min":1.032},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68200000000000005,"5min":0.79000000000000004,"15min":0.88600000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.98099999999999998},"last":0.44},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.374}]},{"osd":3,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.85299999999999998,"15min":1.327},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76800000000000002,"5min":0.93799999999999994,"15min":1.4339999999999999},"last":0.58099999999999996}]},{"osd":4,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.58299999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.999,"5min":1.157,"15min":1.3520000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0009999999999999,"5min":1.149,"15min":1.274},"last":0.503}]},{"osd":5,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.442},"max":{"1min":1.093,"5min":1.093,"15min":1.296},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3680000000000001},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.117,"15min":1.4319999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.84899999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.3819999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.177,"15min":1.4039999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.63200000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.409},"last":0.60099999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312248,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059592,"statfs":{"total":96636764160,"available":96317022208,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46300000000000002,"15min":0.48199999999999998},"min":{"1min":0.30399999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65900000000000003,"5min":0.68100000000000005,"15min":0.83399999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.38700000000000001,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.71399999999999997,"5min":0.79100000000000004,"15min":1.105},"last":0.33000000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48999999999999999,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.74199999999999999,"5min":0.748,"15min":0.83599999999999997},"last":0.432},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.55600000000000005,"15min":0.58499999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.877,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.61599999999999999,"15min":0.63600000000000001},"min":{"1min":0.40300000000000002,"5min":0.39000000000000001,"15min":0.38300000000000001},"max":{"1min":0.79100000000000004,"5min":1,"15min":1},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67200000000000004,"15min":0.70099999999999996},"min":{"1min":0.47499999999999998,"5min":0.46999999999999997,"15min":0.38800000000000001},"max":{"1min":0.91900000000000004,"5min":1.1040000000000001,"15min":1.125},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46000000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.29},"last":0.622},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79500000000000004,"15min":0.81100000000000005},"min":{"1min":0.58399999999999996,"5min":0.53600000000000003,"15min":0.51400000000000001},"max":{"1min":0.999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.82099999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.55500000000000005},"max":{"1min":1.0760000000000001,"5min":1.248,"15min":1.248},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80900000000000005,"15min":0.82399999999999995},"min":{"1min":0.60699999999999998,"5min":0.55500000000000005,"15min":0.54600000000000004},"max":{"1min":1.135,"5min":1.2130000000000001,"15min":1.276},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.83399999999999996,"15min":0.84699999999999998},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.1579999999999999,"5min":1.1759999999999999,"15min":1.2450000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.89700000000000002},"min":{"1min":0.66100000000000003,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.117,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:43:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.87,"15min":0.89000000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1890000000000001,"5min":1.194,"15min":1.4530000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85999999999999999,"15min":0.88200000000000001},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.58899999999999997},"max":{"1min":1.1000000000000001,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.72399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575970,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063688,"statfs":{"total":96636764160,"available":96321216512,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.55000000000000004}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":1.1499999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.53300000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.48299999999999998}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":0.622},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":0.55900000000000005}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.39900000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":0.42099999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":0.44500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067784,"statfs":{"total":96636764160,"available":96325410816,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.73999999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.57899999999999996}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.66500000000000004}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.76000000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.502},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.80900000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:44:07.745 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-08T16:09:10.632700+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=16, tm_min=9, tm_sec=10, tm_wday=6, tm_yday=281, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=8, tm_hour=17, tm_min=44, tm_sec=1, tm_wday=6, tm_yday=281, tm_isdst=0) 2023-10-08T17:44:07.745 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-08T17:44:10.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:10.734 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:27.746 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-08T17:44:27.946 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.945+0000 7f5ab919d700 1 Processor -- start 2023-10-08T17:44:27.947 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.945+0000 7f5ab919d700 1 -- start start 2023-10-08T17:44:27.948 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab919d700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ab413fef0 0x7f5ab415a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab919d700 1 --2- >> v2:172.21.15.29:3300/0 conn(0x7f5ab406aaa0 0x7f5ab40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab919d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab415ae70 con 0x7f5ab413fb20 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab919d700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab406af60 con 0x7f5ab413fef0 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab919d700 1 -- --> v2:172.21.15.29:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab406b240 con 0x7f5ab406aaa0 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ab413fef0 0x7f5ab415a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f5ab413fef0 0x7f5ab415a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60284/0 (socket says 172.21.15.12:60284) 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 -- 172.21.15.12:0/2734306863 learned_addr learned my addr 172.21.15.12:0/2734306863 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab899c700 1 --2- 172.21.15.12:0/2734306863 >> v2:172.21.15.29:3300/0 conn(0x7f5ab406aaa0 0x7f5ab40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 -- 172.21.15.12:0/2734306863 >> v2:172.21.15.29:3300/0 conn(0x7f5ab406aaa0 msgr2=0x7f5ab40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 --2- 172.21.15.12:0/2734306863 >> v2:172.21.15.29:3300/0 conn(0x7f5ab406aaa0 0x7f5ab40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:27.949 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 -- 172.21.15.12:0/2734306863 >> v1:172.21.15.29:6789/0 conn(0x7f5ab413fb20 legacy=0x7f5ab40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:27.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.947+0000 7f5ab37fe700 1 -- 172.21.15.12:0/2734306863 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab406b520 con 0x7f5ab413fef0 2023-10-08T17:44:27.950 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.948+0000 7f5ab37fe700 1 --2- 172.21.15.12:0/2734306863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab413fef0 0x7f5ab415a930 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4069d40 tx=0x7f5aa8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190a9e12abf5c5d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.948+0000 7f5ab2ffd700 1 -- 172.21.15.12:0/2734306863 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005c10 con 0x7f5ab413fef0 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.948+0000 7f5ab2ffd700 1 -- 172.21.15.12:0/2734306863 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8005d70 con 0x7f5ab413fef0 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.948+0000 7f5ab2ffd700 1 -- 172.21.15.12:0/2734306863 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8006260 con 0x7f5ab413fef0 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 -- 172.21.15.12:0/2734306863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab413fef0 msgr2=0x7f5ab415a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 --2- 172.21.15.12:0/2734306863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab413fef0 0x7f5ab415a930 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4069d40 tx=0x7f5aa8009220 comp rx=0 tx=0).stop 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 -- 172.21.15.12:0/2734306863 shutdown_connections 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 --2- 172.21.15.12:0/2734306863 >> v2:172.21.15.29:3300/0 conn(0x7f5ab406aaa0 0x7f5ab40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:27.951 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 --2- 172.21.15.12:0/2734306863 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab413fef0 0x7f5ab415a930 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:27.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 -- 172.21.15.12:0/2734306863 >> 172.21.15.12:0/2734306863 conn(0x7f5ab406d170 msgr2=0x7f5ab40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:27.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 -- 172.21.15.12:0/2734306863 shutdown_connections 2023-10-08T17:44:27.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.949+0000 7f5ab919d700 1 -- 172.21.15.12:0/2734306863 wait complete. 2023-10-08T17:44:27.952 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.950+0000 7f5ab919d700 1 Processor -- start 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.950+0000 7f5ab919d700 1 -- start start 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ab413fb20 0x7f5ab413d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ab413fef0 0x7f5ab415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4159b70 con 0x7f5ab406aaa0 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab40c3eb0 con 0x7f5ab413fef0 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab4158ad0 con 0x7f5ab413fb20 2023-10-08T17:44:27.954 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.951+0000 7f5ab3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60290/0 (socket says 172.21.15.12:60290) 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 -- 172.21.15.12:0/3524347850 learned_addr learned my addr 172.21.15.12:0/3524347850 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 -- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ab413fb20 msgr2=0x7f5ab413d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ab413fb20 0x7f5ab413d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 -- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ab413fef0 msgr2=0x7f5ab415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ab413fef0 0x7f5ab415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 -- 172.21.15.12:0/3524347850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa8009480 con 0x7f5ab406aaa0 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab3fff700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c590 tx=0x7f5aa400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4011590 con 0x7f5ab406aaa0 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa40116f0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.955 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab4158db0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.952+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4011ab0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.953+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab4159370 con 0x7f5ab406aaa0 2023-10-08T17:44:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.954+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab404c3c0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.954+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5aa401b3b0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.956 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.956+0000 7f5a9bfff700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.956+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f5aa4083ab0 con 0x7f5ab406aaa0 2023-10-08T17:44:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.956+0000 7f5ab37fe700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:27.957 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.956+0000 7f5ab37fe700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 0x7f5aa00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4069d40 tx=0x7f5aa8016000 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:27.961 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:27.960+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5aa4050b40 con 0x7f5ab406aaa0 2023-10-08T17:44:28.158 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.157+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 --> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ab415ae40 con 0x7f5aa0066f30 2023-10-08T17:44:28.160 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.159+0000 7f5a9bfff700 1 -- 172.21.15.12:0/3524347850 <== mgr.10590 v2:172.21.15.12:6836/163464 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50177 (secure 0 0 0) 0x7f5ab415ae40 con 0x7f5aa0066f30 2023-10-08T17:44:28.161 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 msgr2=0x7f5aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 0x7f5aa00693e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5ab4069d40 tx=0x7f5aa8016000 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 msgr2=0x7f5ab413dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400c590 tx=0x7f5aa400c950 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 shutdown_connections 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f5aa0066f30 0x7f5aa00693e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f5ab406aaa0 0x7f5ab413dee0 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f5ab413fef0 0x7f5ab415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 --2- 172.21.15.12:0/3524347850 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f5ab413fb20 0x7f5ab413d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.163 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.161+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 >> 172.21.15.12:0/3524347850 conn(0x7f5ab406d170 msgr2=0x7f5ab406de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:28.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.162+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 shutdown_connections 2023-10-08T17:44:28.164 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.162+0000 7f5ab919d700 1 -- 172.21.15.12:0/3524347850 wait complete. 2023-10-08T17:44:28.164 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-10-08T17:44:28.182 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-08T17:44:27.229535+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2462280,"kb_used_data":22536,"kb_used_omap":0,"kb_used_meta":2439680,"kb_avail":752512440,"statfs":{"total":773094113280,"available":770572738560,"internally_reserved":0,"allocated":23076864,"data_stored":12215472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2498232320},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002631"},"pg_stats":[{"pgid":"1.0","version":"218'371","reported_seq":1251,"reported_epoch":218,"state":"active+clean","last_fresh":"2023-10-08T17:44:07.793649+0000","last_change":"2023-10-08T17:44:07.793612+0000","last_active":"2023-10-08T17:44:07.793649+0000","last_peered":"2023-10-08T17:44:07.793649+0000","last_clean":"2023-10-08T17:44:07.793649+0000","last_became_active":"2023-10-08T16:09:11.985081+0000","last_became_peered":"2023-10-08T16:09:11.985081+0000","last_unstale":"2023-10-08T17:44:07.793649+0000","last_undegraded":"2023-10-08T17:44:07.793649+0000","last_fullsized":"2023-10-08T17:44:07.793649+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"218'371","last_scrub_stamp":"2023-10-08T17:44:07.793511+0000","last_deep_scrub":"218'371","last_deep_scrub_stamp":"2023-10-08T17:44:07.793511+0000","last_clean_scrub_stamp":"2023-10-08T17:44:07.793511+0000","objects_scrubbed":2,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T04:49:13.889308+0000","scrub_duration":0.005428988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2324,"num_read_kb":4838,"num_write":619,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":371,"ondisk_log_size":371,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304636,"kb_used_data":3252,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067204,"statfs":{"total":96636764160,"available":96324816896,"internally_reserved":0,"allocated":3330048,"data_stored":1969710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.38300000000000001},"max":{"1min":0.92600000000000005,"5min":0.93999999999999995,"15min":1.0569999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71299999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":1.165},"last":0.871}]},{"osd":1,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.747,"15min":0.78200000000000003},"min":{"1min":0.46600000000000003,"5min":0.45700000000000002,"15min":0.32800000000000001},"max":{"1min":0.96699999999999997,"5min":1.0189999999999999,"15min":1.1080000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.77200000000000002,"15min":0.80300000000000005},"min":{"1min":0.57099999999999995,"5min":0.52600000000000002,"15min":0.45200000000000001},"max":{"1min":0.94199999999999995,"5min":1.034,"15min":1.0940000000000001},"last":0.82599999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70999999999999996,"15min":0.73399999999999999},"min":{"1min":0.46200000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.96499999999999997,"5min":1.0149999999999999,"15min":1.0429999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72799999999999998,"15min":0.76200000000000001},"min":{"1min":0.49399999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92100000000000004,"5min":1,"15min":1.1319999999999999},"last":0.75800000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.71999999999999997,"15min":0.751},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89900000000000002,"5min":0.97199999999999998,"15min":1.0920000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.753,"15min":0.77500000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95299999999999996,"5min":1,"15min":1.5009999999999999},"last":0.80200000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.61499999999999999,"15min":0.626},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.92300000000000004,"5min":1.026,"15min":1.5720000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.64300000000000002,"15min":0.66200000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89700000000000002,"5min":1.01,"15min":1.597},"last":0.52500000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.41699999999999998},"max":{"1min":0.99299999999999999,"5min":1.056,"15min":1.7549999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.69099999999999995,"15min":0.71699999999999997},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.96399999999999997,"5min":1.0900000000000001,"15min":1.6299999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Sun Oct 8 17:44:05 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.76800000000000002,"15min":0.77800000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.22,"5min":1.22,"15min":1.681},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.74199999999999999,"15min":0.746},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.153,"5min":1.153,"15min":1.4570000000000001},"last":0.61899999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067784,"statfs":{"total":96636764160,"available":96325410816,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89600000000000002,"5min":1.018,"15min":1.018},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.72699999999999998,"15min":0.745},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.94799999999999995,"5min":1.083,"15min":1.083},"last":0.81999999999999995}]},{"osd":1,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.68600000000000005,"15min":0.71999999999999997},"min":{"1min":0.442,"5min":0.435,"15min":0.41799999999999998},"max":{"1min":0.90500000000000003,"5min":0.91600000000000004,"15min":1.0229999999999999},"last":0.745},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.75900000000000001},"min":{"1min":0.45300000000000001,"5min":0.438,"15min":0.41999999999999998},"max":{"1min":0.86799999999999999,"5min":1.0049999999999999,"15min":1.1040000000000001},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.748,"15min":0.78500000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.0089999999999999,"5min":1.079,"15min":1.099},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.752,"15min":0.78700000000000003},"min":{"1min":0.52500000000000002,"5min":0.438,"15min":0.438},"max":{"1min":0.85399999999999998,"5min":0.97799999999999998,"15min":1.796},"last":0.78500000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.752,"15min":0.76700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.98399999999999999,"5min":1.0449999999999999,"15min":1.159},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.88700000000000001,"5min":1.119,"15min":1.143},"last":0.86199999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.69099999999999995,"15min":0.68400000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.878,"5min":1.0509999999999999,"15min":1.1299999999999999},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.51600000000000001,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.96299999999999997,"5min":1.028,"15min":1.1200000000000001},"last":0.93799999999999994}]},{"osd":5,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.66100000000000003,"15min":0.66500000000000004},"min":{"1min":0.48799999999999999,"5min":0.42499999999999999,"15min":0.38800000000000001},"max":{"1min":0.84199999999999997,"5min":0.92600000000000005,"15min":1.179},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.54100000000000004,"5min":0.48499999999999999,"15min":0.45600000000000002},"max":{"1min":0.93500000000000005,"5min":1.0489999999999999,"15min":1.1950000000000001},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Oct 8 17:44:16 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73899999999999999,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.498,"15min":0.47299999999999998},"max":{"1min":0.872,"5min":1.0489999999999999,"15min":1.1379999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.74299999999999999,"15min":0.74399999999999999},"min":{"1min":0.499,"5min":0.499,"15min":0.47399999999999998},"max":{"1min":0.93999999999999995,"5min":0.98299999999999998,"15min":1.73},"last":0.81499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063688,"statfs":{"total":96636764160,"available":96321216512,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.32500000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.91400000000000003},"last":0.503},{"interface":"front","average":{"1min":0.499,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.32400000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.69999999999999996,"5min":0.75700000000000001,"15min":1.0649999999999999},"last":0.52000000000000002}]},{"osd":2,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.433,"5min":0.433,"15min":0.41099999999999998},"max":{"1min":0.85099999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.66000000000000003}]},{"osd":3,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.64900000000000002,"15min":0.66400000000000003},"min":{"1min":0.442,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.92400000000000004},"last":0.621},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61199999999999999,"15min":0.62},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.40300000000000002},"max":{"1min":0.85899999999999999,"5min":0.89500000000000002,"15min":1.0580000000000001},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.80400000000000005,"15min":0.83099999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.79200000000000004,"15min":0.81999999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.179,"5min":1.179,"15min":1.2370000000000001},"last":0.88100000000000001}]},{"osd":5,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.80900000000000005,"15min":0.83599999999999997},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.76500000000000001}]},{"osd":6,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.84899999999999998,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.83499999999999996,"15min":0.86099999999999999},"min":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.70099999999999996}]},{"osd":7,"last update":"Sun Oct 8 17:43:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.84599999999999997,"15min":0.875},"min":{"1min":0.58299999999999996,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.25},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.871,"15min":0.89200000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.208,"5min":1.2390000000000001,"15min":1.339},"last":0.91800000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575973,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308732,"kb_used_data":3252,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063108,"statfs":{"total":96636764160,"available":96320622592,"internally_reserved":0,"allocated":3330048,"data_stored":1969710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48599999999999999,"15min":0.49299999999999999},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.23699999999999999},"max":{"1min":0.63500000000000001,"5min":0.73999999999999999,"15min":0.92000000000000004},"last":0.379},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.56999999999999995,"15min":0.57999999999999996},"min":{"1min":0.45500000000000002,"5min":0.39700000000000002,"15min":0.34699999999999998},"max":{"1min":0.69599999999999995,"5min":0.83299999999999996,"15min":0.98999999999999999},"last":0.53700000000000003}]},{"osd":2,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.68500000000000005,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.439},{"interface":"front","average":{"1min":0.505,"5min":0.54700000000000004,"15min":0.54500000000000004},"min":{"1min":0.40799999999999997,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.95499999999999996},"last":0.58899999999999997}]},{"osd":3,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.52500000000000002,"15min":0.53500000000000003},"min":{"1min":0.35699999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71899999999999997,"5min":0.83399999999999996,"15min":0.93600000000000005},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.73899999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.78700000000000003,"15min":0.80600000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.95699999999999996,"5min":1.0429999999999999,"15min":1.2430000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.79000000000000004,"15min":0.80300000000000005},"min":{"1min":0.56699999999999995,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.95199999999999996,"5min":1.151,"15min":1.151},"last":0.76800000000000002}]},{"osd":5,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.54900000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.008,"5min":1.0669999999999999,"15min":1.1779999999999999},"last":0.747},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78000000000000003,"15min":0.81200000000000006},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.48699999999999999},"max":{"1min":0.89600000000000002,"5min":1.101,"15min":1.2589999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.80300000000000005,"15min":0.83599999999999997},"min":{"1min":0.59699999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93799999999999994,"5min":1.1519999999999999,"15min":1.1619999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.499},"max":{"1min":1.016,"5min":1.1379999999999999,"15min":1.204},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Oct 8 17:43:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.82899999999999996,"15min":0.84999999999999998},"min":{"1min":0.60499999999999998,"5min":0.57899999999999996,"15min":0.46700000000000003},"max":{"1min":0.96999999999999997,"5min":1.177,"15min":1.222},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.81799999999999995,"15min":0.84099999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.995,"5min":1.0589999999999999,"15min":1.292},"last":0.75700000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312248,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059592,"statfs":{"total":96636764160,"available":96317022208,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.35399999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.70499999999999996,"5min":0.71699999999999997,"15min":1.032},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.56899999999999995,"15min":0.58799999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68200000000000005,"5min":0.79000000000000004,"15min":0.88600000000000001},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.67300000000000004,"5min":0.82199999999999995,"15min":0.98099999999999998},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.55700000000000005,"15min":0.56399999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.73499999999999999,"5min":0.94399999999999995,"15min":0.98999999999999999},"last":0.64900000000000002}]},{"osd":3,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.71299999999999997,"5min":0.85299999999999998,"15min":1.327},"last":0.5},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.63500000000000001,"15min":0.66500000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76800000000000002,"5min":0.93799999999999994,"15min":1.4339999999999999},"last":0.66400000000000003}]},{"osd":4,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.58299999999999996,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.999,"5min":1.157,"15min":1.3520000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80600000000000005,"15min":0.81299999999999994},"min":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.49299999999999999},"max":{"1min":1.0009999999999999,"5min":1.149,"15min":1.274},"last":0.92100000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.83699999999999997,"15min":0.86299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.442},"max":{"1min":1.093,"5min":1.093,"15min":1.296},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.86099999999999999},"min":{"1min":0.52600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.3680000000000001},"last":0.95499999999999996}]},{"osd":6,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.82099999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.046,"5min":1.117,"15min":1.4319999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.84899999999999998},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58399999999999996},"max":{"1min":1.089,"5min":1.2010000000000001,"15min":1.3819999999999999},"last":0.86799999999999999}]},{"osd":7,"last update":"Sun Oct 8 17:43:40 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98199999999999998,"5min":1.177,"15min":1.4039999999999999},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.875,"15min":0.89300000000000002},"min":{"1min":0.63200000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1100000000000001,"5min":1.115,"15min":1.409},"last":0.90600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":312248,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059592,"statfs":{"total":96636764160,"available":96317022208,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.45200000000000001,"15min":0.47899999999999998},"min":{"1min":0.313,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.83399999999999996},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.502,"15min":0.52800000000000002},"min":{"1min":0.316,"5min":0.316,"15min":0.315},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":1.105},"last":0.45700000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48299999999999998,"15min":0.504},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.83599999999999997},"last":0.505},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.53700000000000003,"15min":0.57499999999999996},"min":{"1min":0.36899999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.74199999999999999,"5min":0.93799999999999994,"15min":0.95799999999999996},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.629},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.83699999999999997,"5min":1,"15min":1},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65400000000000003,"15min":0.69299999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.38800000000000001},"max":{"1min":0.90700000000000003,"5min":1.1040000000000001,"15min":1.125},"last":0.48499999999999999}]},{"osd":4,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.753,"15min":0.77400000000000002},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":1.0980000000000001,"15min":1.29},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.77400000000000002,"15min":0.80000000000000004},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.133,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.79100000000000004,"15min":0.81200000000000006},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0980000000000001,"5min":1.248,"15min":1.248},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.80100000000000005,"15min":0.81599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.208,"5min":1.2130000000000001,"15min":1.276},"last":0.56899999999999995}]},{"osd":6,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.81899999999999995,"15min":0.83899999999999997},"min":{"1min":0.53000000000000003,"5min":0.51000000000000001,"15min":0.47099999999999997},"max":{"1min":1.236,"5min":1.236,"15min":1.2450000000000001},"last":0.621},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.86899999999999999,"15min":0.88900000000000001},"min":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.29,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Oct 8 17:44:17 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.86399999999999999,"15min":0.88400000000000001},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.4530000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84899999999999998,"15min":0.876},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.58899999999999997},"max":{"1min":1.335,"5min":1.3420000000000001,"15min":1.4730000000000001},"last":0.69499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575974,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":308152,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94063688,"statfs":{"total":96636764160,"available":96321216512,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.753,"15min":0.752},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.89600000000000002,"5min":1.089,"15min":1.0900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.747,"15min":0.76200000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.95799999999999996,"5min":1.1060000000000001,"15min":1.1200000000000001},"last":0.84199999999999997}]},{"osd":1,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1,"5min":1.1339999999999999,"15min":1.169},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.75700000000000001,"15min":0.76800000000000002},"min":{"1min":0.436,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.97299999999999998,"5min":1.0509999999999999,"15min":1.079},"last":0.70599999999999996}]},{"osd":2,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.755,"15min":0.76900000000000002},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.109,"15min":1.109},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81499999999999995,"15min":0.80100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.46000000000000002},"max":{"1min":1.0529999999999999,"5min":1.0700000000000001,"15min":1.0920000000000001},"last":0.88700000000000001}]},{"osd":3,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.85899999999999999,"15min":0.83999999999999997},"min":{"1min":0.57799999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.997,"5min":1.085,"15min":1.1499999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.77300000000000002},"min":{"1min":0.56699999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.85299999999999998,"5min":0.98999999999999999,"15min":1.012},"last":0.67100000000000004}]},{"osd":5,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.66900000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.83399999999999996,"5min":1.137,"15min":1.137},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74299999999999999,"15min":0.71399999999999997},"min":{"1min":0.435,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0580000000000001,"15min":1.1759999999999999},"last":0.61199999999999999}]},{"osd":6,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68400000000000005,"15min":0.67200000000000004},"min":{"1min":0.45500000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94899999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.5},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.749,"15min":0.748},"min":{"1min":0.47899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91900000000000004,"5min":1.1000000000000001,"15min":1.121},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Oct 8 17:43:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78500000000000003},"min":{"1min":0.54500000000000004,"5min":0.53100000000000003,"15min":0.47599999999999998},"max":{"1min":0.95499999999999996,"5min":1.113,"15min":1.1160000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.753,"15min":0.751},"min":{"1min":0.51600000000000001,"5min":0.496,"15min":0.48899999999999999},"max":{"1min":0.91600000000000004,"5min":1.069,"15min":1.155},"last":0.56499999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575973,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":304056,"kb_used_data":2672,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067784,"statfs":{"total":96636764160,"available":96325410816,"internally_reserved":0,"allocated":2736128,"data_stored":1379342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.71599999999999997,"15min":0.73199999999999998},"min":{"1min":0.46000000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.87,"5min":1.097,"15min":1.097},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.97799999999999998,"5min":1.03,"15min":1.1659999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.76000000000000001,"15min":0.76900000000000002},"min":{"1min":0.63900000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":1.206},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.45500000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.998,"5min":1.016,"15min":1.151},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.748,"15min":0.78100000000000003},"min":{"1min":0.48799999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.96199999999999997,"5min":1.032,"15min":1.0840000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.73999999999999999,"15min":0.75700000000000001},"min":{"1min":0.51800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.94699999999999995,"5min":1.0449999999999999,"15min":1.131},"last":0.61699999999999999}]},{"osd":3,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.755,"15min":0.77400000000000002},"min":{"1min":0.50600000000000001,"5min":0.47799999999999998,"15min":0.47199999999999998},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.1060000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.78100000000000003,"15min":0.78800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.48799999999999999},"max":{"1min":0.94699999999999995,"5min":1.0269999999999999,"15min":1.1240000000000001},"last":0.72199999999999998}]},{"osd":4,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.625,"15min":0.63},"min":{"1min":0.41899999999999998,"5min":0.40400000000000003,"15min":0.40100000000000002},"max":{"1min":1.004,"5min":1.018,"15min":1.2749999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40200000000000002},"max":{"1min":1.0900000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.70199999999999996,"15min":0.69999999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.999,"5min":0.999,"15min":1.3049999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.72099999999999997,"15min":0.71999999999999997},"min":{"1min":0.55500000000000005,"5min":0.45700000000000002,"15min":0.41899999999999998},"max":{"1min":1.0580000000000001,"5min":1.111,"15min":1.3480000000000001},"last":0.69099999999999995}]},{"osd":7,"last update":"Sun Oct 8 17:43:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.05,"5min":1.0620000000000001,"15min":1.125},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.77800000000000002,"15min":0.78700000000000003},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.52300000000000002},"max":{"1min":1.038,"5min":1.0860000000000001,"15min":1.258},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-08T17:44:28.184 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-08T17:44:28.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.365+0000 7f2c0b59e700 1 Processor -- start 2023-10-08T17:44:28.366 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.365+0000 7f2c0b59e700 1 -- start start 2023-10-08T17:44:28.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c155890 0x7f2c0c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0b59e700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c0c155c60 0x7f2c0c06a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.369 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0b59e700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c0c0c7e70 con 0x7f2c0c06de50 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0b59e700 1 -- --> v2:172.21.15.12:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c0c06b790 con 0x7f2c0c155c60 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c06a8e0 con 0x7f2c0c155890 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c09d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c0c155c60 0x7f2c0c06a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c09d9b700 1 --2- >> v2:172.21.15.12:3300/0 conn(0x7f2c0c155c60 0x7f2c0c06a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60298/0 (socket says 172.21.15.12:60298) 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2598259213 learned_addr learned my addr 172.21.15.12:0/2598259213 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.366+0000 7f2c0a59c700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c155890 0x7f2c0c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2598259213 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c155890 msgr2=0x7f2c0c0c7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c09d9b700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c155890 0x7f2c0c0c7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2598259213 >> v1:172.21.15.29:6789/0 conn(0x7f2c0c06de50 legacy=0x7f2c0c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.370 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2598259213 --> v2:172.21.15.12:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c06ab80 con 0x7f2c0c155c60 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c0959a700 1 -- 172.21.15.12:0/2598259213 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430383870 0 0) 0x7f2c0c0c7e70 con 0x7f2c0c06de50 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c09d9b700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155c60 0x7f2c0c06a3a0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f2c000099b0 tx=0x7f2c00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d612d0378200029e server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c0959a700 1 -- 172.21.15.12:0/2598259213 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00009ea0 con 0x7f2c0c155c60 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c0959a700 1 -- 172.21.15.12:0/2598259213 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000b860 con 0x7f2c0c155c60 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.367+0000 7f2c0959a700 1 -- 172.21.15.12:0/2598259213 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000bc00 con 0x7f2c0c155c60 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2598259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155c60 msgr2=0x7f2c0c06a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155c60 0x7f2c0c06a3a0 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f2c000099b0 tx=0x7f2c00009250 comp rx=0 tx=0).stop 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2598259213 shutdown_connections 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c155890 0x7f2c0c0c7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.371 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2598259213 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155c60 0x7f2c0c06a3a0 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2598259213 >> 172.21.15.12:0/2598259213 conn(0x7f2c0c06d110 msgr2=0x7f2c0c0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:28.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2598259213 shutdown_connections 2023-10-08T17:44:28.372 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.368+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2598259213 wait complete. 2023-10-08T17:44:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.370+0000 7f2c0b59e700 1 Processor -- start 2023-10-08T17:44:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.370+0000 7f2c0b59e700 1 -- start start 2023-10-08T17:44:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c06de50 0x7f2c0c16ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.375 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 0x7f2c0c16d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c157130 con 0x7f2c0c155890 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0c6010 con 0x7f2c0c155c60 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0b59e700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c0c62b0 con 0x7f2c0c06de50 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0a59c700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c06de50 0x7f2c0c16ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60314/0 (socket says 172.21.15.12:60314) 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2145805168 learned_addr learned my addr 172.21.15.12:0/2145805168 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:28.376 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c0ad9d700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 0x7f2c0c16d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c06de50 msgr2=0x7f2c0c16ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c06de50 0x7f2c0c16ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 msgr2=0x7f2c0c16d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.371+0000 7f2c09d9b700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 0x7f2c0c16d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2c09d9b700 1 -- 172.21.15.12:0/2145805168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c000094f0 con 0x7f2c0c155890 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2c0ad9d700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 0x7f2c0c16d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2c09d9b700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0cd1c0 tx=0x7f2c00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000bbe0 con 0x7f2c0c155890 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0001a450 con 0x7f2c0c155890 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0001a7f0 con 0x7f2c0c155890 2023-10-08T17:44:28.377 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c0c157340 con 0x7f2c0c155890 2023-10-08T17:44:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.372+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c0c157900 con 0x7f2c0c155890 2023-10-08T17:44:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.373+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c0c04c3c0 con 0x7f2c0c155890 2023-10-08T17:44:28.378 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.374+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c0001abe0 con 0x7f2c0c155890 2023-10-08T17:44:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.375+0000 7f2bfa7fc700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 0x7f2bec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.375+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f2c00086030 con 0x7f2c0c155890 2023-10-08T17:44:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.375+0000 7f2c0a59c700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 0x7f2bec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.379 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.376+0000 7f2c0a59c700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 0x7f2bec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009db0 tx=0x7f2bfc0091a0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.380 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.379+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c00053160 con 0x7f2c0c155890 2023-10-08T17:44:28.581 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.580+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2c0c0ccb10 con 0x7f2c0c155890 2023-10-08T17:44:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.585+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2c0001ae90 con 0x7f2c0c155890 2023-10-08T17:44:28.586 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.585+0000 7f2bfa7fc700 1 -- 172.21.15.12:0/2145805168 <== mon.0 v2:172.21.15.12:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v76)=0 v76) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2c00056780 con 0x7f2c0c155890 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 msgr2=0x7f2bec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 0x7f2bec0693e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009db0 tx=0x7f2bfc0091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 msgr2=0x7f2c0c0c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c0cd1c0 tx=0x7f2c00017000 comp rx=0 tx=0).stop 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 shutdown_connections 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7f2bec066f30 0x7f2bec0693e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7f2c0c155c60 0x7f2c0c16d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.590 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7f2c0c06de50 0x7f2c0c16ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 --2- 172.21.15.12:0/2145805168 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7f2c0c155890 0x7f2c0c0c5ad0 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.588+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 >> 172.21.15.12:0/2145805168 conn(0x7f2c0c06d110 msgr2=0x7f2c0c0cbf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.589+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 shutdown_connections 2023-10-08T17:44:28.591 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.589+0000 7f2c0b59e700 1 -- 172.21.15.12:0/2145805168 wait complete. 2023-10-08T17:44:28.607 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-08T17:44:28.607 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-08T17:44:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.793+0000 7fdab919d700 1 Processor -- start 2023-10-08T17:44:28.795 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.794+0000 7fdab919d700 1 -- start start 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab919d700 1 -- --> v1:172.21.15.12:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40c6d50 con 0x7fdab4140e40 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab919d700 1 -- --> v1:172.21.15.29:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdab40c7030 con 0x7fdab406de50 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40c7310 con 0x7fdab4140a70 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab37fe700 1 --1- >> v1:172.21.15.12:6789/0 conn(0x7fdab4140e40 0x7fdab40c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.12:6789/0 says I am v1:172.21.15.12:33156/0 (socket says 172.21.15.12:33156) 2023-10-08T17:44:28.796 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab37fe700 1 -- 172.21.15.12:0/587061899 learned_addr learned my addr 172.21.15.12:0/587061899 (peer_addr_for_me v1:172.21.15.12:0/0) 2023-10-08T17:44:28.797 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.795+0000 7fdab3fff700 1 --2- 172.21.15.12:0/587061899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 <== mon.0 v1:172.21.15.12:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960126340 0 0) 0x7fdab40c6d50 con 0x7fdab4140e40 2023-10-08T17:44:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 --> v1:172.21.15.12:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda9c003570 con 0x7fdab4140e40 2023-10-08T17:44:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 <== mon.1 v1:172.21.15.29:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138224290 0 0) 0x7fdab40c7030 con 0x7fdab406de50 2023-10-08T17:44:28.798 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 --> v1:172.21.15.29:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab40c6d50 con 0x7fdab406de50 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab3fff700 1 -- 172.21.15.12:0/587061899 >> v1:172.21.15.29:6789/0 conn(0x7fdab406de50 legacy=0x7fdab40aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab3fff700 1 -- 172.21.15.12:0/587061899 >> v1:172.21.15.12:6789/0 conn(0x7fdab4140e40 legacy=0x7fdab40c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab3fff700 1 -- 172.21.15.12:0/587061899 --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40c75f0 con 0x7fdab4140a70 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab3fff700 1 --2- 172.21.15.12:0/587061899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40c6770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009910 tx=0x7fdaa40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee229ed98d4efdc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 <== mon.2 v2:172.21.15.29:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011630 con 0x7fdab4140a70 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 <== mon.2 v2:172.21.15.29:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdaa4011790 con 0x7fdab4140a70 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.796+0000 7fdab2ffd700 1 -- 172.21.15.12:0/587061899 <== mon.2 v2:172.21.15.29:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4011b50 con 0x7fdab4140a70 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 -- 172.21.15.12:0/587061899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 msgr2=0x7fdab40c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 --2- 172.21.15.12:0/587061899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40c6770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009910 tx=0x7fdaa40091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 -- 172.21.15.12:0/587061899 shutdown_connections 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 --2- 172.21.15.12:0/587061899 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40c6770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.799 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 -- 172.21.15.12:0/587061899 >> 172.21.15.12:0/587061899 conn(0x7fdab406d170 msgr2=0x7fdab40cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:28.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 -- 172.21.15.12:0/587061899 shutdown_connections 2023-10-08T17:44:28.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.797+0000 7fdab919d700 1 -- 172.21.15.12:0/587061899 wait complete. 2023-10-08T17:44:28.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.799+0000 7fdab919d700 1 Processor -- start 2023-10-08T17:44:28.800 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.799+0000 7fdab919d700 1 -- start start 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 --2- >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 0x7fdab40cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 --2- >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 -- --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab416ab60 con 0x7fdab4140e40 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 -- --> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab40cb540 con 0x7fdab406de50 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab919d700 1 -- --> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdab416a230 con 0x7fdab4140a70 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.803 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 --2- >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.12:3300/0 says I am v2:172.21.15.12:60328/0 (socket says 172.21.15.12:60328) 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 -- 172.21.15.12:0/3835985261 learned_addr learned my addr 172.21.15.12:0/3835985261 (peer_addr_for_me v2:172.21.15.12:0/0) 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab3fff700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 0x7fdab40cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab37fe700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 -- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 msgr2=0x7fdab40cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 -- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 msgr2=0x7fdab40cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 0x7fdab40cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab899c700 1 -- 172.21.15.12:0/3835985261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaa4009420 con 0x7fdab4140e40 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab3fff700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 0x7fdab40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.800+0000 7fdab37fe700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fdab899c700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c890 tx=0x7fdaac002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac002030 con 0x7fdab4140e40 2023-10-08T17:44:28.804 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdaac0021b0 con 0x7fdab4140e40 2023-10-08T17:44:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac012630 con 0x7fdab4140e40 2023-10-08T17:44:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab416a510 con 0x7fdab4140e40 2023-10-08T17:44:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.801+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab40c31e0 con 0x7fdab4140e40 2023-10-08T17:44:28.805 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.802+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdab416ad10 con 0x7fdab4140e40 2023-10-08T17:44:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.803+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 4 ==== mgrmap(e 114) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdaac012a20 con 0x7fdab4140e40 2023-10-08T17:44:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.804+0000 7fda9bfff700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 0x7fdaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-08T17:44:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.804+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 5 ==== osd_map(218..218 src has 1..218) v4 ==== 6018+0+0 (secure 0 0 0) 0x7fdaac084ad0 con 0x7fdab4140e40 2023-10-08T17:44:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.804+0000 7fdab3fff700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 0x7fdaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-08T17:44:28.806 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.804+0000 7fdab3fff700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 0x7fdaa00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009860 tx=0x7fdaa40091a0 comp rx=0 tx=0).ready entity=mgr.10590 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-08T17:44:28.809 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:28.808+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdaac051be0 con 0x7fdab4140e40 2023-10-08T17:44:29.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.056+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 --> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdab404c3c0 con 0x7fdab4140e40 2023-10-08T17:44:29.058 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.056+0000 7fda9bfff700 1 -- 172.21.15.12:0/3835985261 <== mon.0 v2:172.21.15.12:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+3529 (secure 0 0 0) 0x7fdaac055200 con 0x7fdab4140e40 2023-10-08T17:44:29.058 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-10-08T17:44:29.059 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":100,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6834/3677525381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6833","nonce":3677525381},{"type":"v1","addr":"172.21.15.29:6834","nonce":3677525381}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8612,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.29:6835/2407780102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.29:6832","nonce":2407780102},{"type":"v1","addr":"172.21.15.29:6835","nonce":2407780102}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":100},{"gid":9592,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6835/966134717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6834","nonce":966134717},{"type":"v1","addr":"172.21.15.12:6835","nonce":966134717}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":10266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.12:6833/3310197103","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6832","nonce":3310197103},{"type":"v1","addr":"172.21.15.12:6833","nonce":3310197103}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[]} 2023-10-08T17:44:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 msgr2=0x7fdaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 0x7fdaa00693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdaa4009860 tx=0x7fdaa40091a0 comp rx=0 tx=0).stop 2023-10-08T17:44:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 msgr2=0x7fdab4169720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-08T17:44:29.061 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00c890 tx=0x7fdaac002700 comp rx=0 tx=0).stop 2023-10-08T17:44:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 shutdown_connections 2023-10-08T17:44:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:6836/163464,v1:172.21.15.12:6837/163464] conn(0x7fdaa0066f30 0x7fdaa00693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x7fdab4140e40 0x7fdab4169720 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3300/0,v1:172.21.15.29:6789/0] conn(0x7fdab406de50 0x7fdab40cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:29.062 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 --2- 172.21.15.12:0/3835985261 >> [v2:172.21.15.29:3301/0,v1:172.21.15.29:6790/0] conn(0x7fdab4140a70 0x7fdab40cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-08T17:44:29.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 >> 172.21.15.12:0/3835985261 conn(0x7fdab406d170 msgr2=0x7fdab4069ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-08T17:44:29.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 shutdown_connections 2023-10-08T17:44:29.063 INFO:teuthology.orchestra.run.smithi012.stderr:2023-10-08T17:44:29.059+0000 7fdab919d700 1 -- 172.21.15.12:0/3835985261 wait complete. 2023-10-08T17:44:29.064 INFO:teuthology.orchestra.run.smithi012.stderr:dumped fsmap epoch 100 2023-10-08T17:44:29.078 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-08T17:44:29.078 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-08T17:44:29.079 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-08T17:44:29.079 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.092 INFO:tasks.ceph.mds.a:Stopped 2023-10-08T17:44:29.092 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-08T17:44:29.093 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.146 INFO:tasks.ceph.mds.c:Stopped 2023-10-08T17:44:29.147 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-08T17:44:29.147 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.163 INFO:tasks.ceph.mds.b:Stopped 2023-10-08T17:44:29.163 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-08T17:44:29.163 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.220 INFO:tasks.ceph.mds.d:Stopped 2023-10-08T17:44:29.220 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-08T17:44:29.220 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-08T17:44:29.221 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.274 INFO:tasks.ceph.osd.0:Stopped 2023-10-08T17:44:29.274 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-08T17:44:29.274 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.335 INFO:tasks.ceph.osd.1:Stopped 2023-10-08T17:44:29.336 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-08T17:44:29.336 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.389 INFO:tasks.ceph.osd.2:Stopped 2023-10-08T17:44:29.390 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-08T17:44:29.390 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.436 INFO:tasks.ceph.osd.3:Stopped 2023-10-08T17:44:29.437 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-08T17:44:29.437 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.493 INFO:tasks.ceph.osd.4:Stopped 2023-10-08T17:44:29.494 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-08T17:44:29.494 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.554 INFO:tasks.ceph.osd.5:Stopped 2023-10-08T17:44:29.554 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-08T17:44:29.554 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.621 INFO:tasks.ceph.osd.6:Stopped 2023-10-08T17:44:29.621 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-08T17:44:29.621 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.673 INFO:tasks.ceph.osd.7:Stopped 2023-10-08T17:44:29.673 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-08T17:44:29.674 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-08T17:44:29.674 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.742 INFO:tasks.ceph.mgr.y:Stopped 2023-10-08T17:44:29.742 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-08T17:44:29.743 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.805 INFO:tasks.ceph.mgr.x:Stopped 2023-10-08T17:44:29.806 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-08T17:44:29.806 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-08T17:44:29.806 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.837 INFO:tasks.ceph.mon.a:Stopped 2023-10-08T17:44:29.838 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-08T17:44:29.838 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.862 INFO:tasks.ceph.mon.b:Stopped 2023-10-08T17:44:29.863 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-08T17:44:29.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-08T17:44:29.928 INFO:tasks.ceph.mon.c:Stopped 2023-10-08T17:44:29.928 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-08T17:44:29.929 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T17:44:30.003 INFO:teuthology.orchestra.run.smithi012.stdout:1696782211.2099319 mon.a (mon.0) 604 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-08T17:44:30.004 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-08T17:44:30.004 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T17:44:30.079 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T17:44:30.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-08T17:44:30.225 INFO:teuthology.orchestra.run.smithi012.stdout:1696782211.2099319 mon.a (mon.0) 604 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2023-10-08T17:44:30.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:44:30.227 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-08T17:44:30.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:44:30.570 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-08T17:44:30.776 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:44:30.777 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-08T17:44:31.010 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:44:31.010 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-08T17:44:31.199 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T17:44:31.199 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-08T17:44:31.413 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T17:44:31.413 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-08T17:44:31.608 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T17:44:31.608 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-08T17:44:31.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T17:44:31.819 DEBUG:teuthology.orchestra.run.smithi029:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-08T17:44:32.002 INFO:tasks.ceph:Archiving mon data... 2023-10-08T17:44:32.004 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/data/mon.a.tgz 2023-10-08T17:44:32.004 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-10-08T17:44:32.043 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.jYWWf7H0Oj 2023-10-08T17:44:32.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.jYWWf7H0Oj 2023-10-08T17:44:32.570 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.jYWWf7H0Oj 2023-10-08T17:44:32.671 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.jYWWf7H0Oj is 3MB 2023-10-08T17:44:32.795 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.jYWWf7H0Oj 2023-10-08T17:44:32.832 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/data/mon.b.tgz 2023-10-08T17:44:32.832 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-08T17:44:32.872 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.5G6p3DJ6B9 2023-10-08T17:44:32.873 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.5G6p3DJ6B9 2023-10-08T17:44:33.447 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.5G6p3DJ6B9 2023-10-08T17:44:33.548 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.5G6p3DJ6B9 is 3MB 2023-10-08T17:44:33.680 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.5G6p3DJ6B9 2023-10-08T17:44:33.717 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/data/mon.c.tgz 2023-10-08T17:44:33.717 DEBUG:teuthology.orchestra.run.smithi029:> mktemp 2023-10-08T17:44:33.793 INFO:teuthology.orchestra.run.smithi029.stdout:/tmp/tmp.koQIUDU4Qv 2023-10-08T17:44:33.793 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.koQIUDU4Qv 2023-10-08T17:44:34.341 DEBUG:teuthology.orchestra.run.smithi029:> sudo chmod 0666 /tmp/tmp.koQIUDU4Qv 2023-10-08T17:44:34.443 DEBUG:teuthology.orchestra.remote:smithi029:/tmp/tmp.koQIUDU4Qv is 3MB 2023-10-08T17:44:34.582 DEBUG:teuthology.orchestra.run.smithi029:> rm -fr /tmp/tmp.koQIUDU4Qv 2023-10-08T17:44:34.619 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-08T17:44:34.620 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T17:44:34.624 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-08T17:44:34.722 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-08T17:44:34.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T17:44:34.726 DEBUG:teuthology.orchestra.run.smithi029:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-08T17:44:34.796 INFO:teuthology.orchestra.run.smithi029.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T17:44:34.803 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-08T17:44:34.819 INFO:tasks.ceph:Archiving crash dumps... 2023-10-08T17:44:34.821 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi012/crash 2023-10-08T17:44:34.822 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T17:44:34.884 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi029/crash 2023-10-08T17:44:34.885 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-08T17:44:34.945 INFO:tasks.ceph:Shutting down logrotate 2023-10-08T17:44:34.945 DEBUG:teuthology.orchestra.run.smithi012:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:34.950 DEBUG:teuthology.orchestra.run.smithi029:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:35.047 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:35.108 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-08T17:44:35.170 INFO:tasks.ceph:Compressing logs... 2023-10-08T17:44:35.170 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T17:44:35.175 DEBUG:teuthology.orchestra.run.smithi029:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-08T17:44:35.232 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153503.log 2023-10-08T17:44:35.233 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127052.log 2023-10-08T17:44:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153503.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153503.log.gz-5 2023-10-08T17:44:35.234 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.171375.log 2023-10-08T17:44:35.235 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164833.log 2023-10-08T17:44:35.235 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.127052.log.gz 2023-10-08T17:44:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171375.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.171375.log.gz 2023-10-08T17:44:35.236 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113917.log 2023-10-08T17:44:35.236 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158682.log 2023-10-08T17:44:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164833.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164833.log.gz 2023-10-08T17:44:35.237 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165686.log 2023-10-08T17:44:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158682.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158682.log.gz 2023-10-08T17:44:35.239 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159671.log 2023-10-08T17:44:35.239 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.120834.log 2023-10-08T17:44:35.239 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113917.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.113917.log.gz 2023-10-08T17:44:35.239 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113758.log 2023-10-08T17:44:35.240 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.3.120834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.120834.log.gz 2023-10-08T17:44:35.240 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.120457.log 2023-10-08T17:44:35.241 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113758.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.113758.log.gz 2023-10-08T17:44:35.241 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113366.log 2023-10-08T17:44:35.242 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.1.120457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.120457.log.gz 2023-10-08T17:44:35.242 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165686.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165686.log.gz 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128733.log 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159671.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159671.log.gz 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146118.log 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128733.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.128733.log.gz 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135257.log 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141993.log 2023-10-08T17:44:35.243 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146118.log.gz 2023-10-08T17:44:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135257.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135257.log.gz 2023-10-08T17:44:35.244 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122501.log 2023-10-08T17:44:35.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141993.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141993.log.gz 2023-10-08T17:44:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136223.log 2023-10-08T17:44:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122501.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122501.log.gz 2023-10-08T17:44:35.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152244.log 2023-10-08T17:44:35.246 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113366.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.113366.log.gz 2023-10-08T17:44:35.246 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-08T17:44:35.247 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T17:44:35.247 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112731.log 2023-10-08T17:44:35.247 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-08T17:44:35.247 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112731.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.112731.log.gz 2023-10-08T17:44:35.247 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-08T17:44:35.248 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136223.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.136223.log.gz 2023-10-08T17:44:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139386.log 2023-10-08T17:44:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152244.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152244.log.gz 2023-10-08T17:44:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123546.log 2023-10-08T17:44:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139386.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.139386.log.gz 2023-10-08T17:44:35.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127232.log 2023-10-08T17:44:35.251 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-08T17:44:35.251 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-08T17:44:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123546.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123546.log.gz 2023-10-08T17:44:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122491.log 2023-10-08T17:44:35.251 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127232.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.127232.log.gz 2023-10-08T17:44:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141602.log 2023-10-08T17:44:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122491.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.122491.log.gz 2023-10-08T17:44:35.252 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147751.log 2023-10-08T17:44:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141602.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141602.log.gz 2023-10-08T17:44:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168850.log 2023-10-08T17:44:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147751.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147751.log.gz 2023-10-08T17:44:35.254 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162550.log 2023-10-08T17:44:35.255 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-08T17:44:35.255 INFO:teuthology.orchestra.run.smithi029.stderr: 93.2% -- replaced with /var/log/ceph/ceph.audit.log.gz/var/log/ceph/ceph-mon.c.log: 2023-10-08T17:44:35.255 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113206.log 2023-10-08T17:44:35.256 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-08T17:44:35.256 INFO:teuthology.orchestra.run.smithi029.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T17:44:35.257 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113206.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.113206.log.gz 2023-10-08T17:44:35.257 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-08T17:44:35.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168850.log.gz 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171845.log 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162550.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.162550.log.gz 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129173.log 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171845.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171845.log.gz 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146990.log 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129173.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.129173.log.gz 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159956.log 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146990.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.146990.log.gz 2023-10-08T17:44:35.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161277.log 2023-10-08T17:44:35.260 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113553.log 2023-10-08T17:44:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159956.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159956.log.gz 2023-10-08T17:44:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159028.log 2023-10-08T17:44:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161277.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161277.log.gz 2023-10-08T17:44:35.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169678.log 2023-10-08T17:44:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159028.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159028.log.gz 2023-10-08T17:44:35.262 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141147.log 2023-10-08T17:44:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169678.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169678.log.gz 2023-10-08T17:44:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161699.log 2023-10-08T17:44:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141147.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141147.log.gz 2023-10-08T17:44:35.263 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133149.log 2023-10-08T17:44:35.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161699.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.161699.log.gz 2023-10-08T17:44:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169596.log 2023-10-08T17:44:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133149.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133149.log.gz 2023-10-08T17:44:35.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149360.log 2023-10-08T17:44:35.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169596.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169596.log.gz 2023-10-08T17:44:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144611.log 2023-10-08T17:44:35.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149360.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.149360.log.gz 2023-10-08T17:44:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160875.log 2023-10-08T17:44:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144611.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144611.log.gz 2023-10-08T17:44:35.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146924.log 2023-10-08T17:44:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160875.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160875.log.gz 2023-10-08T17:44:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172674.log 2023-10-08T17:44:35.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146924.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.146924.log.gz 2023-10-08T17:44:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153216.log 2023-10-08T17:44:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172674.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172674.log.gz 2023-10-08T17:44:35.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139885.log 2023-10-08T17:44:35.272 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153216.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.153216.log.gz 2023-10-08T17:44:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161485.log 2023-10-08T17:44:35.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139885.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139885.log.gz 2023-10-08T17:44:35.274 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173388.log 2023-10-08T17:44:35.275 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161485.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.161485.log.gz 2023-10-08T17:44:35.275 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171028.log 2023-10-08T17:44:35.275 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112490.log 2023-10-08T17:44:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173388.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173388.log.gz 2023-10-08T17:44:35.276 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140679.log 2023-10-08T17:44:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171028.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171028.log.gz 2023-10-08T17:44:35.277 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132399.log 2023-10-08T17:44:35.278 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.113553.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113553.log.gz 2023-10-08T17:44:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140679.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.140679.log.gz 2023-10-08T17:44:35.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138713.log 2023-10-08T17:44:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.132399.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.132399.log.gz 2023-10-08T17:44:35.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153546.log 2023-10-08T17:44:35.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138713.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138713.log.gz 2023-10-08T17:44:35.280 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153103.log 2023-10-08T17:44:35.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153546.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.153546.log.gz 2023-10-08T17:44:35.281 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141557.log 2023-10-08T17:44:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153103.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.153103.log.gz 2023-10-08T17:44:35.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169330.log 2023-10-08T17:44:35.283 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112939.log 2023-10-08T17:44:35.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141557.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.141557.log.gz 2023-10-08T17:44:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131107.log 2023-10-08T17:44:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169330.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.169330.log.gz 2023-10-08T17:44:35.284 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150088.log 2023-10-08T17:44:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131107.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.131107.log.gz 2023-10-08T17:44:35.285 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125729.log 2023-10-08T17:44:35.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150088.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150088.log.gz 2023-10-08T17:44:35.286 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135085.log 2023-10-08T17:44:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125729.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125729.log.gz 2023-10-08T17:44:35.287 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123714.log 2023-10-08T17:44:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135085.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.135085.log.gz 2023-10-08T17:44:35.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157728.log 2023-10-08T17:44:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123714.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123714.log.gz 2023-10-08T17:44:35.289 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171800.log 2023-10-08T17:44:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157728.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.157728.log.gz 2023-10-08T17:44:35.290 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170638.log 2023-10-08T17:44:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171800.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171800.log.gz 2023-10-08T17:44:35.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147308.log 2023-10-08T17:44:35.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170638.log.gz 2023-10-08T17:44:35.293 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112490.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.112490.log.gz 2023-10-08T17:44:35.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131649.log 2023-10-08T17:44:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147308.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147308.log.gz 2023-10-08T17:44:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156109.log 2023-10-08T17:44:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131649.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.131649.log.gz 2023-10-08T17:44:35.294 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162499.log 2023-10-08T17:44:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.156109.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.156109.log.gz 2023-10-08T17:44:35.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158426.log 2023-10-08T17:44:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162499.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162499.log.gz 2023-10-08T17:44:35.296 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172716.log 2023-10-08T17:44:35.297 INFO:teuthology.orchestra.run.smithi029.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-08T17:44:35.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158426.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158426.log.gz 2023-10-08T17:44:35.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158266.log 2023-10-08T17:44:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172716.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172716.log.gz 2023-10-08T17:44:35.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148503.log 2023-10-08T17:44:35.299 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-client.admin.112939.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112939.log.gz 2023-10-08T17:44:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158266.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158266.log.gz 2023-10-08T17:44:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135988.log 2023-10-08T17:44:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148503.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148503.log.gz 2023-10-08T17:44:35.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153061.log 2023-10-08T17:44:35.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135988.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135988.log.gz 2023-10-08T17:44:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158510.log 2023-10-08T17:44:35.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153061.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.153061.log.gz 2023-10-08T17:44:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144661.log 2023-10-08T17:44:35.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158510.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158510.log.gz 2023-10-08T17:44:35.304 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121526.log 2023-10-08T17:44:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144661.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.144661.log.gz 2023-10-08T17:44:35.305 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146581.log 2023-10-08T17:44:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121526.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121526.log.gz 2023-10-08T17:44:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151215.log 2023-10-08T17:44:35.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146581.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-08T17:44:35.307 INFO:teuthology.orchestra.run.smithi012.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.146581.log.gz 2023-10-08T17:44:35.307 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151215.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.151215.log.gz 2023-10-08T17:44:35.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134021.log 2023-10-08T17:44:35.309 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166348.log 2023-10-08T17:44:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134021.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134021.log.gz 2023-10-08T17:44:35.310 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140319.log 2023-10-08T17:44:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166348.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166348.log.gz 2023-10-08T17:44:35.311 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173136.log 2023-10-08T17:44:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140319.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.140319.log.gz 2023-10-08T17:44:35.312 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167218.log 2023-10-08T17:44:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173136.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173136.log.gz 2023-10-08T17:44:35.313 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122286.log 2023-10-08T17:44:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.167218.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.167218.log.gz 2023-10-08T17:44:35.314 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170873.log 2023-10-08T17:44:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122286.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122286.log.gz 2023-10-08T17:44:35.315 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157333.log 2023-10-08T17:44:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170873.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170873.log.gz 2023-10-08T17:44:35.316 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123924.log 2023-10-08T17:44:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157333.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157333.log.gz 2023-10-08T17:44:35.317 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130875.log 2023-10-08T17:44:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123924.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123924.log.gz 2023-10-08T17:44:35.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144849.log 2023-10-08T17:44:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130875.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130875.log.gz 2023-10-08T17:44:35.319 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143264.log 2023-10-08T17:44:35.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125349.log 2023-10-08T17:44:35.320 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144849.log.gz 2023-10-08T17:44:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143264.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.143264.log.gz 2023-10-08T17:44:35.321 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153153.log 2023-10-08T17:44:35.322 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125349.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125349.log.gz 2023-10-08T17:44:35.322 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147037.log 2023-10-08T17:44:35.323 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.153153.log.gz 2023-10-08T17:44:35.323 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129028.log 2023-10-08T17:44:35.324 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147037.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.147037.log.gz 2023-10-08T17:44:35.324 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151350.log 2023-10-08T17:44:35.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122503.log 2023-10-08T17:44:35.325 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129028.log.gz 2023-10-08T17:44:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151350.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151350.log.gz 2023-10-08T17:44:35.326 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169144.log 2023-10-08T17:44:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122503.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122503.log.gz 2023-10-08T17:44:35.327 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129087.log 2023-10-08T17:44:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169144.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169144.log.gz 2023-10-08T17:44:35.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123378.log 2023-10-08T17:44:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129087.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129087.log.gz 2023-10-08T17:44:35.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.88257.log 2023-10-08T17:44:35.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123378.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.123378.log.gz 2023-10-08T17:44:35.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172434.log 2023-10-08T17:44:35.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.tmp-client.admin.88257.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.88257.log.gz 2023-10-08T17:44:35.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134695.log 2023-10-08T17:44:35.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172434.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172434.log.gz 2023-10-08T17:44:35.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145151.log 2023-10-08T17:44:35.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134695.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134695.log.gz 2023-10-08T17:44:35.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168705.log 2023-10-08T17:44:35.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145151.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145151.log.gz 2023-10-08T17:44:35.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160473.log 2023-10-08T17:44:35.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168705.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168705.log.gz 2023-10-08T17:44:35.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140613.log 2023-10-08T17:44:35.336 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160473.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160473.log.gz 2023-10-08T17:44:35.336 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127360.log 2023-10-08T17:44:35.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157893.log 2023-10-08T17:44:35.338 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.140613.log.gz 2023-10-08T17:44:35.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127360.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127360.log.gz 2023-10-08T17:44:35.339 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143096.log 2023-10-08T17:44:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157893.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.157893.log.gz 2023-10-08T17:44:35.340 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134737.log 2023-10-08T17:44:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143096.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.143096.log.gz 2023-10-08T17:44:35.341 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173472.log 2023-10-08T17:44:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134737.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.134737.log.gz 2023-10-08T17:44:35.342 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139302.log 2023-10-08T17:44:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173472.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173472.log.gz 2023-10-08T17:44:35.343 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142714.log 2023-10-08T17:44:35.344 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139302.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139302.log.gz 2023-10-08T17:44:35.344 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140487.log 2023-10-08T17:44:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142714.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142714.log.gz 2023-10-08T17:44:35.345 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166264.log 2023-10-08T17:44:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140487.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140487.log.gz 2023-10-08T17:44:35.346 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136331.log 2023-10-08T17:44:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166264.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166264.log.gz 2023-10-08T17:44:35.352 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152718.log 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136331.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.136331.log.gz 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143968.log 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152718.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152718.log.gz 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135838.log 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143968.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.143968.log.gz 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122160.log 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135838.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.135838.log.gz 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164598.log 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122160.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122160.log.gz 2023-10-08T17:44:35.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132649.log 2023-10-08T17:44:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164598.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164598.log.gz 2023-10-08T17:44:35.354 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140065.log 2023-10-08T17:44:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.132649.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.132649.log.gz 2023-10-08T17:44:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157474.log 2023-10-08T17:44:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140065.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140065.log.gz 2023-10-08T17:44:35.355 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145585.log 2023-10-08T17:44:35.356 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157474.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157474.log.gz 2023-10-08T17:44:35.356 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152158.log 2023-10-08T17:44:35.357 INFO:teuthology.orchestra.run.smithi029.stderr:/var/log/ceph/ceph-mon.b.log: 91.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-08T17:44:35.357 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145585.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145585.log.gz 2023-10-08T17:44:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126111.log 2023-10-08T17:44:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152158.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152158.log.gz 2023-10-08T17:44:35.358 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158638.log 2023-10-08T17:44:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126111.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.126111.log.gz 2023-10-08T17:44:35.359 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125097.log 2023-10-08T17:44:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158638.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158638.log.gz 2023-10-08T17:44:35.360 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172968.log 2023-10-08T17:44:35.361 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125097.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.125097.log.gz 2023-10-08T17:44:35.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157977.log 2023-10-08T17:44:35.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172968.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.172968.log.gz 2023-10-08T17:44:35.362 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135043.log 2023-10-08T17:44:35.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168566.log 2023-10-08T17:44:35.363 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.157977.log.gz 2023-10-08T17:44:35.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135043.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135043.log.gz 2023-10-08T17:44:35.364 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151575.log 2023-10-08T17:44:35.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168566.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168566.log.gz 2023-10-08T17:44:35.365 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149063.log 2023-10-08T17:44:35.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151575.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.151575.log.gz 2023-10-08T17:44:35.366 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149871.log 2023-10-08T17:44:35.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149063.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149063.log.gz 2023-10-08T17:44:35.367 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151160.log 2023-10-08T17:44:35.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149871.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.149871.log.gz 2023-10-08T17:44:35.368 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142756.log 2023-10-08T17:44:35.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151160.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.151160.log.gz 2023-10-08T17:44:35.369 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142970.log 2023-10-08T17:44:35.371 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142756.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142756.log.gz 2023-10-08T17:44:35.371 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144350.log 2023-10-08T17:44:35.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142970.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.142970.log.gz 2023-10-08T17:44:35.372 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172758.log 2023-10-08T17:44:35.373 INFO:teuthology.orchestra.run.smithi029.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-08T17:44:35.373 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144350.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.144350.log.gz 2023-10-08T17:44:35.373 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166733.log 2023-10-08T17:44:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172758.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172758.log.gz 2023-10-08T17:44:35.374 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165255.log 2023-10-08T17:44:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166733.log.gz 2023-10-08T17:44:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148036.log 2023-10-08T17:44:35.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165255.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165255.log.gz 2023-10-08T17:44:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147082.log 2023-10-08T17:44:35.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148036.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.148036.log.gz 2023-10-08T17:44:35.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124142.log 2023-10-08T17:44:35.378 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147082.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.147082.log.gz 2023-10-08T17:44:35.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152380.log 2023-10-08T17:44:35.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.124142.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.124142.log.gz 2023-10-08T17:44:35.379 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122498.log 2023-10-08T17:44:35.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152380.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152380.log.gz 2023-10-08T17:44:35.380 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123840.log 2023-10-08T17:44:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122498.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122498.log.gz 2023-10-08T17:44:35.381 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125181.log 2023-10-08T17:44:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123840.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123840.log.gz 2023-10-08T17:44:35.382 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130233.log 2023-10-08T17:44:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125181.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125181.log.gz 2023-10-08T17:44:35.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121740.log 2023-10-08T17:44:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130233.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130233.log.gz 2023-10-08T17:44:35.384 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134485.log 2023-10-08T17:44:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121740.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.121740.log.gz 2023-10-08T17:44:35.385 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152634.log 2023-10-08T17:44:35.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134485.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134485.log.gz 2023-10-08T17:44:35.386 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162035.log 2023-10-08T17:44:35.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152634.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.152634.log.gz 2023-10-08T17:44:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165960.log 2023-10-08T17:44:35.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162035.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162035.log.gz 2023-10-08T17:44:35.389 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166138.log 2023-10-08T17:44:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165960.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165960.log.gz 2023-10-08T17:44:35.390 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123094.log 2023-10-08T17:44:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166138.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.166138.log.gz 2023-10-08T17:44:35.391 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139428.log 2023-10-08T17:44:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123094.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123094.log.gz 2023-10-08T17:44:35.392 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172842.log 2023-10-08T17:44:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139428.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139428.log.gz 2023-10-08T17:44:35.393 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135519.log 2023-10-08T17:44:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172842.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172842.log.gz 2023-10-08T17:44:35.394 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122493.log 2023-10-08T17:44:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135519.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135519.log.gz 2023-10-08T17:44:35.395 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123174.log 2023-10-08T17:44:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122493.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122493.log.gz 2023-10-08T17:44:35.396 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144520.log 2023-10-08T17:44:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123174.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123174.log.gz 2023-10-08T17:44:35.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161400.log 2023-10-08T17:44:35.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144520.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.144520.log.gz 2023-10-08T17:44:35.398 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127138.log 2023-10-08T17:44:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161400.log: gzip 88.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.161400.log.gz--verbose 2023-10-08T17:44:35.399 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.168940.log 2023-10-08T17:44:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127138.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127138.log.gz 2023-10-08T17:44:35.400 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172800.log 2023-10-08T17:44:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168940.log.gz 2023-10-08T17:44:35.401 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123966.log 2023-10-08T17:44:35.402 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172800.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172800.log.gz 2023-10-08T17:44:35.402 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152288.log 2023-10-08T17:44:35.403 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123966.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123966.log.gz 2023-10-08T17:44:35.403 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136666.log 2023-10-08T17:44:35.404 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152288.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.152288.log.gz 2023-10-08T17:44:35.404 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.0.124559.log 2023-10-08T17:44:35.405 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136666.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.136666.log.gz 2023-10-08T17:44:35.405 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142492.log 2023-10-08T17:44:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.124559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.124559.log.gz 2023-10-08T17:44:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141510.log 2023-10-08T17:44:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142492.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.142492.log.gz 2023-10-08T17:44:35.413 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135796.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141510.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.141510.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.162353.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135796.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125433.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.162353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.162353.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146286.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125433.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125433.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169204.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146286.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.146286.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169770.log 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169204.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.169204.log.gz 2023-10-08T17:44:35.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130817.log 2023-10-08T17:44:35.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169770.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169770.log.gz 2023-10-08T17:44:35.415 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-08T17:44:35.416 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130817.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.130817.log.gz 2023-10-08T17:44:35.416 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169288.log 2023-10-08T17:44:35.416 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166950.log 2023-10-08T17:44:35.417 INFO:teuthology.orchestra.run.smithi012.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-08T17:44:35.417 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169288.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169288.log.gz 2023-10-08T17:44:35.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133928.log 2023-10-08T17:44:35.418 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166950.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.166950.log.gz 2023-10-08T17:44:35.419 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126027.log 2023-10-08T17:44:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133928.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.133928.log.gz 2023-10-08T17:44:35.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121824.log 2023-10-08T17:44:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126027.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.126027.log.gz 2023-10-08T17:44:35.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127316.log 2023-10-08T17:44:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121824.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121824.log.gz 2023-10-08T17:44:35.422 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126489.log 2023-10-08T17:44:35.423 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127316.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-08T17:44:35.423 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.127316.log.gz 2023-10-08T17:44:35.423 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161909.log 2023-10-08T17:44:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126489.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.126489.log.gz 2023-10-08T17:44:35.424 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125943.log 2023-10-08T17:44:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161909.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161909.log.gz 2023-10-08T17:44:35.425 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147989.log 2023-10-08T17:44:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125943.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.125943.log.gz 2023-10-08T17:44:35.426 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156067.log 2023-10-08T17:44:35.427 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159563.log 2023-10-08T17:44:35.427 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.147989.log.gz 2023-10-08T17:44:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.156067.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156067.log.gz 2023-10-08T17:44:35.428 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148587.log 2023-10-08T17:44:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159563.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159563.log.gz 2023-10-08T17:44:35.429 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139618.log 2023-10-08T17:44:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148587.log: gzip 88.6%-5 -- replaced with /var/log/ceph/ceph-client.admin.148587.log.gz 2023-10-08T17:44:35.430 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.131399.log 2023-10-08T17:44:35.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139618.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139618.log.gz 2023-10-08T17:44:35.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161867.log 2023-10-08T17:44:35.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131399.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131399.log.gz 2023-10-08T17:44:35.432 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140958.log 2023-10-08T17:44:35.433 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161867.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161867.log.gz 2023-10-08T17:44:35.434 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168895.log 2023-10-08T17:44:35.434 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140958.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140958.log.gz 2023-10-08T17:44:35.435 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.136181.log 2023-10-08T17:44:35.435 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170530.log 2023-10-08T17:44:35.436 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.168895.log.gz 2023-10-08T17:44:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.136181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.136181.log.gz 2023-10-08T17:44:35.436 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133882.log 2023-10-08T17:44:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170530.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.170530.log.gz 2023-10-08T17:44:35.437 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165813.log 2023-10-08T17:44:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133882.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133882.log.gzgzip 2023-10-08T17:44:35.438 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.139973.log 2023-10-08T17:44:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165813.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.165813.log.gz 2023-10-08T17:44:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140361.log 2023-10-08T17:44:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139973.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139973.log.gz 2023-10-08T17:44:35.440 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138620.log 2023-10-08T17:44:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140361.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.140361.log.gz 2023-10-08T17:44:35.441 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168660.log 2023-10-08T17:44:35.442 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138620.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.138620.log.gz 2023-10-08T17:44:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144565.log 2023-10-08T17:44:35.443 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146244.log 2023-10-08T17:44:35.444 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.168660.log.gz 2023-10-08T17:44:35.444 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167175.log 2023-10-08T17:44:35.444 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144565.log.gz 2023-10-08T17:44:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146244.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146244.log.gz 2023-10-08T17:44:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165213.log 2023-10-08T17:44:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.167175.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.167175.log.gz 2023-10-08T17:44:35.446 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164787.log 2023-10-08T17:44:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165213.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165213.log.gz 2023-10-08T17:44:35.447 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128851.log 2023-10-08T17:44:35.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164787.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164787.log.gz 2023-10-08T17:44:35.448 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126405.log 2023-10-08T17:44:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128851.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128851.log.gz 2023-10-08T17:44:35.449 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157243.log 2023-10-08T17:44:35.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126405.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.126405.log.gz 2023-10-08T17:44:35.451 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131149.log 2023-10-08T17:44:35.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157243.log.gz 2023-10-08T17:44:35.452 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122494.log 2023-10-08T17:44:35.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131149.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.131149.log.gz 2023-10-08T17:44:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158384.log 2023-10-08T17:44:35.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122494.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122494.log.gz 2023-10-08T17:44:35.454 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135001.log 2023-10-08T17:44:35.455 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158384.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.158384.log.gz 2023-10-08T17:44:35.527 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130191.log 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135001.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.135001.log.gz 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127781.log 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130191.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.130191.log.gz 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125307.log 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127781.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.127781.log.gz 2023-10-08T17:44:35.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152676.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125307.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125307.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138216.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152676.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152676.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162853.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138216.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.138216.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160236.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162853.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.162853.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142366.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160236.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.160236.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.140872.log 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142366.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142366.log.gz 2023-10-08T17:44:35.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148377.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.140872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.140872.log.gz 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127274.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148377.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148377.log.gzgzip 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.173262.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127274.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127274.log.gz 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.146840.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173262.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173262.log.gz 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126153.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.146840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.146840.log.gz 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136441.log 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126153.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126153.log.gz 2023-10-08T17:44:35.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133837.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136441.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.136441.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157619.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133837.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.133837.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166180.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157619.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157619.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127528.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166180.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166180.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148977.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127528.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.127528.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.143867.log 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148977.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.148977.log.gz 2023-10-08T17:44:35.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125519.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.143867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.143867.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163380.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125519.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.125519.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122483.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.163380.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.163380.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158774.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122483.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122483.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122202.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158774.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158774.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134569.log 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122202.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122202.log.gz 2023-10-08T17:44:35.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158944.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134569.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134569.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122822.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158944.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158944.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143474.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122822.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122822.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126195.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143474.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.143474.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129431.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126195.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.126195.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126926.log 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129431.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129431.log.gz 2023-10-08T17:44:35.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144940.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126926.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126926.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134527.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144940.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.144940.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149636.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134527.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.134527.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143909.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149636.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149636.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141713.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143909.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.143909.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173666.log 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141713.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141713.log.gz 2023-10-08T17:44:35.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126069.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173666.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173666.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140023.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126069.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.126069.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166096.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.140023.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135213.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166096.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166096.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147943.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135213.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.135213.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133792.log 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147943.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147943.log.gz 2023-10-08T17:44:35.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142798.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133792.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.133792.log.gz 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143348.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142798.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.142798.log.gz 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164990.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143348.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143348.log.gz 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163990.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164990.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.164990.log.gz 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139843.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.163990.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163990.log.gz 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148080.log 2023-10-08T17:44:35.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139843.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.139843.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134653.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148080.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.148080.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123165.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134653.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134653.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158019.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123165.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123165.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173220.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158019.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.158019.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169984.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173220.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173220.log.gz 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161741.log 2023-10-08T17:44:35.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169984.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169984.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159154.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161741.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161741.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126884.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130401.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.159154.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126884.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126884.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130401.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130401.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158902.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143138.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158902.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.158902.log.gz 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149192.log 2023-10-08T17:44:35.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143138.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.143138.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140193.log 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149192.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.149192.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123798.log 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140193.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.140193.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143600.log 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123798.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123798.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169518.log 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136265.log 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.143600.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169518.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.169518.log.gz 2023-10-08T17:44:35.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173584.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136265.log: gzip -5 --verbose 88.4%-- -- replaced with /var/log/ceph/ceph-client.admin.136265.log.gz/var/log/ceph/ceph-client.admin.127655.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173584.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173584.log.gz 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127486.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127655.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.127655.log.gz 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140914.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127486.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127486.log.gz 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160428.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140914.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.140914.log.gz 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130359.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160428.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160428.log.gz 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123756.log 2023-10-08T17:44:35.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130359.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.130359.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166432.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123756.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.123756.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126363.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150313.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.166432.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126363.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126363.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172884.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150313.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.150313.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149486.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172884.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172884.log.gz 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146160.log 2023-10-08T17:44:35.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149486.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.149486.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131049.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146160.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.146160.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160329.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131049.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.131049.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134068.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160329.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160329.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157665.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134068.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.134068.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168474.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157665.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.157665.log.gz 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123882.log 2023-10-08T17:44:35.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168474.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168474.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142840.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123882.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123882.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121318.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142840.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142840.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148461.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121318.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121318.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157427.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148461.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148461.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142450.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157427.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157427.log.gz 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145973.log 2023-10-08T17:44:35.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142450.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.142450.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145235.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145973.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.145973.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149318.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145235.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145235.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148893.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149318.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.149318.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135645.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148893.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148893.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130527.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135645.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135645.log.gz 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135391.log 2023-10-08T17:44:35.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130527.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130527.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123504.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135391.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.135391.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157573.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123504.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.123504.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161993.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157573.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157573.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145667.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161993.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161993.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146412.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145667.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145667.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149957.log 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146412.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.146412.log.gz 2023-10-08T17:44:35.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135561.log 2023-10-08T17:44:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149957.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149957.log.gz 2023-10-08T17:44:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152422.log 2023-10-08T17:44:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135561.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.135561.log.gz 2023-10-08T17:44:35.584 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148691.log 2023-10-08T17:44:35.584 INFO:teuthology.orchestra.run.smithi029.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-08T17:44:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152422.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.152422.log.gz 2023-10-08T17:44:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144473.log 2023-10-08T17:44:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148691.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.148691.log.gz 2023-10-08T17:44:35.592 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165527.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144473.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144473.log.gz 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165527.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.165527.log.gz 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125475.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125391.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125475.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.125475.log.gz 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149108.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125391.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125391.log.gz 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161199.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149108.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.149108.log.gz 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170488.log 2023-10-08T17:44:35.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161199.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161199.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161358.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170488.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170488.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138856.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161358.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.161358.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128232.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138856.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.138856.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147405.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128232.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128232.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159112.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147405.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147405.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124611.log 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159112.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159112.log.gz 2023-10-08T17:44:35.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169246.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.124611.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124611.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164370.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169246.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.169246.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143432.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164370.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164370.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146496.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143432.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.143432.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157935.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146496.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146496.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162094.log 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.157935.log.gz 2023-10-08T17:44:35.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121484.log 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141850.log 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.162094.log.gz 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121484.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121484.log.gz 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123105.log 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.141850.log.gz 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171935.log 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123105.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123105.log.gz 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160188.log 2023-10-08T17:44:35.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171935.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171935.log.gz 2023-10-08T17:44:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161137.log 2023-10-08T17:44:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160188.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160188.log.gz 2023-10-08T17:44:35.598 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146539.log 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161137.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161137.log.gz 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169414.log 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146539.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.146539.log.gz 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134611.log 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169414.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169414.log.gz 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133666.log 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134611.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.134611.log.gz 2023-10-08T17:44:35.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160373.log 2023-10-08T17:44:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133666.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.133666.log.gz 2023-10-08T17:44:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134113.log 2023-10-08T17:44:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160373.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160373.log.gz 2023-10-08T17:44:35.600 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157196.log 2023-10-08T17:44:35.601 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134113.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134113.log.gz 2023-10-08T17:44:35.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143516.log 2023-10-08T17:44:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157196.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157196.log.gz 2023-10-08T17:44:35.602 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165423.log 2023-10-08T17:44:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143516.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143516.log.gz 2023-10-08T17:44:35.603 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164924.log 2023-10-08T17:44:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165423.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165423.log.gz 2023-10-08T17:44:35.604 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135435.log 2023-10-08T17:44:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164924.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164924.log.gz 2023-10-08T17:44:35.605 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171990.log 2023-10-08T17:44:35.606 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135435.log.gz 2023-10-08T17:44:35.606 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138573.log 2023-10-08T17:44:35.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171990.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171990.log.gz 2023-10-08T17:44:35.607 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164742.log 2023-10-08T17:44:35.608 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138573.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138573.log.gz 2023-10-08T17:44:35.608 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121610.log 2023-10-08T17:44:35.609 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164742.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164742.log.gz 2023-10-08T17:44:35.609 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127697.log 2023-10-08T17:44:35.610 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121610.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121610.log.gz 2023-10-08T17:44:35.610 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140151.log 2023-10-08T17:44:35.611 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127697.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.127697.log.gz 2023-10-08T17:44:35.611 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171417.log 2023-10-08T17:44:35.612 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140151.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140151.log.gz 2023-10-08T17:44:35.612 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138339.log 2023-10-08T17:44:35.613 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.171417.log.gz 2023-10-08T17:44:35.614 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152826.log 2023-10-08T17:44:35.614 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138339.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.138339.log.gz 2023-10-08T17:44:35.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152592.log 2023-10-08T17:44:35.615 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152826.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152826.log.gz 2023-10-08T17:44:35.616 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142324.log 2023-10-08T17:44:35.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152592.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.152592.log.gz 2023-10-08T17:44:35.617 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125561.log 2023-10-08T17:44:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142324.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.142324.log.gz 2023-10-08T17:44:35.618 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144752.log 2023-10-08T17:44:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125561.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.125561.log.gz 2023-10-08T17:44:35.619 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134779.log 2023-10-08T17:44:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144752.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.144752.log.gz 2023-10-08T17:44:35.620 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147489.log 2023-10-08T17:44:35.621 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134779.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.134779.log.gz 2023-10-08T17:44:35.621 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123672.log 2023-10-08T17:44:35.622 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147489.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.147489.log.gz 2023-10-08T17:44:35.622 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172080.log 2023-10-08T17:44:35.622 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123672.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123672.log.gz 2023-10-08T17:44:35.623 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140403.log 2023-10-08T17:44:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172080.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.172080.log.gz 2023-10-08T17:44:35.624 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161094.log 2023-10-08T17:44:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140403.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140403.log.gz 2023-10-08T17:44:35.625 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129491.log 2023-10-08T17:44:35.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161094.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161094.log.gz 2023-10-08T17:44:35.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128910.log 2023-10-08T17:44:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129491.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.129491.log.gz 2023-10-08T17:44:35.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158061.log 2023-10-08T17:44:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128910.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.128910.log.gz 2023-10-08T17:44:35.628 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163932.log 2023-10-08T17:44:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158061.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.158061.log.gz 2023-10-08T17:44:35.629 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145445.log 2023-10-08T17:44:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.163932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.163932.log.gz 2023-10-08T17:44:35.630 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138948.log 2023-10-08T17:44:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145445.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145445.log.gz 2023-10-08T17:44:35.631 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143222.log 2023-10-08T17:44:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138948.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.138948.log.gz 2023-10-08T17:44:35.632 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163422.log 2023-10-08T17:44:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143222.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.143222.log.gz 2023-10-08T17:44:35.633 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165605.log 2023-10-08T17:44:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.163422.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163422.log.gz 2023-10-08T17:44:35.634 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149528.log 2023-10-08T17:44:35.635 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165605.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165605.log.gz 2023-10-08T17:44:35.636 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152200.log 2023-10-08T17:44:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149528.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.149528.log.gz 2023-10-08T17:44:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171332.log 2023-10-08T17:44:35.637 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152200.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.152200.log.gz 2023-10-08T17:44:35.638 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143558.log 2023-10-08T17:44:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171332.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.171332.log.gz 2023-10-08T17:44:35.639 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152508.log 2023-10-08T17:44:35.640 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143558.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143558.log.gz 2023-10-08T17:44:35.640 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125054.log 2023-10-08T17:44:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152508.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.152508.log.gz 2023-10-08T17:44:35.641 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150839.log 2023-10-08T17:44:35.642 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125054.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125054.log.gz 2023-10-08T17:44:35.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128792.log 2023-10-08T17:44:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150839.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.150839.log.gz 2023-10-08T17:44:35.643 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149913.log 2023-10-08T17:44:35.644 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128792.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128792.log.gz 2023-10-08T17:44:35.644 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123462.log 2023-10-08T17:44:35.645 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149913.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.149913.log.gz 2023-10-08T17:44:35.645 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162437.log 2023-10-08T17:44:35.645 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.123462.log.gz 2023-10-08T17:44:35.646 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141002.log 2023-10-08T17:44:35.647 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162437.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162437.log.gz 2023-10-08T17:44:35.647 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122837.log 2023-10-08T17:44:35.648 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141002.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141002.log.gz 2023-10-08T17:44:35.648 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128969.log 2023-10-08T17:44:35.649 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122837.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122837.log.gz 2023-10-08T17:44:35.649 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170026.log 2023-10-08T17:44:35.650 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128969.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128969.log.gz 2023-10-08T17:44:35.650 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158594.log 2023-10-08T17:44:35.651 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170026.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170026.log.gz 2023-10-08T17:44:35.651 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172308.log 2023-10-08T17:44:35.652 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158594.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158594.log.gz 2023-10-08T17:44:35.652 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170915.log 2023-10-08T17:44:35.653 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172308.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172308.log.gz 2023-10-08T17:44:35.653 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130643.log 2023-10-08T17:44:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170915.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170915.log.gz 2023-10-08T17:44:35.654 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173346.log 2023-10-08T17:44:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130643.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130643.log.gz 2023-10-08T17:44:35.655 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173304.log 2023-10-08T17:44:35.656 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173346.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173346.log.gz 2023-10-08T17:44:35.656 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158145.log 2023-10-08T17:44:35.657 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173304.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.173304.log.gz 2023-10-08T17:44:35.657 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142882.log 2023-10-08T17:44:35.658 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135880.log 2023-10-08T17:44:35.658 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.158145.log.gz 2023-10-08T17:44:35.659 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142882.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142882.log.gz 2023-10-08T17:44:35.659 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166498.log 2023-10-08T17:44:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135880.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.135880.log.gz 2023-10-08T17:44:35.660 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158860.log 2023-10-08T17:44:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166498.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166498.log.gz 2023-10-08T17:44:35.661 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121950.log 2023-10-08T17:44:35.662 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158860.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158860.log.gz 2023-10-08T17:44:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166306.log 2023-10-08T17:44:35.663 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121950.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.121950.log.gz 2023-10-08T17:44:35.664 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121908.log 2023-10-08T17:44:35.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166306.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166306.log.gz 2023-10-08T17:44:35.665 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144986.log 2023-10-08T17:44:35.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121908.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121908.log.gz 2023-10-08T17:44:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171752.log 2023-10-08T17:44:35.666 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144986.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.144986.log.gz 2023-10-08T17:44:35.667 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165771.log 2023-10-08T17:44:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171752.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.171752.log.gz 2023-10-08T17:44:35.668 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161783.log 2023-10-08T17:44:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.165771.log.gz 2023-10-08T17:44:35.669 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166841.log 2023-10-08T17:44:35.670 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161783.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161783.log.gz 2023-10-08T17:44:35.670 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160967.log 2023-10-08T17:44:35.671 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166841.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166841.log.gz 2023-10-08T17:44:35.671 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140445.log 2023-10-08T17:44:35.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160967.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160967.log.gz 2023-10-08T17:44:35.672 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170194.log 2023-10-08T17:44:35.673 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140445.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.140445.log.gz 2023-10-08T17:44:35.673 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159497.log 2023-10-08T17:44:35.674 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170194.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.170194.log.gz 2023-10-08T17:44:35.674 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122831.log 2023-10-08T17:44:35.675 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159497.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159497.log.gz 2023-10-08T17:44:35.676 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160790.log 2023-10-08T17:44:35.676 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122831.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122831.log.gz 2023-10-08T17:44:35.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121225.log 2023-10-08T17:44:35.678 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160790.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160790.log.gz 2023-10-08T17:44:35.678 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150977.log 2023-10-08T17:44:35.679 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121225.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.121225.log.gz 2023-10-08T17:44:35.679 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123420.log 2023-10-08T17:44:35.680 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150977.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150977.log.gz 2023-10-08T17:44:35.680 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149570.log 2023-10-08T17:44:35.681 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123420.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123420.log.gz 2023-10-08T17:44:35.681 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144081.log 2023-10-08T17:44:35.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125139.log 2023-10-08T17:44:35.682 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.149570.log.gz 2023-10-08T17:44:35.683 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144081.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.144081.log.gz 2023-10-08T17:44:35.683 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146370.log 2023-10-08T17:44:35.684 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125139.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.125139.log.gz 2023-10-08T17:44:35.684 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125771.log 2023-10-08T17:44:35.685 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146370.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.146370.log.gz 2023-10-08T17:44:35.685 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122833.log 2023-10-08T17:44:35.686 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125771.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125771.log.gz 2023-10-08T17:44:35.687 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150931.log 2023-10-08T17:44:35.687 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122833.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122833.log.gz 2023-10-08T17:44:35.688 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126800.log 2023-10-08T17:44:35.689 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150931.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.150931.log.gz 2023-10-08T17:44:35.689 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166775.log 2023-10-08T17:44:35.690 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126800.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126800.log.gz 2023-10-08T17:44:35.690 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127402.log 2023-10-08T17:44:35.690 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166775.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166775.log.gz 2023-10-08T17:44:35.691 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151743.log 2023-10-08T17:44:35.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127402.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127402.log.gz 2023-10-08T17:44:35.692 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145923.log 2023-10-08T17:44:35.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151743.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151743.log.gz 2023-10-08T17:44:35.693 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135169.log 2023-10-08T17:44:35.694 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145923.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145923.log.gz 2023-10-08T17:44:35.694 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135349.log 2023-10-08T17:44:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135169.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135169.log.gz 2023-10-08T17:44:35.695 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165728.log 2023-10-08T17:44:35.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135349.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.135349.log.gz 2023-10-08T17:44:35.696 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.130149.log 2023-10-08T17:44:35.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170110.log 2023-10-08T17:44:35.697 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.165728.log.gz 2023-10-08T17:44:35.698 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130149.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.130149.log.gz 2023-10-08T17:44:35.698 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144030.log 2023-10-08T17:44:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170110.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.170110.log.gz 2023-10-08T17:44:35.699 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-08T17:44:35.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144030.log: gzip 88.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.144030.log.gz 2023-10-08T17:44:35.700 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.145751.log 2023-10-08T17:44:35.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134256.log 2023-10-08T17:44:35.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145751.log.gz 2023-10-08T17:44:35.702 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173624.log 2023-10-08T17:44:35.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134256.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134256.log.gz 2023-10-08T17:44:35.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122034.log 2023-10-08T17:44:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173624.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.173624.log.gz 2023-10-08T17:44:35.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128082.log 2023-10-08T17:44:35.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122034.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122034.log.gz 2023-10-08T17:44:35.706 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148419.log 2023-10-08T17:44:35.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.128082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.128082.log.gz 2023-10-08T17:44:35.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126716.log 2023-10-08T17:44:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.148419.log.gz 2023-10-08T17:44:35.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164645.log 2023-10-08T17:44:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126716.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.126716.log.gz 2023-10-08T17:44:35.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160282.log 2023-10-08T17:44:35.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164645.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164645.log.gz 2023-10-08T17:44:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145835.log 2023-10-08T17:44:35.711 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160282.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160282.log.gz 2023-10-08T17:44:35.712 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166390.log 2023-10-08T17:44:35.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145835.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.145835.log.gz 2023-10-08T17:44:35.713 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173178.log 2023-10-08T17:44:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166390.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.166390.log.gz 2023-10-08T17:44:35.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148629.log 2023-10-08T17:44:35.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173178.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173178.log.gz 2023-10-08T17:44:35.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-08T17:44:35.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148629.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.148629.log.gz 2023-10-08T17:44:35.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151305.log 2023-10-08T17:44:35.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166010.log 2023-10-08T17:44:35.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151305.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151305.log.gz 2023-10-08T17:44:35.720 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140571.log 2023-10-08T17:44:35.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151933.log 2023-10-08T17:44:35.721 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.166010.log.gz 2023-10-08T17:44:35.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140571.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.140571.log.gz 2023-10-08T17:44:35.723 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126758.log 2023-10-08T17:44:35.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.151933.log.gz 2023-10-08T17:44:35.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173052.log 2023-10-08T17:44:35.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126758.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.126758.log.gz 2023-10-08T17:44:35.726 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125687.log 2023-10-08T17:44:35.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138667.log 2023-10-08T17:44:35.727 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173052.log.gz 2023-10-08T17:44:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125687.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125687.log.gz 2023-10-08T17:44:35.728 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160925.log 2023-10-08T17:44:35.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139470.log 2023-10-08T17:44:35.730 INFO:teuthology.orchestra.run.smithi012.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.138667.log.gz 2023-10-08T17:44:35.731 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160925.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.160925.log.gz 2023-10-08T17:44:35.731 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135477.log 2023-10-08T17:44:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122502.log 2023-10-08T17:44:35.733 INFO:teuthology.orchestra.run.smithi012.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139470.log.gz 2023-10-08T17:44:35.733 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135477.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.135477.log.gz 2023-10-08T17:44:35.734 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164505.log 2023-10-08T17:44:35.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161571.log 2023-10-08T17:44:35.735 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.122502.log.gz 2023-10-08T17:44:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164505.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.164505.log.gz 2023-10-08T17:44:35.737 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130759.log 2023-10-08T17:44:35.738 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161571.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.161571.log.gz 2023-10-08T17:44:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161825.log 2023-10-08T17:44:35.739 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130759.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130759.log.gz 2023-10-08T17:44:35.740 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121866.log 2023-10-08T17:44:35.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173010.log 2023-10-08T17:44:35.742 INFO:teuthology.orchestra.run.smithi012.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161825.log.gz 2023-10-08T17:44:35.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121866.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121866.log.gz 2023-10-08T17:44:35.743 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172476.log 2023-10-08T17:44:35.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173010.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173010.log.gz 2023-10-08T17:44:35.744 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130933.log 2023-10-08T17:44:35.745 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172476.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172476.log.gz 2023-10-08T17:44:35.746 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144705.log 2023-10-08T17:44:35.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130933.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130933.log.gz 2023-10-08T17:44:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146202.log 2023-10-08T17:44:35.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.144705.log.gz 2023-10-08T17:44:35.749 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126632.log 2023-10-08T17:44:35.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146202.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.146202.log.gz 2023-10-08T17:44:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145277.log 2023-10-08T17:44:35.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126632.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.126632.log.gz 2023-10-08T17:44:35.752 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169942.log 2023-10-08T17:44:35.753 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145277.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.145277.log.gz 2023-10-08T17:44:35.754 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161951.log 2023-10-08T17:44:35.754 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169942.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169942.log.gz 2023-10-08T17:44:35.755 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122118.log 2023-10-08T17:44:35.756 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161951.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161951.log.gz 2023-10-08T17:44:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127612.log 2023-10-08T17:44:35.757 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122118.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.122118.log.gz 2023-10-08T17:44:35.758 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126321.log 2023-10-08T17:44:35.759 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145507.log 2023-10-08T17:44:35.760 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127612.log.gz 2023-10-08T17:44:35.760 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126321.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.126321.log.gz 2023-10-08T17:44:35.761 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122076.log 2023-10-08T17:44:35.762 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145507.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.145507.log.gz 2023-10-08T17:44:35.762 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121441.log 2023-10-08T17:44:35.764 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122076.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122076.log.gz 2023-10-08T17:44:35.764 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-08T17:44:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121441.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121441.log.gz 2023-10-08T17:44:35.765 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160518.log 2023-10-08T17:44:35.767 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122828.log 2023-10-08T17:44:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160518.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160518.log.gz 2023-10-08T17:44:35.769 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127889.log 2023-10-08T17:44:35.770 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122828.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.122828.log.gz 2023-10-08T17:44:35.770 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158103.log 2023-10-08T17:44:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127889.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.127889.log.gz 2023-10-08T17:44:35.772 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160833.log 2023-10-08T17:44:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158103.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.158103.log.gz 2023-10-08T17:44:35.773 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136378.log 2023-10-08T17:44:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160833.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160833.log.gz 2023-10-08T17:44:35.775 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123630.log 2023-10-08T17:44:35.776 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.136378.log.gz 2023-10-08T17:44:35.776 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122244.log 2023-10-08T17:44:35.778 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123630.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123630.log.gz 2023-10-08T17:44:35.778 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161443.log 2023-10-08T17:44:35.780 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122244.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.122244.log.gz 2023-10-08T17:44:35.780 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121782.log 2023-10-08T17:44:35.782 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161443.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161443.log.gz 2023-10-08T17:44:35.782 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126447.log 2023-10-08T17:44:35.782 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121782.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.121782.log.gz 2023-10-08T17:44:35.783 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127739.log 2023-10-08T17:44:35.785 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126447.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126447.log.gz 2023-10-08T17:44:35.785 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.153019.log 2023-10-08T17:44:35.786 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127739.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127739.log.gz 2023-10-08T17:44:35.787 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171614.log 2023-10-08T17:44:35.787 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.153019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.153019.log.gz 2023-10-08T17:44:35.788 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170572.log 2023-10-08T17:44:35.789 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171614.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171614.log.gz 2023-10-08T17:44:35.790 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125265.log 2023-10-08T17:44:35.792 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166222.log 2023-10-08T17:44:35.792 INFO:teuthology.orchestra.run.smithi012.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.170572.log.gz 2023-10-08T17:44:35.792 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125265.log.gz 2023-10-08T17:44:35.793 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160564.log 2023-10-08T17:44:35.794 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166222.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.166222.log.gz 2023-10-08T17:44:35.795 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121568.log 2023-10-08T17:44:35.796 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160564.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160564.log.gz 2023-10-08T17:44:35.796 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134841.log 2023-10-08T17:44:35.798 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121568.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.121568.log.gz 2023-10-08T17:44:35.798 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170965.log 2023-10-08T17:44:35.799 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134841.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.134841.log.gz 2023-10-08T17:44:35.799 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141648.log 2023-10-08T17:44:35.801 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170965.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170965.log.gz 2023-10-08T17:44:35.801 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139801.log 2023-10-08T17:44:35.803 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141648.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.141648.log.gz 2023-10-08T17:44:35.803 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123167.log 2023-10-08T17:44:35.804 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139801.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.139801.log.gz 2023-10-08T17:44:35.804 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161527.log 2023-10-08T17:44:35.806 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123167.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.123167.log.gz 2023-10-08T17:44:35.806 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151259.log 2023-10-08T17:44:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161527.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161527.log.gz 2023-10-08T17:44:35.807 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139759.log 2023-10-08T17:44:35.809 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151259.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151259.log.gz 2023-10-08T17:44:35.809 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165855.log 2023-10-08T17:44:35.810 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139759.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.139759.log.gz 2023-10-08T17:44:35.810 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125645.log 2023-10-08T17:44:35.812 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139218.log 2023-10-08T17:44:35.812 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.165855.log.gz 2023-10-08T17:44:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125645.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125645.log.gz 2023-10-08T17:44:35.813 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127823.log 2023-10-08T17:44:35.815 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139218.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.139218.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123173.log 2023-10-08T17:44:35.815 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:35.816 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143012.log 2023-10-08T17:44:35.817 INFO:teuthology.orchestra.run.smithi012.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.127823.log.gz 2023-10-08T17:44:35.818 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123173.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123173.log.gz 2023-10-08T17:44:35.818 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135729.log 2023-10-08T17:44:35.819 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143012.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143012.log.gz 2023-10-08T17:44:35.820 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151117.log 2023-10-08T17:44:35.821 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135729.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135729.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129259.log 2023-10-08T17:44:35.821 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:35.823 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151117.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.151117.log.gz 2023-10-08T17:44:35.823 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139344.log 2023-10-08T17:44:35.825 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129259.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129259.log.gzgzip 2023-10-08T17:44:35.825 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.170404.log 2023-10-08T17:44:35.826 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139344.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139344.log.gz 2023-10-08T17:44:35.826 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126279.log 2023-10-08T17:44:35.828 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170404.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.170404.log.gz 2023-10-08T17:44:35.828 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134211.log 2023-10-08T17:44:35.830 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126279.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.126279.log.gz 2023-10-08T17:44:35.830 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130275.log 2023-10-08T17:44:35.831 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134211.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.134211.log.gz 2023-10-08T17:44:35.831 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134919.log 2023-10-08T17:44:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130275.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130275.log.gz 2023-10-08T17:44:35.833 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147613.log 2023-10-08T17:44:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134919.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.134919.log.gz 2023-10-08T17:44:35.834 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152032.log 2023-10-08T17:44:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147613.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.147613.log.gz 2023-10-08T17:44:35.836 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128166.log 2023-10-08T17:44:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152032.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.152032.log.gz 2023-10-08T17:44:35.837 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150625.log 2023-10-08T17:44:35.839 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128166.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141083.log 2023-10-08T17:44:35.839 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128166.log.gz 2023-10-08T17:44:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150625.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150625.log.gz 2023-10-08T17:44:35.841 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147799.log 2023-10-08T17:44:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141083.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.141083.log.gz 2023-10-08T17:44:35.842 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164553.log 2023-10-08T17:44:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147799.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.147799.log.gz 2023-10-08T17:44:35.844 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171491.log 2023-10-08T17:44:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164553.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164553.log.gz 2023-10-08T17:44:35.845 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127010.log 2023-10-08T17:44:35.847 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136709.log 2023-10-08T17:44:35.847 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.171491.log.gz 2023-10-08T17:44:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127010.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.127010.log.gz 2023-10-08T17:44:35.849 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166691.log 2023-10-08T17:44:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.136709.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.136709.log.gz 2023-10-08T17:44:35.850 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159413.log 2023-10-08T17:44:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.166691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.166691.log.gz 2023-10-08T17:44:35.851 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121654.log 2023-10-08T17:44:35.852 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.159413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.159413.log.gz 2023-10-08T17:44:35.853 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122839.log 2023-10-08T17:44:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121654.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.121654.log.gz 2023-10-08T17:44:35.855 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142198.log 2023-10-08T17:44:35.856 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122839.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122839.log.gz 2023-10-08T17:44:35.857 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152116.log 2023-10-08T17:44:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142198.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.142198.log.gz 2023-10-08T17:44:35.858 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130585.log 2023-10-08T17:44:35.860 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152116.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.152116.log.gz 2023-10-08T17:44:35.860 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139717.log 2023-10-08T17:44:35.861 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130585.log: 88.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129345.log 2023-10-08T17:44:35.862 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130585.log.gz 2023-10-08T17:44:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139717.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.139717.log.gz 2023-10-08T17:44:35.863 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171706.log 2023-10-08T17:44:35.864 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129345.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129345.log.gz 2023-10-08T17:44:35.865 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115818.log 2023-10-08T17:44:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171706.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171706.log.gz 2023-10-08T17:44:35.866 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152074.log 2023-10-08T17:44:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.115818.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115818.log.gz 2023-10-08T17:44:35.868 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144803.log 2023-10-08T17:44:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152074.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.152074.log.gz 2023-10-08T17:44:35.869 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144126.log 2023-10-08T17:44:35.871 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144803.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.144803.log.gz-5 2023-10-08T17:44:35.871 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.151025.log 2023-10-08T17:44:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144126.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.144126.log.gz 2023-10-08T17:44:35.873 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159914.log 2023-10-08T17:44:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151025.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151025.log.gz 2023-10-08T17:44:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.115683.log 2023-10-08T17:44:35.875 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159914.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.159914.log.gz 2023-10-08T17:44:35.876 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138758.log 2023-10-08T17:44:35.877 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.115683.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.115683.log.gz 2023-10-08T17:44:35.878 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157382.log 2023-10-08T17:44:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138758.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138758.log.gz 2023-10-08T17:44:35.879 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165899.log 2023-10-08T17:44:35.881 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157382.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157382.log.gz 2023-10-08T17:44:35.881 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168260.log 2023-10-08T17:44:35.882 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165899.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165899.log.gz 2023-10-08T17:44:35.883 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147891.log 2023-10-08T17:44:35.884 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168260.log: gzip -5 88.9% -- replaced with /var/log/ceph/ceph-client.admin.168260.log.gz 2023-10-08T17:44:35.885 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.128674.log 2023-10-08T17:44:35.885 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147891.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.147891.log.gz 2023-10-08T17:44:35.886 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172926.log 2023-10-08T17:44:35.887 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128674.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128674.log.gz 2023-10-08T17:44:35.888 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150026.log 2023-10-08T17:44:35.890 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172926.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160610.log 2023-10-08T17:44:35.890 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172926.log.gz 2023-10-08T17:44:35.892 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150026.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.150026.log.gz 2023-10-08T17:44:35.892 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158204.log 2023-10-08T17:44:35.893 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160610.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.160610.log.gz 2023-10-08T17:44:35.893 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169720.log 2023-10-08T17:44:35.894 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158204.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158204.log.gz 2023-10-08T17:44:35.895 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146059.log 2023-10-08T17:44:35.896 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169720.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169720.log.gz 2023-10-08T17:44:35.896 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153277.log 2023-10-08T17:44:35.898 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146059.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.146059.log.gz 2023-10-08T17:44:35.898 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.122328.log 2023-10-08T17:44:35.899 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.153277.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.153277.log.gz 2023-10-08T17:44:35.900 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143390.log 2023-10-08T17:44:35.901 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122328.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.122328.log.gz 2023-10-08T17:44:35.902 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159070.log 2023-10-08T17:44:35.903 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143390.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.143390.log.gz 2023-10-08T17:44:35.903 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162160.log 2023-10-08T17:44:35.904 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159070.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.159070.log.gz 2023-10-08T17:44:35.905 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172034.log 2023-10-08T17:44:35.906 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162160.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162160.log.gz 2023-10-08T17:44:35.907 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151617.log 2023-10-08T17:44:35.908 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149444.log 2023-10-08T17:44:35.909 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151617.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.172034.log.gz 2023-10-08T17:44:35.910 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.151617.log.gz 2023-10-08T17:44:35.910 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168521.log 2023-10-08T17:44:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149444.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149444.log.gz 2023-10-08T17:44:35.911 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129388.log 2023-10-08T17:44:35.913 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172632.log 2023-10-08T17:44:35.914 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129388.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168521.log.gz 2023-10-08T17:44:35.914 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 87.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.129388.log.gz-- 2023-10-08T17:44:35.915 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138476.log 2023-10-08T17:44:35.916 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172632.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172632.log.gz 2023-10-08T17:44:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147660.log 2023-10-08T17:44:35.917 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138476.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.138476.log.gz 2023-10-08T17:44:35.918 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127570.log 2023-10-08T17:44:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147660.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.147660.log.gz 2023-10-08T17:44:35.920 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158468.log 2023-10-08T17:44:35.921 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127570.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.127570.log.gz 2023-10-08T17:44:35.922 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142282.log 2023-10-08T17:44:35.923 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158468.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158468.log.gz 2023-10-08T17:44:35.923 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166052.log 2023-10-08T17:44:35.925 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142282.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.142282.log.gz 2023-10-08T17:44:35.925 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152550.log 2023-10-08T17:44:35.927 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166052.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.166052.log.gz 2023-10-08T17:44:35.927 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145709.log 2023-10-08T17:44:35.927 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152550.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.152550.log.gz 2023-10-08T17:44:35.928 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140107.log 2023-10-08T17:44:35.929 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.145709.log.gz 2023-10-08T17:44:35.930 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146454.log 2023-10-08T17:44:35.932 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140107.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.140107.log.gz 2023-10-08T17:44:35.932 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148851.log 2023-10-08T17:44:35.933 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146454.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.146454.log.gz 2023-10-08T17:44:35.933 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127094.log 2023-10-08T17:44:35.935 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148851.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.148851.log.gz 2023-10-08T17:44:35.935 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139929.log 2023-10-08T17:44:35.936 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127094.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.127094.log.gz 2023-10-08T17:44:35.937 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164040.log 2023-10-08T17:44:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139929.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.139929.log.gz 2023-10-08T17:44:35.938 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173514.log 2023-10-08T17:44:35.939 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164040.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.164040.log.gz 2023-10-08T17:44:35.940 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148769.log 2023-10-08T17:44:35.941 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173514.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.173514.log.gz 2023-10-08T17:44:35.942 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148545.log 2023-10-08T17:44:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148769.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.148769.log.gz 2023-10-08T17:44:35.943 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161010.log 2023-10-08T17:44:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148545.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.148545.log.gz 2023-10-08T17:44:35.945 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152760.log 2023-10-08T17:44:35.946 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161010.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.161010.log.gz 2023-10-08T17:44:35.947 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171661.log 2023-10-08T17:44:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152760.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-08T17:44:35.949 INFO:teuthology.orchestra.run.smithi012.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.152760.log.gz 2023-10-08T17:44:35.949 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171661.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.171661.log.gz 2023-10-08T17:44:35.950 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170068.log 2023-10-08T17:44:35.952 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145361.log 2023-10-08T17:44:35.953 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170068.log: 89.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125223.log 2023-10-08T17:44:35.953 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.170068.log.gz 2023-10-08T17:44:35.955 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145361.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.145361.log.gz 2023-10-08T17:44:35.955 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159220.log 2023-10-08T17:44:35.956 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125223.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125223.log.gz 2023-10-08T17:44:35.956 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135127.log 2023-10-08T17:44:35.958 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159220.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.159220.log.gz 2023-10-08T17:44:35.959 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121698.log 2023-10-08T17:44:35.959 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135127.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.135127.log.gz 2023-10-08T17:44:35.960 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122832.log 2023-10-08T17:44:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121698.log.gz 2023-10-08T17:44:35.962 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173094.log 2023-10-08T17:44:35.966 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122832.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122832.log.gz 2023-10-08T17:44:35.966 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122838.log 2023-10-08T17:44:35.967 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173094.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173094.log.gz 2023-10-08T17:44:35.967 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157526.log 2023-10-08T17:44:35.967 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.122838.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122838.log.gz 2023-10-08T17:44:35.967 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146015.log 2023-10-08T17:44:35.969 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157526.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157526.log.gz 2023-10-08T17:44:35.969 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151793.log 2023-10-08T17:44:35.970 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146015.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.146015.log.gz 2023-10-08T17:44:35.970 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130443.log 2023-10-08T17:44:35.972 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151793.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.151793.log.gz 2023-10-08T17:44:35.972 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151701.log 2023-10-08T17:44:35.973 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130443.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130443.log.gz 2023-10-08T17:44:35.974 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168752.log 2023-10-08T17:44:35.975 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151701.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.151701.log.gz 2023-10-08T17:44:35.975 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148318.log 2023-10-08T17:44:35.977 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168752.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168752.log.gz 2023-10-08T17:44:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146328.log 2023-10-08T17:44:35.978 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148318.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.148318.log.gz 2023-10-08T17:44:35.979 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161052.log 2023-10-08T17:44:35.980 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146328.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.146328.log.gz 2023-10-08T17:44:35.981 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150715.log 2023-10-08T17:44:35.982 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161052.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161052.log.gz 2023-10-08T17:44:35.983 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157288.log 2023-10-08T17:44:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150715.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.150715.log.gz 2023-10-08T17:44:35.984 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128374.log 2023-10-08T17:44:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157288.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.157288.log.gz 2023-10-08T17:44:35.986 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165129.log 2023-10-08T17:44:35.987 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128374.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128374.log.gz 2023-10-08T17:44:35.988 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148935.log 2023-10-08T17:44:35.989 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165129.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165129.log.gz 2023-10-08T17:44:35.990 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.124970.log 2023-10-08T17:44:35.991 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148935.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.148935.log.gz 2023-10-08T17:44:35.992 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145193.log 2023-10-08T17:44:35.993 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.2.124970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.124970.log.gz 2023-10-08T17:44:35.993 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143054.log 2023-10-08T17:44:35.995 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145193.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.145193.log.gz 2023-10-08T17:44:35.996 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172350.log 2023-10-08T17:44:35.996 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143054.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.143054.log.gz 2023-10-08T17:44:35.997 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138902.log 2023-10-08T17:44:35.998 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172350.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172350.log.gz 2023-10-08T17:44:35.999 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129539.log 2023-10-08T17:44:36.001 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138902.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124008.log 2023-10-08T17:44:36.001 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.138902.log.gz 2023-10-08T17:44:36.002 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129539.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121108.log 2023-10-08T17:44:36.002 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129539.log.gz 2023-10-08T17:44:36.004 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.124008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141948.log 91.0% -- replaced with /var/log/ceph/ceph-client.admin.124008.log.gz 2023-10-08T17:44:36.004 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.005 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121108.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.121108.log.gz 2023-10-08T17:44:36.005 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132899.log 2023-10-08T17:44:36.007 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141948.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.141948.log.gz 2023-10-08T17:44:36.008 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147844.log 2023-10-08T17:44:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.132899.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.132899.log.gz 2023-10-08T17:44:36.009 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170446.log 2023-10-08T17:44:36.011 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147844.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.147844.log.gz 2023-10-08T17:44:36.011 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141758.log 2023-10-08T17:44:36.012 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170446.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.170446.log.gz 2023-10-08T17:44:36.012 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149019.log 2023-10-08T17:44:36.014 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141758.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.141758.log.gz 2023-10-08T17:44:36.015 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125603.log 2023-10-08T17:44:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149019.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149019.log.gz 2023-10-08T17:44:36.016 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123175.log 2023-10-08T17:44:36.018 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125603.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125603.log.gz 2023-10-08T17:44:36.018 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.149829.log 2023-10-08T17:44:36.019 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123175.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.123175.log.gz 2023-10-08T17:44:36.019 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139260.log 2023-10-08T17:44:36.020 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.149829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.149829.log.gz 2023-10-08T17:44:36.022 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150886.log 2023-10-08T17:44:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139260.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139260.log.gz 2023-10-08T17:44:36.023 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166888.log 2023-10-08T17:44:36.024 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.150886.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.150886.log.gz 2023-10-08T17:44:36.025 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134320.log 2023-10-08T17:44:36.026 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.166888.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.166888.log.gz 2023-10-08T17:44:36.027 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149234.log 2023-10-08T17:44:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134320.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.134320.log.gz 2023-10-08T17:44:36.029 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126842.log 2023-10-08T17:44:36.030 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149234.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149234.log.gz 2023-10-08T17:44:36.031 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-08T17:44:36.032 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126842.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.126842.log.gz 2023-10-08T17:44:36.033 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145403.log 2023-10-08T17:44:36.034 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131899.log 2023-10-08T17:44:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145403.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145403.log.gz 2023-10-08T17:44:36.036 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159610.log 2023-10-08T17:44:36.038 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.131899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138525.log 2023-10-08T17:44:36.039 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159610.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131899.log.gz 2023-10-08T17:44:36.039 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159610.log.gz 2023-10-08T17:44:36.041 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115413.log 2023-10-08T17:44:36.042 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138525.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.138525.log.gz 2023-10-08T17:44:36.042 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158816.log 2023-10-08T17:44:36.044 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.115413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144896.log 2023-10-08T17:44:36.045 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158816.log: 87.5% 92.2% -- replaced with /var/log/ceph/ceph-client.admin.115413.log.gz 2023-10-08T17:44:36.046 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.158816.log.gz 2023-10-08T17:44:36.047 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127444.log 2023-10-08T17:44:36.049 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.144896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135603.log 2023-10-08T17:44:36.050 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127444.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.144896.log.gz 2023-10-08T17:44:36.050 INFO:teuthology.orchestra.run.smithi012.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127444.log.gz 2023-10-08T17:44:36.051 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162395.log 2023-10-08T17:44:36.053 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168612.log 2023-10-08T17:44:36.054 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162395.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.135603.log.gz 2023-10-08T17:44:36.054 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.162395.log.gz 2023-10-08T17:44:36.055 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169898.log 2023-10-08T17:44:36.057 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168795.log 2023-10-08T17:44:36.058 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169898.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168612.log.gz 2023-10-08T17:44:36.059 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169898.log.gz 2023-10-08T17:44:36.060 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151855.log 2023-10-08T17:44:36.061 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168795.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.168795.log.gz 2023-10-08T17:44:36.062 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121399.log 2023-10-08T17:44:36.063 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133976.log 2023-10-08T17:44:36.064 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.151855.log.gz 2023-10-08T17:44:36.065 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121399.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121399.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149402.log 2023-10-08T17:44:36.065 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129130.log 2023-10-08T17:44:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149402.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.149402.log.gz 2023-10-08T17:44:36.068 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.133976.log.gz 2023-10-08T17:44:36.070 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160141.log 2023-10-08T17:44:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129130.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.129130.log.gz 2023-10-08T17:44:36.071 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159455.log 2023-10-08T17:44:36.073 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141805.log 2023-10-08T17:44:36.074 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.159455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160141.log.gz 2023-10-08T17:44:36.075 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159455.log.gz 2023-10-08T17:44:36.076 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130701.log 2023-10-08T17:44:36.077 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141805.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141805.log.gz 2023-10-08T17:44:36.078 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171892.log 2023-10-08T17:44:36.079 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126674.log 2023-10-08T17:44:36.080 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130701.log.gz 2023-10-08T17:44:36.082 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135307.log 2023-10-08T17:44:36.082 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5%/var/log/ceph/ceph-client.admin.126674.log: -- replaced with /var/log/ceph/ceph-client.admin.171892.log.gz 2023-10-08T17:44:36.083 INFO:teuthology.orchestra.run.smithi012.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.126674.log.gz 2023-10-08T17:44:36.084 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121992.log 2023-10-08T17:44:36.086 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147705.log 2023-10-08T17:44:36.087 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.121992.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121992.log.gz 2023-10-08T17:44:36.087 INFO:teuthology.orchestra.run.smithi012.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135307.log.gz 2023-10-08T17:44:36.088 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142240.log 2023-10-08T17:44:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.147705.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.147705.log.gz 2023-10-08T17:44:36.090 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147447.log 2023-10-08T17:44:36.092 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134166.log 2023-10-08T17:44:36.093 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142240.log: /var/log/ceph/ceph-client.admin.147447.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.142240.log.gz 2023-10-08T17:44:36.093 INFO:teuthology.orchestra.run.smithi012.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.147447.log.gz 2023-10-08T17:44:36.094 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160013.log 2023-10-08T17:44:36.096 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.134166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173430.log 2023-10-08T17:44:36.097 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.160013.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.134166.log.gz 2023-10-08T17:44:36.097 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.160013.log.gz 2023-10-08T17:44:36.098 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125813.log 2023-10-08T17:44:36.100 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.173430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148152.log 2023-10-08T17:44:36.102 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125813.log: 88.7% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.173430.log.gz -- replaced with /var/log/ceph/ceph-client.admin.125813.log.gz 2023-10-08T17:44:36.102 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.103 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130991.log 2023-10-08T17:44:36.104 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.148152.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.148152.log.gz 2023-10-08T17:44:36.105 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172392.log 2023-10-08T17:44:36.107 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169854.log 2023-10-08T17:44:36.108 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172392.log: 88.3% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.130991.log.gz 2023-10-08T17:44:36.108 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172392.log.gz 2023-10-08T17:44:36.109 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138810.log 2023-10-08T17:44:36.111 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133399.log 2023-10-08T17:44:36.112 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.138810.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138810.log.gz 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169854.log.gz 2023-10-08T17:44:36.113 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.113 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126968.log 2023-10-08T17:44:36.116 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.133399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164878.log 2023-10-08T17:44:36.117 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126968.log: 87.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126968.log.gz 2023-10-08T17:44:36.117 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.133399.log.gz 2023-10-08T17:44:36.118 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170362.log 2023-10-08T17:44:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164878.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164878.log.gz 2023-10-08T17:44:36.120 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123588.log 2023-10-08T17:44:36.122 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140235.log 2023-10-08T17:44:36.122 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170362.log.gz 2023-10-08T17:44:36.124 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169003.log 2023-10-08T17:44:36.125 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140235.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123588.log.gz 2023-10-08T17:44:36.125 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.140235.log.gz 2023-10-08T17:44:36.126 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130317.log 2023-10-08T17:44:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169003.log.gz 2023-10-08T17:44:36.128 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142554.log 2023-10-08T17:44:36.130 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140529.log 2023-10-08T17:44:36.132 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142554.log: 87.5% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.142554.log.gz 2023-10-08T17:44:36.132 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130317.log.gz 2023-10-08T17:44:36.133 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142926.log 2023-10-08T17:44:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140529.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.140529.log.gz 2023-10-08T17:44:36.134 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169372.log 2023-10-08T17:44:36.137 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157071.log 2023-10-08T17:44:36.138 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169372.log: 87.9% 87.0% -- replaced with /var/log/ceph/ceph-client.admin.142926.log.gz 2023-10-08T17:44:36.138 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.169372.log.gz 2023-10-08T17:44:36.139 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143306.log 2023-10-08T17:44:36.141 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.157071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170320.log 2023-10-08T17:44:36.142 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143306.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157071.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143306.log.gz 2023-10-08T17:44:36.142 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.144 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139011.log 2023-10-08T17:44:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170320.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170320.log.gz 2023-10-08T17:44:36.145 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125012.log 2023-10-08T17:44:36.147 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123169.log 2023-10-08T17:44:36.148 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.139011.log.gz 2023-10-08T17:44:36.150 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125012.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.125012.log.gz 2023-10-08T17:44:36.150 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165297.log 2023-10-08T17:44:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.123169.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123169.log.gz 2023-10-08T17:44:36.151 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170278.log 2023-10-08T17:44:36.153 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135922.log 2023-10-08T17:44:36.154 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170278.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165297.log.gz 2023-10-08T17:44:36.154 INFO:teuthology.orchestra.run.smithi012.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170278.log.gz 2023-10-08T17:44:36.156 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139540.log 2023-10-08T17:44:36.157 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.135922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152466.log 2023-10-08T17:44:36.159 INFO:teuthology.orchestra.run.smithi012.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.135922.log.gz 2023-10-08T17:44:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139540.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.139540.log.gz 2023-10-08T17:44:36.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128297.log 2023-10-08T17:44:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152466.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.152466.log.gz 2023-10-08T17:44:36.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139176.log 2023-10-08T17:44:36.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158732.log 2023-10-08T17:44:36.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.139176.log: 87.7% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.139176.log.gz 2023-10-08T17:44:36.165 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128297.log.gz 2023-10-08T17:44:36.166 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130485.log 2023-10-08T17:44:36.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158732.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158732.log.gz 2023-10-08T17:44:36.170 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129216.log 2023-10-08T17:44:36.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.130485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129302.log 2023-10-08T17:44:36.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129216.log: 88.8% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.130485.log.gz 2023-10-08T17:44:36.171 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129216.log.gz 2023-10-08T17:44:36.172 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161657.log 2023-10-08T17:44:36.174 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.129302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143674.log 2023-10-08T17:44:36.175 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161657.log: 88.2% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.161657.log.gz 2023-10-08T17:44:36.176 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129302.log.gz 2023-10-08T17:44:36.177 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151070.log 2023-10-08T17:44:36.178 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143674.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.143674.log.gz 2023-10-08T17:44:36.179 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164688.log 2023-10-08T17:44:36.181 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.151070.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128615.log 2023-10-08T17:44:36.181 INFO:teuthology.orchestra.run.smithi012.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.151070.log.gz 2023-10-08T17:44:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.164688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126237.log 2023-10-08T17:44:36.183 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128615.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.164688.log.gz 2023-10-08T17:44:36.184 INFO:teuthology.orchestra.run.smithi012.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.128615.log.gz 2023-10-08T17:44:36.185 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165171.log 2023-10-08T17:44:36.187 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.126237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170152.log 2023-10-08T17:44:36.188 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165171.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126237.log.gz 2023-10-08T17:44:36.188 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.165171.log.gz 2023-10-08T17:44:36.189 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172256.log 2023-10-08T17:44:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170152.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.170152.log.gz 2023-10-08T17:44:36.191 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151481.log 2023-10-08T17:44:36.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171096.log 2023-10-08T17:44:36.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151481.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172256.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151481.log.gz 2023-10-08T17:44:36.194 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.196 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172125.log 2023-10-08T17:44:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.171096.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.171096.log.gz 2023-10-08T17:44:36.197 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170831.log 2023-10-08T17:44:36.199 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.172125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132149.log 2023-10-08T17:44:36.200 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.0.170831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.170831.log.gz 2023-10-08T17:44:36.200 INFO:teuthology.orchestra.run.smithi012.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172125.log.gz 2023-10-08T17:44:36.202 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143180.log 2023-10-08T17:44:36.203 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.132149.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.132149.log.gz 2023-10-08T17:44:36.203 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145319.log 2023-10-08T17:44:36.205 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.143180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151659.log 2023-10-08T17:44:36.206 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145319.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.143180.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.145319.log.gz 2023-10-08T17:44:36.206 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.208 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127182.log 2023-10-08T17:44:36.209 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151659.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.151659.log.gz 2023-10-08T17:44:36.209 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142057.log 2023-10-08T17:44:36.210 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.127182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165381.log 2023-10-08T17:44:36.211 INFO:teuthology.orchestra.run.smithi012.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.127182.log.gz 2023-10-08T17:44:36.213 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165339.log 2023-10-08T17:44:36.213 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165381.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.142057.log.gz 2023-10-08T17:44:36.214 INFO:teuthology.orchestra.run.smithi012.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165381.log.gz 2023-10-08T17:44:36.215 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158552.log 2023-10-08T17:44:36.217 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161615.log 2023-10-08T17:44:36.218 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158552.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165339.log.gz 2023-10-08T17:44:36.218 INFO:teuthology.orchestra.run.smithi012.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.158552.log.gz 2023-10-08T17:44:36.220 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146647.log 2023-10-08T17:44:36.221 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.161615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142408.log 2023-10-08T17:44:36.222 INFO:teuthology.orchestra.run.smithi012.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161615.log.gz 2023-10-08T17:44:36.223 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165465.log 2023-10-08T17:44:36.224 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142408.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.146647.log.gz 2023-10-08T17:44:36.225 INFO:teuthology.orchestra.run.smithi012.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.142408.log.gz 2023-10-08T17:44:36.226 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149150.log 2023-10-08T17:44:36.228 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.165465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146882.log 2023-10-08T17:44:36.229 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149150.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165465.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.149150.log.gz 2023-10-08T17:44:36.229 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.231 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158986.log 2023-10-08T17:44:36.232 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.146882.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.146882.log.gz 2023-10-08T17:44:36.232 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152338.log 2023-10-08T17:44:36.234 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.158986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169812.log 2023-10-08T17:44:36.235 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.152338.log: 88.4% 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158986.log.gz -- replaced with /var/log/ceph/ceph-client.admin.152338.log.gz 2023-10-08T17:44:36.235 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.237 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169456.log 2023-10-08T17:44:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169812.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.169812.log.gz 2023-10-08T17:44:36.238 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125985.log 2023-10-08T17:44:36.240 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.169456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168350.log 2023-10-08T17:44:36.242 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.125985.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.125985.log.gz 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169456.log.gz 2023-10-08T17:44:36.242 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:36.243 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145793.log 2023-10-08T17:44:36.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.168350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170236.log 2023-10-08T17:44:36.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145793.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.168350.log.gz 2023-10-08T17:44:36.246 INFO:teuthology.orchestra.run.smithi012.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.145793.log.gz 2023-10-08T17:44:36.248 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151533.log 2023-10-08T17:44:36.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.170236.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.170236.log.gz 2023-10-08T17:44:36.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135687.log 2023-10-08T17:44:36.251 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142632.log 2023-10-08T17:44:36.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.151533.log: /var/log/ceph/ceph-client.admin.135687.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151533.log.gz 2023-10-08T17:44:36.252 INFO:teuthology.orchestra.run.smithi012.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.135687.log.gz 2023-10-08T17:44:36.253 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141903.log 2023-10-08T17:44:36.255 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.142632.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-08T17:44:36.256 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141903.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.142632.log.gz 2023-10-08T17:44:36.256 INFO:teuthology.orchestra.run.smithi012.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.141903.log.gz 2023-10-08T17:44:36.257 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162628.log 2023-10-08T17:44:36.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141387.log 2023-10-08T17:44:36.260 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.162628.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.162628.log.gz 2023-10-08T17:44:36.262 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149276.log 2023-10-08T17:44:36.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.141387.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.141387.log.gz 2023-10-08T17:44:36.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140277.log 2023-10-08T17:44:36.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.149276.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.149276.log.gz 2023-10-08T17:44:36.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128124.log 2023-10-08T17:44:36.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.140277.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.140277.log.gz 2023-10-08T17:44:36.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145879.log 2023-10-08T17:44:36.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.128124.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.128124.log.gz 2023-10-08T17:44:36.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.145879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.145879.log.gz 2023-10-08T17:44:37.000 INFO:teuthology.orchestra.run.smithi029.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-08T17:44:37.072 INFO:teuthology.orchestra.run.smithi029.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-08T17:44:37.113 INFO:teuthology.orchestra.run.smithi012.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-08T17:44:37.850 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-08T17:44:38.003 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-08T17:44:38.004 INFO:teuthology.orchestra.run.smithi029.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-08T17:44:38.141 INFO:teuthology.orchestra.run.smithi012.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-08T17:44:38.379 INFO:teuthology.orchestra.run.smithi012.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-08T17:44:38.509 INFO:teuthology.orchestra.run.smithi029.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-08T17:44:38.513 INFO:teuthology.orchestra.run.smithi029.stderr: 2023-10-08T17:44:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:real 0m3.304s 2023-10-08T17:44:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:user 0m14.166s 2023-10-08T17:44:38.513 INFO:teuthology.orchestra.run.smithi029.stderr:sys 0m1.296s 2023-10-08T17:44:38.717 INFO:teuthology.orchestra.run.smithi012.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-08T17:44:39.239 INFO:teuthology.orchestra.run.smithi012.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-08T17:44:39.557 INFO:teuthology.orchestra.run.smithi012.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-08T17:44:40.229 INFO:teuthology.orchestra.run.smithi012.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-08T17:44:40.232 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-10-08T17:44:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m5.028s 2023-10-08T17:44:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:user 0m19.207s 2023-10-08T17:44:40.232 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m3.353s 2023-10-08T17:44:40.233 INFO:tasks.ceph:Archiving logs... 2023-10-08T17:44:40.233 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi012/log 2023-10-08T17:44:40.234 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T17:44:43.115 DEBUG:teuthology.misc:Transferring archived files from smithi029:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi029/log 2023-10-08T17:44:43.116 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-08T17:44:44.844 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-08T17:44:44.859 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-08T17:44:44.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T17:44:44.865 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-08T17:44:44.981 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-08T17:44:44.991 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-08T17:44:44.991 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T17:44:44.996 DEBUG:teuthology.orchestra.run.smithi029:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-08T17:44:45.027 INFO:teuthology.orchestra.run.smithi012.stderr:bash: ntpq: command not found 2023-10-08T17:44:45.032 INFO:teuthology.orchestra.run.smithi029.stderr:bash: ntpq: command not found 2023-10-08T17:44:45.033 INFO:teuthology.orchestra.run.smithi012.stdout:210 Number of sources = 4 2023-10-08T17:44:45.033 INFO:teuthology.orchestra.run.smithi012.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T17:44:45.033 INFO:teuthology.orchestra.run.smithi012.stdout:=============================================================================== 2023-10-08T17:44:45.034 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 50 +21us[ +21us] +/- 92ms 2023-10-08T17:44:45.034 INFO:teuthology.orchestra.run.smithi012.stdout:^* hv02.front.sepia.ceph.com 3 7 377 55 -267us[ -265us] +/- 59ms 2023-10-08T17:44:45.034 INFO:teuthology.orchestra.run.smithi012.stdout:^+ hv03.front.sepia.ceph.com 3 9 377 237 +296us[ +292us] +/- 71ms 2023-10-08T17:44:45.034 INFO:teuthology.orchestra.run.smithi012.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:210 Number of sources = 4 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:=============================================================================== 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +38us[ +31us] +/- 91ms 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -273us[ -279us] +/- 59ms 2023-10-08T17:44:45.038 INFO:teuthology.orchestra.run.smithi029.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 49 +303us[ +303us] +/- 74ms 2023-10-08T17:44:45.039 INFO:teuthology.orchestra.run.smithi029.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-10-08T17:44:45.039 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-08T17:44:45.049 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-08T17:44:45.049 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-08T17:44:45.081 DEBUG:teuthology.orchestra.run.smithi012:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T17:44:45.187 DEBUG:teuthology.orchestra.run.smithi029:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-08T17:44:45.358 DEBUG:teuthology.orchestra.run.smithi012:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T17:44:45.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:44:45.423 DEBUG:teuthology.orchestra.run.smithi029:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-08T17:44:45.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:44:45.492 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-08T17:44:45.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-08T17:44:45.550 INFO:teuthology.task.internal:Duration was 6672.250929 seconds 2023-10-08T17:44:45.550 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-08T17:44:45.599 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-08T17:44:45.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T17:44:45.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-08T17:44:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T17:44:45.718 INFO:teuthology.orchestra.run.smithi029.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-08T17:44:46.047 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-08T17:44:46.047 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-10-08T17:44:46.047 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T17:44:46.099 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi029.front.sepia.ceph.com 2023-10-08T17:44:46.099 DEBUG:teuthology.orchestra.run.smithi029:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-08T17:44:46.152 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-08T17:44:46.152 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T17:44:46.157 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-08T17:44:46.240 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-08T17:44:46.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T17:44:46.245 DEBUG:teuthology.orchestra.run.smithi029:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-08T17:44:46.386 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-08T17:44:46.458 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-08T17:44:46.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T17:44:46.521 DEBUG:teuthology.orchestra.run.smithi029:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-08T17:44:46.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-08T17:44:46.600 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T17:44:46.604 DEBUG:teuthology.orchestra.run.smithi029:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-08T17:44:46.661 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-10-08T17:44:46.666 INFO:teuthology.orchestra.run.smithi029.stdout:kernel.core_pattern = core 2023-10-08T17:44:46.702 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T17:44:46.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:44:46.737 DEBUG:teuthology.orchestra.run.smithi029:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-08T17:44:46.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-08T17:44:46.772 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-08T17:44:46.785 INFO:teuthology.task.internal:Transferring archived files... 2023-10-08T17:44:46.786 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi012 2023-10-08T17:44:46.786 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T17:44:46.857 DEBUG:teuthology.misc:Transferring archived files from smithi029:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299/remote/smithi029 2023-10-08T17:44:46.857 DEBUG:teuthology.orchestra.run.smithi029:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-08T17:44:46.930 INFO:teuthology.task.internal:Removing archive directory... 2023-10-08T17:44:46.930 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T17:44:46.935 DEBUG:teuthology.orchestra.run.smithi029:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-08T17:44:46.971 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-08T17:44:46.983 INFO:teuthology.task.internal:Not uploading archives. 2023-10-08T17:44:46.983 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-08T17:44:47.014 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-08T17:44:47.014 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T17:44:47.018 DEBUG:teuthology.orchestra.run.smithi029:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-08T17:44:47.051 INFO:teuthology.orchestra.run.smithi012.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 17:44 /home/ubuntu/cephtest 2023-10-08T17:44:47.055 INFO:teuthology.orchestra.run.smithi029.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 8 17:44 /home/ubuntu/cephtest 2023-10-08T17:44:47.058 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-08T17:44:47.070 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-08T17:44:47.161 INFO:teuthology.nuke:Checking targets against current locks 2023-10-08T17:44:47.189 DEBUG:teuthology.nuke:shortname: smithi012 2023-10-08T17:44:47.190 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T17:44:47.213 DEBUG:teuthology.nuke:shortname: smithi029 2023-10-08T17:44:47.213 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-08T17:44:47.216 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:39.832299', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJSkqEekuv48eEViEh/hZX5CTaaT7iF+B/2QetvIcodglzyMmHjjeTQrGGJ0mfaWgRgghq4SWSW5oD7HokWaGKI='} 2023-10-08T17:44:47.237 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi029.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-08_15:41:30-fs-wip-yuri-testing-2023-10-06-0949-quincy-distro-default-smithi/7418299', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-08 15:43:39.833820', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlrEluFPAewIEV+F/mxYeLr3pAqlh5o5h8DmueNzXHleLpXz6BOCyvMVla7cIzyZi/+j9wnJXYXUmGsYTDq2d0='} 2023-10-08T17:44:47.270 INFO:teuthology.orchestra.console.smithi012:Power off 2023-10-08T17:44:47.271 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T17:44:47.292 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-10-08T17:44:47.292 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:47.307 INFO:teuthology.orchestra.console.smithi029:Power off 2023-10-08T17:44:47.308 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-08T17:44:47.317 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-08T17:44:47.330 DEBUG:teuthology.orchestra.console.smithi029:power off output: Chassis Power Control: Down/Off 2023-10-08T17:44:47.330 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:47.353 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-08T17:44:51.319 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:51.354 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:51.428 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-10-08T17:44:51.465 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is on 2023-10-08T17:44:55.430 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:55.466 DEBUG:teuthology.orchestra.console.smithi029:pexpect command: ipmitool -H smithi029.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-08T17:44:55.541 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-10-08T17:44:55.576 DEBUG:teuthology.orchestra.console.smithi029:check power output: Chassis Power is off 2023-10-08T17:44:55.642 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-10-08T17:44:55.677 INFO:teuthology.orchestra.console.smithi029:Power off completed 2023-10-08T17:44:55.782 INFO:teuthology.run:Summary data: client.0-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c client.1-kernel-sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 6672.250929355621 failure_reason: '"1696782211.2099319 mon.a (mon.0) 604 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-08T17:44:55.782 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-08T17:44:55.873 INFO:teuthology.run:FAIL